[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 13:04:43.225006 15057 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.14.180.126:38717
I20260709 13:04:43.227188 15057 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 13:04:43.228463 15057 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:43.246342 15064 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:43.246346 15066 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:43.248591 15057 server_base.cc:1061] running on GCE node
W20260709 13:04:43.247140 15063 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:44.471585 15057 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:44.471876 15057 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:44.472038 15057 hybrid_clock.cc:648] HybridClock initialized: now 1783602284472021 us; error 0 us; skew 500 ppm
I20260709 13:04:44.472954 15057 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:44.480862 15057 webserver.cc:533] Webserver started at http://127.14.180.126:46391/ using document root <none> and password file <none>
I20260709 13:04:44.481832 15057 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:44.482066 15057 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:44.482515 15057 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:44.489843 15057 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602283040513-15057-0/minicluster-data/master-0-root/instance:
uuid: "a92ac421eeaf45c095d67c0da5276217"
format_stamp: "Formatted at 2026-07-09 13:04:44 on dist-test-slave-r9m8"
I20260709 13:04:44.498718 15057 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.007s	sys 0.001s
I20260709 13:04:44.504884 15072 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:44.506330 15057 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.005s	sys 0.001s
I20260709 13:04:44.506778 15057 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602283040513-15057-0/minicluster-data/master-0-root
uuid: "a92ac421eeaf45c095d67c0da5276217"
format_stamp: "Formatted at 2026-07-09 13:04:44 on dist-test-slave-r9m8"
I20260709 13:04:44.507166 15057 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602283040513-15057-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602283040513-15057-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602283040513-15057-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:44.571480 15057 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:44.573050 15057 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 13:04:44.573520 15057 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:44.649667 15057 rpc_server.cc:307] RPC server started. Bound to: 127.14.180.126:38717
I20260709 13:04:44.649767 15123 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.180.126:38717 every 8 connection(s)
I20260709 13:04:44.658447 15124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:44.681207 15124 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a92ac421eeaf45c095d67c0da5276217: Bootstrap starting.
I20260709 13:04:44.687568 15124 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a92ac421eeaf45c095d67c0da5276217: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:44.689596 15124 log.cc:826] T 00000000000000000000000000000000 P a92ac421eeaf45c095d67c0da5276217: Log is configured to *not* fsync() on all Append() calls
I20260709 13:04:44.694670 15124 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a92ac421eeaf45c095d67c0da5276217: No bootstrap required, opened a new log
I20260709 13:04:44.715619 15124 raft_consensus.cc:359] T 00000000000000000000000000000000 P a92ac421eeaf45c095d67c0da5276217 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a92ac421eeaf45c095d67c0da5276217" member_type: VOTER }
I20260709 13:04:44.716203 15124 raft_consensus.cc:385] T 00000000000000000000000000000000 P a92ac421eeaf45c095d67c0da5276217 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:44.716509 15124 raft_consensus.cc:740] T 00000000000000000000000000000000 P a92ac421eeaf45c095d67c0da5276217 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a92ac421eeaf45c095d67c0da5276217, State: Initialized, Role: FOLLOWER
I20260709 13:04:44.717655 15124 consensus_queue.cc:260] T 00000000000000000000000000000000 P a92ac421eeaf45c095d67c0da5276217 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a92ac421eeaf45c095d67c0da5276217" member_type: VOTER }
I20260709 13:04:44.718204 15124 raft_consensus.cc:399] T 00000000000000000000000000000000 P a92ac421eeaf45c095d67c0da5276217 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:04:44.718529 15124 raft_consensus.cc:493] T 00000000000000000000000000000000 P a92ac421eeaf45c095d67c0da5276217 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:04:44.718922 15124 raft_consensus.cc:3060] T 00000000000000000000000000000000 P a92ac421eeaf45c095d67c0da5276217 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:44.723258 15124 raft_consensus.cc:515] T 00000000000000000000000000000000 P a92ac421eeaf45c095d67c0da5276217 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a92ac421eeaf45c095d67c0da5276217" member_type: VOTER }
I20260709 13:04:44.724187 15124 leader_election.cc:304] T 00000000000000000000000000000000 P a92ac421eeaf45c095d67c0da5276217 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a92ac421eeaf45c095d67c0da5276217; no voters: 
I20260709 13:04:44.726064 15124 leader_election.cc:290] T 00000000000000000000000000000000 P a92ac421eeaf45c095d67c0da5276217 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:04:44.726478 15127 raft_consensus.cc:2804] T 00000000000000000000000000000000 P a92ac421eeaf45c095d67c0da5276217 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:44.729471 15127 raft_consensus.cc:697] T 00000000000000000000000000000000 P a92ac421eeaf45c095d67c0da5276217 [term 1 LEADER]: Becoming Leader. State: Replica: a92ac421eeaf45c095d67c0da5276217, State: Running, Role: LEADER
I20260709 13:04:44.730537 15127 consensus_queue.cc:237] T 00000000000000000000000000000000 P a92ac421eeaf45c095d67c0da5276217 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a92ac421eeaf45c095d67c0da5276217" member_type: VOTER }
I20260709 13:04:44.731716 15124 sys_catalog.cc:565] T 00000000000000000000000000000000 P a92ac421eeaf45c095d67c0da5276217 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:04:44.742771 15128 sys_catalog.cc:455] T 00000000000000000000000000000000 P a92ac421eeaf45c095d67c0da5276217 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a92ac421eeaf45c095d67c0da5276217" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a92ac421eeaf45c095d67c0da5276217" member_type: VOTER } }
I20260709 13:04:44.743491 15128 sys_catalog.cc:458] T 00000000000000000000000000000000 P a92ac421eeaf45c095d67c0da5276217 [sys.catalog]: This master's current role is: LEADER
I20260709 13:04:44.746088 15129 sys_catalog.cc:455] T 00000000000000000000000000000000 P a92ac421eeaf45c095d67c0da5276217 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a92ac421eeaf45c095d67c0da5276217. Latest consensus state: current_term: 1 leader_uuid: "a92ac421eeaf45c095d67c0da5276217" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a92ac421eeaf45c095d67c0da5276217" member_type: VOTER } }
I20260709 13:04:44.746838 15129 sys_catalog.cc:458] T 00000000000000000000000000000000 P a92ac421eeaf45c095d67c0da5276217 [sys.catalog]: This master's current role is: LEADER
I20260709 13:04:44.747917 15136 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:04:44.762495 15136 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:04:44.764974 15057 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:04:44.780594 15136 catalog_manager.cc:1383] Generated new cluster ID: 65039f7b724446ed9388d105a17f60a6
I20260709 13:04:44.780965 15136 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:04:44.800431 15136 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:04:44.802129 15136 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:04:44.821465 15136 catalog_manager.cc:6070] T 00000000000000000000000000000000 P a92ac421eeaf45c095d67c0da5276217: Generated new TSK 0
I20260709 13:04:44.822535 15136 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:04:44.832701 15057 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:44.843227 15146 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:44.846803 15147 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:44.850708 15057 server_base.cc:1061] running on GCE node
W20260709 13:04:44.850679 15149 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:44.851886 15057 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:44.852264 15057 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:44.852485 15057 hybrid_clock.cc:648] HybridClock initialized: now 1783602284852464 us; error 0 us; skew 500 ppm
I20260709 13:04:44.853264 15057 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:44.858233 15057 webserver.cc:533] Webserver started at http://127.14.180.65:38835/ using document root <none> and password file <none>
I20260709 13:04:44.858950 15057 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:44.859203 15057 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:44.859512 15057 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:44.860733 15057 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602283040513-15057-0/minicluster-data/ts-0-root/instance:
uuid: "6c27090ad71542bca01248b778ff440b"
format_stamp: "Formatted at 2026-07-09 13:04:44 on dist-test-slave-r9m8"
I20260709 13:04:44.867916 15057 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:04:44.873358 15154 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:44.874447 15057 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:04:44.875061 15057 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602283040513-15057-0/minicluster-data/ts-0-root
uuid: "6c27090ad71542bca01248b778ff440b"
format_stamp: "Formatted at 2026-07-09 13:04:44 on dist-test-slave-r9m8"
I20260709 13:04:44.875442 15057 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602283040513-15057-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602283040513-15057-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602283040513-15057-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:44.896788 15057 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:44.898288 15057 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:44.901286 15057 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:44.906370 15057 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:44.906648 15057 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:04:44.906965 15057 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:44.907167 15057 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:45.024904 15057 rpc_server.cc:307] RPC server started. Bound to: 127.14.180.65:39863
I20260709 13:04:45.025015 15216 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.180.65:39863 every 8 connection(s)
I20260709 13:04:45.032632 15057 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:45.042263 15221 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:45.048637 15222 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:45.054085 15057 server_base.cc:1061] running on GCE node
W20260709 13:04:45.054365 15225 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:45.057040 15057 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:45.057317 15057 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:45.057523 15057 hybrid_clock.cc:648] HybridClock initialized: now 1783602285057504 us; error 0 us; skew 500 ppm
I20260709 13:04:45.058156 15057 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:45.061690 15057 webserver.cc:533] Webserver started at http://127.14.180.66:37113/ using document root <none> and password file <none>
I20260709 13:04:45.062283 15057 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:45.062541 15057 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:45.062985 15057 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:45.064582 15057 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602283040513-15057-0/minicluster-data/ts-1-root/instance:
uuid: "a0c7b7a30fcf412c85264c0ed126fede"
format_stamp: "Formatted at 2026-07-09 13:04:45 on dist-test-slave-r9m8"
I20260709 13:04:45.068435 15217 heartbeater.cc:344] Connected to a master server at 127.14.180.126:38717
I20260709 13:04:45.069003 15217 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:45.070348 15217 heartbeater.cc:507] Master 127.14.180.126:38717 requested a full tablet report, sending...
I20260709 13:04:45.072456 15057 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.005s	sys 0.003s
I20260709 13:04:45.074043 15089 ts_manager.cc:194] Registered new tserver with Master: 6c27090ad71542bca01248b778ff440b (127.14.180.65:39863)
I20260709 13:04:45.076762 15089 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54828
I20260709 13:04:45.078485 15229 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:45.080272 15057 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.001s	sys 0.002s
I20260709 13:04:45.080646 15057 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602283040513-15057-0/minicluster-data/ts-1-root
uuid: "a0c7b7a30fcf412c85264c0ed126fede"
format_stamp: "Formatted at 2026-07-09 13:04:45 on dist-test-slave-r9m8"
I20260709 13:04:45.080984 15057 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602283040513-15057-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602283040513-15057-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602283040513-15057-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:45.099040 15057 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:45.100466 15057 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:45.102728 15057 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:45.105747 15057 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:45.106010 15057 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:45.106288 15057 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:45.106484 15057 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:45.215687 15057 rpc_server.cc:307] RPC server started. Bound to: 127.14.180.66:33371
I20260709 13:04:45.215958 15291 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.180.66:33371 every 8 connection(s)
I20260709 13:04:45.226992 15057 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:45.237006 15295 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:45.238984 15296 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:45.240473 15292 heartbeater.cc:344] Connected to a master server at 127.14.180.126:38717
I20260709 13:04:45.241037 15292 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:45.242455 15292 heartbeater.cc:507] Master 127.14.180.126:38717 requested a full tablet report, sending...
I20260709 13:04:45.246901 15089 ts_manager.cc:194] Registered new tserver with Master: a0c7b7a30fcf412c85264c0ed126fede (127.14.180.66:33371)
I20260709 13:04:45.248900 15089 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54840
I20260709 13:04:45.249137 15057 server_base.cc:1061] running on GCE node
W20260709 13:04:45.249574 15298 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:45.250934 15057 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:45.251211 15057 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:45.251418 15057 hybrid_clock.cc:648] HybridClock initialized: now 1783602285251400 us; error 0 us; skew 500 ppm
I20260709 13:04:45.252166 15057 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:45.255260 15057 webserver.cc:533] Webserver started at http://127.14.180.67:34049/ using document root <none> and password file <none>
I20260709 13:04:45.255771 15057 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:45.256008 15057 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:45.256284 15057 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:45.257447 15057 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602283040513-15057-0/minicluster-data/ts-2-root/instance:
uuid: "766aab97368b4169b07e508f36c4c0fb"
format_stamp: "Formatted at 2026-07-09 13:04:45 on dist-test-slave-r9m8"
I20260709 13:04:45.262532 15057 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.002s
I20260709 13:04:45.266477 15303 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:45.267520 15057 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:04:45.267858 15057 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602283040513-15057-0/minicluster-data/ts-2-root
uuid: "766aab97368b4169b07e508f36c4c0fb"
format_stamp: "Formatted at 2026-07-09 13:04:45 on dist-test-slave-r9m8"
I20260709 13:04:45.268188 15057 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602283040513-15057-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602283040513-15057-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602283040513-15057-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:45.281944 15057 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:45.283463 15057 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:45.285296 15057 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:45.288787 15057 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:45.289044 15057 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:45.289314 15057 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:45.289508 15057 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:45.386890 15057 rpc_server.cc:307] RPC server started. Bound to: 127.14.180.67:42585
I20260709 13:04:45.387004 15365 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.180.67:42585 every 8 connection(s)
I20260709 13:04:45.406147 15366 heartbeater.cc:344] Connected to a master server at 127.14.180.126:38717
I20260709 13:04:45.406662 15366 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:45.407481 15366 heartbeater.cc:507] Master 127.14.180.126:38717 requested a full tablet report, sending...
I20260709 13:04:45.409844 15089 ts_manager.cc:194] Registered new tserver with Master: 766aab97368b4169b07e508f36c4c0fb (127.14.180.67:42585)
I20260709 13:04:45.410293 15057 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.018060931s
I20260709 13:04:45.411767 15089 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54854
I20260709 13:04:45.470919 15089 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54858:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:04:45.474840 15089 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:04:45.600193 15179 tablet_service.cc:1511] Processing CreateTablet for tablet b88f6a525ac24e259e1331eaaa2f41ac (DEFAULT_TABLE table=test-workload [id=e37d64f9cc454bce93a70faa85f33eb6]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:04:45.602105 15179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b88f6a525ac24e259e1331eaaa2f41ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:45.602982 15256 tablet_service.cc:1511] Processing CreateTablet for tablet 550f6b32ce5349e4a632e926d5a452de (DEFAULT_TABLE table=test-workload [id=e37d64f9cc454bce93a70faa85f33eb6]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:04:45.604601 15256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 550f6b32ce5349e4a632e926d5a452de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:45.600411 15257 tablet_service.cc:1511] Processing CreateTablet for tablet c61fe875afff40e39c03b36e7266e263 (DEFAULT_TABLE table=test-workload [id=e37d64f9cc454bce93a70faa85f33eb6]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:04:45.607640 15257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c61fe875afff40e39c03b36e7266e263. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:45.615392 15182 tablet_service.cc:1511] Processing CreateTablet for tablet c61fe875afff40e39c03b36e7266e263 (DEFAULT_TABLE table=test-workload [id=e37d64f9cc454bce93a70faa85f33eb6]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:04:45.615939 15254 tablet_service.cc:1511] Processing CreateTablet for tablet b88f6a525ac24e259e1331eaaa2f41ac (DEFAULT_TABLE table=test-workload [id=e37d64f9cc454bce93a70faa85f33eb6]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:04:45.617017 15182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c61fe875afff40e39c03b36e7266e263. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:45.617559 15254 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b88f6a525ac24e259e1331eaaa2f41ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:45.629208 15178 tablet_service.cc:1511] Processing CreateTablet for tablet a7555eadc3bb496bb07b3cc6515fa680 (DEFAULT_TABLE table=test-workload [id=e37d64f9cc454bce93a70faa85f33eb6]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:04:45.625355 15180 tablet_service.cc:1511] Processing CreateTablet for tablet e85d1b0d46a9459a863728eb3bb432c3 (DEFAULT_TABLE table=test-workload [id=e37d64f9cc454bce93a70faa85f33eb6]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:04:45.632447 15255 tablet_service.cc:1511] Processing CreateTablet for tablet e85d1b0d46a9459a863728eb3bb432c3 (DEFAULT_TABLE table=test-workload [id=e37d64f9cc454bce93a70faa85f33eb6]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:04:45.632988 15253 tablet_service.cc:1511] Processing CreateTablet for tablet a7555eadc3bb496bb07b3cc6515fa680 (DEFAULT_TABLE table=test-workload [id=e37d64f9cc454bce93a70faa85f33eb6]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:04:45.635627 15177 tablet_service.cc:1511] Processing CreateTablet for tablet d2a5b790ba6449afa2d539eb54aa63d5 (DEFAULT_TABLE table=test-workload [id=e37d64f9cc454bce93a70faa85f33eb6]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:04:45.622390 15181 tablet_service.cc:1511] Processing CreateTablet for tablet 550f6b32ce5349e4a632e926d5a452de (DEFAULT_TABLE table=test-workload [id=e37d64f9cc454bce93a70faa85f33eb6]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:04:45.635563 15255 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e85d1b0d46a9459a863728eb3bb432c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:45.641613 15252 tablet_service.cc:1511] Processing CreateTablet for tablet d2a5b790ba6449afa2d539eb54aa63d5 (DEFAULT_TABLE table=test-workload [id=e37d64f9cc454bce93a70faa85f33eb6]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:04:45.639235 15178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7555eadc3bb496bb07b3cc6515fa680. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:45.645272 15253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7555eadc3bb496bb07b3cc6515fa680. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:45.649936 15180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e85d1b0d46a9459a863728eb3bb432c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:45.651547 15177 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2a5b790ba6449afa2d539eb54aa63d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:45.652737 15252 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2a5b790ba6449afa2d539eb54aa63d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:45.653535 15181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 550f6b32ce5349e4a632e926d5a452de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:45.685385 15329 tablet_service.cc:1511] Processing CreateTablet for tablet e85d1b0d46a9459a863728eb3bb432c3 (DEFAULT_TABLE table=test-workload [id=e37d64f9cc454bce93a70faa85f33eb6]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:04:45.693804 15330 tablet_service.cc:1511] Processing CreateTablet for tablet 550f6b32ce5349e4a632e926d5a452de (DEFAULT_TABLE table=test-workload [id=e37d64f9cc454bce93a70faa85f33eb6]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:04:45.673467 15326 tablet_service.cc:1511] Processing CreateTablet for tablet d2a5b790ba6449afa2d539eb54aa63d5 (DEFAULT_TABLE table=test-workload [id=e37d64f9cc454bce93a70faa85f33eb6]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:04:45.694761 15328 tablet_service.cc:1511] Processing CreateTablet for tablet b88f6a525ac24e259e1331eaaa2f41ac (DEFAULT_TABLE table=test-workload [id=e37d64f9cc454bce93a70faa85f33eb6]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:04:45.696436 15327 tablet_service.cc:1511] Processing CreateTablet for tablet a7555eadc3bb496bb07b3cc6515fa680 (DEFAULT_TABLE table=test-workload [id=e37d64f9cc454bce93a70faa85f33eb6]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:04:45.697513 15330 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 550f6b32ce5349e4a632e926d5a452de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:45.692482 15331 tablet_service.cc:1511] Processing CreateTablet for tablet c61fe875afff40e39c03b36e7266e263 (DEFAULT_TABLE table=test-workload [id=e37d64f9cc454bce93a70faa85f33eb6]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:04:45.702185 15176 tablet_service.cc:1511] Processing CreateTablet for tablet 5b125feea68040eeb559e4bfa093536c (DEFAULT_TABLE table=test-workload [id=e37d64f9cc454bce93a70faa85f33eb6]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:04:45.710798 15327 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7555eadc3bb496bb07b3cc6515fa680. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:45.717530 15325 tablet_service.cc:1511] Processing CreateTablet for tablet 5b125feea68040eeb559e4bfa093536c (DEFAULT_TABLE table=test-workload [id=e37d64f9cc454bce93a70faa85f33eb6]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:04:45.726776 15176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b125feea68040eeb559e4bfa093536c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:45.715927 15251 tablet_service.cc:1511] Processing CreateTablet for tablet 5b125feea68040eeb559e4bfa093536c (DEFAULT_TABLE table=test-workload [id=e37d64f9cc454bce93a70faa85f33eb6]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:04:45.742796 15329 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e85d1b0d46a9459a863728eb3bb432c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:45.759341 15251 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b125feea68040eeb559e4bfa093536c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:45.767891 15175 tablet_service.cc:1511] Processing CreateTablet for tablet 9f79381ee9024a9e985aab93d98359e5 (DEFAULT_TABLE table=test-workload [id=e37d64f9cc454bce93a70faa85f33eb6]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:04:45.774202 15325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b125feea68040eeb559e4bfa093536c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:04:45.777431 15137 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:45.777662 15175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f79381ee9024a9e985aab93d98359e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:45.777629 15331 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c61fe875afff40e39c03b36e7266e263. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:45.782990 15326 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2a5b790ba6449afa2d539eb54aa63d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:45.787673 15384 tablet_bootstrap.cc:492] T c61fe875afff40e39c03b36e7266e263 P a0c7b7a30fcf412c85264c0ed126fede: Bootstrap starting.
I20260709 13:04:45.799258 15328 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b88f6a525ac24e259e1331eaaa2f41ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:45.806883 15257 tablet_service.cc:1511] Processing CreateTablet for tablet 9f79381ee9024a9e985aab93d98359e5 (DEFAULT_TABLE table=test-workload [id=e37d64f9cc454bce93a70faa85f33eb6]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:04:45.808358 15257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f79381ee9024a9e985aab93d98359e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:45.844372 15324 tablet_service.cc:1511] Processing CreateTablet for tablet 9f79381ee9024a9e985aab93d98359e5 (DEFAULT_TABLE table=test-workload [id=e37d64f9cc454bce93a70faa85f33eb6]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:04:45.851330 15324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f79381ee9024a9e985aab93d98359e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:45.871852 15385 tablet_bootstrap.cc:492] T b88f6a525ac24e259e1331eaaa2f41ac P 6c27090ad71542bca01248b778ff440b: Bootstrap starting.
I20260709 13:04:45.884271 15179 tablet_service.cc:1511] Processing CreateTablet for tablet 4f665c7b3caa440fa5664a96decac188 (DEFAULT_TABLE table=test-workload [id=e37d64f9cc454bce93a70faa85f33eb6]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:04:45.886154 15179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f665c7b3caa440fa5664a96decac188. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:45.927762 15386 tablet_bootstrap.cc:492] T c61fe875afff40e39c03b36e7266e263 P 766aab97368b4169b07e508f36c4c0fb: Bootstrap starting.
I20260709 13:04:45.931098 15384 tablet_bootstrap.cc:654] T c61fe875afff40e39c03b36e7266e263 P a0c7b7a30fcf412c85264c0ed126fede: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:45.937693 15385 tablet_bootstrap.cc:654] T b88f6a525ac24e259e1331eaaa2f41ac P 6c27090ad71542bca01248b778ff440b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:45.956526 15254 tablet_service.cc:1511] Processing CreateTablet for tablet 4f665c7b3caa440fa5664a96decac188 (DEFAULT_TABLE table=test-workload [id=e37d64f9cc454bce93a70faa85f33eb6]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:04:45.957940 15254 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f665c7b3caa440fa5664a96decac188. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:45.979809 15330 tablet_service.cc:1511] Processing CreateTablet for tablet 4f665c7b3caa440fa5664a96decac188 (DEFAULT_TABLE table=test-workload [id=e37d64f9cc454bce93a70faa85f33eb6]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:04:45.981194 15330 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f665c7b3caa440fa5664a96decac188. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:45.995914 15386 tablet_bootstrap.cc:654] T c61fe875afff40e39c03b36e7266e263 P 766aab97368b4169b07e508f36c4c0fb: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:46.004623 15385 tablet_bootstrap.cc:492] T b88f6a525ac24e259e1331eaaa2f41ac P 6c27090ad71542bca01248b778ff440b: No bootstrap required, opened a new log
I20260709 13:04:46.006768 15385 ts_tablet_manager.cc:1403] T b88f6a525ac24e259e1331eaaa2f41ac P 6c27090ad71542bca01248b778ff440b: Time spent bootstrapping tablet: real 0.163s	user 0.021s	sys 0.000s
I20260709 13:04:46.011947 15384 tablet_bootstrap.cc:492] T c61fe875afff40e39c03b36e7266e263 P a0c7b7a30fcf412c85264c0ed126fede: No bootstrap required, opened a new log
I20260709 13:04:46.012475 15384 ts_tablet_manager.cc:1403] T c61fe875afff40e39c03b36e7266e263 P a0c7b7a30fcf412c85264c0ed126fede: Time spent bootstrapping tablet: real 0.236s	user 0.038s	sys 0.022s
I20260709 13:04:46.017637 15386 tablet_bootstrap.cc:492] T c61fe875afff40e39c03b36e7266e263 P 766aab97368b4169b07e508f36c4c0fb: No bootstrap required, opened a new log
I20260709 13:04:46.018987 15386 ts_tablet_manager.cc:1403] T c61fe875afff40e39c03b36e7266e263 P 766aab97368b4169b07e508f36c4c0fb: Time spent bootstrapping tablet: real 0.092s	user 0.016s	sys 0.003s
I20260709 13:04:46.017565 15384 raft_consensus.cc:359] T c61fe875afff40e39c03b36e7266e263 P a0c7b7a30fcf412c85264c0ed126fede [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } } peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } }
I20260709 13:04:46.020053 15384 raft_consensus.cc:385] T c61fe875afff40e39c03b36e7266e263 P a0c7b7a30fcf412c85264c0ed126fede [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:46.022763 15384 raft_consensus.cc:740] T c61fe875afff40e39c03b36e7266e263 P a0c7b7a30fcf412c85264c0ed126fede [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0c7b7a30fcf412c85264c0ed126fede, State: Initialized, Role: FOLLOWER
I20260709 13:04:46.023784 15384 consensus_queue.cc:260] T c61fe875afff40e39c03b36e7266e263 P a0c7b7a30fcf412c85264c0ed126fede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } } peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } }
I20260709 13:04:46.026402 15386 raft_consensus.cc:359] T c61fe875afff40e39c03b36e7266e263 P 766aab97368b4169b07e508f36c4c0fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } } peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } }
I20260709 13:04:46.027192 15386 raft_consensus.cc:385] T c61fe875afff40e39c03b36e7266e263 P 766aab97368b4169b07e508f36c4c0fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:46.024323 15385 raft_consensus.cc:359] T b88f6a525ac24e259e1331eaaa2f41ac P 6c27090ad71542bca01248b778ff440b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:46.027488 15386 raft_consensus.cc:740] T c61fe875afff40e39c03b36e7266e263 P 766aab97368b4169b07e508f36c4c0fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 766aab97368b4169b07e508f36c4c0fb, State: Initialized, Role: FOLLOWER
I20260709 13:04:46.027603 15385 raft_consensus.cc:385] T b88f6a525ac24e259e1331eaaa2f41ac P 6c27090ad71542bca01248b778ff440b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:46.028002 15385 raft_consensus.cc:740] T b88f6a525ac24e259e1331eaaa2f41ac P 6c27090ad71542bca01248b778ff440b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c27090ad71542bca01248b778ff440b, State: Initialized, Role: FOLLOWER
I20260709 13:04:46.028337 15386 consensus_queue.cc:260] T c61fe875afff40e39c03b36e7266e263 P 766aab97368b4169b07e508f36c4c0fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } } peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } }
I20260709 13:04:46.028775 15385 consensus_queue.cc:260] T b88f6a525ac24e259e1331eaaa2f41ac P 6c27090ad71542bca01248b778ff440b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:46.036254 15292 heartbeater.cc:499] Master 127.14.180.126:38717 was elected leader, sending a full tablet report...
I20260709 13:04:46.037185 15384 ts_tablet_manager.cc:1434] T c61fe875afff40e39c03b36e7266e263 P a0c7b7a30fcf412c85264c0ed126fede: Time spent starting tablet: real 0.024s	user 0.012s	sys 0.003s
I20260709 13:04:46.038941 15384 tablet_bootstrap.cc:492] T 550f6b32ce5349e4a632e926d5a452de P a0c7b7a30fcf412c85264c0ed126fede: Bootstrap starting.
I20260709 13:04:46.040086 15217 heartbeater.cc:499] Master 127.14.180.126:38717 was elected leader, sending a full tablet report...
I20260709 13:04:46.043798 15366 heartbeater.cc:499] Master 127.14.180.126:38717 was elected leader, sending a full tablet report...
I20260709 13:04:46.044382 15386 ts_tablet_manager.cc:1434] T c61fe875afff40e39c03b36e7266e263 P 766aab97368b4169b07e508f36c4c0fb: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.015s
I20260709 13:04:46.045411 15386 tablet_bootstrap.cc:492] T 5b125feea68040eeb559e4bfa093536c P 766aab97368b4169b07e508f36c4c0fb: Bootstrap starting.
I20260709 13:04:46.046458 15385 ts_tablet_manager.cc:1434] T b88f6a525ac24e259e1331eaaa2f41ac P 6c27090ad71542bca01248b778ff440b: Time spent starting tablet: real 0.039s	user 0.005s	sys 0.008s
I20260709 13:04:46.047497 15385 tablet_bootstrap.cc:492] T c61fe875afff40e39c03b36e7266e263 P 6c27090ad71542bca01248b778ff440b: Bootstrap starting.
I20260709 13:04:46.052699 15386 tablet_bootstrap.cc:654] T 5b125feea68040eeb559e4bfa093536c P 766aab97368b4169b07e508f36c4c0fb: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:46.055104 15385 tablet_bootstrap.cc:654] T c61fe875afff40e39c03b36e7266e263 P 6c27090ad71542bca01248b778ff440b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:46.067056 15385 tablet_bootstrap.cc:492] T c61fe875afff40e39c03b36e7266e263 P 6c27090ad71542bca01248b778ff440b: No bootstrap required, opened a new log
I20260709 13:04:46.067274 15390 raft_consensus.cc:493] T c61fe875afff40e39c03b36e7266e263 P a0c7b7a30fcf412c85264c0ed126fede [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:46.067631 15385 ts_tablet_manager.cc:1403] T c61fe875afff40e39c03b36e7266e263 P 6c27090ad71542bca01248b778ff440b: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.008s
I20260709 13:04:46.067795 15390 raft_consensus.cc:515] T c61fe875afff40e39c03b36e7266e263 P a0c7b7a30fcf412c85264c0ed126fede [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } } peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } }
I20260709 13:04:46.071723 15390 leader_election.cc:290] T c61fe875afff40e39c03b36e7266e263 P a0c7b7a30fcf412c85264c0ed126fede [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 766aab97368b4169b07e508f36c4c0fb (127.14.180.67:42585), 6c27090ad71542bca01248b778ff440b (127.14.180.65:39863)
I20260709 13:04:46.079769 15385 raft_consensus.cc:359] T c61fe875afff40e39c03b36e7266e263 P 6c27090ad71542bca01248b778ff440b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } } peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } }
I20260709 13:04:46.080588 15385 raft_consensus.cc:385] T c61fe875afff40e39c03b36e7266e263 P 6c27090ad71542bca01248b778ff440b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:46.080899 15385 raft_consensus.cc:740] T c61fe875afff40e39c03b36e7266e263 P 6c27090ad71542bca01248b778ff440b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c27090ad71542bca01248b778ff440b, State: Initialized, Role: FOLLOWER
I20260709 13:04:46.081651 15385 consensus_queue.cc:260] T c61fe875afff40e39c03b36e7266e263 P 6c27090ad71542bca01248b778ff440b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } } peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } }
I20260709 13:04:46.084705 15385 ts_tablet_manager.cc:1434] T c61fe875afff40e39c03b36e7266e263 P 6c27090ad71542bca01248b778ff440b: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 13:04:46.085599 15386 tablet_bootstrap.cc:492] T 5b125feea68040eeb559e4bfa093536c P 766aab97368b4169b07e508f36c4c0fb: No bootstrap required, opened a new log
I20260709 13:04:46.085717 15385 tablet_bootstrap.cc:492] T 9f79381ee9024a9e985aab93d98359e5 P 6c27090ad71542bca01248b778ff440b: Bootstrap starting.
I20260709 13:04:46.086135 15386 ts_tablet_manager.cc:1403] T 5b125feea68040eeb559e4bfa093536c P 766aab97368b4169b07e508f36c4c0fb: Time spent bootstrapping tablet: real 0.041s	user 0.018s	sys 0.005s
I20260709 13:04:46.088099 15384 tablet_bootstrap.cc:654] T 550f6b32ce5349e4a632e926d5a452de P a0c7b7a30fcf412c85264c0ed126fede: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:46.091373 15386 raft_consensus.cc:359] T 5b125feea68040eeb559e4bfa093536c P 766aab97368b4169b07e508f36c4c0fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:46.092176 15386 raft_consensus.cc:385] T 5b125feea68040eeb559e4bfa093536c P 766aab97368b4169b07e508f36c4c0fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:46.092520 15386 raft_consensus.cc:740] T 5b125feea68040eeb559e4bfa093536c P 766aab97368b4169b07e508f36c4c0fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 766aab97368b4169b07e508f36c4c0fb, State: Initialized, Role: FOLLOWER
I20260709 13:04:46.093143 15385 tablet_bootstrap.cc:654] T 9f79381ee9024a9e985aab93d98359e5 P 6c27090ad71542bca01248b778ff440b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:46.093441 15386 consensus_queue.cc:260] T 5b125feea68040eeb559e4bfa093536c P 766aab97368b4169b07e508f36c4c0fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:46.095878 15386 ts_tablet_manager.cc:1434] T 5b125feea68040eeb559e4bfa093536c P 766aab97368b4169b07e508f36c4c0fb: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.003s
I20260709 13:04:46.096849 15386 tablet_bootstrap.cc:492] T e85d1b0d46a9459a863728eb3bb432c3 P 766aab97368b4169b07e508f36c4c0fb: Bootstrap starting.
I20260709 13:04:46.107604 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61fe875afff40e39c03b36e7266e263" candidate_uuid: "a0c7b7a30fcf412c85264c0ed126fede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "766aab97368b4169b07e508f36c4c0fb" is_pre_election: true
I20260709 13:04:46.108589 15341 raft_consensus.cc:2468] T c61fe875afff40e39c03b36e7266e263 P 766aab97368b4169b07e508f36c4c0fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0c7b7a30fcf412c85264c0ed126fede in term 0.
I20260709 13:04:46.110471 15233 leader_election.cc:304] T c61fe875afff40e39c03b36e7266e263 P a0c7b7a30fcf412c85264c0ed126fede [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 766aab97368b4169b07e508f36c4c0fb, a0c7b7a30fcf412c85264c0ed126fede; no voters: 
I20260709 13:04:46.111567 15390 raft_consensus.cc:2804] T c61fe875afff40e39c03b36e7266e263 P a0c7b7a30fcf412c85264c0ed126fede [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:46.112008 15390 raft_consensus.cc:493] T c61fe875afff40e39c03b36e7266e263 P a0c7b7a30fcf412c85264c0ed126fede [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:46.112387 15390 raft_consensus.cc:3060] T c61fe875afff40e39c03b36e7266e263 P a0c7b7a30fcf412c85264c0ed126fede [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:46.115146 15386 tablet_bootstrap.cc:654] T e85d1b0d46a9459a863728eb3bb432c3 P 766aab97368b4169b07e508f36c4c0fb: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:46.121137 15390 raft_consensus.cc:515] T c61fe875afff40e39c03b36e7266e263 P a0c7b7a30fcf412c85264c0ed126fede [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } } peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } }
I20260709 13:04:46.124419 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61fe875afff40e39c03b36e7266e263" candidate_uuid: "a0c7b7a30fcf412c85264c0ed126fede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "766aab97368b4169b07e508f36c4c0fb"
I20260709 13:04:46.125140 15341 raft_consensus.cc:3060] T c61fe875afff40e39c03b36e7266e263 P 766aab97368b4169b07e508f36c4c0fb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:46.133978 15390 leader_election.cc:290] T c61fe875afff40e39c03b36e7266e263 P a0c7b7a30fcf412c85264c0ed126fede [CANDIDATE]: Term 1 election: Requested vote from peers 766aab97368b4169b07e508f36c4c0fb (127.14.180.67:42585), 6c27090ad71542bca01248b778ff440b (127.14.180.65:39863)
I20260709 13:04:46.133121 15341 raft_consensus.cc:2468] T c61fe875afff40e39c03b36e7266e263 P 766aab97368b4169b07e508f36c4c0fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0c7b7a30fcf412c85264c0ed126fede in term 1.
I20260709 13:04:46.136576 15233 leader_election.cc:304] T c61fe875afff40e39c03b36e7266e263 P a0c7b7a30fcf412c85264c0ed126fede [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 766aab97368b4169b07e508f36c4c0fb, a0c7b7a30fcf412c85264c0ed126fede; no voters: 
I20260709 13:04:46.139627 15384 tablet_bootstrap.cc:492] T 550f6b32ce5349e4a632e926d5a452de P a0c7b7a30fcf412c85264c0ed126fede: No bootstrap required, opened a new log
I20260709 13:04:46.140151 15384 ts_tablet_manager.cc:1403] T 550f6b32ce5349e4a632e926d5a452de P a0c7b7a30fcf412c85264c0ed126fede: Time spent bootstrapping tablet: real 0.102s	user 0.013s	sys 0.018s
I20260709 13:04:46.141062 15390 raft_consensus.cc:2804] T c61fe875afff40e39c03b36e7266e263 P a0c7b7a30fcf412c85264c0ed126fede [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:04:46.143536 15367 tablet.cc:2406] T 5b125feea68040eeb559e4bfa093536c P 766aab97368b4169b07e508f36c4c0fb: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:04:46.144914 15385 tablet_bootstrap.cc:492] T 9f79381ee9024a9e985aab93d98359e5 P 6c27090ad71542bca01248b778ff440b: No bootstrap required, opened a new log
I20260709 13:04:46.145689 15385 ts_tablet_manager.cc:1403] T 9f79381ee9024a9e985aab93d98359e5 P 6c27090ad71542bca01248b778ff440b: Time spent bootstrapping tablet: real 0.060s	user 0.021s	sys 0.003s
I20260709 13:04:46.145608 15384 raft_consensus.cc:359] T 550f6b32ce5349e4a632e926d5a452de P a0c7b7a30fcf412c85264c0ed126fede [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:46.146519 15384 raft_consensus.cc:385] T 550f6b32ce5349e4a632e926d5a452de P a0c7b7a30fcf412c85264c0ed126fede [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:46.146893 15384 raft_consensus.cc:740] T 550f6b32ce5349e4a632e926d5a452de P a0c7b7a30fcf412c85264c0ed126fede [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0c7b7a30fcf412c85264c0ed126fede, State: Initialized, Role: FOLLOWER
I20260709 13:04:46.147709 15384 consensus_queue.cc:260] T 550f6b32ce5349e4a632e926d5a452de P a0c7b7a30fcf412c85264c0ed126fede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:46.150104 15385 raft_consensus.cc:359] T 9f79381ee9024a9e985aab93d98359e5 P 6c27090ad71542bca01248b778ff440b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:46.150666 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61fe875afff40e39c03b36e7266e263" candidate_uuid: "a0c7b7a30fcf412c85264c0ed126fede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c27090ad71542bca01248b778ff440b" is_pre_election: true
I20260709 13:04:46.151087 15385 raft_consensus.cc:385] T 9f79381ee9024a9e985aab93d98359e5 P 6c27090ad71542bca01248b778ff440b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:46.150979 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61fe875afff40e39c03b36e7266e263" candidate_uuid: "a0c7b7a30fcf412c85264c0ed126fede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c27090ad71542bca01248b778ff440b"
I20260709 13:04:46.151481 15385 raft_consensus.cc:740] T 9f79381ee9024a9e985aab93d98359e5 P 6c27090ad71542bca01248b778ff440b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c27090ad71542bca01248b778ff440b, State: Initialized, Role: FOLLOWER
I20260709 13:04:46.151503 15192 raft_consensus.cc:2468] T c61fe875afff40e39c03b36e7266e263 P 6c27090ad71542bca01248b778ff440b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0c7b7a30fcf412c85264c0ed126fede in term 0.
I20260709 13:04:46.152416 15385 consensus_queue.cc:260] T 9f79381ee9024a9e985aab93d98359e5 P 6c27090ad71542bca01248b778ff440b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:46.152938 15390 raft_consensus.cc:697] T c61fe875afff40e39c03b36e7266e263 P a0c7b7a30fcf412c85264c0ed126fede [term 1 LEADER]: Becoming Leader. State: Replica: a0c7b7a30fcf412c85264c0ed126fede, State: Running, Role: LEADER
I20260709 13:04:46.156764 15386 tablet_bootstrap.cc:492] T e85d1b0d46a9459a863728eb3bb432c3 P 766aab97368b4169b07e508f36c4c0fb: No bootstrap required, opened a new log
I20260709 13:04:46.157291 15386 ts_tablet_manager.cc:1403] T e85d1b0d46a9459a863728eb3bb432c3 P 766aab97368b4169b07e508f36c4c0fb: Time spent bootstrapping tablet: real 0.061s	user 0.006s	sys 0.008s
I20260709 13:04:46.157984 15384 ts_tablet_manager.cc:1434] T 550f6b32ce5349e4a632e926d5a452de P a0c7b7a30fcf412c85264c0ed126fede: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.006s
I20260709 13:04:46.159013 15384 tablet_bootstrap.cc:492] T b88f6a525ac24e259e1331eaaa2f41ac P a0c7b7a30fcf412c85264c0ed126fede: Bootstrap starting.
I20260709 13:04:46.160615 15386 raft_consensus.cc:359] T e85d1b0d46a9459a863728eb3bb432c3 P 766aab97368b4169b07e508f36c4c0fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:46.162761 15386 raft_consensus.cc:385] T e85d1b0d46a9459a863728eb3bb432c3 P 766aab97368b4169b07e508f36c4c0fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:46.163120 15386 raft_consensus.cc:740] T e85d1b0d46a9459a863728eb3bb432c3 P 766aab97368b4169b07e508f36c4c0fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 766aab97368b4169b07e508f36c4c0fb, State: Initialized, Role: FOLLOWER
I20260709 13:04:46.163997 15386 consensus_queue.cc:260] T e85d1b0d46a9459a863728eb3bb432c3 P 766aab97368b4169b07e508f36c4c0fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:46.165275 15384 tablet_bootstrap.cc:654] T b88f6a525ac24e259e1331eaaa2f41ac P a0c7b7a30fcf412c85264c0ed126fede: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:46.166483 15386 ts_tablet_manager.cc:1434] T e85d1b0d46a9459a863728eb3bb432c3 P 766aab97368b4169b07e508f36c4c0fb: Time spent starting tablet: real 0.009s	user 0.001s	sys 0.005s
I20260709 13:04:46.167685 15386 tablet_bootstrap.cc:492] T 550f6b32ce5349e4a632e926d5a452de P 766aab97368b4169b07e508f36c4c0fb: Bootstrap starting.
I20260709 13:04:46.171820 15385 ts_tablet_manager.cc:1434] T 9f79381ee9024a9e985aab93d98359e5 P 6c27090ad71542bca01248b778ff440b: Time spent starting tablet: real 0.026s	user 0.009s	sys 0.000s
I20260709 13:04:46.173746 15385 tablet_bootstrap.cc:492] T d2a5b790ba6449afa2d539eb54aa63d5 P 6c27090ad71542bca01248b778ff440b: Bootstrap starting.
I20260709 13:04:46.154089 15390 consensus_queue.cc:237] T c61fe875afff40e39c03b36e7266e263 P a0c7b7a30fcf412c85264c0ed126fede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } } peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } }
I20260709 13:04:46.191990 15386 tablet_bootstrap.cc:654] T 550f6b32ce5349e4a632e926d5a452de P 766aab97368b4169b07e508f36c4c0fb: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:46.193653 15385 tablet_bootstrap.cc:654] T d2a5b790ba6449afa2d539eb54aa63d5 P 6c27090ad71542bca01248b778ff440b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:46.193490 15089 catalog_manager.cc:5697] T c61fe875afff40e39c03b36e7266e263 P a0c7b7a30fcf412c85264c0ed126fede reported cstate change: term changed from 0 to 1, leader changed from <none> to a0c7b7a30fcf412c85264c0ed126fede (127.14.180.66). New cstate: current_term: 1 leader_uuid: "a0c7b7a30fcf412c85264c0ed126fede" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:46.199877 15384 tablet_bootstrap.cc:492] T b88f6a525ac24e259e1331eaaa2f41ac P a0c7b7a30fcf412c85264c0ed126fede: No bootstrap required, opened a new log
I20260709 13:04:46.204269 15384 ts_tablet_manager.cc:1403] T b88f6a525ac24e259e1331eaaa2f41ac P a0c7b7a30fcf412c85264c0ed126fede: Time spent bootstrapping tablet: real 0.045s	user 0.020s	sys 0.020s
I20260709 13:04:46.205360 15386 tablet_bootstrap.cc:492] T 550f6b32ce5349e4a632e926d5a452de P 766aab97368b4169b07e508f36c4c0fb: No bootstrap required, opened a new log
I20260709 13:04:46.206070 15386 ts_tablet_manager.cc:1403] T 550f6b32ce5349e4a632e926d5a452de P 766aab97368b4169b07e508f36c4c0fb: Time spent bootstrapping tablet: real 0.039s	user 0.009s	sys 0.009s
I20260709 13:04:46.207439 15384 raft_consensus.cc:359] T b88f6a525ac24e259e1331eaaa2f41ac P a0c7b7a30fcf412c85264c0ed126fede [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:46.208261 15384 raft_consensus.cc:385] T b88f6a525ac24e259e1331eaaa2f41ac P a0c7b7a30fcf412c85264c0ed126fede [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:46.208580 15384 raft_consensus.cc:740] T b88f6a525ac24e259e1331eaaa2f41ac P a0c7b7a30fcf412c85264c0ed126fede [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0c7b7a30fcf412c85264c0ed126fede, State: Initialized, Role: FOLLOWER
I20260709 13:04:46.209405 15384 consensus_queue.cc:260] T b88f6a525ac24e259e1331eaaa2f41ac P a0c7b7a30fcf412c85264c0ed126fede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:46.210214 15386 raft_consensus.cc:359] T 550f6b32ce5349e4a632e926d5a452de P 766aab97368b4169b07e508f36c4c0fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:46.211764 15384 ts_tablet_manager.cc:1434] T b88f6a525ac24e259e1331eaaa2f41ac P a0c7b7a30fcf412c85264c0ed126fede: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:04:46.211804 15386 raft_consensus.cc:385] T 550f6b32ce5349e4a632e926d5a452de P 766aab97368b4169b07e508f36c4c0fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:46.212347 15386 raft_consensus.cc:740] T 550f6b32ce5349e4a632e926d5a452de P 766aab97368b4169b07e508f36c4c0fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 766aab97368b4169b07e508f36c4c0fb, State: Initialized, Role: FOLLOWER
I20260709 13:04:46.212906 15384 tablet_bootstrap.cc:492] T 5b125feea68040eeb559e4bfa093536c P a0c7b7a30fcf412c85264c0ed126fede: Bootstrap starting.
I20260709 13:04:46.213378 15386 consensus_queue.cc:260] T 550f6b32ce5349e4a632e926d5a452de P 766aab97368b4169b07e508f36c4c0fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:46.216642 15392 raft_consensus.cc:493] T b88f6a525ac24e259e1331eaaa2f41ac P 6c27090ad71542bca01248b778ff440b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:46.217197 15392 raft_consensus.cc:515] T b88f6a525ac24e259e1331eaaa2f41ac P 6c27090ad71542bca01248b778ff440b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:46.218093 15386 ts_tablet_manager.cc:1434] T 550f6b32ce5349e4a632e926d5a452de P 766aab97368b4169b07e508f36c4c0fb: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.001s
I20260709 13:04:46.220048 15386 tablet_bootstrap.cc:492] T a7555eadc3bb496bb07b3cc6515fa680 P 766aab97368b4169b07e508f36c4c0fb: Bootstrap starting.
I20260709 13:04:46.220696 15392 leader_election.cc:290] T b88f6a525ac24e259e1331eaaa2f41ac P 6c27090ad71542bca01248b778ff440b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a0c7b7a30fcf412c85264c0ed126fede (127.14.180.66:33371), 766aab97368b4169b07e508f36c4c0fb (127.14.180.67:42585)
I20260709 13:04:46.220798 15385 tablet_bootstrap.cc:492] T d2a5b790ba6449afa2d539eb54aa63d5 P 6c27090ad71542bca01248b778ff440b: No bootstrap required, opened a new log
I20260709 13:04:46.227052 15385 ts_tablet_manager.cc:1403] T d2a5b790ba6449afa2d539eb54aa63d5 P 6c27090ad71542bca01248b778ff440b: Time spent bootstrapping tablet: real 0.054s	user 0.015s	sys 0.003s
I20260709 13:04:46.223559 15384 tablet_bootstrap.cc:654] T 5b125feea68040eeb559e4bfa093536c P a0c7b7a30fcf412c85264c0ed126fede: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:46.230326 15385 raft_consensus.cc:359] T d2a5b790ba6449afa2d539eb54aa63d5 P 6c27090ad71542bca01248b778ff440b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:46.231146 15385 raft_consensus.cc:385] T d2a5b790ba6449afa2d539eb54aa63d5 P 6c27090ad71542bca01248b778ff440b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:46.231459 15385 raft_consensus.cc:740] T d2a5b790ba6449afa2d539eb54aa63d5 P 6c27090ad71542bca01248b778ff440b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c27090ad71542bca01248b778ff440b, State: Initialized, Role: FOLLOWER
I20260709 13:04:46.232366 15385 consensus_queue.cc:260] T d2a5b790ba6449afa2d539eb54aa63d5 P 6c27090ad71542bca01248b778ff440b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:46.239485 15385 ts_tablet_manager.cc:1434] T d2a5b790ba6449afa2d539eb54aa63d5 P 6c27090ad71542bca01248b778ff440b: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:04:46.240731 15385 tablet_bootstrap.cc:492] T a7555eadc3bb496bb07b3cc6515fa680 P 6c27090ad71542bca01248b778ff440b: Bootstrap starting.
I20260709 13:04:46.242686 15386 tablet_bootstrap.cc:654] T a7555eadc3bb496bb07b3cc6515fa680 P 766aab97368b4169b07e508f36c4c0fb: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:46.261020 15390 raft_consensus.cc:493] T b88f6a525ac24e259e1331eaaa2f41ac P a0c7b7a30fcf412c85264c0ed126fede [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:46.261911 15386 tablet_bootstrap.cc:492] T a7555eadc3bb496bb07b3cc6515fa680 P 766aab97368b4169b07e508f36c4c0fb: No bootstrap required, opened a new log
I20260709 13:04:46.261741 15390 raft_consensus.cc:515] T b88f6a525ac24e259e1331eaaa2f41ac P a0c7b7a30fcf412c85264c0ed126fede [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:46.262676 15386 ts_tablet_manager.cc:1403] T a7555eadc3bb496bb07b3cc6515fa680 P 766aab97368b4169b07e508f36c4c0fb: Time spent bootstrapping tablet: real 0.043s	user 0.012s	sys 0.005s
I20260709 13:04:46.269979 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b88f6a525ac24e259e1331eaaa2f41ac" candidate_uuid: "a0c7b7a30fcf412c85264c0ed126fede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c27090ad71542bca01248b778ff440b" is_pre_election: true
I20260709 13:04:46.270434 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b88f6a525ac24e259e1331eaaa2f41ac" candidate_uuid: "a0c7b7a30fcf412c85264c0ed126fede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "766aab97368b4169b07e508f36c4c0fb" is_pre_election: true
I20260709 13:04:46.270735 15192 raft_consensus.cc:2468] T b88f6a525ac24e259e1331eaaa2f41ac P 6c27090ad71542bca01248b778ff440b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0c7b7a30fcf412c85264c0ed126fede in term 0.
W20260709 13:04:46.273401 15233 leader_election.cc:343] T b88f6a525ac24e259e1331eaaa2f41ac P a0c7b7a30fcf412c85264c0ed126fede [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 766aab97368b4169b07e508f36c4c0fb (127.14.180.67:42585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:46.272951 15390 leader_election.cc:290] T b88f6a525ac24e259e1331eaaa2f41ac P a0c7b7a30fcf412c85264c0ed126fede [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6c27090ad71542bca01248b778ff440b (127.14.180.65:39863), 766aab97368b4169b07e508f36c4c0fb (127.14.180.67:42585)
I20260709 13:04:46.272368 15386 raft_consensus.cc:359] T a7555eadc3bb496bb07b3cc6515fa680 P 766aab97368b4169b07e508f36c4c0fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:46.274761 15386 raft_consensus.cc:385] T a7555eadc3bb496bb07b3cc6515fa680 P 766aab97368b4169b07e508f36c4c0fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:46.275218 15386 raft_consensus.cc:740] T a7555eadc3bb496bb07b3cc6515fa680 P 766aab97368b4169b07e508f36c4c0fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 766aab97368b4169b07e508f36c4c0fb, State: Initialized, Role: FOLLOWER
I20260709 13:04:46.276007 15232 leader_election.cc:304] T b88f6a525ac24e259e1331eaaa2f41ac P a0c7b7a30fcf412c85264c0ed126fede [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c27090ad71542bca01248b778ff440b, a0c7b7a30fcf412c85264c0ed126fede; no voters: 766aab97368b4169b07e508f36c4c0fb
I20260709 13:04:46.277293 15390 raft_consensus.cc:2804] T b88f6a525ac24e259e1331eaaa2f41ac P a0c7b7a30fcf412c85264c0ed126fede [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:46.277796 15390 raft_consensus.cc:493] T b88f6a525ac24e259e1331eaaa2f41ac P a0c7b7a30fcf412c85264c0ed126fede [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:46.278640 15390 raft_consensus.cc:3060] T b88f6a525ac24e259e1331eaaa2f41ac P a0c7b7a30fcf412c85264c0ed126fede [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:46.279608 15385 tablet_bootstrap.cc:654] T a7555eadc3bb496bb07b3cc6515fa680 P 6c27090ad71542bca01248b778ff440b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:46.276667 15386 consensus_queue.cc:260] T a7555eadc3bb496bb07b3cc6515fa680 P 766aab97368b4169b07e508f36c4c0fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:46.286221 15386 ts_tablet_manager.cc:1434] T a7555eadc3bb496bb07b3cc6515fa680 P 766aab97368b4169b07e508f36c4c0fb: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.002s
I20260709 13:04:46.287290 15386 tablet_bootstrap.cc:492] T b88f6a525ac24e259e1331eaaa2f41ac P 766aab97368b4169b07e508f36c4c0fb: Bootstrap starting.
I20260709 13:04:46.288322 15390 raft_consensus.cc:515] T b88f6a525ac24e259e1331eaaa2f41ac P a0c7b7a30fcf412c85264c0ed126fede [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:46.293920 15384 tablet_bootstrap.cc:492] T 5b125feea68040eeb559e4bfa093536c P a0c7b7a30fcf412c85264c0ed126fede: No bootstrap required, opened a new log
I20260709 13:04:46.294438 15384 ts_tablet_manager.cc:1403] T 5b125feea68040eeb559e4bfa093536c P a0c7b7a30fcf412c85264c0ed126fede: Time spent bootstrapping tablet: real 0.082s	user 0.032s	sys 0.025s
I20260709 13:04:46.295720 15390 leader_election.cc:290] T b88f6a525ac24e259e1331eaaa2f41ac P a0c7b7a30fcf412c85264c0ed126fede [CANDIDATE]: Term 1 election: Requested vote from peers 6c27090ad71542bca01248b778ff440b (127.14.180.65:39863), 766aab97368b4169b07e508f36c4c0fb (127.14.180.67:42585)
I20260709 13:04:46.296814 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b88f6a525ac24e259e1331eaaa2f41ac" candidate_uuid: "a0c7b7a30fcf412c85264c0ed126fede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c27090ad71542bca01248b778ff440b"
I20260709 13:04:46.297433 15192 raft_consensus.cc:3060] T b88f6a525ac24e259e1331eaaa2f41ac P 6c27090ad71542bca01248b778ff440b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:46.304215 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b88f6a525ac24e259e1331eaaa2f41ac" candidate_uuid: "a0c7b7a30fcf412c85264c0ed126fede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "766aab97368b4169b07e508f36c4c0fb"
W20260709 13:04:46.305918 15233 leader_election.cc:343] T b88f6a525ac24e259e1331eaaa2f41ac P a0c7b7a30fcf412c85264c0ed126fede [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 766aab97368b4169b07e508f36c4c0fb (127.14.180.67:42585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:46.306495 15386 tablet_bootstrap.cc:654] T b88f6a525ac24e259e1331eaaa2f41ac P 766aab97368b4169b07e508f36c4c0fb: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:46.321036 15391 raft_consensus.cc:493] T 5b125feea68040eeb559e4bfa093536c P 766aab97368b4169b07e508f36c4c0fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:46.321831 15391 raft_consensus.cc:515] T 5b125feea68040eeb559e4bfa093536c P 766aab97368b4169b07e508f36c4c0fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:46.342025 15384 raft_consensus.cc:359] T 5b125feea68040eeb559e4bfa093536c P a0c7b7a30fcf412c85264c0ed126fede [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:46.342873 15384 raft_consensus.cc:385] T 5b125feea68040eeb559e4bfa093536c P a0c7b7a30fcf412c85264c0ed126fede [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:46.338915 15192 raft_consensus.cc:2468] T b88f6a525ac24e259e1331eaaa2f41ac P 6c27090ad71542bca01248b778ff440b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0c7b7a30fcf412c85264c0ed126fede in term 1.
I20260709 13:04:46.343518 15391 leader_election.cc:290] T 5b125feea68040eeb559e4bfa093536c P 766aab97368b4169b07e508f36c4c0fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6c27090ad71542bca01248b778ff440b (127.14.180.65:39863), a0c7b7a30fcf412c85264c0ed126fede (127.14.180.66:33371)
I20260709 13:04:46.344009 15384 raft_consensus.cc:740] T 5b125feea68040eeb559e4bfa093536c P a0c7b7a30fcf412c85264c0ed126fede [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0c7b7a30fcf412c85264c0ed126fede, State: Initialized, Role: FOLLOWER
I20260709 13:04:46.351562 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b88f6a525ac24e259e1331eaaa2f41ac" candidate_uuid: "6c27090ad71542bca01248b778ff440b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0c7b7a30fcf412c85264c0ed126fede" is_pre_election: true
I20260709 13:04:46.353567 15232 leader_election.cc:304] T b88f6a525ac24e259e1331eaaa2f41ac P a0c7b7a30fcf412c85264c0ed126fede [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c27090ad71542bca01248b778ff440b, a0c7b7a30fcf412c85264c0ed126fede; no voters: 766aab97368b4169b07e508f36c4c0fb
I20260709 13:04:46.356143 15267 raft_consensus.cc:2393] T b88f6a525ac24e259e1331eaaa2f41ac P a0c7b7a30fcf412c85264c0ed126fede [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c27090ad71542bca01248b778ff440b in current term 1: Already voted for candidate a0c7b7a30fcf412c85264c0ed126fede in this term.
I20260709 13:04:46.356608 15390 raft_consensus.cc:2804] T b88f6a525ac24e259e1331eaaa2f41ac P a0c7b7a30fcf412c85264c0ed126fede [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:46.355834 15384 consensus_queue.cc:260] T 5b125feea68040eeb559e4bfa093536c P a0c7b7a30fcf412c85264c0ed126fede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:46.357649 15390 raft_consensus.cc:697] T b88f6a525ac24e259e1331eaaa2f41ac P a0c7b7a30fcf412c85264c0ed126fede [term 1 LEADER]: Becoming Leader. State: Replica: a0c7b7a30fcf412c85264c0ed126fede, State: Running, Role: LEADER
I20260709 13:04:46.360601 15390 consensus_queue.cc:237] T b88f6a525ac24e259e1331eaaa2f41ac P a0c7b7a30fcf412c85264c0ed126fede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:46.370291 15384 ts_tablet_manager.cc:1434] T 5b125feea68040eeb559e4bfa093536c P a0c7b7a30fcf412c85264c0ed126fede: Time spent starting tablet: real 0.075s	user 0.012s	sys 0.000s
I20260709 13:04:46.374593 15384 tablet_bootstrap.cc:492] T a7555eadc3bb496bb07b3cc6515fa680 P a0c7b7a30fcf412c85264c0ed126fede: Bootstrap starting.
I20260709 13:04:46.375353 15385 tablet_bootstrap.cc:492] T a7555eadc3bb496bb07b3cc6515fa680 P 6c27090ad71542bca01248b778ff440b: No bootstrap required, opened a new log
I20260709 13:04:46.375902 15385 ts_tablet_manager.cc:1403] T a7555eadc3bb496bb07b3cc6515fa680 P 6c27090ad71542bca01248b778ff440b: Time spent bootstrapping tablet: real 0.135s	user 0.028s	sys 0.001s
I20260709 13:04:46.377954 15386 tablet_bootstrap.cc:492] T b88f6a525ac24e259e1331eaaa2f41ac P 766aab97368b4169b07e508f36c4c0fb: No bootstrap required, opened a new log
I20260709 13:04:46.378484 15386 ts_tablet_manager.cc:1403] T b88f6a525ac24e259e1331eaaa2f41ac P 766aab97368b4169b07e508f36c4c0fb: Time spent bootstrapping tablet: real 0.091s	user 0.020s	sys 0.026s
I20260709 13:04:46.379904 15385 raft_consensus.cc:359] T a7555eadc3bb496bb07b3cc6515fa680 P 6c27090ad71542bca01248b778ff440b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:46.381848 15385 raft_consensus.cc:385] T a7555eadc3bb496bb07b3cc6515fa680 P 6c27090ad71542bca01248b778ff440b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:46.387473 15385 raft_consensus.cc:740] T a7555eadc3bb496bb07b3cc6515fa680 P 6c27090ad71542bca01248b778ff440b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c27090ad71542bca01248b778ff440b, State: Initialized, Role: FOLLOWER
I20260709 13:04:46.390031 15386 raft_consensus.cc:359] T b88f6a525ac24e259e1331eaaa2f41ac P 766aab97368b4169b07e508f36c4c0fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:46.391801 15386 raft_consensus.cc:385] T b88f6a525ac24e259e1331eaaa2f41ac P 766aab97368b4169b07e508f36c4c0fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:46.392199 15386 raft_consensus.cc:740] T b88f6a525ac24e259e1331eaaa2f41ac P 766aab97368b4169b07e508f36c4c0fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 766aab97368b4169b07e508f36c4c0fb, State: Initialized, Role: FOLLOWER
I20260709 13:04:46.392803 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b88f6a525ac24e259e1331eaaa2f41ac" candidate_uuid: "6c27090ad71542bca01248b778ff440b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "766aab97368b4169b07e508f36c4c0fb" is_pre_election: true
I20260709 13:04:46.393602 15386 consensus_queue.cc:260] T b88f6a525ac24e259e1331eaaa2f41ac P 766aab97368b4169b07e508f36c4c0fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:46.394316 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b125feea68040eeb559e4bfa093536c" candidate_uuid: "766aab97368b4169b07e508f36c4c0fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c27090ad71542bca01248b778ff440b" is_pre_election: true
I20260709 13:04:46.395601 15341 raft_consensus.cc:2468] T b88f6a525ac24e259e1331eaaa2f41ac P 766aab97368b4169b07e508f36c4c0fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c27090ad71542bca01248b778ff440b in term 0.
I20260709 13:04:46.398379 15391 raft_consensus.cc:493] T 550f6b32ce5349e4a632e926d5a452de P 766aab97368b4169b07e508f36c4c0fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:46.399600 15384 tablet_bootstrap.cc:654] T a7555eadc3bb496bb07b3cc6515fa680 P a0c7b7a30fcf412c85264c0ed126fede: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:46.399389 15391 raft_consensus.cc:515] T 550f6b32ce5349e4a632e926d5a452de P 766aab97368b4169b07e508f36c4c0fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
W20260709 13:04:46.401482 15306 leader_election.cc:343] T 5b125feea68040eeb559e4bfa093536c P 766aab97368b4169b07e508f36c4c0fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6c27090ad71542bca01248b778ff440b (127.14.180.65:39863): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:46.404220 15391 leader_election.cc:290] T 550f6b32ce5349e4a632e926d5a452de P 766aab97368b4169b07e508f36c4c0fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6c27090ad71542bca01248b778ff440b (127.14.180.65:39863), a0c7b7a30fcf412c85264c0ed126fede (127.14.180.66:33371)
I20260709 13:04:46.389348 15385 consensus_queue.cc:260] T a7555eadc3bb496bb07b3cc6515fa680 P 6c27090ad71542bca01248b778ff440b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:46.407143 15401 raft_consensus.cc:493] T 550f6b32ce5349e4a632e926d5a452de P a0c7b7a30fcf412c85264c0ed126fede [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:46.407250 15158 leader_election.cc:304] T b88f6a525ac24e259e1331eaaa2f41ac P 6c27090ad71542bca01248b778ff440b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c27090ad71542bca01248b778ff440b, 766aab97368b4169b07e508f36c4c0fb; no voters: a0c7b7a30fcf412c85264c0ed126fede
I20260709 13:04:46.407869 15401 raft_consensus.cc:515] T 550f6b32ce5349e4a632e926d5a452de P a0c7b7a30fcf412c85264c0ed126fede [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:46.409929 15392 raft_consensus.cc:2764] T b88f6a525ac24e259e1331eaaa2f41ac P 6c27090ad71542bca01248b778ff440b [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:04:46.409492 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550f6b32ce5349e4a632e926d5a452de" candidate_uuid: "766aab97368b4169b07e508f36c4c0fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c27090ad71542bca01248b778ff440b" is_pre_election: true
I20260709 13:04:46.414213 15401 leader_election.cc:290] T 550f6b32ce5349e4a632e926d5a452de P a0c7b7a30fcf412c85264c0ed126fede [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6c27090ad71542bca01248b778ff440b (127.14.180.65:39863), 766aab97368b4169b07e508f36c4c0fb (127.14.180.67:42585)
W20260709 13:04:46.415369 15306 leader_election.cc:343] T 550f6b32ce5349e4a632e926d5a452de P 766aab97368b4169b07e508f36c4c0fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6c27090ad71542bca01248b778ff440b (127.14.180.65:39863): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:46.415299 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550f6b32ce5349e4a632e926d5a452de" candidate_uuid: "a0c7b7a30fcf412c85264c0ed126fede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c27090ad71542bca01248b778ff440b" is_pre_election: true
W20260709 13:04:46.417882 15232 leader_election.cc:343] T 550f6b32ce5349e4a632e926d5a452de P a0c7b7a30fcf412c85264c0ed126fede [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6c27090ad71542bca01248b778ff440b (127.14.180.65:39863): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:46.427690 15385 ts_tablet_manager.cc:1434] T a7555eadc3bb496bb07b3cc6515fa680 P 6c27090ad71542bca01248b778ff440b: Time spent starting tablet: real 0.051s	user 0.005s	sys 0.007s
I20260709 13:04:46.424253 15086 catalog_manager.cc:5697] T b88f6a525ac24e259e1331eaaa2f41ac P a0c7b7a30fcf412c85264c0ed126fede reported cstate change: term changed from 0 to 1, leader changed from <none> to a0c7b7a30fcf412c85264c0ed126fede (127.14.180.66). New cstate: current_term: 1 leader_uuid: "a0c7b7a30fcf412c85264c0ed126fede" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:46.430217 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550f6b32ce5349e4a632e926d5a452de" candidate_uuid: "a0c7b7a30fcf412c85264c0ed126fede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "766aab97368b4169b07e508f36c4c0fb" is_pre_election: true
I20260709 13:04:46.431298 15341 raft_consensus.cc:2468] T 550f6b32ce5349e4a632e926d5a452de P 766aab97368b4169b07e508f36c4c0fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0c7b7a30fcf412c85264c0ed126fede in term 0.
I20260709 13:04:46.431762 15385 tablet_bootstrap.cc:492] T 4f665c7b3caa440fa5664a96decac188 P 6c27090ad71542bca01248b778ff440b: Bootstrap starting.
I20260709 13:04:46.433302 15233 leader_election.cc:304] T 550f6b32ce5349e4a632e926d5a452de P a0c7b7a30fcf412c85264c0ed126fede [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 766aab97368b4169b07e508f36c4c0fb, a0c7b7a30fcf412c85264c0ed126fede; no voters: 6c27090ad71542bca01248b778ff440b
I20260709 13:04:46.435690 15390 raft_consensus.cc:493] T 5b125feea68040eeb559e4bfa093536c P a0c7b7a30fcf412c85264c0ed126fede [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:46.436221 15390 raft_consensus.cc:515] T 5b125feea68040eeb559e4bfa093536c P a0c7b7a30fcf412c85264c0ed126fede [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:46.439518 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b125feea68040eeb559e4bfa093536c" candidate_uuid: "a0c7b7a30fcf412c85264c0ed126fede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c27090ad71542bca01248b778ff440b" is_pre_election: true
I20260709 13:04:46.440387 15386 ts_tablet_manager.cc:1434] T b88f6a525ac24e259e1331eaaa2f41ac P 766aab97368b4169b07e508f36c4c0fb: Time spent starting tablet: real 0.062s	user 0.008s	sys 0.003s
I20260709 13:04:46.441625 15386 tablet_bootstrap.cc:492] T 9f79381ee9024a9e985aab93d98359e5 P 766aab97368b4169b07e508f36c4c0fb: Bootstrap starting.
I20260709 13:04:46.441352 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b125feea68040eeb559e4bfa093536c" candidate_uuid: "a0c7b7a30fcf412c85264c0ed126fede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "766aab97368b4169b07e508f36c4c0fb" is_pre_election: true
W20260709 13:04:46.443028 15232 leader_election.cc:343] T 5b125feea68040eeb559e4bfa093536c P a0c7b7a30fcf412c85264c0ed126fede [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6c27090ad71542bca01248b778ff440b (127.14.180.65:39863): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:46.443868 15390 leader_election.cc:290] T 5b125feea68040eeb559e4bfa093536c P a0c7b7a30fcf412c85264c0ed126fede [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6c27090ad71542bca01248b778ff440b (127.14.180.65:39863), 766aab97368b4169b07e508f36c4c0fb (127.14.180.67:42585)
I20260709 13:04:46.444465 15390 raft_consensus.cc:2804] T 550f6b32ce5349e4a632e926d5a452de P a0c7b7a30fcf412c85264c0ed126fede [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:46.444819 15390 raft_consensus.cc:493] T 550f6b32ce5349e4a632e926d5a452de P a0c7b7a30fcf412c85264c0ed126fede [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:46.448185 15341 raft_consensus.cc:2468] T 5b125feea68040eeb559e4bfa093536c P 766aab97368b4169b07e508f36c4c0fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0c7b7a30fcf412c85264c0ed126fede in term 0.
I20260709 13:04:46.448205 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b125feea68040eeb559e4bfa093536c" candidate_uuid: "766aab97368b4169b07e508f36c4c0fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0c7b7a30fcf412c85264c0ed126fede" is_pre_election: true
I20260709 13:04:46.449260 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550f6b32ce5349e4a632e926d5a452de" candidate_uuid: "766aab97368b4169b07e508f36c4c0fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0c7b7a30fcf412c85264c0ed126fede" is_pre_election: true
I20260709 13:04:46.449764 15267 raft_consensus.cc:2468] T 5b125feea68040eeb559e4bfa093536c P a0c7b7a30fcf412c85264c0ed126fede [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 766aab97368b4169b07e508f36c4c0fb in term 0.
I20260709 13:04:46.448298 15390 raft_consensus.cc:3060] T 550f6b32ce5349e4a632e926d5a452de P a0c7b7a30fcf412c85264c0ed126fede [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:46.450951 15233 leader_election.cc:304] T 5b125feea68040eeb559e4bfa093536c P a0c7b7a30fcf412c85264c0ed126fede [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 766aab97368b4169b07e508f36c4c0fb, a0c7b7a30fcf412c85264c0ed126fede; no voters: 6c27090ad71542bca01248b778ff440b
I20260709 13:04:46.452342 15307 leader_election.cc:304] T 5b125feea68040eeb559e4bfa093536c P 766aab97368b4169b07e508f36c4c0fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 766aab97368b4169b07e508f36c4c0fb, a0c7b7a30fcf412c85264c0ed126fede; no voters: 6c27090ad71542bca01248b778ff440b
I20260709 13:04:46.458461 15401 raft_consensus.cc:2804] T 5b125feea68040eeb559e4bfa093536c P a0c7b7a30fcf412c85264c0ed126fede [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:46.459007 15401 raft_consensus.cc:493] T 5b125feea68040eeb559e4bfa093536c P a0c7b7a30fcf412c85264c0ed126fede [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:46.459419 15401 raft_consensus.cc:3060] T 5b125feea68040eeb559e4bfa093536c P a0c7b7a30fcf412c85264c0ed126fede [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:46.460551 15420 raft_consensus.cc:2804] T 5b125feea68040eeb559e4bfa093536c P 766aab97368b4169b07e508f36c4c0fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:46.461098 15420 raft_consensus.cc:493] T 5b125feea68040eeb559e4bfa093536c P 766aab97368b4169b07e508f36c4c0fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:46.461536 15420 raft_consensus.cc:3060] T 5b125feea68040eeb559e4bfa093536c P 766aab97368b4169b07e508f36c4c0fb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:46.465924 15419 raft_consensus.cc:493] T d2a5b790ba6449afa2d539eb54aa63d5 P 6c27090ad71542bca01248b778ff440b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:46.466571 15419 raft_consensus.cc:515] T d2a5b790ba6449afa2d539eb54aa63d5 P 6c27090ad71542bca01248b778ff440b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:46.467303 15390 raft_consensus.cc:515] T 550f6b32ce5349e4a632e926d5a452de P a0c7b7a30fcf412c85264c0ed126fede [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:46.471832 15419 leader_election.cc:290] T d2a5b790ba6449afa2d539eb54aa63d5 P 6c27090ad71542bca01248b778ff440b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a0c7b7a30fcf412c85264c0ed126fede (127.14.180.66:33371), 766aab97368b4169b07e508f36c4c0fb (127.14.180.67:42585)
I20260709 13:04:46.472841 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2a5b790ba6449afa2d539eb54aa63d5" candidate_uuid: "6c27090ad71542bca01248b778ff440b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0c7b7a30fcf412c85264c0ed126fede" is_pre_election: true
I20260709 13:04:46.473009 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2a5b790ba6449afa2d539eb54aa63d5" candidate_uuid: "6c27090ad71542bca01248b778ff440b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "766aab97368b4169b07e508f36c4c0fb" is_pre_election: true
I20260709 13:04:46.474045 15384 tablet_bootstrap.cc:492] T a7555eadc3bb496bb07b3cc6515fa680 P a0c7b7a30fcf412c85264c0ed126fede: No bootstrap required, opened a new log
I20260709 13:04:46.474639 15384 ts_tablet_manager.cc:1403] T a7555eadc3bb496bb07b3cc6515fa680 P a0c7b7a30fcf412c85264c0ed126fede: Time spent bootstrapping tablet: real 0.100s	user 0.015s	sys 0.014s
W20260709 13:04:46.474934 15158 leader_election.cc:343] T d2a5b790ba6449afa2d539eb54aa63d5 P 6c27090ad71542bca01248b778ff440b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a0c7b7a30fcf412c85264c0ed126fede (127.14.180.66:33371): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:46.475957 15158 leader_election.cc:343] T d2a5b790ba6449afa2d539eb54aa63d5 P 6c27090ad71542bca01248b778ff440b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 766aab97368b4169b07e508f36c4c0fb (127.14.180.67:42585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:46.477818 15158 leader_election.cc:304] T d2a5b790ba6449afa2d539eb54aa63d5 P 6c27090ad71542bca01248b778ff440b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c27090ad71542bca01248b778ff440b; no voters: 766aab97368b4169b07e508f36c4c0fb, a0c7b7a30fcf412c85264c0ed126fede
I20260709 13:04:46.479329 15419 raft_consensus.cc:2749] T d2a5b790ba6449afa2d539eb54aa63d5 P 6c27090ad71542bca01248b778ff440b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:46.480422 15266 raft_consensus.cc:2393] T 550f6b32ce5349e4a632e926d5a452de P a0c7b7a30fcf412c85264c0ed126fede [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 766aab97368b4169b07e508f36c4c0fb in current term 1: Already voted for candidate a0c7b7a30fcf412c85264c0ed126fede in this term.
I20260709 13:04:46.482774 15307 leader_election.cc:304] T 550f6b32ce5349e4a632e926d5a452de P 766aab97368b4169b07e508f36c4c0fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 766aab97368b4169b07e508f36c4c0fb; no voters: 6c27090ad71542bca01248b778ff440b, a0c7b7a30fcf412c85264c0ed126fede
I20260709 13:04:46.484194 15391 raft_consensus.cc:3060] T 550f6b32ce5349e4a632e926d5a452de P 766aab97368b4169b07e508f36c4c0fb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:46.484354 15401 raft_consensus.cc:515] T 5b125feea68040eeb559e4bfa093536c P a0c7b7a30fcf412c85264c0ed126fede [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:46.492321 15401 leader_election.cc:290] T 5b125feea68040eeb559e4bfa093536c P a0c7b7a30fcf412c85264c0ed126fede [CANDIDATE]: Term 1 election: Requested vote from peers 6c27090ad71542bca01248b778ff440b (127.14.180.65:39863), 766aab97368b4169b07e508f36c4c0fb (127.14.180.67:42585)
I20260709 13:04:46.494095 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b125feea68040eeb559e4bfa093536c" candidate_uuid: "a0c7b7a30fcf412c85264c0ed126fede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c27090ad71542bca01248b778ff440b"
W20260709 13:04:46.495921 15232 leader_election.cc:343] T 5b125feea68040eeb559e4bfa093536c P a0c7b7a30fcf412c85264c0ed126fede [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6c27090ad71542bca01248b778ff440b (127.14.180.65:39863): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:46.501219 15391 raft_consensus.cc:2749] T 550f6b32ce5349e4a632e926d5a452de P 766aab97368b4169b07e508f36c4c0fb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:46.502254 15385 tablet_bootstrap.cc:654] T 4f665c7b3caa440fa5664a96decac188 P 6c27090ad71542bca01248b778ff440b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:46.502694 15422 raft_consensus.cc:493] T a7555eadc3bb496bb07b3cc6515fa680 P 766aab97368b4169b07e508f36c4c0fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:46.503573 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b125feea68040eeb559e4bfa093536c" candidate_uuid: "a0c7b7a30fcf412c85264c0ed126fede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "766aab97368b4169b07e508f36c4c0fb"
I20260709 13:04:46.503291 15422 raft_consensus.cc:515] T a7555eadc3bb496bb07b3cc6515fa680 P 766aab97368b4169b07e508f36c4c0fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:46.504930 15384 raft_consensus.cc:359] T a7555eadc3bb496bb07b3cc6515fa680 P a0c7b7a30fcf412c85264c0ed126fede [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:46.505764 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550f6b32ce5349e4a632e926d5a452de" candidate_uuid: "a0c7b7a30fcf412c85264c0ed126fede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c27090ad71542bca01248b778ff440b"
I20260709 13:04:46.507304 15384 raft_consensus.cc:385] T a7555eadc3bb496bb07b3cc6515fa680 P a0c7b7a30fcf412c85264c0ed126fede [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:46.507614 15384 raft_consensus.cc:740] T a7555eadc3bb496bb07b3cc6515fa680 P a0c7b7a30fcf412c85264c0ed126fede [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0c7b7a30fcf412c85264c0ed126fede, State: Initialized, Role: FOLLOWER
I20260709 13:04:46.507107 15419 raft_consensus.cc:493] T a7555eadc3bb496bb07b3cc6515fa680 P 6c27090ad71542bca01248b778ff440b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:46.508785 15232 leader_election.cc:343] T 550f6b32ce5349e4a632e926d5a452de P a0c7b7a30fcf412c85264c0ed126fede [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6c27090ad71542bca01248b778ff440b (127.14.180.65:39863): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:46.508410 15384 consensus_queue.cc:260] T a7555eadc3bb496bb07b3cc6515fa680 P a0c7b7a30fcf412c85264c0ed126fede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:46.509509 15386 tablet_bootstrap.cc:654] T 9f79381ee9024a9e985aab93d98359e5 P 766aab97368b4169b07e508f36c4c0fb: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:46.506338 15340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550f6b32ce5349e4a632e926d5a452de" candidate_uuid: "a0c7b7a30fcf412c85264c0ed126fede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "766aab97368b4169b07e508f36c4c0fb"
I20260709 13:04:46.509119 15419 raft_consensus.cc:515] T a7555eadc3bb496bb07b3cc6515fa680 P 6c27090ad71542bca01248b778ff440b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:46.510524 15384 ts_tablet_manager.cc:1434] T a7555eadc3bb496bb07b3cc6515fa680 P a0c7b7a30fcf412c85264c0ed126fede: Time spent starting tablet: real 0.036s	user 0.008s	sys 0.001s
I20260709 13:04:46.505013 15390 leader_election.cc:290] T 550f6b32ce5349e4a632e926d5a452de P a0c7b7a30fcf412c85264c0ed126fede [CANDIDATE]: Term 1 election: Requested vote from peers 6c27090ad71542bca01248b778ff440b (127.14.180.65:39863), 766aab97368b4169b07e508f36c4c0fb (127.14.180.67:42585)
I20260709 13:04:46.514130 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7555eadc3bb496bb07b3cc6515fa680" candidate_uuid: "766aab97368b4169b07e508f36c4c0fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c27090ad71542bca01248b778ff440b" is_pre_election: true
I20260709 13:04:46.514899 15192 raft_consensus.cc:2468] T a7555eadc3bb496bb07b3cc6515fa680 P 6c27090ad71542bca01248b778ff440b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 766aab97368b4169b07e508f36c4c0fb in term 0.
I20260709 13:04:46.515081 15419 leader_election.cc:290] T a7555eadc3bb496bb07b3cc6515fa680 P 6c27090ad71542bca01248b778ff440b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a0c7b7a30fcf412c85264c0ed126fede (127.14.180.66:33371), 766aab97368b4169b07e508f36c4c0fb (127.14.180.67:42585)
I20260709 13:04:46.517874 15384 tablet_bootstrap.cc:492] T 4f665c7b3caa440fa5664a96decac188 P a0c7b7a30fcf412c85264c0ed126fede: Bootstrap starting.
I20260709 13:04:46.516645 15306 leader_election.cc:304] T a7555eadc3bb496bb07b3cc6515fa680 P 766aab97368b4169b07e508f36c4c0fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c27090ad71542bca01248b778ff440b, 766aab97368b4169b07e508f36c4c0fb; no voters: 
I20260709 13:04:46.520522 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7555eadc3bb496bb07b3cc6515fa680" candidate_uuid: "6c27090ad71542bca01248b778ff440b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0c7b7a30fcf412c85264c0ed126fede" is_pre_election: true
I20260709 13:04:46.521466 15266 raft_consensus.cc:2468] T a7555eadc3bb496bb07b3cc6515fa680 P a0c7b7a30fcf412c85264c0ed126fede [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c27090ad71542bca01248b778ff440b in term 0.
I20260709 13:04:46.523444 15391 raft_consensus.cc:2804] T a7555eadc3bb496bb07b3cc6515fa680 P 766aab97368b4169b07e508f36c4c0fb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:46.523855 15391 raft_consensus.cc:493] T a7555eadc3bb496bb07b3cc6515fa680 P 766aab97368b4169b07e508f36c4c0fb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:46.524194 15391 raft_consensus.cc:3060] T a7555eadc3bb496bb07b3cc6515fa680 P 766aab97368b4169b07e508f36c4c0fb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:46.528345 15340 raft_consensus.cc:2468] T 550f6b32ce5349e4a632e926d5a452de P 766aab97368b4169b07e508f36c4c0fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0c7b7a30fcf412c85264c0ed126fede in term 1.
I20260709 13:04:46.530922 15158 leader_election.cc:304] T a7555eadc3bb496bb07b3cc6515fa680 P 6c27090ad71542bca01248b778ff440b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c27090ad71542bca01248b778ff440b, a0c7b7a30fcf412c85264c0ed126fede; no voters: 
I20260709 13:04:46.531414 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7555eadc3bb496bb07b3cc6515fa680" candidate_uuid: "6c27090ad71542bca01248b778ff440b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "766aab97368b4169b07e508f36c4c0fb" is_pre_election: true
I20260709 13:04:46.532980 15419 raft_consensus.cc:2804] T a7555eadc3bb496bb07b3cc6515fa680 P 6c27090ad71542bca01248b778ff440b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:46.533481 15233 leader_election.cc:304] T 550f6b32ce5349e4a632e926d5a452de P a0c7b7a30fcf412c85264c0ed126fede [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 766aab97368b4169b07e508f36c4c0fb, a0c7b7a30fcf412c85264c0ed126fede; no voters: 6c27090ad71542bca01248b778ff440b
I20260709 13:04:46.533553 15419 raft_consensus.cc:493] T a7555eadc3bb496bb07b3cc6515fa680 P 6c27090ad71542bca01248b778ff440b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:46.534493 15419 raft_consensus.cc:3060] T a7555eadc3bb496bb07b3cc6515fa680 P 6c27090ad71542bca01248b778ff440b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:46.534448 15390 raft_consensus.cc:2804] T 550f6b32ce5349e4a632e926d5a452de P a0c7b7a30fcf412c85264c0ed126fede [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:46.535370 15390 raft_consensus.cc:697] T 550f6b32ce5349e4a632e926d5a452de P a0c7b7a30fcf412c85264c0ed126fede [term 1 LEADER]: Becoming Leader. State: Replica: a0c7b7a30fcf412c85264c0ed126fede, State: Running, Role: LEADER
I20260709 13:04:46.536794 15390 consensus_queue.cc:237] T 550f6b32ce5349e4a632e926d5a452de P a0c7b7a30fcf412c85264c0ed126fede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:46.528825 15420 raft_consensus.cc:515] T 5b125feea68040eeb559e4bfa093536c P 766aab97368b4169b07e508f36c4c0fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:46.543243 15341 raft_consensus.cc:2393] T 5b125feea68040eeb559e4bfa093536c P 766aab97368b4169b07e508f36c4c0fb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a0c7b7a30fcf412c85264c0ed126fede in current term 1: Already voted for candidate 766aab97368b4169b07e508f36c4c0fb in this term.
I20260709 13:04:46.543175 15391 raft_consensus.cc:515] T a7555eadc3bb496bb07b3cc6515fa680 P 766aab97368b4169b07e508f36c4c0fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:46.545542 15339 raft_consensus.cc:2393] T a7555eadc3bb496bb07b3cc6515fa680 P 766aab97368b4169b07e508f36c4c0fb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c27090ad71542bca01248b778ff440b in current term 1: Already voted for candidate 766aab97368b4169b07e508f36c4c0fb in this term.
I20260709 13:04:46.547719 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7555eadc3bb496bb07b3cc6515fa680" candidate_uuid: "766aab97368b4169b07e508f36c4c0fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0c7b7a30fcf412c85264c0ed126fede" is_pre_election: true
I20260709 13:04:46.548420 15266 raft_consensus.cc:2468] T a7555eadc3bb496bb07b3cc6515fa680 P a0c7b7a30fcf412c85264c0ed126fede [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 766aab97368b4169b07e508f36c4c0fb in term 0.
I20260709 13:04:46.549612 15233 leader_election.cc:304] T 5b125feea68040eeb559e4bfa093536c P a0c7b7a30fcf412c85264c0ed126fede [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a0c7b7a30fcf412c85264c0ed126fede; no voters: 6c27090ad71542bca01248b778ff440b, 766aab97368b4169b07e508f36c4c0fb
I20260709 13:04:46.549901 15385 tablet_bootstrap.cc:492] T 4f665c7b3caa440fa5664a96decac188 P 6c27090ad71542bca01248b778ff440b: No bootstrap required, opened a new log
I20260709 13:04:46.550501 15385 ts_tablet_manager.cc:1403] T 4f665c7b3caa440fa5664a96decac188 P 6c27090ad71542bca01248b778ff440b: Time spent bootstrapping tablet: real 0.119s	user 0.017s	sys 0.022s
I20260709 13:04:46.550581 15401 raft_consensus.cc:2749] T 5b125feea68040eeb559e4bfa093536c P a0c7b7a30fcf412c85264c0ed126fede [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:04:46.556386 15391 leader_election.cc:290] T a7555eadc3bb496bb07b3cc6515fa680 P 766aab97368b4169b07e508f36c4c0fb [CANDIDATE]: Term 1 election: Requested vote from peers 6c27090ad71542bca01248b778ff440b (127.14.180.65:39863), a0c7b7a30fcf412c85264c0ed126fede (127.14.180.66:33371)
I20260709 13:04:46.557575 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7555eadc3bb496bb07b3cc6515fa680" candidate_uuid: "766aab97368b4169b07e508f36c4c0fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0c7b7a30fcf412c85264c0ed126fede"
I20260709 13:04:46.555655 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7555eadc3bb496bb07b3cc6515fa680" candidate_uuid: "766aab97368b4169b07e508f36c4c0fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c27090ad71542bca01248b778ff440b"
I20260709 13:04:46.559154 15420 leader_election.cc:290] T 5b125feea68040eeb559e4bfa093536c P 766aab97368b4169b07e508f36c4c0fb [CANDIDATE]: Term 1 election: Requested vote from peers 6c27090ad71542bca01248b778ff440b (127.14.180.65:39863), a0c7b7a30fcf412c85264c0ed126fede (127.14.180.66:33371)
I20260709 13:04:46.544840 15422 leader_election.cc:290] T a7555eadc3bb496bb07b3cc6515fa680 P 766aab97368b4169b07e508f36c4c0fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6c27090ad71542bca01248b778ff440b (127.14.180.65:39863), a0c7b7a30fcf412c85264c0ed126fede (127.14.180.66:33371)
I20260709 13:04:46.561873 15266 raft_consensus.cc:3060] T a7555eadc3bb496bb07b3cc6515fa680 P a0c7b7a30fcf412c85264c0ed126fede [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:46.561360 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b125feea68040eeb559e4bfa093536c" candidate_uuid: "766aab97368b4169b07e508f36c4c0fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c27090ad71542bca01248b778ff440b"
I20260709 13:04:46.564287 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b125feea68040eeb559e4bfa093536c" candidate_uuid: "766aab97368b4169b07e508f36c4c0fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0c7b7a30fcf412c85264c0ed126fede"
W20260709 13:04:46.564626 15306 leader_election.cc:343] T 5b125feea68040eeb559e4bfa093536c P 766aab97368b4169b07e508f36c4c0fb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6c27090ad71542bca01248b778ff440b (127.14.180.65:39863): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:46.578755 15267 raft_consensus.cc:2393] T 5b125feea68040eeb559e4bfa093536c P a0c7b7a30fcf412c85264c0ed126fede [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 766aab97368b4169b07e508f36c4c0fb in current term 1: Already voted for candidate a0c7b7a30fcf412c85264c0ed126fede in this term.
I20260709 13:04:46.562798 15086 catalog_manager.cc:5697] T 550f6b32ce5349e4a632e926d5a452de P a0c7b7a30fcf412c85264c0ed126fede reported cstate change: term changed from 0 to 1, leader changed from <none> to a0c7b7a30fcf412c85264c0ed126fede (127.14.180.66). New cstate: current_term: 1 leader_uuid: "a0c7b7a30fcf412c85264c0ed126fede" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:46.581667 15386 tablet_bootstrap.cc:492] T 9f79381ee9024a9e985aab93d98359e5 P 766aab97368b4169b07e508f36c4c0fb: No bootstrap required, opened a new log
I20260709 13:04:46.582244 15386 ts_tablet_manager.cc:1403] T 9f79381ee9024a9e985aab93d98359e5 P 766aab97368b4169b07e508f36c4c0fb: Time spent bootstrapping tablet: real 0.141s	user 0.016s	sys 0.008s
I20260709 13:04:46.582998 15307 leader_election.cc:304] T 5b125feea68040eeb559e4bfa093536c P 766aab97368b4169b07e508f36c4c0fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 766aab97368b4169b07e508f36c4c0fb; no voters: 6c27090ad71542bca01248b778ff440b, a0c7b7a30fcf412c85264c0ed126fede
I20260709 13:04:46.579880 15419 raft_consensus.cc:515] T a7555eadc3bb496bb07b3cc6515fa680 P 6c27090ad71542bca01248b778ff440b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:46.584304 15266 raft_consensus.cc:2468] T a7555eadc3bb496bb07b3cc6515fa680 P a0c7b7a30fcf412c85264c0ed126fede [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 766aab97368b4169b07e508f36c4c0fb in term 1.
I20260709 13:04:46.587100 15192 raft_consensus.cc:2393] T a7555eadc3bb496bb07b3cc6515fa680 P 6c27090ad71542bca01248b778ff440b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 766aab97368b4169b07e508f36c4c0fb in current term 1: Already voted for candidate 6c27090ad71542bca01248b778ff440b in this term.
I20260709 13:04:46.590690 15386 raft_consensus.cc:359] T 9f79381ee9024a9e985aab93d98359e5 P 766aab97368b4169b07e508f36c4c0fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:46.591347 15419 leader_election.cc:290] T a7555eadc3bb496bb07b3cc6515fa680 P 6c27090ad71542bca01248b778ff440b [CANDIDATE]: Term 1 election: Requested vote from peers a0c7b7a30fcf412c85264c0ed126fede (127.14.180.66:33371), 766aab97368b4169b07e508f36c4c0fb (127.14.180.67:42585)
I20260709 13:04:46.591485 15386 raft_consensus.cc:385] T 9f79381ee9024a9e985aab93d98359e5 P 766aab97368b4169b07e508f36c4c0fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:46.584440 15385 raft_consensus.cc:359] T 4f665c7b3caa440fa5664a96decac188 P 6c27090ad71542bca01248b778ff440b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:46.592213 15386 raft_consensus.cc:740] T 9f79381ee9024a9e985aab93d98359e5 P 766aab97368b4169b07e508f36c4c0fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 766aab97368b4169b07e508f36c4c0fb, State: Initialized, Role: FOLLOWER
I20260709 13:04:46.592675 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7555eadc3bb496bb07b3cc6515fa680" candidate_uuid: "6c27090ad71542bca01248b778ff440b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "766aab97368b4169b07e508f36c4c0fb"
I20260709 13:04:46.593577 15385 raft_consensus.cc:385] T 4f665c7b3caa440fa5664a96decac188 P 6c27090ad71542bca01248b778ff440b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:46.593953 15385 raft_consensus.cc:740] T 4f665c7b3caa440fa5664a96decac188 P 6c27090ad71542bca01248b778ff440b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c27090ad71542bca01248b778ff440b, State: Initialized, Role: FOLLOWER
I20260709 13:04:46.594218 15341 raft_consensus.cc:2393] T a7555eadc3bb496bb07b3cc6515fa680 P 766aab97368b4169b07e508f36c4c0fb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c27090ad71542bca01248b778ff440b in current term 1: Already voted for candidate 766aab97368b4169b07e508f36c4c0fb in this term.
I20260709 13:04:46.594130 15386 consensus_queue.cc:260] T 9f79381ee9024a9e985aab93d98359e5 P 766aab97368b4169b07e508f36c4c0fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:46.594738 15385 consensus_queue.cc:260] T 4f665c7b3caa440fa5664a96decac188 P 6c27090ad71542bca01248b778ff440b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:46.596372 15307 leader_election.cc:304] T a7555eadc3bb496bb07b3cc6515fa680 P 766aab97368b4169b07e508f36c4c0fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 766aab97368b4169b07e508f36c4c0fb, a0c7b7a30fcf412c85264c0ed126fede; no voters: 6c27090ad71542bca01248b778ff440b
I20260709 13:04:46.598703 15384 tablet_bootstrap.cc:654] T 4f665c7b3caa440fa5664a96decac188 P a0c7b7a30fcf412c85264c0ed126fede: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:46.600425 15420 raft_consensus.cc:2804] T a7555eadc3bb496bb07b3cc6515fa680 P 766aab97368b4169b07e508f36c4c0fb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:46.600966 15420 raft_consensus.cc:697] T a7555eadc3bb496bb07b3cc6515fa680 P 766aab97368b4169b07e508f36c4c0fb [term 1 LEADER]: Becoming Leader. State: Replica: 766aab97368b4169b07e508f36c4c0fb, State: Running, Role: LEADER
I20260709 13:04:46.586740 15422 raft_consensus.cc:2749] T 5b125feea68040eeb559e4bfa093536c P 766aab97368b4169b07e508f36c4c0fb [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:04:46.601805 15420 consensus_queue.cc:237] T a7555eadc3bb496bb07b3cc6515fa680 P 766aab97368b4169b07e508f36c4c0fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:46.596709 15386 ts_tablet_manager.cc:1434] T 9f79381ee9024a9e985aab93d98359e5 P 766aab97368b4169b07e508f36c4c0fb: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:04:46.603778 15386 tablet_bootstrap.cc:492] T d2a5b790ba6449afa2d539eb54aa63d5 P 766aab97368b4169b07e508f36c4c0fb: Bootstrap starting.
I20260709 13:04:46.598737 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7555eadc3bb496bb07b3cc6515fa680" candidate_uuid: "6c27090ad71542bca01248b778ff440b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0c7b7a30fcf412c85264c0ed126fede"
I20260709 13:04:46.604779 15385 ts_tablet_manager.cc:1434] T 4f665c7b3caa440fa5664a96decac188 P 6c27090ad71542bca01248b778ff440b: Time spent starting tablet: real 0.054s	user 0.008s	sys 0.000s
I20260709 13:04:46.608361 15385 tablet_bootstrap.cc:492] T 550f6b32ce5349e4a632e926d5a452de P 6c27090ad71542bca01248b778ff440b: Bootstrap starting.
I20260709 13:04:46.616297 15385 tablet_bootstrap.cc:654] T 550f6b32ce5349e4a632e926d5a452de P 6c27090ad71542bca01248b778ff440b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:46.605129 15266 raft_consensus.cc:2393] T a7555eadc3bb496bb07b3cc6515fa680 P a0c7b7a30fcf412c85264c0ed126fede [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6c27090ad71542bca01248b778ff440b in current term 1: Already voted for candidate 766aab97368b4169b07e508f36c4c0fb in this term.
I20260709 13:04:46.620460 15384 tablet_bootstrap.cc:492] T 4f665c7b3caa440fa5664a96decac188 P a0c7b7a30fcf412c85264c0ed126fede: No bootstrap required, opened a new log
I20260709 13:04:46.622355 15158 leader_election.cc:304] T a7555eadc3bb496bb07b3cc6515fa680 P 6c27090ad71542bca01248b778ff440b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c27090ad71542bca01248b778ff440b; no voters: 766aab97368b4169b07e508f36c4c0fb, a0c7b7a30fcf412c85264c0ed126fede
I20260709 13:04:46.622892 15384 ts_tablet_manager.cc:1403] T 4f665c7b3caa440fa5664a96decac188 P a0c7b7a30fcf412c85264c0ed126fede: Time spent bootstrapping tablet: real 0.105s	user 0.015s	sys 0.001s
I20260709 13:04:46.624292 15419 raft_consensus.cc:2749] T a7555eadc3bb496bb07b3cc6515fa680 P 6c27090ad71542bca01248b778ff440b [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:04:46.624008 15089 catalog_manager.cc:5697] T a7555eadc3bb496bb07b3cc6515fa680 P 766aab97368b4169b07e508f36c4c0fb reported cstate change: term changed from 0 to 1, leader changed from <none> to 766aab97368b4169b07e508f36c4c0fb (127.14.180.67). New cstate: current_term: 1 leader_uuid: "766aab97368b4169b07e508f36c4c0fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:46.627339 15384 raft_consensus.cc:359] T 4f665c7b3caa440fa5664a96decac188 P a0c7b7a30fcf412c85264c0ed126fede [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:46.628204 15384 raft_consensus.cc:385] T 4f665c7b3caa440fa5664a96decac188 P a0c7b7a30fcf412c85264c0ed126fede [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:46.628523 15384 raft_consensus.cc:740] T 4f665c7b3caa440fa5664a96decac188 P a0c7b7a30fcf412c85264c0ed126fede [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0c7b7a30fcf412c85264c0ed126fede, State: Initialized, Role: FOLLOWER
I20260709 13:04:46.632983 15386 tablet_bootstrap.cc:654] T d2a5b790ba6449afa2d539eb54aa63d5 P 766aab97368b4169b07e508f36c4c0fb: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:46.633334 15384 consensus_queue.cc:260] T 4f665c7b3caa440fa5664a96decac188 P a0c7b7a30fcf412c85264c0ed126fede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:46.637128 15384 ts_tablet_manager.cc:1434] T 4f665c7b3caa440fa5664a96decac188 P a0c7b7a30fcf412c85264c0ed126fede: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.002s
I20260709 13:04:46.638574 15384 tablet_bootstrap.cc:492] T d2a5b790ba6449afa2d539eb54aa63d5 P a0c7b7a30fcf412c85264c0ed126fede: Bootstrap starting.
I20260709 13:04:46.644639 15419 raft_consensus.cc:493] T 9f79381ee9024a9e985aab93d98359e5 P 6c27090ad71542bca01248b778ff440b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:46.645254 15419 raft_consensus.cc:515] T 9f79381ee9024a9e985aab93d98359e5 P 6c27090ad71542bca01248b778ff440b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:46.649212 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f79381ee9024a9e985aab93d98359e5" candidate_uuid: "6c27090ad71542bca01248b778ff440b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0c7b7a30fcf412c85264c0ed126fede" is_pre_election: true
I20260709 13:04:46.650866 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f79381ee9024a9e985aab93d98359e5" candidate_uuid: "6c27090ad71542bca01248b778ff440b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "766aab97368b4169b07e508f36c4c0fb" is_pre_election: true
I20260709 13:04:46.651678 15341 raft_consensus.cc:2468] T 9f79381ee9024a9e985aab93d98359e5 P 766aab97368b4169b07e508f36c4c0fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c27090ad71542bca01248b778ff440b in term 0.
I20260709 13:04:46.652907 15385 tablet_bootstrap.cc:492] T 550f6b32ce5349e4a632e926d5a452de P 6c27090ad71542bca01248b778ff440b: No bootstrap required, opened a new log
I20260709 13:04:46.653461 15385 ts_tablet_manager.cc:1403] T 550f6b32ce5349e4a632e926d5a452de P 6c27090ad71542bca01248b778ff440b: Time spent bootstrapping tablet: real 0.045s	user 0.009s	sys 0.009s
W20260709 13:04:46.653635 15158 leader_election.cc:343] T 9f79381ee9024a9e985aab93d98359e5 P 6c27090ad71542bca01248b778ff440b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a0c7b7a30fcf412c85264c0ed126fede (127.14.180.66:33371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:46.654323 15420 raft_consensus.cc:493] T e85d1b0d46a9459a863728eb3bb432c3 P 766aab97368b4169b07e508f36c4c0fb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:46.654511 15158 leader_election.cc:304] T 9f79381ee9024a9e985aab93d98359e5 P 6c27090ad71542bca01248b778ff440b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c27090ad71542bca01248b778ff440b, 766aab97368b4169b07e508f36c4c0fb; no voters: a0c7b7a30fcf412c85264c0ed126fede
I20260709 13:04:46.654865 15420 raft_consensus.cc:515] T e85d1b0d46a9459a863728eb3bb432c3 P 766aab97368b4169b07e508f36c4c0fb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:46.655961 15392 raft_consensus.cc:2804] T 9f79381ee9024a9e985aab93d98359e5 P 6c27090ad71542bca01248b778ff440b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:46.656387 15392 raft_consensus.cc:493] T 9f79381ee9024a9e985aab93d98359e5 P 6c27090ad71542bca01248b778ff440b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:46.656809 15392 raft_consensus.cc:3060] T 9f79381ee9024a9e985aab93d98359e5 P 6c27090ad71542bca01248b778ff440b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:46.657593 15384 tablet_bootstrap.cc:654] T d2a5b790ba6449afa2d539eb54aa63d5 P a0c7b7a30fcf412c85264c0ed126fede: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:46.657883 15192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85d1b0d46a9459a863728eb3bb432c3" candidate_uuid: "766aab97368b4169b07e508f36c4c0fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c27090ad71542bca01248b778ff440b" is_pre_election: true
W20260709 13:04:46.659636 15306 leader_election.cc:343] T e85d1b0d46a9459a863728eb3bb432c3 P 766aab97368b4169b07e508f36c4c0fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6c27090ad71542bca01248b778ff440b (127.14.180.65:39863): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:46.662883 15419 leader_election.cc:290] T 9f79381ee9024a9e985aab93d98359e5 P 6c27090ad71542bca01248b778ff440b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a0c7b7a30fcf412c85264c0ed126fede (127.14.180.66:33371), 766aab97368b4169b07e508f36c4c0fb (127.14.180.67:42585)
I20260709 13:04:46.664886 15192 raft_consensus.cc:3060] T c61fe875afff40e39c03b36e7266e263 P 6c27090ad71542bca01248b778ff440b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:46.665112 15385 raft_consensus.cc:359] T 550f6b32ce5349e4a632e926d5a452de P 6c27090ad71542bca01248b778ff440b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:46.665877 15420 leader_election.cc:290] T e85d1b0d46a9459a863728eb3bb432c3 P 766aab97368b4169b07e508f36c4c0fb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6c27090ad71542bca01248b778ff440b (127.14.180.65:39863), a0c7b7a30fcf412c85264c0ed126fede (127.14.180.66:33371)
I20260709 13:04:46.665967 15385 raft_consensus.cc:385] T 550f6b32ce5349e4a632e926d5a452de P 6c27090ad71542bca01248b778ff440b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:46.666433 15385 raft_consensus.cc:740] T 550f6b32ce5349e4a632e926d5a452de P 6c27090ad71542bca01248b778ff440b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c27090ad71542bca01248b778ff440b, State: Initialized, Role: FOLLOWER
I20260709 13:04:46.670766 15392 raft_consensus.cc:515] T 9f79381ee9024a9e985aab93d98359e5 P 6c27090ad71542bca01248b778ff440b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:46.671075 15385 consensus_queue.cc:260] T 550f6b32ce5349e4a632e926d5a452de P 6c27090ad71542bca01248b778ff440b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:46.673429 15385 ts_tablet_manager.cc:1434] T 550f6b32ce5349e4a632e926d5a452de P 6c27090ad71542bca01248b778ff440b: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 13:04:46.670804 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85d1b0d46a9459a863728eb3bb432c3" candidate_uuid: "766aab97368b4169b07e508f36c4c0fb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0c7b7a30fcf412c85264c0ed126fede" is_pre_election: true
I20260709 13:04:46.677251 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f79381ee9024a9e985aab93d98359e5" candidate_uuid: "6c27090ad71542bca01248b778ff440b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0c7b7a30fcf412c85264c0ed126fede"
W20260709 13:04:46.677531 15307 leader_election.cc:343] T e85d1b0d46a9459a863728eb3bb432c3 P 766aab97368b4169b07e508f36c4c0fb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a0c7b7a30fcf412c85264c0ed126fede (127.14.180.66:33371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:46.677956 15307 leader_election.cc:304] T e85d1b0d46a9459a863728eb3bb432c3 P 766aab97368b4169b07e508f36c4c0fb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 766aab97368b4169b07e508f36c4c0fb; no voters: 6c27090ad71542bca01248b778ff440b, a0c7b7a30fcf412c85264c0ed126fede
W20260709 13:04:46.678947 15158 leader_election.cc:343] T 9f79381ee9024a9e985aab93d98359e5 P 6c27090ad71542bca01248b778ff440b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a0c7b7a30fcf412c85264c0ed126fede (127.14.180.66:33371): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:46.679298 15390 consensus_queue.cc:1048] T c61fe875afff40e39c03b36e7266e263 P a0c7b7a30fcf412c85264c0ed126fede [LEADER]: Connected to new peer: Peer: permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:46.679983 15386 tablet_bootstrap.cc:492] T d2a5b790ba6449afa2d539eb54aa63d5 P 766aab97368b4169b07e508f36c4c0fb: No bootstrap required, opened a new log
I20260709 13:04:46.680405 15386 ts_tablet_manager.cc:1403] T d2a5b790ba6449afa2d539eb54aa63d5 P 766aab97368b4169b07e508f36c4c0fb: Time spent bootstrapping tablet: real 0.077s	user 0.013s	sys 0.009s
I20260709 13:04:46.681627 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f79381ee9024a9e985aab93d98359e5" candidate_uuid: "6c27090ad71542bca01248b778ff440b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "766aab97368b4169b07e508f36c4c0fb"
I20260709 13:04:46.682228 15341 raft_consensus.cc:3060] T 9f79381ee9024a9e985aab93d98359e5 P 766aab97368b4169b07e508f36c4c0fb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:46.682708 15422 raft_consensus.cc:2749] T e85d1b0d46a9459a863728eb3bb432c3 P 766aab97368b4169b07e508f36c4c0fb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:46.682825 15386 raft_consensus.cc:359] T d2a5b790ba6449afa2d539eb54aa63d5 P 766aab97368b4169b07e508f36c4c0fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:46.683499 15386 raft_consensus.cc:385] T d2a5b790ba6449afa2d539eb54aa63d5 P 766aab97368b4169b07e508f36c4c0fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:46.683768 15386 raft_consensus.cc:740] T d2a5b790ba6449afa2d539eb54aa63d5 P 766aab97368b4169b07e508f36c4c0fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 766aab97368b4169b07e508f36c4c0fb, State: Initialized, Role: FOLLOWER
I20260709 13:04:46.684405 15386 consensus_queue.cc:260] T d2a5b790ba6449afa2d539eb54aa63d5 P 766aab97368b4169b07e508f36c4c0fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:46.686342 15386 ts_tablet_manager.cc:1434] T d2a5b790ba6449afa2d539eb54aa63d5 P 766aab97368b4169b07e508f36c4c0fb: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.002s
I20260709 13:04:46.687286 15386 tablet_bootstrap.cc:492] T 4f665c7b3caa440fa5664a96decac188 P 766aab97368b4169b07e508f36c4c0fb: Bootstrap starting.
I20260709 13:04:46.691681 15385 tablet_bootstrap.cc:492] T 5b125feea68040eeb559e4bfa093536c P 6c27090ad71542bca01248b778ff440b: Bootstrap starting.
I20260709 13:04:46.692781 15392 leader_election.cc:290] T 9f79381ee9024a9e985aab93d98359e5 P 6c27090ad71542bca01248b778ff440b [CANDIDATE]: Term 1 election: Requested vote from peers a0c7b7a30fcf412c85264c0ed126fede (127.14.180.66:33371), 766aab97368b4169b07e508f36c4c0fb (127.14.180.67:42585)
I20260709 13:04:46.691630 15390 consensus_queue.cc:1048] T c61fe875afff40e39c03b36e7266e263 P a0c7b7a30fcf412c85264c0ed126fede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:04:46.695125 15341 raft_consensus.cc:2468] T 9f79381ee9024a9e985aab93d98359e5 P 766aab97368b4169b07e508f36c4c0fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c27090ad71542bca01248b778ff440b in term 1.
I20260709 13:04:46.699783 15386 tablet_bootstrap.cc:654] T 4f665c7b3caa440fa5664a96decac188 P 766aab97368b4169b07e508f36c4c0fb: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:46.700121 15385 tablet_bootstrap.cc:654] T 5b125feea68040eeb559e4bfa093536c P 6c27090ad71542bca01248b778ff440b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:46.705612 15158 leader_election.cc:304] T 9f79381ee9024a9e985aab93d98359e5 P 6c27090ad71542bca01248b778ff440b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c27090ad71542bca01248b778ff440b, 766aab97368b4169b07e508f36c4c0fb; no voters: a0c7b7a30fcf412c85264c0ed126fede
I20260709 13:04:46.707170 15392 raft_consensus.cc:2804] T 9f79381ee9024a9e985aab93d98359e5 P 6c27090ad71542bca01248b778ff440b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:46.707998 15392 raft_consensus.cc:697] T 9f79381ee9024a9e985aab93d98359e5 P 6c27090ad71542bca01248b778ff440b [term 1 LEADER]: Becoming Leader. State: Replica: 6c27090ad71542bca01248b778ff440b, State: Running, Role: LEADER
I20260709 13:04:46.708684 15419 raft_consensus.cc:493] T 4f665c7b3caa440fa5664a96decac188 P 6c27090ad71542bca01248b778ff440b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:46.709447 15419 raft_consensus.cc:515] T 4f665c7b3caa440fa5664a96decac188 P 6c27090ad71542bca01248b778ff440b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:46.719430 15419 leader_election.cc:290] T 4f665c7b3caa440fa5664a96decac188 P 6c27090ad71542bca01248b778ff440b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a0c7b7a30fcf412c85264c0ed126fede (127.14.180.66:33371), 766aab97368b4169b07e508f36c4c0fb (127.14.180.67:42585)
I20260709 13:04:46.721930 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f665c7b3caa440fa5664a96decac188" candidate_uuid: "6c27090ad71542bca01248b778ff440b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0c7b7a30fcf412c85264c0ed126fede" is_pre_election: true
I20260709 13:04:46.720873 15392 consensus_queue.cc:237] T 9f79381ee9024a9e985aab93d98359e5 P 6c27090ad71542bca01248b778ff440b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:46.726023 15266 raft_consensus.cc:2468] T 4f665c7b3caa440fa5664a96decac188 P a0c7b7a30fcf412c85264c0ed126fede [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c27090ad71542bca01248b778ff440b in term 0.
I20260709 13:04:46.729635 15385 tablet_bootstrap.cc:492] T 5b125feea68040eeb559e4bfa093536c P 6c27090ad71542bca01248b778ff440b: No bootstrap required, opened a new log
I20260709 13:04:46.730262 15385 ts_tablet_manager.cc:1403] T 5b125feea68040eeb559e4bfa093536c P 6c27090ad71542bca01248b778ff440b: Time spent bootstrapping tablet: real 0.039s	user 0.020s	sys 0.004s
I20260709 13:04:46.728828 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f665c7b3caa440fa5664a96decac188" candidate_uuid: "6c27090ad71542bca01248b778ff440b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "766aab97368b4169b07e508f36c4c0fb" is_pre_election: true
I20260709 13:04:46.735597 15158 leader_election.cc:304] T 4f665c7b3caa440fa5664a96decac188 P 6c27090ad71542bca01248b778ff440b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c27090ad71542bca01248b778ff440b, a0c7b7a30fcf412c85264c0ed126fede; no voters: 
I20260709 13:04:46.736413 15386 tablet_bootstrap.cc:492] T 4f665c7b3caa440fa5664a96decac188 P 766aab97368b4169b07e508f36c4c0fb: No bootstrap required, opened a new log
I20260709 13:04:46.745947 15386 ts_tablet_manager.cc:1403] T 4f665c7b3caa440fa5664a96decac188 P 766aab97368b4169b07e508f36c4c0fb: Time spent bootstrapping tablet: real 0.059s	user 0.010s	sys 0.017s
I20260709 13:04:46.749974 15384 tablet_bootstrap.cc:492] T d2a5b790ba6449afa2d539eb54aa63d5 P a0c7b7a30fcf412c85264c0ed126fede: No bootstrap required, opened a new log
I20260709 13:04:46.747699 15419 raft_consensus.cc:2804] T 4f665c7b3caa440fa5664a96decac188 P 6c27090ad71542bca01248b778ff440b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:46.755628 15419 raft_consensus.cc:493] T 4f665c7b3caa440fa5664a96decac188 P 6c27090ad71542bca01248b778ff440b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:46.762485 15419 raft_consensus.cc:3060] T 4f665c7b3caa440fa5664a96decac188 P 6c27090ad71542bca01248b778ff440b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:46.754262 15384 ts_tablet_manager.cc:1403] T d2a5b790ba6449afa2d539eb54aa63d5 P a0c7b7a30fcf412c85264c0ed126fede: Time spent bootstrapping tablet: real 0.116s	user 0.017s	sys 0.006s
W20260709 13:04:46.754091 15158 leader_election.cc:343] T 4f665c7b3caa440fa5664a96decac188 P 6c27090ad71542bca01248b778ff440b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 766aab97368b4169b07e508f36c4c0fb (127.14.180.67:42585): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:46.782469 15137 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:46.783829 15384 raft_consensus.cc:359] T d2a5b790ba6449afa2d539eb54aa63d5 P a0c7b7a30fcf412c85264c0ed126fede [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:46.785861 15384 raft_consensus.cc:385] T d2a5b790ba6449afa2d539eb54aa63d5 P a0c7b7a30fcf412c85264c0ed126fede [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:46.786883 15386 raft_consensus.cc:359] T 4f665c7b3caa440fa5664a96decac188 P 766aab97368b4169b07e508f36c4c0fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:46.787726 15386 raft_consensus.cc:385] T 4f665c7b3caa440fa5664a96decac188 P 766aab97368b4169b07e508f36c4c0fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:46.788053 15386 raft_consensus.cc:740] T 4f665c7b3caa440fa5664a96decac188 P 766aab97368b4169b07e508f36c4c0fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 766aab97368b4169b07e508f36c4c0fb, State: Initialized, Role: FOLLOWER
I20260709 13:04:46.788857 15386 consensus_queue.cc:260] T 4f665c7b3caa440fa5664a96decac188 P 766aab97368b4169b07e508f36c4c0fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:46.781772 15419 raft_consensus.cc:515] T 4f665c7b3caa440fa5664a96decac188 P 6c27090ad71542bca01248b778ff440b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:46.792055 15385 raft_consensus.cc:359] T 5b125feea68040eeb559e4bfa093536c P 6c27090ad71542bca01248b778ff440b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:46.793377 15385 raft_consensus.cc:385] T 5b125feea68040eeb559e4bfa093536c P 6c27090ad71542bca01248b778ff440b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:46.786414 15384 raft_consensus.cc:740] T d2a5b790ba6449afa2d539eb54aa63d5 P a0c7b7a30fcf412c85264c0ed126fede [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0c7b7a30fcf412c85264c0ed126fede, State: Initialized, Role: FOLLOWER
I20260709 13:04:46.801131 15385 raft_consensus.cc:740] T 5b125feea68040eeb559e4bfa093536c P 6c27090ad71542bca01248b778ff440b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c27090ad71542bca01248b778ff440b, State: Initialized, Role: FOLLOWER
I20260709 13:04:46.799607 15088 catalog_manager.cc:5697] T 9f79381ee9024a9e985aab93d98359e5 P 6c27090ad71542bca01248b778ff440b reported cstate change: term changed from 0 to 1, leader changed from <none> to 6c27090ad71542bca01248b778ff440b (127.14.180.65). New cstate: current_term: 1 leader_uuid: "6c27090ad71542bca01248b778ff440b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:46.804916 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f665c7b3caa440fa5664a96decac188" candidate_uuid: "6c27090ad71542bca01248b778ff440b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "766aab97368b4169b07e508f36c4c0fb"
I20260709 13:04:46.804746 15385 consensus_queue.cc:260] T 5b125feea68040eeb559e4bfa093536c P 6c27090ad71542bca01248b778ff440b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:46.805640 15339 raft_consensus.cc:3060] T 4f665c7b3caa440fa5664a96decac188 P 766aab97368b4169b07e508f36c4c0fb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:46.805349 15384 consensus_queue.cc:260] T d2a5b790ba6449afa2d539eb54aa63d5 P a0c7b7a30fcf412c85264c0ed126fede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:46.803735 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f665c7b3caa440fa5664a96decac188" candidate_uuid: "6c27090ad71542bca01248b778ff440b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0c7b7a30fcf412c85264c0ed126fede"
I20260709 13:04:46.808962 15266 raft_consensus.cc:3060] T 4f665c7b3caa440fa5664a96decac188 P a0c7b7a30fcf412c85264c0ed126fede [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:46.809302 15384 ts_tablet_manager.cc:1434] T d2a5b790ba6449afa2d539eb54aa63d5 P a0c7b7a30fcf412c85264c0ed126fede: Time spent starting tablet: real 0.041s	user 0.006s	sys 0.001s
I20260709 13:04:46.798950 15419 leader_election.cc:290] T 4f665c7b3caa440fa5664a96decac188 P 6c27090ad71542bca01248b778ff440b [CANDIDATE]: Term 1 election: Requested vote from peers a0c7b7a30fcf412c85264c0ed126fede (127.14.180.66:33371), 766aab97368b4169b07e508f36c4c0fb (127.14.180.67:42585)
I20260709 13:04:46.806466 15386 ts_tablet_manager.cc:1434] T 4f665c7b3caa440fa5664a96decac188 P 766aab97368b4169b07e508f36c4c0fb: Time spent starting tablet: real 0.060s	user 0.003s	sys 0.006s
I20260709 13:04:46.825639 15266 raft_consensus.cc:2468] T 4f665c7b3caa440fa5664a96decac188 P a0c7b7a30fcf412c85264c0ed126fede [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c27090ad71542bca01248b778ff440b in term 1.
I20260709 13:04:46.818583 15384 tablet_bootstrap.cc:492] T e85d1b0d46a9459a863728eb3bb432c3 P a0c7b7a30fcf412c85264c0ed126fede: Bootstrap starting.
I20260709 13:04:46.822317 15339 raft_consensus.cc:2468] T 4f665c7b3caa440fa5664a96decac188 P 766aab97368b4169b07e508f36c4c0fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c27090ad71542bca01248b778ff440b in term 1.
I20260709 13:04:46.830430 15420 raft_consensus.cc:493] T 4f665c7b3caa440fa5664a96decac188 P 766aab97368b4169b07e508f36c4c0fb [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:46.830879 15158 leader_election.cc:304] T 4f665c7b3caa440fa5664a96decac188 P 6c27090ad71542bca01248b778ff440b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c27090ad71542bca01248b778ff440b, a0c7b7a30fcf412c85264c0ed126fede; no voters: 
I20260709 13:04:46.830986 15420 raft_consensus.cc:515] T 4f665c7b3caa440fa5664a96decac188 P 766aab97368b4169b07e508f36c4c0fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:46.833792 15440 raft_consensus.cc:2804] T 4f665c7b3caa440fa5664a96decac188 P 6c27090ad71542bca01248b778ff440b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:46.834725 15440 raft_consensus.cc:697] T 4f665c7b3caa440fa5664a96decac188 P 6c27090ad71542bca01248b778ff440b [term 1 LEADER]: Becoming Leader. State: Replica: 6c27090ad71542bca01248b778ff440b, State: Running, Role: LEADER
I20260709 13:04:46.835646 15440 consensus_queue.cc:237] T 4f665c7b3caa440fa5664a96decac188 P 6c27090ad71542bca01248b778ff440b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:46.839123 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f665c7b3caa440fa5664a96decac188" candidate_uuid: "766aab97368b4169b07e508f36c4c0fb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c27090ad71542bca01248b778ff440b" is_pre_election: true
I20260709 13:04:46.840960 15384 tablet_bootstrap.cc:654] T e85d1b0d46a9459a863728eb3bb432c3 P a0c7b7a30fcf412c85264c0ed126fede: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:46.843712 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f665c7b3caa440fa5664a96decac188" candidate_uuid: "766aab97368b4169b07e508f36c4c0fb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0c7b7a30fcf412c85264c0ed126fede" is_pre_election: true
I20260709 13:04:46.844661 15266 raft_consensus.cc:2468] T 4f665c7b3caa440fa5664a96decac188 P a0c7b7a30fcf412c85264c0ed126fede [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 766aab97368b4169b07e508f36c4c0fb in term 1.
I20260709 13:04:46.845690 15420 leader_election.cc:290] T 4f665c7b3caa440fa5664a96decac188 P 766aab97368b4169b07e508f36c4c0fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6c27090ad71542bca01248b778ff440b (127.14.180.65:39863), a0c7b7a30fcf412c85264c0ed126fede (127.14.180.66:33371)
I20260709 13:04:46.846199 15307 leader_election.cc:304] T 4f665c7b3caa440fa5664a96decac188 P 766aab97368b4169b07e508f36c4c0fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 766aab97368b4169b07e508f36c4c0fb, a0c7b7a30fcf412c85264c0ed126fede; no voters: 6c27090ad71542bca01248b778ff440b
I20260709 13:04:46.847667 15420 raft_consensus.cc:2804] T 4f665c7b3caa440fa5664a96decac188 P 766aab97368b4169b07e508f36c4c0fb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:46.848179 15420 raft_consensus.cc:493] T 4f665c7b3caa440fa5664a96decac188 P 766aab97368b4169b07e508f36c4c0fb [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:46.849910 15420 raft_consensus.cc:3060] T 4f665c7b3caa440fa5664a96decac188 P 766aab97368b4169b07e508f36c4c0fb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:46.850533 15385 ts_tablet_manager.cc:1434] T 5b125feea68040eeb559e4bfa093536c P 6c27090ad71542bca01248b778ff440b: Time spent starting tablet: real 0.120s	user 0.008s	sys 0.006s
I20260709 13:04:46.851858 15385 tablet_bootstrap.cc:492] T e85d1b0d46a9459a863728eb3bb432c3 P 6c27090ad71542bca01248b778ff440b: Bootstrap starting.
I20260709 13:04:46.855484 15384 tablet_bootstrap.cc:492] T e85d1b0d46a9459a863728eb3bb432c3 P a0c7b7a30fcf412c85264c0ed126fede: No bootstrap required, opened a new log
I20260709 13:04:46.855997 15384 ts_tablet_manager.cc:1403] T e85d1b0d46a9459a863728eb3bb432c3 P a0c7b7a30fcf412c85264c0ed126fede: Time spent bootstrapping tablet: real 0.038s	user 0.015s	sys 0.000s
I20260709 13:04:46.858108 15420 raft_consensus.cc:515] T 4f665c7b3caa440fa5664a96decac188 P 766aab97368b4169b07e508f36c4c0fb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:46.858911 15384 raft_consensus.cc:359] T e85d1b0d46a9459a863728eb3bb432c3 P a0c7b7a30fcf412c85264c0ed126fede [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:46.859639 15384 raft_consensus.cc:385] T e85d1b0d46a9459a863728eb3bb432c3 P a0c7b7a30fcf412c85264c0ed126fede [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:46.859915 15384 raft_consensus.cc:740] T e85d1b0d46a9459a863728eb3bb432c3 P a0c7b7a30fcf412c85264c0ed126fede [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0c7b7a30fcf412c85264c0ed126fede, State: Initialized, Role: FOLLOWER
I20260709 13:04:46.859287 15086 catalog_manager.cc:5697] T 4f665c7b3caa440fa5664a96decac188 P 6c27090ad71542bca01248b778ff440b reported cstate change: term changed from 0 to 1, leader changed from <none> to 6c27090ad71542bca01248b778ff440b (127.14.180.65). New cstate: current_term: 1 leader_uuid: "6c27090ad71542bca01248b778ff440b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:46.860741 15384 consensus_queue.cc:260] T e85d1b0d46a9459a863728eb3bb432c3 P a0c7b7a30fcf412c85264c0ed126fede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:46.863179 15384 ts_tablet_manager.cc:1434] T e85d1b0d46a9459a863728eb3bb432c3 P a0c7b7a30fcf412c85264c0ed126fede: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:04:46.864197 15384 tablet_bootstrap.cc:492] T 9f79381ee9024a9e985aab93d98359e5 P a0c7b7a30fcf412c85264c0ed126fede: Bootstrap starting.
I20260709 13:04:46.870898 15384 tablet_bootstrap.cc:654] T 9f79381ee9024a9e985aab93d98359e5 P a0c7b7a30fcf412c85264c0ed126fede: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:46.871394 15385 tablet_bootstrap.cc:654] T e85d1b0d46a9459a863728eb3bb432c3 P 6c27090ad71542bca01248b778ff440b: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:46.885987 15385 tablet_bootstrap.cc:492] T e85d1b0d46a9459a863728eb3bb432c3 P 6c27090ad71542bca01248b778ff440b: No bootstrap required, opened a new log
I20260709 13:04:46.886682 15385 ts_tablet_manager.cc:1403] T e85d1b0d46a9459a863728eb3bb432c3 P 6c27090ad71542bca01248b778ff440b: Time spent bootstrapping tablet: real 0.035s	user 0.013s	sys 0.000s
I20260709 13:04:46.891846 15440 raft_consensus.cc:493] T 5b125feea68040eeb559e4bfa093536c P 6c27090ad71542bca01248b778ff440b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:46.892102 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f665c7b3caa440fa5664a96decac188" candidate_uuid: "766aab97368b4169b07e508f36c4c0fb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c27090ad71542bca01248b778ff440b"
I20260709 13:04:46.892608 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f665c7b3caa440fa5664a96decac188" candidate_uuid: "766aab97368b4169b07e508f36c4c0fb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0c7b7a30fcf412c85264c0ed126fede"
I20260709 13:04:46.892398 15440 raft_consensus.cc:515] T 5b125feea68040eeb559e4bfa093536c P 6c27090ad71542bca01248b778ff440b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:46.893191 15266 raft_consensus.cc:3060] T 4f665c7b3caa440fa5664a96decac188 P a0c7b7a30fcf412c85264c0ed126fede [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:46.894598 15440 leader_election.cc:290] T 5b125feea68040eeb559e4bfa093536c P 6c27090ad71542bca01248b778ff440b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a0c7b7a30fcf412c85264c0ed126fede (127.14.180.66:33371), 766aab97368b4169b07e508f36c4c0fb (127.14.180.67:42585)
I20260709 13:04:46.896705 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b125feea68040eeb559e4bfa093536c" candidate_uuid: "6c27090ad71542bca01248b778ff440b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0c7b7a30fcf412c85264c0ed126fede" is_pre_election: true
I20260709 13:04:46.897087 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b125feea68040eeb559e4bfa093536c" candidate_uuid: "6c27090ad71542bca01248b778ff440b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "766aab97368b4169b07e508f36c4c0fb" is_pre_election: true
I20260709 13:04:46.897554 15267 raft_consensus.cc:2393] T 5b125feea68040eeb559e4bfa093536c P a0c7b7a30fcf412c85264c0ed126fede [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c27090ad71542bca01248b778ff440b in current term 1: Already voted for candidate a0c7b7a30fcf412c85264c0ed126fede in this term.
I20260709 13:04:46.897923 15339 raft_consensus.cc:2393] T 5b125feea68040eeb559e4bfa093536c P 766aab97368b4169b07e508f36c4c0fb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c27090ad71542bca01248b778ff440b in current term 1: Already voted for candidate 766aab97368b4169b07e508f36c4c0fb in this term.
I20260709 13:04:46.900002 15158 leader_election.cc:304] T 5b125feea68040eeb559e4bfa093536c P 6c27090ad71542bca01248b778ff440b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c27090ad71542bca01248b778ff440b; no voters: 766aab97368b4169b07e508f36c4c0fb, a0c7b7a30fcf412c85264c0ed126fede
I20260709 13:04:46.900352 15420 leader_election.cc:290] T 4f665c7b3caa440fa5664a96decac188 P 766aab97368b4169b07e508f36c4c0fb [CANDIDATE]: Term 2 election: Requested vote from peers 6c27090ad71542bca01248b778ff440b (127.14.180.65:39863), a0c7b7a30fcf412c85264c0ed126fede (127.14.180.66:33371)
I20260709 13:04:46.901194 15440 raft_consensus.cc:3060] T 5b125feea68040eeb559e4bfa093536c P 6c27090ad71542bca01248b778ff440b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:46.902082 15385 raft_consensus.cc:359] T e85d1b0d46a9459a863728eb3bb432c3 P 6c27090ad71542bca01248b778ff440b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:46.902936 15385 raft_consensus.cc:385] T e85d1b0d46a9459a863728eb3bb432c3 P 6c27090ad71542bca01248b778ff440b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:46.903273 15385 raft_consensus.cc:740] T e85d1b0d46a9459a863728eb3bb432c3 P 6c27090ad71542bca01248b778ff440b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c27090ad71542bca01248b778ff440b, State: Initialized, Role: FOLLOWER
I20260709 13:04:46.904289 15385 consensus_queue.cc:260] T e85d1b0d46a9459a863728eb3bb432c3 P 6c27090ad71542bca01248b778ff440b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:46.902091 15266 raft_consensus.cc:2468] T 4f665c7b3caa440fa5664a96decac188 P a0c7b7a30fcf412c85264c0ed126fede [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 766aab97368b4169b07e508f36c4c0fb in term 2.
I20260709 13:04:46.908296 15307 leader_election.cc:304] T 4f665c7b3caa440fa5664a96decac188 P 766aab97368b4169b07e508f36c4c0fb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 766aab97368b4169b07e508f36c4c0fb, a0c7b7a30fcf412c85264c0ed126fede; no voters: 6c27090ad71542bca01248b778ff440b
I20260709 13:04:46.909169 15420 raft_consensus.cc:2804] T 4f665c7b3caa440fa5664a96decac188 P 766aab97368b4169b07e508f36c4c0fb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:46.909698 15420 raft_consensus.cc:697] T 4f665c7b3caa440fa5664a96decac188 P 766aab97368b4169b07e508f36c4c0fb [term 2 LEADER]: Becoming Leader. State: Replica: 766aab97368b4169b07e508f36c4c0fb, State: Running, Role: LEADER
I20260709 13:04:46.910526 15420 consensus_queue.cc:237] T 4f665c7b3caa440fa5664a96decac188 P 766aab97368b4169b07e508f36c4c0fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:46.913679 15440 raft_consensus.cc:2749] T 5b125feea68040eeb559e4bfa093536c P 6c27090ad71542bca01248b778ff440b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:46.908711 15385 ts_tablet_manager.cc:1434] T e85d1b0d46a9459a863728eb3bb432c3 P 6c27090ad71542bca01248b778ff440b: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 13:04:46.918351 15384 tablet_bootstrap.cc:492] T 9f79381ee9024a9e985aab93d98359e5 P a0c7b7a30fcf412c85264c0ed126fede: No bootstrap required, opened a new log
I20260709 13:04:46.918946 15384 ts_tablet_manager.cc:1403] T 9f79381ee9024a9e985aab93d98359e5 P a0c7b7a30fcf412c85264c0ed126fede: Time spent bootstrapping tablet: real 0.055s	user 0.016s	sys 0.011s
I20260709 13:04:46.919036 15339 raft_consensus.cc:3060] T b88f6a525ac24e259e1331eaaa2f41ac P 766aab97368b4169b07e508f36c4c0fb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:46.921909 15384 raft_consensus.cc:359] T 9f79381ee9024a9e985aab93d98359e5 P a0c7b7a30fcf412c85264c0ed126fede [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:46.922760 15384 raft_consensus.cc:385] T 9f79381ee9024a9e985aab93d98359e5 P a0c7b7a30fcf412c85264c0ed126fede [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:46.923100 15384 raft_consensus.cc:740] T 9f79381ee9024a9e985aab93d98359e5 P a0c7b7a30fcf412c85264c0ed126fede [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0c7b7a30fcf412c85264c0ed126fede, State: Initialized, Role: FOLLOWER
I20260709 13:04:46.924010 15384 consensus_queue.cc:260] T 9f79381ee9024a9e985aab93d98359e5 P a0c7b7a30fcf412c85264c0ed126fede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:46.924708 15086 catalog_manager.cc:5697] T 4f665c7b3caa440fa5664a96decac188 P 766aab97368b4169b07e508f36c4c0fb reported cstate change: term changed from 1 to 2, leader changed from 6c27090ad71542bca01248b778ff440b (127.14.180.65) to 766aab97368b4169b07e508f36c4c0fb (127.14.180.67). New cstate: current_term: 2 leader_uuid: "766aab97368b4169b07e508f36c4c0fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:46.927894 15384 ts_tablet_manager.cc:1434] T 9f79381ee9024a9e985aab93d98359e5 P a0c7b7a30fcf412c85264c0ed126fede: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.001s
I20260709 13:04:46.932420 15191 raft_consensus.cc:3060] T 550f6b32ce5349e4a632e926d5a452de P 6c27090ad71542bca01248b778ff440b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:46.934760 15390 consensus_queue.cc:1048] T b88f6a525ac24e259e1331eaaa2f41ac P a0c7b7a30fcf412c85264c0ed126fede [LEADER]: Connected to new peer: Peer: permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:46.946882 15401 consensus_queue.cc:1048] T 550f6b32ce5349e4a632e926d5a452de P a0c7b7a30fcf412c85264c0ed126fede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:46.957077 15390 consensus_queue.cc:1048] T b88f6a525ac24e259e1331eaaa2f41ac P a0c7b7a30fcf412c85264c0ed126fede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:46.968771 15390 consensus_queue.cc:1048] T 550f6b32ce5349e4a632e926d5a452de P a0c7b7a30fcf412c85264c0ed126fede [LEADER]: Connected to new peer: Peer: permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:47.007609 15440 raft_consensus.cc:493] T e85d1b0d46a9459a863728eb3bb432c3 P 6c27090ad71542bca01248b778ff440b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:47.008251 15440 raft_consensus.cc:515] T e85d1b0d46a9459a863728eb3bb432c3 P 6c27090ad71542bca01248b778ff440b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:47.010058 15440 leader_election.cc:290] T e85d1b0d46a9459a863728eb3bb432c3 P 6c27090ad71542bca01248b778ff440b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a0c7b7a30fcf412c85264c0ed126fede (127.14.180.66:33371), 766aab97368b4169b07e508f36c4c0fb (127.14.180.67:42585)
I20260709 13:04:47.010970 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85d1b0d46a9459a863728eb3bb432c3" candidate_uuid: "6c27090ad71542bca01248b778ff440b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0c7b7a30fcf412c85264c0ed126fede" is_pre_election: true
I20260709 13:04:47.011209 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85d1b0d46a9459a863728eb3bb432c3" candidate_uuid: "6c27090ad71542bca01248b778ff440b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "766aab97368b4169b07e508f36c4c0fb" is_pre_election: true
I20260709 13:04:47.011700 15266 raft_consensus.cc:2468] T e85d1b0d46a9459a863728eb3bb432c3 P a0c7b7a30fcf412c85264c0ed126fede [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c27090ad71542bca01248b778ff440b in term 0.
I20260709 13:04:47.011868 15341 raft_consensus.cc:2468] T e85d1b0d46a9459a863728eb3bb432c3 P 766aab97368b4169b07e508f36c4c0fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c27090ad71542bca01248b778ff440b in term 0.
I20260709 13:04:47.012928 15158 leader_election.cc:304] T e85d1b0d46a9459a863728eb3bb432c3 P 6c27090ad71542bca01248b778ff440b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c27090ad71542bca01248b778ff440b, a0c7b7a30fcf412c85264c0ed126fede; no voters: 
I20260709 13:04:47.013818 15440 raft_consensus.cc:2804] T e85d1b0d46a9459a863728eb3bb432c3 P 6c27090ad71542bca01248b778ff440b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:47.014240 15440 raft_consensus.cc:493] T e85d1b0d46a9459a863728eb3bb432c3 P 6c27090ad71542bca01248b778ff440b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:47.014616 15440 raft_consensus.cc:3060] T e85d1b0d46a9459a863728eb3bb432c3 P 6c27090ad71542bca01248b778ff440b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:47.020502 15440 raft_consensus.cc:515] T e85d1b0d46a9459a863728eb3bb432c3 P 6c27090ad71542bca01248b778ff440b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:47.023140 15440 leader_election.cc:290] T e85d1b0d46a9459a863728eb3bb432c3 P 6c27090ad71542bca01248b778ff440b [CANDIDATE]: Term 1 election: Requested vote from peers a0c7b7a30fcf412c85264c0ed126fede (127.14.180.66:33371), 766aab97368b4169b07e508f36c4c0fb (127.14.180.67:42585)
I20260709 13:04:47.024106 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85d1b0d46a9459a863728eb3bb432c3" candidate_uuid: "6c27090ad71542bca01248b778ff440b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0c7b7a30fcf412c85264c0ed126fede"
I20260709 13:04:47.024837 15266 raft_consensus.cc:3060] T e85d1b0d46a9459a863728eb3bb432c3 P a0c7b7a30fcf412c85264c0ed126fede [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:47.026264 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85d1b0d46a9459a863728eb3bb432c3" candidate_uuid: "6c27090ad71542bca01248b778ff440b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "766aab97368b4169b07e508f36c4c0fb"
I20260709 13:04:47.026821 15341 raft_consensus.cc:3060] T e85d1b0d46a9459a863728eb3bb432c3 P 766aab97368b4169b07e508f36c4c0fb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:47.031586 15341 raft_consensus.cc:2468] T e85d1b0d46a9459a863728eb3bb432c3 P 766aab97368b4169b07e508f36c4c0fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c27090ad71542bca01248b778ff440b in term 1.
I20260709 13:04:47.032109 15266 raft_consensus.cc:2468] T e85d1b0d46a9459a863728eb3bb432c3 P a0c7b7a30fcf412c85264c0ed126fede [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c27090ad71542bca01248b778ff440b in term 1.
I20260709 13:04:47.032765 15158 leader_election.cc:304] T e85d1b0d46a9459a863728eb3bb432c3 P 6c27090ad71542bca01248b778ff440b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c27090ad71542bca01248b778ff440b, 766aab97368b4169b07e508f36c4c0fb; no voters: 
I20260709 13:04:47.033646 15440 raft_consensus.cc:2804] T e85d1b0d46a9459a863728eb3bb432c3 P 6c27090ad71542bca01248b778ff440b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:47.034186 15440 raft_consensus.cc:697] T e85d1b0d46a9459a863728eb3bb432c3 P 6c27090ad71542bca01248b778ff440b [term 1 LEADER]: Becoming Leader. State: Replica: 6c27090ad71542bca01248b778ff440b, State: Running, Role: LEADER
I20260709 13:04:47.035073 15440 consensus_queue.cc:237] T e85d1b0d46a9459a863728eb3bb432c3 P 6c27090ad71542bca01248b778ff440b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:47.044194 15086 catalog_manager.cc:5697] T e85d1b0d46a9459a863728eb3bb432c3 P 6c27090ad71542bca01248b778ff440b reported cstate change: term changed from 0 to 1, leader changed from <none> to 6c27090ad71542bca01248b778ff440b (127.14.180.65). New cstate: current_term: 1 leader_uuid: "6c27090ad71542bca01248b778ff440b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:47.059523 15447 raft_consensus.cc:493] T d2a5b790ba6449afa2d539eb54aa63d5 P a0c7b7a30fcf412c85264c0ed126fede [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:47.060065 15447 raft_consensus.cc:515] T d2a5b790ba6449afa2d539eb54aa63d5 P a0c7b7a30fcf412c85264c0ed126fede [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:47.061986 15447 leader_election.cc:290] T d2a5b790ba6449afa2d539eb54aa63d5 P a0c7b7a30fcf412c85264c0ed126fede [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6c27090ad71542bca01248b778ff440b (127.14.180.65:39863), 766aab97368b4169b07e508f36c4c0fb (127.14.180.67:42585)
I20260709 13:04:47.063150 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2a5b790ba6449afa2d539eb54aa63d5" candidate_uuid: "a0c7b7a30fcf412c85264c0ed126fede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c27090ad71542bca01248b778ff440b" is_pre_election: true
I20260709 13:04:47.063319 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2a5b790ba6449afa2d539eb54aa63d5" candidate_uuid: "a0c7b7a30fcf412c85264c0ed126fede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "766aab97368b4169b07e508f36c4c0fb" is_pre_election: true
I20260709 13:04:47.063977 15190 raft_consensus.cc:2468] T d2a5b790ba6449afa2d539eb54aa63d5 P 6c27090ad71542bca01248b778ff440b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0c7b7a30fcf412c85264c0ed126fede in term 0.
I20260709 13:04:47.063988 15341 raft_consensus.cc:2468] T d2a5b790ba6449afa2d539eb54aa63d5 P 766aab97368b4169b07e508f36c4c0fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0c7b7a30fcf412c85264c0ed126fede in term 0.
I20260709 13:04:47.065301 15232 leader_election.cc:304] T d2a5b790ba6449afa2d539eb54aa63d5 P a0c7b7a30fcf412c85264c0ed126fede [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c27090ad71542bca01248b778ff440b, a0c7b7a30fcf412c85264c0ed126fede; no voters: 
I20260709 13:04:47.066190 15447 raft_consensus.cc:2804] T d2a5b790ba6449afa2d539eb54aa63d5 P a0c7b7a30fcf412c85264c0ed126fede [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:47.066620 15447 raft_consensus.cc:493] T d2a5b790ba6449afa2d539eb54aa63d5 P a0c7b7a30fcf412c85264c0ed126fede [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:47.066982 15447 raft_consensus.cc:3060] T d2a5b790ba6449afa2d539eb54aa63d5 P a0c7b7a30fcf412c85264c0ed126fede [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:47.072999 15447 raft_consensus.cc:515] T d2a5b790ba6449afa2d539eb54aa63d5 P a0c7b7a30fcf412c85264c0ed126fede [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:47.074822 15447 leader_election.cc:290] T d2a5b790ba6449afa2d539eb54aa63d5 P a0c7b7a30fcf412c85264c0ed126fede [CANDIDATE]: Term 1 election: Requested vote from peers 6c27090ad71542bca01248b778ff440b (127.14.180.65:39863), 766aab97368b4169b07e508f36c4c0fb (127.14.180.67:42585)
I20260709 13:04:47.075827 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2a5b790ba6449afa2d539eb54aa63d5" candidate_uuid: "a0c7b7a30fcf412c85264c0ed126fede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c27090ad71542bca01248b778ff440b"
I20260709 13:04:47.075973 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2a5b790ba6449afa2d539eb54aa63d5" candidate_uuid: "a0c7b7a30fcf412c85264c0ed126fede" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "766aab97368b4169b07e508f36c4c0fb"
I20260709 13:04:47.076366 15190 raft_consensus.cc:3060] T d2a5b790ba6449afa2d539eb54aa63d5 P 6c27090ad71542bca01248b778ff440b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:47.076849 15341 raft_consensus.cc:3060] T d2a5b790ba6449afa2d539eb54aa63d5 P 766aab97368b4169b07e508f36c4c0fb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:47.081760 15190 raft_consensus.cc:2468] T d2a5b790ba6449afa2d539eb54aa63d5 P 6c27090ad71542bca01248b778ff440b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0c7b7a30fcf412c85264c0ed126fede in term 1.
I20260709 13:04:47.083101 15232 leader_election.cc:304] T d2a5b790ba6449afa2d539eb54aa63d5 P a0c7b7a30fcf412c85264c0ed126fede [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c27090ad71542bca01248b778ff440b, a0c7b7a30fcf412c85264c0ed126fede; no voters: 
I20260709 13:04:47.083971 15447 raft_consensus.cc:2804] T d2a5b790ba6449afa2d539eb54aa63d5 P a0c7b7a30fcf412c85264c0ed126fede [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:47.084472 15447 raft_consensus.cc:697] T d2a5b790ba6449afa2d539eb54aa63d5 P a0c7b7a30fcf412c85264c0ed126fede [term 1 LEADER]: Becoming Leader. State: Replica: a0c7b7a30fcf412c85264c0ed126fede, State: Running, Role: LEADER
I20260709 13:04:47.084285 15341 raft_consensus.cc:2468] T d2a5b790ba6449afa2d539eb54aa63d5 P 766aab97368b4169b07e508f36c4c0fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0c7b7a30fcf412c85264c0ed126fede in term 1.
I20260709 13:04:47.085225 15447 consensus_queue.cc:237] T d2a5b790ba6449afa2d539eb54aa63d5 P a0c7b7a30fcf412c85264c0ed126fede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:47.093690 15086 catalog_manager.cc:5697] T d2a5b790ba6449afa2d539eb54aa63d5 P a0c7b7a30fcf412c85264c0ed126fede reported cstate change: term changed from 0 to 1, leader changed from <none> to a0c7b7a30fcf412c85264c0ed126fede (127.14.180.66). New cstate: current_term: 1 leader_uuid: "a0c7b7a30fcf412c85264c0ed126fede" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:47.108523 15420 consensus_queue.cc:1048] T a7555eadc3bb496bb07b3cc6515fa680 P 766aab97368b4169b07e508f36c4c0fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:47.123641 15420 consensus_queue.cc:1048] T a7555eadc3bb496bb07b3cc6515fa680 P 766aab97368b4169b07e508f36c4c0fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:47.175282 15440 consensus_queue.cc:1048] T 9f79381ee9024a9e985aab93d98359e5 P 6c27090ad71542bca01248b778ff440b [LEADER]: Connected to new peer: Peer: permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:47.186197 15267 raft_consensus.cc:3060] T 9f79381ee9024a9e985aab93d98359e5 P a0c7b7a30fcf412c85264c0ed126fede [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:47.195245 15392 consensus_queue.cc:1048] T 9f79381ee9024a9e985aab93d98359e5 P 6c27090ad71542bca01248b778ff440b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:47.288054 15267 raft_consensus.cc:1240] T 4f665c7b3caa440fa5664a96decac188 P a0c7b7a30fcf412c85264c0ed126fede [term 2 FOLLOWER]: Rejecting Update request from peer 6c27090ad71542bca01248b778ff440b for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:47.289489 15392 consensus_queue.cc:1059] T 4f665c7b3caa440fa5664a96decac188 P 6c27090ad71542bca01248b778ff440b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:47.290304 15419 raft_consensus.cc:3055] T 4f665c7b3caa440fa5664a96decac188 P 6c27090ad71542bca01248b778ff440b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:47.290707 15419 raft_consensus.cc:740] T 4f665c7b3caa440fa5664a96decac188 P 6c27090ad71542bca01248b778ff440b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6c27090ad71542bca01248b778ff440b, State: Running, Role: LEADER
I20260709 13:04:47.291539 15419 consensus_queue.cc:260] T 4f665c7b3caa440fa5664a96decac188 P 6c27090ad71542bca01248b778ff440b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:47.292904 15419 raft_consensus.cc:3060] T 4f665c7b3caa440fa5664a96decac188 P 6c27090ad71542bca01248b778ff440b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:47.318905 15267 raft_consensus.cc:1275] T 4f665c7b3caa440fa5664a96decac188 P a0c7b7a30fcf412c85264c0ed126fede [term 2 FOLLOWER]: Refusing update from remote peer 766aab97368b4169b07e508f36c4c0fb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:04:47.320327 15422 consensus_queue.cc:1048] T 4f665c7b3caa440fa5664a96decac188 P 766aab97368b4169b07e508f36c4c0fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:47.331612 15190 raft_consensus.cc:1275] T 4f665c7b3caa440fa5664a96decac188 P 6c27090ad71542bca01248b778ff440b [term 2 FOLLOWER]: Refusing update from remote peer 766aab97368b4169b07e508f36c4c0fb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260709 13:04:47.332031 15190 pending_rounds.cc:85] T 4f665c7b3caa440fa5664a96decac188 P 6c27090ad71542bca01248b778ff440b: Aborting all ops after (but not including) 0
I20260709 13:04:47.332355 15190 pending_rounds.cc:107] T 4f665c7b3caa440fa5664a96decac188 P 6c27090ad71542bca01248b778ff440b: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:04:47.332643 15190 raft_consensus.cc:2889] T 4f665c7b3caa440fa5664a96decac188 P 6c27090ad71542bca01248b778ff440b [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:47.334496 15454 consensus_queue.cc:1048] T 4f665c7b3caa440fa5664a96decac188 P 766aab97368b4169b07e508f36c4c0fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:47.480784 15447 consensus_queue.cc:1048] T d2a5b790ba6449afa2d539eb54aa63d5 P a0c7b7a30fcf412c85264c0ed126fede [LEADER]: Connected to new peer: Peer: permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:47.505422 15459 consensus_queue.cc:1048] T d2a5b790ba6449afa2d539eb54aa63d5 P a0c7b7a30fcf412c85264c0ed126fede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:47.565369 15419 consensus_queue.cc:1048] T e85d1b0d46a9459a863728eb3bb432c3 P 6c27090ad71542bca01248b778ff440b [LEADER]: Connected to new peer: Peer: permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:47.581470 15419 consensus_queue.cc:1048] T e85d1b0d46a9459a863728eb3bb432c3 P 6c27090ad71542bca01248b778ff440b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:04:47.790416 15137 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:48.356664 15454 raft_consensus.cc:493] T 5b125feea68040eeb559e4bfa093536c P 766aab97368b4169b07e508f36c4c0fb [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:48.357151 15454 raft_consensus.cc:515] T 5b125feea68040eeb559e4bfa093536c P 766aab97368b4169b07e508f36c4c0fb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:48.358837 15454 leader_election.cc:290] T 5b125feea68040eeb559e4bfa093536c P 766aab97368b4169b07e508f36c4c0fb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6c27090ad71542bca01248b778ff440b (127.14.180.65:39863), a0c7b7a30fcf412c85264c0ed126fede (127.14.180.66:33371)
I20260709 13:04:48.359872 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b125feea68040eeb559e4bfa093536c" candidate_uuid: "766aab97368b4169b07e508f36c4c0fb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c27090ad71542bca01248b778ff440b" is_pre_election: true
I20260709 13:04:48.359944 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b125feea68040eeb559e4bfa093536c" candidate_uuid: "766aab97368b4169b07e508f36c4c0fb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0c7b7a30fcf412c85264c0ed126fede" is_pre_election: true
I20260709 13:04:48.360736 15267 raft_consensus.cc:2468] T 5b125feea68040eeb559e4bfa093536c P a0c7b7a30fcf412c85264c0ed126fede [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 766aab97368b4169b07e508f36c4c0fb in term 1.
I20260709 13:04:48.360736 15190 raft_consensus.cc:2468] T 5b125feea68040eeb559e4bfa093536c P 6c27090ad71542bca01248b778ff440b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 766aab97368b4169b07e508f36c4c0fb in term 1.
I20260709 13:04:48.362175 15306 leader_election.cc:304] T 5b125feea68040eeb559e4bfa093536c P 766aab97368b4169b07e508f36c4c0fb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c27090ad71542bca01248b778ff440b, 766aab97368b4169b07e508f36c4c0fb; no voters: 
I20260709 13:04:48.362905 15454 raft_consensus.cc:2804] T 5b125feea68040eeb559e4bfa093536c P 766aab97368b4169b07e508f36c4c0fb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:48.363303 15454 raft_consensus.cc:493] T 5b125feea68040eeb559e4bfa093536c P 766aab97368b4169b07e508f36c4c0fb [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:48.363571 15454 raft_consensus.cc:3060] T 5b125feea68040eeb559e4bfa093536c P 766aab97368b4169b07e508f36c4c0fb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:48.368458 15454 raft_consensus.cc:515] T 5b125feea68040eeb559e4bfa093536c P 766aab97368b4169b07e508f36c4c0fb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:48.370398 15454 leader_election.cc:290] T 5b125feea68040eeb559e4bfa093536c P 766aab97368b4169b07e508f36c4c0fb [CANDIDATE]: Term 2 election: Requested vote from peers 6c27090ad71542bca01248b778ff440b (127.14.180.65:39863), a0c7b7a30fcf412c85264c0ed126fede (127.14.180.66:33371)
I20260709 13:04:48.371258 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b125feea68040eeb559e4bfa093536c" candidate_uuid: "766aab97368b4169b07e508f36c4c0fb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c27090ad71542bca01248b778ff440b"
I20260709 13:04:48.371469 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b125feea68040eeb559e4bfa093536c" candidate_uuid: "766aab97368b4169b07e508f36c4c0fb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0c7b7a30fcf412c85264c0ed126fede"
I20260709 13:04:48.371841 15190 raft_consensus.cc:3060] T 5b125feea68040eeb559e4bfa093536c P 6c27090ad71542bca01248b778ff440b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:48.372103 15267 raft_consensus.cc:3060] T 5b125feea68040eeb559e4bfa093536c P a0c7b7a30fcf412c85264c0ed126fede [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:48.378216 15190 raft_consensus.cc:2468] T 5b125feea68040eeb559e4bfa093536c P 6c27090ad71542bca01248b778ff440b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 766aab97368b4169b07e508f36c4c0fb in term 2.
I20260709 13:04:48.378206 15267 raft_consensus.cc:2468] T 5b125feea68040eeb559e4bfa093536c P a0c7b7a30fcf412c85264c0ed126fede [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 766aab97368b4169b07e508f36c4c0fb in term 2.
I20260709 13:04:48.379760 15306 leader_election.cc:304] T 5b125feea68040eeb559e4bfa093536c P 766aab97368b4169b07e508f36c4c0fb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c27090ad71542bca01248b778ff440b, 766aab97368b4169b07e508f36c4c0fb; no voters: 
I20260709 13:04:48.380642 15454 raft_consensus.cc:2804] T 5b125feea68040eeb559e4bfa093536c P 766aab97368b4169b07e508f36c4c0fb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:48.381170 15454 raft_consensus.cc:697] T 5b125feea68040eeb559e4bfa093536c P 766aab97368b4169b07e508f36c4c0fb [term 2 LEADER]: Becoming Leader. State: Replica: 766aab97368b4169b07e508f36c4c0fb, State: Running, Role: LEADER
I20260709 13:04:48.381837 15454 consensus_queue.cc:237] T 5b125feea68040eeb559e4bfa093536c P 766aab97368b4169b07e508f36c4c0fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:48.389918 15086 catalog_manager.cc:5697] T 5b125feea68040eeb559e4bfa093536c P 766aab97368b4169b07e508f36c4c0fb reported cstate change: term changed from 0 to 2, leader changed from <none> to 766aab97368b4169b07e508f36c4c0fb (127.14.180.67). New cstate: current_term: 2 leader_uuid: "766aab97368b4169b07e508f36c4c0fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:48.923880 15190 raft_consensus.cc:1275] T 5b125feea68040eeb559e4bfa093536c P 6c27090ad71542bca01248b778ff440b [term 2 FOLLOWER]: Refusing update from remote peer 766aab97368b4169b07e508f36c4c0fb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:04:48.925155 15454 consensus_queue.cc:1048] T 5b125feea68040eeb559e4bfa093536c P 766aab97368b4169b07e508f36c4c0fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:48.939590 15267 raft_consensus.cc:1275] T 5b125feea68040eeb559e4bfa093536c P a0c7b7a30fcf412c85264c0ed126fede [term 2 FOLLOWER]: Refusing update from remote peer 766aab97368b4169b07e508f36c4c0fb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:04:48.941097 15454 consensus_queue.cc:1048] T 5b125feea68040eeb559e4bfa093536c P 766aab97368b4169b07e508f36c4c0fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:48.984709 15267 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c61fe875afff40e39c03b36e7266e263"
dest_uuid: "a0c7b7a30fcf412c85264c0ed126fede"
mode: GRACEFUL
new_leader_uuid: "6c27090ad71542bca01248b778ff440b"
 from {username='slave'} at 127.0.0.1:54496
I20260709 13:04:48.985487 15267 raft_consensus.cc:606] T c61fe875afff40e39c03b36e7266e263 P a0c7b7a30fcf412c85264c0ed126fede [term 1 LEADER]: Received request to transfer leadership to TS 6c27090ad71542bca01248b778ff440b
I20260709 13:04:48.991848 15267 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "550f6b32ce5349e4a632e926d5a452de"
dest_uuid: "a0c7b7a30fcf412c85264c0ed126fede"
mode: GRACEFUL
new_leader_uuid: "6c27090ad71542bca01248b778ff440b"
 from {username='slave'} at 127.0.0.1:54496
I20260709 13:04:48.992465 15267 raft_consensus.cc:606] T 550f6b32ce5349e4a632e926d5a452de P a0c7b7a30fcf412c85264c0ed126fede [term 1 LEADER]: Received request to transfer leadership to TS 6c27090ad71542bca01248b778ff440b
I20260709 13:04:49.001644 15267 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b88f6a525ac24e259e1331eaaa2f41ac"
dest_uuid: "a0c7b7a30fcf412c85264c0ed126fede"
mode: GRACEFUL
new_leader_uuid: "6c27090ad71542bca01248b778ff440b"
 from {username='slave'} at 127.0.0.1:54496
I20260709 13:04:49.002256 15267 raft_consensus.cc:606] T b88f6a525ac24e259e1331eaaa2f41ac P a0c7b7a30fcf412c85264c0ed126fede [term 1 LEADER]: Received request to transfer leadership to TS 6c27090ad71542bca01248b778ff440b
I20260709 13:04:49.016541 15341 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a7555eadc3bb496bb07b3cc6515fa680"
dest_uuid: "766aab97368b4169b07e508f36c4c0fb"
mode: GRACEFUL
new_leader_uuid: "a0c7b7a30fcf412c85264c0ed126fede"
 from {username='slave'} at 127.0.0.1:34360
I20260709 13:04:49.017151 15341 raft_consensus.cc:606] T a7555eadc3bb496bb07b3cc6515fa680 P 766aab97368b4169b07e508f36c4c0fb [term 1 LEADER]: Received request to transfer leadership to TS a0c7b7a30fcf412c85264c0ed126fede
I20260709 13:04:49.025179 15341 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5b125feea68040eeb559e4bfa093536c"
dest_uuid: "766aab97368b4169b07e508f36c4c0fb"
mode: GRACEFUL
new_leader_uuid: "a0c7b7a30fcf412c85264c0ed126fede"
 from {username='slave'} at 127.0.0.1:34360
I20260709 13:04:49.025810 15341 raft_consensus.cc:606] T 5b125feea68040eeb559e4bfa093536c P 766aab97368b4169b07e508f36c4c0fb [term 2 LEADER]: Received request to transfer leadership to TS a0c7b7a30fcf412c85264c0ed126fede
I20260709 13:04:49.039915 15191 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9f79381ee9024a9e985aab93d98359e5"
dest_uuid: "6c27090ad71542bca01248b778ff440b"
mode: GRACEFUL
new_leader_uuid: "a0c7b7a30fcf412c85264c0ed126fede"
 from {username='slave'} at 127.0.0.1:40922
I20260709 13:04:49.040650 15191 raft_consensus.cc:606] T 9f79381ee9024a9e985aab93d98359e5 P 6c27090ad71542bca01248b778ff440b [term 1 LEADER]: Received request to transfer leadership to TS a0c7b7a30fcf412c85264c0ed126fede
I20260709 13:04:49.056470 15447 raft_consensus.cc:993] T 550f6b32ce5349e4a632e926d5a452de P a0c7b7a30fcf412c85264c0ed126fede: : Instructing follower 6c27090ad71542bca01248b778ff440b to start an election
I20260709 13:04:49.057029 15480 raft_consensus.cc:1081] T 550f6b32ce5349e4a632e926d5a452de P a0c7b7a30fcf412c85264c0ed126fede [term 1 LEADER]: Signalling peer 6c27090ad71542bca01248b778ff440b to start an election
I20260709 13:04:49.058912 15191 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "550f6b32ce5349e4a632e926d5a452de"
dest_uuid: "6c27090ad71542bca01248b778ff440b"
 from {username='slave'} at 127.0.0.1:40904
I20260709 13:04:49.059396 15191 raft_consensus.cc:493] T 550f6b32ce5349e4a632e926d5a452de P 6c27090ad71542bca01248b778ff440b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:49.059715 15191 raft_consensus.cc:3060] T 550f6b32ce5349e4a632e926d5a452de P 6c27090ad71542bca01248b778ff440b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:49.064436 15191 raft_consensus.cc:515] T 550f6b32ce5349e4a632e926d5a452de P 6c27090ad71542bca01248b778ff440b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:49.066092 15191 leader_election.cc:290] T 550f6b32ce5349e4a632e926d5a452de P 6c27090ad71542bca01248b778ff440b [CANDIDATE]: Term 2 election: Requested vote from peers a0c7b7a30fcf412c85264c0ed126fede (127.14.180.66:33371), 766aab97368b4169b07e508f36c4c0fb (127.14.180.67:42585)
I20260709 13:04:49.067174 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550f6b32ce5349e4a632e926d5a452de" candidate_uuid: "6c27090ad71542bca01248b778ff440b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a0c7b7a30fcf412c85264c0ed126fede"
I20260709 13:04:49.067497 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550f6b32ce5349e4a632e926d5a452de" candidate_uuid: "6c27090ad71542bca01248b778ff440b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "766aab97368b4169b07e508f36c4c0fb"
I20260709 13:04:49.067792 15267 raft_consensus.cc:3055] T 550f6b32ce5349e4a632e926d5a452de P a0c7b7a30fcf412c85264c0ed126fede [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:49.068099 15341 raft_consensus.cc:3060] T 550f6b32ce5349e4a632e926d5a452de P 766aab97368b4169b07e508f36c4c0fb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:49.068161 15267 raft_consensus.cc:740] T 550f6b32ce5349e4a632e926d5a452de P a0c7b7a30fcf412c85264c0ed126fede [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a0c7b7a30fcf412c85264c0ed126fede, State: Running, Role: LEADER
I20260709 13:04:49.069088 15267 consensus_queue.cc:260] T 550f6b32ce5349e4a632e926d5a452de P a0c7b7a30fcf412c85264c0ed126fede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:49.070181 15267 raft_consensus.cc:3060] T 550f6b32ce5349e4a632e926d5a452de P a0c7b7a30fcf412c85264c0ed126fede [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:49.073613 15341 raft_consensus.cc:2468] T 550f6b32ce5349e4a632e926d5a452de P 766aab97368b4169b07e508f36c4c0fb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c27090ad71542bca01248b778ff440b in term 2.
I20260709 13:04:49.075083 15158 leader_election.cc:304] T 550f6b32ce5349e4a632e926d5a452de P 6c27090ad71542bca01248b778ff440b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c27090ad71542bca01248b778ff440b, 766aab97368b4169b07e508f36c4c0fb; no voters: 
I20260709 13:04:49.075976 15440 raft_consensus.cc:2804] T 550f6b32ce5349e4a632e926d5a452de P 6c27090ad71542bca01248b778ff440b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:49.077318 15267 raft_consensus.cc:2468] T 550f6b32ce5349e4a632e926d5a452de P a0c7b7a30fcf412c85264c0ed126fede [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c27090ad71542bca01248b778ff440b in term 2.
I20260709 13:04:49.077641 15440 raft_consensus.cc:697] T 550f6b32ce5349e4a632e926d5a452de P 6c27090ad71542bca01248b778ff440b [term 2 LEADER]: Becoming Leader. State: Replica: 6c27090ad71542bca01248b778ff440b, State: Running, Role: LEADER
I20260709 13:04:49.078655 15440 consensus_queue.cc:237] T 550f6b32ce5349e4a632e926d5a452de P 6c27090ad71542bca01248b778ff440b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:49.088398 15087 catalog_manager.cc:5697] T 550f6b32ce5349e4a632e926d5a452de P 6c27090ad71542bca01248b778ff440b reported cstate change: term changed from 1 to 2, leader changed from a0c7b7a30fcf412c85264c0ed126fede (127.14.180.66) to 6c27090ad71542bca01248b778ff440b (127.14.180.65). New cstate: current_term: 2 leader_uuid: "6c27090ad71542bca01248b778ff440b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:49.274816 15471 raft_consensus.cc:993] T a7555eadc3bb496bb07b3cc6515fa680 P 766aab97368b4169b07e508f36c4c0fb: : Instructing follower a0c7b7a30fcf412c85264c0ed126fede to start an election
I20260709 13:04:49.275347 15454 raft_consensus.cc:1081] T a7555eadc3bb496bb07b3cc6515fa680 P 766aab97368b4169b07e508f36c4c0fb [term 1 LEADER]: Signalling peer a0c7b7a30fcf412c85264c0ed126fede to start an election
I20260709 13:04:49.277267 15267 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a7555eadc3bb496bb07b3cc6515fa680"
dest_uuid: "a0c7b7a30fcf412c85264c0ed126fede"
 from {username='slave'} at 127.0.0.1:54490
I20260709 13:04:49.277894 15267 raft_consensus.cc:493] T a7555eadc3bb496bb07b3cc6515fa680 P a0c7b7a30fcf412c85264c0ed126fede [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:49.278256 15267 raft_consensus.cc:3060] T a7555eadc3bb496bb07b3cc6515fa680 P a0c7b7a30fcf412c85264c0ed126fede [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:49.283327 15267 raft_consensus.cc:515] T a7555eadc3bb496bb07b3cc6515fa680 P a0c7b7a30fcf412c85264c0ed126fede [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:49.285079 15267 leader_election.cc:290] T a7555eadc3bb496bb07b3cc6515fa680 P a0c7b7a30fcf412c85264c0ed126fede [CANDIDATE]: Term 2 election: Requested vote from peers 6c27090ad71542bca01248b778ff440b (127.14.180.65:39863), 766aab97368b4169b07e508f36c4c0fb (127.14.180.67:42585)
I20260709 13:04:49.285984 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7555eadc3bb496bb07b3cc6515fa680" candidate_uuid: "a0c7b7a30fcf412c85264c0ed126fede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6c27090ad71542bca01248b778ff440b"
I20260709 13:04:49.286185 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7555eadc3bb496bb07b3cc6515fa680" candidate_uuid: "a0c7b7a30fcf412c85264c0ed126fede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "766aab97368b4169b07e508f36c4c0fb"
I20260709 13:04:49.286691 15191 raft_consensus.cc:3060] T a7555eadc3bb496bb07b3cc6515fa680 P 6c27090ad71542bca01248b778ff440b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:49.286763 15341 raft_consensus.cc:3055] T a7555eadc3bb496bb07b3cc6515fa680 P 766aab97368b4169b07e508f36c4c0fb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:49.287171 15341 raft_consensus.cc:740] T a7555eadc3bb496bb07b3cc6515fa680 P 766aab97368b4169b07e508f36c4c0fb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 766aab97368b4169b07e508f36c4c0fb, State: Running, Role: LEADER
I20260709 13:04:49.287839 15341 consensus_queue.cc:260] T a7555eadc3bb496bb07b3cc6515fa680 P 766aab97368b4169b07e508f36c4c0fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:49.288781 15341 raft_consensus.cc:3060] T a7555eadc3bb496bb07b3cc6515fa680 P 766aab97368b4169b07e508f36c4c0fb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:49.292089 15191 raft_consensus.cc:2468] T a7555eadc3bb496bb07b3cc6515fa680 P 6c27090ad71542bca01248b778ff440b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0c7b7a30fcf412c85264c0ed126fede in term 2.
I20260709 13:04:49.293320 15232 leader_election.cc:304] T a7555eadc3bb496bb07b3cc6515fa680 P a0c7b7a30fcf412c85264c0ed126fede [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c27090ad71542bca01248b778ff440b, a0c7b7a30fcf412c85264c0ed126fede; no voters: 
I20260709 13:04:49.293620 15341 raft_consensus.cc:2468] T a7555eadc3bb496bb07b3cc6515fa680 P 766aab97368b4169b07e508f36c4c0fb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0c7b7a30fcf412c85264c0ed126fede in term 2.
I20260709 13:04:49.294076 15480 raft_consensus.cc:2804] T a7555eadc3bb496bb07b3cc6515fa680 P a0c7b7a30fcf412c85264c0ed126fede [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:49.294911 15480 raft_consensus.cc:697] T a7555eadc3bb496bb07b3cc6515fa680 P a0c7b7a30fcf412c85264c0ed126fede [term 2 LEADER]: Becoming Leader. State: Replica: a0c7b7a30fcf412c85264c0ed126fede, State: Running, Role: LEADER
I20260709 13:04:49.295738 15480 consensus_queue.cc:237] T a7555eadc3bb496bb07b3cc6515fa680 P a0c7b7a30fcf412c85264c0ed126fede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:49.303066 15087 catalog_manager.cc:5697] T a7555eadc3bb496bb07b3cc6515fa680 P a0c7b7a30fcf412c85264c0ed126fede reported cstate change: term changed from 1 to 2, leader changed from 766aab97368b4169b07e508f36c4c0fb (127.14.180.67) to a0c7b7a30fcf412c85264c0ed126fede (127.14.180.66). New cstate: current_term: 2 leader_uuid: "a0c7b7a30fcf412c85264c0ed126fede" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:49.408592 15447 raft_consensus.cc:993] T b88f6a525ac24e259e1331eaaa2f41ac P a0c7b7a30fcf412c85264c0ed126fede: : Instructing follower 6c27090ad71542bca01248b778ff440b to start an election
I20260709 13:04:49.409122 15480 raft_consensus.cc:1081] T b88f6a525ac24e259e1331eaaa2f41ac P a0c7b7a30fcf412c85264c0ed126fede [term 1 LEADER]: Signalling peer 6c27090ad71542bca01248b778ff440b to start an election
I20260709 13:04:49.411279 15191 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b88f6a525ac24e259e1331eaaa2f41ac"
dest_uuid: "6c27090ad71542bca01248b778ff440b"
 from {username='slave'} at 127.0.0.1:40904
I20260709 13:04:49.412070 15191 raft_consensus.cc:493] T b88f6a525ac24e259e1331eaaa2f41ac P 6c27090ad71542bca01248b778ff440b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:49.412472 15191 raft_consensus.cc:3060] T b88f6a525ac24e259e1331eaaa2f41ac P 6c27090ad71542bca01248b778ff440b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:49.418803 15471 raft_consensus.cc:993] T 5b125feea68040eeb559e4bfa093536c P 766aab97368b4169b07e508f36c4c0fb: : Instructing follower a0c7b7a30fcf412c85264c0ed126fede to start an election
I20260709 13:04:49.419349 15471 raft_consensus.cc:1081] T 5b125feea68040eeb559e4bfa093536c P 766aab97368b4169b07e508f36c4c0fb [term 2 LEADER]: Signalling peer a0c7b7a30fcf412c85264c0ed126fede to start an election
I20260709 13:04:49.419555 15191 raft_consensus.cc:515] T b88f6a525ac24e259e1331eaaa2f41ac P 6c27090ad71542bca01248b778ff440b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:49.421406 15267 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5b125feea68040eeb559e4bfa093536c"
dest_uuid: "a0c7b7a30fcf412c85264c0ed126fede"
 from {username='slave'} at 127.0.0.1:54490
I20260709 13:04:49.421651 15191 leader_election.cc:290] T b88f6a525ac24e259e1331eaaa2f41ac P 6c27090ad71542bca01248b778ff440b [CANDIDATE]: Term 2 election: Requested vote from peers a0c7b7a30fcf412c85264c0ed126fede (127.14.180.66:33371), 766aab97368b4169b07e508f36c4c0fb (127.14.180.67:42585)
I20260709 13:04:49.422057 15267 raft_consensus.cc:493] T 5b125feea68040eeb559e4bfa093536c P a0c7b7a30fcf412c85264c0ed126fede [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:49.422463 15267 raft_consensus.cc:3060] T 5b125feea68040eeb559e4bfa093536c P a0c7b7a30fcf412c85264c0ed126fede [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:49.422976 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b88f6a525ac24e259e1331eaaa2f41ac" candidate_uuid: "6c27090ad71542bca01248b778ff440b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "766aab97368b4169b07e508f36c4c0fb"
I20260709 13:04:49.423359 15266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b88f6a525ac24e259e1331eaaa2f41ac" candidate_uuid: "6c27090ad71542bca01248b778ff440b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a0c7b7a30fcf412c85264c0ed126fede"
I20260709 13:04:49.423668 15341 raft_consensus.cc:3060] T b88f6a525ac24e259e1331eaaa2f41ac P 766aab97368b4169b07e508f36c4c0fb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:49.423950 15266 raft_consensus.cc:3055] T b88f6a525ac24e259e1331eaaa2f41ac P a0c7b7a30fcf412c85264c0ed126fede [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:49.424310 15266 raft_consensus.cc:740] T b88f6a525ac24e259e1331eaaa2f41ac P a0c7b7a30fcf412c85264c0ed126fede [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a0c7b7a30fcf412c85264c0ed126fede, State: Running, Role: LEADER
I20260709 13:04:49.425160 15266 consensus_queue.cc:260] T b88f6a525ac24e259e1331eaaa2f41ac P a0c7b7a30fcf412c85264c0ed126fede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:49.426497 15266 raft_consensus.cc:3060] T b88f6a525ac24e259e1331eaaa2f41ac P a0c7b7a30fcf412c85264c0ed126fede [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:49.430054 15341 raft_consensus.cc:2468] T b88f6a525ac24e259e1331eaaa2f41ac P 766aab97368b4169b07e508f36c4c0fb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c27090ad71542bca01248b778ff440b in term 2.
I20260709 13:04:49.429936 15267 raft_consensus.cc:515] T 5b125feea68040eeb559e4bfa093536c P a0c7b7a30fcf412c85264c0ed126fede [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:49.431331 15158 leader_election.cc:304] T b88f6a525ac24e259e1331eaaa2f41ac P 6c27090ad71542bca01248b778ff440b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c27090ad71542bca01248b778ff440b, 766aab97368b4169b07e508f36c4c0fb; no voters: 
I20260709 13:04:49.432127 15481 raft_consensus.cc:2804] T b88f6a525ac24e259e1331eaaa2f41ac P 6c27090ad71542bca01248b778ff440b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:49.433907 15266 raft_consensus.cc:2468] T b88f6a525ac24e259e1331eaaa2f41ac P a0c7b7a30fcf412c85264c0ed126fede [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c27090ad71542bca01248b778ff440b in term 2.
I20260709 13:04:49.436429 15267 leader_election.cc:290] T 5b125feea68040eeb559e4bfa093536c P a0c7b7a30fcf412c85264c0ed126fede [CANDIDATE]: Term 3 election: Requested vote from peers 6c27090ad71542bca01248b778ff440b (127.14.180.65:39863), 766aab97368b4169b07e508f36c4c0fb (127.14.180.67:42585)
I20260709 13:04:49.436570 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b125feea68040eeb559e4bfa093536c" candidate_uuid: "a0c7b7a30fcf412c85264c0ed126fede" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "6c27090ad71542bca01248b778ff440b"
I20260709 13:04:49.437223 15191 raft_consensus.cc:3060] T 5b125feea68040eeb559e4bfa093536c P 6c27090ad71542bca01248b778ff440b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:49.437331 15440 raft_consensus.cc:993] T 9f79381ee9024a9e985aab93d98359e5 P 6c27090ad71542bca01248b778ff440b: : Instructing follower a0c7b7a30fcf412c85264c0ed126fede to start an election
I20260709 13:04:49.437829 15440 raft_consensus.cc:1081] T 9f79381ee9024a9e985aab93d98359e5 P 6c27090ad71542bca01248b778ff440b [term 1 LEADER]: Signalling peer a0c7b7a30fcf412c85264c0ed126fede to start an election
I20260709 13:04:49.439881 15267 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9f79381ee9024a9e985aab93d98359e5"
dest_uuid: "a0c7b7a30fcf412c85264c0ed126fede"
 from {username='slave'} at 127.0.0.1:54476
I20260709 13:04:49.439986 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b125feea68040eeb559e4bfa093536c" candidate_uuid: "a0c7b7a30fcf412c85264c0ed126fede" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "766aab97368b4169b07e508f36c4c0fb"
I20260709 13:04:49.440972 15341 raft_consensus.cc:3055] T 5b125feea68040eeb559e4bfa093536c P 766aab97368b4169b07e508f36c4c0fb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:49.440917 15267 raft_consensus.cc:493] T 9f79381ee9024a9e985aab93d98359e5 P a0c7b7a30fcf412c85264c0ed126fede [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:49.441605 15341 raft_consensus.cc:740] T 5b125feea68040eeb559e4bfa093536c P 766aab97368b4169b07e508f36c4c0fb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 766aab97368b4169b07e508f36c4c0fb, State: Running, Role: LEADER
I20260709 13:04:49.441876 15267 raft_consensus.cc:3060] T 9f79381ee9024a9e985aab93d98359e5 P a0c7b7a30fcf412c85264c0ed126fede [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:49.442821 15341 consensus_queue.cc:260] T 5b125feea68040eeb559e4bfa093536c P 766aab97368b4169b07e508f36c4c0fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:49.444257 15341 raft_consensus.cc:3060] T 5b125feea68040eeb559e4bfa093536c P 766aab97368b4169b07e508f36c4c0fb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:49.444952 15191 raft_consensus.cc:2468] T 5b125feea68040eeb559e4bfa093536c P 6c27090ad71542bca01248b778ff440b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0c7b7a30fcf412c85264c0ed126fede in term 3.
I20260709 13:04:49.446448 15232 leader_election.cc:304] T 5b125feea68040eeb559e4bfa093536c P a0c7b7a30fcf412c85264c0ed126fede [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c27090ad71542bca01248b778ff440b, a0c7b7a30fcf412c85264c0ed126fede; no voters: 
I20260709 13:04:49.446820 15481 raft_consensus.cc:697] T b88f6a525ac24e259e1331eaaa2f41ac P 6c27090ad71542bca01248b778ff440b [term 2 LEADER]: Becoming Leader. State: Replica: 6c27090ad71542bca01248b778ff440b, State: Running, Role: LEADER
I20260709 13:04:49.447552 15480 raft_consensus.cc:2804] T 5b125feea68040eeb559e4bfa093536c P a0c7b7a30fcf412c85264c0ed126fede [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:49.448112 15480 raft_consensus.cc:697] T 5b125feea68040eeb559e4bfa093536c P a0c7b7a30fcf412c85264c0ed126fede [term 3 LEADER]: Becoming Leader. State: Replica: a0c7b7a30fcf412c85264c0ed126fede, State: Running, Role: LEADER
I20260709 13:04:49.447844 15481 consensus_queue.cc:237] T b88f6a525ac24e259e1331eaaa2f41ac P 6c27090ad71542bca01248b778ff440b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:49.448943 15480 consensus_queue.cc:237] T 5b125feea68040eeb559e4bfa093536c P a0c7b7a30fcf412c85264c0ed126fede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:49.450886 15267 raft_consensus.cc:515] T 9f79381ee9024a9e985aab93d98359e5 P a0c7b7a30fcf412c85264c0ed126fede [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:49.454578 15341 raft_consensus.cc:2468] T 5b125feea68040eeb559e4bfa093536c P 766aab97368b4169b07e508f36c4c0fb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0c7b7a30fcf412c85264c0ed126fede in term 3.
I20260709 13:04:49.456157 15267 leader_election.cc:290] T 9f79381ee9024a9e985aab93d98359e5 P a0c7b7a30fcf412c85264c0ed126fede [CANDIDATE]: Term 2 election: Requested vote from peers 6c27090ad71542bca01248b778ff440b (127.14.180.65:39863), 766aab97368b4169b07e508f36c4c0fb (127.14.180.67:42585)
I20260709 13:04:49.457931 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f79381ee9024a9e985aab93d98359e5" candidate_uuid: "a0c7b7a30fcf412c85264c0ed126fede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "766aab97368b4169b07e508f36c4c0fb"
I20260709 13:04:49.458701 15339 raft_consensus.cc:3060] T 9f79381ee9024a9e985aab93d98359e5 P 766aab97368b4169b07e508f36c4c0fb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:49.459422 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f79381ee9024a9e985aab93d98359e5" candidate_uuid: "a0c7b7a30fcf412c85264c0ed126fede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6c27090ad71542bca01248b778ff440b"
I20260709 13:04:49.460198 15190 raft_consensus.cc:3055] T 9f79381ee9024a9e985aab93d98359e5 P 6c27090ad71542bca01248b778ff440b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:49.460568 15190 raft_consensus.cc:740] T 9f79381ee9024a9e985aab93d98359e5 P 6c27090ad71542bca01248b778ff440b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6c27090ad71542bca01248b778ff440b, State: Running, Role: LEADER
I20260709 13:04:49.461494 15190 consensus_queue.cc:260] T 9f79381ee9024a9e985aab93d98359e5 P 6c27090ad71542bca01248b778ff440b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:49.463871 15190 raft_consensus.cc:3060] T 9f79381ee9024a9e985aab93d98359e5 P 6c27090ad71542bca01248b778ff440b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:49.465776 15490 raft_consensus.cc:993] T c61fe875afff40e39c03b36e7266e263 P a0c7b7a30fcf412c85264c0ed126fede: : Instructing follower 6c27090ad71542bca01248b778ff440b to start an election
I20260709 13:04:49.466307 15341 raft_consensus.cc:1275] T 550f6b32ce5349e4a632e926d5a452de P 766aab97368b4169b07e508f36c4c0fb [term 2 FOLLOWER]: Refusing update from remote peer 6c27090ad71542bca01248b778ff440b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:49.468084 15488 consensus_queue.cc:1048] T 550f6b32ce5349e4a632e926d5a452de P 6c27090ad71542bca01248b778ff440b [LEADER]: Connected to new peer: Peer: permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:49.470541 15447 raft_consensus.cc:1081] T c61fe875afff40e39c03b36e7266e263 P a0c7b7a30fcf412c85264c0ed126fede [term 1 LEADER]: Signalling peer 6c27090ad71542bca01248b778ff440b to start an election
I20260709 13:04:49.471042 15190 raft_consensus.cc:2468] T 9f79381ee9024a9e985aab93d98359e5 P 6c27090ad71542bca01248b778ff440b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0c7b7a30fcf412c85264c0ed126fede in term 2.
I20260709 13:04:49.472834 15232 leader_election.cc:304] T 9f79381ee9024a9e985aab93d98359e5 P a0c7b7a30fcf412c85264c0ed126fede [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c27090ad71542bca01248b778ff440b, a0c7b7a30fcf412c85264c0ed126fede; no voters: 
I20260709 13:04:49.473031 15339 raft_consensus.cc:2468] T 9f79381ee9024a9e985aab93d98359e5 P 766aab97368b4169b07e508f36c4c0fb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0c7b7a30fcf412c85264c0ed126fede in term 2.
I20260709 13:04:49.473765 15447 raft_consensus.cc:2804] T 9f79381ee9024a9e985aab93d98359e5 P a0c7b7a30fcf412c85264c0ed126fede [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:49.473372 15087 catalog_manager.cc:5697] T 5b125feea68040eeb559e4bfa093536c P a0c7b7a30fcf412c85264c0ed126fede reported cstate change: term changed from 2 to 3, leader changed from 766aab97368b4169b07e508f36c4c0fb (127.14.180.67) to a0c7b7a30fcf412c85264c0ed126fede (127.14.180.66). New cstate: current_term: 3 leader_uuid: "a0c7b7a30fcf412c85264c0ed126fede" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:49.475282 15447 raft_consensus.cc:697] T 9f79381ee9024a9e985aab93d98359e5 P a0c7b7a30fcf412c85264c0ed126fede [term 2 LEADER]: Becoming Leader. State: Replica: a0c7b7a30fcf412c85264c0ed126fede, State: Running, Role: LEADER
I20260709 13:04:49.476238 15447 consensus_queue.cc:237] T 9f79381ee9024a9e985aab93d98359e5 P a0c7b7a30fcf412c85264c0ed126fede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:49.477752 15190 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c61fe875afff40e39c03b36e7266e263"
dest_uuid: "6c27090ad71542bca01248b778ff440b"
 from {username='slave'} at 127.0.0.1:40904
I20260709 13:04:49.478452 15190 raft_consensus.cc:493] T c61fe875afff40e39c03b36e7266e263 P 6c27090ad71542bca01248b778ff440b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:49.478878 15190 raft_consensus.cc:3060] T c61fe875afff40e39c03b36e7266e263 P 6c27090ad71542bca01248b778ff440b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:49.479022 15086 catalog_manager.cc:5697] T b88f6a525ac24e259e1331eaaa2f41ac P 6c27090ad71542bca01248b778ff440b reported cstate change: term changed from 1 to 2, leader changed from a0c7b7a30fcf412c85264c0ed126fede (127.14.180.66) to 6c27090ad71542bca01248b778ff440b (127.14.180.65). New cstate: current_term: 2 leader_uuid: "6c27090ad71542bca01248b778ff440b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:49.488564 15190 raft_consensus.cc:515] T c61fe875afff40e39c03b36e7266e263 P 6c27090ad71542bca01248b778ff440b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } } peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } }
I20260709 13:04:49.492661 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61fe875afff40e39c03b36e7266e263" candidate_uuid: "6c27090ad71542bca01248b778ff440b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a0c7b7a30fcf412c85264c0ed126fede"
I20260709 13:04:49.493360 15267 raft_consensus.cc:3055] T c61fe875afff40e39c03b36e7266e263 P a0c7b7a30fcf412c85264c0ed126fede [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:49.493711 15267 raft_consensus.cc:740] T c61fe875afff40e39c03b36e7266e263 P a0c7b7a30fcf412c85264c0ed126fede [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a0c7b7a30fcf412c85264c0ed126fede, State: Running, Role: LEADER
I20260709 13:04:49.494580 15267 consensus_queue.cc:260] T c61fe875afff40e39c03b36e7266e263 P a0c7b7a30fcf412c85264c0ed126fede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } } peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } }
I20260709 13:04:49.495782 15267 raft_consensus.cc:3060] T c61fe875afff40e39c03b36e7266e263 P a0c7b7a30fcf412c85264c0ed126fede [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:49.501241 15190 leader_election.cc:290] T c61fe875afff40e39c03b36e7266e263 P 6c27090ad71542bca01248b778ff440b [CANDIDATE]: Term 2 election: Requested vote from peers a0c7b7a30fcf412c85264c0ed126fede (127.14.180.66:33371), 766aab97368b4169b07e508f36c4c0fb (127.14.180.67:42585)
I20260709 13:04:49.503136 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61fe875afff40e39c03b36e7266e263" candidate_uuid: "6c27090ad71542bca01248b778ff440b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "766aab97368b4169b07e508f36c4c0fb"
I20260709 13:04:49.503778 15341 raft_consensus.cc:3060] T c61fe875afff40e39c03b36e7266e263 P 766aab97368b4169b07e508f36c4c0fb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:49.505276 15086 catalog_manager.cc:5697] T 9f79381ee9024a9e985aab93d98359e5 P a0c7b7a30fcf412c85264c0ed126fede reported cstate change: term changed from 1 to 2, leader changed from 6c27090ad71542bca01248b778ff440b (127.14.180.65) to a0c7b7a30fcf412c85264c0ed126fede (127.14.180.66). New cstate: current_term: 2 leader_uuid: "a0c7b7a30fcf412c85264c0ed126fede" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:49.511433 15341 raft_consensus.cc:2468] T c61fe875afff40e39c03b36e7266e263 P 766aab97368b4169b07e508f36c4c0fb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c27090ad71542bca01248b778ff440b in term 2.
I20260709 13:04:49.512809 15158 leader_election.cc:304] T c61fe875afff40e39c03b36e7266e263 P 6c27090ad71542bca01248b778ff440b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c27090ad71542bca01248b778ff440b, 766aab97368b4169b07e508f36c4c0fb; no voters: 
I20260709 13:04:49.513731 15481 raft_consensus.cc:2804] T c61fe875afff40e39c03b36e7266e263 P 6c27090ad71542bca01248b778ff440b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:49.513638 15267 raft_consensus.cc:2468] T c61fe875afff40e39c03b36e7266e263 P a0c7b7a30fcf412c85264c0ed126fede [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c27090ad71542bca01248b778ff440b in term 2.
I20260709 13:04:49.514436 15481 raft_consensus.cc:697] T c61fe875afff40e39c03b36e7266e263 P 6c27090ad71542bca01248b778ff440b [term 2 LEADER]: Becoming Leader. State: Replica: 6c27090ad71542bca01248b778ff440b, State: Running, Role: LEADER
I20260709 13:04:49.515369 15481 consensus_queue.cc:237] T c61fe875afff40e39c03b36e7266e263 P 6c27090ad71542bca01248b778ff440b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } } peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } }
I20260709 13:04:49.523437 15267 raft_consensus.cc:1275] T 550f6b32ce5349e4a632e926d5a452de P a0c7b7a30fcf412c85264c0ed126fede [term 2 FOLLOWER]: Refusing update from remote peer 6c27090ad71542bca01248b778ff440b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:49.524953 15481 consensus_queue.cc:1048] T 550f6b32ce5349e4a632e926d5a452de P 6c27090ad71542bca01248b778ff440b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:49.529207 15086 catalog_manager.cc:5697] T c61fe875afff40e39c03b36e7266e263 P 6c27090ad71542bca01248b778ff440b reported cstate change: term changed from 1 to 2, leader changed from a0c7b7a30fcf412c85264c0ed126fede (127.14.180.66) to 6c27090ad71542bca01248b778ff440b (127.14.180.65). New cstate: current_term: 2 leader_uuid: "6c27090ad71542bca01248b778ff440b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:49.789372 15190 raft_consensus.cc:1275] T a7555eadc3bb496bb07b3cc6515fa680 P 6c27090ad71542bca01248b778ff440b [term 2 FOLLOWER]: Refusing update from remote peer a0c7b7a30fcf412c85264c0ed126fede: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:49.790926 15447 consensus_queue.cc:1048] T a7555eadc3bb496bb07b3cc6515fa680 P a0c7b7a30fcf412c85264c0ed126fede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:49.799505 15339 raft_consensus.cc:1275] T a7555eadc3bb496bb07b3cc6515fa680 P 766aab97368b4169b07e508f36c4c0fb [term 2 FOLLOWER]: Refusing update from remote peer a0c7b7a30fcf412c85264c0ed126fede: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:49.801337 15490 consensus_queue.cc:1048] T a7555eadc3bb496bb07b3cc6515fa680 P a0c7b7a30fcf412c85264c0ed126fede [LEADER]: Connected to new peer: Peer: permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:49.865443 15339 raft_consensus.cc:1275] T b88f6a525ac24e259e1331eaaa2f41ac P 766aab97368b4169b07e508f36c4c0fb [term 2 FOLLOWER]: Refusing update from remote peer 6c27090ad71542bca01248b778ff440b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:49.866844 15481 consensus_queue.cc:1048] T b88f6a525ac24e259e1331eaaa2f41ac P 6c27090ad71542bca01248b778ff440b [LEADER]: Connected to new peer: Peer: permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:49.876279 15267 raft_consensus.cc:1275] T b88f6a525ac24e259e1331eaaa2f41ac P a0c7b7a30fcf412c85264c0ed126fede [term 2 FOLLOWER]: Refusing update from remote peer 6c27090ad71542bca01248b778ff440b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:49.878248 15440 consensus_queue.cc:1048] T b88f6a525ac24e259e1331eaaa2f41ac P 6c27090ad71542bca01248b778ff440b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:49.907895 15339 raft_consensus.cc:1275] T 5b125feea68040eeb559e4bfa093536c P 766aab97368b4169b07e508f36c4c0fb [term 3 FOLLOWER]: Refusing update from remote peer a0c7b7a30fcf412c85264c0ed126fede: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:04:49.909197 15490 consensus_queue.cc:1048] T 5b125feea68040eeb559e4bfa093536c P a0c7b7a30fcf412c85264c0ed126fede [LEADER]: Connected to new peer: Peer: permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:49.918025 15190 raft_consensus.cc:1275] T 5b125feea68040eeb559e4bfa093536c P 6c27090ad71542bca01248b778ff440b [term 3 FOLLOWER]: Refusing update from remote peer a0c7b7a30fcf412c85264c0ed126fede: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:04:49.919831 15447 consensus_queue.cc:1048] T 5b125feea68040eeb559e4bfa093536c P a0c7b7a30fcf412c85264c0ed126fede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:49.936892 15190 raft_consensus.cc:1275] T 9f79381ee9024a9e985aab93d98359e5 P 6c27090ad71542bca01248b778ff440b [term 2 FOLLOWER]: Refusing update from remote peer a0c7b7a30fcf412c85264c0ed126fede: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:49.938264 15491 consensus_queue.cc:1048] T 9f79381ee9024a9e985aab93d98359e5 P a0c7b7a30fcf412c85264c0ed126fede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:49.949306 15339 raft_consensus.cc:1275] T 9f79381ee9024a9e985aab93d98359e5 P 766aab97368b4169b07e508f36c4c0fb [term 2 FOLLOWER]: Refusing update from remote peer a0c7b7a30fcf412c85264c0ed126fede: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:49.951340 15490 consensus_queue.cc:1048] T 9f79381ee9024a9e985aab93d98359e5 P a0c7b7a30fcf412c85264c0ed126fede [LEADER]: Connected to new peer: Peer: permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:50.035388 15339 raft_consensus.cc:1275] T c61fe875afff40e39c03b36e7266e263 P 766aab97368b4169b07e508f36c4c0fb [term 2 FOLLOWER]: Refusing update from remote peer 6c27090ad71542bca01248b778ff440b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:50.036895 15440 consensus_queue.cc:1048] T c61fe875afff40e39c03b36e7266e263 P 6c27090ad71542bca01248b778ff440b [LEADER]: Connected to new peer: Peer: permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:50.046814 15267 raft_consensus.cc:1275] T c61fe875afff40e39c03b36e7266e263 P a0c7b7a30fcf412c85264c0ed126fede [term 2 FOLLOWER]: Refusing update from remote peer 6c27090ad71542bca01248b778ff440b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:50.048784 15481 consensus_queue.cc:1048] T c61fe875afff40e39c03b36e7266e263 P 6c27090ad71542bca01248b778ff440b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:52.076344 15057 auto_leader_rebalancer-test.cc:316] The leader distribution is 
I20260709 13:04:52.077298 15057 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:52.099088 15267 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a7555eadc3bb496bb07b3cc6515fa680"
dest_uuid: "a0c7b7a30fcf412c85264c0ed126fede"
mode: GRACEFUL
new_leader_uuid: "766aab97368b4169b07e508f36c4c0fb"
 from {username='slave'} at 127.0.0.1:57256
I20260709 13:04:52.099787 15267 raft_consensus.cc:606] T a7555eadc3bb496bb07b3cc6515fa680 P a0c7b7a30fcf412c85264c0ed126fede [term 2 LEADER]: Received request to transfer leadership to TS 766aab97368b4169b07e508f36c4c0fb
I20260709 13:04:52.114478 15190 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b88f6a525ac24e259e1331eaaa2f41ac"
dest_uuid: "6c27090ad71542bca01248b778ff440b"
mode: GRACEFUL
new_leader_uuid: "766aab97368b4169b07e508f36c4c0fb"
 from {username='slave'} at 127.0.0.1:55042
I20260709 13:04:52.115132 15190 raft_consensus.cc:606] T b88f6a525ac24e259e1331eaaa2f41ac P 6c27090ad71542bca01248b778ff440b [term 2 LEADER]: Received request to transfer leadership to TS 766aab97368b4169b07e508f36c4c0fb
I20260709 13:04:52.116552 15057 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:04:52.117103 15057 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:52.195053 15490 raft_consensus.cc:993] T a7555eadc3bb496bb07b3cc6515fa680 P a0c7b7a30fcf412c85264c0ed126fede: : Instructing follower 766aab97368b4169b07e508f36c4c0fb to start an election
I20260709 13:04:52.195688 15490 raft_consensus.cc:1081] T a7555eadc3bb496bb07b3cc6515fa680 P a0c7b7a30fcf412c85264c0ed126fede [term 2 LEADER]: Signalling peer 766aab97368b4169b07e508f36c4c0fb to start an election
I20260709 13:04:52.197458 15339 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a7555eadc3bb496bb07b3cc6515fa680"
dest_uuid: "766aab97368b4169b07e508f36c4c0fb"
 from {username='slave'} at 127.0.0.1:34332
I20260709 13:04:52.198027 15339 raft_consensus.cc:493] T a7555eadc3bb496bb07b3cc6515fa680 P 766aab97368b4169b07e508f36c4c0fb [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:52.198338 15339 raft_consensus.cc:3060] T a7555eadc3bb496bb07b3cc6515fa680 P 766aab97368b4169b07e508f36c4c0fb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:52.203380 15339 raft_consensus.cc:515] T a7555eadc3bb496bb07b3cc6515fa680 P 766aab97368b4169b07e508f36c4c0fb [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:52.205096 15339 leader_election.cc:290] T a7555eadc3bb496bb07b3cc6515fa680 P 766aab97368b4169b07e508f36c4c0fb [CANDIDATE]: Term 3 election: Requested vote from peers 6c27090ad71542bca01248b778ff440b (127.14.180.65:39863), a0c7b7a30fcf412c85264c0ed126fede (127.14.180.66:33371)
I20260709 13:04:52.206053 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7555eadc3bb496bb07b3cc6515fa680" candidate_uuid: "766aab97368b4169b07e508f36c4c0fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a0c7b7a30fcf412c85264c0ed126fede"
I20260709 13:04:52.206056 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7555eadc3bb496bb07b3cc6515fa680" candidate_uuid: "766aab97368b4169b07e508f36c4c0fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6c27090ad71542bca01248b778ff440b"
I20260709 13:04:52.206915 15267 raft_consensus.cc:3055] T a7555eadc3bb496bb07b3cc6515fa680 P a0c7b7a30fcf412c85264c0ed126fede [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:52.206918 15190 raft_consensus.cc:3060] T a7555eadc3bb496bb07b3cc6515fa680 P 6c27090ad71542bca01248b778ff440b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:52.207420 15267 raft_consensus.cc:740] T a7555eadc3bb496bb07b3cc6515fa680 P a0c7b7a30fcf412c85264c0ed126fede [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a0c7b7a30fcf412c85264c0ed126fede, State: Running, Role: LEADER
I20260709 13:04:52.208151 15267 consensus_queue.cc:260] T a7555eadc3bb496bb07b3cc6515fa680 P a0c7b7a30fcf412c85264c0ed126fede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:52.209328 15267 raft_consensus.cc:3060] T a7555eadc3bb496bb07b3cc6515fa680 P a0c7b7a30fcf412c85264c0ed126fede [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:52.214236 15190 raft_consensus.cc:2468] T a7555eadc3bb496bb07b3cc6515fa680 P 6c27090ad71542bca01248b778ff440b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 766aab97368b4169b07e508f36c4c0fb in term 3.
I20260709 13:04:52.215618 15306 leader_election.cc:304] T a7555eadc3bb496bb07b3cc6515fa680 P 766aab97368b4169b07e508f36c4c0fb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c27090ad71542bca01248b778ff440b, 766aab97368b4169b07e508f36c4c0fb; no voters: 
I20260709 13:04:52.215795 15267 raft_consensus.cc:2468] T a7555eadc3bb496bb07b3cc6515fa680 P a0c7b7a30fcf412c85264c0ed126fede [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 766aab97368b4169b07e508f36c4c0fb in term 3.
I20260709 13:04:52.216517 15507 raft_consensus.cc:2804] T a7555eadc3bb496bb07b3cc6515fa680 P 766aab97368b4169b07e508f36c4c0fb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:52.217861 15507 raft_consensus.cc:697] T a7555eadc3bb496bb07b3cc6515fa680 P 766aab97368b4169b07e508f36c4c0fb [term 3 LEADER]: Becoming Leader. State: Replica: 766aab97368b4169b07e508f36c4c0fb, State: Running, Role: LEADER
I20260709 13:04:52.218637 15507 consensus_queue.cc:237] T a7555eadc3bb496bb07b3cc6515fa680 P 766aab97368b4169b07e508f36c4c0fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:52.226125 15087 catalog_manager.cc:5697] T a7555eadc3bb496bb07b3cc6515fa680 P 766aab97368b4169b07e508f36c4c0fb reported cstate change: term changed from 2 to 3, leader changed from a0c7b7a30fcf412c85264c0ed126fede (127.14.180.66) to 766aab97368b4169b07e508f36c4c0fb (127.14.180.67). New cstate: current_term: 3 leader_uuid: "766aab97368b4169b07e508f36c4c0fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:52.458701 15508 raft_consensus.cc:993] T b88f6a525ac24e259e1331eaaa2f41ac P 6c27090ad71542bca01248b778ff440b: : Instructing follower 766aab97368b4169b07e508f36c4c0fb to start an election
I20260709 13:04:52.459108 15519 raft_consensus.cc:1081] T b88f6a525ac24e259e1331eaaa2f41ac P 6c27090ad71542bca01248b778ff440b [term 2 LEADER]: Signalling peer 766aab97368b4169b07e508f36c4c0fb to start an election
I20260709 13:04:52.460942 15339 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b88f6a525ac24e259e1331eaaa2f41ac"
dest_uuid: "766aab97368b4169b07e508f36c4c0fb"
 from {username='slave'} at 127.0.0.1:34344
I20260709 13:04:52.461400 15339 raft_consensus.cc:493] T b88f6a525ac24e259e1331eaaa2f41ac P 766aab97368b4169b07e508f36c4c0fb [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:52.461653 15339 raft_consensus.cc:3060] T b88f6a525ac24e259e1331eaaa2f41ac P 766aab97368b4169b07e508f36c4c0fb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:52.466271 15339 raft_consensus.cc:515] T b88f6a525ac24e259e1331eaaa2f41ac P 766aab97368b4169b07e508f36c4c0fb [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:52.468051 15339 leader_election.cc:290] T b88f6a525ac24e259e1331eaaa2f41ac P 766aab97368b4169b07e508f36c4c0fb [CANDIDATE]: Term 3 election: Requested vote from peers 6c27090ad71542bca01248b778ff440b (127.14.180.65:39863), a0c7b7a30fcf412c85264c0ed126fede (127.14.180.66:33371)
I20260709 13:04:52.469194 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b88f6a525ac24e259e1331eaaa2f41ac" candidate_uuid: "766aab97368b4169b07e508f36c4c0fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a0c7b7a30fcf412c85264c0ed126fede"
I20260709 13:04:52.469218 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b88f6a525ac24e259e1331eaaa2f41ac" candidate_uuid: "766aab97368b4169b07e508f36c4c0fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6c27090ad71542bca01248b778ff440b"
I20260709 13:04:52.469880 15267 raft_consensus.cc:3060] T b88f6a525ac24e259e1331eaaa2f41ac P a0c7b7a30fcf412c85264c0ed126fede [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:52.470050 15190 raft_consensus.cc:3055] T b88f6a525ac24e259e1331eaaa2f41ac P 6c27090ad71542bca01248b778ff440b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:52.470485 15190 raft_consensus.cc:740] T b88f6a525ac24e259e1331eaaa2f41ac P 6c27090ad71542bca01248b778ff440b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6c27090ad71542bca01248b778ff440b, State: Running, Role: LEADER
I20260709 13:04:52.471386 15190 consensus_queue.cc:260] T b88f6a525ac24e259e1331eaaa2f41ac P 6c27090ad71542bca01248b778ff440b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:52.472410 15190 raft_consensus.cc:3060] T b88f6a525ac24e259e1331eaaa2f41ac P 6c27090ad71542bca01248b778ff440b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:52.474447 15267 raft_consensus.cc:2468] T b88f6a525ac24e259e1331eaaa2f41ac P a0c7b7a30fcf412c85264c0ed126fede [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 766aab97368b4169b07e508f36c4c0fb in term 3.
I20260709 13:04:52.475689 15307 leader_election.cc:304] T b88f6a525ac24e259e1331eaaa2f41ac P 766aab97368b4169b07e508f36c4c0fb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 766aab97368b4169b07e508f36c4c0fb, a0c7b7a30fcf412c85264c0ed126fede; no voters: 
I20260709 13:04:52.476506 15507 raft_consensus.cc:2804] T b88f6a525ac24e259e1331eaaa2f41ac P 766aab97368b4169b07e508f36c4c0fb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:52.477056 15507 raft_consensus.cc:697] T b88f6a525ac24e259e1331eaaa2f41ac P 766aab97368b4169b07e508f36c4c0fb [term 3 LEADER]: Becoming Leader. State: Replica: 766aab97368b4169b07e508f36c4c0fb, State: Running, Role: LEADER
I20260709 13:04:52.478261 15190 raft_consensus.cc:2468] T b88f6a525ac24e259e1331eaaa2f41ac P 6c27090ad71542bca01248b778ff440b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 766aab97368b4169b07e508f36c4c0fb in term 3.
I20260709 13:04:52.478076 15507 consensus_queue.cc:237] T b88f6a525ac24e259e1331eaaa2f41ac P 766aab97368b4169b07e508f36c4c0fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:52.487146 15087 catalog_manager.cc:5697] T b88f6a525ac24e259e1331eaaa2f41ac P 766aab97368b4169b07e508f36c4c0fb reported cstate change: term changed from 2 to 3, leader changed from 6c27090ad71542bca01248b778ff440b (127.14.180.65) to 766aab97368b4169b07e508f36c4c0fb (127.14.180.67). New cstate: current_term: 3 leader_uuid: "766aab97368b4169b07e508f36c4c0fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:52.656782 15190 raft_consensus.cc:1275] T a7555eadc3bb496bb07b3cc6515fa680 P 6c27090ad71542bca01248b778ff440b [term 3 FOLLOWER]: Refusing update from remote peer 766aab97368b4169b07e508f36c4c0fb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:52.658335 15507 consensus_queue.cc:1048] T a7555eadc3bb496bb07b3cc6515fa680 P 766aab97368b4169b07e508f36c4c0fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:52.669555 15267 raft_consensus.cc:1275] T a7555eadc3bb496bb07b3cc6515fa680 P a0c7b7a30fcf412c85264c0ed126fede [term 3 FOLLOWER]: Refusing update from remote peer 766aab97368b4169b07e508f36c4c0fb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:52.671474 15507 consensus_queue.cc:1048] T a7555eadc3bb496bb07b3cc6515fa680 P 766aab97368b4169b07e508f36c4c0fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:53.036234 15267 raft_consensus.cc:1275] T b88f6a525ac24e259e1331eaaa2f41ac P a0c7b7a30fcf412c85264c0ed126fede [term 3 FOLLOWER]: Refusing update from remote peer 766aab97368b4169b07e508f36c4c0fb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:53.038102 15507 consensus_queue.cc:1048] T b88f6a525ac24e259e1331eaaa2f41ac P 766aab97368b4169b07e508f36c4c0fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:53.050083 15190 raft_consensus.cc:1275] T b88f6a525ac24e259e1331eaaa2f41ac P 6c27090ad71542bca01248b778ff440b [term 3 FOLLOWER]: Refusing update from remote peer 766aab97368b4169b07e508f36c4c0fb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:53.051940 15507 consensus_queue.cc:1048] T b88f6a525ac24e259e1331eaaa2f41ac P 766aab97368b4169b07e508f36c4c0fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:53.143738 15057 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:53.363981 15190 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c61fe875afff40e39c03b36e7266e263"
dest_uuid: "6c27090ad71542bca01248b778ff440b"
mode: GRACEFUL
new_leader_uuid: "a0c7b7a30fcf412c85264c0ed126fede"
 from {username='slave'} at 127.0.0.1:40922
I20260709 13:04:53.364821 15190 raft_consensus.cc:606] T c61fe875afff40e39c03b36e7266e263 P 6c27090ad71542bca01248b778ff440b [term 2 LEADER]: Received request to transfer leadership to TS a0c7b7a30fcf412c85264c0ed126fede
I20260709 13:04:53.371030 15190 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "550f6b32ce5349e4a632e926d5a452de"
dest_uuid: "6c27090ad71542bca01248b778ff440b"
mode: GRACEFUL
new_leader_uuid: "a0c7b7a30fcf412c85264c0ed126fede"
 from {username='slave'} at 127.0.0.1:40922
I20260709 13:04:53.371582 15190 raft_consensus.cc:606] T 550f6b32ce5349e4a632e926d5a452de P 6c27090ad71542bca01248b778ff440b [term 2 LEADER]: Received request to transfer leadership to TS a0c7b7a30fcf412c85264c0ed126fede
I20260709 13:04:53.377269 15191 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e85d1b0d46a9459a863728eb3bb432c3"
dest_uuid: "6c27090ad71542bca01248b778ff440b"
mode: GRACEFUL
new_leader_uuid: "a0c7b7a30fcf412c85264c0ed126fede"
 from {username='slave'} at 127.0.0.1:40922
I20260709 13:04:53.377856 15191 raft_consensus.cc:606] T e85d1b0d46a9459a863728eb3bb432c3 P 6c27090ad71542bca01248b778ff440b [term 1 LEADER]: Received request to transfer leadership to TS a0c7b7a30fcf412c85264c0ed126fede
I20260709 13:04:53.384135 15339 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b88f6a525ac24e259e1331eaaa2f41ac"
dest_uuid: "766aab97368b4169b07e508f36c4c0fb"
mode: GRACEFUL
new_leader_uuid: "a0c7b7a30fcf412c85264c0ed126fede"
 from {username='slave'} at 127.0.0.1:34360
I20260709 13:04:53.384749 15339 raft_consensus.cc:606] T b88f6a525ac24e259e1331eaaa2f41ac P 766aab97368b4169b07e508f36c4c0fb [term 3 LEADER]: Received request to transfer leadership to TS a0c7b7a30fcf412c85264c0ed126fede
I20260709 13:04:53.391258 15339 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a7555eadc3bb496bb07b3cc6515fa680"
dest_uuid: "766aab97368b4169b07e508f36c4c0fb"
mode: GRACEFUL
new_leader_uuid: "a0c7b7a30fcf412c85264c0ed126fede"
 from {username='slave'} at 127.0.0.1:34360
I20260709 13:04:53.392300 15339 raft_consensus.cc:606] T a7555eadc3bb496bb07b3cc6515fa680 P 766aab97368b4169b07e508f36c4c0fb [term 3 LEADER]: Received request to transfer leadership to TS a0c7b7a30fcf412c85264c0ed126fede
I20260709 13:04:53.472194 15530 raft_consensus.cc:993] T 550f6b32ce5349e4a632e926d5a452de P 6c27090ad71542bca01248b778ff440b: : Instructing follower a0c7b7a30fcf412c85264c0ed126fede to start an election
I20260709 13:04:53.472712 15530 raft_consensus.cc:1081] T 550f6b32ce5349e4a632e926d5a452de P 6c27090ad71542bca01248b778ff440b [term 2 LEADER]: Signalling peer a0c7b7a30fcf412c85264c0ed126fede to start an election
I20260709 13:04:53.474913 15267 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "550f6b32ce5349e4a632e926d5a452de"
dest_uuid: "a0c7b7a30fcf412c85264c0ed126fede"
 from {username='slave'} at 127.0.0.1:54476
I20260709 13:04:53.475574 15267 raft_consensus.cc:493] T 550f6b32ce5349e4a632e926d5a452de P a0c7b7a30fcf412c85264c0ed126fede [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:53.475890 15267 raft_consensus.cc:3060] T 550f6b32ce5349e4a632e926d5a452de P a0c7b7a30fcf412c85264c0ed126fede [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:53.481442 15267 raft_consensus.cc:515] T 550f6b32ce5349e4a632e926d5a452de P a0c7b7a30fcf412c85264c0ed126fede [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:53.483675 15267 leader_election.cc:290] T 550f6b32ce5349e4a632e926d5a452de P a0c7b7a30fcf412c85264c0ed126fede [CANDIDATE]: Term 3 election: Requested vote from peers 6c27090ad71542bca01248b778ff440b (127.14.180.65:39863), 766aab97368b4169b07e508f36c4c0fb (127.14.180.67:42585)
I20260709 13:04:53.484963 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550f6b32ce5349e4a632e926d5a452de" candidate_uuid: "a0c7b7a30fcf412c85264c0ed126fede" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "766aab97368b4169b07e508f36c4c0fb"
I20260709 13:04:53.484685 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550f6b32ce5349e4a632e926d5a452de" candidate_uuid: "a0c7b7a30fcf412c85264c0ed126fede" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6c27090ad71542bca01248b778ff440b"
I20260709 13:04:53.485765 15339 raft_consensus.cc:3060] T 550f6b32ce5349e4a632e926d5a452de P 766aab97368b4169b07e508f36c4c0fb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:53.485782 15191 raft_consensus.cc:3055] T 550f6b32ce5349e4a632e926d5a452de P 6c27090ad71542bca01248b778ff440b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:53.486382 15191 raft_consensus.cc:740] T 550f6b32ce5349e4a632e926d5a452de P 6c27090ad71542bca01248b778ff440b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6c27090ad71542bca01248b778ff440b, State: Running, Role: LEADER
I20260709 13:04:53.487442 15191 consensus_queue.cc:260] T 550f6b32ce5349e4a632e926d5a452de P 6c27090ad71542bca01248b778ff440b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:53.488857 15191 raft_consensus.cc:3060] T 550f6b32ce5349e4a632e926d5a452de P 6c27090ad71542bca01248b778ff440b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:53.493062 15339 raft_consensus.cc:2468] T 550f6b32ce5349e4a632e926d5a452de P 766aab97368b4169b07e508f36c4c0fb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0c7b7a30fcf412c85264c0ed126fede in term 3.
I20260709 13:04:53.494771 15233 leader_election.cc:304] T 550f6b32ce5349e4a632e926d5a452de P a0c7b7a30fcf412c85264c0ed126fede [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 766aab97368b4169b07e508f36c4c0fb, a0c7b7a30fcf412c85264c0ed126fede; no voters: 
I20260709 13:04:53.496429 15531 raft_consensus.cc:2804] T 550f6b32ce5349e4a632e926d5a452de P a0c7b7a30fcf412c85264c0ed126fede [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:53.496944 15191 raft_consensus.cc:2468] T 550f6b32ce5349e4a632e926d5a452de P 6c27090ad71542bca01248b778ff440b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0c7b7a30fcf412c85264c0ed126fede in term 3.
I20260709 13:04:53.497161 15531 raft_consensus.cc:697] T 550f6b32ce5349e4a632e926d5a452de P a0c7b7a30fcf412c85264c0ed126fede [term 3 LEADER]: Becoming Leader. State: Replica: a0c7b7a30fcf412c85264c0ed126fede, State: Running, Role: LEADER
I20260709 13:04:53.498625 15531 consensus_queue.cc:237] T 550f6b32ce5349e4a632e926d5a452de P a0c7b7a30fcf412c85264c0ed126fede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:53.507905 15086 catalog_manager.cc:5697] T 550f6b32ce5349e4a632e926d5a452de P a0c7b7a30fcf412c85264c0ed126fede reported cstate change: term changed from 2 to 3, leader changed from 6c27090ad71542bca01248b778ff440b (127.14.180.65) to a0c7b7a30fcf412c85264c0ed126fede (127.14.180.66). New cstate: current_term: 3 leader_uuid: "a0c7b7a30fcf412c85264c0ed126fede" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:53.520236 15507 raft_consensus.cc:993] T b88f6a525ac24e259e1331eaaa2f41ac P 766aab97368b4169b07e508f36c4c0fb: : Instructing follower a0c7b7a30fcf412c85264c0ed126fede to start an election
I20260709 13:04:53.520838 15507 raft_consensus.cc:1081] T b88f6a525ac24e259e1331eaaa2f41ac P 766aab97368b4169b07e508f36c4c0fb [term 3 LEADER]: Signalling peer a0c7b7a30fcf412c85264c0ed126fede to start an election
I20260709 13:04:53.522907 15267 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b88f6a525ac24e259e1331eaaa2f41ac"
dest_uuid: "a0c7b7a30fcf412c85264c0ed126fede"
 from {username='slave'} at 127.0.0.1:54490
I20260709 13:04:53.523497 15267 raft_consensus.cc:493] T b88f6a525ac24e259e1331eaaa2f41ac P a0c7b7a30fcf412c85264c0ed126fede [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:53.523856 15267 raft_consensus.cc:3060] T b88f6a525ac24e259e1331eaaa2f41ac P a0c7b7a30fcf412c85264c0ed126fede [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:53.528741 15267 raft_consensus.cc:515] T b88f6a525ac24e259e1331eaaa2f41ac P a0c7b7a30fcf412c85264c0ed126fede [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:53.530755 15267 leader_election.cc:290] T b88f6a525ac24e259e1331eaaa2f41ac P a0c7b7a30fcf412c85264c0ed126fede [CANDIDATE]: Term 4 election: Requested vote from peers 6c27090ad71542bca01248b778ff440b (127.14.180.65:39863), 766aab97368b4169b07e508f36c4c0fb (127.14.180.67:42585)
I20260709 13:04:53.531872 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b88f6a525ac24e259e1331eaaa2f41ac" candidate_uuid: "a0c7b7a30fcf412c85264c0ed126fede" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "6c27090ad71542bca01248b778ff440b"
I20260709 13:04:53.532203 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b88f6a525ac24e259e1331eaaa2f41ac" candidate_uuid: "a0c7b7a30fcf412c85264c0ed126fede" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "766aab97368b4169b07e508f36c4c0fb"
I20260709 13:04:53.532449 15191 raft_consensus.cc:3060] T b88f6a525ac24e259e1331eaaa2f41ac P 6c27090ad71542bca01248b778ff440b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:53.532840 15339 raft_consensus.cc:3055] T b88f6a525ac24e259e1331eaaa2f41ac P 766aab97368b4169b07e508f36c4c0fb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:04:53.533157 15339 raft_consensus.cc:740] T b88f6a525ac24e259e1331eaaa2f41ac P 766aab97368b4169b07e508f36c4c0fb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 766aab97368b4169b07e508f36c4c0fb, State: Running, Role: LEADER
I20260709 13:04:53.533915 15339 consensus_queue.cc:260] T b88f6a525ac24e259e1331eaaa2f41ac P 766aab97368b4169b07e508f36c4c0fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:53.535070 15339 raft_consensus.cc:3060] T b88f6a525ac24e259e1331eaaa2f41ac P 766aab97368b4169b07e508f36c4c0fb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:53.538060 15191 raft_consensus.cc:2468] T b88f6a525ac24e259e1331eaaa2f41ac P 6c27090ad71542bca01248b778ff440b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0c7b7a30fcf412c85264c0ed126fede in term 4.
I20260709 13:04:53.539618 15232 leader_election.cc:304] T b88f6a525ac24e259e1331eaaa2f41ac P a0c7b7a30fcf412c85264c0ed126fede [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c27090ad71542bca01248b778ff440b, a0c7b7a30fcf412c85264c0ed126fede; no voters: 
I20260709 13:04:53.539907 15339 raft_consensus.cc:2468] T b88f6a525ac24e259e1331eaaa2f41ac P 766aab97368b4169b07e508f36c4c0fb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0c7b7a30fcf412c85264c0ed126fede in term 4.
I20260709 13:04:53.540792 15531 raft_consensus.cc:2804] T b88f6a525ac24e259e1331eaaa2f41ac P a0c7b7a30fcf412c85264c0ed126fede [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:04:53.541325 15531 raft_consensus.cc:697] T b88f6a525ac24e259e1331eaaa2f41ac P a0c7b7a30fcf412c85264c0ed126fede [term 4 LEADER]: Becoming Leader. State: Replica: a0c7b7a30fcf412c85264c0ed126fede, State: Running, Role: LEADER
I20260709 13:04:53.542137 15531 consensus_queue.cc:237] T b88f6a525ac24e259e1331eaaa2f41ac P a0c7b7a30fcf412c85264c0ed126fede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:53.548907 15086 catalog_manager.cc:5697] T b88f6a525ac24e259e1331eaaa2f41ac P a0c7b7a30fcf412c85264c0ed126fede reported cstate change: term changed from 3 to 4, leader changed from 766aab97368b4169b07e508f36c4c0fb (127.14.180.67) to a0c7b7a30fcf412c85264c0ed126fede (127.14.180.66). New cstate: current_term: 4 leader_uuid: "a0c7b7a30fcf412c85264c0ed126fede" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:53.657063 15519 raft_consensus.cc:993] T e85d1b0d46a9459a863728eb3bb432c3 P 6c27090ad71542bca01248b778ff440b: : Instructing follower a0c7b7a30fcf412c85264c0ed126fede to start an election
I20260709 13:04:53.657512 15530 raft_consensus.cc:1081] T e85d1b0d46a9459a863728eb3bb432c3 P 6c27090ad71542bca01248b778ff440b [term 1 LEADER]: Signalling peer a0c7b7a30fcf412c85264c0ed126fede to start an election
I20260709 13:04:53.659001 15267 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e85d1b0d46a9459a863728eb3bb432c3"
dest_uuid: "a0c7b7a30fcf412c85264c0ed126fede"
 from {username='slave'} at 127.0.0.1:54476
I20260709 13:04:53.659402 15267 raft_consensus.cc:493] T e85d1b0d46a9459a863728eb3bb432c3 P a0c7b7a30fcf412c85264c0ed126fede [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:53.659622 15267 raft_consensus.cc:3060] T e85d1b0d46a9459a863728eb3bb432c3 P a0c7b7a30fcf412c85264c0ed126fede [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:53.663734 15267 raft_consensus.cc:515] T e85d1b0d46a9459a863728eb3bb432c3 P a0c7b7a30fcf412c85264c0ed126fede [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:53.665295 15267 leader_election.cc:290] T e85d1b0d46a9459a863728eb3bb432c3 P a0c7b7a30fcf412c85264c0ed126fede [CANDIDATE]: Term 2 election: Requested vote from peers 6c27090ad71542bca01248b778ff440b (127.14.180.65:39863), 766aab97368b4169b07e508f36c4c0fb (127.14.180.67:42585)
I20260709 13:04:53.666211 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85d1b0d46a9459a863728eb3bb432c3" candidate_uuid: "a0c7b7a30fcf412c85264c0ed126fede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6c27090ad71542bca01248b778ff440b"
I20260709 13:04:53.666917 15191 raft_consensus.cc:3055] T e85d1b0d46a9459a863728eb3bb432c3 P 6c27090ad71542bca01248b778ff440b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:53.666890 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85d1b0d46a9459a863728eb3bb432c3" candidate_uuid: "a0c7b7a30fcf412c85264c0ed126fede" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "766aab97368b4169b07e508f36c4c0fb"
I20260709 13:04:53.667377 15191 raft_consensus.cc:740] T e85d1b0d46a9459a863728eb3bb432c3 P 6c27090ad71542bca01248b778ff440b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6c27090ad71542bca01248b778ff440b, State: Running, Role: LEADER
I20260709 13:04:53.667528 15339 raft_consensus.cc:3060] T e85d1b0d46a9459a863728eb3bb432c3 P 766aab97368b4169b07e508f36c4c0fb [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:53.668220 15191 consensus_queue.cc:260] T e85d1b0d46a9459a863728eb3bb432c3 P 6c27090ad71542bca01248b778ff440b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:53.669492 15191 raft_consensus.cc:3060] T e85d1b0d46a9459a863728eb3bb432c3 P 6c27090ad71542bca01248b778ff440b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:53.674111 15339 raft_consensus.cc:2468] T e85d1b0d46a9459a863728eb3bb432c3 P 766aab97368b4169b07e508f36c4c0fb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0c7b7a30fcf412c85264c0ed126fede in term 2.
I20260709 13:04:53.675333 15233 leader_election.cc:304] T e85d1b0d46a9459a863728eb3bb432c3 P a0c7b7a30fcf412c85264c0ed126fede [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 766aab97368b4169b07e508f36c4c0fb, a0c7b7a30fcf412c85264c0ed126fede; no voters: 
I20260709 13:04:53.676154 15531 raft_consensus.cc:2804] T e85d1b0d46a9459a863728eb3bb432c3 P a0c7b7a30fcf412c85264c0ed126fede [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:53.676262 15191 raft_consensus.cc:2468] T e85d1b0d46a9459a863728eb3bb432c3 P 6c27090ad71542bca01248b778ff440b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0c7b7a30fcf412c85264c0ed126fede in term 2.
I20260709 13:04:53.676578 15531 raft_consensus.cc:697] T e85d1b0d46a9459a863728eb3bb432c3 P a0c7b7a30fcf412c85264c0ed126fede [term 2 LEADER]: Becoming Leader. State: Replica: a0c7b7a30fcf412c85264c0ed126fede, State: Running, Role: LEADER
I20260709 13:04:53.677666 15531 consensus_queue.cc:237] T e85d1b0d46a9459a863728eb3bb432c3 P a0c7b7a30fcf412c85264c0ed126fede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:53.684470 15086 catalog_manager.cc:5697] T e85d1b0d46a9459a863728eb3bb432c3 P a0c7b7a30fcf412c85264c0ed126fede reported cstate change: term changed from 1 to 2, leader changed from 6c27090ad71542bca01248b778ff440b (127.14.180.65) to a0c7b7a30fcf412c85264c0ed126fede (127.14.180.66). New cstate: current_term: 2 leader_uuid: "a0c7b7a30fcf412c85264c0ed126fede" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:53.722219 15519 raft_consensus.cc:993] T c61fe875afff40e39c03b36e7266e263 P 6c27090ad71542bca01248b778ff440b: : Instructing follower a0c7b7a30fcf412c85264c0ed126fede to start an election
I20260709 13:04:53.722802 15530 raft_consensus.cc:1081] T c61fe875afff40e39c03b36e7266e263 P 6c27090ad71542bca01248b778ff440b [term 2 LEADER]: Signalling peer a0c7b7a30fcf412c85264c0ed126fede to start an election
I20260709 13:04:53.724351 15267 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c61fe875afff40e39c03b36e7266e263"
dest_uuid: "a0c7b7a30fcf412c85264c0ed126fede"
 from {username='slave'} at 127.0.0.1:54476
I20260709 13:04:53.724856 15267 raft_consensus.cc:493] T c61fe875afff40e39c03b36e7266e263 P a0c7b7a30fcf412c85264c0ed126fede [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:53.725204 15267 raft_consensus.cc:3060] T c61fe875afff40e39c03b36e7266e263 P a0c7b7a30fcf412c85264c0ed126fede [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:53.729593 15267 raft_consensus.cc:515] T c61fe875afff40e39c03b36e7266e263 P a0c7b7a30fcf412c85264c0ed126fede [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } } peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } }
I20260709 13:04:53.731884 15267 leader_election.cc:290] T c61fe875afff40e39c03b36e7266e263 P a0c7b7a30fcf412c85264c0ed126fede [CANDIDATE]: Term 3 election: Requested vote from peers 766aab97368b4169b07e508f36c4c0fb (127.14.180.67:42585), 6c27090ad71542bca01248b778ff440b (127.14.180.65:39863)
I20260709 13:04:53.732987 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61fe875afff40e39c03b36e7266e263" candidate_uuid: "a0c7b7a30fcf412c85264c0ed126fede" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "766aab97368b4169b07e508f36c4c0fb"
I20260709 13:04:53.733254 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61fe875afff40e39c03b36e7266e263" candidate_uuid: "a0c7b7a30fcf412c85264c0ed126fede" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6c27090ad71542bca01248b778ff440b"
I20260709 13:04:53.733541 15339 raft_consensus.cc:3060] T c61fe875afff40e39c03b36e7266e263 P 766aab97368b4169b07e508f36c4c0fb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:53.733858 15191 raft_consensus.cc:3055] T c61fe875afff40e39c03b36e7266e263 P 6c27090ad71542bca01248b778ff440b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:53.734709 15191 raft_consensus.cc:740] T c61fe875afff40e39c03b36e7266e263 P 6c27090ad71542bca01248b778ff440b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6c27090ad71542bca01248b778ff440b, State: Running, Role: LEADER
I20260709 13:04:53.734838 15513 raft_consensus.cc:993] T a7555eadc3bb496bb07b3cc6515fa680 P 766aab97368b4169b07e508f36c4c0fb: : Instructing follower a0c7b7a30fcf412c85264c0ed126fede to start an election
I20260709 13:04:53.735361 15507 raft_consensus.cc:1081] T a7555eadc3bb496bb07b3cc6515fa680 P 766aab97368b4169b07e508f36c4c0fb [term 3 LEADER]: Signalling peer a0c7b7a30fcf412c85264c0ed126fede to start an election
I20260709 13:04:53.735642 15191 consensus_queue.cc:260] T c61fe875afff40e39c03b36e7266e263 P 6c27090ad71542bca01248b778ff440b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } } peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } }
I20260709 13:04:53.736819 15191 raft_consensus.cc:3060] T c61fe875afff40e39c03b36e7266e263 P 6c27090ad71542bca01248b778ff440b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:53.737264 15267 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a7555eadc3bb496bb07b3cc6515fa680"
dest_uuid: "a0c7b7a30fcf412c85264c0ed126fede"
 from {username='slave'} at 127.0.0.1:54490
I20260709 13:04:53.737788 15267 raft_consensus.cc:493] T a7555eadc3bb496bb07b3cc6515fa680 P a0c7b7a30fcf412c85264c0ed126fede [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:53.738118 15267 raft_consensus.cc:3060] T a7555eadc3bb496bb07b3cc6515fa680 P a0c7b7a30fcf412c85264c0ed126fede [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:53.739293 15339 raft_consensus.cc:2468] T c61fe875afff40e39c03b36e7266e263 P 766aab97368b4169b07e508f36c4c0fb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0c7b7a30fcf412c85264c0ed126fede in term 3.
I20260709 13:04:53.740370 15233 leader_election.cc:304] T c61fe875afff40e39c03b36e7266e263 P a0c7b7a30fcf412c85264c0ed126fede [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 766aab97368b4169b07e508f36c4c0fb, a0c7b7a30fcf412c85264c0ed126fede; no voters: 
I20260709 13:04:53.741154 15531 raft_consensus.cc:2804] T c61fe875afff40e39c03b36e7266e263 P a0c7b7a30fcf412c85264c0ed126fede [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:53.741631 15531 raft_consensus.cc:697] T c61fe875afff40e39c03b36e7266e263 P a0c7b7a30fcf412c85264c0ed126fede [term 3 LEADER]: Becoming Leader. State: Replica: a0c7b7a30fcf412c85264c0ed126fede, State: Running, Role: LEADER
I20260709 13:04:53.742709 15531 consensus_queue.cc:237] T c61fe875afff40e39c03b36e7266e263 P a0c7b7a30fcf412c85264c0ed126fede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } } peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } }
I20260709 13:04:53.743901 15191 raft_consensus.cc:2468] T c61fe875afff40e39c03b36e7266e263 P 6c27090ad71542bca01248b778ff440b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0c7b7a30fcf412c85264c0ed126fede in term 3.
I20260709 13:04:53.744521 15267 raft_consensus.cc:515] T a7555eadc3bb496bb07b3cc6515fa680 P a0c7b7a30fcf412c85264c0ed126fede [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:53.746289 15267 leader_election.cc:290] T a7555eadc3bb496bb07b3cc6515fa680 P a0c7b7a30fcf412c85264c0ed126fede [CANDIDATE]: Term 4 election: Requested vote from peers 6c27090ad71542bca01248b778ff440b (127.14.180.65:39863), 766aab97368b4169b07e508f36c4c0fb (127.14.180.67:42585)
I20260709 13:04:53.747457 15339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7555eadc3bb496bb07b3cc6515fa680" candidate_uuid: "a0c7b7a30fcf412c85264c0ed126fede" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "766aab97368b4169b07e508f36c4c0fb"
I20260709 13:04:53.748019 15339 raft_consensus.cc:3055] T a7555eadc3bb496bb07b3cc6515fa680 P 766aab97368b4169b07e508f36c4c0fb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:04:53.748287 15339 raft_consensus.cc:740] T a7555eadc3bb496bb07b3cc6515fa680 P 766aab97368b4169b07e508f36c4c0fb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 766aab97368b4169b07e508f36c4c0fb, State: Running, Role: LEADER
I20260709 13:04:53.748657 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7555eadc3bb496bb07b3cc6515fa680" candidate_uuid: "a0c7b7a30fcf412c85264c0ed126fede" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "6c27090ad71542bca01248b778ff440b"
I20260709 13:04:53.748987 15339 consensus_queue.cc:260] T a7555eadc3bb496bb07b3cc6515fa680 P 766aab97368b4169b07e508f36c4c0fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:53.749571 15191 raft_consensus.cc:3060] T a7555eadc3bb496bb07b3cc6515fa680 P 6c27090ad71542bca01248b778ff440b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:53.750162 15339 raft_consensus.cc:3060] T a7555eadc3bb496bb07b3cc6515fa680 P 766aab97368b4169b07e508f36c4c0fb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:53.756628 15191 raft_consensus.cc:2468] T a7555eadc3bb496bb07b3cc6515fa680 P 6c27090ad71542bca01248b778ff440b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0c7b7a30fcf412c85264c0ed126fede in term 4.
I20260709 13:04:53.756465 15086 catalog_manager.cc:5697] T c61fe875afff40e39c03b36e7266e263 P a0c7b7a30fcf412c85264c0ed126fede reported cstate change: term changed from 2 to 3, leader changed from 6c27090ad71542bca01248b778ff440b (127.14.180.65) to a0c7b7a30fcf412c85264c0ed126fede (127.14.180.66). New cstate: current_term: 3 leader_uuid: "a0c7b7a30fcf412c85264c0ed126fede" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:53.757390 15339 raft_consensus.cc:2468] T a7555eadc3bb496bb07b3cc6515fa680 P 766aab97368b4169b07e508f36c4c0fb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0c7b7a30fcf412c85264c0ed126fede in term 4.
I20260709 13:04:53.757897 15232 leader_election.cc:304] T a7555eadc3bb496bb07b3cc6515fa680 P a0c7b7a30fcf412c85264c0ed126fede [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c27090ad71542bca01248b778ff440b, a0c7b7a30fcf412c85264c0ed126fede; no voters: 
I20260709 13:04:53.758802 15531 raft_consensus.cc:2804] T a7555eadc3bb496bb07b3cc6515fa680 P a0c7b7a30fcf412c85264c0ed126fede [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:04:53.759291 15531 raft_consensus.cc:697] T a7555eadc3bb496bb07b3cc6515fa680 P a0c7b7a30fcf412c85264c0ed126fede [term 4 LEADER]: Becoming Leader. State: Replica: a0c7b7a30fcf412c85264c0ed126fede, State: Running, Role: LEADER
I20260709 13:04:53.760026 15531 consensus_queue.cc:237] T a7555eadc3bb496bb07b3cc6515fa680 P a0c7b7a30fcf412c85264c0ed126fede [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:53.770835 15086 catalog_manager.cc:5697] T a7555eadc3bb496bb07b3cc6515fa680 P a0c7b7a30fcf412c85264c0ed126fede reported cstate change: term changed from 3 to 4, leader changed from 766aab97368b4169b07e508f36c4c0fb (127.14.180.67) to a0c7b7a30fcf412c85264c0ed126fede (127.14.180.66). New cstate: current_term: 4 leader_uuid: "a0c7b7a30fcf412c85264c0ed126fede" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:53.993602 15191 raft_consensus.cc:1275] T b88f6a525ac24e259e1331eaaa2f41ac P 6c27090ad71542bca01248b778ff440b [term 4 FOLLOWER]: Refusing update from remote peer a0c7b7a30fcf412c85264c0ed126fede: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:04:53.995018 15531 consensus_queue.cc:1048] T b88f6a525ac24e259e1331eaaa2f41ac P a0c7b7a30fcf412c85264c0ed126fede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:54.006557 15339 raft_consensus.cc:1275] T b88f6a525ac24e259e1331eaaa2f41ac P 766aab97368b4169b07e508f36c4c0fb [term 4 FOLLOWER]: Refusing update from remote peer a0c7b7a30fcf412c85264c0ed126fede: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:04:54.008112 15490 consensus_queue.cc:1048] T b88f6a525ac24e259e1331eaaa2f41ac P a0c7b7a30fcf412c85264c0ed126fede [LEADER]: Connected to new peer: Peer: permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:04:54.023242 15339 raft_consensus.cc:1275] T 550f6b32ce5349e4a632e926d5a452de P 766aab97368b4169b07e508f36c4c0fb [term 3 FOLLOWER]: Refusing update from remote peer a0c7b7a30fcf412c85264c0ed126fede: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:54.024827 15490 consensus_queue.cc:1048] T 550f6b32ce5349e4a632e926d5a452de P a0c7b7a30fcf412c85264c0ed126fede [LEADER]: Connected to new peer: Peer: permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:54.036638 15191 raft_consensus.cc:1275] T 550f6b32ce5349e4a632e926d5a452de P 6c27090ad71542bca01248b778ff440b [term 3 FOLLOWER]: Refusing update from remote peer a0c7b7a30fcf412c85264c0ed126fede: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:54.038233 15531 consensus_queue.cc:1048] T 550f6b32ce5349e4a632e926d5a452de P a0c7b7a30fcf412c85264c0ed126fede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:04:54.094681 15120 debug-util.cc:398] Leaking SignalData structure 0x7b0800062060 after lost signal to thread 15060
W20260709 13:04:54.095587 15120 debug-util.cc:398] Leaking SignalData structure 0x7b0800062740 after lost signal to thread 15123
W20260709 13:04:54.096308 15120 debug-util.cc:398] Leaking SignalData structure 0x7b08001ebea0 after lost signal to thread 15216
W20260709 13:04:54.096943 15120 debug-util.cc:398] Leaking SignalData structure 0x7b08001b0520 after lost signal to thread 15291
W20260709 13:04:54.097559 15120 debug-util.cc:398] Leaking SignalData structure 0x7b08001f1400 after lost signal to thread 15365
I20260709 13:04:54.193746 15339 raft_consensus.cc:1275] T a7555eadc3bb496bb07b3cc6515fa680 P 766aab97368b4169b07e508f36c4c0fb [term 4 FOLLOWER]: Refusing update from remote peer a0c7b7a30fcf412c85264c0ed126fede: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:04:54.195410 15531 consensus_queue.cc:1048] T a7555eadc3bb496bb07b3cc6515fa680 P a0c7b7a30fcf412c85264c0ed126fede [LEADER]: Connected to new peer: Peer: permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:54.206297 15191 raft_consensus.cc:1275] T a7555eadc3bb496bb07b3cc6515fa680 P 6c27090ad71542bca01248b778ff440b [term 4 FOLLOWER]: Refusing update from remote peer a0c7b7a30fcf412c85264c0ed126fede: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:04:54.208535 15545 consensus_queue.cc:1048] T a7555eadc3bb496bb07b3cc6515fa680 P a0c7b7a30fcf412c85264c0ed126fede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:04:54.212349 15339 raft_consensus.cc:1275] T e85d1b0d46a9459a863728eb3bb432c3 P 766aab97368b4169b07e508f36c4c0fb [term 2 FOLLOWER]: Refusing update from remote peer a0c7b7a30fcf412c85264c0ed126fede: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:54.214100 15490 consensus_queue.cc:1048] T e85d1b0d46a9459a863728eb3bb432c3 P a0c7b7a30fcf412c85264c0ed126fede [LEADER]: Connected to new peer: Peer: permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:54.226507 15190 raft_consensus.cc:1275] T e85d1b0d46a9459a863728eb3bb432c3 P 6c27090ad71542bca01248b778ff440b [term 2 FOLLOWER]: Refusing update from remote peer a0c7b7a30fcf412c85264c0ed126fede: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:54.228551 15490 consensus_queue.cc:1048] T e85d1b0d46a9459a863728eb3bb432c3 P a0c7b7a30fcf412c85264c0ed126fede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:54.260680 15190 raft_consensus.cc:1275] T c61fe875afff40e39c03b36e7266e263 P 6c27090ad71542bca01248b778ff440b [term 3 FOLLOWER]: Refusing update from remote peer a0c7b7a30fcf412c85264c0ed126fede: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:54.262342 15490 consensus_queue.cc:1048] T c61fe875afff40e39c03b36e7266e263 P a0c7b7a30fcf412c85264c0ed126fede [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:54.275151 15339 raft_consensus.cc:1275] T c61fe875afff40e39c03b36e7266e263 P 766aab97368b4169b07e508f36c4c0fb [term 3 FOLLOWER]: Refusing update from remote peer a0c7b7a30fcf412c85264c0ed126fede: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:54.281484 15490 consensus_queue.cc:1048] T c61fe875afff40e39c03b36e7266e263 P a0c7b7a30fcf412c85264c0ed126fede [LEADER]: Connected to new peer: Peer: permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:56.407769 15057 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:56.416824 15267 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "550f6b32ce5349e4a632e926d5a452de"
dest_uuid: "a0c7b7a30fcf412c85264c0ed126fede"
mode: GRACEFUL
new_leader_uuid: "6c27090ad71542bca01248b778ff440b"
 from {username='slave'} at 127.0.0.1:57256
I20260709 13:04:56.417508 15267 raft_consensus.cc:606] T 550f6b32ce5349e4a632e926d5a452de P a0c7b7a30fcf412c85264c0ed126fede [term 3 LEADER]: Received request to transfer leadership to TS 6c27090ad71542bca01248b778ff440b
I20260709 13:04:56.420466 15267 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5b125feea68040eeb559e4bfa093536c"
dest_uuid: "a0c7b7a30fcf412c85264c0ed126fede"
mode: GRACEFUL
new_leader_uuid: "766aab97368b4169b07e508f36c4c0fb"
 from {username='slave'} at 127.0.0.1:57256
I20260709 13:04:56.421136 15267 raft_consensus.cc:606] T 5b125feea68040eeb559e4bfa093536c P a0c7b7a30fcf412c85264c0ed126fede [term 3 LEADER]: Received request to transfer leadership to TS 766aab97368b4169b07e508f36c4c0fb
I20260709 13:04:56.424716 15267 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9f79381ee9024a9e985aab93d98359e5"
dest_uuid: "a0c7b7a30fcf412c85264c0ed126fede"
mode: GRACEFUL
new_leader_uuid: "766aab97368b4169b07e508f36c4c0fb"
 from {username='slave'} at 127.0.0.1:57256
I20260709 13:04:56.425390 15267 raft_consensus.cc:606] T 9f79381ee9024a9e985aab93d98359e5 P a0c7b7a30fcf412c85264c0ed126fede [term 2 LEADER]: Received request to transfer leadership to TS 766aab97368b4169b07e508f36c4c0fb
I20260709 13:04:56.428530 15267 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c61fe875afff40e39c03b36e7266e263"
dest_uuid: "a0c7b7a30fcf412c85264c0ed126fede"
mode: GRACEFUL
new_leader_uuid: "6c27090ad71542bca01248b778ff440b"
 from {username='slave'} at 127.0.0.1:57256
I20260709 13:04:56.429173 15267 raft_consensus.cc:606] T c61fe875afff40e39c03b36e7266e263 P a0c7b7a30fcf412c85264c0ed126fede [term 3 LEADER]: Received request to transfer leadership to TS 6c27090ad71542bca01248b778ff440b
I20260709 13:04:56.432173 15267 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e85d1b0d46a9459a863728eb3bb432c3"
dest_uuid: "a0c7b7a30fcf412c85264c0ed126fede"
mode: GRACEFUL
new_leader_uuid: "6c27090ad71542bca01248b778ff440b"
 from {username='slave'} at 127.0.0.1:57256
I20260709 13:04:56.432819 15267 raft_consensus.cc:606] T e85d1b0d46a9459a863728eb3bb432c3 P a0c7b7a30fcf412c85264c0ed126fede [term 2 LEADER]: Received request to transfer leadership to TS 6c27090ad71542bca01248b778ff440b
I20260709 13:04:56.434298 15057 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:04:56.435020 15057 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:56.688010 15554 raft_consensus.cc:993] T 5b125feea68040eeb559e4bfa093536c P a0c7b7a30fcf412c85264c0ed126fede: : Instructing follower 766aab97368b4169b07e508f36c4c0fb to start an election
I20260709 13:04:56.688534 15554 raft_consensus.cc:1081] T 5b125feea68040eeb559e4bfa093536c P a0c7b7a30fcf412c85264c0ed126fede [term 3 LEADER]: Signalling peer 766aab97368b4169b07e508f36c4c0fb to start an election
I20260709 13:04:56.690984 15341 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5b125feea68040eeb559e4bfa093536c"
dest_uuid: "766aab97368b4169b07e508f36c4c0fb"
 from {username='slave'} at 127.0.0.1:34332
I20260709 13:04:56.691632 15341 raft_consensus.cc:493] T 5b125feea68040eeb559e4bfa093536c P 766aab97368b4169b07e508f36c4c0fb [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:56.692055 15341 raft_consensus.cc:3060] T 5b125feea68040eeb559e4bfa093536c P 766aab97368b4169b07e508f36c4c0fb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:56.700361 15341 raft_consensus.cc:515] T 5b125feea68040eeb559e4bfa093536c P 766aab97368b4169b07e508f36c4c0fb [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:56.703116 15341 leader_election.cc:290] T 5b125feea68040eeb559e4bfa093536c P 766aab97368b4169b07e508f36c4c0fb [CANDIDATE]: Term 4 election: Requested vote from peers 6c27090ad71542bca01248b778ff440b (127.14.180.65:39863), a0c7b7a30fcf412c85264c0ed126fede (127.14.180.66:33371)
I20260709 13:04:56.704210 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b125feea68040eeb559e4bfa093536c" candidate_uuid: "766aab97368b4169b07e508f36c4c0fb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "a0c7b7a30fcf412c85264c0ed126fede"
I20260709 13:04:56.704246 15190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b125feea68040eeb559e4bfa093536c" candidate_uuid: "766aab97368b4169b07e508f36c4c0fb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "6c27090ad71542bca01248b778ff440b"
I20260709 13:04:56.705093 15267 raft_consensus.cc:3055] T 5b125feea68040eeb559e4bfa093536c P a0c7b7a30fcf412c85264c0ed126fede [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:04:56.705382 15190 raft_consensus.cc:3060] T 5b125feea68040eeb559e4bfa093536c P 6c27090ad71542bca01248b778ff440b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:56.705583 15267 raft_consensus.cc:740] T 5b125feea68040eeb559e4bfa093536c P a0c7b7a30fcf412c85264c0ed126fede [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a0c7b7a30fcf412c85264c0ed126fede, State: Running, Role: LEADER
I20260709 13:04:56.706447 15267 consensus_queue.cc:260] T 5b125feea68040eeb559e4bfa093536c P a0c7b7a30fcf412c85264c0ed126fede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:56.707646 15267 raft_consensus.cc:3060] T 5b125feea68040eeb559e4bfa093536c P a0c7b7a30fcf412c85264c0ed126fede [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:56.713070 15554 raft_consensus.cc:993] T c61fe875afff40e39c03b36e7266e263 P a0c7b7a30fcf412c85264c0ed126fede: : Instructing follower 6c27090ad71542bca01248b778ff440b to start an election
I20260709 13:04:56.713650 15555 raft_consensus.cc:1081] T c61fe875afff40e39c03b36e7266e263 P a0c7b7a30fcf412c85264c0ed126fede [term 3 LEADER]: Signalling peer 6c27090ad71542bca01248b778ff440b to start an election
I20260709 13:04:56.714303 15190 raft_consensus.cc:2468] T 5b125feea68040eeb559e4bfa093536c P 6c27090ad71542bca01248b778ff440b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 766aab97368b4169b07e508f36c4c0fb in term 4.
I20260709 13:04:56.715777 15190 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c61fe875afff40e39c03b36e7266e263"
dest_uuid: "6c27090ad71542bca01248b778ff440b"
 from {username='slave'} at 127.0.0.1:40904
I20260709 13:04:56.715975 15267 raft_consensus.cc:2468] T 5b125feea68040eeb559e4bfa093536c P a0c7b7a30fcf412c85264c0ed126fede [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 766aab97368b4169b07e508f36c4c0fb in term 4.
I20260709 13:04:56.716135 15306 leader_election.cc:304] T 5b125feea68040eeb559e4bfa093536c P 766aab97368b4169b07e508f36c4c0fb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c27090ad71542bca01248b778ff440b, 766aab97368b4169b07e508f36c4c0fb; no voters: 
I20260709 13:04:56.716645 15190 raft_consensus.cc:493] T c61fe875afff40e39c03b36e7266e263 P 6c27090ad71542bca01248b778ff440b [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:56.717116 15190 raft_consensus.cc:3060] T c61fe875afff40e39c03b36e7266e263 P 6c27090ad71542bca01248b778ff440b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:56.717163 15507 raft_consensus.cc:2804] T 5b125feea68040eeb559e4bfa093536c P 766aab97368b4169b07e508f36c4c0fb [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:04:56.718828 15507 raft_consensus.cc:697] T 5b125feea68040eeb559e4bfa093536c P 766aab97368b4169b07e508f36c4c0fb [term 4 LEADER]: Becoming Leader. State: Replica: 766aab97368b4169b07e508f36c4c0fb, State: Running, Role: LEADER
I20260709 13:04:56.719904 15507 consensus_queue.cc:237] T 5b125feea68040eeb559e4bfa093536c P 766aab97368b4169b07e508f36c4c0fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:56.725416 15190 raft_consensus.cc:515] T c61fe875afff40e39c03b36e7266e263 P 6c27090ad71542bca01248b778ff440b [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } } peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } }
I20260709 13:04:56.729532 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61fe875afff40e39c03b36e7266e263" candidate_uuid: "6c27090ad71542bca01248b778ff440b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "a0c7b7a30fcf412c85264c0ed126fede"
I20260709 13:04:56.729154 15086 catalog_manager.cc:5697] T 5b125feea68040eeb559e4bfa093536c P 766aab97368b4169b07e508f36c4c0fb reported cstate change: term changed from 3 to 4, leader changed from a0c7b7a30fcf412c85264c0ed126fede (127.14.180.66) to 766aab97368b4169b07e508f36c4c0fb (127.14.180.67). New cstate: current_term: 4 leader_uuid: "766aab97368b4169b07e508f36c4c0fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:56.729790 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c61fe875afff40e39c03b36e7266e263" candidate_uuid: "6c27090ad71542bca01248b778ff440b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "766aab97368b4169b07e508f36c4c0fb"
I20260709 13:04:56.730124 15267 raft_consensus.cc:3055] T c61fe875afff40e39c03b36e7266e263 P a0c7b7a30fcf412c85264c0ed126fede [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:04:56.730506 15267 raft_consensus.cc:740] T c61fe875afff40e39c03b36e7266e263 P a0c7b7a30fcf412c85264c0ed126fede [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a0c7b7a30fcf412c85264c0ed126fede, State: Running, Role: LEADER
I20260709 13:04:56.730600 15190 leader_election.cc:290] T c61fe875afff40e39c03b36e7266e263 P 6c27090ad71542bca01248b778ff440b [CANDIDATE]: Term 4 election: Requested vote from peers a0c7b7a30fcf412c85264c0ed126fede (127.14.180.66:33371), 766aab97368b4169b07e508f36c4c0fb (127.14.180.67:42585)
I20260709 13:04:56.731381 15267 consensus_queue.cc:260] T c61fe875afff40e39c03b36e7266e263 P a0c7b7a30fcf412c85264c0ed126fede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } } peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } }
I20260709 13:04:56.730516 15341 raft_consensus.cc:3060] T c61fe875afff40e39c03b36e7266e263 P 766aab97368b4169b07e508f36c4c0fb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:56.732743 15267 raft_consensus.cc:3060] T c61fe875afff40e39c03b36e7266e263 P a0c7b7a30fcf412c85264c0ed126fede [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:56.743937 15341 raft_consensus.cc:2468] T c61fe875afff40e39c03b36e7266e263 P 766aab97368b4169b07e508f36c4c0fb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c27090ad71542bca01248b778ff440b in term 4.
I20260709 13:04:56.743956 15267 raft_consensus.cc:2468] T c61fe875afff40e39c03b36e7266e263 P a0c7b7a30fcf412c85264c0ed126fede [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c27090ad71542bca01248b778ff440b in term 4.
I20260709 13:04:56.746726 15158 leader_election.cc:304] T c61fe875afff40e39c03b36e7266e263 P 6c27090ad71542bca01248b778ff440b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c27090ad71542bca01248b778ff440b, 766aab97368b4169b07e508f36c4c0fb; no voters: 
I20260709 13:04:56.749074 15559 raft_consensus.cc:2804] T c61fe875afff40e39c03b36e7266e263 P 6c27090ad71542bca01248b778ff440b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:04:56.749845 15555 raft_consensus.cc:993] T e85d1b0d46a9459a863728eb3bb432c3 P a0c7b7a30fcf412c85264c0ed126fede: : Instructing follower 6c27090ad71542bca01248b778ff440b to start an election
I20260709 13:04:56.750452 15555 raft_consensus.cc:1081] T e85d1b0d46a9459a863728eb3bb432c3 P a0c7b7a30fcf412c85264c0ed126fede [term 2 LEADER]: Signalling peer 6c27090ad71542bca01248b778ff440b to start an election
I20260709 13:04:56.754741 15190 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e85d1b0d46a9459a863728eb3bb432c3"
dest_uuid: "6c27090ad71542bca01248b778ff440b"
 from {username='slave'} at 127.0.0.1:40904
I20260709 13:04:56.755360 15190 raft_consensus.cc:493] T e85d1b0d46a9459a863728eb3bb432c3 P 6c27090ad71542bca01248b778ff440b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:56.755705 15190 raft_consensus.cc:3060] T e85d1b0d46a9459a863728eb3bb432c3 P 6c27090ad71542bca01248b778ff440b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:56.761476 15552 raft_consensus.cc:993] T 550f6b32ce5349e4a632e926d5a452de P a0c7b7a30fcf412c85264c0ed126fede: : Instructing follower 6c27090ad71542bca01248b778ff440b to start an election
I20260709 13:04:56.762006 15552 raft_consensus.cc:1081] T 550f6b32ce5349e4a632e926d5a452de P a0c7b7a30fcf412c85264c0ed126fede [term 3 LEADER]: Signalling peer 6c27090ad71542bca01248b778ff440b to start an election
I20260709 13:04:56.763123 15559 raft_consensus.cc:697] T c61fe875afff40e39c03b36e7266e263 P 6c27090ad71542bca01248b778ff440b [term 4 LEADER]: Becoming Leader. State: Replica: 6c27090ad71542bca01248b778ff440b, State: Running, Role: LEADER
I20260709 13:04:56.764284 15191 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "550f6b32ce5349e4a632e926d5a452de"
dest_uuid: "6c27090ad71542bca01248b778ff440b"
 from {username='slave'} at 127.0.0.1:40904
I20260709 13:04:56.765033 15191 raft_consensus.cc:493] T 550f6b32ce5349e4a632e926d5a452de P 6c27090ad71542bca01248b778ff440b [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:56.765465 15191 raft_consensus.cc:3060] T 550f6b32ce5349e4a632e926d5a452de P 6c27090ad71542bca01248b778ff440b [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:56.764642 15559 consensus_queue.cc:237] T c61fe875afff40e39c03b36e7266e263 P 6c27090ad71542bca01248b778ff440b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } } peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } }
I20260709 13:04:56.773391 15190 raft_consensus.cc:515] T e85d1b0d46a9459a863728eb3bb432c3 P 6c27090ad71542bca01248b778ff440b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:56.776641 15190 leader_election.cc:290] T e85d1b0d46a9459a863728eb3bb432c3 P 6c27090ad71542bca01248b778ff440b [CANDIDATE]: Term 3 election: Requested vote from peers a0c7b7a30fcf412c85264c0ed126fede (127.14.180.66:33371), 766aab97368b4169b07e508f36c4c0fb (127.14.180.67:42585)
I20260709 13:04:56.779341 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85d1b0d46a9459a863728eb3bb432c3" candidate_uuid: "6c27090ad71542bca01248b778ff440b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a0c7b7a30fcf412c85264c0ed126fede"
I20260709 13:04:56.780054 15267 raft_consensus.cc:3055] T e85d1b0d46a9459a863728eb3bb432c3 P a0c7b7a30fcf412c85264c0ed126fede [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:56.780361 15267 raft_consensus.cc:740] T e85d1b0d46a9459a863728eb3bb432c3 P a0c7b7a30fcf412c85264c0ed126fede [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a0c7b7a30fcf412c85264c0ed126fede, State: Running, Role: LEADER
I20260709 13:04:56.777853 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e85d1b0d46a9459a863728eb3bb432c3" candidate_uuid: "6c27090ad71542bca01248b778ff440b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "766aab97368b4169b07e508f36c4c0fb"
I20260709 13:04:56.781325 15267 consensus_queue.cc:260] T e85d1b0d46a9459a863728eb3bb432c3 P a0c7b7a30fcf412c85264c0ed126fede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:56.781811 15341 raft_consensus.cc:3060] T e85d1b0d46a9459a863728eb3bb432c3 P 766aab97368b4169b07e508f36c4c0fb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:56.782369 15267 raft_consensus.cc:3060] T e85d1b0d46a9459a863728eb3bb432c3 P a0c7b7a30fcf412c85264c0ed126fede [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:56.788470 15341 raft_consensus.cc:2468] T e85d1b0d46a9459a863728eb3bb432c3 P 766aab97368b4169b07e508f36c4c0fb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c27090ad71542bca01248b778ff440b in term 3.
I20260709 13:04:56.789594 15267 raft_consensus.cc:2468] T e85d1b0d46a9459a863728eb3bb432c3 P a0c7b7a30fcf412c85264c0ed126fede [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c27090ad71542bca01248b778ff440b in term 3.
I20260709 13:04:56.790099 15158 leader_election.cc:304] T e85d1b0d46a9459a863728eb3bb432c3 P 6c27090ad71542bca01248b778ff440b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c27090ad71542bca01248b778ff440b, 766aab97368b4169b07e508f36c4c0fb; no voters: 
I20260709 13:04:56.791028 15559 raft_consensus.cc:2804] T e85d1b0d46a9459a863728eb3bb432c3 P 6c27090ad71542bca01248b778ff440b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:56.791613 15559 raft_consensus.cc:697] T e85d1b0d46a9459a863728eb3bb432c3 P 6c27090ad71542bca01248b778ff440b [term 3 LEADER]: Becoming Leader. State: Replica: 6c27090ad71542bca01248b778ff440b, State: Running, Role: LEADER
I20260709 13:04:56.791370 15191 raft_consensus.cc:515] T 550f6b32ce5349e4a632e926d5a452de P 6c27090ad71542bca01248b778ff440b [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:56.794040 15191 leader_election.cc:290] T 550f6b32ce5349e4a632e926d5a452de P 6c27090ad71542bca01248b778ff440b [CANDIDATE]: Term 4 election: Requested vote from peers a0c7b7a30fcf412c85264c0ed126fede (127.14.180.66:33371), 766aab97368b4169b07e508f36c4c0fb (127.14.180.67:42585)
I20260709 13:04:56.792516 15559 consensus_queue.cc:237] T e85d1b0d46a9459a863728eb3bb432c3 P 6c27090ad71542bca01248b778ff440b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:56.795423 15341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550f6b32ce5349e4a632e926d5a452de" candidate_uuid: "6c27090ad71542bca01248b778ff440b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "766aab97368b4169b07e508f36c4c0fb"
I20260709 13:04:56.795289 15087 catalog_manager.cc:5697] T c61fe875afff40e39c03b36e7266e263 P 6c27090ad71542bca01248b778ff440b reported cstate change: term changed from 3 to 4, leader changed from a0c7b7a30fcf412c85264c0ed126fede (127.14.180.66) to 6c27090ad71542bca01248b778ff440b (127.14.180.65). New cstate: current_term: 4 leader_uuid: "6c27090ad71542bca01248b778ff440b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:56.796106 15341 raft_consensus.cc:3060] T 550f6b32ce5349e4a632e926d5a452de P 766aab97368b4169b07e508f36c4c0fb [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:56.796121 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "550f6b32ce5349e4a632e926d5a452de" candidate_uuid: "6c27090ad71542bca01248b778ff440b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "a0c7b7a30fcf412c85264c0ed126fede"
I20260709 13:04:56.796819 15267 raft_consensus.cc:3055] T 550f6b32ce5349e4a632e926d5a452de P a0c7b7a30fcf412c85264c0ed126fede [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:04:56.797122 15267 raft_consensus.cc:740] T 550f6b32ce5349e4a632e926d5a452de P a0c7b7a30fcf412c85264c0ed126fede [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a0c7b7a30fcf412c85264c0ed126fede, State: Running, Role: LEADER
I20260709 13:04:56.798025 15267 consensus_queue.cc:260] T 550f6b32ce5349e4a632e926d5a452de P a0c7b7a30fcf412c85264c0ed126fede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:56.799557 15267 raft_consensus.cc:3060] T 550f6b32ce5349e4a632e926d5a452de P a0c7b7a30fcf412c85264c0ed126fede [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:56.803362 15341 raft_consensus.cc:2468] T 550f6b32ce5349e4a632e926d5a452de P 766aab97368b4169b07e508f36c4c0fb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c27090ad71542bca01248b778ff440b in term 4.
I20260709 13:04:56.804772 15158 leader_election.cc:304] T 550f6b32ce5349e4a632e926d5a452de P 6c27090ad71542bca01248b778ff440b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c27090ad71542bca01248b778ff440b, 766aab97368b4169b07e508f36c4c0fb; no voters: 
I20260709 13:04:56.807025 15561 raft_consensus.cc:2804] T 550f6b32ce5349e4a632e926d5a452de P 6c27090ad71542bca01248b778ff440b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:04:56.807557 15267 raft_consensus.cc:2468] T 550f6b32ce5349e4a632e926d5a452de P a0c7b7a30fcf412c85264c0ed126fede [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c27090ad71542bca01248b778ff440b in term 4.
I20260709 13:04:56.808589 15561 raft_consensus.cc:697] T 550f6b32ce5349e4a632e926d5a452de P 6c27090ad71542bca01248b778ff440b [term 4 LEADER]: Becoming Leader. State: Replica: 6c27090ad71542bca01248b778ff440b, State: Running, Role: LEADER
I20260709 13:04:56.809486 15561 consensus_queue.cc:237] T 550f6b32ce5349e4a632e926d5a452de P 6c27090ad71542bca01248b778ff440b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:56.812536 15087 catalog_manager.cc:5697] T e85d1b0d46a9459a863728eb3bb432c3 P 6c27090ad71542bca01248b778ff440b reported cstate change: term changed from 2 to 3, leader changed from a0c7b7a30fcf412c85264c0ed126fede (127.14.180.66) to 6c27090ad71542bca01248b778ff440b (127.14.180.65). New cstate: current_term: 3 leader_uuid: "6c27090ad71542bca01248b778ff440b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:56.824692 15087 catalog_manager.cc:5697] T 550f6b32ce5349e4a632e926d5a452de P 6c27090ad71542bca01248b778ff440b reported cstate change: term changed from 3 to 4, leader changed from a0c7b7a30fcf412c85264c0ed126fede (127.14.180.66) to 6c27090ad71542bca01248b778ff440b (127.14.180.65). New cstate: current_term: 4 leader_uuid: "6c27090ad71542bca01248b778ff440b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:56.858472 15554 raft_consensus.cc:993] T 9f79381ee9024a9e985aab93d98359e5 P a0c7b7a30fcf412c85264c0ed126fede: : Instructing follower 766aab97368b4169b07e508f36c4c0fb to start an election
I20260709 13:04:56.859035 15555 raft_consensus.cc:1081] T 9f79381ee9024a9e985aab93d98359e5 P a0c7b7a30fcf412c85264c0ed126fede [term 2 LEADER]: Signalling peer 766aab97368b4169b07e508f36c4c0fb to start an election
I20260709 13:04:56.860494 15341 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9f79381ee9024a9e985aab93d98359e5"
dest_uuid: "766aab97368b4169b07e508f36c4c0fb"
 from {username='slave'} at 127.0.0.1:34332
I20260709 13:04:56.860910 15341 raft_consensus.cc:493] T 9f79381ee9024a9e985aab93d98359e5 P 766aab97368b4169b07e508f36c4c0fb [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:56.861163 15341 raft_consensus.cc:3060] T 9f79381ee9024a9e985aab93d98359e5 P 766aab97368b4169b07e508f36c4c0fb [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:56.865903 15341 raft_consensus.cc:515] T 9f79381ee9024a9e985aab93d98359e5 P 766aab97368b4169b07e508f36c4c0fb [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:56.867843 15341 leader_election.cc:290] T 9f79381ee9024a9e985aab93d98359e5 P 766aab97368b4169b07e508f36c4c0fb [CANDIDATE]: Term 3 election: Requested vote from peers 6c27090ad71542bca01248b778ff440b (127.14.180.65:39863), a0c7b7a30fcf412c85264c0ed126fede (127.14.180.66:33371)
I20260709 13:04:56.868742 15267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f79381ee9024a9e985aab93d98359e5" candidate_uuid: "766aab97368b4169b07e508f36c4c0fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a0c7b7a30fcf412c85264c0ed126fede"
I20260709 13:04:56.868808 15191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f79381ee9024a9e985aab93d98359e5" candidate_uuid: "766aab97368b4169b07e508f36c4c0fb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6c27090ad71542bca01248b778ff440b"
I20260709 13:04:56.869304 15267 raft_consensus.cc:3055] T 9f79381ee9024a9e985aab93d98359e5 P a0c7b7a30fcf412c85264c0ed126fede [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:56.869424 15191 raft_consensus.cc:3060] T 9f79381ee9024a9e985aab93d98359e5 P 6c27090ad71542bca01248b778ff440b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:56.869711 15267 raft_consensus.cc:740] T 9f79381ee9024a9e985aab93d98359e5 P a0c7b7a30fcf412c85264c0ed126fede [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a0c7b7a30fcf412c85264c0ed126fede, State: Running, Role: LEADER
I20260709 13:04:56.870503 15267 consensus_queue.cc:260] T 9f79381ee9024a9e985aab93d98359e5 P a0c7b7a30fcf412c85264c0ed126fede [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:56.871486 15267 raft_consensus.cc:3060] T 9f79381ee9024a9e985aab93d98359e5 P a0c7b7a30fcf412c85264c0ed126fede [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:56.874782 15191 raft_consensus.cc:2468] T 9f79381ee9024a9e985aab93d98359e5 P 6c27090ad71542bca01248b778ff440b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 766aab97368b4169b07e508f36c4c0fb in term 3.
I20260709 13:04:56.875890 15306 leader_election.cc:304] T 9f79381ee9024a9e985aab93d98359e5 P 766aab97368b4169b07e508f36c4c0fb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c27090ad71542bca01248b778ff440b, 766aab97368b4169b07e508f36c4c0fb; no voters: 
I20260709 13:04:56.876093 15267 raft_consensus.cc:2468] T 9f79381ee9024a9e985aab93d98359e5 P a0c7b7a30fcf412c85264c0ed126fede [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 766aab97368b4169b07e508f36c4c0fb in term 3.
I20260709 13:04:56.876645 15507 raft_consensus.cc:2804] T 9f79381ee9024a9e985aab93d98359e5 P 766aab97368b4169b07e508f36c4c0fb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:56.877116 15507 raft_consensus.cc:697] T 9f79381ee9024a9e985aab93d98359e5 P 766aab97368b4169b07e508f36c4c0fb [term 3 LEADER]: Becoming Leader. State: Replica: 766aab97368b4169b07e508f36c4c0fb, State: Running, Role: LEADER
I20260709 13:04:56.877907 15507 consensus_queue.cc:237] T 9f79381ee9024a9e985aab93d98359e5 P 766aab97368b4169b07e508f36c4c0fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } }
I20260709 13:04:56.884577 15087 catalog_manager.cc:5697] T 9f79381ee9024a9e985aab93d98359e5 P 766aab97368b4169b07e508f36c4c0fb reported cstate change: term changed from 2 to 3, leader changed from a0c7b7a30fcf412c85264c0ed126fede (127.14.180.66) to 766aab97368b4169b07e508f36c4c0fb (127.14.180.67). New cstate: current_term: 3 leader_uuid: "766aab97368b4169b07e508f36c4c0fb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:57.205698 15341 raft_consensus.cc:1275] T c61fe875afff40e39c03b36e7266e263 P 766aab97368b4169b07e508f36c4c0fb [term 4 FOLLOWER]: Refusing update from remote peer 6c27090ad71542bca01248b778ff440b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:04:57.207288 15561 consensus_queue.cc:1048] T c61fe875afff40e39c03b36e7266e263 P 6c27090ad71542bca01248b778ff440b [LEADER]: Connected to new peer: Peer: permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:57.211983 15191 raft_consensus.cc:1275] T 5b125feea68040eeb559e4bfa093536c P 6c27090ad71542bca01248b778ff440b [term 4 FOLLOWER]: Refusing update from remote peer 766aab97368b4169b07e508f36c4c0fb: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:04:57.214339 15507 consensus_queue.cc:1048] T 5b125feea68040eeb559e4bfa093536c P 766aab97368b4169b07e508f36c4c0fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:57.224663 15267 raft_consensus.cc:1275] T c61fe875afff40e39c03b36e7266e263 P a0c7b7a30fcf412c85264c0ed126fede [term 4 FOLLOWER]: Refusing update from remote peer 6c27090ad71542bca01248b778ff440b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:04:57.227517 15566 consensus_queue.cc:1048] T c61fe875afff40e39c03b36e7266e263 P 6c27090ad71542bca01248b778ff440b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:57.230496 15267 raft_consensus.cc:1275] T 5b125feea68040eeb559e4bfa093536c P a0c7b7a30fcf412c85264c0ed126fede [term 4 FOLLOWER]: Refusing update from remote peer 766aab97368b4169b07e508f36c4c0fb: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:04:57.232442 15556 consensus_queue.cc:1048] T 5b125feea68040eeb559e4bfa093536c P 766aab97368b4169b07e508f36c4c0fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:57.256264 15265 raft_consensus.cc:1275] T e85d1b0d46a9459a863728eb3bb432c3 P a0c7b7a30fcf412c85264c0ed126fede [term 3 FOLLOWER]: Refusing update from remote peer 6c27090ad71542bca01248b778ff440b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:57.257629 15561 consensus_queue.cc:1048] T e85d1b0d46a9459a863728eb3bb432c3 P 6c27090ad71542bca01248b778ff440b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:57.266973 15341 raft_consensus.cc:1275] T e85d1b0d46a9459a863728eb3bb432c3 P 766aab97368b4169b07e508f36c4c0fb [term 3 FOLLOWER]: Refusing update from remote peer 6c27090ad71542bca01248b778ff440b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:57.268594 15559 consensus_queue.cc:1048] T e85d1b0d46a9459a863728eb3bb432c3 P 6c27090ad71542bca01248b778ff440b [LEADER]: Connected to new peer: Peer: permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:57.277091 15265 raft_consensus.cc:1275] T 9f79381ee9024a9e985aab93d98359e5 P a0c7b7a30fcf412c85264c0ed126fede [term 3 FOLLOWER]: Refusing update from remote peer 766aab97368b4169b07e508f36c4c0fb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:57.278389 15556 consensus_queue.cc:1048] T 9f79381ee9024a9e985aab93d98359e5 P 766aab97368b4169b07e508f36c4c0fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:57.289114 15190 raft_consensus.cc:1275] T 9f79381ee9024a9e985aab93d98359e5 P 6c27090ad71542bca01248b778ff440b [term 3 FOLLOWER]: Refusing update from remote peer 766aab97368b4169b07e508f36c4c0fb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:57.290627 15573 consensus_queue.cc:1048] T 9f79381ee9024a9e985aab93d98359e5 P 766aab97368b4169b07e508f36c4c0fb [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c27090ad71542bca01248b778ff440b" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 39863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:57.332255 15341 raft_consensus.cc:1275] T 550f6b32ce5349e4a632e926d5a452de P 766aab97368b4169b07e508f36c4c0fb [term 4 FOLLOWER]: Refusing update from remote peer 6c27090ad71542bca01248b778ff440b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:04:57.333587 15559 consensus_queue.cc:1048] T 550f6b32ce5349e4a632e926d5a452de P 6c27090ad71542bca01248b778ff440b [LEADER]: Connected to new peer: Peer: permanent_uuid: "766aab97368b4169b07e508f36c4c0fb" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:57.343086 15265 raft_consensus.cc:1275] T 550f6b32ce5349e4a632e926d5a452de P a0c7b7a30fcf412c85264c0ed126fede [term 4 FOLLOWER]: Refusing update from remote peer 6c27090ad71542bca01248b778ff440b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:04:57.344918 15582 consensus_queue.cc:1048] T 550f6b32ce5349e4a632e926d5a452de P 6c27090ad71542bca01248b778ff440b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0c7b7a30fcf412c85264c0ed126fede" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 33371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:04:57.436017 15057 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:57.441840 15057 tablet_server.cc:179] TabletServer@127.14.180.65:0 shutting down...
W20260709 13:04:57.463778 15232 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:04:57.468477 15232 consensus_peers.cc:597] T b88f6a525ac24e259e1331eaaa2f41ac P a0c7b7a30fcf412c85264c0ed126fede -> Peer 6c27090ad71542bca01248b778ff440b (127.14.180.65:39863): Couldn't send request to peer 6c27090ad71542bca01248b778ff440b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:57.471907 15057 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:57.472990 15057 tablet_replica.cc:333] T e85d1b0d46a9459a863728eb3bb432c3 P 6c27090ad71542bca01248b778ff440b: stopping tablet replica
I20260709 13:04:57.474074 15057 raft_consensus.cc:2243] T e85d1b0d46a9459a863728eb3bb432c3 P 6c27090ad71542bca01248b778ff440b [term 3 LEADER]: Raft consensus shutting down.
W20260709 13:04:57.474098 15232 consensus_peers.cc:597] T a7555eadc3bb496bb07b3cc6515fa680 P a0c7b7a30fcf412c85264c0ed126fede -> Peer 6c27090ad71542bca01248b778ff440b (127.14.180.65:39863): Couldn't send request to peer 6c27090ad71542bca01248b778ff440b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:57.475391 15057 raft_consensus.cc:2272] T e85d1b0d46a9459a863728eb3bb432c3 P 6c27090ad71542bca01248b778ff440b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:57.479209 15057 tablet_replica.cc:333] T 5b125feea68040eeb559e4bfa093536c P 6c27090ad71542bca01248b778ff440b: stopping tablet replica
I20260709 13:04:57.479818 15057 raft_consensus.cc:2243] T 5b125feea68040eeb559e4bfa093536c P 6c27090ad71542bca01248b778ff440b [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:57.480288 15057 raft_consensus.cc:2272] T 5b125feea68040eeb559e4bfa093536c P 6c27090ad71542bca01248b778ff440b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:57.482963 15057 tablet_replica.cc:333] T 550f6b32ce5349e4a632e926d5a452de P 6c27090ad71542bca01248b778ff440b: stopping tablet replica
I20260709 13:04:57.483541 15057 raft_consensus.cc:2243] T 550f6b32ce5349e4a632e926d5a452de P 6c27090ad71542bca01248b778ff440b [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:04:57.484355 15057 raft_consensus.cc:2272] T 550f6b32ce5349e4a632e926d5a452de P 6c27090ad71542bca01248b778ff440b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:57.486689 15057 tablet_replica.cc:333] T b88f6a525ac24e259e1331eaaa2f41ac P 6c27090ad71542bca01248b778ff440b: stopping tablet replica
I20260709 13:04:57.487280 15057 raft_consensus.cc:2243] T b88f6a525ac24e259e1331eaaa2f41ac P 6c27090ad71542bca01248b778ff440b [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:57.487759 15057 raft_consensus.cc:2272] T b88f6a525ac24e259e1331eaaa2f41ac P 6c27090ad71542bca01248b778ff440b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:57.489583 15057 tablet_replica.cc:333] T a7555eadc3bb496bb07b3cc6515fa680 P 6c27090ad71542bca01248b778ff440b: stopping tablet replica
I20260709 13:04:57.490125 15057 raft_consensus.cc:2243] T a7555eadc3bb496bb07b3cc6515fa680 P 6c27090ad71542bca01248b778ff440b [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:57.490646 15057 raft_consensus.cc:2272] T a7555eadc3bb496bb07b3cc6515fa680 P 6c27090ad71542bca01248b778ff440b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:57.492419 15057 tablet_replica.cc:333] T d2a5b790ba6449afa2d539eb54aa63d5 P 6c27090ad71542bca01248b778ff440b: stopping tablet replica
I20260709 13:04:57.492973 15057 raft_consensus.cc:2243] T d2a5b790ba6449afa2d539eb54aa63d5 P 6c27090ad71542bca01248b778ff440b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:57.493412 15057 raft_consensus.cc:2272] T d2a5b790ba6449afa2d539eb54aa63d5 P 6c27090ad71542bca01248b778ff440b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:57.495337 15057 tablet_replica.cc:333] T 9f79381ee9024a9e985aab93d98359e5 P 6c27090ad71542bca01248b778ff440b: stopping tablet replica
I20260709 13:04:57.495873 15057 raft_consensus.cc:2243] T 9f79381ee9024a9e985aab93d98359e5 P 6c27090ad71542bca01248b778ff440b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:57.496325 15057 raft_consensus.cc:2272] T 9f79381ee9024a9e985aab93d98359e5 P 6c27090ad71542bca01248b778ff440b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:57.498658 15057 tablet_replica.cc:333] T 4f665c7b3caa440fa5664a96decac188 P 6c27090ad71542bca01248b778ff440b: stopping tablet replica
I20260709 13:04:57.499184 15057 raft_consensus.cc:2243] T 4f665c7b3caa440fa5664a96decac188 P 6c27090ad71542bca01248b778ff440b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:57.499660 15057 raft_consensus.cc:2272] T 4f665c7b3caa440fa5664a96decac188 P 6c27090ad71542bca01248b778ff440b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:57.501382 15057 tablet_replica.cc:333] T c61fe875afff40e39c03b36e7266e263 P 6c27090ad71542bca01248b778ff440b: stopping tablet replica
I20260709 13:04:57.501916 15057 raft_consensus.cc:2243] T c61fe875afff40e39c03b36e7266e263 P 6c27090ad71542bca01248b778ff440b [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:04:57.502777 15057 raft_consensus.cc:2272] T c61fe875afff40e39c03b36e7266e263 P 6c27090ad71542bca01248b778ff440b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:57.608230 15057 tablet_server.cc:196] TabletServer@127.14.180.65:0 shutdown complete.
I20260709 13:04:57.628974 15057 tablet_server.cc:179] TabletServer@127.14.180.66:0 shutting down...
I20260709 13:04:57.656227 15057 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:57.656942 15057 tablet_replica.cc:333] T 9f79381ee9024a9e985aab93d98359e5 P a0c7b7a30fcf412c85264c0ed126fede: stopping tablet replica
I20260709 13:04:57.657606 15057 raft_consensus.cc:2243] T 9f79381ee9024a9e985aab93d98359e5 P a0c7b7a30fcf412c85264c0ed126fede [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:57.658015 15057 raft_consensus.cc:2272] T 9f79381ee9024a9e985aab93d98359e5 P a0c7b7a30fcf412c85264c0ed126fede [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:57.660458 15057 tablet_replica.cc:333] T e85d1b0d46a9459a863728eb3bb432c3 P a0c7b7a30fcf412c85264c0ed126fede: stopping tablet replica
I20260709 13:04:57.661072 15057 raft_consensus.cc:2243] T e85d1b0d46a9459a863728eb3bb432c3 P a0c7b7a30fcf412c85264c0ed126fede [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:57.661535 15057 raft_consensus.cc:2272] T e85d1b0d46a9459a863728eb3bb432c3 P a0c7b7a30fcf412c85264c0ed126fede [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:57.663686 15057 tablet_replica.cc:333] T d2a5b790ba6449afa2d539eb54aa63d5 P a0c7b7a30fcf412c85264c0ed126fede: stopping tablet replica
I20260709 13:04:57.664218 15057 raft_consensus.cc:2243] T d2a5b790ba6449afa2d539eb54aa63d5 P a0c7b7a30fcf412c85264c0ed126fede [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:57.664973 15057 raft_consensus.cc:2272] T d2a5b790ba6449afa2d539eb54aa63d5 P a0c7b7a30fcf412c85264c0ed126fede [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:57.666812 15057 tablet_replica.cc:333] T b88f6a525ac24e259e1331eaaa2f41ac P a0c7b7a30fcf412c85264c0ed126fede: stopping tablet replica
I20260709 13:04:57.667327 15057 raft_consensus.cc:2243] T b88f6a525ac24e259e1331eaaa2f41ac P a0c7b7a30fcf412c85264c0ed126fede [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:04:57.668030 15057 raft_consensus.cc:2272] T b88f6a525ac24e259e1331eaaa2f41ac P a0c7b7a30fcf412c85264c0ed126fede [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:57.669633 15057 tablet_replica.cc:333] T a7555eadc3bb496bb07b3cc6515fa680 P a0c7b7a30fcf412c85264c0ed126fede: stopping tablet replica
I20260709 13:04:57.670218 15057 raft_consensus.cc:2243] T a7555eadc3bb496bb07b3cc6515fa680 P a0c7b7a30fcf412c85264c0ed126fede [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:04:57.671041 15057 raft_consensus.cc:2272] T a7555eadc3bb496bb07b3cc6515fa680 P a0c7b7a30fcf412c85264c0ed126fede [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:57.672691 15057 tablet_replica.cc:333] T 5b125feea68040eeb559e4bfa093536c P a0c7b7a30fcf412c85264c0ed126fede: stopping tablet replica
I20260709 13:04:57.673174 15057 raft_consensus.cc:2243] T 5b125feea68040eeb559e4bfa093536c P a0c7b7a30fcf412c85264c0ed126fede [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:57.673573 15057 raft_consensus.cc:2272] T 5b125feea68040eeb559e4bfa093536c P a0c7b7a30fcf412c85264c0ed126fede [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:57.675577 15057 tablet_replica.cc:333] T 550f6b32ce5349e4a632e926d5a452de P a0c7b7a30fcf412c85264c0ed126fede: stopping tablet replica
I20260709 13:04:57.676069 15057 raft_consensus.cc:2243] T 550f6b32ce5349e4a632e926d5a452de P a0c7b7a30fcf412c85264c0ed126fede [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:57.676479 15057 raft_consensus.cc:2272] T 550f6b32ce5349e4a632e926d5a452de P a0c7b7a30fcf412c85264c0ed126fede [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:57.678663 15057 tablet_replica.cc:333] T 4f665c7b3caa440fa5664a96decac188 P a0c7b7a30fcf412c85264c0ed126fede: stopping tablet replica
I20260709 13:04:57.679138 15057 raft_consensus.cc:2243] T 4f665c7b3caa440fa5664a96decac188 P a0c7b7a30fcf412c85264c0ed126fede [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:57.679557 15057 raft_consensus.cc:2272] T 4f665c7b3caa440fa5664a96decac188 P a0c7b7a30fcf412c85264c0ed126fede [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:57.681138 15057 tablet_replica.cc:333] T c61fe875afff40e39c03b36e7266e263 P a0c7b7a30fcf412c85264c0ed126fede: stopping tablet replica
I20260709 13:04:57.681608 15057 raft_consensus.cc:2243] T c61fe875afff40e39c03b36e7266e263 P a0c7b7a30fcf412c85264c0ed126fede [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:57.681993 15057 raft_consensus.cc:2272] T c61fe875afff40e39c03b36e7266e263 P a0c7b7a30fcf412c85264c0ed126fede [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:57.705579 15307 consensus_peers.cc:597] T 9f79381ee9024a9e985aab93d98359e5 P 766aab97368b4169b07e508f36c4c0fb -> Peer a0c7b7a30fcf412c85264c0ed126fede (127.14.180.66:33371): Couldn't send request to peer a0c7b7a30fcf412c85264c0ed126fede. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.66:33371: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:57.710969 15306 consensus_peers.cc:597] T 5b125feea68040eeb559e4bfa093536c P 766aab97368b4169b07e508f36c4c0fb -> Peer 6c27090ad71542bca01248b778ff440b (127.14.180.65:39863): Couldn't send request to peer 6c27090ad71542bca01248b778ff440b. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:39863: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:57.711599 15057 tablet_server.cc:196] TabletServer@127.14.180.66:0 shutdown complete.
W20260709 13:04:57.716838 15306 consensus_peers.cc:597] T 9f79381ee9024a9e985aab93d98359e5 P 766aab97368b4169b07e508f36c4c0fb -> Peer 6c27090ad71542bca01248b778ff440b (127.14.180.65:39863): Couldn't send request to peer 6c27090ad71542bca01248b778ff440b. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:39863: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:57.719764 15307 consensus_peers.cc:597] T 5b125feea68040eeb559e4bfa093536c P 766aab97368b4169b07e508f36c4c0fb -> Peer a0c7b7a30fcf412c85264c0ed126fede (127.14.180.66:33371): Couldn't send request to peer a0c7b7a30fcf412c85264c0ed126fede. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.66:33371: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:57.732594 15057 tablet_server.cc:179] TabletServer@127.14.180.67:0 shutting down...
I20260709 13:04:57.756002 15057 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:57.756669 15057 tablet_replica.cc:333] T d2a5b790ba6449afa2d539eb54aa63d5 P 766aab97368b4169b07e508f36c4c0fb: stopping tablet replica
I20260709 13:04:57.757296 15057 raft_consensus.cc:2243] T d2a5b790ba6449afa2d539eb54aa63d5 P 766aab97368b4169b07e508f36c4c0fb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:57.757771 15057 raft_consensus.cc:2272] T d2a5b790ba6449afa2d539eb54aa63d5 P 766aab97368b4169b07e508f36c4c0fb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:57.759549 15057 tablet_replica.cc:333] T 9f79381ee9024a9e985aab93d98359e5 P 766aab97368b4169b07e508f36c4c0fb: stopping tablet replica
I20260709 13:04:57.760063 15057 raft_consensus.cc:2243] T 9f79381ee9024a9e985aab93d98359e5 P 766aab97368b4169b07e508f36c4c0fb [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:04:57.760789 15057 raft_consensus.cc:2272] T 9f79381ee9024a9e985aab93d98359e5 P 766aab97368b4169b07e508f36c4c0fb [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:57.762811 15057 tablet_replica.cc:333] T b88f6a525ac24e259e1331eaaa2f41ac P 766aab97368b4169b07e508f36c4c0fb: stopping tablet replica
I20260709 13:04:57.763306 15057 raft_consensus.cc:2243] T b88f6a525ac24e259e1331eaaa2f41ac P 766aab97368b4169b07e508f36c4c0fb [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:57.763725 15057 raft_consensus.cc:2272] T b88f6a525ac24e259e1331eaaa2f41ac P 766aab97368b4169b07e508f36c4c0fb [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:57.765734 15057 tablet_replica.cc:333] T a7555eadc3bb496bb07b3cc6515fa680 P 766aab97368b4169b07e508f36c4c0fb: stopping tablet replica
I20260709 13:04:57.766291 15057 raft_consensus.cc:2243] T a7555eadc3bb496bb07b3cc6515fa680 P 766aab97368b4169b07e508f36c4c0fb [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:57.766732 15057 raft_consensus.cc:2272] T a7555eadc3bb496bb07b3cc6515fa680 P 766aab97368b4169b07e508f36c4c0fb [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:57.768409 15057 tablet_replica.cc:333] T 5b125feea68040eeb559e4bfa093536c P 766aab97368b4169b07e508f36c4c0fb: stopping tablet replica
I20260709 13:04:57.768944 15057 raft_consensus.cc:2243] T 5b125feea68040eeb559e4bfa093536c P 766aab97368b4169b07e508f36c4c0fb [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:04:57.769685 15057 raft_consensus.cc:2272] T 5b125feea68040eeb559e4bfa093536c P 766aab97368b4169b07e508f36c4c0fb [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:57.772328 15057 tablet_replica.cc:333] T 550f6b32ce5349e4a632e926d5a452de P 766aab97368b4169b07e508f36c4c0fb: stopping tablet replica
I20260709 13:04:57.772866 15057 raft_consensus.cc:2243] T 550f6b32ce5349e4a632e926d5a452de P 766aab97368b4169b07e508f36c4c0fb [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:57.773293 15057 raft_consensus.cc:2272] T 550f6b32ce5349e4a632e926d5a452de P 766aab97368b4169b07e508f36c4c0fb [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:57.775844 15057 tablet_replica.cc:333] T e85d1b0d46a9459a863728eb3bb432c3 P 766aab97368b4169b07e508f36c4c0fb: stopping tablet replica
I20260709 13:04:57.776361 15057 raft_consensus.cc:2243] T e85d1b0d46a9459a863728eb3bb432c3 P 766aab97368b4169b07e508f36c4c0fb [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:57.776770 15057 raft_consensus.cc:2272] T e85d1b0d46a9459a863728eb3bb432c3 P 766aab97368b4169b07e508f36c4c0fb [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:57.778841 15057 tablet_replica.cc:333] T 4f665c7b3caa440fa5664a96decac188 P 766aab97368b4169b07e508f36c4c0fb: stopping tablet replica
I20260709 13:04:57.779352 15057 raft_consensus.cc:2243] T 4f665c7b3caa440fa5664a96decac188 P 766aab97368b4169b07e508f36c4c0fb [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:57.780114 15057 raft_consensus.cc:2272] T 4f665c7b3caa440fa5664a96decac188 P 766aab97368b4169b07e508f36c4c0fb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:57.781847 15057 tablet_replica.cc:333] T c61fe875afff40e39c03b36e7266e263 P 766aab97368b4169b07e508f36c4c0fb: stopping tablet replica
I20260709 13:04:57.782327 15057 raft_consensus.cc:2243] T c61fe875afff40e39c03b36e7266e263 P 766aab97368b4169b07e508f36c4c0fb [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:57.782802 15057 raft_consensus.cc:2272] T c61fe875afff40e39c03b36e7266e263 P 766aab97368b4169b07e508f36c4c0fb [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:57.810314 15057 tablet_server.cc:196] TabletServer@127.14.180.67:0 shutdown complete.
I20260709 13:04:57.826764 15057 master.cc:562] Master@127.14.180.126:38717 shutting down...
I20260709 13:04:57.990774 15144 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Closing
I20260709 13:04:58.032238 15057 raft_consensus.cc:2243] T 00000000000000000000000000000000 P a92ac421eeaf45c095d67c0da5276217 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:58.032835 15057 raft_consensus.cc:2272] T 00000000000000000000000000000000 P a92ac421eeaf45c095d67c0da5276217 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:58.033257 15057 tablet_replica.cc:333] T 00000000000000000000000000000000 P a92ac421eeaf45c095d67c0da5276217: stopping tablet replica
I20260709 13:04:58.073720 15057 master.cc:584] Master@127.14.180.126:38717 shutdown complete.
6c27090ad71542bca01248b778ff440b  4
766aab97368b4169b07e508f36c4c0fb  1
a0c7b7a30fcf412c85264c0ed126fede  4
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (14912 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 13:04:58.132030 15057 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.14.180.126:38397
I20260709 13:04:58.133144 15057 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:58.138917 15588 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:58.140738 15589 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:58.140852 15591 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:58.141393 15057 server_base.cc:1061] running on GCE node
I20260709 13:04:58.142460 15057 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:58.142731 15057 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:58.142951 15057 hybrid_clock.cc:648] HybridClock initialized: now 1783602298142906 us; error 0 us; skew 500 ppm
I20260709 13:04:58.143509 15057 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:58.146162 15057 webserver.cc:533] Webserver started at http://127.14.180.126:43891/ using document root <none> and password file <none>
I20260709 13:04:58.146849 15057 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:58.147065 15057 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:58.147378 15057 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:58.148602 15057 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602283040513-15057-0/minicluster-data/master-0-root/instance:
uuid: "e0698e7005b24af99ae0aaa41d0a3540"
format_stamp: "Formatted at 2026-07-09 13:04:58 on dist-test-slave-r9m8"
I20260709 13:04:58.153494 15057 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:04:58.157544 15596 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:58.158635 15057 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:04:58.158994 15057 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602283040513-15057-0/minicluster-data/master-0-root
uuid: "e0698e7005b24af99ae0aaa41d0a3540"
format_stamp: "Formatted at 2026-07-09 13:04:58 on dist-test-slave-r9m8"
I20260709 13:04:58.159307 15057 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602283040513-15057-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602283040513-15057-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602283040513-15057-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:58.176611 15057 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:58.177913 15057 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:58.219278 15057 rpc_server.cc:307] RPC server started. Bound to: 127.14.180.126:38397
I20260709 13:04:58.219378 15647 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.180.126:38397 every 8 connection(s)
I20260709 13:04:58.223709 15648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:58.234270 15648 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e0698e7005b24af99ae0aaa41d0a3540: Bootstrap starting.
I20260709 13:04:58.239467 15648 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e0698e7005b24af99ae0aaa41d0a3540: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:58.244243 15648 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e0698e7005b24af99ae0aaa41d0a3540: No bootstrap required, opened a new log
I20260709 13:04:58.246445 15648 raft_consensus.cc:359] T 00000000000000000000000000000000 P e0698e7005b24af99ae0aaa41d0a3540 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e0698e7005b24af99ae0aaa41d0a3540" member_type: VOTER }
I20260709 13:04:58.246994 15648 raft_consensus.cc:385] T 00000000000000000000000000000000 P e0698e7005b24af99ae0aaa41d0a3540 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:58.247222 15648 raft_consensus.cc:740] T 00000000000000000000000000000000 P e0698e7005b24af99ae0aaa41d0a3540 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0698e7005b24af99ae0aaa41d0a3540, State: Initialized, Role: FOLLOWER
I20260709 13:04:58.247884 15648 consensus_queue.cc:260] T 00000000000000000000000000000000 P e0698e7005b24af99ae0aaa41d0a3540 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e0698e7005b24af99ae0aaa41d0a3540" member_type: VOTER }
I20260709 13:04:58.248337 15648 raft_consensus.cc:399] T 00000000000000000000000000000000 P e0698e7005b24af99ae0aaa41d0a3540 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:04:58.248576 15648 raft_consensus.cc:493] T 00000000000000000000000000000000 P e0698e7005b24af99ae0aaa41d0a3540 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:04:58.248858 15648 raft_consensus.cc:3060] T 00000000000000000000000000000000 P e0698e7005b24af99ae0aaa41d0a3540 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:58.253067 15648 raft_consensus.cc:515] T 00000000000000000000000000000000 P e0698e7005b24af99ae0aaa41d0a3540 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e0698e7005b24af99ae0aaa41d0a3540" member_type: VOTER }
I20260709 13:04:58.253636 15648 leader_election.cc:304] T 00000000000000000000000000000000 P e0698e7005b24af99ae0aaa41d0a3540 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e0698e7005b24af99ae0aaa41d0a3540; no voters: 
I20260709 13:04:58.254817 15648 leader_election.cc:290] T 00000000000000000000000000000000 P e0698e7005b24af99ae0aaa41d0a3540 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:04:58.255281 15651 raft_consensus.cc:2804] T 00000000000000000000000000000000 P e0698e7005b24af99ae0aaa41d0a3540 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:58.256592 15651 raft_consensus.cc:697] T 00000000000000000000000000000000 P e0698e7005b24af99ae0aaa41d0a3540 [term 1 LEADER]: Becoming Leader. State: Replica: e0698e7005b24af99ae0aaa41d0a3540, State: Running, Role: LEADER
I20260709 13:04:58.257325 15651 consensus_queue.cc:237] T 00000000000000000000000000000000 P e0698e7005b24af99ae0aaa41d0a3540 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e0698e7005b24af99ae0aaa41d0a3540" member_type: VOTER }
I20260709 13:04:58.257728 15648 sys_catalog.cc:565] T 00000000000000000000000000000000 P e0698e7005b24af99ae0aaa41d0a3540 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:04:58.261674 15652 sys_catalog.cc:455] T 00000000000000000000000000000000 P e0698e7005b24af99ae0aaa41d0a3540 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e0698e7005b24af99ae0aaa41d0a3540" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e0698e7005b24af99ae0aaa41d0a3540" member_type: VOTER } }
I20260709 13:04:58.262042 15653 sys_catalog.cc:455] T 00000000000000000000000000000000 P e0698e7005b24af99ae0aaa41d0a3540 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e0698e7005b24af99ae0aaa41d0a3540. Latest consensus state: current_term: 1 leader_uuid: "e0698e7005b24af99ae0aaa41d0a3540" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e0698e7005b24af99ae0aaa41d0a3540" member_type: VOTER } }
I20260709 13:04:58.262465 15652 sys_catalog.cc:458] T 00000000000000000000000000000000 P e0698e7005b24af99ae0aaa41d0a3540 [sys.catalog]: This master's current role is: LEADER
I20260709 13:04:58.262924 15653 sys_catalog.cc:458] T 00000000000000000000000000000000 P e0698e7005b24af99ae0aaa41d0a3540 [sys.catalog]: This master's current role is: LEADER
I20260709 13:04:58.267364 15658 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:04:58.275990 15658 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:04:58.276970 15057 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:04:58.285897 15658 catalog_manager.cc:1383] Generated new cluster ID: cffd739567db428981509e6c200666df
I20260709 13:04:58.286242 15658 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:04:58.307418 15658 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:04:58.308754 15658 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:04:58.330386 15658 catalog_manager.cc:6070] T 00000000000000000000000000000000 P e0698e7005b24af99ae0aaa41d0a3540: Generated new TSK 0
I20260709 13:04:58.331121 15658 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:04:58.344064 15057 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:58.350502 15669 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:58.351078 15670 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:58.353264 15672 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:58.354517 15057 server_base.cc:1061] running on GCE node
I20260709 13:04:58.355523 15057 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:58.355715 15057 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:58.355931 15057 hybrid_clock.cc:648] HybridClock initialized: now 1783602298355897 us; error 0 us; skew 500 ppm
I20260709 13:04:58.356479 15057 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:58.358968 15057 webserver.cc:533] Webserver started at http://127.14.180.65:44401/ using document root <none> and password file <none>
I20260709 13:04:58.359526 15057 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:58.359717 15057 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:58.360013 15057 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:58.361150 15057 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602283040513-15057-0/minicluster-data/ts-0-root/instance:
uuid: "df6686ba21134096a4687dbfd45aef3e"
format_stamp: "Formatted at 2026-07-09 13:04:58 on dist-test-slave-r9m8"
I20260709 13:04:58.367676 15057 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.004s	sys 0.003s
I20260709 13:04:58.371405 15677 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:58.372246 15057 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.004s	sys 0.000s
I20260709 13:04:58.372592 15057 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602283040513-15057-0/minicluster-data/ts-0-root
uuid: "df6686ba21134096a4687dbfd45aef3e"
format_stamp: "Formatted at 2026-07-09 13:04:58 on dist-test-slave-r9m8"
I20260709 13:04:58.372902 15057 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602283040513-15057-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602283040513-15057-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602283040513-15057-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:58.397984 15057 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:58.399401 15057 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:58.400960 15057 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:58.403748 15057 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:58.404031 15057 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:58.404300 15057 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:58.404495 15057 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:58.446413 15057 rpc_server.cc:307] RPC server started. Bound to: 127.14.180.65:42893
I20260709 13:04:58.446503 15739 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.180.65:42893 every 8 connection(s)
I20260709 13:04:58.451588 15057 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:58.459987 15744 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:58.460889 15745 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:58.464674 15747 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:58.465580 15057 server_base.cc:1061] running on GCE node
I20260709 13:04:58.466840 15057 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:04:58.466851 15740 heartbeater.cc:344] Connected to a master server at 127.14.180.126:38397
W20260709 13:04:58.467185 15057 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:58.467340 15740 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:58.467392 15057 hybrid_clock.cc:648] HybridClock initialized: now 1783602298467375 us; error 0 us; skew 500 ppm
I20260709 13:04:58.468156 15057 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:58.468307 15740 heartbeater.cc:507] Master 127.14.180.126:38397 requested a full tablet report, sending...
I20260709 13:04:58.471076 15613 ts_manager.cc:194] Registered new tserver with Master: df6686ba21134096a4687dbfd45aef3e (127.14.180.65:42893)
I20260709 13:04:58.471235 15057 webserver.cc:533] Webserver started at http://127.14.180.66:36319/ using document root <none> and password file <none>
I20260709 13:04:58.471858 15057 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:58.472080 15057 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:58.472361 15057 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:58.473083 15613 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47462
I20260709 13:04:58.473660 15057 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602283040513-15057-0/minicluster-data/ts-1-root/instance:
uuid: "b698cb024cb44d56915bbf45684e0762"
format_stamp: "Formatted at 2026-07-09 13:04:58 on dist-test-slave-r9m8"
I20260709 13:04:58.478473 15057 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.002s
I20260709 13:04:58.482097 15752 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:58.483008 15057 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:04:58.483264 15057 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602283040513-15057-0/minicluster-data/ts-1-root
uuid: "b698cb024cb44d56915bbf45684e0762"
format_stamp: "Formatted at 2026-07-09 13:04:58 on dist-test-slave-r9m8"
I20260709 13:04:58.483515 15057 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602283040513-15057-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602283040513-15057-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602283040513-15057-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:58.521160 15057 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:58.522465 15057 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:58.524129 15057 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:58.526670 15057 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:58.526885 15057 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:58.527231 15057 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:58.527420 15057 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:58.571686 15057 rpc_server.cc:307] RPC server started. Bound to: 127.14.180.66:35237
I20260709 13:04:58.571774 15814 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.180.66:35237 every 8 connection(s)
I20260709 13:04:58.576496 15057 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:58.584614 15818 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:58.586479 15819 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:58.593694 15815 heartbeater.cc:344] Connected to a master server at 127.14.180.126:38397
I20260709 13:04:58.594211 15815 heartbeater.cc:461] Registering TS with master...
W20260709 13:04:58.594952 15821 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:58.594983 15057 server_base.cc:1061] running on GCE node
I20260709 13:04:58.595405 15815 heartbeater.cc:507] Master 127.14.180.126:38397 requested a full tablet report, sending...
I20260709 13:04:58.596470 15057 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:58.596783 15057 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:58.596977 15057 hybrid_clock.cc:648] HybridClock initialized: now 1783602298596961 us; error 0 us; skew 500 ppm
I20260709 13:04:58.597669 15057 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:58.598182 15613 ts_manager.cc:194] Registered new tserver with Master: b698cb024cb44d56915bbf45684e0762 (127.14.180.66:35237)
I20260709 13:04:58.600085 15613 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47474
I20260709 13:04:58.600749 15057 webserver.cc:533] Webserver started at http://127.14.180.67:34381/ using document root <none> and password file <none>
I20260709 13:04:58.601362 15057 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:58.601593 15057 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:58.601923 15057 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:58.603417 15057 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602283040513-15057-0/minicluster-data/ts-2-root/instance:
uuid: "7e4674b8eef7448588dd0c00bf09499e"
format_stamp: "Formatted at 2026-07-09 13:04:58 on dist-test-slave-r9m8"
I20260709 13:04:58.608342 15057 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:04:58.611897 15826 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:58.612735 15057 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:04:58.613152 15057 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602283040513-15057-0/minicluster-data/ts-2-root
uuid: "7e4674b8eef7448588dd0c00bf09499e"
format_stamp: "Formatted at 2026-07-09 13:04:58 on dist-test-slave-r9m8"
I20260709 13:04:58.613464 15057 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602283040513-15057-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602283040513-15057-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602283040513-15057-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:58.633806 15057 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:58.635038 15057 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:58.636487 15057 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:58.638790 15057 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:58.639086 15057 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:58.639329 15057 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:58.639510 15057 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:58.682781 15057 rpc_server.cc:307] RPC server started. Bound to: 127.14.180.67:42215
I20260709 13:04:58.683004 15888 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.180.67:42215 every 8 connection(s)
I20260709 13:04:58.697055 15889 heartbeater.cc:344] Connected to a master server at 127.14.180.126:38397
I20260709 13:04:58.697455 15889 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:58.698235 15889 heartbeater.cc:507] Master 127.14.180.126:38397 requested a full tablet report, sending...
I20260709 13:04:58.700268 15613 ts_manager.cc:194] Registered new tserver with Master: 7e4674b8eef7448588dd0c00bf09499e (127.14.180.67:42215)
I20260709 13:04:58.700707 15057 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014543435s
I20260709 13:04:58.701611 15613 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47486
I20260709 13:04:58.727648 15613 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47500:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:04:58.730768 15613 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:04:58.804147 15705 tablet_service.cc:1511] Processing CreateTablet for tablet 7ff320c2485644c5914cfbab424cc102 (DEFAULT_TABLE table=test-workload [id=ef10f56646024e0c8eb0cd3eef38d077]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:04:58.805711 15705 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ff320c2485644c5914cfbab424cc102. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:58.811590 15704 tablet_service.cc:1511] Processing CreateTablet for tablet 4b331a1f307440c987613c4937b9c972 (DEFAULT_TABLE table=test-workload [id=ef10f56646024e0c8eb0cd3eef38d077]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:04:58.813167 15704 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b331a1f307440c987613c4937b9c972. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:58.814121 15701 tablet_service.cc:1511] Processing CreateTablet for tablet 5b842df9396d40b581214a0fa9c33530 (DEFAULT_TABLE table=test-workload [id=ef10f56646024e0c8eb0cd3eef38d077]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:04:58.815605 15701 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b842df9396d40b581214a0fa9c33530. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:58.819877 15702 tablet_service.cc:1511] Processing CreateTablet for tablet bcebe4c376a840ec82f61ccc634802bb (DEFAULT_TABLE table=test-workload [id=ef10f56646024e0c8eb0cd3eef38d077]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:04:58.821441 15702 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bcebe4c376a840ec82f61ccc634802bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:58.823787 15703 tablet_service.cc:1511] Processing CreateTablet for tablet 17c5f8247b874e168c1ba313418bb685 (DEFAULT_TABLE table=test-workload [id=ef10f56646024e0c8eb0cd3eef38d077]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:04:58.825282 15703 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17c5f8247b874e168c1ba313418bb685. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:58.828408 15700 tablet_service.cc:1511] Processing CreateTablet for tablet 269ab37889604517b35eaed13e3c4fae (DEFAULT_TABLE table=test-workload [id=ef10f56646024e0c8eb0cd3eef38d077]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:04:58.828866 15780 tablet_service.cc:1511] Processing CreateTablet for tablet 7ff320c2485644c5914cfbab424cc102 (DEFAULT_TABLE table=test-workload [id=ef10f56646024e0c8eb0cd3eef38d077]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:04:58.829936 15700 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 269ab37889604517b35eaed13e3c4fae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:58.830245 15780 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ff320c2485644c5914cfbab424cc102. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:58.831795 15699 tablet_service.cc:1511] Processing CreateTablet for tablet c1d542ea2766419380191ac2ffcf8e64 (DEFAULT_TABLE table=test-workload [id=ef10f56646024e0c8eb0cd3eef38d077]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:04:58.833218 15699 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1d542ea2766419380191ac2ffcf8e64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:58.834900 15697 tablet_service.cc:1511] Processing CreateTablet for tablet a0d24e4aeb604523af8ec351df2618d7 (DEFAULT_TABLE table=test-workload [id=ef10f56646024e0c8eb0cd3eef38d077]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:04:58.836392 15697 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0d24e4aeb604523af8ec351df2618d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:58.839905 15698 tablet_service.cc:1511] Processing CreateTablet for tablet aec58ca8ca264a4b9cbcb7703558f1c8 (DEFAULT_TABLE table=test-workload [id=ef10f56646024e0c8eb0cd3eef38d077]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:04:58.841341 15698 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aec58ca8ca264a4b9cbcb7703558f1c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:58.852694 15779 tablet_service.cc:1511] Processing CreateTablet for tablet 4b331a1f307440c987613c4937b9c972 (DEFAULT_TABLE table=test-workload [id=ef10f56646024e0c8eb0cd3eef38d077]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:04:58.854245 15779 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b331a1f307440c987613c4937b9c972. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:58.856406 15776 tablet_service.cc:1511] Processing CreateTablet for tablet 5b842df9396d40b581214a0fa9c33530 (DEFAULT_TABLE table=test-workload [id=ef10f56646024e0c8eb0cd3eef38d077]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:04:58.857911 15776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b842df9396d40b581214a0fa9c33530. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:58.859935 15904 tablet_bootstrap.cc:492] T 7ff320c2485644c5914cfbab424cc102 P b698cb024cb44d56915bbf45684e0762: Bootstrap starting.
I20260709 13:04:58.859870 15778 tablet_service.cc:1511] Processing CreateTablet for tablet 17c5f8247b874e168c1ba313418bb685 (DEFAULT_TABLE table=test-workload [id=ef10f56646024e0c8eb0cd3eef38d077]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:04:58.861968 15778 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17c5f8247b874e168c1ba313418bb685. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:58.853858 15777 tablet_service.cc:1511] Processing CreateTablet for tablet bcebe4c376a840ec82f61ccc634802bb (DEFAULT_TABLE table=test-workload [id=ef10f56646024e0c8eb0cd3eef38d077]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:04:58.864346 15777 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bcebe4c376a840ec82f61ccc634802bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:58.867957 15775 tablet_service.cc:1511] Processing CreateTablet for tablet c1d542ea2766419380191ac2ffcf8e64 (DEFAULT_TABLE table=test-workload [id=ef10f56646024e0c8eb0cd3eef38d077]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:04:58.869513 15775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1d542ea2766419380191ac2ffcf8e64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:58.878129 15780 tablet_service.cc:1511] Processing CreateTablet for tablet 269ab37889604517b35eaed13e3c4fae (DEFAULT_TABLE table=test-workload [id=ef10f56646024e0c8eb0cd3eef38d077]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:04:58.879629 15780 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 269ab37889604517b35eaed13e3c4fae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:58.885066 15774 tablet_service.cc:1511] Processing CreateTablet for tablet a0d24e4aeb604523af8ec351df2618d7 (DEFAULT_TABLE table=test-workload [id=ef10f56646024e0c8eb0cd3eef38d077]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:04:58.885846 15704 tablet_service.cc:1511] Processing CreateTablet for tablet 6a089ebf729d4dcabe86cf94fb987006 (DEFAULT_TABLE table=test-workload [id=ef10f56646024e0c8eb0cd3eef38d077]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:04:58.886613 15774 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0d24e4aeb604523af8ec351df2618d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:58.887204 15704 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a089ebf729d4dcabe86cf94fb987006. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:58.891371 15779 tablet_service.cc:1511] Processing CreateTablet for tablet aec58ca8ca264a4b9cbcb7703558f1c8 (DEFAULT_TABLE table=test-workload [id=ef10f56646024e0c8eb0cd3eef38d077]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:04:58.892725 15779 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aec58ca8ca264a4b9cbcb7703558f1c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:58.894582 15773 tablet_service.cc:1511] Processing CreateTablet for tablet 6a089ebf729d4dcabe86cf94fb987006 (DEFAULT_TABLE table=test-workload [id=ef10f56646024e0c8eb0cd3eef38d077]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:04:58.895977 15773 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a089ebf729d4dcabe86cf94fb987006. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:58.897575 15904 tablet_bootstrap.cc:654] T 7ff320c2485644c5914cfbab424cc102 P b698cb024cb44d56915bbf45684e0762: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:58.931816 15854 tablet_service.cc:1511] Processing CreateTablet for tablet 7ff320c2485644c5914cfbab424cc102 (DEFAULT_TABLE table=test-workload [id=ef10f56646024e0c8eb0cd3eef38d077]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:04:58.933324 15854 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ff320c2485644c5914cfbab424cc102. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:58.935818 15853 tablet_service.cc:1511] Processing CreateTablet for tablet 4b331a1f307440c987613c4937b9c972 (DEFAULT_TABLE table=test-workload [id=ef10f56646024e0c8eb0cd3eef38d077]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:04:58.936194 15848 tablet_service.cc:1511] Processing CreateTablet for tablet c1d542ea2766419380191ac2ffcf8e64 (DEFAULT_TABLE table=test-workload [id=ef10f56646024e0c8eb0cd3eef38d077]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:04:58.937281 15905 tablet_bootstrap.cc:492] T aec58ca8ca264a4b9cbcb7703558f1c8 P df6686ba21134096a4687dbfd45aef3e: Bootstrap starting.
I20260709 13:04:58.937502 15853 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b331a1f307440c987613c4937b9c972. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:58.938136 15849 tablet_service.cc:1511] Processing CreateTablet for tablet 269ab37889604517b35eaed13e3c4fae (DEFAULT_TABLE table=test-workload [id=ef10f56646024e0c8eb0cd3eef38d077]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:04:58.939913 15849 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 269ab37889604517b35eaed13e3c4fae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:58.940376 15850 tablet_service.cc:1511] Processing CreateTablet for tablet 5b842df9396d40b581214a0fa9c33530 (DEFAULT_TABLE table=test-workload [id=ef10f56646024e0c8eb0cd3eef38d077]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:04:58.941781 15850 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b842df9396d40b581214a0fa9c33530. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:58.943747 15848 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1d542ea2766419380191ac2ffcf8e64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:58.944502 15851 tablet_service.cc:1511] Processing CreateTablet for tablet bcebe4c376a840ec82f61ccc634802bb (DEFAULT_TABLE table=test-workload [id=ef10f56646024e0c8eb0cd3eef38d077]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:04:58.945170 15847 tablet_service.cc:1511] Processing CreateTablet for tablet aec58ca8ca264a4b9cbcb7703558f1c8 (DEFAULT_TABLE table=test-workload [id=ef10f56646024e0c8eb0cd3eef38d077]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:04:58.948647 15846 tablet_service.cc:1511] Processing CreateTablet for tablet a0d24e4aeb604523af8ec351df2618d7 (DEFAULT_TABLE table=test-workload [id=ef10f56646024e0c8eb0cd3eef38d077]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:04:58.948905 15852 tablet_service.cc:1511] Processing CreateTablet for tablet 17c5f8247b874e168c1ba313418bb685 (DEFAULT_TABLE table=test-workload [id=ef10f56646024e0c8eb0cd3eef38d077]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:04:58.950757 15852 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17c5f8247b874e168c1ba313418bb685. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:58.952247 15845 tablet_service.cc:1511] Processing CreateTablet for tablet 6a089ebf729d4dcabe86cf94fb987006 (DEFAULT_TABLE table=test-workload [id=ef10f56646024e0c8eb0cd3eef38d077]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:04:58.954312 15845 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a089ebf729d4dcabe86cf94fb987006. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:58.959775 15851 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bcebe4c376a840ec82f61ccc634802bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:58.962464 15847 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aec58ca8ca264a4b9cbcb7703558f1c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:58.964280 15846 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0d24e4aeb604523af8ec351df2618d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:58.975981 15904 tablet_bootstrap.cc:492] T 7ff320c2485644c5914cfbab424cc102 P b698cb024cb44d56915bbf45684e0762: No bootstrap required, opened a new log
I20260709 13:04:58.981928 15904 ts_tablet_manager.cc:1403] T 7ff320c2485644c5914cfbab424cc102 P b698cb024cb44d56915bbf45684e0762: Time spent bootstrapping tablet: real 0.122s	user 0.022s	sys 0.016s
I20260709 13:04:58.990427 15905 tablet_bootstrap.cc:654] T aec58ca8ca264a4b9cbcb7703558f1c8 P df6686ba21134096a4687dbfd45aef3e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:58.997481 15907 tablet_bootstrap.cc:492] T 269ab37889604517b35eaed13e3c4fae P 7e4674b8eef7448588dd0c00bf09499e: Bootstrap starting.
I20260709 13:04:59.009620 15905 tablet_bootstrap.cc:492] T aec58ca8ca264a4b9cbcb7703558f1c8 P df6686ba21134096a4687dbfd45aef3e: No bootstrap required, opened a new log
I20260709 13:04:59.010190 15905 ts_tablet_manager.cc:1403] T aec58ca8ca264a4b9cbcb7703558f1c8 P df6686ba21134096a4687dbfd45aef3e: Time spent bootstrapping tablet: real 0.073s	user 0.011s	sys 0.002s
I20260709 13:04:59.010141 15904 raft_consensus.cc:359] T 7ff320c2485644c5914cfbab424cc102 P b698cb024cb44d56915bbf45684e0762 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } }
I20260709 13:04:59.013456 15905 raft_consensus.cc:359] T aec58ca8ca264a4b9cbcb7703558f1c8 P df6686ba21134096a4687dbfd45aef3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:04:59.014025 15904 raft_consensus.cc:385] T 7ff320c2485644c5914cfbab424cc102 P b698cb024cb44d56915bbf45684e0762 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:59.014281 15905 raft_consensus.cc:385] T aec58ca8ca264a4b9cbcb7703558f1c8 P df6686ba21134096a4687dbfd45aef3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:59.014401 15904 raft_consensus.cc:740] T 7ff320c2485644c5914cfbab424cc102 P b698cb024cb44d56915bbf45684e0762 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b698cb024cb44d56915bbf45684e0762, State: Initialized, Role: FOLLOWER
I20260709 13:04:59.014743 15905 raft_consensus.cc:740] T aec58ca8ca264a4b9cbcb7703558f1c8 P df6686ba21134096a4687dbfd45aef3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df6686ba21134096a4687dbfd45aef3e, State: Initialized, Role: FOLLOWER
I20260709 13:04:59.015558 15905 consensus_queue.cc:260] T aec58ca8ca264a4b9cbcb7703558f1c8 P df6686ba21134096a4687dbfd45aef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:04:59.015679 15904 consensus_queue.cc:260] T 7ff320c2485644c5914cfbab424cc102 P b698cb024cb44d56915bbf45684e0762 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } }
I20260709 13:04:59.017836 15907 tablet_bootstrap.cc:654] T 269ab37889604517b35eaed13e3c4fae P 7e4674b8eef7448588dd0c00bf09499e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:59.018098 15815 heartbeater.cc:499] Master 127.14.180.126:38397 was elected leader, sending a full tablet report...
I20260709 13:04:59.018589 15904 ts_tablet_manager.cc:1434] T 7ff320c2485644c5914cfbab424cc102 P b698cb024cb44d56915bbf45684e0762: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.001s
I20260709 13:04:59.019397 15904 tablet_bootstrap.cc:492] T 4b331a1f307440c987613c4937b9c972 P b698cb024cb44d56915bbf45684e0762: Bootstrap starting.
I20260709 13:04:59.022773 15740 heartbeater.cc:499] Master 127.14.180.126:38397 was elected leader, sending a full tablet report...
I20260709 13:04:59.023483 15905 ts_tablet_manager.cc:1434] T aec58ca8ca264a4b9cbcb7703558f1c8 P df6686ba21134096a4687dbfd45aef3e: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.001s
I20260709 13:04:59.024515 15905 tablet_bootstrap.cc:492] T 4b331a1f307440c987613c4937b9c972 P df6686ba21134096a4687dbfd45aef3e: Bootstrap starting.
I20260709 13:04:59.027635 15904 tablet_bootstrap.cc:654] T 4b331a1f307440c987613c4937b9c972 P b698cb024cb44d56915bbf45684e0762: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:59.030620 15907 tablet_bootstrap.cc:492] T 269ab37889604517b35eaed13e3c4fae P 7e4674b8eef7448588dd0c00bf09499e: No bootstrap required, opened a new log
I20260709 13:04:59.031311 15907 ts_tablet_manager.cc:1403] T 269ab37889604517b35eaed13e3c4fae P 7e4674b8eef7448588dd0c00bf09499e: Time spent bootstrapping tablet: real 0.034s	user 0.009s	sys 0.005s
I20260709 13:04:59.031530 15905 tablet_bootstrap.cc:654] T 4b331a1f307440c987613c4937b9c972 P df6686ba21134096a4687dbfd45aef3e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:59.035315 15907 raft_consensus.cc:359] T 269ab37889604517b35eaed13e3c4fae P 7e4674b8eef7448588dd0c00bf09499e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:04:59.036161 15905 tablet_bootstrap.cc:492] T 4b331a1f307440c987613c4937b9c972 P df6686ba21134096a4687dbfd45aef3e: No bootstrap required, opened a new log
I20260709 13:04:59.036459 15907 raft_consensus.cc:385] T 269ab37889604517b35eaed13e3c4fae P 7e4674b8eef7448588dd0c00bf09499e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:59.036693 15905 ts_tablet_manager.cc:1403] T 4b331a1f307440c987613c4937b9c972 P df6686ba21134096a4687dbfd45aef3e: Time spent bootstrapping tablet: real 0.012s	user 0.008s	sys 0.004s
I20260709 13:04:59.036933 15907 raft_consensus.cc:740] T 269ab37889604517b35eaed13e3c4fae P 7e4674b8eef7448588dd0c00bf09499e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e4674b8eef7448588dd0c00bf09499e, State: Initialized, Role: FOLLOWER
I20260709 13:04:59.039305 15905 raft_consensus.cc:359] T 4b331a1f307440c987613c4937b9c972 P df6686ba21134096a4687dbfd45aef3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:04:59.040125 15905 raft_consensus.cc:385] T 4b331a1f307440c987613c4937b9c972 P df6686ba21134096a4687dbfd45aef3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:59.040400 15905 raft_consensus.cc:740] T 4b331a1f307440c987613c4937b9c972 P df6686ba21134096a4687dbfd45aef3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df6686ba21134096a4687dbfd45aef3e, State: Initialized, Role: FOLLOWER
I20260709 13:04:59.041066 15905 consensus_queue.cc:260] T 4b331a1f307440c987613c4937b9c972 P df6686ba21134096a4687dbfd45aef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:04:59.041489 15904 tablet_bootstrap.cc:492] T 4b331a1f307440c987613c4937b9c972 P b698cb024cb44d56915bbf45684e0762: No bootstrap required, opened a new log
I20260709 13:04:59.042066 15904 ts_tablet_manager.cc:1403] T 4b331a1f307440c987613c4937b9c972 P b698cb024cb44d56915bbf45684e0762: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.008s
I20260709 13:04:59.043056 15905 ts_tablet_manager.cc:1434] T 4b331a1f307440c987613c4937b9c972 P df6686ba21134096a4687dbfd45aef3e: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.003s
I20260709 13:04:59.038056 15907 consensus_queue.cc:260] T 269ab37889604517b35eaed13e3c4fae P 7e4674b8eef7448588dd0c00bf09499e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:04:59.044116 15905 tablet_bootstrap.cc:492] T c1d542ea2766419380191ac2ffcf8e64 P df6686ba21134096a4687dbfd45aef3e: Bootstrap starting.
I20260709 13:04:59.045358 15904 raft_consensus.cc:359] T 4b331a1f307440c987613c4937b9c972 P b698cb024cb44d56915bbf45684e0762 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:04:59.046116 15904 raft_consensus.cc:385] T 4b331a1f307440c987613c4937b9c972 P b698cb024cb44d56915bbf45684e0762 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:59.046427 15904 raft_consensus.cc:740] T 4b331a1f307440c987613c4937b9c972 P b698cb024cb44d56915bbf45684e0762 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b698cb024cb44d56915bbf45684e0762, State: Initialized, Role: FOLLOWER
I20260709 13:04:59.047505 15904 consensus_queue.cc:260] T 4b331a1f307440c987613c4937b9c972 P b698cb024cb44d56915bbf45684e0762 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:04:59.050503 15904 ts_tablet_manager.cc:1434] T 4b331a1f307440c987613c4937b9c972 P b698cb024cb44d56915bbf45684e0762: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:04:59.051900 15904 tablet_bootstrap.cc:492] T 17c5f8247b874e168c1ba313418bb685 P b698cb024cb44d56915bbf45684e0762: Bootstrap starting.
I20260709 13:04:59.052094 15905 tablet_bootstrap.cc:654] T c1d542ea2766419380191ac2ffcf8e64 P df6686ba21134096a4687dbfd45aef3e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:59.054728 15907 ts_tablet_manager.cc:1434] T 269ab37889604517b35eaed13e3c4fae P 7e4674b8eef7448588dd0c00bf09499e: Time spent starting tablet: real 0.023s	user 0.011s	sys 0.005s
I20260709 13:04:59.055532 15889 heartbeater.cc:499] Master 127.14.180.126:38397 was elected leader, sending a full tablet report...
I20260709 13:04:59.060025 15904 tablet_bootstrap.cc:654] T 17c5f8247b874e168c1ba313418bb685 P b698cb024cb44d56915bbf45684e0762: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:59.065847 15907 tablet_bootstrap.cc:492] T bcebe4c376a840ec82f61ccc634802bb P 7e4674b8eef7448588dd0c00bf09499e: Bootstrap starting.
I20260709 13:04:59.072510 15904 tablet_bootstrap.cc:492] T 17c5f8247b874e168c1ba313418bb685 P b698cb024cb44d56915bbf45684e0762: No bootstrap required, opened a new log
I20260709 13:04:59.073084 15904 ts_tablet_manager.cc:1403] T 17c5f8247b874e168c1ba313418bb685 P b698cb024cb44d56915bbf45684e0762: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.004s
I20260709 13:04:59.074298 15907 tablet_bootstrap.cc:654] T bcebe4c376a840ec82f61ccc634802bb P 7e4674b8eef7448588dd0c00bf09499e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:59.076413 15904 raft_consensus.cc:359] T 17c5f8247b874e168c1ba313418bb685 P b698cb024cb44d56915bbf45684e0762 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:04:59.077257 15904 raft_consensus.cc:385] T 17c5f8247b874e168c1ba313418bb685 P b698cb024cb44d56915bbf45684e0762 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:59.077618 15904 raft_consensus.cc:740] T 17c5f8247b874e168c1ba313418bb685 P b698cb024cb44d56915bbf45684e0762 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b698cb024cb44d56915bbf45684e0762, State: Initialized, Role: FOLLOWER
I20260709 13:04:59.078656 15904 consensus_queue.cc:260] T 17c5f8247b874e168c1ba313418bb685 P b698cb024cb44d56915bbf45684e0762 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:04:59.081444 15904 ts_tablet_manager.cc:1434] T 17c5f8247b874e168c1ba313418bb685 P b698cb024cb44d56915bbf45684e0762: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:04:59.082001 15905 tablet_bootstrap.cc:492] T c1d542ea2766419380191ac2ffcf8e64 P df6686ba21134096a4687dbfd45aef3e: No bootstrap required, opened a new log
I20260709 13:04:59.082675 15905 ts_tablet_manager.cc:1403] T c1d542ea2766419380191ac2ffcf8e64 P df6686ba21134096a4687dbfd45aef3e: Time spent bootstrapping tablet: real 0.039s	user 0.019s	sys 0.015s
I20260709 13:04:59.082665 15904 tablet_bootstrap.cc:492] T 6a089ebf729d4dcabe86cf94fb987006 P b698cb024cb44d56915bbf45684e0762: Bootstrap starting.
I20260709 13:04:59.086237 15905 raft_consensus.cc:359] T c1d542ea2766419380191ac2ffcf8e64 P df6686ba21134096a4687dbfd45aef3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:04:59.087198 15905 raft_consensus.cc:385] T c1d542ea2766419380191ac2ffcf8e64 P df6686ba21134096a4687dbfd45aef3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:59.087600 15905 raft_consensus.cc:740] T c1d542ea2766419380191ac2ffcf8e64 P df6686ba21134096a4687dbfd45aef3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df6686ba21134096a4687dbfd45aef3e, State: Initialized, Role: FOLLOWER
I20260709 13:04:59.088608 15905 consensus_queue.cc:260] T c1d542ea2766419380191ac2ffcf8e64 P df6686ba21134096a4687dbfd45aef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:04:59.090346 15904 tablet_bootstrap.cc:654] T 6a089ebf729d4dcabe86cf94fb987006 P b698cb024cb44d56915bbf45684e0762: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:59.091218 15907 tablet_bootstrap.cc:492] T bcebe4c376a840ec82f61ccc634802bb P 7e4674b8eef7448588dd0c00bf09499e: No bootstrap required, opened a new log
I20260709 13:04:59.091734 15907 ts_tablet_manager.cc:1403] T bcebe4c376a840ec82f61ccc634802bb P 7e4674b8eef7448588dd0c00bf09499e: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.004s
I20260709 13:04:59.093107 15905 ts_tablet_manager.cc:1434] T c1d542ea2766419380191ac2ffcf8e64 P df6686ba21134096a4687dbfd45aef3e: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 13:04:59.094293 15905 tablet_bootstrap.cc:492] T 269ab37889604517b35eaed13e3c4fae P df6686ba21134096a4687dbfd45aef3e: Bootstrap starting.
I20260709 13:04:59.095963 15907 raft_consensus.cc:359] T bcebe4c376a840ec82f61ccc634802bb P 7e4674b8eef7448588dd0c00bf09499e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:04:59.097023 15907 raft_consensus.cc:385] T bcebe4c376a840ec82f61ccc634802bb P 7e4674b8eef7448588dd0c00bf09499e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:59.097415 15907 raft_consensus.cc:740] T bcebe4c376a840ec82f61ccc634802bb P 7e4674b8eef7448588dd0c00bf09499e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e4674b8eef7448588dd0c00bf09499e, State: Initialized, Role: FOLLOWER
I20260709 13:04:59.098758 15907 consensus_queue.cc:260] T bcebe4c376a840ec82f61ccc634802bb P 7e4674b8eef7448588dd0c00bf09499e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:04:59.101497 15907 ts_tablet_manager.cc:1434] T bcebe4c376a840ec82f61ccc634802bb P 7e4674b8eef7448588dd0c00bf09499e: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 13:04:59.101652 15905 tablet_bootstrap.cc:654] T 269ab37889604517b35eaed13e3c4fae P df6686ba21134096a4687dbfd45aef3e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:59.102090 15904 tablet_bootstrap.cc:492] T 6a089ebf729d4dcabe86cf94fb987006 P b698cb024cb44d56915bbf45684e0762: No bootstrap required, opened a new log
I20260709 13:04:59.102536 15907 tablet_bootstrap.cc:492] T a0d24e4aeb604523af8ec351df2618d7 P 7e4674b8eef7448588dd0c00bf09499e: Bootstrap starting.
I20260709 13:04:59.102597 15904 ts_tablet_manager.cc:1403] T 6a089ebf729d4dcabe86cf94fb987006 P b698cb024cb44d56915bbf45684e0762: Time spent bootstrapping tablet: real 0.020s	user 0.016s	sys 0.003s
I20260709 13:04:59.105688 15904 raft_consensus.cc:359] T 6a089ebf729d4dcabe86cf94fb987006 P b698cb024cb44d56915bbf45684e0762 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:04:59.106521 15904 raft_consensus.cc:385] T 6a089ebf729d4dcabe86cf94fb987006 P b698cb024cb44d56915bbf45684e0762 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:59.106886 15904 raft_consensus.cc:740] T 6a089ebf729d4dcabe86cf94fb987006 P b698cb024cb44d56915bbf45684e0762 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b698cb024cb44d56915bbf45684e0762, State: Initialized, Role: FOLLOWER
I20260709 13:04:59.107780 15904 consensus_queue.cc:260] T 6a089ebf729d4dcabe86cf94fb987006 P b698cb024cb44d56915bbf45684e0762 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:04:59.109540 15907 tablet_bootstrap.cc:654] T a0d24e4aeb604523af8ec351df2618d7 P 7e4674b8eef7448588dd0c00bf09499e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:59.110579 15904 ts_tablet_manager.cc:1434] T 6a089ebf729d4dcabe86cf94fb987006 P b698cb024cb44d56915bbf45684e0762: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.004s
I20260709 13:04:59.111644 15904 tablet_bootstrap.cc:492] T c1d542ea2766419380191ac2ffcf8e64 P b698cb024cb44d56915bbf45684e0762: Bootstrap starting.
I20260709 13:04:59.114647 15905 tablet_bootstrap.cc:492] T 269ab37889604517b35eaed13e3c4fae P df6686ba21134096a4687dbfd45aef3e: No bootstrap required, opened a new log
I20260709 13:04:59.115312 15905 ts_tablet_manager.cc:1403] T 269ab37889604517b35eaed13e3c4fae P df6686ba21134096a4687dbfd45aef3e: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.005s
I20260709 13:04:59.118081 15905 raft_consensus.cc:359] T 269ab37889604517b35eaed13e3c4fae P df6686ba21134096a4687dbfd45aef3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:04:59.118706 15905 raft_consensus.cc:385] T 269ab37889604517b35eaed13e3c4fae P df6686ba21134096a4687dbfd45aef3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:59.118956 15905 raft_consensus.cc:740] T 269ab37889604517b35eaed13e3c4fae P df6686ba21134096a4687dbfd45aef3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df6686ba21134096a4687dbfd45aef3e, State: Initialized, Role: FOLLOWER
I20260709 13:04:59.119593 15905 consensus_queue.cc:260] T 269ab37889604517b35eaed13e3c4fae P df6686ba21134096a4687dbfd45aef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:04:59.120054 15909 raft_consensus.cc:493] T 4b331a1f307440c987613c4937b9c972 P b698cb024cb44d56915bbf45684e0762 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.120772 15909 raft_consensus.cc:515] T 4b331a1f307440c987613c4937b9c972 P b698cb024cb44d56915bbf45684e0762 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:04:59.121800 15905 ts_tablet_manager.cc:1434] T 269ab37889604517b35eaed13e3c4fae P df6686ba21134096a4687dbfd45aef3e: Time spent starting tablet: real 0.006s	user 0.000s	sys 0.003s
I20260709 13:04:59.122836 15905 tablet_bootstrap.cc:492] T a0d24e4aeb604523af8ec351df2618d7 P df6686ba21134096a4687dbfd45aef3e: Bootstrap starting.
I20260709 13:04:59.123677 15909 leader_election.cc:290] T 4b331a1f307440c987613c4937b9c972 P b698cb024cb44d56915bbf45684e0762 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df6686ba21134096a4687dbfd45aef3e (127.14.180.65:42893), 7e4674b8eef7448588dd0c00bf09499e (127.14.180.67:42215)
I20260709 13:04:59.124085 15907 tablet_bootstrap.cc:492] T a0d24e4aeb604523af8ec351df2618d7 P 7e4674b8eef7448588dd0c00bf09499e: No bootstrap required, opened a new log
I20260709 13:04:59.125908 15907 ts_tablet_manager.cc:1403] T a0d24e4aeb604523af8ec351df2618d7 P 7e4674b8eef7448588dd0c00bf09499e: Time spent bootstrapping tablet: real 0.024s	user 0.015s	sys 0.003s
I20260709 13:04:59.129036 15907 raft_consensus.cc:359] T a0d24e4aeb604523af8ec351df2618d7 P 7e4674b8eef7448588dd0c00bf09499e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:04:59.129871 15907 raft_consensus.cc:385] T a0d24e4aeb604523af8ec351df2618d7 P 7e4674b8eef7448588dd0c00bf09499e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:59.130213 15907 raft_consensus.cc:740] T a0d24e4aeb604523af8ec351df2618d7 P 7e4674b8eef7448588dd0c00bf09499e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e4674b8eef7448588dd0c00bf09499e, State: Initialized, Role: FOLLOWER
I20260709 13:04:59.131048 15907 consensus_queue.cc:260] T a0d24e4aeb604523af8ec351df2618d7 P 7e4674b8eef7448588dd0c00bf09499e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:04:59.133316 15907 ts_tablet_manager.cc:1434] T a0d24e4aeb604523af8ec351df2618d7 P 7e4674b8eef7448588dd0c00bf09499e: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 13:04:59.134539 15907 tablet_bootstrap.cc:492] T c1d542ea2766419380191ac2ffcf8e64 P 7e4674b8eef7448588dd0c00bf09499e: Bootstrap starting.
I20260709 13:04:59.134685 15905 tablet_bootstrap.cc:654] T a0d24e4aeb604523af8ec351df2618d7 P df6686ba21134096a4687dbfd45aef3e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:59.136394 15904 tablet_bootstrap.cc:654] T c1d542ea2766419380191ac2ffcf8e64 P b698cb024cb44d56915bbf45684e0762: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:59.160209 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b331a1f307440c987613c4937b9c972" candidate_uuid: "b698cb024cb44d56915bbf45684e0762" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df6686ba21134096a4687dbfd45aef3e" is_pre_election: true
I20260709 13:04:59.152025 15907 tablet_bootstrap.cc:654] T c1d542ea2766419380191ac2ffcf8e64 P 7e4674b8eef7448588dd0c00bf09499e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:59.161006 15715 raft_consensus.cc:2468] T 4b331a1f307440c987613c4937b9c972 P df6686ba21134096a4687dbfd45aef3e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b698cb024cb44d56915bbf45684e0762 in term 0.
I20260709 13:04:59.163826 15756 leader_election.cc:304] T 4b331a1f307440c987613c4937b9c972 P b698cb024cb44d56915bbf45684e0762 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b698cb024cb44d56915bbf45684e0762, df6686ba21134096a4687dbfd45aef3e; no voters: 
I20260709 13:04:59.164660 15909 raft_consensus.cc:2804] T 4b331a1f307440c987613c4937b9c972 P b698cb024cb44d56915bbf45684e0762 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:59.164932 15905 tablet_bootstrap.cc:492] T a0d24e4aeb604523af8ec351df2618d7 P df6686ba21134096a4687dbfd45aef3e: No bootstrap required, opened a new log
I20260709 13:04:59.165055 15909 raft_consensus.cc:493] T 4b331a1f307440c987613c4937b9c972 P b698cb024cb44d56915bbf45684e0762 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:59.165467 15905 ts_tablet_manager.cc:1403] T a0d24e4aeb604523af8ec351df2618d7 P df6686ba21134096a4687dbfd45aef3e: Time spent bootstrapping tablet: real 0.043s	user 0.007s	sys 0.010s
I20260709 13:04:59.165436 15909 raft_consensus.cc:3060] T 4b331a1f307440c987613c4937b9c972 P b698cb024cb44d56915bbf45684e0762 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:59.166970 15904 tablet_bootstrap.cc:492] T c1d542ea2766419380191ac2ffcf8e64 P b698cb024cb44d56915bbf45684e0762: No bootstrap required, opened a new log
I20260709 13:04:59.167502 15904 ts_tablet_manager.cc:1403] T c1d542ea2766419380191ac2ffcf8e64 P b698cb024cb44d56915bbf45684e0762: Time spent bootstrapping tablet: real 0.056s	user 0.017s	sys 0.009s
I20260709 13:04:59.168761 15905 raft_consensus.cc:359] T a0d24e4aeb604523af8ec351df2618d7 P df6686ba21134096a4687dbfd45aef3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:04:59.169587 15905 raft_consensus.cc:385] T a0d24e4aeb604523af8ec351df2618d7 P df6686ba21134096a4687dbfd45aef3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:59.169906 15905 raft_consensus.cc:740] T a0d24e4aeb604523af8ec351df2618d7 P df6686ba21134096a4687dbfd45aef3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df6686ba21134096a4687dbfd45aef3e, State: Initialized, Role: FOLLOWER
I20260709 13:04:59.170612 15904 raft_consensus.cc:359] T c1d542ea2766419380191ac2ffcf8e64 P b698cb024cb44d56915bbf45684e0762 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:04:59.170701 15905 consensus_queue.cc:260] T a0d24e4aeb604523af8ec351df2618d7 P df6686ba21134096a4687dbfd45aef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:04:59.171468 15904 raft_consensus.cc:385] T c1d542ea2766419380191ac2ffcf8e64 P b698cb024cb44d56915bbf45684e0762 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:59.171845 15904 raft_consensus.cc:740] T c1d542ea2766419380191ac2ffcf8e64 P b698cb024cb44d56915bbf45684e0762 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b698cb024cb44d56915bbf45684e0762, State: Initialized, Role: FOLLOWER
I20260709 13:04:59.173161 15905 ts_tablet_manager.cc:1434] T a0d24e4aeb604523af8ec351df2618d7 P df6686ba21134096a4687dbfd45aef3e: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:04:59.172755 15904 consensus_queue.cc:260] T c1d542ea2766419380191ac2ffcf8e64 P b698cb024cb44d56915bbf45684e0762 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:04:59.173504 15909 raft_consensus.cc:515] T 4b331a1f307440c987613c4937b9c972 P b698cb024cb44d56915bbf45684e0762 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:04:59.174207 15905 tablet_bootstrap.cc:492] T 6a089ebf729d4dcabe86cf94fb987006 P df6686ba21134096a4687dbfd45aef3e: Bootstrap starting.
I20260709 13:04:59.176733 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b331a1f307440c987613c4937b9c972" candidate_uuid: "b698cb024cb44d56915bbf45684e0762" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df6686ba21134096a4687dbfd45aef3e"
I20260709 13:04:59.177703 15715 raft_consensus.cc:3060] T 4b331a1f307440c987613c4937b9c972 P df6686ba21134096a4687dbfd45aef3e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:59.182327 15905 tablet_bootstrap.cc:654] T 6a089ebf729d4dcabe86cf94fb987006 P df6686ba21134096a4687dbfd45aef3e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:59.182659 15904 ts_tablet_manager.cc:1434] T c1d542ea2766419380191ac2ffcf8e64 P b698cb024cb44d56915bbf45684e0762: Time spent starting tablet: real 0.015s	user 0.003s	sys 0.012s
I20260709 13:04:59.186501 15904 tablet_bootstrap.cc:492] T bcebe4c376a840ec82f61ccc634802bb P b698cb024cb44d56915bbf45684e0762: Bootstrap starting.
I20260709 13:04:59.187412 15715 raft_consensus.cc:2468] T 4b331a1f307440c987613c4937b9c972 P df6686ba21134096a4687dbfd45aef3e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b698cb024cb44d56915bbf45684e0762 in term 1.
I20260709 13:04:59.189263 15756 leader_election.cc:304] T 4b331a1f307440c987613c4937b9c972 P b698cb024cb44d56915bbf45684e0762 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b698cb024cb44d56915bbf45684e0762, df6686ba21134096a4687dbfd45aef3e; no voters: 
I20260709 13:04:59.193292 15904 tablet_bootstrap.cc:654] T bcebe4c376a840ec82f61ccc634802bb P b698cb024cb44d56915bbf45684e0762: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:59.194669 15909 leader_election.cc:290] T 4b331a1f307440c987613c4937b9c972 P b698cb024cb44d56915bbf45684e0762 [CANDIDATE]: Term 1 election: Requested vote from peers df6686ba21134096a4687dbfd45aef3e (127.14.180.65:42893), 7e4674b8eef7448588dd0c00bf09499e (127.14.180.67:42215)
I20260709 13:04:59.194921 15925 raft_consensus.cc:2804] T 4b331a1f307440c987613c4937b9c972 P b698cb024cb44d56915bbf45684e0762 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:59.195495 15925 raft_consensus.cc:697] T 4b331a1f307440c987613c4937b9c972 P b698cb024cb44d56915bbf45684e0762 [term 1 LEADER]: Becoming Leader. State: Replica: b698cb024cb44d56915bbf45684e0762, State: Running, Role: LEADER
I20260709 13:04:59.196475 15925 consensus_queue.cc:237] T 4b331a1f307440c987613c4937b9c972 P b698cb024cb44d56915bbf45684e0762 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:04:59.201086 15907 tablet_bootstrap.cc:492] T c1d542ea2766419380191ac2ffcf8e64 P 7e4674b8eef7448588dd0c00bf09499e: No bootstrap required, opened a new log
I20260709 13:04:59.201745 15907 ts_tablet_manager.cc:1403] T c1d542ea2766419380191ac2ffcf8e64 P 7e4674b8eef7448588dd0c00bf09499e: Time spent bootstrapping tablet: real 0.068s	user 0.008s	sys 0.008s
I20260709 13:04:59.205338 15907 raft_consensus.cc:359] T c1d542ea2766419380191ac2ffcf8e64 P 7e4674b8eef7448588dd0c00bf09499e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:04:59.206461 15907 raft_consensus.cc:385] T c1d542ea2766419380191ac2ffcf8e64 P 7e4674b8eef7448588dd0c00bf09499e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:59.206940 15907 raft_consensus.cc:740] T c1d542ea2766419380191ac2ffcf8e64 P 7e4674b8eef7448588dd0c00bf09499e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e4674b8eef7448588dd0c00bf09499e, State: Initialized, Role: FOLLOWER
I20260709 13:04:59.208118 15907 consensus_queue.cc:260] T c1d542ea2766419380191ac2ffcf8e64 P 7e4674b8eef7448588dd0c00bf09499e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:04:59.212311 15904 tablet_bootstrap.cc:492] T bcebe4c376a840ec82f61ccc634802bb P b698cb024cb44d56915bbf45684e0762: No bootstrap required, opened a new log
I20260709 13:04:59.212810 15904 ts_tablet_manager.cc:1403] T bcebe4c376a840ec82f61ccc634802bb P b698cb024cb44d56915bbf45684e0762: Time spent bootstrapping tablet: real 0.027s	user 0.010s	sys 0.003s
I20260709 13:04:59.215233 15910 raft_consensus.cc:493] T a0d24e4aeb604523af8ec351df2618d7 P df6686ba21134096a4687dbfd45aef3e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.215867 15910 raft_consensus.cc:515] T a0d24e4aeb604523af8ec351df2618d7 P df6686ba21134096a4687dbfd45aef3e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:04:59.215955 15904 raft_consensus.cc:359] T bcebe4c376a840ec82f61ccc634802bb P b698cb024cb44d56915bbf45684e0762 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:04:59.216676 15904 raft_consensus.cc:385] T bcebe4c376a840ec82f61ccc634802bb P b698cb024cb44d56915bbf45684e0762 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:59.216971 15904 raft_consensus.cc:740] T bcebe4c376a840ec82f61ccc634802bb P b698cb024cb44d56915bbf45684e0762 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b698cb024cb44d56915bbf45684e0762, State: Initialized, Role: FOLLOWER
I20260709 13:04:59.217811 15904 consensus_queue.cc:260] T bcebe4c376a840ec82f61ccc634802bb P b698cb024cb44d56915bbf45684e0762 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:04:59.221259 15904 ts_tablet_manager.cc:1434] T bcebe4c376a840ec82f61ccc634802bb P b698cb024cb44d56915bbf45684e0762: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:04:59.222317 15904 tablet_bootstrap.cc:492] T 5b842df9396d40b581214a0fa9c33530 P b698cb024cb44d56915bbf45684e0762: Bootstrap starting.
I20260709 13:04:59.222848 15910 leader_election.cc:290] T a0d24e4aeb604523af8ec351df2618d7 P df6686ba21134096a4687dbfd45aef3e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b698cb024cb44d56915bbf45684e0762 (127.14.180.66:35237), 7e4674b8eef7448588dd0c00bf09499e (127.14.180.67:42215)
I20260709 13:04:59.236194 15925 raft_consensus.cc:493] T c1d542ea2766419380191ac2ffcf8e64 P b698cb024cb44d56915bbf45684e0762 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.239482 15925 raft_consensus.cc:515] T c1d542ea2766419380191ac2ffcf8e64 P b698cb024cb44d56915bbf45684e0762 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:04:59.240141 15905 tablet_bootstrap.cc:492] T 6a089ebf729d4dcabe86cf94fb987006 P df6686ba21134096a4687dbfd45aef3e: No bootstrap required, opened a new log
I20260709 13:04:59.240651 15905 ts_tablet_manager.cc:1403] T 6a089ebf729d4dcabe86cf94fb987006 P df6686ba21134096a4687dbfd45aef3e: Time spent bootstrapping tablet: real 0.067s	user 0.021s	sys 0.039s
I20260709 13:04:59.241777 15925 leader_election.cc:290] T c1d542ea2766419380191ac2ffcf8e64 P b698cb024cb44d56915bbf45684e0762 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df6686ba21134096a4687dbfd45aef3e (127.14.180.65:42893), 7e4674b8eef7448588dd0c00bf09499e (127.14.180.67:42215)
I20260709 13:04:59.242997 15864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b331a1f307440c987613c4937b9c972" candidate_uuid: "b698cb024cb44d56915bbf45684e0762" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e4674b8eef7448588dd0c00bf09499e" is_pre_election: true
I20260709 13:04:59.244305 15905 raft_consensus.cc:359] T 6a089ebf729d4dcabe86cf94fb987006 P df6686ba21134096a4687dbfd45aef3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:04:59.245121 15905 raft_consensus.cc:385] T 6a089ebf729d4dcabe86cf94fb987006 P df6686ba21134096a4687dbfd45aef3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:59.244899 15863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b331a1f307440c987613c4937b9c972" candidate_uuid: "b698cb024cb44d56915bbf45684e0762" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e4674b8eef7448588dd0c00bf09499e"
I20260709 13:04:59.246095 15905 raft_consensus.cc:740] T 6a089ebf729d4dcabe86cf94fb987006 P df6686ba21134096a4687dbfd45aef3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df6686ba21134096a4687dbfd45aef3e, State: Initialized, Role: FOLLOWER
I20260709 13:04:59.246133 15862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d542ea2766419380191ac2ffcf8e64" candidate_uuid: "b698cb024cb44d56915bbf45684e0762" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e4674b8eef7448588dd0c00bf09499e" is_pre_election: true
I20260709 13:04:59.247146 15862 raft_consensus.cc:2468] T c1d542ea2766419380191ac2ffcf8e64 P 7e4674b8eef7448588dd0c00bf09499e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b698cb024cb44d56915bbf45684e0762 in term 0.
I20260709 13:04:59.246995 15905 consensus_queue.cc:260] T 6a089ebf729d4dcabe86cf94fb987006 P df6686ba21134096a4687dbfd45aef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:04:59.250113 15907 ts_tablet_manager.cc:1434] T c1d542ea2766419380191ac2ffcf8e64 P 7e4674b8eef7448588dd0c00bf09499e: Time spent starting tablet: real 0.048s	user 0.009s	sys 0.000s
I20260709 13:04:59.253557 15905 ts_tablet_manager.cc:1434] T 6a089ebf729d4dcabe86cf94fb987006 P df6686ba21134096a4687dbfd45aef3e: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.000s
W20260709 13:04:59.253701 15754 leader_election.cc:343] T 4b331a1f307440c987613c4937b9c972 P b698cb024cb44d56915bbf45684e0762 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e4674b8eef7448588dd0c00bf09499e (127.14.180.67:42215): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:59.254738 15905 tablet_bootstrap.cc:492] T bcebe4c376a840ec82f61ccc634802bb P df6686ba21134096a4687dbfd45aef3e: Bootstrap starting.
W20260709 13:04:59.255095 15754 leader_election.cc:343] T 4b331a1f307440c987613c4937b9c972 P b698cb024cb44d56915bbf45684e0762 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7e4674b8eef7448588dd0c00bf09499e (127.14.180.67:42215): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:59.256340 15754 leader_election.cc:304] T c1d542ea2766419380191ac2ffcf8e64 P b698cb024cb44d56915bbf45684e0762 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e4674b8eef7448588dd0c00bf09499e, b698cb024cb44d56915bbf45684e0762; no voters: 
I20260709 13:04:59.258301 15925 raft_consensus.cc:2804] T c1d542ea2766419380191ac2ffcf8e64 P b698cb024cb44d56915bbf45684e0762 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:59.259017 15925 raft_consensus.cc:493] T c1d542ea2766419380191ac2ffcf8e64 P b698cb024cb44d56915bbf45684e0762 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:59.259809 15925 raft_consensus.cc:3060] T c1d542ea2766419380191ac2ffcf8e64 P b698cb024cb44d56915bbf45684e0762 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:59.262084 15907 tablet_bootstrap.cc:492] T 17c5f8247b874e168c1ba313418bb685 P 7e4674b8eef7448588dd0c00bf09499e: Bootstrap starting.
I20260709 13:04:59.262315 15905 tablet_bootstrap.cc:654] T bcebe4c376a840ec82f61ccc634802bb P df6686ba21134096a4687dbfd45aef3e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:59.265027 15611 catalog_manager.cc:5697] T 4b331a1f307440c987613c4937b9c972 P b698cb024cb44d56915bbf45684e0762 reported cstate change: term changed from 0 to 1, leader changed from <none> to b698cb024cb44d56915bbf45684e0762 (127.14.180.66). New cstate: current_term: 1 leader_uuid: "b698cb024cb44d56915bbf45684e0762" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } health_report { overall_health: UNKNOWN } } }
W20260709 13:04:59.270949 15661 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:59.273327 15904 tablet_bootstrap.cc:654] T 5b842df9396d40b581214a0fa9c33530 P b698cb024cb44d56915bbf45684e0762: Neither blocks nor log segments found. Creating new log.
W20260709 13:04:59.237288 15756 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:42893, user_credentials={real_user=slave}} blocked reactor thread for 48149.8us
I20260709 13:04:59.280691 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d542ea2766419380191ac2ffcf8e64" candidate_uuid: "b698cb024cb44d56915bbf45684e0762" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df6686ba21134096a4687dbfd45aef3e" is_pre_election: true
I20260709 13:04:59.281405 15928 raft_consensus.cc:493] T 7ff320c2485644c5914cfbab424cc102 P b698cb024cb44d56915bbf45684e0762 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.283443 15715 raft_consensus.cc:2468] T c1d542ea2766419380191ac2ffcf8e64 P df6686ba21134096a4687dbfd45aef3e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b698cb024cb44d56915bbf45684e0762 in term 0.
I20260709 13:04:59.285050 15928 raft_consensus.cc:515] T 7ff320c2485644c5914cfbab424cc102 P b698cb024cb44d56915bbf45684e0762 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } }
I20260709 13:04:59.291823 15928 leader_election.cc:290] T 7ff320c2485644c5914cfbab424cc102 P b698cb024cb44d56915bbf45684e0762 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df6686ba21134096a4687dbfd45aef3e (127.14.180.65:42893), 7e4674b8eef7448588dd0c00bf09499e (127.14.180.67:42215)
I20260709 13:04:59.296062 15862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff320c2485644c5914cfbab424cc102" candidate_uuid: "b698cb024cb44d56915bbf45684e0762" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e4674b8eef7448588dd0c00bf09499e" is_pre_election: true
I20260709 13:04:59.299430 15862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d24e4aeb604523af8ec351df2618d7" candidate_uuid: "df6686ba21134096a4687dbfd45aef3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e4674b8eef7448588dd0c00bf09499e" is_pre_election: true
I20260709 13:04:59.299773 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff320c2485644c5914cfbab424cc102" candidate_uuid: "b698cb024cb44d56915bbf45684e0762" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df6686ba21134096a4687dbfd45aef3e" is_pre_election: true
I20260709 13:04:59.300129 15862 raft_consensus.cc:2468] T a0d24e4aeb604523af8ec351df2618d7 P 7e4674b8eef7448588dd0c00bf09499e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df6686ba21134096a4687dbfd45aef3e in term 0.
I20260709 13:04:59.301753 15679 leader_election.cc:304] T a0d24e4aeb604523af8ec351df2618d7 P df6686ba21134096a4687dbfd45aef3e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e4674b8eef7448588dd0c00bf09499e, df6686ba21134096a4687dbfd45aef3e; no voters: 
I20260709 13:04:59.303949 15907 tablet_bootstrap.cc:654] T 17c5f8247b874e168c1ba313418bb685 P 7e4674b8eef7448588dd0c00bf09499e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:59.304313 15910 raft_consensus.cc:2804] T a0d24e4aeb604523af8ec351df2618d7 P df6686ba21134096a4687dbfd45aef3e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:59.306982 15905 tablet_bootstrap.cc:492] T bcebe4c376a840ec82f61ccc634802bb P df6686ba21134096a4687dbfd45aef3e: No bootstrap required, opened a new log
I20260709 13:04:59.307560 15905 ts_tablet_manager.cc:1403] T bcebe4c376a840ec82f61ccc634802bb P df6686ba21134096a4687dbfd45aef3e: Time spent bootstrapping tablet: real 0.053s	user 0.016s	sys 0.007s
I20260709 13:04:59.308537 15904 tablet_bootstrap.cc:492] T 5b842df9396d40b581214a0fa9c33530 P b698cb024cb44d56915bbf45684e0762: No bootstrap required, opened a new log
I20260709 13:04:59.309309 15904 ts_tablet_manager.cc:1403] T 5b842df9396d40b581214a0fa9c33530 P b698cb024cb44d56915bbf45684e0762: Time spent bootstrapping tablet: real 0.087s	user 0.009s	sys 0.007s
I20260709 13:04:59.310653 15905 raft_consensus.cc:359] T bcebe4c376a840ec82f61ccc634802bb P df6686ba21134096a4687dbfd45aef3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:04:59.311463 15905 raft_consensus.cc:385] T bcebe4c376a840ec82f61ccc634802bb P df6686ba21134096a4687dbfd45aef3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:04:59.297768 15754 leader_election.cc:343] T 7ff320c2485644c5914cfbab424cc102 P b698cb024cb44d56915bbf45684e0762 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e4674b8eef7448588dd0c00bf09499e (127.14.180.67:42215): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:59.311786 15905 raft_consensus.cc:740] T bcebe4c376a840ec82f61ccc634802bb P df6686ba21134096a4687dbfd45aef3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df6686ba21134096a4687dbfd45aef3e, State: Initialized, Role: FOLLOWER
I20260709 13:04:59.304695 15910 raft_consensus.cc:493] T a0d24e4aeb604523af8ec351df2618d7 P df6686ba21134096a4687dbfd45aef3e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:04:59.312106 15756 leader_election.cc:343] T 7ff320c2485644c5914cfbab424cc102 P b698cb024cb44d56915bbf45684e0762 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df6686ba21134096a4687dbfd45aef3e (127.14.180.65:42893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:59.312379 15910 raft_consensus.cc:3060] T a0d24e4aeb604523af8ec351df2618d7 P df6686ba21134096a4687dbfd45aef3e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:59.312566 15905 consensus_queue.cc:260] T bcebe4c376a840ec82f61ccc634802bb P df6686ba21134096a4687dbfd45aef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:04:59.314421 15756 leader_election.cc:304] T 7ff320c2485644c5914cfbab424cc102 P b698cb024cb44d56915bbf45684e0762 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b698cb024cb44d56915bbf45684e0762; no voters: 7e4674b8eef7448588dd0c00bf09499e, df6686ba21134096a4687dbfd45aef3e
I20260709 13:04:59.315356 15928 raft_consensus.cc:2749] T 7ff320c2485644c5914cfbab424cc102 P b698cb024cb44d56915bbf45684e0762 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:59.323923 15925 raft_consensus.cc:515] T c1d542ea2766419380191ac2ffcf8e64 P b698cb024cb44d56915bbf45684e0762 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:04:59.324783 15904 raft_consensus.cc:359] T 5b842df9396d40b581214a0fa9c33530 P b698cb024cb44d56915bbf45684e0762 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:04:59.326004 15904 raft_consensus.cc:385] T 5b842df9396d40b581214a0fa9c33530 P b698cb024cb44d56915bbf45684e0762 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:59.327136 15904 raft_consensus.cc:740] T 5b842df9396d40b581214a0fa9c33530 P b698cb024cb44d56915bbf45684e0762 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b698cb024cb44d56915bbf45684e0762, State: Initialized, Role: FOLLOWER
I20260709 13:04:59.329159 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d542ea2766419380191ac2ffcf8e64" candidate_uuid: "b698cb024cb44d56915bbf45684e0762" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df6686ba21134096a4687dbfd45aef3e"
I20260709 13:04:59.329918 15715 raft_consensus.cc:3060] T c1d542ea2766419380191ac2ffcf8e64 P df6686ba21134096a4687dbfd45aef3e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:59.327054 15925 leader_election.cc:290] T c1d542ea2766419380191ac2ffcf8e64 P b698cb024cb44d56915bbf45684e0762 [CANDIDATE]: Term 1 election: Requested vote from peers df6686ba21134096a4687dbfd45aef3e (127.14.180.65:42893), 7e4674b8eef7448588dd0c00bf09499e (127.14.180.67:42215)
I20260709 13:04:59.331090 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d24e4aeb604523af8ec351df2618d7" candidate_uuid: "df6686ba21134096a4687dbfd45aef3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b698cb024cb44d56915bbf45684e0762" is_pre_election: true
W20260709 13:04:59.332724 15681 leader_election.cc:343] T a0d24e4aeb604523af8ec351df2618d7 P df6686ba21134096a4687dbfd45aef3e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b698cb024cb44d56915bbf45684e0762 (127.14.180.66:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:59.329102 15862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d542ea2766419380191ac2ffcf8e64" candidate_uuid: "b698cb024cb44d56915bbf45684e0762" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e4674b8eef7448588dd0c00bf09499e"
I20260709 13:04:59.327696 15910 raft_consensus.cc:515] T a0d24e4aeb604523af8ec351df2618d7 P df6686ba21134096a4687dbfd45aef3e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:04:59.335668 15862 raft_consensus.cc:3060] T c1d542ea2766419380191ac2ffcf8e64 P 7e4674b8eef7448588dd0c00bf09499e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:59.339823 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d24e4aeb604523af8ec351df2618d7" candidate_uuid: "df6686ba21134096a4687dbfd45aef3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b698cb024cb44d56915bbf45684e0762"
I20260709 13:04:59.339962 15910 leader_election.cc:290] T a0d24e4aeb604523af8ec351df2618d7 P df6686ba21134096a4687dbfd45aef3e [CANDIDATE]: Term 1 election: Requested vote from peers b698cb024cb44d56915bbf45684e0762 (127.14.180.66:35237), 7e4674b8eef7448588dd0c00bf09499e (127.14.180.67:42215)
I20260709 13:04:59.343019 15904 consensus_queue.cc:260] T 5b842df9396d40b581214a0fa9c33530 P b698cb024cb44d56915bbf45684e0762 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
W20260709 13:04:59.344081 15681 leader_election.cc:343] T a0d24e4aeb604523af8ec351df2618d7 P df6686ba21134096a4687dbfd45aef3e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b698cb024cb44d56915bbf45684e0762 (127.14.180.66:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:59.345796 15904 ts_tablet_manager.cc:1434] T 5b842df9396d40b581214a0fa9c33530 P b698cb024cb44d56915bbf45684e0762: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.001s
I20260709 13:04:59.344502 15905 ts_tablet_manager.cc:1434] T bcebe4c376a840ec82f61ccc634802bb P df6686ba21134096a4687dbfd45aef3e: Time spent starting tablet: real 0.037s	user 0.014s	sys 0.008s
I20260709 13:04:59.347921 15905 tablet_bootstrap.cc:492] T 5b842df9396d40b581214a0fa9c33530 P df6686ba21134096a4687dbfd45aef3e: Bootstrap starting.
I20260709 13:04:59.350160 15925 raft_consensus.cc:493] T bcebe4c376a840ec82f61ccc634802bb P b698cb024cb44d56915bbf45684e0762 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.350951 15907 tablet_bootstrap.cc:492] T 17c5f8247b874e168c1ba313418bb685 P 7e4674b8eef7448588dd0c00bf09499e: No bootstrap required, opened a new log
I20260709 13:04:59.350793 15925 raft_consensus.cc:515] T bcebe4c376a840ec82f61ccc634802bb P b698cb024cb44d56915bbf45684e0762 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:04:59.351732 15907 ts_tablet_manager.cc:1403] T 17c5f8247b874e168c1ba313418bb685 P 7e4674b8eef7448588dd0c00bf09499e: Time spent bootstrapping tablet: real 0.090s	user 0.015s	sys 0.017s
I20260709 13:04:59.340107 15937 raft_consensus.cc:493] T bcebe4c376a840ec82f61ccc634802bb P df6686ba21134096a4687dbfd45aef3e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.354522 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcebe4c376a840ec82f61ccc634802bb" candidate_uuid: "b698cb024cb44d56915bbf45684e0762" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df6686ba21134096a4687dbfd45aef3e" is_pre_election: true
I20260709 13:04:59.354657 15863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcebe4c376a840ec82f61ccc634802bb" candidate_uuid: "b698cb024cb44d56915bbf45684e0762" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e4674b8eef7448588dd0c00bf09499e" is_pre_election: true
I20260709 13:04:59.355234 15905 tablet_bootstrap.cc:654] T 5b842df9396d40b581214a0fa9c33530 P df6686ba21134096a4687dbfd45aef3e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:59.354851 15937 raft_consensus.cc:515] T bcebe4c376a840ec82f61ccc634802bb P df6686ba21134096a4687dbfd45aef3e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:04:59.355576 15863 raft_consensus.cc:2468] T bcebe4c376a840ec82f61ccc634802bb P 7e4674b8eef7448588dd0c00bf09499e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b698cb024cb44d56915bbf45684e0762 in term 0.
I20260709 13:04:59.356277 15714 raft_consensus.cc:2468] T bcebe4c376a840ec82f61ccc634802bb P df6686ba21134096a4687dbfd45aef3e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b698cb024cb44d56915bbf45684e0762 in term 0.
I20260709 13:04:59.357733 15754 leader_election.cc:304] T bcebe4c376a840ec82f61ccc634802bb P b698cb024cb44d56915bbf45684e0762 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e4674b8eef7448588dd0c00bf09499e, b698cb024cb44d56915bbf45684e0762; no voters: 
I20260709 13:04:59.359014 15928 raft_consensus.cc:2804] T bcebe4c376a840ec82f61ccc634802bb P b698cb024cb44d56915bbf45684e0762 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:59.359623 15928 raft_consensus.cc:493] T bcebe4c376a840ec82f61ccc634802bb P b698cb024cb44d56915bbf45684e0762 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:59.359021 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcebe4c376a840ec82f61ccc634802bb" candidate_uuid: "df6686ba21134096a4687dbfd45aef3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b698cb024cb44d56915bbf45684e0762" is_pre_election: true
I20260709 13:04:59.359001 15715 raft_consensus.cc:2468] T c1d542ea2766419380191ac2ffcf8e64 P df6686ba21134096a4687dbfd45aef3e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b698cb024cb44d56915bbf45684e0762 in term 1.
I20260709 13:04:59.360365 15928 raft_consensus.cc:3060] T bcebe4c376a840ec82f61ccc634802bb P b698cb024cb44d56915bbf45684e0762 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:59.359647 15925 leader_election.cc:290] T bcebe4c376a840ec82f61ccc634802bb P b698cb024cb44d56915bbf45684e0762 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df6686ba21134096a4687dbfd45aef3e (127.14.180.65:42893), 7e4674b8eef7448588dd0c00bf09499e (127.14.180.67:42215)
I20260709 13:04:59.360932 15904 tablet_bootstrap.cc:492] T 269ab37889604517b35eaed13e3c4fae P b698cb024cb44d56915bbf45684e0762: Bootstrap starting.
I20260709 13:04:59.362217 15862 raft_consensus.cc:2468] T c1d542ea2766419380191ac2ffcf8e64 P 7e4674b8eef7448588dd0c00bf09499e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b698cb024cb44d56915bbf45684e0762 in term 1.
I20260709 13:04:59.362476 15756 leader_election.cc:304] T c1d542ea2766419380191ac2ffcf8e64 P b698cb024cb44d56915bbf45684e0762 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b698cb024cb44d56915bbf45684e0762, df6686ba21134096a4687dbfd45aef3e; no voters: 
I20260709 13:04:59.364811 15907 raft_consensus.cc:359] T 17c5f8247b874e168c1ba313418bb685 P 7e4674b8eef7448588dd0c00bf09499e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:04:59.365626 15907 raft_consensus.cc:385] T 17c5f8247b874e168c1ba313418bb685 P 7e4674b8eef7448588dd0c00bf09499e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:59.365943 15907 raft_consensus.cc:740] T 17c5f8247b874e168c1ba313418bb685 P 7e4674b8eef7448588dd0c00bf09499e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e4674b8eef7448588dd0c00bf09499e, State: Initialized, Role: FOLLOWER
I20260709 13:04:59.366963 15925 raft_consensus.cc:2804] T c1d542ea2766419380191ac2ffcf8e64 P b698cb024cb44d56915bbf45684e0762 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:59.367693 15925 raft_consensus.cc:697] T c1d542ea2766419380191ac2ffcf8e64 P b698cb024cb44d56915bbf45684e0762 [term 1 LEADER]: Becoming Leader. State: Replica: b698cb024cb44d56915bbf45684e0762, State: Running, Role: LEADER
I20260709 13:04:59.367471 15907 consensus_queue.cc:260] T 17c5f8247b874e168c1ba313418bb685 P 7e4674b8eef7448588dd0c00bf09499e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:04:59.368899 15925 consensus_queue.cc:237] T c1d542ea2766419380191ac2ffcf8e64 P b698cb024cb44d56915bbf45684e0762 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:04:59.371084 15928 raft_consensus.cc:515] T bcebe4c376a840ec82f61ccc634802bb P b698cb024cb44d56915bbf45684e0762 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:04:59.372355 15790 raft_consensus.cc:2393] T bcebe4c376a840ec82f61ccc634802bb P b698cb024cb44d56915bbf45684e0762 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate df6686ba21134096a4687dbfd45aef3e in current term 1: Already voted for candidate b698cb024cb44d56915bbf45684e0762 in this term.
I20260709 13:04:59.374821 15907 ts_tablet_manager.cc:1434] T 17c5f8247b874e168c1ba313418bb685 P 7e4674b8eef7448588dd0c00bf09499e: Time spent starting tablet: real 0.023s	user 0.010s	sys 0.000s
I20260709 13:04:59.376446 15907 tablet_bootstrap.cc:492] T 7ff320c2485644c5914cfbab424cc102 P 7e4674b8eef7448588dd0c00bf09499e: Bootstrap starting.
I20260709 13:04:59.379458 15928 leader_election.cc:290] T bcebe4c376a840ec82f61ccc634802bb P b698cb024cb44d56915bbf45684e0762 [CANDIDATE]: Term 1 election: Requested vote from peers df6686ba21134096a4687dbfd45aef3e (127.14.180.65:42893), 7e4674b8eef7448588dd0c00bf09499e (127.14.180.67:42215)
I20260709 13:04:59.381142 15862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d24e4aeb604523af8ec351df2618d7" candidate_uuid: "df6686ba21134096a4687dbfd45aef3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e4674b8eef7448588dd0c00bf09499e"
I20260709 13:04:59.381889 15863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcebe4c376a840ec82f61ccc634802bb" candidate_uuid: "b698cb024cb44d56915bbf45684e0762" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e4674b8eef7448588dd0c00bf09499e"
I20260709 13:04:59.382167 15862 raft_consensus.cc:3060] T a0d24e4aeb604523af8ec351df2618d7 P 7e4674b8eef7448588dd0c00bf09499e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:59.382517 15863 raft_consensus.cc:3060] T bcebe4c376a840ec82f61ccc634802bb P 7e4674b8eef7448588dd0c00bf09499e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:59.385759 15937 leader_election.cc:290] T bcebe4c376a840ec82f61ccc634802bb P df6686ba21134096a4687dbfd45aef3e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b698cb024cb44d56915bbf45684e0762 (127.14.180.66:35237), 7e4674b8eef7448588dd0c00bf09499e (127.14.180.67:42215)
I20260709 13:04:59.387895 15864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcebe4c376a840ec82f61ccc634802bb" candidate_uuid: "df6686ba21134096a4687dbfd45aef3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e4674b8eef7448588dd0c00bf09499e" is_pre_election: true
I20260709 13:04:59.390041 15679 leader_election.cc:304] T bcebe4c376a840ec82f61ccc634802bb P df6686ba21134096a4687dbfd45aef3e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df6686ba21134096a4687dbfd45aef3e; no voters: 7e4674b8eef7448588dd0c00bf09499e, b698cb024cb44d56915bbf45684e0762
I20260709 13:04:59.392284 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcebe4c376a840ec82f61ccc634802bb" candidate_uuid: "b698cb024cb44d56915bbf45684e0762" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df6686ba21134096a4687dbfd45aef3e"
I20260709 13:04:59.391942 15937 raft_consensus.cc:3060] T bcebe4c376a840ec82f61ccc634802bb P df6686ba21134096a4687dbfd45aef3e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:59.398365 15907 tablet_bootstrap.cc:654] T 7ff320c2485644c5914cfbab424cc102 P 7e4674b8eef7448588dd0c00bf09499e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:59.400596 15904 tablet_bootstrap.cc:654] T 269ab37889604517b35eaed13e3c4fae P b698cb024cb44d56915bbf45684e0762: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:59.403657 15863 raft_consensus.cc:2468] T bcebe4c376a840ec82f61ccc634802bb P 7e4674b8eef7448588dd0c00bf09499e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b698cb024cb44d56915bbf45684e0762 in term 1.
I20260709 13:04:59.408345 15754 leader_election.cc:304] T bcebe4c376a840ec82f61ccc634802bb P b698cb024cb44d56915bbf45684e0762 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e4674b8eef7448588dd0c00bf09499e, b698cb024cb44d56915bbf45684e0762; no voters: 
I20260709 13:04:59.409554 15925 raft_consensus.cc:2804] T bcebe4c376a840ec82f61ccc634802bb P b698cb024cb44d56915bbf45684e0762 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:59.410104 15925 raft_consensus.cc:697] T bcebe4c376a840ec82f61ccc634802bb P b698cb024cb44d56915bbf45684e0762 [term 1 LEADER]: Becoming Leader. State: Replica: b698cb024cb44d56915bbf45684e0762, State: Running, Role: LEADER
I20260709 13:04:59.411602 15862 raft_consensus.cc:2468] T a0d24e4aeb604523af8ec351df2618d7 P 7e4674b8eef7448588dd0c00bf09499e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df6686ba21134096a4687dbfd45aef3e in term 1.
I20260709 13:04:59.412956 15679 leader_election.cc:304] T a0d24e4aeb604523af8ec351df2618d7 P df6686ba21134096a4687dbfd45aef3e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e4674b8eef7448588dd0c00bf09499e, df6686ba21134096a4687dbfd45aef3e; no voters: b698cb024cb44d56915bbf45684e0762
I20260709 13:04:59.414474 15939 raft_consensus.cc:2804] T a0d24e4aeb604523af8ec351df2618d7 P df6686ba21134096a4687dbfd45aef3e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:59.414811 15907 tablet_bootstrap.cc:492] T 7ff320c2485644c5914cfbab424cc102 P 7e4674b8eef7448588dd0c00bf09499e: No bootstrap required, opened a new log
I20260709 13:04:59.415061 15939 raft_consensus.cc:697] T a0d24e4aeb604523af8ec351df2618d7 P df6686ba21134096a4687dbfd45aef3e [term 1 LEADER]: Becoming Leader. State: Replica: df6686ba21134096a4687dbfd45aef3e, State: Running, Role: LEADER
I20260709 13:04:59.415649 15907 ts_tablet_manager.cc:1403] T 7ff320c2485644c5914cfbab424cc102 P 7e4674b8eef7448588dd0c00bf09499e: Time spent bootstrapping tablet: real 0.039s	user 0.011s	sys 0.006s
I20260709 13:04:59.416064 15939 consensus_queue.cc:237] T a0d24e4aeb604523af8ec351df2618d7 P df6686ba21134096a4687dbfd45aef3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:04:59.412616 15925 consensus_queue.cc:237] T bcebe4c376a840ec82f61ccc634802bb P b698cb024cb44d56915bbf45684e0762 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:04:59.420008 15907 raft_consensus.cc:359] T 7ff320c2485644c5914cfbab424cc102 P 7e4674b8eef7448588dd0c00bf09499e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } }
I20260709 13:04:59.421108 15907 raft_consensus.cc:385] T 7ff320c2485644c5914cfbab424cc102 P 7e4674b8eef7448588dd0c00bf09499e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:59.421532 15905 tablet_bootstrap.cc:492] T 5b842df9396d40b581214a0fa9c33530 P df6686ba21134096a4687dbfd45aef3e: No bootstrap required, opened a new log
I20260709 13:04:59.421550 15907 raft_consensus.cc:740] T 7ff320c2485644c5914cfbab424cc102 P 7e4674b8eef7448588dd0c00bf09499e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e4674b8eef7448588dd0c00bf09499e, State: Initialized, Role: FOLLOWER
I20260709 13:04:59.422271 15905 ts_tablet_manager.cc:1403] T 5b842df9396d40b581214a0fa9c33530 P df6686ba21134096a4687dbfd45aef3e: Time spent bootstrapping tablet: real 0.075s	user 0.011s	sys 0.019s
I20260709 13:04:59.422976 15907 consensus_queue.cc:260] T 7ff320c2485644c5914cfbab424cc102 P 7e4674b8eef7448588dd0c00bf09499e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } }
I20260709 13:04:59.425285 15905 raft_consensus.cc:359] T 5b842df9396d40b581214a0fa9c33530 P df6686ba21134096a4687dbfd45aef3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:04:59.426244 15928 raft_consensus.cc:493] T 5b842df9396d40b581214a0fa9c33530 P b698cb024cb44d56915bbf45684e0762 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.431843 15905 raft_consensus.cc:385] T 5b842df9396d40b581214a0fa9c33530 P df6686ba21134096a4687dbfd45aef3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:59.431949 15904 tablet_bootstrap.cc:492] T 269ab37889604517b35eaed13e3c4fae P b698cb024cb44d56915bbf45684e0762: No bootstrap required, opened a new log
I20260709 13:04:59.432278 15905 raft_consensus.cc:740] T 5b842df9396d40b581214a0fa9c33530 P df6686ba21134096a4687dbfd45aef3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df6686ba21134096a4687dbfd45aef3e, State: Initialized, Role: FOLLOWER
I20260709 13:04:59.431993 15928 raft_consensus.cc:515] T 5b842df9396d40b581214a0fa9c33530 P b698cb024cb44d56915bbf45684e0762 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:04:59.432797 15904 ts_tablet_manager.cc:1403] T 269ab37889604517b35eaed13e3c4fae P b698cb024cb44d56915bbf45684e0762: Time spent bootstrapping tablet: real 0.072s	user 0.020s	sys 0.016s
I20260709 13:04:59.433092 15905 consensus_queue.cc:260] T 5b842df9396d40b581214a0fa9c33530 P df6686ba21134096a4687dbfd45aef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:04:59.434495 15928 leader_election.cc:290] T 5b842df9396d40b581214a0fa9c33530 P b698cb024cb44d56915bbf45684e0762 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df6686ba21134096a4687dbfd45aef3e (127.14.180.65:42893), 7e4674b8eef7448588dd0c00bf09499e (127.14.180.67:42215)
I20260709 13:04:59.436669 15905 ts_tablet_manager.cc:1434] T 5b842df9396d40b581214a0fa9c33530 P df6686ba21134096a4687dbfd45aef3e: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.001s
I20260709 13:04:59.436491 15863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b842df9396d40b581214a0fa9c33530" candidate_uuid: "b698cb024cb44d56915bbf45684e0762" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e4674b8eef7448588dd0c00bf09499e" is_pre_election: true
I20260709 13:04:59.436975 15904 raft_consensus.cc:359] T 269ab37889604517b35eaed13e3c4fae P b698cb024cb44d56915bbf45684e0762 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:04:59.428558 15937 raft_consensus.cc:2749] T bcebe4c376a840ec82f61ccc634802bb P df6686ba21134096a4687dbfd45aef3e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:59.436527 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b842df9396d40b581214a0fa9c33530" candidate_uuid: "b698cb024cb44d56915bbf45684e0762" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df6686ba21134096a4687dbfd45aef3e" is_pre_election: true
I20260709 13:04:59.437906 15905 tablet_bootstrap.cc:492] T 7ff320c2485644c5914cfbab424cc102 P df6686ba21134096a4687dbfd45aef3e: Bootstrap starting.
I20260709 13:04:59.437968 15714 raft_consensus.cc:2468] T 5b842df9396d40b581214a0fa9c33530 P df6686ba21134096a4687dbfd45aef3e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b698cb024cb44d56915bbf45684e0762 in term 0.
W20260709 13:04:59.438577 15754 leader_election.cc:343] T 5b842df9396d40b581214a0fa9c33530 P b698cb024cb44d56915bbf45684e0762 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e4674b8eef7448588dd0c00bf09499e (127.14.180.67:42215): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:59.439451 15756 leader_election.cc:304] T 5b842df9396d40b581214a0fa9c33530 P b698cb024cb44d56915bbf45684e0762 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b698cb024cb44d56915bbf45684e0762, df6686ba21134096a4687dbfd45aef3e; no voters: 7e4674b8eef7448588dd0c00bf09499e
I20260709 13:04:59.440546 15928 raft_consensus.cc:2804] T 5b842df9396d40b581214a0fa9c33530 P b698cb024cb44d56915bbf45684e0762 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:59.427438 15909 raft_consensus.cc:493] T 6a089ebf729d4dcabe86cf94fb987006 P b698cb024cb44d56915bbf45684e0762 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.427361 15907 ts_tablet_manager.cc:1434] T 7ff320c2485644c5914cfbab424cc102 P 7e4674b8eef7448588dd0c00bf09499e: Time spent starting tablet: real 0.011s	user 0.010s	sys 0.000s
I20260709 13:04:59.441171 15909 raft_consensus.cc:515] T 6a089ebf729d4dcabe86cf94fb987006 P b698cb024cb44d56915bbf45684e0762 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:04:59.443423 15909 leader_election.cc:290] T 6a089ebf729d4dcabe86cf94fb987006 P b698cb024cb44d56915bbf45684e0762 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df6686ba21134096a4687dbfd45aef3e (127.14.180.65:42893), 7e4674b8eef7448588dd0c00bf09499e (127.14.180.67:42215)
I20260709 13:04:59.444571 15715 raft_consensus.cc:2468] T bcebe4c376a840ec82f61ccc634802bb P df6686ba21134096a4687dbfd45aef3e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b698cb024cb44d56915bbf45684e0762 in term 1.
I20260709 13:04:59.445214 15863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a089ebf729d4dcabe86cf94fb987006" candidate_uuid: "b698cb024cb44d56915bbf45684e0762" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e4674b8eef7448588dd0c00bf09499e" is_pre_election: true
I20260709 13:04:59.445785 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a089ebf729d4dcabe86cf94fb987006" candidate_uuid: "b698cb024cb44d56915bbf45684e0762" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df6686ba21134096a4687dbfd45aef3e" is_pre_election: true
I20260709 13:04:59.446453 15714 raft_consensus.cc:2468] T 6a089ebf729d4dcabe86cf94fb987006 P df6686ba21134096a4687dbfd45aef3e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b698cb024cb44d56915bbf45684e0762 in term 0.
I20260709 13:04:59.447108 15904 raft_consensus.cc:385] T 269ab37889604517b35eaed13e3c4fae P b698cb024cb44d56915bbf45684e0762 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:59.447420 15904 raft_consensus.cc:740] T 269ab37889604517b35eaed13e3c4fae P b698cb024cb44d56915bbf45684e0762 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b698cb024cb44d56915bbf45684e0762, State: Initialized, Role: FOLLOWER
I20260709 13:04:59.448472 15905 tablet_bootstrap.cc:654] T 7ff320c2485644c5914cfbab424cc102 P df6686ba21134096a4687dbfd45aef3e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:59.448096 15904 consensus_queue.cc:260] T 269ab37889604517b35eaed13e3c4fae P b698cb024cb44d56915bbf45684e0762 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:04:59.450208 15904 ts_tablet_manager.cc:1434] T 269ab37889604517b35eaed13e3c4fae P b698cb024cb44d56915bbf45684e0762: Time spent starting tablet: real 0.016s	user 0.003s	sys 0.001s
I20260709 13:04:59.450210 15756 leader_election.cc:304] T 6a089ebf729d4dcabe86cf94fb987006 P b698cb024cb44d56915bbf45684e0762 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b698cb024cb44d56915bbf45684e0762, df6686ba21134096a4687dbfd45aef3e; no voters: 
I20260709 13:04:59.452802 15925 raft_consensus.cc:2804] T 6a089ebf729d4dcabe86cf94fb987006 P b698cb024cb44d56915bbf45684e0762 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:59.453212 15925 raft_consensus.cc:493] T 6a089ebf729d4dcabe86cf94fb987006 P b698cb024cb44d56915bbf45684e0762 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:59.453554 15925 raft_consensus.cc:3060] T 6a089ebf729d4dcabe86cf94fb987006 P b698cb024cb44d56915bbf45684e0762 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:59.453860 15904 tablet_bootstrap.cc:492] T aec58ca8ca264a4b9cbcb7703558f1c8 P b698cb024cb44d56915bbf45684e0762: Bootstrap starting.
W20260709 13:04:59.455775 15754 leader_election.cc:343] T 6a089ebf729d4dcabe86cf94fb987006 P b698cb024cb44d56915bbf45684e0762 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e4674b8eef7448588dd0c00bf09499e (127.14.180.67:42215): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:59.460104 15904 tablet_bootstrap.cc:654] T aec58ca8ca264a4b9cbcb7703558f1c8 P b698cb024cb44d56915bbf45684e0762: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:59.459911 15907 tablet_bootstrap.cc:492] T 6a089ebf729d4dcabe86cf94fb987006 P 7e4674b8eef7448588dd0c00bf09499e: Bootstrap starting.
I20260709 13:04:59.462180 15937 raft_consensus.cc:493] T 269ab37889604517b35eaed13e3c4fae P df6686ba21134096a4687dbfd45aef3e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.462272 15925 raft_consensus.cc:515] T 6a089ebf729d4dcabe86cf94fb987006 P b698cb024cb44d56915bbf45684e0762 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:04:59.462898 15937 raft_consensus.cc:515] T 269ab37889604517b35eaed13e3c4fae P df6686ba21134096a4687dbfd45aef3e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:04:59.464983 15937 leader_election.cc:290] T 269ab37889604517b35eaed13e3c4fae P df6686ba21134096a4687dbfd45aef3e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b698cb024cb44d56915bbf45684e0762 (127.14.180.66:35237), 7e4674b8eef7448588dd0c00bf09499e (127.14.180.67:42215)
I20260709 13:04:59.464542 15925 leader_election.cc:290] T 6a089ebf729d4dcabe86cf94fb987006 P b698cb024cb44d56915bbf45684e0762 [CANDIDATE]: Term 1 election: Requested vote from peers df6686ba21134096a4687dbfd45aef3e (127.14.180.65:42893), 7e4674b8eef7448588dd0c00bf09499e (127.14.180.67:42215)
I20260709 13:04:59.465905 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "269ab37889604517b35eaed13e3c4fae" candidate_uuid: "df6686ba21134096a4687dbfd45aef3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b698cb024cb44d56915bbf45684e0762" is_pre_election: true
I20260709 13:04:59.466216 15863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "269ab37889604517b35eaed13e3c4fae" candidate_uuid: "df6686ba21134096a4687dbfd45aef3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e4674b8eef7448588dd0c00bf09499e" is_pre_election: true
I20260709 13:04:59.466704 15790 raft_consensus.cc:2468] T 269ab37889604517b35eaed13e3c4fae P b698cb024cb44d56915bbf45684e0762 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df6686ba21134096a4687dbfd45aef3e in term 0.
I20260709 13:04:59.467206 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a089ebf729d4dcabe86cf94fb987006" candidate_uuid: "b698cb024cb44d56915bbf45684e0762" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df6686ba21134096a4687dbfd45aef3e"
I20260709 13:04:59.459908 15914 raft_consensus.cc:493] T 269ab37889604517b35eaed13e3c4fae P 7e4674b8eef7448588dd0c00bf09499e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.468142 15714 raft_consensus.cc:3060] T 6a089ebf729d4dcabe86cf94fb987006 P df6686ba21134096a4687dbfd45aef3e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:59.468557 15914 raft_consensus.cc:515] T 269ab37889604517b35eaed13e3c4fae P 7e4674b8eef7448588dd0c00bf09499e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:04:59.469645 15937 raft_consensus.cc:493] T aec58ca8ca264a4b9cbcb7703558f1c8 P df6686ba21134096a4687dbfd45aef3e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.470347 15937 raft_consensus.cc:515] T aec58ca8ca264a4b9cbcb7703558f1c8 P df6686ba21134096a4687dbfd45aef3e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:04:59.464432 15611 catalog_manager.cc:5697] T c1d542ea2766419380191ac2ffcf8e64 P b698cb024cb44d56915bbf45684e0762 reported cstate change: term changed from 0 to 1, leader changed from <none> to b698cb024cb44d56915bbf45684e0762 (127.14.180.66). New cstate: current_term: 1 leader_uuid: "b698cb024cb44d56915bbf45684e0762" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:59.473587 15937 leader_election.cc:290] T aec58ca8ca264a4b9cbcb7703558f1c8 P df6686ba21134096a4687dbfd45aef3e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b698cb024cb44d56915bbf45684e0762 (127.14.180.66:35237), 7e4674b8eef7448588dd0c00bf09499e (127.14.180.67:42215)
I20260709 13:04:59.473658 15862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a089ebf729d4dcabe86cf94fb987006" candidate_uuid: "b698cb024cb44d56915bbf45684e0762" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e4674b8eef7448588dd0c00bf09499e"
I20260709 13:04:59.474712 15681 leader_election.cc:304] T 269ab37889604517b35eaed13e3c4fae P df6686ba21134096a4687dbfd45aef3e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b698cb024cb44d56915bbf45684e0762, df6686ba21134096a4687dbfd45aef3e; no voters: 
I20260709 13:04:59.476691 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aec58ca8ca264a4b9cbcb7703558f1c8" candidate_uuid: "df6686ba21134096a4687dbfd45aef3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b698cb024cb44d56915bbf45684e0762" is_pre_election: true
I20260709 13:04:59.476878 15910 raft_consensus.cc:2804] T 269ab37889604517b35eaed13e3c4fae P df6686ba21134096a4687dbfd45aef3e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:59.477329 15910 raft_consensus.cc:493] T 269ab37889604517b35eaed13e3c4fae P df6686ba21134096a4687dbfd45aef3e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:59.477672 15910 raft_consensus.cc:3060] T 269ab37889604517b35eaed13e3c4fae P df6686ba21134096a4687dbfd45aef3e [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:59.478832 15681 leader_election.cc:343] T aec58ca8ca264a4b9cbcb7703558f1c8 P df6686ba21134096a4687dbfd45aef3e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b698cb024cb44d56915bbf45684e0762 (127.14.180.66:35237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:59.479871 15914 leader_election.cc:290] T 269ab37889604517b35eaed13e3c4fae P 7e4674b8eef7448588dd0c00bf09499e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df6686ba21134096a4687dbfd45aef3e (127.14.180.65:42893), b698cb024cb44d56915bbf45684e0762 (127.14.180.66:35237)
W20260709 13:04:59.480050 15754 leader_election.cc:343] T 6a089ebf729d4dcabe86cf94fb987006 P b698cb024cb44d56915bbf45684e0762 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7e4674b8eef7448588dd0c00bf09499e (127.14.180.67:42215): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:59.481508 15862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aec58ca8ca264a4b9cbcb7703558f1c8" candidate_uuid: "df6686ba21134096a4687dbfd45aef3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e4674b8eef7448588dd0c00bf09499e" is_pre_election: true
W20260709 13:04:59.496049 15679 leader_election.cc:343] T aec58ca8ca264a4b9cbcb7703558f1c8 P df6686ba21134096a4687dbfd45aef3e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7e4674b8eef7448588dd0c00bf09499e (127.14.180.67:42215): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:59.496390 15714 raft_consensus.cc:2468] T 6a089ebf729d4dcabe86cf94fb987006 P df6686ba21134096a4687dbfd45aef3e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b698cb024cb44d56915bbf45684e0762 in term 1.
I20260709 13:04:59.496790 15679 leader_election.cc:304] T aec58ca8ca264a4b9cbcb7703558f1c8 P df6686ba21134096a4687dbfd45aef3e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df6686ba21134096a4687dbfd45aef3e; no voters: 7e4674b8eef7448588dd0c00bf09499e, b698cb024cb44d56915bbf45684e0762
I20260709 13:04:59.486961 15928 raft_consensus.cc:493] T 5b842df9396d40b581214a0fa9c33530 P b698cb024cb44d56915bbf45684e0762 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:59.498271 15756 leader_election.cc:304] T 6a089ebf729d4dcabe86cf94fb987006 P b698cb024cb44d56915bbf45684e0762 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b698cb024cb44d56915bbf45684e0762, df6686ba21134096a4687dbfd45aef3e; no voters: 7e4674b8eef7448588dd0c00bf09499e
I20260709 13:04:59.499095 15928 raft_consensus.cc:3060] T 5b842df9396d40b581214a0fa9c33530 P b698cb024cb44d56915bbf45684e0762 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:59.500209 15939 raft_consensus.cc:2749] T aec58ca8ca264a4b9cbcb7703558f1c8 P df6686ba21134096a4687dbfd45aef3e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:59.501374 15909 raft_consensus.cc:2804] T 6a089ebf729d4dcabe86cf94fb987006 P b698cb024cb44d56915bbf45684e0762 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:59.502126 15909 raft_consensus.cc:697] T 6a089ebf729d4dcabe86cf94fb987006 P b698cb024cb44d56915bbf45684e0762 [term 1 LEADER]: Becoming Leader. State: Replica: b698cb024cb44d56915bbf45684e0762, State: Running, Role: LEADER
I20260709 13:04:59.503412 15909 consensus_queue.cc:237] T 6a089ebf729d4dcabe86cf94fb987006 P b698cb024cb44d56915bbf45684e0762 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:04:59.491670 15907 tablet_bootstrap.cc:654] T 6a089ebf729d4dcabe86cf94fb987006 P 7e4674b8eef7448588dd0c00bf09499e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:59.491799 15611 catalog_manager.cc:5697] T bcebe4c376a840ec82f61ccc634802bb P b698cb024cb44d56915bbf45684e0762 reported cstate change: term changed from 0 to 1, leader changed from <none> to b698cb024cb44d56915bbf45684e0762 (127.14.180.66). New cstate: current_term: 1 leader_uuid: "b698cb024cb44d56915bbf45684e0762" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:59.486013 15863 raft_consensus.cc:2468] T 269ab37889604517b35eaed13e3c4fae P 7e4674b8eef7448588dd0c00bf09499e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df6686ba21134096a4687dbfd45aef3e in term 0.
I20260709 13:04:59.521695 15907 tablet_bootstrap.cc:492] T 6a089ebf729d4dcabe86cf94fb987006 P 7e4674b8eef7448588dd0c00bf09499e: No bootstrap required, opened a new log
I20260709 13:04:59.522421 15907 ts_tablet_manager.cc:1403] T 6a089ebf729d4dcabe86cf94fb987006 P 7e4674b8eef7448588dd0c00bf09499e: Time spent bootstrapping tablet: real 0.063s	user 0.011s	sys 0.005s
I20260709 13:04:59.531342 15907 raft_consensus.cc:359] T 6a089ebf729d4dcabe86cf94fb987006 P 7e4674b8eef7448588dd0c00bf09499e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:04:59.532523 15907 raft_consensus.cc:385] T 6a089ebf729d4dcabe86cf94fb987006 P 7e4674b8eef7448588dd0c00bf09499e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:59.532951 15907 raft_consensus.cc:740] T 6a089ebf729d4dcabe86cf94fb987006 P 7e4674b8eef7448588dd0c00bf09499e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e4674b8eef7448588dd0c00bf09499e, State: Initialized, Role: FOLLOWER
I20260709 13:04:59.534247 15907 consensus_queue.cc:260] T 6a089ebf729d4dcabe86cf94fb987006 P 7e4674b8eef7448588dd0c00bf09499e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:04:59.537578 15909 raft_consensus.cc:493] T 17c5f8247b874e168c1ba313418bb685 P b698cb024cb44d56915bbf45684e0762 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.537617 15907 ts_tablet_manager.cc:1434] T 6a089ebf729d4dcabe86cf94fb987006 P 7e4674b8eef7448588dd0c00bf09499e: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:04:59.538259 15909 raft_consensus.cc:515] T 17c5f8247b874e168c1ba313418bb685 P b698cb024cb44d56915bbf45684e0762 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:04:59.540908 15909 leader_election.cc:290] T 17c5f8247b874e168c1ba313418bb685 P b698cb024cb44d56915bbf45684e0762 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df6686ba21134096a4687dbfd45aef3e (127.14.180.65:42893), 7e4674b8eef7448588dd0c00bf09499e (127.14.180.67:42215)
I20260709 13:04:59.547273 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c5f8247b874e168c1ba313418bb685" candidate_uuid: "b698cb024cb44d56915bbf45684e0762" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df6686ba21134096a4687dbfd45aef3e" is_pre_election: true
W20260709 13:04:59.549810 15756 leader_election.cc:343] T 17c5f8247b874e168c1ba313418bb685 P b698cb024cb44d56915bbf45684e0762 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df6686ba21134096a4687dbfd45aef3e (127.14.180.65:42893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:59.554733 15863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c5f8247b874e168c1ba313418bb685" candidate_uuid: "b698cb024cb44d56915bbf45684e0762" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e4674b8eef7448588dd0c00bf09499e" is_pre_election: true
I20260709 13:04:59.555871 15863 raft_consensus.cc:2468] T 17c5f8247b874e168c1ba313418bb685 P 7e4674b8eef7448588dd0c00bf09499e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b698cb024cb44d56915bbf45684e0762 in term 0.
I20260709 13:04:59.557842 15754 leader_election.cc:304] T 17c5f8247b874e168c1ba313418bb685 P b698cb024cb44d56915bbf45684e0762 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e4674b8eef7448588dd0c00bf09499e, b698cb024cb44d56915bbf45684e0762; no voters: df6686ba21134096a4687dbfd45aef3e
I20260709 13:04:59.559316 15909 raft_consensus.cc:2804] T 17c5f8247b874e168c1ba313418bb685 P b698cb024cb44d56915bbf45684e0762 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:59.558000 15610 catalog_manager.cc:5697] T a0d24e4aeb604523af8ec351df2618d7 P df6686ba21134096a4687dbfd45aef3e reported cstate change: term changed from 0 to 1, leader changed from <none> to df6686ba21134096a4687dbfd45aef3e (127.14.180.65). New cstate: current_term: 1 leader_uuid: "df6686ba21134096a4687dbfd45aef3e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:59.559748 15909 raft_consensus.cc:493] T 17c5f8247b874e168c1ba313418bb685 P b698cb024cb44d56915bbf45684e0762 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:59.560335 15909 raft_consensus.cc:3060] T 17c5f8247b874e168c1ba313418bb685 P b698cb024cb44d56915bbf45684e0762 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:59.547066 15910 raft_consensus.cc:515] T 269ab37889604517b35eaed13e3c4fae P df6686ba21134096a4687dbfd45aef3e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:04:59.566044 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "269ab37889604517b35eaed13e3c4fae" candidate_uuid: "df6686ba21134096a4687dbfd45aef3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b698cb024cb44d56915bbf45684e0762"
I20260709 13:04:59.566704 15790 raft_consensus.cc:3060] T 269ab37889604517b35eaed13e3c4fae P b698cb024cb44d56915bbf45684e0762 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:59.568342 15909 raft_consensus.cc:515] T 17c5f8247b874e168c1ba313418bb685 P b698cb024cb44d56915bbf45684e0762 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:04:59.571575 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c5f8247b874e168c1ba313418bb685" candidate_uuid: "b698cb024cb44d56915bbf45684e0762" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df6686ba21134096a4687dbfd45aef3e"
I20260709 13:04:59.572273 15909 leader_election.cc:290] T 17c5f8247b874e168c1ba313418bb685 P b698cb024cb44d56915bbf45684e0762 [CANDIDATE]: Term 1 election: Requested vote from peers df6686ba21134096a4687dbfd45aef3e (127.14.180.65:42893), 7e4674b8eef7448588dd0c00bf09499e (127.14.180.67:42215)
W20260709 13:04:59.574357 15756 leader_election.cc:343] T 17c5f8247b874e168c1ba313418bb685 P b698cb024cb44d56915bbf45684e0762 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer df6686ba21134096a4687dbfd45aef3e (127.14.180.65:42893): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:59.575627 15790 raft_consensus.cc:2468] T 269ab37889604517b35eaed13e3c4fae P b698cb024cb44d56915bbf45684e0762 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df6686ba21134096a4687dbfd45aef3e in term 1.
I20260709 13:04:59.575721 15863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c5f8247b874e168c1ba313418bb685" candidate_uuid: "b698cb024cb44d56915bbf45684e0762" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e4674b8eef7448588dd0c00bf09499e"
I20260709 13:04:59.576749 15863 raft_consensus.cc:3060] T 17c5f8247b874e168c1ba313418bb685 P 7e4674b8eef7448588dd0c00bf09499e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:59.577623 15681 leader_election.cc:304] T 269ab37889604517b35eaed13e3c4fae P df6686ba21134096a4687dbfd45aef3e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b698cb024cb44d56915bbf45684e0762, df6686ba21134096a4687dbfd45aef3e; no voters: 
I20260709 13:04:59.578980 15939 raft_consensus.cc:2804] T 269ab37889604517b35eaed13e3c4fae P df6686ba21134096a4687dbfd45aef3e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:59.579547 15907 tablet_bootstrap.cc:492] T 5b842df9396d40b581214a0fa9c33530 P 7e4674b8eef7448588dd0c00bf09499e: Bootstrap starting.
I20260709 13:04:59.579705 15939 raft_consensus.cc:697] T 269ab37889604517b35eaed13e3c4fae P df6686ba21134096a4687dbfd45aef3e [term 1 LEADER]: Becoming Leader. State: Replica: df6686ba21134096a4687dbfd45aef3e, State: Running, Role: LEADER
I20260709 13:04:59.581530 15939 consensus_queue.cc:237] T 269ab37889604517b35eaed13e3c4fae P df6686ba21134096a4687dbfd45aef3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:04:59.608525 15862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "269ab37889604517b35eaed13e3c4fae" candidate_uuid: "df6686ba21134096a4687dbfd45aef3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e4674b8eef7448588dd0c00bf09499e"
I20260709 13:04:59.609551 15862 raft_consensus.cc:3060] T 269ab37889604517b35eaed13e3c4fae P 7e4674b8eef7448588dd0c00bf09499e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:59.617143 15910 leader_election.cc:290] T 269ab37889604517b35eaed13e3c4fae P df6686ba21134096a4687dbfd45aef3e [CANDIDATE]: Term 1 election: Requested vote from peers b698cb024cb44d56915bbf45684e0762 (127.14.180.66:35237), 7e4674b8eef7448588dd0c00bf09499e (127.14.180.67:42215)
I20260709 13:04:59.619619 15612 catalog_manager.cc:5697] T 6a089ebf729d4dcabe86cf94fb987006 P b698cb024cb44d56915bbf45684e0762 reported cstate change: term changed from 0 to 1, leader changed from <none> to b698cb024cb44d56915bbf45684e0762 (127.14.180.66). New cstate: current_term: 1 leader_uuid: "b698cb024cb44d56915bbf45684e0762" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:59.627606 15928 raft_consensus.cc:515] T 5b842df9396d40b581214a0fa9c33530 P b698cb024cb44d56915bbf45684e0762 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:04:59.634249 15907 tablet_bootstrap.cc:654] T 5b842df9396d40b581214a0fa9c33530 P 7e4674b8eef7448588dd0c00bf09499e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:59.635026 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b842df9396d40b581214a0fa9c33530" candidate_uuid: "b698cb024cb44d56915bbf45684e0762" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df6686ba21134096a4687dbfd45aef3e"
I20260709 13:04:59.635896 15714 raft_consensus.cc:3060] T 5b842df9396d40b581214a0fa9c33530 P df6686ba21134096a4687dbfd45aef3e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:59.630265 15862 raft_consensus.cc:2468] T 269ab37889604517b35eaed13e3c4fae P 7e4674b8eef7448588dd0c00bf09499e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df6686ba21134096a4687dbfd45aef3e in term 1.
I20260709 13:04:59.640390 15863 raft_consensus.cc:2468] T 17c5f8247b874e168c1ba313418bb685 P 7e4674b8eef7448588dd0c00bf09499e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b698cb024cb44d56915bbf45684e0762 in term 1.
I20260709 13:04:59.642477 15754 leader_election.cc:304] T 17c5f8247b874e168c1ba313418bb685 P b698cb024cb44d56915bbf45684e0762 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e4674b8eef7448588dd0c00bf09499e, b698cb024cb44d56915bbf45684e0762; no voters: df6686ba21134096a4687dbfd45aef3e
I20260709 13:04:59.644285 15909 raft_consensus.cc:2804] T 17c5f8247b874e168c1ba313418bb685 P b698cb024cb44d56915bbf45684e0762 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:59.645009 15909 raft_consensus.cc:697] T 17c5f8247b874e168c1ba313418bb685 P b698cb024cb44d56915bbf45684e0762 [term 1 LEADER]: Becoming Leader. State: Replica: b698cb024cb44d56915bbf45684e0762, State: Running, Role: LEADER
I20260709 13:04:59.646206 15909 consensus_queue.cc:237] T 17c5f8247b874e168c1ba313418bb685 P b698cb024cb44d56915bbf45684e0762 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:04:59.653079 15610 catalog_manager.cc:5697] T 269ab37889604517b35eaed13e3c4fae P df6686ba21134096a4687dbfd45aef3e reported cstate change: term changed from 0 to 1, leader changed from <none> to df6686ba21134096a4687dbfd45aef3e (127.14.180.65). New cstate: current_term: 1 leader_uuid: "df6686ba21134096a4687dbfd45aef3e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } health_report { overall_health: UNKNOWN } } }
W20260709 13:04:59.656158 15754 consensus_peers.cc:597] T 4b331a1f307440c987613c4937b9c972 P b698cb024cb44d56915bbf45684e0762 -> Peer 7e4674b8eef7448588dd0c00bf09499e (127.14.180.67:42215): Couldn't send request to peer 7e4674b8eef7448588dd0c00bf09499e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:59.673411 15714 raft_consensus.cc:2468] T 5b842df9396d40b581214a0fa9c33530 P df6686ba21134096a4687dbfd45aef3e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b698cb024cb44d56915bbf45684e0762 in term 1.
I20260709 13:04:59.678682 15756 leader_election.cc:304] T 5b842df9396d40b581214a0fa9c33530 P b698cb024cb44d56915bbf45684e0762 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b698cb024cb44d56915bbf45684e0762, df6686ba21134096a4687dbfd45aef3e; no voters: 
I20260709 13:04:59.679674 15905 tablet_bootstrap.cc:492] T 7ff320c2485644c5914cfbab424cc102 P df6686ba21134096a4687dbfd45aef3e: No bootstrap required, opened a new log
I20260709 13:04:59.679780 15914 raft_consensus.cc:493] T 7ff320c2485644c5914cfbab424cc102 P 7e4674b8eef7448588dd0c00bf09499e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.680223 15905 ts_tablet_manager.cc:1403] T 7ff320c2485644c5914cfbab424cc102 P df6686ba21134096a4687dbfd45aef3e: Time spent bootstrapping tablet: real 0.243s	user 0.094s	sys 0.122s
I20260709 13:04:59.680289 15914 raft_consensus.cc:515] T 7ff320c2485644c5914cfbab424cc102 P 7e4674b8eef7448588dd0c00bf09499e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } }
I20260709 13:04:59.682675 15914 leader_election.cc:290] T 7ff320c2485644c5914cfbab424cc102 P 7e4674b8eef7448588dd0c00bf09499e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df6686ba21134096a4687dbfd45aef3e (127.14.180.65:42893), b698cb024cb44d56915bbf45684e0762 (127.14.180.66:35237)
I20260709 13:04:59.683256 15925 raft_consensus.cc:2804] T 5b842df9396d40b581214a0fa9c33530 P b698cb024cb44d56915bbf45684e0762 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:59.683122 15905 raft_consensus.cc:359] T 7ff320c2485644c5914cfbab424cc102 P df6686ba21134096a4687dbfd45aef3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } }
I20260709 13:04:59.683794 15905 raft_consensus.cc:385] T 7ff320c2485644c5914cfbab424cc102 P df6686ba21134096a4687dbfd45aef3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:59.684134 15905 raft_consensus.cc:740] T 7ff320c2485644c5914cfbab424cc102 P df6686ba21134096a4687dbfd45aef3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df6686ba21134096a4687dbfd45aef3e, State: Initialized, Role: FOLLOWER
I20260709 13:04:59.685118 15905 consensus_queue.cc:260] T 7ff320c2485644c5914cfbab424cc102 P df6686ba21134096a4687dbfd45aef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } }
I20260709 13:04:59.688211 15905 ts_tablet_manager.cc:1434] T 7ff320c2485644c5914cfbab424cc102 P df6686ba21134096a4687dbfd45aef3e: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:04:59.690008 15905 tablet_bootstrap.cc:492] T 17c5f8247b874e168c1ba313418bb685 P df6686ba21134096a4687dbfd45aef3e: Bootstrap starting.
I20260709 13:04:59.692255 15928 leader_election.cc:290] T 5b842df9396d40b581214a0fa9c33530 P b698cb024cb44d56915bbf45684e0762 [CANDIDATE]: Term 1 election: Requested vote from peers df6686ba21134096a4687dbfd45aef3e (127.14.180.65:42893), 7e4674b8eef7448588dd0c00bf09499e (127.14.180.67:42215)
I20260709 13:04:59.693563 15907 tablet_bootstrap.cc:492] T 5b842df9396d40b581214a0fa9c33530 P 7e4674b8eef7448588dd0c00bf09499e: No bootstrap required, opened a new log
I20260709 13:04:59.694016 15907 ts_tablet_manager.cc:1403] T 5b842df9396d40b581214a0fa9c33530 P 7e4674b8eef7448588dd0c00bf09499e: Time spent bootstrapping tablet: real 0.115s	user 0.017s	sys 0.000s
I20260709 13:04:59.697597 15863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b842df9396d40b581214a0fa9c33530" candidate_uuid: "b698cb024cb44d56915bbf45684e0762" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e4674b8eef7448588dd0c00bf09499e"
I20260709 13:04:59.700901 15907 raft_consensus.cc:359] T 5b842df9396d40b581214a0fa9c33530 P 7e4674b8eef7448588dd0c00bf09499e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:04:59.701711 15907 raft_consensus.cc:385] T 5b842df9396d40b581214a0fa9c33530 P 7e4674b8eef7448588dd0c00bf09499e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:59.701764 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff320c2485644c5914cfbab424cc102" candidate_uuid: "7e4674b8eef7448588dd0c00bf09499e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b698cb024cb44d56915bbf45684e0762" is_pre_election: true
I20260709 13:04:59.702158 15907 raft_consensus.cc:740] T 5b842df9396d40b581214a0fa9c33530 P 7e4674b8eef7448588dd0c00bf09499e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e4674b8eef7448588dd0c00bf09499e, State: Initialized, Role: FOLLOWER
I20260709 13:04:59.702695 15789 raft_consensus.cc:2468] T 7ff320c2485644c5914cfbab424cc102 P b698cb024cb44d56915bbf45684e0762 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e4674b8eef7448588dd0c00bf09499e in term 0.
I20260709 13:04:59.703617 15907 consensus_queue.cc:260] T 5b842df9396d40b581214a0fa9c33530 P 7e4674b8eef7448588dd0c00bf09499e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:04:59.705256 15904 tablet_bootstrap.cc:492] T aec58ca8ca264a4b9cbcb7703558f1c8 P b698cb024cb44d56915bbf45684e0762: No bootstrap required, opened a new log
I20260709 13:04:59.705909 15904 ts_tablet_manager.cc:1403] T aec58ca8ca264a4b9cbcb7703558f1c8 P b698cb024cb44d56915bbf45684e0762: Time spent bootstrapping tablet: real 0.252s	user 0.092s	sys 0.088s
I20260709 13:04:59.697927 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "269ab37889604517b35eaed13e3c4fae" candidate_uuid: "7e4674b8eef7448588dd0c00bf09499e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df6686ba21134096a4687dbfd45aef3e" is_pre_election: true
I20260709 13:04:59.703619 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "269ab37889604517b35eaed13e3c4fae" candidate_uuid: "7e4674b8eef7448588dd0c00bf09499e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b698cb024cb44d56915bbf45684e0762" is_pre_election: true
I20260709 13:04:59.711553 15790 raft_consensus.cc:2393] T 269ab37889604517b35eaed13e3c4fae P b698cb024cb44d56915bbf45684e0762 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e4674b8eef7448588dd0c00bf09499e in current term 1: Already voted for candidate df6686ba21134096a4687dbfd45aef3e in this term.
I20260709 13:04:59.711650 15907 ts_tablet_manager.cc:1434] T 5b842df9396d40b581214a0fa9c33530 P 7e4674b8eef7448588dd0c00bf09499e: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:04:59.699067 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff320c2485644c5914cfbab424cc102" candidate_uuid: "7e4674b8eef7448588dd0c00bf09499e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df6686ba21134096a4687dbfd45aef3e" is_pre_election: true
I20260709 13:04:59.712831 15715 raft_consensus.cc:2468] T 7ff320c2485644c5914cfbab424cc102 P df6686ba21134096a4687dbfd45aef3e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e4674b8eef7448588dd0c00bf09499e in term 0.
I20260709 13:04:59.713513 15830 leader_election.cc:304] T 7ff320c2485644c5914cfbab424cc102 P 7e4674b8eef7448588dd0c00bf09499e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e4674b8eef7448588dd0c00bf09499e, b698cb024cb44d56915bbf45684e0762; no voters: 
I20260709 13:04:59.714380 15914 raft_consensus.cc:2804] T 7ff320c2485644c5914cfbab424cc102 P 7e4674b8eef7448588dd0c00bf09499e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:59.714787 15914 raft_consensus.cc:493] T 7ff320c2485644c5914cfbab424cc102 P 7e4674b8eef7448588dd0c00bf09499e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:59.715119 15914 raft_consensus.cc:3060] T 7ff320c2485644c5914cfbab424cc102 P 7e4674b8eef7448588dd0c00bf09499e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:59.712838 15907 tablet_bootstrap.cc:492] T aec58ca8ca264a4b9cbcb7703558f1c8 P 7e4674b8eef7448588dd0c00bf09499e: Bootstrap starting.
I20260709 13:04:59.716032 15925 raft_consensus.cc:697] T 5b842df9396d40b581214a0fa9c33530 P b698cb024cb44d56915bbf45684e0762 [term 1 LEADER]: Becoming Leader. State: Replica: b698cb024cb44d56915bbf45684e0762, State: Running, Role: LEADER
W20260709 13:04:59.716176 15754 leader_election.cc:343] T 5b842df9396d40b581214a0fa9c33530 P b698cb024cb44d56915bbf45684e0762 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7e4674b8eef7448588dd0c00bf09499e (127.14.180.67:42215): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:59.722018 15905 tablet_bootstrap.cc:654] T 17c5f8247b874e168c1ba313418bb685 P df6686ba21134096a4687dbfd45aef3e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:59.722441 15909 consensus_queue.cc:1048] T 4b331a1f307440c987613c4937b9c972 P b698cb024cb44d56915bbf45684e0762 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:59.719604 15925 consensus_queue.cc:237] T 5b842df9396d40b581214a0fa9c33530 P b698cb024cb44d56915bbf45684e0762 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:04:59.730391 15830 leader_election.cc:304] T 269ab37889604517b35eaed13e3c4fae P 7e4674b8eef7448588dd0c00bf09499e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e4674b8eef7448588dd0c00bf09499e; no voters: b698cb024cb44d56915bbf45684e0762, df6686ba21134096a4687dbfd45aef3e
I20260709 13:04:59.737505 15611 catalog_manager.cc:5697] T 17c5f8247b874e168c1ba313418bb685 P b698cb024cb44d56915bbf45684e0762 reported cstate change: term changed from 0 to 1, leader changed from <none> to b698cb024cb44d56915bbf45684e0762 (127.14.180.66). New cstate: current_term: 1 leader_uuid: "b698cb024cb44d56915bbf45684e0762" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:59.739362 15914 raft_consensus.cc:515] T 7ff320c2485644c5914cfbab424cc102 P 7e4674b8eef7448588dd0c00bf09499e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } }
I20260709 13:04:59.740851 15904 raft_consensus.cc:359] T aec58ca8ca264a4b9cbcb7703558f1c8 P b698cb024cb44d56915bbf45684e0762 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:04:59.749241 15914 leader_election.cc:290] T 7ff320c2485644c5914cfbab424cc102 P 7e4674b8eef7448588dd0c00bf09499e [CANDIDATE]: Term 1 election: Requested vote from peers df6686ba21134096a4687dbfd45aef3e (127.14.180.65:42893), b698cb024cb44d56915bbf45684e0762 (127.14.180.66:35237)
I20260709 13:04:59.749775 15904 raft_consensus.cc:385] T aec58ca8ca264a4b9cbcb7703558f1c8 P b698cb024cb44d56915bbf45684e0762 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:59.749909 15914 raft_consensus.cc:2749] T 269ab37889604517b35eaed13e3c4fae P 7e4674b8eef7448588dd0c00bf09499e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:59.750252 15907 tablet_bootstrap.cc:654] T aec58ca8ca264a4b9cbcb7703558f1c8 P 7e4674b8eef7448588dd0c00bf09499e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:59.751349 15914 raft_consensus.cc:493] T 6a089ebf729d4dcabe86cf94fb987006 P 7e4674b8eef7448588dd0c00bf09499e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.751890 15914 raft_consensus.cc:515] T 6a089ebf729d4dcabe86cf94fb987006 P 7e4674b8eef7448588dd0c00bf09499e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:04:59.754523 15914 leader_election.cc:290] T 6a089ebf729d4dcabe86cf94fb987006 P 7e4674b8eef7448588dd0c00bf09499e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df6686ba21134096a4687dbfd45aef3e (127.14.180.65:42893), b698cb024cb44d56915bbf45684e0762 (127.14.180.66:35237)
I20260709 13:04:59.752635 15904 raft_consensus.cc:740] T aec58ca8ca264a4b9cbcb7703558f1c8 P b698cb024cb44d56915bbf45684e0762 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b698cb024cb44d56915bbf45684e0762, State: Initialized, Role: FOLLOWER
I20260709 13:04:59.758906 15904 consensus_queue.cc:260] T aec58ca8ca264a4b9cbcb7703558f1c8 P b698cb024cb44d56915bbf45684e0762 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:04:59.762667 15904 ts_tablet_manager.cc:1434] T aec58ca8ca264a4b9cbcb7703558f1c8 P b698cb024cb44d56915bbf45684e0762: Time spent starting tablet: real 0.056s	user 0.007s	sys 0.002s
I20260709 13:04:59.766237 15904 tablet_bootstrap.cc:492] T a0d24e4aeb604523af8ec351df2618d7 P b698cb024cb44d56915bbf45684e0762: Bootstrap starting.
I20260709 13:04:59.778523 15904 tablet_bootstrap.cc:654] T a0d24e4aeb604523af8ec351df2618d7 P b698cb024cb44d56915bbf45684e0762: Neither blocks nor log segments found. Creating new log.
W20260709 13:04:59.779855 15830 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:42893, user_credentials={real_user=slave}} blocked reactor thread for 49611.8us
I20260709 13:04:59.781874 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff320c2485644c5914cfbab424cc102" candidate_uuid: "7e4674b8eef7448588dd0c00bf09499e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b698cb024cb44d56915bbf45684e0762"
I20260709 13:04:59.782006 15714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff320c2485644c5914cfbab424cc102" candidate_uuid: "7e4674b8eef7448588dd0c00bf09499e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df6686ba21134096a4687dbfd45aef3e"
I20260709 13:04:59.782572 15790 raft_consensus.cc:3060] T 7ff320c2485644c5914cfbab424cc102 P b698cb024cb44d56915bbf45684e0762 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:59.783011 15714 raft_consensus.cc:3060] T 7ff320c2485644c5914cfbab424cc102 P df6686ba21134096a4687dbfd45aef3e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:59.789191 15907 tablet_bootstrap.cc:492] T aec58ca8ca264a4b9cbcb7703558f1c8 P 7e4674b8eef7448588dd0c00bf09499e: No bootstrap required, opened a new log
I20260709 13:04:59.789815 15907 ts_tablet_manager.cc:1403] T aec58ca8ca264a4b9cbcb7703558f1c8 P 7e4674b8eef7448588dd0c00bf09499e: Time spent bootstrapping tablet: real 0.077s	user 0.012s	sys 0.000s
I20260709 13:04:59.793201 15714 raft_consensus.cc:2468] T 7ff320c2485644c5914cfbab424cc102 P df6686ba21134096a4687dbfd45aef3e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e4674b8eef7448588dd0c00bf09499e in term 1.
I20260709 13:04:59.792866 15907 raft_consensus.cc:359] T aec58ca8ca264a4b9cbcb7703558f1c8 P 7e4674b8eef7448588dd0c00bf09499e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:04:59.798190 15907 raft_consensus.cc:385] T aec58ca8ca264a4b9cbcb7703558f1c8 P 7e4674b8eef7448588dd0c00bf09499e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:59.798507 15907 raft_consensus.cc:740] T aec58ca8ca264a4b9cbcb7703558f1c8 P 7e4674b8eef7448588dd0c00bf09499e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e4674b8eef7448588dd0c00bf09499e, State: Initialized, Role: FOLLOWER
I20260709 13:04:59.798593 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a089ebf729d4dcabe86cf94fb987006" candidate_uuid: "7e4674b8eef7448588dd0c00bf09499e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df6686ba21134096a4687dbfd45aef3e" is_pre_election: true
I20260709 13:04:59.799669 15715 raft_consensus.cc:2393] T 6a089ebf729d4dcabe86cf94fb987006 P df6686ba21134096a4687dbfd45aef3e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e4674b8eef7448588dd0c00bf09499e in current term 1: Already voted for candidate b698cb024cb44d56915bbf45684e0762 in this term.
I20260709 13:04:59.799389 15907 consensus_queue.cc:260] T aec58ca8ca264a4b9cbcb7703558f1c8 P 7e4674b8eef7448588dd0c00bf09499e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:04:59.797605 15790 raft_consensus.cc:2468] T 7ff320c2485644c5914cfbab424cc102 P b698cb024cb44d56915bbf45684e0762 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e4674b8eef7448588dd0c00bf09499e in term 1.
I20260709 13:04:59.803285 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a089ebf729d4dcabe86cf94fb987006" candidate_uuid: "7e4674b8eef7448588dd0c00bf09499e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b698cb024cb44d56915bbf45684e0762" is_pre_election: true
I20260709 13:04:59.806917 15907 ts_tablet_manager.cc:1434] T aec58ca8ca264a4b9cbcb7703558f1c8 P 7e4674b8eef7448588dd0c00bf09499e: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.002s
I20260709 13:04:59.807099 15905 tablet_bootstrap.cc:492] T 17c5f8247b874e168c1ba313418bb685 P df6686ba21134096a4687dbfd45aef3e: No bootstrap required, opened a new log
I20260709 13:04:59.807564 15905 ts_tablet_manager.cc:1403] T 17c5f8247b874e168c1ba313418bb685 P df6686ba21134096a4687dbfd45aef3e: Time spent bootstrapping tablet: real 0.118s	user 0.028s	sys 0.033s
I20260709 13:04:59.820297 15905 raft_consensus.cc:359] T 17c5f8247b874e168c1ba313418bb685 P df6686ba21134096a4687dbfd45aef3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:04:59.821254 15905 raft_consensus.cc:385] T 17c5f8247b874e168c1ba313418bb685 P df6686ba21134096a4687dbfd45aef3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:59.821590 15905 raft_consensus.cc:740] T 17c5f8247b874e168c1ba313418bb685 P df6686ba21134096a4687dbfd45aef3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df6686ba21134096a4687dbfd45aef3e, State: Initialized, Role: FOLLOWER
I20260709 13:04:59.808552 15830 leader_election.cc:304] T 7ff320c2485644c5914cfbab424cc102 P 7e4674b8eef7448588dd0c00bf09499e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e4674b8eef7448588dd0c00bf09499e, df6686ba21134096a4687dbfd45aef3e; no voters: 
I20260709 13:04:59.823077 15960 raft_consensus.cc:2804] T 7ff320c2485644c5914cfbab424cc102 P 7e4674b8eef7448588dd0c00bf09499e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:59.823671 15960 raft_consensus.cc:697] T 7ff320c2485644c5914cfbab424cc102 P 7e4674b8eef7448588dd0c00bf09499e [term 1 LEADER]: Becoming Leader. State: Replica: 7e4674b8eef7448588dd0c00bf09499e, State: Running, Role: LEADER
I20260709 13:04:59.824757 15960 consensus_queue.cc:237] T 7ff320c2485644c5914cfbab424cc102 P 7e4674b8eef7448588dd0c00bf09499e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } }
I20260709 13:04:59.867448 15905 consensus_queue.cc:260] T 17c5f8247b874e168c1ba313418bb685 P df6686ba21134096a4687dbfd45aef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:04:59.868126 15907 tablet_bootstrap.cc:492] T 4b331a1f307440c987613c4937b9c972 P 7e4674b8eef7448588dd0c00bf09499e: Bootstrap starting.
I20260709 13:04:59.866690 15830 leader_election.cc:304] T 6a089ebf729d4dcabe86cf94fb987006 P 7e4674b8eef7448588dd0c00bf09499e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e4674b8eef7448588dd0c00bf09499e; no voters: b698cb024cb44d56915bbf45684e0762, df6686ba21134096a4687dbfd45aef3e
I20260709 13:04:59.875079 15960 raft_consensus.cc:3060] T 6a089ebf729d4dcabe86cf94fb987006 P 7e4674b8eef7448588dd0c00bf09499e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:59.879526 15610 catalog_manager.cc:5697] T 5b842df9396d40b581214a0fa9c33530 P b698cb024cb44d56915bbf45684e0762 reported cstate change: term changed from 0 to 1, leader changed from <none> to b698cb024cb44d56915bbf45684e0762 (127.14.180.66). New cstate: current_term: 1 leader_uuid: "b698cb024cb44d56915bbf45684e0762" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:59.886262 15907 tablet_bootstrap.cc:654] T 4b331a1f307440c987613c4937b9c972 P 7e4674b8eef7448588dd0c00bf09499e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:59.885910 15960 raft_consensus.cc:2749] T 6a089ebf729d4dcabe86cf94fb987006 P 7e4674b8eef7448588dd0c00bf09499e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:59.889806 15905 ts_tablet_manager.cc:1434] T 17c5f8247b874e168c1ba313418bb685 P df6686ba21134096a4687dbfd45aef3e: Time spent starting tablet: real 0.082s	user 0.014s	sys 0.000s
I20260709 13:04:59.891729 15925 consensus_queue.cc:1048] T bcebe4c376a840ec82f61ccc634802bb P b698cb024cb44d56915bbf45684e0762 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:59.896296 15613 catalog_manager.cc:5697] T 7ff320c2485644c5914cfbab424cc102 P 7e4674b8eef7448588dd0c00bf09499e reported cstate change: term changed from 0 to 1, leader changed from <none> to 7e4674b8eef7448588dd0c00bf09499e (127.14.180.67). New cstate: current_term: 1 leader_uuid: "7e4674b8eef7448588dd0c00bf09499e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:59.899924 15907 tablet_bootstrap.cc:492] T 4b331a1f307440c987613c4937b9c972 P 7e4674b8eef7448588dd0c00bf09499e: No bootstrap required, opened a new log
I20260709 13:04:59.900462 15907 ts_tablet_manager.cc:1403] T 4b331a1f307440c987613c4937b9c972 P 7e4674b8eef7448588dd0c00bf09499e: Time spent bootstrapping tablet: real 0.034s	user 0.013s	sys 0.002s
I20260709 13:04:59.902864 15904 tablet_bootstrap.cc:492] T a0d24e4aeb604523af8ec351df2618d7 P b698cb024cb44d56915bbf45684e0762: No bootstrap required, opened a new log
I20260709 13:04:59.903344 15904 ts_tablet_manager.cc:1403] T a0d24e4aeb604523af8ec351df2618d7 P b698cb024cb44d56915bbf45684e0762: Time spent bootstrapping tablet: real 0.137s	user 0.010s	sys 0.006s
I20260709 13:04:59.905073 15907 raft_consensus.cc:359] T 4b331a1f307440c987613c4937b9c972 P 7e4674b8eef7448588dd0c00bf09499e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:04:59.905843 15907 raft_consensus.cc:385] T 4b331a1f307440c987613c4937b9c972 P 7e4674b8eef7448588dd0c00bf09499e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:59.906067 15907 raft_consensus.cc:740] T 4b331a1f307440c987613c4937b9c972 P 7e4674b8eef7448588dd0c00bf09499e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e4674b8eef7448588dd0c00bf09499e, State: Initialized, Role: FOLLOWER
I20260709 13:04:59.906038 15904 raft_consensus.cc:359] T a0d24e4aeb604523af8ec351df2618d7 P b698cb024cb44d56915bbf45684e0762 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:04:59.909969 15904 raft_consensus.cc:385] T a0d24e4aeb604523af8ec351df2618d7 P b698cb024cb44d56915bbf45684e0762 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:59.910259 15904 raft_consensus.cc:740] T a0d24e4aeb604523af8ec351df2618d7 P b698cb024cb44d56915bbf45684e0762 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b698cb024cb44d56915bbf45684e0762, State: Initialized, Role: FOLLOWER
I20260709 13:04:59.910367 15907 consensus_queue.cc:260] T 4b331a1f307440c987613c4937b9c972 P 7e4674b8eef7448588dd0c00bf09499e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:04:59.911111 15904 consensus_queue.cc:260] T a0d24e4aeb604523af8ec351df2618d7 P b698cb024cb44d56915bbf45684e0762 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:04:59.912163 15909 consensus_queue.cc:1048] T 6a089ebf729d4dcabe86cf94fb987006 P b698cb024cb44d56915bbf45684e0762 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:59.912894 15907 ts_tablet_manager.cc:1434] T 4b331a1f307440c987613c4937b9c972 P 7e4674b8eef7448588dd0c00bf09499e: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.002s
I20260709 13:04:59.918838 15904 ts_tablet_manager.cc:1434] T a0d24e4aeb604523af8ec351df2618d7 P b698cb024cb44d56915bbf45684e0762: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:04:59.920886 15928 consensus_queue.cc:1048] T bcebe4c376a840ec82f61ccc634802bb P b698cb024cb44d56915bbf45684e0762 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:59.926091 15928 consensus_queue.cc:1048] T 6a089ebf729d4dcabe86cf94fb987006 P b698cb024cb44d56915bbf45684e0762 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:59.940486 15910 consensus_queue.cc:1048] T a0d24e4aeb604523af8ec351df2618d7 P df6686ba21134096a4687dbfd45aef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:59.951013 15790 raft_consensus.cc:3060] T a0d24e4aeb604523af8ec351df2618d7 P b698cb024cb44d56915bbf45684e0762 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:59.963828 15937 consensus_queue.cc:1048] T a0d24e4aeb604523af8ec351df2618d7 P df6686ba21134096a4687dbfd45aef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:59.966881 15928 consensus_queue.cc:1048] T c1d542ea2766419380191ac2ffcf8e64 P b698cb024cb44d56915bbf45684e0762 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:59.984970 15909 consensus_queue.cc:1048] T c1d542ea2766419380191ac2ffcf8e64 P b698cb024cb44d56915bbf45684e0762 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:00.016940 15937 raft_consensus.cc:493] T 17c5f8247b874e168c1ba313418bb685 P df6686ba21134096a4687dbfd45aef3e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:00.017565 15939 consensus_queue.cc:1048] T 269ab37889604517b35eaed13e3c4fae P df6686ba21134096a4687dbfd45aef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:00.017480 15937 raft_consensus.cc:515] T 17c5f8247b874e168c1ba313418bb685 P df6686ba21134096a4687dbfd45aef3e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:05:00.019728 15937 leader_election.cc:290] T 17c5f8247b874e168c1ba313418bb685 P df6686ba21134096a4687dbfd45aef3e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b698cb024cb44d56915bbf45684e0762 (127.14.180.66:35237), 7e4674b8eef7448588dd0c00bf09499e (127.14.180.67:42215)
I20260709 13:05:00.020366 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c5f8247b874e168c1ba313418bb685" candidate_uuid: "df6686ba21134096a4687dbfd45aef3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b698cb024cb44d56915bbf45684e0762" is_pre_election: true
I20260709 13:05:00.020852 15862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c5f8247b874e168c1ba313418bb685" candidate_uuid: "df6686ba21134096a4687dbfd45aef3e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e4674b8eef7448588dd0c00bf09499e" is_pre_election: true
I20260709 13:05:00.021788 15862 raft_consensus.cc:2393] T 17c5f8247b874e168c1ba313418bb685 P 7e4674b8eef7448588dd0c00bf09499e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate df6686ba21134096a4687dbfd45aef3e in current term 1: Already voted for candidate b698cb024cb44d56915bbf45684e0762 in this term.
I20260709 13:05:00.022869 15679 leader_election.cc:304] T 17c5f8247b874e168c1ba313418bb685 P df6686ba21134096a4687dbfd45aef3e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df6686ba21134096a4687dbfd45aef3e; no voters: 7e4674b8eef7448588dd0c00bf09499e, b698cb024cb44d56915bbf45684e0762
I20260709 13:05:00.023747 15937 raft_consensus.cc:3060] T 17c5f8247b874e168c1ba313418bb685 P df6686ba21134096a4687dbfd45aef3e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:00.030511 15939 consensus_queue.cc:1048] T 269ab37889604517b35eaed13e3c4fae P df6686ba21134096a4687dbfd45aef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:00.031510 15937 raft_consensus.cc:2749] T 17c5f8247b874e168c1ba313418bb685 P df6686ba21134096a4687dbfd45aef3e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:00.039423 15909 raft_consensus.cc:493] T aec58ca8ca264a4b9cbcb7703558f1c8 P b698cb024cb44d56915bbf45684e0762 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:00.039902 15909 raft_consensus.cc:515] T aec58ca8ca264a4b9cbcb7703558f1c8 P b698cb024cb44d56915bbf45684e0762 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:05:00.041842 15909 leader_election.cc:290] T aec58ca8ca264a4b9cbcb7703558f1c8 P b698cb024cb44d56915bbf45684e0762 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df6686ba21134096a4687dbfd45aef3e (127.14.180.65:42893), 7e4674b8eef7448588dd0c00bf09499e (127.14.180.67:42215)
I20260709 13:05:00.042670 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aec58ca8ca264a4b9cbcb7703558f1c8" candidate_uuid: "b698cb024cb44d56915bbf45684e0762" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df6686ba21134096a4687dbfd45aef3e" is_pre_election: true
I20260709 13:05:00.043155 15863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aec58ca8ca264a4b9cbcb7703558f1c8" candidate_uuid: "b698cb024cb44d56915bbf45684e0762" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e4674b8eef7448588dd0c00bf09499e" is_pre_election: true
I20260709 13:05:00.043354 15713 raft_consensus.cc:2468] T aec58ca8ca264a4b9cbcb7703558f1c8 P df6686ba21134096a4687dbfd45aef3e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b698cb024cb44d56915bbf45684e0762 in term 0.
I20260709 13:05:00.043676 15863 raft_consensus.cc:2468] T aec58ca8ca264a4b9cbcb7703558f1c8 P 7e4674b8eef7448588dd0c00bf09499e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b698cb024cb44d56915bbf45684e0762 in term 0.
I20260709 13:05:00.044657 15756 leader_election.cc:304] T aec58ca8ca264a4b9cbcb7703558f1c8 P b698cb024cb44d56915bbf45684e0762 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b698cb024cb44d56915bbf45684e0762, df6686ba21134096a4687dbfd45aef3e; no voters: 
I20260709 13:05:00.045495 15909 raft_consensus.cc:2804] T aec58ca8ca264a4b9cbcb7703558f1c8 P b698cb024cb44d56915bbf45684e0762 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:00.045840 15909 raft_consensus.cc:493] T aec58ca8ca264a4b9cbcb7703558f1c8 P b698cb024cb44d56915bbf45684e0762 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:00.046175 15909 raft_consensus.cc:3060] T aec58ca8ca264a4b9cbcb7703558f1c8 P b698cb024cb44d56915bbf45684e0762 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:00.052467 15909 raft_consensus.cc:515] T aec58ca8ca264a4b9cbcb7703558f1c8 P b698cb024cb44d56915bbf45684e0762 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:05:00.054075 15909 leader_election.cc:290] T aec58ca8ca264a4b9cbcb7703558f1c8 P b698cb024cb44d56915bbf45684e0762 [CANDIDATE]: Term 1 election: Requested vote from peers df6686ba21134096a4687dbfd45aef3e (127.14.180.65:42893), 7e4674b8eef7448588dd0c00bf09499e (127.14.180.67:42215)
I20260709 13:05:00.055007 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aec58ca8ca264a4b9cbcb7703558f1c8" candidate_uuid: "b698cb024cb44d56915bbf45684e0762" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df6686ba21134096a4687dbfd45aef3e"
I20260709 13:05:00.055207 15863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aec58ca8ca264a4b9cbcb7703558f1c8" candidate_uuid: "b698cb024cb44d56915bbf45684e0762" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e4674b8eef7448588dd0c00bf09499e"
I20260709 13:05:00.055552 15713 raft_consensus.cc:3060] T aec58ca8ca264a4b9cbcb7703558f1c8 P df6686ba21134096a4687dbfd45aef3e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:00.055809 15863 raft_consensus.cc:3060] T aec58ca8ca264a4b9cbcb7703558f1c8 P 7e4674b8eef7448588dd0c00bf09499e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:00.061147 15713 raft_consensus.cc:2468] T aec58ca8ca264a4b9cbcb7703558f1c8 P df6686ba21134096a4687dbfd45aef3e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b698cb024cb44d56915bbf45684e0762 in term 1.
I20260709 13:05:00.061807 15863 raft_consensus.cc:2468] T aec58ca8ca264a4b9cbcb7703558f1c8 P 7e4674b8eef7448588dd0c00bf09499e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b698cb024cb44d56915bbf45684e0762 in term 1.
I20260709 13:05:00.061934 15960 raft_consensus.cc:493] T 5b842df9396d40b581214a0fa9c33530 P 7e4674b8eef7448588dd0c00bf09499e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:00.062282 15862 raft_consensus.cc:3060] T 4b331a1f307440c987613c4937b9c972 P 7e4674b8eef7448588dd0c00bf09499e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:00.062436 15960 raft_consensus.cc:515] T 5b842df9396d40b581214a0fa9c33530 P 7e4674b8eef7448588dd0c00bf09499e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:05:00.063241 15754 leader_election.cc:304] T aec58ca8ca264a4b9cbcb7703558f1c8 P b698cb024cb44d56915bbf45684e0762 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e4674b8eef7448588dd0c00bf09499e, b698cb024cb44d56915bbf45684e0762; no voters: 
I20260709 13:05:00.064178 15909 raft_consensus.cc:2804] T aec58ca8ca264a4b9cbcb7703558f1c8 P b698cb024cb44d56915bbf45684e0762 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:00.064563 15960 leader_election.cc:290] T 5b842df9396d40b581214a0fa9c33530 P 7e4674b8eef7448588dd0c00bf09499e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df6686ba21134096a4687dbfd45aef3e (127.14.180.65:42893), b698cb024cb44d56915bbf45684e0762 (127.14.180.66:35237)
I20260709 13:05:00.064713 15909 raft_consensus.cc:697] T aec58ca8ca264a4b9cbcb7703558f1c8 P b698cb024cb44d56915bbf45684e0762 [term 1 LEADER]: Becoming Leader. State: Replica: b698cb024cb44d56915bbf45684e0762, State: Running, Role: LEADER
I20260709 13:05:00.065733 15909 consensus_queue.cc:237] T aec58ca8ca264a4b9cbcb7703558f1c8 P b698cb024cb44d56915bbf45684e0762 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:05:00.066720 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b842df9396d40b581214a0fa9c33530" candidate_uuid: "7e4674b8eef7448588dd0c00bf09499e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b698cb024cb44d56915bbf45684e0762" is_pre_election: true
I20260709 13:05:00.066990 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b842df9396d40b581214a0fa9c33530" candidate_uuid: "7e4674b8eef7448588dd0c00bf09499e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df6686ba21134096a4687dbfd45aef3e" is_pre_election: true
I20260709 13:05:00.067796 15713 raft_consensus.cc:2393] T 5b842df9396d40b581214a0fa9c33530 P df6686ba21134096a4687dbfd45aef3e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7e4674b8eef7448588dd0c00bf09499e in current term 1: Already voted for candidate b698cb024cb44d56915bbf45684e0762 in this term.
I20260709 13:05:00.069089 15830 leader_election.cc:304] T 5b842df9396d40b581214a0fa9c33530 P 7e4674b8eef7448588dd0c00bf09499e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e4674b8eef7448588dd0c00bf09499e; no voters: b698cb024cb44d56915bbf45684e0762, df6686ba21134096a4687dbfd45aef3e
I20260709 13:05:00.070182 15960 raft_consensus.cc:3060] T 5b842df9396d40b581214a0fa9c33530 P 7e4674b8eef7448588dd0c00bf09499e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:00.078961 15960 raft_consensus.cc:2749] T 5b842df9396d40b581214a0fa9c33530 P 7e4674b8eef7448588dd0c00bf09499e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:00.081502 15613 catalog_manager.cc:5697] T aec58ca8ca264a4b9cbcb7703558f1c8 P b698cb024cb44d56915bbf45684e0762 reported cstate change: term changed from 0 to 1, leader changed from <none> to b698cb024cb44d56915bbf45684e0762 (127.14.180.66). New cstate: current_term: 1 leader_uuid: "b698cb024cb44d56915bbf45684e0762" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:00.116125 15862 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7ff320c2485644c5914cfbab424cc102"
dest_uuid: "7e4674b8eef7448588dd0c00bf09499e"
mode: GRACEFUL
new_leader_uuid: "df6686ba21134096a4687dbfd45aef3e"
 from {username='slave'} at 127.0.0.1:33204
I20260709 13:05:00.116714 15862 raft_consensus.cc:606] T 7ff320c2485644c5914cfbab424cc102 P 7e4674b8eef7448588dd0c00bf09499e [term 1 LEADER]: Received request to transfer leadership to TS df6686ba21134096a4687dbfd45aef3e
I20260709 13:05:00.130756 15790 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4b331a1f307440c987613c4937b9c972"
dest_uuid: "b698cb024cb44d56915bbf45684e0762"
mode: GRACEFUL
new_leader_uuid: "df6686ba21134096a4687dbfd45aef3e"
 from {username='slave'} at 127.0.0.1:40188
I20260709 13:05:00.131317 15790 raft_consensus.cc:606] T 4b331a1f307440c987613c4937b9c972 P b698cb024cb44d56915bbf45684e0762 [term 1 LEADER]: Received request to transfer leadership to TS df6686ba21134096a4687dbfd45aef3e
I20260709 13:05:00.136780 15790 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "17c5f8247b874e168c1ba313418bb685"
dest_uuid: "b698cb024cb44d56915bbf45684e0762"
mode: GRACEFUL
new_leader_uuid: "df6686ba21134096a4687dbfd45aef3e"
 from {username='slave'} at 127.0.0.1:40188
I20260709 13:05:00.137362 15790 raft_consensus.cc:606] T 17c5f8247b874e168c1ba313418bb685 P b698cb024cb44d56915bbf45684e0762 [term 1 LEADER]: Received request to transfer leadership to TS df6686ba21134096a4687dbfd45aef3e
I20260709 13:05:00.143126 15790 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bcebe4c376a840ec82f61ccc634802bb"
dest_uuid: "b698cb024cb44d56915bbf45684e0762"
mode: GRACEFUL
new_leader_uuid: "df6686ba21134096a4687dbfd45aef3e"
 from {username='slave'} at 127.0.0.1:40188
I20260709 13:05:00.143744 15790 raft_consensus.cc:606] T bcebe4c376a840ec82f61ccc634802bb P b698cb024cb44d56915bbf45684e0762 [term 1 LEADER]: Received request to transfer leadership to TS df6686ba21134096a4687dbfd45aef3e
I20260709 13:05:00.149865 15790 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5b842df9396d40b581214a0fa9c33530"
dest_uuid: "b698cb024cb44d56915bbf45684e0762"
mode: GRACEFUL
new_leader_uuid: "df6686ba21134096a4687dbfd45aef3e"
 from {username='slave'} at 127.0.0.1:40188
I20260709 13:05:00.150866 15790 raft_consensus.cc:606] T 5b842df9396d40b581214a0fa9c33530 P b698cb024cb44d56915bbf45684e0762 [term 1 LEADER]: Received request to transfer leadership to TS df6686ba21134096a4687dbfd45aef3e
I20260709 13:05:00.165524 15909 consensus_queue.cc:1048] T 17c5f8247b874e168c1ba313418bb685 P b698cb024cb44d56915bbf45684e0762 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:00.169813 15713 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "269ab37889604517b35eaed13e3c4fae"
dest_uuid: "df6686ba21134096a4687dbfd45aef3e"
mode: GRACEFUL
new_leader_uuid: "b698cb024cb44d56915bbf45684e0762"
 from {username='slave'} at 127.0.0.1:58490
I20260709 13:05:00.170666 15713 raft_consensus.cc:606] T 269ab37889604517b35eaed13e3c4fae P df6686ba21134096a4687dbfd45aef3e [term 1 LEADER]: Received request to transfer leadership to TS b698cb024cb44d56915bbf45684e0762
I20260709 13:05:00.181468 15909 consensus_queue.cc:1048] T 17c5f8247b874e168c1ba313418bb685 P b698cb024cb44d56915bbf45684e0762 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:00.193109 15928 raft_consensus.cc:993] T 17c5f8247b874e168c1ba313418bb685 P b698cb024cb44d56915bbf45684e0762: : Instructing follower df6686ba21134096a4687dbfd45aef3e to start an election
I20260709 13:05:00.193617 15909 raft_consensus.cc:1081] T 17c5f8247b874e168c1ba313418bb685 P b698cb024cb44d56915bbf45684e0762 [term 1 LEADER]: Signalling peer df6686ba21134096a4687dbfd45aef3e to start an election
I20260709 13:05:00.194665 15713 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a0d24e4aeb604523af8ec351df2618d7"
dest_uuid: "df6686ba21134096a4687dbfd45aef3e"
mode: GRACEFUL
new_leader_uuid: "b698cb024cb44d56915bbf45684e0762"
 from {username='slave'} at 127.0.0.1:58490
I20260709 13:05:00.195420 15715 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "17c5f8247b874e168c1ba313418bb685"
dest_uuid: "df6686ba21134096a4687dbfd45aef3e"
 from {username='slave'} at 127.0.0.1:32784
I20260709 13:05:00.198738 15713 raft_consensus.cc:606] T a0d24e4aeb604523af8ec351df2618d7 P df6686ba21134096a4687dbfd45aef3e [term 1 LEADER]: Received request to transfer leadership to TS b698cb024cb44d56915bbf45684e0762
I20260709 13:05:00.198705 15715 raft_consensus.cc:493] T 17c5f8247b874e168c1ba313418bb685 P df6686ba21134096a4687dbfd45aef3e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:00.199458 15715 raft_consensus.cc:3060] T 17c5f8247b874e168c1ba313418bb685 P df6686ba21134096a4687dbfd45aef3e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:00.205222 15715 raft_consensus.cc:515] T 17c5f8247b874e168c1ba313418bb685 P df6686ba21134096a4687dbfd45aef3e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:05:00.208078 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c5f8247b874e168c1ba313418bb685" candidate_uuid: "df6686ba21134096a4687dbfd45aef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b698cb024cb44d56915bbf45684e0762"
I20260709 13:05:00.208284 15789 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6a089ebf729d4dcabe86cf94fb987006"
dest_uuid: "b698cb024cb44d56915bbf45684e0762"
mode: GRACEFUL
new_leader_uuid: "7e4674b8eef7448588dd0c00bf09499e"
 from {username='slave'} at 127.0.0.1:40188
I20260709 13:05:00.208775 15790 raft_consensus.cc:3055] T 17c5f8247b874e168c1ba313418bb685 P b698cb024cb44d56915bbf45684e0762 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:00.208876 15789 raft_consensus.cc:606] T 6a089ebf729d4dcabe86cf94fb987006 P b698cb024cb44d56915bbf45684e0762 [term 1 LEADER]: Received request to transfer leadership to TS 7e4674b8eef7448588dd0c00bf09499e
I20260709 13:05:00.209213 15790 raft_consensus.cc:740] T 17c5f8247b874e168c1ba313418bb685 P b698cb024cb44d56915bbf45684e0762 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b698cb024cb44d56915bbf45684e0762, State: Running, Role: LEADER
I20260709 13:05:00.210144 15790 consensus_queue.cc:260] T 17c5f8247b874e168c1ba313418bb685 P b698cb024cb44d56915bbf45684e0762 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:05:00.211387 15790 raft_consensus.cc:3060] T 17c5f8247b874e168c1ba313418bb685 P b698cb024cb44d56915bbf45684e0762 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:00.211596 15715 leader_election.cc:290] T 17c5f8247b874e168c1ba313418bb685 P df6686ba21134096a4687dbfd45aef3e [CANDIDATE]: Term 2 election: Requested vote from peers b698cb024cb44d56915bbf45684e0762 (127.14.180.66:35237), 7e4674b8eef7448588dd0c00bf09499e (127.14.180.67:42215)
I20260709 13:05:00.212316 15862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c5f8247b874e168c1ba313418bb685" candidate_uuid: "df6686ba21134096a4687dbfd45aef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7e4674b8eef7448588dd0c00bf09499e"
I20260709 13:05:00.212931 15862 raft_consensus.cc:3060] T 17c5f8247b874e168c1ba313418bb685 P 7e4674b8eef7448588dd0c00bf09499e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:00.219564 15790 raft_consensus.cc:2468] T 17c5f8247b874e168c1ba313418bb685 P b698cb024cb44d56915bbf45684e0762 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df6686ba21134096a4687dbfd45aef3e in term 2.
I20260709 13:05:00.220256 15862 raft_consensus.cc:2468] T 17c5f8247b874e168c1ba313418bb685 P 7e4674b8eef7448588dd0c00bf09499e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df6686ba21134096a4687dbfd45aef3e in term 2.
I20260709 13:05:00.220975 15681 leader_election.cc:304] T 17c5f8247b874e168c1ba313418bb685 P df6686ba21134096a4687dbfd45aef3e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b698cb024cb44d56915bbf45684e0762, df6686ba21134096a4687dbfd45aef3e; no voters: 
I20260709 13:05:00.221850 15910 raft_consensus.cc:2804] T 17c5f8247b874e168c1ba313418bb685 P df6686ba21134096a4687dbfd45aef3e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:00.222352 15910 raft_consensus.cc:697] T 17c5f8247b874e168c1ba313418bb685 P df6686ba21134096a4687dbfd45aef3e [term 2 LEADER]: Becoming Leader. State: Replica: df6686ba21134096a4687dbfd45aef3e, State: Running, Role: LEADER
I20260709 13:05:00.223241 15910 consensus_queue.cc:237] T 17c5f8247b874e168c1ba313418bb685 P df6686ba21134096a4687dbfd45aef3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:05:00.229754 15613 catalog_manager.cc:5697] T 17c5f8247b874e168c1ba313418bb685 P df6686ba21134096a4687dbfd45aef3e reported cstate change: term changed from 1 to 2, leader changed from b698cb024cb44d56915bbf45684e0762 (127.14.180.66) to df6686ba21134096a4687dbfd45aef3e (127.14.180.65). New cstate: current_term: 2 leader_uuid: "df6686ba21134096a4687dbfd45aef3e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:00.311862 15909 consensus_queue.cc:1048] T 5b842df9396d40b581214a0fa9c33530 P b698cb024cb44d56915bbf45684e0762 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:00.319617 15928 raft_consensus.cc:993] T 5b842df9396d40b581214a0fa9c33530 P b698cb024cb44d56915bbf45684e0762: : Instructing follower df6686ba21134096a4687dbfd45aef3e to start an election
I20260709 13:05:00.320158 15925 raft_consensus.cc:1081] T 5b842df9396d40b581214a0fa9c33530 P b698cb024cb44d56915bbf45684e0762 [term 1 LEADER]: Signalling peer df6686ba21134096a4687dbfd45aef3e to start an election
I20260709 13:05:00.322019 15713 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5b842df9396d40b581214a0fa9c33530"
dest_uuid: "df6686ba21134096a4687dbfd45aef3e"
 from {username='slave'} at 127.0.0.1:32784
I20260709 13:05:00.324599 15713 raft_consensus.cc:493] T 5b842df9396d40b581214a0fa9c33530 P df6686ba21134096a4687dbfd45aef3e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:00.325052 15713 raft_consensus.cc:3060] T 5b842df9396d40b581214a0fa9c33530 P df6686ba21134096a4687dbfd45aef3e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:00.326162 15909 consensus_queue.cc:1048] T 5b842df9396d40b581214a0fa9c33530 P b698cb024cb44d56915bbf45684e0762 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:00.332662 15713 raft_consensus.cc:515] T 5b842df9396d40b581214a0fa9c33530 P df6686ba21134096a4687dbfd45aef3e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:05:00.336539 15713 leader_election.cc:290] T 5b842df9396d40b581214a0fa9c33530 P df6686ba21134096a4687dbfd45aef3e [CANDIDATE]: Term 2 election: Requested vote from peers b698cb024cb44d56915bbf45684e0762 (127.14.180.66:35237), 7e4674b8eef7448588dd0c00bf09499e (127.14.180.67:42215)
I20260709 13:05:00.337035 15862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b842df9396d40b581214a0fa9c33530" candidate_uuid: "df6686ba21134096a4687dbfd45aef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7e4674b8eef7448588dd0c00bf09499e"
I20260709 13:05:00.337682 15862 raft_consensus.cc:3060] T 5b842df9396d40b581214a0fa9c33530 P 7e4674b8eef7448588dd0c00bf09499e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:00.335800 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b842df9396d40b581214a0fa9c33530" candidate_uuid: "df6686ba21134096a4687dbfd45aef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b698cb024cb44d56915bbf45684e0762"
I20260709 13:05:00.338222 15790 raft_consensus.cc:3055] T 5b842df9396d40b581214a0fa9c33530 P b698cb024cb44d56915bbf45684e0762 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:00.338598 15790 raft_consensus.cc:740] T 5b842df9396d40b581214a0fa9c33530 P b698cb024cb44d56915bbf45684e0762 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b698cb024cb44d56915bbf45684e0762, State: Running, Role: LEADER
I20260709 13:05:00.339318 15960 consensus_queue.cc:1048] T 7ff320c2485644c5914cfbab424cc102 P 7e4674b8eef7448588dd0c00bf09499e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:00.339685 15790 consensus_queue.cc:260] T 5b842df9396d40b581214a0fa9c33530 P b698cb024cb44d56915bbf45684e0762 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:05:00.341146 15790 raft_consensus.cc:3060] T 5b842df9396d40b581214a0fa9c33530 P b698cb024cb44d56915bbf45684e0762 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:00.349444 15862 raft_consensus.cc:2468] T 5b842df9396d40b581214a0fa9c33530 P 7e4674b8eef7448588dd0c00bf09499e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df6686ba21134096a4687dbfd45aef3e in term 2.
I20260709 13:05:00.350800 15679 leader_election.cc:304] T 5b842df9396d40b581214a0fa9c33530 P df6686ba21134096a4687dbfd45aef3e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e4674b8eef7448588dd0c00bf09499e, df6686ba21134096a4687dbfd45aef3e; no voters: 
I20260709 13:05:00.351287 15790 raft_consensus.cc:2468] T 5b842df9396d40b581214a0fa9c33530 P b698cb024cb44d56915bbf45684e0762 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df6686ba21134096a4687dbfd45aef3e in term 2.
I20260709 13:05:00.351720 15910 raft_consensus.cc:2804] T 5b842df9396d40b581214a0fa9c33530 P df6686ba21134096a4687dbfd45aef3e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:00.352206 15910 raft_consensus.cc:697] T 5b842df9396d40b581214a0fa9c33530 P df6686ba21134096a4687dbfd45aef3e [term 2 LEADER]: Becoming Leader. State: Replica: df6686ba21134096a4687dbfd45aef3e, State: Running, Role: LEADER
I20260709 13:05:00.353035 15910 consensus_queue.cc:237] T 5b842df9396d40b581214a0fa9c33530 P df6686ba21134096a4687dbfd45aef3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:05:00.357404 15960 consensus_queue.cc:1048] T 7ff320c2485644c5914cfbab424cc102 P 7e4674b8eef7448588dd0c00bf09499e [LEADER]: Connected to new peer: Peer: permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:00.368633 15960 raft_consensus.cc:993] T 7ff320c2485644c5914cfbab424cc102 P 7e4674b8eef7448588dd0c00bf09499e: : Instructing follower df6686ba21134096a4687dbfd45aef3e to start an election
I20260709 13:05:00.368811 15928 raft_consensus.cc:993] T bcebe4c376a840ec82f61ccc634802bb P b698cb024cb44d56915bbf45684e0762: : Instructing follower df6686ba21134096a4687dbfd45aef3e to start an election
I20260709 13:05:00.369131 15960 raft_consensus.cc:1081] T 7ff320c2485644c5914cfbab424cc102 P 7e4674b8eef7448588dd0c00bf09499e [term 1 LEADER]: Signalling peer df6686ba21134096a4687dbfd45aef3e to start an election
I20260709 13:05:00.369402 15928 raft_consensus.cc:1081] T bcebe4c376a840ec82f61ccc634802bb P b698cb024cb44d56915bbf45684e0762 [term 1 LEADER]: Signalling peer df6686ba21134096a4687dbfd45aef3e to start an election
I20260709 13:05:00.368912 15612 catalog_manager.cc:5697] T 5b842df9396d40b581214a0fa9c33530 P df6686ba21134096a4687dbfd45aef3e reported cstate change: term changed from 1 to 2, leader changed from b698cb024cb44d56915bbf45684e0762 (127.14.180.66) to df6686ba21134096a4687dbfd45aef3e (127.14.180.65). New cstate: current_term: 2 leader_uuid: "df6686ba21134096a4687dbfd45aef3e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:00.371251 15715 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7ff320c2485644c5914cfbab424cc102"
dest_uuid: "df6686ba21134096a4687dbfd45aef3e"
 from {username='slave'} at 127.0.0.1:32798
I20260709 13:05:00.371873 15715 raft_consensus.cc:493] T 7ff320c2485644c5914cfbab424cc102 P df6686ba21134096a4687dbfd45aef3e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:00.372310 15715 raft_consensus.cc:3060] T 7ff320c2485644c5914cfbab424cc102 P df6686ba21134096a4687dbfd45aef3e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:00.371531 15713 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bcebe4c376a840ec82f61ccc634802bb"
dest_uuid: "df6686ba21134096a4687dbfd45aef3e"
 from {username='slave'} at 127.0.0.1:32784
I20260709 13:05:00.375188 15713 raft_consensus.cc:493] T bcebe4c376a840ec82f61ccc634802bb P df6686ba21134096a4687dbfd45aef3e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:00.375732 15713 raft_consensus.cc:3060] T bcebe4c376a840ec82f61ccc634802bb P df6686ba21134096a4687dbfd45aef3e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:00.379547 15715 raft_consensus.cc:515] T 7ff320c2485644c5914cfbab424cc102 P df6686ba21134096a4687dbfd45aef3e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } }
I20260709 13:05:00.385876 15862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff320c2485644c5914cfbab424cc102" candidate_uuid: "df6686ba21134096a4687dbfd45aef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7e4674b8eef7448588dd0c00bf09499e"
I20260709 13:05:00.386703 15862 raft_consensus.cc:3055] T 7ff320c2485644c5914cfbab424cc102 P 7e4674b8eef7448588dd0c00bf09499e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:00.387161 15862 raft_consensus.cc:740] T 7ff320c2485644c5914cfbab424cc102 P 7e4674b8eef7448588dd0c00bf09499e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7e4674b8eef7448588dd0c00bf09499e, State: Running, Role: LEADER
I20260709 13:05:00.386895 15713 raft_consensus.cc:515] T bcebe4c376a840ec82f61ccc634802bb P df6686ba21134096a4687dbfd45aef3e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:05:00.388306 15909 raft_consensus.cc:993] T 4b331a1f307440c987613c4937b9c972 P b698cb024cb44d56915bbf45684e0762: : Instructing follower df6686ba21134096a4687dbfd45aef3e to start an election
I20260709 13:05:00.388957 15909 raft_consensus.cc:1081] T 4b331a1f307440c987613c4937b9c972 P b698cb024cb44d56915bbf45684e0762 [term 1 LEADER]: Signalling peer df6686ba21134096a4687dbfd45aef3e to start an election
I20260709 13:05:00.389269 15713 leader_election.cc:290] T bcebe4c376a840ec82f61ccc634802bb P df6686ba21134096a4687dbfd45aef3e [CANDIDATE]: Term 2 election: Requested vote from peers b698cb024cb44d56915bbf45684e0762 (127.14.180.66:35237), 7e4674b8eef7448588dd0c00bf09499e (127.14.180.67:42215)
I20260709 13:05:00.388415 15715 leader_election.cc:290] T 7ff320c2485644c5914cfbab424cc102 P df6686ba21134096a4687dbfd45aef3e [CANDIDATE]: Term 2 election: Requested vote from peers 7e4674b8eef7448588dd0c00bf09499e (127.14.180.67:42215), b698cb024cb44d56915bbf45684e0762 (127.14.180.66:35237)
I20260709 13:05:00.388299 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ff320c2485644c5914cfbab424cc102" candidate_uuid: "df6686ba21134096a4687dbfd45aef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b698cb024cb44d56915bbf45684e0762"
I20260709 13:05:00.390337 15862 consensus_queue.cc:260] T 7ff320c2485644c5914cfbab424cc102 P 7e4674b8eef7448588dd0c00bf09499e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } }
I20260709 13:05:00.390741 15863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcebe4c376a840ec82f61ccc634802bb" candidate_uuid: "df6686ba21134096a4687dbfd45aef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7e4674b8eef7448588dd0c00bf09499e"
I20260709 13:05:00.391453 15863 raft_consensus.cc:3060] T bcebe4c376a840ec82f61ccc634802bb P 7e4674b8eef7448588dd0c00bf09499e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:00.391606 15862 raft_consensus.cc:3060] T 7ff320c2485644c5914cfbab424cc102 P 7e4674b8eef7448588dd0c00bf09499e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:00.391714 15790 raft_consensus.cc:3060] T 7ff320c2485644c5914cfbab424cc102 P b698cb024cb44d56915bbf45684e0762 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:00.395078 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcebe4c376a840ec82f61ccc634802bb" candidate_uuid: "df6686ba21134096a4687dbfd45aef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b698cb024cb44d56915bbf45684e0762"
I20260709 13:05:00.395843 15789 raft_consensus.cc:3055] T bcebe4c376a840ec82f61ccc634802bb P b698cb024cb44d56915bbf45684e0762 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:00.396229 15789 raft_consensus.cc:740] T bcebe4c376a840ec82f61ccc634802bb P b698cb024cb44d56915bbf45684e0762 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b698cb024cb44d56915bbf45684e0762, State: Running, Role: LEADER
I20260709 13:05:00.397629 15789 consensus_queue.cc:260] T bcebe4c376a840ec82f61ccc634802bb P b698cb024cb44d56915bbf45684e0762 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:05:00.399017 15789 raft_consensus.cc:3060] T bcebe4c376a840ec82f61ccc634802bb P b698cb024cb44d56915bbf45684e0762 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:00.399654 15715 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4b331a1f307440c987613c4937b9c972"
dest_uuid: "df6686ba21134096a4687dbfd45aef3e"
 from {username='slave'} at 127.0.0.1:32784
I20260709 13:05:00.400149 15862 raft_consensus.cc:2468] T 7ff320c2485644c5914cfbab424cc102 P 7e4674b8eef7448588dd0c00bf09499e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df6686ba21134096a4687dbfd45aef3e in term 2.
I20260709 13:05:00.400466 15715 raft_consensus.cc:493] T 4b331a1f307440c987613c4937b9c972 P df6686ba21134096a4687dbfd45aef3e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:00.401098 15715 raft_consensus.cc:3060] T 4b331a1f307440c987613c4937b9c972 P df6686ba21134096a4687dbfd45aef3e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:00.401844 15679 leader_election.cc:304] T 7ff320c2485644c5914cfbab424cc102 P df6686ba21134096a4687dbfd45aef3e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e4674b8eef7448588dd0c00bf09499e, df6686ba21134096a4687dbfd45aef3e; no voters: 
I20260709 13:05:00.402891 15910 raft_consensus.cc:2804] T 7ff320c2485644c5914cfbab424cc102 P df6686ba21134096a4687dbfd45aef3e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:00.403489 15910 raft_consensus.cc:697] T 7ff320c2485644c5914cfbab424cc102 P df6686ba21134096a4687dbfd45aef3e [term 2 LEADER]: Becoming Leader. State: Replica: df6686ba21134096a4687dbfd45aef3e, State: Running, Role: LEADER
I20260709 13:05:00.404062 15790 raft_consensus.cc:2468] T 7ff320c2485644c5914cfbab424cc102 P b698cb024cb44d56915bbf45684e0762 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df6686ba21134096a4687dbfd45aef3e in term 2.
I20260709 13:05:00.404469 15910 consensus_queue.cc:237] T 7ff320c2485644c5914cfbab424cc102 P df6686ba21134096a4687dbfd45aef3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } }
I20260709 13:05:00.408241 15863 raft_consensus.cc:2468] T bcebe4c376a840ec82f61ccc634802bb P 7e4674b8eef7448588dd0c00bf09499e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df6686ba21134096a4687dbfd45aef3e in term 2.
I20260709 13:05:00.409317 15789 raft_consensus.cc:2468] T bcebe4c376a840ec82f61ccc634802bb P b698cb024cb44d56915bbf45684e0762 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df6686ba21134096a4687dbfd45aef3e in term 2.
I20260709 13:05:00.410012 15679 leader_election.cc:304] T bcebe4c376a840ec82f61ccc634802bb P df6686ba21134096a4687dbfd45aef3e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e4674b8eef7448588dd0c00bf09499e, df6686ba21134096a4687dbfd45aef3e; no voters: 
I20260709 13:05:00.410239 15715 raft_consensus.cc:515] T 4b331a1f307440c987613c4937b9c972 P df6686ba21134096a4687dbfd45aef3e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:05:00.411278 15910 raft_consensus.cc:2804] T bcebe4c376a840ec82f61ccc634802bb P df6686ba21134096a4687dbfd45aef3e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:00.411937 15910 raft_consensus.cc:697] T bcebe4c376a840ec82f61ccc634802bb P df6686ba21134096a4687dbfd45aef3e [term 2 LEADER]: Becoming Leader. State: Replica: df6686ba21134096a4687dbfd45aef3e, State: Running, Role: LEADER
I20260709 13:05:00.412727 15910 consensus_queue.cc:237] T bcebe4c376a840ec82f61ccc634802bb P df6686ba21134096a4687dbfd45aef3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:05:00.414486 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b331a1f307440c987613c4937b9c972" candidate_uuid: "df6686ba21134096a4687dbfd45aef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b698cb024cb44d56915bbf45684e0762"
I20260709 13:05:00.415407 15789 raft_consensus.cc:3055] T 4b331a1f307440c987613c4937b9c972 P b698cb024cb44d56915bbf45684e0762 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:00.415786 15715 leader_election.cc:290] T 4b331a1f307440c987613c4937b9c972 P df6686ba21134096a4687dbfd45aef3e [CANDIDATE]: Term 2 election: Requested vote from peers b698cb024cb44d56915bbf45684e0762 (127.14.180.66:35237), 7e4674b8eef7448588dd0c00bf09499e (127.14.180.67:42215)
I20260709 13:05:00.415937 15789 raft_consensus.cc:740] T 4b331a1f307440c987613c4937b9c972 P b698cb024cb44d56915bbf45684e0762 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b698cb024cb44d56915bbf45684e0762, State: Running, Role: LEADER
I20260709 13:05:00.416031 15612 catalog_manager.cc:5697] T 7ff320c2485644c5914cfbab424cc102 P df6686ba21134096a4687dbfd45aef3e reported cstate change: term changed from 1 to 2, leader changed from 7e4674b8eef7448588dd0c00bf09499e (127.14.180.67) to df6686ba21134096a4687dbfd45aef3e (127.14.180.65). New cstate: current_term: 2 leader_uuid: "df6686ba21134096a4687dbfd45aef3e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:00.417546 15863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b331a1f307440c987613c4937b9c972" candidate_uuid: "df6686ba21134096a4687dbfd45aef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7e4674b8eef7448588dd0c00bf09499e"
I20260709 13:05:00.417286 15789 consensus_queue.cc:260] T 4b331a1f307440c987613c4937b9c972 P b698cb024cb44d56915bbf45684e0762 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:05:00.418134 15863 raft_consensus.cc:3060] T 4b331a1f307440c987613c4937b9c972 P 7e4674b8eef7448588dd0c00bf09499e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:00.418717 15789 raft_consensus.cc:3060] T 4b331a1f307440c987613c4937b9c972 P b698cb024cb44d56915bbf45684e0762 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:00.423398 15863 raft_consensus.cc:2468] T 4b331a1f307440c987613c4937b9c972 P 7e4674b8eef7448588dd0c00bf09499e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df6686ba21134096a4687dbfd45aef3e in term 2.
I20260709 13:05:00.424782 15679 leader_election.cc:304] T 4b331a1f307440c987613c4937b9c972 P df6686ba21134096a4687dbfd45aef3e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e4674b8eef7448588dd0c00bf09499e, df6686ba21134096a4687dbfd45aef3e; no voters: 
I20260709 13:05:00.425688 15910 raft_consensus.cc:2804] T 4b331a1f307440c987613c4937b9c972 P df6686ba21134096a4687dbfd45aef3e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:00.426173 15910 raft_consensus.cc:697] T 4b331a1f307440c987613c4937b9c972 P df6686ba21134096a4687dbfd45aef3e [term 2 LEADER]: Becoming Leader. State: Replica: df6686ba21134096a4687dbfd45aef3e, State: Running, Role: LEADER
I20260709 13:05:00.427120 15910 consensus_queue.cc:237] T 4b331a1f307440c987613c4937b9c972 P df6686ba21134096a4687dbfd45aef3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:05:00.429147 15789 raft_consensus.cc:2468] T 4b331a1f307440c987613c4937b9c972 P b698cb024cb44d56915bbf45684e0762 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df6686ba21134096a4687dbfd45aef3e in term 2.
I20260709 13:05:00.435540 15612 catalog_manager.cc:5697] T bcebe4c376a840ec82f61ccc634802bb P df6686ba21134096a4687dbfd45aef3e reported cstate change: term changed from 1 to 2, leader changed from b698cb024cb44d56915bbf45684e0762 (127.14.180.66) to df6686ba21134096a4687dbfd45aef3e (127.14.180.65). New cstate: current_term: 2 leader_uuid: "df6686ba21134096a4687dbfd45aef3e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:00.436836 15612 catalog_manager.cc:5697] T 4b331a1f307440c987613c4937b9c972 P df6686ba21134096a4687dbfd45aef3e reported cstate change: term changed from 1 to 2, leader changed from b698cb024cb44d56915bbf45684e0762 (127.14.180.66) to df6686ba21134096a4687dbfd45aef3e (127.14.180.65). New cstate: current_term: 2 leader_uuid: "df6686ba21134096a4687dbfd45aef3e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:00.480208 15928 consensus_queue.cc:1048] T aec58ca8ca264a4b9cbcb7703558f1c8 P b698cb024cb44d56915bbf45684e0762 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:00.491988 15909 consensus_queue.cc:1048] T aec58ca8ca264a4b9cbcb7703558f1c8 P b698cb024cb44d56915bbf45684e0762 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:00.499639 15937 raft_consensus.cc:993] T 269ab37889604517b35eaed13e3c4fae P df6686ba21134096a4687dbfd45aef3e: : Instructing follower b698cb024cb44d56915bbf45684e0762 to start an election
I20260709 13:05:00.500171 15937 raft_consensus.cc:1081] T 269ab37889604517b35eaed13e3c4fae P df6686ba21134096a4687dbfd45aef3e [term 1 LEADER]: Signalling peer b698cb024cb44d56915bbf45684e0762 to start an election
I20260709 13:05:00.502071 15789 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "269ab37889604517b35eaed13e3c4fae"
dest_uuid: "b698cb024cb44d56915bbf45684e0762"
 from {username='slave'} at 127.0.0.1:47144
I20260709 13:05:00.502737 15789 raft_consensus.cc:493] T 269ab37889604517b35eaed13e3c4fae P b698cb024cb44d56915bbf45684e0762 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:00.503048 15789 raft_consensus.cc:3060] T 269ab37889604517b35eaed13e3c4fae P b698cb024cb44d56915bbf45684e0762 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:00.509572 15925 raft_consensus.cc:993] T 6a089ebf729d4dcabe86cf94fb987006 P b698cb024cb44d56915bbf45684e0762: : Instructing follower 7e4674b8eef7448588dd0c00bf09499e to start an election
I20260709 13:05:00.510151 15928 raft_consensus.cc:1081] T 6a089ebf729d4dcabe86cf94fb987006 P b698cb024cb44d56915bbf45684e0762 [term 1 LEADER]: Signalling peer 7e4674b8eef7448588dd0c00bf09499e to start an election
I20260709 13:05:00.512517 15864 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6a089ebf729d4dcabe86cf94fb987006"
dest_uuid: "7e4674b8eef7448588dd0c00bf09499e"
 from {username='slave'} at 127.0.0.1:51490
I20260709 13:05:00.513154 15864 raft_consensus.cc:493] T 6a089ebf729d4dcabe86cf94fb987006 P 7e4674b8eef7448588dd0c00bf09499e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:00.512872 15789 raft_consensus.cc:515] T 269ab37889604517b35eaed13e3c4fae P b698cb024cb44d56915bbf45684e0762 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:05:00.513518 15864 raft_consensus.cc:3060] T 6a089ebf729d4dcabe86cf94fb987006 P 7e4674b8eef7448588dd0c00bf09499e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:00.515969 15789 leader_election.cc:290] T 269ab37889604517b35eaed13e3c4fae P b698cb024cb44d56915bbf45684e0762 [CANDIDATE]: Term 2 election: Requested vote from peers df6686ba21134096a4687dbfd45aef3e (127.14.180.65:42893), 7e4674b8eef7448588dd0c00bf09499e (127.14.180.67:42215)
I20260709 13:05:00.516522 15862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "269ab37889604517b35eaed13e3c4fae" candidate_uuid: "b698cb024cb44d56915bbf45684e0762" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7e4674b8eef7448588dd0c00bf09499e"
I20260709 13:05:00.517117 15862 raft_consensus.cc:3060] T 269ab37889604517b35eaed13e3c4fae P 7e4674b8eef7448588dd0c00bf09499e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:00.517788 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "269ab37889604517b35eaed13e3c4fae" candidate_uuid: "b698cb024cb44d56915bbf45684e0762" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "df6686ba21134096a4687dbfd45aef3e"
I20260709 13:05:00.518486 15715 raft_consensus.cc:3055] T 269ab37889604517b35eaed13e3c4fae P df6686ba21134096a4687dbfd45aef3e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:00.518949 15715 raft_consensus.cc:740] T 269ab37889604517b35eaed13e3c4fae P df6686ba21134096a4687dbfd45aef3e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: df6686ba21134096a4687dbfd45aef3e, State: Running, Role: LEADER
I20260709 13:05:00.519964 15715 consensus_queue.cc:260] T 269ab37889604517b35eaed13e3c4fae P df6686ba21134096a4687dbfd45aef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:05:00.521322 15715 raft_consensus.cc:3060] T 269ab37889604517b35eaed13e3c4fae P df6686ba21134096a4687dbfd45aef3e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:00.523196 15864 raft_consensus.cc:515] T 6a089ebf729d4dcabe86cf94fb987006 P 7e4674b8eef7448588dd0c00bf09499e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:05:00.524961 15862 raft_consensus.cc:2468] T 269ab37889604517b35eaed13e3c4fae P 7e4674b8eef7448588dd0c00bf09499e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b698cb024cb44d56915bbf45684e0762 in term 2.
I20260709 13:05:00.525413 15864 leader_election.cc:290] T 6a089ebf729d4dcabe86cf94fb987006 P 7e4674b8eef7448588dd0c00bf09499e [CANDIDATE]: Term 2 election: Requested vote from peers df6686ba21134096a4687dbfd45aef3e (127.14.180.65:42893), b698cb024cb44d56915bbf45684e0762 (127.14.180.66:35237)
I20260709 13:05:00.526579 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a089ebf729d4dcabe86cf94fb987006" candidate_uuid: "7e4674b8eef7448588dd0c00bf09499e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "df6686ba21134096a4687dbfd45aef3e"
I20260709 13:05:00.526742 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a089ebf729d4dcabe86cf94fb987006" candidate_uuid: "7e4674b8eef7448588dd0c00bf09499e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b698cb024cb44d56915bbf45684e0762"
I20260709 13:05:00.527431 15713 raft_consensus.cc:3060] T 6a089ebf729d4dcabe86cf94fb987006 P df6686ba21134096a4687dbfd45aef3e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:00.527490 15789 raft_consensus.cc:3055] T 6a089ebf729d4dcabe86cf94fb987006 P b698cb024cb44d56915bbf45684e0762 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:00.527932 15789 raft_consensus.cc:740] T 6a089ebf729d4dcabe86cf94fb987006 P b698cb024cb44d56915bbf45684e0762 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b698cb024cb44d56915bbf45684e0762, State: Running, Role: LEADER
I20260709 13:05:00.526548 15754 leader_election.cc:304] T 269ab37889604517b35eaed13e3c4fae P b698cb024cb44d56915bbf45684e0762 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e4674b8eef7448588dd0c00bf09499e, b698cb024cb44d56915bbf45684e0762; no voters: 
I20260709 13:05:00.528781 15789 consensus_queue.cc:260] T 6a089ebf729d4dcabe86cf94fb987006 P b698cb024cb44d56915bbf45684e0762 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:05:00.529652 15909 raft_consensus.cc:2804] T 269ab37889604517b35eaed13e3c4fae P b698cb024cb44d56915bbf45684e0762 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:00.530093 15789 raft_consensus.cc:3060] T 6a089ebf729d4dcabe86cf94fb987006 P b698cb024cb44d56915bbf45684e0762 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:00.530167 15909 raft_consensus.cc:697] T 269ab37889604517b35eaed13e3c4fae P b698cb024cb44d56915bbf45684e0762 [term 2 LEADER]: Becoming Leader. State: Replica: b698cb024cb44d56915bbf45684e0762, State: Running, Role: LEADER
I20260709 13:05:00.531242 15909 consensus_queue.cc:237] T 269ab37889604517b35eaed13e3c4fae P b698cb024cb44d56915bbf45684e0762 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:05:00.533731 15715 raft_consensus.cc:2468] T 269ab37889604517b35eaed13e3c4fae P df6686ba21134096a4687dbfd45aef3e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b698cb024cb44d56915bbf45684e0762 in term 2.
I20260709 13:05:00.534397 15713 raft_consensus.cc:2468] T 6a089ebf729d4dcabe86cf94fb987006 P df6686ba21134096a4687dbfd45aef3e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e4674b8eef7448588dd0c00bf09499e in term 2.
I20260709 13:05:00.536152 15830 leader_election.cc:304] T 6a089ebf729d4dcabe86cf94fb987006 P 7e4674b8eef7448588dd0c00bf09499e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e4674b8eef7448588dd0c00bf09499e, df6686ba21134096a4687dbfd45aef3e; no voters: 
I20260709 13:05:00.537071 15989 raft_consensus.cc:2804] T 6a089ebf729d4dcabe86cf94fb987006 P 7e4674b8eef7448588dd0c00bf09499e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:00.537077 15789 raft_consensus.cc:2468] T 6a089ebf729d4dcabe86cf94fb987006 P b698cb024cb44d56915bbf45684e0762 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e4674b8eef7448588dd0c00bf09499e in term 2.
I20260709 13:05:00.537772 15989 raft_consensus.cc:697] T 6a089ebf729d4dcabe86cf94fb987006 P 7e4674b8eef7448588dd0c00bf09499e [term 2 LEADER]: Becoming Leader. State: Replica: 7e4674b8eef7448588dd0c00bf09499e, State: Running, Role: LEADER
I20260709 13:05:00.538733 15989 consensus_queue.cc:237] T 6a089ebf729d4dcabe86cf94fb987006 P 7e4674b8eef7448588dd0c00bf09499e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:05:00.541720 15613 catalog_manager.cc:5697] T 269ab37889604517b35eaed13e3c4fae P b698cb024cb44d56915bbf45684e0762 reported cstate change: term changed from 1 to 2, leader changed from df6686ba21134096a4687dbfd45aef3e (127.14.180.65) to b698cb024cb44d56915bbf45684e0762 (127.14.180.66). New cstate: current_term: 2 leader_uuid: "b698cb024cb44d56915bbf45684e0762" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:00.547250 15937 raft_consensus.cc:993] T a0d24e4aeb604523af8ec351df2618d7 P df6686ba21134096a4687dbfd45aef3e: : Instructing follower b698cb024cb44d56915bbf45684e0762 to start an election
I20260709 13:05:00.547761 15939 raft_consensus.cc:1081] T a0d24e4aeb604523af8ec351df2618d7 P df6686ba21134096a4687dbfd45aef3e [term 1 LEADER]: Signalling peer b698cb024cb44d56915bbf45684e0762 to start an election
I20260709 13:05:00.550673 15789 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a0d24e4aeb604523af8ec351df2618d7"
dest_uuid: "b698cb024cb44d56915bbf45684e0762"
 from {username='slave'} at 127.0.0.1:47144
I20260709 13:05:00.551353 15789 raft_consensus.cc:493] T a0d24e4aeb604523af8ec351df2618d7 P b698cb024cb44d56915bbf45684e0762 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:00.551803 15789 raft_consensus.cc:3060] T a0d24e4aeb604523af8ec351df2618d7 P b698cb024cb44d56915bbf45684e0762 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:00.553751 15612 catalog_manager.cc:5697] T 6a089ebf729d4dcabe86cf94fb987006 P 7e4674b8eef7448588dd0c00bf09499e reported cstate change: term changed from 1 to 2, leader changed from b698cb024cb44d56915bbf45684e0762 (127.14.180.66) to 7e4674b8eef7448588dd0c00bf09499e (127.14.180.67). New cstate: current_term: 2 leader_uuid: "7e4674b8eef7448588dd0c00bf09499e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:00.558001 15789 raft_consensus.cc:515] T a0d24e4aeb604523af8ec351df2618d7 P b698cb024cb44d56915bbf45684e0762 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:05:00.560258 15789 leader_election.cc:290] T a0d24e4aeb604523af8ec351df2618d7 P b698cb024cb44d56915bbf45684e0762 [CANDIDATE]: Term 2 election: Requested vote from peers df6686ba21134096a4687dbfd45aef3e (127.14.180.65:42893), 7e4674b8eef7448588dd0c00bf09499e (127.14.180.67:42215)
I20260709 13:05:00.561391 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d24e4aeb604523af8ec351df2618d7" candidate_uuid: "b698cb024cb44d56915bbf45684e0762" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "df6686ba21134096a4687dbfd45aef3e"
I20260709 13:05:00.561606 15862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0d24e4aeb604523af8ec351df2618d7" candidate_uuid: "b698cb024cb44d56915bbf45684e0762" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7e4674b8eef7448588dd0c00bf09499e"
I20260709 13:05:00.562202 15713 raft_consensus.cc:3055] T a0d24e4aeb604523af8ec351df2618d7 P df6686ba21134096a4687dbfd45aef3e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:00.562278 15862 raft_consensus.cc:3060] T a0d24e4aeb604523af8ec351df2618d7 P 7e4674b8eef7448588dd0c00bf09499e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:00.562783 15713 raft_consensus.cc:740] T a0d24e4aeb604523af8ec351df2618d7 P df6686ba21134096a4687dbfd45aef3e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: df6686ba21134096a4687dbfd45aef3e, State: Running, Role: LEADER
I20260709 13:05:00.563803 15713 consensus_queue.cc:260] T a0d24e4aeb604523af8ec351df2618d7 P df6686ba21134096a4687dbfd45aef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:05:00.564787 15713 raft_consensus.cc:3060] T a0d24e4aeb604523af8ec351df2618d7 P df6686ba21134096a4687dbfd45aef3e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:00.568419 15862 raft_consensus.cc:2468] T a0d24e4aeb604523af8ec351df2618d7 P 7e4674b8eef7448588dd0c00bf09499e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b698cb024cb44d56915bbf45684e0762 in term 2.
I20260709 13:05:00.569628 15754 leader_election.cc:304] T a0d24e4aeb604523af8ec351df2618d7 P b698cb024cb44d56915bbf45684e0762 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e4674b8eef7448588dd0c00bf09499e, b698cb024cb44d56915bbf45684e0762; no voters: 
I20260709 13:05:00.570370 15909 raft_consensus.cc:2804] T a0d24e4aeb604523af8ec351df2618d7 P b698cb024cb44d56915bbf45684e0762 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:00.570462 15713 raft_consensus.cc:2468] T a0d24e4aeb604523af8ec351df2618d7 P df6686ba21134096a4687dbfd45aef3e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b698cb024cb44d56915bbf45684e0762 in term 2.
I20260709 13:05:00.570978 15909 raft_consensus.cc:697] T a0d24e4aeb604523af8ec351df2618d7 P b698cb024cb44d56915bbf45684e0762 [term 2 LEADER]: Becoming Leader. State: Replica: b698cb024cb44d56915bbf45684e0762, State: Running, Role: LEADER
I20260709 13:05:00.571868 15909 consensus_queue.cc:237] T a0d24e4aeb604523af8ec351df2618d7 P b698cb024cb44d56915bbf45684e0762 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:05:00.578142 15612 catalog_manager.cc:5697] T a0d24e4aeb604523af8ec351df2618d7 P b698cb024cb44d56915bbf45684e0762 reported cstate change: term changed from 1 to 2, leader changed from df6686ba21134096a4687dbfd45aef3e (127.14.180.65) to b698cb024cb44d56915bbf45684e0762 (127.14.180.66). New cstate: current_term: 2 leader_uuid: "b698cb024cb44d56915bbf45684e0762" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:00.683962 15862 raft_consensus.cc:1275] T 17c5f8247b874e168c1ba313418bb685 P 7e4674b8eef7448588dd0c00bf09499e [term 2 FOLLOWER]: Refusing update from remote peer df6686ba21134096a4687dbfd45aef3e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:00.685248 15937 consensus_queue.cc:1048] T 17c5f8247b874e168c1ba313418bb685 P df6686ba21134096a4687dbfd45aef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:00.694275 15789 raft_consensus.cc:1275] T 17c5f8247b874e168c1ba313418bb685 P b698cb024cb44d56915bbf45684e0762 [term 2 FOLLOWER]: Refusing update from remote peer df6686ba21134096a4687dbfd45aef3e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:00.696610 15937 consensus_queue.cc:1048] T 17c5f8247b874e168c1ba313418bb685 P df6686ba21134096a4687dbfd45aef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:00.816087 15862 raft_consensus.cc:1275] T 7ff320c2485644c5914cfbab424cc102 P 7e4674b8eef7448588dd0c00bf09499e [term 2 FOLLOWER]: Refusing update from remote peer df6686ba21134096a4687dbfd45aef3e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:00.817457 15937 consensus_queue.cc:1048] T 7ff320c2485644c5914cfbab424cc102 P df6686ba21134096a4687dbfd45aef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:00.823382 15862 raft_consensus.cc:1275] T 4b331a1f307440c987613c4937b9c972 P 7e4674b8eef7448588dd0c00bf09499e [term 2 FOLLOWER]: Refusing update from remote peer df6686ba21134096a4687dbfd45aef3e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:00.825709 15937 consensus_queue.cc:1048] T 4b331a1f307440c987613c4937b9c972 P df6686ba21134096a4687dbfd45aef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:00.826218 15789 raft_consensus.cc:1275] T 7ff320c2485644c5914cfbab424cc102 P b698cb024cb44d56915bbf45684e0762 [term 2 FOLLOWER]: Refusing update from remote peer df6686ba21134096a4687dbfd45aef3e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:00.827760 15910 consensus_queue.cc:1048] T 7ff320c2485644c5914cfbab424cc102 P df6686ba21134096a4687dbfd45aef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:00.838518 15790 raft_consensus.cc:1275] T 4b331a1f307440c987613c4937b9c972 P b698cb024cb44d56915bbf45684e0762 [term 2 FOLLOWER]: Refusing update from remote peer df6686ba21134096a4687dbfd45aef3e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:00.840039 15937 consensus_queue.cc:1048] T 4b331a1f307440c987613c4937b9c972 P df6686ba21134096a4687dbfd45aef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:00.867847 15790 raft_consensus.cc:1275] T 5b842df9396d40b581214a0fa9c33530 P b698cb024cb44d56915bbf45684e0762 [term 2 FOLLOWER]: Refusing update from remote peer df6686ba21134096a4687dbfd45aef3e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:00.869330 15937 consensus_queue.cc:1048] T 5b842df9396d40b581214a0fa9c33530 P df6686ba21134096a4687dbfd45aef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:00.879127 15862 raft_consensus.cc:1275] T 5b842df9396d40b581214a0fa9c33530 P 7e4674b8eef7448588dd0c00bf09499e [term 2 FOLLOWER]: Refusing update from remote peer df6686ba21134096a4687dbfd45aef3e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:00.880983 15937 consensus_queue.cc:1048] T 5b842df9396d40b581214a0fa9c33530 P df6686ba21134096a4687dbfd45aef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:00.910864 15862 raft_consensus.cc:1275] T bcebe4c376a840ec82f61ccc634802bb P 7e4674b8eef7448588dd0c00bf09499e [term 2 FOLLOWER]: Refusing update from remote peer df6686ba21134096a4687dbfd45aef3e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:00.912420 15937 consensus_queue.cc:1048] T bcebe4c376a840ec82f61ccc634802bb P df6686ba21134096a4687dbfd45aef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:00.920506 15790 raft_consensus.cc:1275] T bcebe4c376a840ec82f61ccc634802bb P b698cb024cb44d56915bbf45684e0762 [term 2 FOLLOWER]: Refusing update from remote peer df6686ba21134096a4687dbfd45aef3e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:00.922192 15910 consensus_queue.cc:1048] T bcebe4c376a840ec82f61ccc634802bb P df6686ba21134096a4687dbfd45aef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:00.929332 15789 raft_consensus.cc:1275] T 6a089ebf729d4dcabe86cf94fb987006 P b698cb024cb44d56915bbf45684e0762 [term 2 FOLLOWER]: Refusing update from remote peer 7e4674b8eef7448588dd0c00bf09499e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:00.930707 15960 consensus_queue.cc:1048] T 6a089ebf729d4dcabe86cf94fb987006 P 7e4674b8eef7448588dd0c00bf09499e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:00.941140 15713 raft_consensus.cc:1275] T 6a089ebf729d4dcabe86cf94fb987006 P df6686ba21134096a4687dbfd45aef3e [term 2 FOLLOWER]: Refusing update from remote peer 7e4674b8eef7448588dd0c00bf09499e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:00.942902 15996 consensus_queue.cc:1048] T 6a089ebf729d4dcabe86cf94fb987006 P 7e4674b8eef7448588dd0c00bf09499e [LEADER]: Connected to new peer: Peer: permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:01.038895 15862 raft_consensus.cc:1275] T 269ab37889604517b35eaed13e3c4fae P 7e4674b8eef7448588dd0c00bf09499e [term 2 FOLLOWER]: Refusing update from remote peer b698cb024cb44d56915bbf45684e0762: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:01.040159 15909 consensus_queue.cc:1048] T 269ab37889604517b35eaed13e3c4fae P b698cb024cb44d56915bbf45684e0762 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:01.049279 15713 raft_consensus.cc:1275] T 269ab37889604517b35eaed13e3c4fae P df6686ba21134096a4687dbfd45aef3e [term 2 FOLLOWER]: Refusing update from remote peer b698cb024cb44d56915bbf45684e0762: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:01.051275 15925 consensus_queue.cc:1048] T 269ab37889604517b35eaed13e3c4fae P b698cb024cb44d56915bbf45684e0762 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:01.061414 15862 raft_consensus.cc:1275] T a0d24e4aeb604523af8ec351df2618d7 P 7e4674b8eef7448588dd0c00bf09499e [term 2 FOLLOWER]: Refusing update from remote peer b698cb024cb44d56915bbf45684e0762: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:01.062907 15925 consensus_queue.cc:1048] T a0d24e4aeb604523af8ec351df2618d7 P b698cb024cb44d56915bbf45684e0762 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:01.073177 15713 raft_consensus.cc:1275] T a0d24e4aeb604523af8ec351df2618d7 P df6686ba21134096a4687dbfd45aef3e [term 2 FOLLOWER]: Refusing update from remote peer b698cb024cb44d56915bbf45684e0762: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:01.074815 15925 consensus_queue.cc:1048] T a0d24e4aeb604523af8ec351df2618d7 P b698cb024cb44d56915bbf45684e0762 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:03.251545 15057 auto_leader_rebalancer-test.cc:348] The leader distribution is 
I20260709 13:05:03.252391 15057 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:03.277846 15715 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4b331a1f307440c987613c4937b9c972"
dest_uuid: "df6686ba21134096a4687dbfd45aef3e"
mode: GRACEFUL
new_leader_uuid: "7e4674b8eef7448588dd0c00bf09499e"
 from {username='slave'} at 127.0.0.1:58504
I20260709 13:05:03.278447 15715 raft_consensus.cc:606] T 4b331a1f307440c987613c4937b9c972 P df6686ba21134096a4687dbfd45aef3e [term 2 LEADER]: Received request to transfer leadership to TS 7e4674b8eef7448588dd0c00bf09499e
I20260709 13:05:03.281908 15715 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bcebe4c376a840ec82f61ccc634802bb"
dest_uuid: "df6686ba21134096a4687dbfd45aef3e"
mode: GRACEFUL
new_leader_uuid: "7e4674b8eef7448588dd0c00bf09499e"
 from {username='slave'} at 127.0.0.1:58504
I20260709 13:05:03.282627 15715 raft_consensus.cc:606] T bcebe4c376a840ec82f61ccc634802bb P df6686ba21134096a4687dbfd45aef3e [term 2 LEADER]: Received request to transfer leadership to TS 7e4674b8eef7448588dd0c00bf09499e
I20260709 13:05:03.284195 15057 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:05:03.284932 15057 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:03.288589 16006 raft_consensus.cc:993] T bcebe4c376a840ec82f61ccc634802bb P df6686ba21134096a4687dbfd45aef3e: : Instructing follower 7e4674b8eef7448588dd0c00bf09499e to start an election
I20260709 13:05:03.289124 16007 raft_consensus.cc:1081] T bcebe4c376a840ec82f61ccc634802bb P df6686ba21134096a4687dbfd45aef3e [term 2 LEADER]: Signalling peer 7e4674b8eef7448588dd0c00bf09499e to start an election
I20260709 13:05:03.291323 15862 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bcebe4c376a840ec82f61ccc634802bb"
dest_uuid: "7e4674b8eef7448588dd0c00bf09499e"
 from {username='slave'} at 127.0.0.1:51502
I20260709 13:05:03.291832 15862 raft_consensus.cc:493] T bcebe4c376a840ec82f61ccc634802bb P 7e4674b8eef7448588dd0c00bf09499e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:03.292104 15862 raft_consensus.cc:3060] T bcebe4c376a840ec82f61ccc634802bb P 7e4674b8eef7448588dd0c00bf09499e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:03.296497 15862 raft_consensus.cc:515] T bcebe4c376a840ec82f61ccc634802bb P 7e4674b8eef7448588dd0c00bf09499e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:05:03.298425 15862 leader_election.cc:290] T bcebe4c376a840ec82f61ccc634802bb P 7e4674b8eef7448588dd0c00bf09499e [CANDIDATE]: Term 3 election: Requested vote from peers df6686ba21134096a4687dbfd45aef3e (127.14.180.65:42893), b698cb024cb44d56915bbf45684e0762 (127.14.180.66:35237)
I20260709 13:05:03.299448 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcebe4c376a840ec82f61ccc634802bb" candidate_uuid: "7e4674b8eef7448588dd0c00bf09499e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "df6686ba21134096a4687dbfd45aef3e"
I20260709 13:05:03.299629 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcebe4c376a840ec82f61ccc634802bb" candidate_uuid: "7e4674b8eef7448588dd0c00bf09499e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b698cb024cb44d56915bbf45684e0762"
I20260709 13:05:03.300117 15715 raft_consensus.cc:3055] T bcebe4c376a840ec82f61ccc634802bb P df6686ba21134096a4687dbfd45aef3e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:03.300196 15789 raft_consensus.cc:3060] T bcebe4c376a840ec82f61ccc634802bb P b698cb024cb44d56915bbf45684e0762 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:03.300694 15715 raft_consensus.cc:740] T bcebe4c376a840ec82f61ccc634802bb P df6686ba21134096a4687dbfd45aef3e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: df6686ba21134096a4687dbfd45aef3e, State: Running, Role: LEADER
I20260709 13:05:03.301662 15715 consensus_queue.cc:260] T bcebe4c376a840ec82f61ccc634802bb P df6686ba21134096a4687dbfd45aef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:05:03.302724 15715 raft_consensus.cc:3060] T bcebe4c376a840ec82f61ccc634802bb P df6686ba21134096a4687dbfd45aef3e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:03.308713 15789 raft_consensus.cc:2468] T bcebe4c376a840ec82f61ccc634802bb P b698cb024cb44d56915bbf45684e0762 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e4674b8eef7448588dd0c00bf09499e in term 3.
I20260709 13:05:03.339514 15830 leader_election.cc:304] T bcebe4c376a840ec82f61ccc634802bb P 7e4674b8eef7448588dd0c00bf09499e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e4674b8eef7448588dd0c00bf09499e, b698cb024cb44d56915bbf45684e0762; no voters: 
I20260709 13:05:03.342270 16002 raft_consensus.cc:2804] T bcebe4c376a840ec82f61ccc634802bb P 7e4674b8eef7448588dd0c00bf09499e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:03.349924 15715 raft_consensus.cc:2468] T bcebe4c376a840ec82f61ccc634802bb P df6686ba21134096a4687dbfd45aef3e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e4674b8eef7448588dd0c00bf09499e in term 3.
I20260709 13:05:03.355930 16006 raft_consensus.cc:993] T 4b331a1f307440c987613c4937b9c972 P df6686ba21134096a4687dbfd45aef3e: : Instructing follower 7e4674b8eef7448588dd0c00bf09499e to start an election
I20260709 13:05:03.357203 16007 raft_consensus.cc:1081] T 4b331a1f307440c987613c4937b9c972 P df6686ba21134096a4687dbfd45aef3e [term 2 LEADER]: Signalling peer 7e4674b8eef7448588dd0c00bf09499e to start an election
I20260709 13:05:03.357002 16002 raft_consensus.cc:697] T bcebe4c376a840ec82f61ccc634802bb P 7e4674b8eef7448588dd0c00bf09499e [term 3 LEADER]: Becoming Leader. State: Replica: 7e4674b8eef7448588dd0c00bf09499e, State: Running, Role: LEADER
I20260709 13:05:03.358847 16002 consensus_queue.cc:237] T bcebe4c376a840ec82f61ccc634802bb P 7e4674b8eef7448588dd0c00bf09499e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:05:03.364506 15862 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4b331a1f307440c987613c4937b9c972"
dest_uuid: "7e4674b8eef7448588dd0c00bf09499e"
 from {username='slave'} at 127.0.0.1:51502
I20260709 13:05:03.365541 15862 raft_consensus.cc:493] T 4b331a1f307440c987613c4937b9c972 P 7e4674b8eef7448588dd0c00bf09499e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:03.366091 15862 raft_consensus.cc:3060] T 4b331a1f307440c987613c4937b9c972 P 7e4674b8eef7448588dd0c00bf09499e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:03.375833 15610 catalog_manager.cc:5697] T bcebe4c376a840ec82f61ccc634802bb P 7e4674b8eef7448588dd0c00bf09499e reported cstate change: term changed from 2 to 3, leader changed from df6686ba21134096a4687dbfd45aef3e (127.14.180.65) to 7e4674b8eef7448588dd0c00bf09499e (127.14.180.67). New cstate: current_term: 3 leader_uuid: "7e4674b8eef7448588dd0c00bf09499e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:03.379997 15862 raft_consensus.cc:515] T 4b331a1f307440c987613c4937b9c972 P 7e4674b8eef7448588dd0c00bf09499e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:05:03.382412 15862 leader_election.cc:290] T 4b331a1f307440c987613c4937b9c972 P 7e4674b8eef7448588dd0c00bf09499e [CANDIDATE]: Term 3 election: Requested vote from peers df6686ba21134096a4687dbfd45aef3e (127.14.180.65:42893), b698cb024cb44d56915bbf45684e0762 (127.14.180.66:35237)
I20260709 13:05:03.386166 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b331a1f307440c987613c4937b9c972" candidate_uuid: "7e4674b8eef7448588dd0c00bf09499e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "df6686ba21134096a4687dbfd45aef3e"
I20260709 13:05:03.386261 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b331a1f307440c987613c4937b9c972" candidate_uuid: "7e4674b8eef7448588dd0c00bf09499e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b698cb024cb44d56915bbf45684e0762"
I20260709 13:05:03.387272 15715 raft_consensus.cc:3055] T 4b331a1f307440c987613c4937b9c972 P df6686ba21134096a4687dbfd45aef3e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:03.387584 15789 raft_consensus.cc:3060] T 4b331a1f307440c987613c4937b9c972 P b698cb024cb44d56915bbf45684e0762 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:03.387832 15715 raft_consensus.cc:740] T 4b331a1f307440c987613c4937b9c972 P df6686ba21134096a4687dbfd45aef3e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: df6686ba21134096a4687dbfd45aef3e, State: Running, Role: LEADER
I20260709 13:05:03.389130 15715 consensus_queue.cc:260] T 4b331a1f307440c987613c4937b9c972 P df6686ba21134096a4687dbfd45aef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:05:03.391933 15715 raft_consensus.cc:3060] T 4b331a1f307440c987613c4937b9c972 P df6686ba21134096a4687dbfd45aef3e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:03.399433 15789 raft_consensus.cc:2468] T 4b331a1f307440c987613c4937b9c972 P b698cb024cb44d56915bbf45684e0762 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e4674b8eef7448588dd0c00bf09499e in term 3.
I20260709 13:05:03.401691 15830 leader_election.cc:304] T 4b331a1f307440c987613c4937b9c972 P 7e4674b8eef7448588dd0c00bf09499e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e4674b8eef7448588dd0c00bf09499e, b698cb024cb44d56915bbf45684e0762; no voters: 
I20260709 13:05:03.402817 16002 raft_consensus.cc:2804] T 4b331a1f307440c987613c4937b9c972 P 7e4674b8eef7448588dd0c00bf09499e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:03.403362 16002 raft_consensus.cc:697] T 4b331a1f307440c987613c4937b9c972 P 7e4674b8eef7448588dd0c00bf09499e [term 3 LEADER]: Becoming Leader. State: Replica: 7e4674b8eef7448588dd0c00bf09499e, State: Running, Role: LEADER
I20260709 13:05:03.403934 15715 raft_consensus.cc:2468] T 4b331a1f307440c987613c4937b9c972 P df6686ba21134096a4687dbfd45aef3e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e4674b8eef7448588dd0c00bf09499e in term 3.
I20260709 13:05:03.404801 16002 consensus_queue.cc:237] T 4b331a1f307440c987613c4937b9c972 P 7e4674b8eef7448588dd0c00bf09499e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:05:03.415653 15610 catalog_manager.cc:5697] T 4b331a1f307440c987613c4937b9c972 P 7e4674b8eef7448588dd0c00bf09499e reported cstate change: term changed from 2 to 3, leader changed from df6686ba21134096a4687dbfd45aef3e (127.14.180.65) to 7e4674b8eef7448588dd0c00bf09499e (127.14.180.67). New cstate: current_term: 3 leader_uuid: "7e4674b8eef7448588dd0c00bf09499e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:03.849897 15713 raft_consensus.cc:1275] T 4b331a1f307440c987613c4937b9c972 P df6686ba21134096a4687dbfd45aef3e [term 3 FOLLOWER]: Refusing update from remote peer 7e4674b8eef7448588dd0c00bf09499e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:03.851466 16002 consensus_queue.cc:1048] T 4b331a1f307440c987613c4937b9c972 P 7e4674b8eef7448588dd0c00bf09499e [LEADER]: Connected to new peer: Peer: permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:03.864346 15789 raft_consensus.cc:1275] T 4b331a1f307440c987613c4937b9c972 P b698cb024cb44d56915bbf45684e0762 [term 3 FOLLOWER]: Refusing update from remote peer 7e4674b8eef7448588dd0c00bf09499e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:03.866313 16019 consensus_queue.cc:1048] T 4b331a1f307440c987613c4937b9c972 P 7e4674b8eef7448588dd0c00bf09499e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:03.940858 15713 raft_consensus.cc:1275] T bcebe4c376a840ec82f61ccc634802bb P df6686ba21134096a4687dbfd45aef3e [term 3 FOLLOWER]: Refusing update from remote peer 7e4674b8eef7448588dd0c00bf09499e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:03.942492 16019 consensus_queue.cc:1048] T bcebe4c376a840ec82f61ccc634802bb P 7e4674b8eef7448588dd0c00bf09499e [LEADER]: Connected to new peer: Peer: permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:03.953027 15789 raft_consensus.cc:1275] T bcebe4c376a840ec82f61ccc634802bb P b698cb024cb44d56915bbf45684e0762 [term 3 FOLLOWER]: Refusing update from remote peer 7e4674b8eef7448588dd0c00bf09499e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:03.955168 16002 consensus_queue.cc:1048] T bcebe4c376a840ec82f61ccc634802bb P 7e4674b8eef7448588dd0c00bf09499e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:04.288283 15057 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:04.303372 15862 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4b331a1f307440c987613c4937b9c972"
dest_uuid: "7e4674b8eef7448588dd0c00bf09499e"
mode: GRACEFUL
new_leader_uuid: "df6686ba21134096a4687dbfd45aef3e"
 from {username='slave'} at 127.0.0.1:33204
I20260709 13:05:04.303946 15862 raft_consensus.cc:606] T 4b331a1f307440c987613c4937b9c972 P 7e4674b8eef7448588dd0c00bf09499e [term 3 LEADER]: Received request to transfer leadership to TS df6686ba21134096a4687dbfd45aef3e
I20260709 13:05:04.314214 15862 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bcebe4c376a840ec82f61ccc634802bb"
dest_uuid: "7e4674b8eef7448588dd0c00bf09499e"
mode: GRACEFUL
new_leader_uuid: "df6686ba21134096a4687dbfd45aef3e"
 from {username='slave'} at 127.0.0.1:33204
I20260709 13:05:04.314755 15862 raft_consensus.cc:606] T bcebe4c376a840ec82f61ccc634802bb P 7e4674b8eef7448588dd0c00bf09499e [term 3 LEADER]: Received request to transfer leadership to TS df6686ba21134096a4687dbfd45aef3e
I20260709 13:05:04.324409 15789 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "269ab37889604517b35eaed13e3c4fae"
dest_uuid: "b698cb024cb44d56915bbf45684e0762"
mode: GRACEFUL
new_leader_uuid: "df6686ba21134096a4687dbfd45aef3e"
 from {username='slave'} at 127.0.0.1:40188
I20260709 13:05:04.325029 15789 raft_consensus.cc:606] T 269ab37889604517b35eaed13e3c4fae P b698cb024cb44d56915bbf45684e0762 [term 2 LEADER]: Received request to transfer leadership to TS df6686ba21134096a4687dbfd45aef3e
I20260709 13:05:04.331043 15789 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c1d542ea2766419380191ac2ffcf8e64"
dest_uuid: "b698cb024cb44d56915bbf45684e0762"
mode: GRACEFUL
new_leader_uuid: "df6686ba21134096a4687dbfd45aef3e"
 from {username='slave'} at 127.0.0.1:40188
I20260709 13:05:04.331667 15789 raft_consensus.cc:606] T c1d542ea2766419380191ac2ffcf8e64 P b698cb024cb44d56915bbf45684e0762 [term 1 LEADER]: Received request to transfer leadership to TS df6686ba21134096a4687dbfd45aef3e
I20260709 13:05:04.336508 15928 raft_consensus.cc:993] T c1d542ea2766419380191ac2ffcf8e64 P b698cb024cb44d56915bbf45684e0762: : Instructing follower df6686ba21134096a4687dbfd45aef3e to start an election
I20260709 13:05:04.337074 16026 raft_consensus.cc:1081] T c1d542ea2766419380191ac2ffcf8e64 P b698cb024cb44d56915bbf45684e0762 [term 1 LEADER]: Signalling peer df6686ba21134096a4687dbfd45aef3e to start an election
I20260709 13:05:04.337738 15789 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aec58ca8ca264a4b9cbcb7703558f1c8"
dest_uuid: "b698cb024cb44d56915bbf45684e0762"
mode: GRACEFUL
new_leader_uuid: "df6686ba21134096a4687dbfd45aef3e"
 from {username='slave'} at 127.0.0.1:40188
I20260709 13:05:04.338423 15789 raft_consensus.cc:606] T aec58ca8ca264a4b9cbcb7703558f1c8 P b698cb024cb44d56915bbf45684e0762 [term 1 LEADER]: Received request to transfer leadership to TS df6686ba21134096a4687dbfd45aef3e
I20260709 13:05:04.338819 15713 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c1d542ea2766419380191ac2ffcf8e64"
dest_uuid: "df6686ba21134096a4687dbfd45aef3e"
 from {username='slave'} at 127.0.0.1:32784
I20260709 13:05:04.339394 15713 raft_consensus.cc:493] T c1d542ea2766419380191ac2ffcf8e64 P df6686ba21134096a4687dbfd45aef3e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:04.339840 15713 raft_consensus.cc:3060] T c1d542ea2766419380191ac2ffcf8e64 P df6686ba21134096a4687dbfd45aef3e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:04.345800 15713 raft_consensus.cc:515] T c1d542ea2766419380191ac2ffcf8e64 P df6686ba21134096a4687dbfd45aef3e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:05:04.347779 15713 leader_election.cc:290] T c1d542ea2766419380191ac2ffcf8e64 P df6686ba21134096a4687dbfd45aef3e [CANDIDATE]: Term 2 election: Requested vote from peers b698cb024cb44d56915bbf45684e0762 (127.14.180.66:35237), 7e4674b8eef7448588dd0c00bf09499e (127.14.180.67:42215)
I20260709 13:05:04.348944 15862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d542ea2766419380191ac2ffcf8e64" candidate_uuid: "df6686ba21134096a4687dbfd45aef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7e4674b8eef7448588dd0c00bf09499e"
I20260709 13:05:04.348866 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1d542ea2766419380191ac2ffcf8e64" candidate_uuid: "df6686ba21134096a4687dbfd45aef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b698cb024cb44d56915bbf45684e0762"
I20260709 13:05:04.349635 15862 raft_consensus.cc:3060] T c1d542ea2766419380191ac2ffcf8e64 P 7e4674b8eef7448588dd0c00bf09499e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:04.349764 15789 raft_consensus.cc:3055] T c1d542ea2766419380191ac2ffcf8e64 P b698cb024cb44d56915bbf45684e0762 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:04.350167 15789 raft_consensus.cc:740] T c1d542ea2766419380191ac2ffcf8e64 P b698cb024cb44d56915bbf45684e0762 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b698cb024cb44d56915bbf45684e0762, State: Running, Role: LEADER
I20260709 13:05:04.351143 15789 consensus_queue.cc:260] T c1d542ea2766419380191ac2ffcf8e64 P b698cb024cb44d56915bbf45684e0762 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:05:04.352147 15789 raft_consensus.cc:3060] T c1d542ea2766419380191ac2ffcf8e64 P b698cb024cb44d56915bbf45684e0762 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:04.355243 15862 raft_consensus.cc:2468] T c1d542ea2766419380191ac2ffcf8e64 P 7e4674b8eef7448588dd0c00bf09499e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df6686ba21134096a4687dbfd45aef3e in term 2.
I20260709 13:05:04.356560 15679 leader_election.cc:304] T c1d542ea2766419380191ac2ffcf8e64 P df6686ba21134096a4687dbfd45aef3e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e4674b8eef7448588dd0c00bf09499e, df6686ba21134096a4687dbfd45aef3e; no voters: 
I20260709 13:05:04.357324 16007 raft_consensus.cc:2804] T c1d542ea2766419380191ac2ffcf8e64 P df6686ba21134096a4687dbfd45aef3e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:04.357769 16007 raft_consensus.cc:697] T c1d542ea2766419380191ac2ffcf8e64 P df6686ba21134096a4687dbfd45aef3e [term 2 LEADER]: Becoming Leader. State: Replica: df6686ba21134096a4687dbfd45aef3e, State: Running, Role: LEADER
I20260709 13:05:04.357996 15789 raft_consensus.cc:2468] T c1d542ea2766419380191ac2ffcf8e64 P b698cb024cb44d56915bbf45684e0762 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df6686ba21134096a4687dbfd45aef3e in term 2.
I20260709 13:05:04.358752 16007 consensus_queue.cc:237] T c1d542ea2766419380191ac2ffcf8e64 P df6686ba21134096a4687dbfd45aef3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:05:04.366357 15610 catalog_manager.cc:5697] T c1d542ea2766419380191ac2ffcf8e64 P df6686ba21134096a4687dbfd45aef3e reported cstate change: term changed from 1 to 2, leader changed from b698cb024cb44d56915bbf45684e0762 (127.14.180.66) to df6686ba21134096a4687dbfd45aef3e (127.14.180.65). New cstate: current_term: 2 leader_uuid: "df6686ba21134096a4687dbfd45aef3e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:04.419698 16019 raft_consensus.cc:993] T 4b331a1f307440c987613c4937b9c972 P 7e4674b8eef7448588dd0c00bf09499e: : Instructing follower df6686ba21134096a4687dbfd45aef3e to start an election
I20260709 13:05:04.420673 16019 raft_consensus.cc:1081] T 4b331a1f307440c987613c4937b9c972 P 7e4674b8eef7448588dd0c00bf09499e [term 3 LEADER]: Signalling peer df6686ba21134096a4687dbfd45aef3e to start an election
I20260709 13:05:04.422478 15713 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4b331a1f307440c987613c4937b9c972"
dest_uuid: "df6686ba21134096a4687dbfd45aef3e"
 from {username='slave'} at 127.0.0.1:32798
I20260709 13:05:04.423101 15713 raft_consensus.cc:493] T 4b331a1f307440c987613c4937b9c972 P df6686ba21134096a4687dbfd45aef3e [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:04.423532 15713 raft_consensus.cc:3060] T 4b331a1f307440c987613c4937b9c972 P df6686ba21134096a4687dbfd45aef3e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:04.430677 15713 raft_consensus.cc:515] T 4b331a1f307440c987613c4937b9c972 P df6686ba21134096a4687dbfd45aef3e [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:05:04.432790 15713 leader_election.cc:290] T 4b331a1f307440c987613c4937b9c972 P df6686ba21134096a4687dbfd45aef3e [CANDIDATE]: Term 4 election: Requested vote from peers b698cb024cb44d56915bbf45684e0762 (127.14.180.66:35237), 7e4674b8eef7448588dd0c00bf09499e (127.14.180.67:42215)
I20260709 13:05:04.433946 15862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b331a1f307440c987613c4937b9c972" candidate_uuid: "df6686ba21134096a4687dbfd45aef3e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "7e4674b8eef7448588dd0c00bf09499e"
I20260709 13:05:04.433965 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b331a1f307440c987613c4937b9c972" candidate_uuid: "df6686ba21134096a4687dbfd45aef3e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b698cb024cb44d56915bbf45684e0762"
I20260709 13:05:04.434626 15862 raft_consensus.cc:3055] T 4b331a1f307440c987613c4937b9c972 P 7e4674b8eef7448588dd0c00bf09499e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:04.434717 15789 raft_consensus.cc:3060] T 4b331a1f307440c987613c4937b9c972 P b698cb024cb44d56915bbf45684e0762 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:04.434916 15862 raft_consensus.cc:740] T 4b331a1f307440c987613c4937b9c972 P 7e4674b8eef7448588dd0c00bf09499e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7e4674b8eef7448588dd0c00bf09499e, State: Running, Role: LEADER
I20260709 13:05:04.436203 15862 consensus_queue.cc:260] T 4b331a1f307440c987613c4937b9c972 P 7e4674b8eef7448588dd0c00bf09499e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:05:04.437198 15862 raft_consensus.cc:3060] T 4b331a1f307440c987613c4937b9c972 P 7e4674b8eef7448588dd0c00bf09499e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:04.442309 15862 raft_consensus.cc:2468] T 4b331a1f307440c987613c4937b9c972 P 7e4674b8eef7448588dd0c00bf09499e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df6686ba21134096a4687dbfd45aef3e in term 4.
I20260709 13:05:04.442821 15789 raft_consensus.cc:2468] T 4b331a1f307440c987613c4937b9c972 P b698cb024cb44d56915bbf45684e0762 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df6686ba21134096a4687dbfd45aef3e in term 4.
I20260709 13:05:04.443509 15679 leader_election.cc:304] T 4b331a1f307440c987613c4937b9c972 P df6686ba21134096a4687dbfd45aef3e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e4674b8eef7448588dd0c00bf09499e, df6686ba21134096a4687dbfd45aef3e; no voters: 
I20260709 13:05:04.444247 16007 raft_consensus.cc:2804] T 4b331a1f307440c987613c4937b9c972 P df6686ba21134096a4687dbfd45aef3e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:04.444690 16007 raft_consensus.cc:697] T 4b331a1f307440c987613c4937b9c972 P df6686ba21134096a4687dbfd45aef3e [term 4 LEADER]: Becoming Leader. State: Replica: df6686ba21134096a4687dbfd45aef3e, State: Running, Role: LEADER
I20260709 13:05:04.445369 16007 consensus_queue.cc:237] T 4b331a1f307440c987613c4937b9c972 P df6686ba21134096a4687dbfd45aef3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:05:04.454425 16009 raft_consensus.cc:993] T bcebe4c376a840ec82f61ccc634802bb P 7e4674b8eef7448588dd0c00bf09499e: : Instructing follower df6686ba21134096a4687dbfd45aef3e to start an election
I20260709 13:05:04.453753 15610 catalog_manager.cc:5697] T 4b331a1f307440c987613c4937b9c972 P df6686ba21134096a4687dbfd45aef3e reported cstate change: term changed from 3 to 4, leader changed from 7e4674b8eef7448588dd0c00bf09499e (127.14.180.67) to df6686ba21134096a4687dbfd45aef3e (127.14.180.65). New cstate: current_term: 4 leader_uuid: "df6686ba21134096a4687dbfd45aef3e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:04.455020 16019 raft_consensus.cc:1081] T bcebe4c376a840ec82f61ccc634802bb P 7e4674b8eef7448588dd0c00bf09499e [term 3 LEADER]: Signalling peer df6686ba21134096a4687dbfd45aef3e to start an election
I20260709 13:05:04.456939 15713 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bcebe4c376a840ec82f61ccc634802bb"
dest_uuid: "df6686ba21134096a4687dbfd45aef3e"
 from {username='slave'} at 127.0.0.1:32798
I20260709 13:05:04.457449 15713 raft_consensus.cc:493] T bcebe4c376a840ec82f61ccc634802bb P df6686ba21134096a4687dbfd45aef3e [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:04.457764 15713 raft_consensus.cc:3060] T bcebe4c376a840ec82f61ccc634802bb P df6686ba21134096a4687dbfd45aef3e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:04.464504 15713 raft_consensus.cc:515] T bcebe4c376a840ec82f61ccc634802bb P df6686ba21134096a4687dbfd45aef3e [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:05:04.466210 15713 leader_election.cc:290] T bcebe4c376a840ec82f61ccc634802bb P df6686ba21134096a4687dbfd45aef3e [CANDIDATE]: Term 4 election: Requested vote from peers b698cb024cb44d56915bbf45684e0762 (127.14.180.66:35237), 7e4674b8eef7448588dd0c00bf09499e (127.14.180.67:42215)
I20260709 13:05:04.467126 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcebe4c376a840ec82f61ccc634802bb" candidate_uuid: "df6686ba21134096a4687dbfd45aef3e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b698cb024cb44d56915bbf45684e0762"
I20260709 13:05:04.467317 15862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcebe4c376a840ec82f61ccc634802bb" candidate_uuid: "df6686ba21134096a4687dbfd45aef3e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "7e4674b8eef7448588dd0c00bf09499e"
I20260709 13:05:04.467916 15862 raft_consensus.cc:3055] T bcebe4c376a840ec82f61ccc634802bb P 7e4674b8eef7448588dd0c00bf09499e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:04.467622 15789 raft_consensus.cc:3060] T bcebe4c376a840ec82f61ccc634802bb P b698cb024cb44d56915bbf45684e0762 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:04.468240 15862 raft_consensus.cc:740] T bcebe4c376a840ec82f61ccc634802bb P 7e4674b8eef7448588dd0c00bf09499e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7e4674b8eef7448588dd0c00bf09499e, State: Running, Role: LEADER
I20260709 13:05:04.469070 15862 consensus_queue.cc:260] T bcebe4c376a840ec82f61ccc634802bb P 7e4674b8eef7448588dd0c00bf09499e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:05:04.470052 15862 raft_consensus.cc:3060] T bcebe4c376a840ec82f61ccc634802bb P 7e4674b8eef7448588dd0c00bf09499e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:04.473073 15789 raft_consensus.cc:2468] T bcebe4c376a840ec82f61ccc634802bb P b698cb024cb44d56915bbf45684e0762 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df6686ba21134096a4687dbfd45aef3e in term 4.
I20260709 13:05:04.474571 15681 leader_election.cc:304] T bcebe4c376a840ec82f61ccc634802bb P df6686ba21134096a4687dbfd45aef3e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b698cb024cb44d56915bbf45684e0762, df6686ba21134096a4687dbfd45aef3e; no voters: 
I20260709 13:05:04.475245 15862 raft_consensus.cc:2468] T bcebe4c376a840ec82f61ccc634802bb P 7e4674b8eef7448588dd0c00bf09499e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df6686ba21134096a4687dbfd45aef3e in term 4.
I20260709 13:05:04.475769 16007 raft_consensus.cc:2804] T bcebe4c376a840ec82f61ccc634802bb P df6686ba21134096a4687dbfd45aef3e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:04.476478 16007 raft_consensus.cc:697] T bcebe4c376a840ec82f61ccc634802bb P df6686ba21134096a4687dbfd45aef3e [term 4 LEADER]: Becoming Leader. State: Replica: df6686ba21134096a4687dbfd45aef3e, State: Running, Role: LEADER
I20260709 13:05:04.477314 16007 consensus_queue.cc:237] T bcebe4c376a840ec82f61ccc634802bb P df6686ba21134096a4687dbfd45aef3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:05:04.484210 15610 catalog_manager.cc:5697] T bcebe4c376a840ec82f61ccc634802bb P df6686ba21134096a4687dbfd45aef3e reported cstate change: term changed from 3 to 4, leader changed from 7e4674b8eef7448588dd0c00bf09499e (127.14.180.67) to df6686ba21134096a4687dbfd45aef3e (127.14.180.65). New cstate: current_term: 4 leader_uuid: "df6686ba21134096a4687dbfd45aef3e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:04.562268 15928 raft_consensus.cc:993] T aec58ca8ca264a4b9cbcb7703558f1c8 P b698cb024cb44d56915bbf45684e0762: : Instructing follower df6686ba21134096a4687dbfd45aef3e to start an election
I20260709 13:05:04.562853 16026 raft_consensus.cc:1081] T aec58ca8ca264a4b9cbcb7703558f1c8 P b698cb024cb44d56915bbf45684e0762 [term 1 LEADER]: Signalling peer df6686ba21134096a4687dbfd45aef3e to start an election
I20260709 13:05:04.564502 15713 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aec58ca8ca264a4b9cbcb7703558f1c8"
dest_uuid: "df6686ba21134096a4687dbfd45aef3e"
 from {username='slave'} at 127.0.0.1:32784
I20260709 13:05:04.565094 15713 raft_consensus.cc:493] T aec58ca8ca264a4b9cbcb7703558f1c8 P df6686ba21134096a4687dbfd45aef3e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:04.565469 15713 raft_consensus.cc:3060] T aec58ca8ca264a4b9cbcb7703558f1c8 P df6686ba21134096a4687dbfd45aef3e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:04.571666 15713 raft_consensus.cc:515] T aec58ca8ca264a4b9cbcb7703558f1c8 P df6686ba21134096a4687dbfd45aef3e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:05:04.574095 15713 leader_election.cc:290] T aec58ca8ca264a4b9cbcb7703558f1c8 P df6686ba21134096a4687dbfd45aef3e [CANDIDATE]: Term 2 election: Requested vote from peers b698cb024cb44d56915bbf45684e0762 (127.14.180.66:35237), 7e4674b8eef7448588dd0c00bf09499e (127.14.180.67:42215)
I20260709 13:05:04.575253 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aec58ca8ca264a4b9cbcb7703558f1c8" candidate_uuid: "df6686ba21134096a4687dbfd45aef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b698cb024cb44d56915bbf45684e0762"
I20260709 13:05:04.575201 15862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aec58ca8ca264a4b9cbcb7703558f1c8" candidate_uuid: "df6686ba21134096a4687dbfd45aef3e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7e4674b8eef7448588dd0c00bf09499e"
I20260709 13:05:04.576072 15862 raft_consensus.cc:3060] T aec58ca8ca264a4b9cbcb7703558f1c8 P 7e4674b8eef7448588dd0c00bf09499e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:04.576022 15789 raft_consensus.cc:3055] T aec58ca8ca264a4b9cbcb7703558f1c8 P b698cb024cb44d56915bbf45684e0762 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:04.576812 15789 raft_consensus.cc:740] T aec58ca8ca264a4b9cbcb7703558f1c8 P b698cb024cb44d56915bbf45684e0762 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b698cb024cb44d56915bbf45684e0762, State: Running, Role: LEADER
I20260709 13:05:04.577446 15928 raft_consensus.cc:993] T 269ab37889604517b35eaed13e3c4fae P b698cb024cb44d56915bbf45684e0762: : Instructing follower df6686ba21134096a4687dbfd45aef3e to start an election
I20260709 13:05:04.577920 16026 raft_consensus.cc:1081] T 269ab37889604517b35eaed13e3c4fae P b698cb024cb44d56915bbf45684e0762 [term 2 LEADER]: Signalling peer df6686ba21134096a4687dbfd45aef3e to start an election
I20260709 13:05:04.577701 15789 consensus_queue.cc:260] T aec58ca8ca264a4b9cbcb7703558f1c8 P b698cb024cb44d56915bbf45684e0762 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:05:04.579049 15789 raft_consensus.cc:3060] T aec58ca8ca264a4b9cbcb7703558f1c8 P b698cb024cb44d56915bbf45684e0762 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:04.580427 15713 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "269ab37889604517b35eaed13e3c4fae"
dest_uuid: "df6686ba21134096a4687dbfd45aef3e"
 from {username='slave'} at 127.0.0.1:32784
I20260709 13:05:04.580926 15713 raft_consensus.cc:493] T 269ab37889604517b35eaed13e3c4fae P df6686ba21134096a4687dbfd45aef3e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:04.581229 15713 raft_consensus.cc:3060] T 269ab37889604517b35eaed13e3c4fae P df6686ba21134096a4687dbfd45aef3e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:04.584089 15862 raft_consensus.cc:2468] T aec58ca8ca264a4b9cbcb7703558f1c8 P 7e4674b8eef7448588dd0c00bf09499e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df6686ba21134096a4687dbfd45aef3e in term 2.
I20260709 13:05:04.585767 15679 leader_election.cc:304] T aec58ca8ca264a4b9cbcb7703558f1c8 P df6686ba21134096a4687dbfd45aef3e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e4674b8eef7448588dd0c00bf09499e, df6686ba21134096a4687dbfd45aef3e; no voters: 
I20260709 13:05:04.585824 15713 raft_consensus.cc:515] T 269ab37889604517b35eaed13e3c4fae P df6686ba21134096a4687dbfd45aef3e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:05:04.586081 15789 raft_consensus.cc:2468] T aec58ca8ca264a4b9cbcb7703558f1c8 P b698cb024cb44d56915bbf45684e0762 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df6686ba21134096a4687dbfd45aef3e in term 2.
I20260709 13:05:04.587987 16025 raft_consensus.cc:2804] T aec58ca8ca264a4b9cbcb7703558f1c8 P df6686ba21134096a4687dbfd45aef3e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:04.588052 15713 leader_election.cc:290] T 269ab37889604517b35eaed13e3c4fae P df6686ba21134096a4687dbfd45aef3e [CANDIDATE]: Term 3 election: Requested vote from peers b698cb024cb44d56915bbf45684e0762 (127.14.180.66:35237), 7e4674b8eef7448588dd0c00bf09499e (127.14.180.67:42215)
I20260709 13:05:04.588975 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "269ab37889604517b35eaed13e3c4fae" candidate_uuid: "df6686ba21134096a4687dbfd45aef3e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b698cb024cb44d56915bbf45684e0762"
I20260709 13:05:04.589156 15862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "269ab37889604517b35eaed13e3c4fae" candidate_uuid: "df6686ba21134096a4687dbfd45aef3e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7e4674b8eef7448588dd0c00bf09499e"
I20260709 13:05:04.589664 15789 raft_consensus.cc:3055] T 269ab37889604517b35eaed13e3c4fae P b698cb024cb44d56915bbf45684e0762 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:04.590034 15789 raft_consensus.cc:740] T 269ab37889604517b35eaed13e3c4fae P b698cb024cb44d56915bbf45684e0762 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b698cb024cb44d56915bbf45684e0762, State: Running, Role: LEADER
I20260709 13:05:04.589840 15862 raft_consensus.cc:3060] T 269ab37889604517b35eaed13e3c4fae P 7e4674b8eef7448588dd0c00bf09499e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:04.592953 15789 consensus_queue.cc:260] T 269ab37889604517b35eaed13e3c4fae P b698cb024cb44d56915bbf45684e0762 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:05:04.594700 15789 raft_consensus.cc:3060] T 269ab37889604517b35eaed13e3c4fae P b698cb024cb44d56915bbf45684e0762 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:04.595091 16025 raft_consensus.cc:697] T aec58ca8ca264a4b9cbcb7703558f1c8 P df6686ba21134096a4687dbfd45aef3e [term 2 LEADER]: Becoming Leader. State: Replica: df6686ba21134096a4687dbfd45aef3e, State: Running, Role: LEADER
I20260709 13:05:04.596024 16025 consensus_queue.cc:237] T aec58ca8ca264a4b9cbcb7703558f1c8 P df6686ba21134096a4687dbfd45aef3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:05:04.596627 15862 raft_consensus.cc:2468] T 269ab37889604517b35eaed13e3c4fae P 7e4674b8eef7448588dd0c00bf09499e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df6686ba21134096a4687dbfd45aef3e in term 3.
I20260709 13:05:04.598124 15679 leader_election.cc:304] T 269ab37889604517b35eaed13e3c4fae P df6686ba21134096a4687dbfd45aef3e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e4674b8eef7448588dd0c00bf09499e, df6686ba21134096a4687dbfd45aef3e; no voters: 
I20260709 13:05:04.599165 16031 raft_consensus.cc:2804] T 269ab37889604517b35eaed13e3c4fae P df6686ba21134096a4687dbfd45aef3e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:04.599658 16031 raft_consensus.cc:697] T 269ab37889604517b35eaed13e3c4fae P df6686ba21134096a4687dbfd45aef3e [term 3 LEADER]: Becoming Leader. State: Replica: df6686ba21134096a4687dbfd45aef3e, State: Running, Role: LEADER
I20260709 13:05:04.600587 16031 consensus_queue.cc:237] T 269ab37889604517b35eaed13e3c4fae P df6686ba21134096a4687dbfd45aef3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:05:04.603332 15789 raft_consensus.cc:2468] T 269ab37889604517b35eaed13e3c4fae P b698cb024cb44d56915bbf45684e0762 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df6686ba21134096a4687dbfd45aef3e in term 3.
I20260709 13:05:04.609282 15610 catalog_manager.cc:5697] T aec58ca8ca264a4b9cbcb7703558f1c8 P df6686ba21134096a4687dbfd45aef3e reported cstate change: term changed from 1 to 2, leader changed from b698cb024cb44d56915bbf45684e0762 (127.14.180.66) to df6686ba21134096a4687dbfd45aef3e (127.14.180.65). New cstate: current_term: 2 leader_uuid: "df6686ba21134096a4687dbfd45aef3e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:04.621977 15610 catalog_manager.cc:5697] T 269ab37889604517b35eaed13e3c4fae P df6686ba21134096a4687dbfd45aef3e reported cstate change: term changed from 2 to 3, leader changed from b698cb024cb44d56915bbf45684e0762 (127.14.180.66) to df6686ba21134096a4687dbfd45aef3e (127.14.180.65). New cstate: current_term: 3 leader_uuid: "df6686ba21134096a4687dbfd45aef3e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:04.767011 15789 raft_consensus.cc:1275] T c1d542ea2766419380191ac2ffcf8e64 P b698cb024cb44d56915bbf45684e0762 [term 2 FOLLOWER]: Refusing update from remote peer df6686ba21134096a4687dbfd45aef3e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:04.768599 16031 consensus_queue.cc:1048] T c1d542ea2766419380191ac2ffcf8e64 P df6686ba21134096a4687dbfd45aef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:04.780133 15862 raft_consensus.cc:1275] T c1d542ea2766419380191ac2ffcf8e64 P 7e4674b8eef7448588dd0c00bf09499e [term 2 FOLLOWER]: Refusing update from remote peer df6686ba21134096a4687dbfd45aef3e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:04.781471 16025 consensus_queue.cc:1048] T c1d542ea2766419380191ac2ffcf8e64 P df6686ba21134096a4687dbfd45aef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:04.874424 15862 raft_consensus.cc:1275] T bcebe4c376a840ec82f61ccc634802bb P 7e4674b8eef7448588dd0c00bf09499e [term 4 FOLLOWER]: Refusing update from remote peer df6686ba21134096a4687dbfd45aef3e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:04.876241 16031 consensus_queue.cc:1048] T bcebe4c376a840ec82f61ccc634802bb P df6686ba21134096a4687dbfd45aef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:04.885478 15789 raft_consensus.cc:1275] T bcebe4c376a840ec82f61ccc634802bb P b698cb024cb44d56915bbf45684e0762 [term 4 FOLLOWER]: Refusing update from remote peer df6686ba21134096a4687dbfd45aef3e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:04.887228 16007 consensus_queue.cc:1048] T bcebe4c376a840ec82f61ccc634802bb P df6686ba21134096a4687dbfd45aef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:05.015833 15862 raft_consensus.cc:1275] T aec58ca8ca264a4b9cbcb7703558f1c8 P 7e4674b8eef7448588dd0c00bf09499e [term 2 FOLLOWER]: Refusing update from remote peer df6686ba21134096a4687dbfd45aef3e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:05.017315 16007 consensus_queue.cc:1048] T aec58ca8ca264a4b9cbcb7703558f1c8 P df6686ba21134096a4687dbfd45aef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:05.023947 15789 raft_consensus.cc:1275] T 4b331a1f307440c987613c4937b9c972 P b698cb024cb44d56915bbf45684e0762 [term 4 FOLLOWER]: Refusing update from remote peer df6686ba21134096a4687dbfd45aef3e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:05.025679 16031 consensus_queue.cc:1048] T 4b331a1f307440c987613c4937b9c972 P df6686ba21134096a4687dbfd45aef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:05.030588 15790 raft_consensus.cc:1275] T aec58ca8ca264a4b9cbcb7703558f1c8 P b698cb024cb44d56915bbf45684e0762 [term 2 FOLLOWER]: Refusing update from remote peer df6686ba21134096a4687dbfd45aef3e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:05.032550 16031 consensus_queue.cc:1048] T aec58ca8ca264a4b9cbcb7703558f1c8 P df6686ba21134096a4687dbfd45aef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:05.046360 15862 raft_consensus.cc:1275] T 4b331a1f307440c987613c4937b9c972 P 7e4674b8eef7448588dd0c00bf09499e [term 4 FOLLOWER]: Refusing update from remote peer df6686ba21134096a4687dbfd45aef3e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:05.048051 16025 consensus_queue.cc:1048] T 4b331a1f307440c987613c4937b9c972 P df6686ba21134096a4687dbfd45aef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:05.070077 15789 raft_consensus.cc:1275] T 269ab37889604517b35eaed13e3c4fae P b698cb024cb44d56915bbf45684e0762 [term 3 FOLLOWER]: Refusing update from remote peer df6686ba21134096a4687dbfd45aef3e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:05.071830 16031 consensus_queue.cc:1048] T 269ab37889604517b35eaed13e3c4fae P df6686ba21134096a4687dbfd45aef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:05.083268 15862 raft_consensus.cc:1275] T 269ab37889604517b35eaed13e3c4fae P 7e4674b8eef7448588dd0c00bf09499e [term 3 FOLLOWER]: Refusing update from remote peer df6686ba21134096a4687dbfd45aef3e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:05.085994 16043 consensus_queue.cc:1048] T 269ab37889604517b35eaed13e3c4fae P df6686ba21134096a4687dbfd45aef3e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:05:06.513055 15736 debug-util.cc:398] Leaking SignalData structure 0x7b0800153940 after lost signal to thread 15060
W20260709 13:05:06.513895 15736 debug-util.cc:398] Leaking SignalData structure 0x7b08000c2ce0 after lost signal to thread 15647
W20260709 13:05:06.514711 15736 debug-util.cc:398] Leaking SignalData structure 0x7b080005cca0 after lost signal to thread 15739
W20260709 13:05:06.515497 15736 debug-util.cc:398] Leaking SignalData structure 0x7b080019f6c0 after lost signal to thread 15814
W20260709 13:05:06.516301 15736 debug-util.cc:398] Leaking SignalData structure 0x7b08001d7d60 after lost signal to thread 15888
I20260709 13:05:07.518049 15057 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:07.530715 15713 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "17c5f8247b874e168c1ba313418bb685"
dest_uuid: "df6686ba21134096a4687dbfd45aef3e"
mode: GRACEFUL
new_leader_uuid: "b698cb024cb44d56915bbf45684e0762"
 from {username='slave'} at 127.0.0.1:58504
I20260709 13:05:07.531327 15713 raft_consensus.cc:606] T 17c5f8247b874e168c1ba313418bb685 P df6686ba21134096a4687dbfd45aef3e [term 2 LEADER]: Received request to transfer leadership to TS b698cb024cb44d56915bbf45684e0762
I20260709 13:05:07.534744 15713 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "269ab37889604517b35eaed13e3c4fae"
dest_uuid: "df6686ba21134096a4687dbfd45aef3e"
mode: GRACEFUL
new_leader_uuid: "7e4674b8eef7448588dd0c00bf09499e"
 from {username='slave'} at 127.0.0.1:58504
I20260709 13:05:07.535260 15713 raft_consensus.cc:606] T 269ab37889604517b35eaed13e3c4fae P df6686ba21134096a4687dbfd45aef3e [term 3 LEADER]: Received request to transfer leadership to TS 7e4674b8eef7448588dd0c00bf09499e
I20260709 13:05:07.538153 15713 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5b842df9396d40b581214a0fa9c33530"
dest_uuid: "df6686ba21134096a4687dbfd45aef3e"
mode: GRACEFUL
new_leader_uuid: "7e4674b8eef7448588dd0c00bf09499e"
 from {username='slave'} at 127.0.0.1:58504
I20260709 13:05:07.538722 15713 raft_consensus.cc:606] T 5b842df9396d40b581214a0fa9c33530 P df6686ba21134096a4687dbfd45aef3e [term 2 LEADER]: Received request to transfer leadership to TS 7e4674b8eef7448588dd0c00bf09499e
I20260709 13:05:07.541493 15713 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bcebe4c376a840ec82f61ccc634802bb"
dest_uuid: "df6686ba21134096a4687dbfd45aef3e"
mode: GRACEFUL
new_leader_uuid: "b698cb024cb44d56915bbf45684e0762"
 from {username='slave'} at 127.0.0.1:58504
I20260709 13:05:07.542057 15713 raft_consensus.cc:606] T bcebe4c376a840ec82f61ccc634802bb P df6686ba21134096a4687dbfd45aef3e [term 4 LEADER]: Received request to transfer leadership to TS b698cb024cb44d56915bbf45684e0762
I20260709 13:05:07.544036 15057 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:05:07.544958 15057 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:07.548503 16047 raft_consensus.cc:993] T bcebe4c376a840ec82f61ccc634802bb P df6686ba21134096a4687dbfd45aef3e: : Instructing follower b698cb024cb44d56915bbf45684e0762 to start an election
I20260709 13:05:07.549044 16043 raft_consensus.cc:1081] T bcebe4c376a840ec82f61ccc634802bb P df6686ba21134096a4687dbfd45aef3e [term 4 LEADER]: Signalling peer b698cb024cb44d56915bbf45684e0762 to start an election
I20260709 13:05:07.551127 15790 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bcebe4c376a840ec82f61ccc634802bb"
dest_uuid: "b698cb024cb44d56915bbf45684e0762"
 from {username='slave'} at 127.0.0.1:47144
I20260709 13:05:07.551842 15790 raft_consensus.cc:493] T bcebe4c376a840ec82f61ccc634802bb P b698cb024cb44d56915bbf45684e0762 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:07.552265 15790 raft_consensus.cc:3060] T bcebe4c376a840ec82f61ccc634802bb P b698cb024cb44d56915bbf45684e0762 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:07.558503 16043 raft_consensus.cc:993] T 269ab37889604517b35eaed13e3c4fae P df6686ba21134096a4687dbfd45aef3e: : Instructing follower 7e4674b8eef7448588dd0c00bf09499e to start an election
I20260709 13:05:07.559091 16048 raft_consensus.cc:1081] T 269ab37889604517b35eaed13e3c4fae P df6686ba21134096a4687dbfd45aef3e [term 3 LEADER]: Signalling peer 7e4674b8eef7448588dd0c00bf09499e to start an election
I20260709 13:05:07.560737 15862 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "269ab37889604517b35eaed13e3c4fae"
dest_uuid: "7e4674b8eef7448588dd0c00bf09499e"
 from {username='slave'} at 127.0.0.1:51502
I20260709 13:05:07.561213 15862 raft_consensus.cc:493] T 269ab37889604517b35eaed13e3c4fae P 7e4674b8eef7448588dd0c00bf09499e [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:07.561512 15862 raft_consensus.cc:3060] T 269ab37889604517b35eaed13e3c4fae P 7e4674b8eef7448588dd0c00bf09499e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:07.564046 15790 raft_consensus.cc:515] T bcebe4c376a840ec82f61ccc634802bb P b698cb024cb44d56915bbf45684e0762 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:05:07.566747 15862 raft_consensus.cc:515] T 269ab37889604517b35eaed13e3c4fae P 7e4674b8eef7448588dd0c00bf09499e [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:05:07.569073 15713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcebe4c376a840ec82f61ccc634802bb" candidate_uuid: "b698cb024cb44d56915bbf45684e0762" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "df6686ba21134096a4687dbfd45aef3e"
I20260709 13:05:07.569393 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "269ab37889604517b35eaed13e3c4fae" candidate_uuid: "7e4674b8eef7448588dd0c00bf09499e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "df6686ba21134096a4687dbfd45aef3e"
I20260709 13:05:07.569738 15713 raft_consensus.cc:3055] T bcebe4c376a840ec82f61ccc634802bb P df6686ba21134096a4687dbfd45aef3e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:07.569931 15715 raft_consensus.cc:3055] T 269ab37889604517b35eaed13e3c4fae P df6686ba21134096a4687dbfd45aef3e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:07.570062 15713 raft_consensus.cc:740] T bcebe4c376a840ec82f61ccc634802bb P df6686ba21134096a4687dbfd45aef3e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: df6686ba21134096a4687dbfd45aef3e, State: Running, Role: LEADER
I20260709 13:05:07.570297 15715 raft_consensus.cc:740] T 269ab37889604517b35eaed13e3c4fae P df6686ba21134096a4687dbfd45aef3e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: df6686ba21134096a4687dbfd45aef3e, State: Running, Role: LEADER
I20260709 13:05:07.570878 15713 consensus_queue.cc:260] T bcebe4c376a840ec82f61ccc634802bb P df6686ba21134096a4687dbfd45aef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:05:07.571125 15715 consensus_queue.cc:260] T 269ab37889604517b35eaed13e3c4fae P df6686ba21134096a4687dbfd45aef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:05:07.572003 15713 raft_consensus.cc:3060] T bcebe4c376a840ec82f61ccc634802bb P df6686ba21134096a4687dbfd45aef3e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:07.572160 15715 raft_consensus.cc:3060] T 269ab37889604517b35eaed13e3c4fae P df6686ba21134096a4687dbfd45aef3e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:07.572599 15863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bcebe4c376a840ec82f61ccc634802bb" candidate_uuid: "b698cb024cb44d56915bbf45684e0762" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "7e4674b8eef7448588dd0c00bf09499e"
I20260709 13:05:07.573251 15863 raft_consensus.cc:3060] T bcebe4c376a840ec82f61ccc634802bb P 7e4674b8eef7448588dd0c00bf09499e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:07.576040 15789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "269ab37889604517b35eaed13e3c4fae" candidate_uuid: "7e4674b8eef7448588dd0c00bf09499e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b698cb024cb44d56915bbf45684e0762"
I20260709 13:05:07.576647 15789 raft_consensus.cc:3060] T 269ab37889604517b35eaed13e3c4fae P b698cb024cb44d56915bbf45684e0762 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:07.580266 15713 raft_consensus.cc:2468] T bcebe4c376a840ec82f61ccc634802bb P df6686ba21134096a4687dbfd45aef3e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b698cb024cb44d56915bbf45684e0762 in term 5.
I20260709 13:05:07.581980 15756 leader_election.cc:304] T bcebe4c376a840ec82f61ccc634802bb P b698cb024cb44d56915bbf45684e0762 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b698cb024cb44d56915bbf45684e0762, df6686ba21134096a4687dbfd45aef3e; no voters: 
I20260709 13:05:07.582995 15928 raft_consensus.cc:2804] T bcebe4c376a840ec82f61ccc634802bb P b698cb024cb44d56915bbf45684e0762 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:07.583354 15790 leader_election.cc:290] T bcebe4c376a840ec82f61ccc634802bb P b698cb024cb44d56915bbf45684e0762 [CANDIDATE]: Term 5 election: Requested vote from peers df6686ba21134096a4687dbfd45aef3e (127.14.180.65:42893), 7e4674b8eef7448588dd0c00bf09499e (127.14.180.67:42215)
I20260709 13:05:07.583691 15789 raft_consensus.cc:2468] T 269ab37889604517b35eaed13e3c4fae P b698cb024cb44d56915bbf45684e0762 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e4674b8eef7448588dd0c00bf09499e in term 4.
I20260709 13:05:07.582846 15863 raft_consensus.cc:2468] T bcebe4c376a840ec82f61ccc634802bb P 7e4674b8eef7448588dd0c00bf09499e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b698cb024cb44d56915bbf45684e0762 in term 5.
I20260709 13:05:07.587007 15862 leader_election.cc:290] T 269ab37889604517b35eaed13e3c4fae P 7e4674b8eef7448588dd0c00bf09499e [CANDIDATE]: Term 4 election: Requested vote from peers df6686ba21134096a4687dbfd45aef3e (127.14.180.65:42893), b698cb024cb44d56915bbf45684e0762 (127.14.180.66:35237)
I20260709 13:05:07.585500 15928 raft_consensus.cc:697] T bcebe4c376a840ec82f61ccc634802bb P b698cb024cb44d56915bbf45684e0762 [term 5 LEADER]: Becoming Leader. State: Replica: b698cb024cb44d56915bbf45684e0762, State: Running, Role: LEADER
I20260709 13:05:07.588806 15830 leader_election.cc:304] T 269ab37889604517b35eaed13e3c4fae P 7e4674b8eef7448588dd0c00bf09499e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e4674b8eef7448588dd0c00bf09499e, b698cb024cb44d56915bbf45684e0762; no voters: 
I20260709 13:05:07.589845 16019 raft_consensus.cc:2804] T 269ab37889604517b35eaed13e3c4fae P 7e4674b8eef7448588dd0c00bf09499e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:07.589811 15928 consensus_queue.cc:237] T bcebe4c376a840ec82f61ccc634802bb P b698cb024cb44d56915bbf45684e0762 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:05:07.592768 15715 raft_consensus.cc:2468] T 269ab37889604517b35eaed13e3c4fae P df6686ba21134096a4687dbfd45aef3e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e4674b8eef7448588dd0c00bf09499e in term 4.
I20260709 13:05:07.594367 16019 raft_consensus.cc:697] T 269ab37889604517b35eaed13e3c4fae P 7e4674b8eef7448588dd0c00bf09499e [term 4 LEADER]: Becoming Leader. State: Replica: 7e4674b8eef7448588dd0c00bf09499e, State: Running, Role: LEADER
I20260709 13:05:07.596011 16019 consensus_queue.cc:237] T 269ab37889604517b35eaed13e3c4fae P 7e4674b8eef7448588dd0c00bf09499e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:05:07.606668 15610 catalog_manager.cc:5697] T bcebe4c376a840ec82f61ccc634802bb P b698cb024cb44d56915bbf45684e0762 reported cstate change: term changed from 4 to 5, leader changed from df6686ba21134096a4687dbfd45aef3e (127.14.180.65) to b698cb024cb44d56915bbf45684e0762 (127.14.180.66). New cstate: current_term: 5 leader_uuid: "b698cb024cb44d56915bbf45684e0762" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:07.613628 15612 catalog_manager.cc:5697] T 269ab37889604517b35eaed13e3c4fae P 7e4674b8eef7448588dd0c00bf09499e reported cstate change: term changed from 3 to 4, leader changed from df6686ba21134096a4687dbfd45aef3e (127.14.180.65) to 7e4674b8eef7448588dd0c00bf09499e (127.14.180.67). New cstate: current_term: 4 leader_uuid: "7e4674b8eef7448588dd0c00bf09499e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:07.623023 16048 raft_consensus.cc:993] T 17c5f8247b874e168c1ba313418bb685 P df6686ba21134096a4687dbfd45aef3e: : Instructing follower b698cb024cb44d56915bbf45684e0762 to start an election
I20260709 13:05:07.623607 16048 raft_consensus.cc:1081] T 17c5f8247b874e168c1ba313418bb685 P df6686ba21134096a4687dbfd45aef3e [term 2 LEADER]: Signalling peer b698cb024cb44d56915bbf45684e0762 to start an election
I20260709 13:05:07.626330 15789 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "17c5f8247b874e168c1ba313418bb685"
dest_uuid: "b698cb024cb44d56915bbf45684e0762"
 from {username='slave'} at 127.0.0.1:47144
I20260709 13:05:07.626987 15789 raft_consensus.cc:493] T 17c5f8247b874e168c1ba313418bb685 P b698cb024cb44d56915bbf45684e0762 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:07.627334 15789 raft_consensus.cc:3060] T 17c5f8247b874e168c1ba313418bb685 P b698cb024cb44d56915bbf45684e0762 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:07.636263 15789 raft_consensus.cc:515] T 17c5f8247b874e168c1ba313418bb685 P b698cb024cb44d56915bbf45684e0762 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:05:07.639667 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c5f8247b874e168c1ba313418bb685" candidate_uuid: "b698cb024cb44d56915bbf45684e0762" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "df6686ba21134096a4687dbfd45aef3e"
I20260709 13:05:07.639812 15789 leader_election.cc:290] T 17c5f8247b874e168c1ba313418bb685 P b698cb024cb44d56915bbf45684e0762 [CANDIDATE]: Term 3 election: Requested vote from peers df6686ba21134096a4687dbfd45aef3e (127.14.180.65:42893), 7e4674b8eef7448588dd0c00bf09499e (127.14.180.67:42215)
I20260709 13:05:07.640440 15715 raft_consensus.cc:3055] T 17c5f8247b874e168c1ba313418bb685 P df6686ba21134096a4687dbfd45aef3e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:07.640843 15715 raft_consensus.cc:740] T 17c5f8247b874e168c1ba313418bb685 P df6686ba21134096a4687dbfd45aef3e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: df6686ba21134096a4687dbfd45aef3e, State: Running, Role: LEADER
I20260709 13:05:07.641166 15862 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17c5f8247b874e168c1ba313418bb685" candidate_uuid: "b698cb024cb44d56915bbf45684e0762" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7e4674b8eef7448588dd0c00bf09499e"
I20260709 13:05:07.641790 15862 raft_consensus.cc:3060] T 17c5f8247b874e168c1ba313418bb685 P 7e4674b8eef7448588dd0c00bf09499e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:07.641750 15715 consensus_queue.cc:260] T 17c5f8247b874e168c1ba313418bb685 P df6686ba21134096a4687dbfd45aef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:05:07.643349 15715 raft_consensus.cc:3060] T 17c5f8247b874e168c1ba313418bb685 P df6686ba21134096a4687dbfd45aef3e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:07.650404 15862 raft_consensus.cc:2468] T 17c5f8247b874e168c1ba313418bb685 P 7e4674b8eef7448588dd0c00bf09499e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b698cb024cb44d56915bbf45684e0762 in term 3.
I20260709 13:05:07.650807 15715 raft_consensus.cc:2468] T 17c5f8247b874e168c1ba313418bb685 P df6686ba21134096a4687dbfd45aef3e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b698cb024cb44d56915bbf45684e0762 in term 3.
I20260709 13:05:07.652320 15754 leader_election.cc:304] T 17c5f8247b874e168c1ba313418bb685 P b698cb024cb44d56915bbf45684e0762 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e4674b8eef7448588dd0c00bf09499e, b698cb024cb44d56915bbf45684e0762; no voters: 
I20260709 13:05:07.653403 15928 raft_consensus.cc:2804] T 17c5f8247b874e168c1ba313418bb685 P b698cb024cb44d56915bbf45684e0762 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:07.653981 15928 raft_consensus.cc:697] T 17c5f8247b874e168c1ba313418bb685 P b698cb024cb44d56915bbf45684e0762 [term 3 LEADER]: Becoming Leader. State: Replica: b698cb024cb44d56915bbf45684e0762, State: Running, Role: LEADER
I20260709 13:05:07.654824 15928 consensus_queue.cc:237] T 17c5f8247b874e168c1ba313418bb685 P b698cb024cb44d56915bbf45684e0762 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:05:07.664472 15612 catalog_manager.cc:5697] T 17c5f8247b874e168c1ba313418bb685 P b698cb024cb44d56915bbf45684e0762 reported cstate change: term changed from 2 to 3, leader changed from df6686ba21134096a4687dbfd45aef3e (127.14.180.65) to b698cb024cb44d56915bbf45684e0762 (127.14.180.66). New cstate: current_term: 3 leader_uuid: "b698cb024cb44d56915bbf45684e0762" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:07.903213 16047 raft_consensus.cc:993] T 5b842df9396d40b581214a0fa9c33530 P df6686ba21134096a4687dbfd45aef3e: : Instructing follower 7e4674b8eef7448588dd0c00bf09499e to start an election
I20260709 13:05:07.903802 16043 raft_consensus.cc:1081] T 5b842df9396d40b581214a0fa9c33530 P df6686ba21134096a4687dbfd45aef3e [term 2 LEADER]: Signalling peer 7e4674b8eef7448588dd0c00bf09499e to start an election
I20260709 13:05:07.905722 15862 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5b842df9396d40b581214a0fa9c33530"
dest_uuid: "7e4674b8eef7448588dd0c00bf09499e"
 from {username='slave'} at 127.0.0.1:51502
I20260709 13:05:07.906400 15862 raft_consensus.cc:493] T 5b842df9396d40b581214a0fa9c33530 P 7e4674b8eef7448588dd0c00bf09499e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:07.906860 15862 raft_consensus.cc:3060] T 5b842df9396d40b581214a0fa9c33530 P 7e4674b8eef7448588dd0c00bf09499e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:07.915127 15862 raft_consensus.cc:515] T 5b842df9396d40b581214a0fa9c33530 P 7e4674b8eef7448588dd0c00bf09499e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:05:07.917644 15862 leader_election.cc:290] T 5b842df9396d40b581214a0fa9c33530 P 7e4674b8eef7448588dd0c00bf09499e [CANDIDATE]: Term 3 election: Requested vote from peers df6686ba21134096a4687dbfd45aef3e (127.14.180.65:42893), b698cb024cb44d56915bbf45684e0762 (127.14.180.66:35237)
I20260709 13:05:07.919018 15715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b842df9396d40b581214a0fa9c33530" candidate_uuid: "7e4674b8eef7448588dd0c00bf09499e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "df6686ba21134096a4687dbfd45aef3e"
I20260709 13:05:07.919207 15790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b842df9396d40b581214a0fa9c33530" candidate_uuid: "7e4674b8eef7448588dd0c00bf09499e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b698cb024cb44d56915bbf45684e0762"
I20260709 13:05:07.920027 15715 raft_consensus.cc:3055] T 5b842df9396d40b581214a0fa9c33530 P df6686ba21134096a4687dbfd45aef3e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:07.920053 15790 raft_consensus.cc:3060] T 5b842df9396d40b581214a0fa9c33530 P b698cb024cb44d56915bbf45684e0762 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:07.920679 15715 raft_consensus.cc:740] T 5b842df9396d40b581214a0fa9c33530 P df6686ba21134096a4687dbfd45aef3e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: df6686ba21134096a4687dbfd45aef3e, State: Running, Role: LEADER
I20260709 13:05:07.921622 15715 consensus_queue.cc:260] T 5b842df9396d40b581214a0fa9c33530 P df6686ba21134096a4687dbfd45aef3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:05:07.923086 15715 raft_consensus.cc:3060] T 5b842df9396d40b581214a0fa9c33530 P df6686ba21134096a4687dbfd45aef3e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:07.928666 15790 raft_consensus.cc:2468] T 5b842df9396d40b581214a0fa9c33530 P b698cb024cb44d56915bbf45684e0762 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e4674b8eef7448588dd0c00bf09499e in term 3.
I20260709 13:05:07.929914 15830 leader_election.cc:304] T 5b842df9396d40b581214a0fa9c33530 P 7e4674b8eef7448588dd0c00bf09499e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e4674b8eef7448588dd0c00bf09499e, b698cb024cb44d56915bbf45684e0762; no voters: 
I20260709 13:05:07.930058 15715 raft_consensus.cc:2468] T 5b842df9396d40b581214a0fa9c33530 P df6686ba21134096a4687dbfd45aef3e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e4674b8eef7448588dd0c00bf09499e in term 3.
I20260709 13:05:07.930900 16019 raft_consensus.cc:2804] T 5b842df9396d40b581214a0fa9c33530 P 7e4674b8eef7448588dd0c00bf09499e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:07.931540 16019 raft_consensus.cc:697] T 5b842df9396d40b581214a0fa9c33530 P 7e4674b8eef7448588dd0c00bf09499e [term 3 LEADER]: Becoming Leader. State: Replica: 7e4674b8eef7448588dd0c00bf09499e, State: Running, Role: LEADER
I20260709 13:05:07.932729 16019 consensus_queue.cc:237] T 5b842df9396d40b581214a0fa9c33530 P 7e4674b8eef7448588dd0c00bf09499e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } }
I20260709 13:05:07.943692 15612 catalog_manager.cc:5697] T 5b842df9396d40b581214a0fa9c33530 P 7e4674b8eef7448588dd0c00bf09499e reported cstate change: term changed from 2 to 3, leader changed from df6686ba21134096a4687dbfd45aef3e (127.14.180.65) to 7e4674b8eef7448588dd0c00bf09499e (127.14.180.67). New cstate: current_term: 3 leader_uuid: "7e4674b8eef7448588dd0c00bf09499e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:08.011232 15862 raft_consensus.cc:1275] T bcebe4c376a840ec82f61ccc634802bb P 7e4674b8eef7448588dd0c00bf09499e [term 5 FOLLOWER]: Refusing update from remote peer b698cb024cb44d56915bbf45684e0762: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:05:08.012708 15928 consensus_queue.cc:1048] T bcebe4c376a840ec82f61ccc634802bb P b698cb024cb44d56915bbf45684e0762 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:08.024233 15715 raft_consensus.cc:1275] T bcebe4c376a840ec82f61ccc634802bb P df6686ba21134096a4687dbfd45aef3e [term 5 FOLLOWER]: Refusing update from remote peer b698cb024cb44d56915bbf45684e0762: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:05:08.026059 15928 consensus_queue.cc:1048] T bcebe4c376a840ec82f61ccc634802bb P b698cb024cb44d56915bbf45684e0762 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:08.062664 15715 raft_consensus.cc:1275] T 17c5f8247b874e168c1ba313418bb685 P df6686ba21134096a4687dbfd45aef3e [term 3 FOLLOWER]: Refusing update from remote peer b698cb024cb44d56915bbf45684e0762: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:08.064066 15928 consensus_queue.cc:1048] T 17c5f8247b874e168c1ba313418bb685 P b698cb024cb44d56915bbf45684e0762 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:08.079363 15862 raft_consensus.cc:1275] T 17c5f8247b874e168c1ba313418bb685 P 7e4674b8eef7448588dd0c00bf09499e [term 3 FOLLOWER]: Refusing update from remote peer b698cb024cb44d56915bbf45684e0762: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:08.081970 15928 consensus_queue.cc:1048] T 17c5f8247b874e168c1ba313418bb685 P b698cb024cb44d56915bbf45684e0762 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e4674b8eef7448588dd0c00bf09499e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 42215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:08.193298 15789 raft_consensus.cc:1275] T 269ab37889604517b35eaed13e3c4fae P b698cb024cb44d56915bbf45684e0762 [term 4 FOLLOWER]: Refusing update from remote peer 7e4674b8eef7448588dd0c00bf09499e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:08.195070 16019 consensus_queue.cc:1048] T 269ab37889604517b35eaed13e3c4fae P 7e4674b8eef7448588dd0c00bf09499e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:08.203890 15715 raft_consensus.cc:1275] T 269ab37889604517b35eaed13e3c4fae P df6686ba21134096a4687dbfd45aef3e [term 4 FOLLOWER]: Refusing update from remote peer 7e4674b8eef7448588dd0c00bf09499e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:08.206099 16050 consensus_queue.cc:1048] T 269ab37889604517b35eaed13e3c4fae P 7e4674b8eef7448588dd0c00bf09499e [LEADER]: Connected to new peer: Peer: permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:08.438391 15789 raft_consensus.cc:1275] T 5b842df9396d40b581214a0fa9c33530 P b698cb024cb44d56915bbf45684e0762 [term 3 FOLLOWER]: Refusing update from remote peer 7e4674b8eef7448588dd0c00bf09499e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:08.440300 16019 consensus_queue.cc:1048] T 5b842df9396d40b581214a0fa9c33530 P 7e4674b8eef7448588dd0c00bf09499e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b698cb024cb44d56915bbf45684e0762" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:08.460201 15715 raft_consensus.cc:1275] T 5b842df9396d40b581214a0fa9c33530 P df6686ba21134096a4687dbfd45aef3e [term 3 FOLLOWER]: Refusing update from remote peer 7e4674b8eef7448588dd0c00bf09499e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:08.461675 16019 consensus_queue.cc:1048] T 5b842df9396d40b581214a0fa9c33530 P 7e4674b8eef7448588dd0c00bf09499e [LEADER]: Connected to new peer: Peer: permanent_uuid: "df6686ba21134096a4687dbfd45aef3e" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 42893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:08.546157 15057 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:08.554018 15057 tablet_server.cc:179] TabletServer@127.14.180.65:0 shutting down...
W20260709 13:05:08.594702 15756 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 5 similar messages]
W20260709 13:05:08.600132 15756 consensus_peers.cc:597] T bcebe4c376a840ec82f61ccc634802bb P b698cb024cb44d56915bbf45684e0762 -> Peer df6686ba21134096a4687dbfd45aef3e (127.14.180.65:42893): Couldn't send request to peer df6686ba21134096a4687dbfd45aef3e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:08.605943 15057 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:08.607213 15057 tablet_replica.cc:333] T 6a089ebf729d4dcabe86cf94fb987006 P df6686ba21134096a4687dbfd45aef3e: stopping tablet replica
I20260709 13:05:08.608278 15057 raft_consensus.cc:2243] T 6a089ebf729d4dcabe86cf94fb987006 P df6686ba21134096a4687dbfd45aef3e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:08.609068 15057 raft_consensus.cc:2272] T 6a089ebf729d4dcabe86cf94fb987006 P df6686ba21134096a4687dbfd45aef3e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:08.612144 15057 tablet_replica.cc:333] T bcebe4c376a840ec82f61ccc634802bb P df6686ba21134096a4687dbfd45aef3e: stopping tablet replica
I20260709 13:05:08.613371 15057 raft_consensus.cc:2243] T bcebe4c376a840ec82f61ccc634802bb P df6686ba21134096a4687dbfd45aef3e [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:08.614024 15057 raft_consensus.cc:2272] T bcebe4c376a840ec82f61ccc634802bb P df6686ba21134096a4687dbfd45aef3e [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:08.618801 15057 tablet_replica.cc:333] T 269ab37889604517b35eaed13e3c4fae P df6686ba21134096a4687dbfd45aef3e: stopping tablet replica
I20260709 13:05:08.619722 15057 raft_consensus.cc:2243] T 269ab37889604517b35eaed13e3c4fae P df6686ba21134096a4687dbfd45aef3e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:08.620398 15057 raft_consensus.cc:2272] T 269ab37889604517b35eaed13e3c4fae P df6686ba21134096a4687dbfd45aef3e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:08.624082 15057 tablet_replica.cc:333] T a0d24e4aeb604523af8ec351df2618d7 P df6686ba21134096a4687dbfd45aef3e: stopping tablet replica
I20260709 13:05:08.625061 15057 raft_consensus.cc:2243] T a0d24e4aeb604523af8ec351df2618d7 P df6686ba21134096a4687dbfd45aef3e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:08.625699 15057 raft_consensus.cc:2272] T a0d24e4aeb604523af8ec351df2618d7 P df6686ba21134096a4687dbfd45aef3e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:08.629217 15057 tablet_replica.cc:333] T 17c5f8247b874e168c1ba313418bb685 P df6686ba21134096a4687dbfd45aef3e: stopping tablet replica
W20260709 13:05:08.629868 15830 consensus_peers.cc:597] T 269ab37889604517b35eaed13e3c4fae P 7e4674b8eef7448588dd0c00bf09499e -> Peer df6686ba21134096a4687dbfd45aef3e (127.14.180.65:42893): Couldn't send request to peer df6686ba21134096a4687dbfd45aef3e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:08.630051 15057 raft_consensus.cc:2243] T 17c5f8247b874e168c1ba313418bb685 P df6686ba21134096a4687dbfd45aef3e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:08.630679 15057 raft_consensus.cc:2272] T 17c5f8247b874e168c1ba313418bb685 P df6686ba21134096a4687dbfd45aef3e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:08.633785 15057 tablet_replica.cc:333] T 5b842df9396d40b581214a0fa9c33530 P df6686ba21134096a4687dbfd45aef3e: stopping tablet replica
I20260709 13:05:08.634660 15057 raft_consensus.cc:2243] T 5b842df9396d40b581214a0fa9c33530 P df6686ba21134096a4687dbfd45aef3e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:08.635241 15057 raft_consensus.cc:2272] T 5b842df9396d40b581214a0fa9c33530 P df6686ba21134096a4687dbfd45aef3e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:08.638584 15057 tablet_replica.cc:333] T c1d542ea2766419380191ac2ffcf8e64 P df6686ba21134096a4687dbfd45aef3e: stopping tablet replica
I20260709 13:05:08.639391 15057 raft_consensus.cc:2243] T c1d542ea2766419380191ac2ffcf8e64 P df6686ba21134096a4687dbfd45aef3e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:08.640399 15057 raft_consensus.cc:2272] T c1d542ea2766419380191ac2ffcf8e64 P df6686ba21134096a4687dbfd45aef3e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:08.642993 15057 tablet_replica.cc:333] T 4b331a1f307440c987613c4937b9c972 P df6686ba21134096a4687dbfd45aef3e: stopping tablet replica
I20260709 13:05:08.643682 15057 raft_consensus.cc:2243] T 4b331a1f307440c987613c4937b9c972 P df6686ba21134096a4687dbfd45aef3e [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:05:08.644690 15057 raft_consensus.cc:2272] T 4b331a1f307440c987613c4937b9c972 P df6686ba21134096a4687dbfd45aef3e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:08.647476 15057 tablet_replica.cc:333] T 7ff320c2485644c5914cfbab424cc102 P df6686ba21134096a4687dbfd45aef3e: stopping tablet replica
I20260709 13:05:08.648208 15057 raft_consensus.cc:2243] T 7ff320c2485644c5914cfbab424cc102 P df6686ba21134096a4687dbfd45aef3e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:08.649228 15057 raft_consensus.cc:2272] T 7ff320c2485644c5914cfbab424cc102 P df6686ba21134096a4687dbfd45aef3e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:08.652100 15057 tablet_replica.cc:333] T aec58ca8ca264a4b9cbcb7703558f1c8 P df6686ba21134096a4687dbfd45aef3e: stopping tablet replica
I20260709 13:05:08.652845 15057 raft_consensus.cc:2243] T aec58ca8ca264a4b9cbcb7703558f1c8 P df6686ba21134096a4687dbfd45aef3e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:08.653800 15057 raft_consensus.cc:2272] T aec58ca8ca264a4b9cbcb7703558f1c8 P df6686ba21134096a4687dbfd45aef3e [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:05:08.765362 15756 consensus_peers.cc:597] T a0d24e4aeb604523af8ec351df2618d7 P b698cb024cb44d56915bbf45684e0762 -> Peer df6686ba21134096a4687dbfd45aef3e (127.14.180.65:42893): Couldn't send request to peer df6686ba21134096a4687dbfd45aef3e. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:42893: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:08.851918 15830 consensus_peers.cc:597] T 6a089ebf729d4dcabe86cf94fb987006 P 7e4674b8eef7448588dd0c00bf09499e -> Peer df6686ba21134096a4687dbfd45aef3e (127.14.180.65:42893): Couldn't send request to peer df6686ba21134096a4687dbfd45aef3e. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:42893: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:08.913298 15830 consensus_peers.cc:597] T 5b842df9396d40b581214a0fa9c33530 P 7e4674b8eef7448588dd0c00bf09499e -> Peer df6686ba21134096a4687dbfd45aef3e (127.14.180.65:42893): Couldn't send request to peer df6686ba21134096a4687dbfd45aef3e. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:42893: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:09.055768 15756 consensus_peers.cc:597] T 17c5f8247b874e168c1ba313418bb685 P b698cb024cb44d56915bbf45684e0762 -> Peer df6686ba21134096a4687dbfd45aef3e (127.14.180.65:42893): Couldn't send request to peer df6686ba21134096a4687dbfd45aef3e. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:42893: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:09.405021 15057 tablet_server.cc:196] TabletServer@127.14.180.65:0 shutdown complete.
I20260709 13:05:09.434646 15057 tablet_server.cc:179] TabletServer@127.14.180.66:0 shutting down...
W20260709 13:05:09.446182 15830 consensus_peers.cc:597] T 5b842df9396d40b581214a0fa9c33530 P 7e4674b8eef7448588dd0c00bf09499e -> Peer b698cb024cb44d56915bbf45684e0762 (127.14.180.66:35237): Couldn't send request to peer b698cb024cb44d56915bbf45684e0762. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:09.461508 15057 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:09.462329 15057 tablet_replica.cc:333] T a0d24e4aeb604523af8ec351df2618d7 P b698cb024cb44d56915bbf45684e0762: stopping tablet replica
I20260709 13:05:09.463304 15057 raft_consensus.cc:2243] T a0d24e4aeb604523af8ec351df2618d7 P b698cb024cb44d56915bbf45684e0762 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:09.464332 15057 raft_consensus.cc:2272] T a0d24e4aeb604523af8ec351df2618d7 P b698cb024cb44d56915bbf45684e0762 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:09.466182 15057 tablet_replica.cc:333] T 269ab37889604517b35eaed13e3c4fae P b698cb024cb44d56915bbf45684e0762: stopping tablet replica
I20260709 13:05:09.466830 15057 raft_consensus.cc:2243] T 269ab37889604517b35eaed13e3c4fae P b698cb024cb44d56915bbf45684e0762 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:09.467231 15057 raft_consensus.cc:2272] T 269ab37889604517b35eaed13e3c4fae P b698cb024cb44d56915bbf45684e0762 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:09.468892 15057 tablet_replica.cc:333] T bcebe4c376a840ec82f61ccc634802bb P b698cb024cb44d56915bbf45684e0762: stopping tablet replica
I20260709 13:05:09.469444 15057 raft_consensus.cc:2243] T bcebe4c376a840ec82f61ccc634802bb P b698cb024cb44d56915bbf45684e0762 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:05:09.470129 15057 raft_consensus.cc:2272] T bcebe4c376a840ec82f61ccc634802bb P b698cb024cb44d56915bbf45684e0762 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:09.471920 15057 tablet_replica.cc:333] T 6a089ebf729d4dcabe86cf94fb987006 P b698cb024cb44d56915bbf45684e0762: stopping tablet replica
I20260709 13:05:09.472388 15057 raft_consensus.cc:2243] T 6a089ebf729d4dcabe86cf94fb987006 P b698cb024cb44d56915bbf45684e0762 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:09.472745 15057 raft_consensus.cc:2272] T 6a089ebf729d4dcabe86cf94fb987006 P b698cb024cb44d56915bbf45684e0762 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:09.474327 15057 tablet_replica.cc:333] T 5b842df9396d40b581214a0fa9c33530 P b698cb024cb44d56915bbf45684e0762: stopping tablet replica
I20260709 13:05:09.474875 15057 raft_consensus.cc:2243] T 5b842df9396d40b581214a0fa9c33530 P b698cb024cb44d56915bbf45684e0762 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:09.475265 15057 raft_consensus.cc:2272] T 5b842df9396d40b581214a0fa9c33530 P b698cb024cb44d56915bbf45684e0762 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:09.476773 15057 tablet_replica.cc:333] T 17c5f8247b874e168c1ba313418bb685 P b698cb024cb44d56915bbf45684e0762: stopping tablet replica
I20260709 13:05:09.477298 15057 raft_consensus.cc:2243] T 17c5f8247b874e168c1ba313418bb685 P b698cb024cb44d56915bbf45684e0762 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:09.477980 15057 raft_consensus.cc:2272] T 17c5f8247b874e168c1ba313418bb685 P b698cb024cb44d56915bbf45684e0762 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:09.479717 15057 tablet_replica.cc:333] T c1d542ea2766419380191ac2ffcf8e64 P b698cb024cb44d56915bbf45684e0762: stopping tablet replica
I20260709 13:05:09.480216 15057 raft_consensus.cc:2243] T c1d542ea2766419380191ac2ffcf8e64 P b698cb024cb44d56915bbf45684e0762 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:09.480621 15057 raft_consensus.cc:2272] T c1d542ea2766419380191ac2ffcf8e64 P b698cb024cb44d56915bbf45684e0762 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:09.482261 15057 tablet_replica.cc:333] T 4b331a1f307440c987613c4937b9c972 P b698cb024cb44d56915bbf45684e0762: stopping tablet replica
I20260709 13:05:09.482824 15057 raft_consensus.cc:2243] T 4b331a1f307440c987613c4937b9c972 P b698cb024cb44d56915bbf45684e0762 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:09.483254 15057 raft_consensus.cc:2272] T 4b331a1f307440c987613c4937b9c972 P b698cb024cb44d56915bbf45684e0762 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:09.485016 15057 tablet_replica.cc:333] T aec58ca8ca264a4b9cbcb7703558f1c8 P b698cb024cb44d56915bbf45684e0762: stopping tablet replica
I20260709 13:05:09.485544 15057 raft_consensus.cc:2243] T aec58ca8ca264a4b9cbcb7703558f1c8 P b698cb024cb44d56915bbf45684e0762 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:09.485929 15057 raft_consensus.cc:2272] T aec58ca8ca264a4b9cbcb7703558f1c8 P b698cb024cb44d56915bbf45684e0762 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:09.487563 15057 tablet_replica.cc:333] T 7ff320c2485644c5914cfbab424cc102 P b698cb024cb44d56915bbf45684e0762: stopping tablet replica
I20260709 13:05:09.488019 15057 raft_consensus.cc:2243] T 7ff320c2485644c5914cfbab424cc102 P b698cb024cb44d56915bbf45684e0762 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:09.488461 15057 raft_consensus.cc:2272] T 7ff320c2485644c5914cfbab424cc102 P b698cb024cb44d56915bbf45684e0762 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:09.519021 15057 tablet_server.cc:196] TabletServer@127.14.180.66:0 shutdown complete.
I20260709 13:05:09.541399 15057 tablet_server.cc:179] TabletServer@127.14.180.67:0 shutting down...
I20260709 13:05:09.568620 15057 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:05:09.569483 15057 tablet_replica.cc:333] T 4b331a1f307440c987613c4937b9c972 P 7e4674b8eef7448588dd0c00bf09499e: stopping tablet replica
I20260709 13:05:09.570313 15057 raft_consensus.cc:2243] T 4b331a1f307440c987613c4937b9c972 P 7e4674b8eef7448588dd0c00bf09499e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:09.571117 15057 raft_consensus.cc:2272] T 4b331a1f307440c987613c4937b9c972 P 7e4674b8eef7448588dd0c00bf09499e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:09.573173 15057 tablet_replica.cc:333] T 6a089ebf729d4dcabe86cf94fb987006 P 7e4674b8eef7448588dd0c00bf09499e: stopping tablet replica
I20260709 13:05:09.573801 15057 raft_consensus.cc:2243] T 6a089ebf729d4dcabe86cf94fb987006 P 7e4674b8eef7448588dd0c00bf09499e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:05:09.574652 15057 raft_consensus.cc:2272] T 6a089ebf729d4dcabe86cf94fb987006 P 7e4674b8eef7448588dd0c00bf09499e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:09.576519 15057 tablet_replica.cc:333] T aec58ca8ca264a4b9cbcb7703558f1c8 P 7e4674b8eef7448588dd0c00bf09499e: stopping tablet replica
I20260709 13:05:09.577054 15057 raft_consensus.cc:2243] T aec58ca8ca264a4b9cbcb7703558f1c8 P 7e4674b8eef7448588dd0c00bf09499e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:09.577512 15057 raft_consensus.cc:2272] T aec58ca8ca264a4b9cbcb7703558f1c8 P 7e4674b8eef7448588dd0c00bf09499e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:09.579228 15057 tablet_replica.cc:333] T 7ff320c2485644c5914cfbab424cc102 P 7e4674b8eef7448588dd0c00bf09499e: stopping tablet replica
I20260709 13:05:09.579741 15057 raft_consensus.cc:2243] T 7ff320c2485644c5914cfbab424cc102 P 7e4674b8eef7448588dd0c00bf09499e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:09.580170 15057 raft_consensus.cc:2272] T 7ff320c2485644c5914cfbab424cc102 P 7e4674b8eef7448588dd0c00bf09499e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:09.581880 15057 tablet_replica.cc:333] T 5b842df9396d40b581214a0fa9c33530 P 7e4674b8eef7448588dd0c00bf09499e: stopping tablet replica
I20260709 13:05:09.582409 15057 raft_consensus.cc:2243] T 5b842df9396d40b581214a0fa9c33530 P 7e4674b8eef7448588dd0c00bf09499e [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:05:09.583232 15057 raft_consensus.cc:2272] T 5b842df9396d40b581214a0fa9c33530 P 7e4674b8eef7448588dd0c00bf09499e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:09.584959 15057 tablet_replica.cc:333] T 17c5f8247b874e168c1ba313418bb685 P 7e4674b8eef7448588dd0c00bf09499e: stopping tablet replica
I20260709 13:05:09.585487 15057 raft_consensus.cc:2243] T 17c5f8247b874e168c1ba313418bb685 P 7e4674b8eef7448588dd0c00bf09499e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:09.585925 15057 raft_consensus.cc:2272] T 17c5f8247b874e168c1ba313418bb685 P 7e4674b8eef7448588dd0c00bf09499e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:09.587596 15057 tablet_replica.cc:333] T c1d542ea2766419380191ac2ffcf8e64 P 7e4674b8eef7448588dd0c00bf09499e: stopping tablet replica
I20260709 13:05:09.588114 15057 raft_consensus.cc:2243] T c1d542ea2766419380191ac2ffcf8e64 P 7e4674b8eef7448588dd0c00bf09499e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:09.588527 15057 raft_consensus.cc:2272] T c1d542ea2766419380191ac2ffcf8e64 P 7e4674b8eef7448588dd0c00bf09499e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:09.590123 15057 tablet_replica.cc:333] T a0d24e4aeb604523af8ec351df2618d7 P 7e4674b8eef7448588dd0c00bf09499e: stopping tablet replica
I20260709 13:05:09.590653 15057 raft_consensus.cc:2243] T a0d24e4aeb604523af8ec351df2618d7 P 7e4674b8eef7448588dd0c00bf09499e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:09.591084 15057 raft_consensus.cc:2272] T a0d24e4aeb604523af8ec351df2618d7 P 7e4674b8eef7448588dd0c00bf09499e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:09.592703 15057 tablet_replica.cc:333] T bcebe4c376a840ec82f61ccc634802bb P 7e4674b8eef7448588dd0c00bf09499e: stopping tablet replica
I20260709 13:05:09.593171 15057 raft_consensus.cc:2243] T bcebe4c376a840ec82f61ccc634802bb P 7e4674b8eef7448588dd0c00bf09499e [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:09.593588 15057 raft_consensus.cc:2272] T bcebe4c376a840ec82f61ccc634802bb P 7e4674b8eef7448588dd0c00bf09499e [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:09.595636 15057 tablet_replica.cc:333] T 269ab37889604517b35eaed13e3c4fae P 7e4674b8eef7448588dd0c00bf09499e: stopping tablet replica
I20260709 13:05:09.596099 15057 raft_consensus.cc:2243] T 269ab37889604517b35eaed13e3c4fae P 7e4674b8eef7448588dd0c00bf09499e [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:05:09.596807 15057 raft_consensus.cc:2272] T 269ab37889604517b35eaed13e3c4fae P 7e4674b8eef7448588dd0c00bf09499e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:09.626828 15057 tablet_server.cc:196] TabletServer@127.14.180.67:0 shutdown complete.
I20260709 13:05:09.646005 15057 master.cc:562] Master@127.14.180.126:38397 shutting down...
I20260709 13:05:09.668246 15057 raft_consensus.cc:2243] T 00000000000000000000000000000000 P e0698e7005b24af99ae0aaa41d0a3540 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:05:09.668876 15057 raft_consensus.cc:2272] T 00000000000000000000000000000000 P e0698e7005b24af99ae0aaa41d0a3540 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:09.669240 15057 tablet_replica.cc:333] T 00000000000000000000000000000000 P e0698e7005b24af99ae0aaa41d0a3540: stopping tablet replica
I20260709 13:05:09.689374 15057 master.cc:584] Master@127.14.180.126:38397 shutdown complete.
7e4674b8eef7448588dd0c00bf09499e  1
b698cb024cb44d56915bbf45684e0762  4
df6686ba21134096a4687dbfd45aef3e  5
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (11602 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 13:05:09.735643 15057 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.14.180.126:35965
I20260709 13:05:09.737006 15057 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:09.744086 16082 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:09.744297 16084 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:09.744352 16081 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:09.745366 15057 server_base.cc:1061] running on GCE node
I20260709 13:05:09.746213 15057 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:09.746411 15057 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:09.746605 15057 hybrid_clock.cc:648] HybridClock initialized: now 1783602309746525 us; error 0 us; skew 500 ppm
I20260709 13:05:09.747193 15057 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:09.750973 15057 webserver.cc:533] Webserver started at http://127.14.180.126:39965/ using document root <none> and password file <none>
I20260709 13:05:09.751507 15057 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:09.751673 15057 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:09.751896 15057 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:09.753053 15057 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602283040513-15057-0/minicluster-data/master-0-root/instance:
uuid: "4dc6f08597514f4d85fd451b999b403e"
format_stamp: "Formatted at 2026-07-09 13:05:09 on dist-test-slave-r9m8"
I20260709 13:05:09.758167 15057 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.002s
I20260709 13:05:09.762749 16089 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:09.763682 15057 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:05:09.763960 15057 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602283040513-15057-0/minicluster-data/master-0-root
uuid: "4dc6f08597514f4d85fd451b999b403e"
format_stamp: "Formatted at 2026-07-09 13:05:09 on dist-test-slave-r9m8"
I20260709 13:05:09.764236 15057 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602283040513-15057-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602283040513-15057-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602283040513-15057-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:09.781849 15057 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:09.783193 15057 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:09.825569 15057 rpc_server.cc:307] RPC server started. Bound to: 127.14.180.126:35965
I20260709 13:05:09.825636 16140 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.180.126:35965 every 8 connection(s)
I20260709 13:05:09.829989 16141 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:09.840569 16141 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4dc6f08597514f4d85fd451b999b403e: Bootstrap starting.
I20260709 13:05:09.845237 16141 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4dc6f08597514f4d85fd451b999b403e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:09.849570 16141 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4dc6f08597514f4d85fd451b999b403e: No bootstrap required, opened a new log
I20260709 13:05:09.851763 16141 raft_consensus.cc:359] T 00000000000000000000000000000000 P 4dc6f08597514f4d85fd451b999b403e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4dc6f08597514f4d85fd451b999b403e" member_type: VOTER }
I20260709 13:05:09.852221 16141 raft_consensus.cc:385] T 00000000000000000000000000000000 P 4dc6f08597514f4d85fd451b999b403e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:09.852458 16141 raft_consensus.cc:740] T 00000000000000000000000000000000 P 4dc6f08597514f4d85fd451b999b403e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dc6f08597514f4d85fd451b999b403e, State: Initialized, Role: FOLLOWER
I20260709 13:05:09.853111 16141 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4dc6f08597514f4d85fd451b999b403e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4dc6f08597514f4d85fd451b999b403e" member_type: VOTER }
I20260709 13:05:09.853593 16141 raft_consensus.cc:399] T 00000000000000000000000000000000 P 4dc6f08597514f4d85fd451b999b403e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:05:09.853837 16141 raft_consensus.cc:493] T 00000000000000000000000000000000 P 4dc6f08597514f4d85fd451b999b403e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:05:09.854126 16141 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 4dc6f08597514f4d85fd451b999b403e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:09.858963 16141 raft_consensus.cc:515] T 00000000000000000000000000000000 P 4dc6f08597514f4d85fd451b999b403e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4dc6f08597514f4d85fd451b999b403e" member_type: VOTER }
I20260709 13:05:09.859606 16141 leader_election.cc:304] T 00000000000000000000000000000000 P 4dc6f08597514f4d85fd451b999b403e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4dc6f08597514f4d85fd451b999b403e; no voters: 
I20260709 13:05:09.860929 16141 leader_election.cc:290] T 00000000000000000000000000000000 P 4dc6f08597514f4d85fd451b999b403e [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:05:09.861277 16144 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 4dc6f08597514f4d85fd451b999b403e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:09.862743 16144 raft_consensus.cc:697] T 00000000000000000000000000000000 P 4dc6f08597514f4d85fd451b999b403e [term 1 LEADER]: Becoming Leader. State: Replica: 4dc6f08597514f4d85fd451b999b403e, State: Running, Role: LEADER
I20260709 13:05:09.863559 16144 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4dc6f08597514f4d85fd451b999b403e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4dc6f08597514f4d85fd451b999b403e" member_type: VOTER }
I20260709 13:05:09.864253 16141 sys_catalog.cc:565] T 00000000000000000000000000000000 P 4dc6f08597514f4d85fd451b999b403e [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:05:09.869369 16146 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4dc6f08597514f4d85fd451b999b403e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4dc6f08597514f4d85fd451b999b403e. Latest consensus state: current_term: 1 leader_uuid: "4dc6f08597514f4d85fd451b999b403e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4dc6f08597514f4d85fd451b999b403e" member_type: VOTER } }
I20260709 13:05:09.870210 16146 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4dc6f08597514f4d85fd451b999b403e [sys.catalog]: This master's current role is: LEADER
I20260709 13:05:09.872361 16145 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4dc6f08597514f4d85fd451b999b403e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4dc6f08597514f4d85fd451b999b403e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4dc6f08597514f4d85fd451b999b403e" member_type: VOTER } }
I20260709 13:05:09.873042 16145 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4dc6f08597514f4d85fd451b999b403e [sys.catalog]: This master's current role is: LEADER
I20260709 13:05:09.873358 16152 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:05:09.878847 16152 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:05:09.883311 15057 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:05:09.889355 16152 catalog_manager.cc:1383] Generated new cluster ID: b83acbf4ea654ddda586fc89adeb1b28
I20260709 13:05:09.889597 16152 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:05:09.905314 16152 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:05:09.907274 16152 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:05:09.924813 16152 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 4dc6f08597514f4d85fd451b999b403e: Generated new TSK 0
I20260709 13:05:09.925427 16152 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:05:09.950417 15057 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:09.957093 16162 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:09.958446 16163 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:09.960961 16165 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:09.962085 15057 server_base.cc:1061] running on GCE node
I20260709 13:05:09.963056 15057 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:09.963294 15057 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:09.963428 15057 hybrid_clock.cc:648] HybridClock initialized: now 1783602309963409 us; error 0 us; skew 500 ppm
I20260709 13:05:09.963905 15057 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:09.967016 15057 webserver.cc:533] Webserver started at http://127.14.180.65:41509/ using document root <none> and password file <none>
I20260709 13:05:09.967489 15057 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:09.967662 15057 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:09.967929 15057 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:09.969067 15057 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602283040513-15057-0/minicluster-data/ts-0-root/instance:
uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
format_stamp: "Formatted at 2026-07-09 13:05:09 on dist-test-slave-r9m8"
I20260709 13:05:09.973799 15057 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.002s
I20260709 13:05:09.977634 16170 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:09.978524 15057 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:05:09.978912 15057 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602283040513-15057-0/minicluster-data/ts-0-root
uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
format_stamp: "Formatted at 2026-07-09 13:05:09 on dist-test-slave-r9m8"
I20260709 13:05:09.979230 15057 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602283040513-15057-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602283040513-15057-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602283040513-15057-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:09.997270 15057 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:09.998710 15057 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:10.000634 15057 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:10.003556 15057 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:10.003818 15057 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:10.004092 15057 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:10.004316 15057 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:10.049832 15057 rpc_server.cc:307] RPC server started. Bound to: 127.14.180.65:46073
I20260709 13:05:10.049985 16232 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.180.65:46073 every 8 connection(s)
I20260709 13:05:10.055538 15057 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:10.063306 16237 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:10.063727 16238 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:10.068539 15057 server_base.cc:1061] running on GCE node
W20260709 13:05:10.068631 16240 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:10.069913 15057 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:10.070204 15057 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:10.070385 15057 hybrid_clock.cc:648] HybridClock initialized: now 1783602310070366 us; error 0 us; skew 500 ppm
I20260709 13:05:10.071079 15057 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:10.073985 15057 webserver.cc:533] Webserver started at http://127.14.180.66:34973/ using document root <none> and password file <none>
I20260709 13:05:10.074729 15057 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:10.074865 16233 heartbeater.cc:344] Connected to a master server at 127.14.180.126:35965
I20260709 13:05:10.075026 15057 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:10.075402 16233 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:10.075446 15057 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:10.076264 16233 heartbeater.cc:507] Master 127.14.180.126:35965 requested a full tablet report, sending...
I20260709 13:05:10.076900 15057 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602283040513-15057-0/minicluster-data/ts-1-root/instance:
uuid: "0aea40d6e4374085a2e38a70a71f63e3"
format_stamp: "Formatted at 2026-07-09 13:05:10 on dist-test-slave-r9m8"
I20260709 13:05:10.078657 16106 ts_manager.cc:194] Registered new tserver with Master: e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073)
I20260709 13:05:10.081000 16106 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38830
I20260709 13:05:10.082312 15057 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:05:10.086109 16245 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:10.087049 15057 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:05:10.087375 15057 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602283040513-15057-0/minicluster-data/ts-1-root
uuid: "0aea40d6e4374085a2e38a70a71f63e3"
format_stamp: "Formatted at 2026-07-09 13:05:10 on dist-test-slave-r9m8"
I20260709 13:05:10.087687 15057 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602283040513-15057-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602283040513-15057-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602283040513-15057-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:10.102914 15057 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:10.104207 15057 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:10.105831 15057 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:10.108371 15057 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:10.108633 15057 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:10.108901 15057 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:10.109130 15057 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:10.156870 15057 rpc_server.cc:307] RPC server started. Bound to: 127.14.180.66:45823
I20260709 13:05:10.157027 16307 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.180.66:45823 every 8 connection(s)
I20260709 13:05:10.162432 15057 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:10.171208 16311 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:10.172497 16312 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:10.176927 16314 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:10.178777 15057 server_base.cc:1061] running on GCE node
I20260709 13:05:10.179323 16308 heartbeater.cc:344] Connected to a master server at 127.14.180.126:35965
I20260709 13:05:10.179744 16308 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:10.180008 15057 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:10.180297 15057 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:10.180536 15057 hybrid_clock.cc:648] HybridClock initialized: now 1783602310180477 us; error 0 us; skew 500 ppm
I20260709 13:05:10.180691 16308 heartbeater.cc:507] Master 127.14.180.126:35965 requested a full tablet report, sending...
I20260709 13:05:10.181316 15057 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:10.184206 16106 ts_manager.cc:194] Registered new tserver with Master: 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:10.185534 15057 webserver.cc:533] Webserver started at http://127.14.180.67:44155/ using document root <none> and password file <none>
I20260709 13:05:10.186339 15057 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:10.186642 15057 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:10.186659 16106 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38840
I20260709 13:05:10.187148 15057 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:10.189179 15057 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602283040513-15057-0/minicluster-data/ts-2-root/instance:
uuid: "363bb2f744eb486f9ad726f08214c98e"
format_stamp: "Formatted at 2026-07-09 13:05:10 on dist-test-slave-r9m8"
I20260709 13:05:10.194408 15057 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.001s
I20260709 13:05:10.198179 16319 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:10.199486 15057 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:05:10.199841 15057 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602283040513-15057-0/minicluster-data/ts-2-root
uuid: "363bb2f744eb486f9ad726f08214c98e"
format_stamp: "Formatted at 2026-07-09 13:05:10 on dist-test-slave-r9m8"
I20260709 13:05:10.200191 15057 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602283040513-15057-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602283040513-15057-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602283040513-15057-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:10.220535 15057 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:10.221908 15057 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:10.223850 15057 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:10.226284 15057 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:10.226522 15057 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:10.226830 15057 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:10.227010 15057 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:10.270433 15057 rpc_server.cc:307] RPC server started. Bound to: 127.14.180.67:46107
I20260709 13:05:10.270748 16381 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.180.67:46107 every 8 connection(s)
I20260709 13:05:10.285998 16382 heartbeater.cc:344] Connected to a master server at 127.14.180.126:35965
I20260709 13:05:10.286427 16382 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:10.287389 16382 heartbeater.cc:507] Master 127.14.180.126:35965 requested a full tablet report, sending...
I20260709 13:05:10.289911 16106 ts_manager.cc:194] Registered new tserver with Master: 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:10.290690 15057 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016849355s
I20260709 13:05:10.291502 16106 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38842
I20260709 13:05:10.320211 16106 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38852:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:05:10.326433 16106 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:05:10.546007 16196 tablet_service.cc:1511] Processing CreateTablet for tablet 9dbc1db111e7466090abdb97a79d0d9b (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:05:10.546376 16195 tablet_service.cc:1511] Processing CreateTablet for tablet 8b615ac918a749989f2968826926adf3 (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:05:10.547892 16196 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dbc1db111e7466090abdb97a79d0d9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:10.548676 16198 tablet_service.cc:1511] Processing CreateTablet for tablet 19e573db44d24720b3a4805dc20210e8 (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:05:10.551661 16197 tablet_service.cc:1511] Processing CreateTablet for tablet 454d01f56c2d4533a035fdbc026c10b3 (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:05:10.555294 16194 tablet_service.cc:1511] Processing CreateTablet for tablet ae7bbe4140004c26b8f5f8b6b79c9b83 (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:05:10.557281 16198 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19e573db44d24720b3a4805dc20210e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:10.565321 16273 tablet_service.cc:1511] Processing CreateTablet for tablet 19e573db44d24720b3a4805dc20210e8 (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:05:10.566301 16195 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b615ac918a749989f2968826926adf3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:10.565968 16272 tablet_service.cc:1511] Processing CreateTablet for tablet 454d01f56c2d4533a035fdbc026c10b3 (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:05:10.566834 16273 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19e573db44d24720b3a4805dc20210e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:10.567600 16272 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 454d01f56c2d4533a035fdbc026c10b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:10.560510 16193 tablet_service.cc:1511] Processing CreateTablet for tablet 552b1776c27a48c194068de522fa45b6 (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:05:10.571527 16193 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 552b1776c27a48c194068de522fa45b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:10.578043 16194 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae7bbe4140004c26b8f5f8b6b79c9b83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:10.579370 16271 tablet_service.cc:1511] Processing CreateTablet for tablet 9dbc1db111e7466090abdb97a79d0d9b (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:05:10.580832 16271 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dbc1db111e7466090abdb97a79d0d9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:10.581641 16197 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 454d01f56c2d4533a035fdbc026c10b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:10.582831 16266 tablet_service.cc:1511] Processing CreateTablet for tablet 4f72b5892c874917882ef9ee926ce439 (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:05:10.583838 16270 tablet_service.cc:1511] Processing CreateTablet for tablet 8b615ac918a749989f2968826926adf3 (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:05:10.584404 16266 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f72b5892c874917882ef9ee926ce439. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:10.585275 16270 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b615ac918a749989f2968826926adf3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:10.587816 16269 tablet_service.cc:1511] Processing CreateTablet for tablet ae7bbe4140004c26b8f5f8b6b79c9b83 (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:05:10.589342 16269 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae7bbe4140004c26b8f5f8b6b79c9b83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:10.591723 16268 tablet_service.cc:1511] Processing CreateTablet for tablet 552b1776c27a48c194068de522fa45b6 (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:05:10.593237 16268 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 552b1776c27a48c194068de522fa45b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:10.594899 16265 tablet_service.cc:1511] Processing CreateTablet for tablet c824093f8d374c1b9f3c8a6e8e711157 (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:05:10.596379 16265 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c824093f8d374c1b9f3c8a6e8e711157. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:10.599750 16267 tablet_service.cc:1511] Processing CreateTablet for tablet 52982fc727d3451e9c722e63eb4d79ef (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:05:10.601361 16267 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52982fc727d3451e9c722e63eb4d79ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:10.603879 16192 tablet_service.cc:1511] Processing CreateTablet for tablet 52982fc727d3451e9c722e63eb4d79ef (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:05:10.605494 16192 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52982fc727d3451e9c722e63eb4d79ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:10.607913 16191 tablet_service.cc:1511] Processing CreateTablet for tablet 4f72b5892c874917882ef9ee926ce439 (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:05:10.610605 16190 tablet_service.cc:1511] Processing CreateTablet for tablet c824093f8d374c1b9f3c8a6e8e711157 (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:05:10.613201 16189 tablet_service.cc:1511] Processing CreateTablet for tablet 862e96f5785248c58d0355cac229fc05 (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:05:10.615845 16264 tablet_service.cc:1511] Processing CreateTablet for tablet 862e96f5785248c58d0355cac229fc05 (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:05:10.617409 16264 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 862e96f5785248c58d0355cac229fc05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:10.626070 16191 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f72b5892c874917882ef9ee926ce439. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:10.628082 16190 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c824093f8d374c1b9f3c8a6e8e711157. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:10.629750 16189 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 862e96f5785248c58d0355cac229fc05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:10.688164 16266 tablet_service.cc:1511] Processing CreateTablet for tablet 7877d879c7564adfac82b8387dbbc867 (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:05:10.689716 16266 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7877d879c7564adfac82b8387dbbc867. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:10.708659 16198 tablet_service.cc:1511] Processing CreateTablet for tablet 7877d879c7564adfac82b8387dbbc867 (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:05:10.710232 16198 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7877d879c7564adfac82b8387dbbc867. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:10.734776 16346 tablet_service.cc:1511] Processing CreateTablet for tablet 454d01f56c2d4533a035fdbc026c10b3 (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:05:10.736205 16346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 454d01f56c2d4533a035fdbc026c10b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:10.730212 16342 tablet_service.cc:1511] Processing CreateTablet for tablet 552b1776c27a48c194068de522fa45b6 (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:05:10.739933 16342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 552b1776c27a48c194068de522fa45b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:10.720829 16347 tablet_service.cc:1511] Processing CreateTablet for tablet 19e573db44d24720b3a4805dc20210e8 (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:05:10.743587 16347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19e573db44d24720b3a4805dc20210e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:10.723872 16345 tablet_service.cc:1511] Processing CreateTablet for tablet 9dbc1db111e7466090abdb97a79d0d9b (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:05:10.745638 16192 tablet_service.cc:1511] Processing CreateTablet for tablet 40719878febd41f9b57c9a6992d4431b (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:05:10.747233 16192 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40719878febd41f9b57c9a6992d4431b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:10.728088 16343 tablet_service.cc:1511] Processing CreateTablet for tablet ae7bbe4140004c26b8f5f8b6b79c9b83 (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:05:10.732023 16341 tablet_service.cc:1511] Processing CreateTablet for tablet 52982fc727d3451e9c722e63eb4d79ef (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:05:10.733973 16340 tablet_service.cc:1511] Processing CreateTablet for tablet 4f72b5892c874917882ef9ee926ce439 (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:05:10.725971 16344 tablet_service.cc:1511] Processing CreateTablet for tablet 8b615ac918a749989f2968826926adf3 (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:05:10.750880 16345 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dbc1db111e7466090abdb97a79d0d9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:10.750768 16265 tablet_service.cc:1511] Processing CreateTablet for tablet 40719878febd41f9b57c9a6992d4431b (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:05:10.750675 16189 tablet_service.cc:1511] Processing CreateTablet for tablet fd2e2dfe8dc4456ab39d1a4d6f6416b7 (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:05:10.753029 16339 tablet_service.cc:1511] Processing CreateTablet for tablet c824093f8d374c1b9f3c8a6e8e711157 (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:05:10.755426 16196 tablet_service.cc:1511] Processing CreateTablet for tablet 73757c6fea8949e090aa4e55902a41d4 (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:05:10.755353 16338 tablet_service.cc:1511] Processing CreateTablet for tablet 862e96f5785248c58d0355cac229fc05 (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:05:10.772905 16343 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae7bbe4140004c26b8f5f8b6b79c9b83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:10.773398 16397 tablet_bootstrap.cc:492] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3: Bootstrap starting.
I20260709 13:05:10.774993 16189 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd2e2dfe8dc4456ab39d1a4d6f6416b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:10.778007 16272 tablet_service.cc:1511] Processing CreateTablet for tablet fd2e2dfe8dc4456ab39d1a4d6f6416b7 (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:05:10.780166 16344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b615ac918a749989f2968826926adf3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:10.781885 16341 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52982fc727d3451e9c722e63eb4d79ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:10.787472 16197 tablet_service.cc:1511] Processing CreateTablet for tablet 26565509c81343bc818483042146461a (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:05:10.787647 16195 tablet_service.cc:1511] Processing CreateTablet for tablet 5063fcda38c2468a8dad5d01023b700a (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:05:10.788978 16197 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26565509c81343bc818483042146461a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:10.802785 16266 tablet_service.cc:1511] Processing CreateTablet for tablet 73757c6fea8949e090aa4e55902a41d4 (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:05:10.789660 16265 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40719878febd41f9b57c9a6992d4431b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:10.792065 16397 tablet_bootstrap.cc:654] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:10.795779 16194 tablet_service.cc:1511] Processing CreateTablet for tablet 16a307cee8ef431184c620fec029af19 (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:05:10.795105 16193 tablet_service.cc:1511] Processing CreateTablet for tablet 888479daeaaa4744a161f6b45bb257f6 (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:05:10.797835 16190 tablet_service.cc:1511] Processing CreateTablet for tablet 186b9e9483624c769871a8894ee07efa (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:05:10.810901 16266 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73757c6fea8949e090aa4e55902a41d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:10.823112 16272 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd2e2dfe8dc4456ab39d1a4d6f6416b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:10.833469 16273 tablet_service.cc:1511] Processing CreateTablet for tablet 5063fcda38c2468a8dad5d01023b700a (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:05:10.834889 16273 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5063fcda38c2468a8dad5d01023b700a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:10.829663 16195 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5063fcda38c2468a8dad5d01023b700a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:10.836236 16193 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 888479daeaaa4744a161f6b45bb257f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:10.837011 16194 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16a307cee8ef431184c620fec029af19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:10.837842 16269 tablet_service.cc:1511] Processing CreateTablet for tablet 26565509c81343bc818483042146461a (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:05:10.839213 16269 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26565509c81343bc818483042146461a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:10.839597 16198 tablet_service.cc:1511] Processing CreateTablet for tablet 4b962ceebb5c48c1914459ae0c0eff1b (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:05:10.840894 16198 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b962ceebb5c48c1914459ae0c0eff1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:10.843875 16338 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 862e96f5785248c58d0355cac229fc05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:10.845857 16270 tablet_service.cc:1511] Processing CreateTablet for tablet 186b9e9483624c769871a8894ee07efa (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:05:10.847297 16340 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f72b5892c874917882ef9ee926ce439. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:10.871574 16197 tablet_service.cc:1511] Processing CreateTablet for tablet 916cdb289e9442b69dd8ed0c99eb8198 (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:05:10.872166 16339 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c824093f8d374c1b9f3c8a6e8e711157. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:10.850015 16346 tablet_service.cc:1511] Processing CreateTablet for tablet 7877d879c7564adfac82b8387dbbc867 (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:05:10.852932 16271 tablet_service.cc:1511] Processing CreateTablet for tablet 916cdb289e9442b69dd8ed0c99eb8198 (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:05:10.854173 16264 tablet_service.cc:1511] Processing CreateTablet for tablet 4b962ceebb5c48c1914459ae0c0eff1b (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:05:10.854878 16190 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 186b9e9483624c769871a8894ee07efa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:10.826494 16268 tablet_service.cc:1511] Processing CreateTablet for tablet 16a307cee8ef431184c620fec029af19 (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:05:10.861130 16266 tablet_service.cc:1511] Processing CreateTablet for tablet 39dd6382a0304387a1341bcc36471cbf (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:05:10.878518 16346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7877d879c7564adfac82b8387dbbc867. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:05:10.881121 16154 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:10.870923 16267 tablet_service.cc:1511] Processing CreateTablet for tablet 888479daeaaa4744a161f6b45bb257f6 (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:05:10.891752 16196 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73757c6fea8949e090aa4e55902a41d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:10.894888 16347 tablet_service.cc:1511] Processing CreateTablet for tablet 40719878febd41f9b57c9a6992d4431b (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:05:10.896757 16347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40719878febd41f9b57c9a6992d4431b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:10.903398 16266 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39dd6382a0304387a1341bcc36471cbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:10.907125 16398 tablet_bootstrap.cc:492] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f: Bootstrap starting.
I20260709 13:05:10.909618 16192 tablet_service.cc:1511] Processing CreateTablet for tablet 39dd6382a0304387a1341bcc36471cbf (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:05:10.907200 16267 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 888479daeaaa4744a161f6b45bb257f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:10.911258 16268 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16a307cee8ef431184c620fec029af19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:10.916949 16397 tablet_bootstrap.cc:492] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3: No bootstrap required, opened a new log
I20260709 13:05:10.917497 16397 ts_tablet_manager.cc:1403] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3: Time spent bootstrapping tablet: real 0.144s	user 0.016s	sys 0.000s
I20260709 13:05:10.918476 16342 tablet_service.cc:1511] Processing CreateTablet for tablet 73757c6fea8949e090aa4e55902a41d4 (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:05:10.935460 16342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73757c6fea8949e090aa4e55902a41d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:10.936247 16400 tablet_bootstrap.cc:492] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e: Bootstrap starting.
I20260709 13:05:10.923946 16191 tablet_service.cc:1511] Processing CreateTablet for tablet aee913c41fb9437587affa768953f637 (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:05:10.940881 16264 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b962ceebb5c48c1914459ae0c0eff1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:10.927277 16265 tablet_service.cc:1511] Processing CreateTablet for tablet aee913c41fb9437587affa768953f637 (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:05:10.922398 16341 tablet_service.cc:1511] Processing CreateTablet for tablet fd2e2dfe8dc4456ab39d1a4d6f6416b7 (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:05:10.943143 16341 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd2e2dfe8dc4456ab39d1a4d6f6416b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:10.943569 16271 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 916cdb289e9442b69dd8ed0c99eb8198. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:10.945170 16270 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 186b9e9483624c769871a8894ee07efa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:10.963557 16265 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aee913c41fb9437587affa768953f637. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:10.930505 16397 raft_consensus.cc:359] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:10.966924 16397 raft_consensus.cc:385] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:10.967366 16397 raft_consensus.cc:740] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Initialized, Role: FOLLOWER
I20260709 13:05:10.967666 16400 tablet_bootstrap.cc:654] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:10.919239 16197 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 916cdb289e9442b69dd8ed0c99eb8198. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:10.969570 16192 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39dd6382a0304387a1341bcc36471cbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:10.977519 16191 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aee913c41fb9437587affa768953f637. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:10.981673 16398 tablet_bootstrap.cc:654] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:10.986707 16397 consensus_queue.cc:260] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:10.935498 16343 tablet_service.cc:1511] Processing CreateTablet for tablet 5063fcda38c2468a8dad5d01023b700a (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:05:10.991544 16343 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5063fcda38c2468a8dad5d01023b700a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:10.991899 16345 tablet_service.cc:1511] Processing CreateTablet for tablet 888479daeaaa4744a161f6b45bb257f6 (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:05:10.992781 16190 tablet_service.cc:1511] Processing CreateTablet for tablet a054979193cb43dcba8c8eb72cd7f05d (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:05:10.993499 16345 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 888479daeaaa4744a161f6b45bb257f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:10.994274 16190 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a054979193cb43dcba8c8eb72cd7f05d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.004691 16196 tablet_service.cc:1511] Processing CreateTablet for tablet 13bc3c8ff9b84838a2664335d7e1582b (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:05:11.005010 16193 tablet_service.cc:1511] Processing CreateTablet for tablet eeda5ee833164deb9ec027b22371793c (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:05:11.021147 16268 tablet_service.cc:1511] Processing CreateTablet for tablet a054979193cb43dcba8c8eb72cd7f05d (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:05:11.022742 16268 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a054979193cb43dcba8c8eb72cd7f05d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.027472 16269 tablet_service.cc:1511] Processing CreateTablet for tablet 13bc3c8ff9b84838a2664335d7e1582b (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:05:11.028885 16269 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13bc3c8ff9b84838a2664335d7e1582b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.031489 16194 tablet_service.cc:1511] Processing CreateTablet for tablet 38b024fb12204d9b9e35d72638671c24 (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:05:11.031618 16339 tablet_service.cc:1511] Processing CreateTablet for tablet 916cdb289e9442b69dd8ed0c99eb8198 (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:05:11.033313 16339 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 916cdb289e9442b69dd8ed0c99eb8198. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.033074 16338 tablet_service.cc:1511] Processing CreateTablet for tablet 186b9e9483624c769871a8894ee07efa (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:05:11.034423 16338 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 186b9e9483624c769871a8894ee07efa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.035214 16196 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13bc3c8ff9b84838a2664335d7e1582b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.039063 16189 tablet_service.cc:1511] Processing CreateTablet for tablet a1a76ba8ceae4d0780583a09087cec0a (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:05:11.039891 16193 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eeda5ee833164deb9ec027b22371793c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.041497 16189 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1a76ba8ceae4d0780583a09087cec0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.042511 16273 tablet_service.cc:1511] Processing CreateTablet for tablet eeda5ee833164deb9ec027b22371793c (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:05:11.043848 16346 tablet_service.cc:1511] Processing CreateTablet for tablet 4b962ceebb5c48c1914459ae0c0eff1b (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:05:11.017884 16344 tablet_service.cc:1511] Processing CreateTablet for tablet 16a307cee8ef431184c620fec029af19 (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:05:11.043833 16273 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eeda5ee833164deb9ec027b22371793c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.057209 16195 tablet_service.cc:1511] Processing CreateTablet for tablet bb3b9c4ba1f147fc8d9858234bfce423 (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:05:11.059501 16267 tablet_service.cc:1511] Processing CreateTablet for tablet 38b024fb12204d9b9e35d72638671c24 (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:05:11.060942 16267 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38b024fb12204d9b9e35d72638671c24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:10.986299 16340 tablet_service.cc:1511] Processing CreateTablet for tablet 26565509c81343bc818483042146461a (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:05:11.043833 16194 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38b024fb12204d9b9e35d72638671c24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.074854 16346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b962ceebb5c48c1914459ae0c0eff1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.082644 16195 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb3b9c4ba1f147fc8d9858234bfce423. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.084578 16233 heartbeater.cc:499] Master 127.14.180.126:35965 was elected leader, sending a full tablet report...
I20260709 13:05:11.086751 16347 tablet_service.cc:1511] Processing CreateTablet for tablet a054979193cb43dcba8c8eb72cd7f05d (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:05:11.090342 16272 tablet_service.cc:1511] Processing CreateTablet for tablet bb3b9c4ba1f147fc8d9858234bfce423 (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:05:11.095062 16403 raft_consensus.cc:493] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:11.103241 16403 raft_consensus.cc:515] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:11.106033 16403 leader_election.cc:290] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:11.095203 16308 heartbeater.cc:499] Master 127.14.180.126:35965 was elected leader, sending a full tablet report...
I20260709 13:05:11.108084 16344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16a307cee8ef431184c620fec029af19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.110880 16340 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26565509c81343bc818483042146461a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.094726 16198 tablet_service.cc:1511] Processing CreateTablet for tablet 7295dce0baa440b8a197da845581ee81 (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:05:11.111912 16198 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7295dce0baa440b8a197da845581ee81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.096089 16197 tablet_service.cc:1511] Processing CreateTablet for tablet c7d554054f014c74992a2a66ff6873cd (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:05:11.116858 16347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a054979193cb43dcba8c8eb72cd7f05d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.117149 16197 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7d554054f014c74992a2a66ff6873cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.098829 16272 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb3b9c4ba1f147fc8d9858234bfce423. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.145947 16397 ts_tablet_manager.cc:1434] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3: Time spent starting tablet: real 0.228s	user 0.018s	sys 0.004s
I20260709 13:05:11.147673 16397 tablet_bootstrap.cc:492] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3: Bootstrap starting.
I20260709 13:05:11.067565 16266 tablet_service.cc:1511] Processing CreateTablet for tablet a1a76ba8ceae4d0780583a09087cec0a (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:05:11.151911 16266 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1a76ba8ceae4d0780583a09087cec0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.160089 16342 tablet_service.cc:1511] Processing CreateTablet for tablet 39dd6382a0304387a1341bcc36471cbf (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:05:11.161717 16342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39dd6382a0304387a1341bcc36471cbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.171187 16400 tablet_bootstrap.cc:492] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e: No bootstrap required, opened a new log
I20260709 13:05:11.171739 16400 ts_tablet_manager.cc:1403] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e: Time spent bootstrapping tablet: real 0.236s	user 0.011s	sys 0.017s
I20260709 13:05:11.172611 16195 tablet_service.cc:1511] Processing CreateTablet for tablet eafb6ab8cb0c42309ea6508e0ad9b9ef (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:05:11.174095 16195 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eafb6ab8cb0c42309ea6508e0ad9b9ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.176831 16264 tablet_service.cc:1511] Processing CreateTablet for tablet c7d554054f014c74992a2a66ff6873cd (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:05:11.200546 16192 tablet_service.cc:1511] Processing CreateTablet for tablet 1356ff4c060346359eb10723422e972a (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:05:11.202052 16192 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1356ff4c060346359eb10723422e972a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.201555 16265 tablet_service.cc:1511] Processing CreateTablet for tablet 1356ff4c060346359eb10723422e972a (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:05:11.204363 16265 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1356ff4c060346359eb10723422e972a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.221612 16341 tablet_service.cc:1511] Processing CreateTablet for tablet 13bc3c8ff9b84838a2664335d7e1582b (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:05:11.185875 16268 tablet_service.cc:1511] Processing CreateTablet for tablet 7295dce0baa440b8a197da845581ee81 (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:05:11.193516 16400 raft_consensus.cc:359] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } }
I20260709 13:05:11.191318 16270 tablet_service.cc:1511] Processing CreateTablet for tablet eafb6ab8cb0c42309ea6508e0ad9b9ef (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:05:11.181989 16339 tablet_service.cc:1511] Processing CreateTablet for tablet aee913c41fb9437587affa768953f637 (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:05:11.224465 16400 raft_consensus.cc:385] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:11.249096 16338 tablet_service.cc:1511] Processing CreateTablet for tablet eeda5ee833164deb9ec027b22371793c (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:05:11.260275 16190 tablet_service.cc:1511] Processing CreateTablet for tablet b241405f79a345849ba216394fcb999a (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:05:11.261780 16190 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b241405f79a345849ba216394fcb999a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.251358 16271 tablet_service.cc:1511] Processing CreateTablet for tablet a7ce522fbeb44228a8c05d5ceeadc347 (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:05:11.253723 16343 tablet_service.cc:1511] Processing CreateTablet for tablet 38b024fb12204d9b9e35d72638671c24 (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:05:11.237709 16400 raft_consensus.cc:740] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Initialized, Role: FOLLOWER
I20260709 13:05:11.265605 16400 consensus_queue.cc:260] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } }
I20260709 13:05:11.269371 16273 tablet_service.cc:1511] Processing CreateTablet for tablet b241405f79a345849ba216394fcb999a (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:05:11.281126 16341 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13bc3c8ff9b84838a2664335d7e1582b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.289389 16339 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aee913c41fb9437587affa768953f637. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.289145 16345 tablet_service.cc:1511] Processing CreateTablet for tablet a1a76ba8ceae4d0780583a09087cec0a (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:05:11.283560 16191 tablet_service.cc:1511] Processing CreateTablet for tablet f022e2e63ae4461d834e476ff2666991 (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:05:11.243311 16264 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7d554054f014c74992a2a66ff6873cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.293668 16382 heartbeater.cc:499] Master 127.14.180.126:35965 was elected leader, sending a full tablet report...
I20260709 13:05:11.295024 16400 ts_tablet_manager.cc:1434] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e: Time spent starting tablet: real 0.123s	user 0.011s	sys 0.002s
I20260709 13:05:11.336998 16191 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f022e2e63ae4461d834e476ff2666991. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.302963 16338 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eeda5ee833164deb9ec027b22371793c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.338376 16343 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38b024fb12204d9b9e35d72638671c24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.306336 16342 tablet_service.cc:1511] Processing CreateTablet for tablet c7d554054f014c74992a2a66ff6873cd (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:05:11.323975 16196 tablet_service.cc:1511] Processing CreateTablet for tablet a7ce522fbeb44228a8c05d5ceeadc347 (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:05:11.325752 16270 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eafb6ab8cb0c42309ea6508e0ad9b9ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.348273 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:11.336759 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:05:11.350525 16248 leader_election.cc:343] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:11.354943 16271 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7ce522fbeb44228a8c05d5ceeadc347. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.300273 16347 tablet_service.cc:1511] Processing CreateTablet for tablet bb3b9c4ba1f147fc8d9858234bfce423 (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:05:11.348664 16196 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7ce522fbeb44228a8c05d5ceeadc347. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.347500 16342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7d554054f014c74992a2a66ff6873cd. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:05:11.360895 16246 leader_election.cc:343] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:11.361434 16246 leader_election.cc:304] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:11.340884 16400 tablet_bootstrap.cc:492] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e: Bootstrap starting.
I20260709 13:05:11.362311 16403 raft_consensus.cc:2749] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:11.363155 16273 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b241405f79a345849ba216394fcb999a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.378443 16193 tablet_service.cc:1511] Processing CreateTablet for tablet 5c2f49b7f95a4153b2d180218e6af1db (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:05:11.379998 16193 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c2f49b7f95a4153b2d180218e6af1db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.281956 16189 tablet_service.cc:1511] Processing CreateTablet for tablet 98afc5914978455ba8cc5329152a3f1d (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:05:11.382064 16189 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98afc5914978455ba8cc5329152a3f1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.365810 16345 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1a76ba8ceae4d0780583a09087cec0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.366770 16408 raft_consensus.cc:493] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:11.382931 16408 raft_consensus.cc:515] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } }
I20260709 13:05:11.383850 16340 tablet_service.cc:1511] Processing CreateTablet for tablet eafb6ab8cb0c42309ea6508e0ad9b9ef (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:05:11.384940 16268 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7295dce0baa440b8a197da845581ee81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.390969 16344 tablet_service.cc:1511] Processing CreateTablet for tablet 1356ff4c060346359eb10723422e972a (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:05:11.391925 16408 leader_election.cc:290] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:11.365309 16269 tablet_service.cc:1511] Processing CreateTablet for tablet 98afc5914978455ba8cc5329152a3f1d (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:05:11.401970 16269 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98afc5914978455ba8cc5329152a3f1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.408501 16397 tablet_bootstrap.cc:654] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:11.408928 16340 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eafb6ab8cb0c42309ea6508e0ad9b9ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.414958 16347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb3b9c4ba1f147fc8d9858234bfce423. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.418951 16344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1356ff4c060346359eb10723422e972a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.419173 16266 tablet_service.cc:1511] Processing CreateTablet for tablet 5c2f49b7f95a4153b2d180218e6af1db (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:05:11.420802 16266 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c2f49b7f95a4153b2d180218e6af1db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.366196 16272 tablet_service.cc:1511] Processing CreateTablet for tablet f022e2e63ae4461d834e476ff2666991 (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:05:11.369304 16400 tablet_bootstrap.cc:654] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:11.371834 16346 tablet_service.cc:1511] Processing CreateTablet for tablet 7295dce0baa440b8a197da845581ee81 (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:05:11.364670 16398 tablet_bootstrap.cc:492] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f: No bootstrap required, opened a new log
I20260709 13:05:11.438977 16398 ts_tablet_manager.cc:1403] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f: Time spent bootstrapping tablet: real 0.532s	user 0.026s	sys 0.011s
I20260709 13:05:11.443197 16346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7295dce0baa440b8a197da845581ee81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.442312 16398 raft_consensus.cc:359] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:11.456789 16398 raft_consensus.cc:385] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:11.457134 16398 raft_consensus.cc:740] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Initialized, Role: FOLLOWER
I20260709 13:05:11.458168 16398 consensus_queue.cc:260] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:11.478873 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:05:11.480867 16320 leader_election.cc:343] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:11.482409 16339 tablet_service.cc:1511] Processing CreateTablet for tablet a7ce522fbeb44228a8c05d5ceeadc347 (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:05:11.483969 16339 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7ce522fbeb44228a8c05d5ceeadc347. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.480532 16338 tablet_service.cc:1511] Processing CreateTablet for tablet b241405f79a345849ba216394fcb999a (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:05:11.486756 16272 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f022e2e63ae4461d834e476ff2666991. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.486485 16194 tablet_service.cc:1511] Processing CreateTablet for tablet 176e2f21e86a4e54a8d9a21aef8a272f (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:05:11.488067 16194 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 176e2f21e86a4e54a8d9a21aef8a272f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.495144 16338 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b241405f79a345849ba216394fcb999a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.496867 16341 tablet_service.cc:1511] Processing CreateTablet for tablet 98afc5914978455ba8cc5329152a3f1d (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:05:11.497401 16397 tablet_bootstrap.cc:492] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3: No bootstrap required, opened a new log
I20260709 13:05:11.502616 16397 ts_tablet_manager.cc:1403] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3: Time spent bootstrapping tablet: real 0.355s	user 0.017s	sys 0.000s
I20260709 13:05:11.505966 16341 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98afc5914978455ba8cc5329152a3f1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.512331 16340 tablet_service.cc:1511] Processing CreateTablet for tablet f022e2e63ae4461d834e476ff2666991 (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:05:11.529881 16340 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f022e2e63ae4461d834e476ff2666991. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.588017 16343 tablet_service.cc:1511] Processing CreateTablet for tablet 5c2f49b7f95a4153b2d180218e6af1db (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:05:11.589540 16343 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c2f49b7f95a4153b2d180218e6af1db. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:05:11.589809 16092 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 76626us
W20260709 13:05:11.592109 16090 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 55458.2us
I20260709 13:05:11.592255 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:11.592386 16270 tablet_service.cc:1511] Processing CreateTablet for tablet 176e2f21e86a4e54a8d9a21aef8a272f (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:05:11.593827 16270 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 176e2f21e86a4e54a8d9a21aef8a272f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:05:11.597947 16322 leader_election.cc:343] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:11.598531 16322 leader_election.cc:304] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:11.599828 16408 raft_consensus.cc:2749] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:11.604363 16342 tablet_service.cc:1511] Processing CreateTablet for tablet 176e2f21e86a4e54a8d9a21aef8a272f (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:05:11.605859 16342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 176e2f21e86a4e54a8d9a21aef8a272f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.607750 16190 tablet_service.cc:1511] Processing CreateTablet for tablet ccde1e8182914560a3c1df0312e6a2b2 (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:05:11.609230 16190 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccde1e8182914560a3c1df0312e6a2b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.611754 16397 raft_consensus.cc:359] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:11.611774 16189 tablet_service.cc:1511] Processing CreateTablet for tablet 5054b6ad2e4141cab2232a3fecd7c858 (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:05:11.613929 16398 ts_tablet_manager.cc:1434] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f: Time spent starting tablet: real 0.174s	user 0.013s	sys 0.003s
I20260709 13:05:11.615104 16398 tablet_bootstrap.cc:492] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f: Bootstrap starting.
I20260709 13:05:11.614106 16189 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5054b6ad2e4141cab2232a3fecd7c858. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.612610 16397 raft_consensus.cc:385] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:11.615861 16397 raft_consensus.cc:740] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Initialized, Role: FOLLOWER
I20260709 13:05:11.616775 16397 consensus_queue.cc:260] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:11.628355 16271 tablet_service.cc:1511] Processing CreateTablet for tablet 5054b6ad2e4141cab2232a3fecd7c858 (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:05:11.629894 16271 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5054b6ad2e4141cab2232a3fecd7c858. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.639726 16194 tablet_service.cc:1511] Processing CreateTablet for tablet 540bfc4ad793452faea5b865343aacf7 (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:05:11.641245 16194 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 540bfc4ad793452faea5b865343aacf7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.644306 16397 ts_tablet_manager.cc:1434] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3: Time spent starting tablet: real 0.141s	user 0.008s	sys 0.005s
I20260709 13:05:11.643110 16400 tablet_bootstrap.cc:492] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e: No bootstrap required, opened a new log
I20260709 13:05:11.645051 16400 ts_tablet_manager.cc:1403] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e: Time spent bootstrapping tablet: real 0.304s	user 0.023s	sys 0.006s
I20260709 13:05:11.655733 16264 tablet_service.cc:1511] Processing CreateTablet for tablet ccde1e8182914560a3c1df0312e6a2b2 (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:05:11.657473 16264 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccde1e8182914560a3c1df0312e6a2b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.659670 16400 raft_consensus.cc:359] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:11.665971 16400 raft_consensus.cc:385] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:11.667622 16400 raft_consensus.cc:740] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Initialized, Role: FOLLOWER
I20260709 13:05:11.661181 16398 tablet_bootstrap.cc:654] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:11.645355 16397 tablet_bootstrap.cc:492] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3: Bootstrap starting.
I20260709 13:05:11.671973 16400 consensus_queue.cc:260] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:11.699004 16340 tablet_service.cc:1511] Processing CreateTablet for tablet 5054b6ad2e4141cab2232a3fecd7c858 (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:05:11.701254 16265 tablet_service.cc:1511] Processing CreateTablet for tablet 540bfc4ad793452faea5b865343aacf7 (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:05:11.707526 16265 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 540bfc4ad793452faea5b865343aacf7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.712291 16191 tablet_service.cc:1511] Processing CreateTablet for tablet 8cabbc283ea543459d45ebdb8b6add94 (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:05:11.713922 16191 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cabbc283ea543459d45ebdb8b6add94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.712401 16344 tablet_service.cc:1511] Processing CreateTablet for tablet ccde1e8182914560a3c1df0312e6a2b2 (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:05:11.704257 16397 tablet_bootstrap.cc:654] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:11.722234 16398 tablet_bootstrap.cc:492] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f: No bootstrap required, opened a new log
I20260709 13:05:11.722842 16398 ts_tablet_manager.cc:1403] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f: Time spent bootstrapping tablet: real 0.108s	user 0.014s	sys 0.000s
I20260709 13:05:11.723217 16345 tablet_service.cc:1511] Processing CreateTablet for tablet 540bfc4ad793452faea5b865343aacf7 (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:05:11.725430 16400 ts_tablet_manager.cc:1434] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e: Time spent starting tablet: real 0.071s	user 0.008s	sys 0.003s
I20260709 13:05:11.716905 16344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccde1e8182914560a3c1df0312e6a2b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.729470 16345 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 540bfc4ad793452faea5b865343aacf7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.729873 16400 tablet_bootstrap.cc:492] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e: Bootstrap starting.
I20260709 13:05:11.730407 16340 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5054b6ad2e4141cab2232a3fecd7c858. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.737914 16272 tablet_service.cc:1511] Processing CreateTablet for tablet 8cabbc283ea543459d45ebdb8b6add94 (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:05:11.739408 16272 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cabbc283ea543459d45ebdb8b6add94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.745958 16194 tablet_service.cc:1511] Processing CreateTablet for tablet d9c15d8e9be8414c84912ab77b66bfb1 (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:05:11.747300 16270 tablet_service.cc:1511] Processing CreateTablet for tablet d9c15d8e9be8414c84912ab77b66bfb1 (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:05:11.754244 16270 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9c15d8e9be8414c84912ab77b66bfb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.726043 16398 raft_consensus.cc:359] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } }
I20260709 13:05:11.759058 16398 raft_consensus.cc:385] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:11.759423 16398 raft_consensus.cc:740] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Initialized, Role: FOLLOWER
I20260709 13:05:11.759970 16194 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9c15d8e9be8414c84912ab77b66bfb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.760347 16398 consensus_queue.cc:260] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } }
I20260709 13:05:11.762049 16339 tablet_service.cc:1511] Processing CreateTablet for tablet 8cabbc283ea543459d45ebdb8b6add94 (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:05:11.763420 16339 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cabbc283ea543459d45ebdb8b6add94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.764070 16403 raft_consensus.cc:493] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:11.764570 16403 raft_consensus.cc:515] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:11.751194 16400 tablet_bootstrap.cc:654] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:11.766964 16403 leader_election.cc:290] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:11.769172 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:11.769881 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:05:11.770826 16248 leader_election.cc:343] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:11.771493 16246 leader_election.cc:343] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:11.771979 16246 leader_election.cc:304] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:11.772590 16398 ts_tablet_manager.cc:1434] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f: Time spent starting tablet: real 0.049s	user 0.003s	sys 0.004s
I20260709 13:05:11.773183 16397 tablet_bootstrap.cc:492] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3: No bootstrap required, opened a new log
I20260709 13:05:11.773706 16397 ts_tablet_manager.cc:1403] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3: Time spent bootstrapping tablet: real 0.129s	user 0.013s	sys 0.000s
I20260709 13:05:11.774911 16403 raft_consensus.cc:2749] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:11.778633 16189 tablet_service.cc:1511] Processing CreateTablet for tablet b9e1324823f04d8da5a4b3ddbd061c0e (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:05:11.780834 16189 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9e1324823f04d8da5a4b3ddbd061c0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.778945 16397 raft_consensus.cc:359] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:11.782014 16397 raft_consensus.cc:385] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:11.785194 16397 raft_consensus.cc:740] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Initialized, Role: FOLLOWER
I20260709 13:05:11.790820 16397 consensus_queue.cc:260] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:11.780754 16338 tablet_service.cc:1511] Processing CreateTablet for tablet d9c15d8e9be8414c84912ab77b66bfb1 (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:05:11.800684 16341 tablet_service.cc:1511] Processing CreateTablet for tablet b9e1324823f04d8da5a4b3ddbd061c0e (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:05:11.803225 16397 ts_tablet_manager.cc:1434] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3: Time spent starting tablet: real 0.029s	user 0.010s	sys 0.000s
I20260709 13:05:11.807444 16265 tablet_service.cc:1511] Processing CreateTablet for tablet b9e1324823f04d8da5a4b3ddbd061c0e (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:05:11.808949 16265 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9e1324823f04d8da5a4b3ddbd061c0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.811460 16397 tablet_bootstrap.cc:492] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3: Bootstrap starting.
I20260709 13:05:11.819149 16398 tablet_bootstrap.cc:492] T 9dbc1db111e7466090abdb97a79d0d9b P e10b16d536674c0bb350a31d7ce5ff7f: Bootstrap starting.
I20260709 13:05:11.827117 16347 tablet_service.cc:1511] Processing CreateTablet for tablet 6759dbf6a6924fcc870cb52b4a5d7953 (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:05:11.830300 16264 tablet_service.cc:1511] Processing CreateTablet for tablet 143d3d1339b44b6dbdf204507b6af74b (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:05:11.831826 16264 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 143d3d1339b44b6dbdf204507b6af74b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.833388 16341 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9e1324823f04d8da5a4b3ddbd061c0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.830299 16191 tablet_service.cc:1511] Processing CreateTablet for tablet 143d3d1339b44b6dbdf204507b6af74b (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:05:11.836002 16191 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 143d3d1339b44b6dbdf204507b6af74b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.836406 16338 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9c15d8e9be8414c84912ab77b66bfb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.843824 16272 tablet_service.cc:1511] Processing CreateTablet for tablet 6759dbf6a6924fcc870cb52b4a5d7953 (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:05:11.845299 16272 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6759dbf6a6924fcc870cb52b4a5d7953. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.846493 16398 tablet_bootstrap.cc:654] T 9dbc1db111e7466090abdb97a79d0d9b P e10b16d536674c0bb350a31d7ce5ff7f: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:11.847358 16347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6759dbf6a6924fcc870cb52b4a5d7953. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.849336 16397 tablet_bootstrap.cc:654] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:11.867491 16400 tablet_bootstrap.cc:492] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e: No bootstrap required, opened a new log
I20260709 13:05:11.868065 16400 ts_tablet_manager.cc:1403] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e: Time spent bootstrapping tablet: real 0.142s	user 0.021s	sys 0.023s
I20260709 13:05:11.871094 16400 raft_consensus.cc:359] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:11.871876 16400 raft_consensus.cc:385] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:11.872304 16400 raft_consensus.cc:740] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Initialized, Role: FOLLOWER
I20260709 13:05:11.873633 16400 consensus_queue.cc:260] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:11.879230 16414 raft_consensus.cc:493] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:11.879979 16414 raft_consensus.cc:515] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:05:11.884502 16154 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:11.894273 16414 leader_election.cc:290] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:11.899848 16189 tablet_service.cc:1511] Processing CreateTablet for tablet 6759dbf6a6924fcc870cb52b4a5d7953 (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:05:11.901623 16400 ts_tablet_manager.cc:1434] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e: Time spent starting tablet: real 0.033s	user 0.008s	sys 0.000s
I20260709 13:05:11.915412 16194 tablet_service.cc:1511] Processing CreateTablet for tablet bc427ac4cc014a9c99e5731814bff30a (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:05:11.917870 16397 tablet_bootstrap.cc:492] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3: No bootstrap required, opened a new log
I20260709 13:05:11.917732 16343 tablet_service.cc:1511] Processing CreateTablet for tablet bc427ac4cc014a9c99e5731814bff30a (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:05:11.918427 16397 ts_tablet_manager.cc:1403] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3: Time spent bootstrapping tablet: real 0.107s	user 0.026s	sys 0.032s
I20260709 13:05:11.918869 16190 tablet_service.cc:1511] Processing CreateTablet for tablet b2275272882d4313a1ce1a8632a5819c (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:05:11.920058 16343 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc427ac4cc014a9c99e5731814bff30a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.920255 16272 tablet_service.cc:1511] Processing CreateTablet for tablet bc427ac4cc014a9c99e5731814bff30a (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:05:11.921693 16397 raft_consensus.cc:359] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } }
I20260709 13:05:11.911607 16189 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6759dbf6a6924fcc870cb52b4a5d7953. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.923130 16190 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2275272882d4313a1ce1a8632a5819c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.923861 16194 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc427ac4cc014a9c99e5731814bff30a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.927604 16339 tablet_service.cc:1511] Processing CreateTablet for tablet 143d3d1339b44b6dbdf204507b6af74b (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:05:11.922726 16272 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc427ac4cc014a9c99e5731814bff30a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.930789 16398 tablet_bootstrap.cc:492] T 9dbc1db111e7466090abdb97a79d0d9b P e10b16d536674c0bb350a31d7ce5ff7f: No bootstrap required, opened a new log
I20260709 13:05:11.936714 16400 tablet_bootstrap.cc:492] T 552b1776c27a48c194068de522fa45b6 P 363bb2f744eb486f9ad726f08214c98e: Bootstrap starting.
I20260709 13:05:11.936718 16265 tablet_service.cc:1511] Processing CreateTablet for tablet b2275272882d4313a1ce1a8632a5819c (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:05:11.946864 16265 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2275272882d4313a1ce1a8632a5819c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.922478 16397 raft_consensus.cc:385] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:11.949299 16397 raft_consensus.cc:740] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Initialized, Role: FOLLOWER
I20260709 13:05:11.950191 16397 consensus_queue.cc:260] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } }
I20260709 13:05:11.954341 16339 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 143d3d1339b44b6dbdf204507b6af74b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.955523 16341 tablet_service.cc:1511] Processing CreateTablet for tablet b2275272882d4313a1ce1a8632a5819c (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:05:11.956889 16341 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2275272882d4313a1ce1a8632a5819c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.959542 16191 tablet_service.cc:1511] Processing CreateTablet for tablet 47342899f1ed4c788d60ea4c5b52969a (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:05:11.961269 16264 tablet_service.cc:1511] Processing CreateTablet for tablet 47342899f1ed4c788d60ea4c5b52969a (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:05:11.961262 16191 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47342899f1ed4c788d60ea4c5b52969a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.963461 16397 ts_tablet_manager.cc:1434] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3: Time spent starting tablet: real 0.045s	user 0.007s	sys 0.000s
I20260709 13:05:11.964550 16397 tablet_bootstrap.cc:492] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3: Bootstrap starting.
I20260709 13:05:11.961458 16345 tablet_service.cc:1511] Processing CreateTablet for tablet 47342899f1ed4c788d60ea4c5b52969a (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:05:11.965044 16398 ts_tablet_manager.cc:1403] T 9dbc1db111e7466090abdb97a79d0d9b P e10b16d536674c0bb350a31d7ce5ff7f: Time spent bootstrapping tablet: real 0.146s	user 0.042s	sys 0.016s
I20260709 13:05:11.965873 16345 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47342899f1ed4c788d60ea4c5b52969a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.969147 16264 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47342899f1ed4c788d60ea4c5b52969a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.974736 16190 tablet_service.cc:1511] Processing CreateTablet for tablet cad5db410b3444caafa5090b94f02dba (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:05:11.968704 16398 raft_consensus.cc:359] T 9dbc1db111e7466090abdb97a79d0d9b P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:11.977272 16190 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cad5db410b3444caafa5090b94f02dba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.980957 16270 tablet_service.cc:1511] Processing CreateTablet for tablet cad5db410b3444caafa5090b94f02dba (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:05:11.983003 16270 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cad5db410b3444caafa5090b94f02dba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:11.987417 16403 raft_consensus.cc:493] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:11.983994 16408 raft_consensus.cc:493] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:11.987924 16403 raft_consensus.cc:515] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } }
I20260709 13:05:11.988701 16408 raft_consensus.cc:515] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:11.990250 16403 leader_election.cc:290] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:11.992013 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:05:11.994711 16320 leader_election.cc:343] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:11.982703 16398 raft_consensus.cc:385] T 9dbc1db111e7466090abdb97a79d0d9b P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.001067 16344 tablet_service.cc:1511] Processing CreateTablet for tablet cad5db410b3444caafa5090b94f02dba (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:05:12.002985 16398 raft_consensus.cc:740] T 9dbc1db111e7466090abdb97a79d0d9b P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.004354 16344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cad5db410b3444caafa5090b94f02dba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:12.004030 16196 tablet_service.cc:1511] Processing CreateTablet for tablet 42944699e5b24681aa3b54ef1010699d (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:05:12.014209 16400 tablet_bootstrap.cc:654] T 552b1776c27a48c194068de522fa45b6 P 363bb2f744eb486f9ad726f08214c98e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.022706 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:12.023306 16196 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42944699e5b24681aa3b54ef1010699d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:12.023497 16208 raft_consensus.cc:2468] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 0.
I20260709 13:05:12.024960 16246 leader_election.cc:304] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:12.025957 16403 raft_consensus.cc:2804] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:12.026397 16403 raft_consensus.cc:493] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:12.026811 16403 raft_consensus.cc:3060] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.001681 16408 leader_election.cc:290] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:12.016872 16273 tablet_service.cc:1511] Processing CreateTablet for tablet 42944699e5b24681aa3b54ef1010699d (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:05:12.031875 16273 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42944699e5b24681aa3b54ef1010699d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:12.038986 16408 raft_consensus.cc:493] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.039578 16408 raft_consensus.cc:515] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:12.042752 16398 consensus_queue.cc:260] T 9dbc1db111e7466090abdb97a79d0d9b P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:12.044999 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:12.045742 16283 raft_consensus.cc:2468] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 0.
I20260709 13:05:12.045048 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:12.045706 16408 leader_election.cc:290] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:05:12.048022 16320 leader_election.cc:343] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:12.048712 16397 tablet_bootstrap.cc:654] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.051357 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:12.052038 16357 raft_consensus.cc:2468] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 0.
I20260709 13:05:12.069536 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:12.069789 16322 leader_election.cc:304] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:12.070668 16408 raft_consensus.cc:2804] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:12.071062 16408 raft_consensus.cc:493] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:12.071434 16408 raft_consensus.cc:3060] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.074947 16398 ts_tablet_manager.cc:1434] T 9dbc1db111e7466090abdb97a79d0d9b P e10b16d536674c0bb350a31d7ce5ff7f: Time spent starting tablet: real 0.109s	user 0.005s	sys 0.003s
W20260709 13:05:12.076815 16322 leader_election.cc:343] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:12.077395 16322 leader_election.cc:304] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:12.074947 16194 tablet_service.cc:1511] Processing CreateTablet for tablet 0340758c689242c3979a434fa59589f7 (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:05:12.079064 16194 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0340758c689242c3979a434fa59589f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:12.082442 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:12.084515 16398 tablet_bootstrap.cc:492] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f: Bootstrap starting.
W20260709 13:05:12.084969 16173 leader_election.cc:343] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:12.088726 16408 raft_consensus.cc:515] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:12.093518 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
W20260709 13:05:12.095235 16320 leader_election.cc:343] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:12.069559 16403 raft_consensus.cc:515] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } }
I20260709 13:05:12.101542 16265 tablet_service.cc:1511] Processing CreateTablet for tablet 0340758c689242c3979a434fa59589f7 (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:05:12.103012 16265 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0340758c689242c3979a434fa59589f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:12.095136 16345 tablet_service.cc:1511] Processing CreateTablet for tablet 42944699e5b24681aa3b54ef1010699d (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:05:12.104684 16345 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42944699e5b24681aa3b54ef1010699d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:12.108438 16403 leader_election.cc:290] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:12.108855 16400 tablet_bootstrap.cc:492] T 552b1776c27a48c194068de522fa45b6 P 363bb2f744eb486f9ad726f08214c98e: No bootstrap required, opened a new log
I20260709 13:05:12.109328 16400 ts_tablet_manager.cc:1403] T 552b1776c27a48c194068de522fa45b6 P 363bb2f744eb486f9ad726f08214c98e: Time spent bootstrapping tablet: real 0.173s	user 0.007s	sys 0.009s
I20260709 13:05:12.109937 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:05:12.110602 16208 raft_consensus.cc:3060] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.111713 16196 tablet_service.cc:1511] Processing CreateTablet for tablet ab124ef29c71409d9c14a75a054095e1 (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:05:12.112571 16400 raft_consensus.cc:359] T 552b1776c27a48c194068de522fa45b6 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:12.113255 16196 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab124ef29c71409d9c14a75a054095e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:12.119314 16338 tablet_service.cc:1511] Processing CreateTablet for tablet ab124ef29c71409d9c14a75a054095e1 (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:05:12.120612 16403 raft_consensus.cc:493] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.120776 16338 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab124ef29c71409d9c14a75a054095e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:12.121152 16403 raft_consensus.cc:515] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:12.121425 16191 tablet_service.cc:1511] Processing CreateTablet for tablet c24b4a916c7f491da5d7f9b92db71ece (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:05:12.122704 16191 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c24b4a916c7f491da5d7f9b92db71ece. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:12.123306 16425 raft_consensus.cc:2749] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:12.126688 16403 leader_election.cc:290] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:12.127624 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:12.113432 16400 raft_consensus.cc:385] T 552b1776c27a48c194068de522fa45b6 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.128562 16400 raft_consensus.cc:740] T 552b1776c27a48c194068de522fa45b6 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Initialized, Role: FOLLOWER
W20260709 13:05:12.129602 16246 leader_election.cc:343] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:12.097848 16408 leader_election.cc:290] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:12.135039 16343 tablet_service.cc:1511] Processing CreateTablet for tablet 0340758c689242c3979a434fa59589f7 (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:05:12.129351 16400 consensus_queue.cc:260] T 552b1776c27a48c194068de522fa45b6 P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:12.136475 16343 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0340758c689242c3979a434fa59589f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:12.138679 16398 tablet_bootstrap.cc:654] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.138448 16264 tablet_service.cc:1511] Processing CreateTablet for tablet c24b4a916c7f491da5d7f9b92db71ece (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:05:12.139986 16264 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c24b4a916c7f491da5d7f9b92db71ece. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:12.144923 16339 tablet_service.cc:1511] Processing CreateTablet for tablet c24b4a916c7f491da5d7f9b92db71ece (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:05:12.146407 16339 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c24b4a916c7f491da5d7f9b92db71ece. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:12.140008 16400 ts_tablet_manager.cc:1434] T 552b1776c27a48c194068de522fa45b6 P 363bb2f744eb486f9ad726f08214c98e: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.003s
I20260709 13:05:12.154137 16400 tablet_bootstrap.cc:492] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 363bb2f744eb486f9ad726f08214c98e: Bootstrap starting.
I20260709 13:05:12.159559 16273 tablet_service.cc:1511] Processing CreateTablet for tablet ab124ef29c71409d9c14a75a054095e1 (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:05:12.161229 16273 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab124ef29c71409d9c14a75a054095e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:12.162102 16397 tablet_bootstrap.cc:492] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3: No bootstrap required, opened a new log
I20260709 13:05:12.162756 16397 ts_tablet_manager.cc:1403] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3: Time spent bootstrapping tablet: real 0.198s	user 0.008s	sys 0.014s
W20260709 13:05:12.163009 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 86244.9us
I20260709 13:05:12.164817 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:05:12.165452 16283 raft_consensus.cc:3060] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.166970 16208 raft_consensus.cc:2468] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 1.
I20260709 13:05:12.168358 16246 leader_election.cc:304] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:12.169215 16403 raft_consensus.cc:2804] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:12.178304 16270 tablet_service.cc:1511] Processing CreateTablet for tablet abbbc04ca95a4119a7e3fb64073fe61f (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:05:12.178740 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:05:12.179977 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:12.182332 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:12.180594 16345 tablet_service.cc:1511] Processing CreateTablet for tablet abbbc04ca95a4119a7e3fb64073fe61f (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:05:12.184554 16355 raft_consensus.cc:2468] T 552b1776c27a48c194068de522fa45b6 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 0.
I20260709 13:05:12.184666 16190 tablet_service.cc:1511] Processing CreateTablet for tablet abbbc04ca95a4119a7e3fb64073fe61f (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:05:12.185274 16345 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abbbc04ca95a4119a7e3fb64073fe61f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:12.185436 16357 raft_consensus.cc:3060] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.186014 16190 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abbbc04ca95a4119a7e3fb64073fe61f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:12.165908 16397 raft_consensus.cc:359] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:12.191437 16397 raft_consensus.cc:385] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.193125 16270 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abbbc04ca95a4119a7e3fb64073fe61f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:12.192898 16194 tablet_service.cc:1511] Processing CreateTablet for tablet 5247d6e15e644eaa8f250cc1aa2d4b75 (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:05:12.194296 16194 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5247d6e15e644eaa8f250cc1aa2d4b75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:12.191859 16397 raft_consensus.cc:740] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.202479 16397 consensus_queue.cc:260] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:12.174295 16283 raft_consensus.cc:2468] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 1.
I20260709 13:05:12.206076 16173 leader_election.cc:304] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:05:12.207430 16414 raft_consensus.cc:2804] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:12.207814 16414 raft_consensus.cc:493] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:12.208168 16414 raft_consensus.cc:3060] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:12.210915 16248 leader_election.cc:343] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:12.211400 16248 leader_election.cc:304] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:12.230574 16265 tablet_service.cc:1511] Processing CreateTablet for tablet 5247d6e15e644eaa8f250cc1aa2d4b75 (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:05:12.232509 16265 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5247d6e15e644eaa8f250cc1aa2d4b75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:12.243175 16339 tablet_service.cc:1511] Processing CreateTablet for tablet 5247d6e15e644eaa8f250cc1aa2d4b75 (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:05:12.244633 16398 tablet_bootstrap.cc:492] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f: No bootstrap required, opened a new log
I20260709 13:05:12.244680 16339 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5247d6e15e644eaa8f250cc1aa2d4b75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:12.245217 16398 ts_tablet_manager.cc:1403] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f: Time spent bootstrapping tablet: real 0.161s	user 0.009s	sys 0.022s
I20260709 13:05:12.248941 16400 tablet_bootstrap.cc:654] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 363bb2f744eb486f9ad726f08214c98e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.245729 16403 raft_consensus.cc:697] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:05:12.258186 16428 raft_consensus.cc:493] T 9dbc1db111e7466090abdb97a79d0d9b P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.259130 16272 tablet_service.cc:1511] Processing CreateTablet for tablet fd0c3c592b464aafaf1d0b94d1e6e360 (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:05:12.260437 16272 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd0c3c592b464aafaf1d0b94d1e6e360. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:12.268308 16397 ts_tablet_manager.cc:1434] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3: Time spent starting tablet: real 0.105s	user 0.017s	sys 0.010s
I20260709 13:05:12.269449 16397 tablet_bootstrap.cc:492] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3: Bootstrap starting.
I20260709 13:05:12.259148 16344 tablet_service.cc:1511] Processing CreateTablet for tablet fd0c3c592b464aafaf1d0b94d1e6e360 (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:05:12.270720 16338 tablet_service.cc:1511] Processing CreateTablet for tablet 18b8d2f02b16479aaf7ec42190a4197f (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:05:12.272066 16338 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18b8d2f02b16479aaf7ec42190a4197f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:12.274287 16191 tablet_service.cc:1511] Processing CreateTablet for tablet fd0c3c592b464aafaf1d0b94d1e6e360 (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:05:12.275776 16191 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd0c3c592b464aafaf1d0b94d1e6e360. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:12.275992 16397 tablet_bootstrap.cc:654] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.278188 16194 tablet_service.cc:1511] Processing CreateTablet for tablet 18b8d2f02b16479aaf7ec42190a4197f (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:05:12.245779 16322 leader_election.cc:304] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:12.279467 16194 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18b8d2f02b16479aaf7ec42190a4197f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:05:12.279771 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 45848.1us
I20260709 13:05:12.280807 16408 raft_consensus.cc:2804] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:12.281529 16408 raft_consensus.cc:697] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 1 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:05:12.294874 16408 consensus_queue.cc:237] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:12.264772 16429 raft_consensus.cc:2749] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:12.303040 16344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd0c3c592b464aafaf1d0b94d1e6e360. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:12.305547 16265 tablet_service.cc:1511] Processing CreateTablet for tablet 18b8d2f02b16479aaf7ec42190a4197f (DEFAULT_TABLE table=test-workload [id=f364cfe226234c5b99453e3013c8717e]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
W20260709 13:05:12.266108 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 54867.5us
I20260709 13:05:12.312271 16414 raft_consensus.cc:515] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:12.256240 16357 raft_consensus.cc:2468] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 1.
I20260709 13:05:12.319271 16265 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18b8d2f02b16479aaf7ec42190a4197f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:12.323534 16403 consensus_queue.cc:237] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } }
I20260709 13:05:12.258754 16428 raft_consensus.cc:515] T 9dbc1db111e7466090abdb97a79d0d9b P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:12.328495 16428 leader_election.cc:290] T 9dbc1db111e7466090abdb97a79d0d9b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:12.328794 16398 raft_consensus.cc:359] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:12.329574 16398 raft_consensus.cc:385] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.329576 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:12.330021 16398 raft_consensus.cc:740] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.329612 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:05:12.332239 16173 leader_election.cc:343] T 9dbc1db111e7466090abdb97a79d0d9b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:12.332820 16414 leader_election.cc:290] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:05:12.332916 16173 leader_election.cc:343] T 9dbc1db111e7466090abdb97a79d0d9b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:12.333464 16173 leader_election.cc:304] T 9dbc1db111e7466090abdb97a79d0d9b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:05:12.334259 16414 raft_consensus.cc:2749] T 9dbc1db111e7466090abdb97a79d0d9b P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:12.334910 16398 consensus_queue.cc:260] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:12.336278 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:05:12.337358 16398 ts_tablet_manager.cc:1434] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f: Time spent starting tablet: real 0.084s	user 0.008s	sys 0.000s
W20260709 13:05:12.337766 16173 leader_election.cc:343] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:12.359607 16106 catalog_manager.cc:5697] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e reported cstate change: term changed from 0 to 1, leader changed from <none> to 363bb2f744eb486f9ad726f08214c98e (127.14.180.67). New cstate: current_term: 1 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:12.362852 16398 tablet_bootstrap.cc:492] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f: Bootstrap starting.
I20260709 13:05:12.362658 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:05:12.369027 16357 raft_consensus.cc:3060] T 552b1776c27a48c194068de522fa45b6 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.374203 16398 tablet_bootstrap.cc:654] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.384532 16104 catalog_manager.cc:5697] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66). New cstate: current_term: 1 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:12.380578 16357 raft_consensus.cc:2468] T 552b1776c27a48c194068de522fa45b6 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 1.
I20260709 13:05:12.385735 16400 tablet_bootstrap.cc:492] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 363bb2f744eb486f9ad726f08214c98e: No bootstrap required, opened a new log
I20260709 13:05:12.387092 16400 ts_tablet_manager.cc:1403] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 363bb2f744eb486f9ad726f08214c98e: Time spent bootstrapping tablet: real 0.233s	user 0.011s	sys 0.008s
I20260709 13:05:12.387446 16173 leader_election.cc:304] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:05:12.378880 16397 tablet_bootstrap.cc:492] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3: No bootstrap required, opened a new log
I20260709 13:05:12.388860 16414 raft_consensus.cc:2804] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:12.389328 16397 ts_tablet_manager.cc:1403] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3: Time spent bootstrapping tablet: real 0.120s	user 0.021s	sys 0.036s
I20260709 13:05:12.389478 16414 raft_consensus.cc:697] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:05:12.390506 16414 consensus_queue.cc:237] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:12.393195 16397 raft_consensus.cc:359] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:12.394732 16397 raft_consensus.cc:385] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.396345 16397 raft_consensus.cc:740] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.397229 16400 raft_consensus.cc:359] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:12.399986 16400 raft_consensus.cc:385] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.397732 16397 consensus_queue.cc:260] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:12.400643 16400 raft_consensus.cc:740] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.403172 16397 ts_tablet_manager.cc:1434] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.002s
I20260709 13:05:12.404691 16400 consensus_queue.cc:260] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:12.407207 16397 tablet_bootstrap.cc:492] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3: Bootstrap starting.
I20260709 13:05:12.407998 16400 ts_tablet_manager.cc:1434] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 363bb2f744eb486f9ad726f08214c98e: Time spent starting tablet: real 0.021s	user 0.010s	sys 0.002s
I20260709 13:05:12.408985 16400 tablet_bootstrap.cc:492] T 8b615ac918a749989f2968826926adf3 P 363bb2f744eb486f9ad726f08214c98e: Bootstrap starting.
I20260709 13:05:12.412006 16398 tablet_bootstrap.cc:492] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f: No bootstrap required, opened a new log
I20260709 13:05:12.411080 16105 catalog_manager.cc:5697] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f reported cstate change: term changed from 0 to 1, leader changed from <none> to e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65). New cstate: current_term: 1 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:12.412654 16398 ts_tablet_manager.cc:1403] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f: Time spent bootstrapping tablet: real 0.071s	user 0.004s	sys 0.014s
I20260709 13:05:12.414623 16400 tablet_bootstrap.cc:654] T 8b615ac918a749989f2968826926adf3 P 363bb2f744eb486f9ad726f08214c98e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.415711 16403 raft_consensus.cc:493] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.416282 16403 raft_consensus.cc:515] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:12.420675 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:12.421623 16357 raft_consensus.cc:2393] T 552b1776c27a48c194068de522fa45b6 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 1: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:05:12.422219 16403 leader_election.cc:290] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:12.422834 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:12.416251 16398 raft_consensus.cc:359] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:12.424252 16398 raft_consensus.cc:385] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.424613 16398 raft_consensus.cc:740] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.425472 16248 leader_election.cc:304] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:12.426520 16403 raft_consensus.cc:3060] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.427210 16397 tablet_bootstrap.cc:654] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.425482 16398 consensus_queue.cc:260] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:12.434773 16400 tablet_bootstrap.cc:492] T 8b615ac918a749989f2968826926adf3 P 363bb2f744eb486f9ad726f08214c98e: No bootstrap required, opened a new log
I20260709 13:05:12.434458 16403 raft_consensus.cc:2749] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:12.436129 16400 ts_tablet_manager.cc:1403] T 8b615ac918a749989f2968826926adf3 P 363bb2f744eb486f9ad726f08214c98e: Time spent bootstrapping tablet: real 0.027s	user 0.014s	sys 0.004s
I20260709 13:05:12.436287 16397 tablet_bootstrap.cc:492] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3: No bootstrap required, opened a new log
I20260709 13:05:12.436930 16397 ts_tablet_manager.cc:1403] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3: Time spent bootstrapping tablet: real 0.033s	user 0.011s	sys 0.004s
I20260709 13:05:12.439761 16398 ts_tablet_manager.cc:1434] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f: Time spent starting tablet: real 0.027s	user 0.003s	sys 0.006s
I20260709 13:05:12.439635 16400 raft_consensus.cc:359] T 8b615ac918a749989f2968826926adf3 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:12.440645 16400 raft_consensus.cc:385] T 8b615ac918a749989f2968826926adf3 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.441072 16398 tablet_bootstrap.cc:492] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f: Bootstrap starting.
I20260709 13:05:12.441007 16400 raft_consensus.cc:740] T 8b615ac918a749989f2968826926adf3 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.442018 16400 consensus_queue.cc:260] T 8b615ac918a749989f2968826926adf3 P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:12.444389 16397 raft_consensus.cc:359] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:12.444831 16400 ts_tablet_manager.cc:1434] T 8b615ac918a749989f2968826926adf3 P 363bb2f744eb486f9ad726f08214c98e: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:05:12.445380 16397 raft_consensus.cc:385] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.445758 16397 raft_consensus.cc:740] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.446197 16400 tablet_bootstrap.cc:492] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e: Bootstrap starting.
I20260709 13:05:12.446782 16397 consensus_queue.cc:260] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:12.449182 16398 tablet_bootstrap.cc:654] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.449582 16397 ts_tablet_manager.cc:1434] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.001s
I20260709 13:05:12.451012 16397 tablet_bootstrap.cc:492] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3: Bootstrap starting.
I20260709 13:05:12.453902 16400 tablet_bootstrap.cc:654] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.458472 16397 tablet_bootstrap.cc:654] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.487927 16398 tablet_bootstrap.cc:492] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f: No bootstrap required, opened a new log
I20260709 13:05:12.488533 16398 ts_tablet_manager.cc:1403] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f: Time spent bootstrapping tablet: real 0.048s	user 0.012s	sys 0.029s
I20260709 13:05:12.488729 16400 tablet_bootstrap.cc:492] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e: No bootstrap required, opened a new log
I20260709 13:05:12.489254 16400 ts_tablet_manager.cc:1403] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e: Time spent bootstrapping tablet: real 0.043s	user 0.024s	sys 0.016s
I20260709 13:05:12.490332 16397 tablet_bootstrap.cc:492] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3: No bootstrap required, opened a new log
I20260709 13:05:12.490293 16414 raft_consensus.cc:493] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.491098 16397 ts_tablet_manager.cc:1403] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3: Time spent bootstrapping tablet: real 0.040s	user 0.011s	sys 0.023s
I20260709 13:05:12.491061 16414 raft_consensus.cc:515] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:12.491930 16398 raft_consensus.cc:359] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:12.492798 16398 raft_consensus.cc:385] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.493131 16398 raft_consensus.cc:740] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.493559 16414 leader_election.cc:290] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:12.494112 16398 consensus_queue.cc:260] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:12.494426 16397 raft_consensus.cc:359] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:12.495204 16397 raft_consensus.cc:385] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.495582 16397 raft_consensus.cc:740] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.495726 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:12.496253 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:12.496486 16397 consensus_queue.cc:260] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:12.496915 16357 raft_consensus.cc:2468] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 0.
I20260709 13:05:12.497412 16283 raft_consensus.cc:2468] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 0.
I20260709 13:05:12.498027 16398 ts_tablet_manager.cc:1434] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.006s
I20260709 13:05:12.498809 16173 leader_election.cc:304] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:12.499454 16398 tablet_bootstrap.cc:492] T 862e96f5785248c58d0355cac229fc05 P e10b16d536674c0bb350a31d7ce5ff7f: Bootstrap starting.
I20260709 13:05:12.500680 16428 raft_consensus.cc:2804] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:12.501117 16428 raft_consensus.cc:493] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:12.501487 16428 raft_consensus.cc:3060] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.507427 16398 tablet_bootstrap.cc:654] T 862e96f5785248c58d0355cac229fc05 P e10b16d536674c0bb350a31d7ce5ff7f: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.507987 16397 ts_tablet_manager.cc:1434] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.000s
I20260709 13:05:12.512507 16397 tablet_bootstrap.cc:492] T 52982fc727d3451e9c722e63eb4d79ef P 0aea40d6e4374085a2e38a70a71f63e3: Bootstrap starting.
I20260709 13:05:12.514235 16400 raft_consensus.cc:359] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:12.515456 16400 raft_consensus.cc:385] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.515921 16400 raft_consensus.cc:740] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.516911 16400 consensus_queue.cc:260] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:12.510397 16428 raft_consensus.cc:515] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:12.519080 16397 tablet_bootstrap.cc:654] T 52982fc727d3451e9c722e63eb4d79ef P 0aea40d6e4374085a2e38a70a71f63e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.519490 16398 tablet_bootstrap.cc:492] T 862e96f5785248c58d0355cac229fc05 P e10b16d536674c0bb350a31d7ce5ff7f: No bootstrap required, opened a new log
I20260709 13:05:12.520011 16398 ts_tablet_manager.cc:1403] T 862e96f5785248c58d0355cac229fc05 P e10b16d536674c0bb350a31d7ce5ff7f: Time spent bootstrapping tablet: real 0.021s	user 0.015s	sys 0.004s
I20260709 13:05:12.521895 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:05:12.522529 16283 raft_consensus.cc:3060] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.523118 16398 raft_consensus.cc:359] T 862e96f5785248c58d0355cac229fc05 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:12.523934 16398 raft_consensus.cc:385] T 862e96f5785248c58d0355cac229fc05 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.524260 16398 raft_consensus.cc:740] T 862e96f5785248c58d0355cac229fc05 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.525210 16398 consensus_queue.cc:260] T 862e96f5785248c58d0355cac229fc05 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:12.530435 16398 ts_tablet_manager.cc:1434] T 862e96f5785248c58d0355cac229fc05 P e10b16d536674c0bb350a31d7ce5ff7f: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:05:12.531558 16398 tablet_bootstrap.cc:492] T 454d01f56c2d4533a035fdbc026c10b3 P e10b16d536674c0bb350a31d7ce5ff7f: Bootstrap starting.
I20260709 13:05:12.532232 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:05:12.532859 16357 raft_consensus.cc:3060] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.538164 16398 tablet_bootstrap.cc:654] T 454d01f56c2d4533a035fdbc026c10b3 P e10b16d536674c0bb350a31d7ce5ff7f: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.540198 16408 raft_consensus.cc:493] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.540706 16408 raft_consensus.cc:515] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:12.543509 16408 leader_election.cc:290] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:12.544559 16414 raft_consensus.cc:493] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.544492 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:12.540699 16357 raft_consensus.cc:2468] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 1.
I20260709 13:05:12.545153 16398 tablet_bootstrap.cc:492] T 454d01f56c2d4533a035fdbc026c10b3 P e10b16d536674c0bb350a31d7ce5ff7f: No bootstrap required, opened a new log
I20260709 13:05:12.545125 16414 raft_consensus.cc:515] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:12.530468 16283 raft_consensus.cc:2468] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 1.
I20260709 13:05:12.546031 16398 ts_tablet_manager.cc:1403] T 454d01f56c2d4533a035fdbc026c10b3 P e10b16d536674c0bb350a31d7ce5ff7f: Time spent bootstrapping tablet: real 0.015s	user 0.013s	sys 0.000s
I20260709 13:05:12.545245 16208 raft_consensus.cc:2468] T 9dbc1db111e7466090abdb97a79d0d9b P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 0.
I20260709 13:05:12.546936 16173 leader_election.cc:304] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:12.547683 16414 leader_election.cc:290] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:12.549250 16414 raft_consensus.cc:2804] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:12.547588 16320 leader_election.cc:304] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:12.548645 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:12.550624 16408 raft_consensus.cc:2804] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:12.551206 16408 raft_consensus.cc:493] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:12.549841 16414 raft_consensus.cc:697] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:05:12.551939 16408 raft_consensus.cc:3060] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.552532 16414 consensus_queue.cc:237] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:12.549526 16398 raft_consensus.cc:359] T 454d01f56c2d4533a035fdbc026c10b3 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:12.546072 16428 leader_election.cc:290] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:12.554075 16398 raft_consensus.cc:385] T 454d01f56c2d4533a035fdbc026c10b3 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.554610 16398 raft_consensus.cc:740] T 454d01f56c2d4533a035fdbc026c10b3 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.555596 16398 consensus_queue.cc:260] T 454d01f56c2d4533a035fdbc026c10b3 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:12.551203 16282 raft_consensus.cc:2468] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 0.
I20260709 13:05:12.558568 16398 ts_tablet_manager.cc:1434] T 454d01f56c2d4533a035fdbc026c10b3 P e10b16d536674c0bb350a31d7ce5ff7f: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.003s
I20260709 13:05:12.559682 16398 tablet_bootstrap.cc:492] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f: Bootstrap starting.
I20260709 13:05:12.560335 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:12.561372 16408 raft_consensus.cc:515] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:12.561941 16397 tablet_bootstrap.cc:492] T 52982fc727d3451e9c722e63eb4d79ef P 0aea40d6e4374085a2e38a70a71f63e3: No bootstrap required, opened a new log
W20260709 13:05:12.561913 16173 leader_election.cc:343] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:12.562716 16397 ts_tablet_manager.cc:1403] T 52982fc727d3451e9c722e63eb4d79ef P 0aea40d6e4374085a2e38a70a71f63e3: Time spent bootstrapping tablet: real 0.050s	user 0.020s	sys 0.009s
I20260709 13:05:12.563455 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:12.564814 16357 raft_consensus.cc:2468] T 8b615ac918a749989f2968826926adf3 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 0.
I20260709 13:05:12.565742 16408 leader_election.cc:290] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:12.565001 16400 ts_tablet_manager.cc:1434] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e: Time spent starting tablet: real 0.075s	user 0.010s	sys 0.001s
I20260709 13:05:12.567006 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:05:12.567624 16282 raft_consensus.cc:3060] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.567688 16397 raft_consensus.cc:359] T 52982fc727d3451e9c722e63eb4d79ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:12.568524 16397 raft_consensus.cc:385] T 52982fc727d3451e9c722e63eb4d79ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.568796 16397 raft_consensus.cc:740] T 52982fc727d3451e9c722e63eb4d79ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.572263 16106 catalog_manager.cc:5697] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f reported cstate change: term changed from 0 to 1, leader changed from <none> to e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65). New cstate: current_term: 1 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:12.573743 16398 tablet_bootstrap.cc:654] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.574961 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:05:12.575595 16208 raft_consensus.cc:3060] T 9dbc1db111e7466090abdb97a79d0d9b P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.578919 16173 leader_election.cc:304] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:05:12.581053 16414 raft_consensus.cc:2804] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:12.581594 16414 raft_consensus.cc:493] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:12.582088 16414 raft_consensus.cc:3060] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.584856 16208 raft_consensus.cc:2468] T 9dbc1db111e7466090abdb97a79d0d9b P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 1.
I20260709 13:05:12.586263 16320 leader_election.cc:304] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:12.569664 16397 consensus_queue.cc:260] T 52982fc727d3451e9c722e63eb4d79ef P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:12.588235 16408 raft_consensus.cc:2804] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:12.590430 16408 raft_consensus.cc:697] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 1 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:05:12.591564 16408 consensus_queue.cc:237] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:12.589250 16400 tablet_bootstrap.cc:492] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e: Bootstrap starting.
I20260709 13:05:12.597347 16403 raft_consensus.cc:493] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.597780 16282 raft_consensus.cc:2468] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 1.
I20260709 13:05:12.598112 16403 raft_consensus.cc:515] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:12.594381 16414 raft_consensus.cc:515] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:12.601950 16403 leader_election.cc:290] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:12.601722 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:12.603924 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:05:12.605723 16246 leader_election.cc:343] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:12.606727 16248 leader_election.cc:343] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:12.607429 16248 leader_election.cc:304] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:12.607818 16397 ts_tablet_manager.cc:1434] T 52982fc727d3451e9c722e63eb4d79ef P 0aea40d6e4374085a2e38a70a71f63e3: Time spent starting tablet: real 0.045s	user 0.007s	sys 0.001s
I20260709 13:05:12.609208 16403 raft_consensus.cc:2749] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:12.610875 16400 tablet_bootstrap.cc:654] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.611330 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
W20260709 13:05:12.613359 16173 leader_election.cc:343] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:12.616298 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:05:12.617221 16357 raft_consensus.cc:3060] T 8b615ac918a749989f2968826926adf3 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.617746 16397 tablet_bootstrap.cc:492] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3: Bootstrap starting.
I20260709 13:05:12.625284 16398 tablet_bootstrap.cc:492] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f: No bootstrap required, opened a new log
I20260709 13:05:12.625805 16398 ts_tablet_manager.cc:1403] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f: Time spent bootstrapping tablet: real 0.066s	user 0.020s	sys 0.036s
I20260709 13:05:12.626744 16414 leader_election.cc:290] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:12.627315 16357 raft_consensus.cc:2468] T 8b615ac918a749989f2968826926adf3 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 1.
I20260709 13:05:12.627502 16106 catalog_manager.cc:5697] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e reported cstate change: term changed from 0 to 1, leader changed from <none> to 363bb2f744eb486f9ad726f08214c98e (127.14.180.67). New cstate: current_term: 1 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:12.628574 16173 leader_election.cc:304] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:05:12.628532 16398 raft_consensus.cc:359] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:12.629369 16398 raft_consensus.cc:385] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.629657 16398 raft_consensus.cc:740] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.629865 16414 raft_consensus.cc:2804] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:12.630354 16398 consensus_queue.cc:260] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:12.631184 16414 raft_consensus.cc:697] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:05:12.631989 16397 tablet_bootstrap.cc:654] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.632655 16398 ts_tablet_manager.cc:1434] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:05:12.633512 16398 tablet_bootstrap.cc:492] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f: Bootstrap starting.
I20260709 13:05:12.632077 16414 consensus_queue.cc:237] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:12.638635 16400 tablet_bootstrap.cc:492] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e: No bootstrap required, opened a new log
I20260709 13:05:12.639127 16400 ts_tablet_manager.cc:1403] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e: Time spent bootstrapping tablet: real 0.050s	user 0.009s	sys 0.015s
I20260709 13:05:12.639283 16398 tablet_bootstrap.cc:654] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.641817 16400 raft_consensus.cc:359] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:12.642567 16400 raft_consensus.cc:385] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.642854 16400 raft_consensus.cc:740] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.643682 16400 consensus_queue.cc:260] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:12.646375 16400 ts_tablet_manager.cc:1434] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:05:12.647370 16400 tablet_bootstrap.cc:492] T 4f72b5892c874917882ef9ee926ce439 P 363bb2f744eb486f9ad726f08214c98e: Bootstrap starting.
I20260709 13:05:12.659796 16104 catalog_manager.cc:5697] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f reported cstate change: term changed from 0 to 1, leader changed from <none> to e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65). New cstate: current_term: 1 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:12.663563 16400 tablet_bootstrap.cc:654] T 4f72b5892c874917882ef9ee926ce439 P 363bb2f744eb486f9ad726f08214c98e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.665561 16397 tablet_bootstrap.cc:492] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3: No bootstrap required, opened a new log
I20260709 13:05:12.666618 16397 ts_tablet_manager.cc:1403] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3: Time spent bootstrapping tablet: real 0.049s	user 0.014s	sys 0.000s
I20260709 13:05:12.670285 16397 raft_consensus.cc:359] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:12.671417 16397 raft_consensus.cc:385] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.671784 16397 raft_consensus.cc:740] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.674106 16397 consensus_queue.cc:260] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:12.675323 16398 tablet_bootstrap.cc:492] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f: No bootstrap required, opened a new log
I20260709 13:05:12.675808 16398 ts_tablet_manager.cc:1403] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f: Time spent bootstrapping tablet: real 0.042s	user 0.021s	sys 0.020s
I20260709 13:05:12.676519 16397 ts_tablet_manager.cc:1434] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:05:12.678483 16398 raft_consensus.cc:359] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:12.679229 16398 raft_consensus.cc:385] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.679522 16398 raft_consensus.cc:740] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.680243 16398 consensus_queue.cc:260] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:12.680990 16397 tablet_bootstrap.cc:492] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3: Bootstrap starting.
I20260709 13:05:12.682703 16398 ts_tablet_manager.cc:1434] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:05:12.683815 16414 raft_consensus.cc:493] T 454d01f56c2d4533a035fdbc026c10b3 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.684352 16414 raft_consensus.cc:515] T 454d01f56c2d4533a035fdbc026c10b3 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:12.687064 16414 leader_election.cc:290] T 454d01f56c2d4533a035fdbc026c10b3 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:12.687810 16397 tablet_bootstrap.cc:654] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.689677 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:12.690797 16400 tablet_bootstrap.cc:492] T 4f72b5892c874917882ef9ee926ce439 P 363bb2f744eb486f9ad726f08214c98e: No bootstrap required, opened a new log
I20260709 13:05:12.691275 16400 ts_tablet_manager.cc:1403] T 4f72b5892c874917882ef9ee926ce439 P 363bb2f744eb486f9ad726f08214c98e: Time spent bootstrapping tablet: real 0.044s	user 0.012s	sys 0.008s
I20260709 13:05:12.691012 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:12.693429 16282 raft_consensus.cc:2393] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 1: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:05:12.695178 16173 leader_election.cc:304] T 454d01f56c2d4533a035fdbc026c10b3 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:05:12.695304 16400 raft_consensus.cc:359] T 4f72b5892c874917882ef9ee926ce439 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:12.696301 16400 raft_consensus.cc:385] T 4f72b5892c874917882ef9ee926ce439 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.696620 16400 raft_consensus.cc:740] T 4f72b5892c874917882ef9ee926ce439 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.696969 16414 raft_consensus.cc:3060] T 454d01f56c2d4533a035fdbc026c10b3 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.697453 16400 consensus_queue.cc:260] T 4f72b5892c874917882ef9ee926ce439 P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:12.699903 16400 ts_tablet_manager.cc:1434] T 4f72b5892c874917882ef9ee926ce439 P 363bb2f744eb486f9ad726f08214c98e: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:05:12.702016 16398 tablet_bootstrap.cc:492] T 26565509c81343bc818483042146461a P e10b16d536674c0bb350a31d7ce5ff7f: Bootstrap starting.
I20260709 13:05:12.703212 16400 tablet_bootstrap.cc:492] T 7877d879c7564adfac82b8387dbbc867 P 363bb2f744eb486f9ad726f08214c98e: Bootstrap starting.
I20260709 13:05:12.703516 16397 tablet_bootstrap.cc:492] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3: No bootstrap required, opened a new log
I20260709 13:05:12.703979 16397 ts_tablet_manager.cc:1403] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3: Time spent bootstrapping tablet: real 0.023s	user 0.006s	sys 0.015s
I20260709 13:05:12.706709 16397 raft_consensus.cc:359] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:12.707417 16397 raft_consensus.cc:385] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.707692 16397 raft_consensus.cc:740] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.708381 16397 consensus_queue.cc:260] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:12.710465 16397 ts_tablet_manager.cc:1434] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:05:12.712088 16414 raft_consensus.cc:2749] T 454d01f56c2d4533a035fdbc026c10b3 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:12.712752 16400 tablet_bootstrap.cc:654] T 7877d879c7564adfac82b8387dbbc867 P 363bb2f744eb486f9ad726f08214c98e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.716408 16398 tablet_bootstrap.cc:654] T 26565509c81343bc818483042146461a P e10b16d536674c0bb350a31d7ce5ff7f: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.718086 16414 raft_consensus.cc:493] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.719440 16397 tablet_bootstrap.cc:492] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3: Bootstrap starting.
I20260709 13:05:12.724997 16400 tablet_bootstrap.cc:492] T 7877d879c7564adfac82b8387dbbc867 P 363bb2f744eb486f9ad726f08214c98e: No bootstrap required, opened a new log
I20260709 13:05:12.725524 16400 ts_tablet_manager.cc:1403] T 7877d879c7564adfac82b8387dbbc867 P 363bb2f744eb486f9ad726f08214c98e: Time spent bootstrapping tablet: real 0.023s	user 0.011s	sys 0.004s
I20260709 13:05:12.729292 16397 tablet_bootstrap.cc:654] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.728875 16400 raft_consensus.cc:359] T 7877d879c7564adfac82b8387dbbc867 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:12.729990 16400 raft_consensus.cc:385] T 7877d879c7564adfac82b8387dbbc867 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.719996 16414 raft_consensus.cc:515] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:12.730422 16400 raft_consensus.cc:740] T 7877d879c7564adfac82b8387dbbc867 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.732532 16414 leader_election.cc:290] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:12.732481 16400 consensus_queue.cc:260] T 7877d879c7564adfac82b8387dbbc867 P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:12.733307 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:12.733788 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:12.734045 16282 raft_consensus.cc:2468] T 52982fc727d3451e9c722e63eb4d79ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 0.
I20260709 13:05:12.734519 16357 raft_consensus.cc:2468] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 0.
I20260709 13:05:12.735723 16173 leader_election.cc:304] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:12.737373 16414 raft_consensus.cc:2804] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:12.737793 16414 raft_consensus.cc:493] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:12.738170 16414 raft_consensus.cc:3060] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.738238 16398 tablet_bootstrap.cc:492] T 26565509c81343bc818483042146461a P e10b16d536674c0bb350a31d7ce5ff7f: No bootstrap required, opened a new log
I20260709 13:05:12.738982 16398 ts_tablet_manager.cc:1403] T 26565509c81343bc818483042146461a P e10b16d536674c0bb350a31d7ce5ff7f: Time spent bootstrapping tablet: real 0.055s	user 0.018s	sys 0.006s
I20260709 13:05:12.743592 16398 raft_consensus.cc:359] T 26565509c81343bc818483042146461a P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:12.744561 16400 ts_tablet_manager.cc:1434] T 7877d879c7564adfac82b8387dbbc867 P 363bb2f744eb486f9ad726f08214c98e: Time spent starting tablet: real 0.019s	user 0.003s	sys 0.006s
I20260709 13:05:12.744653 16398 raft_consensus.cc:385] T 26565509c81343bc818483042146461a P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.745190 16398 raft_consensus.cc:740] T 26565509c81343bc818483042146461a P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.746336 16398 consensus_queue.cc:260] T 26565509c81343bc818483042146461a P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:12.749936 16400 tablet_bootstrap.cc:492] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e: Bootstrap starting.
I20260709 13:05:12.756516 16408 consensus_queue.cc:1048] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:12.757205 16400 tablet_bootstrap.cc:654] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.759227 16408 raft_consensus.cc:493] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.759828 16408 raft_consensus.cc:515] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:12.763461 16398 ts_tablet_manager.cc:1434] T 26565509c81343bc818483042146461a P e10b16d536674c0bb350a31d7ce5ff7f: Time spent starting tablet: real 0.024s	user 0.010s	sys 0.000s
I20260709 13:05:12.746534 16414 raft_consensus.cc:515] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:12.763962 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:12.765256 16208 raft_consensus.cc:2468] T 862e96f5785248c58d0355cac229fc05 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 0.
I20260709 13:05:12.765822 16428 raft_consensus.cc:493] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.766817 16320 leader_election.cc:304] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:12.766597 16428 raft_consensus.cc:515] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:12.767961 16425 raft_consensus.cc:2804] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:12.768565 16425 raft_consensus.cc:493] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:12.768915 16425 raft_consensus.cc:3060] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.769729 16428 leader_election.cc:290] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:12.770103 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:05:12.770850 16283 raft_consensus.cc:3060] T 52982fc727d3451e9c722e63eb4d79ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.771024 16414 leader_election.cc:290] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:12.772527 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:12.773348 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:12.773454 16281 raft_consensus.cc:2468] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 0.
I20260709 13:05:12.775009 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:05:12.775270 16173 leader_election.cc:304] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:12.775774 16356 raft_consensus.cc:3060] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.776362 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:12.777082 16281 raft_consensus.cc:2468] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 0.
I20260709 13:05:12.777256 16408 leader_election.cc:290] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:12.774190 16357 raft_consensus.cc:2468] T 7877d879c7564adfac82b8387dbbc867 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 0.
I20260709 13:05:12.777081 16414 raft_consensus.cc:2804] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:12.779188 16414 raft_consensus.cc:493] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:12.780040 16414 raft_consensus.cc:3060] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.780449 16283 raft_consensus.cc:2468] T 52982fc727d3451e9c722e63eb4d79ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 1.
I20260709 13:05:12.782689 16173 leader_election.cc:304] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:12.783782 16450 raft_consensus.cc:2804] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:12.784283 16450 raft_consensus.cc:697] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 1 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:05:12.785542 16356 raft_consensus.cc:2468] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 1.
I20260709 13:05:12.785146 16450 consensus_queue.cc:237] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:12.786011 16425 raft_consensus.cc:515] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:12.790766 16398 tablet_bootstrap.cc:492] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f: Bootstrap starting.
I20260709 13:05:12.793722 16397 tablet_bootstrap.cc:492] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3: No bootstrap required, opened a new log
I20260709 13:05:12.794258 16397 ts_tablet_manager.cc:1403] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3: Time spent bootstrapping tablet: real 0.075s	user 0.028s	sys 0.020s
I20260709 13:05:12.790598 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:05:12.795621 16208 raft_consensus.cc:3060] T 862e96f5785248c58d0355cac229fc05 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.797504 16398 tablet_bootstrap.cc:654] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.797232 16397 raft_consensus.cc:359] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:12.797924 16397 raft_consensus.cc:385] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.798772 16414 raft_consensus.cc:515] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:12.805817 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:05:12.806469 16283 raft_consensus.cc:3060] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.807212 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:05:12.807760 16414 leader_election.cc:290] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:12.807837 16356 raft_consensus.cc:3060] T 7877d879c7564adfac82b8387dbbc867 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.809202 16208 raft_consensus.cc:2468] T 862e96f5785248c58d0355cac229fc05 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 1.
I20260709 13:05:12.810895 16320 leader_election.cc:304] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:12.812222 16408 raft_consensus.cc:2804] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:12.816670 16356 raft_consensus.cc:2468] T 7877d879c7564adfac82b8387dbbc867 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 1.
I20260709 13:05:12.817977 16173 leader_election.cc:304] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:12.818926 16450 raft_consensus.cc:2804] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:12.819422 16450 raft_consensus.cc:697] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:05:12.798254 16397 raft_consensus.cc:740] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.820335 16397 consensus_queue.cc:260] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:12.820281 16450 consensus_queue.cc:237] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:12.824878 16283 raft_consensus.cc:2468] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 1.
I20260709 13:05:12.826072 16408 raft_consensus.cc:697] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 1 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:05:12.827270 16408 consensus_queue.cc:237] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:12.831347 16398 tablet_bootstrap.cc:492] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f: No bootstrap required, opened a new log
I20260709 13:05:12.831837 16398 ts_tablet_manager.cc:1403] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f: Time spent bootstrapping tablet: real 0.041s	user 0.012s	sys 0.006s
I20260709 13:05:12.832376 16400 tablet_bootstrap.cc:492] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e: No bootstrap required, opened a new log
I20260709 13:05:12.832983 16400 ts_tablet_manager.cc:1403] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e: Time spent bootstrapping tablet: real 0.083s	user 0.011s	sys 0.000s
I20260709 13:05:12.833734 16397 ts_tablet_manager.cc:1434] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3: Time spent starting tablet: real 0.039s	user 0.005s	sys 0.002s
I20260709 13:05:12.834689 16397 tablet_bootstrap.cc:492] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3: Bootstrap starting.
I20260709 13:05:12.821336 16105 catalog_manager.cc:5697] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f reported cstate change: term changed from 0 to 1, leader changed from <none> to e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65). New cstate: current_term: 1 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:12.834625 16398 raft_consensus.cc:359] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:12.835536 16398 raft_consensus.cc:385] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.835815 16398 raft_consensus.cc:740] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.836576 16398 consensus_queue.cc:260] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:12.837297 16414 consensus_queue.cc:1048] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:12.839407 16398 ts_tablet_manager.cc:1434] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:05:12.840420 16398 tablet_bootstrap.cc:492] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f: Bootstrap starting.
I20260709 13:05:12.840934 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:05:12.841689 16280 raft_consensus.cc:3060] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:12.842492 16397 tablet_bootstrap.cc:654] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.856520 16403 raft_consensus.cc:493] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.857075 16403 raft_consensus.cc:515] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:12.857781 16398 tablet_bootstrap.cc:654] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.859483 16403 leader_election.cc:290] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:12.860997 16425 leader_election.cc:290] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:12.862035 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:12.865358 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:05:12.865677 16246 leader_election.cc:343] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:12.867491 16248 leader_election.cc:343] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:12.868151 16248 leader_election.cc:304] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:12.869565 16403 raft_consensus.cc:2749] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:12.870440 16106 catalog_manager.cc:5697] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e reported cstate change: term changed from 0 to 1, leader changed from <none> to 363bb2f744eb486f9ad726f08214c98e (127.14.180.67). New cstate: current_term: 1 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:12.872098 16397 tablet_bootstrap.cc:492] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3: No bootstrap required, opened a new log
I20260709 13:05:12.872691 16397 ts_tablet_manager.cc:1403] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3: Time spent bootstrapping tablet: real 0.038s	user 0.004s	sys 0.013s
I20260709 13:05:12.875162 16398 tablet_bootstrap.cc:492] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f: No bootstrap required, opened a new log
I20260709 13:05:12.875651 16398 ts_tablet_manager.cc:1403] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f: Time spent bootstrapping tablet: real 0.035s	user 0.017s	sys 0.000s
I20260709 13:05:12.875507 16397 raft_consensus.cc:359] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:12.876219 16397 raft_consensus.cc:385] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.876530 16397 raft_consensus.cc:740] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.877651 16397 consensus_queue.cc:260] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:12.878831 16398 raft_consensus.cc:359] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:12.879546 16398 raft_consensus.cc:385] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.879815 16398 raft_consensus.cc:740] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.880127 16397 ts_tablet_manager.cc:1434] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:05:12.880734 16398 consensus_queue.cc:260] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:12.881292 16397 tablet_bootstrap.cc:492] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3: Bootstrap starting.
I20260709 13:05:12.883193 16398 ts_tablet_manager.cc:1434] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:05:12.884208 16398 tablet_bootstrap.cc:492] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f: Bootstrap starting.
I20260709 13:05:12.888178 16397 tablet_bootstrap.cc:654] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.888144 16280 raft_consensus.cc:2468] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 1.
I20260709 13:05:12.890754 16398 tablet_bootstrap.cc:654] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:12.895527 16408 consensus_queue.cc:1048] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:12.897715 16400 raft_consensus.cc:359] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:12.898586 16400 raft_consensus.cc:385] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.898882 16400 raft_consensus.cc:740] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.899757 16400 consensus_queue.cc:260] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:05:12.900655 16154 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:12.905073 16450 raft_consensus.cc:493] T 26565509c81343bc818483042146461a P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.905689 16450 raft_consensus.cc:515] T 26565509c81343bc818483042146461a P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:12.908615 16450 leader_election.cc:290] T 26565509c81343bc818483042146461a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:12.907563 16398 tablet_bootstrap.cc:492] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f: No bootstrap required, opened a new log
I20260709 13:05:12.911278 16398 ts_tablet_manager.cc:1403] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f: Time spent bootstrapping tablet: real 0.027s	user 0.009s	sys 0.005s
I20260709 13:05:12.911672 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:12.913300 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:05:12.914516 16173 leader_election.cc:343] T 26565509c81343bc818483042146461a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:12.915824 16450 consensus_queue.cc:1048] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:05:12.916203 16173 leader_election.cc:343] T 26565509c81343bc818483042146461a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:12.916778 16173 leader_election.cc:304] T 26565509c81343bc818483042146461a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:05:12.914060 16398 raft_consensus.cc:359] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:12.918435 16398 raft_consensus.cc:385] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.918758 16398 raft_consensus.cc:740] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.918947 16450 raft_consensus.cc:2749] T 26565509c81343bc818483042146461a P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:12.920431 16398 consensus_queue.cc:260] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:12.922981 16398 ts_tablet_manager.cc:1434] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:05:12.924274 16398 tablet_bootstrap.cc:492] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f: Bootstrap starting.
I20260709 13:05:12.924702 16400 ts_tablet_manager.cc:1434] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e: Time spent starting tablet: real 0.091s	user 0.008s	sys 0.000s
I20260709 13:05:12.926071 16400 tablet_bootstrap.cc:492] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e: Bootstrap starting.
I20260709 13:05:12.927373 16403 consensus_queue.cc:1048] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:12.929229 16397 tablet_bootstrap.cc:492] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3: No bootstrap required, opened a new log
I20260709 13:05:12.929709 16397 ts_tablet_manager.cc:1403] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3: Time spent bootstrapping tablet: real 0.049s	user 0.013s	sys 0.000s
I20260709 13:05:12.938462 16450 raft_consensus.cc:493] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.944574 16450 raft_consensus.cc:515] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:12.945283 16403 raft_consensus.cc:493] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.945986 16403 raft_consensus.cc:515] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:12.948808 16403 leader_election.cc:290] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:12.953821 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:12.955080 16355 raft_consensus.cc:2393] T 8b615ac918a749989f2968826926adf3 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 1: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:05:12.942271 16105 catalog_manager.cc:5697] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f reported cstate change: term changed from 0 to 1, leader changed from <none> to e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65). New cstate: current_term: 1 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:12.965560 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:12.965183 16397 raft_consensus.cc:359] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:12.966296 16397 raft_consensus.cc:385] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:12.966676 16397 raft_consensus.cc:740] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Initialized, Role: FOLLOWER
I20260709 13:05:12.967592 16397 consensus_queue.cc:260] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:12.969486 16397 ts_tablet_manager.cc:1434] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3: Time spent starting tablet: real 0.039s	user 0.002s	sys 0.005s
I20260709 13:05:12.970763 16397 tablet_bootstrap.cc:492] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3: Bootstrap starting.
I20260709 13:05:12.972100 16450 leader_election.cc:290] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:12.973040 16246 leader_election.cc:304] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:12.961194 16403 consensus_queue.cc:1048] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.021s
I20260709 13:05:13.010329 16400 tablet_bootstrap.cc:654] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:13.016294 16398 tablet_bootstrap.cc:654] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:13.020835 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:13.025040 16397 tablet_bootstrap.cc:654] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:13.028726 16481 raft_consensus.cc:3060] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:13.021956 16355 raft_consensus.cc:2468] T 4f72b5892c874917882ef9ee926ce439 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 0.
I20260709 13:05:13.037782 16173 leader_election.cc:304] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:13.038787 16450 raft_consensus.cc:2804] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:13.039217 16450 raft_consensus.cc:493] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:13.039584 16450 raft_consensus.cc:3060] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:13.039933 16403 raft_consensus.cc:493] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:13.050590 16476 consensus_queue.cc:1048] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.025s
W20260709 13:05:13.044950 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 77665.6us
I20260709 13:05:13.048384 16403 raft_consensus.cc:515] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:13.054948 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:13.055615 16283 raft_consensus.cc:2468] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 0.
I20260709 13:05:13.055768 16403 leader_election.cc:290] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:13.047531 16414 raft_consensus.cc:493] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:13.056586 16414 raft_consensus.cc:515] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:13.057682 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:13.058717 16414 leader_election.cc:290] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:05:13.059128 16248 leader_election.cc:343] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:13.055485 16428 consensus_queue.cc:1048] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:13.064263 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:05:13.068713 16173 leader_election.cc:343] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:13.088016 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:13.106377 16397 tablet_bootstrap.cc:492] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3: No bootstrap required, opened a new log
I20260709 13:05:13.107179 16397 ts_tablet_manager.cc:1403] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3: Time spent bootstrapping tablet: real 0.137s	user 0.013s	sys 0.011s
I20260709 13:05:13.111069 16397 raft_consensus.cc:359] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:13.111874 16397 raft_consensus.cc:385] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:13.112388 16397 raft_consensus.cc:740] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Initialized, Role: FOLLOWER
I20260709 13:05:13.113600 16397 consensus_queue.cc:260] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:13.115000 16466 raft_consensus.cc:493] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:13.115615 16466 raft_consensus.cc:515] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:13.120569 16481 raft_consensus.cc:2749] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:13.121732 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:13.122968 16281 raft_consensus.cc:2468] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 0.
I20260709 13:05:13.123189 16397 ts_tablet_manager.cc:1434] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3: Time spent starting tablet: real 0.016s	user 0.010s	sys 0.000s
I20260709 13:05:13.124831 16397 tablet_bootstrap.cc:492] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3: Bootstrap starting.
I20260709 13:05:13.110337 16450 raft_consensus.cc:515] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:13.126727 16322 leader_election.cc:304] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:05:13.127924 16425 raft_consensus.cc:2804] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:13.129400 16425 raft_consensus.cc:493] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:13.129974 16425 raft_consensus.cc:3060] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:13.125348 16466 leader_election.cc:290] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:13.143066 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:05:13.143776 16356 raft_consensus.cc:3060] T 4f72b5892c874917882ef9ee926ce439 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:13.140295 16450 leader_election.cc:290] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:13.151683 16400 tablet_bootstrap.cc:492] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e: No bootstrap required, opened a new log
I20260709 13:05:13.152246 16400 ts_tablet_manager.cc:1403] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e: Time spent bootstrapping tablet: real 0.226s	user 0.018s	sys 0.014s
I20260709 13:05:13.155145 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:05:13.142976 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:13.155231 16400 raft_consensus.cc:359] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:13.156044 16282 raft_consensus.cc:3060] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:13.155952 16414 consensus_queue.cc:1048] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:13.156548 16400 raft_consensus.cc:385] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:13.156898 16400 raft_consensus.cc:740] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Initialized, Role: FOLLOWER
I20260709 13:05:13.157648 16400 consensus_queue.cc:260] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:13.160595 16400 ts_tablet_manager.cc:1434] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:05:13.161806 16400 tablet_bootstrap.cc:492] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e: Bootstrap starting.
W20260709 13:05:13.168169 16173 leader_election.cc:343] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:13.168736 16173 leader_election.cc:304] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:05:13.169816 16481 raft_consensus.cc:493] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:13.170734 16450 raft_consensus.cc:2749] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:13.170535 16481 raft_consensus.cc:515] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:05:13.171950 16246 leader_election.cc:343] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:13.172711 16246 leader_election.cc:304] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:13.179607 16481 leader_election.cc:290] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:13.175868 16476 consensus_queue.cc:1048] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:05:13.178628 16486 raft_consensus.cc:2749] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:13.181991 16282 raft_consensus.cc:2468] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 1.
I20260709 13:05:13.185199 16450 raft_consensus.cc:493] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:13.185566 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:13.185741 16450 raft_consensus.cc:515] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:13.186254 16206 raft_consensus.cc:2468] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 0.
I20260709 13:05:13.187914 16450 leader_election.cc:290] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:13.173555 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:13.188541 16246 leader_election.cc:304] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:13.195230 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:13.196070 16353 raft_consensus.cc:2468] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 0.
I20260709 13:05:13.199332 16398 tablet_bootstrap.cc:492] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f: No bootstrap required, opened a new log
I20260709 13:05:13.199873 16398 ts_tablet_manager.cc:1403] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f: Time spent bootstrapping tablet: real 0.276s	user 0.025s	sys 0.044s
I20260709 13:05:13.200562 16486 raft_consensus.cc:2804] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:13.191375 16173 leader_election.cc:304] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:13.192248 16356 raft_consensus.cc:2468] T 4f72b5892c874917882ef9ee926ce439 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 1.
I20260709 13:05:13.194187 16425 raft_consensus.cc:515] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:13.212692 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:13.214973 16414 raft_consensus.cc:2804] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:13.215085 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:13.216079 16353 raft_consensus.cc:2393] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 1: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:05:13.216444 16425 leader_election.cc:290] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:13.215863 16414 raft_consensus.cc:697] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:05:13.217392 16414 consensus_queue.cc:237] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:13.218529 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:05:13.210124 16481 raft_consensus.cc:493] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:13.220535 16481 raft_consensus.cc:515] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:13.227512 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:05:13.227743 16481 leader_election.cc:290] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:13.207341 16486 raft_consensus.cc:493] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:13.234786 16486 raft_consensus.cc:3060] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:13.201361 16208 raft_consensus.cc:2468] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 0.
I20260709 13:05:13.230139 16280 raft_consensus.cc:3060] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:13.230504 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:13.240624 16206 raft_consensus.cc:2468] T 26565509c81343bc818483042146461a P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 0.
I20260709 13:05:13.246822 16398 raft_consensus.cc:359] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:13.247426 16398 raft_consensus.cc:385] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:13.247663 16398 raft_consensus.cc:740] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Initialized, Role: FOLLOWER
I20260709 13:05:13.248178 16398 consensus_queue.cc:260] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:13.239606 16450 consensus_queue.cc:1048] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:05:13.251983 16398 ts_tablet_manager.cc:1434] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f: Time spent starting tablet: real 0.052s	user 0.004s	sys 0.003s
I20260709 13:05:13.252753 16398 tablet_bootstrap.cc:492] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f: Bootstrap starting.
I20260709 13:05:13.245987 16246 leader_election.cc:304] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:13.254454 16484 raft_consensus.cc:2804] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:13.254914 16484 raft_consensus.cc:493] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:13.256247 16484 raft_consensus.cc:3060] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:13.289258 16397 tablet_bootstrap.cc:654] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:13.300817 16400 tablet_bootstrap.cc:654] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:13.304888 16484 raft_consensus.cc:515] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:13.308813 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:05:13.316421 16248 leader_election.cc:343] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:13.271332 16280 raft_consensus.cc:2468] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 1.
I20260709 13:05:13.317488 16450 consensus_queue.cc:1048] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:13.321096 16173 leader_election.cc:304] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:05:13.322068 16450 raft_consensus.cc:3060] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:13.323930 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
W20260709 13:05:13.327070 16248 leader_election.cc:343] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:13.328944 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:05:13.329663 16206 raft_consensus.cc:3060] T 26565509c81343bc818483042146461a P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:13.332638 16450 raft_consensus.cc:2749] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:13.337347 16322 leader_election.cc:304] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:13.338471 16484 leader_election.cc:290] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:13.338829 16414 consensus_queue.cc:1048] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:13.339921 16476 raft_consensus.cc:2804] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:13.340669 16476 raft_consensus.cc:697] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 1 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:05:13.341522 16476 consensus_queue.cc:237] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:13.355057 16106 catalog_manager.cc:5697] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f reported cstate change: term changed from 0 to 1, leader changed from <none> to e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65). New cstate: current_term: 1 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:13.367358 16486 raft_consensus.cc:515] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:13.372063 16397 tablet_bootstrap.cc:492] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3: No bootstrap required, opened a new log
I20260709 13:05:13.372607 16397 ts_tablet_manager.cc:1403] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3: Time spent bootstrapping tablet: real 0.248s	user 0.020s	sys 0.020s
I20260709 13:05:13.378971 16486 leader_election.cc:290] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:13.391438 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:05:13.392210 16357 raft_consensus.cc:3060] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:13.393086 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:05:13.393782 16208 raft_consensus.cc:3060] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:13.394603 16397 raft_consensus.cc:359] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:13.395653 16397 raft_consensus.cc:385] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:13.395965 16397 raft_consensus.cc:740] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Initialized, Role: FOLLOWER
I20260709 13:05:13.408867 16489 consensus_queue.cc:1048] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 13:05:13.416635 16425 consensus_queue.cc:1048] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:13.419795 16208 raft_consensus.cc:2468] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 1.
I20260709 13:05:13.421205 16246 leader_election.cc:304] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:13.422076 16486 raft_consensus.cc:2804] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:13.422819 16486 raft_consensus.cc:697] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:05:13.424317 16398 tablet_bootstrap.cc:654] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:13.423722 16486 consensus_queue.cc:237] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:13.424799 16466 consensus_queue.cc:1048] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:13.406329 16450 consensus_queue.cc:1048] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.020s
I20260709 13:05:13.428973 16397 consensus_queue.cc:260] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:13.401499 16206 raft_consensus.cc:2468] T 26565509c81343bc818483042146461a P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 1.
I20260709 13:05:13.433872 16397 ts_tablet_manager.cc:1434] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3: Time spent starting tablet: real 0.061s	user 0.017s	sys 0.007s
I20260709 13:05:13.437783 16450 consensus_queue.cc:1048] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:13.440991 16397 tablet_bootstrap.cc:492] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3: Bootstrap starting.
I20260709 13:05:13.440697 16357 raft_consensus.cc:2468] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 1.
I20260709 13:05:13.443186 16400 tablet_bootstrap.cc:492] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e: No bootstrap required, opened a new log
I20260709 13:05:13.444669 16400 ts_tablet_manager.cc:1403] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e: Time spent bootstrapping tablet: real 0.283s	user 0.022s	sys 0.000s
I20260709 13:05:13.447412 16246 leader_election.cc:304] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 363bb2f744eb486f9ad726f08214c98e
I20260709 13:05:13.448592 16484 raft_consensus.cc:2804] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:13.449203 16484 raft_consensus.cc:697] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:05:13.450472 16484 consensus_queue.cc:237] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:13.451610 16398 tablet_bootstrap.cc:492] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f: No bootstrap required, opened a new log
I20260709 13:05:13.453259 16398 ts_tablet_manager.cc:1403] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f: Time spent bootstrapping tablet: real 0.201s	user 0.025s	sys 0.014s
W20260709 13:05:13.505847 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 58337.3us
I20260709 13:05:13.509378 16400 raft_consensus.cc:359] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:13.511425 16400 raft_consensus.cc:385] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:13.511889 16400 raft_consensus.cc:740] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Initialized, Role: FOLLOWER
I20260709 13:05:13.524456 16486 raft_consensus.cc:493] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:13.528095 16486 raft_consensus.cc:515] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:13.532179 16398 raft_consensus.cc:359] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:13.533301 16398 raft_consensus.cc:385] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:13.533613 16398 raft_consensus.cc:740] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Initialized, Role: FOLLOWER
I20260709 13:05:13.534099 16397 tablet_bootstrap.cc:654] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:13.534731 16398 consensus_queue.cc:260] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:13.536849 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:05:13.540170 16248 leader_election.cc:343] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:13.541496 16398 ts_tablet_manager.cc:1434] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f: Time spent starting tablet: real 0.088s	user 0.004s	sys 0.009s
W20260709 13:05:13.535279 16508 log.cc:927] Time spent T 7877d879c7564adfac82b8387dbbc867 P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:05:13.541762 16486 leader_election.cc:290] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:13.549774 16400 consensus_queue.cc:260] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:13.568157 16400 ts_tablet_manager.cc:1434] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e: Time spent starting tablet: real 0.123s	user 0.013s	sys 0.003s
I20260709 13:05:13.569218 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:13.570246 16398 tablet_bootstrap.cc:492] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f: Bootstrap starting.
I20260709 13:05:13.570169 16206 raft_consensus.cc:2468] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 0.
I20260709 13:05:13.593102 16246 leader_election.cc:304] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 363bb2f744eb486f9ad726f08214c98e
I20260709 13:05:13.596374 16484 raft_consensus.cc:2804] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:13.596903 16484 raft_consensus.cc:493] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:13.597317 16484 raft_consensus.cc:3060] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:13.592445 16400 tablet_bootstrap.cc:492] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e: Bootstrap starting.
I20260709 13:05:13.614215 16484 raft_consensus.cc:515] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:13.629765 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:05:13.630249 16400 tablet_bootstrap.cc:654] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:13.630610 16207 raft_consensus.cc:3060] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:13.631315 16398 tablet_bootstrap.cc:654] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:13.632086 16484 leader_election.cc:290] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:13.642930 16414 raft_consensus.cc:493] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:13.643522 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:05:13.643796 16414 raft_consensus.cc:515] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:05:13.645578 16248 leader_election.cc:343] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:13.650605 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:13.652339 16207 raft_consensus.cc:2468] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 1.
I20260709 13:05:13.653988 16246 leader_election.cc:304] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 363bb2f744eb486f9ad726f08214c98e
I20260709 13:05:13.654978 16484 raft_consensus.cc:2804] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:13.652132 16280 raft_consensus.cc:2468] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 0.
I20260709 13:05:13.655658 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:13.655716 16484 raft_consensus.cc:697] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:05:13.656644 16414 leader_election.cc:290] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:05:13.657531 16173 leader_election.cc:343] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:13.657163 16484 consensus_queue.cc:237] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:13.658655 16173 leader_election.cc:304] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 363bb2f744eb486f9ad726f08214c98e
I20260709 13:05:13.661827 16414 raft_consensus.cc:2804] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:13.662274 16414 raft_consensus.cc:493] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:13.662654 16414 raft_consensus.cc:3060] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:13.664710 16400 tablet_bootstrap.cc:492] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e: No bootstrap required, opened a new log
I20260709 13:05:13.665316 16400 ts_tablet_manager.cc:1403] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e: Time spent bootstrapping tablet: real 0.074s	user 0.020s	sys 0.021s
I20260709 13:05:13.668794 16397 tablet_bootstrap.cc:492] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3: No bootstrap required, opened a new log
I20260709 13:05:13.668984 16400 raft_consensus.cc:359] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:13.669699 16397 ts_tablet_manager.cc:1403] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3: Time spent bootstrapping tablet: real 0.229s	user 0.006s	sys 0.013s
I20260709 13:05:13.668794 16104 catalog_manager.cc:5697] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e reported cstate change: term changed from 0 to 1, leader changed from <none> to 363bb2f744eb486f9ad726f08214c98e (127.14.180.67). New cstate: current_term: 1 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:13.670024 16400 raft_consensus.cc:385] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:13.670394 16400 raft_consensus.cc:740] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Initialized, Role: FOLLOWER
I20260709 13:05:13.671295 16400 consensus_queue.cc:260] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:13.673673 16400 ts_tablet_manager.cc:1434] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:05:13.673280 16397 raft_consensus.cc:359] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:13.674427 16397 raft_consensus.cc:385] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:13.674865 16397 raft_consensus.cc:740] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Initialized, Role: FOLLOWER
I20260709 13:05:13.675272 16400 tablet_bootstrap.cc:492] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e: Bootstrap starting.
I20260709 13:05:13.675752 16397 consensus_queue.cc:260] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:13.679685 16397 ts_tablet_manager.cc:1434] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.004s
I20260709 13:05:13.681324 16397 tablet_bootstrap.cc:492] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3: Bootstrap starting.
I20260709 13:05:13.683892 16400 tablet_bootstrap.cc:654] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:13.685376 16398 tablet_bootstrap.cc:492] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f: No bootstrap required, opened a new log
I20260709 13:05:13.686483 16398 ts_tablet_manager.cc:1403] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f: Time spent bootstrapping tablet: real 0.117s	user 0.015s	sys 0.009s
I20260709 13:05:13.690006 16414 raft_consensus.cc:515] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:13.691742 16398 raft_consensus.cc:359] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:13.692492 16398 raft_consensus.cc:385] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:13.692796 16398 raft_consensus.cc:740] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Initialized, Role: FOLLOWER
I20260709 13:05:13.693562 16398 consensus_queue.cc:260] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:13.694433 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:05:13.695288 16280 raft_consensus.cc:3060] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:13.696290 16105 catalog_manager.cc:5697] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66). New cstate: current_term: 1 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:13.698514 16397 tablet_bootstrap.cc:654] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:13.698975 16105 catalog_manager.cc:5697] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66). New cstate: current_term: 1 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:13.702884 16398 ts_tablet_manager.cc:1434] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:05:13.704247 16398 tablet_bootstrap.cc:492] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f: Bootstrap starting.
I20260709 13:05:13.707301 16280 raft_consensus.cc:2468] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 1.
I20260709 13:05:13.709100 16173 leader_election.cc:304] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:13.710479 16428 raft_consensus.cc:2804] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:13.711175 16428 raft_consensus.cc:697] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:05:13.712551 16428 consensus_queue.cc:237] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:13.713876 16425 raft_consensus.cc:493] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:13.714498 16425 raft_consensus.cc:515] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:13.718331 16425 leader_election.cc:290] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:13.718881 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:13.720022 16281 raft_consensus.cc:2468] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 0.
I20260709 13:05:13.721273 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:13.722033 16207 raft_consensus.cc:2468] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 0.
I20260709 13:05:13.723093 16398 tablet_bootstrap.cc:654] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:13.723837 16320 leader_election.cc:304] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:13.727938 16425 raft_consensus.cc:2804] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:13.728567 16425 raft_consensus.cc:493] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:13.729066 16425 raft_consensus.cc:3060] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:13.740131 16489 consensus_queue.cc:1048] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:13.746332 16398 tablet_bootstrap.cc:492] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f: No bootstrap required, opened a new log
I20260709 13:05:13.746977 16398 ts_tablet_manager.cc:1403] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f: Time spent bootstrapping tablet: real 0.043s	user 0.013s	sys 0.000s
I20260709 13:05:13.751693 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
W20260709 13:05:13.754035 16173 leader_election.cc:343] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:13.755007 16414 leader_election.cc:290] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:13.750389 16398 raft_consensus.cc:359] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:13.764061 16398 raft_consensus.cc:385] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:13.763090 16489 consensus_queue.cc:1048] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:13.764372 16398 raft_consensus.cc:740] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Initialized, Role: FOLLOWER
I20260709 13:05:13.769745 16398 consensus_queue.cc:260] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:13.774982 16425 raft_consensus.cc:515] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:13.776410 16398 ts_tablet_manager.cc:1434] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
I20260709 13:05:13.778280 16398 tablet_bootstrap.cc:492] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f: Bootstrap starting.
I20260709 13:05:13.778597 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:05:13.779227 16207 raft_consensus.cc:3060] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:13.785015 16466 consensus_queue.cc:1048] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:05:13.787324 16105 catalog_manager.cc:5697] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f reported cstate change: term changed from 0 to 1, leader changed from <none> to e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65). New cstate: current_term: 1 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:13.788528 16397 tablet_bootstrap.cc:492] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3: No bootstrap required, opened a new log
I20260709 13:05:13.789037 16397 ts_tablet_manager.cc:1403] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3: Time spent bootstrapping tablet: real 0.108s	user 0.016s	sys 0.016s
I20260709 13:05:13.790787 16207 raft_consensus.cc:2468] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 1.
I20260709 13:05:13.793283 16320 leader_election.cc:304] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:13.793711 16397 raft_consensus.cc:359] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:13.794212 16466 raft_consensus.cc:2804] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:13.794433 16397 raft_consensus.cc:385] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:13.794879 16397 raft_consensus.cc:740] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Initialized, Role: FOLLOWER
I20260709 13:05:13.794245 16398 tablet_bootstrap.cc:654] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:13.795759 16397 consensus_queue.cc:260] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:13.797684 16400 tablet_bootstrap.cc:492] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e: No bootstrap required, opened a new log
I20260709 13:05:13.798342 16400 ts_tablet_manager.cc:1403] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e: Time spent bootstrapping tablet: real 0.123s	user 0.053s	sys 0.050s
I20260709 13:05:13.797873 16466 raft_consensus.cc:697] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 1 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:05:13.800082 16466 consensus_queue.cc:237] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:13.801440 16400 raft_consensus.cc:359] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:13.801301 16102 catalog_manager.cc:5697] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66). New cstate: current_term: 1 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:13.802371 16400 raft_consensus.cc:385] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:13.802815 16425 leader_election.cc:290] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:13.804286 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:05:13.802716 16400 raft_consensus.cc:740] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Initialized, Role: FOLLOWER
I20260709 13:05:13.805078 16282 raft_consensus.cc:3060] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:13.805706 16400 consensus_queue.cc:260] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:13.813275 16282 raft_consensus.cc:2468] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 1.
I20260709 13:05:13.816594 16400 ts_tablet_manager.cc:1434] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:05:13.817269 16425 consensus_queue.cc:1048] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:13.818089 16400 tablet_bootstrap.cc:492] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e: Bootstrap starting.
I20260709 13:05:13.827333 16400 tablet_bootstrap.cc:654] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:13.833381 16484 consensus_queue.cc:1048] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:13.835832 16398 tablet_bootstrap.cc:492] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f: No bootstrap required, opened a new log
I20260709 13:05:13.836439 16398 ts_tablet_manager.cc:1403] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f: Time spent bootstrapping tablet: real 0.059s	user 0.010s	sys 0.005s
I20260709 13:05:13.839725 16397 ts_tablet_manager.cc:1434] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3: Time spent starting tablet: real 0.050s	user 0.006s	sys 0.001s
I20260709 13:05:13.840523 16398 raft_consensus.cc:359] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:13.841287 16398 raft_consensus.cc:385] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:13.841570 16398 raft_consensus.cc:740] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Initialized, Role: FOLLOWER
I20260709 13:05:13.842250 16398 consensus_queue.cc:260] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:13.844645 16398 ts_tablet_manager.cc:1434] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:05:13.845920 16398 tablet_bootstrap.cc:492] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f: Bootstrap starting.
I20260709 13:05:13.854096 16398 tablet_bootstrap.cc:654] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:13.842752 16397 tablet_bootstrap.cc:492] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3: Bootstrap starting.
I20260709 13:05:13.864672 16484 consensus_queue.cc:1048] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:13.874095 16398 tablet_bootstrap.cc:492] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f: No bootstrap required, opened a new log
I20260709 13:05:13.874682 16398 ts_tablet_manager.cc:1403] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f: Time spent bootstrapping tablet: real 0.029s	user 0.015s	sys 0.004s
I20260709 13:05:13.877920 16398 raft_consensus.cc:359] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:13.878701 16398 raft_consensus.cc:385] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:13.878993 16398 raft_consensus.cc:740] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Initialized, Role: FOLLOWER
I20260709 13:05:13.879840 16398 consensus_queue.cc:260] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:13.882457 16398 ts_tablet_manager.cc:1434] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:05:13.888347 16397 tablet_bootstrap.cc:654] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:13.896538 16398 tablet_bootstrap.cc:492] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f: Bootstrap starting.
I20260709 13:05:13.895551 16428 raft_consensus.cc:493] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:13.901221 16428 raft_consensus.cc:515] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:13.906737 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:13.906435 16102 catalog_manager.cc:5697] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e reported cstate change: term changed from 0 to 1, leader changed from <none> to 363bb2f744eb486f9ad726f08214c98e (127.14.180.67). New cstate: current_term: 1 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } }
W20260709 13:05:13.910801 16173 leader_election.cc:343] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:13.912122 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:13.912811 16356 raft_consensus.cc:2468] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 0.
I20260709 13:05:13.914021 16173 leader_election.cc:304] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:05:13.910203 16428 leader_election.cc:290] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:13.915169 16450 raft_consensus.cc:2804] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:13.915670 16450 raft_consensus.cc:493] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:13.916091 16450 raft_consensus.cc:3060] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:13.919586 16398 tablet_bootstrap.cc:654] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:13.924767 16398 tablet_bootstrap.cc:492] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f: No bootstrap required, opened a new log
I20260709 13:05:13.909612 16400 tablet_bootstrap.cc:492] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e: No bootstrap required, opened a new log
I20260709 13:05:13.925889 16400 ts_tablet_manager.cc:1403] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e: Time spent bootstrapping tablet: real 0.108s	user 0.026s	sys 0.028s
I20260709 13:05:13.925333 16450 raft_consensus.cc:515] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:13.925335 16397 tablet_bootstrap.cc:492] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3: No bootstrap required, opened a new log
I20260709 13:05:13.927367 16397 ts_tablet_manager.cc:1403] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3: Time spent bootstrapping tablet: real 0.086s	user 0.017s	sys 0.000s
I20260709 13:05:13.928186 16450 leader_election.cc:290] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:13.929097 16400 raft_consensus.cc:359] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:13.929809 16400 raft_consensus.cc:385] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:13.930131 16400 raft_consensus.cc:740] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Initialized, Role: FOLLOWER
I20260709 13:05:13.930027 16397 raft_consensus.cc:359] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:13.930867 16397 raft_consensus.cc:385] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:13.931154 16397 raft_consensus.cc:740] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Initialized, Role: FOLLOWER
I20260709 13:05:13.931082 16400 consensus_queue.cc:260] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:13.931877 16397 consensus_queue.cc:260] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:13.925335 16398 ts_tablet_manager.cc:1403] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f: Time spent bootstrapping tablet: real 0.035s	user 0.012s	sys 0.001s
I20260709 13:05:13.932576 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:05:13.933336 16356 raft_consensus.cc:3060] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:13.933801 16400 ts_tablet_manager.cc:1434] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:05:13.935057 16400 tablet_bootstrap.cc:492] T 5063fcda38c2468a8dad5d01023b700a P 363bb2f744eb486f9ad726f08214c98e: Bootstrap starting.
I20260709 13:05:13.935809 16398 raft_consensus.cc:359] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:13.936847 16398 raft_consensus.cc:385] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:13.937182 16398 raft_consensus.cc:740] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Initialized, Role: FOLLOWER
I20260709 13:05:13.938170 16398 consensus_queue.cc:260] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:13.940639 16398 ts_tablet_manager.cc:1434] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:05:13.941847 16398 tablet_bootstrap.cc:492] T bb3b9c4ba1f147fc8d9858234bfce423 P e10b16d536674c0bb350a31d7ce5ff7f: Bootstrap starting.
I20260709 13:05:13.942695 16356 raft_consensus.cc:2468] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 1.
I20260709 13:05:13.943558 16400 tablet_bootstrap.cc:654] T 5063fcda38c2468a8dad5d01023b700a P 363bb2f744eb486f9ad726f08214c98e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:13.944082 16173 leader_election.cc:304] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:13.945192 16414 raft_consensus.cc:2804] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:13.945694 16414 raft_consensus.cc:697] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:05:13.946712 16414 consensus_queue.cc:237] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:13.954106 16397 ts_tablet_manager.cc:1434] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260709 13:05:13.955644 16397 tablet_bootstrap.cc:492] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3: Bootstrap starting.
I20260709 13:05:13.958272 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
W20260709 13:05:13.962328 16154 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:13.972455 16398 tablet_bootstrap.cc:654] T bb3b9c4ba1f147fc8d9858234bfce423 P e10b16d536674c0bb350a31d7ce5ff7f: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:13.976477 16173 leader_election.cc:343] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:13.978597 16397 tablet_bootstrap.cc:654] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:13.981237 16489 raft_consensus.cc:493] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:13.982177 16489 raft_consensus.cc:515] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:13.985627 16489 leader_election.cc:290] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:13.992429 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:13.992780 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:13.998520 16414 raft_consensus.cc:493] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:13.999399 16414 raft_consensus.cc:515] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:14.002729 16414 leader_election.cc:290] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:05:14.006047 16173 leader_election.cc:343] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:14.012655 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:14.013733 16281 raft_consensus.cc:2468] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 0.
I20260709 13:05:14.017865 16425 raft_consensus.cc:493] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:14.018436 16425 raft_consensus.cc:515] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:14.018580 16105 catalog_manager.cc:5697] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f reported cstate change: term changed from 0 to 1, leader changed from <none> to e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65). New cstate: current_term: 1 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:14.020768 16425 leader_election.cc:290] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:14.022447 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:14.023241 16208 raft_consensus.cc:2468] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 0.
W20260709 13:05:14.023447 16248 consensus_peers.cc:597] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 -> Peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Couldn't send request to peer 363bb2f744eb486f9ad726f08214c98e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:14.024626 16320 leader_election.cc:304] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:14.022354 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:14.025563 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:05:14.027666 16322 leader_election.cc:343] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:14.031107 16173 leader_election.cc:343] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:14.031419 16425 raft_consensus.cc:2804] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:14.031821 16425 raft_consensus.cc:493] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:14.031783 16173 leader_election.cc:304] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:05:14.032299 16425 raft_consensus.cc:3060] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:14.032831 16489 raft_consensus.cc:2749] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:14.034024 16173 leader_election.cc:304] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:14.036335 16489 raft_consensus.cc:2804] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:14.036788 16489 raft_consensus.cc:493] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:14.037554 16489 raft_consensus.cc:3060] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:14.045215 16425 raft_consensus.cc:515] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:14.048012 16397 tablet_bootstrap.cc:492] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3: No bootstrap required, opened a new log
I20260709 13:05:14.048873 16397 ts_tablet_manager.cc:1403] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3: Time spent bootstrapping tablet: real 0.094s	user 0.012s	sys 0.003s
I20260709 13:05:14.048653 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:05:14.049782 16208 raft_consensus.cc:3060] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:14.051339 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
W20260709 13:05:14.052516 16173 leader_election.cc:343] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:14.053042 16322 leader_election.cc:343] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:14.054258 16425 leader_election.cc:290] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:14.054811 16397 raft_consensus.cc:359] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:14.056774 16397 raft_consensus.cc:385] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:14.057260 16397 raft_consensus.cc:740] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Initialized, Role: FOLLOWER
I20260709 13:05:14.060806 16397 consensus_queue.cc:260] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:14.061712 16398 tablet_bootstrap.cc:492] T bb3b9c4ba1f147fc8d9858234bfce423 P e10b16d536674c0bb350a31d7ce5ff7f: No bootstrap required, opened a new log
I20260709 13:05:14.062203 16398 ts_tablet_manager.cc:1403] T bb3b9c4ba1f147fc8d9858234bfce423 P e10b16d536674c0bb350a31d7ce5ff7f: Time spent bootstrapping tablet: real 0.121s	user 0.041s	sys 0.044s
I20260709 13:05:14.063123 16397 ts_tablet_manager.cc:1434] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:05:14.063608 16484 consensus_queue.cc:1048] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:14.064252 16397 tablet_bootstrap.cc:492] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3: Bootstrap starting.
I20260709 13:05:14.065233 16398 raft_consensus.cc:359] T bb3b9c4ba1f147fc8d9858234bfce423 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:14.045215 16489 raft_consensus.cc:515] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:14.066113 16398 raft_consensus.cc:385] T bb3b9c4ba1f147fc8d9858234bfce423 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:14.066432 16398 raft_consensus.cc:740] T bb3b9c4ba1f147fc8d9858234bfce423 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Initialized, Role: FOLLOWER
I20260709 13:05:14.067267 16398 consensus_queue.cc:260] T bb3b9c4ba1f147fc8d9858234bfce423 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:14.067776 16489 leader_election.cc:290] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:14.068856 16484 raft_consensus.cc:493] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:14.069433 16484 raft_consensus.cc:515] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:14.070372 16450 raft_consensus.cc:493] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:14.070904 16450 raft_consensus.cc:515] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:14.071280 16208 raft_consensus.cc:2468] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 1.
I20260709 13:05:14.072597 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:14.072811 16450 leader_election.cc:290] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:14.073217 16208 raft_consensus.cc:2468] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 0.
I20260709 13:05:14.073891 16398 ts_tablet_manager.cc:1434] T bb3b9c4ba1f147fc8d9858234bfce423 P e10b16d536674c0bb350a31d7ce5ff7f: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.001s
I20260709 13:05:14.073828 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:14.073841 16320 leader_election.cc:304] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:05:14.075070 16398 tablet_bootstrap.cc:492] T 39dd6382a0304387a1341bcc36471cbf P e10b16d536674c0bb350a31d7ce5ff7f: Bootstrap starting.
I20260709 13:05:14.075882 16356 raft_consensus.cc:2468] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 0.
I20260709 13:05:14.077497 16248 leader_election.cc:304] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:05:14.078661 16486 raft_consensus.cc:2804] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:14.079048 16486 raft_consensus.cc:493] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:14.079384 16486 raft_consensus.cc:3060] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:14.081434 16425 raft_consensus.cc:2804] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:14.082011 16425 raft_consensus.cc:697] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 1 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:05:14.083082 16397 tablet_bootstrap.cc:654] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:14.082899 16425 consensus_queue.cc:237] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:14.083767 16400 tablet_bootstrap.cc:492] T 5063fcda38c2468a8dad5d01023b700a P 363bb2f744eb486f9ad726f08214c98e: No bootstrap required, opened a new log
I20260709 13:05:14.084227 16400 ts_tablet_manager.cc:1403] T 5063fcda38c2468a8dad5d01023b700a P 363bb2f744eb486f9ad726f08214c98e: Time spent bootstrapping tablet: real 0.150s	user 0.052s	sys 0.035s
I20260709 13:05:14.085054 16484 leader_election.cc:290] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:14.082906 16398 tablet_bootstrap.cc:654] T 39dd6382a0304387a1341bcc36471cbf P e10b16d536674c0bb350a31d7ce5ff7f: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:14.086704 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:05:14.088459 16280 raft_consensus.cc:3060] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:14.088508 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:05:14.087476 16486 raft_consensus.cc:515] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:14.091928 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:05:14.093001 16208 raft_consensus.cc:3060] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:14.096679 16486 leader_election.cc:290] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:14.097278 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:05:14.098244 16354 raft_consensus.cc:3060] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:14.087172 16400 raft_consensus.cc:359] T 5063fcda38c2468a8dad5d01023b700a P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:14.099541 16400 raft_consensus.cc:385] T 5063fcda38c2468a8dad5d01023b700a P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:14.100550 16400 raft_consensus.cc:740] T 5063fcda38c2468a8dad5d01023b700a P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Initialized, Role: FOLLOWER
I20260709 13:05:14.100629 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:14.099800 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:14.103350 16281 raft_consensus.cc:2393] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 1: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:05:14.102387 16400 consensus_queue.cc:260] T 5063fcda38c2468a8dad5d01023b700a P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:14.104177 16280 raft_consensus.cc:2468] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 1.
I20260709 13:05:14.106287 16356 raft_consensus.cc:3060] T 5063fcda38c2468a8dad5d01023b700a P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:14.108491 16400 ts_tablet_manager.cc:1434] T 5063fcda38c2468a8dad5d01023b700a P 363bb2f744eb486f9ad726f08214c98e: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 13:05:14.109613 16354 raft_consensus.cc:2468] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 1.
I20260709 13:05:14.113571 16400 tablet_bootstrap.cc:492] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e: Bootstrap starting.
I20260709 13:05:14.127956 16208 raft_consensus.cc:2468] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 1.
I20260709 13:05:14.113730 16248 leader_election.cc:304] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:05:14.133566 16484 raft_consensus.cc:2804] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:14.115700 16356 raft_consensus.cc:2468] T 5063fcda38c2468a8dad5d01023b700a P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 1.
I20260709 13:05:14.105225 16173 leader_election.cc:304] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:05:14.136787 16397 tablet_bootstrap.cc:492] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3: No bootstrap required, opened a new log
I20260709 13:05:14.136852 16489 raft_consensus.cc:2749] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:14.137382 16397 ts_tablet_manager.cc:1403] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3: Time spent bootstrapping tablet: real 0.073s	user 0.011s	sys 0.005s
I20260709 13:05:14.134363 16484 raft_consensus.cc:697] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:05:14.139232 16173 leader_election.cc:304] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:14.139063 16484 consensus_queue.cc:237] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:14.140345 16489 raft_consensus.cc:2804] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:14.140847 16489 raft_consensus.cc:697] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [term 1 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:05:14.141695 16489 consensus_queue.cc:237] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:14.141299 16103 catalog_manager.cc:5697] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e reported cstate change: term changed from 0 to 1, leader changed from <none> to 363bb2f744eb486f9ad726f08214c98e (127.14.180.67). New cstate: current_term: 1 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:14.144444 16400 tablet_bootstrap.cc:654] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:14.155653 16397 raft_consensus.cc:359] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:14.156864 16397 raft_consensus.cc:385] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:05:14.157162 16173 consensus_peers.cc:597] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f -> Peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Couldn't send request to peer 363bb2f744eb486f9ad726f08214c98e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:14.157192 16397 raft_consensus.cc:740] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Initialized, Role: FOLLOWER
I20260709 13:05:14.158516 16397 consensus_queue.cc:260] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:14.161460 16397 ts_tablet_manager.cc:1434] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.003s
I20260709 13:05:14.163062 16397 tablet_bootstrap.cc:492] T 186b9e9483624c769871a8894ee07efa P 0aea40d6e4374085a2e38a70a71f63e3: Bootstrap starting.
I20260709 13:05:14.164793 16398 tablet_bootstrap.cc:492] T 39dd6382a0304387a1341bcc36471cbf P e10b16d536674c0bb350a31d7ce5ff7f: No bootstrap required, opened a new log
I20260709 13:05:14.165577 16398 ts_tablet_manager.cc:1403] T 39dd6382a0304387a1341bcc36471cbf P e10b16d536674c0bb350a31d7ce5ff7f: Time spent bootstrapping tablet: real 0.091s	user 0.034s	sys 0.029s
I20260709 13:05:14.183328 16397 tablet_bootstrap.cc:654] T 186b9e9483624c769871a8894ee07efa P 0aea40d6e4374085a2e38a70a71f63e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:14.186404 16103 catalog_manager.cc:5697] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66). New cstate: current_term: 1 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:14.192113 16400 tablet_bootstrap.cc:492] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e: No bootstrap required, opened a new log
I20260709 13:05:14.188882 16398 raft_consensus.cc:359] T 39dd6382a0304387a1341bcc36471cbf P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:14.191502 16106 catalog_manager.cc:5697] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f reported cstate change: term changed from 0 to 1, leader changed from <none> to e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65). New cstate: current_term: 1 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:14.189826 16397 tablet_bootstrap.cc:492] T 186b9e9483624c769871a8894ee07efa P 0aea40d6e4374085a2e38a70a71f63e3: No bootstrap required, opened a new log
I20260709 13:05:14.192564 16398 raft_consensus.cc:385] T 39dd6382a0304387a1341bcc36471cbf P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:14.192623 16400 ts_tablet_manager.cc:1403] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e: Time spent bootstrapping tablet: real 0.079s	user 0.016s	sys 0.003s
I20260709 13:05:14.194706 16398 raft_consensus.cc:740] T 39dd6382a0304387a1341bcc36471cbf P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Initialized, Role: FOLLOWER
I20260709 13:05:14.194310 16484 consensus_queue.cc:1048] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:14.195776 16398 consensus_queue.cc:260] T 39dd6382a0304387a1341bcc36471cbf P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:14.197510 16400 raft_consensus.cc:359] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:14.197955 16398 ts_tablet_manager.cc:1434] T 39dd6382a0304387a1341bcc36471cbf P e10b16d536674c0bb350a31d7ce5ff7f: Time spent starting tablet: real 0.032s	user 0.001s	sys 0.004s
I20260709 13:05:14.198202 16400 raft_consensus.cc:385] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:14.198521 16400 raft_consensus.cc:740] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Initialized, Role: FOLLOWER
I20260709 13:05:14.199106 16398 tablet_bootstrap.cc:492] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f: Bootstrap starting.
I20260709 13:05:14.192919 16397 ts_tablet_manager.cc:1403] T 186b9e9483624c769871a8894ee07efa P 0aea40d6e4374085a2e38a70a71f63e3: Time spent bootstrapping tablet: real 0.030s	user 0.011s	sys 0.001s
I20260709 13:05:14.202368 16397 raft_consensus.cc:359] T 186b9e9483624c769871a8894ee07efa P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:14.203351 16397 raft_consensus.cc:385] T 186b9e9483624c769871a8894ee07efa P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:14.203653 16397 raft_consensus.cc:740] T 186b9e9483624c769871a8894ee07efa P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Initialized, Role: FOLLOWER
I20260709 13:05:14.204370 16397 consensus_queue.cc:260] T 186b9e9483624c769871a8894ee07efa P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:14.207132 16397 ts_tablet_manager.cc:1434] T 186b9e9483624c769871a8894ee07efa P 0aea40d6e4374085a2e38a70a71f63e3: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:05:14.207958 16398 tablet_bootstrap.cc:654] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:14.208182 16397 tablet_bootstrap.cc:492] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3: Bootstrap starting.
I20260709 13:05:14.214838 16400 consensus_queue.cc:260] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:14.217123 16400 ts_tablet_manager.cc:1434] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e: Time spent starting tablet: real 0.022s	user 0.002s	sys 0.002s
I20260709 13:05:14.221834 16354 raft_consensus.cc:3060] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:14.222239 16400 tablet_bootstrap.cc:492] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e: Bootstrap starting.
I20260709 13:05:14.226850 16397 tablet_bootstrap.cc:654] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:14.228456 16486 raft_consensus.cc:493] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:14.229164 16486 raft_consensus.cc:515] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:14.232522 16400 tablet_bootstrap.cc:654] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:14.237147 16481 raft_consensus.cc:493] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:14.241715 16486 leader_election.cc:290] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:14.243410 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:14.244280 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:14.247144 16208 raft_consensus.cc:2468] T 39dd6382a0304387a1341bcc36471cbf P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 0.
I20260709 13:05:14.248718 16246 leader_election.cc:304] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
W20260709 13:05:14.249593 16248 leader_election.cc:343] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:14.245929 16450 consensus_queue.cc:1048] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:14.261520 16397 tablet_bootstrap.cc:492] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3: No bootstrap required, opened a new log
I20260709 13:05:14.262125 16397 ts_tablet_manager.cc:1403] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3: Time spent bootstrapping tablet: real 0.054s	user 0.016s	sys 0.005s
I20260709 13:05:14.265287 16425 consensus_queue.cc:1048] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:14.267721 16400 tablet_bootstrap.cc:492] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e: No bootstrap required, opened a new log
I20260709 13:05:14.268312 16400 ts_tablet_manager.cc:1403] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e: Time spent bootstrapping tablet: real 0.046s	user 0.010s	sys 0.013s
I20260709 13:05:14.270238 16397 raft_consensus.cc:359] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:14.271219 16397 raft_consensus.cc:385] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:14.271589 16397 raft_consensus.cc:740] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Initialized, Role: FOLLOWER
I20260709 13:05:14.272466 16397 consensus_queue.cc:260] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:14.237882 16481 raft_consensus.cc:515] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:14.277180 16400 raft_consensus.cc:359] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:14.278134 16400 raft_consensus.cc:385] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:14.278504 16400 raft_consensus.cc:740] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Initialized, Role: FOLLOWER
I20260709 13:05:14.279726 16400 consensus_queue.cc:260] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:14.281636 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:14.282640 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:05:14.283133 16246 leader_election.cc:343] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:14.283560 16356 raft_consensus.cc:2468] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 0.
I20260709 13:05:14.285360 16248 leader_election.cc:304] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:14.294828 16484 raft_consensus.cc:2804] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:14.295403 16484 raft_consensus.cc:493] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:14.295830 16484 raft_consensus.cc:3060] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:14.305343 16551 raft_consensus.cc:2804] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:14.305939 16551 raft_consensus.cc:493] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:14.312685 16400 ts_tablet_manager.cc:1434] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e: Time spent starting tablet: real 0.044s	user 0.010s	sys 0.001s
I20260709 13:05:14.315826 16476 consensus_queue.cc:1048] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:14.325116 16481 leader_election.cc:290] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:14.308706 16397 ts_tablet_manager.cc:1434] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3: Time spent starting tablet: real 0.046s	user 0.005s	sys 0.009s
I20260709 13:05:14.339432 16397 tablet_bootstrap.cc:492] T 916cdb289e9442b69dd8ed0c99eb8198 P 0aea40d6e4374085a2e38a70a71f63e3: Bootstrap starting.
I20260709 13:05:14.343328 16400 tablet_bootstrap.cc:492] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e: Bootstrap starting.
I20260709 13:05:14.306499 16551 raft_consensus.cc:3060] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:14.376956 16173 consensus_peers.cc:597] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f -> Peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Couldn't send request to peer 0aea40d6e4374085a2e38a70a71f63e3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:14.380262 16481 consensus_queue.cc:1048] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:14.387130 16552 raft_consensus.cc:493] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:14.387669 16552 raft_consensus.cc:515] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:14.390967 16489 consensus_queue.cc:1048] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:14.394886 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:14.396025 16206 raft_consensus.cc:2468] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 0.
I20260709 13:05:14.397951 16246 leader_election.cc:304] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:14.399827 16486 raft_consensus.cc:2804] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:14.400406 16486 raft_consensus.cc:493] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:14.400943 16486 raft_consensus.cc:3060] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:14.393766 16552 leader_election.cc:290] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:14.403553 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:05:14.409358 16248 leader_election.cc:343] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:14.415063 16400 tablet_bootstrap.cc:654] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:14.422696 16484 raft_consensus.cc:515] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:14.430440 16397 tablet_bootstrap.cc:654] T 916cdb289e9442b69dd8ed0c99eb8198 P 0aea40d6e4374085a2e38a70a71f63e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:14.439586 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:05:14.442761 16206 raft_consensus.cc:3060] T 39dd6382a0304387a1341bcc36471cbf P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:14.448998 16484 leader_election.cc:290] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:14.450134 16486 raft_consensus.cc:515] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:14.450496 16551 raft_consensus.cc:515] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:14.451946 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:05:14.456547 16206 raft_consensus.cc:2468] T 39dd6382a0304387a1341bcc36471cbf P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 1.
W20260709 13:05:14.454152 16248 leader_election.cc:343] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:14.461349 16246 leader_election.cc:304] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 363bb2f744eb486f9ad726f08214c98e
I20260709 13:05:14.461720 16551 leader_election.cc:290] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:14.463390 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:05:14.464015 16357 raft_consensus.cc:3060] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:14.459410 16398 tablet_bootstrap.cc:492] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f: No bootstrap required, opened a new log
I20260709 13:05:14.465091 16398 ts_tablet_manager.cc:1403] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f: Time spent bootstrapping tablet: real 0.266s	user 0.053s	sys 0.115s
I20260709 13:05:14.466027 16484 raft_consensus.cc:2804] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:14.466655 16484 raft_consensus.cc:697] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:05:14.467649 16484 consensus_queue.cc:237] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:14.475039 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:05:14.475667 16206 raft_consensus.cc:3060] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:14.476150 16357 raft_consensus.cc:2468] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 1.
I20260709 13:05:14.477448 16248 leader_election.cc:304] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:05:14.478698 16552 raft_consensus.cc:2804] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:14.479202 16552 raft_consensus.cc:697] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:05:14.480047 16552 consensus_queue.cc:237] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:14.483067 16398 raft_consensus.cc:359] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:14.483855 16398 raft_consensus.cc:385] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:14.484141 16398 raft_consensus.cc:740] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Initialized, Role: FOLLOWER
I20260709 13:05:14.484802 16398 consensus_queue.cc:260] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:14.486260 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:05:14.486984 16207 raft_consensus.cc:3060] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:14.498513 16207 raft_consensus.cc:2468] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 1.
I20260709 13:05:14.503948 16398 ts_tablet_manager.cc:1434] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f: Time spent starting tablet: real 0.039s	user 0.004s	sys 0.004s
I20260709 13:05:14.517551 16484 raft_consensus.cc:493] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:14.519517 16484 raft_consensus.cc:515] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:14.523571 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:14.524775 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:05:14.525453 16246 leader_election.cc:343] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:14.528352 16248 leader_election.cc:343] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:14.529007 16248 leader_election.cc:304] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:14.530057 16551 raft_consensus.cc:2749] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:14.531556 16206 raft_consensus.cc:2468] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 1.
I20260709 13:05:14.533674 16246 leader_election.cc:304] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:14.534696 16551 raft_consensus.cc:2804] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:14.535241 16551 raft_consensus.cc:697] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:05:14.535526 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:05:14.483305 16486 leader_election.cc:290] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:14.537807 16481 raft_consensus.cc:493] T 186b9e9483624c769871a8894ee07efa P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:14.541188 16428 raft_consensus.cc:493] T bb3b9c4ba1f147fc8d9858234bfce423 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:14.541601 16481 raft_consensus.cc:515] T 186b9e9483624c769871a8894ee07efa P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:05:14.541925 16248 leader_election.cc:343] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:14.536191 16551 consensus_queue.cc:237] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:14.543898 16481 leader_election.cc:290] T 186b9e9483624c769871a8894ee07efa P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:14.541664 16428 raft_consensus.cc:515] T bb3b9c4ba1f147fc8d9858234bfce423 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:14.537504 16484 leader_election.cc:290] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:14.548509 16398 tablet_bootstrap.cc:492] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f: Bootstrap starting.
I20260709 13:05:14.551568 16397 tablet_bootstrap.cc:492] T 916cdb289e9442b69dd8ed0c99eb8198 P 0aea40d6e4374085a2e38a70a71f63e3: No bootstrap required, opened a new log
I20260709 13:05:14.552279 16397 ts_tablet_manager.cc:1403] T 916cdb289e9442b69dd8ed0c99eb8198 P 0aea40d6e4374085a2e38a70a71f63e3: Time spent bootstrapping tablet: real 0.213s	user 0.018s	sys 0.004s
I20260709 13:05:14.557272 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:14.559095 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:14.561453 16397 raft_consensus.cc:359] T 916cdb289e9442b69dd8ed0c99eb8198 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:14.563681 16397 raft_consensus.cc:385] T 916cdb289e9442b69dd8ed0c99eb8198 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:14.564157 16397 raft_consensus.cc:740] T 916cdb289e9442b69dd8ed0c99eb8198 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Initialized, Role: FOLLOWER
I20260709 13:05:14.567768 16397 consensus_queue.cc:260] T 916cdb289e9442b69dd8ed0c99eb8198 P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:14.572132 16207 raft_consensus.cc:2393] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 1: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:05:14.573218 16397 ts_tablet_manager.cc:1434] T 916cdb289e9442b69dd8ed0c99eb8198 P 0aea40d6e4374085a2e38a70a71f63e3: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.005s
I20260709 13:05:14.575630 16428 leader_election.cc:290] T bb3b9c4ba1f147fc8d9858234bfce423 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:14.578303 16246 leader_election.cc:304] T 186b9e9483624c769871a8894ee07efa P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:14.579288 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:14.580399 16551 raft_consensus.cc:3060] T 186b9e9483624c769871a8894ee07efa P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:14.581066 16397 tablet_bootstrap.cc:492] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3: Bootstrap starting.
W20260709 13:05:14.580794 16173 leader_election.cc:343] T bb3b9c4ba1f147fc8d9858234bfce423 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:14.583801 16400 tablet_bootstrap.cc:492] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e: No bootstrap required, opened a new log
I20260709 13:05:14.584255 16400 ts_tablet_manager.cc:1403] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e: Time spent bootstrapping tablet: real 0.241s	user 0.020s	sys 0.035s
I20260709 13:05:14.587177 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:14.590915 16414 consensus_queue.cc:1048] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:14.593827 16551 raft_consensus.cc:2749] T 186b9e9483624c769871a8894ee07efa P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:05:14.597817 16173 leader_election.cc:343] T bb3b9c4ba1f147fc8d9858234bfce423 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:14.598536 16173 leader_election.cc:304] T bb3b9c4ba1f147fc8d9858234bfce423 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:05:14.600046 16398 tablet_bootstrap.cc:654] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:14.600998 16414 raft_consensus.cc:2749] T bb3b9c4ba1f147fc8d9858234bfce423 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:14.603070 16400 raft_consensus.cc:359] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:14.603819 16400 raft_consensus.cc:385] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:14.604132 16400 raft_consensus.cc:740] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Initialized, Role: FOLLOWER
I20260709 13:05:14.604874 16400 consensus_queue.cc:260] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:14.607224 16400 ts_tablet_manager.cc:1434] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.004s
I20260709 13:05:14.608457 16400 tablet_bootstrap.cc:492] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e: Bootstrap starting.
I20260709 13:05:14.612682 16102 catalog_manager.cc:5697] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66). New cstate: current_term: 1 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:14.610224 16476 consensus_queue.cc:1048] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:05:14.619978 16397 tablet_bootstrap.cc:654] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:14.617084 16102 catalog_manager.cc:5697] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66). New cstate: current_term: 1 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:14.643750 16400 tablet_bootstrap.cc:654] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:14.645843 16551 consensus_queue.cc:1048] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:05:14.652383 16397 tablet_bootstrap.cc:492] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3: No bootstrap required, opened a new log
I20260709 13:05:14.652895 16397 ts_tablet_manager.cc:1403] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3: Time spent bootstrapping tablet: real 0.077s	user 0.018s	sys 0.000s
I20260709 13:05:14.653993 16398 tablet_bootstrap.cc:492] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f: No bootstrap required, opened a new log
I20260709 13:05:14.654451 16398 ts_tablet_manager.cc:1403] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f: Time spent bootstrapping tablet: real 0.107s	user 0.012s	sys 0.015s
I20260709 13:05:14.656711 16476 consensus_queue.cc:1048] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:14.662322 16489 consensus_queue.cc:1048] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:14.668426 16397 raft_consensus.cc:359] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:14.674728 16397 raft_consensus.cc:385] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:14.675557 16397 raft_consensus.cc:740] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Initialized, Role: FOLLOWER
I20260709 13:05:14.672245 16398 raft_consensus.cc:359] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:14.676743 16398 raft_consensus.cc:385] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:14.677103 16398 raft_consensus.cc:740] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Initialized, Role: FOLLOWER
I20260709 13:05:14.677825 16398 consensus_queue.cc:260] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:14.681870 16398 ts_tablet_manager.cc:1434] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f: Time spent starting tablet: real 0.027s	user 0.005s	sys 0.001s
I20260709 13:05:14.684832 16398 tablet_bootstrap.cc:492] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f: Bootstrap starting.
I20260709 13:05:14.678972 16397 consensus_queue.cc:260] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:14.692158 16397 ts_tablet_manager.cc:1434] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3: Time spent starting tablet: real 0.039s	user 0.007s	sys 0.000s
I20260709 13:05:14.693341 16397 tablet_bootstrap.cc:492] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3: Bootstrap starting.
I20260709 13:05:14.700075 16102 catalog_manager.cc:5697] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66). New cstate: current_term: 1 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:14.706992 16398 tablet_bootstrap.cc:654] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:14.712087 16397 tablet_bootstrap.cc:654] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:14.716001 16551 consensus_queue.cc:1048] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:14.741726 16398 tablet_bootstrap.cc:492] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f: No bootstrap required, opened a new log
I20260709 13:05:14.743316 16398 ts_tablet_manager.cc:1403] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f: Time spent bootstrapping tablet: real 0.059s	user 0.010s	sys 0.003s
I20260709 13:05:14.757333 16283 raft_consensus.cc:3060] T 916cdb289e9442b69dd8ed0c99eb8198 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:14.761153 16397 tablet_bootstrap.cc:492] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3: No bootstrap required, opened a new log
I20260709 13:05:14.764204 16397 ts_tablet_manager.cc:1403] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3: Time spent bootstrapping tablet: real 0.071s	user 0.023s	sys 0.018s
I20260709 13:05:14.768734 16400 tablet_bootstrap.cc:492] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e: No bootstrap required, opened a new log
I20260709 13:05:14.769249 16400 ts_tablet_manager.cc:1403] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e: Time spent bootstrapping tablet: real 0.161s	user 0.020s	sys 0.016s
I20260709 13:05:14.746902 16398 raft_consensus.cc:359] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:14.771528 16398 raft_consensus.cc:385] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:14.771850 16398 raft_consensus.cc:740] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Initialized, Role: FOLLOWER
I20260709 13:05:14.772641 16398 consensus_queue.cc:260] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:14.773047 16400 raft_consensus.cc:359] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:14.773819 16400 raft_consensus.cc:385] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:14.773860 16428 raft_consensus.cc:493] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:14.774236 16400 raft_consensus.cc:740] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Initialized, Role: FOLLOWER
I20260709 13:05:14.774410 16428 raft_consensus.cc:515] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:14.774981 16400 consensus_queue.cc:260] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:14.776726 16428 leader_election.cc:290] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:14.774974 16398 ts_tablet_manager.cc:1434] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.001s
I20260709 13:05:14.778088 16400 ts_tablet_manager.cc:1434] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:05:14.779145 16400 tablet_bootstrap.cc:492] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e: Bootstrap starting.
I20260709 13:05:14.779630 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:14.779625 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:14.781992 16398 tablet_bootstrap.cc:492] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f: Bootstrap starting.
W20260709 13:05:14.782380 16173 leader_election.cc:343] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:14.783149 16173 leader_election.cc:343] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:14.783571 16173 leader_election.cc:304] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:05:14.784762 16428 raft_consensus.cc:2749] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:14.793967 16398 tablet_bootstrap.cc:654] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:14.794906 16397 raft_consensus.cc:359] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:14.795744 16397 raft_consensus.cc:385] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:14.796029 16397 raft_consensus.cc:740] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Initialized, Role: FOLLOWER
I20260709 13:05:14.796775 16397 consensus_queue.cc:260] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:14.799146 16397 ts_tablet_manager.cc:1434] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3: Time spent starting tablet: real 0.034s	user 0.005s	sys 0.002s
I20260709 13:05:14.800225 16397 tablet_bootstrap.cc:492] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3: Bootstrap starting.
I20260709 13:05:14.818240 16397 tablet_bootstrap.cc:654] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:14.821288 16400 tablet_bootstrap.cc:654] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:14.836774 16398 tablet_bootstrap.cc:492] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f: No bootstrap required, opened a new log
I20260709 13:05:14.838776 16397 tablet_bootstrap.cc:492] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3: No bootstrap required, opened a new log
I20260709 13:05:14.839509 16397 ts_tablet_manager.cc:1403] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3: Time spent bootstrapping tablet: real 0.040s	user 0.004s	sys 0.012s
I20260709 13:05:14.843839 16398 ts_tablet_manager.cc:1403] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f: Time spent bootstrapping tablet: real 0.062s	user 0.012s	sys 0.005s
I20260709 13:05:14.843583 16397 raft_consensus.cc:359] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:14.844652 16397 raft_consensus.cc:385] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:14.845067 16397 raft_consensus.cc:740] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Initialized, Role: FOLLOWER
I20260709 13:05:14.847325 16397 consensus_queue.cc:260] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:14.850054 16489 raft_consensus.cc:493] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:14.850826 16397 ts_tablet_manager.cc:1434] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3: Time spent starting tablet: real 0.011s	user 0.010s	sys 0.001s
I20260709 13:05:14.850669 16489 raft_consensus.cc:515] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:14.851235 16398 raft_consensus.cc:359] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:14.851964 16398 raft_consensus.cc:385] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:14.852285 16398 raft_consensus.cc:740] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Initialized, Role: FOLLOWER
I20260709 13:05:14.852855 16400 tablet_bootstrap.cc:492] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e: No bootstrap required, opened a new log
I20260709 13:05:14.853394 16400 ts_tablet_manager.cc:1403] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e: Time spent bootstrapping tablet: real 0.074s	user 0.017s	sys 0.010s
I20260709 13:05:14.853014 16398 consensus_queue.cc:260] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:14.854918 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bc3c8ff9b84838a2664335d7e1582b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:14.855360 16398 ts_tablet_manager.cc:1434] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:05:14.855731 16283 raft_consensus.cc:2468] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 0.
I20260709 13:05:14.856314 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bc3c8ff9b84838a2664335d7e1582b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:14.856678 16398 tablet_bootstrap.cc:492] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f: Bootstrap starting.
I20260709 13:05:14.857344 16400 raft_consensus.cc:359] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:14.857745 16476 raft_consensus.cc:493] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:14.858130 16400 raft_consensus.cc:385] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:14.858752 16400 raft_consensus.cc:740] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Initialized, Role: FOLLOWER
I20260709 13:05:14.858266 16476 raft_consensus.cc:515] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:14.859629 16400 consensus_queue.cc:260] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:14.860742 16476 leader_election.cc:290] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:14.860950 16397 tablet_bootstrap.cc:492] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3: Bootstrap starting.
I20260709 13:05:14.861789 16400 ts_tablet_manager.cc:1434] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
W20260709 13:05:14.863229 16173 leader_election.cc:343] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:14.864207 16173 leader_election.cc:304] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 363bb2f744eb486f9ad726f08214c98e
I20260709 13:05:14.865021 16428 raft_consensus.cc:2804] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:14.865403 16428 raft_consensus.cc:493] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:14.865741 16428 raft_consensus.cc:3060] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:14.853062 16489 leader_election.cc:290] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:14.865638 16400 tablet_bootstrap.cc:492] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e: Bootstrap starting.
I20260709 13:05:14.870302 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:14.870357 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:14.874429 16206 raft_consensus.cc:2393] T 39dd6382a0304387a1341bcc36471cbf P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 1: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:05:14.885022 16400 tablet_bootstrap.cc:654] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:14.894953 16322 leader_election.cc:304] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:14.896126 16476 raft_consensus.cc:3060] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:14.913957 16476 raft_consensus.cc:2749] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:14.914718 16397 tablet_bootstrap.cc:654] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:14.916355 16428 raft_consensus.cc:515] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:14.920349 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bc3c8ff9b84838a2664335d7e1582b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:05:14.921152 16283 raft_consensus.cc:3060] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:14.921782 16400 tablet_bootstrap.cc:492] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e: No bootstrap required, opened a new log
I20260709 13:05:14.922437 16398 tablet_bootstrap.cc:654] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:14.923851 16400 ts_tablet_manager.cc:1403] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e: Time spent bootstrapping tablet: real 0.058s	user 0.018s	sys 0.026s
I20260709 13:05:14.926262 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bc3c8ff9b84838a2664335d7e1582b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:05:14.926678 16552 consensus_queue.cc:1048] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:14.927156 16400 raft_consensus.cc:359] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:14.927866 16400 raft_consensus.cc:385] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:05:14.927779 16173 leader_election.cc:343] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:14.928208 16400 raft_consensus.cc:740] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Initialized, Role: FOLLOWER
I20260709 13:05:14.928463 16428 leader_election.cc:290] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:14.928925 16400 consensus_queue.cc:260] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:14.931226 16400 ts_tablet_manager.cc:1434] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:05:14.932884 16400 tablet_bootstrap.cc:492] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e: Bootstrap starting.
I20260709 13:05:14.936856 16398 tablet_bootstrap.cc:492] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f: No bootstrap required, opened a new log
I20260709 13:05:14.937450 16398 ts_tablet_manager.cc:1403] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f: Time spent bootstrapping tablet: real 0.081s	user 0.007s	sys 0.006s
I20260709 13:05:14.940289 16400 tablet_bootstrap.cc:654] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:14.949193 16551 consensus_queue.cc:1048] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:14.952148 16400 tablet_bootstrap.cc:492] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e: No bootstrap required, opened a new log
I20260709 13:05:14.952672 16400 ts_tablet_manager.cc:1403] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.004s
I20260709 13:05:14.955775 16400 raft_consensus.cc:359] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:14.956642 16400 raft_consensus.cc:385] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:14.956915 16400 raft_consensus.cc:740] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Initialized, Role: FOLLOWER
I20260709 13:05:14.957695 16400 consensus_queue.cc:260] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:14.959007 16552 consensus_queue.cc:1048] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:14.961833 16400 ts_tablet_manager.cc:1434] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.003s
I20260709 13:05:14.962992 16400 tablet_bootstrap.cc:492] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e: Bootstrap starting.
I20260709 13:05:14.973162 16400 tablet_bootstrap.cc:654] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:14.958350 16398 raft_consensus.cc:359] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:14.980386 16398 raft_consensus.cc:385] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:14.986155 16400 tablet_bootstrap.cc:492] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e: No bootstrap required, opened a new log
I20260709 13:05:14.986725 16400 ts_tablet_manager.cc:1403] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.007s
I20260709 13:05:14.989493 16400 raft_consensus.cc:359] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:14.990444 16400 raft_consensus.cc:385] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:14.990767 16400 raft_consensus.cc:740] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Initialized, Role: FOLLOWER
I20260709 13:05:14.991598 16400 consensus_queue.cc:260] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:14.994120 16400 ts_tablet_manager.cc:1434] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:05:14.980826 16398 raft_consensus.cc:740] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Initialized, Role: FOLLOWER
I20260709 13:05:14.996938 16283 raft_consensus.cc:2468] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 1.
I20260709 13:05:14.997279 16398 consensus_queue.cc:260] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:14.998386 16173 leader_election.cc:304] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 363bb2f744eb486f9ad726f08214c98e
I20260709 13:05:14.999542 16398 ts_tablet_manager.cc:1434] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f: Time spent starting tablet: real 0.062s	user 0.009s	sys 0.000s
I20260709 13:05:14.999812 16489 raft_consensus.cc:2804] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:15.000213 16397 tablet_bootstrap.cc:492] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3: No bootstrap required, opened a new log
I20260709 13:05:15.000341 16489 raft_consensus.cc:697] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [term 1 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:05:15.000712 16398 tablet_bootstrap.cc:492] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f: Bootstrap starting.
I20260709 13:05:15.000833 16397 ts_tablet_manager.cc:1403] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3: Time spent bootstrapping tablet: real 0.140s	user 0.005s	sys 0.007s
I20260709 13:05:15.001338 16489 consensus_queue.cc:237] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:15.006457 16400 tablet_bootstrap.cc:492] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e: Bootstrap starting.
I20260709 13:05:15.007723 16450 raft_consensus.cc:493] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:15.008289 16450 raft_consensus.cc:515] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:15.024490 16356 raft_consensus.cc:3060] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:15.032454 16450 leader_election.cc:290] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:15.035137 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:15.037554 16414 raft_consensus.cc:493] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:15.040647 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:15.046365 16414 raft_consensus.cc:515] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:15.049819 16414 leader_election.cc:290] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:05:15.069854 16173 leader_election.cc:343] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:15.093994 16484 consensus_queue.cc:1048] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:15.128369 16484 raft_consensus.cc:493] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:15.128908 16484 raft_consensus.cc:515] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:15.131472 16484 leader_election.cc:290] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:15.164672 16397 raft_consensus.cc:359] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:15.165877 16397 raft_consensus.cc:385] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:15.166231 16397 raft_consensus.cc:740] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Initialized, Role: FOLLOWER
I20260709 13:05:15.169421 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:05:15.178179 16173 leader_election.cc:343] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:15.178830 16173 leader_election.cc:304] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:05:15.184118 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:15.187249 16397 consensus_queue.cc:260] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:15.195960 16397 ts_tablet_manager.cc:1434] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3: Time spent starting tablet: real 0.195s	user 0.006s	sys 0.013s
I20260709 13:05:15.196996 16400 tablet_bootstrap.cc:654] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:15.201063 16484 raft_consensus.cc:493] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:15.190353 16489 raft_consensus.cc:2749] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:15.190655 16281 raft_consensus.cc:2468] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 0.
I20260709 13:05:15.201653 16484 raft_consensus.cc:515] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:15.201370 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:05:15.205766 16154 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:15.210093 16354 raft_consensus.cc:2468] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 0.
I20260709 13:05:15.201808 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:15.212530 16355 raft_consensus.cc:2468] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 0.
I20260709 13:05:15.205479 16484 leader_election.cc:290] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:15.216529 16397 tablet_bootstrap.cc:492] T 38b024fb12204d9b9e35d72638671c24 P 0aea40d6e4374085a2e38a70a71f63e3: Bootstrap starting.
W20260709 13:05:15.196306 16246 leader_election.cc:343] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:15.225311 16398 tablet_bootstrap.cc:654] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:15.254681 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:15.252647 16357 raft_consensus.cc:3060] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:15.262053 16248 leader_election.cc:304] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:15.264174 16173 leader_election.cc:304] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:15.269622 16481 raft_consensus.cc:2804] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:15.270057 16481 raft_consensus.cc:493] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:15.268671 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:15.270633 16481 raft_consensus.cc:3060] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:15.270891 16205 raft_consensus.cc:2468] T bb3b9c4ba1f147fc8d9858234bfce423 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 0.
I20260709 13:05:15.263985 16484 raft_consensus.cc:493] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:15.279340 16450 raft_consensus.cc:2804] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:15.285593 16450 raft_consensus.cc:493] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:15.286013 16450 raft_consensus.cc:3060] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:15.275682 16484 raft_consensus.cc:515] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:15.292537 16484 leader_election.cc:290] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:15.293319 16484 consensus_queue.cc:1048] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:15.294826 16354 raft_consensus.cc:3060] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:15.308559 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:15.309496 16208 raft_consensus.cc:2468] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 0.
I20260709 13:05:15.319016 16397 tablet_bootstrap.cc:654] T 38b024fb12204d9b9e35d72638671c24 P 0aea40d6e4374085a2e38a70a71f63e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:15.323608 16400 tablet_bootstrap.cc:492] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e: No bootstrap required, opened a new log
I20260709 13:05:15.324113 16400 ts_tablet_manager.cc:1403] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e: Time spent bootstrapping tablet: real 0.318s	user 0.019s	sys 0.016s
I20260709 13:05:15.326866 16587 raft_consensus.cc:493] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:15.327513 16587 raft_consensus.cc:515] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:05:15.345358 16248 leader_election.cc:343] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:15.346733 16484 consensus_queue.cc:1048] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:15.351667 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:15.404739 16400 raft_consensus.cc:359] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:15.405907 16400 raft_consensus.cc:385] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:15.406292 16400 raft_consensus.cc:740] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Initialized, Role: FOLLOWER
I20260709 13:05:15.409447 16400 consensus_queue.cc:260] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:15.346014 16481 raft_consensus.cc:515] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:15.414598 16400 ts_tablet_manager.cc:1434] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e: Time spent starting tablet: real 0.090s	user 0.007s	sys 0.002s
I20260709 13:05:15.417729 16481 leader_election.cc:290] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:15.420717 16397 tablet_bootstrap.cc:492] T 38b024fb12204d9b9e35d72638671c24 P 0aea40d6e4374085a2e38a70a71f63e3: No bootstrap required, opened a new log
I20260709 13:05:15.421294 16397 ts_tablet_manager.cc:1403] T 38b024fb12204d9b9e35d72638671c24 P 0aea40d6e4374085a2e38a70a71f63e3: Time spent bootstrapping tablet: real 0.205s	user 0.036s	sys 0.034s
I20260709 13:05:15.414127 16246 leader_election.cc:304] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 363bb2f744eb486f9ad726f08214c98e
W20260709 13:05:15.428866 16248 leader_election.cc:343] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:15.429910 16450 raft_consensus.cc:515] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:15.432934 16450 leader_election.cc:290] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:15.435783 16357 raft_consensus.cc:3060] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:15.437963 16400 tablet_bootstrap.cc:492] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e: Bootstrap starting.
I20260709 13:05:15.442808 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:05:15.443499 16246 leader_election.cc:304] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 363bb2f744eb486f9ad726f08214c98e
I20260709 13:05:15.448776 16398 tablet_bootstrap.cc:492] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f: No bootstrap required, opened a new log
I20260709 13:05:15.449313 16398 ts_tablet_manager.cc:1403] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f: Time spent bootstrapping tablet: real 0.449s	user 0.030s	sys 0.021s
I20260709 13:05:15.453133 16592 raft_consensus.cc:2804] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:15.453799 16592 raft_consensus.cc:493] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:15.454253 16592 raft_consensus.cc:3060] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:15.443533 16352 raft_consensus.cc:3060] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:15.450327 16481 raft_consensus.cc:2804] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:15.462960 16397 raft_consensus.cc:359] T 38b024fb12204d9b9e35d72638671c24 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:15.467031 16397 raft_consensus.cc:385] T 38b024fb12204d9b9e35d72638671c24 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:15.467473 16397 raft_consensus.cc:740] T 38b024fb12204d9b9e35d72638671c24 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Initialized, Role: FOLLOWER
I20260709 13:05:15.470132 16481 raft_consensus.cc:493] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:15.472162 16481 raft_consensus.cc:3060] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:15.476485 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:05:15.477175 16351 raft_consensus.cc:3060] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:15.475934 16397 consensus_queue.cc:260] T 38b024fb12204d9b9e35d72638671c24 P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:15.480387 16397 ts_tablet_manager.cc:1434] T 38b024fb12204d9b9e35d72638671c24 P 0aea40d6e4374085a2e38a70a71f63e3: Time spent starting tablet: real 0.059s	user 0.007s	sys 0.000s
I20260709 13:05:15.481632 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:05:15.488037 16587 leader_election.cc:290] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:15.490800 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:15.498046 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:05:15.497874 16398 raft_consensus.cc:359] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:15.499150 16398 raft_consensus.cc:385] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:15.499119 16397 tablet_bootstrap.cc:492] T 1356ff4c060346359eb10723422e972a P 0aea40d6e4374085a2e38a70a71f63e3: Bootstrap starting.
I20260709 13:05:15.499625 16398 raft_consensus.cc:740] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Initialized, Role: FOLLOWER
I20260709 13:05:15.488000 16351 raft_consensus.cc:2468] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 1.
I20260709 13:05:15.498833 16281 raft_consensus.cc:3060] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:15.506122 16428 consensus_queue.cc:1048] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:15.506158 16597 raft_consensus.cc:493] T 38b024fb12204d9b9e35d72638671c24 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:15.508944 16398 consensus_queue.cc:260] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:15.509938 16588 raft_consensus.cc:493] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:05:15.512863 16597 raft_consensus.cc:515] T 38b024fb12204d9b9e35d72638671c24 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:15.522998 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:15.519189 16588 raft_consensus.cc:515] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:15.533488 16398 ts_tablet_manager.cc:1434] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f: Time spent starting tablet: real 0.084s	user 0.006s	sys 0.002s
I20260709 13:05:15.536453 16588 leader_election.cc:290] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:15.537346 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:05:15.540145 16246 leader_election.cc:343] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:15.548331 16597 leader_election.cc:290] T 38b024fb12204d9b9e35d72638671c24 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:15.552718 16398 tablet_bootstrap.cc:492] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f: Bootstrap starting.
I20260709 13:05:15.549989 16103 catalog_manager.cc:5697] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f reported cstate change: term changed from 0 to 1, leader changed from <none> to e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65). New cstate: current_term: 1 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:15.558156 16481 raft_consensus.cc:515] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:05:15.567755 16602 log.cc:927] Time spent T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:05:15.568392 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:15.571544 16352 raft_consensus.cc:2468] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 1.
I20260709 13:05:15.571600 16481 leader_election.cc:290] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:15.577131 16592 raft_consensus.cc:515] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:15.581135 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:05:15.582340 16208 raft_consensus.cc:3060] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:15.586438 16281 raft_consensus.cc:2468] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 1.
I20260709 13:05:15.589999 16400 tablet_bootstrap.cc:654] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:15.591261 16397 tablet_bootstrap.cc:654] T 1356ff4c060346359eb10723422e972a P 0aea40d6e4374085a2e38a70a71f63e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:15.588641 16592 leader_election.cc:290] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:15.599896 16322 leader_election.cc:304] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:15.600848 16588 raft_consensus.cc:2749] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:15.605432 16248 leader_election.cc:304] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:15.606191 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:15.607961 16592 raft_consensus.cc:2804] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:15.608777 16173 leader_election.cc:304] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:15.608675 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:05:15.610994 16450 raft_consensus.cc:2804] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:15.611804 16450 raft_consensus.cc:697] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:05:15.612689 16450 consensus_queue.cc:237] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:15.610997 16592 raft_consensus.cc:697] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:05:15.617333 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:15.619884 16592 consensus_queue.cc:237] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:15.627020 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
W20260709 13:05:15.628677 16248 leader_election.cc:343] T 38b024fb12204d9b9e35d72638671c24 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:15.633618 16398 tablet_bootstrap.cc:654] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:15.638656 16246 leader_election.cc:343] T 38b024fb12204d9b9e35d72638671c24 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:15.639186 16246 leader_election.cc:304] T 38b024fb12204d9b9e35d72638671c24 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:05:15.640019 16248 leader_election.cc:343] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:15.640164 16481 raft_consensus.cc:2749] T 38b024fb12204d9b9e35d72638671c24 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:15.641739 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:05:15.659049 16208 raft_consensus.cc:2468] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 1.
I20260709 13:05:15.659823 16400 tablet_bootstrap.cc:492] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e: No bootstrap required, opened a new log
I20260709 13:05:15.655117 16206 raft_consensus.cc:3060] T bb3b9c4ba1f147fc8d9858234bfce423 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:15.660614 16400 ts_tablet_manager.cc:1403] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e: Time spent bootstrapping tablet: real 0.223s	user 0.022s	sys 0.024s
I20260709 13:05:15.660681 16246 leader_election.cc:304] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:15.661926 16597 raft_consensus.cc:2804] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:15.662683 16597 raft_consensus.cc:697] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:05:15.664577 16400 raft_consensus.cc:359] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:15.665342 16400 raft_consensus.cc:385] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:15.664425 16597 consensus_queue.cc:237] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:15.665652 16400 raft_consensus.cc:740] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Initialized, Role: FOLLOWER
I20260709 13:05:15.683377 16400 consensus_queue.cc:260] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:15.684803 16206 raft_consensus.cc:2468] T bb3b9c4ba1f147fc8d9858234bfce423 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 1.
I20260709 13:05:15.688529 16397 tablet_bootstrap.cc:492] T 1356ff4c060346359eb10723422e972a P 0aea40d6e4374085a2e38a70a71f63e3: No bootstrap required, opened a new log
I20260709 13:05:15.689052 16397 ts_tablet_manager.cc:1403] T 1356ff4c060346359eb10723422e972a P 0aea40d6e4374085a2e38a70a71f63e3: Time spent bootstrapping tablet: real 0.199s	user 0.021s	sys 0.044s
I20260709 13:05:15.691344 16400 ts_tablet_manager.cc:1434] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e: Time spent starting tablet: real 0.030s	user 0.008s	sys 0.001s
I20260709 13:05:15.686054 16322 leader_election.cc:304] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:15.694586 16588 raft_consensus.cc:2749] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:15.694655 16414 raft_consensus.cc:493] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:15.695811 16414 raft_consensus.cc:515] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:15.701826 16400 tablet_bootstrap.cc:492] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e: Bootstrap starting.
I20260709 13:05:15.694115 16246 leader_election.cc:304] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 363bb2f744eb486f9ad726f08214c98e
I20260709 13:05:15.704664 16398 tablet_bootstrap.cc:492] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f: No bootstrap required, opened a new log
I20260709 13:05:15.705386 16398 ts_tablet_manager.cc:1403] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f: Time spent bootstrapping tablet: real 0.153s	user 0.012s	sys 0.003s
W20260709 13:05:15.707163 16248 leader_election.cc:343] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:15.711040 16597 raft_consensus.cc:2804] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:15.718924 16414 leader_election.cc:290] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:15.718669 16398 raft_consensus.cc:359] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:15.719604 16398 raft_consensus.cc:385] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:15.720044 16398 raft_consensus.cc:740] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Initialized, Role: FOLLOWER
I20260709 13:05:15.721381 16489 consensus_queue.cc:1048] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:15.724587 16398 consensus_queue.cc:260] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:15.724946 16397 raft_consensus.cc:359] T 1356ff4c060346359eb10723422e972a P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:15.725620 16397 raft_consensus.cc:385] T 1356ff4c060346359eb10723422e972a P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:15.725843 16397 raft_consensus.cc:740] T 1356ff4c060346359eb10723422e972a P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Initialized, Role: FOLLOWER
I20260709 13:05:15.721017 16597 raft_consensus.cc:697] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:05:15.726955 16397 consensus_queue.cc:260] T 1356ff4c060346359eb10723422e972a P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:15.729910 16400 tablet_bootstrap.cc:654] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:15.730082 16397 ts_tablet_manager.cc:1434] T 1356ff4c060346359eb10723422e972a P 0aea40d6e4374085a2e38a70a71f63e3: Time spent starting tablet: real 0.041s	user 0.006s	sys 0.001s
I20260709 13:05:15.731846 16397 tablet_bootstrap.cc:492] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3: Bootstrap starting.
I20260709 13:05:15.731614 16597 consensus_queue.cc:237] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:15.734992 16398 ts_tablet_manager.cc:1434] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f: Time spent starting tablet: real 0.029s	user 0.008s	sys 0.002s
I20260709 13:05:15.736140 16398 tablet_bootstrap.cc:492] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f: Bootstrap starting.
I20260709 13:05:15.738668 16397 tablet_bootstrap.cc:654] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:15.741941 16400 tablet_bootstrap.cc:492] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e: No bootstrap required, opened a new log
I20260709 13:05:15.742601 16400 ts_tablet_manager.cc:1403] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e: Time spent bootstrapping tablet: real 0.044s	user 0.011s	sys 0.008s
I20260709 13:05:15.743713 16398 tablet_bootstrap.cc:654] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:15.745172 16400 raft_consensus.cc:359] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:15.745929 16400 raft_consensus.cc:385] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:15.746856 16400 raft_consensus.cc:740] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Initialized, Role: FOLLOWER
I20260709 13:05:15.747593 16400 consensus_queue.cc:260] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:15.749290 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:15.750593 16400 ts_tablet_manager.cc:1434] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.001s
I20260709 13:05:15.750155 16279 raft_consensus.cc:2468] T 1356ff4c060346359eb10723422e972a P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 0.
I20260709 13:05:15.751893 16400 tablet_bootstrap.cc:492] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e: Bootstrap starting.
I20260709 13:05:15.755155 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:15.759954 16615 raft_consensus.cc:493] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:15.760601 16615 raft_consensus.cc:515] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:15.763134 16615 leader_election.cc:290] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:15.765024 16400 tablet_bootstrap.cc:654] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:15.770852 16397 tablet_bootstrap.cc:492] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3: No bootstrap required, opened a new log
I20260709 13:05:15.771409 16397 ts_tablet_manager.cc:1403] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3: Time spent bootstrapping tablet: real 0.040s	user 0.007s	sys 0.013s
I20260709 13:05:15.774142 16397 raft_consensus.cc:359] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:15.774955 16400 tablet_bootstrap.cc:492] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e: No bootstrap required, opened a new log
I20260709 13:05:15.775478 16400 ts_tablet_manager.cc:1403] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e: Time spent bootstrapping tablet: real 0.024s	user 0.010s	sys 0.002s
I20260709 13:05:15.778247 16400 raft_consensus.cc:359] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:15.778995 16400 raft_consensus.cc:385] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:15.779263 16400 raft_consensus.cc:740] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Initialized, Role: FOLLOWER
I20260709 13:05:15.779917 16400 consensus_queue.cc:260] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:15.782476 16400 ts_tablet_manager.cc:1434] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:05:15.783543 16400 tablet_bootstrap.cc:492] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e: Bootstrap starting.
I20260709 13:05:15.784926 16397 raft_consensus.cc:385] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:05:15.785176 16173 leader_election.cc:343] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:15.785315 16397 raft_consensus.cc:740] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Initialized, Role: FOLLOWER
I20260709 13:05:15.774842 16103 catalog_manager.cc:5697] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f reported cstate change: term changed from 0 to 1, leader changed from <none> to e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65). New cstate: current_term: 1 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:15.788153 16397 consensus_queue.cc:260] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:15.789664 16400 tablet_bootstrap.cc:654] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:15.790620 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:15.793390 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:15.794283 16355 raft_consensus.cc:2393] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 1: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:05:15.793649 16397 ts_tablet_manager.cc:1434] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 13:05:15.799906 16397 tablet_bootstrap.cc:492] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3: Bootstrap starting.
I20260709 13:05:15.801791 16173 leader_election.cc:304] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 363bb2f744eb486f9ad726f08214c98e
I20260709 13:05:15.802855 16489 raft_consensus.cc:2804] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:15.803345 16489 raft_consensus.cc:493] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:15.803764 16489 raft_consensus.cc:3060] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:15.812105 16489 raft_consensus.cc:515] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:15.814199 16489 leader_election.cc:290] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:15.819566 16173 leader_election.cc:304] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:05:15.829160 16400 tablet_bootstrap.cc:492] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e: No bootstrap required, opened a new log
I20260709 13:05:15.838825 16400 ts_tablet_manager.cc:1403] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e: Time spent bootstrapping tablet: real 0.056s	user 0.021s	sys 0.017s
I20260709 13:05:15.839386 16615 raft_consensus.cc:3060] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:15.833202 16397 tablet_bootstrap.cc:654] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:15.846429 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:05:15.847193 16283 raft_consensus.cc:3060] T 1356ff4c060346359eb10723422e972a P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:15.848737 16105 catalog_manager.cc:5697] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66). New cstate: current_term: 1 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:15.851119 16105 catalog_manager.cc:5697] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66). New cstate: current_term: 1 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:15.848272 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:05:15.853263 16105 catalog_manager.cc:5697] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66). New cstate: current_term: 1 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:15.868348 16398 tablet_bootstrap.cc:492] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f: No bootstrap required, opened a new log
I20260709 13:05:15.868903 16398 ts_tablet_manager.cc:1403] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f: Time spent bootstrapping tablet: real 0.133s	user 0.006s	sys 0.037s
W20260709 13:05:15.868968 16173 leader_election.cc:343] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:15.871101 16481 raft_consensus.cc:493] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:15.871632 16481 raft_consensus.cc:515] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:15.873564 16481 leader_election.cc:290] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:15.873831 16615 raft_consensus.cc:2749] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:15.876151 16283 raft_consensus.cc:2468] T 1356ff4c060346359eb10723422e972a P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 1.
I20260709 13:05:15.876083 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:15.876785 16398 raft_consensus.cc:359] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:15.877467 16398 raft_consensus.cc:385] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:15.877761 16398 raft_consensus.cc:740] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Initialized, Role: FOLLOWER
W20260709 13:05:15.878201 16246 leader_election.cc:343] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:15.879431 16173 leader_election.cc:304] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 363bb2f744eb486f9ad726f08214c98e
I20260709 13:05:15.878439 16398 consensus_queue.cc:260] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:15.885102 16400 raft_consensus.cc:359] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:15.885900 16400 raft_consensus.cc:385] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:15.886174 16400 raft_consensus.cc:740] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Initialized, Role: FOLLOWER
I20260709 13:05:15.886304 16398 ts_tablet_manager.cc:1434] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f: Time spent starting tablet: real 0.017s	user 0.002s	sys 0.005s
I20260709 13:05:15.886976 16400 consensus_queue.cc:260] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:15.889268 16489 raft_consensus.cc:2804] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:15.889762 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:15.890127 16400 ts_tablet_manager.cc:1434] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e: Time spent starting tablet: real 0.048s	user 0.006s	sys 0.000s
I20260709 13:05:15.890425 16489 raft_consensus.cc:697] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [term 1 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
W20260709 13:05:15.891048 16248 leader_election.cc:343] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:15.891561 16248 leader_election.cc:304] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:15.891395 16489 consensus_queue.cc:237] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:15.892367 16400 tablet_bootstrap.cc:492] T f022e2e63ae4461d834e476ff2666991 P 363bb2f744eb486f9ad726f08214c98e: Bootstrap starting.
I20260709 13:05:15.892722 16592 raft_consensus.cc:2749] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:15.896045 16398 tablet_bootstrap.cc:492] T 7295dce0baa440b8a197da845581ee81 P e10b16d536674c0bb350a31d7ce5ff7f: Bootstrap starting.
I20260709 13:05:15.904196 16398 tablet_bootstrap.cc:654] T 7295dce0baa440b8a197da845581ee81 P e10b16d536674c0bb350a31d7ce5ff7f: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:15.921859 16400 tablet_bootstrap.cc:654] T f022e2e63ae4461d834e476ff2666991 P 363bb2f744eb486f9ad726f08214c98e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:15.925406 16397 tablet_bootstrap.cc:492] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3: No bootstrap required, opened a new log
I20260709 13:05:15.925943 16397 ts_tablet_manager.cc:1403] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3: Time spent bootstrapping tablet: real 0.126s	user 0.008s	sys 0.005s
I20260709 13:05:15.928097 16587 raft_consensus.cc:493] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:15.928629 16587 raft_consensus.cc:515] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:15.930930 16587 leader_election.cc:290] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:15.933677 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:15.933450 16397 raft_consensus.cc:359] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:15.934265 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:15.934517 16397 raft_consensus.cc:385] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:15.935045 16280 raft_consensus.cc:2468] T 38b024fb12204d9b9e35d72638671c24 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 0.
I20260709 13:05:15.935003 16397 raft_consensus.cc:740] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Initialized, Role: FOLLOWER
I20260709 13:05:15.936537 16322 leader_election.cc:304] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:05:15.936779 16397 consensus_queue.cc:260] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:05:15.937317 16320 leader_election.cc:343] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:15.938798 16588 raft_consensus.cc:2804] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:15.939193 16588 raft_consensus.cc:493] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:15.939565 16588 raft_consensus.cc:3060] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:15.939772 16398 tablet_bootstrap.cc:492] T 7295dce0baa440b8a197da845581ee81 P e10b16d536674c0bb350a31d7ce5ff7f: No bootstrap required, opened a new log
I20260709 13:05:15.940472 16398 ts_tablet_manager.cc:1403] T 7295dce0baa440b8a197da845581ee81 P e10b16d536674c0bb350a31d7ce5ff7f: Time spent bootstrapping tablet: real 0.045s	user 0.027s	sys 0.010s
I20260709 13:05:15.944552 16398 raft_consensus.cc:359] T 7295dce0baa440b8a197da845581ee81 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:15.945612 16398 raft_consensus.cc:385] T 7295dce0baa440b8a197da845581ee81 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:15.945990 16398 raft_consensus.cc:740] T 7295dce0baa440b8a197da845581ee81 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Initialized, Role: FOLLOWER
I20260709 13:05:15.946904 16398 consensus_queue.cc:260] T 7295dce0baa440b8a197da845581ee81 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:15.939844 16397 ts_tablet_manager.cc:1434] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.004s
I20260709 13:05:15.948299 16588 raft_consensus.cc:515] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:15.948077 16105 catalog_manager.cc:5697] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f reported cstate change: term changed from 0 to 1, leader changed from <none> to e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65). New cstate: current_term: 1 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:15.949379 16397 tablet_bootstrap.cc:492] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3: Bootstrap starting.
I20260709 13:05:15.952168 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
W20260709 13:05:15.953639 16320 leader_election.cc:343] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:15.957523 16400 tablet_bootstrap.cc:492] T f022e2e63ae4461d834e476ff2666991 P 363bb2f744eb486f9ad726f08214c98e: No bootstrap required, opened a new log
I20260709 13:05:15.957811 16398 ts_tablet_manager.cc:1434] T 7295dce0baa440b8a197da845581ee81 P e10b16d536674c0bb350a31d7ce5ff7f: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 13:05:15.958042 16400 ts_tablet_manager.cc:1403] T f022e2e63ae4461d834e476ff2666991 P 363bb2f744eb486f9ad726f08214c98e: Time spent bootstrapping tablet: real 0.066s	user 0.015s	sys 0.014s
I20260709 13:05:15.958878 16398 tablet_bootstrap.cc:492] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f: Bootstrap starting.
I20260709 13:05:15.960747 16400 raft_consensus.cc:359] T f022e2e63ae4461d834e476ff2666991 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:15.961427 16400 raft_consensus.cc:385] T f022e2e63ae4461d834e476ff2666991 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:15.961930 16400 raft_consensus.cc:740] T f022e2e63ae4461d834e476ff2666991 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Initialized, Role: FOLLOWER
I20260709 13:05:15.962179 16397 tablet_bootstrap.cc:654] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:15.962713 16400 consensus_queue.cc:260] T f022e2e63ae4461d834e476ff2666991 P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:15.964944 16400 ts_tablet_manager.cc:1434] T f022e2e63ae4461d834e476ff2666991 P 363bb2f744eb486f9ad726f08214c98e: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:05:15.966032 16400 tablet_bootstrap.cc:492] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e: Bootstrap starting.
I20260709 13:05:15.967988 16398 tablet_bootstrap.cc:654] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:15.972247 16400 tablet_bootstrap.cc:654] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:15.978116 16397 tablet_bootstrap.cc:492] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3: No bootstrap required, opened a new log
I20260709 13:05:15.978753 16397 ts_tablet_manager.cc:1403] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3: Time spent bootstrapping tablet: real 0.030s	user 0.008s	sys 0.011s
I20260709 13:05:15.981652 16397 raft_consensus.cc:359] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:15.982589 16397 raft_consensus.cc:385] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:15.982954 16397 raft_consensus.cc:740] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Initialized, Role: FOLLOWER
I20260709 13:05:15.983866 16397 consensus_queue.cc:260] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:15.988078 16397 ts_tablet_manager.cc:1434] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:05:15.989410 16397 tablet_bootstrap.cc:492] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3: Bootstrap starting.
I20260709 13:05:15.989604 16400 tablet_bootstrap.cc:492] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e: No bootstrap required, opened a new log
I20260709 13:05:15.990273 16400 ts_tablet_manager.cc:1403] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e: Time spent bootstrapping tablet: real 0.025s	user 0.016s	sys 0.007s
I20260709 13:05:15.998457 16397 tablet_bootstrap.cc:654] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:15.999699 16489 consensus_queue.cc:1048] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:16.006425 16398 tablet_bootstrap.cc:492] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f: No bootstrap required, opened a new log
I20260709 13:05:16.007140 16398 ts_tablet_manager.cc:1403] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f: Time spent bootstrapping tablet: real 0.048s	user 0.015s	sys 0.002s
I20260709 13:05:16.006891 16400 raft_consensus.cc:359] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:16.008989 16400 raft_consensus.cc:385] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:16.009305 16400 raft_consensus.cc:740] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Initialized, Role: FOLLOWER
I20260709 13:05:16.009960 16400 consensus_queue.cc:260] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:16.011019 16588 leader_election.cc:290] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:16.012279 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:05:16.013119 16283 raft_consensus.cc:3060] T 38b024fb12204d9b9e35d72638671c24 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:16.015379 16400 ts_tablet_manager.cc:1434] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 13:05:16.018339 16400 tablet_bootstrap.cc:492] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e: Bootstrap starting.
I20260709 13:05:16.018849 16587 raft_consensus.cc:493] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:16.019536 16587 raft_consensus.cc:515] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:16.023581 16587 leader_election.cc:290] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:16.024699 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:16.025403 16279 raft_consensus.cc:2468] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 0.
I20260709 13:05:16.026198 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:16.027100 16208 raft_consensus.cc:2468] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 0.
I20260709 13:05:16.027333 16322 leader_election.cc:304] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:05:16.028925 16587 raft_consensus.cc:2804] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:16.030022 16587 raft_consensus.cc:493] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:16.030460 16587 raft_consensus.cc:3060] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:16.031672 16397 tablet_bootstrap.cc:492] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3: No bootstrap required, opened a new log
I20260709 13:05:16.032135 16397 ts_tablet_manager.cc:1403] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3: Time spent bootstrapping tablet: real 0.043s	user 0.016s	sys 0.021s
I20260709 13:05:16.034596 16400 tablet_bootstrap.cc:654] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:16.036535 16397 raft_consensus.cc:359] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:16.037209 16397 raft_consensus.cc:385] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:16.037588 16397 raft_consensus.cc:740] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Initialized, Role: FOLLOWER
I20260709 13:05:16.038440 16397 consensus_queue.cc:260] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:16.043411 16283 raft_consensus.cc:2468] T 38b024fb12204d9b9e35d72638671c24 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 1.
I20260709 13:05:16.045079 16397 ts_tablet_manager.cc:1434] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3: Time spent starting tablet: real 0.013s	user 0.011s	sys 0.000s
I20260709 13:05:16.047258 16397 tablet_bootstrap.cc:492] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3: Bootstrap starting.
I20260709 13:05:16.047739 16398 raft_consensus.cc:359] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:16.052809 16398 raft_consensus.cc:385] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:16.053290 16322 leader_election.cc:304] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:16.054463 16450 consensus_queue.cc:1048] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:16.055450 16397 tablet_bootstrap.cc:654] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:16.053759 16587 raft_consensus.cc:515] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:16.061046 16587 leader_election.cc:290] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:16.053208 16398 raft_consensus.cc:740] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Initialized, Role: FOLLOWER
I20260709 13:05:16.062906 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:05:16.062592 16398 consensus_queue.cc:260] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:16.063512 16208 raft_consensus.cc:3060] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:16.067253 16398 ts_tablet_manager.cc:1434] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f: Time spent starting tablet: real 0.060s	user 0.007s	sys 0.000s
I20260709 13:05:16.068532 16398 tablet_bootstrap.cc:492] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f: Bootstrap starting.
I20260709 13:05:16.070772 16588 raft_consensus.cc:2804] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:16.100227 16588 raft_consensus.cc:697] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 1 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:05:16.101117 16588 consensus_queue.cc:237] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:16.078934 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:05:16.074759 16587 raft_consensus.cc:493] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:16.103344 16283 raft_consensus.cc:3060] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:16.103619 16587 raft_consensus.cc:515] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:16.070530 16208 raft_consensus.cc:2468] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 1.
I20260709 13:05:16.106894 16587 leader_election.cc:290] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:16.077785 16592 consensus_queue.cc:1048] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.031s
I20260709 13:05:16.080320 16400 tablet_bootstrap.cc:492] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e: No bootstrap required, opened a new log
I20260709 13:05:16.110734 16400 ts_tablet_manager.cc:1403] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e: Time spent bootstrapping tablet: real 0.093s	user 0.016s	sys 0.024s
I20260709 13:05:16.112390 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:16.113332 16280 raft_consensus.cc:2393] T 1356ff4c060346359eb10723422e972a P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 1: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:05:16.113878 16283 raft_consensus.cc:2468] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 1.
I20260709 13:05:16.114754 16400 raft_consensus.cc:359] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:16.116408 16400 raft_consensus.cc:385] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:16.116834 16400 raft_consensus.cc:740] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Initialized, Role: FOLLOWER
I20260709 13:05:16.117507 16398 tablet_bootstrap.cc:654] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:16.120792 16397 tablet_bootstrap.cc:492] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3: No bootstrap required, opened a new log
I20260709 13:05:16.121279 16397 ts_tablet_manager.cc:1403] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3: Time spent bootstrapping tablet: real 0.074s	user 0.034s	sys 0.035s
I20260709 13:05:16.125488 16397 raft_consensus.cc:359] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:16.126221 16397 raft_consensus.cc:385] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:16.126513 16397 raft_consensus.cc:740] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Initialized, Role: FOLLOWER
I20260709 13:05:16.126827 16400 consensus_queue.cc:260] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:16.127326 16397 consensus_queue.cc:260] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:16.128410 16398 tablet_bootstrap.cc:492] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f: No bootstrap required, opened a new log
I20260709 13:05:16.129130 16398 ts_tablet_manager.cc:1403] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f: Time spent bootstrapping tablet: real 0.061s	user 0.010s	sys 0.001s
I20260709 13:05:16.132054 16397 ts_tablet_manager.cc:1434] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.002s
I20260709 13:05:16.133496 16400 ts_tablet_manager.cc:1434] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.001s
I20260709 13:05:16.135329 16400 tablet_bootstrap.cc:492] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e: Bootstrap starting.
I20260709 13:05:16.137912 16398 raft_consensus.cc:359] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:16.138669 16398 raft_consensus.cc:385] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:16.138986 16398 raft_consensus.cc:740] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Initialized, Role: FOLLOWER
I20260709 13:05:16.139765 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:16.139626 16398 consensus_queue.cc:260] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:16.141901 16397 tablet_bootstrap.cc:492] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3: Bootstrap starting.
I20260709 13:05:16.138367 16322 leader_election.cc:304] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:05:16.149528 16320 leader_election.cc:304] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:16.150465 16636 raft_consensus.cc:3060] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:16.156445 16398 ts_tablet_manager.cc:1434] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.000s
I20260709 13:05:16.157601 16398 tablet_bootstrap.cc:492] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f: Bootstrap starting.
I20260709 13:05:16.160557 16636 raft_consensus.cc:2749] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:16.155577 16637 raft_consensus.cc:2804] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:16.162730 16597 consensus_queue.cc:1048] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:16.163044 16637 raft_consensus.cc:697] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 1 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:05:16.163937 16637 consensus_queue.cc:237] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:16.173054 16588 raft_consensus.cc:493] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:16.173571 16588 raft_consensus.cc:515] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:05:16.173970 16248 consensus_peers.cc:597] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 -> Peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Couldn't send request to peer 363bb2f744eb486f9ad726f08214c98e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:16.175755 16588 leader_election.cc:290] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:16.177342 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:16.178134 16280 raft_consensus.cc:2468] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 0.
I20260709 13:05:16.178809 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:16.179593 16206 raft_consensus.cc:2468] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 0.
I20260709 13:05:16.180128 16322 leader_election.cc:304] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:05:16.181197 16637 raft_consensus.cc:2804] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:16.181583 16637 raft_consensus.cc:493] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:16.181921 16637 raft_consensus.cc:3060] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:16.190007 16637 raft_consensus.cc:515] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:16.192073 16397 tablet_bootstrap.cc:654] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:16.192253 16637 leader_election.cc:290] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:16.193819 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:05:16.196938 16398 tablet_bootstrap.cc:654] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:16.194821 16205 raft_consensus.cc:3060] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:16.208323 16400 tablet_bootstrap.cc:654] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:16.209414 16398 tablet_bootstrap.cc:492] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f: No bootstrap required, opened a new log
I20260709 13:05:16.209900 16398 ts_tablet_manager.cc:1403] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f: Time spent bootstrapping tablet: real 0.053s	user 0.011s	sys 0.000s
I20260709 13:05:16.219035 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:05:16.228396 16283 raft_consensus.cc:3060] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:16.228441 16637 raft_consensus.cc:493] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:16.233290 16637 raft_consensus.cc:515] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:16.236330 16398 raft_consensus.cc:359] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:16.239331 16398 raft_consensus.cc:385] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:16.239756 16398 raft_consensus.cc:740] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Initialized, Role: FOLLOWER
I20260709 13:05:16.241261 16398 consensus_queue.cc:260] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:16.242841 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:05:16.243299 16234 tablet.cc:2406] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:05:16.249840 16206 raft_consensus.cc:2393] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 1: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:05:16.253518 16283 raft_consensus.cc:2468] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 1.
I20260709 13:05:16.253088 16637 leader_election.cc:290] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:16.257815 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:16.260072 16398 ts_tablet_manager.cc:1434] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f: Time spent starting tablet: real 0.039s	user 0.007s	sys 0.000s
I20260709 13:05:16.260720 16414 raft_consensus.cc:493] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:16.261215 16414 raft_consensus.cc:515] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:16.261572 16398 tablet_bootstrap.cc:492] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f: Bootstrap starting.
I20260709 13:05:16.263161 16414 leader_election.cc:290] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:16.257440 16322 leader_election.cc:304] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:05:16.266193 16637 raft_consensus.cc:2804] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:16.266719 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:16.267095 16637 raft_consensus.cc:697] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 1 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
W20260709 13:05:16.268095 16173 leader_election.cc:343] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:16.268396 16637 consensus_queue.cc:237] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:16.272547 16322 leader_election.cc:304] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:16.273195 16354 raft_consensus.cc:3060] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:16.277812 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:16.278931 16397 tablet_bootstrap.cc:492] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3: No bootstrap required, opened a new log
I20260709 13:05:16.279414 16397 ts_tablet_manager.cc:1403] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3: Time spent bootstrapping tablet: real 0.139s	user 0.015s	sys 0.009s
W20260709 13:05:16.280093 16173 leader_election.cc:343] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:16.280560 16173 leader_election.cc:304] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:05:16.282617 16414 raft_consensus.cc:2749] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:16.283179 16590 consensus_queue.cc:1048] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:16.287315 16636 raft_consensus.cc:493] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:16.287855 16636 raft_consensus.cc:515] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:16.289644 16205 raft_consensus.cc:2468] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 1.
I20260709 13:05:16.291105 16636 leader_election.cc:290] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:16.292199 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:16.294940 16208 raft_consensus.cc:2468] T 7295dce0baa440b8a197da845581ee81 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 0.
I20260709 13:05:16.292822 16587 raft_consensus.cc:2749] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:16.294348 16398 tablet_bootstrap.cc:654] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:16.298718 16400 tablet_bootstrap.cc:492] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e: No bootstrap required, opened a new log
I20260709 13:05:16.300199 16400 ts_tablet_manager.cc:1403] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e: Time spent bootstrapping tablet: real 0.165s	user 0.011s	sys 0.005s
I20260709 13:05:16.299038 16590 consensus_queue.cc:1048] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:05:16.300529 16320 leader_election.cc:304] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:16.302258 16587 raft_consensus.cc:2804] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:16.303328 16587 raft_consensus.cc:493] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:16.303678 16587 raft_consensus.cc:3060] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:16.303007 16106 catalog_manager.cc:5697] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e reported cstate change: term changed from 0 to 1, leader changed from <none> to 363bb2f744eb486f9ad726f08214c98e (127.14.180.67). New cstate: current_term: 1 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:16.303913 16489 raft_consensus.cc:493] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:16.304463 16489 raft_consensus.cc:515] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:16.306672 16489 leader_election.cc:290] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:16.309491 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:05:16.312342 16173 leader_election.cc:343] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:16.312606 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:16.313431 16489 consensus_queue.cc:1048] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:16.314142 16397 raft_consensus.cc:359] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:16.314888 16397 raft_consensus.cc:385] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:16.315217 16397 raft_consensus.cc:740] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Initialized, Role: FOLLOWER
I20260709 13:05:16.315892 16397 consensus_queue.cc:260] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:16.314970 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:16.314263 16587 raft_consensus.cc:515] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:16.322535 16597 consensus_queue.cc:1048] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:05:16.326614 16587 leader_election.cc:290] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:16.331629 16400 raft_consensus.cc:359] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:16.332327 16400 raft_consensus.cc:385] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:16.332616 16400 raft_consensus.cc:740] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Initialized, Role: FOLLOWER
I20260709 13:05:16.333256 16400 consensus_queue.cc:260] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:05:16.324635 16154 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 13:05:16.338222 16173 leader_election.cc:343] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:16.338742 16173 leader_election.cc:304] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:05:16.339120 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
W20260709 13:05:16.338734 16322 leader_election.cc:343] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:16.339701 16414 raft_consensus.cc:2749] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:05:16.344264 16322 leader_election.cc:343] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:16.352568 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:05:16.353708 16206 raft_consensus.cc:3060] T 7295dce0baa440b8a197da845581ee81 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:16.363395 16206 raft_consensus.cc:2468] T 7295dce0baa440b8a197da845581ee81 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 1.
I20260709 13:05:16.365378 16615 consensus_queue.cc:1048] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:16.365996 16320 leader_election.cc:304] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:05:16.370152 16587 raft_consensus.cc:2804] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:16.372459 16587 raft_consensus.cc:697] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 1 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:05:16.374104 16587 consensus_queue.cc:237] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:16.396255 16397 ts_tablet_manager.cc:1434] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3: Time spent starting tablet: real 0.117s	user 0.006s	sys 0.000s
I20260709 13:05:16.397524 16397 tablet_bootstrap.cc:492] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3: Bootstrap starting.
I20260709 13:05:16.404460 16397 tablet_bootstrap.cc:654] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:16.422012 16398 tablet_bootstrap.cc:492] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f: No bootstrap required, opened a new log
I20260709 13:05:16.422516 16398 ts_tablet_manager.cc:1403] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f: Time spent bootstrapping tablet: real 0.161s	user 0.011s	sys 0.002s
I20260709 13:05:16.426039 16398 raft_consensus.cc:359] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:16.426888 16398 raft_consensus.cc:385] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:16.428915 16398 raft_consensus.cc:740] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Initialized, Role: FOLLOWER
I20260709 13:05:16.429720 16398 consensus_queue.cc:260] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:16.440188 16400 ts_tablet_manager.cc:1434] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e: Time spent starting tablet: real 0.140s	user 0.006s	sys 0.000s
I20260709 13:05:16.441869 16400 tablet_bootstrap.cc:492] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e: Bootstrap starting.
I20260709 13:05:16.443488 16587 raft_consensus.cc:493] T f022e2e63ae4461d834e476ff2666991 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:16.444264 16414 raft_consensus.cc:493] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:16.444000 16587 raft_consensus.cc:515] T f022e2e63ae4461d834e476ff2666991 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:16.442977 16397 tablet_bootstrap.cc:492] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3: No bootstrap required, opened a new log
I20260709 13:05:16.445039 16397 ts_tablet_manager.cc:1403] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3: Time spent bootstrapping tablet: real 0.048s	user 0.023s	sys 0.015s
I20260709 13:05:16.446753 16414 raft_consensus.cc:515] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:16.447690 16397 raft_consensus.cc:359] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:16.448428 16397 raft_consensus.cc:385] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:16.448699 16397 raft_consensus.cc:740] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Initialized, Role: FOLLOWER
I20260709 13:05:16.449102 16414 leader_election.cc:290] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:16.449618 16481 raft_consensus.cc:493] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:16.449398 16397 consensus_queue.cc:260] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:16.450084 16481 raft_consensus.cc:515] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:16.451054 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:16.451821 16283 raft_consensus.cc:2393] T 38b024fb12204d9b9e35d72638671c24 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 1: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:05:16.452812 16481 leader_election.cc:290] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:16.452921 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f022e2e63ae4461d834e476ff2666991" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:16.453629 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:16.454644 16587 leader_election.cc:290] T f022e2e63ae4461d834e476ff2666991 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:05:16.454671 16320 leader_election.cc:343] T f022e2e63ae4461d834e476ff2666991 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:16.456852 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f022e2e63ae4461d834e476ff2666991" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:16.457129 16397 ts_tablet_manager.cc:1434] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:05:16.457427 16400 tablet_bootstrap.cc:654] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:16.457906 16246 leader_election.cc:343] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:16.458153 16322 leader_election.cc:343] T f022e2e63ae4461d834e476ff2666991 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:16.458586 16322 leader_election.cc:304] T f022e2e63ae4461d834e476ff2666991 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:16.459410 16587 raft_consensus.cc:2749] T f022e2e63ae4461d834e476ff2666991 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:16.459867 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:16.459576 16105 catalog_manager.cc:5697] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e reported cstate change: term changed from 0 to 1, leader changed from <none> to 363bb2f744eb486f9ad726f08214c98e (127.14.180.67). New cstate: current_term: 1 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:16.461242 16173 leader_election.cc:304] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:05:16.461427 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:16.462278 16414 raft_consensus.cc:3060] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:16.462154 16105 catalog_manager.cc:5697] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e reported cstate change: term changed from 0 to 1, leader changed from <none> to 363bb2f744eb486f9ad726f08214c98e (127.14.180.67). New cstate: current_term: 1 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } }
W20260709 13:05:16.466591 16248 leader_election.cc:343] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:16.467079 16248 leader_election.cc:304] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:16.467912 16398 ts_tablet_manager.cc:1434] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f: Time spent starting tablet: real 0.045s	user 0.006s	sys 0.001s
I20260709 13:05:16.468647 16481 raft_consensus.cc:2749] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:16.471025 16414 raft_consensus.cc:2749] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:16.473228 16398 tablet_bootstrap.cc:492] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f: Bootstrap starting.
I20260709 13:05:16.473820 16400 tablet_bootstrap.cc:492] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e: No bootstrap required, opened a new log
I20260709 13:05:16.468777 16397 tablet_bootstrap.cc:492] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3: Bootstrap starting.
I20260709 13:05:16.474321 16400 ts_tablet_manager.cc:1403] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e: Time spent bootstrapping tablet: real 0.033s	user 0.013s	sys 0.010s
I20260709 13:05:16.477288 16400 raft_consensus.cc:359] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:16.478199 16400 raft_consensus.cc:385] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:16.478466 16400 raft_consensus.cc:740] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Initialized, Role: FOLLOWER
I20260709 13:05:16.478765 16450 raft_consensus.cc:493] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:16.479264 16450 raft_consensus.cc:515] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:16.479559 16400 consensus_queue.cc:260] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:16.481640 16397 tablet_bootstrap.cc:654] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:16.482071 16400 ts_tablet_manager.cc:1434] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:05:16.483516 16398 tablet_bootstrap.cc:654] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:16.483532 16400 tablet_bootstrap.cc:492] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e: Bootstrap starting.
I20260709 13:05:16.474303 16105 catalog_manager.cc:5697] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e reported cstate change: term changed from 0 to 1, leader changed from <none> to 363bb2f744eb486f9ad726f08214c98e (127.14.180.67). New cstate: current_term: 1 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:16.487087 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:16.481577 16450 leader_election.cc:290] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:05:16.488812 16173 leader_election.cc:343] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:16.488318 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:05:16.499477 16173 leader_election.cc:343] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:16.500211 16173 leader_election.cc:304] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:05:16.502858 16588 consensus_queue.cc:1048] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:16.508507 16450 raft_consensus.cc:2749] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:16.533823 16481 raft_consensus.cc:493] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:16.535032 16481 raft_consensus.cc:515] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:16.538640 16588 consensus_queue.cc:1048] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:16.540241 16481 leader_election.cc:290] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:16.544343 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:16.545919 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:16.546797 16205 raft_consensus.cc:2393] T 7295dce0baa440b8a197da845581ee81 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 1: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:05:16.552767 16400 tablet_bootstrap.cc:654] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:16.570065 16397 tablet_bootstrap.cc:492] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3: No bootstrap required, opened a new log
I20260709 13:05:16.571415 16398 tablet_bootstrap.cc:492] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f: No bootstrap required, opened a new log
I20260709 13:05:16.571913 16398 ts_tablet_manager.cc:1403] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f: Time spent bootstrapping tablet: real 0.099s	user 0.037s	sys 0.048s
I20260709 13:05:16.572678 16397 ts_tablet_manager.cc:1403] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3: Time spent bootstrapping tablet: real 0.106s	user 0.038s	sys 0.028s
I20260709 13:05:16.574756 16398 raft_consensus.cc:359] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:16.575531 16398 raft_consensus.cc:385] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:16.575945 16398 raft_consensus.cc:740] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Initialized, Role: FOLLOWER
I20260709 13:05:16.575912 16397 raft_consensus.cc:359] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:16.576537 16246 leader_election.cc:304] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:16.576862 16397 raft_consensus.cc:385] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:16.577164 16397 raft_consensus.cc:740] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Initialized, Role: FOLLOWER
I20260709 13:05:16.577085 16398 consensus_queue.cc:260] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:16.579130 16481 raft_consensus.cc:3060] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:16.579315 16398 ts_tablet_manager.cc:1434] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:05:16.581627 16398 tablet_bootstrap.cc:492] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f: Bootstrap starting.
I20260709 13:05:16.589362 16398 tablet_bootstrap.cc:654] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:16.577976 16397 consensus_queue.cc:260] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:16.593163 16397 ts_tablet_manager.cc:1434] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 13:05:16.594494 16397 tablet_bootstrap.cc:492] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3: Bootstrap starting.
I20260709 13:05:16.599663 16599 raft_consensus.cc:493] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:16.600271 16599 raft_consensus.cc:515] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:16.601239 16397 tablet_bootstrap.cc:654] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:16.603798 16599 leader_election.cc:290] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:16.605228 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:16.606335 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:05:16.606693 16246 leader_election.cc:343] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:16.609967 16248 leader_election.cc:343] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:16.610523 16248 leader_election.cc:304] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:16.612039 16599 raft_consensus.cc:2749] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:16.616107 16400 tablet_bootstrap.cc:492] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e: No bootstrap required, opened a new log
I20260709 13:05:16.616649 16400 ts_tablet_manager.cc:1403] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e: Time spent bootstrapping tablet: real 0.133s	user 0.008s	sys 0.005s
I20260709 13:05:16.619984 16400 raft_consensus.cc:359] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:16.620759 16400 raft_consensus.cc:385] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:16.621042 16400 raft_consensus.cc:740] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Initialized, Role: FOLLOWER
I20260709 13:05:16.617014 16481 raft_consensus.cc:2749] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:16.622136 16400 consensus_queue.cc:260] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:16.624500 16400 ts_tablet_manager.cc:1434] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.006s
I20260709 13:05:16.624715 16397 tablet_bootstrap.cc:492] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3: No bootstrap required, opened a new log
I20260709 13:05:16.625162 16397 ts_tablet_manager.cc:1403] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3: Time spent bootstrapping tablet: real 0.031s	user 0.009s	sys 0.008s
I20260709 13:05:16.628217 16397 raft_consensus.cc:359] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:16.629000 16397 raft_consensus.cc:385] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:16.629325 16397 raft_consensus.cc:740] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Initialized, Role: FOLLOWER
I20260709 13:05:16.630409 16397 consensus_queue.cc:260] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:16.631984 16398 tablet_bootstrap.cc:492] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f: No bootstrap required, opened a new log
I20260709 13:05:16.632475 16400 tablet_bootstrap.cc:492] T a7ce522fbeb44228a8c05d5ceeadc347 P 363bb2f744eb486f9ad726f08214c98e: Bootstrap starting.
I20260709 13:05:16.632697 16397 ts_tablet_manager.cc:1434] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:05:16.632814 16398 ts_tablet_manager.cc:1403] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f: Time spent bootstrapping tablet: real 0.051s	user 0.016s	sys 0.012s
I20260709 13:05:16.633653 16397 tablet_bootstrap.cc:492] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3: Bootstrap starting.
I20260709 13:05:16.635710 16398 raft_consensus.cc:359] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:16.636412 16398 raft_consensus.cc:385] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:16.636672 16398 raft_consensus.cc:740] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Initialized, Role: FOLLOWER
I20260709 13:05:16.637333 16398 consensus_queue.cc:260] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:16.640913 16397 tablet_bootstrap.cc:654] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:16.643697 16398 ts_tablet_manager.cc:1434] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:05:16.644912 16398 tablet_bootstrap.cc:492] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f: Bootstrap starting.
I20260709 13:05:16.645706 16587 raft_consensus.cc:493] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:16.646221 16587 raft_consensus.cc:515] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:16.646893 16400 tablet_bootstrap.cc:654] T a7ce522fbeb44228a8c05d5ceeadc347 P 363bb2f744eb486f9ad726f08214c98e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:16.648460 16587 leader_election.cc:290] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:16.650206 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:16.651201 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:16.652486 16398 tablet_bootstrap.cc:654] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:16.653066 16320 leader_election.cc:304] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:16.654228 16587 raft_consensus.cc:2749] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:16.659263 16400 tablet_bootstrap.cc:492] T a7ce522fbeb44228a8c05d5ceeadc347 P 363bb2f744eb486f9ad726f08214c98e: No bootstrap required, opened a new log
I20260709 13:05:16.659801 16400 ts_tablet_manager.cc:1403] T a7ce522fbeb44228a8c05d5ceeadc347 P 363bb2f744eb486f9ad726f08214c98e: Time spent bootstrapping tablet: real 0.028s	user 0.015s	sys 0.000s
I20260709 13:05:16.663166 16400 raft_consensus.cc:359] T a7ce522fbeb44228a8c05d5ceeadc347 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:16.663863 16400 raft_consensus.cc:385] T a7ce522fbeb44228a8c05d5ceeadc347 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:16.664112 16400 raft_consensus.cc:740] T a7ce522fbeb44228a8c05d5ceeadc347 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Initialized, Role: FOLLOWER
I20260709 13:05:16.664727 16400 consensus_queue.cc:260] T a7ce522fbeb44228a8c05d5ceeadc347 P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:16.667246 16400 ts_tablet_manager.cc:1434] T a7ce522fbeb44228a8c05d5ceeadc347 P 363bb2f744eb486f9ad726f08214c98e: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:05:16.669100 16400 tablet_bootstrap.cc:492] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e: Bootstrap starting.
I20260709 13:05:16.677548 16400 tablet_bootstrap.cc:654] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:16.680132 16355 raft_consensus.cc:3060] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:16.704918 16400 tablet_bootstrap.cc:492] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e: No bootstrap required, opened a new log
I20260709 13:05:16.705379 16400 ts_tablet_manager.cc:1403] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e: Time spent bootstrapping tablet: real 0.037s	user 0.010s	sys 0.002s
I20260709 13:05:16.707850 16400 raft_consensus.cc:359] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:16.708568 16400 raft_consensus.cc:385] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:16.708855 16400 raft_consensus.cc:740] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Initialized, Role: FOLLOWER
I20260709 13:05:16.709555 16400 consensus_queue.cc:260] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:16.710999 16400 ts_tablet_manager.cc:1434] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e: Time spent starting tablet: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:05:16.711844 16400 tablet_bootstrap.cc:492] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e: Bootstrap starting.
I20260709 13:05:16.716717 16398 tablet_bootstrap.cc:492] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f: No bootstrap required, opened a new log
I20260709 13:05:16.716993 16400 tablet_bootstrap.cc:654] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:16.719519 16398 ts_tablet_manager.cc:1403] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f: Time spent bootstrapping tablet: real 0.075s	user 0.021s	sys 0.027s
I20260709 13:05:16.720096 16397 tablet_bootstrap.cc:492] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3: No bootstrap required, opened a new log
I20260709 13:05:16.720650 16397 ts_tablet_manager.cc:1403] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3: Time spent bootstrapping tablet: real 0.087s	user 0.022s	sys 0.036s
I20260709 13:05:16.728593 16397 raft_consensus.cc:359] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:16.729403 16397 raft_consensus.cc:385] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:16.729761 16397 raft_consensus.cc:740] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Initialized, Role: FOLLOWER
I20260709 13:05:16.730666 16397 consensus_queue.cc:260] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:16.732748 16637 consensus_queue.cc:1048] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:16.729980 16398 raft_consensus.cc:359] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:16.736272 16398 raft_consensus.cc:385] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:16.737178 16398 raft_consensus.cc:740] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Initialized, Role: FOLLOWER
I20260709 13:05:16.738109 16397 ts_tablet_manager.cc:1434] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3: Time spent starting tablet: real 0.017s	user 0.010s	sys 0.003s
I20260709 13:05:16.739351 16397 tablet_bootstrap.cc:492] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3: Bootstrap starting.
I20260709 13:05:16.738922 16398 consensus_queue.cc:260] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:16.743257 16400 tablet_bootstrap.cc:492] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e: No bootstrap required, opened a new log
I20260709 13:05:16.743860 16400 ts_tablet_manager.cc:1403] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e: Time spent bootstrapping tablet: real 0.032s	user 0.007s	sys 0.009s
I20260709 13:05:16.747982 16400 raft_consensus.cc:359] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:16.749064 16400 raft_consensus.cc:385] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:16.749406 16400 raft_consensus.cc:740] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Initialized, Role: FOLLOWER
I20260709 13:05:16.757241 16400 consensus_queue.cc:260] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:16.759121 16400 ts_tablet_manager.cc:1434] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.004s
I20260709 13:05:16.760170 16400 tablet_bootstrap.cc:492] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e: Bootstrap starting.
I20260709 13:05:16.756422 16397 tablet_bootstrap.cc:654] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:16.769131 16588 consensus_queue.cc:1048] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:05:16.774816 16400 tablet_bootstrap.cc:654] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:16.774107 16637 raft_consensus.cc:493] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:16.778229 16450 raft_consensus.cc:493] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:16.778955 16637 raft_consensus.cc:515] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:16.779146 16450 raft_consensus.cc:515] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:16.785691 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:16.786754 16205 raft_consensus.cc:2468] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 0.
I20260709 13:05:16.787689 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:16.788686 16283 raft_consensus.cc:2468] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 0.
I20260709 13:05:16.790791 16400 tablet_bootstrap.cc:492] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e: No bootstrap required, opened a new log
I20260709 13:05:16.791314 16400 ts_tablet_manager.cc:1403] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e: Time spent bootstrapping tablet: real 0.031s	user 0.010s	sys 0.004s
I20260709 13:05:16.791519 16322 leader_election.cc:304] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:05:16.793684 16588 raft_consensus.cc:2804] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:16.794193 16588 raft_consensus.cc:493] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:16.794699 16588 raft_consensus.cc:3060] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:16.795960 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:16.796799 16283 raft_consensus.cc:2468] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 0.
I20260709 13:05:16.798070 16489 raft_consensus.cc:493] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:16.798026 16400 raft_consensus.cc:359] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:16.798655 16173 leader_election.cc:304] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:16.799024 16400 raft_consensus.cc:385] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:16.798765 16489 raft_consensus.cc:515] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:16.799353 16400 raft_consensus.cc:740] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Initialized, Role: FOLLOWER
I20260709 13:05:16.800323 16450 leader_election.cc:290] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:16.800098 16400 consensus_queue.cc:260] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:16.781945 16637 leader_election.cc:290] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:16.807026 16400 ts_tablet_manager.cc:1434] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 13:05:16.807729 16615 raft_consensus.cc:2804] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:16.808332 16400 tablet_bootstrap.cc:492] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e: Bootstrap starting.
I20260709 13:05:16.808250 16615 raft_consensus.cc:493] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:16.808790 16615 raft_consensus.cc:3060] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:16.811372 16588 raft_consensus.cc:515] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:16.806890 16489 leader_election.cc:290] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:16.816366 16615 raft_consensus.cc:515] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:16.817282 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:05:16.817984 16205 raft_consensus.cc:3060] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:16.806824 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:16.818727 16615 leader_election.cc:290] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:16.819025 16354 raft_consensus.cc:2468] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 0.
I20260709 13:05:16.822868 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f022e2e63ae4461d834e476ff2666991" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:16.823676 16283 raft_consensus.cc:2468] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 0.
I20260709 13:05:16.827872 16398 ts_tablet_manager.cc:1434] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f: Time spent starting tablet: real 0.108s	user 0.009s	sys 0.000s
I20260709 13:05:16.835875 16398 tablet_bootstrap.cc:492] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f: Bootstrap starting.
I20260709 13:05:16.837417 16637 consensus_queue.cc:1048] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:16.827664 16173 leader_election.cc:304] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:16.841042 16637 raft_consensus.cc:493] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:16.841847 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:05:16.841627 16637 raft_consensus.cc:515] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:16.840484 16450 raft_consensus.cc:2804] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:16.864001 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:16.845427 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:05:16.864894 16203 raft_consensus.cc:2468] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 0.
I20260709 13:05:16.865165 16357 raft_consensus.cc:3060] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:16.866716 16320 leader_election.cc:304] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:16.867012 16283 raft_consensus.cc:3060] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:16.867972 16636 raft_consensus.cc:2804] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:16.868475 16636 raft_consensus.cc:493] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:16.868871 16636 raft_consensus.cc:3060] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:16.847218 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f022e2e63ae4461d834e476ff2666991" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:16.871162 16354 raft_consensus.cc:2468] T f022e2e63ae4461d834e476ff2666991 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 0.
I20260709 13:05:16.863996 16450 raft_consensus.cc:493] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:16.856724 16670 log.cc:927] Time spent T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 13:05:16.857517 16205 raft_consensus.cc:2468] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 1.
I20260709 13:05:16.863163 16637 leader_election.cc:290] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:16.875859 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:05:16.878312 16590 raft_consensus.cc:493] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:16.855245 16588 leader_election.cc:290] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:16.884774 16283 raft_consensus.cc:2468] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 1.
I20260709 13:05:16.896497 16280 raft_consensus.cc:3060] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:16.894949 16590 raft_consensus.cc:515] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:16.905920 16590 leader_election.cc:290] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:16.908313 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:16.909296 16205 raft_consensus.cc:2468] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 0.
I20260709 13:05:16.912971 16246 leader_election.cc:304] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:16.902283 16357 raft_consensus.cc:2468] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 1.
I20260709 13:05:16.885361 16450 raft_consensus.cc:3060] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:16.925748 16320 leader_election.cc:304] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
W20260709 13:05:16.931290 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 52181.6us
I20260709 13:05:16.939869 16173 leader_election.cc:304] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:16.942116 16414 raft_consensus.cc:2804] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:16.942866 16414 raft_consensus.cc:697] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 1 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:05:16.944296 16400 tablet_bootstrap.cc:654] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:16.943845 16414 consensus_queue.cc:237] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:16.935477 16590 raft_consensus.cc:2804] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:16.946877 16590 raft_consensus.cc:493] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:16.947280 16590 raft_consensus.cc:3060] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:16.930976 16637 raft_consensus.cc:2804] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:16.953295 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:16.953848 16283 raft_consensus.cc:2468] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 0.
I20260709 13:05:16.950264 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:16.955457 16355 raft_consensus.cc:2468] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 0.
I20260709 13:05:16.958613 16637 raft_consensus.cc:697] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 1 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:05:16.959607 16637 consensus_queue.cc:237] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:16.962466 16636 raft_consensus.cc:515] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:16.964692 16636 leader_election.cc:290] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:16.967408 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:05:16.968119 16204 raft_consensus.cc:3060] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:17.009564 16397 tablet_bootstrap.cc:492] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3: No bootstrap required, opened a new log
I20260709 13:05:17.010212 16397 ts_tablet_manager.cc:1403] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3: Time spent bootstrapping tablet: real 0.271s	user 0.018s	sys 0.035s
I20260709 13:05:16.990774 16450 raft_consensus.cc:515] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:17.011090 16489 raft_consensus.cc:493] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:17.016113 16636 raft_consensus.cc:493] T a7ce522fbeb44228a8c05d5ceeadc347 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:17.018630 16675 consensus_queue.cc:1048] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.024s
I20260709 13:05:17.040565 16489 raft_consensus.cc:515] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:17.051004 16587 raft_consensus.cc:493] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:17.059409 16397 raft_consensus.cc:359] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:17.060659 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:05:17.062059 16397 raft_consensus.cc:385] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:17.062192 16283 raft_consensus.cc:3060] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:17.062419 16397 raft_consensus.cc:740] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Initialized, Role: FOLLOWER
I20260709 13:05:17.042191 16636 raft_consensus.cc:515] T a7ce522fbeb44228a8c05d5ceeadc347 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:17.064571 16676 consensus_queue.cc:1048] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260709 13:05:17.073441 16397 consensus_queue.cc:260] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:17.077488 16400 tablet_bootstrap.cc:492] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e: No bootstrap required, opened a new log
I20260709 13:05:17.077975 16400 ts_tablet_manager.cc:1403] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e: Time spent bootstrapping tablet: real 0.270s	user 0.020s	sys 0.004s
I20260709 13:05:17.076498 16590 raft_consensus.cc:515] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:17.071102 16636 leader_election.cc:290] T a7ce522fbeb44228a8c05d5ceeadc347 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:17.064021 16587 raft_consensus.cc:515] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:17.087587 16450 leader_election.cc:290] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:17.097452 16283 raft_consensus.cc:2468] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 1.
I20260709 13:05:17.100435 16397 ts_tablet_manager.cc:1434] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3: Time spent starting tablet: real 0.090s	user 0.011s	sys 0.000s
I20260709 13:05:17.102062 16397 tablet_bootstrap.cc:492] T ccde1e8182914560a3c1df0312e6a2b2 P 0aea40d6e4374085a2e38a70a71f63e3: Bootstrap starting.
I20260709 13:05:17.103286 16398 tablet_bootstrap.cc:654] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:17.104514 16280 raft_consensus.cc:2468] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 1.
I20260709 13:05:17.123847 16489 leader_election.cc:290] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:17.089661 16587 leader_election.cc:290] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:17.137694 16105 catalog_manager.cc:5697] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e reported cstate change: term changed from 0 to 1, leader changed from <none> to 363bb2f744eb486f9ad726f08214c98e (127.14.180.67). New cstate: current_term: 1 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } }
W20260709 13:05:17.162082 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 124154us
I20260709 13:05:17.181628 16400 raft_consensus.cc:359] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:17.182533 16400 raft_consensus.cc:385] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:17.182960 16400 raft_consensus.cc:740] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Initialized, Role: FOLLOWER
I20260709 13:05:17.142665 16590 leader_election.cc:290] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:17.185068 16400 consensus_queue.cc:260] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:17.188227 16322 leader_election.cc:304] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:05:17.188408 16106 catalog_manager.cc:5697] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f reported cstate change: term changed from 0 to 1, leader changed from <none> to e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65). New cstate: current_term: 1 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:17.189385 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f022e2e63ae4461d834e476ff2666991" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:05:17.190013 16283 raft_consensus.cc:3060] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:17.193452 16400 ts_tablet_manager.cc:1434] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e: Time spent starting tablet: real 0.115s	user 0.008s	sys 0.001s
I20260709 13:05:17.194029 16587 raft_consensus.cc:2804] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:17.169462 16204 raft_consensus.cc:2468] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 1.
I20260709 13:05:17.204700 16588 consensus_queue.cc:1048] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:05:17.213653 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:17.194495 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:05:17.214977 16208 raft_consensus.cc:2468] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 0.
I20260709 13:05:17.207264 16587 raft_consensus.cc:697] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 1 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:05:17.219094 16205 raft_consensus.cc:3060] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:17.223703 16587 consensus_queue.cc:237] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:17.212572 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:05:17.227705 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:17.228130 16354 raft_consensus.cc:3060] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:17.228394 16280 raft_consensus.cc:2468] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 0.
I20260709 13:05:17.229035 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:17.229997 16356 raft_consensus.cc:2468] T a7ce522fbeb44228a8c05d5ceeadc347 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 0.
I20260709 13:05:17.231662 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f022e2e63ae4461d834e476ff2666991" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:05:17.232575 16353 raft_consensus.cc:3060] T f022e2e63ae4461d834e476ff2666991 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:17.242790 16283 raft_consensus.cc:2468] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 1.
I20260709 13:05:17.248548 16400 tablet_bootstrap.cc:492] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e: Bootstrap starting.
I20260709 13:05:17.255383 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:17.258388 16279 raft_consensus.cc:2468] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 0.
I20260709 13:05:17.261384 16173 leader_election.cc:304] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:17.261809 16398 tablet_bootstrap.cc:492] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f: No bootstrap required, opened a new log
I20260709 13:05:17.262259 16398 ts_tablet_manager.cc:1403] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f: Time spent bootstrapping tablet: real 0.427s	user 0.021s	sys 0.036s
I20260709 13:05:17.244251 16205 raft_consensus.cc:2468] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 1.
I20260709 13:05:17.264420 16173 leader_election.cc:304] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:17.265157 16414 raft_consensus.cc:2804] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:17.265753 16414 raft_consensus.cc:493] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:17.266235 16414 raft_consensus.cc:3060] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:17.267341 16615 raft_consensus.cc:2804] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:17.268720 16615 raft_consensus.cc:697] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:05:17.271643 16246 leader_election.cc:304] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:17.280055 16400 tablet_bootstrap.cc:654] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:17.274991 16414 raft_consensus.cc:515] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:17.265138 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:17.290891 16414 leader_election.cc:290] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:17.284699 16599 raft_consensus.cc:2804] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:17.272140 16354 raft_consensus.cc:2468] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 1.
I20260709 13:05:17.309197 16615 consensus_queue.cc:237] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:17.300699 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:17.293771 16320 leader_election.cc:304] T a7ce522fbeb44228a8c05d5ceeadc347 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
W20260709 13:05:17.336002 16320 leader_election.cc:343] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:17.342731 16686 raft_consensus.cc:2804] T a7ce522fbeb44228a8c05d5ceeadc347 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:17.349576 16686 raft_consensus.cc:493] T a7ce522fbeb44228a8c05d5ceeadc347 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:17.349996 16686 raft_consensus.cc:3060] T a7ce522fbeb44228a8c05d5ceeadc347 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:17.356774 16397 tablet_bootstrap.cc:654] T ccde1e8182914560a3c1df0312e6a2b2 P 0aea40d6e4374085a2e38a70a71f63e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:17.359436 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:05:17.360329 16278 raft_consensus.cc:3060] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:17.369174 16400 tablet_bootstrap.cc:492] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e: No bootstrap required, opened a new log
I20260709 13:05:17.369900 16400 ts_tablet_manager.cc:1403] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e: Time spent bootstrapping tablet: real 0.122s	user 0.029s	sys 0.002s
I20260709 13:05:17.372964 16398 raft_consensus.cc:359] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:17.373764 16398 raft_consensus.cc:385] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:17.374114 16398 raft_consensus.cc:740] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Initialized, Role: FOLLOWER
I20260709 13:05:17.374788 16398 consensus_queue.cc:260] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:17.380180 16398 ts_tablet_manager.cc:1434] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f: Time spent starting tablet: real 0.118s	user 0.008s	sys 0.000s
I20260709 13:05:17.381337 16398 tablet_bootstrap.cc:492] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f: Bootstrap starting.
I20260709 13:05:17.424501 16677 raft_consensus.cc:493] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:17.436671 16400 raft_consensus.cc:359] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:17.437391 16400 raft_consensus.cc:385] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:17.437670 16400 raft_consensus.cc:740] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Initialized, Role: FOLLOWER
I20260709 13:05:17.425071 16677 raft_consensus.cc:515] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:17.439090 16400 consensus_queue.cc:260] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:17.450253 16400 ts_tablet_manager.cc:1434] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e: Time spent starting tablet: real 0.080s	user 0.003s	sys 0.005s
W20260709 13:05:17.455309 16322 leader_election.cc:343] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:17.455793 16322 leader_election.cc:304] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:17.459496 16682 raft_consensus.cc:2749] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:17.452176 16353 raft_consensus.cc:2468] T f022e2e63ae4461d834e476ff2666991 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 1.
I20260709 13:05:17.467657 16397 tablet_bootstrap.cc:492] T ccde1e8182914560a3c1df0312e6a2b2 P 0aea40d6e4374085a2e38a70a71f63e3: No bootstrap required, opened a new log
I20260709 13:05:17.469283 16397 ts_tablet_manager.cc:1403] T ccde1e8182914560a3c1df0312e6a2b2 P 0aea40d6e4374085a2e38a70a71f63e3: Time spent bootstrapping tablet: real 0.368s	user 0.018s	sys 0.005s
I20260709 13:05:17.472764 16686 raft_consensus.cc:515] T a7ce522fbeb44228a8c05d5ceeadc347 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:17.475489 16397 raft_consensus.cc:359] T ccde1e8182914560a3c1df0312e6a2b2 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:17.476266 16397 raft_consensus.cc:385] T ccde1e8182914560a3c1df0312e6a2b2 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:17.476593 16397 raft_consensus.cc:740] T ccde1e8182914560a3c1df0312e6a2b2 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Initialized, Role: FOLLOWER
I20260709 13:05:17.477451 16397 consensus_queue.cc:260] T ccde1e8182914560a3c1df0312e6a2b2 P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:17.483389 16400 tablet_bootstrap.cc:492] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e: Bootstrap starting.
I20260709 13:05:17.484809 16397 ts_tablet_manager.cc:1434] T ccde1e8182914560a3c1df0312e6a2b2 P 0aea40d6e4374085a2e38a70a71f63e3: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.003s
I20260709 13:05:17.480211 16278 raft_consensus.cc:2468] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 1.
I20260709 13:05:17.494100 16397 tablet_bootstrap.cc:492] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3: Bootstrap starting.
I20260709 13:05:17.489205 16599 raft_consensus.cc:697] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:05:17.515311 16677 leader_election.cc:290] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:17.518378 16398 tablet_bootstrap.cc:654] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f: Neither blocks nor log segments found. Creating new log.
W20260709 13:05:17.519690 16693 log.cc:927] Time spent T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
I20260709 13:05:17.500521 16599 consensus_queue.cc:237] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:17.526827 16686 leader_election.cc:290] T a7ce522fbeb44228a8c05d5ceeadc347 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:17.530076 16400 tablet_bootstrap.cc:654] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:17.538968 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:17.548501 16689 raft_consensus.cc:493] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:17.549386 16689 raft_consensus.cc:515] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:17.552884 16689 leader_election.cc:290] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:17.559988 16173 leader_election.cc:304] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:17.588584 16690 raft_consensus.cc:2804] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:17.589172 16690 raft_consensus.cc:697] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:05:17.594832 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:05:17.595968 16279 raft_consensus.cc:2393] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 1: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:05:17.596706 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:17.598836 16206 raft_consensus.cc:2468] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 0.
I20260709 13:05:17.573853 16684 consensus_queue.cc:1048] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:17.603689 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:17.605032 16397 tablet_bootstrap.cc:654] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:17.608959 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:17.590018 16690 consensus_queue.cc:237] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:17.609733 16276 raft_consensus.cc:2468] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 0.
I20260709 13:05:17.616616 16246 leader_election.cc:304] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:17.599519 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:05:17.619441 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:05:17.622522 16590 raft_consensus.cc:2804] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:17.623042 16590 raft_consensus.cc:493] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:17.623433 16590 raft_consensus.cc:3060] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:17.625985 16322 leader_election.cc:304] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:05:17.629323 16400 tablet_bootstrap.cc:492] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e: No bootstrap required, opened a new log
I20260709 13:05:17.629835 16400 ts_tablet_manager.cc:1403] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e: Time spent bootstrapping tablet: real 0.172s	user 0.028s	sys 0.021s
I20260709 13:05:17.628854 16352 raft_consensus.cc:2393] T a7ce522fbeb44228a8c05d5ceeadc347 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 1: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:05:17.631943 16587 raft_consensus.cc:2804] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:17.628772 16675 consensus_queue.cc:1048] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
W20260709 13:05:17.638463 16248 leader_election.cc:343] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:17.632942 16320 leader_election.cc:343] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:17.642566 16587 raft_consensus.cc:493] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:17.649284 16587 raft_consensus.cc:3060] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:17.652623 16590 raft_consensus.cc:515] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:17.658602 16398 tablet_bootstrap.cc:492] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f: No bootstrap required, opened a new log
I20260709 13:05:17.659291 16398 ts_tablet_manager.cc:1403] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f: Time spent bootstrapping tablet: real 0.278s	user 0.012s	sys 0.011s
I20260709 13:05:17.663026 16320 leader_election.cc:304] T a7ce522fbeb44228a8c05d5ceeadc347 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:17.665215 16588 raft_consensus.cc:2749] T a7ce522fbeb44228a8c05d5ceeadc347 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:05:17.670652 16590 leader_election.cc:290] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:17.672863 16398 raft_consensus.cc:359] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:17.675590 16398 raft_consensus.cc:385] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:17.676009 16398 raft_consensus.cc:740] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Initialized, Role: FOLLOWER
I20260709 13:05:17.673895 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:05:17.664057 16106 catalog_manager.cc:5697] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66). New cstate: current_term: 1 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:17.676854 16398 consensus_queue.cc:260] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:17.691478 16398 ts_tablet_manager.cc:1434] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.003s
I20260709 13:05:17.689543 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:05:17.693256 16615 consensus_queue.cc:1048] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:17.694360 16587 raft_consensus.cc:515] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:17.686128 16206 raft_consensus.cc:3060] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:17.696851 16587 leader_election.cc:290] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:17.702508 16400 raft_consensus.cc:359] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:17.705842 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:05:17.686152 16675 raft_consensus.cc:493] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:17.706487 16283 raft_consensus.cc:3060] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:17.705299 16400 raft_consensus.cc:385] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:17.708032 16400 raft_consensus.cc:740] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Initialized, Role: FOLLOWER
I20260709 13:05:17.714857 16400 consensus_queue.cc:260] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:17.715803 16398 tablet_bootstrap.cc:492] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f: Bootstrap starting.
I20260709 13:05:17.706637 16675 raft_consensus.cc:515] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:05:17.718921 16248 leader_election.cc:343] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:17.680557 16588 consensus_queue.cc:1048] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.038s
I20260709 13:05:17.725808 16681 raft_consensus.cc:493] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:17.726579 16400 ts_tablet_manager.cc:1434] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e: Time spent starting tablet: real 0.094s	user 0.007s	sys 0.007s
I20260709 13:05:17.729568 16400 tablet_bootstrap.cc:492] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e: Bootstrap starting.
I20260709 13:05:17.732906 16283 raft_consensus.cc:2468] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 1.
I20260709 13:05:17.738448 16322 leader_election.cc:304] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:05:17.741274 16414 consensus_queue.cc:1048] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:17.741017 16677 raft_consensus.cc:2804] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:17.746919 16677 raft_consensus.cc:697] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [term 1 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:05:17.748145 16677 consensus_queue.cc:237] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:17.726394 16681 raft_consensus.cc:515] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:17.760221 16675 leader_election.cc:290] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:17.790423 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:17.792299 16283 raft_consensus.cc:2468] T ccde1e8182914560a3c1df0312e6a2b2 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 0.
I20260709 13:05:17.797178 16322 leader_election.cc:304] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:05:17.812048 16397 tablet_bootstrap.cc:492] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3: No bootstrap required, opened a new log
I20260709 13:05:17.812507 16397 ts_tablet_manager.cc:1403] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3: Time spent bootstrapping tablet: real 0.321s	user 0.021s	sys 0.013s
I20260709 13:05:17.815366 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:05:17.816072 16205 raft_consensus.cc:3060] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:17.817104 16397 raft_consensus.cc:359] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:17.817830 16397 raft_consensus.cc:385] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:17.818142 16397 raft_consensus.cc:740] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Initialized, Role: FOLLOWER
I20260709 13:05:17.818890 16397 consensus_queue.cc:260] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:17.802008 16675 raft_consensus.cc:2804] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:17.825125 16397 ts_tablet_manager.cc:1434] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 13:05:17.807739 16206 raft_consensus.cc:2468] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 1.
I20260709 13:05:17.824084 16675 raft_consensus.cc:493] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:17.833416 16675 raft_consensus.cc:3060] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:17.831832 16398 tablet_bootstrap.cc:654] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:17.832007 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:17.841260 16246 leader_election.cc:304] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 363bb2f744eb486f9ad726f08214c98e
I20260709 13:05:17.847703 16590 raft_consensus.cc:2804] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:17.848351 16590 raft_consensus.cc:697] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:05:17.849004 16590 consensus_queue.cc:237] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:17.851215 16205 raft_consensus.cc:2468] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 1.
W20260709 13:05:17.851588 16320 leader_election.cc:343] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:17.852944 16587 consensus_queue.cc:1048] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:17.860491 16397 tablet_bootstrap.cc:492] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3: Bootstrap starting.
I20260709 13:05:17.855875 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:17.862123 16587 consensus_queue.cc:1048] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:17.865298 16278 raft_consensus.cc:2393] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 1: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
W20260709 13:05:17.906796 16714 log.cc:927] Time spent T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:05:17.931689 16681 leader_election.cc:290] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:17.921808 16587 raft_consensus.cc:493] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:17.937825 16684 consensus_queue.cc:1048] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:17.952049 16105 catalog_manager.cc:5697] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e reported cstate change: term changed from 0 to 1, leader changed from <none> to 363bb2f744eb486f9ad726f08214c98e (127.14.180.67). New cstate: current_term: 1 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:17.959025 16397 tablet_bootstrap.cc:654] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:17.962137 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:05:18.012912 16154 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:18.014245 16400 tablet_bootstrap.cc:654] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:17.942914 16587 raft_consensus.cc:515] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:05:18.016880 16721 log.cc:927] Time spent T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 13:05:18.024015 16706 consensus_queue.cc:1048] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:18.028009 16587 leader_election.cc:290] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:18.029443 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:17.982240 16675 raft_consensus.cc:515] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:18.032433 16204 raft_consensus.cc:2393] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 1: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:05:18.045725 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:05:18.037066 16103 catalog_manager.cc:5697] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f reported cstate change: term changed from 0 to 1, leader changed from <none> to e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65). New cstate: current_term: 1 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } }
W20260709 13:05:18.048095 16320 leader_election.cc:343] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:18.047473 16103 catalog_manager.cc:5697] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f reported cstate change: term changed from 0 to 1, leader changed from <none> to e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65). New cstate: current_term: 1 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:18.048370 16599 consensus_queue.cc:1048] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:18.049314 16173 leader_election.cc:304] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:05:18.053369 16679 raft_consensus.cc:2749] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:18.058015 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:18.071327 16106 catalog_manager.cc:5697] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66). New cstate: current_term: 1 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:18.072546 16322 leader_election.cc:304] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:18.077422 16588 raft_consensus.cc:3060] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:18.078624 16398 tablet_bootstrap.cc:492] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f: No bootstrap required, opened a new log
I20260709 13:05:18.079115 16398 ts_tablet_manager.cc:1403] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f: Time spent bootstrapping tablet: real 0.375s	user 0.014s	sys 0.019s
I20260709 13:05:18.081790 16398 raft_consensus.cc:359] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:18.082480 16398 raft_consensus.cc:385] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:18.082930 16398 raft_consensus.cc:740] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Initialized, Role: FOLLOWER
I20260709 13:05:18.083734 16398 consensus_queue.cc:260] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:18.085698 16398 ts_tablet_manager.cc:1434] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.001s
I20260709 13:05:18.096596 16398 tablet_bootstrap.cc:492] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f: Bootstrap starting.
I20260709 13:05:18.097419 16675 leader_election.cc:290] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:18.099071 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:05:18.106539 16279 raft_consensus.cc:3060] T ccde1e8182914560a3c1df0312e6a2b2 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:18.115883 16588 raft_consensus.cc:2749] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:18.116029 16279 raft_consensus.cc:2468] T ccde1e8182914560a3c1df0312e6a2b2 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 1.
I20260709 13:05:18.135161 16615 consensus_queue.cc:1048] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 13:05:18.149819 16679 consensus_queue.cc:1048] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:18.149466 16105 catalog_manager.cc:5697] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e reported cstate change: term changed from 0 to 1, leader changed from <none> to 363bb2f744eb486f9ad726f08214c98e (127.14.180.67). New cstate: current_term: 1 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:18.162611 16322 leader_election.cc:304] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:18.163605 16675 raft_consensus.cc:2804] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:18.166643 16397 tablet_bootstrap.cc:492] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3: No bootstrap required, opened a new log
I20260709 13:05:18.167163 16397 ts_tablet_manager.cc:1403] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3: Time spent bootstrapping tablet: real 0.308s	user 0.028s	sys 0.035s
I20260709 13:05:18.168180 16675 raft_consensus.cc:697] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 1 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:05:18.169538 16675 consensus_queue.cc:237] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:18.181413 16400 tablet_bootstrap.cc:492] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e: No bootstrap required, opened a new log
I20260709 13:05:18.181913 16400 ts_tablet_manager.cc:1403] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e: Time spent bootstrapping tablet: real 0.453s	user 0.030s	sys 0.002s
I20260709 13:05:18.197525 16398 tablet_bootstrap.cc:654] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:18.206413 16400 raft_consensus.cc:359] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:18.207276 16400 raft_consensus.cc:385] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:18.207719 16400 raft_consensus.cc:740] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Initialized, Role: FOLLOWER
I20260709 13:05:18.208678 16400 consensus_queue.cc:260] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:18.211736 16588 consensus_queue.cc:1048] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:18.211946 16397 raft_consensus.cc:359] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:18.212971 16397 raft_consensus.cc:385] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:18.213368 16397 raft_consensus.cc:740] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Initialized, Role: FOLLOWER
I20260709 13:05:18.216034 16397 consensus_queue.cc:260] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:18.220835 16400 ts_tablet_manager.cc:1434] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e: Time spent starting tablet: real 0.039s	user 0.009s	sys 0.000s
I20260709 13:05:18.221743 16398 tablet_bootstrap.cc:492] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f: No bootstrap required, opened a new log
I20260709 13:05:18.222630 16398 ts_tablet_manager.cc:1403] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f: Time spent bootstrapping tablet: real 0.127s	user 0.015s	sys 0.000s
I20260709 13:05:18.221959 16400 tablet_bootstrap.cc:492] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e: Bootstrap starting.
I20260709 13:05:18.228847 16397 ts_tablet_manager.cc:1434] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3: Time spent starting tablet: real 0.061s	user 0.008s	sys 0.001s
I20260709 13:05:18.230643 16397 tablet_bootstrap.cc:492] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3: Bootstrap starting.
I20260709 13:05:18.233407 16106 catalog_manager.cc:5697] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e reported cstate change: term changed from 0 to 1, leader changed from <none> to 363bb2f744eb486f9ad726f08214c98e (127.14.180.67). New cstate: current_term: 1 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:18.239877 16400 tablet_bootstrap.cc:654] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:18.255641 16397 tablet_bootstrap.cc:654] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:18.255961 16398 raft_consensus.cc:359] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:18.256717 16398 raft_consensus.cc:385] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:18.257025 16398 raft_consensus.cc:740] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Initialized, Role: FOLLOWER
I20260709 13:05:18.257653 16398 consensus_queue.cc:260] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:18.265233 16716 raft_consensus.cc:493] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:18.267901 16675 consensus_queue.cc:1048] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:18.274019 16398 ts_tablet_manager.cc:1434] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f: Time spent starting tablet: real 0.051s	user 0.005s	sys 0.000s
I20260709 13:05:18.266396 16716 raft_consensus.cc:515] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:18.282769 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:18.284081 16281 raft_consensus.cc:2393] T ccde1e8182914560a3c1df0312e6a2b2 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 1: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:05:18.285475 16398 tablet_bootstrap.cc:492] T b9e1324823f04d8da5a4b3ddbd061c0e P e10b16d536674c0bb350a31d7ce5ff7f: Bootstrap starting.
I20260709 13:05:18.287253 16716 leader_election.cc:290] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:18.293236 16398 tablet_bootstrap.cc:654] T b9e1324823f04d8da5a4b3ddbd061c0e P e10b16d536674c0bb350a31d7ce5ff7f: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:18.296514 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:18.298599 16173 leader_election.cc:304] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:05:18.301242 16716 raft_consensus.cc:3060] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:18.305459 16400 tablet_bootstrap.cc:492] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e: No bootstrap required, opened a new log
I20260709 13:05:18.305982 16400 ts_tablet_manager.cc:1403] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e: Time spent bootstrapping tablet: real 0.084s	user 0.012s	sys 0.008s
I20260709 13:05:18.306326 16398 tablet_bootstrap.cc:492] T b9e1324823f04d8da5a4b3ddbd061c0e P e10b16d536674c0bb350a31d7ce5ff7f: No bootstrap required, opened a new log
I20260709 13:05:18.306960 16398 ts_tablet_manager.cc:1403] T b9e1324823f04d8da5a4b3ddbd061c0e P e10b16d536674c0bb350a31d7ce5ff7f: Time spent bootstrapping tablet: real 0.022s	user 0.017s	sys 0.003s
I20260709 13:05:18.309355 16400 raft_consensus.cc:359] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:18.310096 16400 raft_consensus.cc:385] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:18.310175 16398 raft_consensus.cc:359] T b9e1324823f04d8da5a4b3ddbd061c0e P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:18.310945 16398 raft_consensus.cc:385] T b9e1324823f04d8da5a4b3ddbd061c0e P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:18.310693 16703 consensus_queue.cc:1048] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:18.310437 16400 raft_consensus.cc:740] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Initialized, Role: FOLLOWER
I20260709 13:05:18.312563 16400 consensus_queue.cc:260] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:18.317557 16400 ts_tablet_manager.cc:1434] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.002s
I20260709 13:05:18.319670 16703 raft_consensus.cc:493] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:18.320185 16703 raft_consensus.cc:515] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:18.326067 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:18.326830 16355 raft_consensus.cc:2468] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 0.
I20260709 13:05:18.327852 16716 raft_consensus.cc:2749] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:18.311425 16398 raft_consensus.cc:740] T b9e1324823f04d8da5a4b3ddbd061c0e P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Initialized, Role: FOLLOWER
I20260709 13:05:18.329876 16398 consensus_queue.cc:260] T b9e1324823f04d8da5a4b3ddbd061c0e P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:18.330405 16703 leader_election.cc:290] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:18.331370 16400 tablet_bootstrap.cc:492] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e: Bootstrap starting.
I20260709 13:05:18.332406 16398 ts_tablet_manager.cc:1434] T b9e1324823f04d8da5a4b3ddbd061c0e P e10b16d536674c0bb350a31d7ce5ff7f: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 13:05:18.333614 16398 tablet_bootstrap.cc:492] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f: Bootstrap starting.
I20260709 13:05:18.335078 16248 leader_election.cc:304] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:05:18.336372 16397 tablet_bootstrap.cc:492] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3: No bootstrap required, opened a new log
I20260709 13:05:18.336895 16397 ts_tablet_manager.cc:1403] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3: Time spent bootstrapping tablet: real 0.107s	user 0.013s	sys 0.003s
I20260709 13:05:18.337833 16400 tablet_bootstrap.cc:654] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:18.338358 16689 raft_consensus.cc:2804] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:18.338812 16689 raft_consensus.cc:493] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:18.339183 16689 raft_consensus.cc:3060] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:18.341773 16397 raft_consensus.cc:359] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:18.342582 16397 raft_consensus.cc:385] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:18.342882 16397 raft_consensus.cc:740] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Initialized, Role: FOLLOWER
I20260709 13:05:18.343699 16397 consensus_queue.cc:260] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:18.346065 16397 ts_tablet_manager.cc:1434] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:05:18.347344 16397 tablet_bootstrap.cc:492] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3: Bootstrap starting.
I20260709 13:05:18.362833 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:18.364771 16206 raft_consensus.cc:2468] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 0.
I20260709 13:05:18.370932 16675 raft_consensus.cc:493] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:18.371484 16599 raft_consensus.cc:493] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:18.372021 16599 raft_consensus.cc:515] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:18.371908 16675 raft_consensus.cc:515] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:18.374997 16675 leader_election.cc:290] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:18.375659 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:18.376441 16203 raft_consensus.cc:2468] T b9e1324823f04d8da5a4b3ddbd061c0e P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 0.
I20260709 13:05:18.377995 16320 leader_election.cc:304] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:18.378985 16675 raft_consensus.cc:2804] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:18.379642 16675 raft_consensus.cc:493] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:18.380399 16675 raft_consensus.cc:3060] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:18.381961 16689 raft_consensus.cc:515] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:18.371066 16703 consensus_queue.cc:1048] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:18.391273 16599 leader_election.cc:290] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:18.393636 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:18.393909 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:05:18.394445 16203 raft_consensus.cc:2468] T b9e1324823f04d8da5a4b3ddbd061c0e P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 0.
I20260709 13:05:18.394692 16204 raft_consensus.cc:3060] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:18.395558 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:18.396502 16279 raft_consensus.cc:2468] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 0.
I20260709 13:05:18.397630 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:18.399005 16246 leader_election.cc:304] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:18.401012 16397 tablet_bootstrap.cc:654] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:18.403394 16590 raft_consensus.cc:2804] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:18.403936 16590 raft_consensus.cc:493] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:18.404312 16590 raft_consensus.cc:3060] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:18.407717 16204 raft_consensus.cc:2468] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 1.
I20260709 13:05:18.406932 16398 tablet_bootstrap.cc:654] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:18.411369 16675 raft_consensus.cc:515] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:18.420486 16356 raft_consensus.cc:2393] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 1: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:05:18.421906 16398 tablet_bootstrap.cc:492] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f: No bootstrap required, opened a new log
I20260709 13:05:18.424224 16398 ts_tablet_manager.cc:1403] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f: Time spent bootstrapping tablet: real 0.091s	user 0.015s	sys 0.000s
I20260709 13:05:18.424726 16246 leader_election.cc:304] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:18.427186 16675 leader_election.cc:290] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:18.428067 16397 tablet_bootstrap.cc:492] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3: No bootstrap required, opened a new log
I20260709 13:05:18.427920 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:05:18.446941 16204 raft_consensus.cc:3060] T b9e1324823f04d8da5a4b3ddbd061c0e P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:18.446944 16397 ts_tablet_manager.cc:1403] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3: Time spent bootstrapping tablet: real 0.100s	user 0.006s	sys 0.009s
I20260709 13:05:18.429838 16706 raft_consensus.cc:2804] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:18.429622 16398 raft_consensus.cc:359] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:18.454865 16398 raft_consensus.cc:385] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:18.454952 16706 raft_consensus.cc:697] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:05:18.455226 16398 raft_consensus.cc:740] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Initialized, Role: FOLLOWER
I20260709 13:05:18.456012 16398 consensus_queue.cc:260] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:18.456259 16706 consensus_queue.cc:237] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:18.459055 16398 ts_tablet_manager.cc:1434] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.001s
I20260709 13:05:18.460070 16398 tablet_bootstrap.cc:492] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f: Bootstrap starting.
I20260709 13:05:18.431581 16689 leader_election.cc:290] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:18.454227 16397 raft_consensus.cc:359] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:18.463130 16397 raft_consensus.cc:385] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:18.463445 16397 raft_consensus.cc:740] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Initialized, Role: FOLLOWER
I20260709 13:05:18.464092 16397 consensus_queue.cc:260] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:18.430945 16590 raft_consensus.cc:515] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:18.438218 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:05:18.465658 16352 raft_consensus.cc:3060] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:18.466110 16398 tablet_bootstrap.cc:654] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:18.467872 16397 ts_tablet_manager.cc:1434] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.003s
I20260709 13:05:18.469470 16204 raft_consensus.cc:2468] T b9e1324823f04d8da5a4b3ddbd061c0e P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 1.
I20260709 13:05:18.437669 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:05:18.470930 16281 raft_consensus.cc:2393] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 1: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:05:18.470947 16320 leader_election.cc:304] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:18.472105 16675 raft_consensus.cc:2804] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:18.472728 16675 raft_consensus.cc:697] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 1 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:05:18.473598 16675 consensus_queue.cc:237] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:18.477408 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:05:18.478390 16397 tablet_bootstrap.cc:492] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3: Bootstrap starting.
I20260709 13:05:18.477455 16352 raft_consensus.cc:2468] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 1.
I20260709 13:05:18.477348 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:05:18.480185 16204 raft_consensus.cc:2393] T b9e1324823f04d8da5a4b3ddbd061c0e P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 1: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:05:18.481384 16246 leader_election.cc:304] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:18.482179 16689 raft_consensus.cc:2749] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:05:18.482211 16590 leader_election.cc:290] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:18.487541 16400 tablet_bootstrap.cc:492] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e: No bootstrap required, opened a new log
I20260709 13:05:18.488319 16400 ts_tablet_manager.cc:1403] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e: Time spent bootstrapping tablet: real 0.157s	user 0.047s	sys 0.033s
I20260709 13:05:18.488981 16397 tablet_bootstrap.cc:654] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:18.496256 16398 tablet_bootstrap.cc:492] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f: No bootstrap required, opened a new log
I20260709 13:05:18.497889 16398 ts_tablet_manager.cc:1403] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f: Time spent bootstrapping tablet: real 0.038s	user 0.010s	sys 0.002s
I20260709 13:05:18.500245 16400 raft_consensus.cc:359] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:18.501004 16400 raft_consensus.cc:385] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:18.501302 16400 raft_consensus.cc:740] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Initialized, Role: FOLLOWER
I20260709 13:05:18.506120 16398 raft_consensus.cc:359] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:18.506929 16398 raft_consensus.cc:385] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:18.507246 16398 raft_consensus.cc:740] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Initialized, Role: FOLLOWER
I20260709 13:05:18.508059 16398 consensus_queue.cc:260] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:18.501940 16400 consensus_queue.cc:260] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:18.510430 16398 ts_tablet_manager.cc:1434] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.000s
I20260709 13:05:18.514631 16106 catalog_manager.cc:5697] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66). New cstate: current_term: 1 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:18.519495 16398 tablet_bootstrap.cc:492] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f: Bootstrap starting.
I20260709 13:05:18.526212 16400 ts_tablet_manager.cc:1434] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e: Time spent starting tablet: real 0.038s	user 0.009s	sys 0.000s
I20260709 13:05:18.526245 16105 catalog_manager.cc:5697] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e reported cstate change: term changed from 0 to 1, leader changed from <none> to 363bb2f744eb486f9ad726f08214c98e (127.14.180.67). New cstate: current_term: 1 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:18.527654 16400 tablet_bootstrap.cc:492] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e: Bootstrap starting.
I20260709 13:05:18.535019 16706 raft_consensus.cc:493] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:18.538378 16675 raft_consensus.cc:493] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:18.538873 16706 raft_consensus.cc:515] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:18.539213 16675 raft_consensus.cc:515] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:18.541368 16675 leader_election.cc:290] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:18.542269 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:18.542945 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:18.543236 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c15d8e9be8414c84912ab77b66bfb1" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:18.541414 16706 leader_election.cc:290] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:05:18.544449 16248 leader_election.cc:343] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:18.544668 16320 leader_election.cc:343] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:05:18.545387 16322 leader_election.cc:343] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:18.545960 16322 leader_election.cc:304] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:18.546350 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c15d8e9be8414c84912ab77b66bfb1" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:18.547132 16204 raft_consensus.cc:2468] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 0.
I20260709 13:05:18.547622 16587 raft_consensus.cc:2749] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:18.549157 16246 leader_election.cc:304] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 363bb2f744eb486f9ad726f08214c98e
I20260709 13:05:18.550292 16706 raft_consensus.cc:2804] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:18.550832 16706 raft_consensus.cc:493] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:18.551259 16706 raft_consensus.cc:3060] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:18.554093 16398 tablet_bootstrap.cc:654] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:18.561960 16400 tablet_bootstrap.cc:654] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:18.558436 16397 tablet_bootstrap.cc:492] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3: No bootstrap required, opened a new log
I20260709 13:05:18.563366 16397 ts_tablet_manager.cc:1403] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3: Time spent bootstrapping tablet: real 0.085s	user 0.019s	sys 0.009s
I20260709 13:05:18.569806 16706 raft_consensus.cc:515] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:18.574679 16398 tablet_bootstrap.cc:492] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f: No bootstrap required, opened a new log
I20260709 13:05:18.575202 16398 ts_tablet_manager.cc:1403] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f: Time spent bootstrapping tablet: real 0.056s	user 0.013s	sys 0.007s
I20260709 13:05:18.576567 16706 leader_election.cc:290] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:18.573875 16397 raft_consensus.cc:359] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:18.577379 16397 raft_consensus.cc:385] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:18.577757 16397 raft_consensus.cc:740] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Initialized, Role: FOLLOWER
I20260709 13:05:18.578141 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c15d8e9be8414c84912ab77b66bfb1" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:05:18.578492 16398 raft_consensus.cc:359] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:18.578580 16397 consensus_queue.cc:260] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:18.579475 16398 raft_consensus.cc:385] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:18.579824 16398 raft_consensus.cc:740] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Initialized, Role: FOLLOWER
W20260709 13:05:18.580240 16248 leader_election.cc:343] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:18.580602 16398 consensus_queue.cc:260] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:18.583009 16398 ts_tablet_manager.cc:1434] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:05:18.584358 16398 tablet_bootstrap.cc:492] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f: Bootstrap starting.
I20260709 13:05:18.584609 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c15d8e9be8414c84912ab77b66bfb1" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:05:18.585460 16204 raft_consensus.cc:3060] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:18.591748 16397 ts_tablet_manager.cc:1434] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.000s
I20260709 13:05:18.593027 16397 tablet_bootstrap.cc:492] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3: Bootstrap starting.
I20260709 13:05:18.599048 16400 tablet_bootstrap.cc:492] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e: No bootstrap required, opened a new log
I20260709 13:05:18.600143 16400 ts_tablet_manager.cc:1403] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e: Time spent bootstrapping tablet: real 0.073s	user 0.018s	sys 0.020s
I20260709 13:05:18.600664 16397 tablet_bootstrap.cc:654] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:18.603307 16400 raft_consensus.cc:359] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:18.604139 16400 raft_consensus.cc:385] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:18.604465 16400 raft_consensus.cc:740] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Initialized, Role: FOLLOWER
I20260709 13:05:18.605180 16400 consensus_queue.cc:260] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:18.608212 16398 tablet_bootstrap.cc:654] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:18.608685 16400 ts_tablet_manager.cc:1434] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:05:18.614143 16400 tablet_bootstrap.cc:492] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e: Bootstrap starting.
I20260709 13:05:18.614236 16397 tablet_bootstrap.cc:492] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3: No bootstrap required, opened a new log
I20260709 13:05:18.615044 16397 ts_tablet_manager.cc:1403] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3: Time spent bootstrapping tablet: real 0.022s	user 0.016s	sys 0.003s
I20260709 13:05:18.617674 16397 raft_consensus.cc:359] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:18.618603 16397 raft_consensus.cc:385] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:18.618944 16397 raft_consensus.cc:740] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Initialized, Role: FOLLOWER
I20260709 13:05:18.619769 16397 consensus_queue.cc:260] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:18.620568 16400 tablet_bootstrap.cc:654] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:18.623613 16397 ts_tablet_manager.cc:1434] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:05:18.626219 16397 tablet_bootstrap.cc:492] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3: Bootstrap starting.
I20260709 13:05:18.634255 16397 tablet_bootstrap.cc:654] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:18.638147 16398 tablet_bootstrap.cc:492] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f: No bootstrap required, opened a new log
I20260709 13:05:18.638808 16398 ts_tablet_manager.cc:1403] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f: Time spent bootstrapping tablet: real 0.055s	user 0.017s	sys 0.000s
I20260709 13:05:18.639478 16742 raft_consensus.cc:493] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:18.640301 16742 raft_consensus.cc:515] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:18.646207 16742 leader_election.cc:290] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:18.647387 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:05:18.648833 16246 leader_election.cc:343] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:18.659417 16587 consensus_queue.cc:1048] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:18.663600 16398 raft_consensus.cc:359] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:18.664678 16398 raft_consensus.cc:385] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:18.665074 16398 raft_consensus.cc:740] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Initialized, Role: FOLLOWER
I20260709 13:05:18.666251 16398 consensus_queue.cc:260] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:18.669415 16398 ts_tablet_manager.cc:1434] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f: Time spent starting tablet: real 0.030s	user 0.008s	sys 0.000s
I20260709 13:05:18.670763 16397 tablet_bootstrap.cc:492] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3: No bootstrap required, opened a new log
I20260709 13:05:18.671267 16397 ts_tablet_manager.cc:1403] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3: Time spent bootstrapping tablet: real 0.045s	user 0.009s	sys 0.028s
I20260709 13:05:18.651038 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:18.673537 16355 raft_consensus.cc:2468] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 0.
I20260709 13:05:18.674621 16397 raft_consensus.cc:359] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:18.675330 16397 raft_consensus.cc:385] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:18.675586 16397 raft_consensus.cc:740] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Initialized, Role: FOLLOWER
I20260709 13:05:18.676247 16397 consensus_queue.cc:260] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:18.678390 16397 ts_tablet_manager.cc:1434] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:05:18.679296 16397 tablet_bootstrap.cc:492] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3: Bootstrap starting.
I20260709 13:05:18.684350 16248 leader_election.cc:304] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:18.685843 16397 tablet_bootstrap.cc:654] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:18.687848 16706 raft_consensus.cc:2804] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:18.688480 16706 raft_consensus.cc:493] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:18.689036 16706 raft_consensus.cc:3060] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:18.800562 16204 raft_consensus.cc:2468] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 1.
I20260709 13:05:18.807238 16398 tablet_bootstrap.cc:492] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f: Bootstrap starting.
I20260709 13:05:18.808920 16742 raft_consensus.cc:493] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:18.810119 16742 raft_consensus.cc:515] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:18.815115 16742 leader_election.cc:290] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:18.817466 16615 raft_consensus.cc:493] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:18.818169 16615 raft_consensus.cc:515] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:18.820449 16615 leader_election.cc:290] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:18.824457 16679 raft_consensus.cc:493] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:18.825013 16679 raft_consensus.cc:515] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:18.825555 16681 raft_consensus.cc:493] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:18.826133 16681 raft_consensus.cc:515] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:18.827310 16679 leader_election.cc:290] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:18.828259 16681 leader_election.cc:290] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:18.830027 16400 tablet_bootstrap.cc:492] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e: No bootstrap required, opened a new log
I20260709 13:05:18.830538 16400 ts_tablet_manager.cc:1403] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e: Time spent bootstrapping tablet: real 0.217s	user 0.060s	sys 0.071s
I20260709 13:05:18.835193 16400 raft_consensus.cc:359] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:18.835922 16400 raft_consensus.cc:385] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:18.836218 16400 raft_consensus.cc:740] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Initialized, Role: FOLLOWER
I20260709 13:05:18.836894 16400 consensus_queue.cc:260] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:18.838508 16400 ts_tablet_manager.cc:1434] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.000s
I20260709 13:05:18.839604 16400 tablet_bootstrap.cc:492] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e: Bootstrap starting.
I20260709 13:05:18.840610 16246 leader_election.cc:304] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 363bb2f744eb486f9ad726f08214c98e
I20260709 13:05:18.849349 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:18.850214 16208 raft_consensus.cc:2468] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 0.
I20260709 13:05:18.850660 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:18.851500 16397 tablet_bootstrap.cc:492] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3: No bootstrap required, opened a new log
I20260709 13:05:18.864856 16397 ts_tablet_manager.cc:1403] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3: Time spent bootstrapping tablet: real 0.186s	user 0.020s	sys 0.025s
I20260709 13:05:18.864742 16356 raft_consensus.cc:2468] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 0.
I20260709 13:05:18.866962 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:18.867928 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:18.855160 16706 raft_consensus.cc:515] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:18.857283 16703 raft_consensus.cc:2804] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:18.867689 16397 raft_consensus.cc:359] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:18.879348 16397 raft_consensus.cc:385] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:18.879415 16703 raft_consensus.cc:697] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:05:18.879666 16397 raft_consensus.cc:740] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Initialized, Role: FOLLOWER
I20260709 13:05:18.880383 16397 consensus_queue.cc:260] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:18.882534 16397 ts_tablet_manager.cc:1434] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.000s
I20260709 13:05:18.883587 16397 tablet_bootstrap.cc:492] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3: Bootstrap starting.
I20260709 13:05:18.869192 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:18.884676 16356 raft_consensus.cc:2468] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 0.
I20260709 13:05:18.854151 16400 tablet_bootstrap.cc:654] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:18.873520 16173 leader_election.cc:304] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:18.868579 16280 raft_consensus.cc:2468] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 0.
I20260709 13:05:18.869614 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:18.875984 16246 leader_election.cc:304] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:18.877441 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:18.889672 16398 tablet_bootstrap.cc:654] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:18.897330 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:18.896225 16173 leader_election.cc:304] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:18.904227 16279 raft_consensus.cc:2393] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 1: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:05:18.906423 16679 raft_consensus.cc:2804] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:18.907121 16679 raft_consensus.cc:493] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:18.907594 16679 raft_consensus.cc:3060] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:18.891381 16716 raft_consensus.cc:2804] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:18.899564 16276 raft_consensus.cc:2468] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 0.
I20260709 13:05:18.880375 16703 consensus_queue.cc:237] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:18.900547 16689 raft_consensus.cc:2804] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:18.919106 16716 raft_consensus.cc:493] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:18.910228 16587 consensus_queue.cc:1048] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.021s
I20260709 13:05:18.940090 16173 leader_election.cc:304] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:18.940821 16489 raft_consensus.cc:2804] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:18.941200 16489 raft_consensus.cc:493] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:18.941643 16489 raft_consensus.cc:3060] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:18.930279 16689 raft_consensus.cc:493] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:18.939560 16716 raft_consensus.cc:3060] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:18.939273 16675 raft_consensus.cc:493] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:18.941253 16590 raft_consensus.cc:493] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:18.947098 16689 raft_consensus.cc:3060] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:18.973623 16706 leader_election.cc:290] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:18.959895 16590 raft_consensus.cc:515] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:18.978164 16400 tablet_bootstrap.cc:492] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e: No bootstrap required, opened a new log
I20260709 13:05:18.979506 16400 ts_tablet_manager.cc:1403] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e: Time spent bootstrapping tablet: real 0.140s	user 0.021s	sys 0.013s
I20260709 13:05:18.956454 16675 raft_consensus.cc:515] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:18.985653 16679 raft_consensus.cc:515] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:19.028008 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
W20260709 13:05:19.039033 16173 leader_election.cc:343] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:19.039206 16590 leader_election.cc:290] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:19.044301 16400 raft_consensus.cc:359] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:19.045136 16400 raft_consensus.cc:385] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:19.045431 16400 raft_consensus.cc:740] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Initialized, Role: FOLLOWER
I20260709 13:05:19.047549 16400 consensus_queue.cc:260] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:19.049140 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:05:19.049823 16355 raft_consensus.cc:3060] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:19.051494 16398 tablet_bootstrap.cc:492] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f: No bootstrap required, opened a new log
I20260709 13:05:19.052011 16398 ts_tablet_manager.cc:1403] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f: Time spent bootstrapping tablet: real 0.245s	user 0.011s	sys 0.007s
I20260709 13:05:19.058967 16679 leader_election.cc:290] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:05:19.060787 16248 leader_election.cc:343] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:19.062083 16489 raft_consensus.cc:515] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:19.064411 16675 leader_election.cc:290] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:19.065131 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:05:19.064152 16489 leader_election.cc:290] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:19.066753 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:05:19.067397 16280 raft_consensus.cc:3060] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:19.069205 16689 raft_consensus.cc:515] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:19.070446 16279 raft_consensus.cc:2393] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 1: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:05:19.071036 16355 raft_consensus.cc:2468] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 1.
I20260709 13:05:19.078840 16706 consensus_queue.cc:1048] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:19.111044 16706 consensus_queue.cc:1048] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:05:19.117388 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:19.151214 16398 raft_consensus.cc:359] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:19.153481 16398 raft_consensus.cc:385] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:19.154464 16398 raft_consensus.cc:740] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Initialized, Role: FOLLOWER
I20260709 13:05:19.149329 16760 raft_consensus.cc:493] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:19.162322 16760 raft_consensus.cc:515] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:19.176193 16398 consensus_queue.cc:260] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:19.177454 16397 tablet_bootstrap.cc:700] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3: Time spent opening tablet: real 0.122s	user 0.007s	sys 0.002s
I20260709 13:05:19.184454 16397 tablet_bootstrap.cc:654] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:19.198215 16398 ts_tablet_manager.cc:1434] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f: Time spent starting tablet: real 0.146s	user 0.014s	sys 0.001s
I20260709 13:05:19.198530 16400 ts_tablet_manager.cc:1434] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e: Time spent starting tablet: real 0.219s	user 0.013s	sys 0.011s
I20260709 13:05:19.212983 16400 tablet_bootstrap.cc:492] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e: Bootstrap starting.
I20260709 13:05:19.227341 16398 tablet_bootstrap.cc:492] T 47342899f1ed4c788d60ea4c5b52969a P e10b16d536674c0bb350a31d7ce5ff7f: Bootstrap starting.
W20260709 13:05:19.228245 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 182665us
I20260709 13:05:19.233024 16248 leader_election.cc:304] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
W20260709 13:05:19.245851 16154 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:19.246658 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c15d8e9be8414c84912ab77b66bfb1" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:19.230654 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c15d8e9be8414c84912ab77b66bfb1" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:19.239234 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:05:19.250047 16207 raft_consensus.cc:2393] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 1: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:05:19.236436 16689 leader_election.cc:290] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:19.271021 16205 raft_consensus.cc:2393] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 1: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:05:19.271183 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:19.272009 16348 raft_consensus.cc:2468] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 0.
I20260709 13:05:19.275424 16770 raft_consensus.cc:2804] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:05:19.297004 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 63515.1us
I20260709 13:05:19.280776 16760 leader_election.cc:290] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:19.303376 16248 leader_election.cc:304] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:05:19.295574 16280 raft_consensus.cc:2468] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 1.
W20260709 13:05:19.295926 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 47073.7us
I20260709 13:05:19.317194 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:05:19.326167 16716 raft_consensus.cc:515] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:19.330412 16173 leader_election.cc:304] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
W20260709 13:05:19.321494 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 46518.9us
I20260709 13:05:19.308754 16742 raft_consensus.cc:2804] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:19.305008 16770 raft_consensus.cc:697] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:05:19.337497 16398 tablet_bootstrap.cc:654] T 47342899f1ed4c788d60ea4c5b52969a P e10b16d536674c0bb350a31d7ce5ff7f: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:19.330451 16203 raft_consensus.cc:2393] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 1: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:05:19.336591 16742 raft_consensus.cc:493] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:19.337095 16771 raft_consensus.cc:2804] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:05:19.357271 16768 log.cc:927] Time spent T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.097s	user 0.001s	sys 0.001s
I20260709 13:05:19.357735 16742 raft_consensus.cc:3060] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:19.357097 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
W20260709 13:05:19.392349 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 52407us
W20260709 13:05:19.393440 16248 leader_election.cc:343] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:19.382586 16766 raft_consensus.cc:493] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:19.399718 16173 leader_election.cc:343] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:19.381333 16320 leader_election.cc:304] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:19.403739 16400 tablet_bootstrap.cc:654] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:19.391342 16716 leader_election.cc:290] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:19.405740 16776 raft_consensus.cc:3060] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:19.401437 16173 leader_election.cc:304] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:05:19.407438 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:05:19.404736 16766 raft_consensus.cc:515] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:19.417075 16766 leader_election.cc:290] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:19.383919 16770 consensus_queue.cc:237] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:19.413261 16356 raft_consensus.cc:3060] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:19.409659 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:05:19.409508 16771 raft_consensus.cc:697] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 1 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:05:19.444048 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:05:19.444655 16246 leader_election.cc:343] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:19.446522 16246 leader_election.cc:304] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:19.447369 16689 raft_consensus.cc:2749] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:05:19.451122 16776 raft_consensus.cc:2749] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:19.451753 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:19.453495 16356 raft_consensus.cc:2468] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 1.
I20260709 13:05:19.455204 16587 consensus_queue.cc:1048] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:19.458513 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:05:19.459424 16355 raft_consensus.cc:2393] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 1: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
W20260709 13:05:19.460428 16320 leader_election.cc:343] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:19.467921 16173 leader_election.cc:304] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:05:19.487205 16742 raft_consensus.cc:515] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:19.493443 16397 tablet_bootstrap.cc:492] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3: No bootstrap required, opened a new log
I20260709 13:05:19.493994 16397 ts_tablet_manager.cc:1403] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3: Time spent bootstrapping tablet: real 0.611s	user 0.024s	sys 0.036s
I20260709 13:05:19.446378 16781 raft_consensus.cc:2749] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:05:19.499200 16757 raft_consensus.cc:2749] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:05:19.506273 16742 leader_election.cc:290] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:19.508736 16397 raft_consensus.cc:359] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:19.509713 16397 raft_consensus.cc:385] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:19.510094 16397 raft_consensus.cc:740] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Initialized, Role: FOLLOWER
W20260709 13:05:19.511787 16246 leader_election.cc:343] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:19.516273 16397 consensus_queue.cc:260] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:19.551575 16397 ts_tablet_manager.cc:1434] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3: Time spent starting tablet: real 0.057s	user 0.003s	sys 0.005s
I20260709 13:05:19.552131 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:05:19.552840 16206 raft_consensus.cc:3060] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:19.618858 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 52352.2us
I20260709 13:05:19.644256 16206 raft_consensus.cc:2468] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 1.
I20260709 13:05:19.650455 16398 tablet_bootstrap.cc:492] T 47342899f1ed4c788d60ea4c5b52969a P e10b16d536674c0bb350a31d7ce5ff7f: No bootstrap required, opened a new log
I20260709 13:05:19.651036 16398 ts_tablet_manager.cc:1403] T 47342899f1ed4c788d60ea4c5b52969a P e10b16d536674c0bb350a31d7ce5ff7f: Time spent bootstrapping tablet: real 0.435s	user 0.021s	sys 0.041s
I20260709 13:05:19.654655 16246 leader_election.cc:304] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:19.655501 16706 raft_consensus.cc:2804] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:19.656778 16788 consensus_queue.cc:1048] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:19.656019 16706 raft_consensus.cc:697] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:05:19.662950 16400 tablet_bootstrap.cc:492] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e: No bootstrap required, opened a new log
I20260709 13:05:19.663627 16400 ts_tablet_manager.cc:1403] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e: Time spent bootstrapping tablet: real 0.451s	user 0.021s	sys 0.032s
I20260709 13:05:19.663470 16706 consensus_queue.cc:237] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:19.540447 16771 consensus_queue.cc:237] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:19.670307 16398 raft_consensus.cc:359] T 47342899f1ed4c788d60ea4c5b52969a P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:19.671432 16398 raft_consensus.cc:385] T 47342899f1ed4c788d60ea4c5b52969a P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:19.671805 16398 raft_consensus.cc:740] T 47342899f1ed4c788d60ea4c5b52969a P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Initialized, Role: FOLLOWER
I20260709 13:05:19.675436 16400 raft_consensus.cc:359] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:19.676209 16400 raft_consensus.cc:385] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:19.676522 16400 raft_consensus.cc:740] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Initialized, Role: FOLLOWER
I20260709 13:05:19.677186 16400 consensus_queue.cc:260] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:19.680270 16400 ts_tablet_manager.cc:1434] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:05:19.696822 16398 consensus_queue.cc:260] T 47342899f1ed4c788d60ea4c5b52969a P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:19.708741 16398 ts_tablet_manager.cc:1434] T 47342899f1ed4c788d60ea4c5b52969a P e10b16d536674c0bb350a31d7ce5ff7f: Time spent starting tablet: real 0.057s	user 0.008s	sys 0.001s
I20260709 13:05:19.712759 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:19.716184 16599 raft_consensus.cc:493] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:19.716941 16599 raft_consensus.cc:515] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:19.722174 16599 leader_election.cc:290] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:19.724236 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:05:19.725968 16246 leader_election.cc:343] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:19.754321 16397 tablet_bootstrap.cc:492] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3: Bootstrap starting.
I20260709 13:05:19.758258 16398 tablet_bootstrap.cc:492] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f: Bootstrap starting.
I20260709 13:05:19.766330 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:19.771721 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:05:19.772395 16356 raft_consensus.cc:3060] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:19.713551 16348 raft_consensus.cc:2468] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 0.
W20260709 13:05:19.776028 16792 log.cc:927] Time spent T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 13:05:19.777843 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:05:19.778532 16248 leader_election.cc:343] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:19.778633 16282 raft_consensus.cc:2468] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 0.
I20260709 13:05:19.779189 16248 leader_election.cc:304] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:19.779960 16788 raft_consensus.cc:2749] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:19.782730 16356 raft_consensus.cc:2468] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 1.
I20260709 13:05:19.794116 16400 tablet_bootstrap.cc:492] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e: Bootstrap starting.
I20260709 13:05:19.784322 16590 consensus_queue.cc:1048] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.022s
I20260709 13:05:19.812493 16398 tablet_bootstrap.cc:654] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:19.820966 16397 tablet_bootstrap.cc:654] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:19.828650 16248 leader_election.cc:304] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:19.840955 16590 raft_consensus.cc:2804] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:19.855400 16590 raft_consensus.cc:493] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:19.855815 16590 raft_consensus.cc:3060] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:19.890285 16398 tablet_bootstrap.cc:492] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f: No bootstrap required, opened a new log
I20260709 13:05:19.890942 16398 ts_tablet_manager.cc:1403] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f: Time spent bootstrapping tablet: real 0.134s	user 0.017s	sys 0.013s
I20260709 13:05:19.891426 16106 catalog_manager.cc:5697] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66). New cstate: current_term: 1 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:19.902118 16322 leader_election.cc:304] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:19.904675 16761 raft_consensus.cc:2804] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:19.905138 16761 raft_consensus.cc:493] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:19.905483 16761 raft_consensus.cc:3060] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:19.910924 16767 consensus_queue.cc:1048] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:05:19.929076 16788 consensus_queue.cc:1048] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:19.932140 16590 raft_consensus.cc:515] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:19.929528 16400 tablet_bootstrap.cc:654] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:19.960953 16398 raft_consensus.cc:359] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:19.967542 16398 raft_consensus.cc:385] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:19.967952 16398 raft_consensus.cc:740] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Initialized, Role: FOLLOWER
I20260709 13:05:19.972012 16398 consensus_queue.cc:260] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:19.978677 16761 raft_consensus.cc:515] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:19.981689 16761 leader_election.cc:290] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:19.982791 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:05:19.987712 16202 raft_consensus.cc:3060] T 47342899f1ed4c788d60ea4c5b52969a P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:19.986310 16398 ts_tablet_manager.cc:1434] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f: Time spent starting tablet: real 0.095s	user 0.007s	sys 0.001s
I20260709 13:05:19.995533 16397 tablet_bootstrap.cc:492] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3: No bootstrap required, opened a new log
I20260709 13:05:19.996208 16397 ts_tablet_manager.cc:1403] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3: Time spent bootstrapping tablet: real 0.242s	user 0.018s	sys 0.020s
I20260709 13:05:19.997023 16398 tablet_bootstrap.cc:492] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f: Bootstrap starting.
I20260709 13:05:19.999567 16590 leader_election.cc:290] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:20.002393 16397 raft_consensus.cc:359] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:20.006826 16397 raft_consensus.cc:385] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:20.007171 16397 raft_consensus.cc:740] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Initialized, Role: FOLLOWER
I20260709 13:05:20.009711 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:05:20.010012 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:05:20.010731 16355 raft_consensus.cc:2393] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 1: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:05:20.010876 16276 raft_consensus.cc:2393] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 1: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:05:20.013187 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:05:20.015342 16248 leader_election.cc:304] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:20.016426 16760 raft_consensus.cc:2749] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:05:20.007833 16397 consensus_queue.cc:260] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:20.027231 16397 ts_tablet_manager.cc:1434] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.001s
I20260709 13:05:20.028385 16397 tablet_bootstrap.cc:492] T 0340758c689242c3979a434fa59589f7 P 0aea40d6e4374085a2e38a70a71f63e3: Bootstrap starting.
I20260709 13:05:20.032749 16400 tablet_bootstrap.cc:492] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e: No bootstrap required, opened a new log
I20260709 13:05:20.032575 16202 raft_consensus.cc:2468] T 47342899f1ed4c788d60ea4c5b52969a P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 1.
I20260709 13:05:20.033684 16400 ts_tablet_manager.cc:1403] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e: Time spent bootstrapping tablet: real 0.240s	user 0.013s	sys 0.007s
I20260709 13:05:20.033756 16590 raft_consensus.cc:493] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:20.034206 16320 leader_election.cc:304] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:05:20.034296 16590 raft_consensus.cc:515] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:20.035590 16777 raft_consensus.cc:2804] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:20.036085 16777 raft_consensus.cc:697] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 1 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:05:20.036545 16400 raft_consensus.cc:359] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:20.037161 16590 leader_election.cc:290] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:20.037321 16400 raft_consensus.cc:385] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:20.036933 16777 consensus_queue.cc:237] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:20.037658 16400 raft_consensus.cc:740] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Initialized, Role: FOLLOWER
I20260709 13:05:20.038329 16400 consensus_queue.cc:260] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:20.039304 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:20.039937 16357 raft_consensus.cc:2468] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 0.
I20260709 13:05:20.042496 16248 leader_election.cc:304] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:05:20.043562 16590 raft_consensus.cc:2804] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:20.043963 16590 raft_consensus.cc:493] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:20.044315 16590 raft_consensus.cc:3060] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:20.045037 16706 consensus_queue.cc:1048] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:20.046398 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:20.039964 16400 ts_tablet_manager.cc:1434] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:05:20.049871 16400 tablet_bootstrap.cc:492] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e: Bootstrap starting.
W20260709 13:05:20.049973 16246 leader_election.cc:343] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:20.054200 16398 tablet_bootstrap.cc:654] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:20.057830 16400 tablet_bootstrap.cc:654] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:20.067569 16590 raft_consensus.cc:515] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:20.074093 16590 leader_election.cc:290] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:20.079071 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:05:20.079128 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:05:20.080451 16357 raft_consensus.cc:3060] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:20.081063 16246 leader_election.cc:343] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:20.086079 16398 tablet_bootstrap.cc:492] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f: No bootstrap required, opened a new log
I20260709 13:05:20.086647 16398 ts_tablet_manager.cc:1403] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f: Time spent bootstrapping tablet: real 0.090s	user 0.022s	sys 0.003s
I20260709 13:05:20.088979 16398 raft_consensus.cc:359] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:20.089625 16398 raft_consensus.cc:385] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:20.089877 16398 raft_consensus.cc:740] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Initialized, Role: FOLLOWER
I20260709 13:05:20.089998 16357 raft_consensus.cc:2468] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 1.
I20260709 13:05:20.090651 16398 consensus_queue.cc:260] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:20.091605 16248 leader_election.cc:304] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:20.092983 16398 ts_tablet_manager.cc:1434] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:05:20.093286 16590 raft_consensus.cc:2804] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:20.094038 16590 raft_consensus.cc:697] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:05:20.095698 16590 consensus_queue.cc:237] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:20.098464 16397 tablet_bootstrap.cc:654] T 0340758c689242c3979a434fa59589f7 P 0aea40d6e4374085a2e38a70a71f63e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:20.101056 16398 tablet_bootstrap.cc:492] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f: Bootstrap starting.
I20260709 13:05:20.111208 16761 raft_consensus.cc:493] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:20.112515 16761 raft_consensus.cc:515] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:20.117293 16761 leader_election.cc:290] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:20.119045 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:20.119342 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:20.119938 16276 raft_consensus.cc:2393] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 1: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:05:20.120440 16205 raft_consensus.cc:2393] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 1: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:05:20.121845 16320 leader_election.cc:304] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:20.122735 16400 tablet_bootstrap.cc:492] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e: No bootstrap required, opened a new log
I20260709 13:05:20.123340 16400 ts_tablet_manager.cc:1403] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e: Time spent bootstrapping tablet: real 0.074s	user 0.016s	sys 0.025s
I20260709 13:05:20.122808 16765 consensus_queue.cc:1048] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:05:20.123890 16766 raft_consensus.cc:3060] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:20.128976 16765 raft_consensus.cc:493] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:20.129477 16765 raft_consensus.cc:515] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:20.131740 16765 leader_election.cc:290] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:20.128494 16400 raft_consensus.cc:359] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:20.134007 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:20.134310 16400 raft_consensus.cc:385] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:20.133776 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:20.134629 16400 raft_consensus.cc:740] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Initialized, Role: FOLLOWER
I20260709 13:05:20.134729 16276 raft_consensus.cc:2468] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 0.
I20260709 13:05:20.136207 16173 leader_election.cc:304] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:20.137037 16765 raft_consensus.cc:2804] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:20.138921 16766 raft_consensus.cc:2749] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:20.143970 16765 raft_consensus.cc:493] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:20.146219 16765 raft_consensus.cc:3060] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:20.146075 16103 catalog_manager.cc:5697] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f reported cstate change: term changed from 0 to 1, leader changed from <none> to e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65). New cstate: current_term: 1 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:20.150502 16398 tablet_bootstrap.cc:654] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:20.135376 16400 consensus_queue.cc:260] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:20.158917 16357 raft_consensus.cc:2468] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 0.
I20260709 13:05:20.165472 16765 raft_consensus.cc:515] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:20.162011 16400 ts_tablet_manager.cc:1434] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e: Time spent starting tablet: real 0.038s	user 0.007s	sys 0.000s
I20260709 13:05:20.166301 16771 consensus_queue.cc:1048] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:20.169384 16400 tablet_bootstrap.cc:492] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e: Bootstrap starting.
I20260709 13:05:20.173759 16590 consensus_queue.cc:1048] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:20.176266 16765 leader_election.cc:290] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:20.178333 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:05:20.178531 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:05:20.178951 16397 tablet_bootstrap.cc:492] T 0340758c689242c3979a434fa59589f7 P 0aea40d6e4374085a2e38a70a71f63e3: No bootstrap required, opened a new log
I20260709 13:05:20.179697 16357 raft_consensus.cc:3060] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:20.179905 16397 ts_tablet_manager.cc:1403] T 0340758c689242c3979a434fa59589f7 P 0aea40d6e4374085a2e38a70a71f63e3: Time spent bootstrapping tablet: real 0.152s	user 0.011s	sys 0.008s
I20260709 13:05:20.179052 16276 raft_consensus.cc:3060] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:20.189386 16106 catalog_manager.cc:5697] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66). New cstate: current_term: 1 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:20.190824 16397 raft_consensus.cc:359] T 0340758c689242c3979a434fa59589f7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:20.191700 16106 catalog_manager.cc:5697] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66). New cstate: current_term: 1 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:20.200731 16398 tablet_bootstrap.cc:492] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f: No bootstrap required, opened a new log
I20260709 13:05:20.201253 16398 ts_tablet_manager.cc:1403] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f: Time spent bootstrapping tablet: real 0.100s	user 0.008s	sys 0.007s
I20260709 13:05:20.202821 16106 catalog_manager.cc:5697] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66). New cstate: current_term: 1 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:20.205183 16590 consensus_queue.cc:1048] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:20.191766 16397 raft_consensus.cc:385] T 0340758c689242c3979a434fa59589f7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:20.210412 16397 raft_consensus.cc:740] T 0340758c689242c3979a434fa59589f7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Initialized, Role: FOLLOWER
I20260709 13:05:20.212785 16400 tablet_bootstrap.cc:654] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:20.213613 16397 consensus_queue.cc:260] T 0340758c689242c3979a434fa59589f7 P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:20.220043 16397 ts_tablet_manager.cc:1434] T 0340758c689242c3979a434fa59589f7 P 0aea40d6e4374085a2e38a70a71f63e3: Time spent starting tablet: real 0.040s	user 0.007s	sys 0.001s
I20260709 13:05:20.221133 16397 tablet_bootstrap.cc:492] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3: Bootstrap starting.
I20260709 13:05:20.214656 16276 raft_consensus.cc:2468] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 1.
I20260709 13:05:20.215195 16398 raft_consensus.cc:359] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:20.223863 16398 raft_consensus.cc:385] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:20.224184 16398 raft_consensus.cc:740] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Initialized, Role: FOLLOWER
I20260709 13:05:20.224859 16398 consensus_queue.cc:260] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:20.227561 16398 ts_tablet_manager.cc:1434] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f: Time spent starting tablet: real 0.026s	user 0.004s	sys 0.005s
I20260709 13:05:20.228176 16173 leader_election.cc:304] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:20.228627 16398 tablet_bootstrap.cc:492] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f: Bootstrap starting.
I20260709 13:05:20.229007 16771 raft_consensus.cc:2804] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:20.229511 16771 raft_consensus.cc:697] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 1 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:05:20.230379 16771 consensus_queue.cc:237] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:20.242892 16489 raft_consensus.cc:493] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:20.243814 16397 tablet_bootstrap.cc:654] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:20.243484 16489 raft_consensus.cc:515] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:20.245525 16489 leader_election.cc:290] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:20.251449 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:20.255591 16398 tablet_bootstrap.cc:654] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:20.255821 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:20.256724 16351 raft_consensus.cc:2393] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 1: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:05:20.258499 16173 leader_election.cc:304] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:05:20.260182 16357 raft_consensus.cc:2468] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 1.
I20260709 13:05:20.259354 16765 raft_consensus.cc:3060] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:20.278296 16103 catalog_manager.cc:5697] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e reported cstate change: term changed from 0 to 1, leader changed from <none> to 363bb2f744eb486f9ad726f08214c98e (127.14.180.67). New cstate: current_term: 1 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:20.291906 16398 tablet_bootstrap.cc:492] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f: No bootstrap required, opened a new log
I20260709 13:05:20.306035 16398 ts_tablet_manager.cc:1403] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f: Time spent bootstrapping tablet: real 0.078s	user 0.014s	sys 0.000s
I20260709 13:05:20.309170 16398 raft_consensus.cc:359] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:20.310003 16398 raft_consensus.cc:385] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:20.310307 16398 raft_consensus.cc:740] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Initialized, Role: FOLLOWER
I20260709 13:05:20.315518 16400 tablet_bootstrap.cc:492] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e: No bootstrap required, opened a new log
I20260709 13:05:20.316097 16400 ts_tablet_manager.cc:1403] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e: Time spent bootstrapping tablet: real 0.147s	user 0.016s	sys 0.009s
I20260709 13:05:20.318990 16400 raft_consensus.cc:359] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:20.319766 16400 raft_consensus.cc:385] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:20.320066 16400 raft_consensus.cc:740] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Initialized, Role: FOLLOWER
I20260709 13:05:20.320793 16400 consensus_queue.cc:260] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:20.304983 16765 raft_consensus.cc:2749] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:20.323212 16400 ts_tablet_manager.cc:1434] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:05:20.324450 16400 tablet_bootstrap.cc:492] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e: Bootstrap starting.
I20260709 13:05:20.320868 16398 consensus_queue.cc:260] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:20.332814 16397 tablet_bootstrap.cc:492] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3: No bootstrap required, opened a new log
I20260709 13:05:20.338469 16398 ts_tablet_manager.cc:1434] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
I20260709 13:05:20.339171 16400 tablet_bootstrap.cc:654] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:20.339286 16397 ts_tablet_manager.cc:1403] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3: Time spent bootstrapping tablet: real 0.118s	user 0.017s	sys 0.010s
I20260709 13:05:20.343099 16397 raft_consensus.cc:359] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:20.344203 16397 raft_consensus.cc:385] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:20.344594 16397 raft_consensus.cc:740] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Initialized, Role: FOLLOWER
I20260709 13:05:20.348345 16397 consensus_queue.cc:260] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:20.352037 16397 ts_tablet_manager.cc:1434] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.004s
I20260709 13:05:20.353194 16397 tablet_bootstrap.cc:492] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3: Bootstrap starting.
I20260709 13:05:20.374286 16400 tablet_bootstrap.cc:492] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e: No bootstrap required, opened a new log
I20260709 13:05:20.374981 16400 ts_tablet_manager.cc:1403] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e: Time spent bootstrapping tablet: real 0.051s	user 0.010s	sys 0.016s
I20260709 13:05:20.376896 16398 tablet_bootstrap.cc:492] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f: Bootstrap starting.
I20260709 13:05:20.387579 16400 raft_consensus.cc:359] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:20.388441 16400 raft_consensus.cc:385] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:20.388753 16400 raft_consensus.cc:740] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Initialized, Role: FOLLOWER
I20260709 13:05:20.389482 16400 consensus_queue.cc:260] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:20.392107 16400 ts_tablet_manager.cc:1434] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.001s
I20260709 13:05:20.392774 16397 tablet_bootstrap.cc:654] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:20.394711 16706 raft_consensus.cc:493] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:20.395277 16706 raft_consensus.cc:515] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:20.396476 16400 tablet_bootstrap.cc:492] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e: Bootstrap starting.
I20260709 13:05:20.398065 16706 leader_election.cc:290] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:20.398279 16102 catalog_manager.cc:5697] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f reported cstate change: term changed from 0 to 1, leader changed from <none> to e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65). New cstate: current_term: 1 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:20.408154 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:20.419013 16400 tablet_bootstrap.cc:654] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:20.418182 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:20.422298 16761 raft_consensus.cc:493] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:20.422888 16761 raft_consensus.cc:515] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:20.425863 16761 leader_election.cc:290] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:20.426424 16489 raft_consensus.cc:493] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:20.426919 16489 raft_consensus.cc:515] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:20.428824 16489 leader_election.cc:290] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:20.430648 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:05:20.432273 16320 leader_election.cc:343] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:20.434417 16489 raft_consensus.cc:493] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:20.434455 16154 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:20.435043 16489 raft_consensus.cc:515] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:05:20.437706 16248 leader_election.cc:343] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:20.438251 16489 leader_election.cc:290] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:05:20.449244 16246 leader_election.cc:343] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:20.449739 16246 leader_election.cc:304] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:20.450793 16760 raft_consensus.cc:2749] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:20.451233 16398 tablet_bootstrap.cc:654] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:20.451334 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:20.454284 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:20.455035 16351 raft_consensus.cc:2468] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 0.
I20260709 13:05:20.456789 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:05:20.456987 16173 leader_election.cc:343] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:20.463800 16398 tablet_bootstrap.cc:492] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f: No bootstrap required, opened a new log
I20260709 13:05:20.464347 16398 ts_tablet_manager.cc:1403] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f: Time spent bootstrapping tablet: real 0.088s	user 0.010s	sys 0.002s
I20260709 13:05:20.466049 16397 tablet_bootstrap.cc:492] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3: No bootstrap required, opened a new log
I20260709 13:05:20.466617 16397 ts_tablet_manager.cc:1403] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3: Time spent bootstrapping tablet: real 0.114s	user 0.014s	sys 0.016s
I20260709 13:05:20.467283 16398 raft_consensus.cc:359] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:20.468005 16398 raft_consensus.cc:385] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:20.468315 16398 raft_consensus.cc:740] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Initialized, Role: FOLLOWER
I20260709 13:05:20.469267 16398 consensus_queue.cc:260] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:20.471997 16398 ts_tablet_manager.cc:1434] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.003s
I20260709 13:05:20.473271 16398 tablet_bootstrap.cc:492] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f: Bootstrap starting.
W20260709 13:05:20.475004 16322 leader_election.cc:343] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:20.476511 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:20.476938 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:20.477341 16276 raft_consensus.cc:2468] T 0340758c689242c3979a434fa59589f7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 0.
I20260709 13:05:20.476541 16322 leader_election.cc:304] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:20.478935 16776 raft_consensus.cc:2749] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:05:20.481145 16173 leader_election.cc:343] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:20.479779 16398 tablet_bootstrap.cc:654] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:20.482357 16173 leader_election.cc:304] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 363bb2f744eb486f9ad726f08214c98e
I20260709 13:05:20.483367 16489 raft_consensus.cc:2804] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:20.483726 16489 raft_consensus.cc:493] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:20.484117 16489 raft_consensus.cc:3060] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:20.487604 16173 leader_election.cc:304] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:05:20.487520 16397 raft_consensus.cc:359] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:20.488386 16397 raft_consensus.cc:385] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:20.488590 16771 raft_consensus.cc:2804] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:20.488731 16397 raft_consensus.cc:740] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Initialized, Role: FOLLOWER
I20260709 13:05:20.489061 16771 raft_consensus.cc:493] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:20.489464 16771 raft_consensus.cc:3060] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:20.497548 16400 tablet_bootstrap.cc:492] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e: No bootstrap required, opened a new log
I20260709 13:05:20.499368 16400 ts_tablet_manager.cc:1403] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e: Time spent bootstrapping tablet: real 0.103s	user 0.015s	sys 0.006s
I20260709 13:05:20.502244 16400 raft_consensus.cc:359] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:20.502997 16400 raft_consensus.cc:385] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:20.503325 16400 raft_consensus.cc:740] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Initialized, Role: FOLLOWER
I20260709 13:05:20.489450 16397 consensus_queue.cc:260] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:20.504099 16400 consensus_queue.cc:260] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:20.505663 16397 ts_tablet_manager.cc:1434] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3: Time spent starting tablet: real 0.039s	user 0.006s	sys 0.000s
I20260709 13:05:20.506222 16400 ts_tablet_manager.cc:1434] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:05:20.506578 16397 tablet_bootstrap.cc:492] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3: Bootstrap starting.
I20260709 13:05:20.506800 16489 raft_consensus.cc:515] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:20.502513 16771 raft_consensus.cc:515] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:20.512147 16489 leader_election.cc:290] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:20.512502 16771 leader_election.cc:290] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:20.512403 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:05:20.513154 16276 raft_consensus.cc:3060] T 0340758c689242c3979a434fa59589f7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:20.513399 16400 tablet_bootstrap.cc:492] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e: Bootstrap starting.
I20260709 13:05:20.515969 16397 tablet_bootstrap.cc:654] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:20.521798 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
W20260709 13:05:20.523530 16173 leader_election.cc:343] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:20.525597 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:05:20.526257 16357 raft_consensus.cc:3060] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:20.528226 16276 raft_consensus.cc:2468] T 0340758c689242c3979a434fa59589f7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 1.
I20260709 13:05:20.529158 16397 tablet_bootstrap.cc:492] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3: No bootstrap required, opened a new log
I20260709 13:05:20.529358 16173 leader_election.cc:304] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:20.529651 16397 ts_tablet_manager.cc:1403] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.004s
I20260709 13:05:20.530483 16489 raft_consensus.cc:2804] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:20.530990 16489 raft_consensus.cc:697] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:05:20.532298 16489 consensus_queue.cc:237] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:20.532645 16397 raft_consensus.cc:359] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:20.533294 16397 raft_consensus.cc:385] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:20.533560 16397 raft_consensus.cc:740] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Initialized, Role: FOLLOWER
I20260709 13:05:20.535804 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:05:20.535805 16397 consensus_queue.cc:260] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:20.536823 16351 raft_consensus.cc:3060] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:20.538327 16397 ts_tablet_manager.cc:1434] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3: Time spent starting tablet: real 0.008s	user 0.001s	sys 0.008s
I20260709 13:05:20.539819 16397 tablet_bootstrap.cc:492] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3: Bootstrap starting.
I20260709 13:05:20.544821 16357 raft_consensus.cc:2468] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 1.
I20260709 13:05:20.556404 16400 tablet_bootstrap.cc:654] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:20.561256 16397 tablet_bootstrap.cc:654] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:20.589723 16351 raft_consensus.cc:2468] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 1.
I20260709 13:05:20.591454 16173 leader_election.cc:304] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:05:20.592873 16771 raft_consensus.cc:2804] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:20.593427 16771 raft_consensus.cc:697] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:05:20.602872 16771 consensus_queue.cc:237] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:20.606395 16398 tablet_bootstrap.cc:492] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f: No bootstrap required, opened a new log
I20260709 13:05:20.607074 16398 ts_tablet_manager.cc:1403] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f: Time spent bootstrapping tablet: real 0.134s	user 0.024s	sys 0.012s
I20260709 13:05:20.610638 16102 catalog_manager.cc:5697] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f reported cstate change: term changed from 0 to 1, leader changed from <none> to e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65). New cstate: current_term: 1 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:20.616648 16398 raft_consensus.cc:359] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:20.617408 16398 raft_consensus.cc:385] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:20.617686 16398 raft_consensus.cc:740] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Initialized, Role: FOLLOWER
I20260709 13:05:20.618687 16398 consensus_queue.cc:260] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:20.620867 16398 ts_tablet_manager.cc:1434] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:05:20.621795 16400 tablet_bootstrap.cc:492] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e: No bootstrap required, opened a new log
I20260709 13:05:20.621924 16398 tablet_bootstrap.cc:492] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f: Bootstrap starting.
I20260709 13:05:20.622309 16400 ts_tablet_manager.cc:1403] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e: Time spent bootstrapping tablet: real 0.109s	user 0.010s	sys 0.005s
I20260709 13:05:20.624500 16397 tablet_bootstrap.cc:492] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3: No bootstrap required, opened a new log
I20260709 13:05:20.624961 16397 ts_tablet_manager.cc:1403] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3: Time spent bootstrapping tablet: real 0.085s	user 0.009s	sys 0.002s
I20260709 13:05:20.624759 16400 raft_consensus.cc:359] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:20.625348 16400 raft_consensus.cc:385] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:20.625598 16400 raft_consensus.cc:740] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Initialized, Role: FOLLOWER
I20260709 13:05:20.627274 16400 consensus_queue.cc:260] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:20.627671 16397 raft_consensus.cc:359] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:20.628391 16397 raft_consensus.cc:385] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:20.628670 16397 raft_consensus.cc:740] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Initialized, Role: FOLLOWER
I20260709 13:05:20.629357 16397 consensus_queue.cc:260] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:20.629796 16400 ts_tablet_manager.cc:1434] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.001s
I20260709 13:05:20.631151 16761 consensus_queue.cc:1048] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:20.640410 16105 catalog_manager.cc:5697] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f reported cstate change: term changed from 0 to 1, leader changed from <none> to e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65). New cstate: current_term: 1 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:20.631510 16397 ts_tablet_manager.cc:1434] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.004s
I20260709 13:05:20.643093 16397 tablet_bootstrap.cc:492] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3: Bootstrap starting.
I20260709 13:05:20.645401 16706 consensus_queue.cc:1048] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:20.641896 16398 tablet_bootstrap.cc:654] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:20.650239 16761 raft_consensus.cc:493] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:20.650812 16761 raft_consensus.cc:515] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:20.654217 16397 tablet_bootstrap.cc:654] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:20.653932 16761 leader_election.cc:290] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:20.657013 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:20.657703 16277 raft_consensus.cc:2468] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 0.
I20260709 13:05:20.659933 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:20.660804 16208 raft_consensus.cc:2468] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 0.
I20260709 13:05:20.656070 16400 tablet_bootstrap.cc:492] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e: Bootstrap starting.
I20260709 13:05:20.664953 16320 leader_election.cc:304] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:20.667505 16776 raft_consensus.cc:2804] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:20.667918 16776 raft_consensus.cc:493] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:20.668323 16776 raft_consensus.cc:3060] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:20.668195 16767 consensus_queue.cc:1048] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:20.669833 16400 tablet_bootstrap.cc:654] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:20.664813 16706 consensus_queue.cc:1048] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:20.694630 16776 raft_consensus.cc:515] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:20.733942 16776 leader_election.cc:290] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:20.734798 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:05:20.735440 16201 raft_consensus.cc:3060] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:20.735947 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:05:20.736867 16276 raft_consensus.cc:3060] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:05:20.745316 16834 log.cc:927] Time spent T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 13:05:20.742676 16615 consensus_queue.cc:1048] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.029s
I20260709 13:05:20.774336 16838 raft_consensus.cc:493] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:20.774923 16838 raft_consensus.cc:515] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:20.819056 16765 raft_consensus.cc:493] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:20.819803 16765 raft_consensus.cc:515] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:20.830703 16765 leader_election.cc:290] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:20.833180 16398 tablet_bootstrap.cc:492] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f: No bootstrap required, opened a new log
I20260709 13:05:20.833740 16398 ts_tablet_manager.cc:1403] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f: Time spent bootstrapping tablet: real 0.212s	user 0.022s	sys 0.025s
I20260709 13:05:20.833729 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:20.852156 16351 raft_consensus.cc:2468] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 0.
I20260709 13:05:20.854957 16173 leader_election.cc:304] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:20.856957 16489 raft_consensus.cc:2804] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:20.857357 16489 raft_consensus.cc:493] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:20.857676 16489 raft_consensus.cc:3060] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:20.863111 16398 raft_consensus.cc:359] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:20.864537 16398 raft_consensus.cc:385] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:20.864939 16398 raft_consensus.cc:740] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Initialized, Role: FOLLOWER
W20260709 13:05:20.872656 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 161760us
I20260709 13:05:20.874487 16398 consensus_queue.cc:260] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:20.878208 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:20.889729 16279 raft_consensus.cc:2468] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 0.
I20260709 13:05:20.907398 16599 raft_consensus.cc:493] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:20.941484 16489 raft_consensus.cc:515] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:20.940440 16838 leader_election.cc:290] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:20.955440 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:20.956238 16202 raft_consensus.cc:2468] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 0.
W20260709 13:05:20.965384 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 84810.9us
I20260709 13:05:20.994807 16400 tablet_bootstrap.cc:492] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e: No bootstrap required, opened a new log
I20260709 13:05:21.015708 16398 ts_tablet_manager.cc:1434] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f: Time spent starting tablet: real 0.180s	user 0.004s	sys 0.012s
I20260709 13:05:21.018873 16400 ts_tablet_manager.cc:1403] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e: Time spent bootstrapping tablet: real 0.363s	user 0.020s	sys 0.011s
I20260709 13:05:20.946579 16599 raft_consensus.cc:515] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:21.034623 16398 tablet_bootstrap.cc:492] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f: Bootstrap starting.
W20260709 13:05:20.996147 16844 log.cc:927] Time spent T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
W20260709 13:05:21.028739 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 154514us
I20260709 13:05:21.037900 16599 leader_election.cc:290] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:21.046265 16276 raft_consensus.cc:2468] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 1.
I20260709 13:05:21.054796 16201 raft_consensus.cc:2468] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 1.
W20260709 13:05:21.081998 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 57085us
I20260709 13:05:21.090128 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:05:21.095376 16277 raft_consensus.cc:3060] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:21.102785 16397 tablet_bootstrap.cc:492] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3: No bootstrap required, opened a new log
I20260709 13:05:21.103276 16397 ts_tablet_manager.cc:1403] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3: Time spent bootstrapping tablet: real 0.460s	user 0.015s	sys 0.012s
I20260709 13:05:21.104351 16489 leader_election.cc:290] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:21.102505 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:21.097462 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:21.106339 16400 raft_consensus.cc:359] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:21.113582 16320 leader_election.cc:304] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:21.113886 16400 raft_consensus.cc:385] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:21.114302 16400 raft_consensus.cc:740] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Initialized, Role: FOLLOWER
I20260709 13:05:21.115195 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:21.115085 16400 consensus_queue.cc:260] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:21.116408 16354 raft_consensus.cc:2393] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 1: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:05:21.117301 16246 leader_election.cc:304] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:21.118497 16397 raft_consensus.cc:359] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:21.118986 16760 raft_consensus.cc:2804] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:21.119302 16397 raft_consensus.cc:385] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:21.119364 16760 raft_consensus.cc:493] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:21.119658 16397 raft_consensus.cc:740] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Initialized, Role: FOLLOWER
I20260709 13:05:21.119796 16760 raft_consensus.cc:3060] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:21.120432 16397 consensus_queue.cc:260] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:21.122088 16397 ts_tablet_manager.cc:1434] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3: Time spent starting tablet: real 0.019s	user 0.000s	sys 0.003s
W20260709 13:05:21.130745 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 46908.5us
I20260709 13:05:21.139585 16400 ts_tablet_manager.cc:1434] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e: Time spent starting tablet: real 0.120s	user 0.004s	sys 0.004s
I20260709 13:05:21.147194 16489 consensus_queue.cc:1048] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:05:21.147821 16400 tablet_bootstrap.cc:492] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e: Bootstrap starting.
I20260709 13:05:21.143656 16761 raft_consensus.cc:2804] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:21.187544 16397 tablet_bootstrap.cc:492] T fd0c3c592b464aafaf1d0b94d1e6e360 P 0aea40d6e4374085a2e38a70a71f63e3: Bootstrap starting.
I20260709 13:05:21.197587 16398 tablet_bootstrap.cc:654] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:21.185125 16760 raft_consensus.cc:515] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:21.241958 16760 leader_election.cc:290] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:05:21.249519 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 61132.8us
W20260709 13:05:21.252915 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 71854.8us
W20260709 13:05:21.258491 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 70558.5us
I20260709 13:05:21.256273 16277 raft_consensus.cc:2468] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 1.
I20260709 13:05:21.258071 16761 raft_consensus.cc:697] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 1 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:05:21.263775 16761 consensus_queue.cc:237] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:21.266772 16173 leader_election.cc:304] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:21.267575 16855 raft_consensus.cc:2804] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:21.268062 16855 raft_consensus.cc:697] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 1 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:05:21.268953 16855 consensus_queue.cc:237] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:05:21.348312 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 83912.3us
I20260709 13:05:21.329733 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:05:21.353045 16206 raft_consensus.cc:3060] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:21.351171 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:05:21.357254 16353 raft_consensus.cc:3060] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:21.362432 16397 tablet_bootstrap.cc:654] T fd0c3c592b464aafaf1d0b94d1e6e360 P 0aea40d6e4374085a2e38a70a71f63e3: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:21.270097 16281 raft_consensus.cc:3060] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:21.372413 16206 raft_consensus.cc:2468] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 1.
I20260709 13:05:21.376088 16246 leader_election.cc:304] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:21.377846 16854 raft_consensus.cc:2804] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:21.378528 16854 raft_consensus.cc:697] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:05:21.379510 16854 consensus_queue.cc:237] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:05:21.383514 16248 leader_election.cc:343] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:21.384527 16248 leader_election.cc:304] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:21.398578 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:05:21.405292 16398 tablet_bootstrap.cc:492] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f: No bootstrap required, opened a new log
I20260709 13:05:21.405844 16398 ts_tablet_manager.cc:1403] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f: Time spent bootstrapping tablet: real 0.379s	user 0.021s	sys 0.006s
I20260709 13:05:21.406313 16771 consensus_queue.cc:1048] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:05:21.409931 16398 raft_consensus.cc:359] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:21.410827 16398 raft_consensus.cc:385] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:21.411389 16398 raft_consensus.cc:740] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Initialized, Role: FOLLOWER
I20260709 13:05:21.412009 16398 consensus_queue.cc:260] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:21.425181 16102 catalog_manager.cc:5697] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e reported cstate change: term changed from 0 to 1, leader changed from <none> to 363bb2f744eb486f9ad726f08214c98e (127.14.180.67). New cstate: current_term: 1 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:21.427659 16855 consensus_queue.cc:1048] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:21.458590 16398 ts_tablet_manager.cc:1434] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f: Time spent starting tablet: real 0.052s	user 0.006s	sys 0.003s
I20260709 13:05:21.470105 16398 tablet_bootstrap.cc:492] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f: Bootstrap starting.
I20260709 13:05:21.468071 16838 raft_consensus.cc:493] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:21.467944 16860 raft_consensus.cc:493] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:21.479987 16860 raft_consensus.cc:515] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:21.492549 16105 catalog_manager.cc:5697] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f reported cstate change: term changed from 0 to 1, leader changed from <none> to e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65). New cstate: current_term: 1 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:21.473747 16838 raft_consensus.cc:515] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:21.505414 16397 tablet_bootstrap.cc:492] T fd0c3c592b464aafaf1d0b94d1e6e360 P 0aea40d6e4374085a2e38a70a71f63e3: No bootstrap required, opened a new log
I20260709 13:05:21.505959 16397 ts_tablet_manager.cc:1403] T fd0c3c592b464aafaf1d0b94d1e6e360 P 0aea40d6e4374085a2e38a70a71f63e3: Time spent bootstrapping tablet: real 0.328s	user 0.020s	sys 0.005s
I20260709 13:05:21.508351 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:21.509267 16275 raft_consensus.cc:2468] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 1.
I20260709 13:05:21.511123 16400 tablet_bootstrap.cc:654] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:21.512590 16173 leader_election.cc:304] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
W20260709 13:05:21.527006 16154 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:05:21.498759 16860 leader_election.cc:290] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:21.524555 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:05:21.533617 16248 leader_election.cc:343] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:21.539017 16353 raft_consensus.cc:2468] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 1.
I20260709 13:05:21.514528 16615 raft_consensus.cc:2804] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:21.540035 16615 raft_consensus.cc:493] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:21.540417 16615 raft_consensus.cc:3060] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:21.559007 16400 tablet_bootstrap.cc:492] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e: No bootstrap required, opened a new log
I20260709 13:05:21.559585 16400 ts_tablet_manager.cc:1403] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e: Time spent bootstrapping tablet: real 0.412s	user 0.024s	sys 0.004s
I20260709 13:05:21.562991 16400 raft_consensus.cc:359] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:21.563735 16400 raft_consensus.cc:385] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:21.564038 16400 raft_consensus.cc:740] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Initialized, Role: FOLLOWER
I20260709 13:05:21.564814 16400 consensus_queue.cc:260] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:21.567744 16400 ts_tablet_manager.cc:1434] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:05:21.576167 16847 consensus_queue.cc:1048] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:21.577231 16838 leader_election.cc:290] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:21.551016 16859 raft_consensus.cc:2749] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:05:21.541731 16355 raft_consensus.cc:2468] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 1.
I20260709 13:05:21.600541 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:21.601290 16351 raft_consensus.cc:2468] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 0.
I20260709 13:05:21.607378 16761 raft_consensus.cc:493] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:21.607549 16615 raft_consensus.cc:515] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:21.607990 16761 raft_consensus.cc:515] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:21.610021 16761 leader_election.cc:290] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:21.611338 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:21.612282 16205 raft_consensus.cc:2468] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 0.
I20260709 13:05:21.645226 16106 catalog_manager.cc:5697] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66). New cstate: current_term: 1 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } }
W20260709 13:05:21.663484 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 69703.5us
I20260709 13:05:21.683571 16615 leader_election.cc:290] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 2 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:21.686918 16397 raft_consensus.cc:359] T fd0c3c592b464aafaf1d0b94d1e6e360 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:21.688055 16397 raft_consensus.cc:385] T fd0c3c592b464aafaf1d0b94d1e6e360 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:21.688401 16397 raft_consensus.cc:740] T fd0c3c592b464aafaf1d0b94d1e6e360 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Initialized, Role: FOLLOWER
I20260709 13:05:21.689121 16397 consensus_queue.cc:260] T fd0c3c592b464aafaf1d0b94d1e6e360 P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:21.693967 16397 ts_tablet_manager.cc:1434] T fd0c3c592b464aafaf1d0b94d1e6e360 P 0aea40d6e4374085a2e38a70a71f63e3: Time spent starting tablet: real 0.188s	user 0.024s	sys 0.012s
I20260709 13:05:21.678224 16851 consensus_queue.cc:1048] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.024s
I20260709 13:05:21.715744 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:05:21.720501 16320 leader_election.cc:343] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:05:21.723085 16398 tablet_bootstrap.cc:654] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:21.723503 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:05:21.724196 16279 raft_consensus.cc:3060] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:21.728878 16400 tablet_bootstrap.cc:492] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e: Bootstrap starting.
I20260709 13:05:21.731796 16279 raft_consensus.cc:2468] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 2.
I20260709 13:05:21.741758 16246 leader_election.cc:304] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:21.745702 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:21.746652 16276 raft_consensus.cc:2468] T fd0c3c592b464aafaf1d0b94d1e6e360 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 0.
I20260709 13:05:21.748674 16400 tablet_bootstrap.cc:654] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e: Neither blocks nor log segments found. Creating new log.
I20260709 13:05:21.765848 16173 leader_election.cc:304] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:21.766633 16615 raft_consensus.cc:2804] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:21.766974 16400 tablet_bootstrap.cc:492] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e: No bootstrap required, opened a new log
I20260709 13:05:21.767493 16400 ts_tablet_manager.cc:1403] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e: Time spent bootstrapping tablet: real 0.039s	user 0.016s	sys 0.000s
I20260709 13:05:21.769932 16398 tablet_bootstrap.cc:492] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f: No bootstrap required, opened a new log
I20260709 13:05:21.770424 16398 ts_tablet_manager.cc:1403] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f: Time spent bootstrapping tablet: real 0.304s	user 0.022s	sys 0.003s
I20260709 13:05:21.771848 16839 raft_consensus.cc:2804] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:21.771709 16400 raft_consensus.cc:359] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:21.765410 16322 leader_election.cc:304] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:21.772238 16839 raft_consensus.cc:493] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:21.772475 16400 raft_consensus.cc:385] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:21.772657 16839 raft_consensus.cc:3060] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:21.772784 16400 raft_consensus.cc:740] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Initialized, Role: FOLLOWER
I20260709 13:05:21.773440 16862 raft_consensus.cc:2804] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:05:21.773916 16862 raft_consensus.cc:493] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:21.773620 16400 consensus_queue.cc:260] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:21.774222 16862 raft_consensus.cc:3060] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:21.775329 16400 ts_tablet_manager.cc:1434] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.002s
I20260709 13:05:21.780371 16839 raft_consensus.cc:515] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:21.781651 16615 raft_consensus.cc:697] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 2 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:05:21.782450 16839 leader_election.cc:290] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:21.782588 16615 consensus_queue.cc:237] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:21.782833 16398 raft_consensus.cc:359] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:21.783560 16398 raft_consensus.cc:385] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:05:21.783864 16398 raft_consensus.cc:740] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Initialized, Role: FOLLOWER
I20260709 13:05:21.784533 16398 consensus_queue.cc:260] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:21.786765 16398 ts_tablet_manager.cc:1434] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:05:21.791041 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:05:21.791823 16205 raft_consensus.cc:3060] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:21.802970 16205 raft_consensus.cc:2468] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 1.
I20260709 13:05:21.803537 16862 raft_consensus.cc:515] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:21.808312 16246 leader_election.cc:304] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:21.809087 16859 raft_consensus.cc:2804] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:21.809741 16859 raft_consensus.cc:697] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:05:21.810622 16859 consensus_queue.cc:237] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:21.811866 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:05:21.812561 16205 raft_consensus.cc:3060] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:21.814496 16862 leader_election.cc:290] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:21.822744 16862 consensus_queue.cc:1048] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:21.825567 16205 raft_consensus.cc:2468] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 1.
I20260709 13:05:21.828848 16320 leader_election.cc:304] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:21.829627 16859 consensus_queue.cc:1048] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:21.831216 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:05:21.832242 16351 raft_consensus.cc:3060] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:21.838765 16761 raft_consensus.cc:2804] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:05:21.839366 16761 raft_consensus.cc:697] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 1 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:05:21.840276 16761 consensus_queue.cc:237] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:21.841671 16351 raft_consensus.cc:2468] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 2.
I20260709 13:05:21.852859 16615 consensus_queue.cc:1048] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:21.866933 16102 catalog_manager.cc:5697] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66). New cstate: current_term: 1 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:21.869110 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:05:21.869755 16353 raft_consensus.cc:3060] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:21.877362 16353 raft_consensus.cc:2468] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 1.
I20260709 13:05:21.888032 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:05:21.888754 16276 raft_consensus.cc:3060] T fd0c3c592b464aafaf1d0b94d1e6e360 P 0aea40d6e4374085a2e38a70a71f63e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:21.901594 16851 consensus_queue.cc:1048] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:21.905272 16276 raft_consensus.cc:2468] T fd0c3c592b464aafaf1d0b94d1e6e360 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 1.
I20260709 13:05:21.916383 16853 consensus_queue.cc:1048] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:21.918586 16353 raft_consensus.cc:3060] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:05:21.918816 16106 catalog_manager.cc:5697] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e reported cstate change: term changed from 0 to 1, leader changed from <none> to 363bb2f744eb486f9ad726f08214c98e (127.14.180.67). New cstate: current_term: 1 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:21.945003 16776 raft_consensus.cc:493] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:21.944764 16875 consensus_queue.cc:1048] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:05:21.945596 16776 raft_consensus.cc:515] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:21.948006 16776 leader_election.cc:290] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:21.948619 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:21.948808 16105 catalog_manager.cc:5697] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f reported cstate change: term changed from 0 to 2, leader changed from <none> to e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65). New cstate: current_term: 2 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:21.961324 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:21.963696 16322 leader_election.cc:304] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:21.995545 16862 raft_consensus.cc:2749] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:22.191223 16875 consensus_queue.cc:1048] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:22.202907 16875 consensus_queue.cc:1048] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:05:22.310879 16353 raft_consensus.cc:1275] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:05:22.312441 16851 consensus_queue.cc:1048] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:22.322907 16280 raft_consensus.cc:1275] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:05:22.325145 16851 consensus_queue.cc:1048] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:22.337535 16862 consensus_queue.cc:1048] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:22.365366 16853 consensus_queue.cc:1048] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:05:22.635211 15057 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:05:22.665007 16903 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:22.665386 16904 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:05:22.665870 16906 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:05:22.666842 15057 server_base.cc:1061] running on GCE node
I20260709 13:05:22.670466 15057 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:05:22.670812 15057 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:05:22.671051 15057 hybrid_clock.cc:648] HybridClock initialized: now 1783602322671023 us; error 0 us; skew 500 ppm
I20260709 13:05:22.671594 15057 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:05:22.674391 15057 webserver.cc:533] Webserver started at http://127.14.180.68:45117/ using document root <none> and password file <none>
I20260709 13:05:22.674979 15057 fs_manager.cc:362] Metadata directory not provided
I20260709 13:05:22.675220 15057 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:05:22.675573 15057 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:05:22.676831 15057 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602283040513-15057-0/minicluster-data/ts-3-root/instance:
uuid: "1109f76a0b7b443a84c0327c8707bc63"
format_stamp: "Formatted at 2026-07-09 13:05:22 on dist-test-slave-r9m8"
I20260709 13:05:22.687201 15057 fs_manager.cc:696] Time spent creating directory manager: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:05:22.692490 16911 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:22.693465 15057 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 13:05:22.693894 15057 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602283040513-15057-0/minicluster-data/ts-3-root
uuid: "1109f76a0b7b443a84c0327c8707bc63"
format_stamp: "Formatted at 2026-07-09 13:05:22 on dist-test-slave-r9m8"
I20260709 13:05:22.694283 15057 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602283040513-15057-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602283040513-15057-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602283040513-15057-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:05:22.720258 15057 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:05:22.721982 15057 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:05:22.723647 15057 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:05:22.726845 15057 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:05:22.727134 15057 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:05:22.727463 15057 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:05:22.727756 15057 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:05:22.830380 15057 rpc_server.cc:307] RPC server started. Bound to: 127.14.180.68:36875
I20260709 13:05:22.830484 16973 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.180.68:36875 every 8 connection(s)
I20260709 13:05:22.836683 15057 auto_leader_rebalancer-test.cc:384] add a tserver: 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:05:22.856170 16974 heartbeater.cc:344] Connected to a master server at 127.14.180.126:35965
I20260709 13:05:22.856837 16974 heartbeater.cc:461] Registering TS with master...
I20260709 13:05:22.857681 16974 heartbeater.cc:507] Master 127.14.180.126:35965 requested a full tablet report, sending...
I20260709 13:05:22.859967 16102 ts_manager.cc:194] Registered new tserver with Master: 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:05:22.862241 16102 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55244
I20260709 13:05:23.865270 16974 heartbeater.cc:499] Master 127.14.180.126:35965 was elected leader, sending a full tablet report...
I20260709 13:05:23.885963 16206 consensus_queue.cc:237] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:05:23.896190 16353 raft_consensus.cc:1275] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:23.898887 16276 raft_consensus.cc:1275] T 1356ff4c060346359eb10723422e972a P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:23.901690 16987 consensus_queue.cc:1048] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:23.903829 16979 consensus_queue.cc:1048] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:05:23.913949 16173 consensus_peers.cc:597] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f -> Peer 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875): Couldn't send request to peer 1109f76a0b7b443a84c0327c8707bc63. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1356ff4c060346359eb10723422e972a. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:23.913816 16987 raft_consensus.cc:2955] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:05:23.915860 16276 raft_consensus.cc:2955] T 1356ff4c060346359eb10723422e972a P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:05:23.921527 16353 raft_consensus.cc:2955] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:05:23.937485 16102 catalog_manager.cc:5697] T 1356ff4c060346359eb10723422e972a P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: config changed from index -1 to 2, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New cstate: current_term: 1 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:05:23.938891 16206 consensus_queue.cc:237] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
W20260709 13:05:23.957494 16173 consensus_peers.cc:597] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f -> Peer 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875): Couldn't send request to peer 1109f76a0b7b443a84c0327c8707bc63. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8b615ac918a749989f2968826926adf3. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:23.958287 16279 raft_consensus.cc:1275] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:23.959436 16353 raft_consensus.cc:1275] T 8b615ac918a749989f2968826926adf3 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:23.961089 16847 consensus_queue.cc:1048] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:23.962608 16986 consensus_queue.cc:1048] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:23.973754 16847 raft_consensus.cc:2955] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:05:23.984107 16353 raft_consensus.cc:2955] T 8b615ac918a749989f2968826926adf3 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:05:23.990290 16276 raft_consensus.cc:2955] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:05:24.011240 16105 catalog_manager.cc:5697] T 8b615ac918a749989f2968826926adf3 P 363bb2f744eb486f9ad726f08214c98e reported cstate change: config changed from index -1 to 2, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New cstate: current_term: 1 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:05:24.034310 16349 consensus_queue.cc:237] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:05:24.044893 16206 raft_consensus.cc:1275] T 862e96f5785248c58d0355cac229fc05 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:24.049634 16279 raft_consensus.cc:1275] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:24.051419 16852 consensus_queue.cc:1048] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:24.052956 16853 consensus_queue.cc:1048] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:05:24.058465 16322 consensus_peers.cc:597] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e -> Peer 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875): Couldn't send request to peer 1109f76a0b7b443a84c0327c8707bc63. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 862e96f5785248c58d0355cac229fc05. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:24.066757 16983 raft_consensus.cc:2955] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:05:24.068620 16207 raft_consensus.cc:2955] T 862e96f5785248c58d0355cac229fc05 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:05:24.069036 16279 raft_consensus.cc:2955] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:05:24.102345 16102 catalog_manager.cc:5697] T 862e96f5785248c58d0355cac229fc05 P e10b16d536674c0bb350a31d7ce5ff7f reported cstate change: config changed from index -1 to 2, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New cstate: current_term: 1 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:05:24.108803 16349 consensus_queue.cc:237] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
W20260709 13:05:24.119884 16322 consensus_peers.cc:597] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e -> Peer 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875): Couldn't send request to peer 1109f76a0b7b443a84c0327c8707bc63. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9dbc1db111e7466090abdb97a79d0d9b. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:24.121410 16279 raft_consensus.cc:1275] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:24.123039 16983 consensus_queue.cc:1048] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:24.139778 16207 raft_consensus.cc:1275] T 9dbc1db111e7466090abdb97a79d0d9b P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:24.142002 16853 consensus_queue.cc:1048] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:24.148114 16978 raft_consensus.cc:2955] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:05:24.152637 16276 raft_consensus.cc:2955] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:05:24.155683 16206 raft_consensus.cc:2955] T 9dbc1db111e7466090abdb97a79d0d9b P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:05:24.169939 16105 catalog_manager.cc:5697] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e reported cstate change: config changed from index -1 to 2, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New cstate: current_term: 1 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:24.285595 17011 ts_tablet_manager.cc:933] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63: Initiating tablet copy from peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073)
I20260709 13:05:24.294991 17011 tablet_copy_client.cc:323] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Beginning tablet copy session from remote peer at address 127.14.180.65:46073
I20260709 13:05:24.312933 16218 tablet_copy_service.cc:140] P e10b16d536674c0bb350a31d7ce5ff7f: Received BeginTabletCopySession request for tablet 1356ff4c060346359eb10723422e972a from peer 1109f76a0b7b443a84c0327c8707bc63 ({username='slave'} at 127.0.0.1:39674)
I20260709 13:05:24.313887 16218 tablet_copy_service.cc:161] P e10b16d536674c0bb350a31d7ce5ff7f: Beginning new tablet copy session on tablet 1356ff4c060346359eb10723422e972a from peer 1109f76a0b7b443a84c0327c8707bc63 at {username='slave'} at 127.0.0.1:39674: session id = 1109f76a0b7b443a84c0327c8707bc63-1356ff4c060346359eb10723422e972a
I20260709 13:05:24.326359 16218 tablet_copy_source_session.cc:215] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:24.330153 17011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1356ff4c060346359eb10723422e972a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:24.346097 17011 tablet_copy_client.cc:806] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:24.347105 17011 tablet_copy_client.cc:670] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:24.352962 17011 tablet_copy_client.cc:538] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:24.361255 17011 tablet_bootstrap.cc:492] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap starting.
I20260709 13:05:24.407297 17011 tablet_bootstrap.cc:492] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:24.408722 17011 tablet_bootstrap.cc:492] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap complete.
I20260709 13:05:24.409880 17011 ts_tablet_manager.cc:1403] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63: Time spent bootstrapping tablet: real 0.049s	user 0.021s	sys 0.016s
I20260709 13:05:24.414244 17011 raft_consensus.cc:359] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:05:24.415272 17011 raft_consensus.cc:740] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Initialized, Role: LEARNER
I20260709 13:05:24.416086 17011 consensus_queue.cc:260] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:05:24.419222 17011 ts_tablet_manager.cc:1434] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 13:05:24.421226 16218 tablet_copy_service.cc:342] P e10b16d536674c0bb350a31d7ce5ff7f: Request end of tablet copy session 1109f76a0b7b443a84c0327c8707bc63-1356ff4c060346359eb10723422e972a received from {username='slave'} at 127.0.0.1:39674
I20260709 13:05:24.421830 16218 tablet_copy_service.cc:434] P e10b16d536674c0bb350a31d7ce5ff7f: ending tablet copy session 1109f76a0b7b443a84c0327c8707bc63-1356ff4c060346359eb10723422e972a on tablet 1356ff4c060346359eb10723422e972a with peer 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:05:24.524117 17011 ts_tablet_manager.cc:933] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63: Initiating tablet copy from peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:24.529726 17011 tablet_copy_client.cc:323] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Beginning tablet copy session from remote peer at address 127.14.180.67:46107
I20260709 13:05:24.587806 17018 ts_tablet_manager.cc:933] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63: Initiating tablet copy from peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073)
I20260709 13:05:24.594995 16367 tablet_copy_service.cc:140] P 363bb2f744eb486f9ad726f08214c98e: Received BeginTabletCopySession request for tablet 862e96f5785248c58d0355cac229fc05 from peer 1109f76a0b7b443a84c0327c8707bc63 ({username='slave'} at 127.0.0.1:33486)
I20260709 13:05:24.595734 16367 tablet_copy_service.cc:161] P 363bb2f744eb486f9ad726f08214c98e: Beginning new tablet copy session on tablet 862e96f5785248c58d0355cac229fc05 from peer 1109f76a0b7b443a84c0327c8707bc63 at {username='slave'} at 127.0.0.1:33486: session id = 1109f76a0b7b443a84c0327c8707bc63-862e96f5785248c58d0355cac229fc05
I20260709 13:05:24.608942 16367 tablet_copy_source_session.cc:215] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:24.620563 17011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 862e96f5785248c58d0355cac229fc05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:24.631054 17018 tablet_copy_client.cc:323] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Beginning tablet copy session from remote peer at address 127.14.180.65:46073
I20260709 13:05:24.634032 16218 tablet_copy_service.cc:140] P e10b16d536674c0bb350a31d7ce5ff7f: Received BeginTabletCopySession request for tablet 8b615ac918a749989f2968826926adf3 from peer 1109f76a0b7b443a84c0327c8707bc63 ({username='slave'} at 127.0.0.1:39674)
I20260709 13:05:24.634698 16218 tablet_copy_service.cc:161] P e10b16d536674c0bb350a31d7ce5ff7f: Beginning new tablet copy session on tablet 8b615ac918a749989f2968826926adf3 from peer 1109f76a0b7b443a84c0327c8707bc63 at {username='slave'} at 127.0.0.1:39674: session id = 1109f76a0b7b443a84c0327c8707bc63-8b615ac918a749989f2968826926adf3
W20260709 13:05:24.651522 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 62394.4us
I20260709 13:05:24.656665 16218 tablet_copy_source_session.cc:215] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:24.667805 17011 tablet_copy_client.cc:806] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:24.670214 17011 tablet_copy_client.cc:670] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:24.677412 17018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b615ac918a749989f2968826926adf3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:24.681702 17011 tablet_copy_client.cc:538] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:24.695545 17021 ts_tablet_manager.cc:933] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63: Initiating tablet copy from peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:24.699272 17011 tablet_bootstrap.cc:492] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap starting.
I20260709 13:05:24.705113 17021 tablet_copy_client.cc:323] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Beginning tablet copy session from remote peer at address 127.14.180.67:46107
I20260709 13:05:24.709524 16367 tablet_copy_service.cc:140] P 363bb2f744eb486f9ad726f08214c98e: Received BeginTabletCopySession request for tablet 9dbc1db111e7466090abdb97a79d0d9b from peer 1109f76a0b7b443a84c0327c8707bc63 ({username='slave'} at 127.0.0.1:33486)
I20260709 13:05:24.710163 16367 tablet_copy_service.cc:161] P 363bb2f744eb486f9ad726f08214c98e: Beginning new tablet copy session on tablet 9dbc1db111e7466090abdb97a79d0d9b from peer 1109f76a0b7b443a84c0327c8707bc63 at {username='slave'} at 127.0.0.1:33486: session id = 1109f76a0b7b443a84c0327c8707bc63-9dbc1db111e7466090abdb97a79d0d9b
I20260709 13:05:24.724167 17018 tablet_copy_client.cc:806] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:24.724921 17018 tablet_copy_client.cc:670] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:24.729888 17018 tablet_copy_client.cc:538] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:24.730409 16367 tablet_copy_source_session.cc:215] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:24.734496 17021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dbc1db111e7466090abdb97a79d0d9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:24.740062 17018 tablet_bootstrap.cc:492] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap starting.
I20260709 13:05:24.769423 17021 tablet_copy_client.cc:806] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:24.769485 17018 tablet_bootstrap.cc:492] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:24.771342 17021 tablet_copy_client.cc:670] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:24.773576 17018 tablet_bootstrap.cc:492] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap complete.
I20260709 13:05:24.774561 17018 ts_tablet_manager.cc:1403] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63: Time spent bootstrapping tablet: real 0.035s	user 0.028s	sys 0.004s
I20260709 13:05:24.776391 17011 tablet_bootstrap.cc:492] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:24.777726 17021 tablet_copy_client.cc:538] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:24.778003 17018 raft_consensus.cc:359] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:05:24.779150 17018 raft_consensus.cc:740] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Initialized, Role: LEARNER
I20260709 13:05:24.779924 17018 consensus_queue.cc:260] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:05:24.782893 17018 ts_tablet_manager.cc:1434] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:05:24.777907 17011 tablet_bootstrap.cc:492] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap complete.
I20260709 13:05:24.793638 17021 tablet_bootstrap.cc:492] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap starting.
I20260709 13:05:24.795467 16218 tablet_copy_service.cc:342] P e10b16d536674c0bb350a31d7ce5ff7f: Request end of tablet copy session 1109f76a0b7b443a84c0327c8707bc63-8b615ac918a749989f2968826926adf3 received from {username='slave'} at 127.0.0.1:39674
I20260709 13:05:24.796000 16218 tablet_copy_service.cc:434] P e10b16d536674c0bb350a31d7ce5ff7f: ending tablet copy session 1109f76a0b7b443a84c0327c8707bc63-8b615ac918a749989f2968826926adf3 on tablet 8b615ac918a749989f2968826926adf3 with peer 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:05:24.804505 16949 raft_consensus.cc:1217] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:24.811128 17011 ts_tablet_manager.cc:1403] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63: Time spent bootstrapping tablet: real 0.112s	user 0.019s	sys 0.010s
I20260709 13:05:24.822212 17011 raft_consensus.cc:359] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:05:24.823137 17011 raft_consensus.cc:740] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Initialized, Role: LEARNER
I20260709 13:05:24.823855 17011 consensus_queue.cc:260] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:05:24.826411 17011 ts_tablet_manager.cc:1434] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.004s
I20260709 13:05:24.828439 16367 tablet_copy_service.cc:342] P 363bb2f744eb486f9ad726f08214c98e: Request end of tablet copy session 1109f76a0b7b443a84c0327c8707bc63-862e96f5785248c58d0355cac229fc05 received from {username='slave'} at 127.0.0.1:33486
I20260709 13:05:24.828922 16367 tablet_copy_service.cc:434] P 363bb2f744eb486f9ad726f08214c98e: ending tablet copy session 1109f76a0b7b443a84c0327c8707bc63-862e96f5785248c58d0355cac229fc05 on tablet 862e96f5785248c58d0355cac229fc05 with peer 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:05:24.832100 17021 tablet_bootstrap.cc:492] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:24.833238 17021 tablet_bootstrap.cc:492] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap complete.
I20260709 13:05:24.834028 17021 ts_tablet_manager.cc:1403] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63: Time spent bootstrapping tablet: real 0.041s	user 0.023s	sys 0.006s
I20260709 13:05:24.837852 17021 raft_consensus.cc:359] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:05:24.838927 17021 raft_consensus.cc:740] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Initialized, Role: LEARNER
I20260709 13:05:24.839661 17021 consensus_queue.cc:260] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:05:24.843185 17021 ts_tablet_manager.cc:1434] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63: Time spent starting tablet: real 0.009s	user 0.000s	sys 0.007s
I20260709 13:05:24.846230 16367 tablet_copy_service.cc:342] P 363bb2f744eb486f9ad726f08214c98e: Request end of tablet copy session 1109f76a0b7b443a84c0327c8707bc63-9dbc1db111e7466090abdb97a79d0d9b received from {username='slave'} at 127.0.0.1:33486
I20260709 13:05:24.846753 16367 tablet_copy_service.cc:434] P 363bb2f744eb486f9ad726f08214c98e: ending tablet copy session 1109f76a0b7b443a84c0327c8707bc63-9dbc1db111e7466090abdb97a79d0d9b on tablet 9dbc1db111e7466090abdb97a79d0d9b with peer 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:05:24.933157 16949 raft_consensus.cc:1217] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:25.157871 16949 raft_consensus.cc:1217] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:25.219843 16949 raft_consensus.cc:1217] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:25.422416 16986 raft_consensus.cc:1064] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f: attempting to promote NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 to VOTER
I20260709 13:05:25.425526 16986 consensus_queue.cc:237] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:25.439366 16351 raft_consensus.cc:1275] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:25.439519 16949 raft_consensus.cc:1275] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [term 1 LEARNER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:25.441087 16276 raft_consensus.cc:1275] T 1356ff4c060346359eb10723422e972a P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:25.441157 17019 consensus_queue.cc:1048] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:25.442924 16987 consensus_queue.cc:1048] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:25.447857 17027 consensus_queue.cc:1048] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:25.466180 16987 raft_consensus.cc:2955] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:25.468263 16276 raft_consensus.cc:2955] T 1356ff4c060346359eb10723422e972a P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:25.471170 16949 raft_consensus.cc:2955] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:25.488902 16105 catalog_manager.cc:5697] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: config changed from index 2 to 3, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:25.508570 16853 raft_consensus.cc:1064] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e: attempting to promote NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 to VOTER
I20260709 13:05:25.511639 16853 consensus_queue.cc:237] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:25.515237 16349 raft_consensus.cc:2955] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:25.543311 16276 raft_consensus.cc:1275] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:25.544201 16205 raft_consensus.cc:1275] T 862e96f5785248c58d0355cac229fc05 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:25.545321 16853 consensus_queue.cc:1048] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:25.546307 16852 consensus_queue.cc:1048] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:25.548065 16949 raft_consensus.cc:1275] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 LEARNER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:25.574678 16852 consensus_queue.cc:1048] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:25.617444 16852 raft_consensus.cc:2955] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:25.622051 16205 raft_consensus.cc:2955] T 862e96f5785248c58d0355cac229fc05 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:25.631840 16949 raft_consensus.cc:2955] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:25.665274 16102 catalog_manager.cc:5697] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: config changed from index 2 to 3, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:25.676482 16280 raft_consensus.cc:2955] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:25.689523 16205 consensus_queue.cc:237] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:25.698280 16351 raft_consensus.cc:1275] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:25.697853 16949 raft_consensus.cc:1275] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:25.704269 17032 consensus_queue.cc:1048] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:25.705183 16351 consensus_queue.cc:237] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:25.706202 17032 consensus_queue.cc:1048] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 13:05:25.718686 16948 raft_consensus.cc:1275] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:25.720402 17027 raft_consensus.cc:2955] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:25.721310 16351 raft_consensus.cc:2955] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:25.726711 17043 consensus_queue.cc:1048] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:25.737641 17043 raft_consensus.cc:2955] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:25.739658 16948 raft_consensus.cc:2955] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:25.746492 16090 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1356ff4c060346359eb10723422e972a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:25.749579 16092 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 862e96f5785248c58d0355cac229fc05 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:25.751260 16280 raft_consensus.cc:1275] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:25.737154 16949 raft_consensus.cc:2955] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:25.758488 17042 consensus_queue.cc:1048] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:25.764617 17010 raft_consensus.cc:1064] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e: attempting to promote NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 to VOTER
I20260709 13:05:25.770139 16279 raft_consensus.cc:2955] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:25.779198 17010 consensus_queue.cc:237] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:25.786689 16103 catalog_manager.cc:5697] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e reported cstate change: config changed from index 3 to 4, VOTER e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) evicted. New cstate: current_term: 1 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:25.796104 17027 raft_consensus.cc:1064] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f: attempting to promote NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 to VOTER
I20260709 13:05:25.798942 17027 consensus_queue.cc:237] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:25.810000 16191 tablet_service.cc:1558] Processing DeleteTablet for tablet 862e96f5785248c58d0355cac229fc05 with delete_type TABLET_DATA_TOMBSTONED (TS e10b16d536674c0bb350a31d7ce5ff7f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60124
I20260709 13:05:25.828941 16948 raft_consensus.cc:1275] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 LEARNER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:25.830533 17032 consensus_queue.cc:1048] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:25.830866 16279 raft_consensus.cc:1275] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:25.834165 17032 consensus_queue.cc:1048] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:25.836220 17047 tablet_replica.cc:333] T 862e96f5785248c58d0355cac229fc05 P e10b16d536674c0bb350a31d7ce5ff7f: stopping tablet replica
I20260709 13:05:25.842409 16351 raft_consensus.cc:1275] T 8b615ac918a749989f2968826926adf3 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:25.846383 17047 raft_consensus.cc:2243] T 862e96f5785248c58d0355cac229fc05 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:25.856550 16102 catalog_manager.cc:5697] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f reported cstate change: config changed from index 3 to 4, VOTER 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) evicted. New cstate: current_term: 1 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:25.858436 17019 consensus_queue.cc:1048] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:05:25.886092 16206 raft_consensus.cc:1275] T 9dbc1db111e7466090abdb97a79d0d9b P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:25.892081 17047 raft_consensus.cc:2272] T 862e96f5785248c58d0355cac229fc05 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:25.890622 16947 raft_consensus.cc:1275] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [term 1 LEARNER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:25.908232 17042 consensus_queue.cc:1048] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 13:05:25.940022 17047 ts_tablet_manager.cc:1916] T 862e96f5785248c58d0355cac229fc05 P e10b16d536674c0bb350a31d7ce5ff7f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:25.951946 16852 consensus_queue.cc:1048] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:05:25.997064 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 46603.9us
W20260709 13:05:26.045673 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 59589.5us
I20260709 13:05:26.061383 16270 tablet_service.cc:1558] Processing DeleteTablet for tablet 1356ff4c060346359eb10723422e972a with delete_type TABLET_DATA_TOMBSTONED (TS 0aea40d6e4374085a2e38a70a71f63e3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45204
W20260709 13:05:26.068002 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 110889us
I20260709 13:05:26.075709 16278 raft_consensus.cc:1275] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 13:05:26.122747 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 73356.6us
I20260709 13:05:26.131135 16853 consensus_queue.cc:1048] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:26.155658 17019 raft_consensus.cc:2955] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:26.199265 17061 tablet_replica.cc:333] T 1356ff4c060346359eb10723422e972a P 0aea40d6e4374085a2e38a70a71f63e3: stopping tablet replica
I20260709 13:05:26.232618 16280 raft_consensus.cc:2955] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:26.236320 17061 raft_consensus.cc:2243] T 1356ff4c060346359eb10723422e972a P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:26.249751 17047 ts_tablet_manager.cc:1929] T 862e96f5785248c58d0355cac229fc05 P e10b16d536674c0bb350a31d7ce5ff7f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:26.256651 17047 log.cc:1199] T 862e96f5785248c58d0355cac229fc05 P e10b16d536674c0bb350a31d7ce5ff7f: Deleting WAL directory at /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602283040513-15057-0/minicluster-data/ts-0-root/wals/862e96f5785248c58d0355cac229fc05
I20260709 13:05:26.260290 16279 raft_consensus.cc:2955] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:26.259213 17043 raft_consensus.cc:2955] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:26.247816 17061 raft_consensus.cc:2272] T 1356ff4c060346359eb10723422e972a P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:26.282822 16090 catalog_manager.cc:5028] TS e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): tablet 862e96f5785248c58d0355cac229fc05 (table test-workload [id=f364cfe226234c5b99453e3013c8717e]) successfully deleted
I20260709 13:05:26.284255 16948 raft_consensus.cc:2955] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:26.295694 16106 catalog_manager.cc:5697] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: config changed from index 2 to 3, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:26.312047 17061 ts_tablet_manager.cc:1916] T 1356ff4c060346359eb10723422e972a P 0aea40d6e4374085a2e38a70a71f63e3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:26.318996 16947 raft_consensus.cc:2955] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:26.328685 16106 catalog_manager.cc:5697] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: config changed from index 2 to 3, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
W20260709 13:05:26.342331 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 54322us
I20260709 13:05:26.349992 16206 consensus_queue.cc:237] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:26.358650 16949 raft_consensus.cc:1275] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:26.358928 16279 raft_consensus.cc:1275] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:26.361282 17019 consensus_queue.cc:1048] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:26.371040 16207 raft_consensus.cc:2955] T 9dbc1db111e7466090abdb97a79d0d9b P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:26.383594 17055 consensus_queue.cc:1048] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:26.398469 17027 raft_consensus.cc:2955] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:26.407383 16349 consensus_queue.cc:237] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:26.409818 16354 raft_consensus.cc:2955] T 8b615ac918a749989f2968826926adf3 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:26.423607 16948 raft_consensus.cc:2955] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:26.432235 16090 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8b615ac918a749989f2968826926adf3 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:26.432444 16279 raft_consensus.cc:2955] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:26.438952 16278 raft_consensus.cc:1275] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:26.438993 16947 raft_consensus.cc:1275] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:26.446892 16106 catalog_manager.cc:5697] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f reported cstate change: config changed from index 3 to 4, VOTER 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) evicted. New cstate: current_term: 1 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:26.458809 17043 consensus_queue.cc:1048] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:26.460496 17040 consensus_queue.cc:1048] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:26.470165 17061 ts_tablet_manager.cc:1929] T 1356ff4c060346359eb10723422e972a P 0aea40d6e4374085a2e38a70a71f63e3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:26.481329 16338 tablet_service.cc:1558] Processing DeleteTablet for tablet 8b615ac918a749989f2968826926adf3 with delete_type TABLET_DATA_TOMBSTONED (TS 363bb2f744eb486f9ad726f08214c98e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:41820
I20260709 13:05:26.491776 17061 log.cc:1199] T 1356ff4c060346359eb10723422e972a P 0aea40d6e4374085a2e38a70a71f63e3: Deleting WAL directory at /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602283040513-15057-0/minicluster-data/ts-1-root/wals/1356ff4c060346359eb10723422e972a
I20260709 13:05:26.493819 16092 catalog_manager.cc:5028] TS 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): tablet 1356ff4c060346359eb10723422e972a (table test-workload [id=f364cfe226234c5b99453e3013c8717e]) successfully deleted
I20260709 13:05:26.503189 17043 raft_consensus.cc:2955] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:26.515525 16948 raft_consensus.cc:2955] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:26.519315 16092 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9dbc1db111e7466090abdb97a79d0d9b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:26.533128 16279 raft_consensus.cc:2955] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:26.544335 16105 catalog_manager.cc:5697] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e reported cstate change: config changed from index 3 to 4, VOTER e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) evicted. New cstate: current_term: 1 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:26.557245 17067 tablet_replica.cc:333] T 8b615ac918a749989f2968826926adf3 P 363bb2f744eb486f9ad726f08214c98e: stopping tablet replica
I20260709 13:05:26.564131 17067 raft_consensus.cc:2243] T 8b615ac918a749989f2968826926adf3 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:26.565021 17067 raft_consensus.cc:2272] T 8b615ac918a749989f2968826926adf3 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:26.579692 17067 ts_tablet_manager.cc:1916] T 8b615ac918a749989f2968826926adf3 P 363bb2f744eb486f9ad726f08214c98e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:26.586846 16191 tablet_service.cc:1558] Processing DeleteTablet for tablet 9dbc1db111e7466090abdb97a79d0d9b with delete_type TABLET_DATA_TOMBSTONED (TS e10b16d536674c0bb350a31d7ce5ff7f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60124
I20260709 13:05:26.587846 17047 tablet_replica.cc:333] T 9dbc1db111e7466090abdb97a79d0d9b P e10b16d536674c0bb350a31d7ce5ff7f: stopping tablet replica
I20260709 13:05:26.589084 17047 raft_consensus.cc:2243] T 9dbc1db111e7466090abdb97a79d0d9b P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:26.591996 17047 raft_consensus.cc:2272] T 9dbc1db111e7466090abdb97a79d0d9b P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:26.598253 17047 ts_tablet_manager.cc:1916] T 9dbc1db111e7466090abdb97a79d0d9b P e10b16d536674c0bb350a31d7ce5ff7f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:26.602854 17067 ts_tablet_manager.cc:1929] T 8b615ac918a749989f2968826926adf3 P 363bb2f744eb486f9ad726f08214c98e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:26.603468 17067 log.cc:1199] T 8b615ac918a749989f2968826926adf3 P 363bb2f744eb486f9ad726f08214c98e: Deleting WAL directory at /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602283040513-15057-0/minicluster-data/ts-2-root/wals/8b615ac918a749989f2968826926adf3
I20260709 13:05:26.605350 16092 catalog_manager.cc:5028] TS 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): tablet 8b615ac918a749989f2968826926adf3 (table test-workload [id=f364cfe226234c5b99453e3013c8717e]) successfully deleted
I20260709 13:05:26.622607 17047 ts_tablet_manager.cc:1929] T 9dbc1db111e7466090abdb97a79d0d9b P e10b16d536674c0bb350a31d7ce5ff7f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:26.623097 17047 log.cc:1199] T 9dbc1db111e7466090abdb97a79d0d9b P e10b16d536674c0bb350a31d7ce5ff7f: Deleting WAL directory at /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602283040513-15057-0/minicluster-data/ts-0-root/wals/9dbc1db111e7466090abdb97a79d0d9b
I20260709 13:05:26.624543 16090 catalog_manager.cc:5028] TS e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): tablet 9dbc1db111e7466090abdb97a79d0d9b (table test-workload [id=f364cfe226234c5b99453e3013c8717e]) successfully deleted
I20260709 13:05:27.675477 16201 consensus_queue.cc:237] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:05:27.683926 16353 raft_consensus.cc:1275] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:05:27.684487 16173 consensus_peers.cc:597] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f -> Peer 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875): Couldn't send request to peer 1109f76a0b7b443a84c0327c8707bc63. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 916cdb289e9442b69dd8ed0c99eb8198. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:27.684556 16278 raft_consensus.cc:1275] T 916cdb289e9442b69dd8ed0c99eb8198 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:27.685760 17069 consensus_queue.cc:1048] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:27.687031 17027 consensus_queue.cc:1048] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:27.696398 17027 raft_consensus.cc:2955] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:05:27.700834 16349 raft_consensus.cc:2955] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:05:27.718171 16201 consensus_queue.cc:237] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:05:27.719923 16105 catalog_manager.cc:5697] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e reported cstate change: config changed from index -1 to 2, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New cstate: current_term: 1 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:05:27.725414 16278 raft_consensus.cc:2955] T 916cdb289e9442b69dd8ed0c99eb8198 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:05:27.752384 16349 raft_consensus.cc:1275] T 552b1776c27a48c194068de522fa45b6 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:27.755012 17027 consensus_queue.cc:1048] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:05:27.759462 16173 consensus_peers.cc:597] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f -> Peer 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875): Couldn't send request to peer 1109f76a0b7b443a84c0327c8707bc63. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 552b1776c27a48c194068de522fa45b6. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:27.763553 16278 raft_consensus.cc:1275] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:27.765575 17027 consensus_queue.cc:1048] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:27.776942 17069 raft_consensus.cc:2955] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:05:27.782429 16356 raft_consensus.cc:2955] T 552b1776c27a48c194068de522fa45b6 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:05:27.831301 16106 catalog_manager.cc:5697] T 552b1776c27a48c194068de522fa45b6 P 363bb2f744eb486f9ad726f08214c98e reported cstate change: config changed from index -1 to 2, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New cstate: current_term: 1 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:05:27.834182 16201 consensus_queue.cc:237] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:05:27.837984 16278 raft_consensus.cc:2955] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:05:27.903445 16356 raft_consensus.cc:1275] T a7ce522fbeb44228a8c05d5ceeadc347 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:05:27.903765 16173 consensus_peers.cc:597] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f -> Peer 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875): Couldn't send request to peer 1109f76a0b7b443a84c0327c8707bc63. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a7ce522fbeb44228a8c05d5ceeadc347. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:27.904852 17082 consensus_queue.cc:1048] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:27.905149 16278 raft_consensus.cc:1275] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:27.907315 17072 consensus_queue.cc:1048] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:27.925064 17082 raft_consensus.cc:2955] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:05:27.927570 16280 raft_consensus.cc:2955] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:05:27.936869 16356 raft_consensus.cc:2955] T a7ce522fbeb44228a8c05d5ceeadc347 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:05:27.942507 16201 consensus_queue.cc:237] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:05:27.947758 16106 catalog_manager.cc:5697] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f reported cstate change: config changed from index -1 to 2, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New cstate: current_term: 1 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:27.968192 16356 raft_consensus.cc:1275] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:27.971159 16280 raft_consensus.cc:1275] T 0340758c689242c3979a434fa59589f7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:05:27.971798 16173 consensus_peers.cc:597] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f -> Peer 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875): Couldn't send request to peer 1109f76a0b7b443a84c0327c8707bc63. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0340758c689242c3979a434fa59589f7. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:27.972126 17072 consensus_queue.cc:1048] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:27.974038 17069 consensus_queue.cc:1048] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:27.991140 17069 raft_consensus.cc:2955] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:05:27.993945 16356 raft_consensus.cc:2955] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:05:28.001061 16278 raft_consensus.cc:2955] T 0340758c689242c3979a434fa59589f7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:05:28.013804 16106 catalog_manager.cc:5697] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e reported cstate change: config changed from index -1 to 2, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New cstate: current_term: 1 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:05:28.266016 17089 ts_tablet_manager.cc:933] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63: Initiating tablet copy from peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073)
I20260709 13:05:28.268117 17089 tablet_copy_client.cc:323] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Beginning tablet copy session from remote peer at address 127.14.180.65:46073
I20260709 13:05:28.269929 16218 tablet_copy_service.cc:140] P e10b16d536674c0bb350a31d7ce5ff7f: Received BeginTabletCopySession request for tablet 916cdb289e9442b69dd8ed0c99eb8198 from peer 1109f76a0b7b443a84c0327c8707bc63 ({username='slave'} at 127.0.0.1:39674)
I20260709 13:05:28.270445 16218 tablet_copy_service.cc:161] P e10b16d536674c0bb350a31d7ce5ff7f: Beginning new tablet copy session on tablet 916cdb289e9442b69dd8ed0c99eb8198 from peer 1109f76a0b7b443a84c0327c8707bc63 at {username='slave'} at 127.0.0.1:39674: session id = 1109f76a0b7b443a84c0327c8707bc63-916cdb289e9442b69dd8ed0c99eb8198
I20260709 13:05:28.276063 16218 tablet_copy_source_session.cc:215] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:28.280093 17089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 916cdb289e9442b69dd8ed0c99eb8198. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.300628 17089 tablet_copy_client.cc:806] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:28.301381 17089 tablet_copy_client.cc:670] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:28.308585 17089 tablet_copy_client.cc:538] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:28.320541 17089 tablet_bootstrap.cc:492] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap starting.
I20260709 13:05:28.352530 17089 tablet_bootstrap.cc:492] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:28.353626 17089 tablet_bootstrap.cc:492] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap complete.
I20260709 13:05:28.354437 17089 ts_tablet_manager.cc:1403] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63: Time spent bootstrapping tablet: real 0.034s	user 0.018s	sys 0.013s
I20260709 13:05:28.357498 17089 raft_consensus.cc:359] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:05:28.358434 17089 raft_consensus.cc:740] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Initialized, Role: LEARNER
I20260709 13:05:28.359227 17089 consensus_queue.cc:260] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:05:28.363457 17089 ts_tablet_manager.cc:1434] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:05:28.366104 17093 ts_tablet_manager.cc:933] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63: Initiating tablet copy from peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073)
I20260709 13:05:28.367277 16218 tablet_copy_service.cc:342] P e10b16d536674c0bb350a31d7ce5ff7f: Request end of tablet copy session 1109f76a0b7b443a84c0327c8707bc63-916cdb289e9442b69dd8ed0c99eb8198 received from {username='slave'} at 127.0.0.1:39674
I20260709 13:05:28.367801 16218 tablet_copy_service.cc:434] P e10b16d536674c0bb350a31d7ce5ff7f: ending tablet copy session 1109f76a0b7b443a84c0327c8707bc63-916cdb289e9442b69dd8ed0c99eb8198 on tablet 916cdb289e9442b69dd8ed0c99eb8198 with peer 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:05:28.382962 17093 tablet_copy_client.cc:323] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Beginning tablet copy session from remote peer at address 127.14.180.65:46073
I20260709 13:05:28.387404 16218 tablet_copy_service.cc:140] P e10b16d536674c0bb350a31d7ce5ff7f: Received BeginTabletCopySession request for tablet 552b1776c27a48c194068de522fa45b6 from peer 1109f76a0b7b443a84c0327c8707bc63 ({username='slave'} at 127.0.0.1:39674)
I20260709 13:05:28.388070 16218 tablet_copy_service.cc:161] P e10b16d536674c0bb350a31d7ce5ff7f: Beginning new tablet copy session on tablet 552b1776c27a48c194068de522fa45b6 from peer 1109f76a0b7b443a84c0327c8707bc63 at {username='slave'} at 127.0.0.1:39674: session id = 1109f76a0b7b443a84c0327c8707bc63-552b1776c27a48c194068de522fa45b6
I20260709 13:05:28.417346 17089 ts_tablet_manager.cc:933] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63: Initiating tablet copy from peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073)
I20260709 13:05:28.428881 17089 tablet_copy_client.cc:323] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Beginning tablet copy session from remote peer at address 127.14.180.65:46073
I20260709 13:05:28.430992 16217 tablet_copy_service.cc:140] P e10b16d536674c0bb350a31d7ce5ff7f: Received BeginTabletCopySession request for tablet a7ce522fbeb44228a8c05d5ceeadc347 from peer 1109f76a0b7b443a84c0327c8707bc63 ({username='slave'} at 127.0.0.1:39674)
I20260709 13:05:28.431730 16217 tablet_copy_service.cc:161] P e10b16d536674c0bb350a31d7ce5ff7f: Beginning new tablet copy session on tablet a7ce522fbeb44228a8c05d5ceeadc347 from peer 1109f76a0b7b443a84c0327c8707bc63 at {username='slave'} at 127.0.0.1:39674: session id = 1109f76a0b7b443a84c0327c8707bc63-a7ce522fbeb44228a8c05d5ceeadc347
I20260709 13:05:28.432821 16218 tablet_copy_source_session.cc:215] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:28.438951 17093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 552b1776c27a48c194068de522fa45b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.442102 16217 tablet_copy_source_session.cc:215] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:28.458961 17089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7ce522fbeb44228a8c05d5ceeadc347. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.487871 17089 tablet_copy_client.cc:806] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:28.488623 17089 tablet_copy_client.cc:670] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:28.492481 17093 tablet_copy_client.cc:806] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:28.493158 17093 tablet_copy_client.cc:670] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:28.493685 17089 tablet_copy_client.cc:538] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:28.497716 17093 tablet_copy_client.cc:538] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:28.509608 17093 tablet_bootstrap.cc:492] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap starting.
I20260709 13:05:28.512472 17089 tablet_bootstrap.cc:492] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap starting.
I20260709 13:05:28.542914 17093 tablet_bootstrap.cc:492] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:28.543007 17089 tablet_bootstrap.cc:492] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:28.544129 17093 tablet_bootstrap.cc:492] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap complete.
I20260709 13:05:28.544904 17089 tablet_bootstrap.cc:492] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap complete.
I20260709 13:05:28.545020 17093 ts_tablet_manager.cc:1403] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63: Time spent bootstrapping tablet: real 0.036s	user 0.027s	sys 0.004s
I20260709 13:05:28.545593 17089 ts_tablet_manager.cc:1403] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63: Time spent bootstrapping tablet: real 0.033s	user 0.021s	sys 0.003s
I20260709 13:05:28.548864 17089 raft_consensus.cc:359] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:05:28.549696 17089 raft_consensus.cc:740] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Initialized, Role: LEARNER
I20260709 13:05:28.548767 17093 raft_consensus.cc:359] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:05:28.550232 17093 raft_consensus.cc:740] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Initialized, Role: LEARNER
I20260709 13:05:28.550441 17089 consensus_queue.cc:260] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:05:28.550961 17093 consensus_queue.cc:260] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:05:28.553023 17089 ts_tablet_manager.cc:1434] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
I20260709 13:05:28.555604 16217 tablet_copy_service.cc:342] P e10b16d536674c0bb350a31d7ce5ff7f: Request end of tablet copy session 1109f76a0b7b443a84c0327c8707bc63-a7ce522fbeb44228a8c05d5ceeadc347 received from {username='slave'} at 127.0.0.1:39674
I20260709 13:05:28.556104 16217 tablet_copy_service.cc:434] P e10b16d536674c0bb350a31d7ce5ff7f: ending tablet copy session 1109f76a0b7b443a84c0327c8707bc63-a7ce522fbeb44228a8c05d5ceeadc347 on tablet a7ce522fbeb44228a8c05d5ceeadc347 with peer 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:05:28.559360 17093 ts_tablet_manager.cc:1434] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:05:28.561688 16217 tablet_copy_service.cc:342] P e10b16d536674c0bb350a31d7ce5ff7f: Request end of tablet copy session 1109f76a0b7b443a84c0327c8707bc63-552b1776c27a48c194068de522fa45b6 received from {username='slave'} at 127.0.0.1:39674
I20260709 13:05:28.562201 16217 tablet_copy_service.cc:434] P e10b16d536674c0bb350a31d7ce5ff7f: ending tablet copy session 1109f76a0b7b443a84c0327c8707bc63-552b1776c27a48c194068de522fa45b6 on tablet 552b1776c27a48c194068de522fa45b6 with peer 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:05:28.564267 17089 ts_tablet_manager.cc:933] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63: Initiating tablet copy from peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073)
I20260709 13:05:28.574218 17089 tablet_copy_client.cc:323] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Beginning tablet copy session from remote peer at address 127.14.180.65:46073
I20260709 13:05:28.575974 16217 tablet_copy_service.cc:140] P e10b16d536674c0bb350a31d7ce5ff7f: Received BeginTabletCopySession request for tablet 0340758c689242c3979a434fa59589f7 from peer 1109f76a0b7b443a84c0327c8707bc63 ({username='slave'} at 127.0.0.1:39674)
I20260709 13:05:28.576541 16217 tablet_copy_service.cc:161] P e10b16d536674c0bb350a31d7ce5ff7f: Beginning new tablet copy session on tablet 0340758c689242c3979a434fa59589f7 from peer 1109f76a0b7b443a84c0327c8707bc63 at {username='slave'} at 127.0.0.1:39674: session id = 1109f76a0b7b443a84c0327c8707bc63-0340758c689242c3979a434fa59589f7
I20260709 13:05:28.585453 16217 tablet_copy_source_session.cc:215] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:28.589290 17089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0340758c689242c3979a434fa59589f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:28.606367 17089 tablet_copy_client.cc:806] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:28.607226 17089 tablet_copy_client.cc:670] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:28.611186 17089 tablet_copy_client.cc:538] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:28.618238 17089 tablet_bootstrap.cc:492] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap starting.
I20260709 13:05:28.637444 17089 tablet_bootstrap.cc:492] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:28.638276 17089 tablet_bootstrap.cc:492] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap complete.
I20260709 13:05:28.638899 17089 ts_tablet_manager.cc:1403] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63: Time spent bootstrapping tablet: real 0.021s	user 0.017s	sys 0.005s
I20260709 13:05:28.640776 17089 raft_consensus.cc:359] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:05:28.641422 17089 raft_consensus.cc:740] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Initialized, Role: LEARNER
I20260709 13:05:28.641989 17089 consensus_queue.cc:260] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:05:28.644423 17089 ts_tablet_manager.cc:1434] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:05:28.646040 16217 tablet_copy_service.cc:342] P e10b16d536674c0bb350a31d7ce5ff7f: Request end of tablet copy session 1109f76a0b7b443a84c0327c8707bc63-0340758c689242c3979a434fa59589f7 received from {username='slave'} at 127.0.0.1:39674
I20260709 13:05:28.646489 16217 tablet_copy_service.cc:434] P e10b16d536674c0bb350a31d7ce5ff7f: ending tablet copy session 1109f76a0b7b443a84c0327c8707bc63-0340758c689242c3979a434fa59589f7 on tablet 0340758c689242c3979a434fa59589f7 with peer 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:05:28.750239 16948 raft_consensus.cc:1217] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:28.803182 16948 raft_consensus.cc:1217] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:28.963714 16948 raft_consensus.cc:1217] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:29.047430 16948 raft_consensus.cc:1217] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:29.155237 17072 raft_consensus.cc:1064] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f: attempting to promote NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 to VOTER
I20260709 13:05:29.158305 17072 consensus_queue.cc:237] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:29.167251 16948 raft_consensus.cc:1275] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 LEARNER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:29.168650 16356 raft_consensus.cc:1275] T 552b1776c27a48c194068de522fa45b6 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:29.168969 16280 raft_consensus.cc:1275] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:29.171826 17072 consensus_queue.cc:1048] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:29.172879 17082 consensus_queue.cc:1048] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:29.173944 17027 consensus_queue.cc:1048] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:29.211351 17027 raft_consensus.cc:2955] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:29.216485 16278 raft_consensus.cc:2955] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:29.239262 16105 catalog_manager.cc:5697] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: config changed from index 2 to 3, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:29.244122 16948 raft_consensus.cc:2955] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:29.244582 16356 raft_consensus.cc:2955] T 552b1776c27a48c194068de522fa45b6 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:29.335479 16206 consensus_queue.cc:237] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:29.342064 16948 raft_consensus.cc:1275] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:29.343924 17072 consensus_queue.cc:1048] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:29.346253 16278 raft_consensus.cc:1275] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:29.356918 17082 raft_consensus.cc:2955] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:29.358825 17072 consensus_queue.cc:1048] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:29.362736 16278 raft_consensus.cc:2955] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:29.365139 16948 raft_consensus.cc:2955] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:29.376467 17106 raft_consensus.cc:1064] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f: attempting to promote NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 to VOTER
I20260709 13:05:29.384944 17106 consensus_queue.cc:237] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:29.389115 16090 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 552b1776c27a48c194068de522fa45b6 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:29.385278 16103 catalog_manager.cc:5697] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: config changed from index 3 to 4, VOTER 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) evicted. New cstate: current_term: 1 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:29.410631 16338 tablet_service.cc:1558] Processing DeleteTablet for tablet 552b1776c27a48c194068de522fa45b6 with delete_type TABLET_DATA_TOMBSTONED (TS 363bb2f744eb486f9ad726f08214c98e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:41820
I20260709 13:05:29.469925 17113 tablet_replica.cc:333] T 552b1776c27a48c194068de522fa45b6 P 363bb2f744eb486f9ad726f08214c98e: stopping tablet replica
I20260709 13:05:29.471038 17113 raft_consensus.cc:2243] T 552b1776c27a48c194068de522fa45b6 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:29.471782 17113 raft_consensus.cc:2272] T 552b1776c27a48c194068de522fa45b6 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:29.476517 17113 ts_tablet_manager.cc:1916] T 552b1776c27a48c194068de522fa45b6 P 363bb2f744eb486f9ad726f08214c98e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:29.477963 16948 raft_consensus.cc:1275] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 LEARNER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:29.478184 16278 raft_consensus.cc:1275] T 916cdb289e9442b69dd8ed0c99eb8198 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:29.481175 17027 consensus_queue.cc:1048] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:29.491447 17114 consensus_queue.cc:1048] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:05:29.494586 17113 ts_tablet_manager.cc:1929] T 552b1776c27a48c194068de522fa45b6 P 363bb2f744eb486f9ad726f08214c98e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:29.497341 17072 raft_consensus.cc:1064] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f: attempting to promote NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 to VOTER
I20260709 13:05:29.499163 17113 log.cc:1199] T 552b1776c27a48c194068de522fa45b6 P 363bb2f744eb486f9ad726f08214c98e: Deleting WAL directory at /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602283040513-15057-0/minicluster-data/ts-2-root/wals/552b1776c27a48c194068de522fa45b6
I20260709 13:05:29.502182 16092 catalog_manager.cc:5028] TS 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): tablet 552b1776c27a48c194068de522fa45b6 (table test-workload [id=f364cfe226234c5b99453e3013c8717e]) successfully deleted
I20260709 13:05:29.501609 17072 consensus_queue.cc:237] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:29.514031 16354 raft_consensus.cc:1275] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:29.523926 17027 raft_consensus.cc:1064] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f: attempting to promote NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 to VOTER
I20260709 13:05:29.537611 17027 consensus_queue.cc:237] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:29.530891 17106 consensus_queue.cc:1048] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:29.549206 16947 raft_consensus.cc:1275] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 LEARNER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:29.549196 16278 raft_consensus.cc:1275] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:29.550719 16356 raft_consensus.cc:1275] T a7ce522fbeb44228a8c05d5ceeadc347 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:29.552991 17082 consensus_queue.cc:1048] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:29.554240 17115 consensus_queue.cc:1048] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:29.554210 17072 raft_consensus.cc:2955] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:29.569689 16947 raft_consensus.cc:2955] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:29.570130 16280 raft_consensus.cc:2955] T 916cdb289e9442b69dd8ed0c99eb8198 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:29.573236 17082 consensus_queue.cc:1048] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:29.653658 16103 catalog_manager.cc:5697] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: config changed from index 2 to 3, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:29.709647 17115 raft_consensus.cc:2955] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:29.713634 16948 raft_consensus.cc:1275] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 LEARNER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:29.714270 16278 raft_consensus.cc:1275] T 0340758c689242c3979a434fa59589f7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:29.716173 16353 raft_consensus.cc:1275] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:29.721402 17116 consensus_queue.cc:1048] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:29.725268 16948 raft_consensus.cc:2955] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:29.729211 16353 raft_consensus.cc:2955] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:29.741837 17116 consensus_queue.cc:1048] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:29.745318 16356 raft_consensus.cc:2955] T a7ce522fbeb44228a8c05d5ceeadc347 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:29.749842 16103 catalog_manager.cc:5697] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: config changed from index 2 to 3, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:29.753402 17116 consensus_queue.cc:1048] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:29.764935 16201 consensus_queue.cc:237] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:29.787741 16201 consensus_queue.cc:237] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:29.794873 16947 raft_consensus.cc:1275] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:29.789749 16280 raft_consensus.cc:2955] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:29.802748 17106 raft_consensus.cc:2955] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:29.819036 16947 raft_consensus.cc:1275] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:29.823273 16353 raft_consensus.cc:2955] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:29.825944 16278 raft_consensus.cc:1275] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:29.830569 17027 consensus_queue.cc:1048] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:29.830588 17116 consensus_queue.cc:1048] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 13:05:29.823269 16354 raft_consensus.cc:1275] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:29.837144 17027 consensus_queue.cc:1048] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:29.844790 17115 raft_consensus.cc:2955] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:29.846297 17072 consensus_queue.cc:1048] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:29.851001 16947 raft_consensus.cc:2955] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:29.855332 16280 raft_consensus.cc:2955] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:29.851028 17072 raft_consensus.cc:2955] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:29.857532 16948 raft_consensus.cc:2955] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:29.862166 16946 raft_consensus.cc:2955] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:29.874531 16278 raft_consensus.cc:2955] T 0340758c689242c3979a434fa59589f7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:29.883627 16103 catalog_manager.cc:5697] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e reported cstate change: config changed from index 2 to 3, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:29.888561 16090 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 916cdb289e9442b69dd8ed0c99eb8198 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:29.889133 16102 catalog_manager.cc:5697] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: config changed from index 3 to 4, VOTER 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) evicted. New cstate: current_term: 1 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:29.900888 16356 raft_consensus.cc:2955] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:29.906853 16090 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a7ce522fbeb44228a8c05d5ceeadc347 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:29.919929 16338 tablet_service.cc:1558] Processing DeleteTablet for tablet a7ce522fbeb44228a8c05d5ceeadc347 with delete_type TABLET_DATA_TOMBSTONED (TS 363bb2f744eb486f9ad726f08214c98e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:41820
I20260709 13:05:29.920933 17113 tablet_replica.cc:333] T a7ce522fbeb44228a8c05d5ceeadc347 P 363bb2f744eb486f9ad726f08214c98e: stopping tablet replica
I20260709 13:05:29.921967 17113 raft_consensus.cc:2243] T a7ce522fbeb44228a8c05d5ceeadc347 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:29.922767 17113 raft_consensus.cc:2272] T a7ce522fbeb44228a8c05d5ceeadc347 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:29.923604 16201 consensus_queue.cc:237] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:29.934882 16103 catalog_manager.cc:5697] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e reported cstate change: config changed from index 3 to 4, VOTER 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) evicted. New cstate: current_term: 1 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:29.936262 17113 ts_tablet_manager.cc:1916] T a7ce522fbeb44228a8c05d5ceeadc347 P 363bb2f744eb486f9ad726f08214c98e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:29.944890 16946 raft_consensus.cc:1275] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:29.946609 17072 consensus_queue.cc:1048] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:29.954752 16270 tablet_service.cc:1558] Processing DeleteTablet for tablet 916cdb289e9442b69dd8ed0c99eb8198 with delete_type TABLET_DATA_TOMBSTONED (TS 0aea40d6e4374085a2e38a70a71f63e3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45204
I20260709 13:05:29.954294 17106 raft_consensus.cc:2955] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:29.955977 16946 raft_consensus.cc:2955] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:29.978897 16090 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0340758c689242c3979a434fa59589f7 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:29.983112 16354 raft_consensus.cc:1275] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:29.989570 17106 consensus_queue.cc:1048] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:29.992246 17113 ts_tablet_manager.cc:1929] T a7ce522fbeb44228a8c05d5ceeadc347 P 363bb2f744eb486f9ad726f08214c98e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:29.992822 17113 log.cc:1199] T a7ce522fbeb44228a8c05d5ceeadc347 P 363bb2f744eb486f9ad726f08214c98e: Deleting WAL directory at /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602283040513-15057-0/minicluster-data/ts-2-root/wals/a7ce522fbeb44228a8c05d5ceeadc347
I20260709 13:05:29.995877 16354 raft_consensus.cc:2955] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:30.000730 16092 catalog_manager.cc:5028] TS 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): tablet a7ce522fbeb44228a8c05d5ceeadc347 (table test-workload [id=f364cfe226234c5b99453e3013c8717e]) successfully deleted
I20260709 13:05:30.013085 17131 tablet_replica.cc:333] T 916cdb289e9442b69dd8ed0c99eb8198 P 0aea40d6e4374085a2e38a70a71f63e3: stopping tablet replica
I20260709 13:05:30.014213 17131 raft_consensus.cc:2243] T 916cdb289e9442b69dd8ed0c99eb8198 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:30.015024 17131 raft_consensus.cc:2272] T 916cdb289e9442b69dd8ed0c99eb8198 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:30.018411 16106 catalog_manager.cc:5697] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: config changed from index 3 to 4, VOTER 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) evicted. New cstate: current_term: 1 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:30.019748 17131 ts_tablet_manager.cc:1916] T 916cdb289e9442b69dd8ed0c99eb8198 P 0aea40d6e4374085a2e38a70a71f63e3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:30.034956 16270 tablet_service.cc:1558] Processing DeleteTablet for tablet 0340758c689242c3979a434fa59589f7 with delete_type TABLET_DATA_TOMBSTONED (TS 0aea40d6e4374085a2e38a70a71f63e3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45204
I20260709 13:05:30.039556 17131 ts_tablet_manager.cc:1929] T 916cdb289e9442b69dd8ed0c99eb8198 P 0aea40d6e4374085a2e38a70a71f63e3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:30.040138 17131 log.cc:1199] T 916cdb289e9442b69dd8ed0c99eb8198 P 0aea40d6e4374085a2e38a70a71f63e3: Deleting WAL directory at /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602283040513-15057-0/minicluster-data/ts-1-root/wals/916cdb289e9442b69dd8ed0c99eb8198
I20260709 13:05:30.043032 16092 catalog_manager.cc:5028] TS 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): tablet 916cdb289e9442b69dd8ed0c99eb8198 (table test-workload [id=f364cfe226234c5b99453e3013c8717e]) successfully deleted
I20260709 13:05:30.044066 17131 tablet_replica.cc:333] T 0340758c689242c3979a434fa59589f7 P 0aea40d6e4374085a2e38a70a71f63e3: stopping tablet replica
I20260709 13:05:30.044914 17131 raft_consensus.cc:2243] T 0340758c689242c3979a434fa59589f7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:30.045442 17131 raft_consensus.cc:2272] T 0340758c689242c3979a434fa59589f7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:30.048714 17131 ts_tablet_manager.cc:1916] T 0340758c689242c3979a434fa59589f7 P 0aea40d6e4374085a2e38a70a71f63e3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:30.061789 17131 ts_tablet_manager.cc:1929] T 0340758c689242c3979a434fa59589f7 P 0aea40d6e4374085a2e38a70a71f63e3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:30.062119 17131 log.cc:1199] T 0340758c689242c3979a434fa59589f7 P 0aea40d6e4374085a2e38a70a71f63e3: Deleting WAL directory at /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602283040513-15057-0/minicluster-data/ts-1-root/wals/0340758c689242c3979a434fa59589f7
I20260709 13:05:30.063750 16092 catalog_manager.cc:5028] TS 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): tablet 0340758c689242c3979a434fa59589f7 (table test-workload [id=f364cfe226234c5b99453e3013c8717e]) successfully deleted
I20260709 13:05:31.160130 16277 consensus_queue.cc:237] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:05:31.169591 16349 raft_consensus.cc:1275] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:31.173525 17077 consensus_queue.cc:1048] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:31.180716 16201 raft_consensus.cc:1275] T bb3b9c4ba1f147fc8d9858234bfce423 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:31.182992 17101 consensus_queue.cc:1048] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:05:31.186576 16248 consensus_peers.cc:597] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 -> Peer 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875): Couldn't send request to peer 1109f76a0b7b443a84c0327c8707bc63. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bb3b9c4ba1f147fc8d9858234bfce423. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:31.186049 17101 raft_consensus.cc:2955] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:05:31.187304 16349 raft_consensus.cc:2955] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:05:31.213775 16105 catalog_manager.cc:5697] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: config changed from index -1 to 2, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New cstate: current_term: 1 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:31.221134 16354 consensus_queue.cc:237] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:05:31.234913 16201 raft_consensus.cc:1275] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:31.237624 17081 consensus_queue.cc:1048] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:31.238533 16277 raft_consensus.cc:1275] T 38b024fb12204d9b9e35d72638671c24 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:31.240887 16207 raft_consensus.cc:2955] T bb3b9c4ba1f147fc8d9858234bfce423 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:05:31.248368 17081 consensus_queue.cc:1048] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:05:31.249393 16322 consensus_peers.cc:597] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e -> Peer 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875): Couldn't send request to peer 1109f76a0b7b443a84c0327c8707bc63. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 38b024fb12204d9b9e35d72638671c24. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:31.256286 16853 raft_consensus.cc:2955] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:05:31.258153 16206 raft_consensus.cc:2955] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:05:31.279155 16351 consensus_queue.cc:237] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:05:31.294178 16105 catalog_manager.cc:5697] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e reported cstate change: config changed from index -1 to 2, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New cstate: current_term: 1 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:05:31.297312 16322 consensus_peers.cc:597] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e -> Peer 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875): Couldn't send request to peer 1109f76a0b7b443a84c0327c8707bc63. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 47342899f1ed4c788d60ea4c5b52969a. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:31.299235 16278 raft_consensus.cc:1275] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:31.302382 16206 raft_consensus.cc:1275] T 47342899f1ed4c788d60ea4c5b52969a P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:31.303030 17109 consensus_queue.cc:1048] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:31.308583 17109 consensus_queue.cc:1048] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:31.320361 16280 raft_consensus.cc:2955] T 38b024fb12204d9b9e35d72638671c24 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:05:31.330231 16853 raft_consensus.cc:2955] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:05:31.367576 16280 raft_consensus.cc:2955] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:05:31.369971 16206 raft_consensus.cc:2955] T 47342899f1ed4c788d60ea4c5b52969a P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:05:31.370271 16207 consensus_queue.cc:237] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:05:31.375123 16105 catalog_manager.cc:5697] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e reported cstate change: config changed from index -1 to 2, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New cstate: current_term: 1 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:31.384778 16351 raft_consensus.cc:1275] T 5063fcda38c2468a8dad5d01023b700a P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:05:31.386188 16173 consensus_peers.cc:597] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f -> Peer 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875): Couldn't send request to peer 1109f76a0b7b443a84c0327c8707bc63. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5063fcda38c2468a8dad5d01023b700a. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:31.390049 17106 consensus_queue.cc:1048] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:31.395524 16280 raft_consensus.cc:1275] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:31.401345 17114 consensus_queue.cc:1048] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:31.430572 17157 raft_consensus.cc:2955] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:05:31.432149 16278 raft_consensus.cc:2955] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:05:31.436659 16351 raft_consensus.cc:2955] T 5063fcda38c2468a8dad5d01023b700a P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:05:31.450901 16105 catalog_manager.cc:5697] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: config changed from index -1 to 2, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New cstate: current_term: 1 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:05:31.726997 17160 ts_tablet_manager.cc:933] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63: Initiating tablet copy from peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:31.729230 17160 tablet_copy_client.cc:323] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Beginning tablet copy session from remote peer at address 127.14.180.67:46107
I20260709 13:05:31.731215 16367 tablet_copy_service.cc:140] P 363bb2f744eb486f9ad726f08214c98e: Received BeginTabletCopySession request for tablet 38b024fb12204d9b9e35d72638671c24 from peer 1109f76a0b7b443a84c0327c8707bc63 ({username='slave'} at 127.0.0.1:33486)
I20260709 13:05:31.731827 16367 tablet_copy_service.cc:161] P 363bb2f744eb486f9ad726f08214c98e: Beginning new tablet copy session on tablet 38b024fb12204d9b9e35d72638671c24 from peer 1109f76a0b7b443a84c0327c8707bc63 at {username='slave'} at 127.0.0.1:33486: session id = 1109f76a0b7b443a84c0327c8707bc63-38b024fb12204d9b9e35d72638671c24
I20260709 13:05:31.739951 16367 tablet_copy_source_session.cc:215] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:31.743785 17160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38b024fb12204d9b9e35d72638671c24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:31.762924 17160 tablet_copy_client.cc:806] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:31.763652 17160 tablet_copy_client.cc:670] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:31.768371 17160 tablet_copy_client.cc:538] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:31.778620 17160 tablet_bootstrap.cc:492] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap starting.
I20260709 13:05:31.791594 17162 ts_tablet_manager.cc:933] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63: Initiating tablet copy from peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:31.884769 17162 tablet_copy_client.cc:323] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Beginning tablet copy session from remote peer at address 127.14.180.66:45823
I20260709 13:05:31.902254 17167 ts_tablet_manager.cc:933] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63: Initiating tablet copy from peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:31.920332 17160 tablet_bootstrap.cc:492] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:31.922272 17160 tablet_bootstrap.cc:492] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap complete.
I20260709 13:05:31.926805 17167 tablet_copy_client.cc:323] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Beginning tablet copy session from remote peer at address 127.14.180.67:46107
I20260709 13:05:31.927567 16293 tablet_copy_service.cc:140] P 0aea40d6e4374085a2e38a70a71f63e3: Received BeginTabletCopySession request for tablet bb3b9c4ba1f147fc8d9858234bfce423 from peer 1109f76a0b7b443a84c0327c8707bc63 ({username='slave'} at 127.0.0.1:42740)
I20260709 13:05:31.932750 16293 tablet_copy_service.cc:161] P 0aea40d6e4374085a2e38a70a71f63e3: Beginning new tablet copy session on tablet bb3b9c4ba1f147fc8d9858234bfce423 from peer 1109f76a0b7b443a84c0327c8707bc63 at {username='slave'} at 127.0.0.1:42740: session id = 1109f76a0b7b443a84c0327c8707bc63-bb3b9c4ba1f147fc8d9858234bfce423
I20260709 13:05:31.933095 17160 ts_tablet_manager.cc:1403] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63: Time spent bootstrapping tablet: real 0.155s	user 0.038s	sys 0.041s
I20260709 13:05:31.936908 17160 raft_consensus.cc:359] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:05:31.930086 17168 ts_tablet_manager.cc:933] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63: Initiating tablet copy from peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073)
I20260709 13:05:31.937951 17160 raft_consensus.cc:740] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Initialized, Role: LEARNER
I20260709 13:05:31.938768 16367 tablet_copy_service.cc:140] P 363bb2f744eb486f9ad726f08214c98e: Received BeginTabletCopySession request for tablet 47342899f1ed4c788d60ea4c5b52969a from peer 1109f76a0b7b443a84c0327c8707bc63 ({username='slave'} at 127.0.0.1:33486)
I20260709 13:05:31.939527 16367 tablet_copy_service.cc:161] P 363bb2f744eb486f9ad726f08214c98e: Beginning new tablet copy session on tablet 47342899f1ed4c788d60ea4c5b52969a from peer 1109f76a0b7b443a84c0327c8707bc63 at {username='slave'} at 127.0.0.1:33486: session id = 1109f76a0b7b443a84c0327c8707bc63-47342899f1ed4c788d60ea4c5b52969a
I20260709 13:05:31.939307 17160 consensus_queue.cc:260] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:05:31.941380 16293 tablet_copy_source_session.cc:215] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:31.947675 17162 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb3b9c4ba1f147fc8d9858234bfce423. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:31.952306 17160 ts_tablet_manager.cc:1434] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63: Time spent starting tablet: real 0.019s	user 0.010s	sys 0.003s
I20260709 13:05:31.954733 16366 tablet_copy_service.cc:342] P 363bb2f744eb486f9ad726f08214c98e: Request end of tablet copy session 1109f76a0b7b443a84c0327c8707bc63-38b024fb12204d9b9e35d72638671c24 received from {username='slave'} at 127.0.0.1:33486
I20260709 13:05:31.955251 16366 tablet_copy_service.cc:434] P 363bb2f744eb486f9ad726f08214c98e: ending tablet copy session 1109f76a0b7b443a84c0327c8707bc63-38b024fb12204d9b9e35d72638671c24 on tablet 38b024fb12204d9b9e35d72638671c24 with peer 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:05:31.955892 16367 tablet_copy_source_session.cc:215] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:31.959359 17167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47342899f1ed4c788d60ea4c5b52969a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:31.980911 17162 tablet_copy_client.cc:806] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:31.980767 17168 tablet_copy_client.cc:323] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Beginning tablet copy session from remote peer at address 127.14.180.65:46073
I20260709 13:05:31.981678 17162 tablet_copy_client.cc:670] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:31.985329 16217 tablet_copy_service.cc:140] P e10b16d536674c0bb350a31d7ce5ff7f: Received BeginTabletCopySession request for tablet 5063fcda38c2468a8dad5d01023b700a from peer 1109f76a0b7b443a84c0327c8707bc63 ({username='slave'} at 127.0.0.1:39674)
I20260709 13:05:31.986012 16217 tablet_copy_service.cc:161] P e10b16d536674c0bb350a31d7ce5ff7f: Beginning new tablet copy session on tablet 5063fcda38c2468a8dad5d01023b700a from peer 1109f76a0b7b443a84c0327c8707bc63 at {username='slave'} at 127.0.0.1:39674: session id = 1109f76a0b7b443a84c0327c8707bc63-5063fcda38c2468a8dad5d01023b700a
I20260709 13:05:31.989496 17162 tablet_copy_client.cc:538] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:31.999853 17162 tablet_bootstrap.cc:492] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap starting.
I20260709 13:05:32.008409 16217 tablet_copy_source_session.cc:215] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:32.010289 17167 tablet_copy_client.cc:806] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:32.011107 17167 tablet_copy_client.cc:670] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:32.015486 17167 tablet_copy_client.cc:538] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:32.034081 17168 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5063fcda38c2468a8dad5d01023b700a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:32.036995 17167 tablet_bootstrap.cc:492] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap starting.
I20260709 13:05:32.059808 17168 tablet_copy_client.cc:806] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:32.060940 17168 tablet_copy_client.cc:670] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:32.066390 17168 tablet_copy_client.cc:538] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:32.073510 17167 tablet_bootstrap.cc:492] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:32.073810 17162 tablet_bootstrap.cc:492] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:32.074787 17167 tablet_bootstrap.cc:492] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap complete.
I20260709 13:05:32.074888 17162 tablet_bootstrap.cc:492] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap complete.
I20260709 13:05:32.075695 17167 ts_tablet_manager.cc:1403] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63: Time spent bootstrapping tablet: real 0.039s	user 0.021s	sys 0.014s
I20260709 13:05:32.076296 17162 ts_tablet_manager.cc:1403] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63: Time spent bootstrapping tablet: real 0.077s	user 0.034s	sys 0.006s
I20260709 13:05:32.079018 17167 raft_consensus.cc:359] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:05:32.080005 17167 raft_consensus.cc:740] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Initialized, Role: LEARNER
I20260709 13:05:32.080785 17167 consensus_queue.cc:260] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:05:32.080875 17162 raft_consensus.cc:359] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:05:32.081904 17168 tablet_bootstrap.cc:492] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap starting.
I20260709 13:05:32.081972 17162 raft_consensus.cc:740] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Initialized, Role: LEARNER
I20260709 13:05:32.083039 17162 consensus_queue.cc:260] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:05:32.083829 17167 ts_tablet_manager.cc:1434] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:05:32.086149 16367 tablet_copy_service.cc:342] P 363bb2f744eb486f9ad726f08214c98e: Request end of tablet copy session 1109f76a0b7b443a84c0327c8707bc63-47342899f1ed4c788d60ea4c5b52969a received from {username='slave'} at 127.0.0.1:33486
I20260709 13:05:32.086683 16367 tablet_copy_service.cc:434] P 363bb2f744eb486f9ad726f08214c98e: ending tablet copy session 1109f76a0b7b443a84c0327c8707bc63-47342899f1ed4c788d60ea4c5b52969a on tablet 47342899f1ed4c788d60ea4c5b52969a with peer 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:05:32.087245 17162 ts_tablet_manager.cc:1434] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:05:32.092998 16293 tablet_copy_service.cc:342] P 0aea40d6e4374085a2e38a70a71f63e3: Request end of tablet copy session 1109f76a0b7b443a84c0327c8707bc63-bb3b9c4ba1f147fc8d9858234bfce423 received from {username='slave'} at 127.0.0.1:42740
I20260709 13:05:32.093544 16293 tablet_copy_service.cc:434] P 0aea40d6e4374085a2e38a70a71f63e3: ending tablet copy session 1109f76a0b7b443a84c0327c8707bc63-bb3b9c4ba1f147fc8d9858234bfce423 on tablet bb3b9c4ba1f147fc8d9858234bfce423 with peer 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:05:32.107293 17168 tablet_bootstrap.cc:492] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:32.108433 17168 tablet_bootstrap.cc:492] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap complete.
I20260709 13:05:32.109274 17168 ts_tablet_manager.cc:1403] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63: Time spent bootstrapping tablet: real 0.028s	user 0.024s	sys 0.004s
I20260709 13:05:32.112426 17168 raft_consensus.cc:359] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:05:32.113322 17168 raft_consensus.cc:740] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Initialized, Role: LEARNER
I20260709 13:05:32.113994 17168 consensus_queue.cc:260] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:05:32.116586 17168 ts_tablet_manager.cc:1434] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:05:32.118673 16217 tablet_copy_service.cc:342] P e10b16d536674c0bb350a31d7ce5ff7f: Request end of tablet copy session 1109f76a0b7b443a84c0327c8707bc63-5063fcda38c2468a8dad5d01023b700a received from {username='slave'} at 127.0.0.1:39674
I20260709 13:05:32.119217 16217 tablet_copy_service.cc:434] P e10b16d536674c0bb350a31d7ce5ff7f: ending tablet copy session 1109f76a0b7b443a84c0327c8707bc63-5063fcda38c2468a8dad5d01023b700a on tablet 5063fcda38c2468a8dad5d01023b700a with peer 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:05:32.157716 16947 raft_consensus.cc:1217] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:32.288851 16947 raft_consensus.cc:1217] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:32.318130 16947 raft_consensus.cc:1217] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:32.526252 16947 raft_consensus.cc:1217] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:32.555977 17175 raft_consensus.cc:1064] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e: attempting to promote NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 to VOTER
I20260709 13:05:32.558995 17175 consensus_queue.cc:237] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:32.570758 16947 raft_consensus.cc:1275] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 LEARNER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:32.572811 17152 consensus_queue.cc:1048] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:32.574162 16278 raft_consensus.cc:1275] T 38b024fb12204d9b9e35d72638671c24 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:32.575747 16207 raft_consensus.cc:1275] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:32.577109 17152 consensus_queue.cc:1048] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:32.579603 17152 consensus_queue.cc:1048] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:32.599280 17152 raft_consensus.cc:2955] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:32.604106 16207 raft_consensus.cc:2955] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:32.602533 16947 raft_consensus.cc:2955] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:32.622071 16278 raft_consensus.cc:2955] T 38b024fb12204d9b9e35d72638671c24 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:32.633299 16106 catalog_manager.cc:5697] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e reported cstate change: config changed from index 2 to 3, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:32.669879 16351 consensus_queue.cc:237] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:32.676366 16947 raft_consensus.cc:1275] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:32.677145 16207 raft_consensus.cc:1275] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:32.678373 17152 consensus_queue.cc:1048] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:32.679788 17175 consensus_queue.cc:1048] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:32.692135 16853 raft_consensus.cc:2955] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:32.697125 16947 raft_consensus.cc:2955] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:32.701282 16206 raft_consensus.cc:2955] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:32.702669 16092 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 38b024fb12204d9b9e35d72638671c24 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:32.711265 16105 catalog_manager.cc:5697] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e reported cstate change: config changed from index 3 to 4, VOTER 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) evicted. New cstate: current_term: 1 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:32.724166 16270 tablet_service.cc:1558] Processing DeleteTablet for tablet 38b024fb12204d9b9e35d72638671c24 with delete_type TABLET_DATA_TOMBSTONED (TS 0aea40d6e4374085a2e38a70a71f63e3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45204
I20260709 13:05:32.751713 17187 tablet_replica.cc:333] T 38b024fb12204d9b9e35d72638671c24 P 0aea40d6e4374085a2e38a70a71f63e3: stopping tablet replica
I20260709 13:05:32.755689 17187 raft_consensus.cc:2243] T 38b024fb12204d9b9e35d72638671c24 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:32.757519 17187 raft_consensus.cc:2272] T 38b024fb12204d9b9e35d72638671c24 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:32.762439 17187 ts_tablet_manager.cc:1916] T 38b024fb12204d9b9e35d72638671c24 P 0aea40d6e4374085a2e38a70a71f63e3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:32.773121 17149 raft_consensus.cc:1064] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3: attempting to promote NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 to VOTER
I20260709 13:05:32.778072 17149 consensus_queue.cc:237] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:32.785442 17187 ts_tablet_manager.cc:1929] T 38b024fb12204d9b9e35d72638671c24 P 0aea40d6e4374085a2e38a70a71f63e3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:32.786322 17187 log.cc:1199] T 38b024fb12204d9b9e35d72638671c24 P 0aea40d6e4374085a2e38a70a71f63e3: Deleting WAL directory at /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602283040513-15057-0/minicluster-data/ts-1-root/wals/38b024fb12204d9b9e35d72638671c24
I20260709 13:05:32.788298 16092 catalog_manager.cc:5028] TS 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): tablet 38b024fb12204d9b9e35d72638671c24 (table test-workload [id=f364cfe226234c5b99453e3013c8717e]) successfully deleted
I20260709 13:05:32.793527 16354 raft_consensus.cc:1275] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:32.794592 16946 raft_consensus.cc:1275] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 LEARNER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:32.796710 17149 consensus_queue.cc:1048] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:32.797497 16206 raft_consensus.cc:1275] T bb3b9c4ba1f147fc8d9858234bfce423 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:32.800350 17149 consensus_queue.cc:1048] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:32.801651 17077 consensus_queue.cc:1048] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:32.822666 17077 raft_consensus.cc:2955] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:32.834757 17186 raft_consensus.cc:1064] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e: attempting to promote NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 to VOTER
I20260709 13:05:32.834152 16354 raft_consensus.cc:2955] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:32.849954 16946 raft_consensus.cc:2955] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:32.869598 17186 consensus_queue.cc:237] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:32.866508 16102 catalog_manager.cc:5697] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: config changed from index 2 to 3, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:32.885476 16946 raft_consensus.cc:1275] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 1 LEARNER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:32.885476 16277 raft_consensus.cc:1275] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:32.889688 17152 consensus_queue.cc:1048] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:32.891041 16853 consensus_queue.cc:1048] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:32.923673 16206 raft_consensus.cc:1275] T 47342899f1ed4c788d60ea4c5b52969a P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:32.926362 16853 consensus_queue.cc:1048] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:32.929669 16207 raft_consensus.cc:2955] T bb3b9c4ba1f147fc8d9858234bfce423 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:32.948417 16277 consensus_queue.cc:237] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:32.957326 16946 raft_consensus.cc:1275] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:32.957983 17152 raft_consensus.cc:2955] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:32.962248 16351 raft_consensus.cc:1275] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:32.963868 17101 consensus_queue.cc:1048] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:32.964896 16946 raft_consensus.cc:2955] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:32.971976 17149 consensus_queue.cc:1048] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:32.974373 17149 raft_consensus.cc:2955] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:32.976871 16947 raft_consensus.cc:2955] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:32.995244 16351 raft_consensus.cc:2955] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:33.005515 16279 raft_consensus.cc:2955] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:33.019223 16102 catalog_manager.cc:5697] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: config changed from index 3 to 4, VOTER e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) evicted. New cstate: current_term: 1 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:33.029517 16201 raft_consensus.cc:2955] T 47342899f1ed4c788d60ea4c5b52969a P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:33.014963 16106 catalog_manager.cc:5697] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e reported cstate change: config changed from index 2 to 3, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:33.035930 16092 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet bb3b9c4ba1f147fc8d9858234bfce423 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:33.036639 16191 tablet_service.cc:1558] Processing DeleteTablet for tablet bb3b9c4ba1f147fc8d9858234bfce423 with delete_type TABLET_DATA_TOMBSTONED (TS e10b16d536674c0bb350a31d7ce5ff7f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60124
I20260709 13:05:33.052845 17198 tablet_replica.cc:333] T bb3b9c4ba1f147fc8d9858234bfce423 P e10b16d536674c0bb350a31d7ce5ff7f: stopping tablet replica
I20260709 13:05:33.079164 17198 raft_consensus.cc:2243] T bb3b9c4ba1f147fc8d9858234bfce423 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:33.080102 17198 raft_consensus.cc:2272] T bb3b9c4ba1f147fc8d9858234bfce423 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:33.088177 17198 ts_tablet_manager.cc:1916] T bb3b9c4ba1f147fc8d9858234bfce423 P e10b16d536674c0bb350a31d7ce5ff7f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:33.088397 16351 consensus_queue.cc:237] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:33.094642 16946 raft_consensus.cc:1275] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:33.094837 16279 raft_consensus.cc:1275] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:33.096699 17152 consensus_queue.cc:1048] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:33.099599 17186 consensus_queue.cc:1048] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:33.111171 17106 raft_consensus.cc:1064] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f: attempting to promote NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 to VOTER
I20260709 13:05:33.113703 17106 consensus_queue.cc:237] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:33.113719 17198 ts_tablet_manager.cc:1929] T bb3b9c4ba1f147fc8d9858234bfce423 P e10b16d536674c0bb350a31d7ce5ff7f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:33.117903 17198 log.cc:1199] T bb3b9c4ba1f147fc8d9858234bfce423 P e10b16d536674c0bb350a31d7ce5ff7f: Deleting WAL directory at /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602283040513-15057-0/minicluster-data/ts-0-root/wals/bb3b9c4ba1f147fc8d9858234bfce423
I20260709 13:05:33.118304 17194 raft_consensus.cc:2955] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:33.120350 16090 catalog_manager.cc:5028] TS e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): tablet bb3b9c4ba1f147fc8d9858234bfce423 (table test-workload [id=f364cfe226234c5b99453e3013c8717e]) successfully deleted
I20260709 13:05:33.120735 16946 raft_consensus.cc:2955] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:33.149561 16277 raft_consensus.cc:2955] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:33.150931 16092 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 47342899f1ed4c788d60ea4c5b52969a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:33.173091 16105 catalog_manager.cc:5697] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e reported cstate change: config changed from index 3 to 4, VOTER e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) evicted. New cstate: current_term: 1 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:33.197417 16946 raft_consensus.cc:1275] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [term 1 LEARNER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:33.200133 16351 raft_consensus.cc:1275] T 5063fcda38c2468a8dad5d01023b700a P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:33.200769 16191 tablet_service.cc:1558] Processing DeleteTablet for tablet 47342899f1ed4c788d60ea4c5b52969a with delete_type TABLET_DATA_TOMBSTONED (TS e10b16d536674c0bb350a31d7ce5ff7f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60124
I20260709 13:05:33.201116 16277 raft_consensus.cc:1275] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:33.201741 17198 tablet_replica.cc:333] T 47342899f1ed4c788d60ea4c5b52969a P e10b16d536674c0bb350a31d7ce5ff7f: stopping tablet replica
I20260709 13:05:33.203151 17198 raft_consensus.cc:2243] T 47342899f1ed4c788d60ea4c5b52969a P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:33.203311 17106 consensus_queue.cc:1048] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:33.206574 17200 consensus_queue.cc:1048] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:33.204106 17198 raft_consensus.cc:2272] T 47342899f1ed4c788d60ea4c5b52969a P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:33.209277 17177 consensus_queue.cc:1048] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:33.215310 17198 ts_tablet_manager.cc:1916] T 47342899f1ed4c788d60ea4c5b52969a P e10b16d536674c0bb350a31d7ce5ff7f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:33.239959 17157 raft_consensus.cc:2955] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:33.252664 16277 raft_consensus.cc:2955] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:33.259276 17198 ts_tablet_manager.cc:1929] T 47342899f1ed4c788d60ea4c5b52969a P e10b16d536674c0bb350a31d7ce5ff7f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:33.259919 17198 log.cc:1199] T 47342899f1ed4c788d60ea4c5b52969a P e10b16d536674c0bb350a31d7ce5ff7f: Deleting WAL directory at /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602283040513-15057-0/minicluster-data/ts-0-root/wals/47342899f1ed4c788d60ea4c5b52969a
I20260709 13:05:33.261586 16090 catalog_manager.cc:5028] TS e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): tablet 47342899f1ed4c788d60ea4c5b52969a (table test-workload [id=f364cfe226234c5b99453e3013c8717e]) successfully deleted
I20260709 13:05:33.273916 16946 raft_consensus.cc:2955] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:33.276614 16103 catalog_manager.cc:5697] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: config changed from index 2 to 3, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:33.285640 16349 raft_consensus.cc:2955] T 5063fcda38c2468a8dad5d01023b700a P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:33.310516 16201 consensus_queue.cc:237] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:33.316977 16277 raft_consensus.cc:1275] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:33.317546 16946 raft_consensus.cc:1275] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:33.318689 17157 consensus_queue.cc:1048] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:33.320191 17200 consensus_queue.cc:1048] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:33.328243 17106 raft_consensus.cc:2955] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:33.329771 16277 raft_consensus.cc:2955] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:33.346071 16090 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5063fcda38c2468a8dad5d01023b700a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:33.360091 16103 catalog_manager.cc:5697] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f reported cstate change: config changed from index 3 to 4, VOTER 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) evicted. New cstate: current_term: 1 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:33.368732 16947 raft_consensus.cc:2955] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:33.383605 16338 tablet_service.cc:1558] Processing DeleteTablet for tablet 5063fcda38c2468a8dad5d01023b700a with delete_type TABLET_DATA_TOMBSTONED (TS 363bb2f744eb486f9ad726f08214c98e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:41820
I20260709 13:05:33.385551 17205 tablet_replica.cc:333] T 5063fcda38c2468a8dad5d01023b700a P 363bb2f744eb486f9ad726f08214c98e: stopping tablet replica
I20260709 13:05:33.386775 17205 raft_consensus.cc:2243] T 5063fcda38c2468a8dad5d01023b700a P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:33.387701 17205 raft_consensus.cc:2272] T 5063fcda38c2468a8dad5d01023b700a P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:33.391957 17205 ts_tablet_manager.cc:1916] T 5063fcda38c2468a8dad5d01023b700a P 363bb2f744eb486f9ad726f08214c98e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:33.412187 17205 ts_tablet_manager.cc:1929] T 5063fcda38c2468a8dad5d01023b700a P 363bb2f744eb486f9ad726f08214c98e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:33.412626 17205 log.cc:1199] T 5063fcda38c2468a8dad5d01023b700a P 363bb2f744eb486f9ad726f08214c98e: Deleting WAL directory at /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602283040513-15057-0/minicluster-data/ts-2-root/wals/5063fcda38c2468a8dad5d01023b700a
I20260709 13:05:33.414268 16092 catalog_manager.cc:5028] TS 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): tablet 5063fcda38c2468a8dad5d01023b700a (table test-workload [id=f364cfe226234c5b99453e3013c8717e]) successfully deleted
I20260709 13:05:34.478520 16354 consensus_queue.cc:237] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:05:34.489114 16277 raft_consensus.cc:1275] T fd0c3c592b464aafaf1d0b94d1e6e360 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:34.491166 17186 consensus_queue.cc:1048] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:34.492436 16201 raft_consensus.cc:1275] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:34.494478 17210 consensus_queue.cc:1048] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:05:34.496270 16322 consensus_peers.cc:597] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e -> Peer 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875): Couldn't send request to peer 1109f76a0b7b443a84c0327c8707bc63. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fd0c3c592b464aafaf1d0b94d1e6e360. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:34.504505 17186 raft_consensus.cc:2955] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:05:34.508039 16201 raft_consensus.cc:2955] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:05:34.508554 16279 raft_consensus.cc:2955] T fd0c3c592b464aafaf1d0b94d1e6e360 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:05:34.535362 16354 consensus_queue.cc:237] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:05:34.535144 16102 catalog_manager.cc:5697] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f reported cstate change: config changed from index -1 to 2, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New cstate: current_term: 1 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:05:34.543967 16279 raft_consensus.cc:1275] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:05:34.544371 16322 consensus_peers.cc:597] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e -> Peer 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875): Couldn't send request to peer 1109f76a0b7b443a84c0327c8707bc63. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7295dce0baa440b8a197da845581ee81. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:34.547598 17213 consensus_queue.cc:1048] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:34.555995 16201 raft_consensus.cc:1275] T 7295dce0baa440b8a197da845581ee81 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:34.558424 17210 consensus_queue.cc:1048] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:34.591562 17210 raft_consensus.cc:2955] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:05:34.606359 16278 raft_consensus.cc:2955] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
W20260709 13:05:34.617460 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:34.618103 16207 consensus_queue.cc:237] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:05:34.622257 16201 raft_consensus.cc:2955] T 7295dce0baa440b8a197da845581ee81 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:05:34.634292 16354 raft_consensus.cc:1275] T 4f72b5892c874917882ef9ee926ce439 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:34.624919 16105 catalog_manager.cc:5697] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e reported cstate change: config changed from index -1 to 2, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New cstate: current_term: 1 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:34.636976 17200 consensus_queue.cc:1048] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:05:34.642849 16173 consensus_peers.cc:597] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f -> Peer 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875): Couldn't send request to peer 1109f76a0b7b443a84c0327c8707bc63. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4f72b5892c874917882ef9ee926ce439. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:34.647583 16279 raft_consensus.cc:1275] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:34.650635 17106 consensus_queue.cc:1048] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:34.654513 17177 raft_consensus.cc:2955] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:05:34.659965 16354 raft_consensus.cc:2955] T 4f72b5892c874917882ef9ee926ce439 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:05:34.673157 16207 consensus_queue.cc:237] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:05:34.680857 16102 catalog_manager.cc:5697] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f reported cstate change: config changed from index -1 to 2, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New cstate: current_term: 1 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:34.683276 16279 raft_consensus.cc:2955] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:05:34.704201 16354 raft_consensus.cc:1275] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:34.706216 17177 consensus_queue.cc:1048] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:34.708827 16278 raft_consensus.cc:1275] T 52982fc727d3451e9c722e63eb4d79ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:05:34.710276 16173 consensus_peers.cc:597] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f -> Peer 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875): Couldn't send request to peer 1109f76a0b7b443a84c0327c8707bc63. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 52982fc727d3451e9c722e63eb4d79ef. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:34.714172 17200 consensus_queue.cc:1048] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:34.736461 17106 raft_consensus.cc:2955] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:05:34.749547 16278 raft_consensus.cc:2955] T 52982fc727d3451e9c722e63eb4d79ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:05:34.768644 16102 catalog_manager.cc:5697] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f reported cstate change: config changed from index -1 to 2, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New cstate: current_term: 1 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:34.791477 16356 raft_consensus.cc:2955] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:05:34.975118 17228 ts_tablet_manager.cc:933] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63: Initiating tablet copy from peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:34.978322 17228 tablet_copy_client.cc:323] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Beginning tablet copy session from remote peer at address 127.14.180.67:46107
I20260709 13:05:34.980509 16367 tablet_copy_service.cc:140] P 363bb2f744eb486f9ad726f08214c98e: Received BeginTabletCopySession request for tablet 7295dce0baa440b8a197da845581ee81 from peer 1109f76a0b7b443a84c0327c8707bc63 ({username='slave'} at 127.0.0.1:33486)
I20260709 13:05:34.981093 16367 tablet_copy_service.cc:161] P 363bb2f744eb486f9ad726f08214c98e: Beginning new tablet copy session on tablet 7295dce0baa440b8a197da845581ee81 from peer 1109f76a0b7b443a84c0327c8707bc63 at {username='slave'} at 127.0.0.1:33486: session id = 1109f76a0b7b443a84c0327c8707bc63-7295dce0baa440b8a197da845581ee81
I20260709 13:05:34.988884 16367 tablet_copy_source_session.cc:215] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:34.993160 17228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7295dce0baa440b8a197da845581ee81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:35.012547 17228 tablet_copy_client.cc:806] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:35.013713 17228 tablet_copy_client.cc:670] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:35.018463 17228 tablet_copy_client.cc:538] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:35.030396 17228 tablet_bootstrap.cc:492] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap starting.
I20260709 13:05:35.075521 17228 tablet_bootstrap.cc:492] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:35.076414 17231 ts_tablet_manager.cc:933] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63: Initiating tablet copy from peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:35.076718 17228 tablet_bootstrap.cc:492] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap complete.
I20260709 13:05:35.077680 17228 ts_tablet_manager.cc:1403] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63: Time spent bootstrapping tablet: real 0.048s	user 0.020s	sys 0.012s
I20260709 13:05:35.079066 17231 tablet_copy_client.cc:323] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Beginning tablet copy session from remote peer at address 127.14.180.67:46107
I20260709 13:05:35.081313 16367 tablet_copy_service.cc:140] P 363bb2f744eb486f9ad726f08214c98e: Received BeginTabletCopySession request for tablet fd0c3c592b464aafaf1d0b94d1e6e360 from peer 1109f76a0b7b443a84c0327c8707bc63 ({username='slave'} at 127.0.0.1:33486)
I20260709 13:05:35.081902 16367 tablet_copy_service.cc:161] P 363bb2f744eb486f9ad726f08214c98e: Beginning new tablet copy session on tablet fd0c3c592b464aafaf1d0b94d1e6e360 from peer 1109f76a0b7b443a84c0327c8707bc63 at {username='slave'} at 127.0.0.1:33486: session id = 1109f76a0b7b443a84c0327c8707bc63-fd0c3c592b464aafaf1d0b94d1e6e360
I20260709 13:05:35.081820 17228 raft_consensus.cc:359] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:05:35.083410 17228 raft_consensus.cc:740] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Initialized, Role: LEARNER
I20260709 13:05:35.084192 17228 consensus_queue.cc:260] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:05:35.088090 17228 ts_tablet_manager.cc:1434] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:05:35.092031 16366 tablet_copy_service.cc:342] P 363bb2f744eb486f9ad726f08214c98e: Request end of tablet copy session 1109f76a0b7b443a84c0327c8707bc63-7295dce0baa440b8a197da845581ee81 received from {username='slave'} at 127.0.0.1:33486
I20260709 13:05:35.092648 16366 tablet_copy_service.cc:434] P 363bb2f744eb486f9ad726f08214c98e: ending tablet copy session 1109f76a0b7b443a84c0327c8707bc63-7295dce0baa440b8a197da845581ee81 on tablet 7295dce0baa440b8a197da845581ee81 with peer 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:05:35.098706 16367 tablet_copy_source_session.cc:215] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:35.104602 17231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd0c3c592b464aafaf1d0b94d1e6e360. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:35.124265 17231 tablet_copy_client.cc:806] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:35.125120 17231 tablet_copy_client.cc:670] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:35.129705 17231 tablet_copy_client.cc:538] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:35.144587 17231 tablet_bootstrap.cc:492] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap starting.
I20260709 13:05:35.166718 17231 tablet_bootstrap.cc:492] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:35.167642 17231 tablet_bootstrap.cc:492] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap complete.
I20260709 13:05:35.168335 17231 ts_tablet_manager.cc:1403] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63: Time spent bootstrapping tablet: real 0.025s	user 0.007s	sys 0.016s
I20260709 13:05:35.171142 17231 raft_consensus.cc:359] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:05:35.172084 17231 raft_consensus.cc:740] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Initialized, Role: LEARNER
I20260709 13:05:35.172873 17231 consensus_queue.cc:260] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:05:35.173520 17228 ts_tablet_manager.cc:933] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63: Initiating tablet copy from peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073)
I20260709 13:05:35.175982 17231 ts_tablet_manager.cc:1434] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.002s
I20260709 13:05:35.195830 16367 tablet_copy_service.cc:342] P 363bb2f744eb486f9ad726f08214c98e: Request end of tablet copy session 1109f76a0b7b443a84c0327c8707bc63-fd0c3c592b464aafaf1d0b94d1e6e360 received from {username='slave'} at 127.0.0.1:33486
I20260709 13:05:35.196326 16367 tablet_copy_service.cc:434] P 363bb2f744eb486f9ad726f08214c98e: ending tablet copy session 1109f76a0b7b443a84c0327c8707bc63-fd0c3c592b464aafaf1d0b94d1e6e360 on tablet fd0c3c592b464aafaf1d0b94d1e6e360 with peer 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:05:35.199299 17228 tablet_copy_client.cc:323] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Beginning tablet copy session from remote peer at address 127.14.180.65:46073
I20260709 13:05:35.202883 16217 tablet_copy_service.cc:140] P e10b16d536674c0bb350a31d7ce5ff7f: Received BeginTabletCopySession request for tablet 4f72b5892c874917882ef9ee926ce439 from peer 1109f76a0b7b443a84c0327c8707bc63 ({username='slave'} at 127.0.0.1:39674)
I20260709 13:05:35.203718 16217 tablet_copy_service.cc:161] P e10b16d536674c0bb350a31d7ce5ff7f: Beginning new tablet copy session on tablet 4f72b5892c874917882ef9ee926ce439 from peer 1109f76a0b7b443a84c0327c8707bc63 at {username='slave'} at 127.0.0.1:39674: session id = 1109f76a0b7b443a84c0327c8707bc63-4f72b5892c874917882ef9ee926ce439
I20260709 13:05:35.219444 16217 tablet_copy_source_session.cc:215] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:35.225376 17228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f72b5892c874917882ef9ee926ce439. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:35.248214 17228 tablet_copy_client.cc:806] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:35.248888 17228 tablet_copy_client.cc:670] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:35.254011 17228 tablet_copy_client.cc:538] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:35.264921 17228 tablet_bootstrap.cc:492] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap starting.
I20260709 13:05:35.287734 17228 tablet_bootstrap.cc:492] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:35.288981 17228 tablet_bootstrap.cc:492] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap complete.
I20260709 13:05:35.289783 17228 ts_tablet_manager.cc:1403] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63: Time spent bootstrapping tablet: real 0.025s	user 0.017s	sys 0.003s
I20260709 13:05:35.293263 17228 raft_consensus.cc:359] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:05:35.294623 17228 raft_consensus.cc:740] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Initialized, Role: LEARNER
I20260709 13:05:35.295421 17228 consensus_queue.cc:260] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:05:35.298190 17228 ts_tablet_manager.cc:1434] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 13:05:35.301994 16217 tablet_copy_service.cc:342] P e10b16d536674c0bb350a31d7ce5ff7f: Request end of tablet copy session 1109f76a0b7b443a84c0327c8707bc63-4f72b5892c874917882ef9ee926ce439 received from {username='slave'} at 127.0.0.1:39674
I20260709 13:05:35.302587 16217 tablet_copy_service.cc:434] P e10b16d536674c0bb350a31d7ce5ff7f: ending tablet copy session 1109f76a0b7b443a84c0327c8707bc63-4f72b5892c874917882ef9ee926ce439 on tablet 4f72b5892c874917882ef9ee926ce439 with peer 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:05:35.308718 17231 ts_tablet_manager.cc:933] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63: Initiating tablet copy from peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073)
I20260709 13:05:35.326767 17231 tablet_copy_client.cc:323] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Beginning tablet copy session from remote peer at address 127.14.180.65:46073
I20260709 13:05:35.328526 16217 tablet_copy_service.cc:140] P e10b16d536674c0bb350a31d7ce5ff7f: Received BeginTabletCopySession request for tablet 52982fc727d3451e9c722e63eb4d79ef from peer 1109f76a0b7b443a84c0327c8707bc63 ({username='slave'} at 127.0.0.1:39674)
I20260709 13:05:35.329142 16217 tablet_copy_service.cc:161] P e10b16d536674c0bb350a31d7ce5ff7f: Beginning new tablet copy session on tablet 52982fc727d3451e9c722e63eb4d79ef from peer 1109f76a0b7b443a84c0327c8707bc63 at {username='slave'} at 127.0.0.1:39674: session id = 1109f76a0b7b443a84c0327c8707bc63-52982fc727d3451e9c722e63eb4d79ef
I20260709 13:05:35.341117 16217 tablet_copy_source_session.cc:215] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:35.344941 17231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52982fc727d3451e9c722e63eb4d79ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:35.363833 17231 tablet_copy_client.cc:806] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:35.364405 17231 tablet_copy_client.cc:670] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:35.368661 17231 tablet_copy_client.cc:538] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:35.379828 17231 tablet_bootstrap.cc:492] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap starting.
I20260709 13:05:35.417284 17231 tablet_bootstrap.cc:492] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:35.418270 17231 tablet_bootstrap.cc:492] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap complete.
I20260709 13:05:35.419023 17231 ts_tablet_manager.cc:1403] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63: Time spent bootstrapping tablet: real 0.039s	user 0.011s	sys 0.015s
I20260709 13:05:35.422791 17231 raft_consensus.cc:359] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:05:35.426319 17231 raft_consensus.cc:740] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Initialized, Role: LEARNER
I20260709 13:05:35.428001 17231 consensus_queue.cc:260] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:05:35.430764 17231 ts_tablet_manager.cc:1434] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:05:35.436311 16217 tablet_copy_service.cc:342] P e10b16d536674c0bb350a31d7ce5ff7f: Request end of tablet copy session 1109f76a0b7b443a84c0327c8707bc63-52982fc727d3451e9c722e63eb4d79ef received from {username='slave'} at 127.0.0.1:39674
I20260709 13:05:35.436780 16217 tablet_copy_service.cc:434] P e10b16d536674c0bb350a31d7ce5ff7f: ending tablet copy session 1109f76a0b7b443a84c0327c8707bc63-52982fc727d3451e9c722e63eb4d79ef on tablet 52982fc727d3451e9c722e63eb4d79ef with peer 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:05:35.443401 16947 raft_consensus.cc:1217] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:35.584605 16947 raft_consensus.cc:1217] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:35.640321 16947 raft_consensus.cc:1217] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:35.818436 16947 raft_consensus.cc:1217] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:35.907435 17210 raft_consensus.cc:1064] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e: attempting to promote NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 to VOTER
I20260709 13:05:35.910267 17210 consensus_queue.cc:237] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:35.919714 16946 raft_consensus.cc:1275] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 LEARNER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:35.921348 16279 raft_consensus.cc:1275] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:35.921649 16205 raft_consensus.cc:1275] T 7295dce0baa440b8a197da845581ee81 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:35.923595 17210 consensus_queue.cc:1048] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:35.924634 17239 consensus_queue.cc:1048] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:35.926767 17240 consensus_queue.cc:1048] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:35.955134 17210 raft_consensus.cc:2955] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:35.966362 16279 raft_consensus.cc:2955] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:35.971930 16946 raft_consensus.cc:2955] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:35.981457 16205 raft_consensus.cc:2955] T 7295dce0baa440b8a197da845581ee81 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:35.989384 16103 catalog_manager.cc:5697] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: config changed from index 2 to 3, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:36.033856 16351 consensus_queue.cc:237] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:36.046181 16279 raft_consensus.cc:1275] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:36.048256 16946 raft_consensus.cc:1275] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:36.050767 17210 consensus_queue.cc:1048] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:36.051808 17240 consensus_queue.cc:1048] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:36.064730 17210 raft_consensus.cc:2955] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:36.068202 16280 raft_consensus.cc:2955] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:36.076396 16946 raft_consensus.cc:2955] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:36.086467 16092 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7295dce0baa440b8a197da845581ee81 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:36.119297 16106 catalog_manager.cc:5697] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: config changed from index 3 to 4, VOTER e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) evicted. New cstate: current_term: 1 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:36.134316 16191 tablet_service.cc:1558] Processing DeleteTablet for tablet 7295dce0baa440b8a197da845581ee81 with delete_type TABLET_DATA_TOMBSTONED (TS e10b16d536674c0bb350a31d7ce5ff7f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60124
I20260709 13:05:36.142361 17252 tablet_replica.cc:333] T 7295dce0baa440b8a197da845581ee81 P e10b16d536674c0bb350a31d7ce5ff7f: stopping tablet replica
I20260709 13:05:36.146643 17252 raft_consensus.cc:2243] T 7295dce0baa440b8a197da845581ee81 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:36.150223 17210 raft_consensus.cc:1064] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e: attempting to promote NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 to VOTER
I20260709 13:05:36.151091 17252 raft_consensus.cc:2272] T 7295dce0baa440b8a197da845581ee81 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:36.155973 17210 consensus_queue.cc:237] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:36.161250 17252 ts_tablet_manager.cc:1916] T 7295dce0baa440b8a197da845581ee81 P e10b16d536674c0bb350a31d7ce5ff7f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:36.183534 16946 raft_consensus.cc:1275] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 LEARNER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:36.186764 16280 raft_consensus.cc:1275] T fd0c3c592b464aafaf1d0b94d1e6e360 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:36.187505 16205 raft_consensus.cc:1275] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:36.190367 17210 consensus_queue.cc:1048] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:36.192091 17240 consensus_queue.cc:1048] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:36.195006 17224 raft_consensus.cc:1064] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f: attempting to promote NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 to VOTER
I20260709 13:05:36.194895 17186 consensus_queue.cc:1048] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:36.198462 17224 consensus_queue.cc:237] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:36.200261 17252 ts_tablet_manager.cc:1929] T 7295dce0baa440b8a197da845581ee81 P e10b16d536674c0bb350a31d7ce5ff7f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:36.214811 17252 log.cc:1199] T 7295dce0baa440b8a197da845581ee81 P e10b16d536674c0bb350a31d7ce5ff7f: Deleting WAL directory at /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602283040513-15057-0/minicluster-data/ts-0-root/wals/7295dce0baa440b8a197da845581ee81
I20260709 13:05:36.217017 16090 catalog_manager.cc:5028] TS e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): tablet 7295dce0baa440b8a197da845581ee81 (table test-workload [id=f364cfe226234c5b99453e3013c8717e]) successfully deleted
I20260709 13:05:36.219812 16947 raft_consensus.cc:1275] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 LEARNER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:36.221932 16356 raft_consensus.cc:1275] T 4f72b5892c874917882ef9ee926ce439 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:36.219051 16280 raft_consensus.cc:1275] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:36.221813 17106 consensus_queue.cc:1048] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:36.225147 17224 consensus_queue.cc:1048] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:36.228608 17177 consensus_queue.cc:1048] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:36.237118 17186 raft_consensus.cc:2955] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:36.238111 16207 raft_consensus.cc:2955] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:36.252509 16946 raft_consensus.cc:2955] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:36.256821 16279 raft_consensus.cc:2955] T fd0c3c592b464aafaf1d0b94d1e6e360 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:36.265230 16102 catalog_manager.cc:5697] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f reported cstate change: config changed from index 2 to 3, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:36.297634 16351 consensus_queue.cc:237] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:36.308024 16201 raft_consensus.cc:1275] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:36.297772 17177 raft_consensus.cc:2955] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:36.313527 17239 consensus_queue.cc:1048] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:36.313165 16354 raft_consensus.cc:2955] T 4f72b5892c874917882ef9ee926ce439 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:36.322892 16946 raft_consensus.cc:1275] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:36.325196 16948 raft_consensus.cc:2955] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:36.336030 16280 raft_consensus.cc:2955] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:36.352312 16106 catalog_manager.cc:5697] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: config changed from index 2 to 3, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:36.326761 17186 consensus_queue.cc:1048] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 13:05:36.362560 17239 raft_consensus.cc:2955] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:36.393990 16092 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet fd0c3c592b464aafaf1d0b94d1e6e360 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:36.395211 16207 raft_consensus.cc:2955] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:36.404747 16948 raft_consensus.cc:2955] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:36.414007 16106 catalog_manager.cc:5697] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e reported cstate change: config changed from index 3 to 4, VOTER 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) evicted. New cstate: current_term: 1 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:36.416772 16201 consensus_queue.cc:237] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:36.428485 16270 tablet_service.cc:1558] Processing DeleteTablet for tablet fd0c3c592b464aafaf1d0b94d1e6e360 with delete_type TABLET_DATA_TOMBSTONED (TS 0aea40d6e4374085a2e38a70a71f63e3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45204
I20260709 13:05:36.434788 16947 raft_consensus.cc:1275] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:36.440727 17224 consensus_queue.cc:1048] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:36.442607 17177 raft_consensus.cc:1064] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f: attempting to promote NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 to VOTER
I20260709 13:05:36.445151 17177 consensus_queue.cc:237] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:36.447227 16280 raft_consensus.cc:1275] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:36.448406 17262 tablet_replica.cc:333] T fd0c3c592b464aafaf1d0b94d1e6e360 P 0aea40d6e4374085a2e38a70a71f63e3: stopping tablet replica
I20260709 13:05:36.457403 17224 consensus_queue.cc:1048] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:36.460973 17200 raft_consensus.cc:2955] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:36.478940 16948 raft_consensus.cc:1275] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [term 1 LEARNER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:36.479666 16947 raft_consensus.cc:2955] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:36.480819 16351 raft_consensus.cc:1275] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:36.482930 17224 consensus_queue.cc:1048] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:36.487691 16277 raft_consensus.cc:2955] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:36.488937 17263 consensus_queue.cc:1048] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:36.499541 16106 catalog_manager.cc:5697] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: config changed from index 3 to 4, VOTER 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) evicted. New cstate: current_term: 1 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:36.501323 17262 raft_consensus.cc:2243] T fd0c3c592b464aafaf1d0b94d1e6e360 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:36.505733 17262 raft_consensus.cc:2272] T fd0c3c592b464aafaf1d0b94d1e6e360 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:36.514933 16280 raft_consensus.cc:1275] T 52982fc727d3451e9c722e63eb4d79ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:36.520669 16338 tablet_service.cc:1558] Processing DeleteTablet for tablet 4f72b5892c874917882ef9ee926ce439 with delete_type TABLET_DATA_TOMBSTONED (TS 363bb2f744eb486f9ad726f08214c98e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:41820
I20260709 13:05:36.526489 17267 tablet_replica.cc:333] T 4f72b5892c874917882ef9ee926ce439 P 363bb2f744eb486f9ad726f08214c98e: stopping tablet replica
I20260709 13:05:36.527118 17262 ts_tablet_manager.cc:1916] T fd0c3c592b464aafaf1d0b94d1e6e360 P 0aea40d6e4374085a2e38a70a71f63e3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:36.529187 17267 raft_consensus.cc:2243] T 4f72b5892c874917882ef9ee926ce439 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:36.530577 17267 raft_consensus.cc:2272] T 4f72b5892c874917882ef9ee926ce439 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:36.533962 16090 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4f72b5892c874917882ef9ee926ce439 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:36.537016 17106 consensus_queue.cc:1048] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:36.567319 17241 raft_consensus.cc:2955] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:36.578493 17267 ts_tablet_manager.cc:1916] T 4f72b5892c874917882ef9ee926ce439 P 363bb2f744eb486f9ad726f08214c98e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:36.577955 16947 raft_consensus.cc:2955] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:36.582338 16277 raft_consensus.cc:2955] T 52982fc727d3451e9c722e63eb4d79ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:36.615289 16102 catalog_manager.cc:5697] T 52982fc727d3451e9c722e63eb4d79ef P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: config changed from index 2 to 3, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:36.620702 17262 ts_tablet_manager.cc:1929] T fd0c3c592b464aafaf1d0b94d1e6e360 P 0aea40d6e4374085a2e38a70a71f63e3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:36.620916 17267 ts_tablet_manager.cc:1929] T 4f72b5892c874917882ef9ee926ce439 P 363bb2f744eb486f9ad726f08214c98e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:36.621248 17262 log.cc:1199] T fd0c3c592b464aafaf1d0b94d1e6e360 P 0aea40d6e4374085a2e38a70a71f63e3: Deleting WAL directory at /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602283040513-15057-0/minicluster-data/ts-1-root/wals/fd0c3c592b464aafaf1d0b94d1e6e360
I20260709 13:05:36.621420 17267 log.cc:1199] T 4f72b5892c874917882ef9ee926ce439 P 363bb2f744eb486f9ad726f08214c98e: Deleting WAL directory at /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602283040513-15057-0/minicluster-data/ts-2-root/wals/4f72b5892c874917882ef9ee926ce439
I20260709 13:05:36.623153 16092 catalog_manager.cc:5028] TS 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): tablet fd0c3c592b464aafaf1d0b94d1e6e360 (table test-workload [id=f364cfe226234c5b99453e3013c8717e]) successfully deleted
I20260709 13:05:36.625167 16092 catalog_manager.cc:5028] TS 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): tablet 4f72b5892c874917882ef9ee926ce439 (table test-workload [id=f364cfe226234c5b99453e3013c8717e]) successfully deleted
I20260709 13:05:36.632395 16351 raft_consensus.cc:2955] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:36.651842 16201 consensus_queue.cc:237] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:36.662317 16947 raft_consensus.cc:1275] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:36.668372 16354 raft_consensus.cc:1275] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:36.670025 17241 consensus_queue.cc:1048] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:36.675220 17263 consensus_queue.cc:1048] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:36.684532 17106 raft_consensus.cc:2955] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:36.690786 16948 raft_consensus.cc:2955] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:36.694684 16090 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 52982fc727d3451e9c722e63eb4d79ef with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:36.703770 16356 raft_consensus.cc:2955] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:36.708837 16106 catalog_manager.cc:5697] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: config changed from index 3 to 4, VOTER 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) evicted. New cstate: current_term: 1 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:36.720607 16270 tablet_service.cc:1558] Processing DeleteTablet for tablet 52982fc727d3451e9c722e63eb4d79ef with delete_type TABLET_DATA_TOMBSTONED (TS 0aea40d6e4374085a2e38a70a71f63e3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45204
I20260709 13:05:36.727526 17262 tablet_replica.cc:333] T 52982fc727d3451e9c722e63eb4d79ef P 0aea40d6e4374085a2e38a70a71f63e3: stopping tablet replica
I20260709 13:05:36.728905 17262 raft_consensus.cc:2243] T 52982fc727d3451e9c722e63eb4d79ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:36.729732 17262 raft_consensus.cc:2272] T 52982fc727d3451e9c722e63eb4d79ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:36.736424 17262 ts_tablet_manager.cc:1916] T 52982fc727d3451e9c722e63eb4d79ef P 0aea40d6e4374085a2e38a70a71f63e3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:36.752996 17262 ts_tablet_manager.cc:1929] T 52982fc727d3451e9c722e63eb4d79ef P 0aea40d6e4374085a2e38a70a71f63e3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:36.753433 17262 log.cc:1199] T 52982fc727d3451e9c722e63eb4d79ef P 0aea40d6e4374085a2e38a70a71f63e3: Deleting WAL directory at /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602283040513-15057-0/minicluster-data/ts-1-root/wals/52982fc727d3451e9c722e63eb4d79ef
I20260709 13:05:36.755584 16092 catalog_manager.cc:5028] TS 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): tablet 52982fc727d3451e9c722e63eb4d79ef (table test-workload [id=f364cfe226234c5b99453e3013c8717e]) successfully deleted
I20260709 13:05:37.817456 16201 consensus_queue.cc:237] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
W20260709 13:05:37.824615 16173 consensus_peers.cc:597] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f -> Peer 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875): Couldn't send request to peer 1109f76a0b7b443a84c0327c8707bc63. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f022e2e63ae4461d834e476ff2666991. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:37.824714 16277 raft_consensus.cc:1275] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:37.825062 16354 raft_consensus.cc:1275] T f022e2e63ae4461d834e476ff2666991 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:37.826195 17224 consensus_queue.cc:1048] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:37.827329 17271 consensus_queue.cc:1048] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:37.838853 17271 raft_consensus.cc:2955] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:05:37.843852 16354 raft_consensus.cc:2955] T f022e2e63ae4461d834e476ff2666991 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:05:37.849932 16280 raft_consensus.cc:2955] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:05:37.862056 16106 catalog_manager.cc:5697] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f reported cstate change: config changed from index -1 to 2, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New cstate: current_term: 1 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:37.863843 16277 consensus_queue.cc:237] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:05:37.880738 16354 raft_consensus.cc:1275] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:37.883328 17269 consensus_queue.cc:1048] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:37.888257 16205 raft_consensus.cc:1275] T 26565509c81343bc818483042146461a P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:37.890486 17207 consensus_queue.cc:1048] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:05:37.894196 16248 consensus_peers.cc:597] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 -> Peer 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875): Couldn't send request to peer 1109f76a0b7b443a84c0327c8707bc63. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 26565509c81343bc818483042146461a. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:37.945318 17207 raft_consensus.cc:2955] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:05:37.947443 16205 raft_consensus.cc:2955] T 26565509c81343bc818483042146461a P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:05:37.962003 16354 raft_consensus.cc:2955] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:05:37.974915 16356 consensus_queue.cc:237] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:05:37.988754 16105 catalog_manager.cc:5697] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: config changed from index -1 to 2, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New cstate: current_term: 1 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:37.995947 16277 raft_consensus.cc:1275] T ccde1e8182914560a3c1df0312e6a2b2 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:37.997530 17240 consensus_queue.cc:1048] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:05:38.001096 16322 consensus_peers.cc:597] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e -> Peer 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875): Couldn't send request to peer 1109f76a0b7b443a84c0327c8707bc63. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ccde1e8182914560a3c1df0312e6a2b2. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:38.001221 16205 raft_consensus.cc:1275] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:38.005955 17240 consensus_queue.cc:1048] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:38.017870 17186 raft_consensus.cc:2955] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:05:38.028045 16280 raft_consensus.cc:2955] T ccde1e8182914560a3c1df0312e6a2b2 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:05:38.035434 16205 raft_consensus.cc:2955] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:05:38.044561 16279 consensus_queue.cc:237] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:05:38.044392 16105 catalog_manager.cc:5697] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e reported cstate change: config changed from index -1 to 2, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New cstate: current_term: 1 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:38.068126 16351 raft_consensus.cc:1275] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:05:38.069157 16248 consensus_peers.cc:597] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 -> Peer 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875): Couldn't send request to peer 1109f76a0b7b443a84c0327c8707bc63. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 39dd6382a0304387a1341bcc36471cbf. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:38.072536 16205 raft_consensus.cc:1275] T 39dd6382a0304387a1341bcc36471cbf P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:38.073951 17207 consensus_queue.cc:1048] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:38.076292 17077 consensus_queue.cc:1048] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:38.089200 17269 raft_consensus.cc:2955] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:05:38.097954 16354 raft_consensus.cc:2955] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:05:38.101366 16201 raft_consensus.cc:2955] T 39dd6382a0304387a1341bcc36471cbf P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:05:38.117210 16102 catalog_manager.cc:5697] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e reported cstate change: config changed from index -1 to 2, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New cstate: current_term: 1 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:05:38.304394 17292 ts_tablet_manager.cc:933] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63: Initiating tablet copy from peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073)
I20260709 13:05:38.306411 17292 tablet_copy_client.cc:323] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Beginning tablet copy session from remote peer at address 127.14.180.65:46073
I20260709 13:05:38.308161 16217 tablet_copy_service.cc:140] P e10b16d536674c0bb350a31d7ce5ff7f: Received BeginTabletCopySession request for tablet f022e2e63ae4461d834e476ff2666991 from peer 1109f76a0b7b443a84c0327c8707bc63 ({username='slave'} at 127.0.0.1:39674)
I20260709 13:05:38.308668 16217 tablet_copy_service.cc:161] P e10b16d536674c0bb350a31d7ce5ff7f: Beginning new tablet copy session on tablet f022e2e63ae4461d834e476ff2666991 from peer 1109f76a0b7b443a84c0327c8707bc63 at {username='slave'} at 127.0.0.1:39674: session id = 1109f76a0b7b443a84c0327c8707bc63-f022e2e63ae4461d834e476ff2666991
I20260709 13:05:38.315863 16217 tablet_copy_source_session.cc:215] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:38.319360 17292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f022e2e63ae4461d834e476ff2666991. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:38.334069 17292 tablet_copy_client.cc:806] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:38.334842 17292 tablet_copy_client.cc:670] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:38.339120 17292 tablet_copy_client.cc:538] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:38.350180 17292 tablet_bootstrap.cc:492] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap starting.
I20260709 13:05:38.410202 17292 tablet_bootstrap.cc:492] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:38.411420 17292 tablet_bootstrap.cc:492] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap complete.
I20260709 13:05:38.412277 17292 ts_tablet_manager.cc:1403] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63: Time spent bootstrapping tablet: real 0.063s	user 0.034s	sys 0.010s
I20260709 13:05:38.415625 17292 raft_consensus.cc:359] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:05:38.416635 17292 raft_consensus.cc:740] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Initialized, Role: LEARNER
I20260709 13:05:38.417456 17292 consensus_queue.cc:260] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:05:38.431223 17292 ts_tablet_manager.cc:1434] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63: Time spent starting tablet: real 0.019s	user 0.014s	sys 0.000s
I20260709 13:05:38.433707 17295 ts_tablet_manager.cc:933] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63: Initiating tablet copy from peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:38.472929 17295 tablet_copy_client.cc:323] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Beginning tablet copy session from remote peer at address 127.14.180.66:45823
I20260709 13:05:38.482947 16293 tablet_copy_service.cc:140] P 0aea40d6e4374085a2e38a70a71f63e3: Received BeginTabletCopySession request for tablet 26565509c81343bc818483042146461a from peer 1109f76a0b7b443a84c0327c8707bc63 ({username='slave'} at 127.0.0.1:42740)
I20260709 13:05:38.483650 16293 tablet_copy_service.cc:161] P 0aea40d6e4374085a2e38a70a71f63e3: Beginning new tablet copy session on tablet 26565509c81343bc818483042146461a from peer 1109f76a0b7b443a84c0327c8707bc63 at {username='slave'} at 127.0.0.1:42740: session id = 1109f76a0b7b443a84c0327c8707bc63-26565509c81343bc818483042146461a
I20260709 13:05:38.504051 16293 tablet_copy_source_session.cc:215] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:38.524189 17295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26565509c81343bc818483042146461a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:38.534945 17298 ts_tablet_manager.cc:933] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63: Initiating tablet copy from peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:38.538684 16217 tablet_copy_service.cc:342] P e10b16d536674c0bb350a31d7ce5ff7f: Request end of tablet copy session 1109f76a0b7b443a84c0327c8707bc63-f022e2e63ae4461d834e476ff2666991 received from {username='slave'} at 127.0.0.1:39674
I20260709 13:05:38.539225 16217 tablet_copy_service.cc:434] P e10b16d536674c0bb350a31d7ce5ff7f: ending tablet copy session 1109f76a0b7b443a84c0327c8707bc63-f022e2e63ae4461d834e476ff2666991 on tablet f022e2e63ae4461d834e476ff2666991 with peer 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:05:38.548902 17298 tablet_copy_client.cc:323] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Beginning tablet copy session from remote peer at address 127.14.180.67:46107
I20260709 13:05:38.554823 16367 tablet_copy_service.cc:140] P 363bb2f744eb486f9ad726f08214c98e: Received BeginTabletCopySession request for tablet ccde1e8182914560a3c1df0312e6a2b2 from peer 1109f76a0b7b443a84c0327c8707bc63 ({username='slave'} at 127.0.0.1:33486)
I20260709 13:05:38.555512 16367 tablet_copy_service.cc:161] P 363bb2f744eb486f9ad726f08214c98e: Beginning new tablet copy session on tablet ccde1e8182914560a3c1df0312e6a2b2 from peer 1109f76a0b7b443a84c0327c8707bc63 at {username='slave'} at 127.0.0.1:33486: session id = 1109f76a0b7b443a84c0327c8707bc63-ccde1e8182914560a3c1df0312e6a2b2
I20260709 13:05:38.557801 17295 tablet_copy_client.cc:806] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:38.558483 17295 tablet_copy_client.cc:670] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:38.571600 16367 tablet_copy_source_session.cc:215] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:38.572361 17295 tablet_copy_client.cc:538] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:38.579389 17298 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccde1e8182914560a3c1df0312e6a2b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:38.586246 17295 tablet_bootstrap.cc:492] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap starting.
I20260709 13:05:38.610487 17298 tablet_copy_client.cc:806] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:38.611212 17298 tablet_copy_client.cc:670] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:38.615691 17292 ts_tablet_manager.cc:933] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63: Initiating tablet copy from peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:38.616066 17298 tablet_copy_client.cc:538] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:38.625916 17295 tablet_bootstrap.cc:492] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:38.625255 17292 tablet_copy_client.cc:323] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Beginning tablet copy session from remote peer at address 127.14.180.66:45823
I20260709 13:05:38.627986 17295 tablet_bootstrap.cc:492] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap complete.
I20260709 13:05:38.628168 17298 tablet_bootstrap.cc:492] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap starting.
I20260709 13:05:38.628274 16293 tablet_copy_service.cc:140] P 0aea40d6e4374085a2e38a70a71f63e3: Received BeginTabletCopySession request for tablet 39dd6382a0304387a1341bcc36471cbf from peer 1109f76a0b7b443a84c0327c8707bc63 ({username='slave'} at 127.0.0.1:42740)
I20260709 13:05:38.629118 17295 ts_tablet_manager.cc:1403] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63: Time spent bootstrapping tablet: real 0.043s	user 0.018s	sys 0.014s
I20260709 13:05:38.629313 16293 tablet_copy_service.cc:161] P 0aea40d6e4374085a2e38a70a71f63e3: Beginning new tablet copy session on tablet 39dd6382a0304387a1341bcc36471cbf from peer 1109f76a0b7b443a84c0327c8707bc63 at {username='slave'} at 127.0.0.1:42740: session id = 1109f76a0b7b443a84c0327c8707bc63-39dd6382a0304387a1341bcc36471cbf
I20260709 13:05:38.633100 17295 raft_consensus.cc:359] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:05:38.634126 17295 raft_consensus.cc:740] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Initialized, Role: LEARNER
I20260709 13:05:38.634876 17295 consensus_queue.cc:260] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:05:38.637856 17295 ts_tablet_manager.cc:1434] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260709 13:05:38.640513 16292 tablet_copy_service.cc:342] P 0aea40d6e4374085a2e38a70a71f63e3: Request end of tablet copy session 1109f76a0b7b443a84c0327c8707bc63-26565509c81343bc818483042146461a received from {username='slave'} at 127.0.0.1:42740
I20260709 13:05:38.641273 16292 tablet_copy_service.cc:434] P 0aea40d6e4374085a2e38a70a71f63e3: ending tablet copy session 1109f76a0b7b443a84c0327c8707bc63-26565509c81343bc818483042146461a on tablet 26565509c81343bc818483042146461a with peer 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:05:38.646260 16293 tablet_copy_source_session.cc:215] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:38.655463 17292 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39dd6382a0304387a1341bcc36471cbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:38.682142 17292 tablet_copy_client.cc:806] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:38.682993 17292 tablet_copy_client.cc:670] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:38.686245 17298 tablet_bootstrap.cc:492] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:38.687247 17298 tablet_bootstrap.cc:492] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap complete.
I20260709 13:05:38.688016 17298 ts_tablet_manager.cc:1403] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63: Time spent bootstrapping tablet: real 0.060s	user 0.018s	sys 0.010s
I20260709 13:05:38.691489 17298 raft_consensus.cc:359] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:05:38.692414 17298 raft_consensus.cc:740] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Initialized, Role: LEARNER
I20260709 13:05:38.693411 17292 tablet_copy_client.cc:538] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:38.693137 17298 consensus_queue.cc:260] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:05:38.695851 17298 ts_tablet_manager.cc:1434] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.002s
I20260709 13:05:38.698046 16367 tablet_copy_service.cc:342] P 363bb2f744eb486f9ad726f08214c98e: Request end of tablet copy session 1109f76a0b7b443a84c0327c8707bc63-ccde1e8182914560a3c1df0312e6a2b2 received from {username='slave'} at 127.0.0.1:33486
I20260709 13:05:38.698599 16367 tablet_copy_service.cc:434] P 363bb2f744eb486f9ad726f08214c98e: ending tablet copy session 1109f76a0b7b443a84c0327c8707bc63-ccde1e8182914560a3c1df0312e6a2b2 on tablet ccde1e8182914560a3c1df0312e6a2b2 with peer 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:05:38.710096 17292 tablet_bootstrap.cc:492] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap starting.
I20260709 13:05:38.748768 16946 raft_consensus.cc:1217] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:38.752193 17292 tablet_bootstrap.cc:492] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:38.753180 17292 tablet_bootstrap.cc:492] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap complete.
I20260709 13:05:38.753917 17292 ts_tablet_manager.cc:1403] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63: Time spent bootstrapping tablet: real 0.044s	user 0.021s	sys 0.003s
I20260709 13:05:38.757194 17292 raft_consensus.cc:359] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:05:38.758049 17292 raft_consensus.cc:740] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Initialized, Role: LEARNER
I20260709 13:05:38.758750 17292 consensus_queue.cc:260] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:05:38.761298 17292 ts_tablet_manager.cc:1434] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
I20260709 13:05:38.766817 16293 tablet_copy_service.cc:342] P 0aea40d6e4374085a2e38a70a71f63e3: Request end of tablet copy session 1109f76a0b7b443a84c0327c8707bc63-39dd6382a0304387a1341bcc36471cbf received from {username='slave'} at 127.0.0.1:42740
I20260709 13:05:38.767346 16293 tablet_copy_service.cc:434] P 0aea40d6e4374085a2e38a70a71f63e3: ending tablet copy session 1109f76a0b7b443a84c0327c8707bc63-39dd6382a0304387a1341bcc36471cbf on tablet 39dd6382a0304387a1341bcc36471cbf with peer 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:05:38.941046 16946 raft_consensus.cc:1217] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:39.092679 16946 raft_consensus.cc:1217] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:39.175285 16946 raft_consensus.cc:1217] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:39.322206 17274 raft_consensus.cc:1064] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f: attempting to promote NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 to VOTER
I20260709 13:05:39.326215 17274 consensus_queue.cc:237] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:39.336812 16279 raft_consensus.cc:1275] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:39.339526 17274 consensus_queue.cc:1048] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:39.336812 16946 raft_consensus.cc:1275] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 LEARNER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:39.344305 16356 raft_consensus.cc:1275] T f022e2e63ae4461d834e476ff2666991 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:39.348956 17271 consensus_queue.cc:1048] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:39.351759 17274 consensus_queue.cc:1048] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 13:05:39.369622 16946 raft_consensus.cc:2955] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:39.367262 17304 raft_consensus.cc:2955] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:39.401692 16105 catalog_manager.cc:5697] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: config changed from index 2 to 3, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:39.401604 16356 raft_consensus.cc:2955] T f022e2e63ae4461d834e476ff2666991 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:39.406313 16279 raft_consensus.cc:2955] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:39.467052 16201 consensus_queue.cc:237] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:39.486308 16947 raft_consensus.cc:1275] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:39.487854 17224 consensus_queue.cc:1048] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:39.494062 16279 raft_consensus.cc:1275] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:39.495543 17271 raft_consensus.cc:2955] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:39.497875 17274 consensus_queue.cc:1048] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:39.502836 16279 raft_consensus.cc:2955] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:39.507512 16090 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f022e2e63ae4461d834e476ff2666991 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:39.510094 16947 raft_consensus.cc:2955] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:39.523891 16102 catalog_manager.cc:5697] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f reported cstate change: config changed from index 3 to 4, VOTER 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) evicted. New cstate: current_term: 1 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:39.542037 16338 tablet_service.cc:1558] Processing DeleteTablet for tablet f022e2e63ae4461d834e476ff2666991 with delete_type TABLET_DATA_TOMBSTONED (TS 363bb2f744eb486f9ad726f08214c98e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:41820
I20260709 13:05:39.549727 17278 raft_consensus.cc:1064] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3: attempting to promote NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 to VOTER
I20260709 13:05:39.552767 17278 consensus_queue.cc:237] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:39.569571 16354 raft_consensus.cc:1275] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:39.571856 16201 raft_consensus.cc:1275] T 26565509c81343bc818483042146461a P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:39.572003 16946 raft_consensus.cc:1275] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 1 LEARNER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:39.572003 17278 consensus_queue.cc:1048] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:05:39.575806 17269 consensus_queue.cc:1048] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:39.580029 17313 tablet_replica.cc:333] T f022e2e63ae4461d834e476ff2666991 P 363bb2f744eb486f9ad726f08214c98e: stopping tablet replica
I20260709 13:05:39.583163 17207 consensus_queue.cc:1048] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:39.589255 17313 raft_consensus.cc:2243] T f022e2e63ae4461d834e476ff2666991 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:39.590358 17313 raft_consensus.cc:2272] T f022e2e63ae4461d834e476ff2666991 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:39.598495 17186 raft_consensus.cc:1064] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e: attempting to promote NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 to VOTER
I20260709 13:05:39.600620 17313 ts_tablet_manager.cc:1916] T f022e2e63ae4461d834e476ff2666991 P 363bb2f744eb486f9ad726f08214c98e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:39.601286 17186 consensus_queue.cc:237] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:39.621508 17313 ts_tablet_manager.cc:1929] T f022e2e63ae4461d834e476ff2666991 P 363bb2f744eb486f9ad726f08214c98e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:39.622175 17313 log.cc:1199] T f022e2e63ae4461d834e476ff2666991 P 363bb2f744eb486f9ad726f08214c98e: Deleting WAL directory at /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602283040513-15057-0/minicluster-data/ts-2-root/wals/f022e2e63ae4461d834e476ff2666991
I20260709 13:05:39.621901 17278 raft_consensus.cc:2955] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:39.624401 16092 catalog_manager.cc:5028] TS 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): tablet f022e2e63ae4461d834e476ff2666991 (table test-workload [id=f364cfe226234c5b99453e3013c8717e]) successfully deleted
I20260709 13:05:39.639881 16277 raft_consensus.cc:1275] T ccde1e8182914560a3c1df0312e6a2b2 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:39.638945 16356 raft_consensus.cc:2955] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:39.641343 16946 raft_consensus.cc:1275] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 LEARNER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:39.643378 17288 consensus_queue.cc:1048] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:39.646183 17288 consensus_queue.cc:1048] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:39.655988 17077 raft_consensus.cc:1064] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3: attempting to promote NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 to VOTER
I20260709 13:05:39.656069 16947 raft_consensus.cc:2955] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:39.658481 17077 consensus_queue.cc:237] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:39.664353 16201 raft_consensus.cc:2955] T 26565509c81343bc818483042146461a P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:39.670506 16207 raft_consensus.cc:1275] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:39.672475 17288 consensus_queue.cc:1048] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:39.671955 16106 catalog_manager.cc:5697] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e reported cstate change: config changed from index 2 to 3, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:39.701778 17240 raft_consensus.cc:2955] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:39.707705 16946 raft_consensus.cc:1275] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 1 LEARNER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:39.709192 16356 raft_consensus.cc:1275] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:39.718597 17207 consensus_queue.cc:1048] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:39.725065 16277 consensus_queue.cc:237] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:39.724997 16106 catalog_manager.cc:5697] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e reported cstate change: config changed from index 2 to 3, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:39.728621 16201 raft_consensus.cc:1275] T 39dd6382a0304387a1341bcc36471cbf P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:39.730768 17269 consensus_queue.cc:1048] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:39.737457 16948 raft_consensus.cc:1275] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:39.737167 17269 consensus_queue.cc:1048] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:05:39.737679 16277 raft_consensus.cc:2955] T ccde1e8182914560a3c1df0312e6a2b2 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:39.744066 17207 consensus_queue.cc:1048] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:39.765758 16353 consensus_queue.cc:237] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:39.748567 16206 raft_consensus.cc:2955] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:39.749789 16356 raft_consensus.cc:1275] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:39.774569 17269 raft_consensus.cc:2955] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:39.752321 16947 raft_consensus.cc:2955] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:39.781534 16949 raft_consensus.cc:2955] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:39.789904 17077 raft_consensus.cc:2955] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:39.812479 17327 consensus_queue.cc:1048] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:39.815304 16092 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 26565509c81343bc818483042146461a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:39.822777 16949 raft_consensus.cc:2955] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:39.826040 16106 catalog_manager.cc:5697] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: config changed from index 3 to 4, VOTER e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) evicted. New cstate: current_term: 1 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:39.829336 16205 raft_consensus.cc:1275] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:39.835949 16206 raft_consensus.cc:2955] T 39dd6382a0304387a1341bcc36471cbf P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:39.844866 17288 consensus_queue.cc:1048] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:05:39.897591 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 46941us
I20260709 13:05:39.945449 16353 raft_consensus.cc:2955] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
W20260709 13:05:39.958758 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 60006.8us
I20260709 13:05:39.960534 16945 raft_consensus.cc:1275] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:39.967114 16191 tablet_service.cc:1558] Processing DeleteTablet for tablet 26565509c81343bc818483042146461a with delete_type TABLET_DATA_TOMBSTONED (TS e10b16d536674c0bb350a31d7ce5ff7f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60124
I20260709 13:05:39.974057 17331 tablet_replica.cc:333] T 26565509c81343bc818483042146461a P e10b16d536674c0bb350a31d7ce5ff7f: stopping tablet replica
I20260709 13:05:39.978402 17331 raft_consensus.cc:2243] T 26565509c81343bc818483042146461a P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:39.979871 16106 catalog_manager.cc:5697] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: config changed from index 2 to 3, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:39.985280 17186 raft_consensus.cc:2955] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:39.992672 17331 raft_consensus.cc:2272] T 26565509c81343bc818483042146461a P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:39.997350 17331 ts_tablet_manager.cc:1916] T 26565509c81343bc818483042146461a P e10b16d536674c0bb350a31d7ce5ff7f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:40.020823 17331 ts_tablet_manager.cc:1929] T 26565509c81343bc818483042146461a P e10b16d536674c0bb350a31d7ce5ff7f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:40.021302 17331 log.cc:1199] T 26565509c81343bc818483042146461a P e10b16d536674c0bb350a31d7ce5ff7f: Deleting WAL directory at /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602283040513-15057-0/minicluster-data/ts-0-root/wals/26565509c81343bc818483042146461a
I20260709 13:05:40.023526 16090 catalog_manager.cc:5028] TS e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): tablet 26565509c81343bc818483042146461a (table test-workload [id=f364cfe226234c5b99453e3013c8717e]) successfully deleted
I20260709 13:05:40.024274 16201 raft_consensus.cc:2955] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:40.027546 16092 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ccde1e8182914560a3c1df0312e6a2b2 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:05:40.028821 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 53221.9us
I20260709 13:05:40.037479 17288 consensus_queue.cc:1048] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:40.067968 16949 raft_consensus.cc:2955] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:40.084492 16280 consensus_queue.cc:237] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:40.089291 16102 catalog_manager.cc:5697] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: config changed from index 3 to 4, VOTER 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) evicted. New cstate: current_term: 1 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:40.107805 16270 tablet_service.cc:1558] Processing DeleteTablet for tablet ccde1e8182914560a3c1df0312e6a2b2 with delete_type TABLET_DATA_TOMBSTONED (TS 0aea40d6e4374085a2e38a70a71f63e3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45204
I20260709 13:05:40.111708 17333 tablet_replica.cc:333] T ccde1e8182914560a3c1df0312e6a2b2 P 0aea40d6e4374085a2e38a70a71f63e3: stopping tablet replica
I20260709 13:05:40.114426 16351 raft_consensus.cc:2955] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:40.127364 16949 raft_consensus.cc:1275] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:40.142789 16353 raft_consensus.cc:1275] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:40.143086 17278 consensus_queue.cc:1048] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:40.148178 17278 consensus_queue.cc:1048] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:40.153338 17333 raft_consensus.cc:2243] T ccde1e8182914560a3c1df0312e6a2b2 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:40.154206 17333 raft_consensus.cc:2272] T ccde1e8182914560a3c1df0312e6a2b2 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:40.157248 17207 raft_consensus.cc:2955] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:40.158880 16949 raft_consensus.cc:2955] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:40.166260 16353 raft_consensus.cc:2955] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:40.168763 16092 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 39dd6382a0304387a1341bcc36471cbf with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:40.183445 17333 ts_tablet_manager.cc:1916] T ccde1e8182914560a3c1df0312e6a2b2 P 0aea40d6e4374085a2e38a70a71f63e3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:40.184768 16106 catalog_manager.cc:5697] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e reported cstate change: config changed from index 3 to 4, VOTER e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) evicted. New cstate: current_term: 1 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:40.208855 16191 tablet_service.cc:1558] Processing DeleteTablet for tablet 39dd6382a0304387a1341bcc36471cbf with delete_type TABLET_DATA_TOMBSTONED (TS e10b16d536674c0bb350a31d7ce5ff7f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60124
I20260709 13:05:40.209909 17331 tablet_replica.cc:333] T 39dd6382a0304387a1341bcc36471cbf P e10b16d536674c0bb350a31d7ce5ff7f: stopping tablet replica
I20260709 13:05:40.211072 17331 raft_consensus.cc:2243] T 39dd6382a0304387a1341bcc36471cbf P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:40.211862 17331 raft_consensus.cc:2272] T 39dd6382a0304387a1341bcc36471cbf P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:40.217845 17333 ts_tablet_manager.cc:1929] T ccde1e8182914560a3c1df0312e6a2b2 P 0aea40d6e4374085a2e38a70a71f63e3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:40.218400 17333 log.cc:1199] T ccde1e8182914560a3c1df0312e6a2b2 P 0aea40d6e4374085a2e38a70a71f63e3: Deleting WAL directory at /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602283040513-15057-0/minicluster-data/ts-1-root/wals/ccde1e8182914560a3c1df0312e6a2b2
I20260709 13:05:40.218647 17331 ts_tablet_manager.cc:1916] T 39dd6382a0304387a1341bcc36471cbf P e10b16d536674c0bb350a31d7ce5ff7f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:40.224267 16092 catalog_manager.cc:5028] TS 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): tablet ccde1e8182914560a3c1df0312e6a2b2 (table test-workload [id=f364cfe226234c5b99453e3013c8717e]) successfully deleted
I20260709 13:05:40.240785 17331 ts_tablet_manager.cc:1929] T 39dd6382a0304387a1341bcc36471cbf P e10b16d536674c0bb350a31d7ce5ff7f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:40.241284 17331 log.cc:1199] T 39dd6382a0304387a1341bcc36471cbf P e10b16d536674c0bb350a31d7ce5ff7f: Deleting WAL directory at /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602283040513-15057-0/minicluster-data/ts-0-root/wals/39dd6382a0304387a1341bcc36471cbf
I20260709 13:05:40.242826 16090 catalog_manager.cc:5028] TS e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): tablet 39dd6382a0304387a1341bcc36471cbf (table test-workload [id=f364cfe226234c5b99453e3013c8717e]) successfully deleted
I20260709 13:05:41.288833 16201 consensus_queue.cc:237] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
W20260709 13:05:41.297027 16173 consensus_peers.cc:597] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f -> Peer 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875): Couldn't send request to peer 1109f76a0b7b443a84c0327c8707bc63. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ae7bbe4140004c26b8f5f8b6b79c9b83. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:41.297187 16280 raft_consensus.cc:1275] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:41.297326 16353 raft_consensus.cc:1275] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:41.298691 17336 consensus_queue.cc:1048] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:41.299767 17271 consensus_queue.cc:1048] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:41.309471 17271 raft_consensus.cc:2955] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:05:41.310946 16353 raft_consensus.cc:2955] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:05:41.315514 16279 raft_consensus.cc:2955] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:05:41.342406 16102 catalog_manager.cc:5697] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 363bb2f744eb486f9ad726f08214c98e reported cstate change: config changed from index -1 to 2, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New cstate: current_term: 1 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:05:41.348207 16353 consensus_queue.cc:237] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
W20260709 13:05:41.362986 16322 consensus_peers.cc:597] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e -> Peer 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875): Couldn't send request to peer 1109f76a0b7b443a84c0327c8707bc63. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 454d01f56c2d4533a035fdbc026c10b3. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:41.364392 16279 raft_consensus.cc:1275] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:41.370604 17334 consensus_queue.cc:1048] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:41.371286 16201 raft_consensus.cc:1275] T 454d01f56c2d4533a035fdbc026c10b3 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:41.374202 17334 consensus_queue.cc:1048] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:41.382051 17319 raft_consensus.cc:2955] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:05:41.383951 16279 raft_consensus.cc:2955] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:05:41.391353 16201 raft_consensus.cc:2955] T 454d01f56c2d4533a035fdbc026c10b3 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:05:41.398759 16208 consensus_queue.cc:237] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:05:41.420996 16278 raft_consensus.cc:1275] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:41.421128 16353 raft_consensus.cc:1275] T 7877d879c7564adfac82b8387dbbc867 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:41.424347 17336 consensus_queue.cc:1048] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:41.429478 16103 catalog_manager.cc:5697] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e reported cstate change: config changed from index -1 to 2, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New cstate: current_term: 1 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:05:41.435237 16173 consensus_peers.cc:597] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f -> Peer 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875): Couldn't send request to peer 1109f76a0b7b443a84c0327c8707bc63. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7877d879c7564adfac82b8387dbbc867. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:41.439146 17332 consensus_queue.cc:1048] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:41.466435 17271 raft_consensus.cc:2955] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:05:41.469219 16351 raft_consensus.cc:2955] T 7877d879c7564adfac82b8387dbbc867 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:05:41.470784 16278 raft_consensus.cc:2955] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:05:41.486979 16351 consensus_queue.cc:237] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:05:41.488142 16102 catalog_manager.cc:5697] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f reported cstate change: config changed from index -1 to 2, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New cstate: current_term: 1 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:41.505540 16201 raft_consensus.cc:1275] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:41.509325 17350 consensus_queue.cc:1048] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:41.519845 16279 raft_consensus.cc:1275] T 186b9e9483624c769871a8894ee07efa P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:05:41.522609 16322 consensus_peers.cc:597] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e -> Peer 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875): Couldn't send request to peer 1109f76a0b7b443a84c0327c8707bc63. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 186b9e9483624c769871a8894ee07efa. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:41.522339 17350 raft_consensus.cc:2955] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:05:41.523372 16201 raft_consensus.cc:2955] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:05:41.524761 17319 consensus_queue.cc:1048] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:05:41.534264 16278 raft_consensus.cc:2955] T 186b9e9483624c769871a8894ee07efa P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:05:41.543469 16102 catalog_manager.cc:5697] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e reported cstate change: config changed from index -1 to 2, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New cstate: current_term: 1 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:41.828923 17354 ts_tablet_manager.cc:933] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63: Initiating tablet copy from peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073)
I20260709 13:05:41.835387 17354 tablet_copy_client.cc:323] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Beginning tablet copy session from remote peer at address 127.14.180.65:46073
I20260709 13:05:41.837033 16217 tablet_copy_service.cc:140] P e10b16d536674c0bb350a31d7ce5ff7f: Received BeginTabletCopySession request for tablet ae7bbe4140004c26b8f5f8b6b79c9b83 from peer 1109f76a0b7b443a84c0327c8707bc63 ({username='slave'} at 127.0.0.1:39674)
I20260709 13:05:41.837551 16217 tablet_copy_service.cc:161] P e10b16d536674c0bb350a31d7ce5ff7f: Beginning new tablet copy session on tablet ae7bbe4140004c26b8f5f8b6b79c9b83 from peer 1109f76a0b7b443a84c0327c8707bc63 at {username='slave'} at 127.0.0.1:39674: session id = 1109f76a0b7b443a84c0327c8707bc63-ae7bbe4140004c26b8f5f8b6b79c9b83
I20260709 13:05:41.847790 16217 tablet_copy_source_session.cc:215] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:41.850885 17356 ts_tablet_manager.cc:933] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63: Initiating tablet copy from peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:41.853368 17354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae7bbe4140004c26b8f5f8b6b79c9b83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:41.855235 17356 tablet_copy_client.cc:323] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Beginning tablet copy session from remote peer at address 127.14.180.67:46107
I20260709 13:05:41.857214 16367 tablet_copy_service.cc:140] P 363bb2f744eb486f9ad726f08214c98e: Received BeginTabletCopySession request for tablet 454d01f56c2d4533a035fdbc026c10b3 from peer 1109f76a0b7b443a84c0327c8707bc63 ({username='slave'} at 127.0.0.1:33486)
I20260709 13:05:41.857808 16367 tablet_copy_service.cc:161] P 363bb2f744eb486f9ad726f08214c98e: Beginning new tablet copy session on tablet 454d01f56c2d4533a035fdbc026c10b3 from peer 1109f76a0b7b443a84c0327c8707bc63 at {username='slave'} at 127.0.0.1:33486: session id = 1109f76a0b7b443a84c0327c8707bc63-454d01f56c2d4533a035fdbc026c10b3
I20260709 13:05:41.868732 16367 tablet_copy_source_session.cc:215] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:41.873260 17356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 454d01f56c2d4533a035fdbc026c10b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:41.875510 17354 tablet_copy_client.cc:806] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:41.876252 17354 tablet_copy_client.cc:670] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:41.880723 17354 tablet_copy_client.cc:538] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:41.891192 17354 tablet_bootstrap.cc:492] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap starting.
I20260709 13:05:41.897409 17356 tablet_copy_client.cc:806] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:41.898177 17356 tablet_copy_client.cc:670] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:41.929745 17356 tablet_copy_client.cc:538] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:41.950909 17356 tablet_bootstrap.cc:492] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap starting.
I20260709 13:05:41.959692 17354 tablet_bootstrap.cc:492] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:41.966666 17354 tablet_bootstrap.cc:492] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap complete.
I20260709 13:05:41.968549 17354 ts_tablet_manager.cc:1403] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63: Time spent bootstrapping tablet: real 0.078s	user 0.024s	sys 0.037s
I20260709 13:05:41.973395 17354 raft_consensus.cc:359] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:05:41.974691 17354 raft_consensus.cc:740] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Initialized, Role: LEARNER
I20260709 13:05:41.975476 17354 consensus_queue.cc:260] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:05:41.987708 17354 ts_tablet_manager.cc:1434] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63: Time spent starting tablet: real 0.018s	user 0.011s	sys 0.003s
I20260709 13:05:41.991081 16217 tablet_copy_service.cc:342] P e10b16d536674c0bb350a31d7ce5ff7f: Request end of tablet copy session 1109f76a0b7b443a84c0327c8707bc63-ae7bbe4140004c26b8f5f8b6b79c9b83 received from {username='slave'} at 127.0.0.1:39674
I20260709 13:05:41.991571 16217 tablet_copy_service.cc:434] P e10b16d536674c0bb350a31d7ce5ff7f: ending tablet copy session 1109f76a0b7b443a84c0327c8707bc63-ae7bbe4140004c26b8f5f8b6b79c9b83 on tablet ae7bbe4140004c26b8f5f8b6b79c9b83 with peer 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:05:41.996061 17354 ts_tablet_manager.cc:933] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63: Initiating tablet copy from peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073)
I20260709 13:05:42.005631 17356 tablet_bootstrap.cc:492] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:42.008759 17356 tablet_bootstrap.cc:492] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap complete.
I20260709 13:05:42.013844 17356 ts_tablet_manager.cc:1403] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63: Time spent bootstrapping tablet: real 0.063s	user 0.030s	sys 0.001s
I20260709 13:05:42.010597 17363 ts_tablet_manager.cc:933] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63: Initiating tablet copy from peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:42.020835 17356 raft_consensus.cc:359] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:05:42.021920 17356 raft_consensus.cc:740] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Initialized, Role: LEARNER
I20260709 13:05:42.023334 17356 consensus_queue.cc:260] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:05:42.027400 17356 ts_tablet_manager.cc:1434] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:05:42.029275 17363 tablet_copy_client.cc:323] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Beginning tablet copy session from remote peer at address 127.14.180.67:46107
I20260709 13:05:42.031255 16367 tablet_copy_service.cc:140] P 363bb2f744eb486f9ad726f08214c98e: Received BeginTabletCopySession request for tablet 186b9e9483624c769871a8894ee07efa from peer 1109f76a0b7b443a84c0327c8707bc63 ({username='slave'} at 127.0.0.1:33486)
I20260709 13:05:42.031843 16367 tablet_copy_service.cc:161] P 363bb2f744eb486f9ad726f08214c98e: Beginning new tablet copy session on tablet 186b9e9483624c769871a8894ee07efa from peer 1109f76a0b7b443a84c0327c8707bc63 at {username='slave'} at 127.0.0.1:33486: session id = 1109f76a0b7b443a84c0327c8707bc63-186b9e9483624c769871a8894ee07efa
I20260709 13:05:42.045121 16367 tablet_copy_source_session.cc:215] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:42.046773 16366 tablet_copy_service.cc:342] P 363bb2f744eb486f9ad726f08214c98e: Request end of tablet copy session 1109f76a0b7b443a84c0327c8707bc63-454d01f56c2d4533a035fdbc026c10b3 received from {username='slave'} at 127.0.0.1:33486
I20260709 13:05:42.047341 16366 tablet_copy_service.cc:434] P 363bb2f744eb486f9ad726f08214c98e: ending tablet copy session 1109f76a0b7b443a84c0327c8707bc63-454d01f56c2d4533a035fdbc026c10b3 on tablet 454d01f56c2d4533a035fdbc026c10b3 with peer 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:05:42.060310 17363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 186b9e9483624c769871a8894ee07efa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:42.078205 17354 tablet_copy_client.cc:323] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Beginning tablet copy session from remote peer at address 127.14.180.65:46073
I20260709 13:05:42.080305 16217 tablet_copy_service.cc:140] P e10b16d536674c0bb350a31d7ce5ff7f: Received BeginTabletCopySession request for tablet 7877d879c7564adfac82b8387dbbc867 from peer 1109f76a0b7b443a84c0327c8707bc63 ({username='slave'} at 127.0.0.1:39674)
I20260709 13:05:42.081262 16217 tablet_copy_service.cc:161] P e10b16d536674c0bb350a31d7ce5ff7f: Beginning new tablet copy session on tablet 7877d879c7564adfac82b8387dbbc867 from peer 1109f76a0b7b443a84c0327c8707bc63 at {username='slave'} at 127.0.0.1:39674: session id = 1109f76a0b7b443a84c0327c8707bc63-7877d879c7564adfac82b8387dbbc867
I20260709 13:05:42.082947 17363 tablet_copy_client.cc:806] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:42.083702 17363 tablet_copy_client.cc:670] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:42.088876 17363 tablet_copy_client.cc:538] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:42.090747 16217 tablet_copy_source_session.cc:215] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:42.094688 17354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7877d879c7564adfac82b8387dbbc867. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:42.101321 17363 tablet_bootstrap.cc:492] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap starting.
I20260709 13:05:42.115651 17354 tablet_copy_client.cc:806] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:42.116330 17354 tablet_copy_client.cc:670] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:42.120896 17354 tablet_copy_client.cc:538] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:42.134727 17354 tablet_bootstrap.cc:492] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap starting.
I20260709 13:05:42.147001 17363 tablet_bootstrap.cc:492] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:42.148150 17363 tablet_bootstrap.cc:492] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap complete.
I20260709 13:05:42.149001 17363 ts_tablet_manager.cc:1403] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63: Time spent bootstrapping tablet: real 0.048s	user 0.020s	sys 0.012s
I20260709 13:05:42.152696 17363 raft_consensus.cc:359] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:05:42.153949 17363 raft_consensus.cc:740] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Initialized, Role: LEARNER
I20260709 13:05:42.155135 17363 consensus_queue.cc:260] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:05:42.163347 17363 ts_tablet_manager.cc:1434] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 13:05:42.169636 17354 tablet_bootstrap.cc:492] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:42.171123 17354 tablet_bootstrap.cc:492] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap complete.
I20260709 13:05:42.172878 17354 ts_tablet_manager.cc:1403] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63: Time spent bootstrapping tablet: real 0.039s	user 0.022s	sys 0.011s
I20260709 13:05:42.174652 16366 tablet_copy_service.cc:342] P 363bb2f744eb486f9ad726f08214c98e: Request end of tablet copy session 1109f76a0b7b443a84c0327c8707bc63-186b9e9483624c769871a8894ee07efa received from {username='slave'} at 127.0.0.1:33486
I20260709 13:05:42.175132 16366 tablet_copy_service.cc:434] P 363bb2f744eb486f9ad726f08214c98e: ending tablet copy session 1109f76a0b7b443a84c0327c8707bc63-186b9e9483624c769871a8894ee07efa on tablet 186b9e9483624c769871a8894ee07efa with peer 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:05:42.177438 17354 raft_consensus.cc:359] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:05:42.178484 17354 raft_consensus.cc:740] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Initialized, Role: LEARNER
I20260709 13:05:42.179272 17354 consensus_queue.cc:260] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:05:42.182271 17354 ts_tablet_manager.cc:1434] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:05:42.184788 16217 tablet_copy_service.cc:342] P e10b16d536674c0bb350a31d7ce5ff7f: Request end of tablet copy session 1109f76a0b7b443a84c0327c8707bc63-7877d879c7564adfac82b8387dbbc867 received from {username='slave'} at 127.0.0.1:39674
I20260709 13:05:42.185286 16217 tablet_copy_service.cc:434] P e10b16d536674c0bb350a31d7ce5ff7f: ending tablet copy session 1109f76a0b7b443a84c0327c8707bc63-7877d879c7564adfac82b8387dbbc867 on tablet 7877d879c7564adfac82b8387dbbc867 with peer 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:05:42.250275 16945 raft_consensus.cc:1217] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:42.454931 16945 raft_consensus.cc:1217] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:42.494246 16949 raft_consensus.cc:1217] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:42.549897 16945 raft_consensus.cc:1217] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:42.686506 17336 raft_consensus.cc:1064] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f: attempting to promote NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 to VOTER
I20260709 13:05:42.689164 17336 consensus_queue.cc:237] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:42.705144 16351 raft_consensus.cc:1275] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:42.706301 16949 raft_consensus.cc:1275] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 LEARNER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:42.723814 16278 raft_consensus.cc:1275] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:42.725736 17332 consensus_queue.cc:1048] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:42.729180 17332 consensus_queue.cc:1048] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:42.730219 17336 consensus_queue.cc:1048] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:42.768693 17336 raft_consensus.cc:2955] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:42.777016 16945 raft_consensus.cc:2955] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:42.784195 16351 raft_consensus.cc:2955] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:42.788549 16280 raft_consensus.cc:2955] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:42.795485 16102 catalog_manager.cc:5697] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f reported cstate change: config changed from index 2 to 3, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:42.827576 16208 consensus_queue.cc:237] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:42.833393 16945 raft_consensus.cc:1275] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:42.838397 15057 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:42.838310 17336 consensus_queue.cc:1048] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:42.840003 16278 raft_consensus.cc:1275] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:42.842312 17336 consensus_queue.cc:1048] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:42.850123 17369 raft_consensus.cc:2955] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:42.853237 16945 raft_consensus.cc:2955] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:42.860276 16278 raft_consensus.cc:2955] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:42.863579 16090 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ae7bbe4140004c26b8f5f8b6b79c9b83 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:42.880479 16102 catalog_manager.cc:5697] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f reported cstate change: config changed from index 3 to 4, VOTER 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) evicted. New cstate: current_term: 1 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:42.882140 17319 raft_consensus.cc:1064] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e: attempting to promote NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 to VOTER
I20260709 13:05:42.888471 17319 consensus_queue.cc:237] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:42.916836 16338 tablet_service.cc:1558] Processing DeleteTablet for tablet ae7bbe4140004c26b8f5f8b6b79c9b83 with delete_type TABLET_DATA_TOMBSTONED (TS 363bb2f744eb486f9ad726f08214c98e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:41820
I20260709 13:05:42.924362 16208 raft_consensus.cc:1275] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:42.926033 17288 consensus_queue.cc:1048] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:42.927026 16278 raft_consensus.cc:1275] T 186b9e9483624c769871a8894ee07efa P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:42.928316 16945 raft_consensus.cc:1275] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 1 LEARNER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:42.932083 17350 consensus_queue.cc:1048] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:42.934386 17350 consensus_queue.cc:1048] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:42.942938 17378 tablet_replica.cc:333] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 363bb2f744eb486f9ad726f08214c98e: stopping tablet replica
I20260709 13:05:42.944767 17378 raft_consensus.cc:2243] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:42.959860 17378 raft_consensus.cc:2272] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:42.973057 17319 raft_consensus.cc:1064] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e: attempting to promote NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 to VOTER
I20260709 13:05:42.976475 17319 consensus_queue.cc:237] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:42.961927 17350 raft_consensus.cc:2955] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:42.982380 17378 ts_tablet_manager.cc:1916] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 363bb2f744eb486f9ad726f08214c98e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:43.047544 17378 ts_tablet_manager.cc:1929] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 363bb2f744eb486f9ad726f08214c98e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:43.048148 17378 log.cc:1199] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 363bb2f744eb486f9ad726f08214c98e: Deleting WAL directory at /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602283040513-15057-0/minicluster-data/ts-2-root/wals/ae7bbe4140004c26b8f5f8b6b79c9b83
W20260709 13:05:43.065032 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 72345.4us
I20260709 13:05:43.077585 17369 raft_consensus.cc:1064] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f: attempting to promote NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 to VOTER
I20260709 13:05:43.081435 17369 consensus_queue.cc:237] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:43.082348 16208 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "13bc3c8ff9b84838a2664335d7e1582b"
dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
mode: GRACEFUL
new_leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
 from {username='slave'} at 127.0.0.1:58160
I20260709 13:05:43.089985 16208 raft_consensus.cc:606] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [term 1 LEADER]: Received request to transfer leadership to TS 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:05:43.095836 16208 raft_consensus.cc:1275] T 454d01f56c2d4533a035fdbc026c10b3 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:43.099306 16949 raft_consensus.cc:2955] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:43.101358 16092 catalog_manager.cc:5028] TS 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): tablet ae7bbe4140004c26b8f5f8b6b79c9b83 (table test-workload [id=f364cfe226234c5b99453e3013c8717e]) successfully deleted
I20260709 13:05:43.113454 17387 consensus_queue.cc:1048] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:43.113461 16946 raft_consensus.cc:1275] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 LEARNER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:43.116266 17332 consensus_queue.cc:1048] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:43.116631 16279 raft_consensus.cc:1275] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:43.119349 17369 consensus_queue.cc:1048] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:43.120061 16946 raft_consensus.cc:1275] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 LEARNER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:43.122635 16205 raft_consensus.cc:2955] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:43.123502 17387 consensus_queue.cc:1048] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:43.124461 16351 raft_consensus.cc:1275] T 7877d879c7564adfac82b8387dbbc867 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:43.126266 17369 consensus_queue.cc:1048] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:43.130787 16103 catalog_manager.cc:5697] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e reported cstate change: config changed from index 2 to 3, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:43.145287 16277 raft_consensus.cc:2955] T 186b9e9483624c769871a8894ee07efa P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:43.148715 16280 raft_consensus.cc:1275] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:43.158226 17390 consensus_queue.cc:1048] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:43.283211 16356 consensus_queue.cc:237] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:43.291725 16205 raft_consensus.cc:1275] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:43.293414 17392 consensus_queue.cc:1048] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:43.303601 17392 raft_consensus.cc:2955] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:43.305888 16205 raft_consensus.cc:2955] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:43.322880 17391 raft_consensus.cc:2955] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:43.324484 16206 raft_consensus.cc:2955] T 454d01f56c2d4533a035fdbc026c10b3 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:43.332634 17332 raft_consensus.cc:2955] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:43.334960 16279 raft_consensus.cc:2955] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:43.346521 16945 raft_consensus.cc:2955] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:43.359200 16092 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 186b9e9483624c769871a8894ee07efa with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:43.365304 16103 catalog_manager.cc:5697] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f reported cstate change: config changed from index 2 to 3, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:43.371065 16105 catalog_manager.cc:5697] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e reported cstate change: config changed from index 2 to 3, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:43.384716 16275 raft_consensus.cc:2955] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
W20260709 13:05:43.388300 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 75023.4us
I20260709 13:05:43.391340 16949 raft_consensus.cc:1275] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:43.407159 16277 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8"
dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
mode: GRACEFUL
new_leader_uuid: "363bb2f744eb486f9ad726f08214c98e"
 from {username='slave'} at 127.0.0.1:39058
I20260709 13:05:43.407994 16277 raft_consensus.cc:606] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 LEADER]: Received request to transfer leadership to TS 363bb2f744eb486f9ad726f08214c98e
I20260709 13:05:43.410403 16949 raft_consensus.cc:2955] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:43.428335 17319 consensus_queue.cc:1048] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:43.435806 16206 consensus_queue.cc:237] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:43.441573 16945 raft_consensus.cc:1275] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:43.444873 16280 raft_consensus.cc:1275] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:43.450057 16277 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "26565509c81343bc818483042146461a"
dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
mode: GRACEFUL
new_leader_uuid: "1109f76a0b7b443a84c0327c8707bc63"
 from {username='slave'} at 127.0.0.1:39058
I20260709 13:05:43.450791 16277 raft_consensus.cc:606] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 LEADER]: Received request to transfer leadership to TS 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:05:43.452579 17271 consensus_queue.cc:1048] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:43.453936 16277 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf"
dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
mode: GRACEFUL
new_leader_uuid: "1109f76a0b7b443a84c0327c8707bc63"
 from {username='slave'} at 127.0.0.1:39058
I20260709 13:05:43.453586 16105 catalog_manager.cc:5697] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e reported cstate change: config changed from index 3 to 4, VOTER 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) evicted. New cstate: current_term: 1 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:43.455003 17332 consensus_queue.cc:1048] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:43.454660 16277 raft_consensus.cc:606] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 LEADER]: Received request to transfer leadership to TS 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:05:43.462707 16277 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423"
dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
mode: GRACEFUL
new_leader_uuid: "1109f76a0b7b443a84c0327c8707bc63"
 from {username='slave'} at 127.0.0.1:39058
I20260709 13:05:43.464135 16277 raft_consensus.cc:606] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 LEADER]: Received request to transfer leadership to TS 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:05:43.468125 16946 raft_consensus.cc:2955] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:43.475488 17336 raft_consensus.cc:2955] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:43.485023 17332 raft_consensus.cc:993] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f: : Instructing follower 0aea40d6e4374085a2e38a70a71f63e3 to start an election
I20260709 13:05:43.484828 16270 tablet_service.cc:1558] Processing DeleteTablet for tablet 186b9e9483624c769871a8894ee07efa with delete_type TABLET_DATA_TOMBSTONED (TS 0aea40d6e4374085a2e38a70a71f63e3 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45204
I20260709 13:05:43.494911 17332 raft_consensus.cc:1081] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [term 1 LEADER]: Signalling peer 0aea40d6e4374085a2e38a70a71f63e3 to start an election
I20260709 13:05:43.487560 16351 consensus_queue.cc:237] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:43.489104 16277 raft_consensus.cc:2955] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:43.500967 16090 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7877d879c7564adfac82b8387dbbc867 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:43.501789 17405 tablet_replica.cc:333] T 186b9e9483624c769871a8894ee07efa P 0aea40d6e4374085a2e38a70a71f63e3: stopping tablet replica
I20260709 13:05:43.502946 17405 raft_consensus.cc:2243] T 186b9e9483624c769871a8894ee07efa P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:43.503355 16279 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "13bc3c8ff9b84838a2664335d7e1582b"
dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
 from {username='slave'} at 127.0.0.1:45218
I20260709 13:05:43.503865 17405 raft_consensus.cc:2272] T 186b9e9483624c769871a8894ee07efa P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:43.504132 16279 raft_consensus.cc:493] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:43.504943 16279 raft_consensus.cc:3060] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:43.492823 16949 raft_consensus.cc:2955] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:43.508119 17405 ts_tablet_manager.cc:1916] T 186b9e9483624c769871a8894ee07efa P 0aea40d6e4374085a2e38a70a71f63e3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:43.546133 16103 catalog_manager.cc:5697] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: config changed from index 3 to 4, VOTER 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) evicted. New cstate: current_term: 1 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:43.549532 16279 raft_consensus.cc:515] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:43.560608 16946 raft_consensus.cc:1275] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:43.563232 16277 raft_consensus.cc:1275] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:43.567216 17390 consensus_queue.cc:1048] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:43.566289 17404 raft_consensus.cc:993] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3: : Instructing follower 1109f76a0b7b443a84c0327c8707bc63 to start an election
I20260709 13:05:43.572070 17288 consensus_queue.cc:1048] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:43.582003 17404 raft_consensus.cc:993] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3: : Instructing follower 363bb2f744eb486f9ad726f08214c98e to start an election
I20260709 13:05:43.582625 17404 raft_consensus.cc:1081] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 LEADER]: Signalling peer 363bb2f744eb486f9ad726f08214c98e to start an election
I20260709 13:05:43.585541 17359 raft_consensus.cc:1081] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 LEADER]: Signalling peer 1109f76a0b7b443a84c0327c8707bc63 to start an election
I20260709 13:05:43.585611 16338 tablet_service.cc:1558] Processing DeleteTablet for tablet 7877d879c7564adfac82b8387dbbc867 with delete_type TABLET_DATA_TOMBSTONED (TS 363bb2f744eb486f9ad726f08214c98e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:41820
I20260709 13:05:43.590143 17288 raft_consensus.cc:2955] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:43.596029 16949 raft_consensus.cc:2955] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:43.597910 16279 leader_election.cc:290] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:43.630038 16092 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 454d01f56c2d4533a035fdbc026c10b3 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:43.632046 16279 raft_consensus.cc:2955] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
W20260709 13:05:43.633348 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 60260.5us
I20260709 13:05:43.630038 16105 catalog_manager.cc:5697] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: config changed from index 3 to 4, VOTER e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) evicted. New cstate: current_term: 1 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:43.651217 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bc3c8ff9b84838a2664335d7e1582b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:05:43.651914 16205 raft_consensus.cc:3055] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:43.652218 16205 raft_consensus.cc:740] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:05:43.652973 16205 consensus_queue.cc:260] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:43.654229 16205 raft_consensus.cc:3060] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:43.658917 16946 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423"
dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
 from {username='slave'} at 127.0.0.1:40078
I20260709 13:05:43.659560 16946 raft_consensus.cc:493] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:43.659880 16946 raft_consensus.cc:3060] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:43.660601 16349 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8"
dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
 from {username='slave'} at 127.0.0.1:41830
I20260709 13:05:43.661178 16349 raft_consensus.cc:493] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:43.661463 16349 raft_consensus.cc:3060] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:43.662886 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bc3c8ff9b84838a2664335d7e1582b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:05:43.663532 16356 raft_consensus.cc:3060] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:43.673774 16356 raft_consensus.cc:2468] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 2.
I20260709 13:05:43.682884 16946 raft_consensus.cc:515] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:43.678505 16248 leader_election.cc:304] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:05:43.689913 17207 raft_consensus.cc:2804] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:43.690431 17207 raft_consensus.cc:697] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:05:43.691218 17408 tablet_replica.cc:333] T 7877d879c7564adfac82b8387dbbc867 P 363bb2f744eb486f9ad726f08214c98e: stopping tablet replica
I20260709 13:05:43.691303 17207 consensus_queue.cc:237] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:43.701305 16205 raft_consensus.cc:2468] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 2.
I20260709 13:05:43.685364 16349 raft_consensus.cc:515] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } }
I20260709 13:05:43.710852 16356 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef"
dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
mode: GRACEFUL
new_leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
 from {username='slave'} at 127.0.0.1:56792
I20260709 13:05:43.711642 16356 raft_consensus.cc:606] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 1 LEADER]: Received request to transfer leadership to TS 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:05:43.714732 17407 raft_consensus.cc:993] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3: : Instructing follower 1109f76a0b7b443a84c0327c8707bc63 to start an election
I20260709 13:05:43.715288 17207 raft_consensus.cc:1081] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 LEADER]: Signalling peer 1109f76a0b7b443a84c0327c8707bc63 to start an election
I20260709 13:05:43.716917 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:05:43.719501 16949 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf"
dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
 from {username='slave'} at 127.0.0.1:40078
I20260709 13:05:43.719901 16277 raft_consensus.cc:3055] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:43.720026 16949 raft_consensus.cc:493] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:43.720257 16277 raft_consensus.cc:740] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:05:43.720438 16949 raft_consensus.cc:3060] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:43.721170 16277 consensus_queue.cc:260] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:43.722687 16277 raft_consensus.cc:3060] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:43.727270 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:05:43.719004 16946 leader_election.cc:290] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:43.732609 16353 raft_consensus.cc:3060] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:43.733028 16949 raft_consensus.cc:515] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:43.739972 16949 leader_election.cc:290] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:43.745628 16280 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c"
dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
mode: GRACEFUL
new_leader_uuid: "363bb2f744eb486f9ad726f08214c98e"
 from {username='slave'} at 127.0.0.1:39058
I20260709 13:05:43.746290 16280 raft_consensus.cc:606] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 LEADER]: Received request to transfer leadership to TS 363bb2f744eb486f9ad726f08214c98e
I20260709 13:05:43.745534 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:05:43.747597 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:05:43.748132 16275 raft_consensus.cc:3055] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:43.748461 16279 raft_consensus.cc:3055] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:43.748468 16353 raft_consensus.cc:2468] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 2.
I20260709 13:05:43.748999 16279 raft_consensus.cc:740] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:05:43.734508 16349 leader_election.cc:290] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 2 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:43.736626 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:05:43.751354 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:05:43.751977 16356 raft_consensus.cc:3060] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:43.751534 16201 raft_consensus.cc:3060] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:43.753397 16914 leader_election.cc:304] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:05:43.749869 16279 consensus_queue.cc:260] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:43.757166 17362 raft_consensus.cc:2804] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:43.757845 16277 raft_consensus.cc:2468] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 2.
I20260709 13:05:43.756489 16279 raft_consensus.cc:3060] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:43.755949 15057 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 7
I20260709 13:05:43.760993 15057 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:43.766492 16279 raft_consensus.cc:2468] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 2.
I20260709 13:05:43.748708 16275 raft_consensus.cc:740] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:05:43.775964 16356 raft_consensus.cc:2468] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 2.
I20260709 13:05:43.780771 16914 leader_election.cc:304] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:05:43.787737 16201 raft_consensus.cc:2468] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 2.
I20260709 13:05:43.787595 17412 raft_consensus.cc:2804] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:43.789008 17412 raft_consensus.cc:697] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 2 LEADER]: Becoming Leader. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:05:43.791153 16320 leader_election.cc:304] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:43.791013 17412 consensus_queue.cc:237] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:43.792256 17392 raft_consensus.cc:2804] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:43.792809 17392 raft_consensus.cc:697] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 2 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:05:43.791998 16275 consensus_queue.cc:260] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } }
I20260709 13:05:43.796316 17392 consensus_queue.cc:237] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } }
I20260709 13:05:43.804141 17408 raft_consensus.cc:2243] T 7877d879c7564adfac82b8387dbbc867 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:43.804827 17408 pending_rounds.cc:70] T 7877d879c7564adfac82b8387dbbc867 P 363bb2f744eb486f9ad726f08214c98e: Trying to abort 1 pending ops.
I20260709 13:05:43.805114 17408 pending_rounds.cc:77] T 7877d879c7564adfac82b8387dbbc867 P 363bb2f744eb486f9ad726f08214c98e: Aborting op as it isn't in flight: id { term: 1 index: 3 } timestamp: 7305635197256482816 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "7877d879c7564adfac82b8387dbbc867" old_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } } new_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } } }
I20260709 13:05:43.806087 17408 raft_consensus.cc:2917] T 7877d879c7564adfac82b8387dbbc867 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted
I20260709 13:05:43.806469 17408 raft_consensus.cc:2889] T 7877d879c7564adfac82b8387dbbc867 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 13:05:43.813870 17408 raft_consensus.cc:2272] T 7877d879c7564adfac82b8387dbbc867 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:43.818419 17408 ts_tablet_manager.cc:1916] T 7877d879c7564adfac82b8387dbbc867 P 363bb2f744eb486f9ad726f08214c98e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:43.801105 17362 raft_consensus.cc:697] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 LEADER]: Becoming Leader. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:05:43.823599 17405 ts_tablet_manager.cc:1929] T 186b9e9483624c769871a8894ee07efa P 0aea40d6e4374085a2e38a70a71f63e3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:43.824313 17405 log.cc:1199] T 186b9e9483624c769871a8894ee07efa P 0aea40d6e4374085a2e38a70a71f63e3: Deleting WAL directory at /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602283040513-15057-0/minicluster-data/ts-1-root/wals/186b9e9483624c769871a8894ee07efa
I20260709 13:05:43.806924 16275 raft_consensus.cc:3060] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:43.824007 17362 consensus_queue.cc:237] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:43.921376 17385 raft_consensus.cc:993] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e: : Instructing follower 0aea40d6e4374085a2e38a70a71f63e3 to start an election
I20260709 13:05:43.922184 17385 raft_consensus.cc:1081] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 1 LEADER]: Signalling peer 0aea40d6e4374085a2e38a70a71f63e3 to start an election
I20260709 13:05:43.924391 16277 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef"
dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
 from {username='slave'} at 127.0.0.1:45210
I20260709 13:05:43.926188 17359 raft_consensus.cc:993] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3: : Instructing follower 1109f76a0b7b443a84c0327c8707bc63 to start an election
I20260709 13:05:43.927024 17359 raft_consensus.cc:1081] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 LEADER]: Signalling peer 1109f76a0b7b443a84c0327c8707bc63 to start an election
I20260709 13:05:43.931452 16277 raft_consensus.cc:493] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:43.932147 16277 raft_consensus.cc:3060] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:43.955237 16945 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "26565509c81343bc818483042146461a"
dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
 from {username='slave'} at 127.0.0.1:40078
I20260709 13:05:43.957931 16945 raft_consensus.cc:493] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:43.963894 16945 raft_consensus.cc:3060] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:43.992782 16277 raft_consensus.cc:515] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:44.004041 16277 leader_election.cc:290] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:44.006652 16945 raft_consensus.cc:515] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:44.008011 16191 tablet_service.cc:1558] Processing DeleteTablet for tablet 454d01f56c2d4533a035fdbc026c10b3 with delete_type TABLET_DATA_TOMBSTONED (TS e10b16d536674c0bb350a31d7ce5ff7f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:60124
I20260709 13:05:44.026700 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:05:44.027582 16351 raft_consensus.cc:3055] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:44.028031 16351 raft_consensus.cc:740] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:05:44.033336 16092 catalog_manager.cc:5028] TS 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): tablet 186b9e9483624c769871a8894ee07efa (table test-workload [id=f364cfe226234c5b99453e3013c8717e]) successfully deleted
I20260709 13:05:44.034250 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:05:44.035050 16276 raft_consensus.cc:3055] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:44.035422 16276 raft_consensus.cc:740] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:05:44.036367 16945 leader_election.cc:290] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:44.036623 16276 consensus_queue.cc:260] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:44.029258 16351 consensus_queue.cc:260] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:44.051538 16351 raft_consensus.cc:3060] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:44.182770 17417 tablet_replica.cc:333] T 454d01f56c2d4533a035fdbc026c10b3 P e10b16d536674c0bb350a31d7ce5ff7f: stopping tablet replica
I20260709 13:05:44.437323 17408 ts_tablet_manager.cc:1929] T 7877d879c7564adfac82b8387dbbc867 P 363bb2f744eb486f9ad726f08214c98e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:44.438414 17408 log.cc:1199] T 7877d879c7564adfac82b8387dbbc867 P 363bb2f744eb486f9ad726f08214c98e: Deleting WAL directory at /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602283040513-15057-0/minicluster-data/ts-2-root/wals/7877d879c7564adfac82b8387dbbc867
I20260709 13:05:45.055099 15057 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:45.072218 17408 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41820 (request call id 75) took 1421 ms. Trace:
W20260709 13:05:45.571532 15062 debug-util.cc:398] Leaking SignalData structure 0x7b080000fb20 after lost signal to thread 16191
W20260709 13:05:45.572413 15062 kernel_stack_watchdog.cc:198] Thread 16191 stuck at /apache/dev/git/kudu/src/kudu/util/thread.cc:642 for 395ms:
Kernel stack:
(could not read kernel stack)
User stack:
<Timed out: thread did not respond: maybe it is blocking signals>
I20260709 13:05:45.653992 17416 raft_consensus.cc:493] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:05:45.654806 17416 raft_consensus.cc:515] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:45.657392 17416 leader_election.cc:290] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:05:45.658432 17416 raft_consensus.cc:493] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:05:45.659204 17416 raft_consensus.cc:515] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:45.661861 17416 leader_election.cc:290] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:45.663403 17416 raft_consensus.cc:493] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:05:45.663779 17418 raft_consensus.cc:493] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:05:45.664006 17419 raft_consensus.cc:493] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:05:45.664297 17416 raft_consensus.cc:515] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:45.664795 17418 raft_consensus.cc:515] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:45.664904 17419 raft_consensus.cc:515] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:45.666904 17416 leader_election.cc:290] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:45.667016 17418 leader_election.cc:290] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:45.667667 17416 raft_consensus.cc:493] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:05:45.668206 17416 raft_consensus.cc:515] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:05:45.669644 16191 thread.cc:641] tablet-delete [worker] (thread pool) Time spent creating pthread: real 1.660s	user 0.000s	sys 0.063s
I20260709 13:05:45.670469 17416 leader_election.cc:290] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:05:45.670792 16191 thread.cc:608] tablet-delete [worker] (thread pool) Time spent starting thread: real 1.662s	user 0.002s	sys 0.064s
I20260709 13:05:45.671254 17419 leader_election.cc:290] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:45.672027 17418 raft_consensus.cc:493] T b9e1324823f04d8da5a4b3ddbd061c0e P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:05:45.672216 17419 raft_consensus.cc:493] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:05:45.672672 17418 raft_consensus.cc:515] T b9e1324823f04d8da5a4b3ddbd061c0e P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:45.673203 17419 raft_consensus.cc:515] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:45.675251 17418 leader_election.cc:290] T b9e1324823f04d8da5a4b3ddbd061c0e P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:45.675853 17418 raft_consensus.cc:493] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:05:45.669816 17421 raft_consensus.cc:493] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:05:45.676553 17418 raft_consensus.cc:515] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:45.678138 17419 leader_election.cc:290] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:05:45.679076 17418 leader_election.cc:290] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:05:45.676816 17421 raft_consensus.cc:515] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:45.682404 17421 leader_election.cc:290] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:45.689216 17423 raft_consensus.cc:493] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:05:45.690167 17423 raft_consensus.cc:515] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:45.693823 17423 leader_election.cc:290] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:45.694479 17423 raft_consensus.cc:493] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:05:45.695241 17423 raft_consensus.cc:515] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:45.089183 17408 rpcz_store.cc:276] 0709 13:05:43.585284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:43.585414 (+   130us) service_pool.cc:224] Handling call
0709 13:05:43.689864 (+104450us) ts_tablet_manager.cc:1151] Deleting tablet 7877d879c7564adfac82b8387dbbc867
0709 13:05:43.689934 (+    70us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:05:44.023774 (+333840us) tablet_metadata.cc:665] Metadata flushed
0709 13:05:44.194426 (+170652us) tablet_metadata.cc:665] Metadata flushed
0709 13:05:45.007010 (+812584us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":109203,"tablet-delete.queue_time_us":103441,"thread_start_us":10113,"threads_started":1}
I20260709 13:05:45.700086 17423 leader_election.cc:290] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:45.700773 17423 raft_consensus.cc:493] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:05:45.701424 17423 raft_consensus.cc:515] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:45.704218 17423 leader_election.cc:290] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:45.705083 17424 raft_consensus.cc:493] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:05:45.707248 17424 raft_consensus.cc:515] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:45.711252 17424 leader_election.cc:290] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:45.714074 17424 raft_consensus.cc:493] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:05:45.715467 17424 raft_consensus.cc:515] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:45.722848 17424 leader_election.cc:290] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:45.716671 17421 raft_consensus.cc:493] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:05:45.718233 17422 raft_consensus.cc:493] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:45.719779 17425 raft_consensus.cc:493] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:05:45.743971 17425 raft_consensus.cc:515] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:45.745481 17428 raft_consensus.cc:493] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:45.745086 17430 raft_consensus.cc:493] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:05:45.746419 17430 raft_consensus.cc:515] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:45.719843 17426 raft_consensus.cc:493] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:05:45.714658 17423 raft_consensus.cc:493] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:05:45.723942 17421 raft_consensus.cc:515] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:45.756554 17423 raft_consensus.cc:515] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:45.758271 17421 leader_election.cc:290] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:45.723942 17422 raft_consensus.cc:515] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:45.759529 17429 raft_consensus.cc:493] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:05:45.755561 17426 raft_consensus.cc:515] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:45.761004 17422 leader_election.cc:290] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:05:45.761505 17431 raft_consensus.cc:493] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:05:45.761616 17422 raft_consensus.cc:493] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:05:45.762348 17422 raft_consensus.cc:515] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:45.762820 17426 leader_election.cc:290] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:45.760156 17429 raft_consensus.cc:515] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:45.764652 17422 leader_election.cc:290] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:45.758862 17421 raft_consensus.cc:493] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:05:45.765817 17429 leader_election.cc:290] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:45.766037 17421 raft_consensus.cc:515] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:45.748167 17428 raft_consensus.cc:515] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:45.743069 17424 raft_consensus.cc:493] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:05:45.768770 17424 raft_consensus.cc:515] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:45.769330 17421 leader_election.cc:290] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:45.761057 17427 raft_consensus.cc:493] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:05:45.769954 17430 leader_election.cc:290] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:45.770641 17427 raft_consensus.cc:515] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:45.771400 17424 leader_election.cc:290] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:45.771664 17428 leader_election.cc:290] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:45.758862 17423 leader_election.cc:290] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:45.773520 17427 leader_election.cc:290] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:45.762259 17431 raft_consensus.cc:515] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:45.777736 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:05:45.778460 16205 raft_consensus.cc:3060] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:45.778703 17427 raft_consensus.cc:493] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:05:45.779368 17427 raft_consensus.cc:515] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:45.782120 17427 leader_election.cc:290] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:45.784670 16348 raft_consensus.cc:1275] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:45.786712 16355 raft_consensus.cc:1275] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:45.790043 17419 raft_consensus.cc:493] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:05:45.790777 17419 raft_consensus.cc:515] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:45.751410 17425 leader_election.cc:290] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:45.793081 17419 leader_election.cc:290] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:45.793792 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:45.793988 17425 consensus_queue.cc:1048] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:05:45.786733 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:45.796730 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:45.797513 17419 raft_consensus.cc:493] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:05:45.797760 17271 raft_consensus.cc:493] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:05:45.798192 17419 raft_consensus.cc:515] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:45.798449 17271 raft_consensus.cc:515] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:45.798893 17423 consensus_queue.cc:1048] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:45.800689 17271 leader_election.cc:290] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:45.800740 17419 leader_election.cc:290] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:05:45.801295 17271 raft_consensus.cc:493] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:45.801436 17419 raft_consensus.cc:493] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:05:45.801812 17271 raft_consensus.cc:515] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:45.802474 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:45.802728 17418 raft_consensus.cc:493] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:05:45.803527 17418 raft_consensus.cc:515] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:45.804422 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:45.804677 17419 raft_consensus.cc:515] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:05:45.805601 16275 consensus_meta.cc:287] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3: Time spent flushing consensus metadata: real 1.945s	user 0.018s	sys 0.003s
I20260709 13:05:45.805850 17418 leader_election.cc:290] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:45.806053 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:45.806841 17419 leader_election.cc:290] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:45.807128 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:45.807780 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f022e2e63ae4461d834e476ff2666991" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:45.808056 16355 raft_consensus.cc:2468] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 1.
I20260709 13:05:45.807813 16201 raft_consensus.cc:2468] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 1.
I20260709 13:05:45.811513 16914 leader_election.cc:304] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:05:45.812698 17423 raft_consensus.cc:2804] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:45.813148 17423 raft_consensus.cc:493] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:45.813576 17423 raft_consensus.cc:3060] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:45.814850 17271 leader_election.cc:290] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:45.816480 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:45.817226 16208 raft_consensus.cc:2468] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 1.
I20260709 13:05:45.805989 16275 raft_consensus.cc:2468] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 2.
I20260709 13:05:45.817965 17431 leader_election.cc:290] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:45.818230 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:45.818853 17433 raft_consensus.cc:493] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:05:45.819818 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:45.819607 17433 raft_consensus.cc:515] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:45.821264 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:45.818744 17421 raft_consensus.cc:493] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:05:45.822008 16208 raft_consensus.cc:2468] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 1.
I20260709 13:05:45.822292 17421 raft_consensus.cc:515] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:45.822968 16948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:05:45.823635 16948 raft_consensus.cc:2468] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 1.
W20260709 13:05:45.818223 16275 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45210 (request call id 1045) took 2073 ms (client timeout 1581 ms). Trace:
I20260709 13:05:45.827879 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:45.828574 16208 raft_consensus.cc:2468] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 1.
I20260709 13:05:45.826442 16205 raft_consensus.cc:2468] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 2.
I20260709 13:05:45.849402 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:45.850896 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:45.851545 16206 raft_consensus.cc:2468] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 1.
I20260709 13:05:45.852396 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:45.854173 17421 leader_election.cc:290] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:45.855351 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:05:45.826921 16275 rpcz_store.cc:269] 0709 13:05:43.744883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:43.745252 (+   369us) service_pool.cc:224] Handling call
0709 13:05:45.818121 (+2072869us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:05:45.900831 16322 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.180.66:45823 timed out after 1.581s (SENT) [suppressed 12 similar messages]
I20260709 13:05:45.907788 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:45.923889 17423 raft_consensus.cc:515] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:45.944541 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:45.949841 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:45.950515 17433 leader_election.cc:290] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:05:45.951009 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:45.952069 16352 raft_consensus.cc:2468] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 1.
I20260709 13:05:45.953191 17423 leader_election.cc:290] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 3 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:45.953855 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:45.951318 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:45.965667 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:05:45.966768 16949 raft_consensus.cc:2468] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 1.
I20260709 13:05:44.038375 16276 raft_consensus.cc:3060] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:45.943890 16912 leader_election.cc:304] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:45.976505 16912 leader_election.cc:304] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 363bb2f744eb486f9ad726f08214c98e
I20260709 13:05:45.977826 17431 raft_consensus.cc:2804] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:45.978241 17431 raft_consensus.cc:493] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:05:45.978706 17431 raft_consensus.cc:3060] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:45.978317 16352 raft_consensus.cc:2468] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 1.
I20260709 13:05:45.980211 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:45.990139 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
W20260709 13:05:45.991465 16351 consensus_meta.cc:287] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 1.939s	user 0.016s	sys 0.003s
I20260709 13:05:45.991852 16351 raft_consensus.cc:2468] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 2.
I20260709 13:05:45.984597 17423 raft_consensus.cc:2804] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:45.993120 17423 raft_consensus.cc:493] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:05:45.993633 17423 raft_consensus.cc:3060] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:45.994696 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:05:45.996878 16351 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41830 (request call id 1167) took 1986 ms (client timeout 1879 ms). Trace:
I20260709 13:05:45.998364 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:45.997320 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:05:45.997757 16351 rpcz_store.cc:269] 0709 13:05:44.005847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:44.011759 (+  5912us) service_pool.cc:224] Handling call
0709 13:05:45.992453 (+1980694us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:46.005051 16357 raft_consensus.cc:2468] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 1.
I20260709 13:05:46.021646 17419 raft_consensus.cc:493] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:05:46.023355 17271 raft_consensus.cc:493] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:46.029475 17420 raft_consensus.cc:493] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:05:46.029351 17271 raft_consensus.cc:515] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } }
W20260709 13:05:45.989492 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 86469.2us
I20260709 13:05:46.030491 17420 raft_consensus.cc:515] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:46.026146 17416 raft_consensus.cc:493] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:05:46.034685 17271 leader_election.cc:290] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:46.034842 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:46.025876 17418 raft_consensus.cc:493] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:05:46.077916 16276 raft_consensus.cc:2468] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 2.
I20260709 13:05:46.161954 17440 raft_consensus.cc:493] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:05:46.162925 17440 raft_consensus.cc:515] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:46.164227 17445 raft_consensus.cc:493] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:05:46.165256 17445 raft_consensus.cc:515] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:46.159852 17271 raft_consensus.cc:493] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
W20260709 13:05:46.167922 16276 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42740 (request call id 11) took 2141 ms (client timeout 1754 ms). Trace:
W20260709 13:05:46.168519 16276 rpcz_store.cc:269] 0709 13:05:44.018941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:44.033762 (+ 14821us) service_pool.cc:224] Handling call
0709 13:05:46.160264 (+2126502us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:46.078912 17419 raft_consensus.cc:515] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:46.170993 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:46.116417 17421 raft_consensus.cc:493] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:05:46.115053 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:46.172132 17421 raft_consensus.cc:515] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:46.172644 17419 leader_election.cc:290] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:46.114682 17433 raft_consensus.cc:493] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:05:46.174751 17271 raft_consensus.cc:515] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:46.174959 17433 raft_consensus.cc:515] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:46.175086 16914 leader_election.cc:304] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:46.176802 17271 leader_election.cc:290] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:46.177258 17433 leader_election.cc:290] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:05:46.177716 17428 raft_consensus.cc:2804] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:46.177825 17433 raft_consensus.cc:493] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:05:46.178181 17428 raft_consensus.cc:493] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:05:46.137444 17431 raft_consensus.cc:515] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:46.132818 17441 raft_consensus.cc:493] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:05:46.180258 17428 raft_consensus.cc:3060] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:46.248418 17443 raft_consensus.cc:493] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:05:46.249442 17443 raft_consensus.cc:515] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:46.179988 17421 leader_election.cc:290] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:46.259356 17447 raft_consensus.cc:493] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:05:46.260285 17447 raft_consensus.cc:515] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:46.178445 17433 raft_consensus.cc:515] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:46.179657 17435 raft_consensus.cc:493] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:05:46.182416 17418 raft_consensus.cc:515] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:46.182077 17416 raft_consensus.cc:515] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:46.272792 17440 leader_election.cc:290] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:46.273010 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
W20260709 13:05:46.279927 16137 debug-util.cc:398] Leaking SignalData structure 0x7b08001b4580 after lost signal to thread 15060
I20260709 13:05:46.264968 17441 raft_consensus.cc:515] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:46.291092 17447 leader_election.cc:290] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:46.280911 17446 raft_consensus.cc:493] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:05:46.287351 16352 raft_consensus.cc:3060] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:05:46.291944 17420 leader_election.cc:290] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:46.302373 17447 raft_consensus.cc:493] T 454d01f56c2d4533a035fdbc026c10b3 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:05:46.285557 17449 raft_consensus.cc:493] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:05:46.308199 17447 raft_consensus.cc:515] T 454d01f56c2d4533a035fdbc026c10b3 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:46.313203 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:05:46.314004 16205 raft_consensus.cc:3060] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:46.286841 17435 raft_consensus.cc:515] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:05:46.318423 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 107540us
I20260709 13:05:46.315855 17446 raft_consensus.cc:515] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:46.320819 16173 leader_election.cc:304] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:46.323179 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:46.316432 17438 raft_consensus.cc:493] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:05:46.315896 17431 leader_election.cc:290] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:46.339390 16205 raft_consensus.cc:2468] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 2.
I20260709 13:05:46.339646 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:46.332876 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:46.332633 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:46.340008 16173 leader_election.cc:304] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:46.343413 16354 raft_consensus.cc:2468] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 1.
I20260709 13:05:46.331712 17416 leader_election.cc:290] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:46.344928 17452 raft_consensus.cc:493] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:05:46.335278 17433 leader_election.cc:290] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:05:46.327538 17444 raft_consensus.cc:2804] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:46.334264 17418 leader_election.cc:290] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:46.355104 17416 raft_consensus.cc:2764] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:05:46.354080 17445 leader_election.cc:290] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:46.331712 17443 leader_election.cc:290] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:46.387253 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:05:46.391301 17444 raft_consensus.cc:493] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:05:46.393512 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:46.410065 17443 raft_consensus.cc:493] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:05:46.410633 16320 leader_election.cc:304] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:46.410964 17443 raft_consensus.cc:515] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:05:46.411477 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 87070.4us
I20260709 13:05:46.360858 16912 leader_election.cc:304] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:46.333454 17438 raft_consensus.cc:515] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:46.331840 17449 raft_consensus.cc:515] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:46.411800 16206 raft_consensus.cc:1275] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:46.412714 16320 leader_election.cc:304] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:46.412881 17451 raft_consensus.cc:493] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:05:46.997963 17451 raft_consensus.cc:515] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:46.965504 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:46.618366 17446 leader_election.cc:290] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:47.000913 17451 leader_election.cc:290] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:47.001170 17430 raft_consensus.cc:2804] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:46.612447 17450 raft_consensus.cc:2804] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:47.001901 17430 raft_consensus.cc:697] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 LEADER]: Becoming Leader. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:05:46.468664 17445 raft_consensus.cc:493] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:05:47.003137 17430 consensus_queue.cc:237] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:47.003641 17445 raft_consensus.cc:515] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:47.006686 17450 raft_consensus.cc:493] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:05:46.403580 17452 raft_consensus.cc:515] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:46.616190 17435 leader_election.cc:290] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:47.009732 17452 leader_election.cc:290] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:46.612879 17457 raft_consensus.cc:493] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:46.482534 17441 leader_election.cc:290] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:47.011325 17457 raft_consensus.cc:515] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:05:46.991912 16249 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.632s	user 0.000s	sys 0.017s
W20260709 13:05:47.013607 16249 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.653s	user 0.000s	sys 0.018s
I20260709 13:05:46.424268 17444 raft_consensus.cc:3060] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:05:47.022300 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 609577us
I20260709 13:05:47.023353 16320 leader_election.cc:304] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:47.007247 17450 raft_consensus.cc:3060] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:46.385391 17458 raft_consensus.cc:493] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:05:47.041816 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:46.910131 16173 leader_election.cc:304] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
W20260709 13:05:47.048971 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 138921us
I20260709 13:05:46.998114 17438 leader_election.cc:290] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:05:47.086583 16173 leader_election.cc:304] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:47.084936 17419 raft_consensus.cc:2804] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:46.600045 17417 raft_consensus.cc:2243] T 454d01f56c2d4533a035fdbc026c10b3 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:47.129806 17462 raft_consensus.cc:493] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:05:47.130242 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:05:47.002620 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 652416us
I20260709 13:05:46.988536 17443 leader_election.cc:290] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:05:46.404868 17423 raft_consensus.cc:515] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:46.616786 17447 leader_election.cc:290] T 454d01f56c2d4533a035fdbc026c10b3 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:05:47.131131 16353 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33486 (request call id 30) took 1356 ms. Trace:
I20260709 13:05:47.067346 17435 raft_consensus.cc:2804] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:47.024259 17464 raft_consensus.cc:2804] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:46.596472 17453 raft_consensus.cc:493] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:05:47.078289 17445 leader_election.cc:290] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:05:47.130565 17462 raft_consensus.cc:515] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:47.139199 17460 raft_consensus.cc:2804] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:47.142095 16353 rpcz_store.cc:276] 0709 13:05:45.775151 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:47.067176 (+1292025us) service_pool.cc:224] Handling call
0709 13:05:47.131067 (+ 63891us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:47.128249 17419 raft_consensus.cc:493] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:05:47.154155 17460 raft_consensus.cc:493] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:05:47.154826 17460 raft_consensus.cc:3060] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:47.159055 16949 raft_consensus.cc:2393] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 2: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
I20260709 13:05:47.144131 17464 raft_consensus.cc:493] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:05:47.145138 17435 raft_consensus.cc:493] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
W20260709 13:05:47.172600 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 147695us
I20260709 13:05:47.178769 17443 raft_consensus.cc:493] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:05:47.159889 17419 raft_consensus.cc:3060] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:47.183044 17430 raft_consensus.cc:493] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
W20260709 13:05:47.184446 17428 consensus_meta.cc:287] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63: Time spent flushing consensus metadata: real 0.936s	user 0.015s	sys 0.000s
I20260709 13:05:47.185005 17430 raft_consensus.cc:515] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:47.185111 17428 raft_consensus.cc:515] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:05:47.188481 16352 consensus_meta.cc:287] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 0.871s	user 0.008s	sys 0.001s
I20260709 13:05:47.188908 16352 raft_consensus.cc:2468] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 3.
I20260709 13:05:47.189092 17428 leader_election.cc:290] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:47.189510 16352 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33486 (request call id 41) took 1012 ms. Trace:
I20260709 13:05:47.190223 17430 leader_election.cc:290] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:47.171021 17461 raft_consensus.cc:493] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:05:47.192214 17461 raft_consensus.cc:515] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:47.198020 17461 leader_election.cc:290] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:05:47.198220 16249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:47.175348 17464 raft_consensus.cc:3060] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:47.174332 17435 raft_consensus.cc:3060] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:47.169211 17453 raft_consensus.cc:515] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:47.189939 16352 rpcz_store.cc:276] 0709 13:05:46.176863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:46.200076 (+ 23213us) service_pool.cc:224] Handling call
0709 13:05:47.189426 (+989350us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:47.164108 17458 raft_consensus.cc:515] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:05:47.233850 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 95489.7us
I20260709 13:05:47.234366 17445 raft_consensus.cc:493] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:05:47.235057 17445 raft_consensus.cc:515] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:47.236479 17458 leader_election.cc:290] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:05:47.237774 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 87111.6us
I20260709 13:05:47.182204 17443 raft_consensus.cc:515] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:47.198832 17463 raft_consensus.cc:493] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:05:47.248283 16946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:05:47.249068 16946 raft_consensus.cc:2468] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 1.
I20260709 13:05:47.251174 17452 raft_consensus.cc:493] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:05:47.251889 17452 raft_consensus.cc:515] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:05:47.257651 16247 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.839s	user 0.026s	sys 0.049s
W20260709 13:05:47.258296 16247 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.860s	user 0.027s	sys 0.049s
I20260709 13:05:47.252177 17450 raft_consensus.cc:515] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:47.259198 17452 leader_election.cc:290] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:47.262872 17417 raft_consensus.cc:2272] T 454d01f56c2d4533a035fdbc026c10b3 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:47.268270 17462 leader_election.cc:290] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:47.240291 17445 leader_election.cc:290] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:47.318455 17453 leader_election.cc:290] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:47.262212 17451 raft_consensus.cc:493] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:05:47.319802 17451 raft_consensus.cc:515] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:47.375375 17457 leader_election.cc:290] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:05:47.256742 17463 raft_consensus.cc:515] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:47.447214 17457 raft_consensus.cc:493] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:05:47.448935 17457 raft_consensus.cc:515] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:47.447988 17441 raft_consensus.cc:493] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:05:47.450424 17441 raft_consensus.cc:515] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:47.453137 17441 leader_election.cc:290] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:05:47.453873 17441 raft_consensus.cc:493] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:05:47.455885 17462 raft_consensus.cc:493] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:05:47.456734 17462 raft_consensus.cc:515] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:47.461177 17453 raft_consensus.cc:493] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:47.462227 17453 raft_consensus.cc:515] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:05:47.595697 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 419578us
I20260709 13:05:47.317225 17458 raft_consensus.cc:493] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:05:47.700189 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:05:47.444746 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:47.706596 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:05:47.703703 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 84186.5us
I20260709 13:05:47.638200 17423 leader_election.cc:290] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:47.640753 17443 leader_election.cc:290] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:47.715739 16349 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41832 (request call id 1158) took 2037 ms. Trace:
I20260709 13:05:47.702708 17463 leader_election.cc:290] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:05:47.454470 17441 raft_consensus.cc:515] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:47.731648 16349 rpcz_store.cc:276] 0709 13:05:45.666389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:47.658926 (+1992537us) service_pool.cc:224] Handling call
0709 13:05:47.699971 (+ 41045us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:47.703014 (+  3043us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:47.703047 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:47.703130 (+    83us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:05:47.703168 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:47.703251 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:47.703395 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:47.741817 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:47.742146 16945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:05:47.748298 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:47.749219 17451 leader_election.cc:290] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:05:47.611225 17419 raft_consensus.cc:515] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:47.613953 17460 raft_consensus.cc:515] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:05:47.757058 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 381121us
I20260709 13:05:47.720234 17450 leader_election.cc:290] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 2 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:47.714196 17462 leader_election.cc:290] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:05:47.755662 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
W20260709 13:05:47.758882 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 77673.9us
I20260709 13:05:47.775111 16945 raft_consensus.cc:1813] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Handling vote request from an unknown peer e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:47.776212 16945 raft_consensus.cc:2410] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for term 2 because replica has last-logged OpId of term: 1 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 13:05:47.776765 17460 leader_election.cc:290] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 2 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:47.773093 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:05:47.778517 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:47.766937 16350 raft_consensus.cc:2468] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 1.
W20260709 13:05:47.779521 16350 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33486 (request call id 31) took 2004 ms (client timeout 2018 ms). Trace:
I20260709 13:05:47.779995 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:47.780848 16349 raft_consensus.cc:2468] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 1.
I20260709 13:05:47.780964 17449 leader_election.cc:290] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:47.781917 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:47.713703 17458 raft_consensus.cc:515] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:47.792550 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:05:47.785233 16349 raft_consensus.cc:2468] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 1.
W20260709 13:05:47.780097 16350 rpcz_store.cc:269] 0709 13:05:45.775477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:47.741324 (+1965847us) service_pool.cc:224] Handling call
0709 13:05:47.779434 (+ 38110us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:47.786253 17417 ts_tablet_manager.cc:1916] T 454d01f56c2d4533a035fdbc026c10b3 P e10b16d536674c0bb350a31d7ce5ff7f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:47.786751 17457 leader_election.cc:290] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:47.782755 17453 leader_election.cc:290] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:05:47.787933 17441 leader_election.cc:290] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:05:47.789870 17444 consensus_meta.cc:287] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f: Time spent flushing consensus metadata: real 0.693s	user 0.008s	sys 0.003s
I20260709 13:05:47.790237 17419 leader_election.cc:290] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 2 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:05:47.791432 17435 consensus_meta.cc:287] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 0.558s	user 0.003s	sys 0.008s
W20260709 13:05:47.802788 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 91355.5us
I20260709 13:05:47.803526 16173 leader_election.cc:304] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:47.793301 17458 leader_election.cc:290] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:05:47.802139 16348 raft_consensus.cc:2368] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 for earlier term 2. Current term is 3.
W20260709 13:05:47.800349 17464 consensus_meta.cc:287] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 0.570s	user 0.011s	sys 0.000s
I20260709 13:05:47.813211 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:47.814020 16275 raft_consensus.cc:2468] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 1.
I20260709 13:05:47.816134 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:47.808200 17447 raft_consensus.cc:2804] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:47.818005 17447 raft_consensus.cc:493] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:05:47.817806 17464 raft_consensus.cc:515] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:47.821921 17464 leader_election.cc:290] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 2 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:47.818449 17447 raft_consensus.cc:3060] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:47.804984 17444 raft_consensus.cc:515] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:05:47.822986 16137 debug-util.cc:398] Leaking SignalData structure 0x7b08001a89a0 after lost signal to thread 16140
I20260709 13:05:47.824967 16200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60154 (request call id 997) took 2009 ms. Trace:
I20260709 13:05:47.818797 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:47.803923 17435 raft_consensus.cc:515] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:47.824795 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:47.818863 16203 raft_consensus.cc:1240] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:47.832474 16203 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60154 (request call id 999) took 2016 ms. Trace:
I20260709 13:05:47.833844 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:47.834599 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:05:47.835142 16205 raft_consensus.cc:2468] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 1.
I20260709 13:05:47.835979 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:47.836790 16276 raft_consensus.cc:2468] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 2.
I20260709 13:05:47.835186 16208 raft_consensus.cc:3060] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:47.825284 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:47.831178 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:47.831084 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:05:47.879216 16249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:47.830178 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:47.879969 16349 raft_consensus.cc:2468] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 1.
I20260709 13:05:47.901464 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:47.825387 16200 rpcz_store.cc:276] 0709 13:05:45.814982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:47.823939 (+2008957us) service_pool.cc:224] Handling call
0709 13:05:47.824313 (+   374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:47.824502 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:47.824529 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:47.824576 (+    47us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:05:47.824608 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:47.824666 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:47.824806 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:47.824810 17444 leader_election.cc:290] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 2 election: Requested vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:05:47.833125 17435 leader_election.cc:290] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 2 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:47.907366 17435 raft_consensus.cc:493] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:05:47.907861 16948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:05:47.908738 16948 raft_consensus.cc:3060] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:47.909883 16277 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45218 (request call id 1196) took 3899 ms. Trace:
I20260709 13:05:47.907979 17435 raft_consensus.cc:515] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:47.910600 16320 leader_election.cc:304] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:47.910495 16277 rpcz_store.cc:276] 0709 13:05:44.010535 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:44.010777 (+   242us) service_pool.cc:224] Handling call
0709 13:05:47.909220 (+3898443us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:47.909437 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:47.909470 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:47.909531 (+    61us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:05:47.909597 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:47.909681 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:47.909796 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:47.911633 17450 raft_consensus.cc:2804] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:47.912022 17450 raft_consensus.cc:493] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:05:47.912375 17435 leader_election.cc:290] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:47.912400 17450 raft_consensus.cc:3060] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:47.914029 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:47.832861 16203 rpcz_store.cc:276] 0709 13:05:45.815606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:47.817842 (+2002236us) service_pool.cc:224] Handling call
0709 13:05:47.818340 (+   498us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:47.832079 (+ 13739us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:47.832414 (+   335us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:47.920106 16208 raft_consensus.cc:2468] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 2.
I20260709 13:05:47.920704 16947 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35106 (request call id 364) took 2099 ms. Trace:
I20260709 13:05:47.921226 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:05:47.921113 16947 rpcz_store.cc:276] 0709 13:05:45.821067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:47.919719 (+2098652us) service_pool.cc:224] Handling call
0709 13:05:47.920077 (+   358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:47.920272 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:47.920300 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:47.920343 (+    43us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:05:47.920372 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:47.920426 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:47.920531 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:47.921983 16208 raft_consensus.cc:3060] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:47.923218 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:47.923890 16349 raft_consensus.cc:2468] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 1.
I20260709 13:05:47.926012 16205 raft_consensus.cc:1275] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:47.928543 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:47.915418 16352 raft_consensus.cc:2393] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 2: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:05:47.929209 16355 raft_consensus.cc:2468] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 1.
W20260709 13:05:47.891156 16348 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33486 (request call id 42) took 1605 ms (client timeout 1754 ms). Trace:
I20260709 13:05:47.934299 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bc3c8ff9b84838a2664335d7e1582b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:47.935165 17468 raft_consensus.cc:493] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:05:47.935343 16357 raft_consensus.cc:2468] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 2.
I20260709 13:05:47.935765 17468 raft_consensus.cc:515] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:47.936726 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:47.893410 17457 consensus_queue.cc:1048] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 13:05:47.938081 16275 raft_consensus.cc:2468] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 1.
I20260709 13:05:47.941529 17469 raft_consensus.cc:493] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:05:47.941720 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:05:47.942210 17469 raft_consensus.cc:515] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:47.907863 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:48.040442 16201 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60154 (request call id 1013) took 1701 ms. Trace:
I20260709 13:05:48.021536 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:47.979115 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:48.034494 16208 raft_consensus.cc:2468] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 2.
I20260709 13:05:48.048836 16355 raft_consensus.cc:2393] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 2: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:05:48.052219 17480 raft_consensus.cc:493] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:05:48.053928 16948 raft_consensus.cc:2468] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 2.
W20260709 13:05:47.932824 16348 rpcz_store.cc:269] 0709 13:05:46.273632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:47.792232 (+1518600us) service_pool.cc:224] Handling call
0709 13:05:47.879230 (+ 86998us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:48.048205 16201 rpcz_store.cc:276] 0709 13:05:46.339196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:46.339540 (+   344us) service_pool.cc:224] Handling call
0709 13:05:46.339845 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:46.387383 (+ 47538us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:46.387414 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:46.387453 (+    39us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:05:46.387481 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:48.040168 (+1652687us) spinlock_profiling.cc:243] Waited 47.3 ms on lock 0x7b54000b45d4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f489e01 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6
0709 13:05:48.040213 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:48.040337 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":108867328}
I20260709 13:05:48.055956 17468 leader_election.cc:290] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:48.056890 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:47.922683 17450 raft_consensus.cc:515] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:48.070008 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:48.041396 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:05:48.039115 16945 raft_consensus.cc:1240] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:48.046243 16350 raft_consensus.cc:2468] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 1.
I20260709 13:05:48.073820 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c15d8e9be8414c84912ab77b66bfb1" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:48.074186 17464 raft_consensus.cc:493] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:05:48.075891 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:48.053437 17416 raft_consensus.cc:493] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:05:48.091434 17416 raft_consensus.cc:515] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:48.093577 17416 leader_election.cc:290] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:05:48.096241 16949 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35106 (request call id 367) took 2111 ms (client timeout 1877 ms). Trace:
W20260709 13:05:48.096680 16949 rpcz_store.cc:269] 0709 13:05:45.984496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:45.984643 (+   147us) service_pool.cc:224] Handling call
0709 13:05:48.095956 (+2111313us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b54002b43d4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:05:48.096124 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2685918592}
I20260709 13:05:48.101258 16103 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38842 (request call id 209) took 4465 ms. Trace:
I20260709 13:05:48.101716 16103 rpcz_store.cc:276] 0709 13:05:43.636009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:43.636152 (+   143us) service_pool.cc:224] Handling call
0709 13:05:48.101031 (+4464879us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":321870,"reported_tablets":1}
I20260709 13:05:48.077047 17469 leader_election.cc:290] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:48.079589 17450 leader_election.cc:290] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 2 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:48.086174 16349 raft_consensus.cc:2468] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 1.
I20260709 13:05:48.087368 16914 leader_election.cc:304] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:05:48.120574 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:48.089823 17464 raft_consensus.cc:515] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:48.110976 17479 raft_consensus.cc:493] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:05:48.108771 16281 raft_consensus.cc:2376] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 2. Re-sending same reply.
I20260709 13:05:48.044543 17477 consensus_queue.cc:1048] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.117s
I20260709 13:05:48.128633 17464 leader_election.cc:290] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:05:48.122968 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 121067us
I20260709 13:05:48.129808 17479 raft_consensus.cc:515] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:48.122992 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:48.132314 16201 raft_consensus.cc:2468] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 1.
I20260709 13:05:48.136547 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:05:48.136250 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:05:48.138304 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:05:48.136615 17461 raft_consensus.cc:2804] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:48.139489 17425 raft_consensus.cc:493] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:05:48.139580 17461 raft_consensus.cc:697] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 3 LEADER]: Becoming Leader. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:05:48.141078 16944 raft_consensus.cc:1240] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:48.143090 16948 raft_consensus.cc:1240] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 LEADER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:48.143628 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:48.146617 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:05:48.147286 16208 raft_consensus.cc:3060] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:48.141793 17425 raft_consensus.cc:515] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:48.152562 17479 leader_election.cc:290] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:48.153792 16945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
W20260709 13:05:48.155303 16321 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.880s	user 0.010s	sys 0.024s
W20260709 13:05:48.155670 16321 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.883s	user 0.010s	sys 0.024s
I20260709 13:05:48.157150 17461 consensus_queue.cc:237] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:48.158169 17464 raft_consensus.cc:493] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:05:48.159080 17464 raft_consensus.cc:515] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:48.161818 16202 raft_consensus.cc:1275] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:48.134990 17450 raft_consensus.cc:493] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:48.153857 16276 raft_consensus.cc:1275] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:48.154919 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:05:48.165555 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:48.169004 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:05:48.169842 16949 raft_consensus.cc:2393] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 2: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
I20260709 13:05:48.108289 17447 raft_consensus.cc:515] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:48.170970 16208 raft_consensus.cc:2468] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 2.
I20260709 13:05:48.171110 16202 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60154 (request call id 996) took 2356 ms. Trace:
I20260709 13:05:48.171501 17450 raft_consensus.cc:515] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:48.167454 16173 leader_election.cc:304] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:48.059530 17480 raft_consensus.cc:515] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:48.377803 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:48.385689 16278 raft_consensus.cc:2468] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 1.
I20260709 13:05:48.164857 17468 raft_consensus.cc:493] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:05:48.261708 17471 raft_consensus.cc:493] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:05:48.379505 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:48.174842 17427 raft_consensus.cc:493] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:05:48.380836 16092 catalog_manager.cc:5028] TS 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): tablet 7877d879c7564adfac82b8387dbbc867 (table test-workload [id=f364cfe226234c5b99453e3013c8717e]) successfully deleted
I20260709 13:05:48.386649 17450 leader_election.cc:290] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:48.379912 17464 leader_election.cc:290] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:05:48.387115 16137 debug-util.cc:398] Leaking SignalData structure 0x7b08002d15e0 after lost signal to thread 16232
I20260709 13:05:48.387547 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:05:48.377802 16322 leader_election.cc:336] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Timed out: RequestConsensusVote RPC to 127.14.180.66:45823 timed out after 1.581s (SENT)
W20260709 13:05:48.400976 16356 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33486 (request call id 29) took 2626 ms (client timeout 1754 ms). Trace:
I20260709 13:05:48.388003 16204 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60154 (request call id 992) took 2701 ms. Trace:
W20260709 13:05:48.401919 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 230161us
I20260709 13:05:48.401836 16204 rpcz_store.cc:276] 0709 13:05:45.686893 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:48.386812 (+2699919us) service_pool.cc:224] Handling call
0709 13:05:48.387233 (+   421us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:48.387496 (+   263us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:48.387525 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:48.387568 (+    43us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:05:48.387609 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:48.387676 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:48.387821 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:05:48.401579 16356 rpcz_store.cc:269] 0709 13:05:45.774864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:48.400550 (+2625686us) service_pool.cc:211] Skipping call since client already timed out
0709 13:05:48.400742 (+   192us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:05:48.405928 17471 raft_consensus.cc:515] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:48.407965 16357 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41832 (request call id 1173) took 1170 ms. Trace:
I20260709 13:05:48.390362 17484 raft_consensus.cc:493] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:05:48.389854 16355 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33486 (request call id 45) took 1371 ms. Trace:
W20260709 13:05:48.392377 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 224985us
I20260709 13:05:48.390990 17468 raft_consensus.cc:515] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:48.382727 16202 rpcz_store.cc:276] 0709 13:05:45.814638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:48.160949 (+2346311us) service_pool.cc:224] Handling call
0709 13:05:48.161351 (+   402us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:48.162266 (+   915us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:48.167860 (+  5594us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:48.395046 17476 raft_consensus.cc:2804] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:48.393437 16199 raft_consensus.cc:1240] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:48.415014 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:48.408456 16357 rpcz_store.cc:276] 0709 13:05:47.237395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:48.104746 (+867351us) service_pool.cc:224] Handling call
0709 13:05:48.105051 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:48.136019 (+ 30968us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:48.136048 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:48.136092 (+    44us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:05:48.136123 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:48.407712 (+271589us) spinlock_profiling.cc:243] Waited 28.1 ms on lock 0x7b540001a754. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f489e01 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6
0709 13:05:48.407754 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:48.407903 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":64672640}
I20260709 13:05:48.427054 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:48.397176 17427 raft_consensus.cc:515] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:48.429623 17427 leader_election.cc:290] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:48.433707 17417 ts_tablet_manager.cc:1929] T 454d01f56c2d4533a035fdbc026c10b3 P e10b16d536674c0bb350a31d7ce5ff7f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:48.434259 17417 log.cc:1199] T 454d01f56c2d4533a035fdbc026c10b3 P e10b16d536674c0bb350a31d7ce5ff7f: Deleting WAL directory at /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602283040513-15057-0/minicluster-data/ts-0-root/wals/454d01f56c2d4533a035fdbc026c10b3
I20260709 13:05:48.434036 16103 catalog_manager.cc:5697] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: term changed from 1 to 2, leader changed from 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) to 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68). New cstate: current_term: 2 leader_uuid: "1109f76a0b7b443a84c0327c8707bc63" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:48.435531 17417 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60124 (request call id 78) took 4428 ms. Trace:
I20260709 13:05:48.436093 16103 catalog_manager.cc:5697] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: term changed from 1 to 2, leader changed from 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) to 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68). New cstate: current_term: 2 leader_uuid: "1109f76a0b7b443a84c0327c8707bc63" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:48.437651 17471 leader_election.cc:290] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:48.439216 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:05:48.441005 16137 debug-util.cc:398] Leaking SignalData structure 0x7b0800351500 after lost signal to thread 16307
W20260709 13:05:48.441424 16137 debug-util.cc:398] Leaking SignalData structure 0x7b08003517e0 after lost signal to thread 16308
W20260709 13:05:48.442533 16137 debug-util.cc:398] Leaking SignalData structure 0x7b080030c2a0 after lost signal to thread 16381
I20260709 13:05:48.445050 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:48.445252 16320 leader_election.cc:304] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:48.446442 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:48.447621 17471 raft_consensus.cc:2804] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:48.447947 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:48.449258 17446 raft_consensus.cc:493] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:05:48.449191 17464 consensus_queue.cc:1059] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:05:48.450708 17450 raft_consensus.cc:3055] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:48.451082 17450 raft_consensus.cc:740] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:05:48.451581 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:48.452030 17450 consensus_queue.cc:260] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:48.452414 16320 leader_election.cc:304] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:48.412477 16355 rpcz_store.cc:276] 0709 13:05:47.108768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:48.055661 (+946893us) service_pool.cc:224] Handling call
0709 13:05:48.055996 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:48.056223 (+   227us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:05:48.057409 (+  1186us) log.cc:844] Serialized 14 byte log entry
0709 13:05:48.378223 (+320814us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:48.378277 (+    54us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:05:48.378316 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:48.378381 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:48.378501 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32373,"prepare.queue_time_us":1201,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":215443,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":93,"thread_start_us":105954,"threads_started":2,"wal-append.queue_time_us":322643}
I20260709 13:05:48.453399 17450 raft_consensus.cc:3060] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:48.451587 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:48.454658 17464 raft_consensus.cc:2804] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:48.423748 17476 raft_consensus.cc:697] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [term 2 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:05:48.455190 17464 raft_consensus.cc:697] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 2 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:05:48.456048 17476 consensus_queue.cc:237] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:48.456638 17464 consensus_queue.cc:237] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:48.457185 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:05:48.458151 16249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:48.460462 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:48.461127 16320 leader_election.cc:304] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:48.450086 17446 raft_consensus.cc:515] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:48.461416 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:48.453555 17471 raft_consensus.cc:697] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 2 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:05:48.464010 17446 leader_election.cc:290] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:05:48.464694 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:48.463061 17471 consensus_queue.cc:237] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:48.466720 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:48.467947 17450 raft_consensus.cc:2804] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:48.468290 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:48.468688 17450 raft_consensus.cc:493] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:05:48.469310 17450 raft_consensus.cc:3060] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:48.461440 16204 raft_consensus.cc:2468] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 2.
I20260709 13:05:48.440171 16205 raft_consensus.cc:2393] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 2: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:05:48.482203 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bc3c8ff9b84838a2664335d7e1582b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:05:48.485221 16354 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41832 (request call id 1168) took 2499 ms (client timeout 2172 ms). Trace:
W20260709 13:05:48.485706 16354 rpcz_store.cc:269] 0709 13:05:45.986092 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:46.170691 (+184599us) service_pool.cc:224] Handling call
0709 13:05:48.485015 (+2314324us) spinlock_profiling.cc:243] Waited 172 ms on lock 0x7b54003cfd54. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:05:48.485113 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":394673024}
W20260709 13:05:48.482489 16352 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41832 (request call id 1172) took 1246 ms (client timeout 1551 ms). Trace:
I20260709 13:05:48.487502 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:05:48.487819 16352 rpcz_store.cc:269] 0709 13:05:47.236532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:47.747810 (+511278us) service_pool.cc:224] Handling call
0709 13:05:48.482238 (+734428us) spinlock_profiling.cc:243] Waited 59.8 ms on lock 0x7b54003093d4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:05:48.482419 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":137513216}
I20260709 13:05:48.392118 16914 leader_election.cc:304] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:48.491863 16320 leader_election.cc:304] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:48.499847 17474 raft_consensus.cc:493] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:05:48.500176 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:48.500510 17474 raft_consensus.cc:515] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:48.500780 17427 raft_consensus.cc:2804] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:48.502019 17427 raft_consensus.cc:697] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 2 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:05:48.502651 17474 leader_election.cc:290] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:48.503258 17447 leader_election.cc:290] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 2 election: Requested vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:05:48.500850 16281 raft_consensus.cc:2468] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 2.
I20260709 13:05:48.503572 17427 consensus_queue.cc:237] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:05:48.504806 16137 debug-util.cc:398] Leaking SignalData structure 0x7b080022e840 after lost signal to thread 16973
W20260709 13:05:48.505282 16137 debug-util.cc:398] Leaking SignalData structure 0x7b08002e30e0 after lost signal to thread 16974
W20260709 13:05:48.505641 16137 debug-util.cc:398] Leaking SignalData structure 0x7b080030f9a0 after lost signal to thread 17207
W20260709 13:05:48.506006 16137 debug-util.cc:398] Leaking SignalData structure 0x7b08002be8c0 after lost signal to thread 17288
W20260709 13:05:48.506433 16137 debug-util.cc:398] Leaking SignalData structure 0x7b0800314860 after lost signal to thread 17327
I20260709 13:05:48.506718 17369 raft_consensus.cc:493] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:05:48.506448 16173 leader_election.cc:304] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
W20260709 13:05:48.507061 16137 debug-util.cc:398] Leaking SignalData structure 0x7b0800267660 after lost signal to thread 17332
W20260709 13:05:48.507622 16137 debug-util.cc:398] Leaking SignalData structure 0x7b080030fa20 after lost signal to thread 17359
I20260709 13:05:48.507951 16173 leader_election.cc:304] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
W20260709 13:05:48.508073 16137 debug-util.cc:398] Leaking SignalData structure 0x7b0800305640 after lost signal to thread 17362
W20260709 13:05:48.508734 16137 debug-util.cc:398] Leaking SignalData structure 0x7b080031fb60 after lost signal to thread 17373
I20260709 13:05:48.420221 17425 leader_election.cc:290] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:48.508908 17460 raft_consensus.cc:2804] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:48.513036 16173 leader_election.cc:304] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:48.516453 16173 leader_election.cc:304] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:48.517771 16173 leader_election.cc:304] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:48.422394 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:05:48.508291 17418 raft_consensus.cc:2804] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:05:48.514616 16137 debug-util.cc:398] Leaking SignalData structure 0x7b080030fc60 after lost signal to thread 17374
I20260709 13:05:48.530048 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:05:48.521994 16320 leader_election.cc:304] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:48.422587 17420 consensus_queue.cc:1059] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.096s
I20260709 13:05:48.533461 16173 leader_election.cc:304] T 454d01f56c2d4533a035fdbc026c10b3 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:05:48.536650 16106 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38840 (request call id 189) took 4861 ms. Trace:
I20260709 13:05:48.522185 17447 raft_consensus.cc:2804] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:48.538496 16106 rpcz_store.cc:276] 0709 13:05:43.670916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:43.671077 (+   161us) service_pool.cc:224] Handling call
0709 13:05:43.743737 (+ 72660us) spinlock_profiling.cc:243] Waited 4.52 ms on lock 0x7b54001375a8. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f362567b331 00007f36256763fc 00007f36252481b4 00007f362534637e 00007f36238072a4 00007f3623807232 00007f3623807161 00007f36238070dc 00007f3623806392 00007f361d7c448c 00007f361d7c38c6
0709 13:05:48.527050 (+4783313us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4004035,"reported_tablets":1,"spinlock_wait_cycles":10404096}
I20260709 13:05:48.517411 17461 raft_consensus.cc:2749] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:05:48.529707 17416 raft_consensus.cc:2804] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:48.491786 17484 raft_consensus.cc:515] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:48.528154 17469 raft_consensus.cc:2804] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:48.517680 17460 raft_consensus.cc:493] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:05:48.507393 17369 raft_consensus.cc:515] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:48.532650 17418 raft_consensus.cc:493] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
W20260709 13:05:48.536526 16137 debug-util.cc:398] Leaking SignalData structure 0x7b0800321580 after lost signal to thread 17375
I20260709 13:05:48.521878 17479 consensus_queue.cc:1048] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:05:48.548398 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:48.546136 17458 raft_consensus.cc:493] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:48.549556 17469 raft_consensus.cc:493] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:05:48.550675 17460 raft_consensus.cc:3060] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:48.550843 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:05:48.544579 16173 raft_consensus.cc:2686] T 454d01f56c2d4533a035fdbc026c10b3 P e10b16d536674c0bb350a31d7ce5ff7f: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260709 13:05:48.531435 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 348643us
I20260709 13:05:48.541102 17435 raft_consensus.cc:2804] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:48.542737 17447 raft_consensus.cc:493] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:05:48.568486 17447 raft_consensus.cc:3060] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:48.569159 17369 leader_election.cc:290] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:48.570585 17419 raft_consensus.cc:3055] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:48.571022 17419 raft_consensus.cc:740] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:05:48.571355 17484 leader_election.cc:290] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:48.572021 17419 consensus_queue.cc:260] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:48.573666 17419 raft_consensus.cc:3060] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:48.559579 17418 raft_consensus.cc:3060] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:48.563158 16173 leader_election.cc:304] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:48.545580 17416 raft_consensus.cc:493] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:48.559619 16137 debug-util.cc:398] Leaking SignalData structure 0x7b08002d4fc0 after lost signal to thread 17376
I20260709 13:05:48.577288 17484 consensus_queue.cc:1059] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:05:48.435925 17417 rpcz_store.cc:276] 0709 13:05:44.007368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:44.007638 (+   270us) service_pool.cc:224] Handling call
0709 13:05:44.181057 (+173419us) ts_tablet_manager.cc:1151] Deleting tablet 454d01f56c2d4533a035fdbc026c10b3
0709 13:05:44.181188 (+   131us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:05:48.120647 (+3939459us) tablet_metadata.cc:665] Metadata flushed
0709 13:05:48.433527 (+312880us) tablet_metadata.cc:665] Metadata flushed
0709 13:05:48.435433 (+  1906us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2179873,"tablet-delete.queue_time_us":172049,"thread_start_us":1662036,"threads_started":1}
W20260709 13:05:48.597167 16137 debug-util.cc:398] Leaking SignalData structure 0x7b080019ad20 after lost signal to thread 17379
W20260709 13:05:48.563311 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 160578us
I20260709 13:05:48.599928 16914 leader_election.cc:304] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:48.600682 17484 raft_consensus.cc:3055] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:48.601236 17484 raft_consensus.cc:740] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:05:48.601919 16914 leader_election.cc:304] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:48.559499 17462 raft_consensus.cc:493] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:05:48.582837 17416 raft_consensus.cc:3060] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:48.564606 17469 raft_consensus.cc:3060] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:48.602465 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:05:48.608198 16090 catalog_manager.cc:5028] TS e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): tablet 454d01f56c2d4533a035fdbc026c10b3 (table test-workload [id=f364cfe226234c5b99453e3013c8717e]) successfully deleted
I20260709 13:05:48.602417 17484 consensus_queue.cc:260] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:48.614807 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:48.566601 17435 raft_consensus.cc:493] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:48.613086 16173 leader_election.cc:304] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:48.582892 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:48.630702 17425 raft_consensus.cc:2804] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:48.631212 17425 raft_consensus.cc:493] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:05:48.631659 17425 raft_consensus.cc:3060] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:48.631743 17435 raft_consensus.cc:3060] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:48.603494 16352 raft_consensus.cc:1275] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:05:48.599949 16137 debug-util.cc:398] Leaking SignalData structure 0x7b0800077060 after lost signal to thread 17382
I20260709 13:05:48.597612 17369 raft_consensus.cc:2804] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:48.639201 16353 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33486 (request call id 44) took 2224 ms. Trace:
I20260709 13:05:48.636350 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:48.566941 17458 raft_consensus.cc:515] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:48.602993 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:48.614616 17461 raft_consensus.cc:2804] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:48.653596 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:05:48.635763 17420 raft_consensus.cc:2804] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:48.618640 17480 leader_election.cc:290] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:48.650864 17468 leader_election.cc:290] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:48.652236 17484 raft_consensus.cc:3060] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:48.652601 16914 leader_election.cc:400] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 election: Vote denied by peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107) with higher term. Message: Invalid argument: T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 for earlier term 2. Current term is 3.
W20260709 13:05:48.648514 16248 connection.cc:256] RPC call timeout handler was delayed by -2.7157550909998918s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1879s for a response
I20260709 13:05:48.668388 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c15d8e9be8414c84912ab77b66bfb1" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:48.669297 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:05:48.637324 16137 debug-util.cc:398] Leaking SignalData structure 0x7b080016b000 after lost signal to thread 17385
I20260709 13:05:48.642215 16353 rpcz_store.cc:276] 0709 13:05:46.409377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:47.153397 (+744020us) service_pool.cc:224] Handling call
0709 13:05:47.153745 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:47.153986 (+   241us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:05:48.471377 (+1317391us) spinlock_profiling.cc:243] Waited 3.68 ms on lock 0x7b18001f4920. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f3625264de1 00007f36252715b1 00007f361f0314bc 00007f361c37f48b 00007f36251d9ab9 00007f361c39b69b 00007f361c39993f 00007f361c399455 00007f3622e813c7 00007f361f4939a7 00007f361f4a30bf
0709 13:05:48.471543 (+   166us) log.cc:844] Serialized 14 byte log entry
0709 13:05:48.633416 (+161873us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:48.633486 (+    70us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:05:48.633544 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:48.633632 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:48.633924 (+   292us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":25331,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":59,"raft.queue_time_us":10163,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":5889,"spinlock_wait_cycles":8458496,"thread_start_us":186686,"threads_started":3,"wal-append.queue_time_us":62626}
I20260709 13:05:48.710888 16947 raft_consensus.cc:2393] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 2: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
I20260709 13:05:48.684181 17420 raft_consensus.cc:493] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:05:48.723647 17420 raft_consensus.cc:3060] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:48.641685 17369 raft_consensus.cc:493] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:05:48.602921 17462 raft_consensus.cc:515] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:48.660986 17461 raft_consensus.cc:493] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:05:48.722003 16914 leader_election.cc:403] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
W20260709 13:05:48.726087 16137 debug-util.cc:398] Leaking SignalData structure 0x7b08000f6180 after lost signal to thread 17386
I20260709 13:05:48.743234 16200 raft_consensus.cc:1240] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [term 2 LEADER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:48.729334 17369 raft_consensus.cc:3060] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:48.711324 16199 raft_consensus.cc:2468] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 1.
W20260709 13:05:48.780542 16137 debug-util.cc:398] Leaking SignalData structure 0x7b08001cd860 after lost signal to thread 17391
I20260709 13:05:48.757967 17461 raft_consensus.cc:3060] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:48.811208 16320 leader_election.cc:304] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
W20260709 13:05:48.812371 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 180780us
I20260709 13:05:48.814998 16322 leader_election.cc:304] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:48.810860 16173 leader_election.cc:304] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
W20260709 13:05:48.817358 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RunLeaderElection -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 101497us
I20260709 13:05:48.805217 16945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
W20260709 13:05:48.808290 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 155947us
W20260709 13:05:48.805680 16137 debug-util.cc:398] Leaking SignalData structure 0x7b0800131f40 after lost signal to thread 17392
I20260709 13:05:48.837253 16322 leader_election.cc:304] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
W20260709 13:05:48.836561 16137 debug-util.cc:398] Leaking SignalData structure 0x7b080013cd80 after lost signal to thread 17394
I20260709 13:05:48.838907 17422 raft_consensus.cc:2804] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:48.862062 17422 raft_consensus.cc:493] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:05:48.862591 17422 raft_consensus.cc:3060] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:05:48.864233 16320 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:48.869557 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 58787.5us
I20260709 13:05:48.872152 17462 leader_election.cc:290] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:48.810186 17475 consensus_queue.cc:1059] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
W20260709 13:05:48.856130 16137 debug-util.cc:398] Leaking SignalData structure 0x7b080016b140 after lost signal to thread 17395
I20260709 13:05:48.844607 17495 raft_consensus.cc:2804] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:48.847350 17468 raft_consensus.cc:2804] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:48.873142 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:48.887897 17501 raft_consensus.cc:2749] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 3 LEADER]: Leader election lost for term 2. Reason: Vote denied by peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107) with higher term. Message: Invalid argument: T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 for earlier term 2. Current term is 3.
I20260709 13:05:48.885108 17468 raft_consensus.cc:493] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:05:48.883052 17495 raft_consensus.cc:493] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:05:48.894518 17495 raft_consensus.cc:3060] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:05:48.882378 16137 debug-util.cc:398] Leaking SignalData structure 0x7b080016b180 after lost signal to thread 17396
I20260709 13:05:48.892132 17468 raft_consensus.cc:3060] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:05:48.901247 16137 debug-util.cc:398] Leaking SignalData structure 0x7b080016b0c0 after lost signal to thread 17398
I20260709 13:05:48.929003 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:05:48.948521 17458 leader_election.cc:290] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:48.950344 17450 raft_consensus.cc:515] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:48.950893 16945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:05:48.953199 17450 leader_election.cc:290] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 2 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:48.955621 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:05:48.955942 16946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:05:48.956290 16948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
W20260709 13:05:48.920650 16137 debug-util.cc:398] Leaking SignalData structure 0x7b080016b440 after lost signal to thread 17399
I20260709 13:05:48.959545 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
W20260709 13:05:48.960191 16137 debug-util.cc:398] Leaking SignalData structure 0x7b080019acc0 after lost signal to thread 17403
I20260709 13:05:48.959313 17418 raft_consensus.cc:515] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:48.949972 17369 raft_consensus.cc:515] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:48.915903 17505 raft_consensus.cc:3060] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:48.968918 17418 leader_election.cc:290] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 2 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:48.969741 17416 raft_consensus.cc:515] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:05:48.963508 16137 debug-util.cc:398] Leaking SignalData structure 0x7b080019aa60 after lost signal to thread 17404
I20260709 13:05:48.975107 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
W20260709 13:05:48.978658 16137 debug-util.cc:398] Leaking SignalData structure 0x7b080016b420 after lost signal to thread 17405
I20260709 13:05:48.976498 16945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:05:48.964319 17460 raft_consensus.cc:515] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:05:48.986297 16137 debug-util.cc:398] Leaking SignalData structure 0x7b080016b400 after lost signal to thread 17407
I20260709 13:05:48.965366 17447 raft_consensus.cc:515] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:48.991395 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:05:48.999650 16137 debug-util.cc:398] Leaking SignalData structure 0x7b080016b3a0 after lost signal to thread 17409
I20260709 13:05:49.019354 16948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:05:48.991395 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:05:49.023612 17369 leader_election.cc:290] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 2 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:05:49.016780 16137 debug-util.cc:398] Leaking SignalData structure 0x7b0800313060 after lost signal to thread 17410
W20260709 13:05:49.039635 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 210591us
W20260709 13:05:49.040711 16914 leader_election.cc:336] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Timed out: RequestConsensusVote RPC to 127.14.180.66:45823 timed out after 1.754s (SENT)
I20260709 13:05:49.043661 17468 raft_consensus.cc:515] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:49.029383 16106 catalog_manager.cc:5697] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 1 to 2, leader changed from e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) to 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66). New cstate: current_term: 2 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:49.048599 17416 leader_election.cc:290] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:49.051254 16945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:05:49.028800 17460 leader_election.cc:290] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 2 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:49.060400 16946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f022e2e63ae4461d834e476ff2666991" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:05:49.063298 16948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:05:49.058389 17468 leader_election.cc:290] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:05:49.073539 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:05:49.098120 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 233043us
W20260709 13:05:49.099000 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 227773us
I20260709 13:05:49.102769 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:49.090396 17435 raft_consensus.cc:515] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:49.105269 17475 consensus_queue.cc:1243] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer e10b16d536674c0bb350a31d7ce5ff7f log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:05:49.113260 16205 raft_consensus.cc:1275] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:49.118119 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:05:49.097740 17425 raft_consensus.cc:515] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:49.178129 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:05:49.179256 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 312286us
I20260709 13:05:49.180465 16322 leader_election.cc:304] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:49.186287 16200 raft_consensus.cc:1275] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:05:49.140558 17419 consensus_meta.cc:287] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f: Time spent flushing consensus metadata: real 0.566s	user 0.016s	sys 0.023s
I20260709 13:05:49.195124 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:49.166463 17505 raft_consensus.cc:2749] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:49.196393 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:49.197717 16948 raft_consensus.cc:1240] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:49.198851 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:49.199297 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:05:49.165867 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:49.166678 17435 leader_election.cc:290] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:49.201239 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:49.201239 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:49.202893 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:49.204988 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:49.206578 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:05:49.209748 16320 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:49.154614 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:05:49.216346 16945 raft_consensus.cc:1275] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:49.219254 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:05:49.167471 17422 raft_consensus.cc:515] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:05:49.240625 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 60204.7us
I20260709 13:05:49.244522 16322 leader_election.cc:304] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:05:49.242864 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 262564us
I20260709 13:05:49.250852 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:05:49.251276 17479 raft_consensus.cc:3055] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:49.245702 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:05:49.258689 17479 raft_consensus.cc:740] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:05:49.259114 16201 raft_consensus.cc:1275] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:49.248013 17447 leader_election.cc:290] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 2 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:49.247097 17484 raft_consensus.cc:2749] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:49.255218 17450 raft_consensus.cc:2749] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:05:49.259850 17479 consensus_queue.cc:260] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:49.264860 16282 raft_consensus.cc:1275] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:49.275117 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:05:49.266479 17469 consensus_meta.cc:287] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f: Time spent flushing consensus metadata: real 0.634s	user 0.014s	sys 0.003s
I20260709 13:05:49.246763 17506 consensus_queue.cc:1048] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 13:05:49.272002 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:05:49.288596 16205 raft_consensus.cc:3060] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:49.260563 16204 raft_consensus.cc:1240] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [term 2 LEADER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:49.271394 16322 leader_election.cc:304] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:49.297796 16322 leader_election.cc:304] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:49.278508 17497 consensus_queue.cc:1048] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:05:49.262840 17435 consensus_queue.cc:1048] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
W20260709 13:05:49.299830 17420 consensus_meta.cc:287] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f: Time spent flushing consensus metadata: real 0.576s	user 0.010s	sys 0.002s
I20260709 13:05:49.270018 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bc3c8ff9b84838a2664335d7e1582b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:05:49.283231 16274 raft_consensus.cc:1275] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:49.300355 17420 raft_consensus.cc:515] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:49.301427 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:49.301486 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:05:49.302173 16274 raft_consensus.cc:3060] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:49.302695 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:05:49.303897 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:05:49.305009 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f022e2e63ae4461d834e476ff2666991" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:49.283584 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:49.283921 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:05:49.284174 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 105791us
I20260709 13:05:49.284402 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:49.284889 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f022e2e63ae4461d834e476ff2666991" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:49.285620 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:49.285892 17479 raft_consensus.cc:3060] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:49.286777 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:49.286660 17469 raft_consensus.cc:515] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:49.284920 16203 raft_consensus.cc:1240] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:49.289983 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:49.293370 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:49.314934 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:49.306288 17461 raft_consensus.cc:515] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:49.319553 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:05:49.353714 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 56010us
I20260709 13:05:49.354167 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:49.357417 16322 leader_election.cc:304] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:49.359949 17484 raft_consensus.cc:2749] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:49.361192 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:05:49.361799 16351 raft_consensus.cc:3060] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:05:49.321107 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 74654.1us
W20260709 13:05:49.364812 16321 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:49.364051 16205 raft_consensus.cc:2468] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 3.
I20260709 13:05:49.368379 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:49.319129 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:49.349812 17427 raft_consensus.cc:2804] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:49.372035 17427 raft_consensus.cc:493] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:05:49.372444 17427 raft_consensus.cc:3060] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:49.372386 17495 raft_consensus.cc:515] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:49.369611 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:49.318950 17450 raft_consensus.cc:2749] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:49.370278 16947 raft_consensus.cc:1240] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:49.370916 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:49.371515 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:05:49.374424 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:05:49.374294 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:49.360898 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:05:49.374337 16357 raft_consensus.cc:2468] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 1.
I20260709 13:05:49.380299 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:05:49.382880 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:49.383249 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:49.383970 17425 leader_election.cc:290] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:49.384536 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:49.385191 16350 raft_consensus.cc:2468] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 1.
I20260709 13:05:49.374114 17460 consensus_queue.cc:1048] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 13:05:49.382925 16199 raft_consensus.cc:2393] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 2: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:05:49.362670 17511 raft_consensus.cc:493] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:05:49.380330 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:49.388309 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:49.377737 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:49.389758 16352 raft_consensus.cc:3060] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:49.392745 16351 raft_consensus.cc:2468] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 2.
I20260709 13:05:49.393401 16356 raft_consensus.cc:2393] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 2: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:05:49.387015 17511 raft_consensus.cc:515] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:49.350172 17435 consensus_queue.cc:1048] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 13:05:49.395229 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:49.414937 16350 raft_consensus.cc:2468] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 1.
I20260709 13:05:49.416981 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:49.420629 17469 leader_election.cc:290] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 2 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:49.420768 16354 raft_consensus.cc:2468] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 2.
I20260709 13:05:49.423594 17420 leader_election.cc:290] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 2 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:49.424933 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:05:49.425686 16320 leader_election.cc:304] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:49.392463 17497 raft_consensus.cc:493] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:49.422286 16200 raft_consensus.cc:1240] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:49.429965 17450 raft_consensus.cc:2804] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:49.436105 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:49.388747 17444 consensus_queue.cc:1059] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:05:49.432868 17497 raft_consensus.cc:515] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:49.448863 15057 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:49.468801 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:49.474334 17497 leader_election.cc:290] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:05:49.456832 17422 leader_election.cc:290] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 2 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:05:49.475834 16320 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:49.478663 17425 consensus_queue.cc:1048] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:05:49.444439 17450 raft_consensus.cc:697] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 3 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:05:49.483049 17501 consensus_queue.cc:1048] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:05:49.483877 16103 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55244 (request call id 119) took 1355 ms. Trace:
I20260709 13:05:49.435384 17484 consensus_queue.cc:1059] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:05:49.511390 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:05:49.516628 16208 raft_consensus.cc:1240] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:49.516966 16356 raft_consensus.cc:3060] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:49.488303 16173 leader_election.cc:304] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:05:49.519078 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:05:49.512467 16352 raft_consensus.cc:2468] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 2.
I20260709 13:05:49.512775 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bc3c8ff9b84838a2664335d7e1582b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:05:49.526013 16354 raft_consensus.cc:3060] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:49.513460 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:49.513986 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:49.515695 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:05:49.534761 16351 raft_consensus.cc:3060] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:49.515741 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:49.480690 17461 leader_election.cc:290] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:05:49.535995 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 47798.5us
I20260709 13:05:49.476692 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:49.536727 16201 raft_consensus.cc:2368] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 2. Current term is 3.
I20260709 13:05:49.539296 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:49.540885 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:49.534019 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:05:49.542399 16173 leader_election.cc:304] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:05:49.484369 16103 rpcz_store.cc:276] 0709 13:05:48.128330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:48.128523 (+   193us) service_pool.cc:224] Handling call
0709 13:05:49.483737 (+1355214us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:05:48.813649 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:05:48.814823 (+  1174us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:05:48.814903 (+    80us) write_op.cc:435] Acquired schema lock
0709 13:05:48.830626 (+ 15723us) tablet.cc:662] Decoding operations
0709 13:05:48.831160 (+   534us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:05:48.831290 (+   130us) write_op.cc:641] Partition lock acquired for write op
0709 13:05:48.831321 (+    31us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:05:48.863847 (+ 32526us) tablet.cc:701] Row locks acquired
0709 13:05:48.880046 (+ 16199us) write_op.cc:260] PREPARE: finished
0709 13:05:48.888341 (+  8295us) write_op.cc:270] Start()
0709 13:05:48.888529 (+   188us) write_op.cc:276] Timestamp: P: 1783602348888252 usec, L: 0
0709 13:05:48.888557 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 13:05:48.894440 (+  5883us) log.cc:844] Serialized 919 byte log entry
0709 13:05:49.367481 (+473041us) op_driver.cc:464] REPLICATION: finished
0709 13:05:49.414991 (+ 47510us) write_op.cc:301] APPLY: starting
0709 13:05:49.415094 (+   103us) tablet.cc:1367] starting BulkCheckPresence
0709 13:05:49.415242 (+   148us) tablet.cc:1370] finished BulkCheckPresence
0709 13:05:49.415394 (+   152us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:05:49.418732 (+  3338us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:05:49.419003 (+   271us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:05:49.419045 (+    42us) write_op.cc:312] APPLY: finished
0709 13:05:49.419326 (+   281us) log.cc:844] Serialized 29 byte log entry
0709 13:05:49.419523 (+   197us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:49.419600 (+    77us) write_op.cc:454] Released schema lock
0709 13:05:49.419660 (+    60us) write_op.cc:341] FINISH: Updating metrics
0709 13:05:49.420000 (+   340us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:49.420026 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":911,"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":47165,"apply.run_cpu_time_us":2727,"apply.run_wall_time_us":5013,"num_ops":2,"prepare.queue_time_us":166556,"prepare.run_cpu_time_us":44953,"prepare.run_wall_time_us":316740,"raft.queue_time_us":145231,"raft.run_cpu_time_us":9040,"raft.run_wall_time_us":50835,"replication_time_us":478761,"thread_start_us":456183,"threads_started":4,"wal-append.queue_time_us":350599}]]}
I20260709 13:05:49.552238 16350 raft_consensus.cc:3060] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:49.552886 17427 raft_consensus.cc:515] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:49.514343 16914 leader_election.cc:304] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:49.558331 16351 raft_consensus.cc:2468] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 2.
I20260709 13:05:49.534201 16202 raft_consensus.cc:2468] T b9e1324823f04d8da5a4b3ddbd061c0e P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 1.
I20260709 13:05:49.539494 17507 raft_consensus.cc:3060] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:49.606266 16354 raft_consensus.cc:2468] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 3.
I20260709 13:05:49.607208 16356 raft_consensus.cc:2468] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 2.
I20260709 13:05:49.559118 17432 raft_consensus.cc:493] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:05:49.547534 17419 raft_consensus.cc:2749] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:49.544023 17495 leader_election.cc:290] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 2 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:49.611270 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:49.613283 16173 leader_election.cc:304] T b9e1324823f04d8da5a4b3ddbd061c0e P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:05:49.615788 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:49.619185 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:49.620034 16173 leader_election.cc:304] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:05:49.622030 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:49.618755 16283 raft_consensus.cc:2468] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 1.
I20260709 13:05:49.623718 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:49.624698 17516 raft_consensus.cc:493] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:05:49.625125 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:49.625320 17516 raft_consensus.cc:515] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:49.559996 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:49.625762 16278 raft_consensus.cc:2468] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 2.
I20260709 13:05:49.627293 16173 leader_election.cc:304] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
W20260709 13:05:49.627705 16322 connection.cc:256] RPC call timeout handler was delayed by -1.3372377760000518s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2097s for a response
I20260709 13:05:49.610107 17425 raft_consensus.cc:2749] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:49.613824 17422 raft_consensus.cc:493] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:49.613474 17494 raft_consensus.cc:493] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:49.653684 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:05:49.627406 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 113139us
I20260709 13:05:49.652559 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:49.654402 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:05:49.621006 17511 leader_election.cc:290] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:49.626819 17474 raft_consensus.cc:2749] T b9e1324823f04d8da5a4b3ddbd061c0e P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:49.655525 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:49.674870 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:05:49.622730 17432 raft_consensus.cc:515] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:49.622100 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:05:49.656142 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:05:49.679543 16278 raft_consensus.cc:3060] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:49.660063 17516 leader_election.cc:290] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:05:49.670957 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
W20260709 13:05:49.672499 17523 log.cc:927] Time spent T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:05:49.668716 17447 consensus_queue.cc:1059] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 13:05:49.674642 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:49.599223 17450 consensus_queue.cc:237] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:49.683987 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:05:49.692716 16207 raft_consensus.cc:3060] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:49.651069 16352 raft_consensus.cc:1240] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:49.678921 17419 raft_consensus.cc:493] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:05:49.676359 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:05:49.687731 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:05:49.672519 17514 log.cc:927] Time spent T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63: Append to log took a long time: real 0.294s	user 0.006s	sys 0.000s
I20260709 13:05:49.666288 17494 raft_consensus.cc:515] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:49.683483 17468 raft_consensus.cc:493] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:49.663297 17422 raft_consensus.cc:515] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:49.688747 16348 raft_consensus.cc:3060] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:49.662866 17418 raft_consensus.cc:2749] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:49.654371 17427 leader_election.cc:290] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 2 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:49.699462 16173 leader_election.cc:304] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
W20260709 13:05:49.760607 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 61285us
I20260709 13:05:49.761646 16173 leader_election.cc:304] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:05:49.700457 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:49.702466 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:05:49.762521 16173 leader_election.cc:304] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:05:49.689565 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:49.732265 16948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:05:49.730588 17468 raft_consensus.cc:515] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:49.744241 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:49.747087 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:49.748245 16274 raft_consensus.cc:2468] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 3.
I20260709 13:05:49.751121 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:49.627717 17505 raft_consensus.cc:2749] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:49.756093 16278 raft_consensus.cc:2468] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 3.
W20260709 13:05:49.767069 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 138755us
I20260709 13:05:49.784929 16277 raft_consensus.cc:1275] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:05:49.785970 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:49.786885 16278 raft_consensus.cc:2468] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 2.
I20260709 13:05:49.768123 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:49.778154 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c15d8e9be8414c84912ab77b66bfb1" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:05:49.779474 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:49.790810 16205 raft_consensus.cc:1240] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:49.744275 17432 leader_election.cc:290] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:05:49.792955 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:49.707255 17419 raft_consensus.cc:515] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:49.775264 17469 raft_consensus.cc:2804] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:49.796725 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:49.797039 16203 raft_consensus.cc:1240] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 1. Current term is 2. Ops: []
W20260709 13:05:49.803340 16320 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:49.796331 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:05:49.805613 16321 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:49.870911 16208 raft_consensus.cc:1240] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:05:49.780151 17474 raft_consensus.cc:2749] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:49.794977 17418 raft_consensus.cc:2804] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:49.889034 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:49.899569 16208 raft_consensus.cc:1240] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:49.900972 16356 raft_consensus.cc:1240] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 1. Current term is 2. Ops: []
W20260709 13:05:49.901525 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 139041us
I20260709 13:05:49.902273 16173 leader_election.cc:304] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:05:49.903112 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:49.903606 16173 leader_election.cc:304] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:05:49.902181 16351 raft_consensus.cc:1240] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:49.904384 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:49.904963 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:49.905458 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:49.906054 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:49.906487 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:49.906955 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:49.907238 16351 raft_consensus.cc:2410] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:05:49.907714 16357 raft_consensus.cc:2393] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 2: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:05:49.907620 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:49.908367 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:49.908555 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:49.908757 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:49.909262 16351 raft_consensus.cc:2393] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 3: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:05:49.909664 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:05:49.909901 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:49.910249 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:49.902362 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:49.910663 16353 raft_consensus.cc:2393] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 2: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:05:49.933527 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:05:49.933938 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:49.775480 16914 leader_election.cc:304] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:49.808514 17469 raft_consensus.cc:493] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:05:49.937853 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:49.951757 16280 raft_consensus.cc:2468] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 1.
I20260709 13:05:49.898689 17418 raft_consensus.cc:493] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:05:49.953191 16322 leader_election.cc:304] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:49.951741 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:49.935014 17509 consensus_queue.cc:1059] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 13:05:49.957760 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:49.958843 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:05:49.959052 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:49.959908 16281 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "26565509c81343bc818483042146461a"
dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
mode: GRACEFUL
new_leader_uuid: "1109f76a0b7b443a84c0327c8707bc63"
 from {username='slave'} at 127.0.0.1:39058
I20260709 13:05:49.960530 16281 raft_consensus.cc:606] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Received request to transfer leadership to TS 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:05:49.960887 16281 raft_consensus.cc:614] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:49.961000 17509 raft_consensus.cc:493] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:05:49.961542 17509 raft_consensus.cc:515] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:49.962044 16281 raft_consensus.cc:3055] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:49.936267 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:49.954211 17425 raft_consensus.cc:2749] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:49.963667 17509 leader_election.cc:290] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:49.963807 16349 raft_consensus.cc:1240] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 2 LEADER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:49.955605 17474 raft_consensus.cc:2804] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:49.955761 17418 raft_consensus.cc:3060] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:49.960009 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:49.965910 16349 raft_consensus.cc:1240] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:49.954044 17462 raft_consensus.cc:493] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:05:49.957629 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:49.969297 16207 raft_consensus.cc:2468] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 2.
I20260709 13:05:49.968047 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:49.970927 17525 raft_consensus.cc:493] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:05:49.947252 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:49.972604 16349 raft_consensus.cc:1240] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:49.970227 16205 raft_consensus.cc:1240] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:49.962404 16281 raft_consensus.cc:740] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:05:49.952365 17469 raft_consensus.cc:3060] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:49.977458 16349 raft_consensus.cc:1240] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:49.978114 16947 raft_consensus.cc:1240] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:49.974673 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:49.975937 16355 raft_consensus.cc:2468] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 2.
I20260709 13:05:49.979054 16349 raft_consensus.cc:1240] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 2 LEADER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:49.979890 16356 raft_consensus.cc:1240] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:49.980827 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bc3c8ff9b84838a2664335d7e1582b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:49.981063 16354 raft_consensus.cc:1240] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 2 LEADER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:49.981106 16281 consensus_queue.cc:260] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:49.982213 16281 raft_consensus.cc:3060] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:49.982653 17419 leader_election.cc:290] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:49.983603 16280 raft_consensus.cc:3055] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:49.983707 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:49.983963 16352 raft_consensus.cc:1240] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:49.984170 16280 raft_consensus.cc:740] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:05:49.985185 16275 raft_consensus.cc:3055] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:49.985030 16280 consensus_queue.cc:260] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:49.985539 16275 raft_consensus.cc:740] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:05:49.985975 16280 raft_consensus.cc:3060] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:49.993543 16281 raft_consensus.cc:1275] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:49.996803 16353 raft_consensus.cc:1240] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:49.993647 16280 raft_consensus.cc:1275] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:05:49.973798 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 213675us
I20260709 13:05:50.003755 16914 leader_election.cc:304] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:50.004528 17425 raft_consensus.cc:2749] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:50.005010 16914 leader_election.cc:304] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:50.005852 17425 raft_consensus.cc:2749] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:50.006335 16914 leader_election.cc:304] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:05:49.986353 16275 consensus_queue.cc:260] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:50.007995 16275 raft_consensus.cc:3060] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:50.008396 16914 leader_election.cc:304] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:05:50.009302 17461 raft_consensus.cc:2749] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:50.009943 17461 raft_consensus.cc:2749] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:49.968415 17509 raft_consensus.cc:2749] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:50.011124 16914 leader_election.cc:304] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:50.012456 17425 raft_consensus.cc:2749] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:50.013656 16914 leader_election.cc:304] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:05:50.017238 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 64153.3us
W20260709 13:05:50.018467 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 114917us
W20260709 13:05:50.019019 16249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:50.019558 16173 leader_election.cc:304] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:05:49.972781 17516 raft_consensus.cc:493] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:05:49.974054 17474 raft_consensus.cc:697] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 2 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:05:49.980878 17528 raft_consensus.cc:2804] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:50.010253 16276 consensus_queue.cc:237] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:05:50.025254 16173 leader_election.cc:304] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:05:50.020112 17425 raft_consensus.cc:2749] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:50.027241 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:50.030268 16173 leader_election.cc:304] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:05:50.031783 17505 raft_consensus.cc:2749] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:49.975239 17462 raft_consensus.cc:515] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:05:50.035681 16249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:49.971524 17525 raft_consensus.cc:515] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:50.035233 16173 leader_election.cc:304] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:05:50.039179 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:05:50.024704 17420 raft_consensus.cc:2804] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:50.045562 16353 raft_consensus.cc:1275] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:05:50.047812 16357 raft_consensus.cc:2368] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 3 LEADER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 2. Current term is 3.
I20260709 13:05:50.034950 17528 raft_consensus.cc:493] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:05:50.049028 17528 raft_consensus.cc:3060] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:50.034929 17530 raft_consensus.cc:2749] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:50.023038 17516 raft_consensus.cc:515] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:50.056591 16278 raft_consensus.cc:2468] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 1.
I20260709 13:05:50.039342 17511 raft_consensus.cc:2749] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:50.062000 16353 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3"
dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
mode: GRACEFUL
new_leader_uuid: "1109f76a0b7b443a84c0327c8707bc63"
 from {username='slave'} at 127.0.0.1:56792
I20260709 13:05:50.066609 16353 raft_consensus.cc:606] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 1 LEADER]: Received request to transfer leadership to TS 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:05:50.068054 17462 leader_election.cc:290] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:05:50.043903 16914 leader_election.cc:304] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:05:50.068758 17462 consensus_queue.cc:1059] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:50.070633 16348 raft_consensus.cc:2468] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 2.
I20260709 13:05:50.071739 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:05:50.072417 17461 raft_consensus.cc:2749] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:50.073137 16351 raft_consensus.cc:1240] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:50.072570 16348 raft_consensus.cc:2393] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 2: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:05:50.063699 16322 leader_election.cc:304] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:50.068150 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c15d8e9be8414c84912ab77b66bfb1" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:05:50.055927 17420 raft_consensus.cc:697] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:05:50.077798 17516 leader_election.cc:290] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:50.086745 17474 consensus_queue.cc:237] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:50.088229 17516 raft_consensus.cc:3055] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:50.088624 17516 raft_consensus.cc:740] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:05:50.081928 16275 raft_consensus.cc:1275] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:50.083222 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:05:50.085137 16249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:50.091028 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 52584.2us
I20260709 13:05:50.080627 16248 leader_election.cc:304] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:05:50.078444 16350 consensus_meta.cc:287] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 0.525s	user 0.010s	sys 0.001s
I20260709 13:05:50.093824 16322 leader_election.cc:304] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:50.094875 16173 leader_election.cc:304] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:05:50.089455 17516 consensus_queue.cc:260] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:50.097366 16322 leader_election.cc:304] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:50.098531 17509 raft_consensus.cc:2749] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:50.098938 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:05:50.099385 17511 raft_consensus.cc:2804] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:50.099702 17422 leader_election.cc:290] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:50.099917 17511 raft_consensus.cc:697] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:05:50.100129 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:50.075142 17468 leader_election.cc:290] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:05:50.100791 16283 raft_consensus.cc:2468] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 2.
I20260709 13:05:50.101227 16173 leader_election.cc:304] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:05:50.102723 16173 leader_election.cc:304] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:05:50.096990 16914 leader_election.cc:304] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:50.103123 17540 raft_consensus.cc:2749] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:50.103914 16173 leader_election.cc:304] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:05:50.104218 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c15d8e9be8414c84912ab77b66bfb1" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:50.098959 16322 leader_election.cc:304] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:50.095952 17475 raft_consensus.cc:2749] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:50.096325 16350 raft_consensus.cc:2468] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 2.
I20260709 13:05:50.106020 17461 raft_consensus.cc:2749] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:05:50.105712 17507 raft_consensus.cc:2749] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:50.106467 17516 raft_consensus.cc:3060] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:50.106524 17468 raft_consensus.cc:2749] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:50.109443 17507 raft_consensus.cc:2804] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:50.107168 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:05:50.108623 16356 raft_consensus.cc:1240] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:50.111747 16283 raft_consensus.cc:3060] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:50.107868 16322 leader_election.cc:304] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:50.113565 17468 raft_consensus.cc:2749] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:50.107005 17533 raft_consensus.cc:2804] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:50.117630 16106 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38840 (request call id 190) took 1257 ms. Trace:
I20260709 13:05:50.117914 16322 leader_election.cc:304] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:50.107728 17525 leader_election.cc:290] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:50.119100 17533 raft_consensus.cc:697] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 2 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:05:50.119215 16322 leader_election.cc:304] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:50.108743 17535 raft_consensus.cc:2804] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:50.119860 17535 raft_consensus.cc:493] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:05:50.126760 17535 raft_consensus.cc:3060] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:50.119891 16105 catalog_manager.cc:5697] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f reported cstate change: term changed from 1 to 2, leader changed from 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) to 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68). New cstate: current_term: 2 leader_uuid: "1109f76a0b7b443a84c0327c8707bc63" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:50.128124 16322 leader_election.cc:304] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:05:50.122335 17475 raft_consensus.cc:2749] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:50.132036 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:05:50.128005 16105 catalog_manager.cc:5697] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f reported cstate change: term changed from 1 to 2, leader changed from 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) to 363bb2f744eb486f9ad726f08214c98e (127.14.180.67). New cstate: current_term: 2 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } }
I20260709 13:05:50.106855 17444 raft_consensus.cc:2804] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:50.138599 16105 catalog_manager.cc:5697] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f reported cstate change: term changed from 1 to 2, leader changed from 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) to e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65). New cstate: current_term: 2 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:05:50.140515 16246 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:50.143365 16248 leader_election.cc:304] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:05:50.141038 16207 raft_consensus.cc:1240] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:50.144632 16322 leader_election.cc:304] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:50.139230 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:05:50.120954 17520 log.cc:927] Time spent T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.333s	user 0.001s	sys 0.001s
I20260709 13:05:50.143586 16320 leader_election.cc:304] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:05:50.111802 17418 raft_consensus.cc:515] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:50.157181 17418 leader_election.cc:290] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 2 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:50.118002 16106 rpcz_store.cc:276] 0709 13:05:48.860083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:48.860359 (+   276us) service_pool.cc:224] Handling call
0709 13:05:50.117582 (+1257223us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:05:49.130562 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:05:49.170435 (+ 39873us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:05:49.170483 (+    48us) write_op.cc:435] Acquired schema lock
0709 13:05:49.170503 (+    20us) tablet.cc:662] Decoding operations
0709 13:05:49.170908 (+   405us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:05:49.170962 (+    54us) write_op.cc:641] Partition lock acquired for write op
0709 13:05:49.171000 (+    38us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:05:49.171187 (+   187us) tablet.cc:701] Row locks acquired
0709 13:05:49.171209 (+    22us) write_op.cc:260] PREPARE: finished
0709 13:05:49.171432 (+   223us) write_op.cc:270] Start()
0709 13:05:49.171552 (+   120us) write_op.cc:276] Timestamp: P: 1783602349171380 usec, L: 0
0709 13:05:49.171576 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:05:49.245254 (+ 73678us) log.cc:844] Serialized 541 byte log entry
0709 13:05:49.422829 (+177575us) op_driver.cc:464] REPLICATION: finished
0709 13:05:49.423181 (+   352us) write_op.cc:301] APPLY: starting
0709 13:05:49.423256 (+    75us) tablet.cc:1367] starting BulkCheckPresence
0709 13:05:49.425234 (+  1978us) tablet.cc:1370] finished BulkCheckPresence
0709 13:05:49.431512 (+  6278us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:05:49.467958 (+ 36446us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:05:49.488085 (+ 20127us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:05:49.514654 (+ 26569us) write_op.cc:312] APPLY: finished
0709 13:05:49.514863 (+   209us) log.cc:844] Serialized 23 byte log entry
0709 13:05:49.515045 (+   182us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:49.515145 (+   100us) write_op.cc:454] Released schema lock
0709 13:05:49.515185 (+    40us) write_op.cc:341] FINISH: Updating metrics
0709 13:05:49.515569 (+   384us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:49.515601 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":629,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":130,"apply.run_cpu_time_us":1938,"apply.run_wall_time_us":92323,"num_ops":1,"prepare.queue_time_us":79975,"prepare.run_cpu_time_us":3479,"prepare.run_wall_time_us":118610,"replication_time_us":222124}]]}
I20260709 13:05:50.159730 16201 raft_consensus.cc:1240] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:50.157793 17525 consensus_queue.cc:1059] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:50.160333 17444 raft_consensus.cc:697] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 2 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:05:50.160632 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c15d8e9be8414c84912ab77b66bfb1" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:50.161093 17525 raft_consensus.cc:3055] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:50.161536 17525 raft_consensus.cc:740] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:05:50.161316 17444 consensus_queue.cc:237] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:50.162788 17427 raft_consensus.cc:2804] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:50.161849 16203 raft_consensus.cc:2393] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 2: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:05:50.113583 17507 raft_consensus.cc:697] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [term 3 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:05:50.120147 17533 consensus_queue.cc:237] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:50.167690 17461 consensus_queue.cc:1048] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:50.168588 16202 raft_consensus.cc:1240] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:50.166960 16248 leader_election.cc:304] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:05:50.138832 17450 raft_consensus.cc:2749] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:05:50.165441 17540 raft_consensus.cc:2749] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:50.177919 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:50.176939 16322 leader_election.cc:304] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:50.182066 16248 leader_election.cc:304] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:05:50.163329 17427 raft_consensus.cc:697] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 2 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:05:50.191273 16246 leader_election.cc:304] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:50.106176 17511 consensus_queue.cc:237] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:50.170608 17479 raft_consensus.cc:2749] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:50.167722 17534 raft_consensus.cc:2804] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:50.185256 17460 raft_consensus.cc:3055] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:50.106748 17420 consensus_queue.cc:237] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:50.204676 16322 leader_election.cc:304] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:50.162438 17525 consensus_queue.cc:260] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:50.216796 16248 leader_election.cc:304] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:50.200090 17450 raft_consensus.cc:2749] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:50.230950 17525 raft_consensus.cc:3060] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:50.209895 17497 raft_consensus.cc:3055] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:50.233016 16283 raft_consensus.cc:2468] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 2.
I20260709 13:05:50.214032 17460 raft_consensus.cc:740] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:05:50.197237 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:50.234829 16322 leader_election.cc:304] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:05:50.202780 16274 raft_consensus.cc:1240] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:05:50.201486 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:50.254715 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:05:50.294178 16247 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:50.296821 17475 raft_consensus.cc:2804] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:50.196791 17507 consensus_queue.cc:237] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:50.297387 17475 raft_consensus.cc:493] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:05:50.297780 17475 raft_consensus.cc:3060] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:50.206406 17506 consensus_queue.cc:1048] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 13:05:50.232841 17497 raft_consensus.cc:740] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:05:50.234208 17534 raft_consensus.cc:697] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 3 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:05:50.207134 16914 leader_election.cc:304] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
W20260709 13:05:50.313217 16249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:50.209214 17532 consensus_queue.cc:1048] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 13:05:50.234202 17479 raft_consensus.cc:2749] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:05:50.209695 17427 consensus_queue.cc:237] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:50.335227 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f022e2e63ae4461d834e476ff2666991" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:50.235121 17529 consensus_queue.cc:1059] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.111s
I20260709 13:05:50.336994 17540 raft_consensus.cc:2749] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:05:50.341290 16321 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:50.214651 17528 raft_consensus.cc:515] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:50.239066 17469 raft_consensus.cc:515] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:50.341683 16204 raft_consensus.cc:2393] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 3: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:05:50.298889 17450 consensus_queue.cc:1048] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 13:05:50.341292 17461 raft_consensus.cc:2749] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:50.419900 16204 raft_consensus.cc:1240] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 1. Current term is 2. Ops: []
W20260709 13:05:50.445001 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 341119us
W20260709 13:05:50.406883 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 199879us
I20260709 13:05:50.449338 16206 raft_consensus.cc:1240] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:50.338477 17460 consensus_queue.cc:260] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:50.451969 16173 leader_election.cc:304] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:50.454159 16173 leader_election.cc:304] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
W20260709 13:05:50.453585 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 243275us
I20260709 13:05:50.452486 17419 consensus_queue.cc:1059] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 13:05:50.456475 17474 raft_consensus.cc:2804] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:50.468897 17419 raft_consensus.cc:3055] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:50.469348 17474 raft_consensus.cc:697] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:05:50.469444 17419 raft_consensus.cc:740] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:05:50.470497 17474 consensus_queue.cc:237] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:05:50.473187 16249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:50.468904 16947 raft_consensus.cc:1240] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:50.451434 16914 leader_election.cc:304] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:50.503147 17461 raft_consensus.cc:2749] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:05:50.502812 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 51496.9us
I20260709 13:05:50.507475 17461 consensus_queue.cc:1048] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:05:50.509172 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:05:50.510076 16279 raft_consensus.cc:3060] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:50.504729 16942 raft_consensus.cc:1240] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:50.455926 17505 raft_consensus.cc:2804] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:50.451879 17534 consensus_queue.cc:237] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:50.525537 17425 raft_consensus.cc:493] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:05:50.528990 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:05:50.535175 16947 raft_consensus.cc:2393] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 2: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
I20260709 13:05:50.536577 17545 raft_consensus.cc:2749] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:50.495223 17460 raft_consensus.cc:3060] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:50.521467 16320 leader_election.cc:304] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:50.545701 16205 raft_consensus.cc:1240] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:50.550091 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:05:50.528283 17369 raft_consensus.cc:3055] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:50.555794 17552 raft_consensus.cc:3060] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:50.530679 17461 raft_consensus.cc:493] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:05:50.560171 16948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:05:50.537533 17545 consensus_queue.cc:1059] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:50.538439 17505 raft_consensus.cc:697] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [term 2 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:05:50.559638 16945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:05:50.564472 17461 raft_consensus.cc:515] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:50.556689 16199 raft_consensus.cc:1240] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 1. Current term is 2. Ops: []
W20260709 13:05:50.570346 16249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:50.544623 17425 raft_consensus.cc:515] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:50.480899 17419 consensus_queue.cc:260] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:50.557106 17369 raft_consensus.cc:740] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:05:50.578178 16279 raft_consensus.cc:2468] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 3.
W20260709 13:05:50.579098 16249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:50.582087 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 366950us
W20260709 13:05:50.623409 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 385271us
W20260709 13:05:50.624114 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 407395us
I20260709 13:05:50.574575 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:05:50.629629 16248 leader_election.cc:304] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:05:50.639999 17420 raft_consensus.cc:493] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:50.623939 17545 raft_consensus.cc:2749] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:50.647768 16322 leader_election.cc:304] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:50.649101 17419 raft_consensus.cc:3060] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:50.661655 16945 raft_consensus.cc:1240] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:50.647164 17420 raft_consensus.cc:515] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:50.667726 17425 leader_election.cc:290] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:50.668521 17420 leader_election.cc:290] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:05:50.660112 17369 consensus_queue.cc:260] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:50.653689 17432 raft_consensus.cc:2804] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:05:50.685739 17535 consensus_meta.cc:287] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 0.558s	user 0.007s	sys 0.009s
I20260709 13:05:50.685052 17525 raft_consensus.cc:3055] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:05:50.705243 16249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:50.700647 17369 raft_consensus.cc:3060] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:50.673498 17475 raft_consensus.cc:515] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:50.717223 16280 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45210 (request call id 1111) took 1059 ms. Trace:
I20260709 13:05:50.684494 17505 consensus_queue.cc:237] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:50.710206 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:05:50.724058 17552 raft_consensus.cc:2749] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:50.717783 16280 rpcz_store.cc:276] 0709 13:05:49.657730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:49.997858 (+340128us) service_pool.cc:224] Handling call
0709 13:05:49.998126 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:50.050013 (+ 51887us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:50.050041 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:50.050085 (+    44us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:05:50.050103 (+    18us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:50.716937 (+666834us) spinlock_profiling.cc:243] Waited 51.7 ms on lock 0x7b5400337cd4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f489e01 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6
0709 13:05:50.716997 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:50.717154 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":118866304}
I20260709 13:05:50.705021 17525 raft_consensus.cc:740] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:05:50.733860 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:50.734742 16282 raft_consensus.cc:2468] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 2.
I20260709 13:05:50.734910 17525 consensus_queue.cc:260] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:50.740509 17525 raft_consensus.cc:3060] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:50.747537 16208 raft_consensus.cc:1240] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 2 LEADER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:50.749145 16204 raft_consensus.cc:1240] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 LEADER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:50.705210 17535 raft_consensus.cc:515] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:05:50.845678 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 216113us
W20260709 13:05:50.810925 17516 consensus_meta.cc:287] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3: Time spent flushing consensus metadata: real 0.701s	user 0.014s	sys 0.000s
I20260709 13:05:50.805140 17550 raft_consensus.cc:2749] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:50.818819 16173 leader_election.cc:304] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 363bb2f744eb486f9ad726f08214c98e
I20260709 13:05:50.837780 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:05:50.831826 16247 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:50.867484 16247 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:50.867268 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 48576.8us
I20260709 13:05:50.804459 17475 leader_election.cc:290] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:05:50.871537 16173 leader_election.cc:304] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:05:50.811575 17494 leader_election.cc:290] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:50.810647 17461 leader_election.cc:290] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:50.805735 17432 raft_consensus.cc:697] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 2 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:05:50.871383 17447 raft_consensus.cc:2804] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:05:50.888626 16249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:50.754001 17525 consensus_queue.cc:1059] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.133s
I20260709 13:05:50.887715 17511 raft_consensus.cc:2749] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:05:50.890870 17447 raft_consensus.cc:493] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:05:50.891502 17539 raft_consensus.cc:2749] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:50.895711 17461 raft_consensus.cc:493] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:50.901602 17447 raft_consensus.cc:3060] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:50.911638 16248 leader_election.cc:304] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:05:50.923337 17535 leader_election.cc:290] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 2 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:50.925571 17468 raft_consensus.cc:493] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:05:50.960144 16281 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45210 (request call id 1110) took 1302 ms. Trace:
W20260709 13:05:50.938448 17567 log.cc:927] Time spent T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.050s	user 0.000s	sys 0.001s
I20260709 13:05:50.960603 16281 rpcz_store.cc:276] 0709 13:05:49.657462 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:49.994465 (+337003us) service_pool.cc:224] Handling call
0709 13:05:50.959353 (+964888us) spinlock_profiling.cc:243] Waited 1.03 ms on lock 0x7b58001a8298. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361c224db1 00007f361c364b71 00007f361c364a22 00007f362527dc09 00007f36243d7ee0 00007f36244a10ab 00007f36244a1131 00007f3624462fc0 00007f362444d929 00007f362444d3d2 00007f361d9c4bd4
0709 13:05:50.959577 (+   224us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:50.959779 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:50.959806 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:50.959845 (+    39us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:05:50.959877 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:50.959949 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:50.960079 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2367872}
I20260709 13:05:50.963960 16322 leader_election.cc:304] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:05:50.906844 17461 raft_consensus.cc:515] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:05:50.969224 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 57711.5us
I20260709 13:05:50.971963 16322 leader_election.cc:304] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:50.913017 17432 consensus_queue.cc:237] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:50.978258 16322 leader_election.cc:304] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:50.972506 17550 raft_consensus.cc:2749] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:50.971514 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:05:50.958932 17468 raft_consensus.cc:515] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:50.987314 16943 raft_consensus.cc:2468] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 2.
I20260709 13:05:50.986685 16322 leader_election.cc:304] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:50.981678 17494 raft_consensus.cc:3060] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:50.991714 17509 raft_consensus.cc:2749] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:51.003706 16173 leader_election.cc:304] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:50.995304 17532 raft_consensus.cc:2749] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:51.000281 17550 consensus_queue.cc:1059] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 13:05:51.008289 17553 consensus_queue.cc:1059] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 13:05:51.008927 17540 raft_consensus.cc:3055] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:51.009408 17540 raft_consensus.cc:740] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:05:51.019523 16349 raft_consensus.cc:1240] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:51.024242 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
W20260709 13:05:51.025076 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 383904us
I20260709 13:05:51.025780 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:51.025825 16246 leader_election.cc:304] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:51.028195 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:05:51.028965 16246 leader_election.cc:400] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 election: Vote denied by peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073) with higher term. Message: Invalid argument: T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 2. Current term is 3.
I20260709 13:05:51.029304 16246 leader_election.cc:403] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:05:50.982136 17549 raft_consensus.cc:493] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:05:51.009424 17553 raft_consensus.cc:3055] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:51.010152 17563 raft_consensus.cc:2749] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:51.033022 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bc3c8ff9b84838a2664335d7e1582b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:51.035526 16246 leader_election.cc:304] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:51.012166 17369 raft_consensus.cc:2804] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:51.010392 17540 consensus_queue.cc:260] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:51.037648 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:05:51.037907 17540 raft_consensus.cc:3060] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:51.038507 16278 raft_consensus.cc:3060] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:51.002787 17475 consensus_queue.cc:1059] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 13:05:51.047569 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:51.044572 16246 leader_election.cc:304] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:51.048367 16279 raft_consensus.cc:2468] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 2.
I20260709 13:05:51.016927 17468 leader_election.cc:290] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:51.051016 16246 leader_election.cc:304] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:51.051608 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:05:51.056895 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:51.056105 16278 raft_consensus.cc:2468] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 2.
I20260709 13:05:51.035090 17553 raft_consensus.cc:740] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:05:51.060853 16322 leader_election.cc:304] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:05:51.044554 17369 raft_consensus.cc:493] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:51.063228 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:51.015045 17557 raft_consensus.cc:493] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:51.046113 17550 raft_consensus.cc:2749] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073) with higher term. Message: Invalid argument: T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 2. Current term is 3.
I20260709 13:05:51.074079 16275 raft_consensus.cc:1275] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:05:51.060811 17554 log.cc:927] Time spent T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
I20260709 13:05:51.057245 17532 raft_consensus.cc:493] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:51.075515 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:51.083483 16351 raft_consensus.cc:2393] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 in current term 2: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:05:51.056912 17549 raft_consensus.cc:515] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:51.084928 17566 raft_consensus.cc:2749] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:51.084631 17551 consensus_queue.cc:1059] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 13:05:51.069749 17369 raft_consensus.cc:3060] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:51.074160 17550 raft_consensus.cc:2749] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:51.072016 17552 raft_consensus.cc:2804] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:51.096534 17552 raft_consensus.cc:493] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:51.095750 16357 raft_consensus.cc:1275] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:05:51.101420 16173 leader_election.cc:336] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Timed out: RequestConsensusVote RPC to 127.14.180.66:45823 timed out after 1.661s (SENT)
I20260709 13:05:51.072578 17418 consensus_queue.cc:1059] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
W20260709 13:05:51.105685 16173 leader_election.cc:336] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Timed out: RequestConsensusVote RPC to 127.14.180.66:45823 timed out after 1.701s (SENT)
I20260709 13:05:51.106006 16275 raft_consensus.cc:1275] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:05:51.098927 17552 raft_consensus.cc:3060] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:51.107120 16203 raft_consensus.cc:2468] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 2.
I20260709 13:05:51.107575 17461 leader_election.cc:290] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:51.110215 17550 raft_consensus.cc:2749] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:51.071368 17553 consensus_queue.cc:260] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:51.115238 17558 raft_consensus.cc:2749] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:51.117180 17550 raft_consensus.cc:3055] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:51.119519 16277 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45210 (request call id 1107) took 1468 ms. Trace:
I20260709 13:05:51.120146 16277 rpcz_store.cc:276] 0709 13:05:49.649926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:49.994401 (+344475us) service_pool.cc:224] Handling call
0709 13:05:50.126746 (+132345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:50.126943 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:50.126970 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:50.127010 (+    40us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:05:50.127039 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:50.127100 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:51.118577 (+991477us) spinlock_profiling.cc:243] Waited 129 ms on lock 0x7b5400126e50. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f4888ad 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:05:51.118707 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":296634112}
W20260709 13:05:51.126706 16173 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.180.66:45823 timed out after 1.783s (SENT) [suppressed 41 similar messages]
I20260709 13:05:51.117631 17550 raft_consensus.cc:740] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:05:51.112888 17566 consensus_queue.cc:1059] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 13:05:51.088555 17532 raft_consensus.cc:515] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:51.123991 17553 raft_consensus.cc:3060] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:51.136387 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:51.137858 16914 leader_election.cc:304] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:51.092764 17557 raft_consensus.cc:515] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:51.157043 17549 leader_election.cc:290] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:05:51.163166 17461 raft_consensus.cc:3060] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:51.181957 17557 leader_election.cc:290] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:05:51.183398 16355 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41832 (request call id 1197) took 1820 ms (client timeout 1520 ms). Trace:
W20260709 13:05:51.183911 16355 rpcz_store.cc:269] 0709 13:05:49.363408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:49.363523 (+   115us) service_pool.cc:224] Handling call
0709 13:05:51.183124 (+1819601us) spinlock_profiling.cc:243] Waited 377 ms on lock 0x7b540032b254. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:05:51.183311 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":867598592}
I20260709 13:05:51.187417 16208 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60138 (request call id 1176) took 1047 ms. Trace:
I20260709 13:05:51.187996 16208 rpcz_store.cc:276] 0709 13:05:50.140203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:50.172683 (+ 32480us) service_pool.cc:224] Handling call
0709 13:05:50.173072 (+   389us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:50.748297 (+575225us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:51.187052 (+438755us) spinlock_profiling.cc:243] Waited 574 ms on lock 0x7b540038a4d4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f489e01 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6
0709 13:05:51.187331 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1320392448}
I20260709 13:05:51.191460 16353 raft_consensus.cc:1275] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:51.193672 16353 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41832 (request call id 1217) took 1131 ms. Trace:
I20260709 13:05:51.194139 16353 rpcz_store.cc:276] 0709 13:05:50.062158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:50.090774 (+ 28616us) service_pool.cc:224] Handling call
0709 13:05:51.190954 (+1100180us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:51.192008 (+  1054us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:51.193377 (+  1369us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b540032b250. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f4888ad 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:05:51.193590 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2515079552}
I20260709 13:05:51.200032 17501 raft_consensus.cc:493] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:05:51.200820 17501 raft_consensus.cc:515] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:05:51.171459 17575 log.cc:927] Time spent T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:05:51.212695 16353 raft_consensus.cc:1240] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 3 LEADER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 2. Current term is 3. Ops: []
W20260709 13:05:51.224542 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 169214us
I20260709 13:05:51.225777 16248 leader_election.cc:400] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 election: Vote denied by peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107) with higher term. Message: Invalid argument: T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 3 LEADER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 2. Current term is 3.
I20260709 13:05:51.229694 16353 raft_consensus.cc:1240] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:51.229502 16948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:05:51.216562 16204 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60138 (request call id 1179) took 1042 ms. Trace:
W20260709 13:05:51.235495 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 184573us
I20260709 13:05:51.160132 17550 consensus_queue.cc:260] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:51.241120 16322 leader_election.cc:304] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
W20260709 13:05:51.252161 16248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:51.251945 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:51.253134 16248 leader_election.cc:304] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:05:51.255522 17532 leader_election.cc:290] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:51.255239 16246 leader_election.cc:304] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:51.268412 16246 leader_election.cc:304] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 363bb2f744eb486f9ad726f08214c98e
W20260709 13:05:51.273342 16249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:51.231675 17551 consensus_queue.cc:1059] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 13:05:51.250909 17535 raft_consensus.cc:2749] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:05:51.275848 16948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:05:51.275840 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:51.282455 16202 raft_consensus.cc:1240] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:51.286048 16353 raft_consensus.cc:2468] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 1.
I20260709 13:05:51.232750 17558 consensus_queue.cc:1059] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 13:05:51.290318 16276 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953"
dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
mode: GRACEFUL
new_leader_uuid: "363bb2f744eb486f9ad726f08214c98e"
 from {username='slave'} at 127.0.0.1:39058
I20260709 13:05:51.291110 16276 raft_consensus.cc:606] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 LEADER]: Received request to transfer leadership to TS 363bb2f744eb486f9ad726f08214c98e
I20260709 13:05:51.274492 17550 raft_consensus.cc:3060] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:05:51.294152 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 167495us
I20260709 13:05:51.275110 17539 raft_consensus.cc:2749] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:51.297807 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:05:51.295006 16173 leader_election.cc:336] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Timed out: RequestConsensusVote RPC to 127.14.180.66:45823 timed out after 1.760s (SENT)
I20260709 13:05:51.301281 16173 leader_election.cc:304] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:05:51.234892 16204 rpcz_store.cc:276] 0709 13:05:50.174126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:50.420782 (+246656us) service_pool.cc:224] Handling call
0709 13:05:50.421110 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:50.749832 (+328722us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:51.207435 (+457603us) spinlock_profiling.cc:243] Waited 328 ms on lock 0x7b5400238054. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f489e01 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6
0709 13:05:51.212063 (+  4628us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":753682176}
I20260709 13:05:51.331023 16353 raft_consensus.cc:1240] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:51.291889 17583 raft_consensus.cc:2749] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:51.305876 16202 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60138 (request call id 1183) took 1127 ms. Trace:
I20260709 13:05:51.294169 17447 raft_consensus.cc:515] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } }
I20260709 13:05:51.333036 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:51.342965 16202 rpcz_store.cc:276] 0709 13:05:50.175271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:50.450040 (+274769us) service_pool.cc:224] Handling call
0709 13:05:51.281816 (+831776us) spinlock_profiling.cc:243] Waited 7.12 ms on lock 0x7b5800002a98. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361c224db1 00007f361c364b71 00007f361c364a22 00007f362527dc09 00007f36243d7ee0 00007f36244a10ab 00007f36244a1131 00007f3624462fc0 00007f362444d929 00007f362444d3d2 00007f361d9c4bd4
0709 13:05:51.282168 (+   352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:51.291888 (+  9720us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:51.302722 (+ 10834us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16366336}
I20260709 13:05:51.367765 17447 leader_election.cc:290] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 election: Requested vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:51.368152 17469 leader_election.cc:290] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 2 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:51.368636 17447 raft_consensus.cc:2749] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:51.353190 17539 raft_consensus.cc:2804] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:51.375392 16352 raft_consensus.cc:1240] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:51.377113 16202 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867"
dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
mode: GRACEFUL
new_leader_uuid: "1109f76a0b7b443a84c0327c8707bc63"
 from {username='slave'} at 127.0.0.1:58160
I20260709 13:05:51.377918 16202 raft_consensus.cc:606] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 LEADER]: Received request to transfer leadership to TS 1109f76a0b7b443a84c0327c8707bc63
W20260709 13:05:51.365574 17576 log.cc:927] Time spent T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.187s	user 0.002s	sys 0.000s
I20260709 13:05:51.365049 17432 raft_consensus.cc:493] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:51.392063 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 123810us
I20260709 13:05:51.393040 16246 leader_election.cc:304] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:51.389845 17538 raft_consensus.cc:3055] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:51.396317 16246 leader_election.cc:304] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:51.390533 17501 leader_election.cc:290] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:51.398311 16246 leader_election.cc:304] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:51.379671 17539 raft_consensus.cc:493] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:05:51.396834 17462 raft_consensus.cc:2749] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:51.400040 17580 raft_consensus.cc:3060] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:51.402320 16246 leader_election.cc:304] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:51.390658 17474 raft_consensus.cc:493] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:05:51.406014 16246 leader_election.cc:304] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:51.372786 17552 raft_consensus.cc:515] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:51.407320 16246 leader_election.cc:304] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:51.408776 16246 leader_election.cc:304] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:05:51.394084 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 118531us
I20260709 13:05:51.414281 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:51.401350 17539 raft_consensus.cc:3060] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:51.414999 17497 consensus_queue.cc:260] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:51.419446 17553 raft_consensus.cc:2749] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:51.420261 17540 raft_consensus.cc:2749] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:51.400880 17538 raft_consensus.cc:740] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:05:51.425381 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bc3c8ff9b84838a2664335d7e1582b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:05:51.426697 16249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:51.405617 17462 raft_consensus.cc:2749] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:51.394394 17432 raft_consensus.cc:515] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:51.433326 16354 raft_consensus.cc:1240] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:51.479879 17538 consensus_queue.cc:260] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:51.480660 17494 raft_consensus.cc:2749] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:51.481045 17497 raft_consensus.cc:3060] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:51.481351 17538 raft_consensus.cc:3060] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:51.481627 16356 raft_consensus.cc:2468] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 2.
I20260709 13:05:51.422279 17474 raft_consensus.cc:515] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:51.504293 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:51.479918 16204 raft_consensus.cc:1240] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:51.507081 17462 raft_consensus.cc:493] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:51.501693 17532 raft_consensus.cc:493] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:05:51.525012 17560 raft_consensus.cc:2749] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:51.531795 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:51.532753 16208 raft_consensus.cc:2468] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 2.
I20260709 13:05:51.508997 17528 leader_election.cc:290] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 2 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:51.527642 17590 raft_consensus.cc:2749] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:51.528002 17462 raft_consensus.cc:515] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:05:51.540503 16248 consensus_peers.cc:597] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 -> Peer 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875): Couldn't send request to peer 1109f76a0b7b443a84c0327c8707bc63. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6759dbf6a6924fcc870cb52b4a5d7953. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:51.559952 17552 leader_election.cc:290] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:51.565562 16208 raft_consensus.cc:1275] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:05:51.572399 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 277375us
W20260709 13:05:51.573936 16173 leader_election.cc:336] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Timed out: RequestConsensusVote RPC to 127.14.180.66:45823 timed out after 1.868s (SENT)
I20260709 13:05:51.552398 17464 raft_consensus.cc:493] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:05:51.558221 17461 raft_consensus.cc:2749] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:51.537772 17532 raft_consensus.cc:515] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:51.556612 17369 raft_consensus.cc:515] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:05:51.589258 17588 log.cc:927] Time spent T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:05:51.599748 16206 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60138 (request call id 1177) took 1434 ms. Trace:
I20260709 13:05:51.600237 16206 rpcz_store.cc:276] 0709 13:05:50.165690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:50.419916 (+254226us) service_pool.cc:224] Handling call
0709 13:05:50.449135 (+ 29219us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:50.449833 (+   698us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:51.599518 (+1149685us) spinlock_profiling.cc:243] Waited 28.9 ms on lock 0x7b54000b5ed0. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f4888ad 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:05:51.599677 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":66510720}
I20260709 13:05:51.580231 17464 raft_consensus.cc:515] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:51.610869 17590 raft_consensus.cc:493] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:51.619060 17590 raft_consensus.cc:515] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:51.632287 17549 raft_consensus.cc:993] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e: : Instructing follower 1109f76a0b7b443a84c0327c8707bc63 to start an election
I20260709 13:05:51.632966 17549 raft_consensus.cc:1081] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 1 LEADER]: Signalling peer 1109f76a0b7b443a84c0327c8707bc63 to start an election
I20260709 13:05:51.635852 17543 raft_consensus.cc:493] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:05:51.638513 17543 raft_consensus.cc:515] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:51.639662 16203 raft_consensus.cc:2393] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 in current term 3: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
W20260709 13:05:51.656479 16249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:51.658998 16248 leader_election.cc:304] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:05:51.661311 16248 leader_election.cc:304] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:05:51.642233 17432 leader_election.cc:290] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:05:51.645092 17474 leader_election.cc:290] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:51.659703 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:51.678226 16948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:05:51.678723 16947 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3"
dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
 from {username='slave'} at 127.0.0.1:35122
I20260709 13:05:51.683702 16947 raft_consensus.cc:493] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:51.684204 16947 raft_consensus.cc:3060] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:51.683424 16276 raft_consensus.cc:2468] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 2.
I20260709 13:05:51.687947 16948 raft_consensus.cc:2393] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 2: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
I20260709 13:05:51.689241 17547 raft_consensus.cc:493] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:05:51.689698 17369 leader_election.cc:290] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 election: Requested vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:05:51.695252 16280 raft_consensus.cc:1275] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:05:51.690115 17547 raft_consensus.cc:515] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:51.699146 17547 leader_election.cc:290] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:51.684702 17580 raft_consensus.cc:2749] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:51.701653 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:05:51.702418 16277 raft_consensus.cc:3060] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:51.667403 17540 raft_consensus.cc:2749] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:05:51.711377 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 302653us
I20260709 13:05:51.677393 17545 raft_consensus.cc:2804] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:51.712621 17545 raft_consensus.cc:493] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:05:51.712662 16246 leader_election.cc:304] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:51.713465 17545 raft_consensus.cc:3060] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:51.714071 17580 raft_consensus.cc:2749] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:51.714627 16246 leader_election.cc:304] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:51.716728 17580 raft_consensus.cc:2749] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:51.718518 16246 leader_election.cc:304] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:51.720078 16246 leader_election.cc:304] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:51.721218 16246 leader_election.cc:304] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:51.731868 16246 leader_election.cc:304] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:05:51.733278 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 214255us
I20260709 13:05:51.737610 16320 leader_election.cc:304] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:51.710630 17432 raft_consensus.cc:493] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:51.702796 17462 leader_election.cc:290] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:51.677716 17550 consensus_queue.cc:1059] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.059s
I20260709 13:05:51.749379 17475 raft_consensus.cc:493] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:51.757790 17475 raft_consensus.cc:515] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:51.763360 16281 raft_consensus.cc:1275] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:51.763322 16277 raft_consensus.cc:2468] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 3.
I20260709 13:05:51.763552 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:05:51.739063 17560 raft_consensus.cc:2749] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:05:51.782116 16174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:51.784713 16947 raft_consensus.cc:515] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:51.772476 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:51.744550 17540 raft_consensus.cc:2749] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:51.774760 17543 leader_election.cc:290] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:51.743975 17558 raft_consensus.cc:2749] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:51.749862 17549 raft_consensus.cc:2749] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:51.771766 17532 leader_election.cc:290] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:51.743016 17553 consensus_queue.cc:1059] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.050s
I20260709 13:05:51.779646 17550 raft_consensus.cc:3055] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:51.789094 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:51.792616 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:05:51.799934 17550 raft_consensus.cc:740] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:05:51.755496 17432 raft_consensus.cc:515] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:51.737666 17501 consensus_queue.cc:1059] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:05:51.796115 16947 leader_election.cc:290] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:51.750406 17551 raft_consensus.cc:2749] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:51.800307 16200 raft_consensus.cc:2376] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 2. Re-sending same reply.
I20260709 13:05:51.743343 17580 consensus_queue.cc:1059] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.055s
I20260709 13:05:51.793965 17450 raft_consensus.cc:493] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:51.809041 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 68510.4us
I20260709 13:05:51.802143 17550 consensus_queue.cc:260] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:05:51.822606 17550 raft_consensus.cc:3060] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:51.842852 17432 leader_election.cc:290] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:51.843951 17603 raft_consensus.cc:493] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:05:51.844633 17603 raft_consensus.cc:515] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:51.846807 17432 raft_consensus.cc:493] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:51.854200 17432 raft_consensus.cc:515] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:51.819417 17450 raft_consensus.cc:515] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:51.871462 17603 leader_election.cc:290] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:51.872284 17603 consensus_queue.cc:1059] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:05:51.880103 17464 leader_election.cc:290] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:51.911983 17545 raft_consensus.cc:515] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:51.883430 17590 leader_election.cc:290] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:51.884464 17420 raft_consensus.cc:493] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:51.900435 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
W20260709 13:05:51.918744 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 186983us
I20260709 13:05:51.913287 17578 raft_consensus.cc:3055] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:51.920405 16246 leader_election.cc:304] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:51.922955 17590 consensus_queue.cc:1059] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 13:05:51.928009 17580 consensus_queue.cc:1059] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:51.929484 17580 raft_consensus.cc:3055] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:51.929960 17580 raft_consensus.cc:740] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:05:51.917750 17420 raft_consensus.cc:515] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:51.926103 17598 consensus_queue.cc:1059] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 13:05:51.922132 17578 raft_consensus.cc:740] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:05:51.928925 17590 raft_consensus.cc:3055] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:51.934496 17580 consensus_queue.cc:260] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:51.922742 17553 raft_consensus.cc:2749] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:51.935220 17598 raft_consensus.cc:3055] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:51.941745 17598 raft_consensus.cc:740] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
W20260709 13:05:51.947907 16249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:51.937405 17590 raft_consensus.cc:740] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:05:51.963438 16320 leader_election.cc:304] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:51.943729 17432 leader_election.cc:290] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:51.974676 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:05:51.976217 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:51.954924 17580 raft_consensus.cc:3060] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:05:51.954756 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 139596us
I20260709 13:05:51.949801 17598 consensus_queue.cc:260] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:51.983099 17598 raft_consensus.cc:3060] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:51.983106 16912 leader_election.cc:304] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 363bb2f744eb486f9ad726f08214c98e
I20260709 13:05:51.986011 17435 consensus_queue.cc:1048] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:51.955230 17551 consensus_queue.cc:1059] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 13:05:51.972954 17545 leader_election.cc:290] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:51.972186 17450 leader_election.cc:290] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:05:51.977099 17516 raft_consensus.cc:3055] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:51.938475 17578 consensus_queue.cc:260] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:51.977612 17539 raft_consensus.cc:515] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:51.984464 17468 consensus_queue.cc:1059] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
I20260709 13:05:52.006318 16201 raft_consensus.cc:3055] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:51.993260 17516 raft_consensus.cc:740] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:05:52.007769 16207 raft_consensus.cc:1240] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:51.993203 17501 consensus_queue.cc:1243] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Peer 363bb2f744eb486f9ad726f08214c98e log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:05:52.006769 16201 raft_consensus.cc:740] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:05:52.010113 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:52.010995 16206 raft_consensus.cc:2393] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 2: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:05:52.010941 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:52.011314 17578 raft_consensus.cc:3060] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:51.995218 16350 raft_consensus.cc:1240] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 2 LEADER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:52.011018 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:52.016654 16283 raft_consensus.cc:1240] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:52.017323 16208 raft_consensus.cc:2393] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 2: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:05:52.018198 16207 raft_consensus.cc:1240] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 LEADER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:52.018491 16322 leader_election.cc:304] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:05:52.014320 16201 consensus_queue.cc:260] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:52.019416 16322 leader_election.cc:304] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:05:52.056416 16247 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:52.111956 16201 raft_consensus.cc:3060] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:05:52.112443 16249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:52.114215 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 89501us
I20260709 13:05:52.115947 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:52.118245 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:52.016841 17501 raft_consensus.cc:3055] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:51.994448 17590 consensus_queue.cc:260] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:52.126349 16276 raft_consensus.cc:1240] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:52.113688 17468 raft_consensus.cc:2804] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:05:52.015452 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 184950us
I20260709 13:05:52.113554 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:52.108873 17528 raft_consensus.cc:493] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:05:52.139042 17528 raft_consensus.cc:515] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:52.141575 17528 leader_election.cc:290] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:52.141644 16199 raft_consensus.cc:2468] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 2.
I20260709 13:05:52.108326 17527 raft_consensus.cc:2804] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:52.123204 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:52.142477 17527 raft_consensus.cc:493] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:52.129631 17606 raft_consensus.cc:2804] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:52.142735 16279 raft_consensus.cc:2468] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 1.
I20260709 13:05:52.143095 17527 raft_consensus.cc:3060] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:52.119122 17497 consensus_queue.cc:1048] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 13:05:52.126027 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:52.127640 16276 raft_consensus.cc:1240] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:52.145473 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:52.133992 17597 raft_consensus.cc:493] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.147049 16914 leader_election.cc:304] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:52.147586 17597 raft_consensus.cc:515] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:05:52.127895 16246 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:52.128381 16278 raft_consensus.cc:1275] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:52.111305 17533 raft_consensus.cc:493] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:05:52.151940 17533 raft_consensus.cc:515] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:52.113740 17432 raft_consensus.cc:2804] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:52.153870 16202 raft_consensus.cc:2410] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:05:52.154250 17432 raft_consensus.cc:493] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:05:52.154838 17432 raft_consensus.cc:3060] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:52.116798 16350 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41832 (request call id 1226) took 1095 ms. Trace:
I20260709 13:05:52.156708 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:52.017287 17604 raft_consensus.cc:493] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
W20260709 13:05:52.133092 16249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:52.115211 17545 consensus_queue.cc:1059] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 13:05:52.135828 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:05:52.136011 16275 raft_consensus.cc:1240] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:52.136931 16280 raft_consensus.cc:1240] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:52.137504 16943 raft_consensus.cc:3055] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:52.137766 17539 leader_election.cc:290] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:52.157337 16350 rpcz_store.cc:276] 0709 13:05:51.021119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:51.024076 (+  2957us) service_pool.cc:224] Handling call
0709 13:05:51.977202 (+953126us) spinlock_profiling.cc:243] Waited 5.85 ms on lock 0x7b5800024698. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361c224db1 00007f361c364b71 00007f361c364a22 00007f362527dc09 00007f36243d7ee0 00007f36244a10ab 00007f36244a1131 00007f3624462fc0 00007f362444d929 00007f362444d3d2 00007f361d9c4bd4
0709 13:05:51.988552 (+ 11350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:52.015765 (+ 27213us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:52.113857 (+ 98092us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13455744}
I20260709 13:05:52.113688 17450 consensus_queue.cc:1048] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 13:05:52.159459 17533 leader_election.cc:290] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:05:52.163724 17601 log.cc:927] Time spent T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.175s	user 0.000s	sys 0.001s
I20260709 13:05:52.122898 17501 raft_consensus.cc:740] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:05:52.122328 17420 leader_election.cc:290] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:52.168412 17468 raft_consensus.cc:697] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 2 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:05:52.119493 17566 raft_consensus.cc:493] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.177052 16201 raft_consensus.cc:1275] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:52.179234 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:05:52.161931 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:52.199571 16322 leader_election.cc:304] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:05:52.212427 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:52.213027 16201 raft_consensus.cc:2468] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 2.
I20260709 13:05:52.179462 16943 raft_consensus.cc:740] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:05:52.190583 17549 consensus_queue.cc:1048] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 13:05:52.204592 17508 raft_consensus.cc:493] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:52.130811 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 147770us
I20260709 13:05:52.227747 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:05:52.204265 17427 consensus_queue.cc:1048] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 13:05:52.176546 17604 raft_consensus.cc:515] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:52.207574 17608 raft_consensus.cc:493] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:05:52.235170 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:52.214339 17597 leader_election.cc:290] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:05:52.233600 17484 raft_consensus.cc:2804] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:52.245028 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:05:52.233121 17606 raft_consensus.cc:697] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [term 2 LEADER]: Becoming Leader. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:05:52.250434 17501 consensus_queue.cc:260] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:52.250736 16943 consensus_queue.cc:260] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:52.250980 17468 consensus_queue.cc:237] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:52.252117 17501 raft_consensus.cc:3060] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:52.252270 16943 raft_consensus.cc:3060] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:52.233613 17516 consensus_queue.cc:260] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:52.254791 16204 raft_consensus.cc:1240] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:52.215466 17566 raft_consensus.cc:515] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:52.257155 16281 raft_consensus.cc:2468] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 2.
I20260709 13:05:52.242179 16350 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d"
dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
mode: GRACEFUL
new_leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
 from {username='slave'} at 127.0.0.1:56792
I20260709 13:05:52.258085 17484 raft_consensus.cc:697] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 3 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:05:52.249387 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:05:52.236232 17508 raft_consensus.cc:515] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:05:52.241645 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 94753.8us
I20260709 13:05:52.266434 16350 raft_consensus.cc:606] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 1 LEADER]: Received request to transfer leadership to TS 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:05:52.241307 17608 raft_consensus.cc:515] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:52.256340 16912 leader_election.cc:304] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:52.276062 17527 raft_consensus.cc:515] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:52.283816 17611 raft_consensus.cc:2749] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:52.284629 17611 raft_consensus.cc:3060] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:52.285588 17527 leader_election.cc:290] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:52.277792 17597 raft_consensus.cc:493] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.287174 17597 raft_consensus.cc:515] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:52.287431 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:52.286509 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:52.273985 16352 raft_consensus.cc:3060] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:52.290218 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:52.291200 16205 raft_consensus.cc:2468] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 2.
I20260709 13:05:52.292197 17566 leader_election.cc:290] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:05:52.295154 16277 raft_consensus.cc:1275] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 2. (term mismatch)
I20260709 13:05:52.297744 16277 pending_rounds.cc:85] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3: Aborting all ops after (but not including) 1
I20260709 13:05:52.305004 17597 leader_election.cc:290] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:52.304469 17484 consensus_queue.cc:237] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:52.287742 17606 consensus_queue.cc:237] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:52.298162 16277 pending_rounds.cc:107] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 1.2
I20260709 13:05:52.317086 16277 raft_consensus.cc:2917] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Aborting config change with OpId 1.2: Aborted: Op aborted by new leader
I20260709 13:05:52.318676 16277 raft_consensus.cc:2889] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:52.322839 16277 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:42736 (request call id 3) took 2323 ms. Trace:
I20260709 13:05:52.321527 17612 raft_consensus.cc:493] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.323237 16277 rpcz_store.cc:276] 0709 13:05:49.996794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:50.008525 (+ 11731us) service_pool.cc:224] Handling call
0709 13:05:50.029410 (+ 20885us) log.cc:844] Serialized 506 byte log entry
0709 13:05:52.319194 (+2289784us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":272272,"raft.run_cpu_time_us":2133,"raft.run_wall_time_us":34671,"thread_start_us":716927,"threads_started":4,"wal-append.queue_time_us":62423,"wal-append.run_cpu_time_us":1777,"wal-append.run_wall_time_us":1016654}
W20260709 13:05:52.342813 16249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:52.325798 16944 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35106 (request call id 416) took 1341 ms. Trace:
I20260709 13:05:52.324285 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:05:52.341353 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:05:52.345496 17604 leader_election.cc:290] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:52.353209 17583 raft_consensus.cc:3055] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:52.353669 17583 raft_consensus.cc:740] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:05:52.342738 17508 leader_election.cc:290] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:52.340777 17613 raft_consensus.cc:493] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:05:52.324741 17612 raft_consensus.cc:515] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:52.348666 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:05:52.359115 16246 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:52.361158 16154 auto_rebalancer.cc:629] Failed to schedule move for tablet 6759dbf6a6924fcc870cb52b4a5d7953: Aborted: Op aborted by new leader
I20260709 13:05:52.350762 16350 raft_consensus.cc:3055] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:52.347982 16282 raft_consensus.cc:3060] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:52.371747 16350 raft_consensus.cc:740] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:05:52.378794 16945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:05:52.379298 16350 consensus_queue.cc:260] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:52.380609 16350 raft_consensus.cc:3060] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:05:52.382400 16915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:52.369925 16914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:52.359169 17475 leader_election.cc:290] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:52.391541 16356 raft_consensus.cc:1275] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:52.394140 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:05:52.395265 16278 raft_consensus.cc:1275] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:52.370390 17604 raft_consensus.cc:493] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:05:52.396158 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:05:52.396271 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:05:52.402081 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:52.411882 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:52.412333 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:05:52.413506 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:05:52.383757 17566 raft_consensus.cc:493] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:05:52.384316 17608 leader_election.cc:290] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:52.408520 16943 raft_consensus.cc:1275] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:05:52.421677 16355 raft_consensus.cc:1275] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:52.423676 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:05:52.371990 17613 raft_consensus.cc:515] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:52.425664 16248 leader_election.cc:304] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:05:52.426231 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:05:52.426899 16949 raft_consensus.cc:2468] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 2.
I20260709 13:05:52.427273 17578 raft_consensus.cc:2749] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:52.427580 17611 raft_consensus.cc:2749] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:52.427670 17613 leader_election.cc:290] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:52.424520 17566 raft_consensus.cc:515] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:52.430034 17578 raft_consensus.cc:493] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.430708 17578 raft_consensus.cc:515] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:52.432817 17578 leader_election.cc:290] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:52.430698 17580 raft_consensus.cc:493] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:52.433569 16320 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:52.433828 16279 raft_consensus.cc:2468] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 2.
I20260709 13:05:52.434381 17508 raft_consensus.cc:493] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:05:52.401357 17583 consensus_queue.cc:260] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:52.433799 17580 raft_consensus.cc:515] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:52.434969 17508 raft_consensus.cc:515] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:52.435665 17583 raft_consensus.cc:3060] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:52.415886 17605 raft_consensus.cc:493] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:05:52.437012 17580 leader_election.cc:290] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:52.437539 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:52.437602 17605 raft_consensus.cc:515] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:52.440110 16914 leader_election.cc:304] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:05:52.440832 17605 leader_election.cc:290] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:52.441694 17605 consensus_queue.cc:1048] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:05:52.445708 16350 raft_consensus.cc:2468] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 2.
I20260709 13:05:52.408375 16203 raft_consensus.cc:1240] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:52.448658 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:52.449530 16274 raft_consensus.cc:2468] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 2.
I20260709 13:05:52.450646 17598 raft_consensus.cc:493] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:05:52.451251 17598 raft_consensus.cc:515] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } }
I20260709 13:05:52.451956 17612 leader_election.cc:290] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:52.452560 17612 raft_consensus.cc:2749] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:52.453663 17598 leader_election.cc:290] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:52.410586 17604 raft_consensus.cc:515] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:52.455405 16275 raft_consensus.cc:1275] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:05:52.455868 16275 pending_rounds.cc:85] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3: Aborting all ops after (but not including) 1
I20260709 13:05:52.456075 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:05:52.456586 17603 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260709 13:05:52.456779 16279 raft_consensus.cc:2468] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 2.
I20260709 13:05:52.407532 17550 raft_consensus.cc:493] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:05:52.457895 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:52.461201 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:05:52.459076 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:05:52.462049 16205 raft_consensus.cc:3060] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:52.462064 16278 raft_consensus.cc:2468] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 1.
I20260709 13:05:52.463021 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:52.463579 16279 raft_consensus.cc:2468] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 2.
I20260709 13:05:52.463915 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:52.464648 16201 raft_consensus.cc:2393] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 3: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:05:52.465059 16246 leader_election.cc:304] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:52.438352 16281 raft_consensus.cc:2468] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 1.
I20260709 13:05:52.466538 16246 leader_election.cc:304] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:52.467120 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:52.468147 16246 leader_election.cc:304] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:52.445811 17432 raft_consensus.cc:515] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:52.471235 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:52.477644 16105 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38830 (request call id 219) took 3052 ms. Trace:
W20260709 13:05:52.481570 16248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:52.471724 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:52.472752 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:05:52.476467 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 60755.6us
I20260709 13:05:52.477947 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:05:52.486256 16173 leader_election.cc:336] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Timed out: RequestConsensusVote RPC to 127.14.180.66:45823 timed out after 1.932s (SENT)
W20260709 13:05:52.486609 16174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:52.456143 16275 pending_rounds.cc:107] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:05:52.489445 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:05:52.487287 16173 leader_election.cc:336] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Timed out: RequestConsensusVote RPC to 127.14.180.66:45823 timed out after 1.950s (SENT)
I20260709 13:05:52.453702 17566 leader_election.cc:290] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:05:52.492931 17615 log.cc:927] Time spent T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:05:52.457963 17550 raft_consensus.cc:515] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:52.495814 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:05:52.499356 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:52.535208 16279 raft_consensus.cc:3060] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:52.501233 16276 raft_consensus.cc:2468] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 2.
I20260709 13:05:52.480067 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:52.471479 17598 raft_consensus.cc:2749] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:52.459076 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:52.478333 17580 raft_consensus.cc:2749] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:52.506757 16351 raft_consensus.cc:1240] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:52.481792 17578 raft_consensus.cc:2749] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:05:52.533375 16281 raft_consensus.cc:2393] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 2: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:05:52.424070 16941 raft_consensus.cc:2468] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 2.
I20260709 13:05:52.493029 17529 raft_consensus.cc:493] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.537770 16945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
W20260709 13:05:52.566576 16154 auto_rebalancer.cc:629] Failed to schedule move for tablet 16a307cee8ef431184c620fec029af19: Illegal state: Replica e10b16d536674c0bb350a31d7ce5ff7f is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 2 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } }
I20260709 13:05:52.569484 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:05:52.570927 17618 ts_tablet_manager.cc:933] T 6759dbf6a6924fcc870cb52b4a5d7953 P 1109f76a0b7b443a84c0327c8707bc63: Initiating tablet copy from peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:52.564090 17444 consensus_queue.cc:1059] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 13:05:52.572125 17444 raft_consensus.cc:3055] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:52.572638 17444 raft_consensus.cc:740] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:05:52.575527 17604 leader_election.cc:290] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:52.544302 17602 raft_consensus.cc:3055] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:52.502652 17553 consensus_queue.cc:1059] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 13:05:52.545817 16279 raft_consensus.cc:2468] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 3.
I20260709 13:05:52.547830 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:52.488047 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:52.580600 17529 raft_consensus.cc:515] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:52.586404 16348 raft_consensus.cc:2468] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 2.
I20260709 13:05:52.500104 16275 raft_consensus.cc:2889] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:52.552678 16205 raft_consensus.cc:2468] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 3.
W20260709 13:05:52.554203 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 63424us
I20260709 13:05:52.551611 17549 raft_consensus.cc:493] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:05:52.505611 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:52.589823 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:52.589824 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:52.481474 16105 rpcz_store.cc:276] 0709 13:05:49.425040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:49.427197 (+  2157us) service_pool.cc:224] Handling call
0709 13:05:52.477549 (+3050352us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:05:50.637418 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:05:50.638297 (+   879us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:05:50.638348 (+    51us) write_op.cc:435] Acquired schema lock
0709 13:05:50.638386 (+    38us) tablet.cc:662] Decoding operations
0709 13:05:50.639251 (+   865us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:05:50.639357 (+   106us) write_op.cc:641] Partition lock acquired for write op
0709 13:05:50.639414 (+    57us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:05:50.639878 (+   464us) tablet.cc:701] Row locks acquired
0709 13:05:50.639907 (+    29us) write_op.cc:260] PREPARE: finished
0709 13:05:50.640109 (+   202us) write_op.cc:270] Start()
0709 13:05:50.640262 (+   153us) write_op.cc:276] Timestamp: P: 1783602350640051 usec, L: 0
0709 13:05:50.640294 (+    32us) op_driver.cc:348] REPLICATION: starting
0709 13:05:50.698537 (+ 58243us) log.cc:844] Serialized 1303 byte log entry
0709 13:05:51.289161 (+590624us) op_driver.cc:464] REPLICATION: finished
0709 13:05:51.583052 (+293891us) write_op.cc:301] APPLY: starting
0709 13:05:51.583161 (+   109us) tablet.cc:1367] starting BulkCheckPresence
0709 13:05:51.600153 (+ 16992us) tablet.cc:1370] finished BulkCheckPresence
0709 13:05:51.608638 (+  8485us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:05:51.659090 (+ 50452us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:05:51.688527 (+ 29437us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 13:05:51.693309 (+  4782us) write_op.cc:312] APPLY: finished
0709 13:05:51.697292 (+  3983us) log.cc:844] Serialized 35 byte log entry
0709 13:05:51.698391 (+  1099us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:51.698575 (+   184us) write_op.cc:454] Released schema lock
0709 13:05:51.698643 (+    68us) write_op.cc:341] FINISH: Updating metrics
0709 13:05:51.699231 (+   588us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:51.699278 (+    47us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":124642,"reported_tablets":5,"child_traces":[["op",{"apply.queue_time_us":287104,"apply.run_cpu_time_us":3922,"apply.run_wall_time_us":117922,"num_ops":3,"prepare.queue_time_us":461423,"prepare.run_cpu_time_us":16614,"prepare.run_wall_time_us":273972,"raft.queue_time_us":250164,"raft.run_cpu_time_us":40601,"raft.run_wall_time_us":228528,"replication_time_us":626156,"thread_start_us":866962,"threads_started":4,"wal-append.queue_time_us":259990}]]}
I20260709 13:05:52.590718 16276 raft_consensus.cc:2468] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 2.
I20260709 13:05:52.586804 16945 raft_consensus.cc:2468] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 3.
I20260709 13:05:52.588605 16320 leader_election.cc:304] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:52.564380 16203 raft_consensus.cc:2468] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 2.
I20260709 13:05:52.593346 16320 leader_election.cc:304] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:52.558187 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:52.562515 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:52.497694 17545 consensus_queue.cc:1059] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.053s
I20260709 13:05:52.597522 17506 raft_consensus.cc:3060] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:52.597743 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:52.598464 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:52.580329 17602 raft_consensus.cc:740] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:05:52.599207 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:52.599659 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:52.600020 17602 consensus_queue.cc:260] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:52.600827 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:52.601473 16275 raft_consensus.cc:2468] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 2.
I20260709 13:05:52.601536 17602 raft_consensus.cc:3060] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:52.601981 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:05:52.602541 16357 raft_consensus.cc:3060] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:52.602758 16202 raft_consensus.cc:2468] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 2.
I20260709 13:05:52.603446 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:52.609470 17464 raft_consensus.cc:2804] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:52.609913 17464 raft_consensus.cc:493] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:52.610275 17464 raft_consensus.cc:3060] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:52.605621 17468 consensus_queue.cc:1048] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 13:05:52.611150 16353 raft_consensus.cc:1275] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:52.595443 17549 raft_consensus.cc:515] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:52.611217 17508 leader_election.cc:290] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:52.643189 16353 raft_consensus.cc:1275] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:05:52.619815 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:52.644292 16355 raft_consensus.cc:2468] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 2.
I20260709 13:05:52.644824 16353 raft_consensus.cc:1275] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:52.645260 17549 leader_election.cc:290] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:52.623582 16354 raft_consensus.cc:1240] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:52.624491 16912 leader_election.cc:304] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:52.646409 17604 raft_consensus.cc:2749] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:52.647154 16912 leader_election.cc:304] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:52.648384 17604 raft_consensus.cc:2749] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:52.650233 17604 raft_consensus.cc:493] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.625706 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:52.650910 17604 raft_consensus.cc:515] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:52.573776 17444 consensus_queue.cc:260] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:52.652608 16278 raft_consensus.cc:1275] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:52.653892 17604 leader_election.cc:290] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:05:52.628566 17621 log.cc:927] Time spent T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 13:05:52.652647 17444 raft_consensus.cc:3060] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:52.668044 17508 raft_consensus.cc:493] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:05:52.669144 17508 raft_consensus.cc:515] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:52.672665 17508 leader_election.cc:290] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:05:52.344105 16944 rpcz_store.cc:276] 0709 13:05:50.979113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:50.981215 (+  2102us) service_pool.cc:224] Handling call
0709 13:05:50.996577 (+ 15362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:51.005537 (+  8960us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:05:51.266701 (+261164us) log.cc:844] Serialized 14 byte log entry
0709 13:05:51.630134 (+363433us) spinlock_profiling.cc:243] Waited 2.19 ms on lock 0x7b18002ebbe0. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f3625264de1 00007f36252715b1 00007f361c39c557 00007f361c39e7c1 00007f361c39e779 00007f361c39e709 00007f361c39e6d1 00007f361c39d9cd 000000000038f354 000000000038f199 00007f361c37f83a
0709 13:05:52.243421 (+613287us) spinlock_profiling.cc:243] Waited 4.83 ms on lock 0x7b18002ebbe0. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f3625264de1 00007f36252715b1 00007f361c37ee07 00007f36251d9ab9 00007f361c39b69b 00007f361c39993f 00007f361c399455 00007f361f481060 00007f361f493716 00007f361f4a4287 00007f361f4a4208
0709 13:05:52.303030 (+ 59609us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:52.308826 (+  5796us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:05:52.312108 (+  3282us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:52.315946 (+  3838us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:52.320896 (+  4950us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":283428,"prepare.run_cpu_time_us":11916,"prepare.run_wall_time_us":28315,"raft.queue_time_us":62765,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":135,"spinlock_wait_cycles":16129536,"thread_start_us":321724,"threads_started":3,"wal-append.queue_time_us":244943}
I20260709 13:05:52.680229 16280 raft_consensus.cc:1275] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:52.631907 16352 raft_consensus.cc:2468] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 2.
I20260709 13:05:52.639850 17550 leader_election.cc:290] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:05:52.614128 16249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:52.654040 17529 leader_election.cc:290] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:52.626652 17432 leader_election.cc:290] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:52.682992 16356 raft_consensus.cc:1240] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:52.684245 16947 raft_consensus.cc:1275] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:52.684676 16283 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45210 (request call id 1145) took 1005 ms. Trace:
I20260709 13:05:52.608426 16320 leader_election.cc:304] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63
W20260709 13:05:52.692034 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 83614.1us
I20260709 13:05:52.692867 17432 raft_consensus.cc:2804] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:05:52.694984 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 134783us
I20260709 13:05:52.685061 16283 rpcz_store.cc:276] 0709 13:05:51.679131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:51.679316 (+   185us) service_pool.cc:224] Handling call
0709 13:05:51.679765 (+   449us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:52.017099 (+337334us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:52.684456 (+667357us) spinlock_profiling.cc:243] Waited 337 ms on lock 0x7b5400125f54. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f489e01 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6
0709 13:05:52.684624 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":774176128}
I20260709 13:05:52.699872 16173 leader_election.cc:304] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 363bb2f744eb486f9ad726f08214c98e
I20260709 13:05:52.703977 17506 raft_consensus.cc:2749] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:52.701426 16320 leader_election.cc:304] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:52.712663 16320 leader_election.cc:304] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:52.715327 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:52.709472 17505 raft_consensus.cc:2804] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:52.716599 17505 raft_consensus.cc:493] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:05:52.716724 17529 raft_consensus.cc:2804] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:52.717200 17505 raft_consensus.cc:3060] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:52.717500 17508 raft_consensus.cc:2804] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:52.717921 17508 raft_consensus.cc:493] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:52.718274 17508 raft_consensus.cc:3060] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:52.696935 17432 raft_consensus.cc:493] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
W20260709 13:05:52.721503 16321 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:52.724188 16173 leader_election.cc:304] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 363bb2f744eb486f9ad726f08214c98e
I20260709 13:05:52.725557 17516 raft_consensus.cc:3060] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:52.718766 17533 consensus_queue.cc:1048] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 13:05:52.727887 17533 consensus_queue.cc:1048] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:52.729278 17533 raft_consensus.cc:2804] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:52.729728 17533 raft_consensus.cc:697] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 2 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:05:52.732369 17432 raft_consensus.cc:3060] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:52.733995 16282 raft_consensus.cc:2468] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 2.
I20260709 13:05:52.733911 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:52.735127 16246 leader_election.cc:304] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:52.736379 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:52.737843 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:52.740959 17432 raft_consensus.cc:515] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:52.742116 17533 consensus_queue.cc:237] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:52.745342 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:52.746048 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:52.747048 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:52.747201 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:52.747726 16355 raft_consensus.cc:2468] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 2.
I20260709 13:05:52.718948 17529 raft_consensus.cc:697] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 3 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:05:52.749172 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:52.699532 17618 tablet_copy_client.cc:323] T 6759dbf6a6924fcc870cb52b4a5d7953 P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Beginning tablet copy session from remote peer at address 127.14.180.66:45823
I20260709 13:05:52.750033 17529 consensus_queue.cc:237] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:52.747380 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:52.754787 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:52.756202 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:52.762274 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:05:52.763118 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:52.765307 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:52.766095 16201 raft_consensus.cc:2468] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 2.
I20260709 13:05:52.770936 16322 leader_election.cc:304] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:52.774200 16354 raft_consensus.cc:2468] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 2.
I20260709 13:05:52.774894 17427 raft_consensus.cc:493] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.775508 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:05:52.775431 17427 raft_consensus.cc:515] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:52.776963 16946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:05:52.777556 17427 leader_election.cc:290] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:52.777904 16946 raft_consensus.cc:2468] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 2.
I20260709 13:05:52.778980 17479 raft_consensus.cc:2804] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:52.779549 17479 raft_consensus.cc:493] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:52.779397 16322 leader_election.cc:304] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:52.780216 17479 raft_consensus.cc:3060] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:52.782284 16348 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2"
dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
mode: GRACEFUL
new_leader_uuid: "1109f76a0b7b443a84c0327c8707bc63"
 from {username='slave'} at 127.0.0.1:56792
I20260709 13:05:52.783035 16348 raft_consensus.cc:606] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Received request to transfer leadership to TS 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:05:52.783412 16348 raft_consensus.cc:614] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:52.783447 16914 leader_election.cc:304] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:05:52.785002 17604 raft_consensus.cc:2804] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:52.785766 17604 raft_consensus.cc:697] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 LEADER]: Becoming Leader. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:05:52.785207 16353 consensus_queue.cc:237] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:05:52.758359 17609 raft_consensus.cc:493] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
W20260709 13:05:52.808167 16246 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:52.805487 16320 leader_election.cc:304] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:52.783347 17534 raft_consensus.cc:3060] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:05:52.813480 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 87726us
I20260709 13:05:52.815176 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c15d8e9be8414c84912ab77b66bfb1" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:52.818425 16208 raft_consensus.cc:2468] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 2.
I20260709 13:05:52.769582 17603 raft_consensus.cc:493] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:05:52.752867 17420 consensus_queue.cc:1059] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.049s
I20260709 13:05:52.821532 16320 leader_election.cc:304] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:52.818204 16173 leader_election.cc:304] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:52.827420 16173 leader_election.cc:304] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:52.815068 17597 raft_consensus.cc:2804] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:52.816048 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:52.824486 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:52.848394 16946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:05:52.852973 16357 raft_consensus.cc:2468] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 3.
I20260709 13:05:52.787055 17604 consensus_queue.cc:237] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:52.812568 17609 raft_consensus.cc:515] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:52.837101 17475 raft_consensus.cc:2804] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:52.836982 17583 raft_consensus.cc:2804] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:52.844926 17597 raft_consensus.cc:493] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:52.856529 17444 raft_consensus.cc:2804] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:52.826344 17603 raft_consensus.cc:515] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:05:52.888451 16322 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:52.862028 17427 raft_consensus.cc:493] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.864912 17468 raft_consensus.cc:493] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:05:52.869304 17475 raft_consensus.cc:493] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:52.870061 17625 raft_consensus.cc:2804] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:52.895895 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:05:52.896198 16944 raft_consensus.cc:2410] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:05:52.871014 17535 raft_consensus.cc:493] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.913192 17535 raft_consensus.cc:515] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:52.914737 17590 raft_consensus.cc:3060] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:52.915241 17535 leader_election.cc:290] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:05:52.915547 16914 leader_election.cc:304] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:05:52.916009 17432 leader_election.cc:290] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 2 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:05:52.917315 17501 raft_consensus.cc:2749] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:52.864670 16200 raft_consensus.cc:2468] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 2.
I20260709 13:05:52.918633 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:05:52.919268 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:52.920121 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:52.920228 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:52.901597 17625 raft_consensus.cc:493] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:52.920689 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c15d8e9be8414c84912ab77b66bfb1" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:52.920897 16282 raft_consensus.cc:2468] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 1.
I20260709 13:05:52.921031 16277 raft_consensus.cc:2468] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 2.
I20260709 13:05:52.905130 17468 raft_consensus.cc:515] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:52.924887 17468 leader_election.cc:290] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:05:52.901307 17427 raft_consensus.cc:515] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:52.927853 17427 leader_election.cc:290] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:52.929438 17505 raft_consensus.cc:515] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:52.930735 17583 raft_consensus.cc:493] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:05:52.931296 17583 raft_consensus.cc:3060] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:52.888764 17444 raft_consensus.cc:493] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:05:52.931599 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:52.932104 17444 raft_consensus.cc:3060] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:52.872231 17597 raft_consensus.cc:3060] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:52.837702 16912 leader_election.cc:304] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:52.934497 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:52.936712 16205 raft_consensus.cc:2393] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 2: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
I20260709 13:05:52.920962 17625 raft_consensus.cc:3060] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:52.939067 17609 leader_election.cc:290] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:52.942508 16208 raft_consensus.cc:3055] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:52.943012 16208 raft_consensus.cc:740] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:05:52.943820 16208 consensus_queue.cc:260] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:52.944561 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:52.944880 16208 raft_consensus.cc:3060] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:05:52.898895 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 71578.9us
I20260709 13:05:52.894719 17464 raft_consensus.cc:515] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:52.901810 17475 raft_consensus.cc:3060] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:52.907058 16293 tablet_copy_service.cc:140] P 0aea40d6e4374085a2e38a70a71f63e3: Received BeginTabletCopySession request for tablet 6759dbf6a6924fcc870cb52b4a5d7953 from peer 1109f76a0b7b443a84c0327c8707bc63 ({username='slave'} at 127.0.0.1:42740)
I20260709 13:05:52.909147 16248 leader_election.cc:304] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:52.907063 17435 raft_consensus.cc:3055] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:52.952618 16173 leader_election.cc:304] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
W20260709 13:05:52.960321 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 51287.4us
I20260709 13:05:52.964576 16208 raft_consensus.cc:1275] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:05:52.970686 16208 pending_rounds.cc:85] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f: Aborting all ops after (but not including) 1
I20260709 13:05:52.971092 16208 pending_rounds.cc:107] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:05:52.971432 16208 raft_consensus.cc:2889] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:52.973358 16248 leader_election.cc:304] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:52.978734 16207 raft_consensus.cc:1240] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:52.979074 16248 leader_election.cc:304] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:52.948274 17479 raft_consensus.cc:515] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:52.970100 16173 leader_election.cc:304] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:52.914804 17603 leader_election.cc:290] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:52.984136 16248 leader_election.cc:304] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:52.982755 16322 leader_election.cc:304] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:52.949239 17501 raft_consensus.cc:2749] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:52.994378 16173 leader_election.cc:304] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:52.968758 17435 raft_consensus.cc:740] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:05:52.979923 17420 raft_consensus.cc:2804] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:52.937305 17508 raft_consensus.cc:515] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:05:52.967463 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 137940us
I20260709 13:05:53.006685 16322 leader_election.cc:304] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:52.982337 17602 raft_consensus.cc:2804] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:53.002205 17516 raft_consensus.cc:3060] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:53.010036 17419 raft_consensus.cc:2804] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:05:53.010612 17630 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260709 13:05:53.012091 17534 raft_consensus.cc:2749] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:52.993848 17539 raft_consensus.cc:2804] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:53.016130 16207 raft_consensus.cc:1240] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:53.002856 17637 raft_consensus.cc:2804] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:53.017323 16912 leader_election.cc:304] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:53.018136 17464 leader_election.cc:290] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:53.021346 16274 raft_consensus.cc:2468] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 2.
I20260709 13:05:53.023113 17602 raft_consensus.cc:697] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:05:53.023888 17505 leader_election.cc:290] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 2 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:53.006058 17420 raft_consensus.cc:493] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:05:52.994765 17636 consensus_queue.cc:1048] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 13:05:53.032575 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:05:53.042028 16208 raft_consensus.cc:3060] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:52.982492 16293 tablet_copy_service.cc:161] P 0aea40d6e4374085a2e38a70a71f63e3: Beginning new tablet copy session on tablet 6759dbf6a6924fcc870cb52b4a5d7953 from peer 1109f76a0b7b443a84c0327c8707bc63 at {username='slave'} at 127.0.0.1:42740: session id = 1109f76a0b7b443a84c0327c8707bc63-6759dbf6a6924fcc870cb52b4a5d7953
I20260709 13:05:53.035475 16205 raft_consensus.cc:1275] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:53.029697 17506 raft_consensus.cc:2749] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:53.016515 17419 raft_consensus.cc:493] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:05:53.008980 17635 consensus_queue.cc:1048] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 13:05:53.050118 16208 raft_consensus.cc:2468] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 3.
I20260709 13:05:53.015542 17468 raft_consensus.cc:2804] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:53.034709 17539 raft_consensus.cc:493] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:53.006731 17529 consensus_queue.cc:1048] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 13:05:53.041198 17637 raft_consensus.cc:697] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:05:53.061849 16946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:05:53.069106 16945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:05:53.068532 16320 leader_election.cc:304] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
W20260709 13:05:53.118487 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 50087.4us
I20260709 13:05:53.117700 16946 raft_consensus.cc:2393] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 2: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
W20260709 13:05:53.119738 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 125427us
W20260709 13:05:53.070709 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:53.121824 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:53.122678 16279 raft_consensus.cc:2468] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 2.
I20260709 13:05:53.065522 15057 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:05:53.051306 17420 raft_consensus.cc:3060] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:53.071082 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:53.127599 16349 raft_consensus.cc:3060] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:53.127799 16357 raft_consensus.cc:2468] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 2.
I20260709 13:05:53.072454 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:53.061335 16278 raft_consensus.cc:1275] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:53.064225 17419 raft_consensus.cc:3060] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:53.067517 17468 raft_consensus.cc:493] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:53.073824 17539 raft_consensus.cc:3060] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:05:53.117624 16174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:53.067320 16351 raft_consensus.cc:1275] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:53.124145 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:05:53.074131 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:05:53.126364 16322 leader_election.cc:304] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:53.128746 16277 raft_consensus.cc:2468] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 2.
I20260709 13:05:53.125140 15057 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:53.055881 17501 raft_consensus.cc:2749] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:53.134794 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
W20260709 13:05:53.116130 16321 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:53.064167 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 46946.1us
I20260709 13:05:53.062016 16352 raft_consensus.cc:2393] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 in current term 3: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:05:53.118304 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:53.058625 17640 consensus_queue.cc:1059] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.080s
I20260709 13:05:53.160569 16275 raft_consensus.cc:2468] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 2.
I20260709 13:05:53.042434 17435 consensus_queue.cc:260] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } }
I20260709 13:05:53.164831 17636 raft_consensus.cc:493] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:05:53.066139 17583 raft_consensus.cc:515] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:53.072088 17464 consensus_queue.cc:1048] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.079s
I20260709 13:05:53.132977 17497 raft_consensus.cc:2804] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:53.192163 17497 raft_consensus.cc:697] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 3 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:05:53.193132 17497 consensus_queue.cc:237] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:53.128705 17580 raft_consensus.cc:493] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:53.195132 17580 raft_consensus.cc:515] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:53.196372 17583 leader_election.cc:290] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:53.197415 17580 leader_election.cc:290] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:53.185041 17636 raft_consensus.cc:515] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:05:53.198359 17633 log.cc:927] Time spent T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.204s	user 0.000s	sys 0.000s
I20260709 13:05:53.200192 17636 leader_election.cc:290] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:53.177183 17508 leader_election.cc:290] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:05:53.170221 17479 leader_election.cc:290] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:53.169397 16941 raft_consensus.cc:2468] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 3.
I20260709 13:05:53.134605 17550 raft_consensus.cc:2749] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:53.146287 17468 raft_consensus.cc:3060] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:05:53.180285 17641 log.cc:927] Time spent T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:05:53.184554 16912 leader_election.cc:304] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:53.187778 16947 raft_consensus.cc:1240] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 LEADER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:53.155901 17625 raft_consensus.cc:515] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:53.161782 17590 raft_consensus.cc:493] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:05:53.157482 17602 consensus_queue.cc:237] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:53.188958 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:53.189865 17528 consensus_queue.cc:1048] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:53.200356 17630 consensus_queue.cc:1048] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:05:53.131202 17533 consensus_queue.cc:1048] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.052s
I20260709 13:05:53.135118 17582 consensus_queue.cc:1048] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.050s
I20260709 13:05:53.180671 16282 raft_consensus.cc:1275] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:05:53.173871 17444 raft_consensus.cc:515] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:53.259841 17580 raft_consensus.cc:493] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:53.183614 17450 consensus_queue.cc:1059] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 13:05:53.175648 17637 consensus_queue.cc:237] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:05:53.223977 16249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:53.259524 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 127611us
I20260709 13:05:53.267236 17464 raft_consensus.cc:3055] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:53.188001 17597 raft_consensus.cc:515] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:53.268648 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
W20260709 13:05:53.289960 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:53.293166 16207 raft_consensus.cc:1240] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:53.292634 17444 leader_election.cc:290] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:53.325627 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:05:53.298092 16293 tablet_copy_source_session.cc:215] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:53.348095 16322 leader_election.cc:304] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:53.354004 17529 raft_consensus.cc:2749] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:53.353490 16103 catalog_manager.cc:5697] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 1 to 2, leader changed from 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) to 363bb2f744eb486f9ad726f08214c98e (127.14.180.67). New cstate: current_term: 2 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } }
I20260709 13:05:53.354144 16322 leader_election.cc:304] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:05:53.333856 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 149389us
I20260709 13:05:53.355401 16912 leader_election.cc:304] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:53.356266 17534 raft_consensus.cc:2804] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:53.356566 17604 raft_consensus.cc:2804] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:53.356737 17534 raft_consensus.cc:493] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:53.357039 17604 raft_consensus.cc:493] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:53.357179 17534 raft_consensus.cc:3060] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:53.357475 17604 raft_consensus.cc:3060] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:05:53.357558 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 71066.2us
I20260709 13:05:53.332446 16349 raft_consensus.cc:1275] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:53.361454 17597 leader_election.cc:290] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:53.363569 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:53.332888 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bc3c8ff9b84838a2664335d7e1582b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:53.276440 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:53.289047 17501 raft_consensus.cc:2749] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:53.292745 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:53.326499 17419 raft_consensus.cc:515] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:53.289354 16204 raft_consensus.cc:2468] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 2.
I20260709 13:05:53.374326 16199 raft_consensus.cc:1275] T b9e1324823f04d8da5a4b3ddbd061c0e P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:53.352576 17618 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6759dbf6a6924fcc870cb52b4a5d7953. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:53.374702 16246 leader_election.cc:304] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:53.376420 17648 raft_consensus.cc:2749] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:53.340452 17528 raft_consensus.cc:493] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:53.377461 17528 raft_consensus.cc:515] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:53.377620 17529 consensus_queue.cc:1048] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:53.378938 16200 raft_consensus.cc:1240] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:53.333241 17464 raft_consensus.cc:740] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:05:53.365882 16173 leader_election.cc:304] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:05:53.361493 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:53.365836 16103 catalog_manager.cc:5697] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 1 to 2, leader changed from e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) to 363bb2f744eb486f9ad726f08214c98e (127.14.180.67). New cstate: current_term: 2 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } }
I20260709 13:05:53.382836 16173 leader_election.cc:304] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:05:53.278057 17590 raft_consensus.cc:515] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:53.355875 16322 leader_election.cc:304] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:53.372610 17479 consensus_queue.cc:1059] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:53.373787 17419 leader_election.cc:290] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 2 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:53.384789 16103 catalog_manager.cc:5697] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 1 to 2, leader changed from 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) to 363bb2f744eb486f9ad726f08214c98e (127.14.180.67). New cstate: current_term: 2 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } }
I20260709 13:05:53.388239 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:05:53.386300 16173 leader_election.cc:304] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:53.364596 17535 raft_consensus.cc:2749] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:53.332814 17580 raft_consensus.cc:515] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:53.398761 16206 raft_consensus.cc:2393] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 3: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:05:53.401053 16173 leader_election.cc:304] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:05:53.370879 17516 raft_consensus.cc:2749] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:05:53.403164 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 47364.1us
I20260709 13:05:53.405228 16173 leader_election.cc:304] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:05:53.386833 17528 leader_election.cc:290] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:05:53.388178 17444 raft_consensus.cc:2749] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:05:53.388003 17505 raft_consensus.cc:2749] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:05:53.407153 16103 catalog_manager.cc:5697] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 1 to 2, leader changed from 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) to 363bb2f744eb486f9ad726f08214c98e (127.14.180.67). New cstate: current_term: 2 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } }
I20260709 13:05:53.370417 17630 consensus_queue.cc:1048] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 13:05:53.417304 16103 catalog_manager.cc:5697] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 2 to 3, leader changed from 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) to 363bb2f744eb486f9ad726f08214c98e (127.14.180.67). New cstate: current_term: 3 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:05:53.387507 17534 raft_consensus.cc:515] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:53.419111 17475 raft_consensus.cc:515] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:53.420964 17534 leader_election.cc:290] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:53.421222 17475 leader_election.cc:290] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:53.422084 16322 leader_election.cc:304] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:53.422763 17464 consensus_queue.cc:260] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:53.423573 16322 leader_election.cc:304] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:53.423895 17534 raft_consensus.cc:2749] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:53.424027 17464 raft_consensus.cc:3060] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:53.424712 16322 leader_election.cc:304] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:53.425221 17640 raft_consensus.cc:2749] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:05:53.425804 17638 raft_consensus.cc:2804] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:53.426262 17638 raft_consensus.cc:493] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:05:53.405814 17419 raft_consensus.cc:2749] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:53.426657 17638 raft_consensus.cc:3060] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:05:53.428553 17427 consensus_queue.cc:1175] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "0aea40d6e4374085a2e38a70a71f63e3" responder_term: 1 status { last_received { term: 1 index: 1 } last_committed_idx: 1 last_received_current_leader { term: 1 index: 1 } }
I20260709 13:05:53.409246 17582 raft_consensus.cc:2749] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:53.401258 17649 raft_consensus.cc:2804] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:53.396065 17533 consensus_queue.cc:1048] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 13:05:53.411782 16202 raft_consensus.cc:1275] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:53.412091 17527 raft_consensus.cc:493] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:05:53.407236 17652 raft_consensus.cc:2804] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:53.458308 16322 leader_election.cc:304] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:53.406005 16912 leader_election.cc:304] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:53.436389 17649 raft_consensus.cc:493] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:53.418591 17528 consensus_queue.cc:1048] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 13:05:53.474939 17501 raft_consensus.cc:2804] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:53.475735 17468 raft_consensus.cc:515] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:53.480322 16206 raft_consensus.cc:1275] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:05:53.479230 16322 leader_election.cc:304] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
W20260709 13:05:53.488098 17655 log.cc:927] Time spent T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:05:53.490140 17435 raft_consensus.cc:3060] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:53.490468 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:05:53.491698 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c15d8e9be8414c84912ab77b66bfb1" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:05:53.454432 17652 raft_consensus.cc:493] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:53.495828 17625 leader_election.cc:290] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:05:53.508674 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 99726.2us
I20260709 13:05:53.478360 17597 raft_consensus.cc:2804] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:53.511961 16276 raft_consensus.cc:1275] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:53.473884 17649 raft_consensus.cc:3060] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:53.526149 16173 leader_election.cc:304] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:53.506392 17501 raft_consensus.cc:493] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:53.518615 17468 leader_election.cc:290] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:05:53.503321 17636 consensus_queue.cc:1059] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 13:05:53.520061 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:05:53.514101 17652 raft_consensus.cc:3060] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:53.515386 17597 raft_consensus.cc:493] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:53.521178 17642 raft_consensus.cc:3055] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:53.521464 17604 raft_consensus.cc:515] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:53.473248 17497 consensus_queue.cc:1048] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 13:05:53.504386 17539 raft_consensus.cc:515] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:53.545727 17501 raft_consensus.cc:3060] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:53.564743 17539 leader_election.cc:290] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:53.525235 17528 consensus_queue.cc:1048] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:05:53.526649 17637 consensus_queue.cc:1048] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:53.510339 17464 raft_consensus.cc:2804] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:53.567083 17464 raft_consensus.cc:493] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:53.567574 17464 raft_consensus.cc:3060] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:53.551666 17597 raft_consensus.cc:3060] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:53.467897 17420 raft_consensus.cc:515] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:53.463260 17527 raft_consensus.cc:515] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:53.572041 17604 leader_election.cc:290] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 3 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:53.518253 17535 consensus_queue.cc:1048] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:53.572870 17420 leader_election.cc:290] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 2 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:53.530759 17529 consensus_queue.cc:1048] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:05:53.532452 17533 raft_consensus.cc:2804] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:53.530627 17590 leader_election.cc:290] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:05:53.516278 16199 raft_consensus.cc:3060] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:53.574388 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:05:53.572876 17527 leader_election.cc:290] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:53.538642 17635 consensus_queue.cc:1059] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:53.580250 17635 raft_consensus.cc:3055] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:53.580685 17635 raft_consensus.cc:740] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:05:53.581568 17635 consensus_queue.cc:260] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:53.539958 17432 raft_consensus.cc:993] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e: : Instructing follower 0aea40d6e4374085a2e38a70a71f63e3 to start an election
W20260709 13:05:53.477780 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 81866.5us
I20260709 13:05:53.551908 17642 raft_consensus.cc:740] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:05:53.583422 17642 consensus_queue.cc:260] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:53.584820 17603 consensus_queue.cc:1048] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 13:05:53.584640 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:05:53.591848 16941 raft_consensus.cc:2468] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 3.
I20260709 13:05:53.589589 17464 raft_consensus.cc:515] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:53.555980 17580 leader_election.cc:290] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:53.513294 17638 raft_consensus.cc:515] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:53.573673 16201 raft_consensus.cc:1240] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:53.574280 17533 raft_consensus.cc:697] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:05:53.596120 17533 consensus_queue.cc:237] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:53.596920 17638 leader_election.cc:290] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 2 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:53.593154 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:05:53.593277 17618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:40078 (request call id 85) took 1252 ms. Trace:
I20260709 13:05:53.552636 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:53.598889 16207 raft_consensus.cc:3060] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:53.584545 16912 leader_election.cc:304] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:53.545903 16322 leader_election.cc:304] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:05:53.603878 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 51941.7us
W20260709 13:05:53.605049 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 59232.4us
I20260709 13:05:53.571116 17652 raft_consensus.cc:515] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:53.602142 17642 raft_consensus.cc:3060] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:53.605979 16322 leader_election.cc:304] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:53.610952 17468 raft_consensus.cc:2749] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:05:53.610742 17637 consensus_queue.cc:1048] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:05:53.612283 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 63518us
W20260709 13:05:53.612758 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:53.613217 16282 raft_consensus.cc:1240] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:05:53.614758 17597 raft_consensus.cc:515] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:53.615447 17635 raft_consensus.cc:3060] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:53.616019 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:53.616981 17597 leader_election.cc:290] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:53.618414 17649 raft_consensus.cc:515] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:53.619499 17450 consensus_queue.cc:1059] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:53.619912 17501 raft_consensus.cc:515] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:53.621464 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:05:53.622175 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:05:53.622593 16283 raft_consensus.cc:3060] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:53.628214 16207 raft_consensus.cc:2468] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 3.
I20260709 13:05:53.598322 17464 leader_election.cc:290] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:05:53.631071 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:05:53.631877 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:53.642889 16201 raft_consensus.cc:2393] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 2: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:05:53.644212 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:05:53.650910 16283 raft_consensus.cc:2468] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 3.
I20260709 13:05:53.651958 16199 raft_consensus.cc:2468] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 3.
I20260709 13:05:53.660418 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:05:53.667505 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:05:53.643280 17539 raft_consensus.cc:493] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:05:53.680932 16173 leader_election.cc:304] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 363bb2f744eb486f9ad726f08214c98e
I20260709 13:05:53.646924 17604 raft_consensus.cc:2749] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:53.641678 17550 raft_consensus.cc:493] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:05:53.647154 17516 raft_consensus.cc:493] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:05:53.684559 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
W20260709 13:05:53.685369 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 79471.5us
I20260709 13:05:53.646808 17602 raft_consensus.cc:493] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:05:53.688880 16320 leader_election.cc:304] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:53.690969 16248 leader_election.cc:304] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:53.691668 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:05:53.692863 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:53.696717 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:05:53.697801 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c15d8e9be8414c84912ab77b66bfb1" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:05:53.698364 16281 raft_consensus.cc:3060] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:53.699486 16201 raft_consensus.cc:2955] T b9e1324823f04d8da5a4b3ddbd061c0e P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:05:53.672942 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:05:53.676420 17648 raft_consensus.cc:493] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:53.672731 17580 raft_consensus.cc:493] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:05:53.680634 17638 raft_consensus.cc:1081] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 1 LEADER]: Signalling peer 0aea40d6e4374085a2e38a70a71f63e3 to start an election
I20260709 13:05:53.719357 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:53.719969 16276 raft_consensus.cc:2468] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 2.
I20260709 13:05:53.720888 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:05:53.722210 16914 leader_election.cc:304] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:05:53.709538 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
W20260709 13:05:53.675438 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 88928.9us
I20260709 13:05:53.683036 17419 raft_consensus.cc:2764] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won
I20260709 13:05:53.734077 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:05:53.732079 16276 raft_consensus.cc:2393] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 3: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:05:53.688860 17427 raft_consensus.cc:2749] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:53.732043 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:05:53.735782 16949 raft_consensus.cc:3060] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:53.685515 17652 leader_election.cc:290] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:53.736356 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:05:53.739015 16276 raft_consensus.cc:3060] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:05:53.712972 17590 raft_consensus.cc:2749] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:53.743944 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:05:53.744911 16283 raft_consensus.cc:2393] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 3: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:05:53.744736 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:05:53.743083 16281 raft_consensus.cc:2468] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 3.
I20260709 13:05:53.747223 16281 raft_consensus.cc:1240] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:53.747375 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:05:53.748098 16356 raft_consensus.cc:2393] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 3: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:05:53.686765 17444 consensus_queue.cc:1048] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.047s
I20260709 13:05:53.755932 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:05:53.757354 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:05:53.734063 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:05:53.714259 17602 raft_consensus.cc:515] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:53.691481 17550 raft_consensus.cc:515] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:53.724376 17533 consensus_queue.cc:1059] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.057s
I20260709 13:05:53.654949 17497 raft_consensus.cc:2955] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:05:53.702445 17516 raft_consensus.cc:515] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:53.815691 16349 raft_consensus.cc:2468] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 2.
I20260709 13:05:53.775121 16355 raft_consensus.cc:1240] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:05:53.759815 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:05:53.828953 16356 raft_consensus.cc:3060] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:53.774397 16357 raft_consensus.cc:1275] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:53.832309 16948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:05:53.833274 16948 raft_consensus.cc:3060] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:53.684079 17539 raft_consensus.cc:515] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:53.778913 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
W20260709 13:05:53.835166 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 128486us
I20260709 13:05:53.604334 17618 rpcz_store.cc:276] 0709 13:05:52.349863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:52.351496 (+  1633us) service_pool.cc:224] Handling call
0709 13:05:52.571283 (+219787us) ts_tablet_manager.cc:934] T 6759dbf6a6924fcc870cb52b4a5d7953 P 1109f76a0b7b443a84c0327c8707bc63: Initiating tablet copy from peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
0709 13:05:53.351246 (+779963us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:05:53.522276 (+171030us) tablet_metadata.cc:665] Metadata flushed
0709 13:05:53.522411 (+   135us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:05:53.592483 (+ 70072us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:05:53.592803 (+   320us) tablet_replica.cc:206] Creating consensus instance
0709 13:05:53.593130 (+   327us) ts_tablet_manager.cc:989] Replica registered.
0709 13:05:53.593198 (+    68us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":107880,"tablet-copy.queue_time_us":59714,"thread_start_us":41545,"threads_started":2}
I20260709 13:05:53.838174 16173 leader_election.cc:304] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:05:53.839875 16349 raft_consensus.cc:1240] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:05:53.741261 17506 raft_consensus.cc:2804] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:53.842679 16278 raft_consensus.cc:1240] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:53.844730 16248 leader_election.cc:304] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:05:53.847826 16322 consensus_peers.cc:597] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e -> Peer 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875): Couldn't send request to peer 1109f76a0b7b443a84c0327c8707bc63. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b9e1324823f04d8da5a4b3ddbd061c0e. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:53.731714 17580 raft_consensus.cc:515] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:53.744048 17604 raft_consensus.cc:2804] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:53.723253 17648 raft_consensus.cc:515] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:53.863006 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:05:53.835342 17432 raft_consensus.cc:3055] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:53.857679 17590 raft_consensus.cc:2749] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:05:53.861961 16173 leader_election.cc:304] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:53.862198 17550 leader_election.cc:290] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:05:53.776206 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:05:53.890219 17673 raft_consensus.cc:3055] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:53.857967 16355 raft_consensus.cc:1240] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:05:53.821626 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:05:53.819450 17649 leader_election.cc:290] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 election: Requested vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:05:53.908228 16173 leader_election.cc:304] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:05:53.911335 16948 raft_consensus.cc:2468] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 4.
I20260709 13:05:53.821740 17501 leader_election.cc:290] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 3 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:53.880059 16949 raft_consensus.cc:2468] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 3.
I20260709 13:05:53.880828 16322 leader_election.cc:304] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:53.882503 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:53.925822 16356 raft_consensus.cc:2468] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 3.
I20260709 13:05:53.892349 16944 raft_consensus.cc:2393] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 3: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
I20260709 13:05:53.888221 17580 leader_election.cc:290] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:05:53.888844 17539 leader_election.cc:290] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:05:53.890708 17673 raft_consensus.cc:740] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:05:53.915777 16946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
W20260709 13:05:53.859004 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 86322.5us
I20260709 13:05:53.863133 17618 tablet_copy_client.cc:806] T 6759dbf6a6924fcc870cb52b4a5d7953 P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:53.925125 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bc3c8ff9b84838a2664335d7e1582b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:53.862888 17666 raft_consensus.cc:2749] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:05:53.926160 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 45410.4us
I20260709 13:05:53.886667 16348 raft_consensus.cc:1240] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:05:53.992798 16322 leader_election.cc:304] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:53.865065 16276 raft_consensus.cc:2468] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 4.
I20260709 13:05:53.996178 16276 raft_consensus.cc:1275] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:05:53.999437 16276 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d"
dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
 from {username='slave'} at 127.0.0.1:45210
W20260709 13:05:53.844127 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 89083.5us
I20260709 13:05:53.934103 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:54.000324 16276 raft_consensus.cc:493] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:53.994422 16322 leader_election.cc:304] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:54.001082 16276 raft_consensus.cc:3060] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:53.965087 16946 raft_consensus.cc:2393] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 3: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
I20260709 13:05:53.880440 17432 raft_consensus.cc:740] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:05:53.900087 17533 raft_consensus.cc:2804] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:53.863898 17506 raft_consensus.cc:697] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [term 3 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:05:54.003273 17506 consensus_queue.cc:237] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:53.857728 17604 raft_consensus.cc:493] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:05:54.000936 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:54.006862 17604 raft_consensus.cc:3060] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:54.007130 16356 raft_consensus.cc:2368] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 3. Current term is 4.
I20260709 13:05:53.896395 17527 raft_consensus.cc:3055] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:54.008344 17527 raft_consensus.cc:740] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:05:54.009320 17527 consensus_queue.cc:260] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:53.930670 17644 raft_consensus.cc:2804] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:05:54.011256 16249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:54.017829 17636 raft_consensus.cc:2749] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:05:54.018409 16322 leader_election.cc:304] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:54.013530 16276 raft_consensus.cc:515] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:53.935747 17529 raft_consensus.cc:2749] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:54.019484 17636 raft_consensus.cc:2804] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:54.020854 17636 raft_consensus.cc:493] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:05:54.021396 17636 raft_consensus.cc:3060] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:54.027298 17604 raft_consensus.cc:515] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:54.028861 16948 raft_consensus.cc:1240] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:54.029985 17604 leader_election.cc:290] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 3 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:54.030333 16276 leader_election.cc:290] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:54.020243 16322 leader_election.cc:304] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:54.032151 16322 leader_election.cc:304] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:54.033171 17508 raft_consensus.cc:2749] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:05:54.035416 16322 leader_election.cc:304] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:53.934865 16352 raft_consensus.cc:2468] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 2.
I20260709 13:05:53.928574 17582 consensus_queue.cc:1048] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.089s
I20260709 13:05:54.010571 17527 raft_consensus.cc:3060] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:53.930740 17630 consensus_queue.cc:1059] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.105s
I20260709 13:05:53.965339 17505 consensus_queue.cc:1048] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.112s
I20260709 13:05:53.963582 17419 consensus_queue.cc:1059] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.112s
I20260709 13:05:54.017167 17533 raft_consensus.cc:697] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 3 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:05:54.067659 17648 leader_election.cc:290] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:54.068096 17533 consensus_queue.cc:237] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:54.036136 17618 tablet_copy_client.cc:670] T 6759dbf6a6924fcc870cb52b4a5d7953 P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:54.071475 16941 raft_consensus.cc:1240] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:05:54.070851 17673 consensus_queue.cc:260] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:54.034862 17539 raft_consensus.cc:493] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:54.072600 17673 raft_consensus.cc:3060] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:54.072544 17539 raft_consensus.cc:515] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:54.044413 17529 raft_consensus.cc:2749] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:05:54.047154 17427 raft_consensus.cc:2749] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:05:54.063902 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 45924.7us
W20260709 13:05:54.068750 17679 log.cc:927] Time spent T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.170s	user 0.001s	sys 0.000s
I20260709 13:05:54.016535 17638 raft_consensus.cc:2749] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:05:54.047080 17508 consensus_queue.cc:1059] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 13:05:54.048533 17644 raft_consensus.cc:697] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:05:54.053567 17549 consensus_queue.cc:1059] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 13:05:54.078342 17602 leader_election.cc:290] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:05:54.127884 17539 leader_election.cc:290] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:54.075522 17604 consensus_queue.cc:1048] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.059s
I20260709 13:05:54.129333 17501 consensus_queue.cc:1048] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:05:54.086220 17630 raft_consensus.cc:3055] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:54.052160 17432 consensus_queue.cc:260] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:54.094467 17516 leader_election.cc:290] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:05:54.136354 17630 raft_consensus.cc:740] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:05:54.139605 17652 raft_consensus.cc:3055] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:54.150905 17652 raft_consensus.cc:740] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:05:54.153448 17644 consensus_queue.cc:237] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:54.153719 17636 raft_consensus.cc:515] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:54.161453 17630 consensus_queue.cc:260] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:54.152204 17652 consensus_queue.cc:260] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:54.163569 17630 raft_consensus.cc:3060] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:05:54.162379 17642 consensus_meta.cc:287] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 0.531s	user 0.007s	sys 0.002s
I20260709 13:05:54.156951 17636 leader_election.cc:290] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 2 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:05:54.220693 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 309183us
W20260709 13:05:54.225832 16173 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:54.085912 16349 raft_consensus.cc:1275] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:05:54.247139 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 209008us
I20260709 13:05:54.249786 16322 leader_election.cc:304] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:05:54.243628 16348 raft_consensus.cc:1275] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:54.287983 17475 raft_consensus.cc:493] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:05:54.289294 17475 raft_consensus.cc:515] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:54.299661 17508 raft_consensus.cc:2804] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:54.300714 17508 raft_consensus.cc:697] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 4 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:05:54.301509 17427 consensus_queue.cc:1048] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:54.294354 17582 consensus_queue.cc:1059] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 13:05:54.302354 17508 consensus_queue.cc:237] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:54.294199 17475 leader_election.cc:290] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:05:54.314152 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 52766.7us
I20260709 13:05:54.086041 16912 leader_election.cc:304] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:54.310422 17539 raft_consensus.cc:493] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:54.316682 17516 raft_consensus.cc:493] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:05:54.327965 17516 raft_consensus.cc:515] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:05:54.333266 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 257921us
I20260709 13:05:54.335178 17604 raft_consensus.cc:2804] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:54.337114 17539 raft_consensus.cc:515] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:54.339035 16248 leader_election.cc:304] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:05:54.340729 17539 leader_election.cc:290] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:54.341495 17539 raft_consensus.cc:2764] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:05:54.342308 17682 raft_consensus.cc:493] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:54.343380 17682 raft_consensus.cc:515] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:54.343976 16173 leader_election.cc:304] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:05:54.345425 17644 raft_consensus.cc:2749] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:05:54.345451 16248 leader_election.cc:304] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:54.347714 17602 raft_consensus.cc:2749] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:05:54.325887 17582 raft_consensus.cc:3055] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:54.358853 17582 raft_consensus.cc:740] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:05:54.360373 17582 consensus_queue.cc:260] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:54.368858 17644 raft_consensus.cc:493] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:54.369925 17644 raft_consensus.cc:515] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:54.373263 17644 leader_election.cc:290] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:54.375955 17516 leader_election.cc:290] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:54.378737 17700 raft_consensus.cc:493] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:54.380728 17700 raft_consensus.cc:515] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } }
I20260709 13:05:54.383504 17700 leader_election.cc:290] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:54.384886 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:05:54.386332 16203 raft_consensus.cc:2393] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 in current term 3: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:05:54.380234 17582 raft_consensus.cc:3060] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:54.397081 16173 leader_election.cc:304] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:05:54.346298 17682 leader_election.cc:290] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:54.398656 16354 raft_consensus.cc:2468] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 3.
I20260709 13:05:54.400183 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:05:54.400779 17637 raft_consensus.cc:2749] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:05:54.402302 16248 leader_election.cc:304] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:54.408347 17497 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:33478 (request call id 9) took 1634 ms. Trace:
I20260709 13:05:54.409524 16282 raft_consensus.cc:3060] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:54.413691 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:05:54.416194 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:54.419363 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:54.411265 17604 raft_consensus.cc:697] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [term 3 LEADER]: Becoming Leader. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:05:54.431567 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:05:54.432214 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:54.436920 17590 raft_consensus.cc:493] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:05:54.437525 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:05:54.437803 17590 raft_consensus.cc:515] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:54.439651 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:05:54.440728 17590 leader_election.cc:290] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:54.425613 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:54.428601 16203 raft_consensus.cc:1275] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:05:54.442288 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:05:54.443209 16941 raft_consensus.cc:2468] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 1.
I20260709 13:05:54.450198 17539 raft_consensus.cc:493] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:05:54.450721 17516 raft_consensus.cc:493] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:54.451510 17539 raft_consensus.cc:515] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:54.451695 17516 raft_consensus.cc:515] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:54.454916 17516 leader_election.cc:290] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:54.455516 17666 raft_consensus.cc:3055] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:54.455600 17516 raft_consensus.cc:493] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:05:54.456176 17666 raft_consensus.cc:740] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:05:54.456312 17539 leader_election.cc:290] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:05:54.456614 17516 raft_consensus.cc:515] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:54.456768 17604 consensus_queue.cc:237] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:54.459347 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:54.460472 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:05:54.461510 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:05:54.462695 16203 raft_consensus.cc:2393] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 2: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:05:54.465032 16248 leader_election.cc:400] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107) with higher term. Message: Invalid argument: T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 3. Current term is 4.
I20260709 13:05:54.466516 16248 leader_election.cc:304] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:05:54.468425 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 71592.7us
I20260709 13:05:54.470682 17666 consensus_queue.cc:260] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:54.472054 17666 raft_consensus.cc:3060] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:54.468451 17590 raft_consensus.cc:2749] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:54.474009 17516 leader_election.cc:290] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:54.487151 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:54.452289 15057 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:54.516786 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:54.517097 16106 catalog_manager.cc:5697] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: term changed from 1 to 3, leader changed from 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) to 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68). New cstate: current_term: 3 leader_uuid: "1109f76a0b7b443a84c0327c8707bc63" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:05:54.537134 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 95518.9us
I20260709 13:05:54.538923 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:05:54.540433 16206 raft_consensus.cc:2393] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 2: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:05:54.409081 17497 rpcz_store.cc:276] 0709 13:05:52.773241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:52.783010 (+  9769us) service_pool.cc:224] Handling call
0709 13:05:53.026785 (+243775us) spinlock_profiling.cc:243] Waited 2.26 ms on lock 0x7b2c00007b38. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361dd82a11 00007f361dd91a0a 00007f361dd91693 00007f361dd91631 00007f361f4c43f1 00007f361f3fd9fe 00007f361f484749 00007f361f48576a 00007f361f48491b 00007f361f49003c 00007f361f48f6b3
0709 13:05:53.039788 (+ 13003us) log.cc:844] Serialized 506 byte log entry
0709 13:05:53.345461 (+305673us) spinlock_profiling.cc:243] Waited 9.05 ms on lock 0x7b180036ca00. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f3625264de1 00007f36252715b1 00007f361c316c0a 00007f3625a56219 00007f361c39ea40 00007f361c3994e4 00007f361c399455 00007f361f3e2b0b 00007f361f467b63 00007f361f48f752 00007f362444fd29
0709 13:05:53.403045 (+ 57584us) spinlock_profiling.cc:243] Waited 3.88 ms on lock 0x7b54001e0120. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f402142 00007f361f3e2eaa 00007f361f3e9d53 00007f361f3e9cd9 00007f361f3e9c69 00007f361f3e9c31 00007f361f3e8dfd 000000000038f354 000000000038f199 00007f361c39c475
0709 13:05:54.408001 (+1004956us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44221,"raft.queue_time_us":130773,"raft.run_cpu_time_us":4705,"raft.run_wall_time_us":232270,"spinlock_wait_cycles":34935168,"thread_start_us":167212,"threads_started":1,"wal-append.queue_time_us":275138}
I20260709 13:05:54.508466 17682 raft_consensus.cc:2749] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:54.488421 17602 raft_consensus.cc:493] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:05:54.527088 17590 raft_consensus.cc:493] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:05:54.573342 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:54.569123 16248 leader_election.cc:304] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:05:54.570459 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:54.531587 17516 consensus_queue.cc:1048] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 13:05:54.564469 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:54.586649 16282 raft_consensus.cc:1275] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:05:54.587370 17704 consensus_queue.cc:1048] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 13:05:54.586722 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:05:54.593509 16942 raft_consensus.cc:1275] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:05:54.594949 16945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:05:54.598024 17636 raft_consensus.cc:493] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:54.598678 17636 raft_consensus.cc:515] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:54.603127 17636 leader_election.cc:290] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:05:54.603822 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 59615.6us
I20260709 13:05:54.604872 17516 raft_consensus.cc:2804] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:54.605408 17516 raft_consensus.cc:493] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:05:54.605859 17516 raft_consensus.cc:3060] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:54.606482 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:54.607396 16204 raft_consensus.cc:2468] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 3.
I20260709 13:05:54.604142 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:54.588181 16173 leader_election.cc:304] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:05:54.587630 16103 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38840 (request call id 192) took 1385 ms. Trace:
I20260709 13:05:54.617846 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:05:54.618506 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:05:54.619576 16354 raft_consensus.cc:2393] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 in current term 3: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:05:54.616026 16945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:05:54.634802 17432 raft_consensus.cc:3060] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:54.635139 17652 raft_consensus.cc:3060] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:54.614324 17644 raft_consensus.cc:2804] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:54.588454 17590 raft_consensus.cc:515] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:54.645588 16280 raft_consensus.cc:2468] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 2.
I20260709 13:05:54.655450 17582 consensus_queue.cc:1059] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:05:54.657514 17630 raft_consensus.cc:3055] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:54.655603 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:05:54.658164 17630 raft_consensus.cc:740] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:05:54.612351 17602 raft_consensus.cc:515] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:54.663280 17630 consensus_queue.cc:260] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:54.645588 17497 raft_consensus.cc:3055] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:54.669762 17497 raft_consensus.cc:740] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:05:54.670043 17602 leader_election.cc:290] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:54.671212 17630 raft_consensus.cc:3060] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:54.671047 17497 consensus_queue.cc:260] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:05:54.672372 17497 raft_consensus.cc:3060] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:54.674019 16279 raft_consensus.cc:1275] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:54.674993 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:05:54.677012 16321 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:54.680249 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:54.681308 16351 raft_consensus.cc:2468] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 2.
I20260709 13:05:54.610319 16103 rpcz_store.cc:276] 0709 13:05:53.160964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:53.161156 (+   192us) service_pool.cc:224] Handling call
0709 13:05:54.535329 (+1374173us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:05:53.702000 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:05:53.779151 (+ 77151us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:05:53.779199 (+    48us) write_op.cc:435] Acquired schema lock
0709 13:05:53.779229 (+    30us) tablet.cc:662] Decoding operations
0709 13:05:53.802407 (+ 23178us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:05:53.802488 (+    81us) write_op.cc:641] Partition lock acquired for write op
0709 13:05:53.802519 (+    31us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:05:53.803093 (+   574us) tablet.cc:701] Row locks acquired
0709 13:05:53.803116 (+    23us) write_op.cc:260] PREPARE: finished
0709 13:05:53.803277 (+   161us) write_op.cc:270] Start()
0709 13:05:53.803415 (+   138us) write_op.cc:276] Timestamp: P: 1783602353803225 usec, L: 0
0709 13:05:53.803442 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 13:05:53.824335 (+ 20893us) log.cc:844] Serialized 2089 byte log entry
0709 13:05:54.174930 (+350595us) op_driver.cc:464] REPLICATION: finished
0709 13:05:54.186983 (+ 12053us) write_op.cc:301] APPLY: starting
0709 13:05:54.187060 (+    77us) tablet.cc:1367] starting BulkCheckPresence
0709 13:05:54.187187 (+   127us) tablet.cc:1370] finished BulkCheckPresence
0709 13:05:54.187333 (+   146us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:05:54.187889 (+   556us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:05:54.188034 (+   145us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 13:05:54.188064 (+    30us) write_op.cc:312] APPLY: finished
0709 13:05:54.188262 (+   198us) log.cc:844] Serialized 47 byte log entry
0709 13:05:54.188398 (+   136us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:54.188474 (+    76us) write_op.cc:454] Released schema lock
0709 13:05:54.188500 (+    26us) write_op.cc:341] FINISH: Updating metrics
0709 13:05:54.288660 (+100160us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:54.288745 (+    85us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":7,"child_traces":[["op",{"apply.queue_time_us":11777,"apply.run_cpu_time_us":1743,"apply.run_wall_time_us":1745,"num_ops":5,"prepare.queue_time_us":272135,"prepare.run_cpu_time_us":76622,"prepare.run_wall_time_us":292541,"raft.queue_time_us":47597,"raft.run_cpu_time_us":5951,"raft.run_wall_time_us":115044,"replication_time_us":371312,"thread_start_us":545608,"threads_started":4,"wal-append.queue_time_us":232568}]]}
I20260709 13:05:54.647725 17644 raft_consensus.cc:493] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:05:54.694501 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:54.694906 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:54.696367 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:54.697327 16356 raft_consensus.cc:2393] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 2: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:05:54.698328 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:54.700551 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:54.700927 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:54.701912 16357 raft_consensus.cc:2393] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 3: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:05:54.716238 16280 raft_consensus.cc:1275] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:54.690768 17644 raft_consensus.cc:3060] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:54.744338 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:54.745014 16352 raft_consensus.cc:1275] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:54.745828 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:54.746584 16322 leader_election.cc:304] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:54.746716 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:54.746948 16352 raft_consensus.cc:1275] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:05:54.747490 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:54.748261 16353 raft_consensus.cc:2468] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 2.
I20260709 13:05:54.748739 16352 raft_consensus.cc:1240] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:05:54.748975 16322 leader_election.cc:304] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:54.749944 16353 raft_consensus.cc:1240] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:54.755494 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:05:54.756425 16357 raft_consensus.cc:2393] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 3: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:05:54.763931 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:54.766579 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:54.751675 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:54.798753 16206 raft_consensus.cc:2393] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 3: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
W20260709 13:05:54.802887 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 148174us
I20260709 13:05:54.805661 16356 raft_consensus.cc:1240] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:05:54.797288 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:54.817427 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:54.820529 17651 raft_consensus.cc:2804] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:54.821305 17651 raft_consensus.cc:697] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 3 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:05:54.822705 17651 consensus_queue.cc:237] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:54.826670 16246 leader_election.cc:304] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:05:54.827988 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 69172.5us
I20260709 13:05:54.828727 17419 consensus_queue.cc:1048] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 13:05:54.829048 16246 leader_election.cc:304] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:54.830084 17516 raft_consensus.cc:515] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:05:54.830600 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 73764.2us
I20260709 13:05:54.832556 16320 leader_election.cc:304] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:54.832787 17516 leader_election.cc:290] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:05:54.834844 17701 raft_consensus.cc:2749] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:05:54.839250 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:54.828119 17682 raft_consensus.cc:2749] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:54.842129 17597 raft_consensus.cc:2749] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:05:54.815927 17590 leader_election.cc:290] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:54.843248 16274 raft_consensus.cc:1240] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:54.844501 17618 tablet_copy_client.cc:538] T 6759dbf6a6924fcc870cb52b4a5d7953 P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:54.846158 16355 raft_consensus.cc:2410] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for term 3 because replica has last-logged OpId of term: 1 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:05:54.848075 16246 leader_election.cc:304] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:54.833588 17516 raft_consensus.cc:2749] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:54.869351 17715 ts_tablet_manager.cc:933] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63: Initiating tablet copy from peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:54.874274 16278 raft_consensus.cc:1240] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 1. Current term is 2. Ops: [1.2-1.2]
I20260709 13:05:54.849747 16282 raft_consensus.cc:2468] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 3.
W20260709 13:05:54.885540 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 54986.4us
I20260709 13:05:54.887178 16945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:05:54.901098 16914 leader_election.cc:304] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:54.859277 17602 raft_consensus.cc:2749] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:54.919265 17704 raft_consensus.cc:2749] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:05:54.932302 16248 leader_election.cc:304] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:05:54.855917 17644 raft_consensus.cc:515] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:54.941869 16914 leader_election.cc:304] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:54.943079 16949 raft_consensus.cc:1275] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:05:54.943961 16320 leader_election.cc:304] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:54.944967 16320 leader_election.cc:304] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:54.945832 17597 raft_consensus.cc:2804] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:54.946254 17597 raft_consensus.cc:493] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:54.946609 17597 raft_consensus.cc:3060] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:54.954571 17549 raft_consensus.cc:2749] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:54.954708 17464 consensus_queue.cc:1048] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 13:05:54.956146 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:05:54.954842 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:54.961421 16208 raft_consensus.cc:1240] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:54.963459 16280 raft_consensus.cc:1240] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 1. Current term is 2. Ops: []
W20260709 13:05:54.972075 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 60386.3us
I20260709 13:05:54.974638 16248 leader_election.cc:304] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:05:54.976475 16248 leader_election.cc:304] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:05:54.949033 17602 raft_consensus.cc:2804] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:54.954910 17604 raft_consensus.cc:2749] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:05:55.001197 16320 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:54.984146 17516 raft_consensus.cc:2749] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:54.984709 17602 raft_consensus.cc:493] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:54.987437 17590 raft_consensus.cc:2804] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:55.017731 16246 leader_election.cc:304] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:55.025033 16322 leader_election.cc:304] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:55.010890 17715 tablet_copy_client.cc:323] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Beginning tablet copy session from remote peer at address 127.14.180.67:46107
I20260709 13:05:55.026358 17682 raft_consensus.cc:2749] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:55.030818 16282 raft_consensus.cc:1275] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:05:55.042467 16246 leader_election.cc:304] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:55.047907 16280 raft_consensus.cc:1275] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:05:55.015748 17602 raft_consensus.cc:3060] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:55.020155 17590 raft_consensus.cc:493] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:55.055573 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:55.036499 16355 consensus_queue.cc:237] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:05:55.058398 16246 leader_election.cc:304] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:55.054632 17590 raft_consensus.cc:3060] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:55.067436 16173 leader_election.cc:304] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:05:55.069849 17716 raft_consensus.cc:2804] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:55.070425 17716 raft_consensus.cc:697] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 3 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:05:55.071633 16208 raft_consensus.cc:1275] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:05:55.070851 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:05:55.059545 17516 raft_consensus.cc:2749] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:55.084363 17635 consensus_queue.cc:1048] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 13:05:55.085711 16206 raft_consensus.cc:1275] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:05:55.051887 17464 consensus_queue.cc:1048] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
W20260709 13:05:55.065303 17666 consensus_meta.cc:287] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f: Time spent flushing consensus metadata: real 0.593s	user 0.010s	sys 0.005s
I20260709 13:05:55.067425 17644 leader_election.cc:290] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 election: Requested vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:05:55.078784 17716 consensus_queue.cc:237] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:55.082983 17726 consensus_queue.cc:1059] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:05:55.083588 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 61026.2us
I20260709 13:05:55.084187 17508 raft_consensus.cc:2804] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:55.066309 17682 raft_consensus.cc:2749] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:55.095566 16173 leader_election.cc:304] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:05:55.078652 17582 consensus_queue.cc:1048] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 13:05:55.104297 17597 raft_consensus.cc:515] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } }
I20260709 13:05:55.107455 16350 raft_consensus.cc:2468] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 2.
W20260709 13:05:55.109206 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 50841.2us
I20260709 13:05:55.111689 16246 leader_election.cc:304] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:55.114279 17539 raft_consensus.cc:493] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:05:55.115223 17539 raft_consensus.cc:515] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:55.115857 17682 raft_consensus.cc:493] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:05:55.116479 17682 raft_consensus.cc:515] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:55.117640 17539 leader_election.cc:290] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:55.118400 17508 raft_consensus.cc:697] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 2 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:05:55.119602 17508 consensus_queue.cc:237] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:55.122568 17582 raft_consensus.cc:2749] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:05:55.122581 17726 consensus_queue.cc:1048] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:05:55.098073 17516 raft_consensus.cc:493] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:55.118682 17682 leader_election.cc:290] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:55.108372 17604 raft_consensus.cc:3055] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:05:55.126853 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 49446.4us
I20260709 13:05:55.135351 16246 leader_election.cc:304] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:55.137157 16246 leader_election.cc:304] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:55.140574 16246 leader_election.cc:304] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:55.156960 17736 raft_consensus.cc:2749] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:55.160159 17736 raft_consensus.cc:2749] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:55.131196 17618 tablet_bootstrap.cc:492] T 6759dbf6a6924fcc870cb52b4a5d7953 P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap starting.
I20260709 13:05:55.144851 17590 raft_consensus.cc:515] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:55.168359 16351 raft_consensus.cc:1275] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:05:55.127875 17604 raft_consensus.cc:740] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:05:55.170077 17590 leader_election.cc:290] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:55.127432 17516 raft_consensus.cc:515] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:55.179474 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:05:55.180037 17516 leader_election.cc:290] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:55.143647 17682 raft_consensus.cc:3060] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:55.143604 17539 raft_consensus.cc:3060] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:55.183342 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:05:55.187088 16206 raft_consensus.cc:3060] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:55.127444 17464 consensus_queue.cc:1048] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.049s
I20260709 13:05:55.132165 17602 raft_consensus.cc:515] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:55.145327 17651 consensus_queue.cc:1048] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:05:55.188056 17590 raft_consensus.cc:493] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:05:55.190440 16203 raft_consensus.cc:1275] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:55.206720 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:55.182797 17582 consensus_queue.cc:1059] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 13:05:55.193488 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:55.211120 16246 leader_election.cc:304] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:55.210150 16248 leader_election.cc:304] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:55.200197 17736 raft_consensus.cc:493] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:05:55.228230 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:55.228901 17602 leader_election.cc:290] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:55.229635 17602 raft_consensus.cc:2749] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:05:55.228231 17736 raft_consensus.cc:515] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:55.194998 17497 consensus_queue.cc:1048] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:05:55.200914 17716 raft_consensus.cc:493] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:05:55.215873 17597 leader_election.cc:290] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:55.250353 17716 raft_consensus.cc:515] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:55.251704 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:05:55.251983 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:55.219951 17604 consensus_queue.cc:260] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:55.246603 17651 raft_consensus.cc:493] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:05:55.230366 17602 raft_consensus.cc:2749] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:55.225698 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:05:55.267177 16283 raft_consensus.cc:1275] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:05:55.268324 16322 leader_election.cc:304] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:05:55.250626 16366 tablet_copy_service.cc:140] P 363bb2f744eb486f9ad726f08214c98e: Received BeginTabletCopySession request for tablet b9e1324823f04d8da5a4b3ddbd061c0e from peer 1109f76a0b7b443a84c0327c8707bc63 ({username='slave'} at 127.0.0.1:33486)
W20260709 13:05:55.275125 17726 consensus_queue.cc:1175] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "363bb2f744eb486f9ad726f08214c98e" responder_term: 2 status { last_received { term: 2 index: 5 } last_committed_idx: 4 last_received_current_leader { term: 2 index: 5 } }
I20260709 13:05:55.252985 17716 leader_election.cc:290] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:55.276153 17651 raft_consensus.cc:515] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:05:55.300251 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 90190.6us
I20260709 13:05:55.305064 16173 leader_election.cc:304] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:05:55.233024 17590 raft_consensus.cc:515] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:55.315212 16248 leader_election.cc:304] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:55.272696 17516 raft_consensus.cc:493] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:05:55.312044 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:05:55.319643 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:55.321559 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:55.313673 17666 raft_consensus.cc:2749] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:55.295253 17419 consensus_queue.cc:1048] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
W20260709 13:05:55.333566 17734 log.cc:927] Time spent T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.173s	user 0.000s	sys 0.005s
I20260709 13:05:55.328687 17688 consensus_queue.cc:1059] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:05:55.329270 17505 consensus_queue.cc:1048] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 13:05:55.334831 17702 consensus_queue.cc:1048] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 13:05:55.331517 17716 consensus_queue.cc:1048] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:55.313460 16366 tablet_copy_service.cc:161] P 363bb2f744eb486f9ad726f08214c98e: Beginning new tablet copy session on tablet b9e1324823f04d8da5a4b3ddbd061c0e from peer 1109f76a0b7b443a84c0327c8707bc63 at {username='slave'} at 127.0.0.1:33486: session id = 1109f76a0b7b443a84c0327c8707bc63-b9e1324823f04d8da5a4b3ddbd061c0e
I20260709 13:05:55.345649 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:05:55.302131 17602 consensus_queue.cc:1048] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:05:55.440899 16206 raft_consensus.cc:2468] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 4.
I20260709 13:05:55.482900 17673 raft_consensus.cc:493] T b9e1324823f04d8da5a4b3ddbd061c0e P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:05:55.483323 17666 raft_consensus.cc:493] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:55.483656 17673 raft_consensus.cc:515] T b9e1324823f04d8da5a4b3ddbd061c0e P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:05:55.484009 17666 raft_consensus.cc:515] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:55.314867 17733 raft_consensus.cc:493] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:05:55.321208 17450 consensus_queue.cc:1048] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.075s
I20260709 13:05:55.322140 17516 raft_consensus.cc:515] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:55.443812 17582 raft_consensus.cc:493] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:55.489013 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 145666us
I20260709 13:05:55.484937 16948 raft_consensus.cc:1275] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:05:55.399928 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 46515.3us
I20260709 13:05:55.481182 16352 raft_consensus.cc:1275] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:55.551947 16351 raft_consensus.cc:1275] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:05:55.542223 17597 raft_consensus.cc:493] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:55.559739 17687 raft_consensus.cc:493] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:05:55.562678 17501 raft_consensus.cc:493] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:55.554524 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 69033.7us
W20260709 13:05:55.591392 16912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:55.494983 17630 consensus_queue.cc:1059] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.069s
I20260709 13:05:55.524910 17582 raft_consensus.cc:515] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:55.600147 17602 raft_consensus.cc:2804] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:55.685878 16278 raft_consensus.cc:1240] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:05:55.527570 17733 raft_consensus.cc:515] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:05:55.712545 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 397555us
I20260709 13:05:55.714998 16248 leader_election.cc:304] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:05:55.701673 17699 log.cc:927] Time spent T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 13:05:55.598650 17597 raft_consensus.cc:515] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:05:55.701530 17738 log.cc:927] Time spent T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.226s	user 0.000s	sys 0.001s
I20260709 13:05:55.760149 16278 raft_consensus.cc:1240] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:05:55.598361 17501 raft_consensus.cc:515] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:55.699615 16366 tablet_copy_source_session.cc:215] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:55.713570 17688 raft_consensus.cc:3055] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:55.772261 17590 leader_election.cc:290] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:05:55.700419 17752 raft_consensus.cc:493] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:05:55.683504 17687 raft_consensus.cc:515] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:55.851483 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:55.852751 16281 raft_consensus.cc:2393] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 3: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
W20260709 13:05:55.853935 17712 log.cc:927] Time spent T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:05:55.820087 17673 leader_election.cc:290] T b9e1324823f04d8da5a4b3ddbd061c0e P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:55.834213 17666 leader_election.cc:290] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:55.823011 17688 raft_consensus.cc:740] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:05:55.925282 17501 leader_election.cc:290] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:05:55.926088 17745 log.cc:927] Time spent T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.240s	user 0.000s	sys 0.001s
I20260709 13:05:55.927090 17754 raft_consensus.cc:493] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:55.936035 17529 raft_consensus.cc:2749] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:55.936197 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:05:55.939270 17505 raft_consensus.cc:493] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:55.940006 17505 raft_consensus.cc:515] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:55.942245 17505 leader_election.cc:290] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:55.951591 17635 raft_consensus.cc:3055] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:55.927644 17754 raft_consensus.cc:515] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:55.976428 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:05:55.971649 17539 consensus_meta.cc:287] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3: Time spent flushing consensus metadata: real 0.783s	user 0.009s	sys 0.003s
I20260709 13:05:55.913024 17752 raft_consensus.cc:515] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:55.977938 17635 raft_consensus.cc:740] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:05:56.008689 17687 leader_election.cc:290] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:55.994028 17539 raft_consensus.cc:2749] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:55.981206 17750 raft_consensus.cc:493] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:05:55.997195 16274 raft_consensus.cc:2468] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 4.
W20260709 13:05:56.024667 17758 log.cc:927] Time spent T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:05:55.999456 17582 leader_election.cc:290] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:05:56.008785 17739 log.cc:927] Time spent T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.285s	user 0.001s	sys 0.001s
I20260709 13:05:56.051934 16277 raft_consensus.cc:1275] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:56.054582 17750 raft_consensus.cc:515] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:56.015317 17688 consensus_queue.cc:260] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:56.064862 17688 raft_consensus.cc:3060] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:56.064728 17635 consensus_queue.cc:260] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:56.066424 17635 raft_consensus.cc:3060] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:56.071035 17752 leader_election.cc:290] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:56.072152 17754 leader_election.cc:290] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:56.072939 17733 leader_election.cc:290] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:56.073675 17750 leader_election.cc:290] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:56.075723 17765 raft_consensus.cc:2749] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:05:56.106571 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:56.107568 16348 raft_consensus.cc:2393] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 2: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:05:56.025243 17597 leader_election.cc:290] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:56.115921 17419 raft_consensus.cc:3055] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:56.116565 17419 raft_consensus.cc:740] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:05:56.117898 17419 consensus_queue.cc:260] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:05:56.115276 17682 consensus_meta.cc:287] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3: Time spent flushing consensus metadata: real 0.922s	user 0.013s	sys 0.000s
W20260709 13:05:56.169734 16912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:56.142084 17682 raft_consensus.cc:2749] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:56.195976 17597 raft_consensus.cc:493] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
W20260709 13:05:56.410812 17618 log.cc:927] Time spent T 6759dbf6a6924fcc870cb52b4a5d7953 P 1109f76a0b7b443a84c0327c8707bc63: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
I20260709 13:05:56.444329 17618 tablet_bootstrap.cc:492] T 6759dbf6a6924fcc870cb52b4a5d7953 P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:05:56.445511 17618 tablet_bootstrap.cc:492] T 6759dbf6a6924fcc870cb52b4a5d7953 P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap complete.
I20260709 13:05:56.446280 17618 ts_tablet_manager.cc:1403] T 6759dbf6a6924fcc870cb52b4a5d7953 P 1109f76a0b7b443a84c0327c8707bc63: Time spent bootstrapping tablet: real 1.315s	user 0.025s	sys 0.007s
I20260709 13:05:56.350992 17752 raft_consensus.cc:493] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:05:56.463583 17508 raft_consensus.cc:493] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.458465 17736 leader_election.cc:290] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:56.463657 17766 raft_consensus.cc:493] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:05:56.483156 17766 raft_consensus.cc:515] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:56.485765 16349 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41832 (request call id 1281) took 1186 ms. Trace:
I20260709 13:05:56.480295 17754 raft_consensus.cc:493] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.407045 17597 raft_consensus.cc:515] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:56.488308 17766 leader_election.cc:290] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:05:56.480477 17652 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.012s	sys 0.029s
I20260709 13:05:56.490795 16349 rpcz_store.cc:276] 0709 13:05:55.299219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:55.299349 (+   130us) service_pool.cc:224] Handling call
0709 13:05:55.317916 (+ 18567us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:55.335252 (+ 17336us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:05:55.335615 (+   363us) log.cc:844] Serialized 14 byte log entry
0709 13:05:55.523408 (+187793us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:55.524555 (+  1147us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:05:55.524612 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:56.485209 (+960597us) spinlock_profiling.cc:243] Waited 4.85 ms on lock 0x7b54003a4654. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f489e01 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6
0709 13:05:56.485322 (+   113us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:56.485595 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21668,"prepare.queue_time_us":213,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":53872,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":37997,"spinlock_wait_cycles":11181696,"thread_start_us":165616,"threads_started":1,"wal-append.queue_time_us":253537}
W20260709 13:05:56.499207 17652 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.600s	user 0.012s	sys 0.029s
I20260709 13:05:56.467517 17752 raft_consensus.cc:515] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:05:56.653674 16912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:56.675925 17766 raft_consensus.cc:493] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:05:56.676710 17766 raft_consensus.cc:515] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:56.679615 17766 leader_election.cc:290] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:56.534302 17516 leader_election.cc:290] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:05:56.621987 16321 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.909s	user 0.025s	sys 0.039s
W20260709 13:05:56.712486 16321 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.004s	user 0.025s	sys 0.039s
I20260709 13:05:56.496724 17508 raft_consensus.cc:515] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:56.567072 17754 raft_consensus.cc:515] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:05:56.715939 17602 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.936s	user 0.054s	sys 0.103s
W20260709 13:05:56.762583 17751 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.000s	sys 0.023s
W20260709 13:05:56.763193 17751 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.835s	user 0.000s	sys 0.023s
I20260709 13:05:56.763769 17754 leader_election.cc:290] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:56.765553 17597 leader_election.cc:290] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:56.766206 17597 raft_consensus.cc:493] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.754908 17652 raft_consensus.cc:493] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:56.763842 17757 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.668s	user 0.016s	sys 0.012s
W20260709 13:05:56.752390 17602 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.977s	user 0.054s	sys 0.103s
I20260709 13:05:56.751794 17766 raft_consensus.cc:493] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
W20260709 13:05:56.774912 17757 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.832s	user 0.016s	sys 0.013s
I20260709 13:05:56.794101 17618 raft_consensus.cc:359] T 6759dbf6a6924fcc870cb52b4a5d7953 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 NON_PARTICIPANT]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:05:56.772375 17688 consensus_meta.cc:287] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f: Time spent flushing consensus metadata: real 0.696s	user 0.009s	sys 0.008s
I20260709 13:05:56.776870 17602 raft_consensus.cc:697] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
W20260709 13:05:56.814798 16913 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.925s	user 0.016s	sys 0.034s
W20260709 13:05:56.815250 16913 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.958s	user 0.016s	sys 0.035s
I20260709 13:05:56.782819 17766 raft_consensus.cc:515] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:56.816251 17652 raft_consensus.cc:515] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:56.773452 17597 raft_consensus.cc:515] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:05:56.826213 17740 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.906s	user 0.009s	sys 0.036s
I20260709 13:05:56.827557 17754 raft_consensus.cc:493] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:05:56.828140 17752 leader_election.cc:290] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:05:56.838711 16351 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41832 (request call id 1286) took 1537 ms. Trace:
W20260709 13:05:56.840279 16322 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.314s	user 0.019s	sys 0.058s
W20260709 13:05:56.837998 17740 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.063s	user 0.010s	sys 0.037s
W20260709 13:05:56.843430 16322 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.317s	user 0.019s	sys 0.059s
W20260709 13:05:56.847512 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 1.34423e+06us
I20260709 13:05:56.842193 16351 rpcz_store.cc:276] 0709 13:05:55.300915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:55.554665 (+253750us) service_pool.cc:224] Handling call
0709 13:05:55.555047 (+   382us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:55.595223 (+ 40176us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:55.595254 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:55.632121 (+ 36867us) log.cc:844] Serialized 26 byte log entry
0709 13:05:56.185590 (+553469us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:05:56.185661 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:56.185759 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:56.838424 (+652665us) raft_consensus.cc:1685] finished
0709 13:05:56.838447 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:56.838634 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":132653,"raft.run_cpu_time_us":73,"raft.run_wall_time_us":72,"thread_start_us":428863,"threads_started":1,"wal-append.queue_time_us":1019379}
I20260709 13:05:56.879767 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:56.845853 17508 leader_election.cc:290] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:05:56.881373 16356 raft_consensus.cc:2468] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 3.
I20260709 13:05:56.843180 17754 raft_consensus.cc:515] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:56.868525 17752 consensus_queue.cc:1048] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
W20260709 13:05:56.891780 17787 log.cc:927] Time spent T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 13:05:56.887491 17784 raft_consensus.cc:493] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.893334 17652 leader_election.cc:290] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:56.894356 17618 raft_consensus.cc:740] T 6759dbf6a6924fcc870cb52b4a5d7953 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Initialized, Role: LEARNER
I20260709 13:05:56.915194 17618 consensus_queue.cc:260] T 6759dbf6a6924fcc870cb52b4a5d7953 P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:05:56.868901 17602 consensus_queue.cc:237] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:56.890223 17790 raft_consensus.cc:493] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
W20260709 13:05:56.918298 16283 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.198s	user 0.003s	sys 0.027s
W20260709 13:05:56.925189 16283 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.214s	user 0.005s	sys 0.027s
W20260709 13:05:56.922351 17786 log.cc:927] Time spent T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.107s	user 0.001s	sys 0.001s
I20260709 13:05:56.928738 16283 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45218 (request call id 1335) took 1396 ms. Trace:
I20260709 13:05:56.929543 16283 rpcz_store.cc:276] 0709 13:05:55.530352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:55.599672 (+ 69320us) service_pool.cc:224] Handling call
0709 13:05:55.680169 (+ 80497us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:55.681501 (+  1332us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:05:55.700430 (+ 18929us) log.cc:844] Serialized 14 byte log entry
0709 13:05:56.926292 (+1225862us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:56.926367 (+    75us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:05:56.926427 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:56.926523 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:56.926719 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13366,"prepare.queue_time_us":18303,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":265658,"raft.run_cpu_time_us":213,"raft.run_wall_time_us":8965,"thread_start_us":1215005,"threads_started":1}
I20260709 13:05:56.924031 17784 raft_consensus.cc:515] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:05:56.924664 17790 raft_consensus.cc:515] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:56.953725 17597 leader_election.cc:290] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:56.950990 17508 raft_consensus.cc:493] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:05:56.957316 17766 leader_election.cc:290] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:56.965090 17792 raft_consensus.cc:493] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.966766 17791 raft_consensus.cc:493] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.978036 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:56.979151 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:05:56.970218 17752 raft_consensus.cc:493] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:05:56.984010 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:56.968360 17508 raft_consensus.cc:515] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:05:56.980647 17789 log.cc:927] Time spent T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
I20260709 13:05:56.974874 17754 leader_election.cc:290] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:56.975639 17597 raft_consensus.cc:493] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:05:56.976214 17793 raft_consensus.cc:493] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:05:56.977754 17795 raft_consensus.cc:493] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:05:56.988004 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:56.990002 17793 raft_consensus.cc:515] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:56.996356 17793 leader_election.cc:290] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:56.979163 17792 raft_consensus.cc:515] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:56.983961 17752 raft_consensus.cc:515] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:57.000871 17752 leader_election.cc:290] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:56.981989 17791 raft_consensus.cc:515] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:56.989548 17754 raft_consensus.cc:493] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:05:57.005060 17793 raft_consensus.cc:493] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:05:57.006301 17508 leader_election.cc:290] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:57.007637 17790 leader_election.cc:290] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:56.992780 17795 raft_consensus.cc:515] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:57.010727 16356 raft_consensus.cc:2468] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 3.
I20260709 13:05:57.012036 17784 leader_election.cc:290] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:56.989380 17597 raft_consensus.cc:515] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:57.010371 17795 leader_election.cc:290] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:05:57.015652 17597 leader_election.cc:290] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:05:57.005903 17793 raft_consensus.cc:515] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:57.017304 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:57.018977 16348 raft_consensus.cc:2468] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 2.
I20260709 13:05:57.020443 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:57.020468 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:57.021428 16356 raft_consensus.cc:2468] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 1.
I20260709 13:05:57.022383 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:57.025897 17792 leader_election.cc:290] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:57.026743 17754 raft_consensus.cc:515] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:57.031134 17754 leader_election.cc:290] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:57.033973 17791 leader_election.cc:290] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:57.035022 17790 raft_consensus.cc:493] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:05:57.035593 17790 raft_consensus.cc:515] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:57.037048 17715 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9e1324823f04d8da5a4b3ddbd061c0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:57.038517 17790 leader_election.cc:290] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:57.039595 17790 raft_consensus.cc:493] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:05:57.040123 17790 raft_consensus.cc:515] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:57.043068 17790 leader_election.cc:290] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:57.048040 16914 leader_election.cc:304] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:05:57.049254 17790 raft_consensus.cc:2804] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:57.049646 16914 leader_election.cc:304] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:05:57.049646 17790 raft_consensus.cc:493] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:57.051268 17790 raft_consensus.cc:3060] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:57.051733 17754 raft_consensus.cc:2804] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:57.052170 17754 raft_consensus.cc:493] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:05:57.052585 17754 raft_consensus.cc:3060] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:57.055541 17783 raft_consensus.cc:493] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:05:57.056181 17783 raft_consensus.cc:515] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:57.057477 17793 leader_election.cc:290] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:57.059408 17783 leader_election.cc:290] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:05:57.060014 17740 raft_consensus.cc:493] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:05:57.060364 17780 raft_consensus.cc:493] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.060633 17740 raft_consensus.cc:515] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:57.061124 17780 raft_consensus.cc:515] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:57.062762 17775 raft_consensus.cc:493] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:05:57.063290 17740 leader_election.cc:290] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:05:57.063968 17740 raft_consensus.cc:493] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:05:57.063577 17775 raft_consensus.cc:515] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:57.064539 17740 raft_consensus.cc:515] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:57.076938 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:57.078061 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:57.085320 16945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:05:57.076378 17793 raft_consensus.cc:493] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:05:57.083549 17435 raft_consensus.cc:493] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:05:57.091003 17450 raft_consensus.cc:493] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:05:57.099850 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:05:57.102161 17651 leader_election.cc:290] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:57.094408 17793 raft_consensus.cc:515] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:57.093695 17597 raft_consensus.cc:493] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.095782 17435 raft_consensus.cc:515] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:57.107718 16948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:05:57.110001 17435 leader_election.cc:290] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:05:57.113791 16173 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.412s	user 0.031s	sys 0.072s
W20260709 13:05:57.114238 16173 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.412s	user 0.031s	sys 0.072s
I20260709 13:05:57.116524 17793 leader_election.cc:290] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:57.117594 17597 raft_consensus.cc:515] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:57.120121 17597 leader_election.cc:290] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:05:57.121802 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 1.49581e+06us
I20260709 13:05:57.127473 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:05:57.107118 17450 raft_consensus.cc:515] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:05:57.131027 16320 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:57.134087 16248 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.365s	user 0.018s	sys 0.075s
I20260709 13:05:57.135519 17688 raft_consensus.cc:493] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.136183 17688 raft_consensus.cc:515] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:57.137262 17780 leader_election.cc:290] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:57.138505 17688 leader_election.cc:290] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:05:57.139148 16322 consensus_peers.cc:597] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e -> Peer 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875): Couldn't send request to peer 1109f76a0b7b443a84c0327c8707bc63. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c7d554054f014c74992a2a66ff6873cd. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:05:57.134478 16248 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.365s	user 0.018s	sys 0.075s
W20260709 13:05:57.140419 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 1.42539e+06us
I20260709 13:05:57.141444 16248 leader_election.cc:304] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:57.143306 16248 leader_election.cc:304] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:57.144994 16248 leader_election.cc:304] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:57.146451 17778 raft_consensus.cc:493] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:05:57.147132 17778 raft_consensus.cc:515] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:57.147953 17780 raft_consensus.cc:2749] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:57.148815 17602 raft_consensus.cc:2749] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:57.136128 17790 raft_consensus.cc:515] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:57.151131 16248 leader_election.cc:304] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:05:57.149312 17450 leader_election.cc:290] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:57.157069 16948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:05:57.157323 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:57.157771 16948 raft_consensus.cc:2468] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 1.
I20260709 13:05:57.149508 17778 leader_election.cc:290] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:05:57.219657 16356 raft_consensus.cc:1240] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:57.163043 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:57.208141 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:05:57.184803 16912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:57.236865 16948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:05:57.237251 16320 leader_election.cc:304] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:57.233721 16355 raft_consensus.cc:2468] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 2.
I20260709 13:05:57.160481 17602 raft_consensus.cc:2804] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:57.159056 17780 raft_consensus.cc:3060] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:57.164530 16351 raft_consensus.cc:2468] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 3.
I20260709 13:05:57.245950 16248 leader_election.cc:304] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:05:57.222101 17790 leader_election.cc:290] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 4 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:57.236552 17516 raft_consensus.cc:493] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:05:57.246994 17776 raft_consensus.cc:493] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.236812 17464 raft_consensus.cc:493] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.244554 17432 raft_consensus.cc:2804] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:57.238682 17529 raft_consensus.cc:493] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.215622 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:57.223760 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:05:57.218916 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:57.214484 17783 raft_consensus.cc:493] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.234242 17793 raft_consensus.cc:493] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.216456 17779 raft_consensus.cc:493] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:05:57.237120 17791 raft_consensus.cc:493] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.153110 17754 raft_consensus.cc:515] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:57.274242 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:57.274323 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:57.244879 17751 raft_consensus.cc:493] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:05:57.294524 16356 raft_consensus.cc:2468] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 1.
I20260709 13:05:57.294975 17751 raft_consensus.cc:515] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:57.295161 17804 consensus_queue.cc:1048] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:57.295588 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:57.295812 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:57.296402 16356 raft_consensus.cc:2393] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 3: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:05:57.296998 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:05:57.297348 17751 leader_election.cc:290] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:57.297266 17804 consensus_queue.cc:1048] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:57.297778 16351 raft_consensus.cc:3060] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:05:57.266278 17597 raft_consensus.cc:493] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.266634 17778 raft_consensus.cc:493] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:57.280735 16322 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.180.66:45823 timed out after 1.940s (SENT) [suppressed 3 similar messages]
I20260709 13:05:57.273579 17651 raft_consensus.cc:493] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.293171 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:57.273808 17688 raft_consensus.cc:493] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:05:57.271075 17602 raft_consensus.cc:493] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:05:57.286283 17781 raft_consensus.cc:493] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:05:57.286448 17757 raft_consensus.cc:493] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:05:57.275029 17516 raft_consensus.cc:515] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:57.298000 17751 raft_consensus.cc:493] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:05:57.318771 17783 raft_consensus.cc:515] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:57.321969 17754 leader_election.cc:290] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:57.323082 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:57.287262 17774 raft_consensus.cc:493] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.324204 16947 raft_consensus.cc:2393] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 2: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
I20260709 13:05:57.292989 16348 raft_consensus.cc:2468] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 3.
W20260709 13:05:57.327340 16913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:57.290273 17432 raft_consensus.cc:697] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 4 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:05:57.286032 17776 raft_consensus.cc:515] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:57.352556 17688 raft_consensus.cc:515] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:57.351843 17778 raft_consensus.cc:515] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:57.352911 17602 raft_consensus.cc:3060] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:57.393869 17783 leader_election.cc:290] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:05:57.356098 17805 log.cc:927] Time spent T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:05:57.333756 17793 raft_consensus.cc:515] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:57.298664 17779 raft_consensus.cc:515] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:57.396777 17793 leader_election.cc:290] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:57.352694 17651 raft_consensus.cc:515] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:57.373164 17781 raft_consensus.cc:515] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:57.400475 17781 leader_election.cc:290] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:57.310184 17791 raft_consensus.cc:515] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:57.402362 16357 raft_consensus.cc:2393] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 3: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:05:57.351575 17597 raft_consensus.cc:515] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:57.376477 16349 raft_consensus.cc:2393] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 3: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:05:57.370154 17516 leader_election.cc:290] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:57.287516 17529 raft_consensus.cc:515] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:57.377974 17774 raft_consensus.cc:515] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:57.394570 17783 raft_consensus.cc:2804] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:57.400664 17688 leader_election.cc:290] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:57.375069 17751 raft_consensus.cc:515] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:57.287990 17464 raft_consensus.cc:515] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:57.410235 17529 leader_election.cc:290] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:05:57.407076 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 126395us
I20260709 13:05:57.408702 17432 consensus_queue.cc:237] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } }
I20260709 13:05:57.409854 17774 leader_election.cc:290] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:05:57.404901 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 115470us
W20260709 13:05:57.406905 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 161025us
I20260709 13:05:57.377936 17757 raft_consensus.cc:515] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:57.407845 17779 leader_election.cc:290] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:57.427848 17757 leader_election.cc:290] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:57.428134 17791 leader_election.cc:290] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:05:57.428771 17776 leader_election.cc:290] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:05:57.430276 17780 raft_consensus.cc:2749] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:57.430907 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:57.431645 16352 raft_consensus.cc:2468] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 3.
I20260709 13:05:57.410794 17783 raft_consensus.cc:493] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:05:57.422497 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:05:57.440675 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:05:57.441345 16279 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 2.154s	user 0.051s	sys 0.056s
I20260709 13:05:57.425830 17715 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:35122 (request call id 295) took 2817 ms. Trace:
W20260709 13:05:57.441869 16279 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.155s	user 0.051s	sys 0.056s
I20260709 13:05:57.447011 16914 leader_election.cc:304] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:05:57.432775 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c15d8e9be8414c84912ab77b66bfb1" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:57.437003 17783 raft_consensus.cc:3060] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:57.442101 17715 rpcz_store.cc:276] 0709 13:05:54.605410 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:54.614771 (+  9361us) service_pool.cc:224] Handling call
0709 13:05:54.869842 (+255071us) ts_tablet_manager.cc:934] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63: Initiating tablet copy from peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
0709 13:05:57.035508 (+2165666us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:05:57.081753 (+ 46245us) tablet_metadata.cc:665] Metadata flushed
0709 13:05:57.085832 (+  4079us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:05:57.394130 (+308298us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:05:57.394491 (+   361us) tablet_replica.cc:206] Creating consensus instance
0709 13:05:57.418043 (+ 23552us) ts_tablet_manager.cc:989] Replica registered.
0709 13:05:57.420167 (+  2124us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":25058,"tablet-copy.queue_time_us":242623,"thread_start_us":281197,"threads_started":2}
I20260709 13:05:57.456908 17715 tablet_copy_client.cc:806] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:57.457062 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:57.457541 17715 tablet_copy_client.cc:670] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:57.442541 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:57.459785 17801 raft_consensus.cc:2804] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:57.472532 17801 raft_consensus.cc:493] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:57.472945 17801 raft_consensus.cc:3060] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:05:57.481945 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 62198.8us
I20260709 13:05:57.483348 16173 leader_election.cc:304] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:57.454641 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:05:57.493822 17757 raft_consensus.cc:2804] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:57.508736 17597 leader_election.cc:290] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:57.513024 17604 raft_consensus.cc:3060] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:57.494366 17757 raft_consensus.cc:493] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:05:57.513854 17757 raft_consensus.cc:3060] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:56.466427 15057 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:57.519387 17778 leader_election.cc:290] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:05:57.521962 17751 leader_election.cc:290] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:05:57.523947 16351 raft_consensus.cc:2468] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 4.
I20260709 13:05:57.525014 17602 raft_consensus.cc:515] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:05:57.528264 16276 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.795s	user 0.011s	sys 0.007s
W20260709 13:05:57.528712 16276 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.818s	user 0.011s	sys 0.007s
I20260709 13:05:57.506994 16279 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45210 (request call id 1228) took 2295 ms. Trace:
I20260709 13:05:57.541016 17740 leader_election.cc:290] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:05:57.543483 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 122418us
I20260709 13:05:57.535974 16279 rpcz_store.cc:276] 0709 13:05:55.203802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:55.205272 (+  1470us) service_pool.cc:224] Handling call
0709 13:05:55.217379 (+ 12107us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:55.235890 (+ 18511us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:05:57.442310 (+2206420us) log.cc:844] Serialized 14 byte log entry
0709 13:05:57.493254 (+ 50944us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:57.499288 (+  6034us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:05:57.499354 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:57.499444 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:57.499604 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":838,"prepare.queue_time_us":255576,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":102,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":121,"thread_start_us":2205839,"threads_started":2}
I20260709 13:05:57.544458 16248 leader_election.cc:304] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:05:57.552789 16248 leader_election.cc:304] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:05:57.556974 17751 raft_consensus.cc:2749] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:57.554167 17740 raft_consensus.cc:2804] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:57.558768 17740 raft_consensus.cc:493] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:05:57.559201 17740 raft_consensus.cc:3060] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:57.564476 16945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:05:57.565182 16945 raft_consensus.cc:2468] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 1.
I20260709 13:05:57.565747 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:05:57.566433 16949 raft_consensus.cc:2468] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 1.
I20260709 13:05:57.568537 17757 raft_consensus.cc:515] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:57.555819 17432 raft_consensus.cc:493] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.571698 17432 raft_consensus.cc:515] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:57.574095 17432 leader_election.cc:290] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:57.576964 16248 leader_election.cc:304] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:05:57.579352 17602 leader_election.cc:290] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 election: Requested vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:05:57.580523 17783 raft_consensus.cc:515] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:57.581110 17757 leader_election.cc:290] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:57.583717 17751 raft_consensus.cc:2804] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:57.585278 17751 raft_consensus.cc:493] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:57.585703 17751 raft_consensus.cc:3060] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:57.599293 17783 leader_election.cc:290] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:05:57.602790 16174 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.825s	user 0.020s	sys 0.023s
W20260709 13:05:57.603242 16174 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.826s	user 0.020s	sys 0.023s
I20260709 13:05:57.603120 17740 raft_consensus.cc:515] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:57.605728 17740 leader_election.cc:290] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:57.605970 17528 raft_consensus.cc:493] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.606662 17528 raft_consensus.cc:515] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:57.608229 17757 raft_consensus.cc:493] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:05:57.608971 17528 leader_election.cc:290] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:57.609090 17757 raft_consensus.cc:515] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:57.605733 17816 raft_consensus.cc:493] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.615209 17816 raft_consensus.cc:515] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:57.616827 17757 leader_election.cc:290] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:57.617569 17816 leader_election.cc:290] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:05:57.584055 16248 leader_election.cc:304] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:05:57.623154 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:05:57.656050 17740 raft_consensus.cc:2804] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:57.604125 17801 raft_consensus.cc:515] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:57.660857 17827 raft_consensus.cc:493] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:57.661375 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 157853us
I20260709 13:05:57.661592 17827 raft_consensus.cc:515] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:57.662881 16173 leader_election.cc:304] T b9e1324823f04d8da5a4b3ddbd061c0e P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:57.666518 17528 raft_consensus.cc:493] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:05:57.667204 16173 leader_election.cc:304] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:57.667145 17528 raft_consensus.cc:515] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:57.668423 16173 leader_election.cc:304] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:57.669436 17757 raft_consensus.cc:2804] T b9e1324823f04d8da5a4b3ddbd061c0e P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:57.668421 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:57.670069 17757 raft_consensus.cc:493] T b9e1324823f04d8da5a4b3ddbd061c0e P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:05:57.670517 17757 raft_consensus.cc:3060] T b9e1324823f04d8da5a4b3ddbd061c0e P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:57.670647 16204 raft_consensus.cc:2410] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:05:57.671798 17824 raft_consensus.cc:2804] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:57.672297 17824 raft_consensus.cc:493] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:57.672760 17824 raft_consensus.cc:3060] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:57.672364 17751 raft_consensus.cc:515] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:57.676378 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:57.677089 16206 raft_consensus.cc:2468] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 3.
I20260709 13:05:57.658526 17740 raft_consensus.cc:493] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:05:57.680087 17740 raft_consensus.cc:3060] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:57.682436 17827 leader_election.cc:290] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:05:57.683238 16276 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45218 (request call id 1338) took 2151 ms. Trace:
I20260709 13:05:57.670818 17808 raft_consensus.cc:2804] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:57.692931 17808 raft_consensus.cc:493] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:57.693364 17808 raft_consensus.cc:3060] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:57.669574 17783 raft_consensus.cc:493] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.693477 17801 leader_election.cc:290] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 4 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:57.679260 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:57.704926 17757 raft_consensus.cc:515] T b9e1324823f04d8da5a4b3ddbd061c0e P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:05:57.706318 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:57.706768 17783 raft_consensus.cc:515] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } }
I20260709 13:05:57.707343 17757 leader_election.cc:290] T b9e1324823f04d8da5a4b3ddbd061c0e P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 2 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:57.708856 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:05:57.709273 17783 leader_election.cc:290] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:57.710271 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f022e2e63ae4461d834e476ff2666991" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:57.708374 16276 rpcz_store.cc:276] 0709 13:05:55.531700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:55.700074 (+168374us) service_pool.cc:224] Handling call
0709 13:05:55.700452 (+   378us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:57.540667 (+1840215us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:57.540718 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:57.541297 (+   579us) log.cc:844] Serialized 26 byte log entry
0709 13:05:57.660683 (+119386us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:05:57.660725 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:57.664177 (+  3452us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:57.682957 (+ 18780us) raft_consensus.cc:1685] finished
0709 13:05:57.682980 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:57.683155 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10109,"raft.queue_time_us":293511,"raft.run_cpu_time_us":235,"raft.run_wall_time_us":9756,"thread_start_us":1936928,"threads_started":2,"wal-append.queue_time_us":138673}
I20260709 13:05:57.722734 17464 leader_election.cc:290] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:57.710754 17808 raft_consensus.cc:515] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:57.731576 17808 leader_election.cc:290] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:57.722047 17824 raft_consensus.cc:515] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:05:57.726771 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 58405.2us
I20260709 13:05:57.727604 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:57.726820 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:57.733716 17824 leader_election.cc:290] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:57.744517 17824 raft_consensus.cc:493] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.745203 17824 raft_consensus.cc:515] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:57.747627 17824 leader_election.cc:290] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:57.755823 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:57.774878 17783 raft_consensus.cc:493] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:05:57.775632 17809 raft_consensus.cc:493] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:05:57.776808 17810 raft_consensus.cc:493] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:05:57.776397 17779 raft_consensus.cc:493] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:05:57.775663 17783 raft_consensus.cc:515] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:57.777381 17810 raft_consensus.cc:515] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:57.780689 17751 leader_election.cc:290] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:05:57.777496 17779 raft_consensus.cc:515] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:57.778991 17809 raft_consensus.cc:515] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:57.782428 17751 raft_consensus.cc:493] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:05:57.785981 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:57.787268 17783 leader_election.cc:290] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:57.788345 17783 raft_consensus.cc:493] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.788607 17809 leader_election.cc:290] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:05:57.789191 17809 raft_consensus.cc:493] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:05:57.788870 17783 raft_consensus.cc:515] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:57.790464 17809 raft_consensus.cc:515] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:57.792614 17751 raft_consensus.cc:515] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:57.784857 17779 leader_election.cc:290] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:05:57.798967 17810 leader_election.cc:290] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:05:57.799630 17810 raft_consensus.cc:493] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:05:57.800158 17810 raft_consensus.cc:515] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:57.802033 17810 leader_election.cc:290] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:05:57.796868 17779 raft_consensus.cc:493] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:05:58.141237 17809 leader_election.cc:290] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:58.141378 17779 raft_consensus.cc:515] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:57.803586 17751 leader_election.cc:290] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:05:58.143635 17751 raft_consensus.cc:493] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.902354 17832 raft_consensus.cc:493] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:05:57.802786 17810 raft_consensus.cc:493] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:05:58.142004 17809 raft_consensus.cc:493] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:05:58.205438 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:05:58.206248 16276 raft_consensus.cc:3060] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:58.144207 17751 raft_consensus.cc:515] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:58.143910 17779 leader_election.cc:290] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:05:58.145587 17783 leader_election.cc:290] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:58.145324 17810 raft_consensus.cc:515] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:05:58.227383 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 86512.3us
I20260709 13:05:58.228832 16276 raft_consensus.cc:2468] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 4.
W20260709 13:05:58.219542 16282 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.225s	user 0.013s	sys 0.048s
I20260709 13:05:58.144771 17832 raft_consensus.cc:515] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:58.203596 17809 raft_consensus.cc:515] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:58.235137 17651 leader_election.cc:290] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:57.669436 17528 leader_election.cc:290] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:58.216285 17833 raft_consensus.cc:493] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:05:58.238178 16278 raft_consensus.cc:1275] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:58.241492 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:58.242491 16281 raft_consensus.cc:2468] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 1.
I20260709 13:05:58.243989 17810 leader_election.cc:290] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:58.244635 17810 raft_consensus.cc:493] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:05:58.245162 17810 raft_consensus.cc:515] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:58.245609 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:58.229210 17783 raft_consensus.cc:493] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
W20260709 13:05:58.239018 16282 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.252s	user 0.014s	sys 0.048s
I20260709 13:05:58.256428 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:58.242400 17809 leader_election.cc:290] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:05:58.256173 16246 connection.cc:256] RPC call timeout handler was delayed by -1.4586432680000598s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16920000000000002s for a response
I20260709 13:05:58.273821 17779 raft_consensus.cc:493] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:05:58.273835 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:58.274386 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:58.274847 16207 raft_consensus.cc:2468] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 3.
I20260709 13:05:58.274741 17779 raft_consensus.cc:515] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:58.275200 16204 raft_consensus.cc:2468] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 2.
I20260709 13:05:58.275949 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:58.276276 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:58.276635 16207 raft_consensus.cc:2468] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 1.
I20260709 13:05:58.276986 16204 raft_consensus.cc:2468] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 2.
I20260709 13:05:58.277848 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c15d8e9be8414c84912ab77b66bfb1" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:58.277982 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:58.274000 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:58.278668 16207 raft_consensus.cc:2468] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 3.
I20260709 13:05:58.274438 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:58.281061 16199 raft_consensus.cc:2368] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 3. Current term is 4.
I20260709 13:05:58.281046 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:05:58.282366 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:58.282738 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:58.282925 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:58.283257 16199 raft_consensus.cc:2393] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 4: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:05:58.283552 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:58.284157 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:05:58.284600 16205 raft_consensus.cc:2468] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 3.
I20260709 13:05:58.285372 16282 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45218 (request call id 1329) took 3085 ms. Trace:
I20260709 13:05:58.285518 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:58.284255 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:58.265847 17809 raft_consensus.cc:493] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:05:58.287107 16207 raft_consensus.cc:2468] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 2.
I20260709 13:05:58.287294 17809 raft_consensus.cc:515] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:58.290979 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:58.291867 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bc3c8ff9b84838a2664335d7e1582b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:58.292173 16274 raft_consensus.cc:2410] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:05:58.292655 16275 raft_consensus.cc:2468] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 3.
I20260709 13:05:58.284355 17810 leader_election.cc:290] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:58.293392 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:58.293536 16204 raft_consensus.cc:2468] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 3.
I20260709 13:05:58.293576 17810 raft_consensus.cc:493] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:05:58.293025 17618 ts_tablet_manager.cc:1434] T 6759dbf6a6924fcc870cb52b4a5d7953 P 1109f76a0b7b443a84c0327c8707bc63: Time spent starting tablet: real 1.841s	user 0.024s	sys 0.026s
I20260709 13:05:58.294487 17810 raft_consensus.cc:515] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:05:58.294939 17618 ts_tablet_manager.cc:1467] T 6759dbf6a6924fcc870cb52b4a5d7953 P 1109f76a0b7b443a84c0327c8707bc63: Tablet startup took 1848ms
I20260709 13:05:58.293680 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:58.294178 16274 raft_consensus.cc:2468] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 3.
I20260709 13:05:58.295768 16275 raft_consensus.cc:2468] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 2.
I20260709 13:05:58.296572 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:58.322192 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:58.323467 16276 raft_consensus.cc:2410] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:05:58.250411 17833 raft_consensus.cc:515] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:58.281095 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:05:58.256852 17783 raft_consensus.cc:515] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:58.331059 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f022e2e63ae4461d834e476ff2666991" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:05:58.332226 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 63511.3us
I20260709 13:05:58.330065 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:58.333962 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:58.334687 16204 raft_consensus.cc:2393] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 2: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:05:58.335121 17751 leader_election.cc:290] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:05:58.335457 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:58.336440 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:58.337497 16276 raft_consensus.cc:2393] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 3: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:05:58.323038 17810 leader_election.cc:290] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:58.345247 16281 raft_consensus.cc:2468] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 1.
W20260709 13:05:58.295421 17618 ts_tablet_manager.cc:1469] T 6759dbf6a6924fcc870cb52b4a5d7953 P 1109f76a0b7b443a84c0327c8707bc63: Trace:
0709 13:05:52.349863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:52.351496 (+  1633us) service_pool.cc:224] Handling call
0709 13:05:52.571283 (+219787us) ts_tablet_manager.cc:934] T 6759dbf6a6924fcc870cb52b4a5d7953 P 1109f76a0b7b443a84c0327c8707bc63: Initiating tablet copy from peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
0709 13:05:53.351246 (+779963us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:05:53.522276 (+171030us) tablet_metadata.cc:665] Metadata flushed
0709 13:05:53.522411 (+   135us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:05:53.592483 (+ 70072us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:05:53.592803 (+   320us) tablet_replica.cc:206] Creating consensus instance
0709 13:05:53.593130 (+   327us) ts_tablet_manager.cc:989] Replica registered.
0709 13:05:53.593198 (+    68us) inbound_call.cc:177] Queueing success response
0709 13:05:55.130665 (+1537467us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:05:56.451823 (+1321158us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:05:56.764752 (+312929us) tablet_replica.cc:261] Starting instrumentation
0709 13:05:56.765562 (+   810us) tablet_replica.cc:280] Starting consensus
0709 13:05:57.359196 (+593634us) spinlock_profiling.cc:243] Waited 1.1 ms on lock 0x7b18003959e0. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f3625264de1 00007f36252715b1 00007f361c39c522 00007f361c39e7c1 00007f361c39e779 00007f361c39e709 00007f361c39e6d1 00007f361c39d9cd 000000000038f354 000000000038f199 00007f361c37f83a
0709 13:05:58.287407 (+928211us) spinlock_profiling.cc:243] Waited 1.83 ms on lock 0x7b18003959e0. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f3625264de1 00007f36252715b1 00007f361f0314bc 00007f361c37f48b 00007f36251d9ab9 00007f361c39b69b 00007f361c39993f 00007f361c399455 00007f361f481060 00007f361f47ed71 00007f3622e7bb2e
Metrics: {"dns_us":107880,"raft.queue_time_us":57370,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":3553,"spinlock_wait_cycles":6724864,"tablet-copy.queue_time_us":59714,"tablet-download-pool.queue_time_us":159,"tablet-download-pool.run_cpu_time_us":1602,"tablet-download-pool.run_wall_time_us":773181,"thread_start_us":99302,"threads_started":3}
I20260709 13:05:58.344988 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:58.285810 16282 rpcz_store.cc:276] 0709 13:05:55.199567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:55.200056 (+   489us) service_pool.cc:224] Handling call
0709 13:05:55.233948 (+ 33892us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:55.251753 (+ 17805us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:05:55.771152 (+519399us) log.cc:844] Serialized 14 byte log entry
0709 13:05:58.266900 (+2495748us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:58.273589 (+  6689us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:05:58.273656 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:58.278959 (+  5303us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:58.285312 (+  6353us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":52467,"prepare.queue_time_us":343151,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":42,"thread_start_us":2666975,"threads_started":2,"wal-append.queue_time_us":955919,"wal-append.run_cpu_time_us":2840,"wal-append.run_wall_time_us":1145277}
I20260709 13:05:58.326901 17809 leader_election.cc:290] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:05:58.346140 16246 leader_election.cc:304] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:58.328429 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:58.348456 16912 leader_election.cc:304] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:58.348887 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:58.349479 16205 raft_consensus.cc:2468] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 1.
I20260709 13:05:58.350374 17833 leader_election.cc:290] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:58.351007 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:05:58.352967 16246 leader_election.cc:304] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 363bb2f744eb486f9ad726f08214c98e
I20260709 13:05:58.355677 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:58.357040 16276 raft_consensus.cc:2393] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 2: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:05:58.338253 16274 raft_consensus.cc:2468] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 3.
I20260709 13:05:58.351687 17832 leader_election.cc:290] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:05:58.362001 16246 leader_election.cc:304] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 363bb2f744eb486f9ad726f08214c98e
I20260709 13:05:58.353689 17809 raft_consensus.cc:2749] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:05:58.363365 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:58.365149 16246 leader_election.cc:304] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:58.365330 16276 raft_consensus.cc:2468] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 2.
I20260709 13:05:58.360410 17833 raft_consensus.cc:2804] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:58.370442 17833 raft_consensus.cc:493] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:05:58.370993 17833 raft_consensus.cc:3060] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:58.372845 17838 consensus_queue.cc:1059] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:58.357128 16204 raft_consensus.cc:2468] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 3.
I20260709 13:05:58.367619 17837 consensus_queue.cc:1059] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:05:58.360718 16202 raft_consensus.cc:3060] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:58.366973 16275 raft_consensus.cc:2393] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 4: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:05:58.376436 16246 leader_election.cc:304] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:58.377226 17809 raft_consensus.cc:2804] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:58.380024 17809 raft_consensus.cc:493] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:05:58.380476 17809 raft_consensus.cc:3060] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:58.368191 17835 raft_consensus.cc:2804] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:58.381837 17835 raft_consensus.cc:493] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:58.382176 17835 raft_consensus.cc:3060] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:58.380055 17837 raft_consensus.cc:3055] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:58.383108 17837 raft_consensus.cc:740] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:05:58.383963 17837 consensus_queue.cc:260] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:58.385494 17837 raft_consensus.cc:3060] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:58.386898 17783 leader_election.cc:290] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:58.364995 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:58.390750 17835 raft_consensus.cc:515] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:58.391374 16282 raft_consensus.cc:2468] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 2.
I20260709 13:05:58.393177 17835 leader_election.cc:290] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:58.392978 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:05:58.393858 16282 raft_consensus.cc:2376] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 4. Re-sending same reply.
W20260709 13:05:58.394448 16942 consensus_meta.cc:287] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63: Time spent flushing consensus metadata: real 0.826s	user 0.013s	sys 0.005s
I20260709 13:05:58.396387 16246 leader_election.cc:304] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:58.394872 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:57.660857 17590 raft_consensus.cc:493] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:05:58.400936 16282 raft_consensus.cc:1240] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:58.395004 16942 raft_consensus.cc:2468] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 3.
I20260709 13:05:58.402905 17783 raft_consensus.cc:2804] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:58.403438 17783 raft_consensus.cc:493] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:05:58.403880 17783 raft_consensus.cc:3060] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:05:58.405162 16942 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35106 (request call id 454) took 3219 ms (client timeout 2035 ms). Trace:
I20260709 13:05:58.376708 17840 raft_consensus.cc:2749] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:58.406301 17797 raft_consensus.cc:493] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:58.408737 17797 raft_consensus.cc:515] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:58.409185 17810 raft_consensus.cc:2804] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:58.409646 17810 raft_consensus.cc:493] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:58.410063 17810 raft_consensus.cc:3060] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:58.415848 16202 raft_consensus.cc:2468] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 4.
I20260709 13:05:58.417554 17797 leader_election.cc:290] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:58.419503 16277 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45218 (request call id 1331) took 3219 ms. Trace:
I20260709 13:05:58.419924 16277 rpcz_store.cc:276] 0709 13:05:55.200513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:55.200646 (+   133us) service_pool.cc:224] Handling call
0709 13:05:55.218844 (+ 18198us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:56.052567 (+833723us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:58.419237 (+2366670us) spinlock_profiling.cc:243] Waited 832 ms on lock 0x7b54000767d4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f489e01 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6
0709 13:05:58.419439 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1914509696}
I20260709 13:05:58.423907 17810 raft_consensus.cc:515] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:58.401065 17590 raft_consensus.cc:515] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:58.426949 17810 leader_election.cc:290] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:58.428236 16246 leader_election.cc:400] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 pre-election: Vote denied by peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073) with higher term. Message: Invalid argument: T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 3. Current term is 4.
I20260709 13:05:58.428598 16246 leader_election.cc:403] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:05:58.430011 17810 raft_consensus.cc:3060] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Advancing to term 4
W20260709 13:05:58.405628 16942 rpcz_store.cc:269] 0709 13:05:55.185687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:55.190170 (+  4483us) service_pool.cc:224] Handling call
0709 13:05:58.404897 (+3214727us) spinlock_profiling.cc:243] Waited 2.3 s on lock 0x7b54002b5054. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:05:58.405039 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5282324864}
I20260709 13:05:58.435060 16246 leader_election.cc:304] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 363bb2f744eb486f9ad726f08214c98e
I20260709 13:05:58.436852 17835 raft_consensus.cc:2804] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:58.437250 17835 raft_consensus.cc:493] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:05:58.437614 17835 raft_consensus.cc:3060] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:58.438179 17701 raft_consensus.cc:493] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:05:58.453121 16246 leader_election.cc:304] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:58.456094 16246 leader_election.cc:304] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:58.457278 17832 raft_consensus.cc:2804] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:58.457779 17832 raft_consensus.cc:493] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:05:58.458249 17832 raft_consensus.cc:3060] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:58.441152 17783 raft_consensus.cc:515] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:58.445309 17835 raft_consensus.cc:515] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:58.448787 17809 raft_consensus.cc:515] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:05:58.451304 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 95952.6us
I20260709 13:05:58.421911 17833 raft_consensus.cc:515] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:58.462275 17516 raft_consensus.cc:2804] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:58.464143 17516 raft_consensus.cc:493] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:05:58.464598 17516 raft_consensus.cc:3060] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:58.465027 17809 leader_election.cc:290] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:58.466465 16246 leader_election.cc:304] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:58.467408 17809 raft_consensus.cc:2804] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:58.467830 17809 raft_consensus.cc:493] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:05:58.468190 17809 raft_consensus.cc:3060] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:58.460018 17701 raft_consensus.cc:515] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:58.474380 17784 raft_consensus.cc:493] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:05:58.475044 17784 raft_consensus.cc:515] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:58.475821 16246 leader_election.cc:304] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:58.477209 17784 leader_election.cc:290] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:05:58.479877 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:58.480077 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:58.480800 16282 raft_consensus.cc:2393] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 2: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:05:58.480895 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:58.481878 16275 raft_consensus.cc:2393] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 3: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:05:58.481813 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:58.482646 16274 raft_consensus.cc:2468] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 3.
I20260709 13:05:58.477584 17809 raft_consensus.cc:515] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:05:58.484685 16171 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.782s	user 0.050s	sys 0.038s
I20260709 13:05:58.484865 17842 raft_consensus.cc:493] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:58.485081 16171 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.783s	user 0.050s	sys 0.038s
I20260709 13:05:58.485363 16275 raft_consensus.cc:1275] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:58.478048 17832 raft_consensus.cc:515] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:05:58.495239 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 136848us
I20260709 13:05:58.485481 17842 raft_consensus.cc:515] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:58.499023 16912 leader_election.cc:304] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:58.493800 17701 leader_election.cc:290] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:05:58.469043 17810 raft_consensus.cc:2749] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073) with higher term. Message: Invalid argument: T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 3. Current term is 4.
W20260709 13:05:58.505797 17740 consensus_meta.cc:287] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3: Time spent flushing consensus metadata: real 0.825s	user 0.017s	sys 0.000s
W20260709 13:05:58.506981 16320 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:58.529917 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:58.530905 16275 raft_consensus.cc:2393] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 3: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:05:58.508683 17516 raft_consensus.cc:515] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:58.510113 16941 raft_consensus.cc:2393] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 4: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
I20260709 13:05:58.510669 17833 leader_election.cc:290] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:58.512135 17835 leader_election.cc:290] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:58.512558 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:58.513383 17842 leader_election.cc:290] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:58.515483 17809 leader_election.cc:290] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:58.518375 17783 leader_election.cc:290] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:58.519799 17832 leader_election.cc:290] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:58.539086 16200 raft_consensus.cc:2376] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 4. Re-sending same reply.
I20260709 13:05:58.539974 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:58.540654 16276 raft_consensus.cc:2468] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 1.
I20260709 13:05:58.541186 17775 leader_election.cc:290] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:05:58.525305 17780 raft_consensus.cc:2804] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:58.541939 17780 raft_consensus.cc:493] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:05:58.542402 17780 raft_consensus.cc:3060] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:58.543617 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:58.544349 16276 raft_consensus.cc:2468] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 3.
I20260709 13:05:58.546429 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:58.526644 17781 raft_consensus.cc:493] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:05:58.548499 17516 leader_election.cc:290] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:58.548676 17781 raft_consensus.cc:515] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:58.549865 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:05:58.528455 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:58.552098 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 53168.9us
I20260709 13:05:58.524880 16279 raft_consensus.cc:1240] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:58.552481 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:58.552409 16277 raft_consensus.cc:2468] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 4.
I20260709 13:05:58.549642 17740 raft_consensus.cc:515] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:58.555935 16275 raft_consensus.cc:1240] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:58.555778 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:05:58.551708 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:05:58.556874 16942 raft_consensus.cc:3060] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:58.557596 16282 raft_consensus.cc:2393] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 3: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:05:58.558145 17740 leader_election.cc:290] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:05:58.559544 17837 raft_consensus.cc:493] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:58.560099 17837 raft_consensus.cc:515] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } }
I20260709 13:05:58.554960 16274 raft_consensus.cc:2468] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 3.
I20260709 13:05:58.555060 17501 raft_consensus.cc:2804] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:58.564706 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:05:58.565372 16949 raft_consensus.cc:2468] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 1.
I20260709 13:05:58.568385 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:58.569047 16276 raft_consensus.cc:2468] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 3.
I20260709 13:05:58.563082 17501 raft_consensus.cc:697] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 LEADER]: Becoming Leader. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:05:58.573928 17501 consensus_queue.cc:237] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:05:58.575941 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:58.571884 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:05:58.579918 17781 leader_election.cc:290] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:58.582155 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:58.583889 16274 raft_consensus.cc:2468] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 2.
I20260709 13:05:58.592316 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:05:58.593070 16949 raft_consensus.cc:2468] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 1.
I20260709 13:05:58.593922 17837 leader_election.cc:290] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:58.571532 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:58.594573 16208 raft_consensus.cc:1275] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 13:05:58.594942 16208 pending_rounds.cc:85] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f: Aborting all ops after (but not including) 4
I20260709 13:05:58.595175 16208 pending_rounds.cc:107] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 13:05:58.595504 16208 raft_consensus.cc:2889] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:58.603773 17841 raft_consensus.cc:493] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:05:58.604569 17845 raft_consensus.cc:493] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:05:58.605041 17841 raft_consensus.cc:515] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:58.605423 17845 raft_consensus.cc:515] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:58.608418 17770 raft_consensus.cc:493] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:05:58.609014 17841 leader_election.cc:290] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:58.609145 17770 raft_consensus.cc:515] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:58.611728 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:05:58.612406 16276 raft_consensus.cc:3060] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:58.613296 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:05:58.616170 16945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:05:58.616575 16948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:05:58.616766 16941 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35122 (request call id 316) took 1179 ms. Trace:
I20260709 13:05:58.616905 16945 raft_consensus.cc:2468] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 1.
I20260709 13:05:58.617072 16248 leader_election.cc:304] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:05:58.617218 16948 raft_consensus.cc:2468] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 1.
I20260709 13:05:58.612916 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c15d8e9be8414c84912ab77b66bfb1" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:58.618710 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f022e2e63ae4461d834e476ff2666991" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:05:58.619031 16279 raft_consensus.cc:2393] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 4: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:05:58.618934 16248 leader_election.cc:304] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:58.619691 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:58.617295 16941 rpcz_store.cc:276] 0709 13:05:57.437680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:57.438902 (+  1222us) service_pool.cc:224] Handling call
0709 13:05:58.616496 (+1177594us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b54002b43d4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:05:58.616661 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2325007232}
I20260709 13:05:58.622366 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:58.623345 17751 raft_consensus.cc:2804] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:58.624614 16248 leader_election.cc:304] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:05:58.624756 17751 raft_consensus.cc:493] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:05:58.624835 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:58.625440 17751 raft_consensus.cc:3060] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:58.625746 16279 raft_consensus.cc:2393] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 3: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:05:58.626495 17845 leader_election.cc:290] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:58.625514 17740 raft_consensus.cc:2804] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:58.627336 17740 raft_consensus.cc:493] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:05:58.627144 17770 leader_election.cc:290] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:58.627912 17740 raft_consensus.cc:3060] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:58.627122 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:58.629016 16279 raft_consensus.cc:2468] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 4.
I20260709 13:05:58.629456 17810 raft_consensus.cc:2804] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:58.629945 17810 raft_consensus.cc:493] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:05:58.629982 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:05:58.630632 17810 raft_consensus.cc:3060] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:58.631031 16274 raft_consensus.cc:2393] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 2: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:05:58.631183 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:58.637800 16293 tablet_copy_service.cc:342] P 0aea40d6e4374085a2e38a70a71f63e3: Request end of tablet copy session 1109f76a0b7b443a84c0327c8707bc63-6759dbf6a6924fcc870cb52b4a5d7953 received from {username='slave'} at 127.0.0.1:42740
I20260709 13:05:58.643249 16293 tablet_copy_service.cc:434] P 0aea40d6e4374085a2e38a70a71f63e3: ending tablet copy session 1109f76a0b7b443a84c0327c8707bc63-6759dbf6a6924fcc870cb52b4a5d7953 on tablet 6759dbf6a6924fcc870cb52b4a5d7953 with peer 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:05:58.639113 17780 raft_consensus.cc:515] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:58.632107 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:58.633356 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:05:58.633428 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:58.633847 17590 leader_election.cc:290] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:58.634507 16945 raft_consensus.cc:1240] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:58.635098 16248 leader_election.cc:304] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:05:58.675158 16248 leader_election.cc:304] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:58.638958 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:58.638381 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:58.676739 16276 raft_consensus.cc:2468] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 4.
I20260709 13:05:58.647399 16106 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55244 (request call id 120) took 7449 ms. Trace:
I20260709 13:05:58.673156 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:05:58.632381 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:58.647043 16946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:05:58.677841 16208 raft_consensus.cc:2468] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 3.
I20260709 13:05:58.651978 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bc3c8ff9b84838a2664335d7e1582b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:58.678103 16949 raft_consensus.cc:2393] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 4: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
I20260709 13:05:58.665127 16279 raft_consensus.cc:2393] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 in current term 2: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:05:58.647042 16940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:05:58.652061 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:58.661830 16105 catalog_manager.cc:5697] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e reported cstate change: term changed from 1 to 2, leader changed from 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) to 363bb2f744eb486f9ad726f08214c98e (127.14.180.67). New cstate: current_term: 2 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:58.678067 16946 raft_consensus.cc:2376] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 3. Re-sending same reply.
I20260709 13:05:58.682404 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:58.683151 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:58.685493 16942 raft_consensus.cc:2468] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 2.
I20260709 13:05:58.685874 16940 raft_consensus.cc:2410] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:05:58.686053 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:58.683305 17602 raft_consensus.cc:2749] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:58.687454 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:58.687681 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:58.687922 16948 raft_consensus.cc:1240] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:58.679370 17516 raft_consensus.cc:2804] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:58.689006 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:58.689458 17516 raft_consensus.cc:493] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:05:58.689908 17516 raft_consensus.cc:3060] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:58.690944 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:58.691404 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:58.692189 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:58.692916 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:58.693604 16276 raft_consensus.cc:2368] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 for earlier term 2. Current term is 3.
I20260709 13:05:58.693735 16208 raft_consensus.cc:2468] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 1.
I20260709 13:05:58.689047 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:58.695116 16248 leader_election.cc:304] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:58.696029 16914 leader_election.cc:304] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:58.697836 16914 leader_election.cc:304] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:05:58.700301 16914 leader_election.cc:304] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:58.701977 16914 leader_election.cc:304] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:05:58.707383 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:05:58.709447 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 51392.8us
I20260709 13:05:58.713191 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c15d8e9be8414c84912ab77b66bfb1" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:05:58.714084 16208 raft_consensus.cc:3060] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:58.711124 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:58.671314 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:58.731787 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:05:58.733487 16914 leader_election.cc:304] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:58.732107 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:58.733935 16248 leader_election.cc:304] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:58.731920 16105 catalog_manager.cc:5697] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:58.740089 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:58.742120 16914 leader_election.cc:304] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:05:58.747303 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:58.747545 16914 leader_election.cc:304] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:05:58.750422 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f022e2e63ae4461d834e476ff2666991" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:58.751526 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:58.712087 17840 raft_consensus.cc:2749] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:58.708042 17770 raft_consensus.cc:2749] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:05:58.703624 16304 debug-util.cc:398] Leaking SignalData structure 0x7b0800133260 after lost signal to thread 15060
I20260709 13:05:58.708140 17841 raft_consensus.cc:2749] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:58.671849 17751 raft_consensus.cc:515] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:58.712162 17602 raft_consensus.cc:2804] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:58.677313 16106 rpcz_store.cc:276] 0709 13:05:51.198061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:51.198213 (+   152us) service_pool.cc:224] Handling call
0709 13:05:58.647317 (+7449104us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:05:54.822090 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:05:54.823324 (+  1234us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:05:54.823398 (+    74us) write_op.cc:435] Acquired schema lock
0709 13:05:54.823427 (+    29us) tablet.cc:662] Decoding operations
0709 13:05:54.823960 (+   533us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:05:54.824073 (+   113us) write_op.cc:641] Partition lock acquired for write op
0709 13:05:54.824116 (+    43us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:05:54.824559 (+   443us) tablet.cc:701] Row locks acquired
0709 13:05:54.824645 (+    86us) write_op.cc:260] PREPARE: finished
0709 13:05:54.824882 (+   237us) write_op.cc:270] Start()
0709 13:05:54.825083 (+   201us) write_op.cc:276] Timestamp: P: 1783602354824790 usec, L: 0
0709 13:05:54.825143 (+    60us) op_driver.cc:348] REPLICATION: starting
0709 13:05:54.826010 (+   867us) log.cc:844] Serialized 536 byte log entry
0709 13:05:55.078479 (+252469us) op_driver.cc:464] REPLICATION: finished
0709 13:05:55.271331 (+192852us) write_op.cc:301] APPLY: starting
0709 13:05:55.294858 (+ 23527us) tablet.cc:1367] starting BulkCheckPresence
0709 13:05:55.318132 (+ 23274us) tablet.cc:1370] finished BulkCheckPresence
0709 13:05:55.480290 (+162158us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:05:55.556755 (+ 76465us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:05:55.557007 (+   252us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:05:55.557077 (+    70us) write_op.cc:312] APPLY: finished
0709 13:05:55.560177 (+  3100us) log.cc:844] Serialized 23 byte log entry
0709 13:05:55.560370 (+   193us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:55.560454 (+    84us) write_op.cc:454] Released schema lock
0709 13:05:55.560527 (+    73us) write_op.cc:341] FINISH: Updating metrics
0709 13:05:55.560928 (+   401us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:55.560979 (+    51us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":139559,"reported_tablets":5,"child_traces":[["op",{"apply.queue_time_us":137247,"apply.run_cpu_time_us":3306,"apply.run_wall_time_us":307180,"num_ops":1,"prepare.queue_time_us":129856,"prepare.run_cpu_time_us":4296,"prepare.run_wall_time_us":4296,"replication_time_us":253123,"thread_start_us":179724,"threads_started":2}]]}
I20260709 13:05:58.752514 17797 raft_consensus.cc:2749] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:58.708590 17501 raft_consensus.cc:2749] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:58.739243 17775 raft_consensus.cc:2749] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:05:58.745265 17726 raft_consensus.cc:2749] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:58.763938 16912 leader_election.cc:304] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:58.766176 16246 leader_election.cc:304] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:58.758908 17604 raft_consensus.cc:2749] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:58.780309 17590 raft_consensus.cc:2804] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:58.780840 17590 raft_consensus.cc:493] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:05:58.781206 17770 raft_consensus.cc:2804] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:58.781754 17770 raft_consensus.cc:493] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:58.782111 17770 raft_consensus.cc:3060] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:58.783007 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:05:58.784726 17751 leader_election.cc:290] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 election: Requested vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:05:58.786597 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:05:58.787567 16202 raft_consensus.cc:3060] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:58.794986 17602 raft_consensus.cc:697] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:05:58.793563 17740 raft_consensus.cc:515] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:58.796145 16274 raft_consensus.cc:2393] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 in current term 2: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:05:58.796056 17602 consensus_queue.cc:237] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:58.799264 17780 leader_election.cc:290] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:58.801271 17810 raft_consensus.cc:515] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:58.803114 16276 raft_consensus.cc:2368] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 for earlier term 2. Current term is 3.
I20260709 13:05:58.803184 16275 raft_consensus.cc:2393] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 in current term 2: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:05:58.806173 17740 leader_election.cc:290] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:05:58.781279 17590 raft_consensus.cc:3060] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:58.812711 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:58.808104 17779 leader_election.cc:290] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:58.813937 16280 raft_consensus.cc:2393] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 3: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:05:58.817544 16208 raft_consensus.cc:2468] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 4.
I20260709 13:05:58.812907 17810 leader_election.cc:290] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:05:58.820254 16246 leader_election.cc:304] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:58.820681 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:58.821324 17810 raft_consensus.cc:2804] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:58.821903 17810 raft_consensus.cc:697] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:05:58.822664 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:05:58.823462 16203 raft_consensus.cc:3060] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:58.823298 17810 consensus_queue.cc:237] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:58.829922 16202 raft_consensus.cc:2468] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 3.
I20260709 13:05:58.833546 16203 raft_consensus.cc:2468] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 4.
I20260709 13:05:58.845340 16203 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39674 (request call id 92) took 1140 ms. Trace:
I20260709 13:05:58.845712 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
W20260709 13:05:58.846199 17774 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.163s	user 0.002s	sys 0.010s
I20260709 13:05:58.845928 16203 rpcz_store.cc:276] 0709 13:05:57.705019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:58.822312 (+1117293us) service_pool.cc:224] Handling call
0709 13:05:58.845259 (+ 22947us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:58.847373 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:58.838531 17590 raft_consensus.cc:515] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:58.848656 16203 raft_consensus.cc:2468] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 2.
I20260709 13:05:58.822043 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:05:58.853212 16912 leader_election.cc:304] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:58.853552 16208 raft_consensus.cc:3060] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:58.842519 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:58.854157 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:05:58.855845 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:05:58.856973 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:05:58.857964 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:58.854878 16246 leader_election.cc:304] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:58.843564 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:58.860140 16201 raft_consensus.cc:2468] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 3.
I20260709 13:05:58.861044 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:05:58.861605 16201 raft_consensus.cc:3060] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:05:58.848855 16357 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41830 (request call id 1256) took 1629 ms (client timeout 1629 ms). Trace:
I20260709 13:05:58.847482 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:58.850289 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:58.841066 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:05:58.859575 17740 raft_consensus.cc:2804] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:58.863623 16199 raft_consensus.cc:2468] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 2.
I20260709 13:05:58.865929 16246 leader_election.cc:304] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
W20260709 13:05:58.866401 16304 debug-util.cc:398] Leaking SignalData structure 0x7b0800133940 after lost signal to thread 16140
I20260709 13:05:58.854226 17501 raft_consensus.cc:2804] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:05:58.866968 16304 debug-util.cc:398] Leaking SignalData structure 0x7b0800133a00 after lost signal to thread 16154
I20260709 13:05:58.867318 17501 raft_consensus.cc:697] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 4 LEADER]: Becoming Leader. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:05:58.868847 17740 raft_consensus.cc:697] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:05:58.868424 17501 consensus_queue.cc:237] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:58.866894 17779 raft_consensus.cc:2804] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:58.869544 17779 raft_consensus.cc:493] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:58.869961 17779 raft_consensus.cc:3060] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:58.870352 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:05:58.871865 16246 leader_election.cc:304] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
W20260709 13:05:58.862233 16357 rpcz_store.cc:269] 0709 13:05:57.218995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:57.271955 (+ 52960us) service_pool.cc:224] Handling call
0709 13:05:58.848589 (+1576634us) spinlock_profiling.cc:243] Waited 60.3 ms on lock 0x7b540026a554. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:05:58.848746 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":138636160}
I20260709 13:05:58.874030 17751 raft_consensus.cc:2804] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:58.876014 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:05:58.876107 17751 raft_consensus.cc:493] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:05:58.876793 17751 raft_consensus.cc:3060] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:58.876917 16354 raft_consensus.cc:2393] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 3: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
W20260709 13:05:58.877511 16354 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41830 (request call id 1249) took 3580 ms (client timeout 2021 ms). Trace:
W20260709 13:05:58.877866 16354 rpcz_store.cc:269] 0709 13:05:55.296661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:55.296818 (+   157us) service_pool.cc:224] Handling call
0709 13:05:58.875857 (+3579039us) spinlock_profiling.cc:243] Waited 4.49 ms on lock 0x7b5800024698. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361c224db1 00007f361c364b71 00007f361c364a22 00007f362527dc09 00007f36243d7ee0 00007f36244a10ab 00007f36244a1131 00007f362444f0a0 00007f362444e984 00007f361d9c96d4 00007f361d9c9662
0709 13:05:58.877408 (+  1551us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10327424}
I20260709 13:05:58.869975 17740 consensus_queue.cc:237] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:58.879820 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:58.880496 16277 raft_consensus.cc:2468] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 4.
I20260709 13:05:58.881438 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:05:58.884088 16304 debug-util.cc:398] Leaking SignalData structure 0x7b0800334300 after lost signal to thread 16232
W20260709 13:05:58.884670 16304 debug-util.cc:398] Leaking SignalData structure 0x7b08002bd3a0 after lost signal to thread 16233
W20260709 13:05:58.885754 16304 debug-util.cc:398] Leaking SignalData structure 0x7b0800377f60 after lost signal to thread 16307
I20260709 13:05:58.890836 17618 ts_tablet_manager.cc:933] T c7d554054f014c74992a2a66ff6873cd P 1109f76a0b7b443a84c0327c8707bc63: Initiating tablet copy from peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:58.893265 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:58.861857 16208 raft_consensus.cc:2468] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 4.
I20260709 13:05:58.894089 16277 raft_consensus.cc:2468] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 2.
I20260709 13:05:58.893558 16948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
W20260709 13:05:58.907358 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 159917us
I20260709 13:05:58.895598 16246 leader_election.cc:304] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:58.911032 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bc3c8ff9b84838a2664335d7e1582b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:58.895237 16207 raft_consensus.cc:2393] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 3: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:05:58.915793 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:58.905965 16201 raft_consensus.cc:2468] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 4.
I20260709 13:05:58.917645 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:58.917915 16246 leader_election.cc:304] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:58.932835 16277 raft_consensus.cc:1240] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:05:58.934911 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:05:58.922812 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 250892us
I20260709 13:05:58.924013 16914 leader_election.cc:304] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:58.854749 17590 leader_election.cc:290] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:58.939975 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:58.938741 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:58.855403 16203 raft_consensus.cc:3060] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:05:58.946533 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 158869us
I20260709 13:05:58.942281 16173 leader_election.cc:304] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:05:58.945775 16914 leader_election.cc:304] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:05:58.944125 16201 raft_consensus.cc:2393] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 4: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
W20260709 13:05:58.941129 17774 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.263s	user 0.002s	sys 0.011s
I20260709 13:05:58.961861 16173 leader_election.cc:304] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:05:58.953336 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:58.962466 16914 leader_election.cc:400] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823) with higher term. Message: Invalid argument: T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 for earlier term 2. Current term is 3.
I20260709 13:05:58.931687 17776 raft_consensus.cc:2804] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:58.962327 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:58.963037 16208 raft_consensus.cc:2393] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 4: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:05:58.963222 17776 raft_consensus.cc:697] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:05:58.963802 16914 leader_election.cc:403] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:05:58.963984 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:58.964452 17840 raft_consensus.cc:3060] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:05:58.964627 16208 raft_consensus.cc:2468] T b9e1324823f04d8da5a4b3ddbd061c0e P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 2.
I20260709 13:05:58.963229 16201 raft_consensus.cc:2468] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 2.
I20260709 13:05:58.965973 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:58.966377 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:05:58.967141 16201 raft_consensus.cc:3060] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:58.967232 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:05:58.967953 16208 raft_consensus.cc:3060] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:58.969079 16946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:05:58.964533 16948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:05:58.971395 16948 raft_consensus.cc:2468] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 1.
I20260709 13:05:58.964320 17776 consensus_queue.cc:237] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:58.973364 17839 raft_consensus.cc:2749] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:58.973389 17840 raft_consensus.cc:2749] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823) with higher term. Message: Invalid argument: T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 for earlier term 2. Current term is 3.
I20260709 13:05:58.975221 16914 leader_election.cc:304] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:58.976650 17501 raft_consensus.cc:3060] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:58.976827 16948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:05:58.977839 16320 leader_election.cc:304] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:58.978861 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:58.940966 17775 raft_consensus.cc:2804] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:58.979532 16207 raft_consensus.cc:2468] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 2.
I20260709 13:05:58.980548 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:58.981137 16207 raft_consensus.cc:2468] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 3.
I20260709 13:05:58.982498 16948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:05:58.984717 16201 raft_consensus.cc:2468] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 2.
I20260709 13:05:58.979363 16173 leader_election.cc:304] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:58.988003 16173 leader_election.cc:304] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:58.943647 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:05:58.942404 17726 raft_consensus.cc:2749] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:05:58.992180 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:59.000293 16276 raft_consensus.cc:2410] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:05:58.999797 16173 leader_election.cc:304] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:58.993461 16279 raft_consensus.cc:1240] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:58.994053 16280 raft_consensus.cc:1240] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 LEADER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:58.989974 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:58.944753 17549 raft_consensus.cc:493] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:05:58.986132 16246 leader_election.cc:304] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:58.997928 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:05:59.018059 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:59.026822 16948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:05:58.978713 17841 raft_consensus.cc:2749] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:59.032598 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:59.033564 16205 raft_consensus.cc:2410] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:05:59.031080 16208 raft_consensus.cc:2468] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 2.
I20260709 13:05:58.997291 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:05:59.003232 16320 leader_election.cc:304] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:59.001864 16173 leader_election.cc:304] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:58.948683 17716 consensus_queue.cc:1048] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.055s
I20260709 13:05:59.038386 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:59.030228 16914 leader_election.cc:304] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:59.035697 16246 leader_election.cc:304] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:58.991125 17781 raft_consensus.cc:2804] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:59.042001 16173 leader_election.cc:304] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:59.036875 16948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:05:59.043047 16948 raft_consensus.cc:3060] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:59.040058 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:58.986877 17845 consensus_queue.cc:1048] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.054s
I20260709 13:05:58.962234 17701 consensus_queue.cc:1048] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.066s
W20260709 13:05:59.028640 16304 debug-util.cc:398] Leaking SignalData structure 0x7b0800233580 after lost signal to thread 16381
I20260709 13:05:58.990300 17774 raft_consensus.cc:3055] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:59.046096 16946 raft_consensus.cc:2410] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:05:58.995147 17688 raft_consensus.cc:2804] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:59.043464 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:05:58.955992 17516 raft_consensus.cc:515] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:58.998620 17775 raft_consensus.cc:697] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:05:59.044556 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f022e2e63ae4461d834e476ff2666991" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:59.069520 16274 raft_consensus.cc:1240] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:59.075080 17432 raft_consensus.cc:3060] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:59.075959 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:05:59.079536 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 43927.3us
I20260709 13:05:59.068068 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:59.045913 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:59.081800 16948 raft_consensus.cc:2468] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 2.
I20260709 13:05:59.027310 17848 raft_consensus.cc:2804] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:59.083683 16948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:05:59.082036 16208 raft_consensus.cc:2393] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 4: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
W20260709 13:05:59.067615 16304 debug-util.cc:398] Leaking SignalData structure 0x7b080026d380 after lost signal to thread 16382
I20260709 13:05:59.044962 17604 raft_consensus.cc:3060] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:59.027655 17837 consensus_queue.cc:1059] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.057s
I20260709 13:05:59.033881 17602 raft_consensus.cc:2804] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:59.118091 16283 raft_consensus.cc:1275] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:05:59.106923 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:59.091840 16248 leader_election.cc:304] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:59.068593 17804 raft_consensus.cc:2804] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:59.116074 16205 raft_consensus.cc:1275] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:59.069161 17774 raft_consensus.cc:740] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:05:59.071048 17688 raft_consensus.cc:493] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:59.072353 17760 raft_consensus.cc:2804] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:59.121779 16248 leader_election.cc:304] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:59.137006 16205 raft_consensus.cc:1240] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:05:59.043035 17781 raft_consensus.cc:493] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:05:59.140867 17781 raft_consensus.cc:3060] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:59.145147 16199 raft_consensus.cc:2468] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 3.
I20260709 13:05:59.146806 16246 leader_election.cc:304] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:59.087368 17848 raft_consensus.cc:493] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:05:59.038504 17549 raft_consensus.cc:515] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:59.087947 17618 tablet_copy_client.cc:323] T c7d554054f014c74992a2a66ff6873cd P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Beginning tablet copy session from remote peer at address 127.14.180.67:46107
I20260709 13:05:59.094708 17810 raft_consensus.cc:2804] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:59.122320 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:05:59.139963 16205 raft_consensus.cc:1240] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:59.108214 16207 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0340758c689242c3979a434fa59589f7"
dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
mode: GRACEFUL
new_leader_uuid: "1109f76a0b7b443a84c0327c8707bc63"
 from {username='slave'} at 127.0.0.1:58160
I20260709 13:05:59.196365 16207 raft_consensus.cc:606] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 LEADER]: Received request to transfer leadership to TS 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:05:59.196635 17549 leader_election.cc:290] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:05:59.198107 16207 raft_consensus.cc:1240] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:59.199712 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:59.202073 17516 leader_election.cc:290] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 election: Requested vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:05:59.109586 17841 consensus_queue.cc:1059] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.066s
I20260709 13:05:59.134047 17775 consensus_queue.cc:237] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:59.122815 17804 raft_consensus.cc:493] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:05:59.276919 17804 raft_consensus.cc:3060] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:59.279284 17419 raft_consensus.cc:3060] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:59.209721 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:59.215669 16205 raft_consensus.cc:1240] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:59.127708 17590 raft_consensus.cc:2804] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:59.136107 17688 raft_consensus.cc:3060] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:59.205268 17774 consensus_queue.cc:260] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:59.178460 17848 raft_consensus.cc:3060] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:59.218947 17866 raft_consensus.cc:493] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:59.236719 16199 raft_consensus.cc:1275] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:05:59.179739 17779 raft_consensus.cc:515] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:59.135670 17780 consensus_queue.cc:1048] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.105s
I20260709 13:05:59.239933 16204 raft_consensus.cc:2468] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 3.
W20260709 13:05:59.241828 16304 debug-util.cc:398] Leaking SignalData structure 0x7b080028a220 after lost signal to thread 16973
I20260709 13:05:59.247695 17841 raft_consensus.cc:3055] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:59.252151 17770 raft_consensus.cc:515] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:59.260664 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:59.263854 16203 raft_consensus.cc:2468] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 3.
I20260709 13:05:59.266619 17846 raft_consensus.cc:3055] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:59.136881 17760 raft_consensus.cc:493] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:59.223507 16207 raft_consensus.cc:1240] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:59.288797 16275 raft_consensus.cc:1240] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 LEADER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 3. Current term is 4. Ops: [3.2-3.2]
W20260709 13:05:59.287894 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 245957us
W20260709 13:05:59.329310 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 326139us
I20260709 13:05:59.290000 16205 raft_consensus.cc:1275] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
W20260709 13:05:59.225562 17857 log.cc:927] Time spent T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:05:59.332341 16173 leader_election.cc:304] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
W20260709 13:05:59.300009 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 178288us
I20260709 13:05:59.287463 17590 raft_consensus.cc:493] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:05:59.300724 17516 raft_consensus.cc:2749] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:59.330971 16320 leader_election.cc:304] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:59.335211 16248 leader_election.cc:304] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:59.338267 17590 raft_consensus.cc:3060] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:59.340062 17501 raft_consensus.cc:2749] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:59.340781 17867 consensus_queue.cc:1059] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:59.341905 16173 leader_election.cc:304] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:59.311107 17776 raft_consensus.cc:2804] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:59.309645 17528 raft_consensus.cc:2804] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:59.303756 17774 raft_consensus.cc:3060] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:59.360776 16320 leader_election.cc:304] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:59.362520 16248 leader_election.cc:304] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:05:59.380997 16248 leader_election.cc:304] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:05:59.373677 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 226959us
I20260709 13:05:59.315500 17841 raft_consensus.cc:740] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:05:59.333089 17760 raft_consensus.cc:3060] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:59.389717 16246 leader_election.cc:304] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:59.331617 17778 raft_consensus.cc:2749] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:59.382474 16914 leader_election.cc:304] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:59.332788 17846 raft_consensus.cc:740] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:05:59.348898 17673 raft_consensus.cc:2804] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:05:59.388469 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 46618.2us
I20260709 13:05:59.309419 17866 raft_consensus.cc:515] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:59.378481 17549 raft_consensus.cc:2804] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:59.384780 16322 leader_election.cc:304] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
W20260709 13:05:59.379957 16304 debug-util.cc:398] Leaking SignalData structure 0x7b0800356760 after lost signal to thread 17727
I20260709 13:05:59.418361 16203 raft_consensus.cc:3055] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:59.395889 16320 leader_election.cc:304] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:59.377496 17810 raft_consensus.cc:697] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:05:59.392834 16248 leader_election.cc:304] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:59.378793 17780 raft_consensus.cc:2749] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:05:59.391505 16246 leader_election.cc:304] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:59.418507 16199 raft_consensus.cc:1275] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:05:59.385923 17432 raft_consensus.cc:2749] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:59.389428 17740 raft_consensus.cc:2804] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:59.394832 17870 raft_consensus.cc:2749] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:05:59.426522 17848 raft_consensus.cc:515] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:59.416221 17549 raft_consensus.cc:493] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:59.431543 17770 leader_election.cc:290] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 4 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:59.432155 16200 raft_consensus.cc:1240] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:59.432653 17779 leader_election.cc:290] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:59.432823 17862 raft_consensus.cc:2804] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:59.400283 17673 raft_consensus.cc:493] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:59.396293 17776 raft_consensus.cc:697] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:05:59.396891 17816 raft_consensus.cc:2804] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:59.440826 17824 raft_consensus.cc:3055] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:59.388983 17797 consensus_queue.cc:1048] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:05:59.442605 17867 consensus_queue.cc:1059] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:05:59.444206 17781 raft_consensus.cc:515] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:59.492316 17867 raft_consensus.cc:3055] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:59.492808 17867 raft_consensus.cc:740] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:05:59.493507 17781 leader_election.cc:290] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:59.445150 17841 consensus_queue.cc:260] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:59.446127 16173 leader_election.cc:304] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 363bb2f744eb486f9ad726f08214c98e
I20260709 13:05:59.494624 17841 raft_consensus.cc:3060] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:05:59.494907 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 48872us
I20260709 13:05:59.496878 17866 leader_election.cc:290] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:59.497067 17845 raft_consensus.cc:2804] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:59.497586 17845 raft_consensus.cc:697] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 3 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:05:59.446753 17842 consensus_queue.cc:1059] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:05:59.498922 16913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:59.499688 17839 raft_consensus.cc:3055] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:59.499990 17816 raft_consensus.cc:697] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 4 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:05:59.500159 17839 raft_consensus.cc:740] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:05:59.501022 17816 consensus_queue.cc:237] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:05:59.450309 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 52911.1us
I20260709 13:05:59.501761 17804 raft_consensus.cc:515] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:59.422206 17854 raft_consensus.cc:2749] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:59.425540 17602 raft_consensus.cc:697] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:05:59.421222 16203 raft_consensus.cc:740] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:05:59.448858 17784 raft_consensus.cc:2804] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:05:59.462455 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 77764.5us
I20260709 13:05:59.515610 16322 leader_election.cc:304] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:05:59.516790 16322 leader_election.cc:304] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
W20260709 13:05:59.463045 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 70299.9us
I20260709 13:05:59.447237 17878 raft_consensus.cc:2804] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:59.434944 17873 raft_consensus.cc:2804] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:59.534755 17873 raft_consensus.cc:493] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:59.534407 17590 raft_consensus.cc:515] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:59.535226 17873 raft_consensus.cc:3060] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:59.536211 16275 raft_consensus.cc:1240] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:59.537599 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:05:59.501096 17839 consensus_queue.cc:260] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:59.537774 17688 raft_consensus.cc:515] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:59.425078 17837 consensus_queue.cc:1059] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 13:05:59.459136 17549 raft_consensus.cc:3060] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:05:59.450915 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 69674.4us
I20260709 13:05:59.499723 17842 raft_consensus.cc:993] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f: : Instructing follower 1109f76a0b7b443a84c0327c8707bc63 to start an election
I20260709 13:05:59.498503 17845 consensus_queue.cc:237] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:59.511458 16281 raft_consensus.cc:1240] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 1. Current term is 2. Ops: []
W20260709 13:05:59.533310 17876 log.cc:927] Time spent T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:05:59.568219 17837 consensus_queue.cc:1243] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer 0aea40d6e4374085a2e38a70a71f63e3 log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:05:59.515265 17784 raft_consensus.cc:493] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:59.533648 16208 raft_consensus.cc:1275] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:05:59.538991 17751 consensus_meta.cc:287] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3: Time spent flushing consensus metadata: real 0.662s	user 0.010s	sys 0.004s
I20260709 13:05:59.539778 17810 consensus_queue.cc:237] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:59.431336 17528 raft_consensus.cc:493] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:59.542273 17880 consensus_queue.cc:1048] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:59.543586 16943 raft_consensus.cc:1240] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:59.543710 17878 raft_consensus.cc:697] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
W20260709 13:05:59.544911 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:59.557562 16200 raft_consensus.cc:3060] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:59.545464 17701 raft_consensus.cc:2804] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:59.547026 16206 raft_consensus.cc:2468] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 2.
I20260709 13:05:59.548203 16322 leader_election.cc:304] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:59.477461 17870 raft_consensus.cc:2749] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:05:59.553814 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:05:59.482745 17862 raft_consensus.cc:493] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:05:59.480098 17775 raft_consensus.cc:493] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:59.485055 17780 raft_consensus.cc:2804] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:59.485294 17673 raft_consensus.cc:3060] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:59.554440 16948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:05:59.554167 17651 raft_consensus.cc:2804] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:59.485306 17824 raft_consensus.cc:740] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
W20260709 13:05:59.562839 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 167006us
I20260709 13:05:59.567047 16199 raft_consensus.cc:1275] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:05:59.567392 16944 raft_consensus.cc:1275] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:59.593022 17701 raft_consensus.cc:493] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:59.586076 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:05:59.636053 16276 raft_consensus.cc:3060] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:05:59.593672 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 45545.8us
I20260709 13:05:59.637063 16322 leader_election.cc:304] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:59.584162 17740 raft_consensus.cc:697] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:05:59.637392 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:05:59.585079 17751 raft_consensus.cc:515] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:59.515594 17846 consensus_queue.cc:260] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:59.569058 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:05:59.585436 17837 raft_consensus.cc:1081] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 LEADER]: Signalling peer 1109f76a0b7b443a84c0327c8707bc63 to start an election
I20260709 13:05:59.584309 17528 raft_consensus.cc:3060] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:59.611459 16320 leader_election.cc:304] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:59.493806 17867 consensus_queue.cc:260] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:59.599246 17862 raft_consensus.cc:3060] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:59.576081 17827 consensus_queue.cc:1059] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:05:59.533313 17602 consensus_queue.cc:237] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:59.671525 17889 raft_consensus.cc:2804] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:59.672021 17889 raft_consensus.cc:493] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:59.672382 17889 raft_consensus.cc:3060] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:59.673192 16322 leader_election.cc:304] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:05:59.599642 17864 raft_consensus.cc:3060] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:59.674991 17868 raft_consensus.cc:3060] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:05:59.675067 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 63699.9us
W20260709 13:05:59.675946 17883 log.cc:927] Time spent T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:05:59.588766 17776 consensus_queue.cc:237] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:59.676795 17865 raft_consensus.cc:2804] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:59.677249 17865 raft_consensus.cc:493] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:05:59.677623 17865 raft_consensus.cc:3060] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:59.596495 17838 raft_consensus.cc:493] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:59.634361 16201 raft_consensus.cc:1275] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:05:59.675981 16320 leader_election.cc:304] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:59.581470 17784 raft_consensus.cc:3060] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:59.606307 17775 raft_consensus.cc:515] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:05:59.658679 16206 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39674 (request call id 87) took 1956 ms (client timeout 1800 ms). Trace:
W20260709 13:05:59.659806 17604 consensus_meta.cc:287] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63: Time spent flushing consensus metadata: real 0.538s	user 0.012s	sys 0.000s
W20260709 13:05:59.696025 16206 rpcz_store.cc:269] 0709 13:05:57.678872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:57.679022 (+   150us) service_pool.cc:224] Handling call
0709 13:05:59.634785 (+1955763us) spinlock_profiling.cc:243] Waited 1.84 s on lock 0x7b54003d0754. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:05:59.634900 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4240606592}
I20260709 13:05:59.704377 16322 leader_election.cc:304] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:05:59.660830 17848 leader_election.cc:290] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:59.632373 17780 raft_consensus.cc:697] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:05:59.605876 17878 consensus_queue.cc:237] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:59.612046 17651 raft_consensus.cc:493] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:05:59.690369 16276 raft_consensus.cc:2468] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 4.
I20260709 13:05:59.698050 16279 raft_consensus.cc:1240] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:59.700003 16320 leader_election.cc:304] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:05:59.714522 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:59.649438 17701 raft_consensus.cc:3060] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:05:59.721997 16248 leader_election.cc:336] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 2.021s (SENT)
I20260709 13:05:59.734848 16248 leader_election.cc:304] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:59.686376 17864 raft_consensus.cc:2749] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:59.667972 16274 raft_consensus.cc:2376] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 4. Re-sending same reply.
I20260709 13:05:59.733318 17651 raft_consensus.cc:3060] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:59.716336 17779 raft_consensus.cc:493] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:05:59.720111 17604 raft_consensus.cc:2749] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:59.731918 17867 raft_consensus.cc:3060] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:59.686983 17740 consensus_queue.cc:237] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:59.686718 17838 raft_consensus.cc:515] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:05:59.753896 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 187930us
I20260709 13:05:59.714900 17652 consensus_queue.cc:1059] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 13:05:59.740965 17602 raft_consensus.cc:2749] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:59.765143 16946 raft_consensus.cc:1240] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:59.781473 16276 raft_consensus.cc:1240] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:59.790232 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:05:59.790896 16279 raft_consensus.cc:3060] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:59.792603 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:05:59.793241 16283 raft_consensus.cc:3060] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Advancing to term 3
W20260709 13:05:59.795917 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 95958.6us
I20260709 13:05:59.798659 16944 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0340758c689242c3979a434fa59589f7"
dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
 from {username='slave'} at 127.0.0.1:35106
I20260709 13:05:59.777408 17432 raft_consensus.cc:2749] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:05:59.792872 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 88582.1us
I20260709 13:05:59.778518 17688 leader_election.cc:290] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:59.807157 16320 leader_election.cc:304] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:59.755121 17779 raft_consensus.cc:515] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:59.807690 16322 leader_election.cc:304] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:59.810797 16320 leader_election.cc:304] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:59.813042 17887 raft_consensus.cc:2749] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:59.814415 17775 leader_election.cc:290] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:59.800637 16944 raft_consensus.cc:493] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:59.810240 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:05:59.818132 17528 raft_consensus.cc:515] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:59.819177 17904 raft_consensus.cc:2804] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:59.823988 17873 raft_consensus.cc:515] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:59.824882 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:05:59.825124 17888 consensus_queue.cc:1048] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.110s
I20260709 13:05:59.825867 17893 raft_consensus.cc:493] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:59.808553 17868 raft_consensus.cc:2749] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:59.756412 17824 consensus_queue.cc:260] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:05:59.866120 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 45043.8us
W20260709 13:05:59.883285 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 72550.8us
I20260709 13:05:59.884192 16320 leader_election.cc:304] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:59.886168 16320 leader_election.cc:304] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:59.866858 17432 raft_consensus.cc:2804] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:59.867403 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:05:59.873297 17549 raft_consensus.cc:515] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:05:59.876650 17903 raft_consensus.cc:2749] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:05:59.878355 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 108508us
W20260709 13:05:59.879810 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:59.827203 16944 raft_consensus.cc:3060] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:59.896152 16322 leader_election.cc:304] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:59.899413 16201 raft_consensus.cc:2410] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:05:59.803619 17780 consensus_queue.cc:237] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:59.878095 16282 raft_consensus.cc:3060] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:59.874660 17602 raft_consensus.cc:493] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:05:59.903208 16320 leader_election.cc:304] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:05:59.886077 17904 raft_consensus.cc:493] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:05:59.899231 17864 raft_consensus.cc:2749] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:59.915947 16173 leader_election.cc:304] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:05:59.902036 17866 raft_consensus.cc:2749] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:59.882068 17893 raft_consensus.cc:515] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:05:59.923339 17528 leader_election.cc:290] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:05:59.926488 16913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:59.902384 17751 leader_election.cc:290] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:05:59.931252 17902 consensus_queue.cc:1059] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 13:05:59.901597 17432 raft_consensus.cc:493] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:59.932818 17688 raft_consensus.cc:2804] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:05:59.937922 17901 log.cc:927] Time spent T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:05:59.914669 17868 raft_consensus.cc:2804] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:59.935986 17774 consensus_queue.cc:1059] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
W20260709 13:05:59.943660 17897 log.cc:927] Time spent T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:05:59.943477 17905 raft_consensus.cc:3060] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:59.921809 17880 raft_consensus.cc:493] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:05:59.921294 17904 raft_consensus.cc:3060] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:59.949604 17898 consensus_queue.cc:1059] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 13:05:59.899471 17887 consensus_queue.cc:1048] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 13:05:59.939930 17903 raft_consensus.cc:3060] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:59.943049 17432 raft_consensus.cc:3060] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:59.921003 17602 raft_consensus.cc:515] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:59.947861 17868 raft_consensus.cc:493] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:59.961017 17900 log.cc:927] Time spent T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 13:05:59.953822 17688 raft_consensus.cc:697] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [term 4 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
W20260709 13:05:59.982949 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 79812.9us
I20260709 13:05:59.991501 17779 leader_election.cc:290] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:05:59.986294 16203 consensus_queue.cc:260] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:05:59.992336 16203 raft_consensus.cc:3060] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:59.981741 17873 leader_election.cc:290] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:05:59.983609 17868 raft_consensus.cc:3060] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:59.964025 17673 raft_consensus.cc:515] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } }
I20260709 13:06:00.000939 16279 raft_consensus.cc:2468] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 4.
I20260709 13:05:59.970583 17880 raft_consensus.cc:515] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:06:00.008651 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 67746.4us
I20260709 13:05:59.980947 17875 consensus_queue.cc:1048] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 13:05:59.978380 17865 raft_consensus.cc:515] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:00.017426 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:00.019085 17889 raft_consensus.cc:515] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:00.021770 17889 leader_election.cc:290] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:00.022099 16283 raft_consensus.cc:2468] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 3.
I20260709 13:06:00.022996 16275 raft_consensus.cc:1240] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 LEADER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:00.013190 17873 consensus_queue.cc:1059] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
W20260709 13:06:00.031337 17760 consensus_meta.cc:287] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 0.627s	user 0.006s	sys 0.006s
I20260709 13:06:00.031764 17760 raft_consensus.cc:515] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:00.032613 17673 leader_election.cc:290] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 election: Requested vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:00.033897 17760 leader_election.cc:290] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:00.033983 16203 raft_consensus.cc:1275] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:00.009464 17864 consensus_queue.cc:1059] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 13:06:00.038849 17760 consensus_queue.cc:1059] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:00.039067 17864 consensus_queue.cc:1048] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:00.037974 17862 raft_consensus.cc:515] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:00.040555 17590 leader_election.cc:290] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:00.044116 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:00.044978 16283 raft_consensus.cc:3060] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:00.009339 17652 consensus_queue.cc:1059] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 13:06:00.055104 17652 raft_consensus.cc:3055] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:00.055464 17652 raft_consensus.cc:740] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:06:00.056308 17784 raft_consensus.cc:515] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:00.015774 17898 consensus_queue.cc:1059] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
W20260709 13:06:00.054067 16173 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:00.054193 17887 raft_consensus.cc:3055] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:00.056608 17652 consensus_queue.cc:260] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:06:00.068219 16278 raft_consensus.cc:1240] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:00.068284 17652 raft_consensus.cc:3060] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:00.072217 17651 raft_consensus.cc:515] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:00.050258 17911 consensus_queue.cc:1059] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.057s
I20260709 13:06:00.087884 17911 raft_consensus.cc:3055] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:00.088359 17911 raft_consensus.cc:740] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:06:00.090062 17898 raft_consensus.cc:493] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:00.090893 17898 raft_consensus.cc:515] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:00.027812 17549 leader_election.cc:290] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:00.082908 17887 raft_consensus.cc:740] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:06:00.095589 17862 leader_election.cc:290] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:00.052227 17688 consensus_queue.cc:237] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:00.136791 17880 leader_election.cc:290] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:00.144008 17881 consensus_queue.cc:1048] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 13:06:00.146425 16948 raft_consensus.cc:1240] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 3. Current term is 4. Ops: []
W20260709 13:06:00.137204 17716 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 13:06:00.137349 17886 consensus_queue.cc:1048] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 13:06:00.161314 16283 raft_consensus.cc:2468] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 5.
I20260709 13:06:00.162842 17841 raft_consensus.cc:493] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:00.131763 17862 raft_consensus.cc:3055] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:00.142316 17528 raft_consensus.cc:493] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:00.153957 17903 raft_consensus.cc:2749] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:06:00.190056 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 163040us
I20260709 13:06:00.197611 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bc3c8ff9b84838a2664335d7e1582b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:00.178893 17862 raft_consensus.cc:740] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
W20260709 13:06:00.207307 17915 log.cc:927] Time spent T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.180s	user 0.001s	sys 0.000s
W20260709 13:06:00.216109 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 309686us
I20260709 13:06:00.178963 17893 leader_election.cc:290] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:00.217281 16322 leader_election.cc:304] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:00.190671 17528 raft_consensus.cc:515] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:00.227185 17862 consensus_queue.cc:260] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:00.228309 17528 leader_election.cc:290] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:00.184288 17867 consensus_queue.cc:1059] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:06:00.185322 17841 raft_consensus.cc:515] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:00.215269 17651 leader_election.cc:290] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:00.210425 17549 consensus_queue.cc:1059] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:06:00.228809 17862 raft_consensus.cc:3060] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:00.229041 16274 raft_consensus.cc:1240] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:00.240939 17867 raft_consensus.cc:3055] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:00.244352 17905 raft_consensus.cc:2749] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:00.223560 17602 leader_election.cc:290] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:00.230654 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:00.254253 17898 leader_election.cc:290] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:00.199419 17887 consensus_queue.cc:260] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:00.247182 17916 consensus_queue.cc:1048] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 13:06:00.255687 17865 leader_election.cc:290] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:06:00.257136 17701 consensus_meta.cc:287] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 0.508s	user 0.011s	sys 0.006s
I20260709 13:06:00.257553 17701 raft_consensus.cc:515] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:00.259492 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bc3c8ff9b84838a2664335d7e1582b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:00.260759 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:00.261564 16202 raft_consensus.cc:2393] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 3: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:06:00.255210 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:00.239626 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:00.266041 17804 leader_election.cc:290] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:00.286820 17784 leader_election.cc:290] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:00.287665 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:00.288981 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:00.289669 17432 raft_consensus.cc:515] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:00.290057 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:00.278100 17917 raft_consensus.cc:2749] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:00.291656 16205 raft_consensus.cc:3060] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:00.280872 17896 raft_consensus.cc:3055] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:00.292497 17896 raft_consensus.cc:740] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:00.293308 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:06:00.296531 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 77425.6us
I20260709 13:06:00.250614 17867 raft_consensus.cc:740] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
W20260709 13:06:00.301919 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 85687.5us
I20260709 13:06:00.302086 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:06:00.278956 16200 consensus_meta.cc:287] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f: Time spent flushing consensus metadata: real 0.672s	user 0.000s	sys 0.019s
I20260709 13:06:00.238687 16944 raft_consensus.cc:515] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:00.307009 16201 raft_consensus.cc:1240] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:00.308712 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:00.285044 17846 raft_consensus.cc:3060] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:00.336376 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:00.273391 16203 raft_consensus.cc:3060] T b9e1324823f04d8da5a4b3ddbd061c0e P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:00.337021 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:00.277853 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
W20260709 13:06:00.319666 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:00.338378 16357 raft_consensus.cc:1240] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:00.337893 16355 raft_consensus.cc:2468] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 2.
I20260709 13:06:00.344836 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:00.345074 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:00.346603 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
W20260709 13:06:00.347100 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:00.347219 16353 raft_consensus.cc:2468] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 4.
I20260709 13:06:00.346836 16354 raft_consensus.cc:2393] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 3: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:06:00.307626 17804 raft_consensus.cc:493] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:00.351080 16946 raft_consensus.cc:1240] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:00.358844 16205 raft_consensus.cc:2468] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 3.
I20260709 13:06:00.358784 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:00.336457 16200 raft_consensus.cc:2468] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 4.
W20260709 13:06:00.362010 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:00.364269 17841 leader_election.cc:290] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:00.367338 17701 leader_election.cc:290] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:00.367506 17863 raft_consensus.cc:3055] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:00.357071 16282 raft_consensus.cc:2468] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 3.
I20260709 13:06:00.385881 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:00.357774 17804 raft_consensus.cc:515] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:00.387809 16944 leader_election.cc:290] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 4 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:00.388800 17804 leader_election.cc:290] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:00.362697 16202 raft_consensus.cc:1240] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [term 4 LEADER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:00.381335 17845 raft_consensus.cc:3055] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:00.390120 17845 raft_consensus.cc:740] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:00.390861 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:00.391227 17845 consensus_queue.cc:260] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:00.362046 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:00.349225 17917 raft_consensus.cc:493] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:00.376196 16355 raft_consensus.cc:1240] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:00.295764 17896 consensus_queue.cc:260] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:00.381115 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:00.381595 17863 raft_consensus.cc:740] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:06:00.382139 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:00.397063 16357 raft_consensus.cc:2468] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 3.
I20260709 13:06:00.342239 17868 raft_consensus.cc:515] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:00.408371 17501 raft_consensus.cc:493] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:00.417114 17501 raft_consensus.cc:515] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:00.420219 17501 leader_election.cc:290] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:00.412971 17432 leader_election.cc:290] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:00.407335 17841 raft_consensus.cc:493] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:00.423852 17841 raft_consensus.cc:515] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:00.427819 16280 raft_consensus.cc:1275] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:00.429104 16351 raft_consensus.cc:1240] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:06:00.434973 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:00.436165 16276 raft_consensus.cc:2393] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 2: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:06:00.439778 16246 leader_election.cc:304] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:00.392843 17845 raft_consensus.cc:3060] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:00.426231 17841 leader_election.cc:290] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:06:00.441648 16913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:00.392827 16202 raft_consensus.cc:1275] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:00.442766 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:00.449430 16279 raft_consensus.cc:2468] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 3.
I20260709 13:06:00.436692 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:00.451098 16281 raft_consensus.cc:2393] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 in current term 2: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:06:00.453473 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:00.454519 16275 raft_consensus.cc:2393] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 3: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:06:00.435591 17896 raft_consensus.cc:3060] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:00.361032 17867 consensus_queue.cc:260] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:00.436126 17881 raft_consensus.cc:493] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:00.467423 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:00.447897 16944 raft_consensus.cc:1240] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:00.471361 16356 raft_consensus.cc:2468] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 3.
I20260709 13:06:00.447500 17863 consensus_queue.cc:260] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:00.473402 17863 raft_consensus.cc:3060] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:00.473701 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:00.468488 16173 leader_election.cc:304] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:00.469753 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:00.475373 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:00.476370 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:00.476651 16356 raft_consensus.cc:2368] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for earlier term 2. Current term is 3.
I20260709 13:06:00.476918 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c15d8e9be8414c84912ab77b66bfb1" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:00.477252 16353 raft_consensus.cc:2393] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 4: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:06:00.475425 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:00.478173 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:00.478457 16357 raft_consensus.cc:2393] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 4: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:06:00.478984 16356 raft_consensus.cc:2393] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 3: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:06:00.479389 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:00.479787 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:00.480639 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:00.480948 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:00.451867 17886 raft_consensus.cc:2804] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:06:00.484861 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:00.465430 16274 raft_consensus.cc:2393] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 in current term 2: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:06:00.440582 17848 consensus_queue.cc:1059] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 13:06:00.494884 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:00.484027 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:00.497390 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:00.482366 17898 raft_consensus.cc:493] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:00.505229 16353 raft_consensus.cc:1240] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:00.505836 16357 raft_consensus.cc:2393] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 3: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:06:00.481387 17881 raft_consensus.cc:515] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:00.415056 17917 raft_consensus.cc:515] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:00.509392 17841 raft_consensus.cc:493] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:00.510265 16354 raft_consensus.cc:2393] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 4: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
I20260709 13:06:00.493510 17886 raft_consensus.cc:697] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:00.506699 17528 raft_consensus.cc:2804] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:06:00.515651 17925 log.cc:927] Time spent T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.210s	user 0.001s	sys 0.000s
I20260709 13:06:00.523940 16946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:06:00.472298 17904 raft_consensus.cc:515] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:00.533671 17904 leader_election.cc:290] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 2 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:00.536090 16349 raft_consensus.cc:1240] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:00.528345 16173 leader_election.cc:304] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:00.536605 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:00.537870 16356 raft_consensus.cc:3060] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:00.511550 16282 raft_consensus.cc:2468] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 1.
I20260709 13:06:00.537374 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:00.540424 17528 raft_consensus.cc:697] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [term 4 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:00.540683 17419 raft_consensus.cc:2804] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:00.541406 17419 raft_consensus.cc:697] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:00.540429 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:00.517410 17841 raft_consensus.cc:515] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:00.514760 17898 raft_consensus.cc:515] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:00.556227 16173 leader_election.cc:304] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:00.541600 17528 consensus_queue.cc:237] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:06:00.634254 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 78102.4us
W20260709 13:06:00.584961 16174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:00.635601 16174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:00.633167 16353 raft_consensus.cc:1240] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:00.541630 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:00.546218 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
W20260709 13:06:00.640209 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:00.642423 16173 leader_election.cc:304] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
W20260709 13:06:00.645933 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 110274us
I20260709 13:06:00.639935 17688 raft_consensus.cc:2804] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:00.650177 17804 raft_consensus.cc:2804] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:00.650733 17740 raft_consensus.cc:493] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:00.651240 17740 raft_consensus.cc:515] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:00.651968 16356 raft_consensus.cc:2468] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 4.
I20260709 13:06:00.652884 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:00.653059 17902 consensus_queue.cc:1048] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:00.653604 17740 leader_election.cc:290] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:06:00.657320 16173 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:00.660295 16248 leader_election.cc:304] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:00.634281 17604 raft_consensus.cc:493] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:00.662357 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:00.673014 17881 leader_election.cc:290] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:00.673847 17881 raft_consensus.cc:493] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:00.674791 17419 consensus_queue.cc:237] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:00.670187 17688 raft_consensus.cc:697] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:00.680001 17688 consensus_queue.cc:237] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } }
I20260709 13:06:00.645015 16944 raft_consensus.cc:2468] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 1.
I20260709 13:06:00.645579 16943 raft_consensus.cc:2468] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 3.
I20260709 13:06:00.670841 17740 raft_consensus.cc:2749] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:06:00.691257 17930 log.cc:927] Time spent T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.052s	user 0.001s	sys 0.001s
I20260709 13:06:00.701732 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:00.704906 16353 raft_consensus.cc:1240] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 2. Current term is 3. Ops: []
W20260709 13:06:00.706382 16174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:00.715688 16208 raft_consensus.cc:2468] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 3.
I20260709 13:06:00.669783 17894 consensus_queue.cc:1048] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 13:06:00.717669 16248 leader_election.cc:304] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:06:00.731289 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:00.674414 17881 raft_consensus.cc:515] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:00.706625 17854 raft_consensus.cc:493] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:00.737934 16248 leader_election.cc:304] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:06:00.735014 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c15d8e9be8414c84912ab77b66bfb1" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:00.687765 17604 raft_consensus.cc:515] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:00.649281 17886 consensus_queue.cc:237] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:00.731959 16353 raft_consensus.cc:2376] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 3. Re-sending same reply.
I20260709 13:06:00.745108 17604 leader_election.cc:290] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:00.734733 17740 raft_consensus.cc:2804] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:00.746932 17740 raft_consensus.cc:493] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:00.747347 17740 raft_consensus.cc:3060] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:00.759970 16321 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:00.742576 17602 raft_consensus.cc:2804] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:00.766215 16205 raft_consensus.cc:1275] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:06:00.768793 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:00.768383 16205 raft_consensus.cc:1275] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:00.748626 17917 leader_election.cc:290] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:00.743039 17854 raft_consensus.cc:515] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:00.775035 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:00.786770 16356 raft_consensus.cc:2393] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 4: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:06:00.775806 16203 raft_consensus.cc:2468] T b9e1324823f04d8da5a4b3ddbd061c0e P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 3.
I20260709 13:06:00.783864 17881 leader_election.cc:290] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:00.799677 17841 leader_election.cc:290] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:00.800316 17841 raft_consensus.cc:493] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:00.800367 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:00.801004 17841 raft_consensus.cc:515] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:00.822741 17854 leader_election.cc:290] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:00.797645 17804 raft_consensus.cc:697] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:00.765754 17604 raft_consensus.cc:493] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:00.766151 17602 raft_consensus.cc:493] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:00.835502 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:00.836695 16356 raft_consensus.cc:2376] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 4. Re-sending same reply.
W20260709 13:06:00.846948 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:00.847404 17919 log.cc:927] Time spent T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.654s	user 0.006s	sys 0.000s
I20260709 13:06:00.846484 17838 leader_election.cc:290] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:00.851130 17841 leader_election.cc:290] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:06:00.852506 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:00.854884 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:00.833900 17602 raft_consensus.cc:3060] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:00.864831 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:00.865840 17911 consensus_queue.cc:260] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:00.866910 17911 raft_consensus.cc:3060] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:00.824250 17804 consensus_queue.cc:237] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:00.851130 17760 raft_consensus.cc:3055] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:00.877023 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:00.878316 16356 raft_consensus.cc:2393] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 4: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:06:00.833146 17604 raft_consensus.cc:515] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:00.893282 17604 leader_election.cc:290] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:00.882992 17898 leader_election.cc:290] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:00.894919 16943 raft_consensus.cc:1275] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:00.887995 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:00.923656 16348 raft_consensus.cc:2410] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:00.925122 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:06:00.925971 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:00.927114 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:00.928248 16356 raft_consensus.cc:2368] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 2. Current term is 3.
I20260709 13:06:00.929458 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:00.943092 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:00.943252 16203 raft_consensus.cc:1275] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:00.944041 16356 raft_consensus.cc:2410] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:00.943725 16353 raft_consensus.cc:2468] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 2.
I20260709 13:06:00.945271 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:00.945025 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:00.946156 16353 raft_consensus.cc:2468] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 3.
I20260709 13:06:00.946818 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:00.947356 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:00.947505 16356 raft_consensus.cc:2468] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 4.
I20260709 13:06:00.948534 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:00.874379 17760 raft_consensus.cc:740] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:06:00.949728 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:00.950407 16356 raft_consensus.cc:2468] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 2.
I20260709 13:06:00.950539 17760 consensus_queue.cc:260] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:00.951180 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:00.951758 17760 raft_consensus.cc:3060] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:00.951696 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:00.953500 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:00.951954 16354 raft_consensus.cc:2368] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for earlier term 2. Current term is 3.
I20260709 13:06:00.916296 17894 raft_consensus.cc:493] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:00.972199 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:00.973119 16354 raft_consensus.cc:2393] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 3: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:06:00.945029 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:00.976346 16948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:00.977365 16948 raft_consensus.cc:2468] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 3.
I20260709 13:06:00.982947 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:00.889060 17740 raft_consensus.cc:515] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:00.992599 16173 leader_election.cc:304] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:00.994585 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:00.986845 17898 raft_consensus.cc:493] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:01.002686 16913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:01.009195 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:01.010490 16356 raft_consensus.cc:2393] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 4: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
W20260709 13:06:01.012781 16320 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:00.989282 16203 raft_consensus.cc:2468] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 2.
I20260709 13:06:01.020397 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:00.985525 17894 raft_consensus.cc:515] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:01.017454 17898 raft_consensus.cc:515] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:01.026947 17528 raft_consensus.cc:2804] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:06:01.035060 17912 log.cc:927] Time spent T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.882s	user 0.000s	sys 0.003s
I20260709 13:06:01.035633 17898 leader_election.cc:290] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:01.035844 17528 raft_consensus.cc:493] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:01.020202 17886 raft_consensus.cc:493] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:01.036401 17528 raft_consensus.cc:3060] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:01.036824 17824 raft_consensus.cc:3060] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:01.036697 17886 raft_consensus.cc:515] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:01.046193 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:01.025179 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:01.021299 17940 raft_consensus.cc:493] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:01.045163 16173 leader_election.cc:304] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:01.047254 16278 raft_consensus.cc:2468] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 2.
I20260709 13:06:01.027524 17903 raft_consensus.cc:493] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:01.050025 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:01.057382 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:01.061161 16356 raft_consensus.cc:2393] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 3: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:06:01.072008 16354 raft_consensus.cc:2468] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 4.
I20260709 13:06:01.073643 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:01.047876 17886 leader_election.cc:290] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:06:01.061632 17929 log.cc:927] Time spent T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.534s	user 0.003s	sys 0.000s
W20260709 13:06:01.081686 16173 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:01.081291 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:01.060155 17940 raft_consensus.cc:515] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:01.062606 17903 raft_consensus.cc:515] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:01.134308 17854 raft_consensus.cc:493] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:01.136066 17951 raft_consensus.cc:493] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
W20260709 13:06:01.117082 17947 log.cc:927] Time spent T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:06:01.123322 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:01.086180 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:06:01.126971 16248 leader_election.cc:336] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 1.582s (SENT)
I20260709 13:06:01.137993 16248 leader_election.cc:304] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:01.139729 17903 leader_election.cc:290] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:01.139775 16354 raft_consensus.cc:2468] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 3.
I20260709 13:06:01.140419 17894 leader_election.cc:290] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:06:01.114390 16321 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:01.060698 17688 raft_consensus.cc:2804] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:01.145838 16912 leader_election.cc:304] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:01.101341 16948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:06:01.142001 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:01.142658 16356 raft_consensus.cc:2410] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for term 2 because replica has last-logged OpId of term: 1 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:01.137082 17914 raft_consensus.cc:493] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:01.143221 17940 leader_election.cc:290] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:01.144398 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:06:01.146340 16321 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:01.142537 17943 log.cc:927] Time spent T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
W20260709 13:06:01.147162 16174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:01.152927 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:01.114869 17839 raft_consensus.cc:3060] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:01.147787 16948 raft_consensus.cc:3060] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:01.151937 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:01.120923 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:01.154371 16205 raft_consensus.cc:2393] T b9e1324823f04d8da5a4b3ddbd061c0e P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 3: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:06:01.147495 17688 raft_consensus.cc:493] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:01.100095 17740 leader_election.cc:290] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 election: Requested vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:01.094758 17942 raft_consensus.cc:493] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:01.155984 16356 raft_consensus.cc:2393] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 3: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:06:01.185681 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:01.167827 17804 raft_consensus.cc:493] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:01.169512 17954 raft_consensus.cc:2749] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:01.191562 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:01.172262 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bc3c8ff9b84838a2664335d7e1582b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:01.173573 17887 raft_consensus.cc:3060] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:01.149739 17604 raft_consensus.cc:2804] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:01.175154 17688 raft_consensus.cc:3060] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:01.178028 16200 raft_consensus.cc:3055] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:01.178364 17886 raft_consensus.cc:493] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:01.179199 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:06:01.182041 16174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:01.182225 16207 raft_consensus.cc:1240] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 1. Current term is 2. Ops: []
W20260709 13:06:01.209883 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 82982.2us
I20260709 13:06:01.183622 16320 leader_election.cc:304] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
W20260709 13:06:01.184031 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:01.136626 17854 raft_consensus.cc:515] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:01.186936 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:01.187832 16356 raft_consensus.cc:2393] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 2: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:06:01.188412 17903 consensus_queue.cc:1059] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 13:06:01.136664 17951 raft_consensus.cc:515] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:01.193472 16948 raft_consensus.cc:2468] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 4.
I20260709 13:06:01.216152 16357 raft_consensus.cc:2468] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 2.
I20260709 13:06:01.200868 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:01.201730 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:01.207108 17894 consensus_queue.cc:1048] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:01.208863 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:01.210426 16353 raft_consensus.cc:2468] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 3.
I20260709 13:06:01.216713 16914 leader_election.cc:304] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
W20260709 13:06:01.213634 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:01.151613 17914 raft_consensus.cc:515] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:01.216034 16320 leader_election.cc:304] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:06:01.219575 16320 leader_election.cc:304] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
W20260709 13:06:01.220472 16248 leader_election.cc:336] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 1.629s (SENT)
I20260709 13:06:01.220854 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:01.221552 16208 raft_consensus.cc:1240] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:01.221902 16207 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60154 (request call id 1230) took 1019 ms. Trace:
I20260709 13:06:01.222615 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:01.220949 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:01.223698 16201 raft_consensus.cc:1240] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [term 4 LEADER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:01.226176 16248 leader_election.cc:304] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:06:01.227569 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:01.222257 16207 rpcz_store.cc:276] 0709 13:06:00.202031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:00.202207 (+   176us) service_pool.cc:224] Handling call
0709 13:06:01.181792 (+979585us) spinlock_profiling.cc:243] Waited 10.5 ms on lock 0x7b5800002a98. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361c224db1 00007f361c364b71 00007f361c364a22 00007f362527dc09 00007f36243d7ee0 00007f36244a10ab 00007f36244a1131 00007f3624462fc0 00007f362444d929 00007f362444d3d2 00007f361d9c4bd4
0709 13:06:01.182038 (+   246us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:01.221574 (+ 39536us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:01.221766 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":24117632}
I20260709 13:06:01.228783 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:01.229851 16276 raft_consensus.cc:2393] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 3: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:06:01.188308 16203 raft_consensus.cc:2468] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 4.
I20260709 13:06:01.196005 17942 raft_consensus.cc:515] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:01.234077 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:01.236681 16357 raft_consensus.cc:2368] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 3. Current term is 4.
I20260709 13:06:01.234118 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:01.235697 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:01.238759 16354 raft_consensus.cc:2468] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 4.
I20260709 13:06:01.199816 17604 raft_consensus.cc:493] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:01.209986 16200 raft_consensus.cc:740] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:01.194198 17804 raft_consensus.cc:515] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:01.239794 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:01.351881 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:01.223789 17940 raft_consensus.cc:493] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:01.288277 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:01.357239 16201 raft_consensus.cc:2393] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 4: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:06:01.335320 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:01.358704 16206 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60154 (request call id 1232) took 1156 ms. Trace:
I20260709 13:06:01.359195 16206 rpcz_store.cc:276] 0709 13:06:00.202786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:00.202917 (+   131us) service_pool.cc:224] Handling call
0709 13:06:01.335134 (+1132217us) spinlock_profiling.cc:243] Waited 9.43 ms on lock 0x7b5800002a98. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361c224db1 00007f361c364b71 00007f361c364a22 00007f362527dc09 00007f36243d7ee0 00007f36244a10ab 00007f36244a1131 00007f362444f0a0 00007f362444e984 00007f361d9c96d4 00007f361d9c9662
0709 13:06:01.358644 (+ 23510us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":21691776}
I20260709 13:06:01.223636 17866 raft_consensus.cc:2804] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:01.353747 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:01.367280 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:01.368216 16356 raft_consensus.cc:2368] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 3. Current term is 4.
I20260709 13:06:01.277770 16348 raft_consensus.cc:2393] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 4: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:06:01.369342 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:01.352331 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:01.330001 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c15d8e9be8414c84912ab77b66bfb1" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:01.224363 17841 raft_consensus.cc:2804] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:01.233316 17917 raft_consensus.cc:2804] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:01.289114 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:01.241227 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:01.278519 17604 raft_consensus.cc:3060] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:01.377043 16353 raft_consensus.cc:2368] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 2. Current term is 3.
I20260709 13:06:01.223944 17916 consensus_queue.cc:1059] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.132s
I20260709 13:06:01.323169 17904 raft_consensus.cc:2804] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:06:01.315634 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:01.354158 16282 raft_consensus.cc:1275] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:01.373256 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:01.219192 17886 raft_consensus.cc:515] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:01.293004 17935 raft_consensus.cc:493] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:01.412635 17760 raft_consensus.cc:3055] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:01.413288 17760 raft_consensus.cc:740] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:06:01.413018 17935 raft_consensus.cc:515] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:01.351517 17955 consensus_queue.cc:1048] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.068s
I20260709 13:06:01.379551 17841 raft_consensus.cc:493] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:01.376596 17917 raft_consensus.cc:493] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:01.392606 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
W20260709 13:06:01.396162 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:01.416828 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:01.352041 17956 raft_consensus.cc:2804] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:01.330377 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:01.397584 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:01.399590 17866 raft_consensus.cc:697] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 3 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:06:01.394443 17501 raft_consensus.cc:493] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:01.394939 17948 log.cc:927] Time spent T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.246s	user 0.000s	sys 0.004s
I20260709 13:06:01.218456 17954 consensus_queue.cc:1048] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.155s
W20260709 13:06:01.420790 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:01.441948 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:01.220376 17740 consensus_queue.cc:1048] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.179s
I20260709 13:06:01.374356 17898 raft_consensus.cc:493] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:01.233263 17602 raft_consensus.cc:515] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:01.443687 16349 raft_consensus.cc:2468] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 3.
I20260709 13:06:01.435319 17914 leader_election.cc:290] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:01.435201 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:01.368865 17940 raft_consensus.cc:515] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:01.449836 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:01.437280 17854 leader_election.cc:290] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:01.415645 17841 raft_consensus.cc:3060] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:01.440696 17501 raft_consensus.cc:515] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:01.453703 17866 consensus_queue.cc:237] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:01.455657 17501 leader_election.cc:290] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:01.457643 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:01.458316 16207 raft_consensus.cc:2468] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 2.
I20260709 13:06:01.459424 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:01.460263 16348 raft_consensus.cc:2393] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 2: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:06:01.461227 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:01.462100 16348 raft_consensus.cc:2410] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:01.416239 17955 raft_consensus.cc:493] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:01.462934 17955 raft_consensus.cc:515] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:06:01.464435 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 59460.4us
I20260709 13:06:01.465556 17955 leader_election.cc:290] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:01.424247 17916 consensus_queue.cc:1243] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer e10b16d536674c0bb350a31d7ce5ff7f log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:06:01.277571 17528 raft_consensus.cc:515] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:01.444033 16350 raft_consensus.cc:2376] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 2. Re-sending same reply.
I20260709 13:06:01.468258 17528 leader_election.cc:290] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:01.416072 17917 raft_consensus.cc:3060] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:01.468555 17942 leader_election.cc:290] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:01.470690 16912 leader_election.cc:304] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:01.414510 17760 consensus_queue.cc:260] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:01.471613 17804 leader_election.cc:290] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:01.471879 16204 raft_consensus.cc:2468] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 2.
I20260709 13:06:01.472733 17838 raft_consensus.cc:493] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:01.472986 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:01.473279 17838 raft_consensus.cc:515] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:01.473662 17886 leader_election.cc:290] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:01.435810 17956 raft_consensus.cc:697] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:01.474973 17956 consensus_queue.cc:237] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:01.475800 17940 leader_election.cc:290] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:01.449075 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:01.436077 16203 raft_consensus.cc:1240] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 LEADER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:06:01.479130 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:01.424149 17904 raft_consensus.cc:697] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 3 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:06:01.438535 17868 leader_election.cc:290] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:01.473662 16353 raft_consensus.cc:2376] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 3. Re-sending same reply.
I20260709 13:06:01.440915 17941 raft_consensus.cc:493] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:01.479892 16207 raft_consensus.cc:2468] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 2.
I20260709 13:06:01.451599 16349 raft_consensus.cc:2468] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 2.
I20260709 13:06:01.440276 17951 leader_election.cc:290] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:01.506871 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:01.508096 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c15d8e9be8414c84912ab77b66bfb1" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:01.509202 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:01.509739 16357 raft_consensus.cc:2376] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 3. Re-sending same reply.
I20260709 13:06:01.513130 16355 raft_consensus.cc:2410] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:01.513659 17841 raft_consensus.cc:515] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:01.515651 16355 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41832 (request call id 1319) took 1039 ms. Trace:
I20260709 13:06:01.516127 17841 leader_election.cc:290] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:01.484674 16912 leader_election.cc:304] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:01.517890 17501 raft_consensus.cc:2804] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:01.518271 17501 raft_consensus.cc:493] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:01.518687 17501 raft_consensus.cc:3060] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:01.520000 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:01.521009 16207 raft_consensus.cc:2468] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 2.
I20260709 13:06:01.523036 17688 raft_consensus.cc:515] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:01.526636 16912 leader_election.cc:304] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:01.528334 16912 leader_election.cc:304] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:01.528960 16351 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41832 (request call id 1309) took 1191 ms. Trace:
I20260709 13:06:01.529490 16351 rpcz_store.cc:276] 0709 13:06:00.337430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:00.343720 (+  6290us) service_pool.cc:224] Handling call
0709 13:06:00.343985 (+   265us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:00.429583 (+ 85598us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:01.528560 (+1098977us) spinlock_profiling.cc:243] Waited 84.9 ms on lock 0x7b54002576d4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f489e01 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6
0709 13:06:01.528876 (+   316us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":195197824}
I20260709 13:06:01.530833 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:01.531901 16357 raft_consensus.cc:2368] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 3. Current term is 4.
I20260709 13:06:01.482898 16205 raft_consensus.cc:2468] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 3.
I20260709 13:06:01.500658 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:01.500777 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:01.501336 17935 leader_election.cc:290] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:01.535182 16352 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41832 (request call id 1303) took 1232 ms. Trace:
I20260709 13:06:01.535229 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:01.501025 17904 consensus_queue.cc:237] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
W20260709 13:06:01.538661 16322 service_pool.cc:136] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:41830 dropped due to backpressure: service queue is full with 50 items
I20260709 13:06:01.468568 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:01.430670 16200 consensus_queue.cc:260] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:01.504029 17602 leader_election.cc:290] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 election: Requested vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:01.504470 17941 raft_consensus.cc:515] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:01.451965 17898 raft_consensus.cc:515] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:01.482832 17942 raft_consensus.cc:2804] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:01.516362 16367 tablet_copy_service.cc:140] P 363bb2f744eb486f9ad726f08214c98e: Received BeginTabletCopySession request for tablet c7d554054f014c74992a2a66ff6873cd from peer 1109f76a0b7b443a84c0327c8707bc63 ({username='slave'} at 127.0.0.1:33486)
I20260709 13:06:01.516052 16355 rpcz_store.cc:276] 0709 13:06:00.475740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:00.476666 (+   926us) service_pool.cc:224] Handling call
0709 13:06:01.515444 (+1038778us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b540032c154. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:06:01.515584 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2380810496}
I20260709 13:06:01.447528 16356 raft_consensus.cc:2468] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 4.
I20260709 13:06:01.510145 17604 raft_consensus.cc:515] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:01.533845 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:06:01.536368 16174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:01.535597 16352 rpcz_store.cc:276] 0709 13:06:00.303168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:00.305627 (+  2459us) service_pool.cc:224] Handling call
0709 13:06:01.484784 (+1179157us) spinlock_profiling.cc:243] Waited 1.24 ms on lock 0x7b5800024698. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361c224db1 00007f361c364e9c 00007f361c364a5b 00007f362527dc09 00007f36243d7ee0 00007f36244a10ab 00007f36244a1131 00007f362444f0a0 00007f362444e984 00007f361d9c96d4 00007f361d9c9662
0709 13:06:01.535115 (+ 50331us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2842496}
W20260709 13:06:01.544425 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 324858us
W20260709 13:06:01.555085 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 328954us
W20260709 13:06:01.558799 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:01.566911 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 338332us
I20260709 13:06:01.534890 17854 raft_consensus.cc:2804] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:06:01.572140 16321 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:01.591722 16320 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:01.592694 16207 raft_consensus.cc:1240] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 LEADER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:01.568207 17942 raft_consensus.cc:493] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:01.570119 16200 raft_consensus.cc:3060] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:01.565661 17841 raft_consensus.cc:2804] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:06:01.603435 16320 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:01.540666 17917 raft_consensus.cc:515] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:06:01.611977 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:01.614089 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:01.608861 16246 leader_election.cc:304] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
W20260709 13:06:01.627837 16913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:01.589154 17602 raft_consensus.cc:493] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:01.599304 17854 raft_consensus.cc:493] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:01.539052 16322 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:41830 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33486 (request call id 114)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41830 (request call id 1318)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41830 (request call id 1339)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41830 (request call id 1316)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33486 (request call id 111)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41830 (request call id 1299)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33486 (request call id 103)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33486 (request call id 110)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41830 (request call id 1340)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41830 (request call id 1328)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41830 (request call id 1290)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41830 (request call id 1296)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41830 (request call id 1313)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33486 (request call id 109)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33486 (request call id 113)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41830 (request call id 1329)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41830 (request call id 1341)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41830 (request call id 1330)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41830 (request call id 1292)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41830 (request call id 1342)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41830 (request call id 1343)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41830 (request call id 1344)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41830 (request call id 1325)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41830 (request call id 1331)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41830 (request call id 1346)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33486 (request call id 104)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41830 (request call id 1332)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41830 (request call id 1309)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41830 (request call id 1302)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41830 (request call id 1323)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33486 (request call id 115)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41830 (request call id 1345)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33486 (request call id 101)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41832 (request call id 1356)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41830 (request call id 1276)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41830 (request call id 1303)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41830 (request call id 1305)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41830 (request call id 1306)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41830 (request call id 1315)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41830 (request call id 1319)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41830 (request call id 1320)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41830 (request call id 1321)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41830 (request call id 1322)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41830 (request call id 1324)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33486 (request call id 99)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33486 (request call id 100)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33486 (request call id 102)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33486 (request call id 106)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33486 (request call id 107)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33486 (request call id 108)
I20260709 13:06:01.589313 16367 tablet_copy_service.cc:161] P 363bb2f744eb486f9ad726f08214c98e: Beginning new tablet copy session on tablet c7d554054f014c74992a2a66ff6873cd from peer 1109f76a0b7b443a84c0327c8707bc63 at {username='slave'} at 127.0.0.1:33486: session id = 1109f76a0b7b443a84c0327c8707bc63-c7d554054f014c74992a2a66ff6873cd
W20260709 13:06:01.629745 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 101459us
W20260709 13:06:01.748526 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:01.670316 17688 leader_election.cc:290] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:01.599937 17959 raft_consensus.cc:493] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:01.599177 16199 raft_consensus.cc:2468] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 2.
I20260709 13:06:01.621411 17942 raft_consensus.cc:3060] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:01.670727 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 61982.5us
W20260709 13:06:01.729043 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 155951us
I20260709 13:06:01.778263 16946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
W20260709 13:06:01.647889 16321 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:01.766000 16948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
W20260709 13:06:01.670634 16174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:01.780157 16173 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:01.780231 16948 raft_consensus.cc:3060] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:01.780551 16321 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:01.781337 16173 leader_election.cc:304] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
W20260709 13:06:01.762493 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:01.784512 17969 log.cc:927] Time spent T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:06:01.786772 17893 raft_consensus.cc:2804] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:01.787256 17893 raft_consensus.cc:493] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:01.787629 17893 raft_consensus.cc:3060] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:01.765288 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:01.789047 16944 raft_consensus.cc:2393] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 4: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
I20260709 13:06:01.790341 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:06:01.633495 17841 raft_consensus.cc:493] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:01.783556 16206 raft_consensus.cc:1240] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:01.791319 16949 raft_consensus.cc:2368] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for earlier term 3. Current term is 4.
I20260709 13:06:01.765267 17602 raft_consensus.cc:515] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:01.792865 16204 raft_consensus.cc:1275] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:01.793412 17602 leader_election.cc:290] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:01.793291 17501 raft_consensus.cc:515] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:01.793871 17941 leader_election.cc:290] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:01.794246 17841 raft_consensus.cc:3060] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:01.795122 17917 leader_election.cc:290] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:01.795428 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:01.781597 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:01.797251 16207 raft_consensus.cc:2468] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 3.
I20260709 13:06:01.798702 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:01.799649 16206 raft_consensus.cc:2393] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 3: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:06:01.804476 16948 raft_consensus.cc:2468] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 2.
I20260709 13:06:01.736754 17866 raft_consensus.cc:493] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:01.771840 17854 raft_consensus.cc:3060] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:01.806025 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:01.810458 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:01.810796 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:01.811151 16277 raft_consensus.cc:2468] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 4.
I20260709 13:06:01.811641 16280 raft_consensus.cc:2468] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 2.
I20260709 13:06:01.812112 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:01.812585 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:01.813009 16173 leader_election.cc:400] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 election: Vote denied by peer 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875) with higher term. Message: Invalid argument: T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for earlier term 3. Current term is 4.
I20260709 13:06:01.762705 17903 raft_consensus.cc:493] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:01.807471 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:01.814334 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:01.688025 17886 raft_consensus.cc:2804] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:01.809154 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:01.815057 16355 raft_consensus.cc:2468] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 3.
I20260709 13:06:01.730410 17604 leader_election.cc:290] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 4 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:01.814736 16173 leader_election.cc:403] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:06:01.815927 16277 raft_consensus.cc:2393] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 in current term 2: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:06:01.815951 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:01.816921 16279 raft_consensus.cc:2393] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 3: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:06:01.817028 16914 leader_election.cc:304] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:06:01.818773 17903 raft_consensus.cc:515] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:01.813470 17804 consensus_queue.cc:1048] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 13:06:01.820012 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:01.820688 16275 raft_consensus.cc:2468] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 3.
I20260709 13:06:01.821081 17903 leader_election.cc:290] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:01.821642 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:01.823207 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:01.823908 16274 raft_consensus.cc:2468] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 3.
I20260709 13:06:01.823936 17914 raft_consensus.cc:3060] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:01.825098 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:01.825388 17863 consensus_queue.cc:1059] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:01.826118 17863 consensus_queue.cc:1243] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer e10b16d536674c0bb350a31d7ce5ff7f log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:06:01.826578 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:01.826725 17887 raft_consensus.cc:3055] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:01.826843 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:01.827287 17887 raft_consensus.cc:740] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:06:01.816946 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:01.766960 17959 raft_consensus.cc:515] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:01.822276 16275 raft_consensus.cc:2468] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 2.
W20260709 13:06:01.900547 16321 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:01.828245 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:02.069548 16276 raft_consensus.cc:3060] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:02.070041 16321 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:02.085363 16174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:01.853425 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:01.874248 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
W20260709 13:06:01.956552 16173 leader_election.cc:336] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 1.583s (SENT)
I20260709 13:06:01.934883 16948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:02.093570 16173 leader_election.cc:304] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:01.830415 16320 leader_election.cc:304] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:02.070469 16280 raft_consensus.cc:1275] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:06:01.959628 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:02.096812 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:01.843338 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:01.844373 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:02.091941 16277 raft_consensus.cc:3060] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:02.095150 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:02.071203 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 228244us
I20260709 13:06:02.100147 16279 raft_consensus.cc:3060] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:02.095085 16948 raft_consensus.cc:2468] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 1.
W20260709 13:06:02.101999 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:02.067997 17968 log.cc:927] Time spent T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 13:06:02.104115 16246 leader_election.cc:304] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:02.112735 16280 raft_consensus.cc:2468] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 2.
I20260709 13:06:02.110278 16276 raft_consensus.cc:2468] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 4.
W20260709 13:06:02.112308 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 155799us
W20260709 13:06:02.113916 16173 leader_election.cc:336] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 1.646s (SENT)
W20260709 13:06:02.074895 17972 log.cc:927] Time spent T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 13:06:02.116868 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:02.115134 16283 raft_consensus.cc:2393] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 in current term 2: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
W20260709 13:06:02.115216 16173 leader_election.cc:336] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 1.679s (SENT)
I20260709 13:06:01.799937 17904 consensus_queue.cc:1059] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.304s
I20260709 13:06:02.116571 17688 raft_consensus.cc:2749] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:01.809819 17917 consensus_queue.cc:1059] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.308s
I20260709 13:06:02.130347 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:02.131305 16355 raft_consensus.cc:2393] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 3: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:06:01.930387 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:01.834532 17886 raft_consensus.cc:493] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:02.119215 17956 consensus_queue.cc:1059] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:02.119691 17602 raft_consensus.cc:2764] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:06:01.826409 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:02.071934 17760 raft_consensus.cc:3060] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:02.070602 17914 raft_consensus.cc:2749] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875) with higher term. Message: Invalid argument: T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for earlier term 3. Current term is 4.
W20260709 13:06:02.124640 16173 leader_election.cc:336] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 1.685s (SENT)
W20260709 13:06:02.104269 17973 log.cc:927] Time spent T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 13:06:01.873575 17501 leader_election.cc:290] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:06:01.867885 16199 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39674 (request call id 112) took 1497 ms (client timeout 1512 ms). Trace:
I20260709 13:06:01.842840 17935 raft_consensus.cc:2804] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:02.121048 16275 raft_consensus.cc:1275] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:06:01.818284 17866 raft_consensus.cc:515] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:06:02.145478 17602 raft_consensus.cc:3055] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:02.147958 17602 raft_consensus.cc:740] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:02.127360 17970 consensus_queue.cc:1048] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 13:06:02.127836 16276 raft_consensus.cc:1275] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:02.111239 17894 raft_consensus.cc:493] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:02.148834 17602 consensus_queue.cc:260] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:02.149121 17894 raft_consensus.cc:515] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:06:02.150036 17971 log.cc:927] Time spent T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.123s	user 0.000s	sys 0.001s
I20260709 13:06:02.150127 17602 raft_consensus.cc:3060] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:02.163182 17961 raft_consensus.cc:2804] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:02.163797 17961 raft_consensus.cc:697] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 3 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:06:01.937204 17854 raft_consensus.cc:515] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:02.138974 16173 leader_election.cc:304] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:02.140232 16282 raft_consensus.cc:2468] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 4.
I20260709 13:06:02.152020 17894 leader_election.cc:290] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:02.138844 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:02.183189 16352 raft_consensus.cc:2376] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 4. Re-sending same reply.
I20260709 13:06:02.178769 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:02.156708 17898 leader_election.cc:290] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:02.134728 17886 raft_consensus.cc:3060] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:02.159017 17946 log.cc:927] Time spent T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 1.134s	user 0.000s	sys 0.005s
I20260709 13:06:02.161779 17866 leader_election.cc:290] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:02.164808 17961 consensus_queue.cc:237] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:03.075476 17886 raft_consensus.cc:515] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:02.171300 17893 raft_consensus.cc:515] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:03.078035 17886 leader_election.cc:290] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:03.079008 17893 leader_election.cc:290] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:02.174511 17959 leader_election.cc:290] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:06:02.147130 16199 rpcz_store.cc:269] 0709 13:06:00.370349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:00.383220 (+ 12871us) service_pool.cc:224] Handling call
0709 13:06:01.867659 (+1484439us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b540002b7d4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:06:01.867803 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2766006656}
I20260709 13:06:02.191668 17838 leader_election.cc:290] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:02.195463 17841 raft_consensus.cc:515] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:03.082679 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:03.083981 17841 leader_election.cc:290] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 3 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:01.828253 17887 consensus_queue.cc:260] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } }
I20260709 13:06:03.085162 17887 raft_consensus.cc:3060] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:03.089946 16199 raft_consensus.cc:2468] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 2.
I20260709 13:06:03.090828 16199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39674 (request call id 129) took 1067 ms. Trace:
I20260709 13:06:03.091252 16199 rpcz_store.cc:276] 0709 13:06:02.023507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:03.082346 (+1058839us) service_pool.cc:224] Handling call
0709 13:06:03.090754 (+  8408us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:03.092453 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:03.093622 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:02.211071 16943 raft_consensus.cc:1240] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:02.211723 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:02.211773 16940 raft_consensus.cc:1240] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 3. Current term is 4. Ops: []
W20260709 13:06:02.214617 16913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:02.156468 16200 consensus_meta.cc:287] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f: Time spent flushing consensus metadata: real 0.524s	user 0.005s	sys 0.005s
I20260709 13:06:02.154809 16283 raft_consensus.cc:1275] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:03.388934 16283 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45218 (request call id 1420) took 1574 ms. Trace:
I20260709 13:06:03.389436 16283 rpcz_store.cc:276] 0709 13:06:01.814325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:02.136414 (+322089us) service_pool.cc:224] Handling call
0709 13:06:02.145052 (+  8638us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:03.386526 (+1241474us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:03.388529 (+  2003us) spinlock_profiling.cc:243] Waited 9.35 ms on lock 0x7b54001a8bd4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f489e01 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6
0709 13:06:03.388849 (+   320us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":21503360}
I20260709 13:06:02.159943 16349 raft_consensus.cc:2468] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 3.
I20260709 13:06:02.184348 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:02.165750 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:02.168004 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:02.334522 17986 raft_consensus.cc:3055] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:03.453478 17986 raft_consensus.cc:740] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
W20260709 13:06:03.453696 16355 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33486 (request call id 109) took 1935 ms (client timeout 1861 ms). Trace:
W20260709 13:06:03.454098 16355 rpcz_store.cc:269] 0709 13:06:01.518751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:02.141334 (+622583us) service_pool.cc:224] Handling call
0709 13:06:03.453625 (+1312291us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:03.454384 17986 consensus_queue.cc:260] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:06:03.455190 16355 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41830 (request call id 1329) took 2017 ms (client timeout 1993 ms). Trace:
I20260709 13:06:03.455749 17986 raft_consensus.cc:3060] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:03.456257 16349 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41830 (request call id 1335) took 2017 ms (client timeout 1760 ms). Trace:
W20260709 13:06:03.456640 16349 rpcz_store.cc:269] 0709 13:06:01.439195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:01.487299 (+ 48104us) service_pool.cc:224] Handling call
0709 13:06:03.456085 (+1968786us) spinlock_profiling.cc:243] Waited 562 ms on lock 0x7b540026a054. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:06:03.456195 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1291845888}
W20260709 13:06:03.457588 16349 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41830 (request call id 1341) took 1946 ms (client timeout 1940 ms). Trace:
W20260709 13:06:03.457907 16349 rpcz_store.cc:269] 0709 13:06:01.510886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:03.457425 (+1946539us) service_pool.cc:211] Skipping call since client already timed out
0709 13:06:03.457534 (+   109us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:06:02.967903 17988 log.cc:927] Time spent T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.742s	user 0.000s	sys 0.002s
I20260709 13:06:03.058030 16206 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60138 (request call id 1313) took 1107 ms. Trace:
I20260709 13:06:03.459045 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:06:03.459834 16349 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41830 (request call id 1330) took 2022 ms (client timeout 2042 ms). Trace:
I20260709 13:06:03.458957 16206 rpcz_store.cc:276] 0709 13:06:01.950655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:01.950880 (+   225us) service_pool.cc:224] Handling call
0709 13:06:02.071003 (+120123us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:02.071246 (+   243us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:06:02.169199 (+ 97953us) log.cc:844] Serialized 14 byte log entry
0709 13:06:03.057728 (+888529us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:03.057776 (+    48us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:03.057805 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:03.057855 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:03.057959 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":140661,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":1327,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":143,"thread_start_us":96031,"threads_started":3,"wal-append.queue_time_us":958}
W20260709 13:06:03.460168 16349 rpcz_store.cc:269] 0709 13:06:01.437867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:03.458654 (+2020787us) service_pool.cc:224] Handling call
0709 13:06:03.459760 (+  1106us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:03.066720 16204 raft_consensus.cc:2468] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 2.
I20260709 13:06:03.460980 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:06:03.461256 16204 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39674 (request call id 130) took 1426 ms (client timeout 1512 ms). Trace:
W20260709 13:06:03.099000 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 974286us
I20260709 13:06:03.461669 16206 raft_consensus.cc:2468] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 2.
W20260709 13:06:03.462152 16173 leader_election.cc:336] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 1.715s (SENT)
I20260709 13:06:03.101626 16199 raft_consensus.cc:2468] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 4.
W20260709 13:06:03.455544 16355 rpcz_store.cc:269] 0709 13:06:01.437616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:03.454996 (+2017380us) service_pool.cc:211] Skipping call since client already timed out
0709 13:06:03.455110 (+   114us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:06:03.463068 16199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39674 (request call id 126) took 1466 ms. Trace:
I20260709 13:06:03.107347 16203 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60138 (request call id 1305) took 1323 ms. Trace:
I20260709 13:06:03.460980 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:03.464471 16349 raft_consensus.cc:2410] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for term 2 because replica has last-logged OpId of term: 1 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:06:03.464913 16349 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41830 (request call id 1292) took 2284 ms (client timeout 2308 ms). Trace:
I20260709 13:06:03.463645 16203 rpcz_store.cc:276] 0709 13:06:01.783516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:01.783676 (+   160us) service_pool.cc:224] Handling call
0709 13:06:01.784183 (+   507us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:01.813840 (+ 29657us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:01.828783 (+ 14943us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:01.932205 (+103422us) log.cc:844] Serialized 26 byte log entry
0709 13:06:02.087945 (+155740us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:02.093359 (+  5414us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:02.113190 (+ 19831us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:03.107013 (+993823us) raft_consensus.cc:1685] finished
0709 13:06:03.107048 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:03.107263 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16308,"raft.queue_time_us":22052,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":11379,"thread_start_us":133959,"threads_started":1,"wal-append.queue_time_us":205719,"wal-append.run_cpu_time_us":2028,"wal-append.run_wall_time_us":1048262}
W20260709 13:06:03.465250 16349 rpcz_store.cc:269] 0709 13:06:01.180399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:03.460757 (+2280358us) service_pool.cc:224] Handling call
0709 13:06:03.464854 (+  4097us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:03.466147 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:03.134163 16278 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45218 (request call id 1404) took 1955 ms. Trace:
I20260709 13:06:02.141007 16274 raft_consensus.cc:2468] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 2.
I20260709 13:06:03.466984 16349 raft_consensus.cc:2410] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:06:03.467290 16274 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45218 (request call id 1417) took 1653 ms (client timeout 2088 ms). Trace:
W20260709 13:06:03.148918 16279 consensus_meta.cc:287] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3: Time spent flushing consensus metadata: real 1.033s	user 0.008s	sys 0.002s
W20260709 13:06:03.467927 16349 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41830 (request call id 1343) took 1956 ms (client timeout 1986 ms). Trace:
I20260709 13:06:03.468430 16279 raft_consensus.cc:2468] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 2.
W20260709 13:06:03.469164 16279 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42740 (request call id 97) took 1658 ms (client timeout 1806 ms). Trace:
W20260709 13:06:03.469625 16279 rpcz_store.cc:269] 0709 13:06:01.811243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:01.844061 (+ 32818us) service_pool.cc:224] Handling call
0709 13:06:03.469086 (+1625025us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:03.156390 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:03.470917 16356 raft_consensus.cc:2376] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 4. Re-sending same reply.
W20260709 13:06:03.471596 16356 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41830 (request call id 1339) took 2031 ms (client timeout 1829 ms). Trace:
W20260709 13:06:03.472064 16356 rpcz_store.cc:269] 0709 13:06:01.440281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:03.156027 (+1715746us) service_pool.cc:224] Handling call
0709 13:06:03.471505 (+315478us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:03.473435 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
W20260709 13:06:03.162468 16249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:03.167691 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:03.476454 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:03.169099 16321 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:03.194008 16277 consensus_meta.cc:287] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3: Time spent flushing consensus metadata: real 1.084s	user 0.011s	sys 0.011s
W20260709 13:06:03.197314 16246 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.078s	user 0.007s	sys 0.009s
I20260709 13:06:03.223006 16205 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60138 (request call id 1311) took 1390 ms. Trace:
I20260709 13:06:03.228251 16281 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45218 (request call id 1406) took 2033 ms. Trace:
I20260709 13:06:03.241317 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:06:03.478330 16321 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:03.249141 16275 raft_consensus.cc:1240] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 2. Current term is 3. Ops: []
W20260709 13:06:03.252306 16248 leader_election.cc:336] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 1.686s (SENT)
I20260709 13:06:03.462664 16173 leader_election.cc:304] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
W20260709 13:06:02.280727 16914 leader_election.cc:336] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 1.793s (SENT)
I20260709 13:06:03.479135 16277 raft_consensus.cc:2468] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 4.
I20260709 13:06:03.477890 16205 rpcz_store.cc:276] 0709 13:06:01.832258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:01.832429 (+   171us) service_pool.cc:224] Handling call
0709 13:06:01.832885 (+   456us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:01.833418 (+   533us) raft_consensus.cc:1534] Early marking committed up to index 1
0709 13:06:01.833509 (+    91us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:01.843600 (+ 10091us) log.cc:844] Serialized 26 byte log entry
0709 13:06:02.123169 (+279569us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:02.123213 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:02.123317 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:03.222647 (+1099330us) raft_consensus.cc:1685] finished
0709 13:06:03.222676 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:03.222875 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":155,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":20829,"thread_start_us":131143,"threads_started":1,"wal-append.queue_time_us":228137,"wal-append.run_cpu_time_us":2068,"wal-append.run_wall_time_us":1002334}
W20260709 13:06:03.483011 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 1.20221e+06us
I20260709 13:06:03.466678 16278 rpcz_store.cc:276] 0709 13:06:01.178455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:01.178862 (+   407us) service_pool.cc:224] Handling call
0709 13:06:01.179268 (+   406us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:01.276741 (+ 97473us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:06:01.556136 (+279395us) log.cc:844] Serialized 14 byte log entry
0709 13:06:01.687260 (+131124us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:01.687324 (+    64us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:01.687380 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:03.133825 (+1446445us) spinlock_profiling.cc:243] Waited 97.1 ms on lock 0x7b54000767d4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f489e01 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6
0709 13:06:03.133891 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:03.134084 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":70861,"prepare.queue_time_us":138163,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":27,"raft.queue_time_us":94,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":39516,"spinlock_wait_cycles":223373696,"thread_start_us":359415,"threads_started":2,"wal-append.queue_time_us":257648,"wal-append.run_cpu_time_us":1116,"wal-append.run_wall_time_us":1031200}
I20260709 13:06:02.989275 17867 raft_consensus.cc:3060] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:03.487110 17838 raft_consensus.cc:2749] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:03.478540 16281 rpcz_store.cc:276] 0709 13:06:01.194833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:01.195886 (+  1053us) service_pool.cc:224] Handling call
0709 13:06:01.196275 (+   389us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:01.423768 (+227493us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:01.423802 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:01.428703 (+  4901us) log.cc:844] Serialized 52 byte log entry
0709 13:06:01.634022 (+205319us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:01.634085 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:03.227884 (+1593799us) spinlock_profiling.cc:243] Waited 219 ms on lock 0x7b54001f59d4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f489e01 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6
0709 13:06:03.227933 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:03.227973 (+    40us) raft_consensus.cc:1685] finished
0709 13:06:03.227982 (+     9us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:03.228196 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":51346,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":98,"spinlock_wait_cycles":503308672,"thread_start_us":160994,"threads_started":1,"wal-append.queue_time_us":515230,"wal-append.run_cpu_time_us":2969,"wal-append.run_wall_time_us":1163725}
I20260709 13:06:03.487797 17838 raft_consensus.cc:493] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.488270 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bc3c8ff9b84838a2664335d7e1582b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:03.488869 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:02.166606 17935 raft_consensus.cc:493] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:03.491995 17935 raft_consensus.cc:3060] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:03.098296 17940 raft_consensus.cc:2749] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:02.217923 17942 raft_consensus.cc:515] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:03.496927 16208 raft_consensus.cc:2410] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:06:03.162954 17959 raft_consensus.cc:493] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.500660 17959 raft_consensus.cc:515] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:06:03.282167 16351 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33486 (request call id 114) took 1744 ms (client timeout 1690 ms). Trace:
W20260709 13:06:03.502812 16351 rpcz_store.cc:269] 0709 13:06:01.537725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:03.281929 (+1744204us) service_pool.cc:211] Skipping call since client already timed out
0709 13:06:03.282076 (+   147us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:06:03.296872 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:03.305729 16276 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.141s	user 0.007s	sys 0.014s
W20260709 13:06:03.504757 16276 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.340s	user 0.008s	sys 0.015s
I20260709 13:06:03.505458 16946 raft_consensus.cc:2393] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 3: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
I20260709 13:06:03.312256 16367 tablet_copy_source_session.cc:215] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:03.506981 16279 raft_consensus.cc:2368] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for earlier term 3. Current term is 4.
I20260709 13:06:03.507122 16367 rpcz_store.cc:275] Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.0.0.1:33486 (request call id 105) took 1992 ms. Trace:
I20260709 13:06:03.507517 16367 rpcz_store.cc:276] 0709 13:06:01.514451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:01.516096 (+  1645us) service_pool.cc:224] Handling call
0709 13:06:03.311779 (+1795683us) spinlock_profiling.cc:243] Waited 360 ms on lock 0x7b54000d8ed4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f4933f7 00007f3624429036 00007f3624432a3e 00007f361bcf627b 00007f36244329ba 00007f362442dacc 00007f3624428c7b 00007f362441d8d1 00007f36234d14b4 00007f36234d1442
0709 13:06:03.507024 (+195245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":827534720}
W20260709 13:06:03.508152 16946 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35106 (request call id 486) took 1728 ms (client timeout 2088 ms). Trace:
I20260709 13:06:03.313575 16200 raft_consensus.cc:2468] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 4.
W20260709 13:06:03.508558 16946 rpcz_store.cc:269] 0709 13:06:01.777839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:01.778008 (+   169us) service_pool.cc:224] Handling call
0709 13:06:03.506341 (+1728333us) spinlock_profiling.cc:243] Waited 1.73 s on lock 0x7b5400418cd4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:06:03.506499 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3970132864}
W20260709 13:06:03.509037 16200 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39674 (request call id 113) took 3069 ms (client timeout 1769 ms). Trace:
W20260709 13:06:03.509418 16200 rpcz_store.cc:269] 0709 13:06:00.439375 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:00.473379 (+ 34004us) service_pool.cc:224] Handling call
0709 13:06:01.177879 (+704500us) spinlock_profiling.cc:243] Waited 36.3 ms on lock 0x7b54004a0220. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f400dc0 00007f361f48ce18 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6
0709 13:06:03.508965 (+2331086us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":83537152}
I20260709 13:06:03.504156 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:03.510712 16351 raft_consensus.cc:2393] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 3: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
W20260709 13:06:03.511107 16351 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41830 (request call id 1325) took 2074 ms (client timeout 2120 ms). Trace:
I20260709 13:06:03.511277 16200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39674 (request call id 128) took 1493 ms. Trace:
W20260709 13:06:03.511474 16351 rpcz_store.cc:269] 0709 13:06:01.436491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:03.503792 (+2067301us) service_pool.cc:224] Handling call
0709 13:06:03.511050 (+  7258us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:03.511695 16200 rpcz_store.cc:276] 0709 13:06:02.017862 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:03.510368 (+1492506us) service_pool.cc:224] Handling call
0709 13:06:03.510743 (+   375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:03.510949 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:03.510976 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:03.511016 (+    40us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:03.511052 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:03.511112 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:03.511226 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:03.512465 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:06:03.513177 16351 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41830 (request call id 1331) took 2075 ms (client timeout 2162 ms). Trace:
I20260709 13:06:03.513545 16200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39674 (request call id 131) took 1476 ms. Trace:
W20260709 13:06:03.513495 16351 rpcz_store.cc:269] 0709 13:06:01.438110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:03.512205 (+2074095us) service_pool.cc:224] Handling call
0709 13:06:03.513123 (+   918us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:03.319859 16320 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.224s	user 0.000s	sys 0.018s
I20260709 13:06:03.498448 17942 leader_election.cc:290] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 3 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:06:03.514998 17781 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
W20260709 13:06:03.467801 16274 rpcz_store.cc:269] 0709 13:06:01.813473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:01.826142 (+ 12669us) service_pool.cc:224] Handling call
0709 13:06:03.467231 (+1641089us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:03.368969 16357 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33486 (request call id 111) took 1849 ms (client timeout 1769 ms). Trace:
I20260709 13:06:03.515962 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
W20260709 13:06:03.516240 16357 rpcz_store.cc:269] 0709 13:06:01.519404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:03.368693 (+1849289us) service_pool.cc:211] Skipping call since client already timed out
0709 13:06:03.368883 (+   190us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:06:03.516786 16274 raft_consensus.cc:2393] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 3: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:06:03.517131 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:03.517735 16357 raft_consensus.cc:2468] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 3.
I20260709 13:06:03.395277 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:03.518150 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:03.519037 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:03.519377 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:03.519733 16283 raft_consensus.cc:2393] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 4: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:06:03.520556 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:03.463442 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:03.521096 16283 raft_consensus.cc:3060] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:03.378237 16350 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41830 (request call id 1299) took 2175 ms (client timeout 2095 ms). Trace:
I20260709 13:06:03.524979 17959 leader_election.cc:290] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:06:03.524879 16350 rpcz_store.cc:269] 0709 13:06:01.202631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:03.377973 (+2175342us) service_pool.cc:211] Skipping call since client already timed out
0709 13:06:03.378150 (+   177us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:06:03.474418 16356 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41830 (request call id 1344) took 1962 ms (client timeout 1995 ms). Trace:
I20260709 13:06:03.525998 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:03.526391 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:03.526687 16350 raft_consensus.cc:2468] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 3.
I20260709 13:06:03.526957 16279 raft_consensus.cc:3060] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:03.527334 16350 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41830 (request call id 1332) took 2089 ms (client timeout 2360 ms). Trace:
W20260709 13:06:03.395993 16174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:03.530323 16246 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.411s	user 0.008s	sys 0.010s
W20260709 13:06:03.530728 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 1.41174e+06us
W20260709 13:06:03.527711 16350 rpcz_store.cc:269] 0709 13:06:01.438361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:03.525694 (+2087333us) service_pool.cc:224] Handling call
0709 13:06:03.527275 (+  1581us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:03.534662 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:06:03.535498 16350 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41830 (request call id 1309) took 2329 ms (client timeout 2648 ms). Trace:
W20260709 13:06:03.535873 16350 rpcz_store.cc:269] 0709 13:06:01.206041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:03.534331 (+2328290us) service_pool.cc:224] Handling call
0709 13:06:03.535431 (+  1100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:03.536856 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:03.537608 16350 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33486 (request call id 123) took 1341 ms. Trace:
I20260709 13:06:03.537936 16350 rpcz_store.cc:276] 0709 13:06:02.196232 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:03.536560 (+1340328us) service_pool.cc:224] Handling call
0709 13:06:03.537547 (+   987us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:03.513998 16200 rpcz_store.cc:276] 0709 13:06:02.037340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:03.512715 (+1475375us) service_pool.cc:224] Handling call
0709 13:06:03.513048 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:03.513221 (+   173us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:03.513248 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:03.513292 (+    44us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:03.513328 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:03.513384 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:03.513496 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:03.539732 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:03.541091 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:03.514456 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
W20260709 13:06:03.542658 16351 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41830 (request call id 1346) took 2030 ms (client timeout 2142 ms). Trace:
W20260709 13:06:03.543006 16351 rpcz_store.cc:269] 0709 13:06:01.512215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:03.514200 (+2001985us) service_pool.cc:224] Handling call
0709 13:06:03.542600 (+ 28400us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:03.544256 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:03.545624 16276 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45218 (request call id 1427) took 1472 ms. Trace:
I20260709 13:06:03.546876 16282 raft_consensus.cc:1240] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:03.549356 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:03.431298 16102 catalog_manager.cc:5697] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f reported cstate change: term changed from 1 to 2, leader changed from 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) to e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65). New cstate: current_term: 2 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:03.431331 16322 connection.cc:256] RPC call timeout handler was delayed by -3.2802624139999352s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1635s for a response
I20260709 13:06:03.550493 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
W20260709 13:06:03.550822 16322 connection.cc:256] RPC call timeout handler was delayed by -2.7042624139999134s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2275s for a response
I20260709 13:06:03.551314 16282 raft_consensus.cc:2368] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for earlier term 4. Current term is 5.
W20260709 13:06:03.439708 16323 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.331s	user 0.010s	sys 0.012s
I20260709 13:06:03.445518 16940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
W20260709 13:06:03.552146 16323 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.450s	user 0.011s	sys 0.012s
I20260709 13:06:03.551700 16102 catalog_manager.cc:5697] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f reported cstate change: term changed from 2 to 3, leader changed from 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) to e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65). New cstate: current_term: 3 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:03.552639 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:03.553179 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:03.450616 16201 raft_consensus.cc:1240] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:03.450580 16202 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60138 (request call id 1291) took 3062 ms. Trace:
I20260709 13:06:03.553843 16282 raft_consensus.cc:3060] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:03.452164 16352 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33486 (request call id 113) took 1915 ms (client timeout 1871 ms). Trace:
I20260709 13:06:03.554919 16201 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60154 (request call id 1254) took 2332 ms. Trace:
W20260709 13:06:03.555111 16352 rpcz_store.cc:269] 0709 13:06:01.537322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:02.184038 (+646716us) service_pool.cc:224] Handling call
0709 13:06:03.452090 (+1268052us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:03.462217 16206 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60138 (request call id 1315) took 1471 ms. Trace:
I20260709 13:06:03.555521 16201 rpcz_store.cc:276] 0709 13:06:01.222210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:01.359899 (+137689us) service_pool.cc:224] Handling call
0709 13:06:03.450398 (+2090499us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:03.553927 (+103529us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:03.554686 (+   759us) spinlock_profiling.cc:243] Waited 2.09 s on lock 0x7b54003d0c50. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f4888ad 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:06:03.554839 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4806660480}
I20260709 13:06:03.556219 16206 rpcz_store.cc:276] 0709 13:06:01.990653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:03.460717 (+1470064us) service_pool.cc:224] Handling call
0709 13:06:03.462160 (+  1443us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:03.557374 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:03.558043 16206 raft_consensus.cc:3060] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:03.186702 16354 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41830 (request call id 1280) took 2049 ms (client timeout 1886 ms). Trace:
I20260709 13:06:03.255456 16280 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45218 (request call id 1426) took 1182 ms. Trace:
W20260709 13:06:03.558732 16354 rpcz_store.cc:269] 0709 13:06:01.137349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:01.147629 (+ 10280us) service_pool.cc:224] Handling call
0709 13:06:03.186392 (+2038763us) spinlock_profiling.cc:243] Waited 85.1 ms on lock 0x7b5400290ed4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:06:03.186610 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":195765120}
I20260709 13:06:03.559239 16280 rpcz_store.cc:276] 0709 13:06:02.073090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:02.096543 (+ 23453us) service_pool.cc:224] Handling call
0709 13:06:03.255208 (+1158665us) spinlock_profiling.cc:243] Waited 15 ms on lock 0x7b5400075dd4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:06:03.255350 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":34611584}
I20260709 13:06:03.559054 16201 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60138 (request call id 1316) took 1466 ms. Trace:
W20260709 13:06:03.481544 16173 leader_election.cc:336] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 1.739s (SENT)
I20260709 13:06:03.560665 16173 leader_election.cc:304] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
W20260709 13:06:03.561697 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 80180.4us
I20260709 13:06:03.554118 16202 rpcz_store.cc:276] 0709 13:06:00.388085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:00.481472 (+ 93387us) service_pool.cc:224] Handling call
0709 13:06:00.481795 (+   323us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:00.518690 (+ 36895us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:00.519584 (+   894us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:01.407559 (+887975us) spinlock_profiling.cc:243] Waited 7.29 ms on lock 0x7b2c000014c8. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361dd82a11 00007f361dd92372 00007f361f4c4a01 00007f361f48943a 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2
0709 13:06:01.408186 (+   627us) log.cc:844] Serialized 26 byte log entry
0709 13:06:01.661238 (+253052us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:01.687933 (+ 26695us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:01.761756 (+ 73823us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:03.450184 (+1688428us) raft_consensus.cc:1685] finished
0709 13:06:03.450200 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:03.450472 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29319,"raft.queue_time_us":23957,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":1924,"spinlock_wait_cycles":16764800,"thread_start_us":216834,"threads_started":1,"wal-append.queue_time_us":435604,"wal-append.run_cpu_time_us":9259,"wal-append.run_wall_time_us":1307516}
I20260709 13:06:03.452562 16353 raft_consensus.cc:2468] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 3.
I20260709 13:06:02.970188 17854 leader_election.cc:290] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 3 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:03.484169 16205 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39674 (request call id 127) took 1480 ms. Trace:
I20260709 13:06:03.482197 17673 raft_consensus.cc:493] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.564765 16205 rpcz_store.cc:276] 0709 13:06:02.004322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:03.483320 (+1478998us) service_pool.cc:224] Handling call
0709 13:06:03.483661 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:03.483839 (+   178us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:03.483866 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:03.483913 (+    47us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:03.483945 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:03.484005 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:03.484113 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:03.565053 17673 raft_consensus.cc:515] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:03.463430 16199 rpcz_store.cc:276] 0709 13:06:01.996866 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:03.093427 (+1096561us) service_pool.cc:224] Handling call
0709 13:06:03.463009 (+369582us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:03.461639 16204 rpcz_store.cc:269] 0709 13:06:02.035263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:02.178340 (+143077us) service_pool.cc:224] Handling call
0709 13:06:03.461196 (+1282856us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:03.485076 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:03.567173 16278 raft_consensus.cc:2393] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 3: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:06:02.228727 17904 consensus_queue.cc:1243] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer e10b16d536674c0bb350a31d7ce5ff7f log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:06:03.568513 16278 raft_consensus.cc:1240] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 LEADER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:03.546059 16276 rpcz_store.cc:276] 0709 13:06:02.073413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:02.163629 (+ 90216us) service_pool.cc:224] Handling call
0709 13:06:02.164001 (+   372us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:02.164389 (+   388us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:06:02.164949 (+   560us) log.cc:844] Serialized 14 byte log entry
0709 13:06:03.505200 (+1340251us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:03.505682 (+   482us) log.cc:844] Serialized 26 byte log entry
0709 13:06:03.505849 (+   167us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:03.505883 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:03.505949 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:03.545379 (+ 39430us) raft_consensus.cc:1685] finished
0709 13:06:03.545407 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:03.545566 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":140,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":33,"raft.queue_time_us":3689,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":179,"spinlock_wait_cycles":1321344,"thread_start_us":1339894,"threads_started":1,"wal-append.queue_time_us":60828}
I20260709 13:06:03.569617 17673 leader_election.cc:290] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:03.570191 16278 raft_consensus.cc:1240] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 LEADER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 3. Current term is 4. Ops: []
W20260709 13:06:03.479120 16348 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41830 (request call id 1316) took 2270 ms (client timeout 2063 ms). Trace:
I20260709 13:06:03.425976 16912 leader_election.cc:304] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
W20260709 13:06:03.571810 16348 rpcz_store.cc:269] 0709 13:06:01.208401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:03.241028 (+2032627us) service_pool.cc:224] Handling call
0709 13:06:03.479025 (+237997us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:03.572412 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 146538us
W20260709 13:06:03.478971 16321 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:03.573411 16321 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:03.489003 16281 raft_consensus.cc:3060] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:03.054384 17911 raft_consensus.cc:3055] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:03.575464 17911 raft_consensus.cc:740] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:06:03.576454 17911 consensus_queue.cc:260] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:03.577497 17911 raft_consensus.cc:3060] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:03.578168 17841 raft_consensus.cc:2804] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:03.578723 17866 raft_consensus.cc:493] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.579162 17760 raft_consensus.cc:493] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.579267 17866 raft_consensus.cc:515] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:03.579721 17760 raft_consensus.cc:515] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:03.498867 17845 raft_consensus.cc:493] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:03.514671 16320 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.418s	user 0.000s	sys 0.019s
I20260709 13:06:03.448478 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:03.449580 16105 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38842 (request call id 210) took 9864 ms. Trace:
W20260709 13:06:03.553416 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:03.483135 16277 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45218 (request call id 1424) took 1667 ms (client timeout 1751 ms). Trace:
W20260709 13:06:03.563418 16353 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33486 (request call id 103) took 2049 ms (client timeout 1793 ms). Trace:
I20260709 13:06:03.563891 17781 raft_consensus.cc:2749] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:03.560840 16280 raft_consensus.cc:1240] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 LEADER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:03.480239 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:03.480477 16248 leader_election.cc:304] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:06:03.490079 16914 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 1.871s (SENT) [suppressed 81 similar messages]
I20260709 13:06:03.488291 17838 raft_consensus.cc:515] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:06:03.498371 16208 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60154 (request call id 1260) took 2273 ms (client timeout 2757 ms). Trace:
I20260709 13:06:03.572085 17983 raft_consensus.cc:3055] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:06:03.518185 16357 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33486 (request call id 104) took 2004 ms (client timeout 2228 ms). Trace:
I20260709 13:06:03.570413 16276 raft_consensus.cc:1240] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 LEADER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:03.582860 17845 raft_consensus.cc:515] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:03.612762 16102 catalog_manager.cc:5697] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f reported cstate change: term changed from 1 to 2, leader changed from 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) to e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65). New cstate: current_term: 2 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:03.628304 16102 catalog_manager.cc:5697] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f reported cstate change: term changed from 1 to 2, leader changed from 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) to e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65). New cstate: current_term: 2 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:03.632743 16102 catalog_manager.cc:5697] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f reported cstate change: term changed from 1 to 2, leader changed from 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) to e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65). New cstate: current_term: 2 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:03.541671 16274 raft_consensus.cc:3060] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:03.584374 16278 raft_consensus.cc:1240] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:03.582504 17866 leader_election.cc:290] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:06:03.584635 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:03.583110 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 1.75262e+06us
I20260709 13:06:03.615407 16200 raft_consensus.cc:3060] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:03.584697 16277 rpcz_store.cc:269] 0709 13:06:01.815544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:01.816711 (+  1167us) service_pool.cc:224] Handling call
0709 13:06:03.483077 (+1666366us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:03.585491 16949 raft_consensus.cc:2393] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 4: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
W20260709 13:06:03.588093 16208 rpcz_store.cc:269] 0709 13:06:01.225185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:01.289027 (+ 63842us) service_pool.cc:224] Handling call
0709 13:06:03.498140 (+2209113us) spinlock_profiling.cc:243] Waited 2.13 s on lock 0x7b54001423d4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:06:03.498288 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4889395584}
I20260709 13:06:03.589342 17838 leader_election.cc:290] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:06:03.584753 16353 rpcz_store.cc:269] 0709 13:06:01.513912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:02.165385 (+651473us) service_pool.cc:224] Handling call
0709 13:06:03.563339 (+1397954us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:03.586768 16275 raft_consensus.cc:3060] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:03.594285 16357 rpcz_store.cc:269] 0709 13:06:01.514174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:03.516887 (+2002713us) service_pool.cc:224] Handling call
0709 13:06:03.518134 (+  1247us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:03.636224 16278 raft_consensus.cc:1240] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:03.592372 17983 raft_consensus.cc:740] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:06:03.639396 16277 raft_consensus.cc:1240] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 1. Current term is 2. Ops: []
W20260709 13:06:03.651994 16173 leader_election.cc:336] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 1.809s (SENT)
I20260709 13:06:03.654222 17983 consensus_queue.cc:260] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:03.640249 16199 raft_consensus.cc:1240] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [term 4 LEADER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:03.640607 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:03.657109 16205 raft_consensus.cc:2468] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 2.
I20260709 13:06:03.607456 16276 raft_consensus.cc:1240] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 LEADER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:03.657490 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:03.610034 16940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:03.658571 16199 raft_consensus.cc:2468] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 2.
I20260709 13:06:03.596230 16280 raft_consensus.cc:1240] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 LEADER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:03.659126 16940 raft_consensus.cc:2393] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 3: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
I20260709 13:06:03.606006 17841 raft_consensus.cc:697] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 LEADER]: Becoming Leader. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:06:03.584287 16105 rpcz_store.cc:276] 0709 13:05:53.585066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:53.585226 (+   160us) service_pool.cc:224] Handling call
0709 13:06:03.449510 (+9864284us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:05:59.060872 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:05:59.130282 (+ 69410us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:05:59.130326 (+    44us) write_op.cc:435] Acquired schema lock
0709 13:05:59.130351 (+    25us) tablet.cc:662] Decoding operations
0709 13:05:59.130838 (+   487us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:05:59.133382 (+  2544us) write_op.cc:641] Partition lock acquired for write op
0709 13:05:59.133427 (+    45us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:05:59.133854 (+   427us) tablet.cc:701] Row locks acquired
0709 13:05:59.133873 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:05:59.134026 (+   153us) write_op.cc:270] Start()
0709 13:05:59.134157 (+   131us) write_op.cc:276] Timestamp: P: 1783602359133978 usec, L: 0
0709 13:05:59.134179 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:05:59.141086 (+  6907us) log.cc:844] Serialized 929 byte log entry
0709 13:05:59.605775 (+464689us) op_driver.cc:464] REPLICATION: finished
0709 13:06:00.161142 (+555367us) spinlock_profiling.cc:243] Waited 22.3 ms on lock 0x7b1800296e00. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f3625264de1 00007f36252715b1 00007f361c39c3f3 00007f361c39e7c1 00007f361c39e779 00007f361c39e709 00007f361c39e6d1 00007f361c39d9cd 000000000038f354 000000000038f199 00007f361c37f83a
0709 13:06:00.161385 (+   243us) write_op.cc:301] APPLY: starting
0709 13:06:00.161491 (+   106us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:00.180725 (+ 19234us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:00.185800 (+  5075us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:00.206032 (+ 20232us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:00.206208 (+   176us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:06:00.206256 (+    48us) write_op.cc:312] APPLY: finished
0709 13:06:00.206475 (+   219us) log.cc:844] Serialized 29 byte log entry
0709 13:06:00.206723 (+   248us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:00.206832 (+   109us) write_op.cc:454] Released schema lock
0709 13:06:00.206901 (+    69us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:00.207325 (+   424us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:00.207364 (+    39us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":194583,"reported_tablets":13,"child_traces":[["op",{"apply.queue_time_us":326582,"apply.run_cpu_time_us":2357,"apply.run_wall_time_us":45928,"num_ops":2,"prepare.queue_time_us":121713,"prepare.run_cpu_time_us":15758,"prepare.run_wall_time_us":267060,"raft.queue_time_us":163079,"raft.run_cpu_time_us":28284,"raft.run_wall_time_us":319869,"replication_time_us":471420,"spinlock_wait_cycles":51203968,"thread_start_us":558320,"threads_started":4,"wal-append.queue_time_us":243382,"wal-append.run_cpu_time_us":24540,"wal-append.run_wall_time_us":1819668}]]}
I20260709 13:06:03.591420 17760 leader_election.cc:290] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:03.655824 17838 raft_consensus.cc:493] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:03.660573 16199 raft_consensus.cc:1275] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:03.661059 17838 raft_consensus.cc:515] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:03.638257 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:03.663581 16204 raft_consensus.cc:2368] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for earlier term 3. Current term is 4.
I20260709 13:06:03.663618 17838 leader_election.cc:290] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:03.658197 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:03.649394 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:03.665117 16204 raft_consensus.cc:1275] T b9e1324823f04d8da5a4b3ddbd061c0e P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:03.665442 16208 raft_consensus.cc:2410] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 13:06:03.601900 16202 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39674 (request call id 132) took 1476 ms. Trace:
I20260709 13:06:03.560297 16201 rpcz_store.cc:276] 0709 13:06:02.092645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:03.557549 (+1464904us) service_pool.cc:224] Handling call
0709 13:06:03.558451 (+   902us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:03.558671 (+   220us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:03.558702 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:03.558752 (+    50us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:03.558786 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:03.558859 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:03.558990 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:03.666390 16202 rpcz_store.cc:276] 0709 13:06:02.125289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:03.562498 (+1437209us) service_pool.cc:224] Handling call
0709 13:06:03.562880 (+   382us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:03.563084 (+   204us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:03.583670 (+ 20586us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:03.583733 (+    63us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:03.583783 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:03.584087 (+   304us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:03.601817 (+ 17730us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:03.637079 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:03.660595 17841 consensus_queue.cc:237] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:03.669697 17911 raft_consensus.cc:493] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.670289 17911 raft_consensus.cc:515] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:03.670967 16276 raft_consensus.cc:1240] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:03.657478 16277 raft_consensus.cc:1240] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:03.672559 17911 leader_election.cc:290] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:03.629560 17845 leader_election.cc:290] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:03.673118 17911 raft_consensus.cc:493] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.673628 17911 raft_consensus.cc:515] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } }
I20260709 13:06:03.672876 16280 raft_consensus.cc:1240] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:03.676396 16280 raft_consensus.cc:1240] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 LEADER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:06:03.677902 16280 raft_consensus.cc:1240] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:06:03.622000 17935 raft_consensus.cc:515] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:03.550442 16355 raft_consensus.cc:2468] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 4.
W20260709 13:06:03.685657 16355 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41830 (request call id 1342) took 2174 ms (client timeout 1980 ms). Trace:
I20260709 13:06:03.634660 16102 catalog_manager.cc:5697] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f reported cstate change: term changed from 1 to 2, leader changed from 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) to e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65). New cstate: current_term: 2 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:03.655871 16173 leader_election.cc:336] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 1.823s (SENT)
W20260709 13:06:03.689157 16173 leader_election.cc:336] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 1.855s (SENT)
W20260709 13:06:03.687275 16355 rpcz_store.cc:269] 0709 13:06:01.511197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:03.463182 (+1951985us) service_pool.cc:224] Handling call
0709 13:06:03.685583 (+222401us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:03.692811 16281 raft_consensus.cc:2468] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 4.
W20260709 13:06:03.694002 16913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:03.693892 16282 raft_consensus.cc:2468] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 3.
I20260709 13:06:03.690701 16173 leader_election.cc:304] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
W20260709 13:06:03.525769 16356 rpcz_store.cc:269] 0709 13:06:01.511740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:03.473044 (+1961304us) service_pool.cc:224] Handling call
0709 13:06:03.474349 (+  1305us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:03.708590 16948 raft_consensus.cc:1240] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:03.709204 16102 catalog_manager.cc:5697] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f reported cstate change: term changed from 1 to 2, leader changed from 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) to e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65). New cstate: current_term: 2 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:03.702994 17983 raft_consensus.cc:3060] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:03.715557 16200 raft_consensus.cc:2468] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 3.
W20260709 13:06:03.716703 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 142810us
I20260709 13:06:03.739859 16912 leader_election.cc:304] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:03.716152 16320 leader_election.cc:304] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:03.742753 16320 leader_election.cc:304] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:03.742967 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:03.740073 16275 raft_consensus.cc:2468] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 3.
I20260709 13:06:03.744055 16355 raft_consensus.cc:2468] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 4.
I20260709 13:06:03.732093 16283 raft_consensus.cc:2468] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 2.
I20260709 13:06:03.744864 16355 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33486 (request call id 118) took 1570 ms. Trace:
I20260709 13:06:03.745453 16355 rpcz_store.cc:276] 0709 13:06:02.194297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:03.742541 (+1548244us) service_pool.cc:224] Handling call
0709 13:06:03.744777 (+  2236us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:03.746140 16206 raft_consensus.cc:2468] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 3.
I20260709 13:06:03.747228 16280 raft_consensus.cc:1275] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:03.749470 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:03.750705 16356 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33486 (request call id 116) took 1984 ms. Trace:
I20260709 13:06:03.751209 16356 rpcz_store.cc:276] 0709 13:06:01.766038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:03.749058 (+1983020us) service_pool.cc:224] Handling call
0709 13:06:03.750621 (+  1563us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:03.752628 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:03.753873 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:03.755168 16355 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33486 (request call id 117) took 1581 ms. Trace:
I20260709 13:06:03.755649 16355 rpcz_store.cc:276] 0709 13:06:02.174272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:03.746478 (+1572206us) service_pool.cc:224] Handling call
0709 13:06:03.755080 (+  8602us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:03.757014 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:03.758782 16102 catalog_manager.cc:5697] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f reported cstate change: term changed from 1 to 2, leader changed from 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) to e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65). New cstate: current_term: 2 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:03.760401 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:03.763172 16912 leader_election.cc:304] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:06:03.764567 16320 leader_election.cc:400] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 election: Vote denied by peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073) with higher term. Message: Invalid argument: T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for earlier term 3. Current term is 4.
I20260709 13:06:03.765376 16320 leader_election.cc:403] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:06:03.768405 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:03.769503 16353 raft_consensus.cc:2468] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 4.
I20260709 13:06:03.770262 16353 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41830 (request call id 1323) took 2334 ms. Trace:
I20260709 13:06:03.770828 16353 rpcz_store.cc:276] 0709 13:06:01.435933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:03.732383 (+2296450us) service_pool.cc:224] Handling call
0709 13:06:03.770180 (+ 37797us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:03.774955 16356 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41830 (request call id 1345) took 2263 ms. Trace:
W20260709 13:06:03.775108 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 285029us
I20260709 13:06:03.775743 16356 rpcz_store.cc:276] 0709 13:06:01.511969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:03.752184 (+2240215us) service_pool.cc:224] Handling call
0709 13:06:03.774838 (+ 22654us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:03.468443 16349 rpcz_store.cc:269] 0709 13:06:01.511470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:03.465889 (+1954419us) service_pool.cc:224] Handling call
0709 13:06:03.467869 (+  1980us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:03.761061 16102 catalog_manager.cc:5697] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f reported cstate change: term changed from 1 to 3, leader changed from 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) to 363bb2f744eb486f9ad726f08214c98e (127.14.180.67). New cstate: current_term: 3 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } }
I20260709 13:06:03.810135 16948 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35122 (request call id 324) took 1569 ms. Trace:
I20260709 13:06:03.811968 16349 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3"
dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
mode: GRACEFUL
new_leader_uuid: "1109f76a0b7b443a84c0327c8707bc63"
 from {username='slave'} at 127.0.0.1:56792
I20260709 13:06:03.812114 16948 rpcz_store.cc:276] 0709 13:06:02.198631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:02.200212 (+  1581us) service_pool.cc:224] Handling call
0709 13:06:02.211429 (+ 11217us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:03.729751 (+1518322us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:03.767586 (+ 37835us) spinlock_profiling.cc:243] Waited 1.5 s on lock 0x7b54006437d4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f489e01 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6
0709 13:06:03.767864 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3442622720}
I20260709 13:06:03.809916 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:03.813804 16354 raft_consensus.cc:3060] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:03.811134 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:03.813452 16102 catalog_manager.cc:5697] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f reported cstate change: term changed from 1 to 2, leader changed from 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) to e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65). New cstate: current_term: 2 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:03.777154 16351 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33486 (request call id 120) took 1582 ms. Trace:
W20260709 13:06:03.814613 16352 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33486 (request call id 119) took 1619 ms (client timeout 1863 ms). Trace:
I20260709 13:06:03.810626 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:06:03.815164 16352 rpcz_store.cc:269] 0709 13:06:02.194826 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:03.753470 (+1558644us) service_pool.cc:224] Handling call
0709 13:06:03.814523 (+ 61053us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:03.815639 16357 raft_consensus.cc:2468] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 3.
I20260709 13:06:03.816249 16357 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33486 (request call id 121) took 1620 ms. Trace:
I20260709 13:06:03.812682 16349 raft_consensus.cc:606] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Received request to transfer leadership to TS 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:06:03.816579 16357 rpcz_store.cc:276] 0709 13:06:02.195567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:03.753549 (+1557982us) service_pool.cc:224] Handling call
0709 13:06:03.816187 (+ 62638us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:03.816725 16349 raft_consensus.cc:614] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:03.817061 16352 raft_consensus.cc:1275] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:03.818022 16352 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41832 (request call id 1356) took 2987 ms. Trace:
I20260709 13:06:03.818296 16357 raft_consensus.cc:1275] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 13:06:03.818684 16349 raft_consensus.cc:1275] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:03.818861 16357 pending_rounds.cc:85] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e: Aborting all ops after (but not including) 1
I20260709 13:06:03.819509 16357 pending_rounds.cc:107] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:06:03.819159 16351 rpcz_store.cc:276] 0709 13:06:02.195154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:03.759994 (+1564840us) service_pool.cc:224] Handling call
0709 13:06:03.777070 (+ 17076us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:03.820194 16357 raft_consensus.cc:2889] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:03.821147 16207 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60138 (request call id 1312) took 1906 ms. Trace:
I20260709 13:06:03.778664 16912 leader_election.cc:304] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:03.821460 16357 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41830 (request call id 1303) took 2617 ms. Trace:
I20260709 13:06:03.819681 16349 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41830 (request call id 1305) took 2615 ms. Trace:
I20260709 13:06:03.818480 16352 rpcz_store.cc:276] 0709 13:06:00.830246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:03.816213 (+2985967us) service_pool.cc:224] Handling call
0709 13:06:03.816640 (+   427us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:03.817703 (+  1063us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:03.817958 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:03.822897 16351 raft_consensus.cc:1275] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:03.821607 16207 rpcz_store.cc:276] 0709 13:06:01.914940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:01.915129 (+   189us) service_pool.cc:224] Handling call
0709 13:06:01.915612 (+   483us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:01.915947 (+   335us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:01.915978 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:03.437433 (+1521455us) spinlock_profiling.cc:243] Waited 24.8 ms on lock 0x7b2c000014c8. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361dd82a11 00007f361dd92372 00007f361f4c4a01 00007f361f48943a 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2
0709 13:06:03.437934 (+   501us) log.cc:844] Serialized 26 byte log entry
0709 13:06:03.726908 (+288974us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:06:03.726990 (+    82us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:03.727110 (+   120us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:03.727185 (+    75us) raft_consensus.cc:1685] finished
0709 13:06:03.727205 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:03.821087 (+ 93882us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":11306,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":154,"spinlock_wait_cycles":56995200,"thread_start_us":288467,"threads_started":1,"wal-append.queue_time_us":84991}
I20260709 13:06:03.823506 16351 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41830 (request call id 1306) took 2618 ms. Trace:
I20260709 13:06:03.823689 16352 raft_consensus.cc:1275] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:03.824460 16352 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41830 (request call id 1315) took 2616 ms. Trace:
I20260709 13:06:03.825928 16352 rpcz_store.cc:276] 0709 13:06:01.208114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:03.822922 (+2614808us) service_pool.cc:224] Handling call
0709 13:06:03.823339 (+   417us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:03.824189 (+   850us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:03.824406 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:03.822324 16357 rpcz_store.cc:276] 0709 13:06:01.204013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:03.817417 (+2613404us) service_pool.cc:224] Handling call
0709 13:06:03.817883 (+   466us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:03.821075 (+  3192us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:03.821406 (+   331us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:03.830650 16349 rpcz_store.cc:276] 0709 13:06:01.204693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:03.817949 (+2613256us) service_pool.cc:224] Handling call
0709 13:06:03.818267 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:03.819398 (+  1131us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:03.819625 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:03.864784 16349 raft_consensus.cc:1240] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:03.865792 16349 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41830 (request call id 1321) took 2430 ms. Trace:
W20260709 13:06:03.866205 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 101826us
I20260709 13:06:03.866317 16349 rpcz_store.cc:276] 0709 13:06:01.435211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:03.864045 (+2428834us) service_pool.cc:224] Handling call
0709 13:06:03.864529 (+   484us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:03.865555 (+  1026us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:03.865737 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:03.867700 18009 raft_consensus.cc:3060] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:03.823977 16351 rpcz_store.cc:276] 0709 13:06:01.205028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:03.820464 (+2615436us) service_pool.cc:224] Handling call
0709 13:06:03.822585 (+  2121us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:03.823263 (+   678us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:03.823456 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:03.868247 16349 raft_consensus.cc:1275] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 2. (term mismatch)
I20260709 13:06:03.868845 16349 pending_rounds.cc:85] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e: Aborting all ops after (but not including) 1
W20260709 13:06:03.869592 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 93224.7us
I20260709 13:06:03.869454 16357 raft_consensus.cc:1275] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:06:03.828231 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 295952us
I20260709 13:06:03.776589 17760 raft_consensus.cc:2804] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:03.860340 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
W20260709 13:06:03.861930 16914 leader_election.cc:336] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 1.861s (SENT)
I20260709 13:06:03.880324 16914 leader_election.cc:304] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:03.809954 17838 raft_consensus.cc:493] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:03.887895 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:03.810012 17845 raft_consensus.cc:2749] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:03.767323 17866 raft_consensus.cc:2804] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:03.870926 16322 leader_election.cc:304] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:06:03.871085 16357 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41830 (request call id 1320) took 2492 ms. Trace:
I20260709 13:06:03.822338 18002 raft_consensus.cc:2804] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:03.859303 17942 raft_consensus.cc:493] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:03.896317 16206 raft_consensus.cc:1275] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:03.882687 16355 raft_consensus.cc:2468] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 4.
I20260709 13:06:03.900280 16914 leader_election.cc:304] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:06:03.900569 16355 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33486 (request call id 101) took 2387 ms. Trace:
I20260709 13:06:03.900702 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:03.870209 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:03.905128 16352 raft_consensus.cc:1275] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:06:03.869454 16351 raft_consensus.cc:1275] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:06:03.889652 16353 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33486 (request call id 124) took 1693 ms. Trace:
I20260709 13:06:03.891327 16357 rpcz_store.cc:276] 0709 13:06:01.379083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:03.827905 (+2448822us) service_pool.cc:224] Handling call
0709 13:06:03.869194 (+ 41289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:03.870817 (+  1623us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:03.871027 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:03.872022 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 183466us
I20260709 13:06:03.892511 17841 raft_consensus.cc:2804] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:03.874191 16279 raft_consensus.cc:2410] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:06:03.824591 17998 raft_consensus.cc:493] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:03.809753 17904 consensus_queue.cc:1048] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.064s
I20260709 13:06:03.869151 16349 pending_rounds.cc:107] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 1.2
I20260709 13:06:03.912431 16349 raft_consensus.cc:2917] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Aborting config change with OpId 1.2: Aborted: Op aborted by new leader
I20260709 13:06:03.883424 16354 raft_consensus.cc:2468] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 4.
I20260709 13:06:03.902729 17863 consensus_queue.cc:1048] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:03.903272 17935 leader_election.cc:290] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 5 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:03.903707 17911 leader_election.cc:290] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:03.879046 17760 raft_consensus.cc:493] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:03.906972 16353 rpcz_store.cc:276] 0709 13:06:02.196602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:03.811553 (+1614951us) service_pool.cc:224] Handling call
0709 13:06:03.889570 (+ 78017us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1766272}
I20260709 13:06:03.906502 16351 pending_rounds.cc:85] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e: Aborting all ops after (but not including) 1
W20260709 13:06:03.908102 16173 connection.cc:256] RPC call timeout handler was delayed by -1.5193989480000027s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1797s for a response
I20260709 13:06:03.821372 18001 raft_consensus.cc:2804] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:03.907557 16350 raft_consensus.cc:3060] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:03.901140 16355 rpcz_store.cc:276] 0709 13:06:01.513380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:03.756647 (+2243267us) service_pool.cc:224] Handling call
0709 13:06:03.900420 (+143773us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:03.892724 17866 raft_consensus.cc:493] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:03.892994 18002 raft_consensus.cc:493] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
W20260709 13:06:03.913535 16354 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41830 (request call id 1302) took 2709 ms (client timeout 3330 ms). Trace:
I20260709 13:06:03.903275 17986 raft_consensus.cc:2749] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:06:03.911230 18006 log.cc:927] Time spent T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63: Append to log took a long time: real 0.204s	user 0.003s	sys 0.000s
I20260709 13:06:03.921335 16351 pending_rounds.cc:107] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e: Aborting uncommitted NO_OP operation due to leader change: 2.2
W20260709 13:06:03.921360 16173 connection.cc:256] RPC call timeout handler was delayed by -1.5026087539999935s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2275s for a response
I20260709 13:06:03.892115 17838 raft_consensus.cc:515] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:06:03.930295 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:03.933456 16354 rpcz_store.cc:269] 0709 13:06:01.203669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:03.742256 (+2538587us) service_pool.cc:224] Handling call
0709 13:06:03.913151 (+170895us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:03.934680 16353 raft_consensus.cc:1240] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:03.935194 16351 raft_consensus.cc:2889] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:06:03.952613 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:03.935097 16349 raft_consensus.cc:2889] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:06:03.935274 16173 leader_election.cc:336] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 1.932s (SENT)
I20260709 13:06:03.954427 16173 leader_election.cc:304] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
W20260709 13:06:03.956426 16173 connection.cc:256] RPC call timeout handler was delayed by -1.3877281650001123s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1688s for a response
W20260709 13:06:03.957378 16173 connection.cc:256] RPC call timeout handler was delayed by -1.2979989479999858s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20430000000000004s for a response
W20260709 13:06:03.957824 16173 connection.cc:256] RPC call timeout handler was delayed by -1.2898989479999727s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20520000000000002s for a response
I20260709 13:06:03.959823 16353 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33486 (request call id 100) took 2446 ms. Trace:
I20260709 13:06:03.960548 16353 rpcz_store.cc:276] 0709 13:06:01.513133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:03.920841 (+2407708us) service_pool.cc:224] Handling call
0709 13:06:03.934467 (+ 13626us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:03.959424 (+ 24957us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:03.959730 (+   306us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:03.963055 16174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:03.964039 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 711674us
W20260709 13:06:03.965204 16248 leader_election.cc:336] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 1.687s (SENT)
I20260709 13:06:03.936741 17854 raft_consensus.cc:2804] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:06:03.941558 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:03.941689 16352 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41830 (request call id 1319) took 2574 ms. Trace:
I20260709 13:06:03.969192 16352 rpcz_store.cc:276] 0709 13:06:01.366883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:03.827098 (+2460215us) service_pool.cc:224] Handling call
0709 13:06:03.869782 (+ 42684us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:03.905554 (+ 35772us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:03.941395 (+ 35841us) spinlock_profiling.cc:243] Waited 34.9 ms on lock 0x7b540032bc54. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f489e01 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6
0709 13:06:03.941618 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":80208768}
I20260709 13:06:03.901965 17942 raft_consensus.cc:515] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:03.953393 16354 raft_consensus.cc:1275] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:06:03.971942 16354 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33486 (request call id 106) took 2454 ms. Trace:
I20260709 13:06:03.972520 16354 rpcz_store.cc:276] 0709 13:06:01.517708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:03.952726 (+2435018us) service_pool.cc:224] Handling call
0709 13:06:03.953050 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:03.971487 (+ 18437us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:03.971857 (+   370us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:03.973205 16321 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:03.953434 16351 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41830 (request call id 1324) took 2517 ms. Trace:
W20260709 13:06:03.958235 16173 connection.cc:256] RPC call timeout handler was delayed by -1.289581877000046s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24910000000000002s for a response
W20260709 13:06:03.973891 16173 connection.cc:256] RPC call timeout handler was delayed by -1.2799989479999567s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20630000000000004s for a response
I20260709 13:06:03.935386 17935 raft_consensus.cc:2749] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:03.974653 17781 raft_consensus.cc:2749] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:03.973724 16351 rpcz_store.cc:276] 0709 13:06:01.436194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:03.868804 (+2432610us) service_pool.cc:224] Handling call
0709 13:06:03.869110 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:03.953083 (+ 83973us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:03.953356 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:03.974305 16173 connection.cc:256] RPC call timeout handler was delayed by -1.2637989480000442s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2081s for a response
W20260709 13:06:03.976022 16173 connection.cc:256] RPC call timeout handler was delayed by -1.202598948000059s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2149s for a response
W20260709 13:06:03.976336 16173 connection.cc:256] RPC call timeout handler was delayed by -1.1692989480000051s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21860000000000002s for a response
W20260709 13:06:03.976653 16173 connection.cc:256] RPC call timeout handler was delayed by -1.1683989480000037s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2187s for a response
W20260709 13:06:03.976953 16173 connection.cc:256] RPC call timeout handler was delayed by -1.1278989480000519s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22320000000000004s for a response
W20260709 13:06:03.977345 16173 connection.cc:256] RPC call timeout handler was delayed by -1.0026540720000412s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2002s for a response
W20260709 13:06:03.966715 16248 leader_election.cc:336] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 1.696s (SENT)
I20260709 13:06:03.923470 17760 raft_consensus.cc:3060] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:03.978508 17845 consensus_queue.cc:1059] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:03.979929 17845 raft_consensus.cc:3055] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:03.980513 17845 raft_consensus.cc:740] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:03.981791 17845 consensus_queue.cc:260] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:03.984135 17845 raft_consensus.cc:3060] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:03.987367 16248 leader_election.cc:304] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
W20260709 13:06:03.989228 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 210676us
I20260709 13:06:03.991734 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:03.992182 16940 raft_consensus.cc:1275] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:06:03.992843 16912 leader_election.cc:304] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:03.995324 17959 raft_consensus.cc:2749] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:06:04.004498 16321 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:03.998889 16248 leader_election.cc:336] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 1.932s (SENT)
I20260709 13:06:04.011868 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:04.052064 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:04.052692 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:04.052975 16206 raft_consensus.cc:2468] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 2.
I20260709 13:06:04.053610 16201 raft_consensus.cc:3060] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:03.934159 18001 raft_consensus.cc:697] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 LEADER]: Becoming Leader. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
W20260709 13:06:04.062251 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:04.062677 16349 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:33478 (request call id 10) took 9027 ms. Trace:
I20260709 13:06:04.064146 16352 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33486 (request call id 108) took 2545 ms. Trace:
I20260709 13:06:04.064615 16352 rpcz_store.cc:276] 0709 13:06:01.518372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:03.970802 (+2452430us) service_pool.cc:224] Handling call
0709 13:06:04.063604 (+ 92802us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:04.063796 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:04.063824 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:04.063865 (+    41us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:04.063904 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:04.063959 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:04.064079 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:04.065034 16353 raft_consensus.cc:1275] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:03.934656 17715 tablet_copy_client.cc:538] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 13:06:04.014899 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:04.063089 16349 rpcz_store.cc:276] 0709 13:05:55.016562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:55.020615 (+  4053us) service_pool.cc:224] Handling call
0709 13:05:55.161228 (+140613us) log.cc:844] Serialized 506 byte log entry
0709 13:05:55.700092 (+538864us) spinlock_profiling.cc:243] Waited 3.2 ms on lock 0x7b1800415480. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f3625264de1 00007f36252715b1 00007f361c39c3f3 00007f361c39e7c1 00007f361c39e779 00007f361c39e709 00007f361c39e6d1 00007f361c39d9cd 000000000038f354 000000000038f199 00007f361c37f83a
0709 13:05:56.463510 (+763418us) spinlock_profiling.cc:243] Waited 1.8 ms on lock 0x7b1800415480. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f3625264de1 00007f36252715b1 00007f361c37ee07 00007f36251d9ab9 00007f361c39b69b 00007f361c39993f 00007f361c399455 00007f361f3e2b0b 00007f361f467b63 00007f361f48f752 00007f362444fd29
0709 13:05:57.361166 (+897656us) spinlock_profiling.cc:243] Waited 3.45 ms on lock 0x7b540017f5a0. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f402142 00007f361f3e2eaa 00007f361f3e9d53 00007f361f3e9cd9 00007f361f3e9c69 00007f361f3e9c31 00007f361f3e8dfd 000000000038f354 000000000038f199 00007f361c39c475
0709 13:06:04.012976 (+6651810us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":114032,"raft.queue_time_us":267942,"raft.run_cpu_time_us":15469,"raft.run_wall_time_us":2038844,"spinlock_wait_cycles":19461760,"thread_start_us":608260,"threads_started":2,"wal-append.queue_time_us":259837,"wal-append.run_cpu_time_us":11630,"wal-append.run_wall_time_us":1598227}
I20260709 13:06:03.930967 17911 raft_consensus.cc:493] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:03.933053 17866 raft_consensus.cc:3060] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:03.929919 18004 raft_consensus.cc:493] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.091008 18004 raft_consensus.cc:515] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:04.091915 16357 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33486 (request call id 99) took 2579 ms. Trace:
I20260709 13:06:04.092530 16357 rpcz_store.cc:276] 0709 13:06:01.512830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:03.909154 (+2396324us) service_pool.cc:224] Handling call
0709 13:06:03.919424 (+ 10270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:03.962885 (+ 43461us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:03.962932 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:03.962999 (+    67us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:03.963046 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:04.091606 (+128560us) spinlock_profiling.cc:243] Waited 43.1 ms on lock 0x7b540028b4d4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f489e01 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6
0709 13:06:04.091669 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:04.091852 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":99205376}
W20260709 13:06:04.043965 16321 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:04.095270 16321 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:04.044482 16248 leader_election.cc:304] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:06:04.054872 16914 leader_election.cc:336] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 2.228s (SENT)
I20260709 13:06:03.934731 18002 raft_consensus.cc:3060] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:03.934397 17999 raft_consensus.cc:2749] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:03.913252 17998 raft_consensus.cc:515] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:03.968140 17854 raft_consensus.cc:493] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:04.072952 16948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:04.074369 16353 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33486 (request call id 107) took 2556 ms. Trace:
I20260709 13:06:04.081594 17911 raft_consensus.cc:515] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:04.082167 17781 consensus_queue.cc:1059] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:04.083469 16349 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41830 (request call id 1322) took 2647 ms. Trace:
I20260709 13:06:04.119168 16353 rpcz_store.cc:276] 0709 13:06:01.518048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:03.961684 (+2443636us) service_pool.cc:224] Handling call
0709 13:06:04.040043 (+ 78359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:04.071312 (+ 31269us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:04.071836 (+   524us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:04.121582 16349 rpcz_store.cc:276] 0709 13:06:01.435632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:03.867514 (+2431882us) service_pool.cc:224] Handling call
0709 13:06:03.867846 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:04.083178 (+215332us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:04.083393 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:04.084451 16203 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60138 (request call id 1314) took 2119 ms. Trace:
I20260709 13:06:04.096725 16914 leader_election.cc:304] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:04.121124 16278 raft_consensus.cc:1217] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 LEADER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
W20260709 13:06:04.097074 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:04.123134 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 68345.4us
I20260709 13:06:04.061808 17962 raft_consensus.cc:493] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.069752 17959 raft_consensus.cc:493] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.123150 16278 raft_consensus.cc:1240] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 LEADER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 1. Current term is 2. Ops: [1.2-1.2]
I20260709 13:06:04.119458 16948 raft_consensus.cc:2393] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 3: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
W20260709 13:06:04.104254 16320 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:04.079411 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:04.096606 17935 raft_consensus.cc:2804] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:06:04.198987 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 328117us
I20260709 13:06:04.066768 17760 raft_consensus.cc:515] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:04.103703 18015 raft_consensus.cc:493] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.216441 16201 raft_consensus.cc:2468] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 5.
I20260709 13:06:04.071496 16348 raft_consensus.cc:2468] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 2.
I20260709 13:06:04.062260 17673 consensus_queue.cc:1059] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.051s
I20260709 13:06:04.120927 17854 raft_consensus.cc:3060] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:04.214401 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 143932us
W20260709 13:06:04.221014 16320 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:04.236193 16320 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:04.236536 16249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:04.236683 16173 leader_election.cc:304] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:04.199034 17965 raft_consensus.cc:493] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.202952 17999 raft_consensus.cc:493] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
W20260709 13:06:04.229365 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 135088us
W20260709 13:06:04.230037 16913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:04.218729 16202 raft_consensus.cc:2468] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 2.
I20260709 13:06:04.228251 17886 raft_consensus.cc:2749] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:04.211949 17838 leader_election.cc:290] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:04.233613 16280 raft_consensus.cc:1240] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:04.234066 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:04.234658 16275 raft_consensus.cc:1240] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:04.234730 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:04.235281 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
W20260709 13:06:04.263129 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 264788us
I20260709 13:06:04.238463 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:04.222856 17935 raft_consensus.cc:697] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 LEADER]: Becoming Leader. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
W20260709 13:06:04.232090 16274 consensus_meta.cc:287] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3: Time spent flushing consensus metadata: real 0.587s	user 0.008s	sys 0.003s
I20260709 13:06:04.229666 16322 leader_election.cc:304] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:04.240250 16246 leader_election.cc:304] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:04.259795 16206 raft_consensus.cc:1275] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:04.209720 17962 raft_consensus.cc:515] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:06:04.260914 16154 auto_rebalancer.cc:629] Failed to schedule move for tablet c7d554054f014c74992a2a66ff6873cd: Aborted: Op aborted by new leader
I20260709 13:06:04.258419 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:06:04.301693 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:04.303637 16201 raft_consensus.cc:2468] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 2.
I20260709 13:06:04.303990 16278 raft_consensus.cc:3060] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:06:04.261086 18004 leader_election.cc:290] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:06:04.235706 16348 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33486 (request call id 115) took 2697 ms (client timeout 3330 ms). Trace:
I20260709 13:06:04.306990 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:04.285084 17904 raft_consensus.cc:493] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:04.294051 16248 leader_election.cc:336] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 1.950s (SENT)
I20260709 13:06:04.297138 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:04.297828 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:04.316991 16277 raft_consensus.cc:2376] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 2. Re-sending same reply.
I20260709 13:06:04.239331 18016 raft_consensus.cc:2749] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:06:04.285035 16378 debug-util.cc:398] Leaking SignalData structure 0x7b080019fe00 after lost signal to thread 15057
I20260709 13:06:04.303007 16283 raft_consensus.cc:2468] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 2.
I20260709 13:06:04.200270 17841 raft_consensus.cc:697] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 LEADER]: Becoming Leader. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
W20260709 13:06:04.301307 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 64648.4us
I20260709 13:06:04.232545 17959 raft_consensus.cc:515] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:04.309016 16280 raft_consensus.cc:3060] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:04.265039 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:06:04.309511 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 69359.2us
I20260709 13:06:04.478277 16276 raft_consensus.cc:2393] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 in current term 2: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:06:04.225163 18015 raft_consensus.cc:515] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:04.366888 16173 leader_election.cc:304] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:06:04.390275 16355 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33486 (request call id 102) took 2876 ms. Trace:
W20260709 13:06:04.391716 18024 log.cc:927] Time spent T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.086s	user 0.002s	sys 0.000s
W20260709 13:06:04.353785 18020 log.cc:927] Time spent T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:06:04.387730 18022 raft_consensus.cc:2749] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:06:04.352753 18023 log.cc:927] Time spent T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 13:06:04.354575 18013 log.cc:927] Time spent T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.139s	user 0.000s	sys 0.001s
I20260709 13:06:04.449057 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:04.261693 17999 raft_consensus.cc:515] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:04.374903 18010 raft_consensus.cc:493] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.389904 16281 raft_consensus.cc:2393] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 in current term 2: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:06:04.319459 17942 leader_election.cc:290] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:04.291462 17965 raft_consensus.cc:515] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:04.348367 16274 raft_consensus.cc:2410] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:04.374331 16282 raft_consensus.cc:3060] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:04.126179 16203 rpcz_store.cc:276] 0709 13:06:01.965455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:03.465511 (+1500056us) service_pool.cc:224] Handling call
0709 13:06:03.465885 (+   374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:03.466119 (+   234us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:06:03.775634 (+309515us) log.cc:844] Serialized 14 byte log entry
0709 13:06:04.083898 (+308264us) spinlock_profiling.cc:243] Waited 29.5 ms on lock 0x7b1800441ee0. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f3625264de1 00007f36252715b1 00007f361f0314bc 00007f361c37f48b 00007f36251d9ab9 00007f361c39b69b 00007f361c39993f 00007f361c39bc02 00007f361f02320b 00007f361f028d23 00007f361f02923a
0709 13:06:04.084082 (+   184us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:04.084148 (+    66us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:04.084188 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:04.084259 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:04.084395 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":344528,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":1679,"spinlock_wait_cycles":67760512,"thread_start_us":358237,"threads_started":2,"wal-append.queue_time_us":130272}
I20260709 13:06:04.321063 17904 raft_consensus.cc:515] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:04.261274 18001 consensus_queue.cc:237] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:04.389159 17863 raft_consensus.cc:493] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:04.360215 16321 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:04.475415 16248 leader_election.cc:336] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 2.129s (SENT)
I20260709 13:06:04.321944 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
W20260709 13:06:04.534327 16321 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:04.534300 16248 leader_election.cc:304] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:04.448096 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:04.321331 16350 raft_consensus.cc:2468] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 4.
W20260709 13:06:04.307546 16348 rpcz_store.cc:269] 0709 13:06:01.538049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:03.944679 (+2406630us) service_pool.cc:224] Handling call
0709 13:06:04.232359 (+287680us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:04.305152 16912 leader_election.cc:304] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
W20260709 13:06:04.538702 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 233615us
I20260709 13:06:04.486120 17760 leader_election.cc:290] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:04.483847 16355 rpcz_store.cc:276] 0709 13:06:01.513644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:03.926233 (+2412589us) service_pool.cc:224] Handling call
0709 13:06:03.931106 (+  4873us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:04.213949 (+282843us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:04.213991 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:04.214036 (+    45us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:04.214070 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:04.389989 (+175919us) spinlock_profiling.cc:243] Waited 281 ms on lock 0x7b54002292d4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f489e01 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6
0709 13:06:04.390047 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:04.390209 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":646018816}
I20260709 13:06:04.470381 17911 leader_election.cc:290] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:04.514595 16206 raft_consensus.cc:3060] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:04.452123 17886 raft_consensus.cc:493] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
W20260709 13:06:04.320953 16378 debug-util.cc:398] Leaking SignalData structure 0x7b08001a61a0 after lost signal to thread 15060
W20260709 13:06:04.539181 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 309568us
W20260709 13:06:04.484140 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 117369us
W20260709 13:06:04.538740 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 63377.1us
I20260709 13:06:04.496259 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:04.494482 17673 raft_consensus.cc:3055] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:04.488278 18003 raft_consensus.cc:493] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:04.548313 16279 raft_consensus.cc:1240] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:04.510174 17781 raft_consensus.cc:2749] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:06:04.550175 16321 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:04.551326 16173 leader_election.cc:400] T b9e1324823f04d8da5a4b3ddbd061c0e P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 2 election: Vote denied by peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107) with higher term. Message: Invalid argument: T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for earlier term 2. Current term is 3.
I20260709 13:06:04.563005 16173 leader_election.cc:403] T b9e1324823f04d8da5a4b3ddbd061c0e P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
W20260709 13:06:04.552068 16248 connection.cc:256] RPC call timeout handler was delayed by -1.1823320340000691s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1718s for a response
W20260709 13:06:04.563655 16248 connection.cc:256] RPC call timeout handler was delayed by -1.1517320340000197s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17520000000000002s for a response
W20260709 13:06:04.564040 16248 connection.cc:256] RPC call timeout handler was delayed by -1.0841406560000451s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1544s for a response
W20260709 13:06:04.564332 16248 connection.cc:256] RPC call timeout handler was delayed by -1.050688353000055s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.26480000000000004s for a response
W20260709 13:06:04.564651 16248 connection.cc:256] RPC call timeout handler was delayed by -1.0184406560000525s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1617s for a response
I20260709 13:06:04.572407 16248 leader_election.cc:304] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:06:04.549139 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:04.554589 16322 leader_election.cc:304] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:06:04.573725 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:04.473718 17935 consensus_queue.cc:237] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:04.545857 16274 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45210 (request call id 1300) took 1201 ms. Trace:
I20260709 13:06:04.588438 16248 leader_election.cc:304] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:06:04.549361 16350 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33486 (request call id 122) took 2350 ms (client timeout 1861 ms). Trace:
I20260709 13:06:04.557065 17911 raft_consensus.cc:493] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:04.559644 17673 raft_consensus.cc:740] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:04.541309 17863 raft_consensus.cc:515] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:04.512369 17841 consensus_queue.cc:237] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:04.576555 17998 leader_election.cc:290] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:04.540611 18010 raft_consensus.cc:515] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:04.607774 17854 raft_consensus.cc:515] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:04.585351 18004 raft_consensus.cc:2749] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:06:04.596205 16378 debug-util.cc:398] Leaking SignalData structure 0x7b08000efc00 after lost signal to thread 16140
I20260709 13:06:04.558965 17886 raft_consensus.cc:515] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:04.593083 17962 leader_election.cc:290] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:04.617993 17959 leader_election.cc:290] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:04.567370 18003 raft_consensus.cc:515] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:04.620057 18022 raft_consensus.cc:2749] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:04.599958 17911 raft_consensus.cc:515] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:04.627818 17962 raft_consensus.cc:2749] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:06:04.637768 17983 consensus_meta.cc:287] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 0.896s	user 0.011s	sys 0.002s
W20260709 13:06:04.646494 18009 consensus_meta.cc:287] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 0.778s	user 0.005s	sys 0.006s
I20260709 13:06:04.649636 18009 raft_consensus.cc:2749] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073) with higher term. Message: Invalid argument: T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for earlier term 3. Current term is 4.
I20260709 13:06:04.654915 18015 leader_election.cc:290] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:04.568818 16200 raft_consensus.cc:3060] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:04.684926 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 195090us
I20260709 13:06:04.688519 16246 leader_election.cc:304] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:04.691439 16246 leader_election.cc:304] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
W20260709 13:06:04.692670 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 141361us
I20260709 13:06:04.693068 16246 leader_election.cc:304] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:04.579382 16274 rpcz_store.cc:276] 0709 13:06:03.339837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:03.540817 (+200980us) service_pool.cc:224] Handling call
0709 13:06:04.541646 (+1000829us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:04.698244 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 123883us
W20260709 13:06:04.699906 16320 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:04.623247 16378 debug-util.cc:398] Leaking SignalData structure 0x7b08000efd20 after lost signal to thread 16154
W20260709 13:06:04.593498 16350 rpcz_store.cc:269] 0709 13:06:02.195889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:03.740309 (+1544420us) service_pool.cc:224] Handling call
0709 13:06:04.546282 (+805973us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:04.703157 16378 debug-util.cc:398] Leaking SignalData structure 0x7b08003b9660 after lost signal to thread 16232
W20260709 13:06:04.703640 16378 debug-util.cc:398] Leaking SignalData structure 0x7b08003b9340 after lost signal to thread 16233
I20260709 13:06:04.699985 16322 leader_election.cc:304] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:06:04.705344 16378 debug-util.cc:398] Leaking SignalData structure 0x7b08003ba1e0 after lost signal to thread 16307
W20260709 13:06:04.705847 16378 debug-util.cc:398] Leaking SignalData structure 0x7b08003ba040 after lost signal to thread 16308
W20260709 13:06:04.708436 16378 debug-util.cc:398] Leaking SignalData structure 0x7b08003a6ee0 after lost signal to thread 16381
W20260709 13:06:04.709015 16378 debug-util.cc:398] Leaking SignalData structure 0x7b080031e300 after lost signal to thread 16382
I20260709 13:06:04.708367 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c15d8e9be8414c84912ab77b66bfb1" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:04.709167 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:04.710251 16203 raft_consensus.cc:2410] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for term 5 because replica has last-logged OpId of term: 4 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:04.708130 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:06:04.711069 16378 debug-util.cc:398] Leaking SignalData structure 0x7b08003df2a0 after lost signal to thread 16973
I20260709 13:06:04.628644 17760 consensus_queue.cc:1059] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.088s
I20260709 13:06:04.714668 17673 consensus_queue.cc:260] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:06:04.720084 16378 debug-util.cc:398] Leaking SignalData structure 0x7b08003df3a0 after lost signal to thread 16974
W20260709 13:06:04.720559 16378 debug-util.cc:398] Leaking SignalData structure 0x7b08003df320 after lost signal to thread 17618
W20260709 13:06:04.720948 16378 debug-util.cc:398] Leaking SignalData structure 0x7b08003df2c0 after lost signal to thread 17727
W20260709 13:06:04.722725 16320 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:04.637089 17845 consensus_meta.cc:287] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f: Time spent flushing consensus metadata: real 0.652s	user 0.017s	sys 0.005s
I20260709 13:06:04.729115 16280 raft_consensus.cc:2468] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 3.
I20260709 13:06:04.729252 16278 raft_consensus.cc:2468] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 4.
I20260709 13:06:04.731237 17959 consensus_queue.cc:1048] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:04.732537 18017 raft_consensus.cc:2749] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:04.493201 18039 consensus_queue.cc:1048] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.257s
W20260709 13:06:04.743258 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 154759us
I20260709 13:06:04.744858 17838 raft_consensus.cc:3055] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:04.745630 17838 raft_consensus.cc:740] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:04.746831 16322 leader_election.cc:304] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:04.747929 18004 raft_consensus.cc:2804] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:04.748545 18004 raft_consensus.cc:493] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:04.749172 18004 raft_consensus.cc:3060] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:04.749487 17962 raft_consensus.cc:2804] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:04.750350 17962 raft_consensus.cc:697] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:04.720953 17673 raft_consensus.cc:3060] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:04.545475 18034 raft_consensus.cc:2804] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:04.760380 18034 raft_consensus.cc:493] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:04.760946 18034 raft_consensus.cc:3060] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:04.760679 17962 consensus_queue.cc:237] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:04.761444 17863 leader_election.cc:290] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:04.746346 16248 leader_election.cc:304] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:06:04.766873 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 74033us
W20260709 13:06:04.760901 17866 consensus_meta.cc:287] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 0.673s	user 0.010s	sys 0.006s
I20260709 13:06:04.771857 18055 raft_consensus.cc:2804] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:04.771895 17838 consensus_queue.cc:260] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:04.774796 18031 raft_consensus.cc:2764] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:06:04.777956 17854 leader_election.cc:290] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 5 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:04.548697 18036 raft_consensus.cc:2804] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:06:04.788532 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:04.788880 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 49623.4us
I20260709 13:06:04.789367 17838 raft_consensus.cc:3060] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:04.789580 17863 raft_consensus.cc:2749] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:04.545748 18033 raft_consensus.cc:2749] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:04.791877 17965 leader_election.cc:290] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:04.781044 18055 raft_consensus.cc:493] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:04.807960 16200 raft_consensus.cc:2468] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 3.
I20260709 13:06:04.810747 18030 raft_consensus.cc:2749] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:04.812947 16282 raft_consensus.cc:2468] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 3.
I20260709 13:06:04.815001 17904 leader_election.cc:290] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:06:04.810820 18002 consensus_meta.cc:287] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63: Time spent flushing consensus metadata: real 0.652s	user 0.016s	sys 0.002s
I20260709 13:06:04.818343 18015 raft_consensus.cc:493] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.819657 18015 raft_consensus.cc:515] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:06:04.818284 16321 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:04.822781 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 128751us
I20260709 13:06:04.818595 18002 raft_consensus.cc:515] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:04.824090 16173 leader_election.cc:304] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:04.826812 18035 raft_consensus.cc:3060] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:04.826872 16949 raft_consensus.cc:2468] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 2.
W20260709 13:06:04.831790 16174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:04.833146 16912 leader_election.cc:304] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:04.795064 17866 raft_consensus.cc:515] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:04.835634 16356 raft_consensus.cc:1240] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:04.837040 18015 leader_election.cc:290] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:04.837919 18002 leader_election.cc:290] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:04.622869 18040 consensus_queue.cc:1059] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.197s
I20260709 13:06:04.841377 18040 raft_consensus.cc:3055] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:04.841961 18040 raft_consensus.cc:740] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
W20260709 13:06:04.842521 16249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:04.850871 16913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:04.854712 18036 raft_consensus.cc:493] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:04.855450 18036 raft_consensus.cc:3060] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:04.837988 17866 leader_election.cc:290] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:04.861653 17886 leader_election.cc:290] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:04.863337 16207 raft_consensus.cc:1275] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:04.873440 16914 leader_election.cc:304] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:06:04.874316 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:04.875156 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:04.875607 16355 raft_consensus.cc:2393] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 3: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:06:04.876163 18021 raft_consensus.cc:2804] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:04.877048 18021 raft_consensus.cc:697] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 2 LEADER]: Becoming Leader. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:06:04.877182 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:04.878108 16349 raft_consensus.cc:2468] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 3.
I20260709 13:06:04.878539 18003 leader_election.cc:290] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:04.875634 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:04.878445 18021 consensus_queue.cc:237] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:04.880030 16350 raft_consensus.cc:2468] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 4.
I20260709 13:06:04.874908 17986 consensus_queue.cc:1059] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:04.876137 16348 raft_consensus.cc:2468] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 2.
I20260709 13:06:04.826355 16173 leader_election.cc:304] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:04.793954 18010 leader_election.cc:290] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:06:04.893085 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:04.895390 16353 raft_consensus.cc:1275] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
W20260709 13:06:04.896334 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 70185us
I20260709 13:06:04.898164 17983 raft_consensus.cc:3055] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:04.898799 17673 raft_consensus.cc:2749] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:04.901841 18035 raft_consensus.cc:2749] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:06:04.902987 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 70275.3us
I20260709 13:06:04.816143 18055 raft_consensus.cc:3060] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:04.904320 16353 pending_rounds.cc:85] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e: Aborting all ops after (but not including) 2
I20260709 13:06:04.858253 18034 raft_consensus.cc:515] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:04.912130 18026 raft_consensus.cc:2749] T b9e1324823f04d8da5a4b3ddbd061c0e P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107) with higher term. Message: Invalid argument: T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for earlier term 2. Current term is 3.
I20260709 13:06:04.912985 18002 raft_consensus.cc:2804] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:04.929579 18002 raft_consensus.cc:697] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [term 3 LEADER]: Becoming Leader. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:06:04.916077 17911 leader_election.cc:290] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:04.919086 17715 tablet_bootstrap.cc:492] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap starting.
W20260709 13:06:04.924727 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 178633us
I20260709 13:06:04.927706 16173 leader_election.cc:304] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:04.928561 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:04.931221 18034 leader_election.cc:290] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 3 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:04.917007 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:04.926823 16353 pending_rounds.cc:107] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:06:04.936187 16353 raft_consensus.cc:2889] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:04.937567 16207 raft_consensus.cc:2468] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 4.
I20260709 13:06:04.937228 18040 consensus_queue.cc:260] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:04.931071 18002 consensus_queue.cc:237] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:04.939407 18040 raft_consensus.cc:3060] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:04.907588 17983 raft_consensus.cc:740] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
W20260709 13:06:04.940704 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:04.941599 17983 consensus_queue.cc:260] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:04.943373 17999 leader_election.cc:290] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:04.944814 17986 raft_consensus.cc:493] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.945617 17986 raft_consensus.cc:515] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:04.949047 18035 raft_consensus.cc:2749] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:04.948957 16280 raft_consensus.cc:1275] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:04.948895 16206 raft_consensus.cc:2468] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 3.
I20260709 13:06:04.952626 18001 consensus_queue.cc:1048] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:06:04.956882 16320 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:04.942420 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:04.960654 16353 raft_consensus.cc:1275] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:04.960845 16348 raft_consensus.cc:2468] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 3.
I20260709 13:06:04.943425 17983 raft_consensus.cc:3060] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:04.962857 16352 raft_consensus.cc:1275] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:04.963171 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:04.963577 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:04.963173 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
W20260709 13:06:04.978322 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 50763.5us
I20260709 13:06:04.979600 16173 leader_election.cc:304] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:04.980039 16353 raft_consensus.cc:1275] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:06:04.981586 16321 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:04.982637 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:04.985129 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:04.986142 16201 raft_consensus.cc:2368] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 3. Current term is 4.
I20260709 13:06:04.983403 16355 raft_consensus.cc:1275] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:04.984406 16356 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41830 (request call id 1276) took 3966 ms. Trace:
I20260709 13:06:04.987040 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:04.987264 16356 rpcz_store.cc:276] 0709 13:06:01.017674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:03.817220 (+2799546us) service_pool.cc:224] Handling call
0709 13:06:04.061878 (+244658us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:04.836146 (+774268us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:04.984071 (+147925us) spinlock_profiling.cc:243] Waited 773 ms on lock 0x7b5400269654. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f489e01 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6
0709 13:06:04.984313 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1778587904}
I20260709 13:06:04.964183 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:04.988622 16350 raft_consensus.cc:2468] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 2.
I20260709 13:06:04.989537 18004 raft_consensus.cc:515] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:04.994886 18035 raft_consensus.cc:2749] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:04.995165 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:04.996212 16203 raft_consensus.cc:2410] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for term 5 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:04.995882 18035 consensus_queue.cc:1059] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:04.998047 17838 raft_consensus.cc:3055] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:04.998593 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:04.999706 16280 raft_consensus.cc:3060] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:05.004413 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:04.964883 17986 leader_election.cc:290] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:04.998574 17838 raft_consensus.cc:740] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:05.013703 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:05.014845 16350 raft_consensus.cc:2393] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 3: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:06:05.015764 16173 leader_election.cc:304] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:05.013643 17838 consensus_queue.cc:260] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:05.017014 17838 raft_consensus.cc:3060] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:05.017782 17845 consensus_queue.cc:1059] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:05.026722 16357 raft_consensus.cc:2468] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 4.
I20260709 13:06:05.026710 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:05.011448 16348 raft_consensus.cc:2468] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 4.
I20260709 13:06:05.037793 18035 raft_consensus.cc:2804] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:05.038337 18035 raft_consensus.cc:493] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:05.038846 18035 raft_consensus.cc:3060] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:05.042263 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:05.042603 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:05.043071 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:05.043285 16355 raft_consensus.cc:2468] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 4.
I20260709 13:06:05.044286 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:05.044697 18017 raft_consensus.cc:3055] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:05.045162 18017 raft_consensus.cc:740] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:06:05.045604 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:05.046631 16356 raft_consensus.cc:2393] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 3: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:06:05.046319 18017 consensus_queue.cc:260] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:05.047335 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:05.036840 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:05.048002 17845 raft_consensus.cc:3055] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:05.048346 16204 raft_consensus.cc:2468] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 4.
I20260709 13:06:05.048705 16206 raft_consensus.cc:2393] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 3: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
I20260709 13:06:05.049105 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:05.009157 18036 raft_consensus.cc:515] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:05.050092 16350 raft_consensus.cc:2468] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 2.
I20260709 13:06:05.050777 16200 raft_consensus.cc:1240] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:05.051263 16173 leader_election.cc:304] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:05.054957 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:06:05.055573 16321 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:05.055830 16201 raft_consensus.cc:2468] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 2.
I20260709 13:06:05.063499 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:05.064515 16203 raft_consensus.cc:2410] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 13:06:05.066716 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 67591.4us
I20260709 13:06:05.048727 17845 raft_consensus.cc:740] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:05.066217 18036 leader_election.cc:290] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 election: Requested vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:05.022723 18055 raft_consensus.cc:515] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:05.035391 16248 leader_election.cc:304] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:06:05.074450 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bc3c8ff9b84838a2664335d7e1582b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:05.075934 16357 raft_consensus.cc:2393] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 4: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:06:05.047250 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:05.080598 16280 raft_consensus.cc:2468] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 5.
I20260709 13:06:05.068060 18004 leader_election.cc:290] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:05.048046 18017 raft_consensus.cc:3060] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:05.038707 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
W20260709 13:06:05.088579 16321 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:05.089103 16320 leader_election.cc:304] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:05.089208 16351 raft_consensus.cc:2468] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 2.
I20260709 13:06:05.090044 18002 consensus_queue.cc:1048] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:05.093030 17965 raft_consensus.cc:2804] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:05.088649 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
W20260709 13:06:05.096127 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:05.096815 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:05.096879 18055 leader_election.cc:290] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:05.098912 16282 raft_consensus.cc:2368] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 for earlier term 2. Current term is 3.
W20260709 13:06:05.111179 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 82298.5us
I20260709 13:06:05.114854 18042 consensus_queue.cc:1048] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:06:05.117362 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:05.129704 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:05.110235 18043 raft_consensus.cc:2804] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:06:05.129737 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 44819.2us
I20260709 13:06:05.131314 17983 raft_consensus.cc:2804] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:05.132138 17983 raft_consensus.cc:697] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 3 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:06:05.133186 17983 consensus_queue.cc:237] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:05.135100 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
W20260709 13:06:05.135748 16320 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:05.107841 17965 raft_consensus.cc:493] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:05.137526 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:05.138185 16349 raft_consensus.cc:2468] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 4.
I20260709 13:06:05.140383 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:05.140437 18026 consensus_queue.cc:1048] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:05.141426 16354 raft_consensus.cc:3060] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:05.142788 17965 raft_consensus.cc:3060] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:05.143596 16246 leader_election.cc:304] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:05.143756 16914 leader_election.cc:304] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
W20260709 13:06:05.155699 16174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:05.158393 18055 raft_consensus.cc:2804] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:05.159015 18055 raft_consensus.cc:493] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:05.159446 18055 raft_consensus.cc:3060] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:05.160061 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:05.148967 16350 raft_consensus.cc:2393] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 3: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
W20260709 13:06:05.166460 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 51888.8us
I20260709 13:06:05.148561 16348 raft_consensus.cc:3060] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:05.171824 16357 raft_consensus.cc:2468] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 3.
I20260709 13:06:05.173354 16246 leader_election.cc:400] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 pre-election: Vote denied by peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073) with higher term. Message: Invalid argument: T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 3. Current term is 4.
I20260709 13:06:05.179631 16246 leader_election.cc:403] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:05.174758 18019 consensus_queue.cc:1059] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:05.175616 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:05.136551 18043 raft_consensus.cc:493] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:05.167259 16200 raft_consensus.cc:1240] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:05.183616 18043 raft_consensus.cc:3060] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:05.193917 17618 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7d554054f014c74992a2a66ff6873cd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:05.212908 16354 raft_consensus.cc:2468] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 5.
I20260709 13:06:05.201571 16352 raft_consensus.cc:1275] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:06:05.203864 17965 raft_consensus.cc:515] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:05.207765 16351 raft_consensus.cc:2468] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 2.
I20260709 13:06:05.213269 16355 raft_consensus.cc:1275] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:05.193645 18035 raft_consensus.cc:515] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:06:05.219204 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 49816.4us
W20260709 13:06:05.220700 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 58131.8us
I20260709 13:06:05.110278 17845 consensus_queue.cc:260] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:06:05.223140 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 78359.8us
I20260709 13:06:05.184581 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f022e2e63ae4461d834e476ff2666991" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:05.227655 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:05.187542 18001 raft_consensus.cc:493] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:05.229368 18034 raft_consensus.cc:2804] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:05.233115 18034 raft_consensus.cc:697] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 5 LEADER]: Becoming Leader. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:06:05.233471 18001 raft_consensus.cc:515] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:05.234421 18034 consensus_queue.cc:237] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:05.239485 16353 raft_consensus.cc:1275] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:06:05.239787 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:05.233160 17845 raft_consensus.cc:3060] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:05.243685 17935 raft_consensus.cc:493] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
W20260709 13:06:05.257812 16321 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:05.263300 16248 leader_election.cc:400] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 election: Vote denied by peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107) with higher term. Message: Invalid argument: T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 3. Current term is 4.
I20260709 13:06:05.259676 17838 consensus_queue.cc:1048] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 13:06:05.247823 17962 raft_consensus.cc:2749] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073) with higher term. Message: Invalid argument: T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 3. Current term is 4.
I20260709 13:06:05.261505 16246 leader_election.cc:304] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
W20260709 13:06:05.277045 16913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:05.286971 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:05.288007 16200 raft_consensus.cc:2393] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 3: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:06:05.290647 17935 raft_consensus.cc:515] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:05.291810 16200 raft_consensus.cc:1275] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:06:05.293219 17935 leader_election.cc:290] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:05.296913 16173 leader_election.cc:304] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:06:05.298161 17781 consensus_queue.cc:1048] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:05.299356 18026 raft_consensus.cc:2764] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:06:05.307122 16173 leader_election.cc:304] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
W20260709 13:06:05.312441 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 51037.4us
I20260709 13:06:05.307977 16348 raft_consensus.cc:2468] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 4.
W20260709 13:06:05.323146 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:05.325835 18035 leader_election.cc:290] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:06:05.326838 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:05.327090 16320 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:05.327548 16246 leader_election.cc:304] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
W20260709 13:06:05.329814 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:05.330323 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:05.330422 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:05.333666 18035 raft_consensus.cc:2804] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:05.334224 18025 raft_consensus.cc:2804] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:05.334290 18035 raft_consensus.cc:697] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:05.334828 18025 raft_consensus.cc:493] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:05.335305 18025 raft_consensus.cc:3060] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:05.335644 18035 consensus_queue.cc:237] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:05.334617 17983 consensus_queue.cc:1059] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:05.339628 17983 raft_consensus.cc:3055] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:05.340051 18061 raft_consensus.cc:2804] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:05.340370 17983 raft_consensus.cc:740] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:06:05.340533 18061 raft_consensus.cc:493] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:05.340966 18061 raft_consensus.cc:3060] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:05.341531 17983 consensus_queue.cc:260] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:05.343977 17983 raft_consensus.cc:3060] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:05.345669 16201 raft_consensus.cc:1275] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:05.348985 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:05.349921 16280 raft_consensus.cc:2393] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 3: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
W20260709 13:06:05.353134 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:05.351606 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:05.354110 17854 raft_consensus.cc:3055] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:05.352820 16278 raft_consensus.cc:1275] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:05.354759 17854 raft_consensus.cc:740] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:06:05.350770 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:05.355834 16946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:05.354382 16207 raft_consensus.cc:2393] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 3: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:06:05.356892 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:05.357793 16278 raft_consensus.cc:2393] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 5: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
W20260709 13:06:05.364642 16249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:05.364287 18069 log.cc:927] Time spent T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63: Append to log took a long time: real 0.114s	user 0.002s	sys 0.000s
W20260709 13:06:05.370085 16914 leader_election.cc:336] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 1.710s (SENT)
I20260709 13:06:05.372391 16912 leader_election.cc:304] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:06:05.375684 16914 leader_election.cc:336] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 1.769s (SENT)
I20260709 13:06:05.376196 16914 leader_election.cc:304] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:05.377082 17935 raft_consensus.cc:2749] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:06:05.372982 16174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:05.378197 17935 raft_consensus.cc:2749] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:05.355844 17854 consensus_queue.cc:260] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:05.379325 16201 raft_consensus.cc:1275] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:05.379488 17935 consensus_queue.cc:1048] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:05.379774 17854 raft_consensus.cc:3060] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:05.381007 17935 consensus_queue.cc:1048] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:05.381848 16207 raft_consensus.cc:1275] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:05.383891 18021 consensus_queue.cc:1048] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:05.384402 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f022e2e63ae4461d834e476ff2666991" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:05.373328 17965 leader_election.cc:290] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 election: Requested vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:05.374153 18001 leader_election.cc:290] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:05.386317 18021 consensus_queue.cc:1048] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:06:05.389230 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 57152.1us
I20260709 13:06:05.306352 18055 raft_consensus.cc:515] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:06:05.398145 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:05.411547 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 143642us
W20260709 13:06:05.441279 18075 log.cc:927] Time spent T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:06:05.442239 16248 leader_election.cc:304] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:06:05.443958 16320 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:05.406314 18043 raft_consensus.cc:515] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:06:05.465216 16321 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:05.470036 16321 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:05.471663 16914 leader_election.cc:400] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 election: Vote denied by peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823) with higher term. Message: Invalid argument: T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 for earlier term 2. Current term is 3.
I20260709 13:06:05.472131 16914 leader_election.cc:403] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:06:05.474102 18055 leader_election.cc:290] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:05.473953 16248 leader_election.cc:304] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:05.418830 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
W20260709 13:06:05.484761 16248 leader_election.cc:336] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Remote error: Timed out: Call waited in the queue past client deadline
I20260709 13:06:05.485452 16248 leader_election.cc:304] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:05.487164 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:05.488103 16278 raft_consensus.cc:2468] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 5.
I20260709 13:06:05.490036 16200 raft_consensus.cc:1240] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:05.487174 18055 raft_consensus.cc:2764] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:06:05.487469 17962 raft_consensus.cc:2749] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:06:05.494730 16248 leader_election.cc:336] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Remote error: Timed out: Call waited in the queue past client deadline
I20260709 13:06:05.495637 18016 raft_consensus.cc:3060] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:05.496711 16248 leader_election.cc:304] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:05.497784 17962 raft_consensus.cc:3060] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:05.500221 16173 leader_election.cc:304] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:05.500370 17911 consensus_queue.cc:1059] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:05.501402 17911 raft_consensus.cc:3055] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:05.501789 17911 raft_consensus.cc:740] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
W20260709 13:06:05.508756 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:05.462633 17999 raft_consensus.cc:2749] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:06:05.511143 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 48949.7us
I20260709 13:06:05.468434 18040 raft_consensus.cc:493] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:05.515255 18040 raft_consensus.cc:515] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:05.528610 17935 consensus_queue.cc:1048] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:05.530433 17935 consensus_queue.cc:1048] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:05.533713 16173 leader_election.cc:304] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:05.536108 18040 leader_election.cc:290] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:05.533753 18061 raft_consensus.cc:515] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:05.538753 17911 consensus_queue.cc:260] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:05.540632 17911 raft_consensus.cc:3060] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:05.514669 18035 raft_consensus.cc:2764] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:06:05.544179 18061 leader_election.cc:290] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:05.546494 18035 raft_consensus.cc:2804] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:05.548190 18043 leader_election.cc:290] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:06:05.551445 18080 log.cc:927] Time spent T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.134s	user 0.000s	sys 0.001s
W20260709 13:06:05.556324 16321 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:05.563905 16199 raft_consensus.cc:2368] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 for earlier term 2. Current term is 3.
I20260709 13:06:05.583534 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:05.563900 18035 raft_consensus.cc:697] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [term 4 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
W20260709 13:06:05.584473 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 87844.6us
I20260709 13:06:05.586418 16946 raft_consensus.cc:1240] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 2 LEADER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:05.584967 16278 raft_consensus.cc:1275] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:05.596844 18035 consensus_queue.cc:237] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:05.598470 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f022e2e63ae4461d834e476ff2666991" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:05.599417 16274 raft_consensus.cc:2468] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 1.
W20260709 13:06:05.601712 16321 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:05.597558 16281 raft_consensus.cc:1275] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:06:05.606509 16282 raft_consensus.cc:1240] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 2. Current term is 3. Ops: []
W20260709 13:06:05.609347 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:05.626025 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:05.626974 16203 raft_consensus.cc:3060] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:05.630043 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:05.631065 16278 raft_consensus.cc:2468] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 3.
I20260709 13:06:05.632401 16281 raft_consensus.cc:1275] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:05.633729 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:05.634781 16282 raft_consensus.cc:2393] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 3: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:06:05.638659 16914 leader_election.cc:304] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:05.640460 16912 leader_election.cc:400] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 election: Vote denied by peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073) with higher term. Message: Invalid argument: T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 for earlier term 2. Current term is 3.
W20260709 13:06:05.721796 16321 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:05.724465 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 72642.2us
W20260709 13:06:05.722529 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 71582.6us
I20260709 13:06:05.721994 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:06:05.727667 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:05.728178 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:05.723582 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:05.652343 18001 raft_consensus.cc:2804] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:05.775651 16275 raft_consensus.cc:1275] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:05.775326 16279 raft_consensus.cc:2468] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 1.
W20260709 13:06:05.778976 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:05.779587 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:05.785264 16320 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:05.785866 16320 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:05.790872 16248 leader_election.cc:304] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:05.765707 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:05.724130 18034 consensus_queue.cc:1048] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.071s
W20260709 13:06:05.799937 16320 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:05.726691 17935 consensus_queue.cc:1059] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 13:06:05.778110 16274 raft_consensus.cc:1275] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:05.807273 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:05.776862 18001 raft_consensus.cc:493] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:05.792420 18040 raft_consensus.cc:493] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:05.731990 18025 raft_consensus.cc:515] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:05.797096 18021 raft_consensus.cc:493] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:05.814852 18001 raft_consensus.cc:3060] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:05.825033 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:05.806463 16200 raft_consensus.cc:3060] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:05.826884 16948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:05.828137 18021 raft_consensus.cc:515] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:05.832266 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:05.833640 16202 raft_consensus.cc:2410] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:06:05.834908 18021 leader_election.cc:290] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:06:05.835247 18088 log.cc:927] Time spent T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:06:05.836426 18025 leader_election.cc:290] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:05.842945 16280 raft_consensus.cc:1240] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
W20260709 13:06:05.849094 16322 connection.cc:256] RPC call timeout handler was delayed by -1.4684028589999798s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1636s for a response
W20260709 13:06:05.850688 16322 connection.cc:256] RPC call timeout handler was delayed by -1.4531028589999551s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1653s for a response
W20260709 13:06:05.852932 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:05.853524 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 126564us
W20260709 13:06:05.852308 16322 connection.cc:256] RPC call timeout handler was delayed by -1.4342028589999245s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1674s for a response
W20260709 13:06:05.851109 16321 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:05.854487 16322 connection.cc:256] RPC call timeout handler was delayed by -1.4153028590000076s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1695s for a response
W20260709 13:06:05.858817 18087 log.cc:927] Time spent T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
W20260709 13:06:05.856875 16322 connection.cc:256] RPC call timeout handler was delayed by -1.3289028589999816s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1791s for a response
W20260709 13:06:05.872669 16322 connection.cc:256] RPC call timeout handler was delayed by -1.3190028589999656s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18020000000000003s for a response
W20260709 13:06:05.879884 16322 connection.cc:256] RPC call timeout handler was delayed by -1.2713028590000022s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1855s for a response
I20260709 13:06:05.874233 17618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:35122 (request call id 319) took 6981 ms. Trace:
W20260709 13:06:05.884948 16322 connection.cc:256] RPC call timeout handler was delayed by -1.188502858999982s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1947s for a response
W20260709 13:06:05.891096 16249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:05.861300 18086 log.cc:927] Time spent T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
W20260709 13:06:05.862528 18084 log.cc:927] Time spent T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.131s	user 0.000s	sys 0.000s
I20260709 13:06:05.864998 18016 raft_consensus.cc:2749] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823) with higher term. Message: Invalid argument: T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 for earlier term 2. Current term is 3.
I20260709 13:06:05.811805 18004 raft_consensus.cc:2749] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:05.892030 16948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
W20260709 13:06:05.889267 16322 connection.cc:256] RPC call timeout handler was delayed by -1.1849028589999762s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19510000000000002s for a response
I20260709 13:06:05.878950 16949 raft_consensus.cc:2468] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 4.
W20260709 13:06:05.899160 16322 connection.cc:256] RPC call timeout handler was delayed by -1.1561028589999296s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19830000000000003s for a response
W20260709 13:06:05.900148 16173 connection.cc:256] RPC call timeout handler was delayed by -1.9586213720000387s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20120000000000002s for a response
W20260709 13:06:05.900173 16322 connection.cc:256] RPC call timeout handler was delayed by -1.1183028589999822s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2025s for a response
I20260709 13:06:05.857522 16248 leader_election.cc:304] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:06:05.939319 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:05.902521 16948 raft_consensus.cc:2393] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 3: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
W20260709 13:06:05.951145 16914 leader_election.cc:336] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 1.871s (SENT)
W20260709 13:06:05.965981 16321 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:05.959234 16946 raft_consensus.cc:1240] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 1. Current term is 2. Ops: []
W20260709 13:06:06.000988 16321 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:05.921623 16203 raft_consensus.cc:2468] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 5.
W20260709 13:06:06.002408 16322 connection.cc:256] RPC call timeout handler was delayed by -1.0886028589999341s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20579999999999998s for a response
W20260709 13:06:06.008704 16320 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:06.025892 16322 connection.cc:256] RPC call timeout handler was delayed by -1.0229028589999416s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21309999999999998s for a response
I20260709 13:06:05.899475 17999 raft_consensus.cc:493] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:05.956027 17962 raft_consensus.cc:2749] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:05.929993 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:05.888217 17618 rpcz_store.cc:276] 0709 13:05:58.889091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:58.890107 (+  1016us) service_pool.cc:224] Handling call
0709 13:05:58.891391 (+  1284us) ts_tablet_manager.cc:934] T c7d554054f014c74992a2a66ff6873cd P 1109f76a0b7b443a84c0327c8707bc63: Initiating tablet copy from peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
0709 13:06:05.191948 (+6300557us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:06:05.510753 (+318805us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:05.553597 (+ 42844us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:06:05.850422 (+296825us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:06:05.865595 (+ 15173us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:05.869205 (+  3610us) ts_tablet_manager.cc:989] Replica registered.
0709 13:06:05.870620 (+  1415us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":42612,"tablet-copy.queue_time_us":133,"thread_start_us":141457,"threads_started":1}
I20260709 13:06:05.957681 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:06:05.953293 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:06.023262 16914 leader_election.cc:304] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
W20260709 13:06:06.041224 16321 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:06.043747 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:06.044123 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
W20260709 13:06:06.045212 18094 log.cc:927] Time spent T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:06:06.045090 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:06.025628 16200 raft_consensus.cc:2468] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 5.
I20260709 13:06:06.051631 17618 tablet_copy_client.cc:806] T c7d554054f014c74992a2a66ff6873cd P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:06.030053 18031 raft_consensus.cc:2749] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:06:06.065562 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:05.896258 18040 raft_consensus.cc:515] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:06.081054 16283 raft_consensus.cc:2393] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 3: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:06:06.088210 16201 raft_consensus.cc:1275] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:06.089286 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:06.090121 16352 raft_consensus.cc:3060] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:06.090413 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:06.091156 16357 raft_consensus.cc:2468] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 2.
I20260709 13:06:06.092221 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:06.093446 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:06.094056 16357 raft_consensus.cc:3060] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:06.094946 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:06.095355 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:06.096328 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:06.096729 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:06.097182 16351 raft_consensus.cc:2468] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 4.
I20260709 13:06:06.097496 16350 raft_consensus.cc:2468] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 4.
I20260709 13:06:06.098986 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:06.100481 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:06.096379 18040 leader_election.cc:290] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:06.099718 16356 raft_consensus.cc:2468] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 5.
W20260709 13:06:06.108094 16321 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:06.114918 16322 leader_election.cc:400] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 election: Vote denied by peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823) with higher term. Message: Invalid argument: T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for earlier term 3. Current term is 4.
W20260709 13:06:06.126149 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:06.079846 16348 raft_consensus.cc:3060] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:06.134135 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:06.134809 16352 raft_consensus.cc:2468] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 3.
I20260709 13:06:06.136504 16351 raft_consensus.cc:1275] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:06:06.141708 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:06.145525 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 288161us
W20260709 13:06:06.146955 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 52501.5us
I20260709 13:06:06.147886 16322 leader_election.cc:304] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:06.149328 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:06.060294 17999 raft_consensus.cc:515] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:06.131225 18016 raft_consensus.cc:3060] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:06.173302 16357 raft_consensus.cc:2468] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 5.
I20260709 13:06:06.177448 16352 raft_consensus.cc:1275] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:06:06.143278 17618 tablet_copy_client.cc:670] T c7d554054f014c74992a2a66ff6873cd P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Starting download of 1 WAL segments...
W20260709 13:06:06.180575 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 229475us
I20260709 13:06:06.157601 17715 tablet_bootstrap.cc:492] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:06:06.185046 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 163177us
I20260709 13:06:06.131443 17986 consensus_queue.cc:1048] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 13:06:06.191164 16246 leader_election.cc:304] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
W20260709 13:06:06.189023 16914 leader_election.cc:336] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 1.690s (SENT)
I20260709 13:06:06.192209 16914 leader_election.cc:304] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:06.150919 16350 raft_consensus.cc:3055] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:06:06.205121 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 178251us
W20260709 13:06:06.211323 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 48662.2us
W20260709 13:06:06.215955 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:06.204728 16350 raft_consensus.cc:740] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:06:06.223060 18034 raft_consensus.cc:2749] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:06.224004 17999 leader_election.cc:290] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:06.218577 17715 tablet_bootstrap.cc:492] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap complete.
W20260709 13:06:06.248405 17911 consensus_meta.cc:287] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 0.707s	user 0.017s	sys 0.001s
I20260709 13:06:06.263183 16248 leader_election.cc:304] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:06:06.265331 16173 leader_election.cc:336] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 2.125s (SENT)
I20260709 13:06:06.257612 17715 ts_tablet_manager.cc:1403] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63: Time spent bootstrapping tablet: real 1.427s	user 0.047s	sys 0.021s
I20260709 13:06:06.271924 16173 leader_election.cc:304] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:06.245160 16350 consensus_queue.cc:260] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:06.279443 16350 raft_consensus.cc:3060] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:06.288162 16943 raft_consensus.cc:2468] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 3.
I20260709 13:06:06.266120 17986 raft_consensus.cc:2749] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:06:06.271603 18092 log.cc:927] Time spent T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63: Append to log took a long time: real 0.185s	user 0.001s	sys 0.000s
I20260709 13:06:06.286566 18035 raft_consensus.cc:2749] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:06.260311 18001 raft_consensus.cc:515] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:06:06.295892 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 106878us
W20260709 13:06:06.298964 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:06.308579 18097 consensus_queue.cc:1048] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:06.310930 16914 leader_election.cc:304] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:06:06.311165 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:06.312628 18097 raft_consensus.cc:2804] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:06:06.313105 18097 raft_consensus.cc:493] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:06.313555 18097 raft_consensus.cc:3060] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:06.313926 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:06.318205 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 68611.4us
I20260709 13:06:06.320670 16350 raft_consensus.cc:1275] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:06:06.323627 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 132612us
I20260709 13:06:06.324779 16246 leader_election.cc:304] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:06.326931 16947 raft_consensus.cc:1240] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 1. Current term is 2. Ops: []
W20260709 13:06:06.327144 18103 log.cc:927] Time spent T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 13:06:06.335386 16249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:06.295089 18105 raft_consensus.cc:2749] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:06.337917 17962 raft_consensus.cc:2804] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:06.338806 18002 consensus_queue.cc:1048] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 13:06:06.332078 18031 raft_consensus.cc:2804] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:06:06.376268 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 228474us
I20260709 13:06:06.389793 16322 leader_election.cc:304] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:06:06.366648 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:06.392339 16173 leader_election.cc:336] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 2.255s (SENT)
I20260709 13:06:06.393043 16173 leader_election.cc:304] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
W20260709 13:06:06.394332 16914 leader_election.cc:336] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 1.806s (SENT)
W20260709 13:06:06.411890 16914 leader_election.cc:336] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 1.863s (SENT)
I20260709 13:06:06.403342 18035 raft_consensus.cc:2749] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:06.398599 17962 raft_consensus.cc:697] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:06.415279 16914 leader_election.cc:304] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
W20260709 13:06:06.426764 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:06.427449 16321 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:06.413324 17999 raft_consensus.cc:493] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.403605 18116 consensus_queue.cc:1048] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
W20260709 13:06:06.440783 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 48904.8us
I20260709 13:06:06.432693 18031 raft_consensus.cc:697] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
W20260709 13:06:06.444090 17942 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.791s	user 0.005s	sys 0.011s
W20260709 13:06:06.453204 17942 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.926s	user 0.006s	sys 0.011s
W20260709 13:06:06.452999 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 63369.4us
W20260709 13:06:06.455698 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 117257us
I20260709 13:06:06.437016 17911 raft_consensus.cc:493] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:06.446372 18021 raft_consensus.cc:2749] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:06.440140 18004 consensus_queue.cc:1048] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
W20260709 13:06:06.475829 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 65977.8us
I20260709 13:06:06.444774 17999 raft_consensus.cc:515] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:06.462805 18114 raft_consensus.cc:2749] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:06:06.483580 16321 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:06.466012 18016 raft_consensus.cc:2749] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:06.474152 18121 raft_consensus.cc:493] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.473886 18035 raft_consensus.cc:493] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:06.492434 18001 leader_election.cc:290] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:06.503953 16940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:06:06.508422 16322 leader_election.cc:304] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:06.498621 18116 consensus_queue.cc:1059] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 13:06:06.514827 18122 consensus_queue.cc:1048] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:06.495029 18043 consensus_queue.cc:1048] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 13:06:06.499361 17715 raft_consensus.cc:359] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:06:06.524024 17715 raft_consensus.cc:740] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Initialized, Role: LEARNER
W20260709 13:06:06.524323 18083 log.cc:927] Time spent T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 1.002s	user 0.007s	sys 0.000s
I20260709 13:06:06.524422 18043 consensus_queue.cc:1048] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:06.525044 17715 consensus_queue.cc:260] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:06:06.525985 18043 consensus_queue.cc:1048] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:06.512651 18121 raft_consensus.cc:515] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:06:06.527309 18111 log.cc:927] Time spent T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:06:06.530970 18114 raft_consensus.cc:2749] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:06.505322 18035 raft_consensus.cc:515] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:06.532047 18124 consensus_queue.cc:1048] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:06.606717 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:06.471385 17962 consensus_queue.cc:237] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:06.607746 16280 raft_consensus.cc:2468] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 3.
I20260709 13:06:06.586093 18097 raft_consensus.cc:515] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:06.609395 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:06.492368 17911 raft_consensus.cc:515] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:06.610312 18097 leader_election.cc:290] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:06.617503 17911 leader_election.cc:290] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:06:06.547793 18096 log.cc:927] Time spent T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.507s	user 0.002s	sys 0.000s
I20260709 13:06:06.617918 18035 leader_election.cc:290] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:06.632696 18130 raft_consensus.cc:493] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.633474 18130 raft_consensus.cc:515] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:06.636148 18130 leader_election.cc:290] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:06:06.572723 18119 log.cc:927] Time spent T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:06:06.640444 16940 raft_consensus.cc:2468] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 3.
W20260709 13:06:06.646329 18089 log.cc:927] Time spent T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.834s	user 0.002s	sys 0.000s
I20260709 13:06:06.651367 18098 raft_consensus.cc:3055] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:06.652011 18098 raft_consensus.cc:740] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:06:06.654412 16276 raft_consensus.cc:1275] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:06:06.658053 18098 consensus_queue.cc:260] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:06.659817 18098 raft_consensus.cc:3060] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:06.656337 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f022e2e63ae4461d834e476ff2666991" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:06.664508 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:06.665205 16276 raft_consensus.cc:3060] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:06.666929 16280 raft_consensus.cc:1240] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:06.540392 18129 consensus_queue.cc:1048] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.002s
W20260709 13:06:06.583940 16321 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:06.585778 16322 leader_election.cc:304] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:06:06.674907 16321 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:06.675554 16321 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:06.675799 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 90160.7us
I20260709 13:06:06.676767 16322 leader_election.cc:304] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:06.587778 17999 leader_election.cc:290] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:06.549232 18105 consensus_queue.cc:1048] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:06.589699 17715 ts_tablet_manager.cc:1434] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63: Time spent starting tablet: real 0.306s	user 0.011s	sys 0.000s
I20260709 13:06:06.520931 18031 consensus_queue.cc:237] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:06.591039 18121 leader_election.cc:290] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:06.547484 18061 consensus_queue.cc:1048] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:06.592159 16348 raft_consensus.cc:2468] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 4.
I20260709 13:06:06.595350 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c15d8e9be8414c84912ab77b66bfb1" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:06:06.597688 18102 log.cc:927] Time spent T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.314s	user 0.002s	sys 0.000s
W20260709 13:06:06.589743 18109 log.cc:927] Time spent T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.314s	user 0.002s	sys 0.000s
I20260709 13:06:06.600716 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:06.601186 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:06.603173 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:06.605296 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
W20260709 13:06:06.549393 18120 log.cc:927] Time spent T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 13:06:06.619597 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:06.725106 16276 raft_consensus.cc:2468] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 2.
W20260709 13:06:06.695188 16321 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:06.514248 18128 consensus_queue.cc:1048] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
W20260709 13:06:06.676812 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 159782us
W20260709 13:06:06.765334 16320 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:06.675602 18114 raft_consensus.cc:2749] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:06:06.781006 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 102097us
I20260709 13:06:06.794618 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:06.763034 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:06.795686 16205 raft_consensus.cc:2410] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:06:06.801800 18133 raft_consensus.cc:493] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.805233 16248 leader_election.cc:304] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:06.805299 18133 raft_consensus.cc:515] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:06.701324 17854 raft_consensus.cc:3055] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:06:06.807627 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 130941us
W20260709 13:06:06.789930 17715 ts_tablet_manager.cc:1467] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63: Tablet startup took 520ms
I20260709 13:06:06.808310 17854 raft_consensus.cc:740] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:06:06.804268 17983 raft_consensus.cc:493] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.829087 17983 raft_consensus.cc:515] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:06.831737 17983 leader_election.cc:290] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:06.816982 18136 consensus_queue.cc:1059] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 13:06:06.818053 18129 raft_consensus.cc:2749] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:06:06.836256 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 136799us
I20260709 13:06:06.821803 16322 leader_election.cc:304] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:06.814724 18128 consensus_queue.cc:1048] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 13:06:06.831915 18114 raft_consensus.cc:2749] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:06.832937 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:06.834499 18133 leader_election.cc:290] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:06.815586 16278 raft_consensus.cc:1240] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:06:06.819495 17854 consensus_queue.cc:260] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:06.831789 18121 raft_consensus.cc:493] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
W20260709 13:06:06.859498 16320 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:06.849413 16914 leader_election.cc:304] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
W20260709 13:06:06.882306 16320 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:06.838326 18040 raft_consensus.cc:493] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.889297 18040 raft_consensus.cc:515] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:06.849989 17983 raft_consensus.cc:2749] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:06.891988 18040 leader_election.cc:290] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:06.879837 17942 consensus_queue.cc:1059] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
W20260709 13:06:06.893795 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 72396us
I20260709 13:06:06.895130 16322 leader_election.cc:400] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 election: Vote denied by peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823) with higher term. Message: Invalid argument: T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for earlier term 4. Current term is 5.
I20260709 13:06:06.895463 16322 leader_election.cc:403] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:06:06.849944 18097 consensus_queue.cc:1048] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:06:06.888695 18116 raft_consensus.cc:2804] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:06:06.943951 16914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:06.955718 16914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:06.948793 16355 raft_consensus.cc:2468] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 5.
W20260709 13:06:06.948931 16320 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:06.951215 18113 raft_consensus.cc:2749] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823) with higher term. Message: Invalid argument: T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for earlier term 4. Current term is 5.
W20260709 13:06:07.036801 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 88430.9us
W20260709 13:06:07.040550 18143 log.cc:927] Time spent T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:06:07.037748 18121 raft_consensus.cc:515] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:07.042903 18113 consensus_queue.cc:1059] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:07.043907 18121 leader_election.cc:290] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:07.044595 17983 consensus_queue.cc:1059] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:06:07.045739 16321 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:07.045102 17911 consensus_queue.cc:1059] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:07.036895 18116 raft_consensus.cc:697] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 LEADER]: Becoming Leader. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:06:07.049702 18116 consensus_queue.cc:237] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:06:06.813354 17715 ts_tablet_manager.cc:1469] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63: Trace:
0709 13:05:54.605410 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:54.614771 (+  9361us) service_pool.cc:224] Handling call
0709 13:05:54.869842 (+255071us) ts_tablet_manager.cc:934] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63: Initiating tablet copy from peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
0709 13:05:57.035508 (+2165666us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:05:57.081753 (+ 46245us) tablet_metadata.cc:665] Metadata flushed
0709 13:05:57.085832 (+  4079us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:05:57.394130 (+308298us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:05:57.394491 (+   361us) tablet_replica.cc:206] Creating consensus instance
0709 13:05:57.418043 (+ 23552us) ts_tablet_manager.cc:989] Replica registered.
0709 13:05:57.420167 (+  2124us) inbound_call.cc:177] Queueing success response
0709 13:06:04.830070 (+7409903us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:06:06.283210 (+1453140us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:06:06.328199 (+ 44989us) tablet_replica.cc:261] Starting instrumentation
0709 13:06:06.328828 (+   629us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":25058,"mutex_wait_us":3780,"raft.queue_time_us":9410,"raft.run_cpu_time_us":196,"raft.run_wall_time_us":32972,"tablet-copy.queue_time_us":242623,"tablet-download-pool.queue_time_us":168,"tablet-download-pool.run_cpu_time_us":2186,"tablet-download-pool.run_wall_time_us":6472341,"thread_start_us":281197,"threads_started":2}
W20260709 13:06:07.131467 18141 log.cc:927] Time spent T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
W20260709 13:06:07.223645 18146 log.cc:927] Time spent T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 13:06:07.258818 16322 leader_election.cc:304] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:07.259995 18147 raft_consensus.cc:2804] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:07.261044 16322 leader_election.cc:304] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:07.267019 18147 raft_consensus.cc:697] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e [term 4 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
W20260709 13:06:07.267616 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:07.268829 18152 raft_consensus.cc:2804] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:07.271847 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:07.272837 16199 raft_consensus.cc:2468] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 3.
I20260709 13:06:07.277278 16322 leader_election.cc:304] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:07.278633 18151 consensus_queue.cc:1048] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:07.269850 18147 consensus_queue.cc:237] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:07.281282 18151 raft_consensus.cc:2749] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:07.281556 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:07.282564 16208 raft_consensus.cc:2393] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 3: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:06:07.286686 18152 raft_consensus.cc:697] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 2 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:06:07.288285 18152 consensus_queue.cc:237] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:06:07.311391 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:07.314630 16322 leader_election.cc:304] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:07.315145 18136 raft_consensus.cc:493] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:07.315900 18152 raft_consensus.cc:2749] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:07.315809 18136 raft_consensus.cc:515] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:07.317093 18152 consensus_queue.cc:1048] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:07.317269 16322 leader_election.cc:304] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:07.318461 18136 leader_election.cc:290] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:07.322408 18152 raft_consensus.cc:2749] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:07.323185 16322 leader_election.cc:304] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:07.326078 18152 raft_consensus.cc:2804] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:07.326496 18152 raft_consensus.cc:493] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:07.326918 18152 raft_consensus.cc:3060] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:07.327522 16322 leader_election.cc:304] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:07.328365 18153 raft_consensus.cc:2804] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:07.328786 18153 raft_consensus.cc:493] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:07.329188 18153 raft_consensus.cc:3060] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:07.337931 18152 raft_consensus.cc:515] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } }
I20260709 13:06:07.341092 18153 raft_consensus.cc:515] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:07.341691 18129 raft_consensus.cc:493] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:07.342314 18129 raft_consensus.cc:515] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:07.344494 16322 leader_election.cc:304] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:07.345628 18129 leader_election.cc:290] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:07.345824 16322 leader_election.cc:304] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:07.347214 16322 leader_election.cc:304] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:07.343523 18153 leader_election.cc:290] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:07.348157 18151 raft_consensus.cc:2749] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:07.348837 18151 raft_consensus.cc:2749] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:07.349500 18151 raft_consensus.cc:2749] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:07.355232 16914 leader_election.cc:304] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:07.356650 16914 leader_election.cc:304] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:06:07.359193 18154 raft_consensus.cc:493] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:07.359807 18154 raft_consensus.cc:515] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:07.361259 16914 leader_election.cc:304] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:07.363098 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:07.363924 16947 raft_consensus.cc:2393] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 3: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:06:07.364399 18019 raft_consensus.cc:2804] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:07.364892 18019 raft_consensus.cc:493] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:07.365243 18019 raft_consensus.cc:3060] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:07.365650 16173 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.855s	user 0.006s	sys 0.021s
W20260709 13:06:07.365991 16173 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.855s	user 0.007s	sys 0.021s
W20260709 13:06:07.366268 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 861774us
I20260709 13:06:07.366616 18152 leader_election.cc:290] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:07.362278 18154 leader_election.cc:290] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:07.368906 18157 raft_consensus.cc:493] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:07.369541 18157 raft_consensus.cc:515] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:07.371199 18154 raft_consensus.cc:493] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:07.371743 18154 raft_consensus.cc:515] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:07.372254 18157 leader_election.cc:290] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:07.372833 18157 raft_consensus.cc:493] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:07.373360 18157 raft_consensus.cc:515] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:07.374018 18154 leader_election.cc:290] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:07.374491 18133 consensus_queue.cc:1048] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:06:07.375356 18157 leader_election.cc:290] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:07.375968 18157 consensus_queue.cc:1048] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:06:07.377985 16322 consensus_peers.cc:597] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e -> Peer 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875): Couldn't send request to peer 1109f76a0b7b443a84c0327c8707bc63. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:07.378701 16322 leader_election.cc:304] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:06:07.379762 18154 raft_consensus.cc:2749] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:07.381150 16322 leader_election.cc:304] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:06:07.383500 16275 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.028s	sys 0.048s
W20260709 13:06:07.384016 16275 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.567s	user 0.028s	sys 0.048s
I20260709 13:06:07.383803 18152 raft_consensus.cc:2749] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:07.384519 18158 consensus_queue.cc:1048] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:07.387356 18152 consensus_queue.cc:1059] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:07.384249 16173 leader_election.cc:304] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:06:07.388779 18147 raft_consensus.cc:3055] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:07.389252 18147 raft_consensus.cc:740] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:06:07.389716 18158 raft_consensus.cc:2804] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:07.390193 18158 raft_consensus.cc:493] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:07.390661 18158 raft_consensus.cc:3060] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:07.390323 18147 consensus_queue.cc:260] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:07.391949 18153 raft_consensus.cc:493] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:07.392540 18153 raft_consensus.cc:515] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:07.394836 18153 leader_election.cc:290] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:07.398437 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:07.399560 16173 leader_election.cc:304] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:06:07.399915 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:07.401600 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:07.402819 16199 raft_consensus.cc:2410] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:07.403628 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:07.403892 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:07.404382 16202 raft_consensus.cc:2468] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 2.
I20260709 13:06:07.405297 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:07.405689 18133 raft_consensus.cc:493] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:07.406371 18133 raft_consensus.cc:515] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:07.417289 18133 leader_election.cc:290] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:07.412271 16320 leader_election.cc:304] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
W20260709 13:06:07.417292 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 53125.7us
I20260709 13:06:07.421600 18154 raft_consensus.cc:2804] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:07.423188 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:07.424115 16205 raft_consensus.cc:2468] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 3.
I20260709 13:06:07.417976 18133 raft_consensus.cc:493] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:07.423663 16320 leader_election.cc:304] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:07.430897 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:07.431021 18151 raft_consensus.cc:3060] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:07.431218 17935 raft_consensus.cc:2764] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:06:07.431682 16199 raft_consensus.cc:2468] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 2.
I20260709 13:06:07.432065 17935 raft_consensus.cc:2749] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:07.430645 18019 raft_consensus.cc:515] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:07.432863 17935 consensus_queue.cc:1048] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:07.422974 18154 raft_consensus.cc:493] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:07.434825 16199 raft_consensus.cc:1275] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:06:07.435119 17935 consensus_queue.cc:1048] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:07.435642 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:07.435964 18019 leader_election.cc:290] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 5 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:07.437094 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:07.439713 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:07.440644 16356 raft_consensus.cc:2468] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 4.
I20260709 13:06:07.444242 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:07.445312 16199 raft_consensus.cc:2468] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 4.
I20260709 13:06:07.434830 18154 raft_consensus.cc:3060] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:07.461277 16356 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b241405f79a345849ba216394fcb999a"
dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
mode: GRACEFUL
new_leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
 from {username='slave'} at 127.0.0.1:56792
I20260709 13:06:07.462145 16356 raft_consensus.cc:606] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Received request to transfer leadership to TS 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:06:07.462671 16947 raft_consensus.cc:3060] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 2 LEARNER]: Advancing to term 3
I20260709 13:06:07.462488 16356 raft_consensus.cc:614] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:07.469866 18035 raft_consensus.cc:2764] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:06:07.473526 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f022e2e63ae4461d834e476ff2666991" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:07.476681 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
W20260709 13:06:07.500890 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 79916.8us
I20260709 13:06:07.498293 16246 leader_election.cc:304] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
W20260709 13:06:07.503309 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 61144.9us
I20260709 13:06:07.503340 18151 raft_consensus.cc:2749] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:07.512475 18154 raft_consensus.cc:515] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:07.512887 16355 raft_consensus.cc:2468] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 3.
W20260709 13:06:07.514781 16320 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:07.516191 16320 leader_election.cc:304] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:07.502907 16246 leader_election.cc:304] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:07.517699 16246 leader_election.cc:304] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:07.439601 18133 raft_consensus.cc:515] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:07.521561 18153 raft_consensus.cc:2804] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:07.460556 18158 raft_consensus.cc:515] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:07.527740 18153 raft_consensus.cc:493] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:07.528152 16201 raft_consensus.cc:1240] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 2. Current term is 3. Ops: []
W20260709 13:06:07.525409 16914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:07.518352 18136 raft_consensus.cc:2804] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:07.519877 18128 raft_consensus.cc:2804] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:07.520094 17935 consensus_queue.cc:1048] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:06:07.532725 18153 raft_consensus.cc:3060] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:07.539556 18136 raft_consensus.cc:493] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:07.539073 18128 raft_consensus.cc:493] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:07.555343 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:07.548267 18137 raft_consensus.cc:2804] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:07.562177 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:07.563143 16205 raft_consensus.cc:3060] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:07.557701 18136 raft_consensus.cc:3060] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:07.568400 16367 tablet_copy_service.cc:342] P 363bb2f744eb486f9ad726f08214c98e: Request end of tablet copy session 1109f76a0b7b443a84c0327c8707bc63-b9e1324823f04d8da5a4b3ddbd061c0e received from {username='slave'} at 127.0.0.1:33486
I20260709 13:06:07.568873 18158 leader_election.cc:290] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:06:07.572305 18113 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.015s	sys 0.029s
W20260709 13:06:07.598001 18113 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.554s	user 0.016s	sys 0.029s
I20260709 13:06:07.549562 18031 consensus_queue.cc:1048] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 13:06:07.559132 18128 raft_consensus.cc:3060] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:07.559065 18154 leader_election.cc:290] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:07.583022 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:07.601503 16280 raft_consensus.cc:3060] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:07.584180 16353 raft_consensus.cc:1240] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:07.585573 18133 leader_election.cc:290] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:07.578228 18035 raft_consensus.cc:493] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:07.588091 16940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:07.588296 18105 raft_consensus.cc:3055] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:07.560220 18137 raft_consensus.cc:493] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:07.597477 16367 tablet_copy_service.cc:434] P 363bb2f744eb486f9ad726f08214c98e: ending tablet copy session 1109f76a0b7b443a84c0327c8707bc63-b9e1324823f04d8da5a4b3ddbd061c0e on tablet b9e1324823f04d8da5a4b3ddbd061c0e with peer 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:06:07.609633 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:07.610392 16353 raft_consensus.cc:2468] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 4.
I20260709 13:06:07.611338 18137 raft_consensus.cc:3060] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:07.611539 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:07.612193 16353 raft_consensus.cc:2468] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 3.
I20260709 13:06:07.613564 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:07.614195 16353 raft_consensus.cc:2376] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 4. Re-sending same reply.
I20260709 13:06:07.605551 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:07.615027 18035 raft_consensus.cc:515] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:07.615661 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:07.608080 16281 raft_consensus.cc:1275] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:07.617022 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:07.617327 18035 leader_election.cc:290] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:07.618418 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:07.639869 16350 raft_consensus.cc:2376] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 4. Re-sending same reply.
I20260709 13:06:07.608651 18105 raft_consensus.cc:740] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
W20260709 13:06:07.633137 16102 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38830 (request call id 220) took 13919 ms (client timeout 15000 ms). Trace:
I20260709 13:06:07.641853 16205 raft_consensus.cc:2468] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 4.
I20260709 13:06:07.629472 18153 raft_consensus.cc:515] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:07.635874 16106 catalog_manager.cc:5697] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 1 to 2, leader changed from 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) to 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68). New cstate: current_term: 2 leader_uuid: "1109f76a0b7b443a84c0327c8707bc63" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:06:07.641258 16353 raft_consensus.cc:2468] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 3.
I20260709 13:06:07.644140 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:07.645020 16350 raft_consensus.cc:2468] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 4.
I20260709 13:06:07.645793 16280 raft_consensus.cc:2468] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 4.
I20260709 13:06:07.648808 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:07.650483 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:06:07.651021 16914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:07.651615 16282 raft_consensus.cc:2468] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 3.
I20260709 13:06:07.655465 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:07.654910 18043 raft_consensus.cc:493] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:07.657438 16356 raft_consensus.cc:2368] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for earlier term 4. Current term is 5.
I20260709 13:06:07.657236 18043 raft_consensus.cc:515] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:07.658347 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:07.642463 18035 raft_consensus.cc:493] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:07.634243 18128 raft_consensus.cc:515] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:07.666930 17983 raft_consensus.cc:493] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:07.666662 16173 leader_election.cc:304] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:07.659467 18043 leader_election.cc:290] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:07.667580 17983 raft_consensus.cc:515] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:07.664083 18133 raft_consensus.cc:493] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:07.668705 18133 raft_consensus.cc:515] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:07.670024 17983 leader_election.cc:290] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:07.661921 18121 consensus_queue.cc:1059] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 13:06:07.666405 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:07.673888 16201 raft_consensus.cc:3060] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:07.675328 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:07.675639 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:07.676301 16207 raft_consensus.cc:2393] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 4: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:06:07.671680 18121 raft_consensus.cc:3055] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:07.675091 18035 raft_consensus.cc:515] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:07.680393 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:07.680498 18121 raft_consensus.cc:740] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:07.678067 18158 raft_consensus.cc:2804] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:07.682775 18158 raft_consensus.cc:493] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:07.683256 18158 raft_consensus.cc:3060] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:07.685186 17911 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.636s	user 0.027s	sys 0.027s
W20260709 13:06:07.685658 17911 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.637s	user 0.027s	sys 0.027s
I20260709 13:06:07.687223 16948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:07.681824 18121 consensus_queue.cc:260] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:07.688870 18121 raft_consensus.cc:3060] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:07.671908 18105 consensus_queue.cc:260] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:07.696425 18105 raft_consensus.cc:3060] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:07.671993 18128 leader_election.cc:290] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:07.670893 18133 leader_election.cc:290] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:06:07.642819 16102 rpcz_store.cc:269] 0709 13:05:53.713224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:53.731786 (+ 18562us) service_pool.cc:224] Handling call
0709 13:06:07.632886 (+13901100us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:04.013459 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:04.255340 (+241881us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:04.256641 (+  1301us) write_op.cc:435] Acquired schema lock
0709 13:06:04.261347 (+  4706us) tablet.cc:662] Decoding operations
0709 13:06:04.323660 (+ 62313us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:04.382936 (+ 59276us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:04.387375 (+  4439us) tablet.cc:685] Acquiring locks for 10 operations
0709 13:06:04.576238 (+188863us) tablet.cc:701] Row locks acquired
0709 13:06:04.583000 (+  6762us) write_op.cc:260] PREPARE: finished
0709 13:06:04.596834 (+ 13834us) write_op.cc:270] Start()
0709 13:06:04.614733 (+ 17899us) write_op.cc:276] Timestamp: P: 1783602364594242 usec, L: 0
0709 13:06:04.619030 (+  4297us) op_driver.cc:348] REPLICATION: starting
0709 13:06:04.648780 (+ 29750us) log.cc:844] Serialized 4029 byte log entry
0709 13:06:05.187213 (+538433us) op_driver.cc:464] REPLICATION: finished
0709 13:06:05.502169 (+314956us) write_op.cc:301] APPLY: starting
0709 13:06:05.502293 (+   124us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:05.502722 (+   429us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:05.578239 (+ 75517us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:05.866036 (+287797us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:05.866649 (+   613us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=10
0709 13:06:05.866740 (+    91us) write_op.cc:312] APPLY: finished
0709 13:06:05.867434 (+   694us) log.cc:844] Serialized 77 byte log entry
0709 13:06:05.867711 (+   277us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:05.868063 (+   352us) write_op.cc:454] Released schema lock
0709 13:06:05.868170 (+   107us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:05.868878 (+   708us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:05.868928 (+    50us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":347696,"reported_tablets":17,"child_traces":[["op",{"apply.queue_time_us":235240,"apply.run_cpu_time_us":7383,"apply.run_wall_time_us":366664,"num_ops":10,"prepare.queue_time_us":148135,"prepare.run_cpu_time_us":23877,"prepare.run_wall_time_us":956751,"raft.queue_time_us":110863,"raft.run_cpu_time_us":13363,"raft.run_wall_time_us":203524,"replication_time_us":518040,"thread_start_us":371832,"threads_started":4,"wal-append.queue_time_us":237998,"wal-append.run_cpu_time_us":7057,"wal-append.run_wall_time_us":1980005}]]}
I20260709 13:06:07.704535 16949 raft_consensus.cc:1240] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 1. Current term is 2. Ops: []
W20260709 13:06:07.708674 18116 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.006s	sys 0.011s
W20260709 13:06:07.709167 18116 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.598s	user 0.006s	sys 0.011s
I20260709 13:06:07.709712 16106 catalog_manager.cc:5697] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 1 to 2, leader changed from 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) to 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66). New cstate: current_term: 2 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:07.711730 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:07.711575 17983 consensus_queue.cc:1059] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:07.712435 16354 raft_consensus.cc:2468] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 3.
I20260709 13:06:07.712122 16106 catalog_manager.cc:5697] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 1 to 3, leader changed from 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) to 363bb2f744eb486f9ad726f08214c98e (127.14.180.67). New cstate: current_term: 3 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } }
I20260709 13:06:07.682435 18035 leader_election.cc:290] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:07.713730 16106 catalog_manager.cc:5697] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 1 to 2, leader changed from e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) to 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66). New cstate: current_term: 2 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:07.670512 18137 raft_consensus.cc:515] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:07.722494 17854 raft_consensus.cc:3060] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:07.726534 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:07.736402 16353 raft_consensus.cc:2468] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 3.
I20260709 13:06:07.737690 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:07.738787 18136 raft_consensus.cc:515] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:07.740502 16280 raft_consensus.cc:2368] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for earlier term 3. Current term is 4.
I20260709 13:06:07.738426 16353 raft_consensus.cc:2468] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 4.
I20260709 13:06:07.770197 16940 raft_consensus.cc:2468] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 3.
I20260709 13:06:07.770396 18031 raft_consensus.cc:493] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:07.771384 18031 raft_consensus.cc:515] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:07.778614 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:07.781940 16912 leader_election.cc:304] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:07.755713 16106 catalog_manager.cc:5697] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } }
W20260709 13:06:07.785907 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 90731.8us
I20260709 13:06:07.793784 16173 leader_election.cc:304] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:07.797962 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:07.798715 16353 raft_consensus.cc:3060] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:07.787446 18162 raft_consensus.cc:2749] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:07.788825 18132 raft_consensus.cc:493] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:07.757026 18158 raft_consensus.cc:515] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:07.800698 16201 raft_consensus.cc:2468] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 5.
I20260709 13:06:07.798095 18121 raft_consensus.cc:493] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:07.814831 16282 raft_consensus.cc:1240] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:07.816140 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:07.816980 16282 raft_consensus.cc:2393] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 4: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:06:07.819464 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:07.821487 16275 raft_consensus.cc:2393] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 3: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:06:07.822403 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:07.810981 18152 raft_consensus.cc:493] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:07.807494 18158 leader_election.cc:290] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:07.799417 18173 consensus_queue.cc:1048] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 13:06:07.811985 18177 raft_consensus.cc:2764] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader election decision vote started in defunct term 4: won
I20260709 13:06:07.826344 18152 raft_consensus.cc:515] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:07.827554 16282 raft_consensus.cc:1275] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:07.828387 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:07.839329 16275 raft_consensus.cc:2410] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:07.805478 18132 raft_consensus.cc:515] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } }
I20260709 13:06:07.860728 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:07.861398 16275 raft_consensus.cc:3060] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:07.862005 18132 leader_election.cc:290] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:07.834758 18151 raft_consensus.cc:493] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:07.824994 18121 raft_consensus.cc:515] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:07.823837 18105 raft_consensus.cc:493] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:07.865676 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 78728.5us
W20260709 13:06:07.865046 16249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:07.870273 16249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:07.870446 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:07.864295 18040 raft_consensus.cc:493] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:07.880321 16202 raft_consensus.cc:1275] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:06:07.886355 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:07.871733 18180 raft_consensus.cc:493] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:07.863037 18151 raft_consensus.cc:515] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:07.902068 18152 leader_election.cc:290] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:07.904578 18151 leader_election.cc:290] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:07.906471 18121 leader_election.cc:290] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:07.908748 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:07.913602 17983 raft_consensus.cc:493] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:07.928680 16280 raft_consensus.cc:2468] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 4.
I20260709 13:06:07.928756 17983 raft_consensus.cc:515] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:07.929778 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:07.930702 16280 raft_consensus.cc:2393] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 4: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
W20260709 13:06:07.915534 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 1.11032e+06us
I20260709 13:06:07.931125 16204 raft_consensus.cc:1240] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:07.931485 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:07.931979 16248 leader_election.cc:304] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:07.932626 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:07.932974 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:07.933367 16248 leader_election.cc:304] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:07.869006 18105 raft_consensus.cc:515] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:07.933779 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:07.934190 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:07.916134 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:07.915555 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:07.917073 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:07.948644 16279 raft_consensus.cc:2393] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 3: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:06:07.888728 18040 raft_consensus.cc:515] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:07.949661 16356 raft_consensus.cc:2376] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 5. Re-sending same reply.
I20260709 13:06:07.951320 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:07.949666 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:07.954141 16279 raft_consensus.cc:3060] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:07.935681 18105 leader_election.cc:290] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:07.936254 18187 raft_consensus.cc:2804] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:07.926257 18148 raft_consensus.cc:3055] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:07.900264 18180 raft_consensus.cc:515] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:07.937866 18121 raft_consensus.cc:2749] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:07.939347 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:07.940937 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:07.942443 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:07.970208 16281 raft_consensus.cc:3060] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:07.970180 16350 raft_consensus.cc:2376] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 5. Re-sending same reply.
I20260709 13:06:07.961748 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:07.944108 16275 raft_consensus.cc:2468] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 4.
I20260709 13:06:07.938436 16353 raft_consensus.cc:2468] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 5.
I20260709 13:06:07.953588 16356 raft_consensus.cc:2468] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 5.
I20260709 13:06:07.931166 17983 leader_election.cc:290] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:07.946291 16320 leader_election.cc:304] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:07.937302 16248 leader_election.cc:304] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:07.942854 17618 tablet_copy_client.cc:538] T c7d554054f014c74992a2a66ff6873cd P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 13:06:07.969326 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 175574us
I20260709 13:06:07.972733 16353 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157"
dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
mode: GRACEFUL
new_leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
 from {username='slave'} at 127.0.0.1:56792
I20260709 13:06:07.951828 18040 leader_election.cc:290] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:07.973254 16356 raft_consensus.cc:1275] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:07.991743 16173 leader_election.cc:304] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
W20260709 13:06:07.993551 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 47381.5us
I20260709 13:06:07.993813 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:07.994448 16350 raft_consensus.cc:2376] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 3. Re-sending same reply.
I20260709 13:06:07.959076 18187 raft_consensus.cc:493] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:07.960376 18148 raft_consensus.cc:740] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:06:08.003104 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:07.992499 17911 raft_consensus.cc:493] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:07.996055 16320 leader_election.cc:304] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:07.995322 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:06:08.003827 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 66620.1us
I20260709 13:06:08.005318 16173 leader_election.cc:304] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:06:07.991757 16353 raft_consensus.cc:606] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 1 LEADER]: Received request to transfer leadership to TS 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:06:08.005543 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:08.007717 16350 raft_consensus.cc:1240] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:06:08.009174 16280 raft_consensus.cc:2410] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:06:08.006608 16282 raft_consensus.cc:2955] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:06:08.011178 16320 leader_election.cc:304] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:08.014904 16352 raft_consensus.cc:2468] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 4.
I20260709 13:06:08.015816 16350 raft_consensus.cc:1275] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:08.003144 18040 raft_consensus.cc:2804] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:08.016506 18040 raft_consensus.cc:697] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 4 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:06:08.016783 18188 raft_consensus.cc:2749] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:08.016330 18114 raft_consensus.cc:2804] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:08.017572 18040 consensus_queue.cc:237] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:08.014918 18154 consensus_queue.cc:1048] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:08.025314 16280 raft_consensus.cc:1240] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:08.006698 18186 raft_consensus.cc:2804] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:08.015681 17911 raft_consensus.cc:515] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:08.010099 17983 raft_consensus.cc:2749] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:08.006239 18187 raft_consensus.cc:3060] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:08.039897 18180 leader_election.cc:290] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:08.044984 16357 raft_consensus.cc:1240] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:08.046213 16248 leader_election.cc:304] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:08.046495 16173 leader_election.cc:304] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:06:08.033185 18151 consensus_queue.cc:1059] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 13:06:08.040942 18186 raft_consensus.cc:493] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:08.040267 17911 leader_election.cc:290] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:06:08.072207 16914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:08.070374 18151 raft_consensus.cc:3055] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:06:08.102979 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 56531.6us
I20260709 13:06:08.104722 16248 leader_election.cc:304] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:08.046128 18114 raft_consensus.cc:697] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 5 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:06:08.109373 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:08.116029 16204 raft_consensus.cc:3060] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:08.052127 18180 raft_consensus.cc:2804] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:08.052834 18171 raft_consensus.cc:2749] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:08.112950 16202 raft_consensus.cc:3055] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:08.104203 18097 raft_consensus.cc:493] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:08.111521 16173 leader_election.cc:304] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:08.070993 18186 raft_consensus.cc:3060] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:08.074420 18133 raft_consensus.cc:3060] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:08.139477 16202 raft_consensus.cc:740] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:08.106295 18151 raft_consensus.cc:740] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:06:08.135540 18180 raft_consensus.cc:493] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
W20260709 13:06:08.161168 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 56542.4us
I20260709 13:06:08.158059 16173 leader_election.cc:304] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:08.157796 18180 raft_consensus.cc:3060] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:08.156658 18188 raft_consensus.cc:2749] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:06:08.158779 18035 raft_consensus.cc:2804] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:06:08.186678 16229 debug-util.cc:398] Leaking SignalData structure 0x7b0800092d60 after lost signal to thread 15060
I20260709 13:06:08.187173 18035 raft_consensus.cc:697] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
W20260709 13:06:08.187952 16229 debug-util.cc:398] Leaking SignalData structure 0x7b08000b7960 after lost signal to thread 16140
I20260709 13:06:08.188318 18035 consensus_queue.cc:237] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:08.118707 18148 consensus_queue.cc:260] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:08.191905 16248 leader_election.cc:304] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:08.177031 16173 leader_election.cc:304] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:06:08.197850 18025 raft_consensus.cc:2764] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:06:08.171074 18105 raft_consensus.cc:493] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:08.198392 18128 consensus_queue.cc:1048] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:08.199121 18105 raft_consensus.cc:515] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:08.201437 18105 leader_election.cc:290] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:08.202661 18190 consensus_queue.cc:1059] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:08.204327 18149 raft_consensus.cc:3055] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:08.204777 18149 raft_consensus.cc:740] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:06:08.205641 18149 consensus_queue.cc:260] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:08.207361 18192 raft_consensus.cc:2804] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:08.206980 18151 consensus_queue.cc:260] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:08.207973 18192 raft_consensus.cc:697] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:08.209443 16173 leader_election.cc:304] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:06:08.170517 18114 consensus_queue.cc:237] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:08.221624 18192 consensus_queue.cc:237] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:08.223127 18031 leader_election.cc:290] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:08.151906 18097 raft_consensus.cc:515] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:08.224362 18184 consensus_queue.cc:1059] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:08.224870 18190 raft_consensus.cc:3055] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:08.225332 18190 raft_consensus.cc:740] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:08.225744 18184 raft_consensus.cc:3055] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:08.226172 18184 raft_consensus.cc:740] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:08.225397 18097 leader_election.cc:290] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:08.231465 16173 leader_election.cc:304] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:06:08.237767 16279 raft_consensus.cc:2468] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 5.
I20260709 13:06:08.241140 18177 raft_consensus.cc:2804] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:08.241649 18177 raft_consensus.cc:493] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:08.242105 18177 raft_consensus.cc:3060] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:08.248143 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 53839.9us
I20260709 13:06:08.208487 18151 raft_consensus.cc:3060] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:08.250938 16204 raft_consensus.cc:2410] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 13:06:08.253681 16249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:08.239502 18171 raft_consensus.cc:2804] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:08.250921 18149 raft_consensus.cc:3060] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:08.269390 16281 raft_consensus.cc:2410] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:06:08.252529 18040 raft_consensus.cc:493] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:08.280310 18197 log.cc:927] Time spent T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 13:06:08.281486 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:08.282287 16348 raft_consensus.cc:2376] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 4. Re-sending same reply.
W20260709 13:06:08.285516 16276 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.468s	user 0.015s	sys 0.032s
I20260709 13:06:08.285619 18133 raft_consensus.cc:2749] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:08.288458 18187 raft_consensus.cc:515] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:08.290925 17618 tablet_bootstrap.cc:492] T c7d554054f014c74992a2a66ff6873cd P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap starting.
I20260709 13:06:08.292374 18147 raft_consensus.cc:3060] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:08.295879 16248 leader_election.cc:304] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:08.273547 18157 raft_consensus.cc:493] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:08.302088 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:08.306275 16173 leader_election.cc:304] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:06:08.265462 18171 raft_consensus.cc:493] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
W20260709 13:06:08.315907 16276 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.498s	user 0.016s	sys 0.033s
I20260709 13:06:08.316567 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:06:08.319430 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:08.303406 16229 debug-util.cc:398] Leaking SignalData structure 0x7b08002d1060 after lost signal to thread 16232
I20260709 13:06:08.322309 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:08.326154 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:08.274113 18183 raft_consensus.cc:2764] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:06:08.323928 16276 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42740 (request call id 124) took 1666 ms. Trace:
I20260709 13:06:08.326880 16207 raft_consensus.cc:3060] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:08.322675 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:06:08.336683 16249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:08.339900 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 66552.1us
I20260709 13:06:08.318251 18031 raft_consensus.cc:2804] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:08.329365 16276 rpcz_store.cc:276] 0709 13:06:06.651117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:06.797559 (+146442us) service_pool.cc:224] Handling call
0709 13:06:06.797978 (+   419us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:06.802114 (+  4136us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:06.802148 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:06.811353 (+  9205us) log.cc:844] Serialized 26 byte log entry
0709 13:06:08.316596 (+1505243us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:08.316658 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:08.316761 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:08.316827 (+    66us) raft_consensus.cc:1685] finished
0709 13:06:08.316845 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:08.317041 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11821,"raft.queue_time_us":746,"raft.run_cpu_time_us":218,"raft.run_wall_time_us":5238,"thread_start_us":1498626,"threads_started":1,"wal-append.queue_time_us":251024,"wal-append.run_cpu_time_us":3188,"wal-append.run_wall_time_us":1027672}
I20260709 13:06:08.226473 18190 consensus_queue.cc:260] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:08.319551 18043 raft_consensus.cc:2804] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:08.352017 16173 leader_election.cc:304] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:06:08.319339 18171 raft_consensus.cc:3060] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:08.329583 16229 debug-util.cc:398] Leaking SignalData structure 0x7b080014e2c0 after lost signal to thread 16233
I20260709 13:06:08.322176 18122 raft_consensus.cc:493] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:08.302947 18040 raft_consensus.cc:515] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:08.323494 18061 consensus_queue.cc:1048] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 13:06:08.364221 18161 raft_consensus.cc:2804] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:08.329459 18186 raft_consensus.cc:515] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:08.355011 18043 raft_consensus.cc:493] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:08.365137 16200 raft_consensus.cc:1240] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 2. Current term is 3. Ops: []
W20260709 13:06:08.383129 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:08.341109 18157 raft_consensus.cc:515] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:08.388955 16173 leader_election.cc:304] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:06:08.368402 18161 raft_consensus.cc:493] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:08.393769 18208 consensus_queue.cc:1048] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.081s
I20260709 13:06:08.396898 18034 raft_consensus.cc:493] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:08.379089 18043 raft_consensus.cc:3060] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:08.329382 18184 consensus_queue.cc:260] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:06:08.407163 16173 leader_election.cc:336] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 1.547s (SENT)
I20260709 13:06:08.377786 18188 consensus_queue.cc:1048] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:06:08.365024 18122 raft_consensus.cc:515] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:08.468251 16173 leader_election.cc:304] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:08.407624 18161 raft_consensus.cc:3060] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:08.410310 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:08.481761 16949 raft_consensus.cc:2468] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 4.
I20260709 13:06:08.468866 16940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
W20260709 13:06:08.490324 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 83191.5us
I20260709 13:06:08.407967 18031 raft_consensus.cc:697] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:08.408282 18187 leader_election.cc:290] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:08.410338 18192 raft_consensus.cc:2804] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:06:08.494709 16173 leader_election.cc:336] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 1.840s (SENT)
I20260709 13:06:08.496584 16173 leader_election.cc:304] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:08.433777 18129 consensus_queue.cc:1048] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.081s
I20260709 13:06:08.470937 18180 raft_consensus.cc:515] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:08.493854 18152 raft_consensus.cc:493] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:08.504949 18175 raft_consensus.cc:3060] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:08.441877 18034 raft_consensus.cc:515] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:08.512181 18152 raft_consensus.cc:515] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:08.495823 16940 raft_consensus.cc:2468] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 3.
I20260709 13:06:08.517071 18010 raft_consensus.cc:3055] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:08.517491 18031 consensus_queue.cc:237] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:08.519011 16322 leader_election.cc:304] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: 
W20260709 13:06:08.562618 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 43709.7us
I20260709 13:06:08.521615 18153 leader_election.cc:290] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:08.523977 18137 leader_election.cc:290] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:08.527470 16202 consensus_queue.cc:260] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:08.528746 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:08.530310 18136 leader_election.cc:290] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:08.577565 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:08.534353 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:08.534793 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:08.535820 16281 raft_consensus.cc:1240] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:08.536648 16275 raft_consensus.cc:1240] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:08.537395 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bc3c8ff9b84838a2664335d7e1582b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:08.538575 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:08.541823 18157 leader_election.cc:290] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:08.549647 16207 raft_consensus.cc:2468] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 3.
I20260709 13:06:08.550083 18035 raft_consensus.cc:2749] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:08.500623 18204 raft_consensus.cc:493] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:08.564991 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:08.568322 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:08.574093 18153 raft_consensus.cc:493] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:08.574180 18114 raft_consensus.cc:2804] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:08.566988 18040 leader_election.cc:290] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:08.574666 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:08.562631 18010 raft_consensus.cc:740] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:06:08.576265 18034 leader_election.cc:290] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:08.586144 16280 raft_consensus.cc:2468] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 3.
I20260709 13:06:08.586828 16282 raft_consensus.cc:2468] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 4.
I20260709 13:06:08.497329 18192 raft_consensus.cc:493] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:08.584311 16279 raft_consensus.cc:2393] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 3: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:06:08.588577 16202 raft_consensus.cc:3060] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:08.594483 18153 raft_consensus.cc:515] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:08.605683 18010 consensus_queue.cc:260] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:08.606994 18010 raft_consensus.cc:3060] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:08.607389 18153 leader_election.cc:290] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:06:08.609025 16229 debug-util.cc:398] Leaking SignalData structure 0x7b08003ca560 after lost signal to thread 16307
W20260709 13:06:08.609375 16229 debug-util.cc:398] Leaking SignalData structure 0x7b08003ca600 after lost signal to thread 16308
I20260709 13:06:08.610337 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:08.590729 16940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
W20260709 13:06:08.611603 18213 log.cc:927] Time spent T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:06:08.619043 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:08.594758 16947 raft_consensus.cc:2468] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 2.
I20260709 13:06:08.619788 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:08.619959 16274 raft_consensus.cc:2468] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 4.
I20260709 13:06:08.620985 16283 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42740 (request call id 130) took 1276 ms. Trace:
I20260709 13:06:08.621061 16282 raft_consensus.cc:2410] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for term 5 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:08.592823 18114 raft_consensus.cc:493] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:08.622318 18114 raft_consensus.cc:3060] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:08.621443 16283 rpcz_store.cc:276] 0709 13:06:07.344224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:08.228332 (+884108us) service_pool.cc:224] Handling call
0709 13:06:08.228764 (+   432us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:08.229253 (+   489us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:08.229288 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:08.229799 (+   511us) log.cc:844] Serialized 26 byte log entry
0709 13:06:08.386624 (+156825us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:08.386877 (+   253us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:08.387007 (+   130us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:08.620779 (+233772us) raft_consensus.cc:1685] finished
0709 13:06:08.620800 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:08.620929 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7174,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":9980,"thread_start_us":156308,"threads_started":1,"wal-append.queue_time_us":262972}
I20260709 13:06:08.612910 18192 raft_consensus.cc:3060] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:08.625168 18212 log.cc:927] Time spent T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.156s	user 0.004s	sys 0.000s
W20260709 13:06:08.629179 18215 log.cc:927] Time spent T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:06:08.631799 18180 leader_election.cc:290] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:08.632459 16352 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33486 (request call id 155) took 1044 ms. Trace:
I20260709 13:06:08.579545 18186 leader_election.cc:290] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:08.578527 16944 raft_consensus.cc:2468] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 4.
I20260709 13:06:08.636734 16355 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41832 (request call id 1386) took 1259 ms. Trace:
I20260709 13:06:08.636916 18177 raft_consensus.cc:515] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:08.637212 16355 rpcz_store.cc:276] 0709 13:06:07.377446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:07.436826 (+ 59380us) service_pool.cc:224] Handling call
0709 13:06:08.636529 (+1199703us) spinlock_profiling.cc:243] Waited 68.1 ms on lock 0x7b54002288d4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:06:08.636642 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":156539648}
I20260709 13:06:08.637872 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:08.639181 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:08.632893 16352 rpcz_store.cc:276] 0709 13:06:07.588223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:08.229907 (+641684us) service_pool.cc:224] Handling call
0709 13:06:08.230349 (+   442us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:08.239940 (+  9591us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:08.239996 (+    56us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:08.249066 (+  9070us) log.cc:844] Serialized 26 byte log entry
0709 13:06:08.354242 (+105176us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:08.354289 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:08.354363 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:08.613897 (+259534us) spinlock_profiling.cc:243] Waited 3.24 ms on lock 0x7b4400022b4c. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361c224db1 00007f361c2c2c85 00007f361c2c36a2 00007f361f0351db 00007f361f030aaf 00007f361f02486e 00007f361f023bb6 00007f361f0237d8 00007f361f02d221 00007f361f02d1d9 00007f361f02d169
0709 13:06:08.632107 (+ 18210us) raft_consensus.cc:1685] finished
0709 13:06:08.632133 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:08.632396 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1809,"raft.queue_time_us":152,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":9147,"spinlock_wait_cycles":7456000,"thread_start_us":95839,"threads_started":1,"wal-append.queue_time_us":134386}
I20260709 13:06:08.642428 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:06:08.574856 16322 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:08.613333 18122 leader_election.cc:290] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:08.644673 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:08.644789 16282 raft_consensus.cc:1240] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:08.645275 16352 raft_consensus.cc:3060] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:08.646502 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:08.600921 18152 leader_election.cc:290] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:08.646652 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bc3c8ff9b84838a2664335d7e1582b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:08.647455 16357 raft_consensus.cc:2468] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 3.
I20260709 13:06:08.610951 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:08.648772 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:08.649747 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:08.614956 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:08.652190 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:08.652232 16199 raft_consensus.cc:1240] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:08.592757 18204 raft_consensus.cc:515] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:08.654106 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:08.654903 16355 raft_consensus.cc:2468] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 4.
I20260709 13:06:08.655189 16276 raft_consensus.cc:2468] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 3.
W20260709 13:06:08.595948 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 104895us
I20260709 13:06:08.657648 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:08.657886 18177 leader_election.cc:290] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:08.658466 16356 raft_consensus.cc:2368] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 3. Current term is 4.
I20260709 13:06:08.610421 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:08.663705 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:08.664426 16275 raft_consensus.cc:2410] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 13:06:08.664537 16173 leader_election.cc:336] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 1.862s (SENT)
I20260709 13:06:08.664438 16356 raft_consensus.cc:2468] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 4.
I20260709 13:06:08.667579 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:08.669428 16352 raft_consensus.cc:2468] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 3.
I20260709 13:06:08.670601 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:08.671368 16352 raft_consensus.cc:2468] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 3.
I20260709 13:06:08.675377 16279 raft_consensus.cc:1240] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:08.675292 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:08.676134 16353 raft_consensus.cc:2393] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 6: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:06:08.678187 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:08.678700 16280 raft_consensus.cc:1240] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:08.679685 16279 raft_consensus.cc:1275] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:08.678880 16350 raft_consensus.cc:2468] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 4.
I20260709 13:06:08.681280 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:08.684782 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:06:08.687672 16320 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:08.686167 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:08.687736 16202 raft_consensus.cc:1240] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:08.689219 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:08.690126 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:06:08.690657 16320 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:08.691296 16276 raft_consensus.cc:1240] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:08.693224 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:08.693873 16352 raft_consensus.cc:3060] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:08.694517 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:08.695910 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:08.697371 16280 raft_consensus.cc:1240] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:08.697631 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:06:08.698274 16321 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:08.699939 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:08.701635 16357 raft_consensus.cc:2468] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 4.
I20260709 13:06:08.702638 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:08.704298 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:08.704818 16356 raft_consensus.cc:2468] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 4.
I20260709 13:06:08.707917 16355 raft_consensus.cc:2468] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 4.
I20260709 13:06:08.709594 16350 raft_consensus.cc:2393] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 5: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
I20260709 13:06:08.716755 18148 raft_consensus.cc:3060] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:08.718815 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:08.719734 16202 raft_consensus.cc:2468] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 4.
I20260709 13:06:08.721016 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:08.721792 16202 raft_consensus.cc:2393] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 3: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:06:08.722242 18204 leader_election.cc:290] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:06:08.722774 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 65947.6us
I20260709 13:06:08.724525 16279 raft_consensus.cc:1240] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 2. Current term is 4. Ops: []
I20260709 13:06:08.726737 16275 raft_consensus.cc:1275] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:08.728621 16202 raft_consensus.cc:1275] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:08.732950 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:08.782388 16356 raft_consensus.cc:1275] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 5 index: 2. (index mismatch)
W20260709 13:06:08.723523 16173 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 2.104s (SENT) [suppressed 28 similar messages]
W20260709 13:06:08.806648 16249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:08.810792 16355 raft_consensus.cc:1240] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:08.651714 18043 raft_consensus.cc:515] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:08.840826 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:08.813591 16246 leader_election.cc:304] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:08.642989 18171 raft_consensus.cc:515] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:08.839715 16208 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60138 (request call id 1355) took 1400 ms. Trace:
I20260709 13:06:08.818013 16352 raft_consensus.cc:2468] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 5.
W20260709 13:06:08.859269 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 45761.4us
I20260709 13:06:08.850455 16208 rpcz_store.cc:276] 0709 13:06:07.396218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:07.398655 (+  2437us) service_pool.cc:224] Handling call
0709 13:06:07.398990 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:07.399233 (+   243us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:06:07.438190 (+ 38957us) log.cc:844] Serialized 14 byte log entry
0709 13:06:08.795647 (+1357457us) spinlock_profiling.cc:243] Waited 14.1 ms on lock 0x7b1800151c00. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f3625264de1 00007f36252715b1 00007f361f0314bc 00007f361c37f48b 00007f36251d9ab9 00007f361c39b69b 00007f361c39993f 00007f361c39bc02 00007f361f02320b 00007f361f028d23 00007f361f02923a
0709 13:06:08.795908 (+   261us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:08.795981 (+    73us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:08.796069 (+    88us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:08.796165 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:08.796347 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39311,"prepare.queue_time_us":55953,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":67,"raft.queue_time_us":14096,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":29931,"spinlock_wait_cycles":32502528,"thread_start_us":100269,"threads_started":2,"wal-append.queue_time_us":83940,"wal-append.run_cpu_time_us":1123,"wal-append.run_wall_time_us":1007114}
I20260709 13:06:08.877777 16203 raft_consensus.cc:1240] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:08.883363 16207 raft_consensus.cc:1275] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:06:08.885799 16202 raft_consensus.cc:1275] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 5 index: 2. (index mismatch)
I20260709 13:06:08.889784 18180 consensus_queue.cc:1048] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:08.892926 18105 consensus_queue.cc:1048] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:08.912221 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
W20260709 13:06:08.916929 16249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:08.916075 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:08.918146 16352 raft_consensus.cc:3060] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:08.871210 18121 raft_consensus.cc:2804] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:08.854861 18031 consensus_queue.cc:1059] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.063s
I20260709 13:06:08.867113 18161 raft_consensus.cc:515] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:08.920500 16200 raft_consensus.cc:1240] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 3. Current term is 4. Ops: []
W20260709 13:06:08.964570 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 241057us
I20260709 13:06:08.968669 16173 leader_election.cc:400] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 pre-election: Vote denied by peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823) with higher term. Message: Invalid argument: T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for earlier term 3. Current term is 4.
I20260709 13:06:08.973809 16173 leader_election.cc:403] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:08.974794 16352 raft_consensus.cc:2468] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 4.
I20260709 13:06:08.979739 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:08.952046 18121 raft_consensus.cc:697] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:08.962971 18175 raft_consensus.cc:2749] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:09.012252 16173 leader_election.cc:304] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:09.013672 16208 raft_consensus.cc:1240] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:09.014093 16173 leader_election.cc:304] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:09.016127 16173 leader_election.cc:304] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:09.005941 18035 raft_consensus.cc:3060] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:06:09.008780 18192 raft_consensus.cc:515] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:09.011350 18177 raft_consensus.cc:493] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:09.037959 16204 raft_consensus.cc:1240] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:09.022323 18186 raft_consensus.cc:2804] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:09.023787 18220 raft_consensus.cc:2804] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:09.006310 18114 raft_consensus.cc:515] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:09.048810 16322 leader_election.cc:304] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:09.015805 18133 consensus_queue.cc:1059] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 13:06:09.023355 18219 consensus_queue.cc:1059] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 13:06:09.063421 16322 leader_election.cc:304] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:09.022686 18157 consensus_queue.cc:1059] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.026s
W20260709 13:06:09.047549 16229 debug-util.cc:398] Leaking SignalData structure 0x7b080012c440 after lost signal to thread 16381
I20260709 13:06:09.034572 18175 consensus_queue.cc:1059] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.028s
W20260709 13:06:09.078928 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:09.046818 18186 raft_consensus.cc:493] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:09.062023 18220 raft_consensus.cc:697] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 3 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:09.066810 18147 raft_consensus.cc:493] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:09.045131 18177 raft_consensus.cc:515] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:06:09.080762 18221 log.cc:927] Time spent T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.212s	user 0.000s	sys 0.002s
I20260709 13:06:09.083863 18152 raft_consensus.cc:2749] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:09.086875 18186 raft_consensus.cc:3060] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:09.073535 18151 consensus_queue.cc:1048] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 13:06:09.103531 18147 raft_consensus.cc:515] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:09.124696 18177 leader_election.cc:290] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:09.099028 18043 leader_election.cc:290] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:06:09.117252 16229 debug-util.cc:398] Leaking SignalData structure 0x7b08002da040 after lost signal to thread 16973
I20260709 13:06:09.091893 18121 consensus_queue.cc:237] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:06:09.141223 16229 debug-util.cc:398] Leaking SignalData structure 0x7b0800108120 after lost signal to thread 16974
W20260709 13:06:09.161880 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 144395us
I20260709 13:06:09.137214 18147 leader_election.cc:290] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:09.170717 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:09.141700 18192 leader_election.cc:290] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:06:09.160737 18223 log.cc:927] Time spent T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.163s	user 0.000s	sys 0.002s
I20260709 13:06:09.190325 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:06:09.196376 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 133032us
W20260709 13:06:09.180401 16229 debug-util.cc:398] Leaking SignalData structure 0x7b080038b560 after lost signal to thread 17986
I20260709 13:06:09.174683 18204 raft_consensus.cc:493] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:09.202996 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
W20260709 13:06:09.191879 18224 log.cc:927] Time spent T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
W20260709 13:06:09.201661 16229 debug-util.cc:398] Leaking SignalData structure 0x7b080038b7c0 after lost signal to thread 18001
W20260709 13:06:09.189071 18010 consensus_meta.cc:287] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 0.582s	user 0.014s	sys 0.000s
I20260709 13:06:09.209220 16277 raft_consensus.cc:3060] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:09.232158 18226 log.cc:927] Time spent T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
I20260709 13:06:09.237151 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:09.223271 16351 raft_consensus.cc:2468] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 2.
I20260709 13:06:09.239588 16274 raft_consensus.cc:1275] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:09.241328 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:09.242690 18190 raft_consensus.cc:3060] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:09.241232 16349 raft_consensus.cc:1240] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e [term 4 LEADER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:09.246523 16349 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41832 (request call id 1384) took 1869 ms. Trace:
I20260709 13:06:09.246923 16349 rpcz_store.cc:276] 0709 13:06:07.377122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:08.019358 (+642236us) service_pool.cc:224] Handling call
0709 13:06:08.019696 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:09.241042 (+1221346us) spinlock_profiling.cc:243] Waited 11.9 ms on lock 0x7b5400109da0. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f400dc0 00007f361f48b1c0 00007f361f48c231 00007f361f488d8f 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c
0709 13:06:09.246186 (+  5144us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:09.246458 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":27460864}
I20260709 13:06:09.248741 16349 raft_consensus.cc:1240] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260709 13:06:09.249912 18148 consensus_meta.cc:287] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 0.533s	user 0.008s	sys 0.005s
I20260709 13:06:09.250149 16349 raft_consensus.cc:3060] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:09.228425 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
W20260709 13:06:09.217429 16229 debug-util.cc:398] Leaking SignalData structure 0x7b0800341b20 after lost signal to thread 18002
I20260709 13:06:09.201582 18183 raft_consensus.cc:2804] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:09.181588 18043 consensus_queue.cc:1059] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 13:06:09.207732 18192 consensus_queue.cc:1048] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.028s
W20260709 13:06:09.275039 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:09.226168 18114 leader_election.cc:290] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:06:09.285153 16249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:09.285436 16208 raft_consensus.cc:1240] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:09.263789 16322 leader_election.cc:304] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:09.279975 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
W20260709 13:06:09.281263 18229 log.cc:927] Time spent T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.180s	user 0.001s	sys 0.000s
I20260709 13:06:09.233994 16940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:09.177507 18220 consensus_queue.cc:237] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:09.282447 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:06:09.272099 16229 debug-util.cc:398] Leaking SignalData structure 0x7b080038b780 after lost signal to thread 18004
W20260709 13:06:09.272706 18231 log.cc:927] Time spent T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 13:06:09.294986 16354 raft_consensus.cc:1240] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:09.216229 18204 raft_consensus.cc:515] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:09.283687 18149 raft_consensus.cc:2749] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:09.298076 16322 leader_election.cc:304] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:09.305725 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:09.319088 16947 raft_consensus.cc:1275] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:09.311789 18175 raft_consensus.cc:493] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:09.296792 18129 consensus_queue.cc:1059] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 13:06:09.326647 18175 raft_consensus.cc:515] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:06:09.329357 18233 log.cc:927] Time spent T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
I20260709 13:06:09.311636 18157 raft_consensus.cc:493] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:09.331831 18157 raft_consensus.cc:515] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:09.336210 18204 leader_election.cc:290] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:09.337442 16349 raft_consensus.cc:1275] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 13:06:09.340269 18234 log.cc:927] Time spent T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
W20260709 13:06:09.343145 18228 log.cc:927] Time spent T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
W20260709 13:06:09.345206 18232 log.cc:927] Time spent T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.161s	user 0.000s	sys 0.001s
I20260709 13:06:09.356840 18035 raft_consensus.cc:2749] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823) with higher term. Message: Invalid argument: T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for earlier term 3. Current term is 4.
I20260709 13:06:09.299146 18238 raft_consensus.cc:493] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:09.359457 18238 raft_consensus.cc:515] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:06:09.301723 16229 debug-util.cc:398] Leaking SignalData structure 0x7b080038b700 after lost signal to thread 18016
W20260709 13:06:09.366274 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 68144.4us
I20260709 13:06:09.306524 18242 raft_consensus.cc:3055] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:09.373059 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:09.369519 16322 leader_election.cc:304] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:06:09.369045 16229 debug-util.cc:398] Leaking SignalData structure 0x7b0800368780 after lost signal to thread 18021
I20260709 13:06:09.309760 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:09.380718 16322 leader_election.cc:304] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:09.376061 16914 leader_election.cc:304] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:06:09.381690 16322 leader_election.cc:304] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:09.368382 18204 raft_consensus.cc:493] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:09.394500 16173 leader_election.cc:304] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:06:09.385682 16355 raft_consensus.cc:1275] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:06:09.368419 18148 raft_consensus.cc:2749] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:09.368626 18114 raft_consensus.cc:2749] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:09.397477 16173 leader_election.cc:400] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 election: Vote denied by peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107) with higher term. Message: Invalid argument: T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for earlier term 4. Current term is 5.
I20260709 13:06:09.401207 16173 leader_election.cc:304] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:09.402710 16173 leader_election.cc:304] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:06:09.376142 18242 raft_consensus.cc:740] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:09.382436 18175 leader_election.cc:290] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:06:09.398633 16320 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:09.392035 18238 leader_election.cc:290] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:09.418190 16277 raft_consensus.cc:2468] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 4.
I20260709 13:06:09.400667 18157 leader_election.cc:290] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:09.401696 18043 raft_consensus.cc:2804] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:06:09.427337 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 51347.6us
W20260709 13:06:09.441999 16249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:09.423062 16229 debug-util.cc:398] Leaking SignalData structure 0x7b08003c4480 after lost signal to thread 18126
I20260709 13:06:09.411952 18192 raft_consensus.cc:2749] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:09.419251 18190 raft_consensus.cc:2804] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:09.398012 18204 raft_consensus.cc:515] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:06:09.460384 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 78733.5us
I20260709 13:06:09.419623 18251 raft_consensus.cc:2749] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:09.424224 18010 raft_consensus.cc:2804] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:09.458580 16914 leader_election.cc:304] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:06:09.409255 18242 consensus_queue.cc:260] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:09.469291 16322 leader_election.cc:304] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:09.419051 18175 consensus_queue.cc:1048] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 13:06:09.431572 18043 raft_consensus.cc:493] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:09.482697 18248 raft_consensus.cc:493] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:09.483417 18248 raft_consensus.cc:515] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:09.485895 18248 leader_election.cc:290] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:09.430438 18238 consensus_queue.cc:1059] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.047s
I20260709 13:06:09.456933 18247 raft_consensus.cc:2749] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:09.460551 18250 raft_consensus.cc:2804] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:09.462841 18190 raft_consensus.cc:493] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:09.505043 16322 leader_election.cc:304] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:09.458473 18220 consensus_queue.cc:1048] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 13:06:09.480999 18043 raft_consensus.cc:3060] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:09.490661 18010 raft_consensus.cc:697] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 4 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
W20260709 13:06:09.513406 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 91958.3us
I20260709 13:06:09.503245 18248 raft_consensus.cc:2749] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:09.505987 18208 raft_consensus.cc:493] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:09.506500 18190 raft_consensus.cc:3060] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:09.527601 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:09.507572 18061 raft_consensus.cc:493] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:09.528362 16207 raft_consensus.cc:2468] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 3.
I20260709 13:06:09.511142 18251 raft_consensus.cc:2749] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:09.511202 18262 raft_consensus.cc:493] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:09.533125 16320 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:09.534093 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 75625.2us
W20260709 13:06:09.534516 16320 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:09.525971 18230 log.cc:927] Time spent T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.388s	user 0.000s	sys 0.004s
I20260709 13:06:09.533680 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:09.540437 16173 leader_election.cc:304] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:09.541872 16173 leader_election.cc:304] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:06:09.549460 18192 raft_consensus.cc:493] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:09.551288 16173 leader_election.cc:304] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:06:09.560565 16320 leader_election.cc:304] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:09.563822 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:09.539798 18248 raft_consensus.cc:493] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:09.552189 18157 raft_consensus.cc:2804] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:09.551419 18238 raft_consensus.cc:2804] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:09.584961 18157 raft_consensus.cc:493] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:09.586197 18157 raft_consensus.cc:3060] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:09.587309 18238 raft_consensus.cc:493] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:09.587937 18238 raft_consensus.cc:3060] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:09.588389 18158 raft_consensus.cc:2749] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:09.556061 18180 raft_consensus.cc:493] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:09.545652 18262 raft_consensus.cc:515] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:09.589964 18180 raft_consensus.cc:515] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:09.591903 18262 leader_election.cc:290] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:09.592432 18180 leader_election.cc:290] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:09.592548 18262 raft_consensus.cc:2804] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:09.592785 18184 raft_consensus.cc:3060] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:09.593111 18262 raft_consensus.cc:493] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:09.593394 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:09.583823 18248 raft_consensus.cc:515] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:09.594841 18187 raft_consensus.cc:3055] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:09.595242 18187 raft_consensus.cc:740] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:09.596374 18248 leader_election.cc:290] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:09.596086 18187 consensus_queue.cc:260] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:09.587343 18204 leader_election.cc:290] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:09.597467 18187 raft_consensus.cc:3060] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:09.555617 18035 raft_consensus.cc:493] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
W20260709 13:06:09.589396 16351 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41832 (request call id 1380) took 2213 ms (client timeout 1547 ms). Trace:
I20260709 13:06:09.580199 16940 raft_consensus.cc:1275] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:06:09.524703 18247 consensus_queue.cc:1059] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
W20260709 13:06:09.600466 16351 rpcz_store.cc:269] 0709 13:06:07.376273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:08.642136 (+1265863us) service_pool.cc:224] Handling call
0709 13:06:09.589193 (+947057us) spinlock_profiling.cc:243] Waited 580 ms on lock 0x7b540026af54. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:06:09.589320 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1333975808}
I20260709 13:06:09.593585 18262 raft_consensus.cc:3060] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:09.540055 18061 raft_consensus.cc:515] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:06:09.582741 18010 consensus_queue.cc:237] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:06:09.574401 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:09.550422 18192 raft_consensus.cc:515] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:06:09.594398 18260 log.cc:927] Time spent T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
W20260709 13:06:09.572283 18239 log.cc:927] Time spent T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.179s	user 0.001s	sys 0.000s
W20260709 13:06:09.613443 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 73478.7us
I20260709 13:06:09.620566 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:09.537060 18208 raft_consensus.cc:515] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:09.621484 18238 raft_consensus.cc:515] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:06:09.625573 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 115630us
I20260709 13:06:09.602948 18250 raft_consensus.cc:697] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 5 LEADER]: Becoming Leader. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
W20260709 13:06:09.639878 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 79422.9us
I20260709 13:06:09.612627 18185 raft_consensus.cc:493] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:09.641172 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 87805.5us
I20260709 13:06:09.642632 16948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:09.643545 16948 raft_consensus.cc:2410] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:06:09.644405 16322 leader_election.cc:304] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:09.658932 18276 raft_consensus.cc:493] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:09.659781 18276 raft_consensus.cc:515] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:09.604221 18035 raft_consensus.cc:515] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:09.663619 18271 raft_consensus.cc:2804] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:09.664271 18242 raft_consensus.cc:3060] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:09.664695 18208 leader_election.cc:290] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:09.614789 18114 consensus_queue.cc:1059] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 13:06:09.611004 18186 raft_consensus.cc:515] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:09.702241 16940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f022e2e63ae4461d834e476ff2666991" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:09.702945 18272 consensus_queue.cc:1048] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:09.705602 18248 raft_consensus.cc:3055] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:09.705972 18157 raft_consensus.cc:515] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:09.707862 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:09.703367 16940 raft_consensus.cc:2393] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 2: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
I20260709 13:06:09.706104 18248 raft_consensus.cc:740] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:06:09.715699 16948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:09.662418 18276 leader_election.cc:290] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:06:09.718703 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 89120.6us
I20260709 13:06:09.664297 18271 raft_consensus.cc:697] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [term 5 LEADER]: Becoming Leader. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
W20260709 13:06:09.726791 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 82482us
W20260709 13:06:09.727195 16249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:09.690088 18171 leader_election.cc:290] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:09.733179 16322 leader_election.cc:304] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:09.735270 16201 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60154 (request call id 1335) took 1048 ms. Trace:
I20260709 13:06:09.736822 16205 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60138 (request call id 1385) took 1204 ms. Trace:
I20260709 13:06:09.690460 18220 consensus_queue.cc:1048] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:06:09.737243 16205 rpcz_store.cc:276] 0709 13:06:08.532684 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:08.589143 (+ 56459us) service_pool.cc:224] Handling call
0709 13:06:08.602433 (+ 13290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:08.656359 (+ 53926us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:06:08.915853 (+259494us) log.cc:844] Serialized 14 byte log entry
0709 13:06:09.078174 (+162321us) log.cc:844] Serialized 14 byte log entry
0709 13:06:09.183680 (+105506us) log.cc:844] Serialized 14 byte log entry
0709 13:06:09.183957 (+   277us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:09.184020 (+    63us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:09.184080 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:09.730954 (+546874us) spinlock_profiling.cc:243] Waited 53.7 ms on lock 0x7b54003d1654. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f489e01 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6
0709 13:06:09.731023 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:09.736759 (+  5736us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":321963,"prepare.run_cpu_time_us":129,"prepare.run_wall_time_us":2784,"raft.queue_time_us":93409,"raft.run_cpu_time_us":251,"raft.run_wall_time_us":253,"spinlock_wait_cycles":124942592,"thread_start_us":478665,"threads_started":3,"wal-append.queue_time_us":240817}
I20260709 13:06:09.736434 16201 rpcz_store.cc:276] 0709 13:06:08.686746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:08.688391 (+  1645us) service_pool.cc:224] Handling call
0709 13:06:08.961887 (+273496us) spinlock_profiling.cc:243] Waited 2.33 ms on lock 0x7b5800002a98. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361c224db1 00007f361c364b71 00007f361c364a22 00007f362527dc09 00007f36243d7ee0 00007f36244a10ab 00007f36244a1131 00007f3624462fc0 00007f362444d929 00007f362444d3d2 00007f361d9c4bd4
0709 13:06:08.962103 (+   216us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:08.997159 (+ 35056us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:08.997191 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:09.008460 (+ 11269us) log.cc:844] Serialized 26 byte log entry
0709 13:06:09.199865 (+191405us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:09.199938 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:09.203753 (+  3815us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:09.715663 (+511910us) raft_consensus.cc:1685] finished
0709 13:06:09.715687 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:09.735151 (+ 19464us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":34927,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":6053,"spinlock_wait_cycles":5355904,"thread_start_us":176371,"threads_started":1,"wal-append.queue_time_us":295594}
I20260709 13:06:09.746469 16322 leader_election.cc:304] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:09.748654 18192 leader_election.cc:290] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:06:09.754738 18267 log.cc:927] Time spent T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.097s	user 0.000s	sys 0.005s
W20260709 13:06:09.755440 18256 log.cc:927] Time spent T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.136s	user 0.000s	sys 0.005s
I20260709 13:06:09.755215 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:06:09.761987 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:09.652369 18185 raft_consensus.cc:515] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:09.762869 16940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:06:09.770362 18271 consensus_queue.cc:237] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:09.771077 16278 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45218 (request call id 1464) took 1231 ms. Trace:
W20260709 13:06:09.776168 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:09.777057 16248 leader_election.cc:400] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107) with higher term. Message: Invalid argument: T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 3. Current term is 4.
I20260709 13:06:09.771445 16278 rpcz_store.cc:276] 0709 13:06:08.539686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:09.770153 (+1230467us) service_pool.cc:224] Handling call
0709 13:06:09.770509 (+   356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:09.770728 (+   219us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:09.770752 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:09.770792 (+    40us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:09.770831 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:09.770886 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:09.771019 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:09.780462 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:06:09.762873 16944 raft_consensus.cc:2468] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 4.
I20260709 13:06:09.786959 16248 leader_election.cc:304] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:09.783799 18238 leader_election.cc:290] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:09.745811 18010 raft_consensus.cc:493] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:09.790833 16948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:06:09.792273 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:09.793581 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:09.794909 18185 leader_election.cc:290] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:09.799079 16948 raft_consensus.cc:2410] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:06:09.747553 18278 raft_consensus.cc:2749] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:09.749691 18273 raft_consensus.cc:2804] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:09.802532 16248 leader_election.cc:304] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:09.784361 18175 raft_consensus.cc:493] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:09.791594 18171 raft_consensus.cc:493] T b9e1324823f04d8da5a4b3ddbd061c0e P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:09.845726 16248 leader_election.cc:304] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:09.765754 18248 consensus_queue.cc:260] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:09.848516 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:09.740147 18250 consensus_queue.cc:237] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:09.850414 16948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:09.843473 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:09.854276 16944 raft_consensus.cc:2468] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 2.
I20260709 13:06:09.831669 16943 raft_consensus.cc:2468] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 2.
I20260709 13:06:09.866655 18208 raft_consensus.cc:2749] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:09.841699 18185 consensus_queue.cc:1048] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
W20260709 13:06:09.868285 16249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:09.843524 18128 raft_consensus.cc:2749] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:06:09.875146 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 223920us
W20260709 13:06:09.844805 18261 log.cc:927] Time spent T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.146s	user 0.004s	sys 0.001s
I20260709 13:06:09.803243 18010 raft_consensus.cc:515] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:09.843381 18282 raft_consensus.cc:2749] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:09.832136 18273 raft_consensus.cc:493] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:09.887256 16248 leader_election.cc:304] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:09.846771 18061 leader_election.cc:290] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:09.890205 16248 leader_election.cc:304] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:09.897469 18010 leader_election.cc:290] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:09.845744 18278 consensus_queue.cc:1048] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 13:06:09.880592 18248 raft_consensus.cc:3060] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:09.933143 18252 raft_consensus.cc:493] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:09.933804 18252 raft_consensus.cc:515] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:06:09.936561 16249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:09.922801 16248 leader_election.cc:304] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:09.852978 18262 raft_consensus.cc:515] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:09.849603 18171 raft_consensus.cc:515] T b9e1324823f04d8da5a4b3ddbd061c0e P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:06:09.849020 18175 raft_consensus.cc:515] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:09.889457 18273 raft_consensus.cc:3060] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:09.942129 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 77867us
I20260709 13:06:09.883119 18043 raft_consensus.cc:515] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:09.895710 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:09.895022 18186 leader_election.cc:290] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:09.894060 18208 raft_consensus.cc:2749] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:09.931766 18187 raft_consensus.cc:2749] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:09.937777 18010 raft_consensus.cc:493] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:09.951712 16912 leader_election.cc:304] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:06:09.936414 18183 raft_consensus.cc:493] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:09.944198 16940 raft_consensus.cc:2468] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 3.
I20260709 13:06:09.951229 18128 raft_consensus.cc:2804] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:09.966758 18128 raft_consensus.cc:493] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:09.967317 18128 raft_consensus.cc:3060] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:09.959749 18269 raft_consensus.cc:2804] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:09.960762 18171 leader_election.cc:290] T b9e1324823f04d8da5a4b3ddbd061c0e P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:09.975378 18269 raft_consensus.cc:493] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:09.975621 18171 raft_consensus.cc:493] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:09.975890 18269 raft_consensus.cc:3060] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:09.976267 18171 raft_consensus.cc:515] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:09.961269 18262 leader_election.cc:290] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:09.962216 18190 raft_consensus.cc:515] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:09.963088 18043 leader_election.cc:290] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:09.964047 16354 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41830 (request call id 1393) took 1291 ms. Trace:
W20260709 13:06:09.983549 18237 log.cc:927] Time spent T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.702s	user 0.001s	sys 0.002s
I20260709 13:06:09.958151 18010 raft_consensus.cc:515] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:09.984899 18171 leader_election.cc:290] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:09.985168 16356 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41830 (request call id 1379) took 1316 ms. Trace:
I20260709 13:06:09.985824 18279 raft_consensus.cc:2804] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:09.986491 18279 raft_consensus.cc:493] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:09.956903 18183 raft_consensus.cc:3060] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:09.978257 16354 rpcz_store.cc:276] 0709 13:06:08.672441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:09.301212 (+628771us) service_pool.cc:224] Handling call
0709 13:06:09.310526 (+  9314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:09.365842 (+ 55316us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:09.365877 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:09.366365 (+   488us) log.cc:844] Serialized 26 byte log entry
0709 13:06:09.429873 (+ 63508us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:09.469267 (+ 39394us) log.cc:844] Serialized 14 byte log entry
0709 13:06:09.489656 (+ 20389us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:09.489738 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:09.963851 (+474113us) raft_consensus.cc:1685] finished
0709 13:06:09.963870 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:09.963989 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":74993,"prepare.queue_time_us":39097,"prepare.run_wall_time_us":47,"raft.queue_time_us":77325,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":2893,"spinlock_wait_cycles":19225856,"thread_start_us":38236,"threads_started":1,"wal-append.queue_time_us":128017}
I20260709 13:06:09.989014 16248 leader_election.cc:304] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:09.987036 18279 raft_consensus.cc:3060] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:09.990149 18285 log.cc:927] Time spent T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 13:06:09.990413 18190 leader_election.cc:290] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:09.996626 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:10.004062 17618 tablet_bootstrap.cc:492] T c7d554054f014c74992a2a66ff6873cd P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:06:10.003921 18161 leader_election.cc:290] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:09.985635 16356 rpcz_store.cc:276] 0709 13:06:08.669113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:08.944402 (+275289us) service_pool.cc:224] Handling call
0709 13:06:08.964107 (+ 19705us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:08.966391 (+  2284us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:08.966461 (+    70us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:08.967368 (+   907us) log.cc:844] Serialized 26 byte log entry
0709 13:06:09.144309 (+176941us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:09.293504 (+149195us) log.cc:844] Serialized 14 byte log entry
0709 13:06:09.367944 (+ 74440us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:09.368062 (+   118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:09.976623 (+608561us) spinlock_profiling.cc:243] Waited 2.81 ms on lock 0x7b4400022b4c. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361c224db1 00007f361c2c2c85 00007f361c2c36a2 00007f361f0351db 00007f361f030aaf 00007f361f02486e 00007f361f023bb6 00007f361f0237d8 00007f361f02d221 00007f361f02d1d9 00007f361f02d169
0709 13:06:09.984861 (+  8238us) raft_consensus.cc:1685] finished
0709 13:06:09.984969 (+   108us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:09.985105 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":71749,"prepare.queue_time_us":87451,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":73156,"raft.run_cpu_time_us":266,"raft.run_wall_time_us":31747,"spinlock_wait_cycles":6465280,"thread_start_us":242351,"threads_started":2,"wal-append.queue_time_us":204663}
I20260709 13:06:10.014096 16248 leader_election.cc:304] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:09.985723 18010 leader_election.cc:290] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:10.019647 18277 raft_consensus.cc:2749] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:10.017047 18061 consensus_queue.cc:1059] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 13:06:10.024578 18061 raft_consensus.cc:3055] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:10.025467 18061 raft_consensus.cc:740] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:10.011729 18186 raft_consensus.cc:493] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:10.026850 18186 raft_consensus.cc:515] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:10.028504 16200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60138 (request call id 1382) took 1723 ms. Trace:
I20260709 13:06:10.028579 17618 tablet_bootstrap.cc:492] T c7d554054f014c74992a2a66ff6873cd P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap complete.
I20260709 13:06:10.029461 18186 leader_election.cc:290] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:10.029760 17618 ts_tablet_manager.cc:1403] T c7d554054f014c74992a2a66ff6873cd P 1109f76a0b7b443a84c0327c8707bc63: Time spent bootstrapping tablet: real 1.755s	user 0.041s	sys 0.022s
I20260709 13:06:10.013801 18208 raft_consensus.cc:2749] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:10.031455 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:10.032609 16280 raft_consensus.cc:2393] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 3: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:06:10.034682 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:10.036834 16248 leader_election.cc:304] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:10.041064 16248 leader_election.cc:304] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:10.042878 16248 leader_election.cc:304] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:10.042508 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:10.044853 16278 raft_consensus.cc:1275] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:06:10.047043 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:10.048095 16276 raft_consensus.cc:2393] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 3: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:06:10.050779 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:10.051689 16277 raft_consensus.cc:2468] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 2.
I20260709 13:06:10.015404 18187 consensus_queue.cc:1048] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 13:06:10.053685 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:10.040395 18188 raft_consensus.cc:493] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:10.055099 18188 raft_consensus.cc:515] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:10.059046 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:10.060019 16279 raft_consensus.cc:2393] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 5: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:06:10.068277 18208 consensus_queue.cc:1048] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:10.070133 18217 raft_consensus.cc:493] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:10.049594 18180 raft_consensus.cc:2804] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:10.057893 18188 leader_election.cc:290] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:10.026444 18061 consensus_queue.cc:260] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:10.076089 18170 raft_consensus.cc:2749] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:10.078053 18177 raft_consensus.cc:3055] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:10.078280 18180 raft_consensus.cc:697] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:10.078742 18177 raft_consensus.cc:740] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:10.079774 18180 consensus_queue.cc:237] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:10.079999 18177 consensus_queue.cc:260] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:10.081447 18177 raft_consensus.cc:3060] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:10.060961 18121 raft_consensus.cc:2749] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:10.089066 18217 raft_consensus.cc:515] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:10.028960 16200 rpcz_store.cc:276] 0709 13:06:08.304694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:08.566565 (+261871us) service_pool.cc:224] Handling call
0709 13:06:08.594363 (+ 27798us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:08.961761 (+367398us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:10.027831 (+1066070us) spinlock_profiling.cc:243] Waited 283 ms on lock 0x7b54003d3454. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f489e01 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6
0709 13:06:10.028435 (+   604us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":650748288}
W20260709 13:06:10.102102 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 364853us
I20260709 13:06:10.107856 16356 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef"
dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
mode: GRACEFUL
new_leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
 from {username='slave'} at 127.0.0.1:56792
I20260709 13:06:10.118963 16356 raft_consensus.cc:606] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Received request to transfer leadership to TS 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:06:10.119901 16356 raft_consensus.cc:614] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:10.107789 16322 leader_election.cc:304] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:10.099635 18273 raft_consensus.cc:515] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:10.133576 18273 leader_election.cc:290] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:10.134074 16199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60138 (request call id 1378) took 1831 ms. Trace:
I20260709 13:06:10.097345 18132 raft_consensus.cc:3055] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:10.134752 16199 rpcz_store.cc:276] 0709 13:06:08.302271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:08.326121 (+ 23850us) service_pool.cc:224] Handling call
0709 13:06:08.627098 (+300977us) spinlock_profiling.cc:243] Waited 14.7 ms on lock 0x7b5800002a98. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361c224db1 00007f361c364b71 00007f361c364a22 00007f362527dc09 00007f36243d7ee0 00007f36244a10ab 00007f36244a1131 00007f3624462fc0 00007f362444d929 00007f362444d3d2 00007f361d9c4bd4
0709 13:06:08.627347 (+   249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:08.652953 (+ 25606us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:10.133747 (+1480794us) spinlock_profiling.cc:243] Waited 20.2 ms on lock 0x7b5400238054. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f489e01 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6
0709 13:06:10.133992 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":80119936}
I20260709 13:06:10.123945 16322 leader_election.cc:304] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:06:10.118799 18175 leader_election.cc:290] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:10.095679 18128 raft_consensus.cc:515] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:10.137065 18132 raft_consensus.cc:740] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:10.149248 18295 raft_consensus.cc:2749] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:10.161052 16322 leader_election.cc:304] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:06:10.162631 16199 raft_consensus.cc:1240] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:10.162995 16322 leader_election.cc:304] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:06:10.164410 16322 leader_election.cc:304] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:06:10.170168 16322 leader_election.cc:304] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: 
W20260709 13:06:10.171303 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 99153.1us
I20260709 13:06:10.173748 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:10.175230 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:10.175604 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:10.176213 16356 raft_consensus.cc:2468] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 4.
I20260709 13:06:10.177021 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:10.177378 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:10.178216 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:10.178522 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:10.179113 16356 raft_consensus.cc:2393] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 4: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:06:10.179236 16349 raft_consensus.cc:2468] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 3.
I20260709 13:06:10.180006 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:10.180264 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:10.181378 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:10.181779 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:10.182823 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:10.183463 16349 raft_consensus.cc:2468] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 2.
I20260709 13:06:10.183784 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:06:10.184612 16943 raft_consensus.cc:3060] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:10.184774 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:10.185170 16282 raft_consensus.cc:2468] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 3.
I20260709 13:06:10.186141 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:10.118958 18269 raft_consensus.cc:515] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:10.207499 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:10.207912 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:10.211926 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:10.209009 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:10.212455 16278 raft_consensus.cc:2468] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 2.
I20260709 13:06:10.211609 16282 raft_consensus.cc:3060] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:10.188827 16357 raft_consensus.cc:1275] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:06:10.130160 18279 raft_consensus.cc:515] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:10.214913 18296 raft_consensus.cc:2804] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:10.215377 18296 raft_consensus.cc:493] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:10.215754 18296 raft_consensus.cc:3060] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:10.218988 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:10.213116 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:10.219475 16355 raft_consensus.cc:1240] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:06:10.219684 16354 raft_consensus.cc:3060] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:10.219903 16276 raft_consensus.cc:2468] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 3.
I20260709 13:06:10.220494 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:10.213328 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:10.221140 16351 raft_consensus.cc:2376] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 3. Re-sending same reply.
I20260709 13:06:10.213361 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:10.222095 16204 raft_consensus.cc:2468] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 2.
I20260709 13:06:10.222043 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:10.223140 16199 raft_consensus.cc:1240] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:10.212532 16202 raft_consensus.cc:2468] T b9e1324823f04d8da5a4b3ddbd061c0e P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 3.
I20260709 13:06:10.212189 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:10.226778 16356 raft_consensus.cc:2468] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 3.
I20260709 13:06:10.228080 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:10.172881 18040 raft_consensus.cc:2749] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:10.228825 16199 raft_consensus.cc:2468] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 4.
I20260709 13:06:10.223268 16350 raft_consensus.cc:2468] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 2.
I20260709 13:06:10.229822 16277 raft_consensus.cc:1275] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:10.210292 18273 raft_consensus.cc:2804] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:10.229964 16282 raft_consensus.cc:2468] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 5.
I20260709 13:06:10.230468 16322 leader_election.cc:304] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:10.185756 18151 raft_consensus.cc:2804] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:10.209566 18114 raft_consensus.cc:2804] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:10.223471 18262 raft_consensus.cc:493] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:10.224550 18147 raft_consensus.cc:493] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:10.285503 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:10.276924 16249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:10.209848 18129 consensus_queue.cc:1048] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 13:06:10.228456 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:10.239786 18186 raft_consensus.cc:493] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:10.233279 18295 raft_consensus.cc:493] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:10.310882 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 71713.3us
I20260709 13:06:10.231979 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:10.239349 18273 raft_consensus.cc:493] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:10.327451 17618 raft_consensus.cc:359] T c7d554054f014c74992a2a66ff6873cd P 1109f76a0b7b443a84c0327c8707bc63 [term 2 NON_PARTICIPANT]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:10.329434 18252 leader_election.cc:290] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:10.285763 18114 raft_consensus.cc:493] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:10.312026 18262 raft_consensus.cc:515] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:10.337765 18186 raft_consensus.cc:515] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:10.288537 18247 consensus_queue.cc:1048] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 13:06:10.320516 18147 raft_consensus.cc:515] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:10.298648 18151 raft_consensus.cc:493] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:10.248070 18240 raft_consensus.cc:493] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:10.359215 18262 leader_election.cc:290] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:10.359397 18240 raft_consensus.cc:515] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:10.362087 18147 leader_election.cc:290] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:10.364367 16248 leader_election.cc:304] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:06:10.251240 16914 leader_election.cc:304] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:10.287966 18208 consensus_queue.cc:1059] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.038s
I20260709 13:06:10.348366 16200 raft_consensus.cc:2393] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 4: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:06:10.332685 18251 raft_consensus.cc:993] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e: : Instructing follower 0aea40d6e4374085a2e38a70a71f63e3 to start an election
I20260709 13:06:10.341355 18273 raft_consensus.cc:3060] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:10.357297 18186 leader_election.cc:290] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:06:10.357476 18299 log.cc:927] Time spent T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
I20260709 13:06:10.357812 18288 raft_consensus.cc:2749] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:10.335500 18295 raft_consensus.cc:515] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:10.358078 18151 raft_consensus.cc:3060] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:10.350347 18114 raft_consensus.cc:3060] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:10.357518 17618 raft_consensus.cc:740] T c7d554054f014c74992a2a66ff6873cd P 1109f76a0b7b443a84c0327c8707bc63 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Initialized, Role: LEARNER
W20260709 13:06:10.367669 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 116542us
I20260709 13:06:10.434103 16914 leader_election.cc:304] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:06:10.436499 16914 leader_election.cc:304] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:10.369086 18279 leader_election.cc:290] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:10.370433 18188 raft_consensus.cc:2804] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:10.231843 18132 consensus_queue.cc:260] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:10.398736 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:10.405762 16354 raft_consensus.cc:2468] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 4.
I20260709 13:06:10.438632 16276 raft_consensus.cc:2393] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 5: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:06:10.371722 16282 raft_consensus.cc:1275] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:10.365067 18240 leader_election.cc:290] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:06:10.412498 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 198904us
I20260709 13:06:10.355819 18217 leader_election.cc:290] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:10.416317 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:10.446498 16205 raft_consensus.cc:3060] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:10.415630 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:10.409402 18128 leader_election.cc:290] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:10.447824 16280 raft_consensus.cc:2468] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 5.
I20260709 13:06:10.416837 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:10.432004 18262 raft_consensus.cc:1081] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 1 LEADER]: Signalling peer 0aea40d6e4374085a2e38a70a71f63e3 to start an election
W20260709 13:06:10.457373 18300 log.cc:927] Time spent T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 13:06:10.457646 18217 consensus_queue.cc:1059] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:10.458076 18281 raft_consensus.cc:2749] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:10.458674 18217 consensus_queue.cc:1059] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:10.459326 18281 raft_consensus.cc:2804] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:10.451198 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:10.440745 18188 raft_consensus.cc:493] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:10.453118 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:10.463724 16276 raft_consensus.cc:2468] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 3.
I20260709 13:06:10.446240 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
W20260709 13:06:10.460692 18298 log.cc:927] Time spent T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 13:06:10.449606 16940 raft_consensus.cc:1275] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:06:10.473531 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:10.465520 18188 raft_consensus.cc:3060] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:10.483289 16354 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360"
dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
mode: GRACEFUL
new_leader_uuid: "1109f76a0b7b443a84c0327c8707bc63"
 from {username='slave'} at 127.0.0.1:56792
I20260709 13:06:10.484036 16354 raft_consensus.cc:606] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Received request to transfer leadership to TS 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:06:10.484401 16354 raft_consensus.cc:614] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:10.459864 18281 raft_consensus.cc:493] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:10.485922 18271 raft_consensus.cc:2804] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:10.486667 18302 raft_consensus.cc:3055] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:10.489105 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:10.476082 18295 leader_election.cc:290] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:10.496096 16943 raft_consensus.cc:2468] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 5.
I20260709 13:06:10.497867 15057 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:06:10.463112 16348 raft_consensus.cc:2468] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 3.
I20260709 13:06:10.462659 18279 consensus_queue.cc:1059] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 13:06:10.466234 18269 leader_election.cc:290] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 4 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:06:10.501818 18257 log.cc:927] Time spent T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.953s	user 0.002s	sys 0.004s
I20260709 13:06:10.515180 16203 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60138 (request call id 1387) took 1878 ms. Trace:
I20260709 13:06:10.488236 16205 raft_consensus.cc:2468] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 4.
I20260709 13:06:10.501127 18281 raft_consensus.cc:3060] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:10.529353 16912 leader_election.cc:304] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:10.526660 16203 rpcz_store.cc:276] 0709 13:06:08.636792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:08.640071 (+  3279us) service_pool.cc:224] Handling call
0709 13:06:08.640403 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:08.878251 (+237848us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:10.514785 (+1636534us) spinlock_profiling.cc:243] Waited 237 ms on lock 0x7b540038a4d4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f489e01 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6
0709 13:06:10.515071 (+   286us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":545452800}
I20260709 13:06:10.511124 18302 raft_consensus.cc:740] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:10.537251 16322 leader_election.cc:304] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:06:10.469553 17618 consensus_queue.cc:260] T c7d554054f014c74992a2a66ff6873cd P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:06:10.543043 18272 raft_consensus.cc:2804] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:10.533636 18114 raft_consensus.cc:515] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:10.585216 18272 raft_consensus.cc:697] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 5 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:06:10.596621 18269 raft_consensus.cc:493] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:10.637761 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 201382us
W20260709 13:06:10.637042 18183 consensus_meta.cc:287] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f: Time spent flushing consensus metadata: real 0.621s	user 0.009s	sys 0.005s
I20260709 13:06:10.653878 16349 raft_consensus.cc:2393] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 in current term 3: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:06:10.593302 18302 consensus_queue.cc:260] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:10.645586 18269 raft_consensus.cc:515] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:10.656471 18183 raft_consensus.cc:515] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:06:10.672921 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 228012us
I20260709 13:06:10.684388 16246 leader_election.cc:304] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:10.691629 18308 raft_consensus.cc:2804] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:10.692134 18308 raft_consensus.cc:493] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:10.692519 18308 raft_consensus.cc:3060] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:10.695044 18309 log.cc:927] Time spent T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:06:10.695195 18296 raft_consensus.cc:515] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:10.696580 16353 raft_consensus.cc:2393] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 in current term 5: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:06:10.696973 18302 raft_consensus.cc:3060] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:10.702754 18272 consensus_queue.cc:237] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:10.703890 18296 leader_election.cc:290] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:10.705147 18307 consensus_queue.cc:1059] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:10.706079 18170 raft_consensus.cc:3055] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:10.706466 18170 raft_consensus.cc:740] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:10.707114 16246 leader_election.cc:304] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:10.707695 18170 consensus_queue.cc:260] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:10.709126 18170 raft_consensus.cc:3060] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:10.694255 18273 raft_consensus.cc:515] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:10.709513 18151 raft_consensus.cc:515] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:10.710731 16351 raft_consensus.cc:1240] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:10.711416 18114 leader_election.cc:290] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:10.712038 18307 raft_consensus.cc:2804] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:10.712623 18307 raft_consensus.cc:493] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:10.713055 18307 raft_consensus.cc:3060] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:10.713606 18273 leader_election.cc:290] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:10.716233 18269 leader_election.cc:290] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:10.717948 18269 raft_consensus.cc:2804] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:10.706521 18183 leader_election.cc:290] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:10.725721 16246 leader_election.cc:304] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:06:10.738679 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 334368us
I20260709 13:06:10.739768 16248 leader_election.cc:304] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:10.752238 16947 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35106 (request call id 502) took 1552 ms. Trace:
I20260709 13:06:10.755270 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:10.753154 16946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:06:10.753043 16947 rpcz_store.cc:276] 0709 13:06:09.184350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:09.184594 (+   244us) service_pool.cc:224] Handling call
0709 13:06:09.184936 (+   342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:09.319641 (+134705us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:10.736150 (+1416509us) spinlock_profiling.cc:243] Waited 134 ms on lock 0x7b54001fbb54. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f489e01 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6
0709 13:06:10.736432 (+   282us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":307636480}
I20260709 13:06:10.756523 16946 raft_consensus.cc:3060] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:10.767652 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:10.731475 18302 raft_consensus.cc:3060] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:10.768543 16278 raft_consensus.cc:2468] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 4.
I20260709 13:06:10.774401 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:10.776247 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:10.701705 18308 raft_consensus.cc:515] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:06:10.782160 16283 raft_consensus.cc:1240] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 4. Current term is 5. Ops: [2.2-4.3]
I20260709 13:06:10.782684 16280 raft_consensus.cc:1275] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:06:10.780571 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 138690us
I20260709 13:06:10.785408 16248 leader_election.cc:304] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:10.785455 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:10.755250 18269 raft_consensus.cc:697] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 LEADER]: Becoming Leader. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:06:10.786334 16276 raft_consensus.cc:3060] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:10.758960 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:06:10.763734 18129 raft_consensus.cc:2749] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:10.771119 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:06:10.792511 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:10.788919 16278 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157"
dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
 from {username='slave'} at 127.0.0.1:45210
I20260709 13:06:10.795130 16278 raft_consensus.cc:493] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:10.795082 16283 raft_consensus.cc:2468] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 3.
I20260709 13:06:10.801429 16280 raft_consensus.cc:1240] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:10.795747 16278 raft_consensus.cc:3060] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:10.832197 16249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:10.842216 16280 raft_consensus.cc:1240] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:10.803093 16944 raft_consensus.cc:3060] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:10.862270 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:10.800459 18188 raft_consensus.cc:515] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:10.854415 18279 raft_consensus.cc:2749] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:06:10.896864 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:10.956851 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:10.957583 16276 raft_consensus.cc:2468] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 3.
I20260709 13:06:10.957903 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:10.958485 16283 raft_consensus.cc:2468] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 3.
I20260709 13:06:10.938141 18183 raft_consensus.cc:493] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
W20260709 13:06:10.950798 18287 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.516s	user 0.003s	sys 0.013s
W20260709 13:06:10.966868 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 181542us
I20260709 13:06:10.961436 17618 ts_tablet_manager.cc:1434] T c7d554054f014c74992a2a66ff6873cd P 1109f76a0b7b443a84c0327c8707bc63: Time spent starting tablet: real 0.931s	user 0.024s	sys 0.024s
I20260709 13:06:10.951071 18151 leader_election.cc:290] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:10.979343 16248 leader_election.cc:304] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:10.884284 18307 raft_consensus.cc:515] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:10.990048 16248 leader_election.cc:304] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
W20260709 13:06:10.974807 18312 log.cc:927] Time spent T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.179s	user 0.000s	sys 0.001s
I20260709 13:06:10.994483 16914 leader_election.cc:304] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:06:10.997061 16248 leader_election.cc:304] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:06:10.976763 17618 ts_tablet_manager.cc:1467] T c7d554054f014c74992a2a66ff6873cd P 1109f76a0b7b443a84c0327c8707bc63: Tablet startup took 946ms
W20260709 13:06:11.009227 18323 log.cc:927] Time spent T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:06:11.011051 16946 raft_consensus.cc:2468] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 3.
I20260709 13:06:11.020864 18334 raft_consensus.cc:2749] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:10.953034 18269 consensus_queue.cc:237] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:10.992166 18279 raft_consensus.cc:2749] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:11.019121 18129 raft_consensus.cc:2749] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:10.977840 18183 raft_consensus.cc:515] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:11.045149 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:11.045966 16203 raft_consensus.cc:2468] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 2.
I20260709 13:06:11.024365 16944 raft_consensus.cc:2468] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 3.
I20260709 13:06:11.056272 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:11.058936 16205 raft_consensus.cc:1275] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:06:11.060701 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:11.061672 18133 raft_consensus.cc:3055] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:11.062217 18133 raft_consensus.cc:740] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:11.046912 18308 leader_election.cc:290] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:06:11.069980 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 75590.3us
I20260709 13:06:11.076714 16914 leader_election.cc:304] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:11.054908 18328 raft_consensus.cc:2764] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:06:11.077872 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:11.080190 16205 raft_consensus.cc:3060] T b9e1324823f04d8da5a4b3ddbd061c0e P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:11.055320 18335 raft_consensus.cc:493] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:11.081806 16203 raft_consensus.cc:1240] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:11.081887 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:11.063401 18133 consensus_queue.cc:260] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } }
I20260709 13:06:11.083184 16199 raft_consensus.cc:3060] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:11.063778 18188 leader_election.cc:290] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:11.048136 18180 consensus_queue.cc:1059] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 13:06:11.080721 16278 raft_consensus.cc:515] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:11.091670 16205 raft_consensus.cc:2468] T b9e1324823f04d8da5a4b3ddbd061c0e P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 4.
I20260709 13:06:11.092509 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:11.093142 16202 raft_consensus.cc:3060] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:11.093124 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:11.094851 16201 raft_consensus.cc:2468] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 3.
W20260709 13:06:11.095939 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 98969.8us
I20260709 13:06:11.096748 16248 leader_election.cc:304] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:11.093899 16246 leader_election.cc:304] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:11.098405 16914 leader_election.cc:304] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:06:11.099407 16204 raft_consensus.cc:1275] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:06:11.099875 16204 pending_rounds.cc:85] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f: Aborting all ops after (but not including) 5
I20260709 13:06:11.100152 16204 pending_rounds.cc:107] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:06:11.100402 16204 raft_consensus.cc:2889] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:11.102913 18307 leader_election.cc:290] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:06:11.000175 17618 ts_tablet_manager.cc:1469] T c7d554054f014c74992a2a66ff6873cd P 1109f76a0b7b443a84c0327c8707bc63: Trace:
0709 13:05:58.889091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:58.890107 (+  1016us) service_pool.cc:224] Handling call
0709 13:05:58.891391 (+  1284us) ts_tablet_manager.cc:934] T c7d554054f014c74992a2a66ff6873cd P 1109f76a0b7b443a84c0327c8707bc63: Initiating tablet copy from peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
0709 13:06:05.191948 (+6300557us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:06:05.510753 (+318805us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:05.553597 (+ 42844us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:06:05.850422 (+296825us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:06:05.865595 (+ 15173us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:05.869205 (+  3610us) ts_tablet_manager.cc:989] Replica registered.
0709 13:06:05.870620 (+  1415us) inbound_call.cc:177] Queueing success response
0709 13:06:08.269800 (+2399180us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:06:10.030175 (+1760375us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:06:10.125049 (+ 94874us) tablet_replica.cc:261] Starting instrumentation
0709 13:06:10.125652 (+   603us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":42612,"mutex_wait_us":26324,"raft.queue_time_us":228892,"raft.run_cpu_time_us":214,"raft.run_wall_time_us":9978,"tablet-copy.queue_time_us":133,"tablet-download-pool.queue_time_us":38911,"tablet-download-pool.run_cpu_time_us":4068,"tablet-download-pool.run_wall_time_us":1714428,"thread_start_us":336722,"threads_started":2}
I20260709 13:06:11.105108 18188 raft_consensus.cc:3055] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:11.105585 18188 raft_consensus.cc:740] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:11.106987 16202 raft_consensus.cc:2468] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 5.
I20260709 13:06:11.107052 18188 consensus_queue.cc:260] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:11.109709 16248 leader_election.cc:304] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:11.110940 18316 raft_consensus.cc:2804] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:11.087041 18335 raft_consensus.cc:515] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:11.111666 18316 raft_consensus.cc:493] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:11.111769 18133 raft_consensus.cc:3060] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:11.112159 18316 raft_consensus.cc:3060] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:11.112599 18188 raft_consensus.cc:3060] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:11.113730 18335 leader_election.cc:290] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:11.115064 18307 raft_consensus.cc:2749] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:11.115864 18307 raft_consensus.cc:2804] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:11.116222 18307 raft_consensus.cc:493] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:11.116566 18307 raft_consensus.cc:3060] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:11.116559 18308 consensus_queue.cc:1048] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:11.117920 16246 leader_election.cc:304] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:11.118805 18334 raft_consensus.cc:2804] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:11.118582 18308 consensus_queue.cc:1059] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 5.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:11.119357 18334 raft_consensus.cc:697] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:11.121080 18316 raft_consensus.cc:515] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:11.121400 18334 consensus_queue.cc:237] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:06:11.122406 18279 raft_consensus.cc:3055] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:11.122895 18279 raft_consensus.cc:740] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:11.123840 18279 consensus_queue.cc:260] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.2, Last appended by leader: 2, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:11.124287 18316 leader_election.cc:290] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 4 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:11.124963 18279 raft_consensus.cc:3060] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:11.127990 18183 leader_election.cc:290] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:11.090757 18275 raft_consensus.cc:2804] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:11.128827 18275 raft_consensus.cc:493] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:11.129261 18275 raft_consensus.cc:3060] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:11.129514 18281 consensus_meta.cc:287] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63: Time spent flushing consensus metadata: real 0.587s	user 0.007s	sys 0.005s
I20260709 13:06:11.136812 16246 leader_election.cc:304] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:11.137799 18188 raft_consensus.cc:2804] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:11.138679 18188 raft_consensus.cc:697] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:11.129937 18281 raft_consensus.cc:515] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:11.140355 18302 raft_consensus.cc:2749] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:11.140475 18308 raft_consensus.cc:3060] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:11.142081 18183 raft_consensus.cc:493] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:11.143184 18183 raft_consensus.cc:515] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:11.140548 16248 leader_election.cc:304] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:11.146198 16248 leader_election.cc:304] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:11.139766 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f022e2e63ae4461d834e476ff2666991" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:11.139650 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:11.148164 16203 raft_consensus.cc:2468] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 2.
I20260709 13:06:11.173395 16278 leader_election.cc:290] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:11.159861 18317 raft_consensus.cc:2749] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:11.148061 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:11.159451 18279 raft_consensus.cc:2804] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:11.146814 18183 leader_election.cc:290] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:11.164997 18308 raft_consensus.cc:2749] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:11.147791 16202 raft_consensus.cc:3060] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:11.178004 16200 raft_consensus.cc:3060] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:11.151615 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:11.151684 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f022e2e63ae4461d834e476ff2666991" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:06:11.188900 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:11.152340 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
W20260709 13:06:11.189527 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:11.189787 16283 raft_consensus.cc:3060] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:11.171123 16199 raft_consensus.cc:2468] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 3.
I20260709 13:06:11.196142 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:11.196923 16208 raft_consensus.cc:2393] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 5: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:06:11.197381 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:11.198295 16199 raft_consensus.cc:2468] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 5.
I20260709 13:06:11.160861 16248 leader_election.cc:304] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:11.206451 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
W20260709 13:06:11.211483 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 50723.3us
I20260709 13:06:11.212924 18170 raft_consensus.cc:2749] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:11.213487 18035 leader_election.cc:290] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:11.213828 18170 consensus_queue.cc:1048] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:11.215179 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:11.207752 16283 raft_consensus.cc:2468] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 4.
I20260709 13:06:11.155057 18281 leader_election.cc:290] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 4 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:11.224298 16914 leader_election.cc:304] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:06:11.180852 18279 raft_consensus.cc:697] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:11.227093 18208 raft_consensus.cc:493] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:11.227005 18308 raft_consensus.cc:493] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:11.228159 16944 raft_consensus.cc:1240] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 LEADER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 2. Current term is 4. Ops: []
I20260709 13:06:11.228853 18157 leader_election.cc:290] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 election: Requested vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:11.229310 18292 raft_consensus.cc:2804] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:11.232295 16353 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33486 (request call id 162) took 1052 ms. Trace:
I20260709 13:06:11.232954 16356 raft_consensus.cc:1240] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 13:06:11.234187 18271 raft_consensus.cc:493] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:11.225327 18035 raft_consensus.cc:493] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:11.222771 16202 raft_consensus.cc:2468] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 4.
W20260709 13:06:11.260156 16246 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:11.264228 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
W20260709 13:06:11.274646 16246 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:11.265594 16203 raft_consensus.cc:1240] T b9e1324823f04d8da5a4b3ddbd061c0e P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:11.265385 16353 rpcz_store.cc:276] 0709 13:06:10.179606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:10.213066 (+ 33460us) service_pool.cc:224] Handling call
0709 13:06:11.232099 (+1019033us) spinlock_profiling.cc:243] Waited 474 ms on lock 0x7b5400195354. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:06:11.232234 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1090153344}
W20260709 13:06:11.271847 16173 connection.cc:256] RPC call timeout handler was delayed by -1.4568962109999575s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1577s for a response
W20260709 13:06:11.275354 16173 connection.cc:256] RPC call timeout handler was delayed by -1.4343962110000348s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1602s for a response
W20260709 13:06:11.276156 16173 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:11.276473 16173 connection.cc:256] RPC call timeout handler was delayed by -1.18959621099998s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1874s for a response
W20260709 13:06:11.276780 16173 connection.cc:256] RPC call timeout handler was delayed by -1.0995962109999482s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19740000000000002s for a response
I20260709 13:06:11.272776 18220 raft_consensus.cc:493] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:11.277469 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:11.161213 18188 consensus_queue.cc:237] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:11.278012 16278 raft_consensus.cc:1240] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 4. Current term is 5. Ops: []
W20260709 13:06:11.298985 16249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:11.358232 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:11.384178 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:11.382202 16349 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33486 (request call id 163) took 1202 ms. Trace:
I20260709 13:06:11.382830 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:11.279945 16173 leader_election.cc:304] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:11.385812 16349 rpcz_store.cc:276] 0709 13:06:10.179902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:10.184567 (+  4665us) service_pool.cc:224] Handling call
0709 13:06:11.381958 (+1197391us) spinlock_profiling.cc:243] Waited 462 ms on lock 0x7b540028c3d4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:06:11.382136 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1061693184}
W20260709 13:06:11.386797 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 106936us
I20260709 13:06:11.391768 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:11.392467 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:11.315560 18292 raft_consensus.cc:697] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 LEADER]: Becoming Leader. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:06:11.396493 16277 raft_consensus.cc:1240] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:11.273453 18271 raft_consensus.cc:3060] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:11.403043 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:11.394528 18157 raft_consensus.cc:2804] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:11.404776 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
W20260709 13:06:11.389200 18347 log.cc:927] Time spent T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 13:06:11.410080 16278 raft_consensus.cc:2468] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 4.
W20260709 13:06:11.410987 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:11.406292 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:11.433830 16202 raft_consensus.cc:2468] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 2.
I20260709 13:06:11.413513 16276 raft_consensus.cc:2368] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for earlier term 3. Current term is 4.
I20260709 13:06:11.414861 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
W20260709 13:06:11.434022 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 46354.9us
I20260709 13:06:11.431435 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:11.439307 16206 raft_consensus.cc:1240] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:11.441499 16203 raft_consensus.cc:1275] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:06:11.446007 16247 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:11.267737 18308 raft_consensus.cc:515] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:11.268121 18208 raft_consensus.cc:515] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:11.455901 16205 raft_consensus.cc:1240] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:11.461234 16282 raft_consensus.cc:2468] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 6.
I20260709 13:06:11.462772 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f022e2e63ae4461d834e476ff2666991" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:11.280331 18035 raft_consensus.cc:515] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:06:11.465786 16247 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:11.430604 16940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f022e2e63ae4461d834e476ff2666991" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:11.478608 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:11.478762 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:06:11.483263 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 45454.8us
I20260709 13:06:11.391543 18220 raft_consensus.cc:515] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:11.489245 16945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:11.501819 16278 raft_consensus.cc:1275] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:11.580008 16206 raft_consensus.cc:2393] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 5: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:06:11.277704 18183 consensus_queue.cc:1048] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.160s
I20260709 13:06:11.576650 16277 raft_consensus.cc:2468] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 5.
I20260709 13:06:11.449445 16943 raft_consensus.cc:1240] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:06:11.573043 16282 raft_consensus.cc:2468] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 1.
I20260709 13:06:11.596415 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bc3c8ff9b84838a2664335d7e1582b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:11.577716 16279 raft_consensus.cc:3060] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:11.578682 18272 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.780s	user 0.000s	sys 0.005s
W20260709 13:06:11.580224 18345 log.cc:927] Time spent T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63: Append to log took a long time: real 0.375s	user 0.000s	sys 0.002s
I20260709 13:06:11.606303 16205 raft_consensus.cc:1240] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:11.611019 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
W20260709 13:06:11.618363 18245 log.cc:927] Time spent T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.955s	user 0.009s	sys 0.016s
I20260709 13:06:11.618264 16279 raft_consensus.cc:2468] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 4.
I20260709 13:06:11.575287 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:11.623131 16949 raft_consensus.cc:2393] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 5: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:06:11.624818 16199 raft_consensus.cc:1275] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:06:11.628286 18303 raft_consensus.cc:3055] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:11.628808 18303 raft_consensus.cc:740] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:11.628558 16352 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41830 (request call id 1380) took 2959 ms. Trace:
I20260709 13:06:11.579032 18157 raft_consensus.cc:697] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
W20260709 13:06:11.602746 18272 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.812s	user 0.000s	sys 0.006s
I20260709 13:06:11.630399 16352 rpcz_store.cc:276] 0709 13:06:08.669338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:09.003590 (+334252us) service_pool.cc:224] Handling call
0709 13:06:09.024579 (+ 20989us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:09.062287 (+ 37708us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:09.062341 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:09.075723 (+ 13382us) log.cc:844] Serialized 26 byte log entry
0709 13:06:09.275767 (+200044us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:09.295423 (+ 19656us) log.cc:844] Serialized 14 byte log entry
0709 13:06:09.306320 (+ 10897us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:09.306522 (+   202us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:10.634569 (+1328047us) spinlock_profiling.cc:243] Waited 9.71 ms on lock 0x7b1800430240. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f3625264de1 00007f36252715b1 00007f361c39c3f3 00007f361c39e7c1 00007f361c39e779 00007f361c39e709 00007f361c39e6d1 00007f361c39d9cd 000000000038f354 000000000038f199 00007f361c37f83a
0709 13:06:11.617742 (+983173us) spinlock_profiling.cc:243] Waited 1.62 ms on lock 0x7b4400022b4c. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361c224db1 00007f361c2c2c85 00007f361c2c36a2 00007f361f0351db 00007f361f030aaf 00007f361f02486e 00007f361f023bb6 00007f361f0237d8 00007f361f02d221 00007f361f02d1d9 00007f361f02d169
0709 13:06:11.628208 (+ 10466us) raft_consensus.cc:1685] finished
0709 13:06:11.628262 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:11.628449 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10526,"prepare.queue_time_us":23504,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":33793,"raft.run_cpu_time_us":373,"raft.run_wall_time_us":62579,"spinlock_wait_cycles":26046208,"thread_start_us":155388,"threads_started":1,"wal-append.queue_time_us":238916}
I20260709 13:06:11.523520 18292 consensus_queue.cc:237] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:11.598333 16940 raft_consensus.cc:2468] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 2.
I20260709 13:06:11.540237 18279 consensus_queue.cc:237] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:06:11.637306 18275 consensus_meta.cc:287] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63: Time spent flushing consensus metadata: real 0.508s	user 0.011s	sys 0.000s
I20260709 13:06:11.680684 18035 leader_election.cc:290] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:06:11.675782 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 96338.5us
W20260709 13:06:11.694962 18346 log.cc:927] Time spent T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.283s	user 0.001s	sys 0.000s
I20260709 13:06:11.675588 18217 raft_consensus.cc:493] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:11.696228 18132 raft_consensus.cc:3060] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:11.696045 18217 raft_consensus.cc:515] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:11.698665 18303 consensus_queue.cc:260] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:06:11.700428 16200 consensus_meta.cc:287] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f: Time spent flushing consensus metadata: real 0.515s	user 0.003s	sys 0.007s
I20260709 13:06:11.700811 16200 raft_consensus.cc:2468] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 2.
I20260709 13:06:11.632444 18133 consensus_queue.cc:1048] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 13:06:11.704684 16208 raft_consensus.cc:1240] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:11.710709 16173 leader_election.cc:304] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:06:11.707695 18303 raft_consensus.cc:3060] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:11.714715 18035 consensus_queue.cc:1059] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
W20260709 13:06:11.725286 18351 log.cc:927] Time spent T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
I20260709 13:06:11.715729 18308 leader_election.cc:290] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:11.744560 18271 raft_consensus.cc:515] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:11.749275 18308 raft_consensus.cc:493] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:11.749929 18061 raft_consensus.cc:3060] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:11.749889 18308 raft_consensus.cc:515] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:11.701026 18275 raft_consensus.cc:515] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:11.762472 16207 raft_consensus.cc:1275] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:11.718658 18352 consensus_queue.cc:1059] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 13:06:11.778709 18275 leader_election.cc:290] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 4 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:11.780459 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:11.781388 18271 leader_election.cc:290] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 4 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:11.765983 18220 leader_election.cc:290] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:11.784690 16280 raft_consensus.cc:3060] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:11.716813 18354 raft_consensus.cc:2804] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:11.717731 18157 consensus_queue.cc:237] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:06:11.790126 16249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:11.799463 18307 consensus_meta.cc:287] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3: Time spent flushing consensus metadata: real 0.682s	user 0.010s	sys 0.004s
I20260709 13:06:11.798484 18354 raft_consensus.cc:493] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:11.772815 18356 consensus_queue.cc:1059] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 13:06:11.815579 16356 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41830 (request call id 1403) took 1638 ms. Trace:
I20260709 13:06:11.815855 18356 raft_consensus.cc:3055] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:11.816321 18356 raft_consensus.cc:740] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:11.817394 16946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f022e2e63ae4461d834e476ff2666991" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:11.817195 18356 consensus_queue.cc:260] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:11.818159 16946 raft_consensus.cc:2393] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 2: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
I20260709 13:06:11.812662 16280 raft_consensus.cc:2468] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 4.
I20260709 13:06:11.814612 18354 raft_consensus.cc:3060] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:11.815173 18308 leader_election.cc:290] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:11.810382 18271 raft_consensus.cc:493] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:11.822991 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:11.823128 18271 raft_consensus.cc:515] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:11.824222 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:11.825277 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:11.825873 16279 raft_consensus.cc:2468] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 3.
I20260709 13:06:11.827159 18208 leader_election.cc:290] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:11.815985 16356 rpcz_store.cc:276] 0709 13:06:10.177506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:10.232045 (+ 54539us) service_pool.cc:224] Handling call
0709 13:06:11.232707 (+1000662us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:11.268076 (+ 35369us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:11.815367 (+547291us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b5400195350. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f4888ad 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:06:11.815517 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2300464512}
I20260709 13:06:11.825277 18271 leader_election.cc:290] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:11.831050 18217 leader_election.cc:290] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:06:11.831822 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:11.832350 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:11.832651 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:11.833683 18356 raft_consensus.cc:3060] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:11.834265 16279 raft_consensus.cc:1275] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:06:11.804014 18352 raft_consensus.cc:3055] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:06:11.811069 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 96494.7us
I20260709 13:06:11.836892 18352 raft_consensus.cc:740] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:11.842638 18352 consensus_queue.cc:260] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:11.843986 18352 raft_consensus.cc:3060] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:11.808960 18307 raft_consensus.cc:515] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:11.844805 16173 leader_election.cc:304] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:11.854120 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:11.855244 18307 leader_election.cc:290] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:11.855717 16283 raft_consensus.cc:2368] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for earlier term 3. Current term is 4.
I20260709 13:06:11.857049 16173 leader_election.cc:400] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 election: Vote denied by peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823) with higher term. Message: Invalid argument: T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for earlier term 3. Current term is 4.
I20260709 13:06:11.868705 16173 leader_election.cc:403] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:06:11.864792 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:11.866022 18220 raft_consensus.cc:3055] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:11.863543 18105 raft_consensus.cc:3055] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:11.870250 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:11.885620 16279 raft_consensus.cc:3060] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:11.859938 18035 raft_consensus.cc:2804] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:11.887931 16274 raft_consensus.cc:2410] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:11.872236 16173 leader_election.cc:304] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:11.883407 18105 raft_consensus.cc:740] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:11.885114 18157 raft_consensus.cc:2749] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823) with higher term. Message: Invalid argument: T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for earlier term 3. Current term is 4.
I20260709 13:06:11.892668 16173 leader_election.cc:304] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:11.897230 18358 raft_consensus.cc:2804] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:11.928689 18358 raft_consensus.cc:697] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 6 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:11.930156 18358 consensus_queue.cc:237] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:11.930964 18291 consensus_queue.cc:1048] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:11.931788 18307 raft_consensus.cc:493] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:11.913199 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:11.932906 16201 raft_consensus.cc:2393] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 4: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:06:11.914003 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:11.914721 18279 raft_consensus.cc:493] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:11.930207 16248 leader_election.cc:304] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:11.933148 16173 leader_election.cc:304] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:11.914867 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:11.915699 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:11.871233 18220 raft_consensus.cc:740] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:11.916837 18105 consensus_queue.cc:260] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:11.918540 16199 raft_consensus.cc:1275] T b9e1324823f04d8da5a4b3ddbd061c0e P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:06:11.934252 16203 raft_consensus.cc:2468] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 5.
W20260709 13:06:11.925511 18349 log.cc:927] Time spent T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.324s	user 0.001s	sys 0.000s
I20260709 13:06:11.927284 16351 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41830 (request call id 1402) took 1750 ms. Trace:
I20260709 13:06:11.930708 18303 raft_consensus.cc:493] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:11.945000 18303 raft_consensus.cc:515] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:11.946791 18105 raft_consensus.cc:3060] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:11.947480 18220 consensus_queue.cc:260] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:11.949059 18220 raft_consensus.cc:3060] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:11.889973 18219 raft_consensus.cc:493] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:11.935114 16279 raft_consensus.cc:2468] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 4.
I20260709 13:06:11.932317 18307 raft_consensus.cc:515] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:11.949746 18219 raft_consensus.cc:515] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:11.955238 18307 leader_election.cc:290] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:11.936210 18188 raft_consensus.cc:493] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:11.956014 18188 raft_consensus.cc:515] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:06:11.956882 18355 log.cc:927] Time spent T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.351s	user 0.002s	sys 0.000s
I20260709 13:06:11.939961 16173 leader_election.cc:304] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:11.938128 18322 raft_consensus.cc:3060] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:06:11.943487 18157 raft_consensus.cc:2804] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:11.943845 18279 raft_consensus.cc:515] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } }
I20260709 13:06:11.944226 18359 raft_consensus.cc:2804] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:11.939517 16351 rpcz_store.cc:276] 0709 13:06:10.177222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:10.221882 (+ 44660us) service_pool.cc:224] Handling call
0709 13:06:10.232422 (+ 10540us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:10.711103 (+478681us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:11.927010 (+1215907us) spinlock_profiling.cc:243] Waited 478 ms on lock 0x7b54002927d4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f489e01 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6
0709 13:06:11.927215 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1099441920}
I20260709 13:06:11.986619 16354 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41830 (request call id 1407) took 1596 ms. Trace:
I20260709 13:06:11.960738 16914 leader_election.cc:304] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:06:11.961017 16173 leader_election.cc:304] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
W20260709 13:06:11.963299 18353 log.cc:927] Time spent T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.254s	user 0.002s	sys 0.000s
I20260709 13:06:11.963032 18303 leader_election.cc:290] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:11.963831 18356 raft_consensus.cc:2804] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:11.965067 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:11.958370 18188 leader_election.cc:290] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:11.888110 18035 raft_consensus.cc:493] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:11.975800 16357 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41832 (request call id 1423) took 1799 ms. Trace:
I20260709 13:06:11.978685 16947 raft_consensus.cc:1240] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 2. Current term is 4. Ops: [2.5-2.5]
I20260709 13:06:11.980798 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bc3c8ff9b84838a2664335d7e1582b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:12.000398 16206 raft_consensus.cc:2393] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 5: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
W20260709 13:06:11.985049 16246 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:11.987036 16354 rpcz_store.cc:276] 0709 13:06:10.390252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:10.497568 (+107316us) service_pool.cc:224] Handling call
0709 13:06:10.497999 (+   431us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:10.506976 (+  8977us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:10.507024 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:10.509272 (+  2248us) log.cc:844] Serialized 26 byte log entry
0709 13:06:10.668003 (+158731us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:10.671403 (+  3400us) log.cc:844] Serialized 14 byte log entry
0709 13:06:11.986225 (+1314822us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:11.986321 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:11.986365 (+    44us) raft_consensus.cc:1685] finished
0709 13:06:11.986378 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:11.986529 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1314526,"prepare.queue_time_us":2729,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":1426,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":134,"thread_start_us":125261,"threads_started":1,"wal-append.queue_time_us":302628}
I20260709 13:06:11.988893 18359 raft_consensus.cc:493] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:11.989068 16940 raft_consensus.cc:3060] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 3 LEARNER]: Advancing to term 4
I20260709 13:06:11.989558 16355 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41832 (request call id 1424) took 1813 ms. Trace:
W20260709 13:06:12.001555 16246 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:11.989868 18157 raft_consensus.cc:697] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 5 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
W20260709 13:06:11.990646 16247 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:11.991451 18248 raft_consensus.cc:1064] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e: attempting to promote NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 to VOTER
I20260709 13:06:12.010422 18157 consensus_queue.cc:237] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:12.012524 18248 consensus_queue.cc:237] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:12.016144 16350 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33486 (request call id 164) took 1836 ms. Trace:
I20260709 13:06:12.017454 18279 leader_election.cc:290] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:12.016608 16350 rpcz_store.cc:276] 0709 13:06:10.180222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:10.235840 (+ 55618us) service_pool.cc:224] Handling call
0709 13:06:10.238303 (+  2463us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:10.335642 (+ 97339us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:06:10.667907 (+332265us) log.cc:844] Serialized 14 byte log entry
0709 13:06:12.014758 (+1346851us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:12.014818 (+    60us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:12.014862 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:12.015906 (+  1044us) spinlock_profiling.cc:243] Waited 97.1 ms on lock 0x7b54002913d4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f489e01 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6
0709 13:06:12.015952 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:12.016082 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1076769,"prepare.queue_time_us":169290,"prepare.run_cpu_time_us":24,"prepare.run_wall_time_us":24,"spinlock_wait_cycles":223277312,"thread_start_us":600124,"threads_started":2,"wal-append.queue_time_us":209403,"wal-append.run_cpu_time_us":1737,"wal-append.run_wall_time_us":1125566}
I20260709 13:06:12.018007 18359 raft_consensus.cc:3060] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:11.992400 16203 raft_consensus.cc:3060] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Advancing to term 4
W20260709 13:06:11.971369 18362 log.cc:927] Time spent T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:06:11.994975 16173 leader_election.cc:304] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:11.995847 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:11.996996 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:11.993311 15057 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:11.998167 18291 raft_consensus.cc:2804] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:12.008237 16275 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42740 (request call id 146) took 1020 ms. Trace:
I20260709 13:06:12.009228 18296 raft_consensus.cc:493] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:12.002058 16355 rpcz_store.cc:276] 0709 13:06:10.176399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:10.220320 (+ 43921us) service_pool.cc:224] Handling call
0709 13:06:10.233153 (+ 12833us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:10.233369 (+   216us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:06:10.561043 (+327674us) log.cc:844] Serialized 14 byte log entry
0709 13:06:11.989159 (+1428116us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:11.989216 (+    57us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:11.989270 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:11.989362 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:11.989492 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1220552,"prepare.queue_time_us":271339,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":1221585,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":81,"thread_start_us":483269,"threads_started":2,"wal-append.queue_time_us":398555}
I20260709 13:06:12.043491 16275 rpcz_store.cc:276] 0709 13:06:10.987376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:10.987568 (+   192us) service_pool.cc:224] Handling call
0709 13:06:10.988068 (+   500us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:10.996407 (+  8339us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:10.996430 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:11.000788 (+  4358us) log.cc:844] Serialized 26 byte log entry
0709 13:06:11.448002 (+447214us) spinlock_profiling.cc:243] Waited 20 ms on lock 0x7b1800347020. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f3625264de1 00007f36252715b1 00007f361c37ee07 00007f36251d9ab9 00007f361c39b69b 00007f361c39993f 00007f361c39bc02 00007f361f02320b 00007f361f028d23 00007f361f0290d1 00007f361f444a0f
0709 13:06:11.510716 (+ 62714us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:11.597019 (+ 86303us) log.cc:844] Serialized 14 byte log entry
0709 13:06:11.597207 (+   188us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:11.597275 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:11.962582 (+365307us) spinlock_profiling.cc:243] Waited 4.36 ms on lock 0x7b4400022b4c. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361c224db1 00007f361c2c2c85 00007f361c2c36a2 00007f361f0351db 00007f361f030aaf 00007f361f02486e 00007f361f023bb6 00007f361f0237d8 00007f361f02d221 00007f361f02d1d9 00007f361f02d169
0709 13:06:12.007984 (+ 45402us) raft_consensus.cc:1685] finished
0709 13:06:12.008008 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:12.008167 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8359,"prepare.queue_time_us":86767,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":63,"raft.queue_time_us":20721,"raft.run_cpu_time_us":225,"raft.run_wall_time_us":2517,"spinlock_wait_cycles":56044288,"thread_start_us":62386,"threads_started":1,"wal-append.queue_time_us":627336}
I20260709 13:06:11.999703 16357 rpcz_store.cc:276] 0709 13:06:10.176143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:10.214977 (+ 38834us) service_pool.cc:224] Handling call
0709 13:06:10.215302 (+   325us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:10.233574 (+ 18272us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:10.233617 (+    43us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:10.235917 (+  2300us) log.cc:844] Serialized 52 byte log entry
0709 13:06:10.591682 (+355765us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:10.635926 (+ 44244us) log.cc:844] Serialized 14 byte log entry
0709 13:06:10.636354 (+   428us) log.cc:844] Serialized 14 byte log entry
0709 13:06:11.681929 (+1045575us) spinlock_profiling.cc:243] Waited 1.62 ms on lock 0x7b1800168760. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f3625264de1 00007f36252715b1 00007f361c39c3f3 00007f361c39e7c1 00007f361c39e779 00007f361c39e709 00007f361c39e6d1 00007f361c39d9cd 000000000038f354 000000000038f199 00007f361c37f83a
0709 13:06:11.896953 (+215024us) spinlock_profiling.cc:243] Waited 1.51 ms on lock 0x7b1800168760. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f3625264de1 00007f36252715b1 00007f361c39c3f3 00007f361c39e7c1 00007f361c39e779 00007f361c39e709 00007f361c39e6d1 00007f361c39d9cd 000000000038f354 000000000038f199 00007f361c37f83a
0709 13:06:11.975226 (+ 78273us) spinlock_profiling.cc:243] Waited 1.05 ms on lock 0x7b1800168760. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f3625264de1 00007f36252715b1 00007f361c316c0a 00007f3625a56219 00007f361c39ea40 00007f361c3994e4 00007f361c399455 00007f361f481060 00007f361f493716 00007f361f4a4287 00007f361f4a4208
0709 13:06:11.975400 (+   174us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:11.975472 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:11.975542 (+    70us) raft_consensus.cc:1685] finished
0709 13:06:11.975556 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:11.975727 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20527,"prepare.queue_time_us":46894,"prepare.run_cpu_time_us":87,"prepare.run_wall_time_us":89,"raft.queue_time_us":1370680,"raft.run_cpu_time_us":375,"raft.run_wall_time_us":47229,"spinlock_wait_cycles":9621120,"thread_start_us":272375,"threads_started":1,"wal-append.queue_time_us":468895}
I20260709 13:06:12.026052 16199 raft_consensus.cc:2468] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 5.
I20260709 13:06:11.884498 18354 raft_consensus.cc:515] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:12.041112 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:12.051338 16205 raft_consensus.cc:2468] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 6.
I20260709 13:06:12.043175 16201 raft_consensus.cc:2468] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 5.
I20260709 13:06:12.027731 16173 leader_election.cc:304] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
W20260709 13:06:12.039597 16274 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45210 (request call id 1354) took 2009 ms (client timeout 2269 ms). Trace:
I20260709 13:06:11.997929 18133 raft_consensus.cc:2804] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:12.053447 16246 leader_election.cc:304] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:12.063027 16912 leader_election.cc:304] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:06:12.019484 18035 raft_consensus.cc:3060] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:12.018982 18277 raft_consensus.cc:493] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:12.074941 18277 raft_consensus.cc:515] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:12.077988 18277 leader_election.cc:290] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:12.080977 18354 leader_election.cc:290] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:12.016062 18219 leader_election.cc:290] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:12.058481 18296 raft_consensus.cc:515] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:12.086659 18061 consensus_queue.cc:1048] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:12.068152 18318 consensus_queue.cc:1048] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 13:06:12.048069 18352 raft_consensus.cc:2749] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:12.039812 18188 consensus_queue.cc:1059] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 13:06:12.097465 18188 raft_consensus.cc:3055] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:12.098012 18188 raft_consensus.cc:740] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:12.058115 18291 raft_consensus.cc:697] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 LEADER]: Becoming Leader. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:06:12.099738 18291 consensus_queue.cc:237] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:12.068639 18279 raft_consensus.cc:2804] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:12.102226 18279 raft_consensus.cc:697] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:12.103605 18279 consensus_queue.cc:237] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:12.065737 18133 raft_consensus.cc:493] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:12.106029 18133 raft_consensus.cc:3060] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:12.107586 18330 raft_consensus.cc:2804] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:12.108098 18330 raft_consensus.cc:493] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:12.108506 18330 raft_consensus.cc:3060] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:12.064726 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:12.066774 16246 leader_election.cc:304] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
W20260709 13:06:12.057365 16274 rpcz_store.cc:269] 0709 13:06:10.030059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:10.037435 (+  7376us) service_pool.cc:224] Handling call
0709 13:06:12.039305 (+2001870us) spinlock_profiling.cc:243] Waited 1.82 s on lock 0x7b54000028d4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:06:12.039496 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4179715456}
I20260709 13:06:12.071213 16173 leader_election.cc:304] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:12.110842 16206 raft_consensus.cc:2468] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 2.
I20260709 13:06:12.114434 16173 leader_election.cc:304] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63
W20260709 13:06:12.111689 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 45010.6us
I20260709 13:06:12.086277 18296 leader_election.cc:290] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:06:12.118484 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 1.39627e+06us
I20260709 13:06:12.119937 16203 raft_consensus.cc:2468] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 4.
I20260709 13:06:12.054723 18153 raft_consensus.cc:493] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:12.066082 18183 raft_consensus.cc:2804] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:12.129166 16283 raft_consensus.cc:1275] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:06:12.133018 16320 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:12.134775 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:12.116420 18061 raft_consensus.cc:2804] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:06:12.135566 16282 raft_consensus.cc:2468] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 4.
I20260709 13:06:12.099138 18188 consensus_queue.cc:260] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:12.152124 16947 raft_consensus.cc:1275] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:06:12.155088 16246 leader_election.cc:304] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:12.157719 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:12.160485 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:12.165354 16246 leader_election.cc:304] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:12.126914 18153 raft_consensus.cc:515] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:06:12.175966 16249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:12.160326 18288 raft_consensus.cc:493] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:12.179225 18273 raft_consensus.cc:1027] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 3 LEADER]: attempt to promote peer 1109f76a0b7b443a84c0327c8707bc63: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260709 13:06:12.162739 18354 raft_consensus.cc:2804] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:12.180915 18354 raft_consensus.cc:493] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:12.180400 16103 catalog_manager.cc:5697] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: term changed from 2 to 4, leader changed from e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) to 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68). New cstate: current_term: 4 leader_uuid: "1109f76a0b7b443a84c0327c8707bc63" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:12.163283 16940 raft_consensus.cc:1275] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 4 LEARNER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:06:12.176299 18217 raft_consensus.cc:2804] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:12.181393 18354 raft_consensus.cc:3060] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:12.182473 16103 catalog_manager.cc:5697] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: term changed from 2 to 4, leader changed from 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) to 363bb2f744eb486f9ad726f08214c98e (127.14.180.67). New cstate: current_term: 4 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:06:12.161691 18282 raft_consensus.cc:493] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:12.189944 18217 raft_consensus.cc:493] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:12.160425 18264 raft_consensus.cc:493] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:12.155064 18358 raft_consensus.cc:2749] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:12.165725 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:06:12.197613 16246 leader_election.cc:304] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:12.200052 16914 leader_election.cc:304] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:12.167098 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:12.153648 18121 consensus_queue.cc:1059] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
W20260709 13:06:12.204902 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 90618.7us
W20260709 13:06:12.205453 16106 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38840 (request call id 193) took 13143 ms (client timeout 15000 ms). Trace:
I20260709 13:06:12.211140 16173 leader_election.cc:304] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:12.171025 18061 raft_consensus.cc:697] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:12.179828 18288 raft_consensus.cc:515] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:12.195813 18217 raft_consensus.cc:3060] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:12.202154 18282 raft_consensus.cc:515] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:12.175662 18151 raft_consensus.cc:493] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:12.214607 16246 leader_election.cc:304] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:12.160183 18219 consensus_queue.cc:1048] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 13:06:12.196213 18170 raft_consensus.cc:2804] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:12.193306 18152 raft_consensus.cc:493] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:12.196110 18272 raft_consensus.cc:493] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:12.217891 16103 catalog_manager.cc:5697] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: term changed from 2 to 3, leader changed from e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) to 363bb2f744eb486f9ad726f08214c98e (127.14.180.67). New cstate: current_term: 3 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:06:12.203522 18114 raft_consensus.cc:493] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:12.192988 18296 raft_consensus.cc:493] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:12.227626 16246 leader_election.cc:304] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:12.219884 18273 raft_consensus.cc:493] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:12.221103 16173 leader_election.cc:304] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:12.252111 16246 leader_election.cc:304] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:12.203804 18262 raft_consensus.cc:493] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:12.221673 18277 raft_consensus.cc:2804] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:12.162272 18334 consensus_queue.cc:1059] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:06:12.127151 18324 consensus_queue.cc:1048] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.070s
I20260709 13:06:12.248435 18157 raft_consensus.cc:2749] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:12.256999 16173 leader_election.cc:304] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:12.278086 16173 leader_election.cc:304] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:12.279312 16173 leader_election.cc:304] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
W20260709 13:06:12.279557 16246 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:12.239315 18121 raft_consensus.cc:2804] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:12.239076 18040 raft_consensus.cc:493] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:12.239573 18251 raft_consensus.cc:493] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:12.239984 18170 raft_consensus.cc:493] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:12.240594 18151 raft_consensus.cc:515] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:12.265250 16103 catalog_manager.cc:5697] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: term changed from 1 to 2, leader changed from e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) to 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66). New cstate: current_term: 2 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:06:12.263756 18297 raft_consensus.cc:493] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:12.248741 18152 raft_consensus.cc:515] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:12.352257 18061 consensus_queue.cc:237] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:12.356101 18132 raft_consensus.cc:493] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:12.356711 18132 raft_consensus.cc:515] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:12.312790 18307 raft_consensus.cc:493] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:12.358011 18307 raft_consensus.cc:515] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:12.332816 18251 raft_consensus.cc:515] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:12.213966 18356 raft_consensus.cc:697] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:12.263748 18337 raft_consensus.cc:3060] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:12.261965 18128 raft_consensus.cc:2804] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:12.259738 18248 raft_consensus.cc:493] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:12.242957 18308 consensus_queue.cc:1048] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 13:06:12.262902 18277 raft_consensus.cc:493] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
W20260709 13:06:12.211519 16106 rpcz_store.cc:269] 0709 13:05:59.071757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:59.072054 (+   297us) service_pool.cc:224] Handling call
0709 13:06:12.205360 (+13133306us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:08.016316 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:08.016924 (+   608us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:08.016970 (+    46us) write_op.cc:435] Acquired schema lock
0709 13:06:08.016988 (+    18us) tablet.cc:662] Decoding operations
0709 13:06:08.017794 (+   806us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:08.017905 (+   111us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:08.017943 (+    38us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:06:08.019477 (+  1534us) tablet.cc:701] Row locks acquired
0709 13:06:08.019519 (+    42us) write_op.cc:260] PREPARE: finished
0709 13:06:08.019690 (+   171us) write_op.cc:270] Start()
0709 13:06:08.019847 (+   157us) write_op.cc:276] Timestamp: P: 1783602368019626 usec, L: 0
0709 13:06:08.019867 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:06:08.030792 (+ 10925us) log.cc:844] Serialized 2089 byte log entry
0709 13:06:08.492521 (+461729us) op_driver.cc:464] REPLICATION: finished
0709 13:06:08.659608 (+167087us) write_op.cc:301] APPLY: starting
0709 13:06:08.659717 (+   109us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:08.659913 (+   196us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:08.660053 (+   140us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:08.660773 (+   720us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:08.660978 (+   205us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 13:06:08.661035 (+    57us) write_op.cc:312] APPLY: finished
0709 13:06:08.661292 (+   257us) log.cc:844] Serialized 47 byte log entry
0709 13:06:08.661468 (+   176us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:08.661581 (+   113us) write_op.cc:454] Released schema lock
0709 13:06:08.661625 (+    44us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:08.662048 (+   423us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:08.662080 (+    32us) write_op.cc:454] Released schema lock
0709 13:06:10.001282 (+1339202us) spinlock_profiling.cc:243] Waited 5.33 ms on lock 0x7b5400137754. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48632a 00007f361f40bf14 00007f361f40bec3 00007f361f40be38 00007f361f40bdf3 00007f361f40b0dc 00007f361f434e16 00007f361f41ccbb 00007f361f40739d 00007f361f40ad75
Metrics: {"mutex_wait_us":24888,"reported_tablets":18,"child_traces":[["op",{"apply.queue_time_us":163503,"apply.run_cpu_time_us":2414,"apply.run_wall_time_us":2414,"num_ops":5,"prepare.queue_time_us":189827,"prepare.run_cpu_time_us":32287,"prepare.run_wall_time_us":121687,"raft.queue_time_us":203520,"raft.run_cpu_time_us":28203,"raft.run_wall_time_us":1531579,"replication_time_us":463842,"spinlock_wait_cycles":12266240,"thread_start_us":422736,"threads_started":4,"wal-append.queue_time_us":132047,"wal-append.run_cpu_time_us":40385,"wal-append.run_wall_time_us":1522377}]]}
I20260709 13:06:12.332310 16275 raft_consensus.cc:1275] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:12.268975 18303 raft_consensus.cc:2804] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:12.209103 18264 raft_consensus.cc:515] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:12.337774 16204 raft_consensus.cc:1275] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:06:12.326749 18040 raft_consensus.cc:515] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:12.251255 18296 raft_consensus.cc:515] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:12.318222 18121 raft_consensus.cc:493] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:12.377915 16103 catalog_manager.cc:5697] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: term changed from 1 to 3, leader changed from e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) to 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68). New cstate: current_term: 3 leader_uuid: "1109f76a0b7b443a84c0327c8707bc63" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:12.351830 18288 leader_election.cc:290] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:12.251549 18272 raft_consensus.cc:515] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:06:12.379227 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:12.323235 18322 raft_consensus.cc:2749] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:06:12.380764 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:12.324445 18283 consensus_queue.cc:1048] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.063s
I20260709 13:06:12.359623 18282 leader_election.cc:290] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:12.443838 18282 raft_consensus.cc:493] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:12.444640 18282 raft_consensus.cc:515] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:12.445794 18040 leader_election.cc:290] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:12.358439 18359 raft_consensus.cc:515] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:12.446424 18040 raft_consensus.cc:493] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:12.446985 18040 raft_consensus.cc:515] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:12.448764 18359 leader_election.cc:290] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:12.449136 18040 leader_election.cc:290] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:12.382897 18372 raft_consensus.cc:2749] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:12.265341 18262 raft_consensus.cc:515] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:12.390971 18277 raft_consensus.cc:3060] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:12.452510 18262 leader_election.cc:290] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:12.328524 18157 raft_consensus.cc:2749] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:12.326876 18170 raft_consensus.cc:3060] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:12.457863 18303 raft_consensus.cc:697] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
W20260709 13:06:12.359757 18364 log.cc:927] Time spent T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:06:12.459477 18303 consensus_queue.cc:237] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:12.256743 18114 raft_consensus.cc:515] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:12.354319 18152 leader_election.cc:290] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:12.462538 18152 raft_consensus.cc:493] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:12.463156 18152 raft_consensus.cc:515] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:12.463479 18114 leader_election.cc:290] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:12.262996 18273 raft_consensus.cc:515] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:12.351038 18297 raft_consensus.cc:515] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:12.477550 18297 leader_election.cc:290] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:06:12.398518 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:12.360479 18132 leader_election.cc:290] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:12.399693 18121 raft_consensus.cc:3060] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:12.378228 18128 raft_consensus.cc:493] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:12.403046 18153 leader_election.cc:290] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:12.407859 18251 leader_election.cc:290] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:12.412194 18133 raft_consensus.cc:515] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:06:12.419457 18367 log.cc:927] Time spent T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
I20260709 13:06:12.423048 18307 leader_election.cc:290] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:12.424593 18151 leader_election.cc:290] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:12.426506 18272 leader_election.cc:290] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:12.436057 18296 leader_election.cc:290] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:12.384889 18366 raft_consensus.cc:2749] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:12.388341 18248 raft_consensus.cc:515] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:12.379282 18370 raft_consensus.cc:2804] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:12.468577 16201 raft_consensus.cc:2468] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 4.
I20260709 13:06:12.373235 18183 raft_consensus.cc:697] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 4 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:12.472007 16320 leader_election.cc:304] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:12.398481 16103 catalog_manager.cc:5697] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: term changed from 1 to 4, leader changed from 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) to 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68). New cstate: current_term: 4 leader_uuid: "1109f76a0b7b443a84c0327c8707bc63" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:12.452550 18264 leader_election.cc:290] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:12.467500 18152 leader_election.cc:290] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:12.434283 18035 raft_consensus.cc:515] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:12.491833 18128 raft_consensus.cc:3060] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:12.556094 16353 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41830 (request call id 1411) took 2162 ms. Trace:
W20260709 13:06:12.560983 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 281731us
W20260709 13:06:12.563942 16247 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:12.572377 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 100957us
I20260709 13:06:12.573354 16202 raft_consensus.cc:1275] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:12.574088 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:12.576498 16173 leader_election.cc:304] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:12.560374 16353 rpcz_store.cc:276] 0709 13:06:10.393610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:11.278870 (+885260us) service_pool.cc:224] Handling call
0709 13:06:11.279294 (+   424us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:12.054314 (+775020us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:12.054362 (+    48us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:12.056189 (+  1827us) log.cc:844] Serialized 52 byte log entry
0709 13:06:12.386948 (+330759us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:12.470221 (+ 83273us) log.cc:844] Serialized 14 byte log entry
0709 13:06:12.541487 (+ 71266us) spinlock_profiling.cc:243] Waited 2.94 ms on lock 0x7b1800348ca0. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f3625264de1 00007f36252715b1 00007f361c316c0a 00007f3625a56219 00007f361c39ea40 00007f361c3994e4 00007f361c399455 00007f361f481060 00007f361f493716 00007f361f4a4287 00007f361f4a4208
0709 13:06:12.542078 (+   591us) log.cc:844] Serialized 14 byte log entry
0709 13:06:12.542347 (+   269us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:12.542466 (+   119us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:12.555782 (+ 13316us) raft_consensus.cc:1685] finished
0709 13:06:12.555818 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:12.556007 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":842095,"prepare.queue_time_us":88744,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":55,"raft.queue_time_us":918764,"raft.run_cpu_time_us":314,"raft.run_wall_time_us":9901,"spinlock_wait_cycles":17009280,"thread_start_us":258893,"threads_started":1,"wal-append.queue_time_us":303732}
I20260709 13:06:12.550601 18370 raft_consensus.cc:493] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:12.548488 18295 raft_consensus.cc:493] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:12.588447 16202 raft_consensus.cc:1240] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:12.590484 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:12.592051 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:12.592713 16350 raft_consensus.cc:3060] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:12.596968 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:12.597656 16357 raft_consensus.cc:3060] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:12.538107 18307 consensus_queue.cc:1048] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 13:06:12.602427 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:12.604312 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:12.604908 16349 raft_consensus.cc:2393] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 3: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:06:12.605706 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:12.578709 18105 raft_consensus.cc:493] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:12.610409 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bc3c8ff9b84838a2664335d7e1582b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:12.623840 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:12.519623 18356 consensus_queue.cc:237] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:12.641675 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:06:12.642539 16355 raft_consensus.cc:2393] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 3: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:06:12.610517 16356 raft_consensus.cc:2468] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 5.
I20260709 13:06:12.628150 18183 consensus_queue.cc:237] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:12.602612 18370 raft_consensus.cc:3060] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:12.630972 18292 consensus_queue.cc:1059] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 13:06:12.633415 16357 raft_consensus.cc:2468] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 6.
I20260709 13:06:12.633536 18310 raft_consensus.cc:493] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:12.634734 18153 raft_consensus.cc:493] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:12.635784 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 56276.7us
I20260709 13:06:12.673192 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:12.673781 16320 leader_election.cc:304] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:12.579025 18322 raft_consensus.cc:493] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:12.638439 16282 raft_consensus.cc:1240] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:06:12.639428 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:12.683670 16352 raft_consensus.cc:3060] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:12.638468 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:12.685637 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:12.687497 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:12.622982 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:12.688664 16351 raft_consensus.cc:3060] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:12.642695 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:12.580698 18282 leader_election.cc:290] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:12.646981 16356 raft_consensus.cc:1275] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:12.649534 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f022e2e63ae4461d834e476ff2666991" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
W20260709 13:06:12.648857 16173 connection.cc:256] RPC call timeout handler was delayed by -1.3049428489999855s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1779s for a response
I20260709 13:06:12.661846 16350 raft_consensus.cc:2468] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 4.
I20260709 13:06:12.606999 18358 raft_consensus.cc:2749] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:12.668192 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:06:12.644209 18371 log.cc:927] Time spent T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:06:12.602844 18264 raft_consensus.cc:493] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:12.608464 18374 raft_consensus.cc:2804] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:12.613111 16348 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41830 (request call id 1409) took 2215 ms. Trace:
I20260709 13:06:12.678599 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:12.606837 18336 consensus_queue.cc:1048] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.066s
W20260709 13:06:12.691536 16173 connection.cc:256] RPC call timeout handler was delayed by -1.3049428489999855s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1779s for a response
I20260709 13:06:12.692656 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:12.645969 18272 raft_consensus.cc:493] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:12.643795 18273 leader_election.cc:290] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:12.694243 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:12.718313 16356 raft_consensus.cc:2468] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 3.
I20260709 13:06:12.719633 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:12.696908 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:12.700953 16357 raft_consensus.cc:3060] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:12.682189 16279 raft_consensus.cc:1275] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 5 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 13:06:12.649664 18376 raft_consensus.cc:493] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:12.703840 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f022e2e63ae4461d834e476ff2666991" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:12.725147 16276 raft_consensus.cc:3060] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:12.609820 18295 raft_consensus.cc:515] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:12.709128 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:12.738734 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:12.712503 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:12.671991 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:12.599368 18375 consensus_queue.cc:1048] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.115s
I20260709 13:06:12.647174 18105 raft_consensus.cc:515] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:12.735697 16352 raft_consensus.cc:2468] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 5.
W20260709 13:06:12.749272 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 84915.5us
W20260709 13:06:12.756026 16249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:12.737290 18354 consensus_meta.cc:287] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f: Time spent flushing consensus metadata: real 0.532s	user 0.010s	sys 0.001s
I20260709 13:06:12.776383 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:12.705397 18374 raft_consensus.cc:493] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:12.694375 18153 raft_consensus.cc:515] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } }
I20260709 13:06:12.788137 16355 raft_consensus.cc:2468] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 5.
I20260709 13:06:12.677361 18310 raft_consensus.cc:515] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:12.717550 18152 raft_consensus.cc:2804] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:12.696939 18322 raft_consensus.cc:515] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:12.811710 18105 leader_election.cc:290] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:12.812556 18322 leader_election.cc:290] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:12.816623 18310 leader_election.cc:290] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:12.797225 16352 raft_consensus.cc:2468] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 4.
I20260709 13:06:12.727051 18272 raft_consensus.cc:515] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:12.823549 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:06:12.823695 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 116316us
I20260709 13:06:12.801127 16276 raft_consensus.cc:2468] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 3.
I20260709 13:06:12.730221 18282 consensus_queue.cc:1059] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.063s
I20260709 13:06:12.803740 16278 raft_consensus.cc:1275] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:12.711127 18264 raft_consensus.cc:515] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:12.801127 16357 raft_consensus.cc:2468] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 5.
I20260709 13:06:12.737311 18151 consensus_queue.cc:1059] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.059s
I20260709 13:06:12.787606 16944 raft_consensus.cc:1240] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 LEADER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 3. Current term is 4. Ops: [3.5-3.5]
W20260709 13:06:12.828485 16173 connection.cc:256] RPC call timeout handler was delayed by -1.1798428490000106s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1918s for a response
I20260709 13:06:12.799343 16351 raft_consensus.cc:2468] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 5.
W20260709 13:06:12.826498 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 120222us
I20260709 13:06:12.829691 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:12.830433 16351 raft_consensus.cc:2468] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 3.
I20260709 13:06:12.831684 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:12.832808 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:12.834226 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:12.834524 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:06:12.829594 16173 connection.cc:256] RPC call timeout handler was delayed by -1.141142848999948s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19610000000000002s for a response
I20260709 13:06:12.835356 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:06:12.835358 16173 connection.cc:256] RPC call timeout handler was delayed by -1.1258428489999233s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1978s for a response
W20260709 13:06:12.835990 16173 connection.cc:256] RPC call timeout handler was delayed by -1.0889428489999773s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20190000000000002s for a response
I20260709 13:06:12.836261 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:12.834179 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c15d8e9be8414c84912ab77b66bfb1" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:12.837565 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:12.837637 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:12.838281 16352 raft_consensus.cc:2468] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 5.
I20260709 13:06:12.835866 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:12.792888 18133 leader_election.cc:290] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:12.840646 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:12.839612 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:12.827024 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:12.820757 18152 raft_consensus.cc:493] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:12.802989 18374 raft_consensus.cc:3060] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:12.753880 18384 consensus_queue.cc:1048] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.071s
I20260709 13:06:12.843495 16357 raft_consensus.cc:2468] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 3.
I20260709 13:06:12.860374 18272 leader_election.cc:290] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:12.861121 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:12.862102 16357 raft_consensus.cc:2393] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 4: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:06:12.843591 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:12.863214 16357 raft_consensus.cc:1240] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:12.863850 16200 raft_consensus.cc:2393] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 4: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:06:12.864681 16357 raft_consensus.cc:1275] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:06:12.865119 16357 pending_rounds.cc:85] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e: Aborting all ops after (but not including) 1
I20260709 13:06:12.846391 16350 raft_consensus.cc:3060] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:12.843087 18157 consensus_queue.cc:1059] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
W20260709 13:06:12.894618 18337 consensus_meta.cc:287] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63: Time spent flushing consensus metadata: real 0.512s	user 0.005s	sys 0.005s
I20260709 13:06:12.847630 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:12.848227 18153 leader_election.cc:290] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:12.848603 18152 raft_consensus.cc:3060] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:12.854296 18386 log.cc:927] Time spent T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:06:12.857515 18264 leader_election.cc:290] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:12.858139 16349 raft_consensus.cc:3060] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:12.895117 18337 raft_consensus.cc:2749] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:12.820391 18273 raft_consensus.cc:493] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:12.819289 18248 leader_election.cc:290] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:12.868319 16173 leader_election.cc:400] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 pre-election: Vote denied by peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823) with higher term. Message: Invalid argument: T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for earlier term 3. Current term is 4.
I20260709 13:06:12.846302 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bc3c8ff9b84838a2664335d7e1582b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:12.895114 18157 raft_consensus.cc:3055] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:12.871589 18121 raft_consensus.cc:515] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } }
I20260709 13:06:12.867491 18035 leader_election.cc:290] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:12.878712 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:12.877271 18133 consensus_queue.cc:1048] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 13:06:12.886541 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:06:12.889726 16321 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:12.806820 18354 raft_consensus.cc:515] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:12.757287 18376 raft_consensus.cc:515] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:12.895578 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:12.903007 16357 pending_rounds.cc:107] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:06:12.904817 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:12.858228 18295 leader_election.cc:290] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:12.845481 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:12.927184 16357 raft_consensus.cc:2889] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:12.927769 16353 raft_consensus.cc:2468] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 6.
I20260709 13:06:12.911152 16350 raft_consensus.cc:2468] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 3.
I20260709 13:06:12.912643 16173 leader_election.cc:403] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:12.869853 16200 raft_consensus.cc:1275] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 13:06:12.929575 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 61433.9us
I20260709 13:06:12.930094 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:12.917949 16283 raft_consensus.cc:1275] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:06:12.920192 16322 leader_election.cc:304] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:06:12.930855 16351 raft_consensus.cc:3060] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:12.930033 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:12.924407 16205 raft_consensus.cc:2468] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 5.
I20260709 13:06:12.928545 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:12.931993 16322 leader_election.cc:304] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:06:12.925978 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:12.928210 16208 raft_consensus.cc:1240] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:12.917817 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:12.933409 16202 raft_consensus.cc:2410] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:06:12.934355 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:12.935563 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:12.936084 16357 raft_consensus.cc:3060] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:12.933987 18248 raft_consensus.cc:2749] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:12.940747 18379 raft_consensus.cc:3055] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:12.941258 18379 raft_consensus.cc:740] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:06:12.944247 18128 raft_consensus.cc:515] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:12.945003 18170 raft_consensus.cc:515] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:12.946868 16274 raft_consensus.cc:2393] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 6: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:06:12.948065 18354 leader_election.cc:290] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 election: Requested vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:12.936247 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:12.952656 16208 raft_consensus.cc:2468] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 5.
I20260709 13:06:12.955533 18248 raft_consensus.cc:2749] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:12.922847 16367 tablet_copy_service.cc:342] P 363bb2f744eb486f9ad726f08214c98e: Request end of tablet copy session 1109f76a0b7b443a84c0327c8707bc63-c7d554054f014c74992a2a66ff6873cd received from {username='slave'} at 127.0.0.1:33486
I20260709 13:06:12.920917 18157 raft_consensus.cc:740] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:12.958125 16322 leader_election.cc:304] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:06:12.933130 18217 consensus_meta.cc:287] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3: Time spent flushing consensus metadata: real 0.704s	user 0.012s	sys 0.000s
I20260709 13:06:12.703956 16348 rpcz_store.cc:276] 0709 13:06:10.390979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:10.541529 (+150550us) service_pool.cc:224] Handling call
0709 13:06:10.579108 (+ 37579us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:06:10.643506 (+ 64398us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:10.645341 (+  1835us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:06:11.023965 (+378624us) spinlock_profiling.cc:243] Waited 1.5 ms on lock 0x7b2c00007b38. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361dd82a11 00007f361dd92372 00007f361f4c4a01 00007f361f48943a 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2
0709 13:06:11.024813 (+   848us) log.cc:844] Serialized 78 byte log entry
0709 13:06:11.087481 (+ 62668us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:11.112100 (+ 24619us) log.cc:844] Serialized 14 byte log entry
0709 13:06:12.094790 (+982690us) log.cc:844] Serialized 14 byte log entry
0709 13:06:12.105197 (+ 10407us) spinlock_profiling.cc:243] Waited 19.6 ms on lock 0x7b1800348ac0. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f3625264de1 00007f36252715b1 00007f361c39c3f3 00007f361c39e7c1 00007f361c39e779 00007f361c39e709 00007f361c39e6d1 00007f361c39d9cd 000000000038f354 000000000038f199 00007f361c37f83a
0709 13:06:12.182987 (+ 77790us) log.cc:844] Serialized 14 byte log entry
0709 13:06:12.538988 (+356001us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:12.547674 (+  8686us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:12.556585 (+  8911us) raft_consensus.cc:1685] finished
0709 13:06:12.556612 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:12.605841 (+ 49229us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1103015,"prepare.queue_time_us":43390,"prepare.run_cpu_time_us":123,"prepare.run_wall_time_us":128,"raft.queue_time_us":2423344,"raft.run_cpu_time_us":568,"raft.run_wall_time_us":28649,"spinlock_wait_cycles":48488576,"thread_start_us":387379,"threads_started":2,"wal-append.queue_time_us":110367}
I20260709 13:06:12.959494 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:12.978118 16353 raft_consensus.cc:2468] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 3.
I20260709 13:06:12.978617 18317 raft_consensus.cc:1064] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3: attempting to promote NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 to VOTER
I20260709 13:06:12.932474 18035 raft_consensus.cc:2749] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823) with higher term. Message: Invalid argument: T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for earlier term 3. Current term is 4.
I20260709 13:06:12.942258 18379 consensus_queue.cc:260] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:12.956670 18128 leader_election.cc:290] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:06:12.986846 18317 raft_consensus.cc:1068] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3: Unable to promote non-voter 1109f76a0b7b443a84c0327c8707bc63: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:06:12.934664 16940 raft_consensus.cc:1240] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:12.914333 18273 raft_consensus.cc:515] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:12.961995 16282 raft_consensus.cc:1275] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:06:12.958508 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:06:12.985271 18399 log.cc:927] Time spent T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:06:12.988160 16205 raft_consensus.cc:3055] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:12.988929 16353 raft_consensus.cc:3055] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:13.002898 16353 raft_consensus.cc:740] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:06:12.970588 16322 leader_election.cc:304] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:12.973424 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:12.974241 16201 raft_consensus.cc:1240] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:12.962779 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:13.005223 16322 leader_election.cc:304] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:12.999338 16349 raft_consensus.cc:2468] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 5.
I20260709 13:06:12.998407 16351 raft_consensus.cc:2468] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 4.
I20260709 13:06:13.002147 16205 raft_consensus.cc:740] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:13.009709 16322 leader_election.cc:304] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:12.966745 16367 tablet_copy_service.cc:434] P 363bb2f744eb486f9ad726f08214c98e: ending tablet copy session 1109f76a0b7b443a84c0327c8707bc63-c7d554054f014c74992a2a66ff6873cd on tablet c7d554054f014c74992a2a66ff6873cd with peer 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:06:13.012001 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:13.012749 16277 raft_consensus.cc:3060] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:12.970094 18368 log.cc:927] Time spent T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.591s	user 0.004s	sys 0.000s
I20260709 13:06:13.015666 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:12.978871 16348 raft_consensus.cc:1275] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:06:12.970412 18330 consensus_meta.cc:287] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63: Time spent flushing consensus metadata: real 0.861s	user 0.009s	sys 0.003s
I20260709 13:06:13.012097 16353 consensus_queue.cc:260] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:13.007778 16205 consensus_queue.cc:260] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:13.026300 16946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:06:12.963539 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
W20260709 13:06:12.966733 18388 log.cc:927] Time spent T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.162s	user 0.000s	sys 0.001s
I20260709 13:06:12.968000 18188 raft_consensus.cc:3060] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:06:12.970808 18295 raft_consensus.cc:2804] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:06:12.962754 18277 consensus_meta.cc:287] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3: Time spent flushing consensus metadata: real 0.510s	user 0.010s	sys 0.002s
I20260709 13:06:13.000320 18133 raft_consensus.cc:493] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:13.026971 16205 raft_consensus.cc:3060] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:12.965695 18121 leader_election.cc:290] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:13.019665 16246 leader_election.cc:304] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:13.016772 16208 raft_consensus.cc:2468] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 5.
I20260709 13:06:13.029753 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:13.053634 16201 raft_consensus.cc:2468] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 5.
I20260709 13:06:12.987669 18379 raft_consensus.cc:3060] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:13.040180 16949 raft_consensus.cc:1275] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:06:13.054278 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:13.055162 16208 raft_consensus.cc:3060] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:06:13.059538 18317 raft_consensus.cc:2804] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:13.060096 18317 raft_consensus.cc:493] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:13.060575 18317 raft_consensus.cc:3060] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:13.060190 18334 consensus_queue.cc:1048] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:13.064222 18170 leader_election.cc:290] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:13.064945 18133 raft_consensus.cc:515] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:13.067344 16200 raft_consensus.cc:2393] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 3: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:06:13.017585 18153 raft_consensus.cc:2804] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:13.030401 16946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:06:13.041096 16320 leader_election.cc:304] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:13.051991 16357 raft_consensus.cc:2468] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 4.
I20260709 13:06:13.055961 18396 consensus_queue.cc:1048] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:13.055963 18337 consensus_queue.cc:1048] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:12.970980 18114 consensus_queue.cc:1048] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.069s
I20260709 13:06:13.057054 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:13.016428 18395 consensus_queue.cc:1048] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.074s
I20260709 13:06:13.096608 18133 leader_election.cc:290] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:12.969372 18157 consensus_queue.cc:260] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:13.099094 15057 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:13.069545 16946 raft_consensus.cc:2393] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 5: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:06:13.100666 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:13.042282 16322 leader_election.cc:304] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:06:12.969755 18217 raft_consensus.cc:515] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:13.041162 18295 raft_consensus.cc:493] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:13.111624 16206 raft_consensus.cc:1240] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:13.111827 18170 raft_consensus.cc:493] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:13.083873 16320 leader_election.cc:304] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:13.040436 18330 raft_consensus.cc:515] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:06:13.114257 16320 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:13.025661 18251 raft_consensus.cc:2764] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:06:13.115470 18170 raft_consensus.cc:515] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:13.071341 16246 leader_election.cc:304] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:13.088129 16199 raft_consensus.cc:3060] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:06:13.126202 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 54996.1us
I20260709 13:06:13.125470 16173 leader_election.cc:304] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:06:13.084307 16357 raft_consensus.cc:1275] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:06:13.107414 18187 raft_consensus.cc:3055] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:13.109133 18217 leader_election.cc:290] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:13.109550 16349 raft_consensus.cc:1275] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:06:13.111966 18295 raft_consensus.cc:3060] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:13.015393 18272 raft_consensus.cc:2749] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:13.114418 18330 leader_election.cc:290] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 3 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:13.051960 18277 raft_consensus.cc:515] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:13.115025 16947 raft_consensus.cc:2393] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 3: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
I20260709 13:06:13.115521 18151 raft_consensus.cc:2764] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:06:13.086802 18248 raft_consensus.cc:2804] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:13.116906 18114 consensus_queue.cc:1059] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:06:13.129182 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 86835us
I20260709 13:06:13.138039 18040 raft_consensus.cc:2804] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:13.132463 18170 leader_election.cc:290] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:06:13.083616 16174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:13.136147 16173 leader_election.cc:304] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:13.092258 16277 raft_consensus.cc:2468] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 5.
W20260709 13:06:13.181663 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 45729.4us
I20260709 13:06:13.105060 18153 raft_consensus.cc:697] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 5 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:06:13.075259 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f022e2e63ae4461d834e476ff2666991" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:13.171695 16322 leader_election.cc:304] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:06:13.102313 18282 consensus_queue.cc:1059] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.064s
W20260709 13:06:13.172942 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 94189.5us
I20260709 13:06:13.185371 18356 consensus_queue.cc:1048] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:13.135335 18308 raft_consensus.cc:2804] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:13.181746 18375 raft_consensus.cc:2804] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:13.187563 18375 raft_consensus.cc:697] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:13.188746 18375 consensus_queue.cc:237] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:13.189448 16173 leader_election.cc:304] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:06:13.190790 18352 raft_consensus.cc:2749] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:13.181737 16199 raft_consensus.cc:2468] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 7.
I20260709 13:06:13.183463 18153 consensus_queue.cc:237] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:13.127110 16246 leader_election.cc:304] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
W20260709 13:06:13.192411 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 65399.7us
W20260709 13:06:13.193466 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 174471us
I20260709 13:06:13.193915 16275 raft_consensus.cc:2393] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 6: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
W20260709 13:06:13.194527 16246 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:13.146502 18387 raft_consensus.cc:2749] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:13.196662 16322 leader_election.cc:304] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:13.197482 18121 raft_consensus.cc:2804] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:13.197827 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:13.197916 18121 raft_consensus.cc:493] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:13.198536 18121 raft_consensus.cc:3060] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:13.134740 18133 consensus_queue.cc:1048] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 13:06:13.134796 18187 raft_consensus.cc:740] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:13.186810 18308 raft_consensus.cc:493] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:13.200784 16322 leader_election.cc:304] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:13.199445 16199 raft_consensus.cc:3060] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:13.204298 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:13.204739 16246 leader_election.cc:304] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:13.170009 18248 raft_consensus.cc:493] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:13.174057 18040 raft_consensus.cc:493] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:13.216899 18303 raft_consensus.cc:2804] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:13.211988 18396 raft_consensus.cc:2804] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:13.218451 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:13.199968 16348 raft_consensus.cc:1240] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 13:06:13.227931 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f022e2e63ae4461d834e476ff2666991" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:13.207053 18318 consensus_queue.cc:1059] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:06:13.207963 18356 raft_consensus.cc:493] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:13.235777 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f022e2e63ae4461d834e476ff2666991" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:13.268338 16274 raft_consensus.cc:2393] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 in current term 3: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:06:13.240335 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:13.223541 18277 leader_election.cc:290] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:13.243603 16322 leader_election.cc:304] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:06:13.242610 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:13.213825 18308 raft_consensus.cc:3060] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:13.246344 16199 raft_consensus.cc:2468] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 6.
I20260709 13:06:13.236212 18334 consensus_queue.cc:1059] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 13:06:13.206841 18251 raft_consensus.cc:2749] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:13.235198 18248 raft_consensus.cc:3060] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:13.278537 16246 leader_election.cc:304] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
W20260709 13:06:13.291659 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 48106.7us
I20260709 13:06:13.280051 16199 raft_consensus.cc:1240] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:13.241739 18322 raft_consensus.cc:493] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:13.237905 18040 raft_consensus.cc:3060] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:13.286681 18105 raft_consensus.cc:493] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:13.280716 16200 raft_consensus.cc:3060] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:13.293184 16322 leader_election.cc:304] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:06:13.295200 16914 leader_election.cc:304] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:13.278637 18282 raft_consensus.cc:2804] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:06:13.284209 18370 consensus_meta.cc:287] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f: Time spent flushing consensus metadata: real 0.589s	user 0.010s	sys 0.003s
I20260709 13:06:13.257344 18303 raft_consensus.cc:697] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:13.289757 18396 raft_consensus.cc:697] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 3 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:06:13.305835 18217 raft_consensus.cc:2804] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:13.243275 18152 raft_consensus.cc:515] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:13.312232 18273 leader_election.cc:290] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:13.324096 18282 raft_consensus.cc:493] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:13.307566 18380 raft_consensus.cc:2749] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:13.283973 18356 raft_consensus.cc:515] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:13.337347 18281 raft_consensus.cc:2749] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:13.409061 16200 raft_consensus.cc:2468] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 6.
I20260709 13:06:13.311305 18283 consensus_queue.cc:1059] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:06:13.312914 18322 raft_consensus.cc:515] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:13.462980 16208 raft_consensus.cc:2468] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 4.
I20260709 13:06:13.331516 18105 raft_consensus.cc:515] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:13.336974 18374 raft_consensus.cc:515] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:13.408509 18282 raft_consensus.cc:3060] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:13.406865 18114 raft_consensus.cc:2764] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader election decision vote started in defunct term 3: won
I20260709 13:06:13.470487 16356 raft_consensus.cc:2393] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 4: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:06:13.337255 18370 raft_consensus.cc:515] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:13.422684 18133 raft_consensus.cc:493] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:13.467221 18402 log.cc:927] Time spent T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.211s	user 0.001s	sys 0.000s
I20260709 13:06:13.494326 16200 raft_consensus.cc:1275] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:13.505273 16352 raft_consensus.cc:2468] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 5.
I20260709 13:06:13.512609 16207 raft_consensus.cc:1240] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:13.431262 18273 consensus_queue.cc:1048] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.070s
I20260709 13:06:13.499435 18334 raft_consensus.cc:493] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:13.521987 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 199334us
I20260709 13:06:13.583909 16322 leader_election.cc:304] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:06:13.591432 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:13.592314 16279 raft_consensus.cc:2393] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 5: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:06:13.593868 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:13.597599 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:13.599936 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:13.602607 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:13.605029 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:13.608728 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c15d8e9be8414c84912ab77b66bfb1" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:13.613390 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:13.614143 16278 raft_consensus.cc:2393] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 4: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:06:13.618462 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:13.622785 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:13.623493 16276 raft_consensus.cc:2468] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 4.
I20260709 13:06:13.625515 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:06:13.593263 18188 consensus_meta.cc:287] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3: Time spent flushing consensus metadata: real 0.548s	user 0.010s	sys 0.002s
I20260709 13:06:13.627233 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:13.639676 16279 raft_consensus.cc:2393] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 6: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:06:13.640479 16204 raft_consensus.cc:1240] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 4. Current term is 5. Ops: []
W20260709 13:06:13.593413 18402 log.cc:927] Time spent T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 13:06:13.627110 16946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:13.645771 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:13.503928 18133 raft_consensus.cc:515] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:13.648481 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:13.652678 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:13.595722 18296 raft_consensus.cc:2749] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:13.658313 16278 raft_consensus.cc:2410] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for term 5 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:13.654901 16946 raft_consensus.cc:1240] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 4 LEARNER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 3. Current term is 4. Ops: []
W20260709 13:06:13.642877 18379 consensus_meta.cc:287] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 0.560s	user 0.011s	sys 0.001s
I20260709 13:06:13.660027 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:06:13.661494 16174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:13.661175 16248 leader_election.cc:304] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:13.663636 16279 raft_consensus.cc:2393] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 5: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:06:13.509330 18303 consensus_queue.cc:237] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } }
I20260709 13:06:13.661823 16945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:13.662024 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:13.664085 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:13.587730 18334 raft_consensus.cc:515] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:13.673066 16351 raft_consensus.cc:1275] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:06:13.673537 16351 pending_rounds.cc:85] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e: Aborting all ops after (but not including) 2
I20260709 13:06:13.673800 16351 pending_rounds.cc:107] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:06:13.674055 16351 raft_consensus.cc:2889] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:13.668975 16246 leader_election.cc:304] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:13.503856 18396 consensus_queue.cc:237] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:13.676517 16948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:13.679239 16248 leader_election.cc:304] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:13.681381 16278 raft_consensus.cc:1240] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 LEADER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 3. Current term is 4. Ops: []
W20260709 13:06:13.686985 16322 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:13.688745 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:13.690186 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:13.691039 16278 raft_consensus.cc:1240] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:06:13.693527 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:06:13.676479 18414 log.cc:927] Time spent T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.211s	user 0.001s	sys 0.000s
I20260709 13:06:13.666631 18382 raft_consensus.cc:493] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:13.667986 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
W20260709 13:06:13.029106 18035 consensus_queue.cc:1175] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "1109f76a0b7b443a84c0327c8707bc63" responder_term: 4 status { last_received { term: 4 index: 5 } last_committed_idx: 4 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 3. Current term is 4. Ops: [3.5-3.5]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:06:13.699918 16279 raft_consensus.cc:2468] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 4.
I20260709 13:06:13.821740 16947 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35106 (request call id 516) took 1155 ms. Trace:
I20260709 13:06:13.701484 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bc3c8ff9b84838a2664335d7e1582b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:13.822507 16947 rpcz_store.cc:276] 0709 13:06:12.649035 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:12.649268 (+   233us) service_pool.cc:224] Handling call
0709 13:06:13.741279 (+1092011us) spinlock_profiling.cc:243] Waited 423 ms on lock 0x7b5400642b54. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:06:13.804648 (+ 63369us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":973340032}
I20260709 13:06:13.823751 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:13.694717 16246 leader_election.cc:304] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:13.870621 16357 raft_consensus.cc:2393] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 3: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:06:13.715662 18133 leader_election.cc:290] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:13.791028 16355 raft_consensus.cc:1275] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:06:13.726716 18410 log.cc:927] Time spent T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.251s	user 0.001s	sys 0.001s
W20260709 13:06:13.713992 18412 log.cc:927] Time spent T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 13:06:13.716027 18152 leader_election.cc:290] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:13.804852 16350 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41830 (request call id 1420) took 1124 ms. Trace:
W20260709 13:06:13.719976 18409 log.cc:927] Time spent T 00000000000000000000000000000000 P 4dc6f08597514f4d85fd451b999b403e: Append to log took a long time: real 0.377s	user 0.001s	sys 0.001s
W20260709 13:06:13.897811 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 214122us
I20260709 13:06:13.901957 16350 rpcz_store.cc:276] 0709 13:06:12.680560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:12.738345 (+ 57785us) service_pool.cc:224] Handling call
0709 13:06:13.740750 (+1002405us) spinlock_profiling.cc:243] Waited 107 ms on lock 0x7b540026af54. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:06:13.804759 (+ 64009us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":245332864}
I20260709 13:06:13.827570 16322 leader_election.cc:304] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:13.903658 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
W20260709 13:06:13.904829 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 77343us
I20260709 13:06:13.905135 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:06:13.768749 18416 log.cc:927] Time spent T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
W20260709 13:06:13.914196 18040 consensus_meta.cc:287] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 0.583s	user 0.007s	sys 0.004s
I20260709 13:06:13.914837 18040 raft_consensus.cc:515] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:13.917624 18040 leader_election.cc:290] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:13.918661 16349 raft_consensus.cc:1240] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:13.739169 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:13.906057 16322 leader_election.cc:304] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:13.906101 16350 raft_consensus.cc:2468] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 3.
I20260709 13:06:13.947278 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:13.948005 16350 raft_consensus.cc:2376] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 5. Re-sending same reply.
I20260709 13:06:13.907452 18422 raft_consensus.cc:2749] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:06:13.860438 18415 log.cc:927] Time spent T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.207s	user 0.001s	sys 0.003s
W20260709 13:06:13.827409 18295 consensus_meta.cc:287] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 0.660s	user 0.010s	sys 0.002s
I20260709 13:06:13.890442 18105 leader_election.cc:290] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:13.813267 18418 raft_consensus.cc:2804] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:06:13.825593 18121 consensus_meta.cc:287] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3: Time spent flushing consensus metadata: real 0.591s	user 0.013s	sys 0.000s
I20260709 13:06:13.963172 18121 raft_consensus.cc:515] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:13.779361 18434 raft_consensus.cc:2804] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:13.773123 18322 leader_election.cc:290] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:13.939994 18114 raft_consensus.cc:3055] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:13.947589 16322 leader_election.cc:304] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:06:13.820093 18317 consensus_meta.cc:287] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3: Time spent flushing consensus metadata: real 0.759s	user 0.013s	sys 0.000s
I20260709 13:06:13.860517 18217 raft_consensus.cc:697] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:13.715898 18334 leader_election.cc:290] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:06:13.903720 18248 consensus_meta.cc:287] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 0.591s	user 0.009s	sys 0.004s
I20260709 13:06:13.790189 18188 raft_consensus.cc:2749] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:13.778710 18356 leader_election.cc:290] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:13.955624 18152 raft_consensus.cc:2749] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:06:13.820864 18413 log.cc:927] Time spent T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.204s	user 0.004s	sys 0.000s
I20260709 13:06:13.954823 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:13.957324 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:13.897763 18374 leader_election.cc:290] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:13.908241 18132 raft_consensus.cc:2804] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:13.922536 18370 leader_election.cc:290] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 election: Requested vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:13.973668 16322 leader_election.cc:304] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:13.975119 18322 raft_consensus.cc:493] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:13.724085 18382 raft_consensus.cc:515] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:13.970640 18114 raft_consensus.cc:740] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:06:13.968698 18434 raft_consensus.cc:493] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:13.975844 18317 raft_consensus.cc:515] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:13.979874 18248 raft_consensus.cc:515] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:14.061373 18376 leader_election.cc:290] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:06:14.061957 18308 consensus_meta.cc:287] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3: Time spent flushing consensus metadata: real 0.764s	user 0.010s	sys 0.003s
I20260709 13:06:14.062525 18248 leader_election.cc:290] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:13.987679 18334 raft_consensus.cc:493] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:13.971426 18418 raft_consensus.cc:697] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:14.064620 18114 consensus_queue.cc:260] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:14.011364 16350 raft_consensus.cc:2468] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 5.
I20260709 13:06:14.067121 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:14.067786 16350 raft_consensus.cc:2376] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 5. Re-sending same reply.
I20260709 13:06:14.068887 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:13.968611 18105 consensus_queue.cc:1048] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 13:06:13.979506 18422 raft_consensus.cc:2749] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:13.960801 18295 raft_consensus.cc:515] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:14.071520 18217 consensus_queue.cc:237] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:14.073741 18295 leader_election.cc:290] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:06:14.022078 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 48500.4us
I20260709 13:06:14.075073 16322 leader_election.cc:304] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:14.052520 16353 raft_consensus.cc:3060] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:14.076583 16322 leader_election.cc:304] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:14.025408 18322 raft_consensus.cc:515] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:14.025518 18251 raft_consensus.cc:2749] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:14.056730 18434 raft_consensus.cc:3060] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:14.058822 18132 raft_consensus.cc:697] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:14.060642 18317 leader_election.cc:290] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:13.996675 16349 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33486 (request call id 174) took 1080 ms. Trace:
I20260709 13:06:14.003646 18188 raft_consensus.cc:493] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:14.064195 16348 raft_consensus.cc:2468] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 5.
I20260709 13:06:14.070135 16274 raft_consensus.cc:2368] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for earlier term 4. Current term is 5.
W20260709 13:06:14.077354 16320 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:14.082835 18248 raft_consensus.cc:2749] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:14.077569 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:14.077805 16322 leader_election.cc:304] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:14.078047 16199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60138 (request call id 1446) took 1085 ms. Trace:
I20260709 13:06:14.090729 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:14.090133 16199 rpcz_store.cc:276] 0709 13:06:12.992799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:13.293032 (+300233us) service_pool.cc:224] Handling call
0709 13:06:13.293435 (+   403us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:13.293739 (+   304us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:13.293764 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:13.294232 (+   468us) log.cc:844] Serialized 26 byte log entry
0709 13:06:13.477090 (+182858us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:13.477138 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:13.477218 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:14.077854 (+600636us) raft_consensus.cc:1685] finished
0709 13:06:14.077874 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:14.077990 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":992,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":16067,"spinlock_wait_cycles":28800,"thread_start_us":182541,"threads_started":1,"wal-append.queue_time_us":780313}
I20260709 13:06:14.092406 16322 leader_election.cc:304] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:06:14.093133 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:14.093952 16199 raft_consensus.cc:2468] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 4.
I20260709 13:06:14.066041 18114 raft_consensus.cc:3060] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:14.083345 16349 rpcz_store.cc:276] 0709 13:06:12.915986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:13.166706 (+250720us) service_pool.cc:224] Handling call
0709 13:06:13.167011 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:13.919230 (+752219us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:13.996410 (+ 77180us) spinlock_profiling.cc:243] Waited 751 ms on lock 0x7b54000d89d4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f489e01 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6
0709 13:06:13.996607 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1727967104}
I20260709 13:06:14.098037 16322 leader_election.cc:304] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:14.098876 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:14.099699 16349 raft_consensus.cc:2468] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 6.
I20260709 13:06:14.081979 18295 raft_consensus.cc:2749] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:14.100736 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:14.099713 16322 leader_election.cc:304] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:14.096462 18422 raft_consensus.cc:493] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:14.108354 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:14.096410 18251 raft_consensus.cc:493] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
W20260709 13:06:14.118976 18429 log.cc:927] Time spent T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
I20260709 13:06:14.118758 18251 raft_consensus.cc:515] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:14.120270 16203 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60138 (request call id 1448) took 1127 ms. Trace:
I20260709 13:06:14.121274 18248 raft_consensus.cc:2804] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:14.121835 18248 raft_consensus.cc:493] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:14.122310 18248 raft_consensus.cc:3060] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:14.123662 16275 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45218 (request call id 1500) took 1487 ms. Trace:
I20260709 13:06:14.124136 16275 rpcz_store.cc:276] 0709 13:06:12.635844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:12.636104 (+   260us) service_pool.cc:224] Handling call
0709 13:06:14.123383 (+1487279us) spinlock_profiling.cc:243] Waited 482 ms on lock 0x7b54002fadd4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:06:14.123580 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1108171136}
I20260709 13:06:14.126601 18377 raft_consensus.cc:2749] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:14.127056 16278 raft_consensus.cc:1240] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:14.120623 16203 rpcz_store.cc:276] 0709 13:06:12.993327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:13.307251 (+313924us) service_pool.cc:224] Handling call
0709 13:06:13.370458 (+ 63207us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:13.370812 (+   354us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:13.370841 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:13.371308 (+   467us) log.cc:844] Serialized 26 byte log entry
0709 13:06:13.700220 (+328912us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:13.700272 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:13.700363 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:14.120043 (+419680us) raft_consensus.cc:1685] finished
0709 13:06:14.120062 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:14.120210 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":35055,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":7746,"thread_start_us":207890,"threads_started":1,"wal-append.queue_time_us":457080}
I20260709 13:06:14.104948 18382 leader_election.cc:290] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:14.104867 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:14.107733 16349 raft_consensus.cc:2376] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 5. Re-sending same reply.
I20260709 13:06:14.078611 18334 raft_consensus.cc:515] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:14.065531 18418 consensus_queue.cc:237] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:14.062984 18308 raft_consensus.cc:515] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:14.110070 16322 leader_election.cc:304] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:14.101245 18374 raft_consensus.cc:2749] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:06:14.092226 18292 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.749s	user 0.012s	sys 0.033s
I20260709 13:06:14.108475 18422 raft_consensus.cc:515] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:14.134805 18322 leader_election.cc:290] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:14.109133 16199 raft_consensus.cc:2468] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 4.
W20260709 13:06:14.100613 18282 consensus_meta.cc:287] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 0.605s	user 0.008s	sys 0.004s
I20260709 13:06:14.155838 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:14.089146 18188 raft_consensus.cc:515] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:14.117693 16353 raft_consensus.cc:1275] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 4. (term mismatch)
I20260709 13:06:14.107409 18152 raft_consensus.cc:2749] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:14.156489 18035 raft_consensus.cc:493] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:14.109886 18183 raft_consensus.cc:493] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:14.186725 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:14.188375 16349 raft_consensus.cc:2468] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 4.
I20260709 13:06:14.156255 18356 raft_consensus.cc:493] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:14.177573 16353 pending_rounds.cc:85] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e: Aborting all ops after (but not including) 3
I20260709 13:06:14.190049 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:14.190706 16353 pending_rounds.cc:107] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 3.4
I20260709 13:06:14.190940 16203 raft_consensus.cc:2368] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for earlier term 5. Current term is 6.
I20260709 13:06:14.191083 16199 raft_consensus.cc:2410] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:14.191139 16353 raft_consensus.cc:2917] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Aborting config change with OpId 3.4: Aborted: Op aborted by new leader
I20260709 13:06:14.191874 16353 raft_consensus.cc:2889] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:14.193359 16353 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41830 (request call id 1427) took 1508 ms. Trace:
W20260709 13:06:14.167869 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 57891.2us
I20260709 13:06:14.157419 16350 raft_consensus.cc:2376] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 4. Re-sending same reply.
I20260709 13:06:14.195302 16322 leader_election.cc:304] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:14.196966 16322 leader_election.cc:304] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:14.175896 18377 raft_consensus.cc:2749] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:14.199959 18187 consensus_queue.cc:260] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:14.201223 18187 raft_consensus.cc:3060] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:14.204334 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
W20260709 13:06:14.205664 16249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:14.205535 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:14.207348 16199 raft_consensus.cc:2368] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for earlier term 5. Current term is 6.
I20260709 13:06:14.158485 18424 raft_consensus.cc:493] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:14.219519 16173 leader_election.cc:304] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:14.187532 18282 raft_consensus.cc:515] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:06:14.168614 18292 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.825s	user 0.012s	sys 0.033s
I20260709 13:06:14.211520 16940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:14.193868 16353 rpcz_store.cc:276] 0709 13:06:12.685349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:12.986233 (+300884us) service_pool.cc:224] Handling call
0709 13:06:12.988784 (+  2551us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:14.025930 (+1037146us) spinlock_profiling.cc:243] Waited 96.7 ms on lock 0x7b58005e04d0. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f3e50aa 00007f361f467447 00007f361f47ffe7 00007f361f4817de 00007f361f48bb49 00007f361f48c416 00007f361f488d8f 00007f361f48883e 00007f362444d419 00007f361d9c4bd4
0709 13:06:14.192977 (+167047us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:14.193264 (+   287us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":222429952}
I20260709 13:06:14.190074 18183 raft_consensus.cc:515] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:14.216863 18157 raft_consensus.cc:3060] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:14.217770 16320 leader_election.cc:400] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 election: Vote denied by peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073) with higher term. Message: Invalid argument: T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for earlier term 5. Current term is 6.
I20260709 13:06:14.227277 16320 leader_election.cc:403] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:06:14.221601 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:14.134799 18248 raft_consensus.cc:515] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:14.222245 16322 leader_election.cc:304] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:14.189831 18035 raft_consensus.cc:515] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:14.176215 18121 leader_election.cc:290] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:14.245767 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:14.246726 16203 raft_consensus.cc:2393] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 4: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:06:14.225864 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:14.203711 18040 raft_consensus.cc:2749] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:14.240041 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:14.206724 18356 raft_consensus.cc:515] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:14.218910 18424 raft_consensus.cc:515] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:14.253333 16320 leader_election.cc:400] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 election: Vote denied by peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073) with higher term. Message: Invalid argument: T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for earlier term 5. Current term is 6.
I20260709 13:06:14.253733 16320 leader_election.cc:403] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:06:14.243516 18183 leader_election.cc:290] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:14.250444 16353 raft_consensus.cc:2468] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 5.
I20260709 13:06:14.208427 18374 raft_consensus.cc:2749] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:14.244400 18035 leader_election.cc:290] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:14.159034 18132 consensus_queue.cc:237] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:14.228708 18382 raft_consensus.cc:2804] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:06:14.262362 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 63868.8us
I20260709 13:06:14.267493 16322 leader_election.cc:304] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:14.227914 18370 consensus_queue.cc:1048] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 13:06:14.273404 18334 leader_election.cc:290] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:14.259316 18152 raft_consensus.cc:3060] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:14.274945 16322 leader_election.cc:304] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:14.280804 18308 leader_election.cc:290] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:06:14.258137 16208 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.024s	sys 0.070s
I20260709 13:06:14.280388 18248 leader_election.cc:290] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:06:14.285573 16208 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.587s	user 0.024s	sys 0.070s
I20260709 13:06:14.266396 18376 raft_consensus.cc:3060] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:14.268898 18040 raft_consensus.cc:2749] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:14.288268 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:06:14.287931 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:14.322278 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
W20260709 13:06:14.322676 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:14.331137 16203 raft_consensus.cc:2393] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 4: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:06:14.270609 16940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:06:14.281519 18374 raft_consensus.cc:2749] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:14.333050 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:14.333951 16203 raft_consensus.cc:2393] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 5: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:06:14.275853 18422 leader_election.cc:290] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:14.335289 16948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:14.281872 18377 raft_consensus.cc:2749] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:06:14.354961 16248 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.639s	user 0.011s	sys 0.026s
W20260709 13:06:14.356719 16248 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.640s	user 0.011s	sys 0.026s
W20260709 13:06:14.357803 16249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:14.348383 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:14.359203 16203 raft_consensus.cc:2393] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 4: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
W20260709 13:06:14.364746 16914 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.017s	user 0.013s	sys 0.020s
W20260709 13:06:14.366286 16914 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.019s	user 0.013s	sys 0.020s
W20260709 13:06:14.368010 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 1.02074e+06us
W20260709 13:06:14.365454 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 686265us
W20260709 13:06:14.371572 16282 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.649s	user 0.007s	sys 0.026s
I20260709 13:06:14.371798 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:14.372995 16353 raft_consensus.cc:3060] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:14.374167 16282 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.656s	user 0.008s	sys 0.026s
W20260709 13:06:14.375249 18427 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.613s	user 0.018s	sys 0.034s
I20260709 13:06:14.343947 18339 raft_consensus.cc:3055] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:06:14.380448 18427 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.639s	user 0.018s	sys 0.034s
I20260709 13:06:14.383754 16248 leader_election.cc:304] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:14.383471 16914 leader_election.cc:304] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:14.389616 16914 leader_election.cc:304] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:14.393204 16914 leader_election.cc:304] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:06:14.386970 16248 leader_election.cc:304] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:14.337589 18425 consensus_queue.cc:1059] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.061s
I20260709 13:06:14.385483 18427 raft_consensus.cc:2749] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:14.397224 18360 raft_consensus.cc:2749] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:14.401762 16248 leader_election.cc:304] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:14.402014 16206 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60138 (request call id 1461) took 1102 ms. Trace:
I20260709 13:06:14.394586 18297 raft_consensus.cc:2749] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:14.405548 16206 rpcz_store.cc:276] 0709 13:06:13.299528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:14.386511 (+1086983us) service_pool.cc:224] Handling call
0709 13:06:14.401323 (+ 14812us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:14.401555 (+   232us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:14.401595 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:14.401657 (+    62us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:14.401704 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:14.401779 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:14.401938 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:14.408424 18424 leader_election.cc:290] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:14.403064 18292 raft_consensus.cc:2804] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:14.411146 18292 raft_consensus.cc:493] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:14.411655 18292 raft_consensus.cc:3060] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:14.390297 18188 leader_election.cc:290] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:14.414698 18308 consensus_queue.cc:1059] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:14.385646 18250 raft_consensus.cc:3055] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:14.404083 16914 leader_election.cc:304] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:06:14.420806 18250 raft_consensus.cc:740] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:06:14.416229 18308 raft_consensus.cc:3055] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:14.395375 18339 raft_consensus.cc:740] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:06:14.446973 16207 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39674 (request call id 217) took 1873 ms. Trace:
I20260709 13:06:14.400139 18128 raft_consensus.cc:2749] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:06:14.463986 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 62370.2us
I20260709 13:06:14.464107 16354 raft_consensus.cc:3055] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:06:14.471657 16354 raft_consensus.cc:740] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:06:14.457118 16207 rpcz_store.cc:276] 0709 13:06:12.573203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:12.574707 (+  1504us) service_pool.cc:224] Handling call
0709 13:06:12.575071 (+   364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:13.513379 (+938308us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:14.442286 (+928907us) spinlock_profiling.cc:243] Waited 937 ms on lock 0x7b54001414d4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f489e01 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6
0709 13:06:14.446858 (+  4572us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2155355008}
I20260709 13:06:14.473237 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:14.470026 16203 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39674 (request call id 230) took 1210 ms. Trace:
W20260709 13:06:14.464596 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 60636.4us
I20260709 13:06:14.474337 16203 rpcz_store.cc:276] 0709 13:06:13.260004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:14.377863 (+1117859us) service_pool.cc:224] Handling call
0709 13:06:14.423583 (+ 45720us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:14.464703 (+ 41120us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:14.469605 (+  4902us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:14.469665 (+    60us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:14.469706 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:14.469772 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:14.469906 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:14.418306 16206 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60138 (request call id 1462) took 1118 ms. Trace:
I20260709 13:06:14.479168 16206 rpcz_store.cc:276] 0709 13:06:13.299867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:14.417244 (+1117377us) service_pool.cc:224] Handling call
0709 13:06:14.417661 (+   417us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:14.417890 (+   229us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:14.417927 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:14.417982 (+    55us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:14.418026 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:14.418097 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:14.418241 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:14.481467 16207 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39674 (request call id 231) took 1146 ms. Trace:
I20260709 13:06:14.482378 16207 rpcz_store.cc:276] 0709 13:06:13.335549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:14.480639 (+1145090us) service_pool.cc:224] Handling call
0709 13:06:14.480965 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:14.481145 (+   180us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:14.481168 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:14.481211 (+    43us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:14.481238 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:14.481289 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:14.481391 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:14.424670 18297 raft_consensus.cc:2804] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:14.489310 16205 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39674 (request call id 221) took 1508 ms. Trace:
I20260709 13:06:14.436499 18308 raft_consensus.cc:740] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:14.491760 16205 rpcz_store.cc:276] 0709 13:06:12.980633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:12.987710 (+  7077us) service_pool.cc:224] Handling call
0709 13:06:12.988040 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:14.488633 (+1500593us) spinlock_profiling.cc:243] Waited 595 ms on lock 0x7b540004bb20. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f404858 00007f361f488e9d 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c
0709 13:06:14.488727 (+    94us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:06:14.488768 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:14.488837 (+    69us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:14.488900 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:14.488999 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:14.489211 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22898,"raft.queue_time_us":25878,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":11321,"spinlock_wait_cycles":1368441600}
I20260709 13:06:14.496567 16353 raft_consensus.cc:2468] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 4.
I20260709 13:06:14.468530 18188 raft_consensus.cc:3060] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:14.498710 16247 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.007s	sys 0.018s
I20260709 13:06:14.501241 16248 leader_election.cc:304] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:06:14.501678 16247 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.552s	user 0.008s	sys 0.018s
I20260709 13:06:14.485137 16354 consensus_queue.cc:260] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:14.503388 16322 leader_election.cc:400] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 pre-election: Vote denied by peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823) with higher term. Message: Invalid argument: T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for earlier term 4. Current term is 5.
I20260709 13:06:14.503701 16322 leader_election.cc:403] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:14.504454 16248 leader_election.cc:304] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:14.478952 18282 leader_election.cc:290] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:14.503770 16354 raft_consensus.cc:3060] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:06:14.508695 16202 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.008s	sys 0.019s
W20260709 13:06:14.509495 16202 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.599s	user 0.008s	sys 0.019s
I20260709 13:06:14.491364 18356 leader_election.cc:290] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:14.489404 18382 raft_consensus.cc:697] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 5 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
W20260709 13:06:14.511631 16246 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.001s	sys 0.042s
W20260709 13:06:14.513734 16246 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.565s	user 0.001s	sys 0.042s
I20260709 13:06:14.504894 18380 raft_consensus.cc:3060] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:06:14.486042 18424 consensus_queue.cc:1048] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 13:06:14.496733 18035 raft_consensus.cc:493] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:14.485862 18279 consensus_queue.cc:1048] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
W20260709 13:06:14.505439 18303 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.021s	sys 0.021s
I20260709 13:06:14.521557 16200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60154 (request call id 1383) took 1387 ms. Trace:
I20260709 13:06:14.523583 16355 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41830 (request call id 1442) took 1710 ms. Trace:
I20260709 13:06:14.526798 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:14.460001 18250 consensus_queue.cc:260] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:14.532627 16355 rpcz_store.cc:276] 0709 13:06:12.813654 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:13.099667 (+286013us) service_pool.cc:224] Handling call
0709 13:06:13.790285 (+690618us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:13.894121 (+103836us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:14.523372 (+629251us) spinlock_profiling.cc:243] Waited 679 ms on lock 0x7b540026af50. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f4888ad 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:06:14.523525 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1561033600}
I20260709 13:06:14.532496 16200 rpcz_store.cc:276] 0709 13:06:13.134078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:13.516151 (+382073us) service_pool.cc:224] Handling call
0709 13:06:14.520845 (+1004694us) spinlock_profiling.cc:243] Waited 5.44 ms on lock 0x7b5800002a98. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361c224db1 00007f361c364b71 00007f361c364a22 00007f362527dc09 00007f36243d7ee0 00007f36244a10ab 00007f36244a1131 00007f3624462fc0 00007f362444d929 00007f362444d3d2 00007f361d9c4bd4
0709 13:06:14.521063 (+   218us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:14.521249 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:14.521274 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:14.521316 (+    42us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:14.521343 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:14.521400 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:14.521503 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12518656}
I20260709 13:06:14.534097 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:14.543727 16353 raft_consensus.cc:2376] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 6. Re-sending same reply.
I20260709 13:06:14.545634 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:06:14.525322 18061 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.008s	sys 0.019s
I20260709 13:06:14.550058 16281 raft_consensus.cc:1275] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:14.511729 18435 raft_consensus.cc:2804] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:14.550535 16246 leader_election.cc:304] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:14.508877 18322 consensus_queue.cc:1048] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 13:06:14.546602 16282 raft_consensus.cc:2468] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 5.
I20260709 13:06:14.583662 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:14.583997 18322 raft_consensus.cc:2804] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:14.584441 18322 raft_consensus.cc:493] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:14.584781 18322 raft_consensus.cc:3060] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:14.584968 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:14.522903 18334 raft_consensus.cc:493] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:14.508505 18419 consensus_queue.cc:1048] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
W20260709 13:06:14.533752 18303 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.548s	user 0.021s	sys 0.021s
I20260709 13:06:14.557897 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:14.558583 18279 raft_consensus.cc:493] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:14.594305 18334 raft_consensus.cc:515] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:14.594862 18279 raft_consensus.cc:515] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:14.558769 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:14.597214 16355 raft_consensus.cc:2376] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 5. Re-sending same reply.
I20260709 13:06:14.559957 18250 raft_consensus.cc:3060] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:14.540196 18434 raft_consensus.cc:515] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:06:14.551137 18061 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.535s	user 0.008s	sys 0.020s
I20260709 13:06:14.563302 18277 raft_consensus.cc:493] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:14.564859 16203 raft_consensus.cc:1240] T b9e1324823f04d8da5a4b3ddbd061c0e P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:14.520460 18217 raft_consensus.cc:2804] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:06:14.531910 18396 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.765s	user 0.002s	sys 0.026s
I20260709 13:06:14.567260 16354 raft_consensus.cc:2468] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 2.
W20260709 13:06:14.611510 16354 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41830 (request call id 1423) took 1930 ms (client timeout 2078 ms). Trace:
W20260709 13:06:14.612003 16354 rpcz_store.cc:269] 0709 13:06:12.681529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:12.690956 (+  9427us) service_pool.cc:224] Handling call
0709 13:06:14.463979 (+1773023us) spinlock_profiling.cc:243] Waited 139 ms on lock 0x7b54002268a0. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f400dc0 00007f361f48ce18 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6
0709 13:06:14.611441 (+147462us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":320169216}
I20260709 13:06:14.567761 18317 raft_consensus.cc:493] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:14.571061 18308 consensus_queue.cc:260] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:14.572674 18382 consensus_queue.cc:237] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:14.523056 18356 raft_consensus.cc:493] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:14.588001 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:14.517832 18128 consensus_queue.cc:1048] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 13:06:14.601603 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:14.601751 18440 consensus_queue.cc:1048] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:14.604226 16248 leader_election.cc:304] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:14.536698 18035 raft_consensus.cc:515] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:14.618865 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:14.600245 18114 raft_consensus.cc:493] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:14.621189 16320 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:14.628016 16915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:14.599565 18435 raft_consensus.cc:697] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
W20260709 13:06:14.615716 18396 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.848s	user 0.002s	sys 0.027s
I20260709 13:06:14.611039 18217 raft_consensus.cc:493] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:14.680449 18217 raft_consensus.cc:3060] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:14.682423 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:14.682585 16200 raft_consensus.cc:1240] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:14.674320 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:14.623687 18133 raft_consensus.cc:493] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:14.620673 18310 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 13:06:14.651721 18370 raft_consensus.cc:493] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:14.653481 18035 leader_election.cc:290] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:14.643401 18061 raft_consensus.cc:2804] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:14.642933 18264 raft_consensus.cc:493] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:14.531638 18339 consensus_queue.cc:260] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:14.671365 16207 raft_consensus.cc:1275] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:06:14.625658 18317 raft_consensus.cc:515] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:14.675884 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:14.700726 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:14.679003 18435 consensus_queue.cc:237] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:14.610687 18277 raft_consensus.cc:515] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:14.650313 16282 raft_consensus.cc:2368] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for earlier term 5. Current term is 6.
I20260709 13:06:14.706442 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:14.660404 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:14.707221 16274 raft_consensus.cc:3060] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:14.667905 18251 leader_election.cc:290] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:14.699632 16207 pending_rounds.cc:85] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f: Aborting all ops after (but not including) 2
I20260709 13:06:14.708141 16207 pending_rounds.cc:107] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:06:14.708334 16322 leader_election.cc:400] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Vote denied by peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823) with higher term. Message: Invalid argument: T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for earlier term 5. Current term is 6.
I20260709 13:06:14.708599 16207 raft_consensus.cc:2889] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:14.708877 16322 leader_election.cc:403] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:14.701447 16357 raft_consensus.cc:2468] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 3.
I20260709 13:06:14.639268 18356 raft_consensus.cc:515] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:14.648864 18114 raft_consensus.cc:515] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:14.711195 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:06:14.743077 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:14.690050 16201 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.688s	user 0.023s	sys 0.053s
I20260709 13:06:14.696306 18279 leader_election.cc:290] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:06:14.766355 16201 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.764s	user 0.024s	sys 0.053s
I20260709 13:06:14.766634 16208 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60138 (request call id 1457) took 1570 ms. Trace:
I20260709 13:06:14.770221 16278 raft_consensus.cc:3060] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:14.698179 18061 raft_consensus.cc:697] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:14.692291 18425 consensus_queue.cc:1059] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 13:06:14.715443 18377 raft_consensus.cc:3060] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:06:14.712373 18339 raft_consensus.cc:3060] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:14.694070 18133 raft_consensus.cc:515] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:14.697009 18370 raft_consensus.cc:515] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:14.766008 18396 raft_consensus.cc:493] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:14.698097 18264 raft_consensus.cc:515] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:06:14.778349 18334 leader_election.cc:290] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:14.769869 18295 raft_consensus.cc:493] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:14.783975 18152 raft_consensus.cc:2749] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073) with higher term. Message: Invalid argument: T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for earlier term 5. Current term is 6.
W20260709 13:06:14.811157 18187 consensus_meta.cc:287] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3: Time spent flushing consensus metadata: real 0.608s	user 0.012s	sys 0.000s
W20260709 13:06:14.924999 18445 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.500s	user 0.014s	sys 0.021s
I20260709 13:06:14.952395 18295 raft_consensus.cc:515] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:14.925341 18292 raft_consensus.cc:515] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:06:15.023332 16352 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41830 (request call id 1429) took 2337 ms (client timeout 2798 ms). Trace:
I20260709 13:06:14.924038 18396 raft_consensus.cc:515] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:15.025393 18217 raft_consensus.cc:515] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:15.025421 18035 raft_consensus.cc:493] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:14.879585 18440 raft_consensus.cc:493] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:15.029997 18061 consensus_queue.cc:237] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:06:15.026624 18451 log.cc:927] Time spent T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
W20260709 13:06:15.067224 16915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:15.036748 18288 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.982s	user 0.041s	sys 0.066s
W20260709 13:06:15.074157 16949 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.000s	sys 0.055s
I20260709 13:06:15.032860 18334 raft_consensus.cc:493] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:15.039387 18376 consensus_meta.cc:287] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 0.707s	user 0.008s	sys 0.006s
W20260709 13:06:15.076123 16914 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.591s	user 0.019s	sys 0.039s
W20260709 13:06:15.120546 16914 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.636s	user 0.019s	sys 0.040s
I20260709 13:06:14.785315 18279 raft_consensus.cc:493] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:15.109490 18337 consensus_queue.cc:1059] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:15.110082 16948 raft_consensus.cc:1240] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:15.111017 16940 raft_consensus.cc:1240] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:15.117064 18114 leader_election.cc:290] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:15.076156 18424 consensus_queue.cc:1059] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 13:06:15.134783 18317 leader_election.cc:290] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:15.112208 18370 leader_election.cc:290] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:06:15.121202 16949 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.605s	user 0.000s	sys 0.055s
W20260709 13:06:15.120985 18288 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.067s	user 0.041s	sys 0.067s
W20260709 13:06:15.125970 18188 consensus_meta.cc:287] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3: Time spent flushing consensus metadata: real 0.618s	user 0.009s	sys 0.002s
I20260709 13:06:15.123871 18376 raft_consensus.cc:2749] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073) with higher term. Message: Invalid argument: T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for earlier term 5. Current term is 6.
I20260709 13:06:15.120422 18434 leader_election.cc:290] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:06:15.136476 18380 consensus_meta.cc:287] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 0.616s	user 0.008s	sys 0.003s
I20260709 13:06:15.111146 18292 leader_election.cc:290] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 4 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:15.144107 18396 leader_election.cc:290] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:15.145896 18217 leader_election.cc:290] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:06:15.161115 18322 consensus_meta.cc:287] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3: Time spent flushing consensus metadata: real 0.576s	user 0.015s	sys 0.000s
I20260709 13:06:15.125468 18334 raft_consensus.cc:515] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:06:15.154436 18446 log.cc:927] Time spent T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:06:15.123348 18440 raft_consensus.cc:515] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:15.169198 18380 raft_consensus.cc:2749] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823) with higher term. Message: Invalid argument: T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for earlier term 4. Current term is 5.
W20260709 13:06:15.186800 18455 log.cc:927] Time spent T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.071s	user 0.001s	sys 0.001s
I20260709 13:06:15.171257 18356 leader_election.cc:290] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:15.188536 18295 leader_election.cc:290] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:15.186360 18440 leader_election.cc:290] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:15.197872 18377 raft_consensus.cc:2749] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823) with higher term. Message: Invalid argument: T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for earlier term 5. Current term is 6.
I20260709 13:06:15.179770 18322 raft_consensus.cc:515] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:15.201826 18322 leader_election.cc:290] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:06:15.212591 18450 log.cc:927] Time spent T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
W20260709 13:06:15.254453 16246 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.699s	user 0.022s	sys 0.029s
I20260709 13:06:15.255249 16201 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39674 (request call id 225) took 2273 ms. Trace:
W20260709 13:06:15.256069 16174 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.760s	user 0.009s	sys 0.030s
W20260709 13:06:15.256560 16174 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.761s	user 0.009s	sys 0.030s
W20260709 13:06:15.257545 16247 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:15.259552 16202 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60154 (request call id 1384) took 2060 ms. Trace:
I20260709 13:06:15.026523 16351 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41830 (request call id 1437) took 2214 ms. Trace:
W20260709 13:06:15.255553 16246 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.701s	user 0.022s	sys 0.030s
W20260709 13:06:15.261174 16203 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.012s	sys 0.035s
W20260709 13:06:15.261933 16203 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.576s	user 0.012s	sys 0.035s
W20260709 13:06:15.262125 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 711630us
I20260709 13:06:15.264576 16204 raft_consensus.cc:1240] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 5 LEADER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:15.264991 16246 leader_election.cc:304] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:15.028096 16283 raft_consensus.cc:1240] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 LEADER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 1. Current term is 2. Ops: []
I20260709 13:06:15.267890 16277 raft_consensus.cc:1240] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 13:06:15.031888 16282 raft_consensus.cc:2468] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 4.
I20260709 13:06:15.260761 16351 rpcz_store.cc:276] 0709 13:06:12.811998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:13.006577 (+194579us) service_pool.cc:224] Handling call
0709 13:06:13.007057 (+   480us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:13.674628 (+667571us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:15.026217 (+1351589us) spinlock_profiling.cc:243] Waited 664 ms on lock 0x7b5400291dd4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f489e01 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6
0709 13:06:15.026451 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1526609664}
I20260709 13:06:15.272107 16282 raft_consensus.cc:1240] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260709 13:06:15.105831 16352 rpcz_store.cc:269] 0709 13:06:12.686105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:12.841566 (+155461us) service_pool.cc:224] Handling call
0709 13:06:15.005900 (+2164334us) spinlock_profiling.cc:243] Waited 610 ms on lock 0x7b540032b754. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:06:15.023073 (+ 17173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1402131200}
W20260709 13:06:15.050633 16320 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:15.120792 18035 raft_consensus.cc:515] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:15.291054 18377 raft_consensus.cc:493] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:15.291463 18035 leader_election.cc:290] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:15.139619 18133 leader_election.cc:290] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:06:15.152071 18157 consensus_meta.cc:287] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f: Time spent flushing consensus metadata: real 0.913s	user 0.012s	sys 0.001s
I20260709 13:06:15.155509 18277 leader_election.cc:290] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:15.292212 18377 raft_consensus.cc:515] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:15.295226 18264 leader_election.cc:290] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:06:15.300872 16915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:15.217260 18288 raft_consensus.cc:3055] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:06:15.302875 16174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:15.303305 18288 raft_consensus.cc:740] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:06:15.304984 18288 consensus_queue.cc:260] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:15.306874 18458 raft_consensus.cc:493] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:15.307459 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:15.307708 18458 raft_consensus.cc:515] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:15.309006 16206 raft_consensus.cc:2410] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:06:15.309325 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:15.311121 16357 raft_consensus.cc:2468] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 6.
I20260709 13:06:15.311589 18133 raft_consensus.cc:493] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:15.312177 18132 raft_consensus.cc:493] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:15.312482 18133 raft_consensus.cc:515] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:15.313114 18132 raft_consensus.cc:515] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:15.167507 18188 raft_consensus.cc:2749] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:15.314942 18370 raft_consensus.cc:493] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:15.255008 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 290091us
I20260709 13:06:15.255949 16201 rpcz_store.cc:276] 0709 13:06:12.981855 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:13.148656 (+166801us) service_pool.cc:224] Handling call
0709 13:06:13.149161 (+   505us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:13.149750 (+   589us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:13.149809 (+    59us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:13.150486 (+   677us) log.cc:844] Serialized 26 byte log entry
0709 13:06:14.001614 (+851128us) spinlock_profiling.cc:243] Waited 3.4 ms on lock 0x7b1800440680. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f3625264de1 00007f36252715b1 00007f361c37ee07 00007f36251d9ab9 00007f361c39b69b 00007f361c39993f 00007f361c39bc02 00007f361f02320b 00007f361f028d23 00007f361f0290d1 00007f361f444a0f
0709 13:06:14.771552 (+769938us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:14.771635 (+    83us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:14.771732 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:15.253940 (+482208us) raft_consensus.cc:1685] finished
0709 13:06:15.254039 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:15.254892 (+   853us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":628,"raft.queue_time_us":209,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":14057,"spinlock_wait_cycles":7821568,"thread_start_us":769683,"threads_started":1,"wal-append.queue_time_us":1947613}
I20260709 13:06:15.149355 18279 raft_consensus.cc:515] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:15.317404 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:15.316037 18370 raft_consensus.cc:515] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:15.311270 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:15.307332 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
W20260709 13:06:15.121006 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 636302us
W20260709 13:06:15.165441 18121 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.607s	user 0.045s	sys 0.061s
I20260709 13:06:15.300977 18183 raft_consensus.cc:493] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:15.325961 16351 raft_consensus.cc:3060] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:15.328840 18183 raft_consensus.cc:515] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:15.330035 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:15.330826 16207 raft_consensus.cc:3060] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:15.328575 16350 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41832 (request call id 1455) took 1598 ms (client timeout 1961 ms). Trace:
I20260709 13:06:15.333392 16322 leader_election.cc:304] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
W20260709 13:06:15.333341 16350 rpcz_store.cc:269] 0709 13:06:13.692468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:14.097105 (+404637us) service_pool.cc:224] Handling call
0709 13:06:15.290000 (+1192895us) spinlock_profiling.cc:243] Waited 2.63 ms on lock 0x7b54003a4654. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:06:15.290336 (+   336us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6038784}
I20260709 13:06:15.334875 18264 raft_consensus.cc:2804] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:15.335023 18279 leader_election.cc:290] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:15.335618 18264 raft_consensus.cc:697] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 4 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:06:15.335708 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:06:15.336015 18121 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.778s	user 0.046s	sys 0.062s
I20260709 13:06:15.337563 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:15.339744 18133 leader_election.cc:290] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:15.327378 18288 raft_consensus.cc:3060] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:15.260059 16202 rpcz_store.cc:276] 0709 13:06:13.199094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:13.686753 (+487659us) service_pool.cc:224] Handling call
0709 13:06:13.687175 (+   422us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:13.687604 (+   429us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:13.687651 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:13.709016 (+ 21365us) log.cc:844] Serialized 26 byte log entry
0709 13:06:14.510202 (+801186us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:14.510262 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:14.510392 (+   130us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:15.258831 (+748439us) raft_consensus.cc:1685] finished
0709 13:06:15.258890 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:15.259280 (+   390us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":101,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":8669,"thread_start_us":599483,"threads_started":1,"wal-append.queue_time_us":1088318}
I20260709 13:06:15.344467 18339 consensus_queue.cc:1059] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:15.337435 18264 consensus_queue.cc:237] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:15.359208 18132 leader_election.cc:290] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:15.355901 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:06:15.356793 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:15.361141 16206 raft_consensus.cc:2468] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 5.
I20260709 13:06:15.362800 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:15.362964 18295 raft_consensus.cc:493] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:15.363353 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:15.363903 18295 raft_consensus.cc:515] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:15.364701 16202 raft_consensus.cc:3060] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:15.332382 18183 leader_election.cc:290] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:14.770396 16208 rpcz_store.cc:276] 0709 13:06:13.196456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:13.653081 (+456625us) service_pool.cc:224] Handling call
0709 13:06:13.666125 (+ 13044us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:13.666345 (+   220us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:06:14.314003 (+647658us) log.cc:844] Serialized 14 byte log entry
0709 13:06:14.766167 (+452164us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:14.766235 (+    68us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:14.766283 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:14.766355 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:14.766526 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5762,"prepare.queue_time_us":29770,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":54384,"thread_start_us":1016375,"threads_started":2}
I20260709 13:06:15.369946 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:15.370070 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:15.371594 16352 raft_consensus.cc:2468] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 3.
I20260709 13:06:15.365409 16207 raft_consensus.cc:2468] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 5.
I20260709 13:06:15.381412 16208 raft_consensus.cc:3060] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:15.376814 16356 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41830 (request call id 1430) took 2659 ms (client timeout 2232 ms). Trace:
I20260709 13:06:15.378011 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:15.378857 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:15.365039 16204 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60154 (request call id 1387) took 1228 ms. Trace:
I20260709 13:06:15.382380 16204 rpcz_store.cc:276] 0709 13:06:14.136388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:14.542105 (+405717us) service_pool.cc:224] Handling call
0709 13:06:14.559736 (+ 17631us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:15.265595 (+705859us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:15.364669 (+ 99074us) spinlock_profiling.cc:243] Waited 704 ms on lock 0x7b54000b4ad4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f489e01 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6
0709 13:06:15.364954 (+   285us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1618869632}
I20260709 13:06:15.379169 18295 leader_election.cc:290] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:15.327503 18458 leader_election.cc:290] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:06:15.382033 16356 rpcz_store.cc:269] 0709 13:06:12.718086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:12.719257 (+  1171us) service_pool.cc:224] Handling call
0709 13:06:15.376289 (+2657032us) spinlock_profiling.cc:243] Waited 715 ms on lock 0x7b5400269654. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:06:15.376560 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1643998464}
I20260709 13:06:15.400880 16351 raft_consensus.cc:2468] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 4.
I20260709 13:06:15.403205 16354 raft_consensus.cc:2468] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 5.
I20260709 13:06:15.404047 18418 raft_consensus.cc:2804] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:15.404596 18418 raft_consensus.cc:493] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:15.404745 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:15.405055 18418 raft_consensus.cc:3060] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:15.405689 16354 raft_consensus.cc:2468] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 5.
I20260709 13:06:15.399905 16350 raft_consensus.cc:2468] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 5.
I20260709 13:06:15.409960 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:15.408890 18295 raft_consensus.cc:493] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:15.421895 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:15.426391 18370 leader_election.cc:290] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:15.426240 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:15.427807 16949 raft_consensus.cc:2468] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 4.
I20260709 13:06:15.438679 16206 raft_consensus.cc:2393] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 4: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:06:15.438359 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:15.440340 16351 raft_consensus.cc:3060] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:15.435576 16203 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60154 (request call id 1396) took 1221 ms. Trace:
I20260709 13:06:15.447386 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:15.449164 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:15.450879 16204 raft_consensus.cc:1240] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 3. Current term is 4. Ops: []
W20260709 13:06:15.458014 16274 consensus_meta.cc:287] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3: Time spent flushing consensus metadata: real 0.747s	user 0.005s	sys 0.009s
I20260709 13:06:15.459021 18458 consensus_queue.cc:1048] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:06:15.462142 16248 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 2.232s (SENT) [suppressed 24 similar messages]
W20260709 13:06:15.462683 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:15.478435 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:15.479351 18377 leader_election.cc:290] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:15.481817 16199 raft_consensus.cc:1240] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 3. Current term is 4. Ops: []
W20260709 13:06:15.485138 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 54310.8us
I20260709 13:06:15.489609 16320 leader_election.cc:304] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:15.501142 16940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:15.502661 16274 raft_consensus.cc:2468] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 5.
I20260709 13:06:15.505496 16948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:15.506532 16948 raft_consensus.cc:2468] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 4.
I20260709 13:06:15.511439 16201 raft_consensus.cc:2468] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 5.
W20260709 13:06:15.518725 16279 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45210 (request call id 1400) took 1828 ms (client timeout 2264 ms). Trace:
W20260709 13:06:15.519320 16279 rpcz_store.cc:269] 0709 13:06:13.690335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:13.693176 (+  2841us) service_pool.cc:224] Handling call
0709 13:06:15.518287 (+1825111us) spinlock_profiling.cc:243] Waited 1.76 ms on lock 0x7b5400127354. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:06:15.518487 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4047104}
I20260709 13:06:15.520226 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:15.523734 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:15.525434 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:15.528820 16350 raft_consensus.cc:2468] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 4.
I20260709 13:06:15.531172 18250 raft_consensus.cc:3055] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:06:15.430502 18297 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.815s	user 0.028s	sys 0.037s
I20260709 13:06:15.543196 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:15.534036 18250 raft_consensus.cc:740] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
W20260709 13:06:15.546312 16915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:15.547345 16278 consensus_meta.cc:287] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3: Time spent flushing consensus metadata: real 0.776s	user 0.010s	sys 0.009s
I20260709 13:06:15.547796 16278 raft_consensus.cc:2468] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 4.
I20260709 13:06:15.547837 16356 raft_consensus.cc:2468] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 5.
I20260709 13:06:15.548547 16356 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41830 (request call id 1455) took 1023 ms. Trace:
I20260709 13:06:15.548894 16356 rpcz_store.cc:276] 0709 13:06:14.524732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:15.409540 (+884808us) service_pool.cc:224] Handling call
0709 13:06:15.548462 (+138922us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:15.549954 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:15.550690 16356 raft_consensus.cc:3060] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:06:15.554570 16354 raft_consensus.cc:2376] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 3. Re-sending same reply.
I20260709 13:06:15.555207 16354 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41830 (request call id 1460) took 1013 ms. Trace:
I20260709 13:06:15.555512 16354 rpcz_store.cc:276] 0709 13:06:14.541981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:15.524928 (+982947us) service_pool.cc:224] Handling call
0709 13:06:15.555150 (+ 30222us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:15.555828 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:15.556573 16350 raft_consensus.cc:3060] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:15.556703 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:06:15.557386 18297 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.049s	user 0.030s	sys 0.037s
I20260709 13:06:15.557714 18297 raft_consensus.cc:697] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [term 4 LEADER]: Becoming Leader. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:06:15.538810 16173 leader_election.cc:304] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
W20260709 13:06:15.559767 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 73270.2us
I20260709 13:06:15.560052 16357 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41830 (request call id 1461) took 1017 ms. Trace:
I20260709 13:06:15.560683 16173 leader_election.cc:304] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:15.562498 18419 raft_consensus.cc:493] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:15.563339 18419 raft_consensus.cc:515] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:06:15.565191 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 76212.7us
I20260709 13:06:15.565560 18377 raft_consensus.cc:2749] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:06:15.565817 16913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:15.444729 16203 rpcz_store.cc:276] 0709 13:06:14.213724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:14.631173 (+417449us) service_pool.cc:224] Handling call
0709 13:06:14.685161 (+ 53988us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:14.685372 (+   211us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:06:15.262907 (+577535us) log.cc:844] Serialized 14 byte log entry
0709 13:06:15.387091 (+124184us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:15.389396 (+  2305us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:15.407916 (+ 18520us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:15.414189 (+  6273us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:15.435498 (+ 21309us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30613,"prepare.queue_time_us":74927,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":52,"raft.queue_time_us":33439,"raft.run_cpu_time_us":219,"raft.run_wall_time_us":220,"thread_start_us":631405,"threads_started":2,"wal-append.queue_time_us":97464}
I20260709 13:06:15.568138 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:06:15.569525 16249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:15.570948 18434 raft_consensus.cc:493] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:15.571429 16945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:15.571652 18434 raft_consensus.cc:515] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:15.560484 16357 rpcz_store.cc:276] 0709 13:06:14.542221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:14.710889 (+168668us) service_pool.cc:224] Handling call
0709 13:06:15.559812 (+848923us) spinlock_profiling.cc:243] Waited 513 ms on lock 0x7b54001e7dd4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:06:15.559975 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1179225344}
I20260709 13:06:15.574051 18434 leader_election.cc:290] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:15.574252 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:15.575471 18376 raft_consensus.cc:493] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:15.576349 16357 raft_consensus.cc:2393] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 4: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:06:15.576218 18376 raft_consensus.cc:515] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:15.562512 16173 leader_election.cc:304] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:15.569589 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:15.582967 16202 raft_consensus.cc:2468] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 6.
I20260709 13:06:15.585521 16354 raft_consensus.cc:2410] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:06:15.586674 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:15.587759 16357 raft_consensus.cc:2393] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 6: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:06:15.588213 18376 leader_election.cc:290] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:15.588959 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:15.589762 16357 raft_consensus.cc:3060] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:15.591141 18419 leader_election.cc:290] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:15.591988 18370 raft_consensus.cc:2749] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:15.593204 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:15.593669 18458 raft_consensus.cc:2749] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:15.594026 16320 leader_election.cc:304] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:15.595956 18396 consensus_queue.cc:1048] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:15.597632 16352 raft_consensus.cc:2468] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 6.
I20260709 13:06:15.585669 16355 raft_consensus.cc:2468] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 5.
I20260709 13:06:15.600467 18370 raft_consensus.cc:2749] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:15.601657 16203 raft_consensus.cc:2393] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 4: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:06:15.598918 16352 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41830 (request call id 1448) took 1898 ms. Trace:
I20260709 13:06:15.599465 16355 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41830 (request call id 1462) took 1057 ms. Trace:
I20260709 13:06:15.585793 16356 raft_consensus.cc:2468] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 5.
I20260709 13:06:15.608124 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:15.602947 16352 rpcz_store.cc:276] 0709 13:06:13.702180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:15.401492 (+1699312us) service_pool.cc:224] Handling call
0709 13:06:15.598861 (+197369us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:15.600874 16276 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45210 (request call id 1389) took 1975 ms (client timeout 2187 ms). Trace:
I20260709 13:06:15.603744 16355 rpcz_store.cc:276] 0709 13:06:14.552007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:15.378190 (+826183us) service_pool.cc:224] Handling call
0709 13:06:15.599415 (+221225us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:15.610064 16276 rpcz_store.cc:269] 0709 13:06:13.625103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:13.625221 (+   118us) service_pool.cc:224] Handling call
0709 13:06:15.600462 (+1975241us) spinlock_profiling.cc:243] Waited 884 ms on lock 0x7b54001a8bd4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:06:15.600685 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2034023680}
I20260709 13:06:15.627544 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:15.629186 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:15.537626 18295 raft_consensus.cc:515] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:15.632541 16208 raft_consensus.cc:2468] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 6.
I20260709 13:06:15.634083 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:15.636089 16352 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41830 (request call id 1466) took 1083 ms. Trace:
I20260709 13:06:15.636540 16352 rpcz_store.cc:276] 0709 13:06:14.552763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:15.609835 (+1057072us) service_pool.cc:224] Handling call
0709 13:06:15.636021 (+ 26186us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:15.637749 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:15.638844 16352 raft_consensus.cc:2468] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 4.
I20260709 13:06:15.639900 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:15.642089 18292 raft_consensus.cc:3055] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:15.642665 18292 raft_consensus.cc:740] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:06:15.643841 18292 consensus_queue.cc:260] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:06:15.645684 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 51798.8us
I20260709 13:06:15.647593 18377 raft_consensus.cc:493] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:15.648309 18453 log.cc:927] Time spent T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63: Append to log took a long time: real 1.286s	user 0.010s	sys 0.008s
I20260709 13:06:15.648521 18377 raft_consensus.cc:515] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:15.651441 16944 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35122 (request call id 371) took 1825 ms. Trace:
I20260709 13:06:15.652454 18376 raft_consensus.cc:493] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:15.653385 18376 raft_consensus.cc:515] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:15.547386 18250 consensus_queue.cc:260] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:15.654749 18377 leader_election.cc:290] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:15.654847 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:15.655937 16356 raft_consensus.cc:3060] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:15.656112 16320 leader_election.cc:304] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:15.656432 18250 raft_consensus.cc:3060] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:15.656365 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:15.658756 16943 raft_consensus.cc:1275] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:15.659617 16943 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35106 (request call id 522) took 1411 ms. Trace:
I20260709 13:06:15.659751 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:15.660406 16208 raft_consensus.cc:2468] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 4.
I20260709 13:06:15.662011 16353 raft_consensus.cc:1275] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:06:15.662791 16353 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41832 (request call id 1445) took 1973 ms. Trace:
I20260709 13:06:15.663406 16353 rpcz_store.cc:276] 0709 13:06:13.688995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:15.661037 (+1972042us) service_pool.cc:224] Handling call
0709 13:06:15.661522 (+   485us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:15.662438 (+   916us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:15.662693 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:15.652103 16944 rpcz_store.cc:276] 0709 13:06:13.825930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:13.860382 (+ 34452us) service_pool.cc:224] Handling call
0709 13:06:13.929938 (+ 69556us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:13.978751 (+ 48813us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:13.981846 (+  3095us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:14.076344 (+ 94498us) log.cc:844] Serialized 26 byte log entry
0709 13:06:14.363247 (+286903us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:14.363316 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:14.363429 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:15.647051 (+1283622us) spinlock_profiling.cc:243] Waited 10.4 ms on lock 0x7b4400022b4c. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361c224db1 00007f361c2c2c85 00007f361c2c36a2 00007f361f0351db 00007f361f030aaf 00007f361f02486e 00007f361f023bb6 00007f361f0237d8 00007f361f02d221 00007f361f02d1d9 00007f361f02d169
0709 13:06:15.650660 (+  3609us) raft_consensus.cc:1685] finished
0709 13:06:15.650695 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:15.651144 (+   449us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3963,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":6091,"spinlock_wait_cycles":23864576,"thread_start_us":286396,"threads_started":1,"wal-append.queue_time_us":285221}
I20260709 13:06:15.665267 16353 raft_consensus.cc:1240] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:06:15.665956 16353 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41832 (request call id 1447) took 1976 ms. Trace:
I20260709 13:06:15.662699 18288 raft_consensus.cc:2804] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:15.667016 18288 raft_consensus.cc:493] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:15.667418 18288 raft_consensus.cc:3060] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:15.667871 18376 leader_election.cc:290] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:15.669885 16200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60154 (request call id 1386) took 1533 ms. Trace:
I20260709 13:06:15.670320 16200 rpcz_store.cc:276] 0709 13:06:14.136169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:14.540680 (+404511us) service_pool.cc:224] Handling call
0709 13:06:14.557084 (+ 16404us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:14.683464 (+126380us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:15.669414 (+985950us) spinlock_profiling.cc:243] Waited 125 ms on lock 0x7b54000b40d4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f489e01 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6
0709 13:06:15.669693 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":288011520}
I20260709 13:06:15.671356 16277 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45218 (request call id 1515) took 1132 ms. Trace:
I20260709 13:06:15.671751 16277 rpcz_store.cc:276] 0709 13:06:14.539271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:14.540809 (+  1538us) service_pool.cc:224] Handling call
0709 13:06:14.654179 (+113370us) spinlock_profiling.cc:243] Waited 1.18 ms on lock 0x7b58001a8298. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361c224db1 00007f361c364b71 00007f361c364a22 00007f362527dc09 00007f36243d7ee0 00007f36244a10ab 00007f36244a1131 00007f3624462fc0 00007f362444d929 00007f362444d3d2 00007f361d9c4bd4
0709 13:06:14.654481 (+   302us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:15.268835 (+614354us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:15.671093 (+402258us) spinlock_profiling.cc:243] Waited 612 ms on lock 0x7b54003377d4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f489e01 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6
0709 13:06:15.671303 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1410992768}
W20260709 13:06:15.674506 18439 log.cc:927] Time spent T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63: Append to log took a long time: real 1.172s	user 0.005s	sys 0.001s
I20260709 13:06:15.663026 16275 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45218 (request call id 1514) took 1124 ms. Trace:
I20260709 13:06:15.677537 16202 raft_consensus.cc:3060] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:15.677205 16275 rpcz_store.cc:276] 0709 13:06:14.538977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:14.541138 (+  2161us) service_pool.cc:224] Handling call
0709 13:06:14.591674 (+ 50536us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:15.575011 (+983337us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:15.575061 (+    50us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:15.575103 (+    42us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:15.575132 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:15.662639 (+ 87507us) spinlock_profiling.cc:243] Waited 983 ms on lock 0x7b540031d154. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f489e01 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6
0709 13:06:15.662683 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:15.662850 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2259986176}
I20260709 13:06:15.658887 18292 raft_consensus.cc:3060] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:15.681401 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:15.682574 18275 raft_consensus.cc:3055] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:15.682797 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:15.683025 18275 raft_consensus.cc:740] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:06:15.684088 18275 consensus_queue.cc:260] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:15.635357 16351 raft_consensus.cc:2468] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 6.
I20260709 13:06:15.666282 16353 rpcz_store.cc:276] 0709 13:06:13.689837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:15.664474 (+1974637us) service_pool.cc:224] Handling call
0709 13:06:15.664910 (+   436us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:15.665680 (+   770us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:15.665898 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:15.685118 18275 raft_consensus.cc:3060] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:15.694758 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:15.695215 16351 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41830 (request call id 1465) took 1140 ms. Trace:
I20260709 13:06:15.696848 16351 rpcz_store.cc:276] 0709 13:06:14.552605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:15.409034 (+856429us) service_pool.cc:224] Handling call
0709 13:06:15.692797 (+283763us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:15.697371 16350 raft_consensus.cc:2468] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 7.
I20260709 13:06:15.698262 16350 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41830 (request call id 1446) took 1998 ms. Trace:
I20260709 13:06:15.698709 16350 rpcz_store.cc:276] 0709 13:06:13.700169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:15.539536 (+1839367us) service_pool.cc:224] Handling call
0709 13:06:15.698185 (+158649us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:15.693766 18264 raft_consensus.cc:2764] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:06:15.706918 16355 raft_consensus.cc:2468] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 5.
I20260709 13:06:15.712057 18297 consensus_queue.cc:237] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:15.713462 16207 pending_rounds.cc:85] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f: Aborting all ops after (but not including) 4
I20260709 13:06:15.713874 16207 pending_rounds.cc:107] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 13:06:15.714203 16207 raft_consensus.cc:2889] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:15.660013 16943 rpcz_store.cc:276] 0709 13:06:14.248523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:14.253409 (+  4886us) service_pool.cc:224] Handling call
0709 13:06:15.657786 (+1404377us) spinlock_profiling.cc:243] Waited 5.59 ms on lock 0x7b58001a3d98. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361c224db1 00007f361c364b71 00007f361c364eee 0000000000375939 00007f36243d81e0 00007f36244a10c4 00007f36244a1131 00007f3624462fc0 00007f362444d929 00007f362444d3d2 00007f361d9c4bd4
0709 13:06:15.658061 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:15.659339 (+  1278us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:15.659547 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12866304}
I20260709 13:06:15.716591 18061 raft_consensus.cc:493] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:15.717372 18061 raft_consensus.cc:515] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:15.707021 18419 raft_consensus.cc:493] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:15.719281 16280 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45218 (request call id 1513) took 1180 ms. Trace:
I20260709 13:06:15.719939 16280 rpcz_store.cc:276] 0709 13:06:14.538656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:14.539926 (+  1270us) service_pool.cc:224] Handling call
0709 13:06:14.540309 (+   383us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:14.540750 (+   441us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:14.540803 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:15.358508 (+817705us) spinlock_profiling.cc:243] Waited 7.9 ms on lock 0x7b2c0000ffe8. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361dd82a11 00007f361dd92372 00007f361f4c4a01 00007f361f48943a 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2
0709 13:06:15.410054 (+ 51546us) log.cc:844] Serialized 26 byte log entry
0709 13:06:15.531921 (+121867us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:15.536508 (+  4587us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:15.547691 (+ 11183us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:15.718632 (+170941us) raft_consensus.cc:1685] finished
0709 13:06:15.718661 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:15.719036 (+   375us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9436,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":13306,"spinlock_wait_cycles":18173312,"thread_start_us":119780,"threads_started":1,"wal-append.queue_time_us":300844}
I20260709 13:06:15.722276 18419 raft_consensus.cc:515] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:15.726362 16357 raft_consensus.cc:2468] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 4.
I20260709 13:06:15.726732 16356 raft_consensus.cc:2468] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 7.
I20260709 13:06:15.727844 16352 raft_consensus.cc:1240] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:15.734247 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
W20260709 13:06:15.736397 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 174014us
I20260709 13:06:15.725404 18419 leader_election.cc:290] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:15.735189 16199 raft_consensus.cc:1240] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:15.724763 18418 raft_consensus.cc:515] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:06:15.746157 16914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:15.755097 16246 leader_election.cc:304] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:15.760162 16350 raft_consensus.cc:1240] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:15.710248 18370 raft_consensus.cc:493] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:15.762817 16350 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41832 (request call id 1463) took 1269 ms. Trace:
I20260709 13:06:15.763242 16350 rpcz_store.cc:276] 0709 13:06:14.491863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:15.703920 (+1212057us) service_pool.cc:224] Handling call
0709 13:06:15.737767 (+ 33847us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:15.760788 (+ 23021us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:15.761064 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:15.769634 16915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:15.769743 16357 raft_consensus.cc:1275] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:15.771948 16357 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41830 (request call id 1459) took 1230 ms. Trace:
I20260709 13:06:15.772357 16357 rpcz_store.cc:276] 0709 13:06:14.541754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:15.736209 (+1194455us) service_pool.cc:224] Handling call
0709 13:06:15.763115 (+ 26906us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:15.771593 (+  8478us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:15.771876 (+   283us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:15.774721 16351 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33486 (request call id 178) took 1947 ms. Trace:
I20260709 13:06:15.775198 16351 rpcz_store.cc:276] 0709 13:06:13.825070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:15.702252 (+1877182us) service_pool.cc:224] Handling call
0709 13:06:15.762634 (+ 60382us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:15.771698 (+  9064us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:15.771738 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:15.771797 (+    59us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:15.771849 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:15.771928 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:15.772064 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:15.774737 16173 leader_election.cc:304] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:06:15.773079 16202 raft_consensus.cc:2468] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 5.
W20260709 13:06:15.778805 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 316871us
W20260709 13:06:15.780138 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 203340us
W20260709 13:06:15.791451 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 83810.7us
I20260709 13:06:15.793730 16355 raft_consensus.cc:1275] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:15.798144 16355 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41832 (request call id 1468) took 1305 ms. Trace:
I20260709 13:06:15.798517 16355 rpcz_store.cc:276] 0709 13:06:14.493168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:15.711861 (+1218693us) service_pool.cc:224] Handling call
0709 13:06:15.770011 (+ 58150us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:15.797900 (+ 27889us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:15.798088 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:15.791095 18458 raft_consensus.cc:2804] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:15.806203 16350 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41830 (request call id 1468) took 1215 ms. Trace:
I20260709 13:06:15.806790 16350 rpcz_store.cc:276] 0709 13:06:14.590443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:15.764237 (+1173794us) service_pool.cc:224] Handling call
0709 13:06:15.789046 (+ 24809us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:15.805812 (+ 16766us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:15.805852 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:15.805905 (+    53us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:15.805942 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:15.806004 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:15.806132 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:15.812412 16355 raft_consensus.cc:1275] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:06:15.791334 18370 raft_consensus.cc:515] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:15.821800 16246 leader_election.cc:304] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:15.828433 16356 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41830 (request call id 1467) took 1238 ms. Trace:
I20260709 13:06:15.828904 16356 rpcz_store.cc:276] 0709 13:06:14.590085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:15.736418 (+1146333us) service_pool.cc:224] Handling call
0709 13:06:15.750049 (+ 13631us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:15.750972 (+   923us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:15.751005 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:15.751526 (+   521us) log.cc:844] Serialized 26 byte log entry
0709 13:06:15.781251 (+ 29725us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:15.795935 (+ 14684us) log.cc:844] Serialized 14 byte log entry
0709 13:06:15.796239 (+   304us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:15.796333 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:15.828183 (+ 31850us) raft_consensus.cc:1685] finished
0709 13:06:15.828206 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:15.828366 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":13296,"raft.queue_time_us":889,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":4827,"spinlock_wait_cycles":6310016,"thread_start_us":29137,"threads_started":1,"wal-append.queue_time_us":40706}
I20260709 13:06:15.834735 16322 leader_election.cc:304] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:15.834990 18303 raft_consensus.cc:2804] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:15.836648 16322 leader_election.cc:304] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:15.806349 18458 raft_consensus.cc:493] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
W20260709 13:06:15.843116 16247 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:15.839202 18308 raft_consensus.cc:3060] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:15.851404 18458 raft_consensus.cc:3060] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:15.862684 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 100130us
I20260709 13:06:15.888581 16355 raft_consensus.cc:1275] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:06:15.875447 18377 raft_consensus.cc:2749] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:15.895104 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f022e2e63ae4461d834e476ff2666991" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:15.895897 16943 raft_consensus.cc:2468] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 3.
W20260709 13:06:15.896916 18487 log.cc:927] Time spent T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.067s	user 0.001s	sys 0.001s
I20260709 13:06:15.898496 16942 raft_consensus.cc:2468] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 6.
I20260709 13:06:15.895114 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:15.904453 18370 leader_election.cc:290] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:15.884398 18303 raft_consensus.cc:697] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:15.906148 18303 consensus_queue.cc:237] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:06:15.907737 16349 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41830 (request call id 1444) took 2208 ms (client timeout 1986 ms). Trace:
W20260709 13:06:15.908356 16349 rpcz_store.cc:269] 0709 13:06:13.699237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:14.155459 (+456222us) service_pool.cc:224] Handling call
0709 13:06:15.907259 (+1751800us) spinlock_profiling.cc:243] Waited 17.7 ms on lock 0x7b5400290ed4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:06:15.907479 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":40739200}
W20260709 13:06:15.911867 16281 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45218 (request call id 1517) took 1371 ms (client timeout 1811 ms). Trace:
W20260709 13:06:15.912554 16281 rpcz_store.cc:269] 0709 13:06:14.539845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:14.551756 (+ 11911us) service_pool.cc:224] Handling call
0709 13:06:15.911311 (+1359555us) spinlock_profiling.cc:243] Waited 672 ms on lock 0x7b54003368d4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:06:15.911615 (+   304us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1546116864}
I20260709 13:06:15.890156 18418 leader_election.cc:290] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:06:15.915880 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 94347.6us
I20260709 13:06:15.917526 16246 leader_election.cc:304] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:15.919013 18322 raft_consensus.cc:2804] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:15.919207 16348 raft_consensus.cc:2468] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 4.
I20260709 13:06:15.919718 18322 raft_consensus.cc:697] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:15.921049 18322 consensus_queue.cc:237] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:15.922899 18419 raft_consensus.cc:2804] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:15.923605 18419 raft_consensus.cc:697] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:15.924868 18419 consensus_queue.cc:237] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:15.927338 18040 raft_consensus.cc:2749] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:15.929510 16173 leader_election.cc:304] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:06:15.930506 18370 raft_consensus.cc:2804] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:15.931159 18370 raft_consensus.cc:493] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:15.931226 16173 leader_election.cc:304] T b9e1324823f04d8da5a4b3ddbd061c0e P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:15.931618 18370 raft_consensus.cc:3060] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:15.930013 18377 raft_consensus.cc:493] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:15.936203 18288 raft_consensus.cc:515] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:15.938154 16246 leader_election.cc:304] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:15.940821 18035 raft_consensus.cc:2749] T b9e1324823f04d8da5a4b3ddbd061c0e P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:15.941872 18434 raft_consensus.cc:2804] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:15.883136 18061 leader_election.cc:290] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:15.937435 18377 raft_consensus.cc:515] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:06:15.963869 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 127339us
I20260709 13:06:15.942399 18434 raft_consensus.cc:493] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
W20260709 13:06:15.981467 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 50365.2us
I20260709 13:06:15.975656 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:15.982882 16200 raft_consensus.cc:3060] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:15.970955 18434 raft_consensus.cc:3060] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:15.985532 16173 leader_election.cc:304] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:15.987121 16173 leader_election.cc:304] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
W20260709 13:06:15.985920 16348 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41830 (request call id 1443) took 2291 ms (client timeout 2188 ms). Trace:
W20260709 13:06:15.988601 16348 rpcz_store.cc:269] 0709 13:06:13.698022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:14.673915 (+975893us) service_pool.cc:224] Handling call
0709 13:06:15.985651 (+1311736us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b54002576d4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:06:15.985838 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2838453504}
I20260709 13:06:15.990483 18183 raft_consensus.cc:2749] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:15.991386 18183 raft_consensus.cc:2764] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Leader election decision vote started in defunct term 5: won
I20260709 13:06:15.991873 16246 leader_election.cc:304] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:15.992820 16173 leader_election.cc:304] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:06:15.993719 18183 raft_consensus.cc:2804] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:15.994125 18183 raft_consensus.cc:493] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:15.994205 18418 raft_consensus.cc:2804] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:15.994617 18183 raft_consensus.cc:3060] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:15.995003 18418 raft_consensus.cc:697] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:15.996304 18418 consensus_queue.cc:237] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:15.997668 16353 raft_consensus.cc:1275] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:15.999473 16353 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41832 (request call id 1460) took 2305 ms. Trace:
I20260709 13:06:16.004563 16352 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41832 (request call id 1444) took 2315 ms. Trace:
I20260709 13:06:16.005035 16352 rpcz_store.cc:276] 0709 13:06:13.688683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:15.641134 (+1952451us) service_pool.cc:224] Handling call
0709 13:06:15.727613 (+ 86479us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:15.728357 (+   744us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:16.004343 (+275986us) spinlock_profiling.cc:243] Waited 63.5 ms on lock 0x7b540026a550. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f4888ad 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:06:16.004504 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":145984384}
I20260709 13:06:16.008075 16940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:16.009853 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:15.999845 16353 rpcz_store.cc:276] 0709 13:06:13.694303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:15.702298 (+2007995us) service_pool.cc:224] Handling call
0709 13:06:15.997268 (+294970us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:15.998058 (+   790us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:15.999212 (+  1154us) spinlock_profiling.cc:243] Waited 282 ms on lock 0x7b54002576d0. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f4888ad 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:06:15.999378 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":649035520}
I20260709 13:06:16.009948 18334 leader_election.cc:290] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:16.013782 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:16.015897 16278 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45210 (request call id 1407) took 1428 ms. Trace:
I20260709 13:06:16.015748 16322 leader_election.cc:304] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:06:16.016453 16278 rpcz_store.cc:276] 0709 13:06:14.587968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:14.682055 (+ 94087us) service_pool.cc:224] Handling call
0709 13:06:16.015655 (+1333600us) spinlock_profiling.cc:243] Waited 86.7 ms on lock 0x7b54000ac8d4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:06:16.015829 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":199399168}
I20260709 13:06:16.018083 18288 leader_election.cc:290] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:06:16.024461 16174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:16.028904 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f022e2e63ae4461d834e476ff2666991" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:16.030647 16944 raft_consensus.cc:2468] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 3.
I20260709 13:06:16.032286 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:16.033530 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:16.034224 16357 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41830 (request call id 1469) took 1424 ms. Trace:
I20260709 13:06:16.034922 16357 rpcz_store.cc:276] 0709 13:06:14.590838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:15.773988 (+1183150us) service_pool.cc:224] Handling call
0709 13:06:15.784103 (+ 10115us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:15.810283 (+ 26180us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:15.810315 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:15.828412 (+ 18097us) log.cc:844] Serialized 26 byte log entry
0709 13:06:15.976457 (+148045us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:16.014805 (+ 38348us) log.cc:844] Serialized 14 byte log entry
0709 13:06:16.015082 (+   277us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:16.015185 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:16.015250 (+    65us) raft_consensus.cc:1685] finished
0709 13:06:16.015268 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:16.015434 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":42556,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":58,"raft.queue_time_us":13496,"raft.run_cpu_time_us":228,"raft.run_wall_time_us":1714,"thread_start_us":108203,"threads_started":1,"wal-append.queue_time_us":135265}
I20260709 13:06:16.044559 18288 raft_consensus.cc:2749] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:16.046990 18493 raft_consensus.cc:493] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:16.047931 18493 raft_consensus.cc:515] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:06:16.048228 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 67146.4us
I20260709 13:06:16.051932 16322 leader_election.cc:304] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:16.053414 18496 raft_consensus.cc:2749] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:16.010325 18377 leader_election.cc:290] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:16.057622 18458 raft_consensus.cc:515] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:16.059995 16322 leader_election.cc:304] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:06:16.060142 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 47700.3us
I20260709 13:06:16.066143 18377 raft_consensus.cc:2804] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:06:16.071352 16915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:16.071961 18377 raft_consensus.cc:697] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 5 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:06:16.071841 16322 leader_election.cc:304] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:16.068969 18493 leader_election.cc:290] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:16.134898 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c15d8e9be8414c84912ab77b66bfb1" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:06:16.150709 16249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:16.073096 18377 consensus_queue.cc:237] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:06:16.163441 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 46923.6us
W20260709 13:06:16.162276 18489 log.cc:927] Time spent T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
W20260709 13:06:16.177049 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 110576us
W20260709 13:06:16.171734 18384 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.725s	user 0.014s	sys 0.050s
I20260709 13:06:16.166687 18495 raft_consensus.cc:2764] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:06:16.181159 18330 raft_consensus.cc:493] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:16.185065 18434 raft_consensus.cc:515] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:16.178915 16248 leader_election.cc:304] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:16.202412 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:16.203357 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:16.203845 16940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:16.207944 16940 raft_consensus.cc:2468] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 4.
I20260709 13:06:16.207705 18330 raft_consensus.cc:515] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:16.213089 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:16.186503 18458 leader_election.cc:290] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:16.213912 16282 raft_consensus.cc:2468] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 3.
I20260709 13:06:16.202937 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:16.223991 16282 raft_consensus.cc:1240] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 3. Current term is 4. Ops: []
W20260709 13:06:16.180536 18384 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.795s	user 0.015s	sys 0.050s
I20260709 13:06:16.235262 16200 raft_consensus.cc:2468] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 6.
I20260709 13:06:16.237409 16320 leader_election.cc:304] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:16.246091 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:06:16.241755 16173 connection.cc:256] RPC call timeout handler was delayed by -1.7151389360000167s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18510000000000001s for a response
I20260709 13:06:16.246522 16322 leader_election.cc:304] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:16.244344 18322 raft_consensus.cc:2804] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:16.248351 18310 raft_consensus.cc:2804] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:16.245869 18427 consensus_queue.cc:1059] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:06:16.249699 18310 raft_consensus.cc:697] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [term 4 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:06:16.249698 18322 raft_consensus.cc:493] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:16.252411 18322 raft_consensus.cc:3060] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:16.253476 18434 leader_election.cc:290] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:06:16.247553 16173 connection.cc:256] RPC call timeout handler was delayed by -1.5603389359999937s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20230000000000004s for a response
W20260709 13:06:16.255402 16173 connection.cc:256] RPC call timeout handler was delayed by -1.2163978500000212s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19610000000000002s for a response
I20260709 13:06:16.256170 18035 raft_consensus.cc:493] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:16.256700 18035 raft_consensus.cc:515] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:16.259084 18035 leader_election.cc:290] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:16.259186 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
W20260709 13:06:16.262964 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 84143.5us
I20260709 13:06:16.264007 16248 leader_election.cc:304] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:16.250692 18493 raft_consensus.cc:2804] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:16.265306 18493 raft_consensus.cc:697] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 6 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:06:16.266700 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:16.190864 18370 raft_consensus.cc:515] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:16.268352 16199 raft_consensus.cc:1240] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:16.251688 18310 consensus_queue.cc:237] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:16.251621 16274 raft_consensus.cc:1275] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:06:16.272249 16276 raft_consensus.cc:1275] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:06:16.269667 18370 leader_election.cc:290] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 election: Requested vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:16.273638 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:16.274854 16353 raft_consensus.cc:1275] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:06:16.325104 18187 raft_consensus.cc:2804] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:16.325565 18187 raft_consensus.cc:493] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:16.276521 18330 leader_election.cc:290] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:16.325951 18187 raft_consensus.cc:3060] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:16.278393 16282 raft_consensus.cc:1240] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:16.247822 18458 raft_consensus.cc:493] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:16.327108 18458 raft_consensus.cc:515] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:16.328121 18322 raft_consensus.cc:515] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:16.329326 18458 leader_election.cc:290] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:16.282406 18295 leader_election.cc:290] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:16.266368 18493 consensus_queue.cc:237] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:06:16.286186 18490 log.cc:927] Time spent T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.390s	user 0.001s	sys 0.007s
I20260709 13:06:16.287499 18183 raft_consensus.cc:515] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:16.287983 16354 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41832 (request call id 1464) took 1795 ms. Trace:
W20260709 13:06:16.291841 16103 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55244 (request call id 121) took 14702 ms (client timeout 15000 ms). Trace:
I20260709 13:06:16.297689 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:16.299899 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:16.308604 16276 raft_consensus.cc:1240] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:16.309703 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:16.390987 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:16.312381 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:16.316680 16173 leader_election.cc:304] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:16.323168 18427 raft_consensus.cc:3055] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:06:16.324394 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 60532.4us
I20260709 13:06:16.356981 16354 rpcz_store.cc:276] 0709 13:06:14.492110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:15.556260 (+1064150us) service_pool.cc:224] Handling call
0709 13:06:16.287715 (+731455us) spinlock_profiling.cc:243] Waited 27.8 ms on lock 0x7b5400194e54. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:06:16.287906 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":64048512}
I20260709 13:06:16.330451 18322 leader_election.cc:290] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:16.414366 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:16.311401 16206 raft_consensus.cc:1275] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:16.391187 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:16.416432 16248 leader_election.cc:304] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:16.427353 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:16.430671 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:16.432680 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:16.433145 16202 raft_consensus.cc:1275] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:06:16.440547 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:16.441609 16282 raft_consensus.cc:1275] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:16.442487 16202 raft_consensus.cc:1275] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:06:16.419477 18458 raft_consensus.cc:3060] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:16.446838 16351 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41830 (request call id 1470) took 1838 ms. Trace:
I20260709 13:06:16.449972 16351 rpcz_store.cc:276] 0709 13:06:14.600899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:15.779922 (+1179023us) service_pool.cc:224] Handling call
0709 13:06:15.802677 (+ 22755us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:15.861707 (+ 59030us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:15.861753 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:15.943298 (+ 81545us) log.cc:844] Serialized 26 byte log entry
0709 13:06:16.115211 (+171913us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:16.167046 (+ 51835us) log.cc:844] Serialized 14 byte log entry
0709 13:06:16.167281 (+   235us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:16.167362 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:16.438683 (+271321us) raft_consensus.cc:1685] finished
0709 13:06:16.438706 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:16.438833 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2115,"prepare.queue_time_us":58106,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":34,"raft.queue_time_us":21227,"raft.run_cpu_time_us":296,"raft.run_wall_time_us":10275,"thread_start_us":188938,"threads_started":2,"wal-append.queue_time_us":359102}
I20260709 13:06:16.446348 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:16.413873 18427 raft_consensus.cc:740] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:16.449059 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:16.446280 16203 raft_consensus.cc:3060] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:16.454644 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 138048us
I20260709 13:06:16.456576 16200 raft_consensus.cc:1240] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:16.458420 16206 raft_consensus.cc:1240] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 5. Current term is 6. Ops: []
W20260709 13:06:16.465518 16174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:16.450050 18419 raft_consensus.cc:1064] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3: attempting to promote NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 to VOTER
I20260709 13:06:16.462148 16205 raft_consensus.cc:2468] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 5.
I20260709 13:06:16.440483 18322 raft_consensus.cc:2749] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:06:16.475266 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 58931.4us
I20260709 13:06:16.473672 16204 raft_consensus.cc:1275] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:06:16.484593 16248 leader_election.cc:304] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:16.489319 18322 raft_consensus.cc:2804] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:16.489943 18322 raft_consensus.cc:493] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:16.490355 18322 raft_consensus.cc:3060] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:16.486063 16248 leader_election.cc:304] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:16.490945 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:16.493711 18035 consensus_queue.cc:1048] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:16.468523 16940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:16.497342 16173 leader_election.cc:304] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:16.499511 16274 raft_consensus.cc:1275] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:06:16.474152 18183 leader_election.cc:290] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:16.520787 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:16.498772 18303 raft_consensus.cc:2749] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:16.527087 16274 raft_consensus.cc:1275] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 13:06:16.502374 18370 raft_consensus.cc:2804] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:16.490365 18336 consensus_queue.cc:1059] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:06:16.535871 18217 consensus_queue.cc:1048] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:16.538640 18308 consensus_queue.cc:1048] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:16.539893 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:16.527544 16274 pending_rounds.cc:85] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3: Aborting all ops after (but not including) 4
I20260709 13:06:16.563095 16274 pending_rounds.cc:107] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 13:06:16.563880 16274 raft_consensus.cc:2889] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:16.538456 16275 raft_consensus.cc:1240] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:16.460145 18427 consensus_queue.cc:260] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:16.572496 16280 raft_consensus.cc:2468] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 5.
I20260709 13:06:16.566511 16248 leader_election.cc:304] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:06:16.542606 18370 raft_consensus.cc:493] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
W20260709 13:06:16.356675 16103 rpcz_store.cc:269] 0709 13:06:01.589165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:01.599016 (+  9851us) service_pool.cc:224] Handling call
0709 13:06:16.291575 (+14692559us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:12.919702 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:12.955582 (+ 35880us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:12.955622 (+    40us) write_op.cc:435] Acquired schema lock
0709 13:06:12.955643 (+    21us) tablet.cc:662] Decoding operations
0709 13:06:13.067537 (+111894us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:13.086994 (+ 19457us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:13.089900 (+  2906us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:06:13.116770 (+ 26870us) tablet.cc:701] Row locks acquired
0709 13:06:13.116806 (+    36us) write_op.cc:260] PREPARE: finished
0709 13:06:13.116990 (+   184us) write_op.cc:270] Start()
0709 13:06:13.117131 (+   141us) write_op.cc:276] Timestamp: P: 1783602373116934 usec, L: 0
0709 13:06:13.117165 (+    34us) op_driver.cc:348] REPLICATION: starting
0709 13:06:13.118017 (+   852us) log.cc:844] Serialized 2452 byte log entry
0709 13:06:14.385813 (+1267796us) op_driver.cc:464] REPLICATION: finished
0709 13:06:15.111986 (+726173us) write_op.cc:301] APPLY: starting
0709 13:06:15.112082 (+    96us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:15.112279 (+   197us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:15.112431 (+   152us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:15.139526 (+ 27095us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:15.174533 (+ 35007us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 13:06:15.179135 (+  4602us) write_op.cc:312] APPLY: finished
0709 13:06:15.189283 (+ 10148us) log.cc:844] Serialized 53 byte log entry
0709 13:06:15.189520 (+   237us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:15.189679 (+   159us) write_op.cc:454] Released schema lock
0709 13:06:15.189753 (+    74us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:15.190207 (+   454us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:15.190246 (+    39us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1667748,"reported_tablets":13,"child_traces":[["op",{"apply.queue_time_us":722294,"apply.run_cpu_time_us":4049,"apply.run_wall_time_us":78156,"num_ops":6,"prepare.queue_time_us":240564,"prepare.run_cpu_time_us":21183,"prepare.run_wall_time_us":268737,"raft.queue_time_us":456261,"raft.run_cpu_time_us":52143,"raft.run_wall_time_us":741419,"replication_time_us":1247219,"thread_start_us":1321134,"threads_started":4,"wal-append.queue_time_us":164928,"wal-append.run_cpu_time_us":42053,"wal-append.run_wall_time_us":2905485}]]}
I20260709 13:06:16.561177 18061 consensus_queue.cc:1059] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.038s
I20260709 13:06:16.574337 18035 consensus_queue.cc:1059] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 5.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 13:06:16.588717 18370 raft_consensus.cc:3060] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:16.561542 18418 consensus_queue.cc:1059] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 13:06:16.572724 18303 consensus_queue.cc:1048] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
W20260709 13:06:16.615732 18505 log.cc:927] Time spent T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
I20260709 13:06:16.615857 16173 leader_election.cc:304] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:16.596293 18187 raft_consensus.cc:515] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:16.614101 16940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:16.617822 16940 raft_consensus.cc:2393] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 4: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
I20260709 13:06:16.618636 18187 leader_election.cc:290] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:16.619736 18419 consensus_queue.cc:237] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 3, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:16.624567 16206 raft_consensus.cc:3055] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:16.625065 16206 raft_consensus.cc:740] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:16.625836 16206 consensus_queue.cc:260] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:16.620702 15057 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:16.614573 18427 raft_consensus.cc:3060] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:16.613899 18380 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.854s	user 0.000s	sys 0.038s
I20260709 13:06:16.667057 16203 raft_consensus.cc:2468] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 5.
W20260709 13:06:16.676967 16915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:16.679395 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 125229us
I20260709 13:06:16.683907 16914 leader_election.cc:304] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:06:16.684814 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:16.628572 18297 raft_consensus.cc:493] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:16.685734 16949 raft_consensus.cc:2410] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for term 6 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:06:16.695907 16206 raft_consensus.cc:3060] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:16.680135 18380 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.039s	user 0.000s	sys 0.039s
W20260709 13:06:16.698936 16246 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:16.699281 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 83493.8us
W20260709 13:06:16.707485 16974 heartbeater.cc:646] Failed to heartbeat to 127.14.180.126:35965 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.14.180.126:35965 timed out after 15.000s (SENT)
W20260709 13:06:16.711102 18509 log.cc:927] Time spent T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 13:06:16.712173 16206 raft_consensus.cc:1275] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:06:16.712568 16206 pending_rounds.cc:85] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f: Aborting all ops after (but not including) 2
I20260709 13:06:16.712822 16206 pending_rounds.cc:107] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:06:16.713081 16206 raft_consensus.cc:2889] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:16.646920 18322 raft_consensus.cc:515] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:16.716534 18322 leader_election.cc:290] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:16.698853 18292 consensus_queue.cc:1059] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 13:06:16.719811 18292 raft_consensus.cc:3055] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:16.720180 18292 raft_consensus.cc:740] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:06:16.721046 18292 consensus_queue.cc:260] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:16.722218 18292 raft_consensus.cc:3060] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:16.685412 16940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:16.724228 18297 raft_consensus.cc:515] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:16.707337 18330 raft_consensus.cc:2804] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:16.729101 18330 raft_consensus.cc:493] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:16.729561 18330 raft_consensus.cc:3060] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:16.738065 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:16.738804 16949 raft_consensus.cc:2468] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 5.
I20260709 13:06:16.739382 16206 raft_consensus.cc:3055] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:16.739840 16206 raft_consensus.cc:740] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:16.745491 18520 raft_consensus.cc:2804] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:16.746052 18520 raft_consensus.cc:493] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:16.746428 18520 raft_consensus.cc:3060] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:16.734762 18297 leader_election.cc:290] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:16.762604 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:16.764386 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:16.765283 16350 raft_consensus.cc:2468] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 4.
I20260709 13:06:16.762212 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:16.741302 16940 raft_consensus.cc:2468] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 2.
I20260709 13:06:16.754024 18334 raft_consensus.cc:2804] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:16.770879 16354 raft_consensus.cc:1240] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 5 LEADER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:16.776003 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:16.778360 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:16.777570 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:16.761164 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:16.786154 16320 leader_election.cc:304] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:16.788559 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:16.788801 16206 consensus_queue.cc:260] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:16.789371 16352 raft_consensus.cc:2468] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 4.
I20260709 13:06:16.770828 18217 raft_consensus.cc:3055] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:16.796030 16350 raft_consensus.cc:1240] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 3. Current term is 4. Ops: [2.2-3.3]
I20260709 13:06:16.797590 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:16.798309 16354 raft_consensus.cc:2468] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 6.
W20260709 13:06:16.793040 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 109199us
I20260709 13:06:16.802677 18297 consensus_queue.cc:1048] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:16.807279 18418 raft_consensus.cc:493] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:16.807914 18418 raft_consensus.cc:515] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:16.808761 16246 leader_election.cc:304] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:16.780268 18334 raft_consensus.cc:493] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:16.824627 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:16.825565 16354 raft_consensus.cc:2410] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:06:16.819365 16353 raft_consensus.cc:1275] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:06:16.819689 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:16.811385 18419 raft_consensus.cc:2804] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:16.823102 16206 raft_consensus.cc:3060] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:16.810490 18418 leader_election.cc:290] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:16.873780 18526 consensus_queue.cc:1048] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:06:16.795989 18514 log.cc:927] Time spent T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.228s	user 0.000s	sys 0.001s
I20260709 13:06:16.818835 16914 leader_election.cc:304] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:16.878870 16354 raft_consensus.cc:1240] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 6 LEADER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:16.881366 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:16.882417 18517 raft_consensus.cc:493] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:16.882982 18517 raft_consensus.cc:515] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:16.885234 18517 leader_election.cc:290] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:06:16.894042 18513 log.cc:927] Time spent T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.312s	user 0.000s	sys 0.001s
I20260709 13:06:16.810892 18396 raft_consensus.cc:2804] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:16.823474 18334 raft_consensus.cc:3060] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:16.810981 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:16.796384 18217 raft_consensus.cc:740] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:16.916867 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:16.818737 18288 consensus_queue.cc:1048] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.096s
I20260709 13:06:16.929088 16354 raft_consensus.cc:2393] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 4: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
W20260709 13:06:16.931391 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 176496us
W20260709 13:06:16.930529 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 111764us
W20260709 13:06:16.932885 16248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:16.812109 18303 consensus_queue.cc:1048] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.106s
I20260709 13:06:16.903542 18419 raft_consensus.cc:697] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:16.937188 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
W20260709 13:06:16.938375 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:16.941274 16202 raft_consensus.cc:2393] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 4: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:06:16.938822 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:16.939390 16201 raft_consensus.cc:1275] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:06:16.942090 16349 raft_consensus.cc:2376] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 6. Re-sending same reply.
I20260709 13:06:16.939473 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:06:16.937971 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 195921us
I20260709 13:06:16.917053 18517 raft_consensus.cc:2749] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:16.948035 16201 raft_consensus.cc:1275] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:06:16.948612 16202 raft_consensus.cc:1275] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:06:16.944096 16205 raft_consensus.cc:1240] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:16.880445 18520 raft_consensus.cc:515] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:16.810835 18519 consensus_queue.cc:1059] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.117s
I20260709 13:06:16.945147 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:16.951936 16914 leader_election.cc:304] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:16.952348 16200 raft_consensus.cc:2393] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 4: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:06:16.946862 16353 raft_consensus.cc:1275] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:16.947330 16354 raft_consensus.cc:2468] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 6.
I20260709 13:06:16.952373 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f022e2e63ae4461d834e476ff2666991" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:16.961719 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:16.916339 18396 raft_consensus.cc:493] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:16.946925 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:16.962874 16350 raft_consensus.cc:2468] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 4.
I20260709 13:06:16.915845 18330 raft_consensus.cc:515] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:16.952446 16348 raft_consensus.cc:2393] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 5: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:06:16.970788 18396 raft_consensus.cc:3060] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:16.975041 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:16.975708 16349 raft_consensus.cc:2468] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 5.
I20260709 13:06:16.975881 16356 raft_consensus.cc:1275] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:06:16.976714 18515 log.cc:927] Time spent T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.176s	user 0.000s	sys 0.001s
I20260709 13:06:16.978906 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
W20260709 13:06:16.997938 16247 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:16.998488 16247 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:17.008770 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 47479us
I20260709 13:06:17.011452 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:17.012403 16274 raft_consensus.cc:2410] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:06:17.015352 16206 raft_consensus.cc:1275] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:17.019443 16322 leader_election.cc:304] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:17.024338 18396 raft_consensus.cc:515] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:17.027091 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:17.028393 18496 raft_consensus.cc:493] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:17.029863 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:17.006855 18517 raft_consensus.cc:2749] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:17.047036 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:06:17.047276 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 46658.5us
I20260709 13:06:17.047276 16322 leader_election.cc:304] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:06:17.046795 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 94922.7us
I20260709 13:06:17.050578 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:17.051518 16276 raft_consensus.cc:2410] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for term 6 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:06:17.047915 16280 raft_consensus.cc:2468] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 3.
I20260709 13:06:17.059371 16350 raft_consensus.cc:1240] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:17.063807 16173 leader_election.cc:304] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:06:17.009987 18061 consensus_queue.cc:1048] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.047s
I20260709 13:06:17.068856 16248 leader_election.cc:304] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:17.019676 18370 raft_consensus.cc:515] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:17.075678 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:06:17.077056 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:17.078675 16276 raft_consensus.cc:2468] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 3.
W20260709 13:06:17.068856 18458 consensus_meta.cc:287] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f: Time spent flushing consensus metadata: real 0.613s	user 0.013s	sys 0.000s
I20260709 13:06:17.055181 18035 consensus_queue.cc:1048] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 13:06:17.086783 18322 raft_consensus.cc:2804] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:06:17.089359 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 280638us
I20260709 13:06:17.090807 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:17.091315 18531 consensus_queue.cc:1048] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 13:06:17.090099 18458 raft_consensus.cc:2749] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:17.065441 18250 consensus_queue.cc:1048] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 13:06:17.069881 18496 raft_consensus.cc:515] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:17.075736 18310 consensus_queue.cc:1048] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 13:06:17.088657 18493 raft_consensus.cc:2804] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:17.102058 18322 raft_consensus.cc:493] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:17.119885 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:17.147228 18493 raft_consensus.cc:493] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:17.147811 18493 raft_consensus.cc:3060] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:17.115581 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c15d8e9be8414c84912ab77b66bfb1" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:17.148180 18292 raft_consensus.cc:493] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:17.124152 18524 log.cc:927] Time spent T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
I20260709 13:06:17.148757 18292 raft_consensus.cc:515] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:17.130861 18275 raft_consensus.cc:3055] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:17.149827 18275 raft_consensus.cc:740] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
W20260709 13:06:17.133540 18529 log.cc:927] Time spent T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.158s	user 0.000s	sys 0.001s
I20260709 13:06:17.139339 16248 leader_election.cc:304] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:17.048295 18419 consensus_queue.cc:237] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:17.118291 18520 leader_election.cc:290] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:17.115334 18035 raft_consensus.cc:2749] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:17.116968 16275 raft_consensus.cc:1275] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:06:17.152293 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 135238us
I20260709 13:06:17.107672 18377 raft_consensus.cc:2749] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:17.147305 18322 raft_consensus.cc:3060] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:17.161123 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:17.163812 16282 raft_consensus.cc:2468] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 3.
I20260709 13:06:17.167634 16207 raft_consensus.cc:1240] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:17.170086 16207 raft_consensus.cc:1240] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:17.171474 16200 raft_consensus.cc:1275] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:06:17.172355 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 125033us
I20260709 13:06:17.176978 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:17.176577 16914 leader_election.cc:304] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:06:17.177726 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:17.178448 16275 raft_consensus.cc:3060] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:17.181691 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:17.179935 16283 raft_consensus.cc:2468] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 4.
I20260709 13:06:17.186726 18384 raft_consensus.cc:3055] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:17.186641 18533 consensus_queue.cc:1048] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.010s
I20260709 13:06:17.187371 18384 raft_consensus.cc:740] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
W20260709 13:06:17.187623 18510 log.cc:927] Time spent T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.616s	user 0.002s	sys 0.008s
I20260709 13:06:17.188421 18384 consensus_queue.cc:260] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:17.189729 18496 leader_election.cc:290] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:17.190194 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:17.169631 18061 raft_consensus.cc:2749] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:17.190866 16352 raft_consensus.cc:2468] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 5.
I20260709 13:06:17.190970 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:17.158861 18275 consensus_queue.cc:260] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:17.191419 18541 raft_consensus.cc:493] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:17.191848 16350 raft_consensus.cc:2393] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 in current term 3: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:06:17.192227 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:17.192162 18541 raft_consensus.cc:515] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:17.192796 18297 raft_consensus.cc:2804] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:17.193009 16348 raft_consensus.cc:2468] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 4.
I20260709 13:06:17.193293 18297 raft_consensus.cc:493] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:17.193843 18297 raft_consensus.cc:3060] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:17.194219 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:17.194862 16353 raft_consensus.cc:3060] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:17.195171 16322 leader_election.cc:304] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:17.195096 18541 leader_election.cc:290] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:17.192427 18275 raft_consensus.cc:3060] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:17.146055 18537 consensus_queue.cc:1048] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:06:17.170967 18330 leader_election.cc:290] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 6 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:17.174333 18292 leader_election.cc:290] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:17.182173 18396 leader_election.cc:290] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:06:17.211088 16915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:17.201634 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:17.218932 16204 raft_consensus.cc:3060] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:17.199234 16914 leader_election.cc:304] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
W20260709 13:06:17.213060 18536 log.cc:927] Time spent T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
W20260709 13:06:17.216080 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 152349us
I20260709 13:06:17.227057 18540 consensus_queue.cc:1048] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:17.232029 18330 raft_consensus.cc:2804] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:17.232149 18538 raft_consensus.cc:2749] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:17.232614 18330 raft_consensus.cc:493] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:17.233147 18330 raft_consensus.cc:3060] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:17.191852 18520 raft_consensus.cc:493] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:17.235980 18496 consensus_queue.cc:1059] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 13:06:17.240422 16275 raft_consensus.cc:2468] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 6.
I20260709 13:06:17.237525 16173 leader_election.cc:304] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:17.247876 16105 catalog_manager.cc:5697] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e reported cstate change: term changed from 3 to 4, leader changed from e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) to 363bb2f744eb486f9ad726f08214c98e (127.14.180.67). New cstate: current_term: 4 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:17.249310 18334 raft_consensus.cc:515] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:17.241681 16322 leader_election.cc:304] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:17.250393 16105 catalog_manager.cc:5697] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e reported cstate change: term changed from 1 to 3, leader changed from e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) to 363bb2f744eb486f9ad726f08214c98e (127.14.180.67). New cstate: current_term: 3 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:17.252456 16173 leader_election.cc:304] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:06:17.257052 18537 raft_consensus.cc:2804] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:17.257566 18537 raft_consensus.cc:493] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:17.257807 18370 leader_election.cc:290] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:17.258040 18537 raft_consensus.cc:3060] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:17.257810 18520 raft_consensus.cc:515] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:17.260982 18520 leader_election.cc:290] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:17.240191 18377 consensus_queue.cc:1059] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 13:06:17.273587 18322 raft_consensus.cc:515] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:17.276417 18183 raft_consensus.cc:3055] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:17.276172 18493 raft_consensus.cc:515] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:17.277803 18377 raft_consensus.cc:2749] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:17.278363 18334 leader_election.cc:290] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 election: Requested vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:17.280287 16173 leader_election.cc:304] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:17.285493 18520 raft_consensus.cc:2804] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:17.285827 16322 leader_election.cc:304] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:06:17.286096 18520 raft_consensus.cc:493] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:17.288712 16353 raft_consensus.cc:2468] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 6.
I20260709 13:06:17.312813 18520 raft_consensus.cc:3060] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:17.286904 18541 raft_consensus.cc:3055] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:17.315409 18541 raft_consensus.cc:740] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:06:17.316321 18322 leader_election.cc:290] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:17.282974 18183 raft_consensus.cc:740] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:17.317165 18377 raft_consensus.cc:493] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:17.317997 18496 raft_consensus.cc:2749] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:17.317703 18183 consensus_queue.cc:260] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:17.282707 18526 raft_consensus.cc:2749] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:17.317848 18377 raft_consensus.cc:515] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:17.317746 16322 leader_election.cc:304] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:06:17.311249 16173 leader_election.cc:304] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
W20260709 13:06:17.321337 16246 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:17.322000 16915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:17.320761 16914 leader_election.cc:304] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:06:17.325518 16322 leader_election.cc:304] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:17.338482 16322 leader_election.cc:304] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:06:17.339854 16322 leader_election.cc:304] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:06:17.340996 18288 raft_consensus.cc:2749] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:17.341104 16322 leader_election.cc:304] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:17.342228 18288 raft_consensus.cc:2804] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:17.342758 18288 raft_consensus.cc:493] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:17.343283 18288 raft_consensus.cc:3060] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:17.342986 18538 raft_consensus.cc:2804] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:17.343992 18538 raft_consensus.cc:493] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:17.344633 18538 raft_consensus.cc:3060] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:17.349948 16322 leader_election.cc:304] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:17.328042 18540 raft_consensus.cc:3060] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:17.363155 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 52015.8us
I20260709 13:06:17.364202 16173 leader_election.cc:304] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:06:17.379778 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:17.380190 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:17.381489 16276 raft_consensus.cc:2468] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 4.
I20260709 13:06:17.383359 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:17.384197 16274 raft_consensus.cc:2468] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 4.
I20260709 13:06:17.385689 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:17.287606 18396 raft_consensus.cc:493] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:17.393815 16204 raft_consensus.cc:2468] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 6.
W20260709 13:06:17.394686 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 69889.6us
I20260709 13:06:17.395567 16248 leader_election.cc:304] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:17.334075 18183 raft_consensus.cc:3060] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:17.337361 18496 raft_consensus.cc:493] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:17.398125 16283 raft_consensus.cc:1240] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:06:17.400341 16280 raft_consensus.cc:1240] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 LEADER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:17.334890 18295 raft_consensus.cc:2749] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:17.402240 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:17.400704 16940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:17.407419 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
W20260709 13:06:17.408042 18545 log.cc:927] Time spent T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:06:17.402493 18396 raft_consensus.cc:515] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:17.440562 18493 leader_election.cc:290] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:17.441385 18493 raft_consensus.cc:2749] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:17.441524 18396 leader_election.cc:290] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:17.390868 18297 raft_consensus.cc:515] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:17.410966 16945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:06:17.444240 18297 leader_election.cc:290] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 3 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:17.412246 18520 raft_consensus.cc:515] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:17.423672 18187 raft_consensus.cc:3055] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:17.446275 18537 raft_consensus.cc:515] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:17.446856 18187 raft_consensus.cc:740] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:17.447479 18520 leader_election.cc:290] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 election: Requested vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:17.362669 18541 consensus_queue.cc:260] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:17.447922 18187 consensus_queue.cc:260] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:17.414757 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:17.415284 16248 leader_election.cc:304] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:17.409770 18288 raft_consensus.cc:515] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:17.449148 18187 raft_consensus.cc:3060] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:17.451133 18377 leader_election.cc:290] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:17.451809 18377 raft_consensus.cc:493] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:17.452412 18377 raft_consensus.cc:515] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:17.431825 18496 raft_consensus.cc:515] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:17.454232 18288 leader_election.cc:290] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:17.456076 18496 leader_election.cc:290] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:17.416688 18547 raft_consensus.cc:2749] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:17.418934 18322 raft_consensus.cc:2749] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:17.416038 16277 raft_consensus.cc:1240] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 13:06:17.390616 18526 raft_consensus.cc:2749] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:17.414265 18217 consensus_queue.cc:260] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:17.422856 16279 raft_consensus.cc:1240] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:17.440562 16283 raft_consensus.cc:1240] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:06:17.448596 18541 raft_consensus.cc:3060] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:17.431028 16275 raft_consensus.cc:3060] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:17.456476 18538 raft_consensus.cc:515] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:06:17.464185 16174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:17.471381 16945 raft_consensus.cc:2468] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 4.
I20260709 13:06:17.398624 18405 raft_consensus.cc:2804] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:06:17.481307 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 131443us
I20260709 13:06:17.445834 18330 raft_consensus.cc:515] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:17.474718 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:17.477052 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:17.488994 16202 raft_consensus.cc:2468] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 4.
I20260709 13:06:17.503600 16201 raft_consensus.cc:1240] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 5. Current term is 6. Ops: []
W20260709 13:06:17.510300 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 95096.4us
I20260709 13:06:17.523686 16248 leader_election.cc:304] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:06:17.525645 16208 raft_consensus.cc:1240] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
W20260709 13:06:17.531517 16247 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:17.533248 16275 raft_consensus.cc:2468] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 6.
I20260709 13:06:17.535073 16206 raft_consensus.cc:1275] T b9e1324823f04d8da5a4b3ddbd061c0e P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:06:17.469228 18322 raft_consensus.cc:493] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:17.480387 18217 raft_consensus.cc:3060] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:17.533052 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:17.539921 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:17.542318 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:17.548130 16207 raft_consensus.cc:2468] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 4.
I20260709 13:06:17.548231 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:17.440610 16105 catalog_manager.cc:5697] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e reported cstate change: config changed from index -1 to 2, term changed from 1 to 3, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New cstate: current_term: 3 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:17.544616 16948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:06:17.508222 18419 raft_consensus.cc:2749] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:17.549556 16948 raft_consensus.cc:3060] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:17.548455 16357 raft_consensus.cc:2368] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 for earlier term 3. Current term is 4.
I20260709 13:06:17.549410 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:17.546078 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:17.555419 16354 raft_consensus.cc:3060] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:17.539036 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:17.556354 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:17.558139 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:17.558815 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:06:17.558729 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 165238us
I20260709 13:06:17.546351 16945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:17.553201 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bc3c8ff9b84838a2664335d7e1582b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:17.560444 16945 raft_consensus.cc:2393] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 5: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
I20260709 13:06:17.548175 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:17.521181 18405 raft_consensus.cc:697] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 6 LEADER]: Becoming Leader. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:06:17.562906 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:17.557467 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:17.570246 16946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:06:17.570911 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:17.571167 16206 raft_consensus.cc:1240] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:17.572106 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
W20260709 13:06:17.572455 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:17.552846 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:06:17.511885 18396 consensus_queue.cc:1048] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.049s
W20260709 13:06:17.576135 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 52541.6us
I20260709 13:06:17.547250 18537 leader_election.cc:290] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 election: Requested vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:17.578486 16207 raft_consensus.cc:1275] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:06:17.549252 18295 raft_consensus.cc:493] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:17.588784 16320 leader_election.cc:304] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:17.552717 18322 raft_consensus.cc:515] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:17.580682 18540 raft_consensus.cc:2749] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:17.580976 16945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:17.581499 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
W20260709 13:06:17.588290 16174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:17.588454 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:17.600791 16947 raft_consensus.cc:2468] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 4.
W20260709 13:06:17.600981 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:17.537061 18559 raft_consensus.cc:493] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:17.592183 16208 raft_consensus.cc:1240] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:06:17.534112 18334 consensus_queue.cc:1059] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:06:17.547711 18434 consensus_queue.cc:1048] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 13:06:17.607697 16283 raft_consensus.cc:2468] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 5.
I20260709 13:06:17.601747 18295 raft_consensus.cc:515] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:17.605427 18322 leader_election.cc:290] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:17.604938 16105 catalog_manager.cc:5697] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e reported cstate change: term changed from 1 to 3, leader changed from e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) to 363bb2f744eb486f9ad726f08214c98e (127.14.180.67). New cstate: current_term: 3 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:17.606317 18396 raft_consensus.cc:2804] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:17.550977 18418 consensus_queue.cc:1048] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 13:06:17.583153 18532 raft_consensus.cc:3055] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:17.597016 16275 raft_consensus.cc:1240] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 5. Current term is 6. Ops: [2.2-5.3]
I20260709 13:06:17.610756 16208 raft_consensus.cc:1240] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:17.602012 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:17.627768 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:17.620321 16948 raft_consensus.cc:2468] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 4.
I20260709 13:06:17.623049 16279 raft_consensus.cc:1275] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:06:17.621718 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bc3c8ff9b84838a2664335d7e1582b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:17.642599 16205 raft_consensus.cc:2468] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 5.
I20260709 13:06:17.609867 18537 raft_consensus.cc:493] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:17.648528 16320 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:17.650708 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:17.651582 16201 raft_consensus.cc:2393] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 4: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:06:17.612494 18555 consensus_queue.cc:1048] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.078s
I20260709 13:06:17.621166 18532 raft_consensus.cc:740] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:17.675220 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:17.641299 18396 raft_consensus.cc:697] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 6 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:06:17.675972 18288 raft_consensus.cc:493] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:17.615680 18559 raft_consensus.cc:515] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:17.661554 18540 consensus_queue.cc:1059] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 13:06:17.677874 18496 consensus_queue.cc:1048] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 13:06:17.705338 16348 raft_consensus.cc:1275] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:06:17.677215 18537 raft_consensus.cc:515] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:17.733505 16350 raft_consensus.cc:3060] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:17.735986 18493 raft_consensus.cc:493] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:17.736913 18493 raft_consensus.cc:515] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:17.737112 18396 consensus_queue.cc:237] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:17.677019 18405 consensus_queue.cc:237] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:17.725051 18540 raft_consensus.cc:493] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:17.733314 16912 leader_election.cc:304] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
W20260709 13:06:17.775092 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 175009us
I20260709 13:06:17.775732 16208 raft_consensus.cc:2393] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 5: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
W20260709 13:06:17.776432 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 202784us
I20260709 13:06:17.723698 18288 raft_consensus.cc:515] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:17.753959 18183 raft_consensus.cc:493] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:17.791507 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:17.794632 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:17.756830 18377 leader_election.cc:290] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:17.793601 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bc3c8ff9b84838a2664335d7e1582b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:17.796855 16199 raft_consensus.cc:2468] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 5.
I20260709 13:06:17.795238 16205 raft_consensus.cc:3060] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:17.797544 16946 raft_consensus.cc:2468] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 6.
W20260709 13:06:17.800381 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 56179.3us
I20260709 13:06:17.802495 16350 raft_consensus.cc:2468] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 6.
I20260709 13:06:17.800478 18377 raft_consensus.cc:493] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:17.741706 18532 consensus_queue.cc:260] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:06:17.811223 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 299673us
W20260709 13:06:17.811991 16173 connection.cc:256] RPC call timeout handler was delayed by -1.17851654399999s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21720000000000003s for a response
I20260709 13:06:17.817785 16248 leader_election.cc:304] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:06:17.757846 18540 raft_consensus.cc:515] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } }
I20260709 13:06:17.799046 18330 leader_election.cc:290] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 5 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:17.814702 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:17.852972 16280 raft_consensus.cc:2468] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 7.
I20260709 13:06:17.808406 18496 raft_consensus.cc:493] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:17.857213 16914 leader_election.cc:400] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 3 election: Vote denied by peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107) with higher term. Message: Invalid argument: T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 for earlier term 3. Current term is 4.
I20260709 13:06:17.798821 18183 raft_consensus.cc:515] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:17.811815 18395 raft_consensus.cc:2804] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:06:17.858744 16173 leader_election.cc:336] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 1.961s (SENT)
I20260709 13:06:17.862702 16914 leader_election.cc:403] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:06:17.868834 16248 leader_election.cc:304] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:17.850230 18542 raft_consensus.cc:493] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:17.867925 18532 raft_consensus.cc:3060] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:17.870500 18395 raft_consensus.cc:493] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:17.954259 16174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:17.953845 16277 raft_consensus.cc:2468] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 3.
W20260709 13:06:17.985608 16247 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:18.034344 16174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:18.059660 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 199880us
I20260709 13:06:17.858068 18377 raft_consensus.cc:515] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:18.060614 16248 leader_election.cc:304] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:06:17.891072 18560 log.cc:927] Time spent T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.196s	user 0.001s	sys 0.000s
I20260709 13:06:18.070055 18540 leader_election.cc:290] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:17.868068 18496 raft_consensus.cc:515] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:06:18.071636 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:17.884002 18396 raft_consensus.cc:493] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:17.889734 18535 raft_consensus.cc:2749] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107) with higher term. Message: Invalid argument: T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 for earlier term 3. Current term is 4.
I20260709 13:06:17.875924 18310 consensus_queue.cc:1059] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.055s
I20260709 13:06:17.920493 18538 leader_election.cc:290] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:06:18.071008 18187 consensus_meta.cc:287] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3: Time spent flushing consensus metadata: real 0.621s	user 0.013s	sys 0.000s
W20260709 13:06:18.088934 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:18.052001 18395 raft_consensus.cc:3060] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:18.072743 18564 log.cc:927] Time spent T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.363s	user 0.000s	sys 0.001s
W20260709 13:06:18.104990 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:18.111189 16354 consensus_meta.cc:287] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 0.553s	user 0.006s	sys 0.004s
W20260709 13:06:18.097059 16173 leader_election.cc:336] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 2.128s (SENT)
I20260709 13:06:18.125766 16281 raft_consensus.cc:2468] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 4.
I20260709 13:06:18.074220 18528 raft_consensus.cc:493] T b9e1324823f04d8da5a4b3ddbd061c0e P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
W20260709 13:06:18.131183 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 70658.4us
I20260709 13:06:18.129900 16354 raft_consensus.cc:2468] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 4.
I20260709 13:06:17.892338 18542 raft_consensus.cc:515] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:18.098067 18539 raft_consensus.cc:3055] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:18.093127 18559 leader_election.cc:290] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:18.107704 18334 raft_consensus.cc:2804] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:18.092929 18537 leader_election.cc:290] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:18.093628 18540 raft_consensus.cc:493] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:18.073139 18061 consensus_queue.cc:1048] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
W20260709 13:06:18.148175 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:18.135998 18187 raft_consensus.cc:2804] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:18.162946 18540 raft_consensus.cc:515] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:18.185477 18540 leader_election.cc:290] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:18.187708 18533 consensus_queue.cc:1048] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 13:06:18.192584 18496 leader_election.cc:290] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:06:18.194888 18579 log.cc:927] Time spent T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.281s	user 0.000s	sys 0.001s
W20260709 13:06:18.183121 16941 consensus_meta.cc:287] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63: Time spent flushing consensus metadata: real 0.580s	user 0.009s	sys 0.002s
I20260709 13:06:18.140762 18288 leader_election.cc:290] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:18.140295 18539 raft_consensus.cc:740] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
W20260709 13:06:18.241168 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 165150us
W20260709 13:06:18.200840 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:18.163599 18567 log.cc:927] Time spent T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63: Append to log took a long time: real 0.355s	user 0.001s	sys 0.000s
W20260709 13:06:18.161046 16944 consensus_meta.cc:287] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63: Time spent flushing consensus metadata: real 0.710s	user 0.005s	sys 0.006s
I20260709 13:06:18.205844 16205 raft_consensus.cc:2468] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 5.
I20260709 13:06:18.249724 18187 raft_consensus.cc:697] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
W20260709 13:06:18.210825 16206 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.018s	sys 0.004s
W20260709 13:06:18.250738 16206 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.635s	user 0.018s	sys 0.004s
I20260709 13:06:18.149091 18334 raft_consensus.cc:493] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:18.252000 18187 consensus_queue.cc:237] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:06:18.164490 18569 log.cc:927] Time spent T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.368s	user 0.001s	sys 0.001s
I20260709 13:06:18.254714 18434 raft_consensus.cc:3055] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:06:18.235951 16174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:18.211005 16941 raft_consensus.cc:2468] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 5.
I20260709 13:06:18.123159 18396 raft_consensus.cc:515] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:18.150986 18588 raft_consensus.cc:2804] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:18.249876 16944 raft_consensus.cc:2468] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 5.
W20260709 13:06:18.251542 18568 log.cc:927] Time spent T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 13:06:18.219517 18573 consensus_queue.cc:1048] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:18.251538 18334 raft_consensus.cc:3060] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:18.255254 18434 raft_consensus.cc:740] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:18.140380 18528 raft_consensus.cc:515] T b9e1324823f04d8da5a4b3ddbd061c0e P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
W20260709 13:06:18.284315 16173 leader_election.cc:336] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 2.148s (SENT)
W20260709 13:06:18.277304 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 137997us
I20260709 13:06:18.292518 16322 leader_election.cc:304] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:06:18.261183 18288 raft_consensus.cc:493] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:18.281495 18588 raft_consensus.cc:697] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:18.300279 16322 leader_election.cc:304] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
W20260709 13:06:18.309412 16173 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:18.294541 18183 leader_election.cc:290] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:06:18.317312 16246 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.005s	sys 0.000s
W20260709 13:06:18.317976 16246 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.523s	user 0.005s	sys 0.000s
W20260709 13:06:18.318423 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 538157us
I20260709 13:06:18.322230 18588 consensus_queue.cc:237] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.2, Last appended by leader: 2, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:18.304397 18538 raft_consensus.cc:2804] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:18.308450 18559 raft_consensus.cc:2764] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:06:18.346745 16173 leader_election.cc:304] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
W20260709 13:06:18.318506 16278 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.633s	user 0.005s	sys 0.015s
W20260709 13:06:18.355273 16278 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.679s	user 0.006s	sys 0.015s
I20260709 13:06:18.315758 18537 raft_consensus.cc:493] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:18.302376 18288 raft_consensus.cc:515] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:18.339147 18538 raft_consensus.cc:493] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:18.361382 16279 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.685s	user 0.004s	sys 0.045s
W20260709 13:06:18.320559 18418 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.002s	sys 0.003s
I20260709 13:06:18.298451 16354 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7295dce0baa440b8a197da845581ee81"
dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
mode: GRACEFUL
new_leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
 from {username='slave'} at 127.0.0.1:56792
W20260709 13:06:18.395977 16279 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.728s	user 0.012s	sys 0.047s
W20260709 13:06:18.380139 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 182272us
I20260709 13:06:18.347599 18377 leader_election.cc:290] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:18.361888 18522 raft_consensus.cc:2804] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:18.353173 18183 raft_consensus.cc:2764] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
W20260709 13:06:18.404600 16321 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.013s	sys 0.021s
W20260709 13:06:18.413297 16321 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.619s	user 0.014s	sys 0.022s
W20260709 13:06:18.404973 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 64110.5us
I20260709 13:06:18.372531 18538 raft_consensus.cc:3060] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:06:18.422273 16247 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:18.301872 18539 consensus_queue.cc:260] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:06:18.397550 18418 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.635s	user 0.003s	sys 0.003s
I20260709 13:06:18.395313 18559 raft_consensus.cc:493] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:18.367426 18537 raft_consensus.cc:515] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } }
I20260709 13:06:18.394876 18533 consensus_queue.cc:1048] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 13:06:18.433106 18183 consensus_queue.cc:1048] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 13:06:18.441639 18295 leader_election.cc:290] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:18.443981 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:18.447041 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:18.447728 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:18.448377 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:18.449203 16274 raft_consensus.cc:2410] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:06:18.450883 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:18.451893 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:18.452232 18288 leader_election.cc:290] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:18.452677 18493 leader_election.cc:290] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:18.426913 18591 raft_consensus.cc:493] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:18.456102 18541 consensus_meta.cc:287] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 0.975s	user 0.009s	sys 0.003s
I20260709 13:06:18.455556 18591 raft_consensus.cc:515] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:18.457264 16940 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40078 (request call id 174) took 1120 ms. Trace:
W20260709 13:06:18.430896 18217 consensus_meta.cc:287] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3: Time spent flushing consensus metadata: real 0.878s	user 0.012s	sys 0.002s
I20260709 13:06:18.457700 16940 rpcz_store.cc:276] 0709 13:06:17.336653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:17.337291 (+   638us) service_pool.cc:224] Handling call
0709 13:06:18.457037 (+1119746us) spinlock_profiling.cc:243] Waited 886 ms on lock 0x7b540040f1d4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:06:18.457180 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2037896960}
I20260709 13:06:18.450342 16281 raft_consensus.cc:1240] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 5. Current term is 6. Ops: [2.2-5.3]
W20260709 13:06:18.461748 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 43813.4us
I20260709 13:06:18.468206 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:18.496491 16173 leader_election.cc:304] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:18.498807 16173 leader_election.cc:304] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:06:18.481702 16205 raft_consensus.cc:1240] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:18.486191 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:18.486939 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:18.486590 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:18.520601 16200 raft_consensus.cc:2410] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for term 8 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 2.
I20260709 13:06:18.459017 16282 raft_consensus.cc:1275] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
W20260709 13:06:18.522799 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 202478us
I20260709 13:06:18.552286 16282 pending_rounds.cc:85] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3: Aborting all ops after (but not including) 3
I20260709 13:06:18.552686 16282 pending_rounds.cc:107] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3: Aborting uncommitted NO_OP operation due to leader change: 5.4
W20260709 13:06:18.464100 18584 log.cc:927] Time spent T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.158s	user 0.001s	sys 0.000s
I20260709 13:06:18.534910 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:18.535933 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:18.536366 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:06:18.463649 18593 log.cc:927] Time spent T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:06:18.562333 16246 leader_election.cc:304] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:18.557832 16281 raft_consensus.cc:2393] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 6: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:06:18.521368 18377 raft_consensus.cc:493] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:18.562471 16280 raft_consensus.cc:3055] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:18.553134 16282 raft_consensus.cc:2889] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:18.570346 16280 raft_consensus.cc:740] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:18.561925 16320 leader_election.cc:304] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:18.458514 18591 leader_election.cc:290] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:06:18.580132 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 45311.4us
W20260709 13:06:18.580521 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:18.467419 18528 leader_election.cc:290] T b9e1324823f04d8da5a4b3ddbd061c0e P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:18.470088 18542 leader_election.cc:290] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:18.527315 18531 raft_consensus.cc:2749] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:18.559625 16912 leader_election.cc:304] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:18.592798 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:18.461120 18532 consensus_queue.cc:1048] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.106s
I20260709 13:06:18.588893 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:06:18.618682 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:18.644932 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
W20260709 13:06:18.645551 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 83696.4us
I20260709 13:06:18.712388 16320 leader_election.cc:304] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:18.460263 18183 consensus_queue.cc:1048] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.118s
I20260709 13:06:18.434532 18559 raft_consensus.cc:515] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:18.648818 16248 leader_election.cc:304] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:18.774947 16274 raft_consensus.cc:3060] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:18.587505 18377 raft_consensus.cc:515] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:18.568563 18295 raft_consensus.cc:493] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:18.657989 16200 raft_consensus.cc:2410] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:06:18.583145 18578 raft_consensus.cc:2804] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:18.656833 18528 raft_consensus.cc:2804] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:06:18.679184 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 90182.4us
I20260709 13:06:18.660506 18493 consensus_queue.cc:1059] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.118s
I20260709 13:06:18.567938 18419 consensus_queue.cc:1048] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.095s
W20260709 13:06:18.684998 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 99696.7us
I20260709 13:06:18.680596 16205 raft_consensus.cc:2393] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 6: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:06:18.660130 18591 raft_consensus.cc:2804] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:18.789534 18591 raft_consensus.cc:493] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:18.789723 18559 leader_election.cc:290] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:18.789988 18591 raft_consensus.cc:3060] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:18.780830 18528 raft_consensus.cc:493] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:18.794809 18528 raft_consensus.cc:3060] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:18.795473 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:18.796725 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:18.797874 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:06:18.779254 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:18.783131 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 284439us
I20260709 13:06:18.800813 16173 leader_election.cc:304] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:18.801654 18183 raft_consensus.cc:2749] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:18.535113 18541 raft_consensus.cc:493] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:18.803063 18541 raft_consensus.cc:515] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:06:18.803721 18395 consensus_meta.cc:287] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63: Time spent flushing consensus metadata: real 0.671s	user 0.008s	sys 0.003s
I20260709 13:06:18.804131 18395 raft_consensus.cc:515] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:18.805341 18541 leader_election.cc:290] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:18.782465 18295 raft_consensus.cc:515] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:18.808826 18295 leader_election.cc:290] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:18.676710 18288 raft_consensus.cc:493] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:18.810001 18288 raft_consensus.cc:515] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:18.794142 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:18.813090 18396 leader_election.cc:290] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:18.781617 18578 raft_consensus.cc:493] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:18.813724 16199 raft_consensus.cc:2410] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:06:18.813977 18578 raft_consensus.cc:3060] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:18.800019 18377 leader_election.cc:290] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:18.788780 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:18.817750 16205 raft_consensus.cc:2393] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 6: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:06:18.787644 16206 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60154 (request call id 1429) took 1177 ms. Trace:
I20260709 13:06:18.790318 18598 raft_consensus.cc:493] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:18.818576 16173 leader_election.cc:304] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:18.791512 16283 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45210 (request call id 1434) took 1280 ms. Trace:
W20260709 13:06:18.791886 18608 log.cc:927] Time spent T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.131s	user 0.000s	sys 0.000s
I20260709 13:06:18.792088 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:18.793437 16356 raft_consensus.cc:1275] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:06:18.812767 18288 leader_election.cc:290] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:18.790774 18589 raft_consensus.cc:2804] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:18.581372 18061 consensus_queue.cc:1059] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.085s
I20260709 13:06:18.819438 16283 rpcz_store.cc:276] 0709 13:06:17.511088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:17.534116 (+ 23028us) service_pool.cc:224] Handling call
0709 13:06:18.791307 (+1257191us) spinlock_profiling.cc:243] Waited 46.8 ms on lock 0x7b5400389d54. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:06:18.791431 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":107613056}
I20260709 13:06:18.818434 16206 rpcz_store.cc:276] 0709 13:06:17.610283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:17.610538 (+   255us) service_pool.cc:224] Handling call
0709 13:06:17.614082 (+  3544us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:17.614459 (+   377us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:17.614488 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:17.615002 (+   514us) log.cc:844] Serialized 26 byte log entry
0709 13:06:18.251213 (+636211us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:18.251264 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:18.251353 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:18.787400 (+536047us) raft_consensus.cc:1685] finished
0709 13:06:18.787428 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:18.787587 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9809,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":21031,"thread_start_us":635796,"threads_started":1,"wal-append.queue_time_us":725418}
W20260709 13:06:18.830251 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 46476.6us
W20260709 13:06:18.858350 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 146012us
W20260709 13:06:18.864383 16174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:18.864890 16174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:18.781591 18531 raft_consensus.cc:493] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:18.806341 18395 leader_election.cc:290] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 5 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:06:18.870074 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 67599.4us
I20260709 13:06:18.892203 16173 leader_election.cc:304] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:06:18.893550 16173 leader_election.cc:304] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:18.894747 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:06:18.898900 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 250189us
I20260709 13:06:18.902319 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:18.866926 18183 raft_consensus.cc:2749] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:18.905212 18183 raft_consensus.cc:493] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:18.907481 16348 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41832 (request call id 1483) took 1368 ms. Trace:
I20260709 13:06:18.907935 16348 rpcz_store.cc:276] 0709 13:06:17.538824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:17.545700 (+  6876us) service_pool.cc:224] Handling call
0709 13:06:17.570486 (+ 24786us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:17.733241 (+162755us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:18.907157 (+1173916us) spinlock_profiling.cc:243] Waited 74.9 ms on lock 0x7b5400194e54. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f489e01 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6
0709 13:06:18.907369 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":172222336}
I20260709 13:06:18.911016 18539 raft_consensus.cc:3060] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:18.902343 18589 raft_consensus.cc:697] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [term 5 LEADER]: Becoming Leader. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:06:18.912375 18589 consensus_queue.cc:237] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:18.911160 18597 raft_consensus.cc:2749] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:18.915858 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:18.905822 18183 raft_consensus.cc:515] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:18.916391 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:18.916697 16207 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60154 (request call id 1427) took 1307 ms. Trace:
I20260709 13:06:18.917083 16207 rpcz_store.cc:276] 0709 13:06:17.609606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:17.611083 (+  1477us) service_pool.cc:224] Handling call
0709 13:06:18.915741 (+1304658us) spinlock_profiling.cc:243] Waited 1.89 ms on lock 0x7b5800002a98. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361c224db1 00007f361c364b71 00007f361c364eee 0000000000375939 00007f36243d81e0 00007f36244a10c4 00007f36244a1131 00007f362444f0a0 00007f362444e984 00007f361d9c96d4 00007f361d9c9662
0709 13:06:18.916614 (+   873us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4357504}
I20260709 13:06:18.918191 18183 leader_election.cc:290] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:18.919378 18183 raft_consensus.cc:2804] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:18.917896 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:18.910041 18528 raft_consensus.cc:515] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:18.922610 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:18.920241 18183 raft_consensus.cc:493] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:18.920455 18616 raft_consensus.cc:2749] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:18.926265 18582 raft_consensus.cc:2749] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:18.926960 18602 raft_consensus.cc:493] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:18.927287 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:18.926803 18183 raft_consensus.cc:3060] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:18.927542 18602 raft_consensus.cc:515] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:18.929899 18602 leader_election.cc:290] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:18.918249 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:18.931876 16207 raft_consensus.cc:3060] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:18.921043 16203 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60138 (request call id 1533) took 1137 ms. Trace:
I20260709 13:06:18.911099 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:18.932622 16912 leader_election.cc:304] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:18.932384 16203 rpcz_store.cc:276] 0709 13:06:17.783729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:17.783899 (+   170us) service_pool.cc:224] Handling call
0709 13:06:17.789446 (+  5547us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:17.891831 (+102385us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:17.891865 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:18.061871 (+170006us) log.cc:844] Serialized 26 byte log entry
0709 13:06:18.373203 (+311332us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:18.373257 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:18.920675 (+547418us) spinlock_profiling.cc:243] Waited 96 ms on lock 0x7b54001194d4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f489e01 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6
0709 13:06:18.920724 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:18.920771 (+    47us) raft_consensus.cc:1685] finished
0709 13:06:18.920783 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:18.920988 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":85,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":5263,"spinlock_wait_cycles":220903808,"thread_start_us":245582,"threads_started":1,"wal-append.queue_time_us":557860}
I20260709 13:06:18.924944 18528 leader_election.cc:290] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:18.925225 18538 raft_consensus.cc:515] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:06:18.937520 16322 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:18.938083 16322 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:18.960789 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 74030.9us
I20260709 13:06:18.961423 16274 raft_consensus.cc:2468] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 5.
I20260709 13:06:18.961645 16320 leader_election.cc:304] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:18.966171 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:18.968209 16279 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45210 (request call id 1443) took 1302 ms. Trace:
I20260709 13:06:18.975790 16203 raft_consensus.cc:2393] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 5: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:06:18.968758 16279 rpcz_store.cc:276] 0709 13:06:17.666302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:17.666669 (+   367us) service_pool.cc:224] Handling call
0709 13:06:17.667066 (+   397us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:18.396764 (+729698us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:18.396804 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:18.415512 (+ 18708us) log.cc:844] Serialized 26 byte log entry
0709 13:06:18.664521 (+249009us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:18.664706 (+   185us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:18.664823 (+   117us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:18.967895 (+303072us) raft_consensus.cc:1685] finished
0709 13:06:18.967928 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:18.968129 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":158813,"raft.queue_time_us":206658,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":13405,"thread_start_us":958563,"threads_started":2,"wal-append.queue_time_us":466961}
I20260709 13:06:18.978147 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:18.971019 18559 raft_consensus.cc:493] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:18.983870 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:18.984647 16348 raft_consensus.cc:3060] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:18.986328 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:18.987780 16200 raft_consensus.cc:2393] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 5: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:06:18.990859 16320 leader_election.cc:304] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:06:18.995795 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 102322us
I20260709 13:06:18.997725 16320 leader_election.cc:304] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:19.000919 16173 leader_election.cc:304] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:19.004526 16354 raft_consensus.cc:606] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 3 LEADER]: Received request to transfer leadership to TS 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:06:18.982395 18556 raft_consensus.cc:2749] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:18.986088 18396 raft_consensus.cc:493] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:18.989895 18532 raft_consensus.cc:493] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:19.019796 16203 raft_consensus.cc:1275] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:06:18.850821 18598 raft_consensus.cc:515] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:18.986307 18288 raft_consensus.cc:493] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:18.896155 18531 raft_consensus.cc:515] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:19.038669 16200 raft_consensus.cc:1275] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:06:19.016016 18555 raft_consensus.cc:2749] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:19.012076 16173 leader_election.cc:304] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:18.993690 18310 raft_consensus.cc:2749] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:19.033802 16207 raft_consensus.cc:2468] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 5.
I20260709 13:06:19.006101 18541 raft_consensus.cc:2749] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:19.011462 18537 leader_election.cc:290] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:19.058318 18537 raft_consensus.cc:493] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:18.988767 18559 raft_consensus.cc:515] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:18.982133 18597 consensus_queue.cc:1059] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 13:06:19.036741 18396 raft_consensus.cc:515] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:19.062716 16912 leader_election.cc:304] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:19.049273 18264 raft_consensus.cc:493] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:19.019652 18528 consensus_queue.cc:1048] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 13:06:19.054704 18596 consensus_queue.cc:1048] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.013s
W20260709 13:06:19.063196 18334 consensus_meta.cc:287] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3: Time spent flushing consensus metadata: real 0.771s	user 0.006s	sys 0.007s
I20260709 13:06:19.072784 18618 raft_consensus.cc:2804] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:19.078711 18619 raft_consensus.cc:2804] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:19.079154 18618 raft_consensus.cc:697] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [term 5 LEADER]: Becoming Leader. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:06:19.080304 18618 consensus_queue.cc:237] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:19.072537 18595 consensus_queue.cc:1048] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.192s
I20260709 13:06:19.070672 18599 consensus_queue.cc:1048] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.153s
I20260709 13:06:19.058947 18537 raft_consensus.cc:515] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:19.078805 18334 raft_consensus.cc:515] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:19.089900 18334 leader_election.cc:290] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 election: Requested vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:19.036957 18532 raft_consensus.cc:515] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:06:19.077590 18561 log.cc:927] Time spent T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 1.496s	user 0.000s	sys 0.009s
I20260709 13:06:19.086308 18537 leader_election.cc:290] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:19.099254 18626 raft_consensus.cc:2804] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:19.091677 18264 raft_consensus.cc:515] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:06:19.099853 18553 log.cc:927] Time spent T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63: Append to log took a long time: real 1.505s	user 0.002s	sys 0.007s
I20260709 13:06:19.099855 18619 raft_consensus.cc:697] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:19.101531 18531 leader_election.cc:290] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:19.116571 18591 raft_consensus.cc:515] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:19.044739 18288 raft_consensus.cc:515] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:06:19.120754 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 79599.2us
W20260709 13:06:19.123273 16350 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41832 (request call id 1484) took 1584 ms (client timeout 1732 ms). Trace:
W20260709 13:06:19.166242 16350 rpcz_store.cc:269] 0709 13:06:17.539184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:17.547970 (+  8786us) service_pool.cc:224] Handling call
0709 13:06:19.123107 (+1575137us) spinlock_profiling.cc:243] Waited 184 ms on lock 0x7b54003494d4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:06:19.123215 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":424264960}
I20260709 13:06:19.133337 16348 raft_consensus.cc:2468] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 5.
W20260709 13:06:19.135370 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:19.162453 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 164930us
I20260709 13:06:19.166481 16248 leader_election.cc:304] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:06:19.157593 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 145597us
I20260709 13:06:19.168985 16173 leader_election.cc:304] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:19.169875 16205 raft_consensus.cc:1240] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:19.169006 16320 leader_election.cc:304] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:19.171483 16173 leader_election.cc:304] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:19.171962 16320 leader_election.cc:304] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:19.173025 16283 raft_consensus.cc:1275] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:06:19.156423 18626 raft_consensus.cc:493] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:19.178841 16322 leader_election.cc:304] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:06:19.182224 16320 leader_election.cc:304] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:19.182499 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:19.180266 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:19.187522 16202 raft_consensus.cc:1240] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:19.175398 18528 raft_consensus.cc:2764] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:06:19.172479 18597 raft_consensus.cc:2749] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:06:19.208483 18634 log.cc:927] Time spent T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:06:19.179447 18589 raft_consensus.cc:493] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:19.167987 18596 consensus_queue.cc:1048] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 13:06:19.190292 18537 raft_consensus.cc:2749] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:19.181864 18538 leader_election.cc:290] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:19.229460 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:19.185479 18626 raft_consensus.cc:3060] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:19.234687 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 68284.6us
W20260709 13:06:19.237919 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:19.241400 16248 leader_election.cc:304] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:06:19.242947 18418 raft_consensus.cc:2764] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:06:19.243367 16248 leader_election.cc:304] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:19.243692 18418 consensus_queue.cc:1048] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:19.244526 18555 raft_consensus.cc:3060] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:19.248059 18609 raft_consensus.cc:2749] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:19.202351 18541 raft_consensus.cc:2749] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:19.209182 18604 raft_consensus.cc:2804] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:19.260720 18264 leader_election.cc:290] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:06:19.261149 18627 log.cc:927] Time spent T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:06:19.261858 18336 consensus_queue.cc:1048] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:06:19.262459 18640 raft_consensus.cc:2749] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:19.258827 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:19.263453 16941 raft_consensus.cc:2468] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 4.
I20260709 13:06:19.264245 16200 raft_consensus.cc:1275] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:06:19.228899 18618 raft_consensus.cc:493] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:19.266181 18618 raft_consensus.cc:515] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:19.266965 16940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:19.267874 16940 raft_consensus.cc:2393] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 6: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:06:19.269207 18618 leader_election.cc:290] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:19.229228 18395 raft_consensus.cc:493] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:19.234496 18556 raft_consensus.cc:493] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:19.291013 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 112247us
I20260709 13:06:19.291913 16322 leader_election.cc:304] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:06:19.238848 18589 raft_consensus.cc:515] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:06:19.306566 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 63252.4us
I20260709 13:06:19.309085 16322 leader_election.cc:304] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:06:19.255204 18597 raft_consensus.cc:493] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:19.257877 18604 raft_consensus.cc:493] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:19.312952 16322 leader_election.cc:304] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:06:19.231631 18578 raft_consensus.cc:515] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:19.323474 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:19.273689 18538 raft_consensus.cc:493] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:19.325500 16200 raft_consensus.cc:2393] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 in current term 4: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:06:19.320571 18604 raft_consensus.cc:3060] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:19.332545 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:19.343113 16276 raft_consensus.cc:2410] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for term 7 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:06:19.333556 16248 leader_election.cc:304] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:19.312100 18541 raft_consensus.cc:2804] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:06:19.347164 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 166512us
I20260709 13:06:19.299609 18395 raft_consensus.cc:515] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:19.335443 16942 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35122 (request call id 381) took 2576 ms. Trace:
I20260709 13:06:19.353932 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:06:19.350148 16940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:19.281174 18619 consensus_queue.cc:237] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:19.323004 18631 raft_consensus.cc:2804] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:19.373450 16946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f022e2e63ae4461d834e476ff2666991" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:06:19.362927 18532 leader_election.cc:290] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:19.363090 18288 leader_election.cc:290] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:19.377612 16354 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:56792 (request call id 9) took 1095 ms. Trace:
I20260709 13:06:19.378058 16354 rpcz_store.cc:276] 0709 13:06:18.291582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:18.296374 (+  4792us) service_pool.cc:224] Handling call
0709 13:06:19.377444 (+1081070us) spinlock_profiling.cc:243] Waited 609 ms on lock 0x7b540028c3d4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f483853 00007f362445160a 00007f361d9d77d4 00007f361d9d7762 00007f361d9d7691 00007f361d9d760c 00007f361d9d68c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:06:19.377528 (+    84us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1399788416}
I20260709 13:06:19.379400 18395 leader_election.cc:290] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:19.380221 18537 consensus_queue.cc:1059] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:19.381093 18537 raft_consensus.cc:3055] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:19.381418 18537 raft_consensus.cc:740] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:19.381860 18633 consensus_queue.cc:1059] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:19.383069 18532 raft_consensus.cc:3055] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:19.383499 18532 raft_consensus.cc:740] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:19.384538 18532 consensus_queue.cc:260] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:19.386016 18532 raft_consensus.cc:3060] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:19.387521 16947 raft_consensus.cc:2410] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:06:19.371140 18528 raft_consensus.cc:493] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:19.388305 18528 raft_consensus.cc:515] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:19.346097 18559 leader_election.cc:290] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:19.371606 16942 rpcz_store.cc:276] 0709 13:06:16.751195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:16.752466 (+  1271us) service_pool.cc:224] Handling call
0709 13:06:17.258230 (+505764us) spinlock_profiling.cc:243] Waited 6.5 ms on lock 0x7b58001a3d98. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361c224db1 00007f361c364b71 00007f361c364a22 00007f362527dc09 00007f36243d7ee0 00007f36244a10ab 00007f36244a1131 00007f3624462fc0 00007f362444d929 00007f362444d3d2 00007f361d9c4bd4
0709 13:06:17.258475 (+   245us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:17.270763 (+ 12288us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:17.270797 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:17.271422 (+   625us) log.cc:844] Serialized 26 byte log entry
0709 13:06:17.423970 (+152548us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:17.431882 (+  7912us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:17.440642 (+  8760us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:18.978081 (+1537439us) spinlock_profiling.cc:243] Waited 4.21 ms on lock 0x7b4400022b4c. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361c224db1 00007f361c2c2c85 00007f361c2c36a2 00007f361f0351db 00007f361f030aaf 00007f361f02486e 00007f361f023bb6 00007f361f0237d8 00007f361f02d221 00007f361f02d1d9 00007f361f02d169
0709 13:06:19.309153 (+331072us) raft_consensus.cc:1685] finished
0709 13:06:19.312348 (+  3195us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:19.323169 (+ 10821us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":24629504,"thread_start_us":123684,"threads_started":1,"wal-append.queue_time_us":231191}
I20260709 13:06:19.363777 18591 leader_election.cc:290] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:19.374078 18541 raft_consensus.cc:697] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 4 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:06:19.393813 16946 raft_consensus.cc:3060] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:19.372191 16173 leader_election.cc:304] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:19.305100 18556 raft_consensus.cc:515] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:06:19.400595 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 165536us
I20260709 13:06:19.351862 18599 raft_consensus.cc:2749] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:19.347469 18641 raft_consensus.cc:2804] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:19.336630 18308 consensus_queue.cc:1059] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.064s
I20260709 13:06:19.411012 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:19.411828 16274 raft_consensus.cc:2468] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 6.
W20260709 13:06:19.412062 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 229894us
I20260709 13:06:19.415226 16320 leader_election.cc:304] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:19.415532 16279 raft_consensus.cc:1275] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:06:19.407037 18633 raft_consensus.cc:2804] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:19.399437 18631 raft_consensus.cc:697] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 5 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:06:19.353116 18538 raft_consensus.cc:515] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:19.411891 18641 raft_consensus.cc:493] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:19.430711 18528 leader_election.cc:290] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:19.344547 18597 raft_consensus.cc:515] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:19.464799 16947 raft_consensus.cc:1275] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 4 LEARNER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:06:19.467049 18641 raft_consensus.cc:3060] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:19.461916 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:19.468595 18541 consensus_queue.cc:237] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:19.462154 16320 leader_election.cc:304] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:19.494611 16282 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45210 (request call id 1444) took 1828 ms. Trace:
I20260709 13:06:19.461751 18652 raft_consensus.cc:2749] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:06:19.466753 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 54745.2us
I20260709 13:06:19.382323 18537 consensus_queue.cc:260] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:19.495277 16280 consensus_queue.cc:260] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:06:19.504702 18183 consensus_meta.cc:287] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f: Time spent flushing consensus metadata: real 0.576s	user 0.008s	sys 0.008s
I20260709 13:06:19.512712 18631 consensus_queue.cc:237] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:19.543717 16280 raft_consensus.cc:3060] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:19.515152 16946 raft_consensus.cc:2410] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:06:19.513480 18556 leader_election.cc:290] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:19.518795 16282 rpcz_store.cc:276] 0709 13:06:17.670837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:17.673897 (+  3060us) service_pool.cc:224] Handling call
0709 13:06:17.674235 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:18.586126 (+911891us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:19.473832 (+887706us) spinlock_profiling.cc:243] Waited 784 ms on lock 0x7b540031db54. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f489e01 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6
0709 13:06:19.494529 (+ 20697us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1803859840}
I20260709 13:06:19.504762 16940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:06:19.512712 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
W20260709 13:06:19.535243 16248 connection.cc:256] RPC call timeout handler was delayed by -1.0098704970000654s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.194s for a response
W20260709 13:06:19.521878 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 59820.6us
W20260709 13:06:19.511493 18606 log.cc:927] Time spent T 00000000000000000000000000000000 P 4dc6f08597514f4d85fd451b999b403e: Append to log took a long time: real 0.940s	user 0.007s	sys 0.003s
I20260709 13:06:19.517107 18578 leader_election.cc:290] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:19.547683 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:06:19.548431 16947 raft_consensus.cc:3060] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:19.549603 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:19.550012 16275 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45210 (request call id 1445) took 1878 ms. Trace:
I20260709 13:06:19.539230 18264 raft_consensus.cc:493] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:19.546339 16248 leader_election.cc:304] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:19.553608 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:19.554286 16949 raft_consensus.cc:2468] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 5.
I20260709 13:06:19.552736 16320 leader_election.cc:304] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:19.521080 18187 raft_consensus.cc:493] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:19.560909 16320 leader_election.cc:304] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:19.562271 16320 leader_election.cc:304] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:19.539875 18418 raft_consensus.cc:493] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:19.542889 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:06:19.561546 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:19.563982 16276 raft_consensus.cc:1240] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 LEADER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:19.566766 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:19.550401 16275 rpcz_store.cc:276] 0709 13:06:17.671312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:17.672215 (+   903us) service_pool.cc:224] Handling call
0709 13:06:17.672607 (+   392us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:17.672880 (+   273us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:06:19.475166 (+1802286us) spinlock_profiling.cc:243] Waited 7.49 ms on lock 0x7b180007fc60. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f3625264de1 00007f36252715b1 00007f361f0314bc 00007f361c37f48b 00007f36251d9ab9 00007f361c39b69b 00007f361c39993f 00007f361c399455 00007f3622e813c7 00007f361f4939a7 00007f361f4a30bf
0709 13:06:19.493998 (+ 18832us) log.cc:844] Serialized 14 byte log entry
0709 13:06:19.549680 (+ 55682us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:19.549737 (+    57us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:19.549779 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:19.549843 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:19.549959 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13007,"prepare.queue_time_us":171472,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":49,"raft.queue_time_us":1756,"spinlock_wait_cycles":17234304,"thread_start_us":240413,"threads_started":2}
I20260709 13:06:19.564111 16248 leader_election.cc:304] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:19.575918 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:19.568558 16942 raft_consensus.cc:2393] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 4: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:06:19.566211 18187 raft_consensus.cc:515] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:19.579461 16202 raft_consensus.cc:1275] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:06:19.565371 18587 raft_consensus.cc:493] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:19.580188 18587 raft_consensus.cc:515] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:19.581148 18187 leader_election.cc:290] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:19.581866 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f022e2e63ae4461d834e476ff2666991" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:19.586979 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:19.588855 16947 raft_consensus.cc:2468] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 5.
I20260709 13:06:19.589316 16248 leader_election.cc:304] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:19.545461 18539 raft_consensus.cc:493] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:19.537840 18650 raft_consensus.cc:3060] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:19.571202 18649 log.cc:927] Time spent T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:06:19.573086 18597 leader_election.cc:290] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:19.573905 18589 leader_election.cc:290] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:19.585795 16943 raft_consensus.cc:3060] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:19.545670 18183 raft_consensus.cc:515] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:19.592697 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:19.562356 18652 raft_consensus.cc:2749] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:19.592796 18654 raft_consensus.cc:493] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:19.593581 18539 raft_consensus.cc:515] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:19.594995 18658 raft_consensus.cc:493] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:19.595947 18308 raft_consensus.cc:2749] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:19.565747 18559 raft_consensus.cc:2749] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:19.599315 18538 leader_election.cc:290] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:19.600564 18555 raft_consensus.cc:2749] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:19.565481 18537 raft_consensus.cc:3060] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:19.565994 18419 raft_consensus.cc:2804] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:19.605705 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:19.609426 18578 consensus_queue.cc:1048] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 13:06:19.567108 18380 raft_consensus.cc:2749] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:19.606855 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:19.608606 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:19.668999 16275 raft_consensus.cc:2468] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 6.
I20260709 13:06:19.670189 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:19.563206 18264 raft_consensus.cc:515] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:06:19.563951 16320 leader_election.cc:304] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:06:19.645763 16208 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60154 (request call id 1431) took 2017 ms (client timeout 1678 ms). Trace:
W20260709 13:06:19.672964 16208 rpcz_store.cc:269] 0709 13:06:17.624242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:17.627520 (+  3278us) service_pool.cc:224] Handling call
0709 13:06:19.634258 (+2006738us) spinlock_profiling.cc:243] Waited 147 ms on lock 0x7b54003782d4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:06:19.634501 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":338017536}
I20260709 13:06:19.607132 18187 raft_consensus.cc:2804] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:19.575032 18418 raft_consensus.cc:515] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:19.649613 18658 raft_consensus.cc:515] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:19.651804 18434 consensus_queue.cc:260] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:19.603008 18626 raft_consensus.cc:515] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:19.654922 18396 leader_election.cc:290] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:19.656810 16203 raft_consensus.cc:1240] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:19.662245 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:19.684386 16201 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60138 (request call id 1532) took 1901 ms. Trace:
I20260709 13:06:19.684912 16941 raft_consensus.cc:2468] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 6.
I20260709 13:06:19.684855 16201 rpcz_store.cc:276] 0709 13:06:17.783413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:17.783528 (+   115us) service_pool.cc:224] Handling call
0709 13:06:17.792234 (+  8706us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:17.792580 (+   346us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:17.792608 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:17.798618 (+  6010us) log.cc:844] Serialized 26 byte log entry
0709 13:06:18.081155 (+282537us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:18.081200 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:18.081276 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:19.682187 (+1600911us) spinlock_profiling.cc:243] Waited 18.1 ms on lock 0x7b2400121298. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361c224db1 00007f361c2229c4 00007f361c220acb 00007f361c3dbdc9 00007f361c3dba55 00007f361c3dafb0 00007f361f051488 00007f361f051be8 00007f361f029398 00007f361f02476a 00007f361f023bb6
0709 13:06:19.684063 (+  1876us) raft_consensus.cc:1685] finished
0709 13:06:19.684089 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:19.684323 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":108,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":8161,"spinlock_wait_cycles":41671936,"thread_start_us":236045,"threads_started":1,"wal-append.queue_time_us":452188}
I20260709 13:06:19.635448 18599 raft_consensus.cc:493] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:19.686815 18599 raft_consensus.cc:515] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:19.687892 16948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:19.688535 18418 leader_election.cc:290] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:19.689119 18599 leader_election.cc:290] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:19.558853 18633 raft_consensus.cc:697] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:19.671543 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f022e2e63ae4461d834e476ff2666991" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:19.690198 16279 raft_consensus.cc:2393] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 in current term 4: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:06:19.678752 18187 raft_consensus.cc:697] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:19.690665 18633 consensus_queue.cc:237] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:19.691813 18187 consensus_queue.cc:237] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:19.690660 16275 raft_consensus.cc:2468] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 4.
I20260709 13:06:19.696487 18434 raft_consensus.cc:3060] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:19.697315 18658 leader_election.cc:290] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:19.652065 18539 leader_election.cc:290] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:06:19.676127 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 112244us
W20260709 13:06:19.678706 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:19.704669 16283 raft_consensus.cc:1240] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:19.671450 18419 raft_consensus.cc:697] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:19.716285 18419 consensus_queue.cc:237] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:19.716836 18264 leader_election.cc:290] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:19.706457 16320 leader_election.cc:304] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:19.716944 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:19.718957 16200 raft_consensus.cc:2468] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 4.
I20260709 13:06:19.719408 18380 raft_consensus.cc:3060] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:19.719841 18572 consensus_queue.cc:1048] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:19.679700 18555 raft_consensus.cc:2749] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:19.722810 18555 consensus_queue.cc:1048] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:19.711481 18183 leader_election.cc:290] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:19.711732 18295 raft_consensus.cc:3055] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:19.723917 18295 raft_consensus.cc:740] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:06:19.648545 18654 raft_consensus.cc:515] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:19.724867 18295 consensus_queue.cc:260] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:19.725929 18295 raft_consensus.cc:3060] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:19.726075 18626 leader_election.cc:290] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:19.727753 18654 leader_election.cc:290] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:06:19.732511 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:19.733143 16320 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:19.735930 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:19.737223 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:19.750425 16280 raft_consensus.cc:1275] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:06:19.750823 16280 pending_rounds.cc:85] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3: Aborting all ops after (but not including) 3
I20260709 13:06:19.751082 16280 pending_rounds.cc:107] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:06:19.751356 16280 raft_consensus.cc:2889] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:19.750236 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:19.752301 16201 raft_consensus.cc:2468] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 5.
I20260709 13:06:19.753876 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:19.755874 16280 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45210 (request call id 1459) took 1263 ms. Trace:
I20260709 13:06:19.756421 16280 rpcz_store.cc:276] 0709 13:06:18.492975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:18.493383 (+   408us) service_pool.cc:224] Handling call
0709 13:06:18.535658 (+ 42275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:19.472228 (+936570us) spinlock_profiling.cc:243] Waited 316 ms on lock 0x7b54002ca4a0. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f40706f 00007f361f47ff60 00007f361f4817de 00007f361f48bb49 00007f361f48c416 00007f361f488d8f 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62
0709 13:06:19.755602 (+283374us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:19.755809 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":726361856}
I20260709 13:06:19.757004 16200 raft_consensus.cc:1240] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:19.758240 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bc3c8ff9b84838a2664335d7e1582b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:19.759127 16204 raft_consensus.cc:3060] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:19.748286 18597 raft_consensus.cc:493] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
W20260709 13:06:19.769148 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 58912.9us
I20260709 13:06:19.753407 18631 raft_consensus.cc:493] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:19.772887 16200 raft_consensus.cc:1240] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:19.787846 16204 raft_consensus.cc:2468] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 6.
I20260709 13:06:19.796464 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:06:19.798908 16174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:19.751727 18641 raft_consensus.cc:515] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:06:19.805272 18642 log.cc:927] Time spent T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.330s	user 0.000s	sys 0.007s
I20260709 13:06:19.815150 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:19.802533 16943 raft_consensus.cc:2468] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 4.
I20260709 13:06:19.817180 16320 leader_election.cc:304] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:19.817678 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:19.819084 16248 leader_election.cc:304] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:06:19.819864 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c15d8e9be8414c84912ab77b66bfb1" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:06:19.820528 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:19.820634 18396 raft_consensus.cc:2804] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:19.821067 18396 raft_consensus.cc:493] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:19.821439 18396 raft_consensus.cc:3060] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:19.821895 16206 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60138 (request call id 1537) took 1256 ms. Trace:
I20260709 13:06:19.822278 16206 rpcz_store.cc:276] 0709 13:06:18.565689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:18.855100 (+289411us) service_pool.cc:224] Handling call
0709 13:06:18.897056 (+ 41956us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:19.055686 (+158630us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:06:19.132856 (+ 77170us) log.cc:844] Serialized 14 byte log entry
0709 13:06:19.280940 (+148084us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:19.280993 (+    53us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:19.281038 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:19.821660 (+540622us) spinlock_profiling.cc:243] Waited 158 ms on lock 0x7b540038a9d4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f489e01 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6
0709 13:06:19.821707 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:19.821841 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":31895,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":2830,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":9263,"spinlock_wait_cycles":370715648,"thread_start_us":214343,"threads_started":2,"wal-append.queue_time_us":274508}
I20260709 13:06:19.824477 18418 raft_consensus.cc:2804] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:19.825066 18418 raft_consensus.cc:697] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:19.825423 18395 raft_consensus.cc:493] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:19.825953 18395 raft_consensus.cc:515] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:19.825997 18418 consensus_queue.cc:237] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:19.828433 18395 leader_election.cc:290] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:19.818212 16320 leader_election.cc:304] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:19.830873 18384 raft_consensus.cc:3060] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:19.832263 18557 raft_consensus.cc:2749] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:06:19.833038 18557 consensus_queue.cc:1059] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:19.834592 16320 leader_election.cc:304] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:19.780596 18597 raft_consensus.cc:515] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:19.835392 18539 raft_consensus.cc:2804] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:19.844973 16912 leader_election.cc:304] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:19.846647 18336 consensus_queue.cc:1048] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:19.781901 18631 raft_consensus.cc:515] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:19.835897 18334 raft_consensus.cc:493] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:19.847797 18539 raft_consensus.cc:697] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e [term 6 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:06:19.873024 16206 raft_consensus.cc:1275] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:06:19.874593 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:19.876652 16204 raft_consensus.cc:2393] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 in current term 5: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:06:19.852887 18587 leader_election.cc:290] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:19.800057 18604 raft_consensus.cc:515] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:19.891883 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:19.899217 16274 raft_consensus.cc:1240] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:19.902700 18617 raft_consensus.cc:2764] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:06:19.903272 18539 consensus_queue.cc:237] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:19.871692 18334 raft_consensus.cc:515] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:19.920188 16277 raft_consensus.cc:2468] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 6.
I20260709 13:06:19.893494 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:19.924700 18604 leader_election.cc:290] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:19.882905 18292 consensus_queue.cc:1048] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
W20260709 13:06:19.935614 18643 log.cc:927] Time spent T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.460s	user 0.000s	sys 0.006s
I20260709 13:06:19.949391 16173 leader_election.cc:304] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:19.950408 18522 raft_consensus.cc:493] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:19.950989 18522 raft_consensus.cc:3060] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:19.951238 18641 leader_election.cc:290] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:19.922670 18217 raft_consensus.cc:493] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:19.953931 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:19.954131 16173 leader_election.cc:304] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:19.954892 16200 raft_consensus.cc:2393] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 5: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
W20260709 13:06:19.961463 16321 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:19.961254 18581 raft_consensus.cc:493] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:19.962360 18647 raft_consensus.cc:2749] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:19.962885 18581 raft_consensus.cc:515] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:19.964289 18597 leader_election.cc:290] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:19.965564 18609 raft_consensus.cc:493] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:19.965718 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:19.966375 16206 raft_consensus.cc:2468] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 5.
I20260709 13:06:19.966132 18609 raft_consensus.cc:515] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:19.967705 16320 leader_election.cc:304] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:19.968549 18597 raft_consensus.cc:2804] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:19.968953 18597 raft_consensus.cc:493] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:19.969367 18597 raft_consensus.cc:3060] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:19.976228 16248 leader_election.cc:304] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:06:19.969200 18664 log.cc:927] Time spent T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.186s	user 0.001s	sys 0.001s
I20260709 13:06:19.992885 16914 leader_election.cc:304] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:06:19.995734 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:19.997475 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bc3c8ff9b84838a2664335d7e1582b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:19.946272 18631 leader_election.cc:290] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:20.003841 16173 leader_election.cc:304] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:20.004652 16206 raft_consensus.cc:2393] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 6: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
W20260709 13:06:20.005095 16246 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:19.981988 18609 leader_election.cc:290] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:20.007045 18617 raft_consensus.cc:2804] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:20.007822 18297 consensus_queue.cc:1048] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:20.018110 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:20.011322 16173 leader_election.cc:304] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:20.020174 16173 leader_election.cc:304] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:20.022300 16914 leader_election.cc:304] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:20.023409 18667 raft_consensus.cc:2804] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:20.024019 18667 raft_consensus.cc:697] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:20.014036 18336 raft_consensus.cc:493] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:20.024915 18667 consensus_queue.cc:237] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:20.027094 18525 consensus_queue.cc:1059] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:19.991187 18604 raft_consensus.cc:2749] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:20.062932 18292 raft_consensus.cc:3060] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:20.025719 18336 raft_consensus.cc:515] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:06:20.070461 18664 log.cc:927] Time spent T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:06:20.016417 18626 raft_consensus.cc:2804] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:20.095741 16173 leader_election.cc:304] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:06:20.021112 18617 raft_consensus.cc:493] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:19.980662 18217 raft_consensus.cc:515] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:06:20.079666 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 48501.5us
I20260709 13:06:19.991545 18537 raft_consensus.cc:2804] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:20.066919 18183 raft_consensus.cc:2804] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:20.070612 18525 raft_consensus.cc:3055] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:20.099681 16206 pending_rounds.cc:85] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f: Aborting all ops after (but not including) 2
I20260709 13:06:20.169152 16206 pending_rounds.cc:107] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f: Aborting uncommitted NO_OP operation due to leader change: 6.3
I20260709 13:06:20.169574 16206 raft_consensus.cc:2889] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:20.105765 16946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:20.172236 16173 leader_election.cc:304] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:06:20.095428 18598 leader_election.cc:290] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:20.100167 18626 raft_consensus.cc:493] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:20.103354 18617 raft_consensus.cc:3060] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:20.183483 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:20.191562 16173 leader_election.cc:304] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
W20260709 13:06:20.168341 18619 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.787s	user 0.007s	sys 0.026s
I20260709 13:06:20.169045 18525 raft_consensus.cc:740] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
W20260709 13:06:20.212121 16320 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:20.104547 18522 raft_consensus.cc:515] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:20.184950 18626 raft_consensus.cc:3060] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:20.183087 18334 leader_election.cc:290] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:20.179677 18183 raft_consensus.cc:697] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:20.157728 18633 raft_consensus.cc:2804] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:20.200146 18532 raft_consensus.cc:2749] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:20.207748 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:06:20.214120 18537 raft_consensus.cc:697] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 6 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:20.226056 18647 raft_consensus.cc:2804] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:06:20.233160 18650 consensus_meta.cc:287] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 0.609s	user 0.012s	sys 0.000s
W20260709 13:06:20.230229 18619 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.849s	user 0.013s	sys 0.026s
W20260709 13:06:20.257069 18380 consensus_meta.cc:287] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 0.535s	user 0.010s	sys 0.003s
I20260709 13:06:20.291607 18380 raft_consensus.cc:2749] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:20.291857 18336 leader_election.cc:290] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:06:20.293536 18678 log.cc:927] Time spent T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
W20260709 13:06:20.302713 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:20.289847 18539 raft_consensus.cc:493] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:20.304124 18525 consensus_queue.cc:260] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:20.305050 18539 raft_consensus.cc:515] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:20.305912 18525 raft_consensus.cc:3060] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:20.315505 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:20.328022 16208 raft_consensus.cc:2468] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 5.
I20260709 13:06:20.329394 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:20.309484 18590 raft_consensus.cc:493] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:20.334134 18396 consensus_meta.cc:287] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 0.512s	user 0.011s	sys 0.002s
I20260709 13:06:20.258590 18647 raft_consensus.cc:493] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:20.354583 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 203169us
I20260709 13:06:20.353796 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:20.314877 18650 raft_consensus.cc:2749] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:20.379695 18619 raft_consensus.cc:493] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:20.354857 18590 raft_consensus.cc:515] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:20.381600 18619 raft_consensus.cc:515] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:20.383576 18590 leader_election.cc:290] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:20.384042 18619 leader_election.cc:290] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:20.353055 18539 leader_election.cc:290] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:20.384701 16208 raft_consensus.cc:1240] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:20.355470 18647 raft_consensus.cc:3060] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:20.356719 18532 raft_consensus.cc:493] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:20.356031 18396 raft_consensus.cc:515] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:20.353574 18597 raft_consensus.cc:515] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:20.392112 18633 raft_consensus.cc:697] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 6 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
W20260709 13:06:20.411922 18648 log.cc:927] Time spent T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 1.025s	user 0.006s	sys 0.008s
I20260709 13:06:20.412084 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:20.342983 18183 consensus_queue.cc:237] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:06:20.407424 18682 log.cc:927] Time spent T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.100s	user 0.000s	sys 0.002s
I20260709 13:06:20.423343 18633 consensus_queue.cc:237] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:20.431049 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:06:20.431517 16277 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45210 (request call id 1452) took 1986 ms (client timeout 1663 ms). Trace:
W20260709 13:06:20.431912 16277 rpcz_store.cc:269] 0709 13:06:18.444885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:18.450645 (+  5760us) service_pool.cc:224] Handling call
0709 13:06:20.431344 (+1980699us) spinlock_profiling.cc:243] Waited 1.47 s on lock 0x7b54002f9ed4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:06:20.431453 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3377408768}
I20260709 13:06:20.434850 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:20.403849 18532 raft_consensus.cc:515] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:20.356529 18537 consensus_queue.cc:237] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:20.439137 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bc3c8ff9b84838a2664335d7e1582b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:20.442920 16283 raft_consensus.cc:2393] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 6: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:06:20.439383 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:06:20.443332 16321 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:20.440972 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:20.441670 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:20.446779 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:20.447491 16281 raft_consensus.cc:2468] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 6.
I20260709 13:06:20.447788 18555 raft_consensus.cc:493] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:20.448307 18555 raft_consensus.cc:515] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:20.458456 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:20.462977 16949 raft_consensus.cc:1275] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:06:20.463304 16940 raft_consensus.cc:1275] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:20.463622 18532 leader_election.cc:290] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:20.464450 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c15d8e9be8414c84912ab77b66bfb1" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:20.464587 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:20.417516 16944 raft_consensus.cc:2468] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 4.
I20260709 13:06:20.448400 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:20.424715 18522 leader_election.cc:290] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 election: Requested vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:20.468750 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:20.472023 16281 raft_consensus.cc:2468] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 4.
W20260709 13:06:20.474555 16915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:20.477288 16278 raft_consensus.cc:3060] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:20.464726 18555 leader_election.cc:290] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:20.460268 18336 raft_consensus.cc:493] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:20.478955 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:20.466861 18641 raft_consensus.cc:493] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:20.545724 18650 raft_consensus.cc:493] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:20.554420 18584 log.cc:927] Time spent T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:06:20.544741 18292 raft_consensus.cc:2749] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:20.565388 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:20.548709 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:06:20.559754 18591 raft_consensus.cc:493] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:20.596664 16200 raft_consensus.cc:1275] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:06:20.551690 18336 raft_consensus.cc:515] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:20.604816 18396 leader_election.cc:290] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:06:20.605286 18688 log.cc:927] Time spent T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.139s	user 0.000s	sys 0.001s
I20260709 13:06:20.610709 16942 raft_consensus.cc:2393] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 5: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:06:20.611608 16943 raft_consensus.cc:2468] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 5.
W20260709 13:06:20.613371 18691 log.cc:927] Time spent T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.193s	user 0.000s	sys 0.000s
I20260709 13:06:20.619768 18597 leader_election.cc:290] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:20.560101 18641 raft_consensus.cc:515] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:20.594825 18591 raft_consensus.cc:515] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:20.579092 18650 raft_consensus.cc:515] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:20.628494 18631 consensus_queue.cc:1048] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:20.685729 16278 raft_consensus.cc:1275] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:20.667142 18689 raft_consensus.cc:493] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:20.688683 18619 raft_consensus.cc:493] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:20.689636 18336 leader_election.cc:290] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:20.691440 16203 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60138 (request call id 1540) took 2112 ms. Trace:
I20260709 13:06:20.693017 18650 leader_election.cc:290] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:20.694929 18641 leader_election.cc:290] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:20.695245 18581 leader_election.cc:290] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:20.710091 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:20.696821 18626 raft_consensus.cc:515] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:06:20.705060 16246 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:20.715865 16278 raft_consensus.cc:1240] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:20.706960 16203 rpcz_store.cc:276] 0709 13:06:18.579379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:19.060378 (+480999us) service_pool.cc:224] Handling call
0709 13:06:19.060722 (+   344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:19.680604 (+619882us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:20.691156 (+1010552us) spinlock_profiling.cc:243] Waited 596 ms on lock 0x7b5400259754. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f489e01 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6
0709 13:06:20.691356 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1370055424}
I20260709 13:06:20.642406 18617 raft_consensus.cc:515] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:20.710911 16354 raft_consensus.cc:2368] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for earlier term 4. Current term is 5.
I20260709 13:06:20.710716 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:20.711797 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:20.711455 18619 raft_consensus.cc:515] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:06:20.712205 18692 log.cc:927] Time spent T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:06:20.712433 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:20.727005 16357 raft_consensus.cc:1240] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:20.719796 16348 raft_consensus.cc:2410] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:06:20.727782 16352 raft_consensus.cc:1240] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:06:20.719997 16351 raft_consensus.cc:2393] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 5: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:06:20.720984 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:20.724062 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:20.729229 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:20.729976 16349 raft_consensus.cc:2468] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 3.
I20260709 13:06:20.730135 16278 raft_consensus.cc:1240] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 4. Current term is 5. Ops: []
W20260709 13:06:20.731316 16914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:20.729254 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:20.732017 16280 raft_consensus.cc:2468] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 4.
I20260709 13:06:20.735059 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:20.735872 16354 raft_consensus.cc:2468] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 6.
I20260709 13:06:20.737326 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:20.738044 16353 raft_consensus.cc:2468] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 6.
I20260709 13:06:20.740325 16275 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42740 (request call id 223) took 1114 ms. Trace:
I20260709 13:06:20.740957 16275 rpcz_store.cc:276] 0709 13:06:19.625554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:19.669902 (+ 44348us) service_pool.cc:224] Handling call
0709 13:06:20.740118 (+1070216us) spinlock_profiling.cc:243] Waited 19.8 ms on lock 0x7b540031bd54. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:06:20.740233 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":45555456}
I20260709 13:06:20.742056 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:20.747642 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:20.742902 16355 raft_consensus.cc:2468] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 4.
I20260709 13:06:20.750769 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:20.755684 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:20.756439 16349 raft_consensus.cc:2468] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 4.
I20260709 13:06:20.748364 16356 raft_consensus.cc:2468] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 7.
I20260709 13:06:20.706503 18689 raft_consensus.cc:515] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:20.762077 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:20.763163 16353 raft_consensus.cc:2468] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 5.
I20260709 13:06:20.758831 16246 leader_election.cc:304] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:20.767307 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:20.770920 18310 raft_consensus.cc:3055] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:20.771684 18310 raft_consensus.cc:740] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
W20260709 13:06:20.772830 18681 log.cc:927] Time spent T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.535s	user 0.002s	sys 0.006s
I20260709 13:06:20.772931 18310 consensus_queue.cc:260] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:20.771723 18599 raft_consensus.cc:2804] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:20.774699 18599 raft_consensus.cc:493] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:20.775090 18599 raft_consensus.cc:3060] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:20.776010 16356 raft_consensus.cc:2468] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 6.
I20260709 13:06:20.784369 16200 raft_consensus.cc:3060] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:20.785423 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:20.786023 16353 raft_consensus.cc:3060] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:20.787117 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:20.787753 16349 raft_consensus.cc:2468] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 4.
I20260709 13:06:20.790993 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:20.791709 16349 raft_consensus.cc:2468] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 2.
I20260709 13:06:20.793771 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:20.794190 16357 raft_consensus.cc:1275] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:06:20.794435 16349 raft_consensus.cc:2468] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 4.
I20260709 13:06:20.797588 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:20.784287 16354 raft_consensus.cc:2468] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 5.
I20260709 13:06:20.804536 16356 raft_consensus.cc:2393] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 6: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:06:20.808491 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:20.811316 16353 raft_consensus.cc:2468] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 7.
I20260709 13:06:20.815270 18609 raft_consensus.cc:493] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:20.818061 18609 raft_consensus.cc:515] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:20.820298 18609 leader_election.cc:290] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:20.823827 18217 leader_election.cc:290] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:06:20.824842 18695 log.cc:927] Time spent T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.051s	user 0.002s	sys 0.000s
I20260709 13:06:20.825868 18689 leader_election.cc:290] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:20.828768 18591 leader_election.cc:290] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:20.829562 18647 raft_consensus.cc:515] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:20.784158 18596 consensus_queue.cc:1059] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 13:06:20.831415 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:20.831852 18596 raft_consensus.cc:3055] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:20.832255 18596 raft_consensus.cc:740] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:20.833092 18596 consensus_queue.cc:260] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:20.834192 18596 raft_consensus.cc:3060] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:20.835317 18617 leader_election.cc:290] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 7 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:20.836014 16274 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45218 (request call id 1556) took 1247 ms. Trace:
W20260709 13:06:20.836472 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:20.836372 16274 rpcz_store.cc:276] 0709 13:06:19.588445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:19.588579 (+   134us) service_pool.cc:224] Handling call
0709 13:06:19.588848 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:19.899864 (+311016us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:20.835792 (+935928us) spinlock_profiling.cc:243] Waited 310 ms on lock 0x7b54000767d4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f489e01 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6
0709 13:06:20.835958 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":713384704}
I20260709 13:06:20.836365 18626 leader_election.cc:290] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 election: Requested vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:20.863921 18591 raft_consensus.cc:493] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:20.875337 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:20.875427 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:06:20.823864 18619 leader_election.cc:290] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:20.886657 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:20.880504 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:20.887532 16207 raft_consensus.cc:2393] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 7: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:06:20.882408 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:20.863598 18696 raft_consensus.cc:493] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
W20260709 13:06:20.890010 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 83767.6us
I20260709 13:06:20.891016 16200 raft_consensus.cc:1275] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:06:20.891074 16944 raft_consensus.cc:3060] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:20.909557 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:20.909214 16942 raft_consensus.cc:2393] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 5: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:06:20.918861 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:20.919610 16353 raft_consensus.cc:2468] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 4.
I20260709 13:06:20.919457 16356 raft_consensus.cc:2468] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 6.
I20260709 13:06:20.887218 18591 raft_consensus.cc:515] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:20.932258 16353 raft_consensus.cc:1275] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:06:20.899988 18696 raft_consensus.cc:515] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:20.935102 18703 consensus_queue.cc:1059] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:20.937529 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:20.940148 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:20.941686 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:20.943261 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:20.927484 18706 raft_consensus.cc:493] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:20.974457 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:20.974509 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:20.974906 16248 leader_election.cc:304] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:06:20.983675 16276 raft_consensus.cc:1275] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:06:20.990276 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:20.993705 16914 leader_election.cc:304] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:06:21.001332 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:21.001888 18645 consensus_queue.cc:1059] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:21.002082 16353 raft_consensus.cc:2468] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 6.
I20260709 13:06:21.006124 16173 leader_election.cc:304] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:06:21.007234 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:06:20.975096 18380 raft_consensus.cc:493] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:21.010383 18633 raft_consensus.cc:493] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:21.012519 16946 raft_consensus.cc:1240] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 6. Current term is 7. Ops: []
W20260709 13:06:21.033324 16248 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 1.686s (SENT) [suppressed 11 similar messages]
I20260709 13:06:21.039357 18711 raft_consensus.cc:2804] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:21.039882 18711 raft_consensus.cc:493] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:21.040249 18711 raft_consensus.cc:3060] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:21.049024 16915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:21.051070 16322 leader_election.cc:304] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:20.998361 18525 raft_consensus.cc:493] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:20.971199 18599 raft_consensus.cc:515] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:20.997992 18334 raft_consensus.cc:493] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:21.060001 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:21.063457 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:21.064288 16280 raft_consensus.cc:3060] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:21.010960 18633 raft_consensus.cc:515] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:21.008113 18297 raft_consensus.cc:2804] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:06:21.070648 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 73751.1us
I20260709 13:06:21.019165 18183 raft_consensus.cc:2749] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:21.074231 16322 leader_election.cc:304] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:20.998003 18619 consensus_queue.cc:1059] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.063s
W20260709 13:06:21.081143 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 47837.3us
W20260709 13:06:21.083334 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 66594.6us
I20260709 13:06:21.084345 16173 leader_election.cc:304] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:06:21.084651 16322 leader_election.cc:304] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:21.089339 16322 leader_election.cc:304] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:21.090971 16322 leader_election.cc:304] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:21.093451 16322 leader_election.cc:304] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:06:21.074365 18616 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.668s	user 0.010s	sys 0.004s
I20260709 13:06:21.097755 16280 raft_consensus.cc:2468] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 7.
I20260709 13:06:21.099013 16322 leader_election.cc:304] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:21.048978 18537 consensus_queue.cc:1048] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.055s
I20260709 13:06:21.073318 18297 raft_consensus.cc:493] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:21.065968 18697 raft_consensus.cc:2749] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:21.113767 18711 raft_consensus.cc:515] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:21.117048 16322 leader_election.cc:304] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:21.094414 18396 raft_consensus.cc:2749] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:21.056062 18264 consensus_queue.cc:1048] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 13:06:21.060293 18581 consensus_queue.cc:1048] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.038s
W20260709 13:06:21.115810 18616 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.711s	user 0.011s	sys 0.005s
W20260709 13:06:21.120340 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 119553us
I20260709 13:06:21.029803 18380 raft_consensus.cc:515] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:21.094777 18493 raft_consensus.cc:2764] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:06:21.094120 18641 raft_consensus.cc:2749] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:21.096659 18650 raft_consensus.cc:2804] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:20.994733 18706 raft_consensus.cc:515] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:21.118614 18557 raft_consensus.cc:2749] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:06:21.139104 16321 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:21.069340 18525 raft_consensus.cc:515] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:21.122956 18631 raft_consensus.cc:2749] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:21.073910 18334 raft_consensus.cc:515] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:21.142674 16914 leader_election.cc:304] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:06:21.147187 18396 consensus_queue.cc:1048] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 13:06:21.151964 18696 leader_election.cc:290] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:21.087782 18703 consensus_queue.cc:1059] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
W20260709 13:06:21.153223 18709 log.cc:927] Time spent T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:06:21.153571 18380 leader_election.cc:290] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:21.155715 18334 leader_election.cc:290] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:06:21.156872 18708 log.cc:927] Time spent T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.162s	user 0.001s	sys 0.000s
I20260709 13:06:21.153357 18703 raft_consensus.cc:3055] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:06:21.157382 18675 log.cc:927] Time spent T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.968s	user 0.000s	sys 0.003s
I20260709 13:06:21.155736 18711 leader_election.cc:290] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 election: Requested vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:21.130316 18297 raft_consensus.cc:3060] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:21.136449 18722 raft_consensus.cc:493] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:21.138935 18597 raft_consensus.cc:2804] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:21.141121 18619 raft_consensus.cc:2749] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:21.144797 18650 raft_consensus.cc:493] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:21.181560 18707 log.cc:927] Time spent T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.192s	user 0.001s	sys 0.000s
I20260709 13:06:21.157437 18703 raft_consensus.cc:740] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:21.195716 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:06:21.185575 18650 raft_consensus.cc:3060] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:21.180866 18591 leader_election.cc:290] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:21.181191 18597 raft_consensus.cc:493] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:21.195307 16942 raft_consensus.cc:1275] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:06:21.201874 18703 consensus_queue.cc:260] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:21.216765 18703 raft_consensus.cc:3060] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:21.197868 16946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:21.187506 18719 raft_consensus.cc:2804] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:21.218508 18599 leader_election.cc:290] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:21.209134 18597 raft_consensus.cc:3060] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:21.185782 18722 raft_consensus.cc:515] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:21.479040 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:21.479799 16204 raft_consensus.cc:2468] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 4.
I20260709 13:06:21.480662 18722 leader_election.cc:290] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:21.222220 18719 raft_consensus.cc:493] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:21.481386 18719 raft_consensus.cc:3060] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:21.373667 18596 consensus_meta.cc:287] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3: Time spent flushing consensus metadata: real 0.539s	user 0.016s	sys 0.000s
W20260709 13:06:21.373824 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 289537us
I20260709 13:06:21.374563 18633 leader_election.cc:290] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:06:21.376448 16246 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:21.483336 16246 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:21.472898 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 339499us
I20260709 13:06:21.487687 16322 leader_election.cc:304] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:06:21.488559 18640 raft_consensus.cc:2749] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:21.490051 16322 leader_election.cc:304] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:06:21.491295 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:21.492033 16277 raft_consensus.cc:2468] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 3.
I20260709 13:06:21.495687 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:21.498208 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
W20260709 13:06:21.499233 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:21.501492 16274 raft_consensus.cc:1240] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:21.503456 18640 raft_consensus.cc:2749] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:21.504745 16277 raft_consensus.cc:2410] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:06:21.501430 16914 leader_election.cc:304] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:06:21.515859 18645 raft_consensus.cc:2804] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:21.517362 16277 raft_consensus.cc:1275] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:06:21.517511 18645 raft_consensus.cc:493] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:21.377580 18525 leader_election.cc:290] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:06:21.378397 18700 log.cc:927] Time spent T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.607s	user 0.002s	sys 0.008s
I20260709 13:06:21.518452 16322 leader_election.cc:304] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:21.517973 16103 catalog_manager.cc:5697] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: term changed from 3 to 6, leader changed from 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) to 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68). New cstate: current_term: 6 leader_uuid: "1109f76a0b7b443a84c0327c8707bc63" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:21.379503 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:21.380977 16199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60154 (request call id 1471) took 1568 ms. Trace:
I20260709 13:06:21.519759 16103 catalog_manager.cc:5697] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: term changed from 1 to 5, leader changed from e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) to 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68). New cstate: current_term: 5 leader_uuid: "1109f76a0b7b443a84c0327c8707bc63" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:21.519930 16199 rpcz_store.cc:276] 0709 13:06:19.812849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:19.814652 (+  1803us) service_pool.cc:224] Handling call
0709 13:06:21.281277 (+1466625us) spinlock_profiling.cc:243] Waited 21.1 ms on lock 0x7b5800002a98. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361c224db1 00007f361c364f8c 00007f361c364ef6 0000000000375939 00007f36243d81e0 00007f36244a10c4 00007f36244a1131 00007f3624462fc0 00007f362444d929 00007f362444d3d2 00007f361d9c4bd4
0709 13:06:21.380226 (+ 98949us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:21.380480 (+   254us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:21.380535 (+    55us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:21.380589 (+    54us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:21.380641 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:21.380718 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:21.380893 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":48520320}
I20260709 13:06:21.521512 16103 catalog_manager.cc:5697] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:06:21.383703 16944 raft_consensus.cc:2468] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 6.
I20260709 13:06:21.383975 18706 leader_election.cc:290] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:06:21.386705 18679 log.cc:927] Time spent T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 1.054s	user 0.012s	sys 0.005s
I20260709 13:06:21.522959 18640 raft_consensus.cc:2749] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:21.518008 18645 raft_consensus.cc:3060] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:21.524117 16201 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39674 (request call id 278) took 1649 ms. Trace:
I20260709 13:06:21.524519 16201 rpcz_store.cc:276] 0709 13:06:19.874681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:19.875732 (+  1051us) service_pool.cc:224] Handling call
0709 13:06:19.880682 (+  4950us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:19.881142 (+   460us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:19.881184 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:19.885793 (+  4609us) log.cc:844] Serialized 26 byte log entry
0709 13:06:19.983451 (+ 97658us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:19.983491 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:19.983555 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:21.277704 (+1294149us) spinlock_profiling.cc:243] Waited 1.52 ms on lock 0x7b4400022b4c. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361c224db1 00007f361c2c2c85 00007f361c2c36a2 00007f361f0351db 00007f361f030aaf 00007f361f02486e 00007f361f023bb6 00007f361f0237d8 00007f361f02d221 00007f361f02d1d9 00007f361f02d169
0709 13:06:21.523818 (+246114us) raft_consensus.cc:1685] finished
0709 13:06:21.523841 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:21.524056 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":120,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":3743,"spinlock_wait_cycles":3499392,"thread_start_us":60358,"threads_started":1,"wal-append.queue_time_us":358804}
I20260709 13:06:21.527493 16201 raft_consensus.cc:1240] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 LEADER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:21.528981 16201 raft_consensus.cc:1240] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:21.522938 16103 catalog_manager.cc:5697] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: term changed from 1 to 5, leader changed from e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) to 363bb2f744eb486f9ad726f08214c98e (127.14.180.67). New cstate: current_term: 5 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
W20260709 13:06:21.390220 18674 log.cc:927] Time spent T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63: Append to log took a long time: real 1.169s	user 0.002s	sys 0.002s
I20260709 13:06:21.396380 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:06:21.400486 18701 log.cc:927] Time spent T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.626s	user 0.000s	sys 0.001s
I20260709 13:06:21.404238 18297 raft_consensus.cc:515] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:21.546624 16948 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40078 (request call id 186) took 1681 ms. Trace:
I20260709 13:06:21.547330 18297 leader_election.cc:290] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 5 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:21.379498 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:21.548241 18658 raft_consensus.cc:493] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:21.548843 18658 raft_consensus.cc:515] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:21.406925 18539 raft_consensus.cc:493] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:21.407557 16208 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60138 (request call id 1562) took 1348 ms. Trace:
I20260709 13:06:21.550755 16208 rpcz_store.cc:276] 0709 13:06:20.059471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:20.388290 (+328819us) service_pool.cc:224] Handling call
0709 13:06:20.395729 (+  7439us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:20.464491 (+ 68762us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:20.464524 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:20.464567 (+    43us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:20.464597 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:21.407047 (+942450us) spinlock_profiling.cc:243] Waited 68.6 ms on lock 0x7b54000dc0d4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f489e01 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6
0709 13:06:21.407151 (+   104us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:21.407461 (+   310us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":157674880}
I20260709 13:06:21.551908 16173 leader_election.cc:304] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:21.552194 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:21.553074 18183 raft_consensus.cc:2804] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:21.553709 18183 raft_consensus.cc:697] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 7 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:21.407974 18716 raft_consensus.cc:493] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:21.407621 16946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:21.554252 18658 leader_election.cc:290] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:21.554775 18183 consensus_queue.cc:237] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:21.550419 18539 raft_consensus.cc:515] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:21.426712 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:21.432507 16943 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35106 (request call id 540) took 1326 ms. Trace:
I20260709 13:06:21.557142 16943 rpcz_store.cc:276] 0709 13:06:20.106295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:20.115750 (+  9455us) service_pool.cc:224] Handling call
0709 13:06:21.432257 (+1316507us) spinlock_profiling.cc:243] Waited 317 ms on lock 0x7b54005f0ad4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:06:21.432422 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":729856768}
I20260709 13:06:21.428754 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:21.557919 18539 leader_election.cc:290] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:21.436389 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:21.445317 18559 raft_consensus.cc:993] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e: : Instructing follower 0aea40d6e4374085a2e38a70a71f63e3 to start an election
I20260709 13:06:21.558883 18559 raft_consensus.cc:1081] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 3 LEADER]: Signalling peer 0aea40d6e4374085a2e38a70a71f63e3 to start an election
I20260709 13:06:21.559242 18616 raft_consensus.cc:3055] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:21.448416 16940 raft_consensus.cc:1240] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:21.559633 18616 raft_consensus.cc:740] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:21.560484 18616 consensus_queue.cc:260] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:21.442905 18609 raft_consensus.cc:3055] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:21.449615 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:21.561578 18609 raft_consensus.cc:740] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:21.455684 18647 leader_election.cc:290] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:21.562604 18609 consensus_queue.cc:260] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:21.547035 16948 rpcz_store.cc:276] 0709 13:06:19.865144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:19.869048 (+  3904us) service_pool.cc:224] Handling call
0709 13:06:19.869725 (+   677us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:19.870094 (+   369us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:19.870112 (+    18us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:19.876791 (+  6679us) log.cc:844] Serialized 564 byte log entry
0709 13:06:19.912264 (+ 35473us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:19.912341 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:19.912446 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:21.389451 (+1477005us) spinlock_profiling.cc:243] Waited 3.39 ms on lock 0x7b4400022b4c. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361c224db1 00007f361c2c2c85 00007f361c2c36a2 00007f361f0351db 00007f361f030aaf 00007f361f02486e 00007f361f023bb6 00007f361f0237d8 00007f361f02d221 00007f361f02d1d9 00007f361f02d169
0709 13:06:21.546273 (+156822us) raft_consensus.cc:1685] finished
0709 13:06:21.546301 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:21.546536 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7790976,"thread_start_us":35132,"threads_started":1,"wal-append.queue_time_us":301819}
I20260709 13:06:21.563704 18609 raft_consensus.cc:3060] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:21.564299 16208 raft_consensus.cc:1240] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:21.464809 18310 raft_consensus.cc:3060] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:21.469306 16915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:21.572494 16948 raft_consensus.cc:1275] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:06:21.577592 16355 raft_consensus.cc:2468] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 4.
I20260709 13:06:21.577726 18616 raft_consensus.cc:3060] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:21.581442 16249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:21.557833 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:21.582957 16202 raft_consensus.cc:2468] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 5.
I20260709 13:06:21.193814 18217 raft_consensus.cc:493] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:21.480860 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:21.482295 18718 raft_consensus.cc:3055] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:21.587705 16940 raft_consensus.cc:1275] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:21.587807 18718 raft_consensus.cc:740] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
W20260709 13:06:21.588340 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 69983us
I20260709 13:06:21.588440 18217 raft_consensus.cc:515] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:21.589228 16322 leader_election.cc:304] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:06:21.535234 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:21.537663 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:21.590647 16948 raft_consensus.cc:1275] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:06:21.538919 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:21.591586 16282 raft_consensus.cc:2468] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 6.
W20260709 13:06:21.591941 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 52037.6us
I20260709 13:06:21.539564 16320 leader_election.cc:304] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:21.554843 18716 raft_consensus.cc:515] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:21.453919 18573 consensus_queue.cc:1048] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:21.595124 18706 consensus_queue.cc:1059] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:21.597003 18573 raft_consensus.cc:2955] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 LEADER]: Committing config change with OpId 4.5: config changed from index 2 to 5, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:06:21.600051 18539 raft_consensus.cc:2749] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:21.594354 18716 leader_election.cc:290] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:21.588975 18718 consensus_queue.cc:260] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:21.601106 18718 raft_consensus.cc:3060] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:21.605541 16940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:21.605517 16946 raft_consensus.cc:2955] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 2 to 5, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:06:21.387809 18650 raft_consensus.cc:515] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:21.607940 16948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:21.607975 18539 raft_consensus.cc:2804] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:06:21.606909 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 67444.1us
W20260709 13:06:21.609724 16247 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:21.610733 16321 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:21.610916 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 73029.3us
I20260709 13:06:21.611930 18702 raft_consensus.cc:3055] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:21.612357 18702 raft_consensus.cc:740] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:21.613237 18702 consensus_queue.cc:260] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:21.613696 16173 leader_election.cc:304] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:21.610250 18539 raft_consensus.cc:493] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:21.615558 18539 raft_consensus.cc:3060] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:21.614940 18724 raft_consensus.cc:2804] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:21.618021 18724 raft_consensus.cc:697] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:21.619113 16948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f022e2e63ae4461d834e476ff2666991" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:21.619029 18724 consensus_queue.cc:237] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:21.619879 16948 raft_consensus.cc:2468] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 4.
I20260709 13:06:21.622928 18702 raft_consensus.cc:3060] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:21.629971 16173 leader_election.cc:304] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
W20260709 13:06:21.643471 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 54327.5us
I20260709 13:06:21.644457 16912 leader_election.cc:304] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
W20260709 13:06:21.649492 16246 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:21.651292 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:21.652076 16275 raft_consensus.cc:3060] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:21.643951 16103 catalog_manager.cc:5697] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: term changed from 1 to 4, leader changed from 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) to 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68). New cstate: current_term: 4 leader_uuid: "1109f76a0b7b443a84c0327c8707bc63" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:21.662299 16173 leader_election.cc:304] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:21.665150 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:21.592350 18217 leader_election.cc:290] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:21.673454 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:06:21.675693 16173 leader_election.cc:336] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 1.662s (SENT)
I20260709 13:06:21.681300 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
W20260709 13:06:21.731184 16105 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38842 (request call id 211) took 14035 ms (client timeout 15000 ms). Trace:
I20260709 13:06:21.758013 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f022e2e63ae4461d834e476ff2666991" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:21.774744 16277 raft_consensus.cc:2468] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 4.
W20260709 13:06:21.776659 18693 log.cc:927] Time spent T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260709 13:06:21.674096 18658 consensus_queue.cc:1048] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.109s
I20260709 13:06:21.734122 18650 leader_election.cc:290] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:21.670606 18720 consensus_queue.cc:1048] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.107s
I20260709 13:06:21.668185 18647 consensus_queue.cc:1048] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.114s
W20260709 13:06:21.778559 18674 log.cc:927] Time spent T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 13:06:21.663932 18690 raft_consensus.cc:2804] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:21.779824 18690 raft_consensus.cc:697] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:21.781116 18690 consensus_queue.cc:237] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:21.684541 18667 raft_consensus.cc:2804] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:21.783440 18667 raft_consensus.cc:493] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:21.784168 18667 raft_consensus.cc:3060] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:21.683809 16322 leader_election.cc:304] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:06:21.510234 18719 raft_consensus.cc:515] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:06:21.787704 16247 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:21.771360 16173 leader_election.cc:304] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
W20260709 13:06:21.788898 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 113225us
I20260709 13:06:21.789036 18719 leader_election.cc:290] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 5 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:06:21.789798 16173 leader_election.cc:336] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 1.783s (SENT)
W20260709 13:06:21.790871 16173 leader_election.cc:336] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 1.811s (SENT)
I20260709 13:06:21.792490 18650 raft_consensus.cc:2749] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:21.667739 18493 consensus_queue.cc:1048] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.130s
W20260709 13:06:21.787704 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 103999us
I20260709 13:06:21.802246 16947 raft_consensus.cc:2393] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 5: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
I20260709 13:06:21.676720 16103 catalog_manager.cc:5697] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: term changed from 1 to 4, leader changed from e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) to 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68). New cstate: current_term: 4 leader_uuid: "1109f76a0b7b443a84c0327c8707bc63" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:21.805639 16322 leader_election.cc:304] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:21.805750 16103 catalog_manager.cc:5697] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: term changed from 3 to 4, leader changed from 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) to 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66). New cstate: current_term: 4 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:06:21.792770 16173 leader_election.cc:304] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
W20260709 13:06:21.741895 18744 log.cc:927] Time spent T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
I20260709 13:06:21.797791 16275 raft_consensus.cc:2468] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 5.
W20260709 13:06:21.772270 16105 rpcz_store.cc:269] 0709 13:06:07.695859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:07.696196 (+   337us) service_pool.cc:224] Handling call
0709 13:06:21.731086 (+14034890us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:18.221042 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:18.222017 (+   975us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:18.222093 (+    76us) write_op.cc:435] Acquired schema lock
0709 13:06:18.222114 (+    21us) tablet.cc:662] Decoding operations
0709 13:06:18.222948 (+   834us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:18.223034 (+    86us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:18.223066 (+    32us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:06:18.223675 (+   609us) tablet.cc:701] Row locks acquired
0709 13:06:18.223719 (+    44us) write_op.cc:260] PREPARE: finished
0709 13:06:18.223895 (+   176us) write_op.cc:270] Start()
0709 13:06:18.224054 (+   159us) write_op.cc:276] Timestamp: P: 1783602378223829 usec, L: 0
0709 13:06:18.224088 (+    34us) op_driver.cc:348] REPLICATION: starting
0709 13:06:18.224895 (+   807us) log.cc:844] Serialized 1764 byte log entry
0709 13:06:19.404580 (+1179685us) spinlock_profiling.cc:243] Waited 4.78 ms on lock 0x7b4400022b4c. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361c224db1 00007f361c2c2c85 00007f361c2c36a2 00007f361f0351db 00007f361f030aaf 00007f361f02486e 00007f361f023bb6 00007f361f0237d8 00007f361f02d221 00007f361f02d1d9 00007f361f02d169
0709 13:06:19.654138 (+249558us) op_driver.cc:464] REPLICATION: finished
0709 13:06:19.845863 (+191725us) write_op.cc:301] APPLY: starting
0709 13:06:19.857235 (+ 11372us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:19.883766 (+ 26531us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:19.890895 (+  7129us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:19.921771 (+ 30876us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:19.922075 (+   304us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 13:06:19.922147 (+    72us) write_op.cc:312] APPLY: finished
0709 13:06:20.005785 (+ 83638us) log.cc:844] Serialized 41 byte log entry
0709 13:06:20.005994 (+   209us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:20.006098 (+   104us) write_op.cc:454] Released schema lock
0709 13:06:20.006154 (+    56us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:20.006529 (+   375us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:20.006578 (+    49us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":31,"child_traces":[["op",{"apply.queue_time_us":128814,"apply.run_cpu_time_us":3891,"apply.run_wall_time_us":208034,"num_ops":4,"prepare.queue_time_us":409149,"prepare.run_cpu_time_us":16161,"prepare.run_wall_time_us":190943,"raft.queue_time_us":83516,"raft.run_cpu_time_us":32194,"raft.run_wall_time_us":98645,"replication_time_us":1429853,"spinlock_wait_cycles":11040512,"thread_start_us":558650,"threads_started":4,"wal-append.queue_time_us":207885,"wal-append.run_cpu_time_us":20704,"wal-append.run_wall_time_us":2649534}]]}
I20260709 13:06:21.815948 18493 raft_consensus.cc:493] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:21.840430 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 49589.6us
I20260709 13:06:21.816617 18650 raft_consensus.cc:493] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:21.816220 18380 raft_consensus.cc:2749] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:21.840090 18730 raft_consensus.cc:2749] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:21.856462 16355 raft_consensus.cc:1275] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
W20260709 13:06:21.851814 16173 leader_election.cc:336] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 1.840s (SENT)
I20260709 13:06:21.857947 16173 leader_election.cc:304] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:21.857018 18597 raft_consensus.cc:515] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:21.842531 16103 catalog_manager.cc:5697] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: term changed from 1 to 3, leader changed from e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) to 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68). New cstate: current_term: 3 leader_uuid: "1109f76a0b7b443a84c0327c8707bc63" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:21.819532 18720 raft_consensus.cc:2749] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:21.819633 18555 consensus_queue.cc:1048] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:06:21.856056 18297 raft_consensus.cc:2804] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:21.863235 18730 raft_consensus.cc:2749] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:21.862694 16103 catalog_manager.cc:5697] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: term changed from 2 to 4, leader changed from 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) to 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68). New cstate: current_term: 4 leader_uuid: "1109f76a0b7b443a84c0327c8707bc63" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:06:21.864212 16173 leader_election.cc:336] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 1.851s (SENT)
I20260709 13:06:21.730783 18217 consensus_queue.cc:1048] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.130s
I20260709 13:06:21.876438 16173 leader_election.cc:304] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
W20260709 13:06:21.879230 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 105333us
I20260709 13:06:21.877549 16103 catalog_manager.cc:5697] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: term changed from 1 to 2, leader changed from e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) to 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68). New cstate: current_term: 2 leader_uuid: "1109f76a0b7b443a84c0327c8707bc63" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:21.880087 16246 leader_election.cc:304] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:21.881569 16246 leader_election.cc:304] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:21.881042 16103 catalog_manager.cc:5697] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: term changed from 1 to 4, leader changed from e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) to 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68). New cstate: current_term: 4 leader_uuid: "1109f76a0b7b443a84c0327c8707bc63" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:21.883401 16103 catalog_manager.cc:5697] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "1109f76a0b7b443a84c0327c8707bc63" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:21.889745 16103 catalog_manager.cc:5697] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: term changed from 1 to 2, leader changed from 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) to 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68). New cstate: current_term: 2 leader_uuid: "1109f76a0b7b443a84c0327c8707bc63" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:21.894371 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:21.894963 16173 leader_election.cc:304] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:21.854323 18493 raft_consensus.cc:515] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:21.883103 18537 raft_consensus.cc:2749] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:21.882652 18706 raft_consensus.cc:2749] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:21.860462 18650 raft_consensus.cc:515] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:21.888554 18599 raft_consensus.cc:2749] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:21.910367 16355 raft_consensus.cc:1275] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:06:21.905625 18730 raft_consensus.cc:2804] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:21.879416 18539 raft_consensus.cc:515] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:21.941044 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:21.941838 16351 raft_consensus.cc:2368] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 6. Current term is 7.
W20260709 13:06:21.950413 18746 log.cc:927] Time spent T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.241s	user 0.002s	sys 0.000s
I20260709 13:06:21.963521 18297 raft_consensus.cc:493] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:21.962776 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:21.940124 18730 raft_consensus.cc:493] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:21.968420 18745 log.cc:927] Time spent T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.185s	user 0.001s	sys 0.001s
I20260709 13:06:21.968541 18730 raft_consensus.cc:3060] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:21.966364 18297 raft_consensus.cc:3060] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:21.971880 18645 raft_consensus.cc:515] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:21.973316 16941 raft_consensus.cc:2393] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 4: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
I20260709 13:06:21.902052 18720 consensus_queue.cc:1048] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 13:06:21.986932 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:21.987790 16206 raft_consensus.cc:3060] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:21.981155 16915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:21.985685 16246 leader_election.cc:304] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:21.994379 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:21.994167 18395 raft_consensus.cc:493] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:21.996883 16355 raft_consensus.cc:2393] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 6: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:06:21.998834 16914 leader_election.cc:304] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:06:21.974511 18645 leader_election.cc:290] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 4 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:21.959403 18650 leader_election.cc:290] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:06:21.974720 16941 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40078 (request call id 187) took 2109 ms (client timeout 2207 ms). Trace:
W20260709 13:06:22.013624 16246 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:22.002910 16203 raft_consensus.cc:2955] T b9e1324823f04d8da5a4b3ddbd061c0e P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 2 to 5, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:06:21.976269 18702 raft_consensus.cc:493] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:21.977387 18539 leader_election.cc:290] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:21.975649 18573 raft_consensus.cc:493] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:22.012905 16206 raft_consensus.cc:2468] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 5.
I20260709 13:06:21.997550 18572 raft_consensus.cc:2749] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:22.020757 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:22.024775 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:22.005823 18336 raft_consensus.cc:2804] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:22.025353 16320 leader_election.cc:304] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:22.025931 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:22.026137 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:22.031968 16275 raft_consensus.cc:3060] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:22.032166 16279 raft_consensus.cc:2393] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 in current term 5: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:06:22.028906 18573 raft_consensus.cc:515] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:22.033826 18555 raft_consensus.cc:2804] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:21.981019 18667 raft_consensus.cc:515] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:06:22.036759 16912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:22.005250 18395 raft_consensus.cc:515] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:22.036541 18555 raft_consensus.cc:697] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 5 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:06:22.045583 16275 raft_consensus.cc:2468] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 4.
I20260709 13:06:22.038759 18336 raft_consensus.cc:697] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 LEADER]: Becoming Leader. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:06:22.026538 18702 raft_consensus.cc:515] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:22.080880 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bc3c8ff9b84838a2664335d7e1582b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:06:22.100982 16173 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:22.101673 16246 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:22.111956 16247 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:22.122929 16321 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:22.047389 18597 leader_election.cc:290] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:06:22.135701 18751 log.cc:927] Time spent T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63: Append to log took a long time: real 0.152s	user 0.000s	sys 0.001s
I20260709 13:06:22.135267 18336 consensus_queue.cc:237] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:06:22.137356 18753 log.cc:927] Time spent T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
W20260709 13:06:22.138588 18750 log.cc:927] Time spent T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.147s	user 0.001s	sys 0.000s
I20260709 13:06:22.140259 16353 raft_consensus.cc:1240] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260709 13:06:22.018846 16941 rpcz_store.cc:269] 0709 13:06:19.865575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:19.872615 (+  7040us) service_pool.cc:224] Handling call
0709 13:06:21.291309 (+1418694us) spinlock_profiling.cc:243] Waited 6.91 ms on lock 0x7b58001a3d98. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361c224db1 00007f361c364b71 00007f361c364eee 0000000000375939 00007f36243d81e0 00007f36244a10c4 00007f36244a1131 00007f362444f0a0 00007f362444e984 00007f361d9c96d4 00007f361d9c9662
0709 13:06:21.974458 (+683149us) spinlock_profiling.cc:243] Waited 453 ms on lock 0x7b54001faed4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:06:21.974634 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1058542208}
I20260709 13:06:22.132315 18706 raft_consensus.cc:493] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:22.050164 18555 consensus_queue.cc:237] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:22.202909 16355 raft_consensus.cc:2468] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 6.
W20260709 13:06:22.216023 16248 leader_election.cc:336] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 2.837s (SENT)
W20260709 13:06:22.225085 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:22.163311 18706 raft_consensus.cc:515] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:22.246835 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:06:22.255043 18756 log.cc:927] Time spent T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 13:06:22.264057 18650 raft_consensus.cc:493] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:22.264739 18650 raft_consensus.cc:515] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:06:22.265815 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 63562.1us
I20260709 13:06:22.267424 18395 leader_election.cc:290] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:22.280118 16948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
W20260709 13:06:22.281381 16247 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:22.284677 16948 raft_consensus.cc:2393] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 4: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
I20260709 13:06:22.294001 16353 raft_consensus.cc:1240] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:22.274829 18493 leader_election.cc:290] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:22.262290 18730 raft_consensus.cc:515] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:22.303470 16199 raft_consensus.cc:2393] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 7: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:06:22.291709 18667 leader_election.cc:290] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:22.317408 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:22.318213 16200 raft_consensus.cc:2368] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 4. Current term is 5.
I20260709 13:06:22.320106 18706 leader_election.cc:290] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:22.323035 18297 raft_consensus.cc:515] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:22.325919 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:22.327507 16348 raft_consensus.cc:1240] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:22.327980 18702 leader_election.cc:290] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:22.328516 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bc3c8ff9b84838a2664335d7e1582b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:22.329917 18730 leader_election.cc:290] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:22.330077 16348 raft_consensus.cc:1275] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:06:22.330791 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:22.331751 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:22.332466 18573 leader_election.cc:290] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:22.332894 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:22.333938 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:22.335302 16354 raft_consensus.cc:1240] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:06:22.335795 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:22.336311 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:22.336988 16354 raft_consensus.cc:3060] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:22.338343 16948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f022e2e63ae4461d834e476ff2666991" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:06:22.338891 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:22.339737 16357 raft_consensus.cc:2393] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 4: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:06:22.340590 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:22.341737 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:22.338927 16948 raft_consensus.cc:3060] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:22.336381 16356 raft_consensus.cc:2468] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 6.
I20260709 13:06:22.334519 16350 raft_consensus.cc:2468] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 4.
I20260709 13:06:22.356499 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:22.357338 16348 raft_consensus.cc:2393] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 4: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:06:22.387980 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:22.388913 16350 raft_consensus.cc:2468] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 6.
I20260709 13:06:22.299532 18650 leader_election.cc:290] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:22.386699 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:22.394330 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:22.395116 16279 raft_consensus.cc:3060] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:22.396660 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:22.397563 16350 raft_consensus.cc:2468] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 4.
I20260709 13:06:22.400552 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:22.411433 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:22.412534 16357 raft_consensus.cc:2376] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 6. Re-sending same reply.
I20260709 13:06:22.418064 16354 raft_consensus.cc:2468] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 5.
I20260709 13:06:22.421132 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:22.421183 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:22.421896 16356 raft_consensus.cc:3060] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:22.422530 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:06:22.425976 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 71273.3us
I20260709 13:06:22.426273 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:22.427385 16348 raft_consensus.cc:2468] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 5.
I20260709 13:06:22.428855 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:22.430182 16357 raft_consensus.cc:3060] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:22.424110 16354 raft_consensus.cc:2376] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 5. Re-sending same reply.
I20260709 13:06:22.432329 16275 raft_consensus.cc:1275] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:06:22.432793 16275 pending_rounds.cc:85] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3: Aborting all ops after (but not including) 5
I20260709 13:06:22.433073 16275 pending_rounds.cc:107] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:06:22.433336 16275 raft_consensus.cc:2889] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:22.436275 16941 raft_consensus.cc:1275] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:06:22.436354 16940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:22.437765 16940 raft_consensus.cc:2468] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 6.
I20260709 13:06:22.439991 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f022e2e63ae4461d834e476ff2666991" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:22.440212 16947 raft_consensus.cc:1240] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:22.440642 16277 raft_consensus.cc:3060] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:22.442148 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:22.479143 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:22.479900 16350 raft_consensus.cc:2376] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 5. Re-sending same reply.
W20260709 13:06:22.486362 16246 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:22.411875 18297 leader_election.cc:290] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 6 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:22.497085 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:22.500941 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:22.502460 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:22.505573 16948 raft_consensus.cc:2468] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 5.
I20260709 13:06:22.508396 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:22.508481 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:22.509466 16199 raft_consensus.cc:2468] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 5.
I20260709 13:06:22.509877 16356 raft_consensus.cc:2468] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 6.
I20260709 13:06:22.510768 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:22.512194 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:22.514885 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:22.515445 16281 raft_consensus.cc:2393] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 7: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:06:22.520337 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:22.521581 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bc3c8ff9b84838a2664335d7e1582b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:22.522938 16276 raft_consensus.cc:2393] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 6: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:06:22.524403 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:22.525056 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:22.525238 16276 raft_consensus.cc:2468] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 3.
I20260709 13:06:22.526217 16278 raft_consensus.cc:2393] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 5: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
W20260709 13:06:22.527379 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 442505us
W20260709 13:06:22.534132 16321 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:22.536679 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:22.536835 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:22.539904 16947 raft_consensus.cc:1240] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:06:22.539811 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:22.543166 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:22.545706 16283 raft_consensus.cc:1240] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:22.550947 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:22.555299 16941 raft_consensus.cc:1240] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:22.555686 18702 consensus_queue.cc:1048] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:22.522742 16940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:22.559865 16940 raft_consensus.cc:2468] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 5.
I20260709 13:06:22.538039 18597 raft_consensus.cc:493] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:22.562206 16276 raft_consensus.cc:1240] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:06:22.561928 18597 raft_consensus.cc:515] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:22.563284 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:22.563876 16276 raft_consensus.cc:3060] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:06:22.564162 18597 leader_election.cc:290] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:22.565265 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:22.566782 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:22.567665 16275 raft_consensus.cc:1275] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:06:22.568640 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:22.569597 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:22.570710 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
W20260709 13:06:22.572013 16912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:22.573161 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:22.580379 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:22.586223 16279 raft_consensus.cc:2468] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 7.
I20260709 13:06:22.588629 16357 raft_consensus.cc:2468] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 5.
I20260709 13:06:22.557924 18702 consensus_queue.cc:1048] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:22.589919 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:22.590695 16277 raft_consensus.cc:2468] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 5.
I20260709 13:06:22.598901 16205 raft_consensus.cc:1240] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 LEADER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 5. Current term is 6. Ops: []
W20260709 13:06:22.603749 16915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:22.605028 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:22.604483 16348 raft_consensus.cc:2468] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 4.
I20260709 13:06:22.605690 16350 raft_consensus.cc:3060] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:22.605804 16278 raft_consensus.cc:1240] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:22.607138 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:22.607818 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:22.608484 16356 raft_consensus.cc:2393] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 5: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:06:22.608240 16322 leader_election.cc:304] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:06:22.608247 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:22.613837 16354 raft_consensus.cc:3060] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:22.606889 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:22.614399 16348 raft_consensus.cc:2468] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 4.
I20260709 13:06:22.630750 16948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:22.566902 16281 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7295dce0baa440b8a197da845581ee81"
dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
 from {username='slave'} at 127.0.0.1:45210
I20260709 13:06:22.631429 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:22.631899 16281 raft_consensus.cc:493] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:22.632424 16281 raft_consensus.cc:3060] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:22.632490 16357 raft_consensus.cc:2393] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 5: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:06:22.634050 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:22.637518 16322 leader_election.cc:304] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:22.638589 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:22.639369 16356 raft_consensus.cc:2393] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 6: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:06:22.639410 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:22.641502 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:22.645233 16350 raft_consensus.cc:2468] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 5.
I20260709 13:06:22.646327 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:22.645110 16348 raft_consensus.cc:2376] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 7. Re-sending same reply.
I20260709 13:06:22.609882 18537 raft_consensus.cc:493] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:22.630565 18597 raft_consensus.cc:2764] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:06:22.657814 16357 raft_consensus.cc:3060] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:22.658330 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:22.671329 16357 raft_consensus.cc:2468] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 7.
I20260709 13:06:22.672298 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:22.674126 16348 raft_consensus.cc:2468] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 6.
I20260709 13:06:22.675666 16350 raft_consensus.cc:2468] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 4.
I20260709 13:06:22.676885 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:22.678865 16356 raft_consensus.cc:2376] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 5. Re-sending same reply.
I20260709 13:06:22.676692 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:22.682035 16357 raft_consensus.cc:2393] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 in current term 4: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:06:22.704044 16276 raft_consensus.cc:2468] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 5.
I20260709 13:06:22.704030 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:22.705752 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:06:22.707418 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 302486us
I20260709 13:06:22.709779 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:22.649916 18493 consensus_queue.cc:1059] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:06:22.679653 18539 raft_consensus.cc:2749] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:22.720235 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
W20260709 13:06:22.714448 16247 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:22.704396 18764 log.cc:927] Time spent T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.319s	user 0.000s	sys 0.001s
I20260709 13:06:22.680744 16941 raft_consensus.cc:1240] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 LEADER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:06:22.716097 16357 raft_consensus.cc:2468] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 6.
I20260709 13:06:22.735787 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:22.735836 16948 raft_consensus.cc:1275] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:06:22.736976 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:22.734712 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:22.674186 18537 raft_consensus.cc:515] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:22.741040 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:22.741637 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:22.742177 16357 raft_consensus.cc:3060] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:22.742590 16348 raft_consensus.cc:2468] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 5.
W20260709 13:06:22.748327 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 249681us
I20260709 13:06:22.749133 16354 raft_consensus.cc:2468] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 7.
W20260709 13:06:22.747133 16173 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:22.755870 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bc3c8ff9b84838a2664335d7e1582b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:22.788040 16246 leader_election.cc:400] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 pre-election: Vote denied by peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073) with higher term. Message: Invalid argument: T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 4. Current term is 5.
I20260709 13:06:22.788335 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:22.788542 16246 leader_election.cc:403] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:22.788574 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:22.789127 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:22.789775 16348 raft_consensus.cc:2468] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 3.
W20260709 13:06:22.793306 16247 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:22.795102 16173 leader_election.cc:304] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
W20260709 13:06:22.801416 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 49795.8us
I20260709 13:06:22.802000 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:22.802821 16354 raft_consensus.cc:2393] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 in current term 5: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:06:22.802711 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:22.803972 16356 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4"
dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
mode: GRACEFUL
new_leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
 from {username='slave'} at 127.0.0.1:56792
I20260709 13:06:22.804746 16356 raft_consensus.cc:606] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Received request to transfer leadership to TS 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:06:22.805224 16356 raft_consensus.cc:614] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:22.804824 16246 leader_election.cc:304] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:22.806272 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:22.809746 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:22.810448 16350 raft_consensus.cc:2468] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 6.
W20260709 13:06:22.748436 18760 log.cc:927] Time spent T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.340s	user 0.002s	sys 0.000s
I20260709 13:06:22.817716 16357 raft_consensus.cc:2468] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 7.
I20260709 13:06:22.822772 16354 raft_consensus.cc:1240] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:22.823189 16357 raft_consensus.cc:1275] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:06:22.824290 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:22.809283 18702 raft_consensus.cc:2749] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073) with higher term. Message: Invalid argument: T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 4. Current term is 5.
W20260709 13:06:22.826372 18765 log.cc:927] Time spent T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.189s	user 0.001s	sys 0.000s
I20260709 13:06:22.731424 18310 consensus_queue.cc:1059] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.078s
I20260709 13:06:22.828356 18310 consensus_queue.cc:1243] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer e10b16d536674c0bb350a31d7ce5ff7f log is divergent from this leader: its last log entry 6.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:06:22.830520 16351 raft_consensus.cc:1275] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:06:22.831969 16351 raft_consensus.cc:1240] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:22.833364 16351 raft_consensus.cc:1275] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:06:22.834744 16351 raft_consensus.cc:1275] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:06:22.836064 16351 raft_consensus.cc:1275] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:06:22.837170 16351 raft_consensus.cc:3055] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:22.837517 16351 raft_consensus.cc:740] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
W20260709 13:06:22.839290 18767 log.cc:927] Time spent T b9e1324823f04d8da5a4b3ddbd061c0e P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 13:06:22.842038 18716 raft_consensus.cc:2804] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:22.841948 18217 raft_consensus.cc:493] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:22.842847 18716 raft_consensus.cc:493] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:22.843850 16354 raft_consensus.cc:1240] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:22.826407 16350 raft_consensus.cc:1275] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:06:22.838403 16351 consensus_queue.cc:260] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:22.865877 16351 raft_consensus.cc:3060] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:22.868305 16246 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:22.865267 16281 raft_consensus.cc:515] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:22.843327 18716 raft_consensus.cc:3060] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:22.877934 16281 leader_election.cc:290] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 election: Requested vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:06:22.879732 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 242307us
I20260709 13:06:22.865384 18724 raft_consensus.cc:2804] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:22.843039 18217 raft_consensus.cc:515] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:22.817320 18647 consensus_queue.cc:1048] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 13:06:22.886713 16322 leader_election.cc:304] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:06:22.889508 16357 raft_consensus.cc:1240] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:22.971696 16914 leader_election.cc:304] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:06:22.973771 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 62219.2us
I20260709 13:06:22.980947 16351 raft_consensus.cc:1275] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 13:06:22.981412 16351 pending_rounds.cc:85] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e: Aborting all ops after (but not including) 5
I20260709 13:06:22.981658 16351 pending_rounds.cc:107] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 13:06:22.981909 16351 raft_consensus.cc:2889] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:06:22.986529 18773 log.cc:927] Time spent T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
I20260709 13:06:22.999097 16283 raft_consensus.cc:1275] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:06:22.910424 18380 consensus_queue.cc:1059] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.091s
I20260709 13:06:22.983479 18644 consensus_queue.cc:1048] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
W20260709 13:06:23.004283 18770 log.cc:927] Time spent T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
I20260709 13:06:22.941607 18539 raft_consensus.cc:2764] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:06:23.004997 18217 leader_election.cc:290] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:06:23.003453 18772 log.cc:927] Time spent T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 13:06:23.010205 16914 leader_election.cc:304] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:22.887247 18724 raft_consensus.cc:697] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:22.996941 18719 raft_consensus.cc:2804] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:06:23.023417 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 367844us
I20260709 13:06:23.024703 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:23.026100 16278 raft_consensus.cc:2468] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 6.
I20260709 13:06:23.029994 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:23.028679 16914 leader_election.cc:304] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:06:23.034513 16914 leader_election.cc:304] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:06:23.036437 16914 leader_election.cc:304] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:23.037984 16914 leader_election.cc:304] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 363bb2f744eb486f9ad726f08214c98e
W20260709 13:06:23.041599 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 246591us
I20260709 13:06:22.986009 18650 consensus_queue.cc:1059] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
W20260709 13:06:23.045455 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 495185us
I20260709 13:06:23.029531 18609 raft_consensus.cc:493] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:23.027901 18539 raft_consensus.cc:3055] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:23.027313 18719 raft_consensus.cc:493] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:23.032122 18644 raft_consensus.cc:2749] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:06:23.087294 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 53091.3us
I20260709 13:06:23.090341 16248 leader_election.cc:304] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:23.034744 18537 leader_election.cc:290] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:23.040218 18297 raft_consensus.cc:2804] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:23.033789 18542 raft_consensus.cc:2804] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:23.043978 18640 raft_consensus.cc:493] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:23.039947 18525 raft_consensus.cc:2749] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:23.050824 18395 raft_consensus.cc:2804] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:06:23.190907 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 59751.5us
W20260709 13:06:23.194761 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 104513us
I20260709 13:06:23.195899 16248 leader_election.cc:304] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:23.119030 18719 raft_consensus.cc:3060] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:23.202639 16173 leader_election.cc:304] T b9e1324823f04d8da5a4b3ddbd061c0e P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:06:23.121094 18706 raft_consensus.cc:493] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:23.084002 18539 raft_consensus.cc:740] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:06:23.209517 16248 leader_election.cc:304] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:23.232786 18711 raft_consensus.cc:2749] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:23.050520 18774 consensus_queue.cc:1048] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.149s
I20260709 13:06:23.233388 16173 leader_election.cc:304] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
W20260709 13:06:23.190400 18772 log.cc:927] Time spent T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:06:23.126516 18573 raft_consensus.cc:493] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:23.233605 18781 log.cc:927] Time spent T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
I20260709 13:06:23.275470 18573 raft_consensus.cc:515] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:23.278890 18573 leader_election.cc:290] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:23.241926 16248 leader_election.cc:304] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:23.128261 18724 consensus_queue.cc:237] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:23.284171 16248 leader_election.cc:304] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63
W20260709 13:06:23.240350 16322 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:23.286592 16322 leader_election.cc:304] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:23.246304 16173 leader_election.cc:304] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:23.094696 18609 raft_consensus.cc:515] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:23.206923 18599 raft_consensus.cc:2749] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:23.082193 18217 consensus_queue.cc:1059] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.168s
I20260709 13:06:23.259991 18797 raft_consensus.cc:2804] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:06:23.261122 18775 log.cc:927] Time spent T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.250s	user 0.000s	sys 0.001s
W20260709 13:06:23.279215 18778 log.cc:927] Time spent T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.268s	user 0.001s	sys 0.000s
I20260709 13:06:23.185395 18796 consensus_queue.cc:1059] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.117s
I20260709 13:06:23.128978 18542 raft_consensus.cc:493] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:23.308430 16353 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41830 (request call id 1512) took 1011 ms. Trace:
I20260709 13:06:23.308485 18542 raft_consensus.cc:3060] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:23.308995 18217 consensus_queue.cc:1243] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer 363bb2f744eb486f9ad726f08214c98e log is divergent from this leader: its last log entry 4.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:06:23.309669 18217 raft_consensus.cc:3060] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:23.289503 16322 leader_election.cc:304] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:23.308907 16353 rpcz_store.cc:276] 0709 13:06:22.296786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:22.296998 (+   212us) service_pool.cc:224] Handling call
0709 13:06:22.303512 (+  6514us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:22.303748 (+   236us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:22.303775 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:22.313240 (+  9465us) log.cc:844] Serialized 26 byte log entry
0709 13:06:22.704296 (+391056us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:23.020114 (+315818us) log.cc:844] Serialized 14 byte log entry
0709 13:06:23.238966 (+218852us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:23.239066 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:23.308203 (+ 69137us) raft_consensus.cc:1685] finished
0709 13:06:23.308227 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:23.308368 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43776,"prepare.queue_time_us":137193,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":106781,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":35380,"thread_start_us":752902,"threads_started":3,"wal-append.queue_time_us":491323}
I20260709 13:06:23.293998 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:23.311208 18603 raft_consensus.cc:2804] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:23.311558 16348 raft_consensus.cc:2376] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 7. Re-sending same reply.
I20260709 13:06:23.311673 18603 raft_consensus.cc:493] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:23.312094 18603 raft_consensus.cc:3060] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:23.234769 18690 raft_consensus.cc:2804] T b9e1324823f04d8da5a4b3ddbd061c0e P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:23.284353 18616 raft_consensus.cc:2749] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:23.193825 18640 raft_consensus.cc:515] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:23.300189 18539 consensus_queue.cc:260] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:23.293277 18784 raft_consensus.cc:2749] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:23.305544 18609 leader_election.cc:290] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:23.296108 18573 consensus_queue.cc:1048] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 13:06:23.306753 18797 raft_consensus.cc:493] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:23.315024 16322 leader_election.cc:304] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:23.222882 18647 consensus_queue.cc:1048] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.075s
W20260709 13:06:23.362454 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 47547.9us
W20260709 13:06:23.316294 18763 log.cc:927] Time spent T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 13:06:23.366930 16322 leader_election.cc:304] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:23.373611 16322 leader_election.cc:304] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:23.242426 18706 raft_consensus.cc:515] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:06:23.327754 18759 log.cc:927] Time spent T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:06:23.398592 16322 leader_election.cc:304] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:23.328014 18597 raft_consensus.cc:2749] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:06:23.403522 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 157333us
I20260709 13:06:23.329344 18690 raft_consensus.cc:493] T b9e1324823f04d8da5a4b3ddbd061c0e P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:23.408437 16173 leader_election.cc:304] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:06:23.366113 18797 raft_consensus.cc:3060] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:23.414342 16173 leader_election.cc:304] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:06:23.404786 18539 raft_consensus.cc:3060] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:23.365814 18786 raft_consensus.cc:2749] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:23.419670 16173 leader_election.cc:304] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
W20260709 13:06:23.366874 16247 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:23.365072 18599 raft_consensus.cc:3055] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:23.421241 16173 leader_election.cc:304] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:23.414790 18690 raft_consensus.cc:3060] T b9e1324823f04d8da5a4b3ddbd061c0e P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:23.402508 18807 raft_consensus.cc:2749] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:23.419857 18784 raft_consensus.cc:2749] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:23.420059 18774 raft_consensus.cc:3060] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:23.437434 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 153356us
I20260709 13:06:23.422036 18599 raft_consensus.cc:740] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:23.443557 16248 leader_election.cc:304] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:23.429992 18597 raft_consensus.cc:2749] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:23.439150 18650 consensus_queue.cc:1243] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer 1109f76a0b7b443a84c0327c8707bc63 log is divergent from this leader: its last log entry 5.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:06:23.447238 16248 leader_election.cc:304] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:23.451290 18599 consensus_queue.cc:260] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:23.484799 16248 leader_election.cc:304] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:23.454726 18730 raft_consensus.cc:2804] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:23.455482 18813 raft_consensus.cc:2804] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:23.494143 18813 raft_consensus.cc:697] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:23.495251 18813 consensus_queue.cc:237] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:23.497352 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:23.498715 18730 raft_consensus.cc:697] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 7 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:23.499930 18599 raft_consensus.cc:3060] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:23.499768 18730 consensus_queue.cc:237] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:23.455541 18706 leader_election.cc:290] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:23.456166 18667 raft_consensus.cc:2804] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:06:23.463713 18787 log.cc:927] Time spent T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.136s	user 0.002s	sys 0.000s
W20260709 13:06:23.465124 18780 log.cc:927] Time spent T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.579s	user 0.002s	sys 0.000s
I20260709 13:06:23.430181 18786 consensus_queue.cc:1059] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
W20260709 13:06:23.467677 18716 consensus_meta.cc:287] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3: Time spent flushing consensus metadata: real 0.583s	user 0.011s	sys 0.000s
I20260709 13:06:23.468688 18719 raft_consensus.cc:515] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:23.462116 18542 raft_consensus.cc:515] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:23.484058 18640 leader_election.cc:290] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:23.480322 18810 raft_consensus.cc:2749] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:23.487166 18690 raft_consensus.cc:515] T b9e1324823f04d8da5a4b3ddbd061c0e P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:23.488618 18217 raft_consensus.cc:2749] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:23.453761 18808 raft_consensus.cc:2804] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:23.492398 16203 raft_consensus.cc:1275] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:06:23.530387 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 207498us
I20260709 13:06:23.418870 18297 raft_consensus.cc:697] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 7 LEADER]: Becoming Leader. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
W20260709 13:06:23.504285 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 83154.8us
I20260709 13:06:23.504546 16248 leader_election.cc:304] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:06:23.510609 18811 raft_consensus.cc:2764] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader election decision vote started in defunct term 6: won
I20260709 13:06:23.507843 18667 raft_consensus.cc:493] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:23.501900 18796 raft_consensus.cc:2749] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:23.531911 16914 leader_election.cc:304] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:23.482296 18797 raft_consensus.cc:515] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:23.520864 18808 raft_consensus.cc:493] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
W20260709 13:06:23.505364 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 94870.1us
I20260709 13:06:23.519942 18395 raft_consensus.cc:697] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 LEADER]: Becoming Leader. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:06:23.535633 16173 leader_election.cc:304] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:06:23.513772 18716 raft_consensus.cc:515] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:06:23.545063 16321 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:23.532670 18810 raft_consensus.cc:493] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:23.535070 18786 consensus_queue.cc:1048] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
I20260709 13:06:23.534171 18603 raft_consensus.cc:515] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:23.548832 18719 leader_election.cc:290] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 7 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:23.550362 16248 leader_election.cc:304] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:23.542078 18732 raft_consensus.cc:493] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:23.541095 18667 raft_consensus.cc:3060] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:23.551911 18819 consensus_queue.cc:1059] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:23.543326 18808 raft_consensus.cc:3060] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:23.553004 18297 consensus_queue.cc:237] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:23.561024 18810 raft_consensus.cc:515] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:23.554101 18796 raft_consensus.cc:2804] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:23.555320 18690 leader_election.cc:290] T b9e1324823f04d8da5a4b3ddbd061c0e P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:23.556023 16173 leader_election.cc:304] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:23.556188 18380 raft_consensus.cc:3055] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:06:23.670779 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 114999us
I20260709 13:06:23.538326 18217 raft_consensus.cc:2804] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:23.557377 16322 leader_election.cc:304] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:23.559557 18812 raft_consensus.cc:3055] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:23.540431 18774 raft_consensus.cc:2749] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:06:23.627375 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 51563us
I20260709 13:06:23.712675 16283 raft_consensus.cc:1240] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 6. Current term is 7. Ops: []
W20260709 13:06:23.640681 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 90358.8us
W20260709 13:06:23.672766 16321 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:23.672541 16173 leader_election.cc:304] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:06:23.713807 16248 leader_election.cc:304] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:06:23.715152 16248 leader_election.cc:304] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:23.715785 16173 leader_election.cc:304] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
W20260709 13:06:23.641428 18787 log.cc:927] Time spent T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 13:06:23.717271 16173 leader_election.cc:304] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:06:23.626580 18805 raft_consensus.cc:2749] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:23.713569 18336 raft_consensus.cc:493] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:23.712153 18812 raft_consensus.cc:740] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:23.669625 18796 raft_consensus.cc:493] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:23.736449 16280 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45210 (request call id 1492) took 1184 ms. Trace:
I20260709 13:06:23.736569 18796 raft_consensus.cc:3060] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:23.736620 18812 consensus_queue.cc:260] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:23.718107 18690 raft_consensus.cc:2804] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:23.738683 18812 raft_consensus.cc:3060] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:23.729416 18779 raft_consensus.cc:2804] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:23.739768 18779 raft_consensus.cc:697] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 7 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:23.736898 16280 rpcz_store.cc:276] 0709 13:06:22.551641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:22.571536 (+ 19895us) service_pool.cc:224] Handling call
0709 13:06:22.571858 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:22.572232 (+   374us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:06:22.607642 (+ 35410us) log.cc:844] Serialized 14 byte log entry
0709 13:06:22.665429 (+ 57787us) spinlock_profiling.cc:243] Waited 1.66 ms on lock 0x7b18002d3a00. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f3625264de1 00007f36252715b1 00007f361c37ee07 00007f36251d9ab9 00007f361c39b69b 00007f361c39993f 00007f361c39bc02 00007f361f02320b 00007f361f028d23 00007f361f02923a 00007f361f493a2a
0709 13:06:22.878924 (+213495us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:22.880413 (+  1489us) log.cc:844] Serialized 26 byte log entry
0709 13:06:22.880593 (+   180us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:22.911144 (+ 30551us) log.cc:844] Serialized 14 byte log entry
0709 13:06:22.934870 (+ 23726us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:22.934958 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:23.089687 (+154729us) spinlock_profiling.cc:243] Waited 3.27 ms on lock 0x7b18002d3a00. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f3625264de1 00007f36252715b1 00007f361c39c522 00007f361c39e7c1 00007f361c39e779 00007f361c39e709 00007f361c39e6d1 00007f361c39d9cd 000000000038f354 000000000038f199 00007f361c37f83a
0709 13:06:23.463058 (+373371us) spinlock_profiling.cc:243] Waited 31.8 ms on lock 0x7b4400022b4c. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361c224db1 00007f361c2c2c85 00007f361c2c36a2 00007f361f0351db 00007f361f030aaf 00007f361f02486e 00007f361f023bb6 00007f361f0237d8 00007f361f02d221 00007f361f02d1d9 00007f361f02d169
0709 13:06:23.558993 (+ 95935us) spinlock_profiling.cc:243] Waited 4.45 ms on lock 0x7b18002d3a00. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f3625264de1 00007f36252715b1 00007f361c39c3f3 00007f361c39e7c1 00007f361c39e779 00007f361c39e709 00007f361c39e6d1 00007f361c39d9cd 000000000038f354 000000000038f199 00007f361c37f83a
0709 13:06:23.736212 (+177219us) raft_consensus.cc:1685] finished
0709 13:06:23.736235 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:23.736383 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":98634,"prepare.queue_time_us":714193,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":62,"raft.queue_time_us":7948,"raft.run_cpu_time_us":447,"raft.run_wall_time_us":58696,"spinlock_wait_cycles":94632832,"thread_start_us":212476,"threads_started":1,"wal-append.queue_time_us":632342}
I20260709 13:06:23.739923 18822 raft_consensus.cc:2804] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:23.740463 18822 raft_consensus.cc:493] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:23.740855 18822 raft_consensus.cc:3060] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:23.740757 18779 consensus_queue.cc:237] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:23.668807 18810 leader_election.cc:290] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:23.668941 18640 raft_consensus.cc:493] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
W20260709 13:06:23.716440 18780 log.cc:927] Time spent T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.155s	user 0.001s	sys 0.000s
I20260709 13:06:23.729653 18814 raft_consensus.cc:2804] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:23.729264 18797 leader_election.cc:290] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:23.743235 18640 raft_consensus.cc:515] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:23.723387 18603 leader_election.cc:290] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 election: Requested vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:23.746583 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:23.668895 18732 raft_consensus.cc:515] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:23.749202 18706 raft_consensus.cc:2749] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:23.749778 18732 leader_election.cc:290] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:23.751317 18814 raft_consensus.cc:697] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:23.752473 18814 consensus_queue.cc:237] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:23.738793 18690 raft_consensus.cc:493] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:23.755788 18690 raft_consensus.cc:3060] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:23.736857 18336 raft_consensus.cc:515] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:23.727906 18395 consensus_queue.cc:237] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:06:23.763420 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 46207.4us
I20260709 13:06:23.748524 16248 leader_election.cc:304] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:23.767001 18774 consensus_queue.cc:1048] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:23.767895 16248 leader_election.cc:304] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:06:23.770198 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 212881us
I20260709 13:06:23.779613 16322 leader_election.cc:304] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:23.767133 18336 leader_election.cc:290] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:23.797533 16248 leader_election.cc:304] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:23.641872 18817 raft_consensus.cc:493] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:23.805088 16248 leader_election.cc:304] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:06:23.670542 18380 raft_consensus.cc:740] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:06:23.677114 18716 leader_election.cc:290] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:23.668622 18542 leader_election.cc:290] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 7 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:23.810570 16248 leader_election.cc:304] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:23.662997 18811 raft_consensus.cc:2749] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:23.628129 18597 consensus_queue.cc:1048] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.238s
I20260709 13:06:23.815651 16248 leader_election.cc:304] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:23.793936 18640 leader_election.cc:290] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:06:23.869462 16249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:23.892424 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 72082.5us
I20260709 13:06:23.805830 18310 raft_consensus.cc:2749] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:23.794376 18599 raft_consensus.cc:2749] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:23.808420 18650 raft_consensus.cc:493] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:23.801025 18819 raft_consensus.cc:493] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:23.799659 16322 leader_election.cc:304] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:06:23.913245 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 113685us
I20260709 13:06:23.914219 16322 leader_election.cc:304] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:23.800705 18810 raft_consensus.cc:2749] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:23.813796 18603 raft_consensus.cc:2804] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:23.807219 18774 consensus_queue.cc:1048] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.097s
I20260709 13:06:23.797688 18217 raft_consensus.cc:697] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:23.811924 18797 raft_consensus.cc:3060] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:23.924569 18603 raft_consensus.cc:697] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:23.928812 18603 consensus_queue.cc:237] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:23.804855 18720 consensus_queue.cc:1048] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.112s
I20260709 13:06:23.903234 18777 raft_consensus.cc:2749] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:23.818907 18706 raft_consensus.cc:2749] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:23.899073 18786 raft_consensus.cc:493] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:23.920655 18807 raft_consensus.cc:2749] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:23.907413 18803 raft_consensus.cc:493] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:23.950826 18803 raft_consensus.cc:515] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:23.744982 18667 raft_consensus.cc:515] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:23.955869 18667 leader_election.cc:290] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:23.895394 18818 consensus_queue.cc:1048] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.129s
I20260709 13:06:23.959234 18797 raft_consensus.cc:2749] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:23.959532 18786 raft_consensus.cc:515] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:23.960510 18808 raft_consensus.cc:515] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:23.953444 18803 leader_election.cc:290] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:23.815899 18816 consensus_queue.cc:1048] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.118s
I20260709 13:06:23.917018 18784 raft_consensus.cc:2749] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:23.944411 18609 raft_consensus.cc:493] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:23.945015 18730 raft_consensus.cc:493] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:23.812297 18809 raft_consensus.cc:2749] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:23.895251 18711 consensus_queue.cc:1048] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 13:06:23.814386 18817 raft_consensus.cc:515] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:23.912499 18702 consensus_queue.cc:1059] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:06:23.963258 16322 leader_election.cc:304] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:23.980273 16322 leader_election.cc:304] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:23.799943 18724 consensus_queue.cc:1059] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.119s
I20260709 13:06:23.908502 18776 consensus_queue.cc:1059] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.053s
I20260709 13:06:23.945739 18815 raft_consensus.cc:2749] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:23.913975 18650 raft_consensus.cc:515] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:23.917703 18811 consensus_queue.cc:1048] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 13:06:23.976778 18690 raft_consensus.cc:515] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:23.923753 18819 raft_consensus.cc:515] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:06:23.978291 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 176202us
I20260709 13:06:23.927018 18380 consensus_queue.cc:260] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:23.997486 16322 leader_election.cc:304] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
W20260709 13:06:23.999163 16249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:23.947746 18796 raft_consensus.cc:515] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:23.983765 18784 raft_consensus.cc:2749] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:06:23.971230 18609 raft_consensus.cc:515] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:24.012257 18786 leader_election.cc:290] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:24.014688 18609 leader_election.cc:290] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:24.012382 18724 consensus_queue.cc:1048] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 13:06:24.003705 18310 raft_consensus.cc:2749] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:24.005048 18776 raft_consensus.cc:3055] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:24.020316 16280 raft_consensus.cc:1275] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:06:23.987195 18217 consensus_queue.cc:237] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:24.003510 18822 raft_consensus.cc:515] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:24.005779 18809 raft_consensus.cc:2749] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:24.007315 18829 raft_consensus.cc:493] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:23.975292 18730 raft_consensus.cc:515] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:24.050695 16948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:24.050948 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:24.049233 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:24.052412 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:06:24.054471 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 45495.3us
I20260709 13:06:24.022097 18808 leader_election.cc:290] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:24.030042 18817 leader_election.cc:290] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:24.023268 16943 raft_consensus.cc:1240] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 LEADER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:24.060209 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:24.064356 16203 raft_consensus.cc:2468] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 6.
I20260709 13:06:24.023645 18819 leader_election.cc:290] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:24.053519 18784 raft_consensus.cc:493] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:24.062899 18310 raft_consensus.cc:493] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:24.042714 18776 raft_consensus.cc:740] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:24.025270 18796 leader_election.cc:290] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:24.027812 18650 leader_election.cc:290] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:24.062000 16948 raft_consensus.cc:1240] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:24.064795 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:24.065502 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:24.074770 16204 raft_consensus.cc:2468] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 4.
I20260709 13:06:24.057148 18803 raft_consensus.cc:493] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:24.062328 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:24.070399 16320 leader_election.cc:304] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:24.024852 18690 leader_election.cc:290] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 election: Requested vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:24.059270 18720 raft_consensus.cc:493] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:24.060395 18807 raft_consensus.cc:493] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:24.081223 16948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:06:24.087894 16948 raft_consensus.cc:3060] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:24.090291 18822 leader_election.cc:290] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:24.086762 16320 leader_election.cc:304] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:24.099815 16948 raft_consensus.cc:2468] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 5.
I20260709 13:06:24.086202 18830 raft_consensus.cc:2804] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:24.102998 18690 raft_consensus.cc:493] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:24.083449 18831 raft_consensus.cc:493] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:24.095098 18720 raft_consensus.cc:515] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:24.073927 18310 raft_consensus.cc:515] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } }
I20260709 13:06:24.057904 18829 raft_consensus.cc:515] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:24.101261 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:06:24.072369 18784 raft_consensus.cc:515] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:24.092610 18796 raft_consensus.cc:493] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:24.102008 18650 raft_consensus.cc:2804] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:24.084678 18803 raft_consensus.cc:515] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:24.124876 18812 raft_consensus.cc:493] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:24.106123 18616 raft_consensus.cc:493] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:24.127465 18822 raft_consensus.cc:493] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:24.135730 18310 leader_election.cc:290] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:24.152158 18829 leader_election.cc:290] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:24.154059 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:24.123813 18830 raft_consensus.cc:493] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:24.138300 18724 consensus_queue.cc:1048] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:06:24.140663 18822 raft_consensus.cc:515] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:24.141765 18720 leader_election.cc:290] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:24.132634 18816 consensus_queue.cc:1059] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 13:06:24.143436 18804 raft_consensus.cc:3055] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:24.144423 18647 raft_consensus.cc:493] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:24.146703 18616 raft_consensus.cc:515] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:24.204035 18616 leader_election.cc:290] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:24.206167 18647 raft_consensus.cc:515] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:24.208564 18647 leader_election.cc:290] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:24.147018 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:24.209438 16204 raft_consensus.cc:2468] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 7.
I20260709 13:06:24.173758 16206 raft_consensus.cc:1240] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 3. Current term is 4. Ops: []
W20260709 13:06:24.192925 18792 log.cc:927] Time spent T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.959s	user 0.011s	sys 0.002s
I20260709 13:06:24.129164 18831 raft_consensus.cc:515] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:24.194060 18818 raft_consensus.cc:493] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:24.226020 18818 raft_consensus.cc:515] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:24.226912 18831 leader_election.cc:290] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:24.228323 18818 leader_election.cc:290] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:24.228603 18784 leader_election.cc:290] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:24.096818 18807 raft_consensus.cc:515] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:24.136896 18650 raft_consensus.cc:493] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:24.213831 16948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:24.235749 16948 raft_consensus.cc:2393] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 6: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
I20260709 13:06:24.128155 18690 raft_consensus.cc:515] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:24.213140 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
W20260709 13:06:24.223938 18833 log.cc:927] Time spent T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:06:24.195319 18724 raft_consensus.cc:493] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:24.181663 18830 raft_consensus.cc:3060] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:24.204064 18822 leader_election.cc:290] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:24.243884 16949 raft_consensus.cc:1240] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:24.247421 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:24.119134 18776 consensus_queue.cc:260] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:24.249187 18776 raft_consensus.cc:3060] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:24.250001 18706 raft_consensus.cc:3055] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:24.139215 18796 raft_consensus.cc:515] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:24.253134 16280 raft_consensus.cc:1275] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:06:24.160290 18812 raft_consensus.cc:515] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:24.257138 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:24.230222 18779 raft_consensus.cc:3055] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:24.201416 18804 raft_consensus.cc:740] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:06:24.261504 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:24.263278 16945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:24.263717 16948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:24.265499 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
W20260709 13:06:24.266866 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 126904us
W20260709 13:06:24.267156 16321 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:24.241855 18650 raft_consensus.cc:3060] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:24.250413 18706 raft_consensus.cc:740] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:24.269641 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:24.273057 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:24.273649 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:24.283087 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:24.283951 16205 raft_consensus.cc:2393] T b9e1324823f04d8da5a4b3ddbd061c0e P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 in current term 5: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:06:24.282217 16320 leader_election.cc:304] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:24.286422 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:24.261255 18779 raft_consensus.cc:740] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:24.291688 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:24.292557 16278 raft_consensus.cc:1275] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:06:24.273151 18805 raft_consensus.cc:493] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:24.267830 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:06:24.295437 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:24.305403 16205 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6"
dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
mode: GRACEFUL
new_leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
 from {username='slave'} at 127.0.0.1:58160
I20260709 13:06:24.307027 16205 raft_consensus.cc:606] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 LEADER]: Received request to transfer leadership to TS 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:06:24.256199 18724 raft_consensus.cc:515] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:24.308612 16203 raft_consensus.cc:1240] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:24.315970 16941 raft_consensus.cc:1240] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:24.312903 18836 raft_consensus.cc:493] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:24.313376 16204 raft_consensus.cc:1240] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:24.313843 18784 raft_consensus.cc:493] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:24.288405 18803 leader_election.cc:290] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:24.360149 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:24.297468 18493 raft_consensus.cc:2804] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:24.366823 18493 raft_consensus.cc:493] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:24.367368 18493 raft_consensus.cc:3060] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:24.345322 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:24.344007 18644 raft_consensus.cc:493] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:24.371173 16349 raft_consensus.cc:2468] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 7.
I20260709 13:06:24.371245 18644 raft_consensus.cc:515] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:24.314759 18805 raft_consensus.cc:515] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:24.373749 18644 leader_election.cc:290] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:24.317261 16943 raft_consensus.cc:3055] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:24.374972 16943 raft_consensus.cc:740] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:06:24.375535 18796 leader_election.cc:290] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:24.376901 18807 leader_election.cc:290] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:24.376427 16943 consensus_queue.cc:260] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:24.364332 18809 raft_consensus.cc:493] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:24.378008 18779 consensus_queue.cc:260] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:24.378885 18809 raft_consensus.cc:515] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:24.379132 16943 raft_consensus.cc:3060] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:24.381137 18809 leader_election.cc:290] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:24.348613 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:24.381959 16351 raft_consensus.cc:2468] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 7.
I20260709 13:06:24.382786 18730 leader_election.cc:290] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:24.378500 18650 raft_consensus.cc:515] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:24.317205 18804 consensus_queue.cc:260] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:24.384130 16355 raft_consensus.cc:1240] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:24.385020 18650 leader_election.cc:290] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:24.403610 16349 raft_consensus.cc:1240] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:06:24.404115 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:24.403638 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:24.385896 18836 raft_consensus.cc:515] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:24.387228 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:24.405378 16357 raft_consensus.cc:2468] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 7.
I20260709 13:06:24.406029 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:24.388656 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:24.389187 16274 raft_consensus.cc:1240] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:24.389684 16282 raft_consensus.cc:1240] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:24.407582 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:24.390184 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:24.408280 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:24.408952 16277 raft_consensus.cc:2468] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 5.
I20260709 13:06:24.385833 18724 leader_election.cc:290] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:24.391595 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:24.410267 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:24.390270 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:24.400523 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:24.411437 16281 raft_consensus.cc:2468] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 8.
I20260709 13:06:24.404958 16356 raft_consensus.cc:2393] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 7: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:06:24.391595 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:24.409279 16353 raft_consensus.cc:3060] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:24.391291 18380 raft_consensus.cc:3060] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:24.407826 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:24.416059 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:24.418025 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:24.420969 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:24.421669 16206 raft_consensus.cc:3060] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:24.422699 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:24.423569 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:24.424068 16357 raft_consensus.cc:3060] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:24.379391 18779 raft_consensus.cc:3060] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:24.417549 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:24.429714 16356 raft_consensus.cc:3060] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:24.434485 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:24.446512 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:24.447281 16352 raft_consensus.cc:3060] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:24.374451 18805 leader_election.cc:290] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:24.453248 16357 raft_consensus.cc:2468] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 7.
W20260709 13:06:24.454722 16247 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:24.455569 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:24.406698 18796 raft_consensus.cc:493] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:24.418362 18818 raft_consensus.cc:493] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:24.490123 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:24.462177 16356 raft_consensus.cc:2468] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 6.
I20260709 13:06:24.492357 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:24.464277 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:24.465340 16205 raft_consensus.cc:1240] T b9e1324823f04d8da5a4b3ddbd061c0e P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:24.461437 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:24.467047 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:24.469821 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:24.470016 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:24.496114 16277 raft_consensus.cc:2393] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 7: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:06:24.477670 16206 raft_consensus.cc:2468] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 5.
I20260709 13:06:24.497859 16282 raft_consensus.cc:2393] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 7: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:06:24.497800 16320 leader_election.cc:304] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:24.498445 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:24.499449 16281 raft_consensus.cc:2410] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:06:24.400803 18784 raft_consensus.cc:515] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:24.497924 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:24.503060 16357 raft_consensus.cc:3060] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:06:24.508929 16249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:24.510032 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:24.510902 16356 raft_consensus.cc:3060] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:24.512509 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:24.510958 16204 raft_consensus.cc:1240] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:24.511698 18786 raft_consensus.cc:2804] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:24.522825 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:24.362498 18706 consensus_queue.cc:260] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:24.529837 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:24.531471 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:24.532583 16353 raft_consensus.cc:2468] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 5.
I20260709 13:06:24.532691 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f022e2e63ae4461d834e476ff2666991" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:06:24.574029 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:24.581375 16274 raft_consensus.cc:2468] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 5.
I20260709 13:06:24.581805 16357 raft_consensus.cc:2468] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 7.
I20260709 13:06:24.540634 16173 leader_election.cc:304] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:06:24.587572 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:24.602093 16353 raft_consensus.cc:2468] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 6.
I20260709 13:06:24.600387 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:24.544534 18805 consensus_queue.cc:1059] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.060s
I20260709 13:06:24.605520 16356 raft_consensus.cc:2468] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 7.
I20260709 13:06:24.608711 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:06:24.613821 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 73244.9us
I20260709 13:06:24.519837 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:24.647185 16941 raft_consensus.cc:2393] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 7: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
I20260709 13:06:24.619676 16352 raft_consensus.cc:2468] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 7.
I20260709 13:06:24.529309 18786 raft_consensus.cc:697] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 5 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:06:24.649359 16173 leader_election.cc:304] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:24.654044 18183 raft_consensus.cc:2804] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:24.649720 18786 consensus_queue.cc:237] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:24.654605 18183 raft_consensus.cc:493] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:24.654994 18183 raft_consensus.cc:3060] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:24.633998 18836 leader_election.cc:290] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:24.635097 18395 consensus_queue.cc:1059] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:24.615103 18829 raft_consensus.cc:2749] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:24.637403 16943 raft_consensus.cc:2410] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:06:24.637501 18774 raft_consensus.cc:3055] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:24.500698 18796 raft_consensus.cc:515] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:24.660173 18774 raft_consensus.cc:740] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:24.509663 18818 raft_consensus.cc:515] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:24.644474 16357 raft_consensus.cc:2468] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 5.
I20260709 13:06:24.648317 18813 consensus_queue.cc:1059] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:24.663095 18813 raft_consensus.cc:3055] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:24.663470 18813 raft_consensus.cc:740] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:24.664229 18813 consensus_queue.cc:260] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:24.665750 18813 raft_consensus.cc:3060] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:24.665721 18183 raft_consensus.cc:515] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:24.667559 16173 leader_election.cc:304] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:06:24.668416 18829 raft_consensus.cc:2749] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:24.668848 16173 leader_election.cc:304] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:24.669641 18829 raft_consensus.cc:2804] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:24.670042 18829 raft_consensus.cc:493] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:24.670408 18829 raft_consensus.cc:3060] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:24.678617 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f022e2e63ae4461d834e476ff2666991" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:06:24.688872 18828 log.cc:927] Time spent T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63: Append to log took a long time: real 0.760s	user 0.005s	sys 0.000s
W20260709 13:06:24.692235 18783 log.cc:927] Time spent T 00000000000000000000000000000000 P 4dc6f08597514f4d85fd451b999b403e: Append to log took a long time: real 1.529s	user 0.028s	sys 0.027s
I20260709 13:06:24.529596 18814 consensus_queue.cc:1059] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.109s
I20260709 13:06:24.611991 18555 raft_consensus.cc:493] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:24.669811 16173 leader_election.cc:304] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:06:24.706194 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:24.616114 18603 raft_consensus.cc:493] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:24.590392 18816 consensus_queue.cc:1048] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.095s
I20260709 13:06:24.549557 18724 consensus_queue.cc:1048] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.095s
I20260709 13:06:24.714612 16205 raft_consensus.cc:2468] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 4.
I20260709 13:06:24.721221 16352 raft_consensus.cc:1240] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 6. Current term is 7. Ops: []
W20260709 13:06:24.748155 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 208668us
I20260709 13:06:24.750301 16320 leader_election.cc:304] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
W20260709 13:06:24.732105 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 62325.7us
I20260709 13:06:24.592037 18711 consensus_queue.cc:1059] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.118s
I20260709 13:06:24.756263 16248 leader_election.cc:304] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:06:24.744895 18817 raft_consensus.cc:3055] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:24.742050 18720 raft_consensus.cc:3060] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:24.782037 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 241726us
I20260709 13:06:24.680804 18829 raft_consensus.cc:515] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:24.797539 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:06:24.779587 18807 raft_consensus.cc:2804] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:24.794201 18817 raft_consensus.cc:740] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:06:24.811391 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:06:24.798954 18830 consensus_meta.cc:287] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 0.551s	user 0.012s	sys 0.000s
I20260709 13:06:24.815493 18829 leader_election.cc:290] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:24.816457 18817 consensus_queue.cc:260] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:06:24.817788 18841 log.cc:927] Time spent T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63: Append to log took a long time: real 0.172s	user 0.001s	sys 0.000s
I20260709 13:06:24.818781 18573 raft_consensus.cc:3055] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:24.802642 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:24.837090 18572 raft_consensus.cc:2804] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:24.739746 18555 raft_consensus.cc:515] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:24.743968 18603 raft_consensus.cc:515] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:06:24.853894 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 270934us
I20260709 13:06:24.820310 18784 leader_election.cc:290] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:24.780855 18730 consensus_queue.cc:1059] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.068s
W20260709 13:06:24.860267 16321 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:24.813387 18807 raft_consensus.cc:493] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:24.858428 16354 raft_consensus.cc:2955] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 2 to 5, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
W20260709 13:06:24.869460 16249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:24.861344 18572 raft_consensus.cc:493] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:24.858783 18573 raft_consensus.cc:740] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:24.873368 18807 raft_consensus.cc:3060] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:24.851713 18830 raft_consensus.cc:515] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:24.873730 18817 raft_consensus.cc:3060] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:24.879236 16941 raft_consensus.cc:1275] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:06:24.886488 18572 raft_consensus.cc:3060] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:24.929438 18829 raft_consensus.cc:3055] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:24.931280 18805 raft_consensus.cc:3055] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:24.931867 18805 raft_consensus.cc:740] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:06:24.933122 18805 consensus_queue.cc:260] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:24.937894 18830 leader_election.cc:290] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:24.941167 18603 leader_election.cc:290] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:24.942785 18555 leader_election.cc:290] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:24.930163 18829 raft_consensus.cc:740] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:24.940572 18573 consensus_queue.cc:260] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:06:24.946386 18380 consensus_meta.cc:287] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 0.527s	user 0.008s	sys 0.000s
I20260709 13:06:24.984690 16349 raft_consensus.cc:2410] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:06:24.981724 18805 raft_consensus.cc:3060] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:24.987027 18493 consensus_meta.cc:287] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 0.619s	user 0.008s	sys 0.004s
I20260709 13:06:24.962035 18724 raft_consensus.cc:493] T b9e1324823f04d8da5a4b3ddbd061c0e P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:24.987478 18493 raft_consensus.cc:515] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } }
I20260709 13:06:24.988066 18724 raft_consensus.cc:515] T b9e1324823f04d8da5a4b3ddbd061c0e P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:24.989655 18493 leader_election.cc:290] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:24.995513 18724 leader_election.cc:290] T b9e1324823f04d8da5a4b3ddbd061c0e P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:06:25.023512 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 223045us
I20260709 13:06:24.946317 18774 consensus_queue.cc:260] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:06:25.022825 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 439347us
W20260709 13:06:25.029660 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 149415us
I20260709 13:06:25.017197 18573 raft_consensus.cc:3060] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:25.022409 18779 consensus_meta.cc:287] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f: Time spent flushing consensus metadata: real 0.572s	user 0.010s	sys 0.002s
I20260709 13:06:24.990368 18572 raft_consensus.cc:515] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:06:25.033901 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 276638us
I20260709 13:06:25.037768 16248 leader_election.cc:304] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:06:25.024194 18812 leader_election.cc:290] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:25.040189 16912 leader_election.cc:304] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:06:25.052857 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:25.093063 18866 raft_consensus.cc:2749] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:25.093834 18811 raft_consensus.cc:3055] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:25.094300 18811 raft_consensus.cc:740] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:25.095234 18811 consensus_queue.cc:260] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:06:25.096779 18852 log.cc:927] Time spent T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:06:25.143193 16350 raft_consensus.cc:1275] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:06:25.143658 16350 pending_rounds.cc:85] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e: Aborting all ops after (but not including) 5
I20260709 13:06:25.143893 16350 pending_rounds.cc:107] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:06:25.144137 16350 raft_consensus.cc:2889] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:25.093067 18814 raft_consensus.cc:2804] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:25.147182 18814 raft_consensus.cc:493] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:25.147907 18814 raft_consensus.cc:3060] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:25.148142 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:25.150102 16942 raft_consensus.cc:2468] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 7.
W20260709 13:06:25.153726 18852 log.cc:927] Time spent T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.055s	user 0.003s	sys 0.000s
I20260709 13:06:25.020876 18829 consensus_queue.cc:260] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:25.155042 18829 raft_consensus.cc:3060] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:25.158885 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 120011us
W20260709 13:06:25.158736 18864 log.cc:927] Time spent T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:06:25.161943 16248 leader_election.cc:304] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:06:25.163621 16248 leader_election.cc:304] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:06:25.170002 18863 consensus_queue.cc:1059] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:06:25.171239 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:25.136355 18811 raft_consensus.cc:3060] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:25.172879 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 132759us
I20260709 13:06:25.174614 16912 leader_election.cc:304] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:06:25.165393 18845 log.cc:927] Time spent T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:06:25.177412 16246 leader_election.cc:304] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:06:25.171504 18854 log.cc:927] Time spent T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:06:25.165581 18846 raft_consensus.cc:2804] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:25.171700 18720 raft_consensus.cc:2749] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:25.185200 16946 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35106 (request call id 559) took 1112 ms. Trace:
I20260709 13:06:25.183837 18855 raft_consensus.cc:2749] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:25.191390 16942 raft_consensus.cc:1240] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:25.191701 16941 raft_consensus.cc:1240] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:25.175431 18603 raft_consensus.cc:3055] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:06:25.209445 16914 leader_election.cc:336] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 1.684s (SENT)
I20260709 13:06:25.193079 16946 rpcz_store.cc:276] 0709 13:06:24.072841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:24.073024 (+   183us) service_pool.cc:224] Handling call
0709 13:06:24.222817 (+149793us) spinlock_profiling.cc:243] Waited 2.21 ms on lock 0x7b58001a3d98. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361c224db1 00007f361c364b71 00007f361c364a22 00007f362527dc09 00007f36243d7ee0 00007f36244a10ab 00007f36244a1131 00007f3624462fc0 00007f362444d929 00007f362444d3d2 00007f361d9c4bd4
0709 13:06:24.223042 (+   225us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:24.223264 (+   222us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:06:24.412678 (+189414us) log.cc:844] Serialized 14 byte log entry
0709 13:06:25.170947 (+758269us) spinlock_profiling.cc:243] Waited 37.5 ms on lock 0x7b18002c4700. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f3625264de1 00007f36252715b1 00007f361f0314bc 00007f361c37f48b 00007f36251d9ab9 00007f361c39b69b 00007f361c39993f 00007f361c39bc02 00007f361f02320b 00007f361f028d23 00007f361f02923a
0709 13:06:25.184671 (+ 13724us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:25.184899 (+   228us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:25.184947 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:25.185012 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:25.185135 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3235,"prepare.queue_time_us":323566,"prepare.run_cpu_time_us":90,"prepare.run_wall_time_us":6696,"raft.queue_time_us":90,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":4637,"spinlock_wait_cycles":91442816,"thread_start_us":320145,"threads_started":2,"wal-append.queue_time_us":360778}
I20260709 13:06:25.232497 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:25.233330 16205 raft_consensus.cc:3060] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:25.184100 18711 raft_consensus.cc:2804] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:25.242108 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:25.185887 18846 raft_consensus.cc:493] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:25.184058 18848 raft_consensus.cc:2749] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:25.251995 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:25.184638 18860 consensus_queue.cc:1059] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.069s
I20260709 13:06:25.202478 18819 raft_consensus.cc:493] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:25.252998 18720 raft_consensus.cc:493] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:25.274128 18720 raft_consensus.cc:515] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:25.275027 18807 raft_consensus.cc:515] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:25.276716 18720 leader_election.cc:290] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:25.277403 18807 leader_election.cc:290] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:25.271606 16203 raft_consensus.cc:1275] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:06:25.283753 18819 raft_consensus.cc:515] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:25.255879 18846 raft_consensus.cc:3060] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:25.232594 18603 raft_consensus.cc:740] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
W20260709 13:06:25.294814 16321 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:25.309401 16205 raft_consensus.cc:2468] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 7.
W20260709 13:06:25.300101 16915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:25.307235 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:25.312042 16206 raft_consensus.cc:3060] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:25.314699 16320 leader_election.cc:304] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:25.317559 18720 consensus_queue.cc:1048] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:06:25.322973 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 140074us
I20260709 13:06:25.317966 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:25.325915 16246 leader_election.cc:304] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:25.327153 16940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:25.327605 18493 raft_consensus.cc:2804] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:06:25.328140 16940 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35106 (request call id 556) took 1263 ms (client timeout 1582 ms). Trace:
I20260709 13:06:25.328222 18493 raft_consensus.cc:697] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 7 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
W20260709 13:06:25.328650 16940 rpcz_store.cc:269] 0709 13:06:24.064519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:24.065598 (+  1079us) service_pool.cc:224] Handling call
0709 13:06:25.326965 (+1261367us) spinlock_profiling.cc:243] Waited 2.2 ms on lock 0x7b58001a3d98. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361c224db1 00007f361c364b71 00007f361c364a22 00007f362527dc09 00007f36243d7ee0 00007f36244a10ab 00007f36244a1131 00007f362444f0a0 00007f362444e984 00007f361d9c96d4 00007f361d9c9662
0709 13:06:25.328052 (+  1087us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5064576}
I20260709 13:06:25.329524 16205 raft_consensus.cc:1240] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:25.330138 18183 leader_election.cc:290] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:25.332433 16914 leader_election.cc:304] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:25.335917 16203 raft_consensus.cc:1240] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:25.336153 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:06:25.336866 16320 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:25.341696 18572 leader_election.cc:290] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 election: Requested vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:25.346495 16206 raft_consensus.cc:2468] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 5.
I20260709 13:06:25.347527 16946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:06:25.350569 16205 raft_consensus.cc:1240] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:25.357282 16320 leader_election.cc:304] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:25.329216 18493 consensus_queue.cc:237] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:25.343842 18817 raft_consensus.cc:2804] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:25.313285 18848 consensus_queue.cc:1059] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 13:06:25.339561 16942 raft_consensus.cc:2468] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 5.
I20260709 13:06:25.332516 18809 consensus_queue.cc:1048] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 13:06:25.363051 18849 raft_consensus.cc:3060] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:25.363730 18784 raft_consensus.cc:2804] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:25.365082 18817 raft_consensus.cc:493] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:25.381659 18804 raft_consensus.cc:3060] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:25.358814 18603 consensus_queue.cc:260] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:25.384517 18603 raft_consensus.cc:3060] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:25.387634 18785 raft_consensus.cc:493] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:25.388229 18785 raft_consensus.cc:515] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:06:25.390722 16173 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:25.392730 18814 raft_consensus.cc:515] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:25.396054 18819 leader_election.cc:290] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:25.396974 18690 leader_election.cc:290] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:25.398952 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:25.399928 16206 raft_consensus.cc:2410] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:06:25.400947 18817 raft_consensus.cc:3060] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:25.374951 18860 consensus_queue.cc:1059] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 13:06:25.405916 18183 raft_consensus.cc:493] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:25.407859 16246 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:25.409572 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:25.406589 18183 raft_consensus.cc:515] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:25.411393 18874 raft_consensus.cc:3055] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:25.411871 18874 raft_consensus.cc:740] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:25.412472 18183 leader_election.cc:290] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:06:25.413021 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:25.412818 18874 consensus_queue.cc:260] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:25.414005 18796 leader_election.cc:290] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:25.414740 18784 raft_consensus.cc:697] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 5 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:06:25.415694 18784 consensus_queue.cc:237] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:25.420626 18811 raft_consensus.cc:493] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:25.421221 18811 raft_consensus.cc:515] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:25.421650 18817 raft_consensus.cc:515] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:25.421994 18849 raft_consensus.cc:2749] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:25.423657 18811 leader_election.cc:290] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:25.425724 18860 raft_consensus.cc:3055] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:25.426218 18860 raft_consensus.cc:740] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:25.426564 16940 raft_consensus.cc:1240] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:06:25.427350 18860 consensus_queue.cc:260] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:25.428594 18860 raft_consensus.cc:3060] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:25.428664 18817 leader_election.cc:290] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 6 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:25.429594 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f022e2e63ae4461d834e476ff2666991" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:25.432509 18874 raft_consensus.cc:3060] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:25.449935 18876 raft_consensus.cc:493] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:25.450613 18876 raft_consensus.cc:515] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:25.453799 18814 leader_election.cc:290] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:25.453456 18876 leader_election.cc:290] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:25.459609 16941 raft_consensus.cc:1275] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:06:25.461290 16942 raft_consensus.cc:1275] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:06:25.466342 18785 leader_election.cc:290] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:25.467777 18814 consensus_queue.cc:1048] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:25.477797 18809 raft_consensus.cc:493] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:25.478458 18809 raft_consensus.cc:515] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:25.471364 18846 raft_consensus.cc:515] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:25.488377 18846 leader_election.cc:290] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:06:25.527367 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:25.531612 16247 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:25.547456 16283 raft_consensus.cc:1240] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 7. Current term is 8. Ops: []
W20260709 13:06:25.549366 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 83253.8us
I20260709 13:06:25.553572 18814 raft_consensus.cc:493] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:25.563009 18850 raft_consensus.cc:493] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:25.564260 18850 raft_consensus.cc:515] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:25.566159 18829 raft_consensus.cc:493] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:25.567346 18829 raft_consensus.cc:515] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:25.573112 18872 consensus_queue.cc:1048] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:25.577294 18882 raft_consensus.cc:493] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:25.578347 18882 raft_consensus.cc:515] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:25.586817 16200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39674 (request call id 309) took 1347 ms. Trace:
I20260709 13:06:25.587409 16200 rpcz_store.cc:276] 0709 13:06:24.239077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:24.239209 (+   132us) service_pool.cc:224] Handling call
0709 13:06:24.239452 (+   243us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:24.362303 (+122851us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:24.362335 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:24.362382 (+    47us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:24.362417 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:25.586060 (+1223643us) spinlock_profiling.cc:243] Waited 123 ms on lock 0x7b54001973d4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f489e01 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6
0709 13:06:25.586191 (+   131us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:25.586485 (+   294us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":281985920}
I20260709 13:06:25.589083 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f022e2e63ae4461d834e476ff2666991" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
W20260709 13:06:25.590015 16912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:25.590332 16277 raft_consensus.cc:3060] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:25.554996 18814 raft_consensus.cc:515] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:25.605436 18784 raft_consensus.cc:493] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:25.606796 18784 raft_consensus.cc:515] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:06:25.642346 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:25.642987 18784 leader_election.cc:290] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:06:25.678785 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 72083.7us
I20260709 13:06:25.665446 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:25.688236 16349 raft_consensus.cc:2468] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 2.
I20260709 13:06:25.680481 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:25.664471 18572 raft_consensus.cc:3055] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:25.695261 18572 raft_consensus.cc:740] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:25.666280 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:25.667276 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:25.696900 18572 consensus_queue.cc:260] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:25.701529 18572 raft_consensus.cc:3060] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:25.700968 18813 consensus_queue.cc:1059] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:25.713896 18814 leader_election.cc:290] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:25.713914 18882 leader_election.cc:290] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:25.720862 18812 raft_consensus.cc:3055] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:25.721451 18812 raft_consensus.cc:740] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:25.722999 18812 consensus_queue.cc:260] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:25.726594 18850 leader_election.cc:290] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:25.728603 18644 raft_consensus.cc:493] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:25.732244 18644 raft_consensus.cc:515] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:06:25.737932 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:25.741226 16249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:25.744354 16321 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:25.753921 18818 leader_election.cc:290] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:25.746222 18774 raft_consensus.cc:3060] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:25.754133 18882 raft_consensus.cc:493] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:25.759121 18882 raft_consensus.cc:515] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:25.759646 18809 leader_election.cc:290] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:25.761736 18882 leader_election.cc:290] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:25.761958 18812 raft_consensus.cc:3060] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:25.762624 16249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:25.656008 18706 raft_consensus.cc:3060] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:25.773442 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:25.774669 16205 raft_consensus.cc:2468] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 5.
I20260709 13:06:25.776185 18814 raft_consensus.cc:493] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:25.777107 18814 raft_consensus.cc:515] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:25.778184 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:25.780659 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:25.782444 16355 raft_consensus.cc:1240] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:06:25.815868 18818 raft_consensus.cc:493] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:25.816354 16103 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55244 (request call id 122) took 6014 ms. Trace:
I20260709 13:06:25.816779 18818 raft_consensus.cc:515] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } }
I20260709 13:06:25.719233 18829 leader_election.cc:290] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:06:25.824605 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 214949us
W20260709 13:06:25.827443 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:25.830166 16320 leader_election.cc:304] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:25.832306 18650 raft_consensus.cc:2804] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:25.832813 18650 raft_consensus.cc:493] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:25.833168 18650 raft_consensus.cc:3060] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:25.834733 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:06:25.835031 16173 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:25.855945 16280 raft_consensus.cc:1275] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:06:25.856511 16278 raft_consensus.cc:1240] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:25.857502 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:25.857945 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:25.858750 16276 raft_consensus.cc:3060] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:25.859578 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:25.860337 16355 raft_consensus.cc:3060] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:25.858500 16352 raft_consensus.cc:3060] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:25.864303 18804 raft_consensus.cc:493] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:25.864959 16206 raft_consensus.cc:2468] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 6.
I20260709 13:06:25.865131 18804 raft_consensus.cc:515] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:25.866482 16912 leader_election.cc:304] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:25.867311 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:25.867466 18809 raft_consensus.cc:493] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:25.868325 18809 raft_consensus.cc:515] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:06:25.869714 16915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:25.870182 18850 raft_consensus.cc:2804] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:25.871924 18865 raft_consensus.cc:493] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:25.872385 18850 raft_consensus.cc:493] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:25.872663 18865 raft_consensus.cc:515] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:25.872910 18850 raft_consensus.cc:3060] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:25.875538 18644 leader_election.cc:290] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:25.876230 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:25.877660 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:25.878578 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c15d8e9be8414c84912ab77b66bfb1" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:25.883037 16277 raft_consensus.cc:2468] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 6.
I20260709 13:06:25.884692 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:25.886469 16350 raft_consensus.cc:1240] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:06:25.887957 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:25.888864 16350 raft_consensus.cc:2468] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 5.
I20260709 13:06:25.889221 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:25.890443 16280 raft_consensus.cc:2393] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 6: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:06:25.891335 16282 raft_consensus.cc:1240] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 5. Current term is 6. Ops: [3.5-5.6]
I20260709 13:06:25.891624 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:25.892385 16280 raft_consensus.cc:2468] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 4.
I20260709 13:06:25.893097 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:25.893329 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:25.894052 16280 raft_consensus.cc:2468] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 6.
I20260709 13:06:25.894848 18804 leader_election.cc:290] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:25.896711 18882 raft_consensus.cc:493] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:25.897316 18882 raft_consensus.cc:515] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:25.898501 16281 raft_consensus.cc:2468] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 6.
I20260709 13:06:25.900506 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:25.901289 16349 raft_consensus.cc:3060] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:25.902138 16280 raft_consensus.cc:1240] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:25.853103 18818 leader_election.cc:290] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:25.890429 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:25.907418 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:25.912673 16350 raft_consensus.cc:2468] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 5.
W20260709 13:06:25.918695 16247 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:25.919215 16274 raft_consensus.cc:1240] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:25.898233 16355 raft_consensus.cc:2468] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 7.
I20260709 13:06:25.923942 18785 raft_consensus.cc:493] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:25.924175 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:25.924747 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:25.924609 18785 raft_consensus.cc:515] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:25.925793 16355 raft_consensus.cc:2393] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 8: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:06:25.927170 16275 raft_consensus.cc:2468] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 8.
I20260709 13:06:25.926448 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:25.918533 16105 catalog_manager.cc:5697] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 1 to 3, leader changed from e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) to 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66). New cstate: current_term: 3 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:25.921798 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:25.933513 16352 raft_consensus.cc:2468] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 6.
W20260709 13:06:25.935988 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:25.933998 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:25.946238 16278 raft_consensus.cc:1240] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:06:25.945627 16105 catalog_manager.cc:5697] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 2 to 4, leader changed from 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) to 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66). New cstate: current_term: 4 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } }
W20260709 13:06:25.948897 16248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:25.948221 16105 catalog_manager.cc:5697] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 2 to 5, leader changed from 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) to e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65). New cstate: current_term: 5 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } }
I20260709 13:06:25.921002 18818 raft_consensus.cc:493] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:25.950325 16350 raft_consensus.cc:2468] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 5.
I20260709 13:06:26.065934 16276 raft_consensus.cc:2468] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 6.
I20260709 13:06:25.966929 16206 raft_consensus.cc:2468] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 2.
I20260709 13:06:26.015610 16283 raft_consensus.cc:2468] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 5.
I20260709 13:06:26.053903 16349 raft_consensus.cc:2468] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 5.
I20260709 13:06:26.001552 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
W20260709 13:06:26.039672 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:26.038214 16348 raft_consensus.cc:2468] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 6.
I20260709 13:06:26.071669 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:26.059602 18706 raft_consensus.cc:493] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:26.073948 18706 raft_consensus.cc:515] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:26.076128 18706 leader_election.cc:290] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:26.078657 16356 raft_consensus.cc:1240] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:06:26.079977 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:25.816992 16103 rpcz_store.cc:276] 0709 13:06:19.811437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:19.812362 (+   925us) service_pool.cc:224] Handling call
0709 13:06:25.816057 (+6003695us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:22.199073 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:22.199700 (+   627us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:22.199741 (+    41us) write_op.cc:435] Acquired schema lock
0709 13:06:22.199762 (+    21us) tablet.cc:662] Decoding operations
0709 13:06:22.201004 (+  1242us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:22.201084 (+    80us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:22.201117 (+    33us) tablet.cc:685] Acquiring locks for 13 operations
0709 13:06:22.301219 (+100102us) tablet.cc:701] Row locks acquired
0709 13:06:22.301238 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:06:22.301392 (+   154us) write_op.cc:270] Start()
0709 13:06:22.302362 (+   970us) write_op.cc:276] Timestamp: P: 1783602382301346 usec, L: 0
0709 13:06:22.302388 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 13:06:22.583100 (+280712us) log.cc:844] Serialized 5196 byte log entry
0709 13:06:24.690872 (+2107772us) spinlock_profiling.cc:243] Waited 18.2 ms on lock 0x7b4400022b4c. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361c224db1 00007f361c2c2c85 00007f361c2c36a2 00007f361f0351db 00007f361f030aaf 00007f361f02486e 00007f361f023bb6 00007f361f0237d8 00007f361f02d221 00007f361f02d1d9 00007f361f02d169
0709 13:06:25.151134 (+460262us) op_driver.cc:464] REPLICATION: finished
0709 13:06:25.287058 (+135924us) write_op.cc:301] APPLY: starting
0709 13:06:25.287159 (+   101us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:25.287447 (+   288us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:25.287466 (+    19us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:25.348993 (+ 61527us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:25.376037 (+ 27044us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=13
0709 13:06:25.376105 (+    68us) write_op.cc:312] APPLY: finished
0709 13:06:25.376534 (+   429us) log.cc:844] Serialized 95 byte log entry
0709 13:06:25.376712 (+   178us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:25.376857 (+   145us) write_op.cc:454] Released schema lock
0709 13:06:25.376911 (+    54us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:25.377356 (+   445us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:25.377388 (+    32us) write_op.cc:454] Released schema lock
0709 13:06:25.393842 (+ 16454us) spinlock_profiling.cc:243] Waited 45.8 ms on lock 0x7b5400137754. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48632a 00007f361f40bf14 00007f361f40bec3 00007f361f40be38 00007f361f40bdf3 00007f361f40b0dc 00007f361f434e16 00007f361f41ccbb 00007f361f40739d 00007f361f40ad75
Metrics: {"mutex_wait_us":14410,"reported_tablets":26,"spinlock_wait_cycles":1288448,"child_traces":[["op",{"apply.queue_time_us":135520,"apply.run_cpu_time_us":5419,"apply.run_wall_time_us":90269,"num_ops":13,"prepare.queue_time_us":200459,"prepare.run_cpu_time_us":55262,"prepare.run_wall_time_us":712551,"raft.queue_time_us":397937,"raft.run_cpu_time_us":30329,"raft.run_wall_time_us":302655,"replication_time_us":2845201,"spinlock_wait_cycles":147141760,"thread_start_us":809026,"threads_started":4,"wal-append.queue_time_us":481803}]]}
W20260709 13:06:26.086696 16248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:26.068876 16914 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 1.983s (SENT) [suppressed 42 similar messages]
W20260709 13:06:26.012974 18711 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.005s	sys 0.004s
I20260709 13:06:25.974817 18814 leader_election.cc:290] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:25.950985 18875 raft_consensus.cc:493] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:26.093607 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:26.094292 16350 raft_consensus.cc:2468] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 5.
I20260709 13:06:26.095309 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:06:26.098621 18864 log.cc:927] Time spent T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
I20260709 13:06:26.099265 18822 raft_consensus.cc:493] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:26.099901 18809 leader_election.cc:290] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:26.099982 18822 raft_consensus.cc:515] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:06:26.091368 18711 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.824s	user 0.007s	sys 0.005s
I20260709 13:06:26.038518 18650 raft_consensus.cc:515] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:26.088958 18882 leader_election.cc:290] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:26.106734 16348 raft_consensus.cc:2393] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 6: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:06:26.100476 16105 catalog_manager.cc:5697] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 1 to 2, leader changed from 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) to 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66). New cstate: current_term: 2 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:26.106988 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:26.108289 16350 raft_consensus.cc:3060] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:26.108558 16352 raft_consensus.cc:1240] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:06:26.112962 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:26.121258 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:26.125783 16348 raft_consensus.cc:2468] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 2.
I20260709 13:06:26.127678 16356 raft_consensus.cc:2368] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for earlier term 6. Current term is 7.
I20260709 13:06:26.125396 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:26.131981 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c15d8e9be8414c84912ab77b66bfb1" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:26.104396 18711 raft_consensus.cc:697] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:26.132820 16355 raft_consensus.cc:1275] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:06:26.133319 16353 raft_consensus.cc:2393] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 8: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:06:26.137760 16352 raft_consensus.cc:2468] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 4.
I20260709 13:06:26.137838 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:26.140890 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:26.141570 16205 raft_consensus.cc:2468] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 5.
I20260709 13:06:26.144970 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:26.146802 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:26.130533 18822 leader_election.cc:290] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:26.145905 16352 raft_consensus.cc:2376] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 5. Re-sending same reply.
I20260709 13:06:26.135025 18785 leader_election.cc:290] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:06:26.155071 16247 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:26.156663 16200 raft_consensus.cc:1240] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:26.152895 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:26.131192 18818 raft_consensus.cc:515] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:26.160892 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:26.166105 16348 raft_consensus.cc:2468] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 6.
I20260709 13:06:26.166819 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:26.167593 16356 raft_consensus.cc:2468] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 6.
I20260709 13:06:26.167809 16348 raft_consensus.cc:1275] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:06:26.168638 16355 raft_consensus.cc:2468] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 4.
I20260709 13:06:26.179076 18865 leader_election.cc:290] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:26.179730 18817 consensus_queue.cc:1059] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:06:26.180284 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:26.180718 18817 consensus_queue.cc:1243] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Peer 0aea40d6e4374085a2e38a70a71f63e3 log is divergent from this leader: its last log entry 6.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:06:26.181320 18817 raft_consensus.cc:3055] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:06:26.183929 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:26.139767 18875 raft_consensus.cc:515] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:26.176409 16353 raft_consensus.cc:1240] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:26.188552 16352 raft_consensus.cc:2468] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 3.
I20260709 13:06:26.181689 18817 raft_consensus.cc:740] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:06:26.191134 16200 raft_consensus.cc:1275] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:06:26.193173 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:26.190371 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
W20260709 13:06:26.200029 16249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:26.193367 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:26.160362 18850 raft_consensus.cc:515] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:26.204038 16206 raft_consensus.cc:2393] T b9e1324823f04d8da5a4b3ddbd061c0e P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 5: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:06:26.161477 16105 catalog_manager.cc:5697] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 2 to 3, leader changed from 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) to e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65). New cstate: current_term: 3 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } }
I20260709 13:06:26.204186 16320 leader_election.cc:304] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:26.203855 18809 raft_consensus.cc:493] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:26.209474 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:26.210952 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:26.214069 16205 raft_consensus.cc:3060] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:06:26.210556 16352 raft_consensus.cc:2376] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 6. Re-sending same reply.
I20260709 13:06:26.216451 16204 raft_consensus.cc:2468] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 7.
I20260709 13:06:26.204738 18818 leader_election.cc:290] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:26.210703 18804 raft_consensus.cc:2804] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:26.225237 18572 raft_consensus.cc:493] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:26.225904 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:26.226131 18572 raft_consensus.cc:515] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:26.227007 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:26.228121 16941 raft_consensus.cc:2468] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 7.
I20260709 13:06:26.228801 18644 raft_consensus.cc:493] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:26.229617 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:26.212908 18706 raft_consensus.cc:493] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:26.229390 18644 raft_consensus.cc:515] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:26.235898 18706 raft_consensus.cc:515] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:26.237711 18644 leader_election.cc:290] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:26.238704 16202 raft_consensus.cc:1240] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:26.213135 18809 raft_consensus.cc:515] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:26.219091 16105 catalog_manager.cc:5697] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } }
W20260709 13:06:26.240386 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:26.220359 18650 leader_election.cc:290] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:26.244266 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:26.229864 18804 raft_consensus.cc:493] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:26.248121 16320 leader_election.cc:304] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
W20260709 13:06:26.250123 16912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:26.251508 16352 raft_consensus.cc:2393] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 8: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:06:26.212790 18493 consensus_queue.cc:1048] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 13:06:26.249473 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:26.256345 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:26.257015 16201 raft_consensus.cc:2468] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 4.
I20260709 13:06:26.254346 16353 raft_consensus.cc:2376] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 7. Re-sending same reply.
I20260709 13:06:26.240231 18706 leader_election.cc:290] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:26.240468 18572 leader_election.cc:290] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:26.251858 18804 raft_consensus.cc:3060] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:26.266111 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:26.247577 18882 consensus_queue.cc:1059] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 13:06:26.262091 18785 raft_consensus.cc:2804] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:26.281394 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:26.263005 16105 catalog_manager.cc:5697] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 2 to 5, leader changed from 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) to 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66). New cstate: current_term: 5 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:26.282998 16353 raft_consensus.cc:2468] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 5.
I20260709 13:06:26.253403 18812 consensus_queue.cc:1048] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 13:06:26.232448 18711 consensus_queue.cc:237] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:26.279201 18785 raft_consensus.cc:493] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:26.299546 16915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:26.252291 18817 consensus_queue.cc:260] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:26.304013 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:26.286947 18850 leader_election.cc:290] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 7 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:26.305538 16353 raft_consensus.cc:2468] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 7.
W20260709 13:06:26.309844 18895 log.cc:927] Time spent T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.120s	user 0.001s	sys 0.001s
I20260709 13:06:26.310830 18809 leader_election.cc:290] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:26.311182 18706 raft_consensus.cc:3055] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:26.311652 18706 raft_consensus.cc:740] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:26.312707 18706 consensus_queue.cc:260] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:26.303954 16105 catalog_manager.cc:5697] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 2 to 5, leader changed from e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) to 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66). New cstate: current_term: 5 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:26.314026 18706 raft_consensus.cc:3060] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:26.316646 18817 raft_consensus.cc:3060] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:26.318235 16322 leader_election.cc:304] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:26.318701 18380 raft_consensus.cc:493] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:26.319499 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:26.319409 18380 raft_consensus.cc:515] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:26.320159 16353 raft_consensus.cc:2468] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 7.
I20260709 13:06:26.321663 18380 leader_election.cc:290] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:26.304966 18785 raft_consensus.cc:3060] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:06:26.327235 16321 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:26.327883 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:26.340638 16200 raft_consensus.cc:2410] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:06:26.347539 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:06:26.348067 16249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:26.330516 16246 leader_election.cc:304] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:26.341630 18830 raft_consensus.cc:2749] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:26.355691 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:26.358160 16206 raft_consensus.cc:3060] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:26.283535 18818 consensus_queue.cc:1059] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 13:06:26.341292 16322 leader_election.cc:304] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:26.339048 16173 leader_election.cc:304] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:06:26.343189 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:26.338588 16350 raft_consensus.cc:2468] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 6.
I20260709 13:06:26.359562 16203 raft_consensus.cc:2468] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 5.
I20260709 13:06:26.366696 18875 leader_election.cc:290] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:06:26.367461 18894 log.cc:927] Time spent T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
I20260709 13:06:26.375618 18818 raft_consensus.cc:3055] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:26.376195 18818 raft_consensus.cc:740] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:26.377209 18818 consensus_queue.cc:260] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:06:26.377990 16173 leader_election.cc:336] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 2.059s (SENT)
I20260709 13:06:26.378736 18865 raft_consensus.cc:2749] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:26.380643 16173 leader_election.cc:304] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:26.381820 18865 raft_consensus.cc:2749] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:26.360244 16105 catalog_manager.cc:5697] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 1 to 4, leader changed from 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) to 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66). New cstate: current_term: 4 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:26.386904 16105 catalog_manager.cc:5697] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 3 to 6, leader changed from 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) to 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66). New cstate: current_term: 6 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:26.388769 16105 catalog_manager.cc:5697] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: config changed from index 2 to 5, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New cstate: current_term: 4 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:26.334807 18882 consensus_queue.cc:1059] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.056s
I20260709 13:06:26.391949 18882 raft_consensus.cc:3055] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:26.392443 18882 raft_consensus.cc:740] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
W20260709 13:06:26.392971 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:26.393508 18882 consensus_queue.cc:260] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:26.339389 18899 raft_consensus.cc:493] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:26.395064 18899 raft_consensus.cc:515] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:26.397495 18899 leader_election.cc:290] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:06:26.344872 18890 log.cc:927] Time spent T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.125s	user 0.001s	sys 0.001s
I20260709 13:06:26.417021 18818 raft_consensus.cc:3060] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:26.417192 18809 raft_consensus.cc:493] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:26.417574 18830 raft_consensus.cc:493] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:26.418315 18830 raft_consensus.cc:515] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:26.417939 18809 raft_consensus.cc:515] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:26.420749 18830 leader_election.cc:290] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:26.421912 18809 leader_election.cc:290] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:26.422873 16206 raft_consensus.cc:2468] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 7.
W20260709 13:06:26.423164 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 92829.2us
I20260709 13:06:26.430629 16912 leader_election.cc:304] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:26.431674 16204 raft_consensus.cc:2468] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 6.
I20260709 13:06:26.414227 18380 raft_consensus.cc:2749] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:26.433725 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:26.433005 18882 raft_consensus.cc:3060] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:26.447714 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 106560us
I20260709 13:06:26.448781 16322 leader_election.cc:304] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:06:26.449661 18380 raft_consensus.cc:2764] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:06:26.450641 18380 consensus_queue.cc:1048] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:26.439153 18395 raft_consensus.cc:2804] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:26.451743 18395 raft_consensus.cc:697] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 LEADER]: Becoming Leader. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:06:26.452948 18395 consensus_queue.cc:237] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:26.469767 18785 raft_consensus.cc:515] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:06:26.470805 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 92864.4us
I20260709 13:06:26.441607 18875 raft_consensus.cc:2804] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:06:26.477578 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 45283.9us
W20260709 13:06:26.482053 16247 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:26.492509 16322 leader_election.cc:304] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:26.496368 16105 catalog_manager.cc:5697] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 1 to 4, leader changed from 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) to e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65). New cstate: current_term: 4 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } }
W20260709 13:06:26.509815 16173 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:26.504532 16205 raft_consensus.cc:2468] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 7.
I20260709 13:06:26.510923 18899 raft_consensus.cc:2749] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:26.516163 16279 raft_consensus.cc:1240] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 LEADER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 6. Current term is 7. Ops: []
W20260709 13:06:26.517213 16174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:26.517122 18809 raft_consensus.cc:493] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:26.517886 18809 raft_consensus.cc:515] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:26.517678 16105 catalog_manager.cc:5697] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 1 to 5, leader changed from e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) to 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66). New cstate: current_term: 5 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:26.520268 18809 leader_election.cc:290] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:26.521499 16320 leader_election.cc:304] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:26.508575 18875 raft_consensus.cc:493] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:26.520706 16105 catalog_manager.cc:5697] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:26.531772 16246 leader_election.cc:304] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:26.534901 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:26.537864 18706 raft_consensus.cc:2804] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:26.540148 18706 raft_consensus.cc:493] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:26.540637 18706 raft_consensus.cc:3060] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:26.541189 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:26.541821 16204 raft_consensus.cc:3060] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:26.542723 18812 raft_consensus.cc:493] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:26.543548 18812 raft_consensus.cc:515] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:26.532956 18809 raft_consensus.cc:2804] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:26.547326 18785 leader_election.cc:290] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:26.549265 18809 raft_consensus.cc:697] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 7 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:06:26.550459 18809 consensus_queue.cc:237] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:06:26.548066 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 105178us
I20260709 13:06:26.553445 16205 raft_consensus.cc:2410] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for term 9 because replica has last-logged OpId of term: 7 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 2.
W20260709 13:06:26.556139 16173 leader_election.cc:336] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 2.224s (SENT)
I20260709 13:06:26.556680 16173 leader_election.cc:304] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:26.558285 18865 raft_consensus.cc:2749] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:26.530191 18875 raft_consensus.cc:3060] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:26.560134 16173 leader_election.cc:304] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
W20260709 13:06:26.553519 16912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:26.561002 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 68629us
I20260709 13:06:26.599279 16246 leader_election.cc:304] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:26.604048 16246 leader_election.cc:304] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:26.605453 16204 raft_consensus.cc:2468] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 8.
I20260709 13:06:26.583113 18829 raft_consensus.cc:2804] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:26.589781 18804 raft_consensus.cc:515] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:26.535801 18882 consensus_queue.cc:1059] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.063s
I20260709 13:06:26.608291 16320 leader_election.cc:304] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:26.608058 16105 catalog_manager.cc:5697] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 1 to 2, leader changed from 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) to 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66). New cstate: current_term: 2 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:26.613018 16105 catalog_manager.cc:5697] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 1 to 6. New cstate: current_term: 6 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:26.614375 16248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:26.620115 16248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:26.621455 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:26.608063 18829 raft_consensus.cc:493] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:26.608799 18572 raft_consensus.cc:2804] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:26.623518 16322 leader_election.cc:304] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:26.615024 18812 leader_election.cc:290] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:26.621018 18785 raft_consensus.cc:2804] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:26.631414 18829 raft_consensus.cc:3060] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:26.645408 18810 raft_consensus.cc:2804] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:26.646039 18810 raft_consensus.cc:493] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:26.646836 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 48293.8us
I20260709 13:06:26.629916 18572 raft_consensus.cc:493] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:26.654121 18804 leader_election.cc:290] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:06:26.654757 18903 log.cc:927] Time spent T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
W20260709 13:06:26.656786 18901 log.cc:927] Time spent T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:06:26.662699 18829 raft_consensus.cc:515] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:26.664059 18804 raft_consensus.cc:493] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:26.664865 18804 raft_consensus.cc:515] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:26.648939 18810 raft_consensus.cc:3060] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:26.666091 18829 leader_election.cc:290] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 election: Requested vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:06:26.666774 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:26.669466 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 61563.7us
I20260709 13:06:26.669873 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:26.670650 16322 leader_election.cc:304] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:26.672914 16322 leader_election.cc:304] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:26.673936 18493 raft_consensus.cc:2749] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:26.650956 16105 catalog_manager.cc:5697] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 2 to 7, leader changed from 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) to 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66). New cstate: current_term: 7 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:26.673969 18650 raft_consensus.cc:2749] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:26.674991 18804 leader_election.cc:290] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:26.676419 16105 catalog_manager.cc:5697] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:26.651558 18785 raft_consensus.cc:697] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 8 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:06:26.647410 18830 raft_consensus.cc:2749] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:26.685953 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:26.690043 18785 consensus_queue.cc:237] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:26.690116 16105 catalog_manager.cc:5697] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 2 to 7, leader changed from e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) to 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66). New cstate: current_term: 7 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:26.692488 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:06:26.653532 18572 raft_consensus.cc:3060] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:26.695802 18644 raft_consensus.cc:493] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:26.705288 18644 raft_consensus.cc:515] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:06:26.702849 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 98883.6us
I20260709 13:06:26.712736 18644 leader_election.cc:290] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:06:26.713480 16915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:26.715799 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:26.716615 16204 raft_consensus.cc:2468] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 4.
I20260709 13:06:26.718132 16912 leader_election.cc:304] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:26.719192 18861 raft_consensus.cc:2804] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:26.719620 18861 raft_consensus.cc:493] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:26.719959 18861 raft_consensus.cc:3060] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:26.709214 16105 catalog_manager.cc:5697] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } }
I20260709 13:06:26.724996 16322 leader_election.cc:304] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:26.725961 18804 raft_consensus.cc:2749] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:26.725581 16105 catalog_manager.cc:5697] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:26.728947 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:26.729737 16276 raft_consensus.cc:2468] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 6.
I20260709 13:06:26.700520 16941 raft_consensus.cc:3060] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:26.736225 18861 raft_consensus.cc:515] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:26.741106 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:26.741816 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:26.741941 16276 raft_consensus.cc:2468] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 5.
I20260709 13:06:26.742427 16204 raft_consensus.cc:3060] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:26.743206 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:26.743798 16279 raft_consensus.cc:3060] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:06:26.767694 16247 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:26.768821 16204 raft_consensus.cc:2468] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 5.
I20260709 13:06:26.770737 16912 leader_election.cc:304] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:26.771836 18644 raft_consensus.cc:2804] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:26.771610 18875 raft_consensus.cc:515] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:26.772516 18644 raft_consensus.cc:697] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 LEADER]: Becoming Leader. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:06:26.773643 18644 consensus_queue.cc:237] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:26.774154 18875 leader_election.cc:290] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:26.746606 16105 catalog_manager.cc:5697] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 1 to 4, leader changed from e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) to 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66). New cstate: current_term: 4 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:26.786361 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:26.744441 18706 raft_consensus.cc:515] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:06:26.790169 16912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:26.790796 16105 catalog_manager.cc:5697] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 3 to 6, leader changed from 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) to 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66). New cstate: current_term: 6 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:26.794257 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:26.796196 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:26.786263 16914 leader_election.cc:304] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:26.808190 18861 leader_election.cc:290] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 5 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:06:26.809746 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:26.811425 16279 raft_consensus.cc:2468] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 7.
I20260709 13:06:26.807085 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bc3c8ff9b84838a2664335d7e1582b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:26.819216 16105 catalog_manager.cc:5697] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 3 to 5, leader changed from e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) to 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66). New cstate: current_term: 5 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:26.822525 16357 raft_consensus.cc:1240] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
W20260709 13:06:26.826680 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:26.826321 18810 raft_consensus.cc:515] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:06:26.827327 16246 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:26.827672 16941 raft_consensus.cc:2468] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 8.
I20260709 13:06:26.828977 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:26.809717 18817 raft_consensus.cc:2804] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:26.827009 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:26.845005 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:26.851511 16353 raft_consensus.cc:1240] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 7 LEADER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 6. Current term is 7. Ops: []
W20260709 13:06:26.854640 16249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:26.855952 16350 raft_consensus.cc:1240] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:26.857060 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:26.857686 16352 raft_consensus.cc:3060] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:26.859931 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:06:26.865309 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 79186us
I20260709 13:06:26.866442 18817 raft_consensus.cc:697] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [term 6 LEADER]: Becoming Leader. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:06:26.867727 16354 raft_consensus.cc:1275] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:06:26.867684 18817 consensus_queue.cc:237] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:26.868464 16914 leader_election.cc:304] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:06:26.869248 16350 raft_consensus.cc:1240] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 5 LEADER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:26.874275 18904 raft_consensus.cc:2804] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:26.874775 18904 raft_consensus.cc:493] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:26.875140 18904 raft_consensus.cc:3060] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:26.875634 18810 leader_election.cc:290] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:26.876607 16350 raft_consensus.cc:1240] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:26.872822 16173 leader_election.cc:304] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:26.888537 16357 raft_consensus.cc:1275] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:06:26.889904 16352 raft_consensus.cc:2468] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 8.
I20260709 13:06:26.888759 18818 raft_consensus.cc:2804] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:26.889223 16105 catalog_manager.cc:5697] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 1 to 5, leader changed from e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) to 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66). New cstate: current_term: 5 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:26.892023 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:26.903919 16199 raft_consensus.cc:2393] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 7: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:06:26.892791 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:26.893424 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:26.895926 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:26.898337 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:26.870690 18814 raft_consensus.cc:3055] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:26.899269 16353 raft_consensus.cc:1240] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:26.906724 18814 raft_consensus.cc:740] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:26.903115 18818 raft_consensus.cc:493] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:26.907498 18818 raft_consensus.cc:3060] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:26.907930 18814 consensus_queue.cc:260] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:26.909125 18814 raft_consensus.cc:3060] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:26.906327 16357 raft_consensus.cc:3060] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:26.899504 18706 leader_election.cc:290] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:26.871223 18572 raft_consensus.cc:515] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:26.921376 18572 leader_election.cc:290] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:26.921806 16357 raft_consensus.cc:2468] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 8.
I20260709 13:06:26.926821 16350 raft_consensus.cc:2468] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 7.
I20260709 13:06:26.934701 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:26.935537 16350 raft_consensus.cc:2468] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 6.
I20260709 13:06:26.931422 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:26.935438 16173 leader_election.cc:304] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:26.937701 16353 raft_consensus.cc:2468] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 4.
I20260709 13:06:26.938009 18908 raft_consensus.cc:2804] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:26.938410 18908 raft_consensus.cc:493] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:26.938836 18908 raft_consensus.cc:3060] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:26.939869 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:26.945423 16357 raft_consensus.cc:2376] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 6. Re-sending same reply.
I20260709 13:06:26.942492 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:26.950809 16354 raft_consensus.cc:2468] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 5.
I20260709 13:06:26.944186 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:26.952224 16350 raft_consensus.cc:2468] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 6.
I20260709 13:06:26.926451 18818 raft_consensus.cc:515] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:26.948758 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:26.955433 18865 consensus_queue.cc:1059] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:26.956699 18829 raft_consensus.cc:3055] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:26.957058 18829 raft_consensus.cc:740] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:26.958034 18818 leader_election.cc:290] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:26.930186 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:26.958379 18829 consensus_queue.cc:260] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:26.969969 18829 raft_consensus.cc:3060] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:26.959570 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bc3c8ff9b84838a2664335d7e1582b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:06:26.961577 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:26.962212 18865 consensus_queue.cc:1059] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:26.976238 18865 raft_consensus.cc:3055] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:26.976681 18865 raft_consensus.cc:740] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:26.977779 18865 consensus_queue.cc:260] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:26.979178 18865 raft_consensus.cc:3060] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:26.982746 18572 raft_consensus.cc:493] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:26.983608 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:26.983492 18572 raft_consensus.cc:515] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:26.963773 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:26.986868 16350 raft_consensus.cc:1275] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:06:26.988988 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:26.991677 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:26.992410 16352 raft_consensus.cc:3060] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:26.955814 16353 raft_consensus.cc:2376] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 7. Re-sending same reply.
I20260709 13:06:26.966252 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:06:26.966323 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 87266.4us
I20260709 13:06:26.968004 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:26.984244 16348 raft_consensus.cc:2376] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 5. Re-sending same reply.
I20260709 13:06:26.996804 18395 raft_consensus.cc:493] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:26.997408 18395 raft_consensus.cc:515] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:06:27.003827 16247 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:27.004096 18395 leader_election.cc:290] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:27.005972 16199 raft_consensus.cc:1275] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:06:27.008251 18908 raft_consensus.cc:515] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:06:27.010767 16246 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:27.010530 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:27.011354 16199 raft_consensus.cc:2468] T b9e1324823f04d8da5a4b3ddbd061c0e P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 5.
W20260709 13:06:27.012022 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:27.012085 18395 consensus_queue.cc:1048] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:27.013559 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:27.015312 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:27.015959 16283 raft_consensus.cc:2468] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 7.
I20260709 13:06:27.017242 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:27.018015 16283 raft_consensus.cc:2393] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 6: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:06:27.023872 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:27.024610 16354 raft_consensus.cc:3060] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:27.024199 18904 raft_consensus.cc:515] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:27.028646 18904 leader_election.cc:290] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 6 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:26.965023 16173 leader_election.cc:304] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:27.033871 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:27.060201 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:27.060408 16282 raft_consensus.cc:2468] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 5.
I20260709 13:06:27.060880 16275 raft_consensus.cc:2468] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 5.
I20260709 13:06:27.034098 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:27.061857 16276 raft_consensus.cc:2468] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 6.
I20260709 13:06:27.034503 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:27.037201 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:27.063393 16278 raft_consensus.cc:2468] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 5.
I20260709 13:06:27.063508 16348 raft_consensus.cc:3060] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:27.039098 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:27.040184 16354 raft_consensus.cc:2468] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 5.
I20260709 13:06:27.041196 18572 leader_election.cc:290] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:26.962761 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:27.041996 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:27.043197 16204 raft_consensus.cc:3055] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:27.043923 18706 raft_consensus.cc:493] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:27.082767 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:27.043956 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:27.049786 16206 raft_consensus.cc:1240] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:27.050701 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:27.085007 16202 raft_consensus.cc:3060] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:27.052062 16352 raft_consensus.cc:2468] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 7.
W20260709 13:06:27.059592 16248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:27.064900 16208 raft_consensus.cc:2393] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 7: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
W20260709 13:06:27.064708 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 99859.7us
I20260709 13:06:27.072470 18829 raft_consensus.cc:2804] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:06:27.076987 16912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:27.088017 16173 leader_election.cc:304] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:27.077020 16204 raft_consensus.cc:740] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:27.089082 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:27.084591 16246 leader_election.cc:304] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:27.081449 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:06:27.089874 16174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:27.081804 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:27.082175 16207 raft_consensus.cc:2393] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 5: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:06:27.087780 16200 raft_consensus.cc:2393] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 8: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:06:27.090386 16278 raft_consensus.cc:2393] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 5: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:06:27.092034 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:27.092202 18572 raft_consensus.cc:2749] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:27.092710 16275 raft_consensus.cc:3060] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:27.092939 18822 consensus_queue.cc:1059] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:27.093843 18822 consensus_queue.cc:1243] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer 0aea40d6e4374085a2e38a70a71f63e3 log is divergent from this leader: its last log entry 7.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:06:27.094228 16274 raft_consensus.cc:1275] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:06:27.094363 18822 raft_consensus.cc:2804] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:27.094753 18822 raft_consensus.cc:493] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:27.095098 18822 raft_consensus.cc:3060] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:27.082816 18706 raft_consensus.cc:515] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:27.097257 18706 leader_election.cc:290] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:27.093212 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:27.064239 18908 leader_election.cc:290] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:27.106101 16276 raft_consensus.cc:2468] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 5.
I20260709 13:06:27.122360 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:27.123478 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:27.124368 16276 raft_consensus.cc:2393] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 7: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:06:27.115028 18829 raft_consensus.cc:697] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:27.135762 18850 consensus_queue.cc:1048] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:27.148356 16348 raft_consensus.cc:2468] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 6.
I20260709 13:06:27.149340 16281 raft_consensus.cc:2468] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 5.
I20260709 13:06:27.151108 16202 raft_consensus.cc:2468] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 6.
I20260709 13:06:27.153920 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:27.154109 16946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:27.154826 16202 raft_consensus.cc:2468] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 5.
I20260709 13:06:27.155455 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:27.156060 16940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:27.156400 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:27.156962 16940 raft_consensus.cc:2393] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 5: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:06:27.154852 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:27.161291 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:27.163105 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:27.163792 16279 raft_consensus.cc:2376] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 8. Re-sending same reply.
I20260709 13:06:27.165083 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:27.165831 16277 raft_consensus.cc:2393] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 7: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:06:27.167763 16246 leader_election.cc:304] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:27.165773 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:27.174185 16280 raft_consensus.cc:2393] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 7: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:06:27.173929 16246 leader_election.cc:304] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:27.188345 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:27.189270 16279 raft_consensus.cc:2393] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 5: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:06:27.192416 16282 raft_consensus.cc:2468] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 7.
I20260709 13:06:27.194096 16280 raft_consensus.cc:1275] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:06:27.195328 16173 leader_election.cc:304] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:27.200783 16204 consensus_queue.cc:260] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:27.202216 16204 raft_consensus.cc:3060] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:27.205034 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:27.207401 16275 raft_consensus.cc:2468] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 6.
W20260709 13:06:27.208904 16248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:27.209546 16248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:27.213915 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:27.218127 16204 raft_consensus.cc:1275] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:06:27.192591 18711 raft_consensus.cc:2804] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:27.224277 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:27.193792 18706 raft_consensus.cc:2804] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:27.135854 18829 consensus_queue.cc:237] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:27.247409 16275 raft_consensus.cc:2468] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 5.
I20260709 13:06:27.248391 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:27.256363 16281 raft_consensus.cc:2468] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 7.
W20260709 13:06:27.253384 18812 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 13:06:27.261720 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:27.280211 16947 raft_consensus.cc:2393] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 6: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
I20260709 13:06:27.270442 18818 raft_consensus.cc:2804] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:27.281854 18818 raft_consensus.cc:697] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 8 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:27.283114 18818 consensus_queue.cc:237] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:27.284010 16281 raft_consensus.cc:1275] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:06:27.286731 16202 raft_consensus.cc:1275] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:06:27.257565 18814 consensus_queue.cc:1048] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 13:06:27.253788 18706 raft_consensus.cc:493] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:27.291741 18706 raft_consensus.cc:3060] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:27.260306 18380 raft_consensus.cc:493] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
W20260709 13:06:27.304308 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:27.339946 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 144705us
I20260709 13:06:27.259832 18711 raft_consensus.cc:697] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:27.347438 18711 consensus_queue.cc:237] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:27.348748 18928 raft_consensus.cc:493] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:27.349592 18928 raft_consensus.cc:515] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:27.352458 18875 raft_consensus.cc:493] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:27.342068 18380 raft_consensus.cc:515] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:27.355327 16204 raft_consensus.cc:1275] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:06:27.355079 18875 raft_consensus.cc:515] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:27.356619 18380 leader_election.cc:290] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:27.362872 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:27.363741 16281 raft_consensus.cc:2393] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 7: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:06:27.358770 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:27.319126 18804 raft_consensus.cc:493] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:27.357417 18875 leader_election.cc:290] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:27.394794 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:27.299631 18919 consensus_queue.cc:1048] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.088s
I20260709 13:06:27.353487 18809 raft_consensus.cc:493] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:27.352762 18830 raft_consensus.cc:493] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:27.399428 16204 raft_consensus.cc:1275] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:06:27.370539 18865 raft_consensus.cc:493] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:27.400131 16173 leader_election.cc:304] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
W20260709 13:06:27.403839 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:27.417027 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:27.357441 18899 raft_consensus.cc:493] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:27.393507 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:27.411471 18822 raft_consensus.cc:515] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:27.412443 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:27.369474 18380 consensus_queue.cc:1048] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 13:06:27.399746 18875 raft_consensus.cc:493] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:27.424374 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:27.423332 18818 raft_consensus.cc:2804] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:27.427381 16173 leader_election.cc:304] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:27.436337 18908 raft_consensus.cc:2804] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:27.436911 18908 raft_consensus.cc:493] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
W20260709 13:06:27.437222 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 297485us
I20260709 13:06:27.437736 18875 raft_consensus.cc:515] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:27.440280 18875 leader_election.cc:290] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:27.401254 18804 raft_consensus.cc:515] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:27.421084 18644 raft_consensus.cc:493] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:27.442765 18644 raft_consensus.cc:515] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:27.444068 18804 leader_election.cc:290] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:27.444905 18644 leader_election.cc:290] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:27.430029 18818 raft_consensus.cc:493] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:27.445674 18818 raft_consensus.cc:3060] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:27.450745 18830 raft_consensus.cc:515] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:27.451226 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:27.453162 18830 leader_election.cc:290] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:27.453783 18830 raft_consensus.cc:493] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:27.420742 18865 raft_consensus.cc:515] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:27.437325 18908 raft_consensus.cc:3060] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:27.423743 18899 raft_consensus.cc:515] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:27.460711 16173 leader_election.cc:304] T b9e1324823f04d8da5a4b3ddbd061c0e P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:27.462011 18899 leader_election.cc:290] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:27.474680 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:27.475594 16280 raft_consensus.cc:2393] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 6: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
W20260709 13:06:27.486480 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 214537us
I20260709 13:06:27.490851 16914 leader_election.cc:304] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:27.454298 18830 raft_consensus.cc:515] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:27.420069 18809 raft_consensus.cc:515] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:27.495743 18929 raft_consensus.cc:2804] T b9e1324823f04d8da5a4b3ddbd061c0e P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:27.495882 18861 raft_consensus.cc:2804] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:27.497263 18919 consensus_queue.cc:1048] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:06:27.509763 18706 raft_consensus.cc:515] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:27.511626 18865 leader_election.cc:290] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:27.511996 18706 leader_election.cc:290] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:27.500437 18929 raft_consensus.cc:493] T b9e1324823f04d8da5a4b3ddbd061c0e P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:27.513001 18929 raft_consensus.cc:3060] T b9e1324823f04d8da5a4b3ddbd061c0e P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:27.519508 18928 leader_election.cc:290] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:27.501046 16914 leader_election.cc:304] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:06:27.506830 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:27.507630 18822 leader_election.cc:290] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:27.507548 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:27.524123 16281 raft_consensus.cc:3060] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:27.507990 18809 leader_election.cc:290] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:27.508104 18861 raft_consensus.cc:493] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:27.522243 16278 raft_consensus.cc:2410] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for term 9 because replica has last-logged OpId of term: 7 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 2.
W20260709 13:06:27.523617 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 119749us
I20260709 13:06:27.526285 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
W20260709 13:06:27.528350 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:27.532514 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 96706.7us
I20260709 13:06:27.537510 18830 leader_election.cc:290] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:27.532781 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:27.530092 18861 raft_consensus.cc:3060] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:27.543118 16207 raft_consensus.cc:2368] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for earlier term 4. Current term is 5.
I20260709 13:06:27.546324 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:27.549043 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:27.546473 16173 leader_election.cc:304] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:27.550191 16280 raft_consensus.cc:2468] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 6.
I20260709 13:06:27.559702 16274 raft_consensus.cc:1275] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:06:27.560515 16208 raft_consensus.cc:1275] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 13:06:27.561108 16208 pending_rounds.cc:85] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f: Aborting all ops after (but not including) 5
I20260709 13:06:27.565608 16281 raft_consensus.cc:2468] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 8.
W20260709 13:06:27.568517 16174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:27.561427 16208 pending_rounds.cc:107] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f: Aborting uncommitted NO_OP operation due to leader change: 5.6
W20260709 13:06:27.570326 16174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:27.547222 18926 raft_consensus.cc:2804] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:06:27.571666 16174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:27.574051 16320 leader_election.cc:400] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 pre-election: Vote denied by peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073) with higher term. Message: Invalid argument: T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for earlier term 4. Current term is 5.
I20260709 13:06:27.518422 18908 raft_consensus.cc:515] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:27.569715 16208 raft_consensus.cc:2889] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:27.576902 16320 leader_election.cc:403] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:27.531949 18818 raft_consensus.cc:515] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:27.559163 18809 consensus_queue.cc:1048] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.013s
I20260709 13:06:27.562624 18822 raft_consensus.cc:2804] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:27.587535 16348 raft_consensus.cc:1240] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:27.589676 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:27.566268 18711 raft_consensus.cc:493] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:27.596035 16352 raft_consensus.cc:2376] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 7. Re-sending same reply.
I20260709 13:06:27.598325 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:27.600286 16357 raft_consensus.cc:2393] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 in current term 5: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:06:27.599859 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:27.601097 16208 raft_consensus.cc:2468] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 8.
I20260709 13:06:27.610740 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:27.611517 16351 raft_consensus.cc:2376] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 7. Re-sending same reply.
I20260709 13:06:27.611770 18818 leader_election.cc:290] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:27.606428 18934 raft_consensus.cc:493] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:27.619930 18934 raft_consensus.cc:515] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:27.623703 18822 raft_consensus.cc:697] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 8 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:27.624488 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:27.624758 18822 consensus_queue.cc:237] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:06:27.625720 16912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:27.594347 18936 raft_consensus.cc:493] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:27.626904 18936 raft_consensus.cc:515] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:27.629160 18936 leader_election.cc:290] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:27.629976 18711 raft_consensus.cc:515] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:27.632543 18711 leader_election.cc:290] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:27.585381 18926 raft_consensus.cc:697] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [term 6 LEADER]: Becoming Leader. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:06:27.633932 18926 consensus_queue.cc:237] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:27.641908 18935 raft_consensus.cc:3060] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:06:27.642959 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:27.643759 16204 raft_consensus.cc:3060] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:27.646831 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:06:27.655156 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 51628.2us
W20260709 13:06:27.654506 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 48781.4us
I20260709 13:06:27.622304 18934 leader_election.cc:290] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:27.665108 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:06:27.669344 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 109350us
I20260709 13:06:27.666985 16320 leader_election.cc:304] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
W20260709 13:06:27.667668 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 52081.3us
I20260709 13:06:27.673591 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:27.674477 16352 raft_consensus.cc:2468] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 5.
I20260709 13:06:27.679080 16274 raft_consensus.cc:1275] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:06:27.682852 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:27.646929 18908 leader_election.cc:290] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:27.684926 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:27.633689 18929 raft_consensus.cc:515] T b9e1324823f04d8da5a4b3ddbd061c0e P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:27.686900 16351 raft_consensus.cc:2468] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 5.
I20260709 13:06:27.684271 18933 raft_consensus.cc:493] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:27.694226 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:27.702831 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:27.703749 16351 raft_consensus.cc:2468] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 5.
I20260709 13:06:27.709920 16248 leader_election.cc:304] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:27.662253 18817 consensus_queue.cc:1048] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 13:06:27.699739 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:27.683137 18934 raft_consensus.cc:2804] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:27.719408 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:27.724174 16351 raft_consensus.cc:3060] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:27.734706 16281 raft_consensus.cc:2468] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 7.
I20260709 13:06:27.736042 18810 consensus_queue.cc:1048] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:27.740417 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:27.741178 16354 raft_consensus.cc:2468] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 4.
I20260709 13:06:27.742367 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:27.746698 16354 raft_consensus.cc:2468] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 5.
I20260709 13:06:27.751365 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:27.754848 16354 raft_consensus.cc:2393] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 6: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:06:27.698168 16204 raft_consensus.cc:2468] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 6.
I20260709 13:06:27.762789 16246 leader_election.cc:304] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:27.763737 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:27.764555 16354 raft_consensus.cc:2468] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 5.
I20260709 13:06:27.765058 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:27.765475 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:27.766171 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:27.766844 16355 raft_consensus.cc:2468] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 7.
I20260709 13:06:27.768262 16349 raft_consensus.cc:2393] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 8: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:06:27.769219 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:27.770246 16349 raft_consensus.cc:2393] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 8: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:06:27.728579 18934 raft_consensus.cc:493] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:27.775934 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:27.776600 16355 raft_consensus.cc:3060] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:27.775853 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:27.780076 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:27.780750 16349 raft_consensus.cc:3060] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:27.782275 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:27.761302 18810 consensus_queue.cc:1059] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 13:06:27.768195 18814 raft_consensus.cc:2804] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:27.800276 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:27.801097 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:27.803917 16356 raft_consensus.cc:2393] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 5: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:06:27.805197 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:27.806648 16350 raft_consensus.cc:2393] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 7: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:06:27.773658 18934 raft_consensus.cc:3060] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:27.722729 18861 raft_consensus.cc:515] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:27.804427 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:27.816151 16281 raft_consensus.cc:1275] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:06:27.811291 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:27.813584 18929 leader_election.cc:290] T b9e1324823f04d8da5a4b3ddbd061c0e P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:27.821004 16351 raft_consensus.cc:2468] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 6.
I20260709 13:06:27.825364 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:06:27.819818 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 83548.1us
I20260709 13:06:27.831156 16349 raft_consensus.cc:2468] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 5.
I20260709 13:06:27.721818 18933 raft_consensus.cc:515] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:27.835184 16278 raft_consensus.cc:1275] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:06:27.836237 16355 raft_consensus.cc:2468] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 8.
I20260709 13:06:27.775490 16348 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c"
dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
mode: GRACEFUL
new_leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
 from {username='slave'} at 127.0.0.1:56792
I20260709 13:06:27.838266 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:27.843152 16348 raft_consensus.cc:606] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Received request to transfer leadership to TS 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:06:27.843552 16348 raft_consensus.cc:614] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:27.834997 18814 raft_consensus.cc:697] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:27.844764 18814 consensus_queue.cc:237] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:27.849623 18572 raft_consensus.cc:2749] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:06:27.851279 18939 log.cc:927] Time spent T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.151s	user 0.000s	sys 0.001s
I20260709 13:06:27.852409 18861 leader_election.cc:290] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 6 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:27.852481 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
W20260709 13:06:27.830159 18941 log.cc:927] Time spent T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 13:06:27.853689 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:27.857450 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:27.858429 16206 raft_consensus.cc:2393] T b9e1324823f04d8da5a4b3ddbd061c0e P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 in current term 6: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:06:27.860677 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:06:27.868669 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:27.908445 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:27.910851 16173 leader_election.cc:304] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:06:27.951177 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:27.964072 16278 raft_consensus.cc:2393] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 8: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
W20260709 13:06:27.964959 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 54252.1us
I20260709 13:06:27.966444 16173 leader_election.cc:304] T b9e1324823f04d8da5a4b3ddbd061c0e P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
W20260709 13:06:27.971082 18946 log.cc:927] Time spent T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
W20260709 13:06:27.973466 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 269586us
I20260709 13:06:27.952379 18706 raft_consensus.cc:493] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:27.951668 18380 raft_consensus.cc:493] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:27.983739 16914 leader_election.cc:336] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 1.816s (SENT)
I20260709 13:06:27.985750 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:27.986202 16914 leader_election.cc:304] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:27.965794 18829 raft_consensus.cc:2804] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:27.987149 16173 leader_election.cc:400] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 pre-election: Vote denied by peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107) with higher term. Message: Invalid argument: T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for earlier term 6. Current term is 7.
I20260709 13:06:27.910317 18929 consensus_queue.cc:1048] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.073s
I20260709 13:06:27.988584 16173 leader_election.cc:403] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:27.986455 16278 raft_consensus.cc:3060] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:27.969136 18936 raft_consensus.cc:2764] T b9e1324823f04d8da5a4b3ddbd061c0e P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Leader election decision vote started in defunct term 5: won
I20260709 13:06:27.988430 18706 raft_consensus.cc:515] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:27.989585 16322 leader_election.cc:304] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:27.963538 18711 consensus_queue.cc:1048] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:06:27.993671 18822 raft_consensus.cc:2749] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107) with higher term. Message: Invalid argument: T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for earlier term 6. Current term is 7.
I20260709 13:06:27.990844 18829 raft_consensus.cc:493] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:27.993968 18904 raft_consensus.cc:2749] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:06:28.119653 16278 raft_consensus.cc:2468] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 6.
I20260709 13:06:28.096732 18933 leader_election.cc:290] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:06:28.105171 18948 log.cc:927] Time spent T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.140s	user 0.000s	sys 0.000s
I20260709 13:06:28.133546 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:06:28.106465 18942 log.cc:927] Time spent T 00000000000000000000000000000000 P 4dc6f08597514f4d85fd451b999b403e: Append to log took a long time: real 0.142s	user 0.000s	sys 0.003s
I20260709 13:06:28.135023 18911 consensus_queue.cc:1059] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
W20260709 13:06:28.106891 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 123199us
W20260709 13:06:28.136160 16914 leader_election.cc:336] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 1.891s (SENT)
W20260709 13:06:28.137458 16914 leader_election.cc:336] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 1.904s (SENT)
I20260709 13:06:28.137882 16914 leader_election.cc:304] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:28.081180 18935 raft_consensus.cc:2749] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073) with higher term. Message: Invalid argument: T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for earlier term 4. Current term is 5.
I20260709 13:06:28.138754 18958 raft_consensus.cc:2749] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:28.139689 16352 raft_consensus.cc:2468] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 5.
I20260709 13:06:27.990782 18380 raft_consensus.cc:515] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:28.114363 18936 raft_consensus.cc:493] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:28.113559 18829 raft_consensus.cc:3060] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:28.136205 18911 raft_consensus.cc:3055] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:06:28.095463 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 111658us
I20260709 13:06:28.141952 16248 leader_election.cc:304] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63
W20260709 13:06:28.161019 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 171539us
I20260709 13:06:28.162505 16322 leader_election.cc:304] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:28.164676 16322 leader_election.cc:304] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:28.166842 16322 leader_election.cc:304] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:28.151160 18919 raft_consensus.cc:2749] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:06:28.198951 18960 raft_consensus.cc:2804] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:28.199788 18963 raft_consensus.cc:2749] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:06:28.198086 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 74155.5us
I20260709 13:06:28.156293 18911 raft_consensus.cc:740] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
W20260709 13:06:28.200929 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 85376.9us
I20260709 13:06:28.203938 16248 leader_election.cc:304] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:06:28.207880 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 49192.2us
I20260709 13:06:28.208946 16914 leader_election.cc:304] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:28.169044 18830 raft_consensus.cc:2749] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:28.168853 18933 raft_consensus.cc:2749] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:28.157238 18936 raft_consensus.cc:515] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:06:28.211500 18954 log.cc:927] Time spent T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
I20260709 13:06:28.211717 18911 consensus_queue.cc:260] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:28.212301 18706 leader_election.cc:290] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:28.229331 16248 leader_election.cc:304] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:28.217552 18380 leader_election.cc:290] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:28.219300 16173 leader_election.cc:304] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:06:28.239363 18706 raft_consensus.cc:2804] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:28.239833 18706 raft_consensus.cc:493] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:28.240206 18706 raft_consensus.cc:3060] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:28.241050 16173 leader_election.cc:304] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:28.222029 18910 raft_consensus.cc:2804] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:28.242177 18910 raft_consensus.cc:697] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:28.238226 18911 raft_consensus.cc:3060] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:06:28.264923 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 56843.2us
I20260709 13:06:28.233006 18936 leader_election.cc:290] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:28.209740 18960 raft_consensus.cc:697] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:28.256297 18929 raft_consensus.cc:2804] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:28.260203 18909 raft_consensus.cc:3055] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:28.259233 18908 raft_consensus.cc:2749] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:06:28.319607 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 110730us
I20260709 13:06:28.321604 16914 leader_election.cc:304] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3
W20260709 13:06:28.289750 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 48784.2us
W20260709 13:06:28.295135 16174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:28.327845 16208 raft_consensus.cc:1275] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:06:28.283155 16248 leader_election.cc:304] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:28.305270 16322 leader_election.cc:304] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:28.290140 18929 raft_consensus.cc:493] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:28.313444 18706 raft_consensus.cc:515] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:28.328804 18926 raft_consensus.cc:2804] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:28.348414 18926 raft_consensus.cc:493] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:28.348945 18926 raft_consensus.cc:3060] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:28.355293 18830 raft_consensus.cc:493] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:28.355926 18830 raft_consensus.cc:515] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:28.360221 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:28.343592 16353 raft_consensus.cc:1275] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:06:28.264915 18904 raft_consensus.cc:2749] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:28.366693 16173 leader_election.cc:304] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:06:28.316896 18909 raft_consensus.cc:740] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:28.326239 18822 raft_consensus.cc:493] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:28.378314 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:28.331727 18572 raft_consensus.cc:493] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:28.330246 18929 raft_consensus.cc:3060] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:06:28.381672 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 60165.4us
I20260709 13:06:28.381758 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:28.333238 18706 leader_election.cc:290] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:28.330749 18944 raft_consensus.cc:493] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:28.385251 16914 leader_election.cc:304] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:06:28.391908 16173 leader_election.cc:304] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
W20260709 13:06:28.393918 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:28.385982 18572 raft_consensus.cc:515] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:28.395362 18861 consensus_queue.cc:1048] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:28.386137 18830 leader_election.cc:290] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:28.396520 18572 leader_election.cc:290] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:28.398886 16200 raft_consensus.cc:1275] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:06:28.379477 18908 raft_consensus.cc:2804] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:06:28.388355 18934 consensus_meta.cc:287] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 0.559s	user 0.006s	sys 0.004s
I20260709 13:06:28.383127 18963 raft_consensus.cc:493] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
W20260709 13:06:28.414106 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 108996us
I20260709 13:06:28.383613 18785 raft_consensus.cc:2749] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:06:28.432499 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 53890.4us
I20260709 13:06:28.435421 16173 leader_election.cc:304] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:28.411289 18572 raft_consensus.cc:2804] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:28.409408 18908 raft_consensus.cc:493] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:28.383086 18822 raft_consensus.cc:515] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:28.439414 16173 leader_election.cc:304] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:06:28.412258 18928 raft_consensus.cc:2804] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:06:28.441463 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 158392us
I20260709 13:06:28.431080 18963 raft_consensus.cc:515] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:28.454053 16248 leader_election.cc:304] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:28.399432 18944 raft_consensus.cc:515] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:28.438868 18936 raft_consensus.cc:3060] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:28.473354 16248 leader_election.cc:304] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:28.460453 18927 raft_consensus.cc:2804] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:28.464597 18822 leader_election.cc:290] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:28.397473 18910 consensus_queue.cc:237] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:28.439479 18909 consensus_queue.cc:260] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } }
W20260709 13:06:28.469446 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 69649.1us
I20260709 13:06:28.470371 18958 raft_consensus.cc:493] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:28.458407 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:28.459039 18572 raft_consensus.cc:697] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:28.427529 18934 raft_consensus.cc:515] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:28.478789 16280 raft_consensus.cc:1275] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:06:28.482610 16207 raft_consensus.cc:1275] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:06:28.451443 18908 raft_consensus.cc:3060] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:28.483858 18927 raft_consensus.cc:493] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:28.494908 18927 raft_consensus.cc:3060] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:28.491171 18644 raft_consensus.cc:493] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:28.499125 18644 raft_consensus.cc:515] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:28.500765 18572 consensus_queue.cc:237] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:28.502779 18934 leader_election.cc:290] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:28.485261 18809 consensus_queue.cc:1048] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:28.515053 18644 leader_election.cc:290] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:28.520982 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:28.522182 18944 leader_election.cc:290] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:28.453454 18814 consensus_queue.cc:1048] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 13:06:28.524955 18963 leader_election.cc:290] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:28.439183 18960 consensus_queue.cc:237] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:06:28.529284 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 69204.2us
I20260709 13:06:28.530167 16248 leader_election.cc:304] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:06:28.530965 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 47785.1us
I20260709 13:06:28.535519 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:28.538468 16248 leader_election.cc:304] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:28.485961 18977 raft_consensus.cc:2764] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader election decision vote started in defunct term 7: won
W20260709 13:06:28.485980 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 56727.6us
I20260709 13:06:28.458956 18875 raft_consensus.cc:2804] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:06:28.486428 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 47135.3us
I20260709 13:06:28.493003 18965 consensus_queue.cc:1048] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:06:28.542847 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 53824.3us
I20260709 13:06:28.542085 16208 raft_consensus.cc:2468] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 8.
I20260709 13:06:28.531860 18958 raft_consensus.cc:515] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:28.549144 16248 leader_election.cc:304] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:28.561601 16248 leader_election.cc:304] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:06:28.549903 16322 leader_election.cc:304] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:28.558403 18875 raft_consensus.cc:493] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:28.554888 18911 raft_consensus.cc:2749] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:28.559183 18706 consensus_queue.cc:1048] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 13:06:28.565153 18963 raft_consensus.cc:3060] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:28.568320 18711 raft_consensus.cc:2749] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:06:28.576210 16173 leader_election.cc:304] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:06:28.578991 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:28.572365 16322 leader_election.cc:304] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:28.576776 18817 consensus_queue.cc:1048] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 13:06:28.580235 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:28.582244 18957 raft_consensus.cc:2749] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:28.570762 18875 raft_consensus.cc:3060] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:28.581888 18929 raft_consensus.cc:515] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:28.574846 18814 raft_consensus.cc:2804] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:28.567742 18829 raft_consensus.cc:515] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:28.591344 18928 raft_consensus.cc:697] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 6 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:28.585824 18908 raft_consensus.cc:515] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:28.620532 16204 raft_consensus.cc:1240] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:28.573110 18926 raft_consensus.cc:515] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:28.622368 16202 raft_consensus.cc:1240] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 4. Current term is 5. Ops: []
W20260709 13:06:28.622431 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 60911.8us
I20260709 13:06:28.624327 16248 leader_election.cc:304] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:28.626286 16248 leader_election.cc:304] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:06:28.605971 18809 raft_consensus.cc:2749] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:06:28.632573 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 63482us
I20260709 13:06:28.612995 18814 raft_consensus.cc:697] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
W20260709 13:06:28.638875 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 162138us
I20260709 13:06:28.640910 16322 leader_election.cc:304] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:28.643211 16205 raft_consensus.cc:1240] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:28.645895 18929 leader_election.cc:290] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:28.647684 18972 raft_consensus.cc:2749] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:28.650679 18908 leader_election.cc:290] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:28.635044 18957 raft_consensus.cc:2749] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:28.654582 18951 consensus_queue.cc:1048] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.097s
W20260709 13:06:28.656701 16246 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:28.662708 18957 raft_consensus.cc:493] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:28.663348 18957 raft_consensus.cc:515] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:28.689884 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:28.666332 18957 leader_election.cc:290] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:28.702284 16320 leader_election.cc:304] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
W20260709 13:06:28.707947 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 81769.9us
I20260709 13:06:28.621228 18927 raft_consensus.cc:515] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:06:28.725508 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 81107.7us
I20260709 13:06:28.728371 16173 leader_election.cc:304] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:06:28.709458 16248 leader_election.cc:304] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:06:28.710538 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 74017us
I20260709 13:06:28.731391 16322 leader_election.cc:304] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:28.731956 16173 leader_election.cc:304] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:28.692157 18951 raft_consensus.cc:493] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:28.698761 18935 raft_consensus.cc:493] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:28.698936 18809 raft_consensus.cc:2749] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:28.701821 18822 raft_consensus.cc:2764] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:06:28.701191 18934 raft_consensus.cc:493] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:28.740473 18965 raft_consensus.cc:2804] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:28.746976 18804 raft_consensus.cc:2749] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:28.793188 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:06:28.797564 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 88186.4us
I20260709 13:06:28.751160 18957 raft_consensus.cc:2749] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:28.800294 16248 leader_election.cc:304] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:28.698233 18972 consensus_queue.cc:1059] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.085s
I20260709 13:06:28.803469 18934 raft_consensus.cc:515] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:06:28.813830 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 70752.6us
I20260709 13:06:28.813890 18829 leader_election.cc:290] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:28.816125 18829 raft_consensus.cc:2749] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:06:28.811446 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 79542us
I20260709 13:06:28.816666 18785 consensus_queue.cc:1048] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:28.817394 16322 leader_election.cc:304] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:28.817574 16173 leader_election.cc:304] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:28.818210 18785 raft_consensus.cc:2749] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:28.818634 18829 raft_consensus.cc:2749] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:06:28.818949 18952 log.cc:927] Time spent T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.058s	user 0.000s	sys 0.004s
I20260709 13:06:28.821426 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:28.822273 16278 raft_consensus.cc:2468] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 7.
I20260709 13:06:28.824107 18974 raft_consensus.cc:2804] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:28.824707 18974 raft_consensus.cc:697] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:28.825691 18974 consensus_queue.cc:237] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:28.821480 18981 raft_consensus.cc:2764] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader election decision vote started in defunct term 5: won
I20260709 13:06:28.824519 16248 leader_election.cc:304] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:28.833889 16322 leader_election.cc:304] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:06:28.839080 16322 leader_election.cc:304] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:06:28.790226 18936 raft_consensus.cc:2749] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:28.847100 18924 raft_consensus.cc:493] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:28.800263 18908 raft_consensus.cc:2804] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:28.811817 18965 raft_consensus.cc:697] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 8 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:06:28.856076 16322 leader_election.cc:304] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:06:28.838186 18830 raft_consensus.cc:2749] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:28.864552 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:28.865335 16274 raft_consensus.cc:3060] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:28.866600 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:28.867075 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:28.868494 16322 leader_election.cc:304] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:28.872008 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:28.767593 18935 raft_consensus.cc:515] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:28.882202 16275 raft_consensus.cc:1240] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:28.883919 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f022e2e63ae4461d834e476ff2666991" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:28.854811 18785 raft_consensus.cc:2749] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:28.855775 18908 raft_consensus.cc:493] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:28.764448 18951 raft_consensus.cc:515] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:28.909286 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f022e2e63ae4461d834e476ff2666991" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:28.914495 18971 consensus_queue.cc:1059] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:28.910871 16173 leader_election.cc:304] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:28.915387 16274 raft_consensus.cc:2468] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 8.
I20260709 13:06:28.915584 18908 raft_consensus.cc:3060] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:28.951537 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:06:28.960095 18810 raft_consensus.cc:3055] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:28.877833 18960 raft_consensus.cc:2749] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:29.016391 18810 raft_consensus.cc:740] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:29.016703 16942 raft_consensus.cc:2393] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 6: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
I20260709 13:06:29.017722 16282 raft_consensus.cc:3060] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:29.017406 18810 consensus_queue.cc:260] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:28.927210 18899 raft_consensus.cc:2749] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:06:29.019377 18810 raft_consensus.cc:3060] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:28.964272 16941 raft_consensus.cc:1275] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:06:28.968777 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:29.024000 16283 raft_consensus.cc:2393] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 6: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
I20260709 13:06:29.028447 18963 raft_consensus.cc:2749] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:29.029250 16282 raft_consensus.cc:2468] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 6.
I20260709 13:06:28.920123 16204 raft_consensus.cc:1240] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:28.970925 18927 leader_election.cc:290] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 8 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:28.858088 18924 raft_consensus.cc:515] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:29.033124 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:28.860203 18958 leader_election.cc:290] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:28.975351 18926 leader_election.cc:290] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 6 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:28.976048 18919 raft_consensus.cc:493] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:28.983083 18935 leader_election.cc:290] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:06:28.984326 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 159906us
I20260709 13:06:28.985117 18981 raft_consensus.cc:3055] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:29.053011 18981 raft_consensus.cc:740] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:29.052749 18919 raft_consensus.cc:515] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:29.054221 18981 consensus_queue.cc:260] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:29.055473 18919 leader_election.cc:290] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:28.799788 18928 consensus_queue.cc:237] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:29.003942 18965 consensus_queue.cc:237] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:28.876307 18380 raft_consensus.cc:2749] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:29.007464 16105 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38840 (request call id 194) took 6493 ms. Trace:
I20260709 13:06:29.008225 18822 consensus_queue.cc:1059] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:29.010520 16173 leader_election.cc:304] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:06:28.873152 18957 consensus_queue.cc:1059] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.075s
I20260709 13:06:28.870947 18909 raft_consensus.cc:3060] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:29.033337 18924 leader_election.cc:290] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:29.033979 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:29.034513 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:29.034787 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c15d8e9be8414c84912ab77b66bfb1" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:29.034931 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:29.055907 18908 raft_consensus.cc:515] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:29.036676 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:06:29.040828 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 172399us
I20260709 13:06:28.812618 18814 consensus_queue.cc:237] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:29.056103 16248 leader_election.cc:304] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:28.995618 18934 leader_election.cc:290] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:29.060396 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:29.066128 16199 raft_consensus.cc:1275] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:06:29.125293 16199 pending_rounds.cc:85] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f: Aborting all ops after (but not including) 3
I20260709 13:06:29.125603 16199 pending_rounds.cc:107] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:06:29.125839 16199 raft_consensus.cc:2889] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:29.128058 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:29.129746 16208 raft_consensus.cc:1275] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:06:29.130201 16208 pending_rounds.cc:85] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f: Aborting all ops after (but not including) 4
I20260709 13:06:29.130429 16208 pending_rounds.cc:107] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:06:29.130705 16208 raft_consensus.cc:2889] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:29.068749 16105 rpcz_store.cc:276] 0709 13:06:22.514216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:22.514352 (+   136us) service_pool.cc:224] Handling call
0709 13:06:23.021975 (+507623us) spinlock_profiling.cc:243] Waited 164 ms on lock 0x7b5400137754. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f3090 00007f361f491f3a 00007f36252481cc 00007f362534637e 00007f36238072a4 00007f3623807232 00007f3623807161 00007f36238070dc 00007f3623806392 00007f361d7c448c 00007f361d7c38c6
0709 13:06:29.007372 (+5985397us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:27.409379 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:27.464298 (+ 54919us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:27.464350 (+    52us) write_op.cc:435] Acquired schema lock
0709 13:06:27.464370 (+    20us) tablet.cc:662] Decoding operations
0709 13:06:27.466237 (+  1867us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:27.466344 (+   107us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:27.466374 (+    30us) tablet.cc:685] Acquiring locks for 25 operations
0709 13:06:27.541810 (+ 75436us) tablet.cc:701] Row locks acquired
0709 13:06:27.541868 (+    58us) write_op.cc:260] PREPARE: finished
0709 13:06:27.542071 (+   203us) write_op.cc:270] Start()
0709 13:06:27.542275 (+   204us) write_op.cc:276] Timestamp: P: 1783602387541993 usec, L: 0
0709 13:06:27.542301 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 13:06:27.581527 (+ 39226us) log.cc:844] Serialized 9894 byte log entry
0709 13:06:28.013684 (+432157us) spinlock_profiling.cc:243] Waited 8.29 ms on lock 0x7b4400022b4c. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361c224db1 00007f361c2c2c85 00007f361c2c36a2 00007f361f0351db 00007f361f030aaf 00007f361f02486e 00007f361f023bb6 00007f361f0237d8 00007f361f02d221 00007f361f02d1d9 00007f361f02d169
0709 13:06:28.330926 (+317242us) op_driver.cc:464] REPLICATION: finished
0709 13:06:28.466046 (+135120us) spinlock_profiling.cc:243] Waited 1.15 ms on lock 0x7b1800032320. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f3625264de1 00007f36252715b1 00007f361c39c3f3 00007f361c39e7c1 00007f361c39e779 00007f361c39e709 00007f361c39e6d1 00007f361c39d9cd 000000000038f354 000000000038f199 00007f361c37f83a
0709 13:06:28.466272 (+   226us) write_op.cc:301] APPLY: starting
0709 13:06:28.466378 (+   106us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:28.493145 (+ 26767us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:28.493198 (+    53us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:28.496148 (+  2950us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:28.496678 (+   530us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=25
0709 13:06:28.496736 (+    58us) write_op.cc:312] APPLY: finished
0709 13:06:28.497400 (+   664us) log.cc:844] Serialized 170 byte log entry
0709 13:06:28.497626 (+   226us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:28.497871 (+   245us) write_op.cc:454] Released schema lock
0709 13:06:28.497960 (+    89us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:28.498432 (+   472us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:28.498465 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":49,"spinlock_wait_cycles":378183936,"child_traces":[["op",{"apply.queue_time_us":107760,"apply.run_cpu_time_us":6130,"apply.run_wall_time_us":32134,"num_ops":25,"prepare.queue_time_us":218200,"prepare.run_cpu_time_us":155286,"prepare.run_wall_time_us":383945,"raft.queue_time_us":194978,"raft.run_cpu_time_us":13281,"raft.run_wall_time_us":103535,"replication_time_us":788402,"spinlock_wait_cycles":21703808,"thread_start_us":494165,"threads_started":4,"wal-append.queue_time_us":222667}]]}
W20260709 13:06:29.140061 18875 consensus_meta.cc:287] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3: Time spent flushing consensus metadata: real 0.529s	user 0.009s	sys 0.000s
I20260709 13:06:29.140559 18875 raft_consensus.cc:515] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:29.141361 18810 raft_consensus.cc:2804] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:29.141949 18810 raft_consensus.cc:697] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:29.142901 18810 consensus_queue.cc:237] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:29.148017 16279 raft_consensus.cc:2368] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for earlier term 6. Current term is 7.
I20260709 13:06:29.150138 16274 raft_consensus.cc:2468] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 7.
W20260709 13:06:29.067926 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 197890us
I20260709 13:06:28.973959 18951 leader_election.cc:290] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:06:29.075289 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 64888.9us
I20260709 13:06:29.078493 18929 raft_consensus.cc:2749] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:29.055507 18981 raft_consensus.cc:3060] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:29.078395 18984 raft_consensus.cc:3055] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:29.091131 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:29.094890 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:29.101331 16322 leader_election.cc:304] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:06:29.107549 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 51539us
I20260709 13:06:29.113648 16201 raft_consensus.cc:1240] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:29.117736 18971 raft_consensus.cc:3055] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:29.117802 16102 catalog_manager.cc:5697] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:29.066370 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:29.061825 18990 raft_consensus.cc:2804] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:29.166605 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:06:29.173725 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 72452.6us
I20260709 13:06:29.174615 16322 leader_election.cc:304] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:29.173887 16204 raft_consensus.cc:2468] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 5.
I20260709 13:06:29.179836 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:29.183423 16947 raft_consensus.cc:1240] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:29.190156 16322 leader_election.cc:304] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:06:29.163975 18380 raft_consensus.cc:493] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:29.203039 18380 raft_consensus.cc:515] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:29.205459 18380 leader_election.cc:290] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:29.168167 18984 raft_consensus.cc:740] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:29.206708 18995 consensus_queue.cc:1048] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.012s
I20260709 13:06:29.200578 16248 leader_election.cc:304] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:29.168743 18971 raft_consensus.cc:740] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:29.195467 18830 raft_consensus.cc:2804] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:29.231068 18933 raft_consensus.cc:2749] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:29.230952 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:29.231989 18963 consensus_queue.cc:1048] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:29.171922 18572 consensus_queue.cc:1048] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
W20260709 13:06:29.268740 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 102990us
I20260709 13:06:29.217885 16947 raft_consensus.cc:1275] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:06:29.217566 16322 leader_election.cc:304] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:06:29.234062 16320 leader_election.cc:304] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
W20260709 13:06:29.271271 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 53785.6us
I20260709 13:06:29.226632 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:29.214433 18875 leader_election.cc:290] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:29.215691 18951 raft_consensus.cc:2749] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:29.213289 18935 consensus_queue.cc:1048] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.038s
I20260709 13:06:29.238672 18830 raft_consensus.cc:493] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:29.216183 18908 leader_election.cc:290] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 election: Requested vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:29.187947 18934 raft_consensus.cc:2749] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:29.276571 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:29.222327 18974 consensus_queue.cc:1059] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 13:06:29.274411 16914 leader_election.cc:304] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:06:29.289772 16246 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:29.299753 16208 raft_consensus.cc:3060] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:29.270730 16102 catalog_manager.cc:5697] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } }
W20260709 13:06:29.301702 16246 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:29.277724 16941 raft_consensus.cc:2468] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 7.
I20260709 13:06:29.278113 18804 raft_consensus.cc:2749] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:29.277983 18785 raft_consensus.cc:2804] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:29.314159 18988 consensus_queue.cc:1048] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.100s
I20260709 13:06:29.314738 16276 raft_consensus.cc:1240] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:29.305291 18875 consensus_queue.cc:1048] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.010s
I20260709 13:06:29.323568 16102 catalog_manager.cc:5697] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:29.332075 16208 raft_consensus.cc:2468] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 7.
I20260709 13:06:29.297768 18830 raft_consensus.cc:3060] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:06:29.351142 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 48614.1us
W20260709 13:06:29.265431 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 108359us
I20260709 13:06:29.382755 16102 catalog_manager.cc:5697] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:29.302927 18933 raft_consensus.cc:493] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:29.347337 18785 raft_consensus.cc:493] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:29.365391 18927 raft_consensus.cc:2749] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:29.372390 18875 consensus_queue.cc:1243] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer 1109f76a0b7b443a84c0327c8707bc63 log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
W20260709 13:06:29.396227 16173 leader_election.cc:336] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 2.193s (SENT)
I20260709 13:06:29.396814 16173 leader_election.cc:304] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
W20260709 13:06:29.398875 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 126857us
I20260709 13:06:29.412011 16322 leader_election.cc:304] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:29.390242 18785 raft_consensus.cc:3060] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:29.413367 16322 leader_election.cc:304] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:06:29.412024 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 89591.2us
I20260709 13:06:29.418368 16248 leader_election.cc:304] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:06:29.421402 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:29.423408 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:29.424386 16349 raft_consensus.cc:2468] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 7.
W20260709 13:06:29.423704 18999 log.cc:927] Time spent T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:06:29.364805 18971 consensus_queue.cc:260] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:29.426749 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:29.431529 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:29.428707 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:29.428707 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:29.415269 18929 raft_consensus.cc:2749] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:29.414695 18809 raft_consensus.cc:2749] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:29.418358 18804 raft_consensus.cc:2749] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:29.437285 16351 raft_consensus.cc:1240] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:29.440356 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:29.441108 16351 raft_consensus.cc:2468] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 6.
I20260709 13:06:29.394310 18933 raft_consensus.cc:515] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:29.443063 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:29.447752 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:29.448719 16350 raft_consensus.cc:3060] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:29.454355 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:29.455283 16356 raft_consensus.cc:2468] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 6.
I20260709 13:06:29.456418 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:29.457285 18990 raft_consensus.cc:493] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:29.457801 18990 raft_consensus.cc:3060] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:29.467942 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:29.469616 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:29.470427 16942 raft_consensus.cc:2468] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 7.
I20260709 13:06:29.472965 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:06:29.473194 18996 log.cc:927] Time spent T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.202s	user 0.002s	sys 0.000s
I20260709 13:06:29.475095 16352 raft_consensus.cc:1275] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:06:29.476738 16352 raft_consensus.cc:1275] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:06:29.478305 16352 raft_consensus.cc:1275] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:06:29.486080 18933 leader_election.cc:290] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:06:29.494269 16247 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:29.495934 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 77642.3us
I20260709 13:06:29.496876 16200 raft_consensus.cc:1275] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:06:29.498059 18974 raft_consensus.cc:2804] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:29.501916 16246 leader_election.cc:304] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:29.513618 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:29.520458 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:29.522919 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:29.531597 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:29.536793 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:29.538075 16947 raft_consensus.cc:2410] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:06:29.542969 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:29.543833 16277 raft_consensus.cc:2393] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 8: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:06:29.544216 16350 raft_consensus.cc:2468] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 8.
I20260709 13:06:29.540182 16248 leader_election.cc:304] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:29.548491 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:06:29.551810 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 155614us
I20260709 13:06:29.555673 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:29.555696 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:29.552412 16102 catalog_manager.cc:5697] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:29.558185 16249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:29.558065 16248 leader_election.cc:304] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:29.500622 18974 raft_consensus.cc:493] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:29.573320 16173 leader_election.cc:304] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:29.543587 18988 raft_consensus.cc:2804] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:29.580031 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:29.580749 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:29.580996 16352 raft_consensus.cc:3060] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:29.581911 16350 raft_consensus.cc:2393] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 3: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:06:29.583371 16173 leader_election.cc:304] T b9e1324823f04d8da5a4b3ddbd061c0e P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:06:29.585800 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:29.586246 16102 catalog_manager.cc:5697] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e reported cstate change: term changed from 2 to 6, leader changed from e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) to 363bb2f744eb486f9ad726f08214c98e (127.14.180.67). New cstate: current_term: 6 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:29.491757 18830 raft_consensus.cc:515] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:29.600219 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:29.603058 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:29.566900 18822 consensus_queue.cc:1048] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 13:06:29.577257 18974 raft_consensus.cc:3060] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:29.617365 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:29.631340 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:29.632112 16348 raft_consensus.cc:3060] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:29.557516 18875 consensus_queue.cc:1048] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.055s
I20260709 13:06:29.636739 16356 raft_consensus.cc:2393] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 7: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:06:29.591516 18979 raft_consensus.cc:2804] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:29.586010 19001 raft_consensus.cc:2749] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:06:29.598436 18988 raft_consensus.cc:697] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:29.579710 18924 consensus_queue.cc:1059] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 13:06:29.615008 18929 raft_consensus.cc:2749] T b9e1324823f04d8da5a4b3ddbd061c0e P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:06:29.660288 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 46335.2us
I20260709 13:06:29.634792 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:06:29.665340 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 90219.2us
I20260709 13:06:29.671345 16350 raft_consensus.cc:2468] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 8.
I20260709 13:06:29.674433 16352 raft_consensus.cc:2468] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 8.
I20260709 13:06:29.676740 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:29.677378 16352 raft_consensus.cc:2468] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 6.
I20260709 13:06:29.678411 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c15d8e9be8414c84912ab77b66bfb1" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:29.678097 18988 consensus_queue.cc:237] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:29.679966 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:29.656248 16941 pending_rounds.cc:85] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63: Aborting all ops after (but not including) 7
I20260709 13:06:29.680833 16352 raft_consensus.cc:2468] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 5.
I20260709 13:06:29.682564 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:29.684345 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:29.685273 16352 raft_consensus.cc:3060] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:29.696460 18830 leader_election.cc:290] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:29.629096 18850 consensus_queue.cc:1048] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:06:29.709789 16352 raft_consensus.cc:2468] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 6.
W20260709 13:06:29.716606 16246 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:29.681283 16941 pending_rounds.cc:107] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:06:29.731505 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:29.732978 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:29.709908 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:29.733896 16352 raft_consensus.cc:3060] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:29.734033 16350 raft_consensus.cc:2376] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 6. Re-sending same reply.
W20260709 13:06:29.736758 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 178761us
I20260709 13:06:29.665798 18979 raft_consensus.cc:697] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:29.702415 18981 raft_consensus.cc:493] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:29.764794 16248 leader_election.cc:304] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:29.771238 16248 leader_election.cc:304] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:29.731343 16941 raft_consensus.cc:2889] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:06:29.782281 19003 log.cc:927] Time spent T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
I20260709 13:06:29.782725 18957 raft_consensus.cc:3055] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:06:29.783437 19013 log.cc:927] Time spent T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 13:06:29.743431 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:29.745225 16275 raft_consensus.cc:2468] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 5.
I20260709 13:06:29.730410 16348 raft_consensus.cc:2468] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 6.
I20260709 13:06:29.815797 16350 raft_consensus.cc:3060] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:29.816483 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:29.753213 16352 raft_consensus.cc:2468] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 6.
I20260709 13:06:29.812137 18979 consensus_queue.cc:237] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:29.783427 18957 raft_consensus.cc:740] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:29.822490 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:29.832267 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:29.833182 16352 raft_consensus.cc:2468] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 8.
I20260709 13:06:29.840341 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:29.776090 18981 raft_consensus.cc:515] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:06:29.842370 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 299078us
I20260709 13:06:29.840044 18990 raft_consensus.cc:515] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:29.848245 18990 leader_election.cc:290] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:29.856689 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:29.857257 18909 raft_consensus.cc:2749] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:29.857697 16352 raft_consensus.cc:2393] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 in current term 6: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
W20260709 13:06:29.832496 18972 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.708s	user 0.003s	sys 0.018s
I20260709 13:06:29.824000 19001 raft_consensus.cc:2804] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:29.890189 16350 raft_consensus.cc:2468] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 8.
I20260709 13:06:29.890542 16348 raft_consensus.cc:1240] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 7. Current term is 8. Ops: [5.4-7.5]
I20260709 13:06:29.892046 16350 raft_consensus.cc:1275] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:06:29.896471 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 313210us
I20260709 13:06:29.898835 16350 raft_consensus.cc:1275] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:06:29.901144 16173 leader_election.cc:304] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:29.853458 19019 raft_consensus.cc:2804] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:29.903469 16350 raft_consensus.cc:1240] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 5. Current term is 6. Ops: []
W20260709 13:06:29.903231 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 59403.9us
W20260709 13:06:29.889123 18972 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.765s	user 0.003s	sys 0.018s
W20260709 13:06:29.899850 19012 log.cc:927] Time spent T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 13:06:29.904421 16173 leader_election.cc:400] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 election: Vote denied by peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823) with higher term. Message: Invalid argument: T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for earlier term 6. Current term is 7.
I20260709 13:06:29.919690 16173 leader_election.cc:403] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:06:29.923458 18908 raft_consensus.cc:2749] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823) with higher term. Message: Invalid argument: T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for earlier term 6. Current term is 7.
I20260709 13:06:29.920786 16173 leader_election.cc:304] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:29.925194 18908 raft_consensus.cc:2804] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:29.925745 18908 raft_consensus.cc:697] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 7 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:29.926753 18908 consensus_queue.cc:237] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:29.935105 18822 consensus_queue.cc:1059] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:29.900753 19001 raft_consensus.cc:493] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:29.904927 18928 raft_consensus.cc:2804] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:29.953755 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:29.909075 19019 raft_consensus.cc:493] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:29.985113 19019 raft_consensus.cc:3060] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:29.992408 18984 consensus_queue.cc:260] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:29.946573 18957 consensus_queue.cc:260] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:06:29.999037 19016 log.cc:927] Time spent T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.168s	user 0.001s	sys 0.000s
I20260709 13:06:29.949038 19001 raft_consensus.cc:3060] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:30.002907 18928 raft_consensus.cc:697] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
W20260709 13:06:29.983685 19013 log.cc:927] Time spent T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 13:06:30.017848 18974 raft_consensus.cc:515] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:30.018711 18904 raft_consensus.cc:3055] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:30.019326 18904 raft_consensus.cc:740] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:06:30.020635 18904 consensus_queue.cc:260] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:30.019341 16282 raft_consensus.cc:2393] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 8: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:06:30.028294 18951 raft_consensus.cc:493] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:30.028849 18951 raft_consensus.cc:515] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:30.050345 16353 raft_consensus.cc:2468] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 8.
W20260709 13:06:30.079960 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:30.104101 18957 raft_consensus.cc:3060] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:30.110970 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:30.111718 16204 raft_consensus.cc:2468] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 5.
I20260709 13:06:30.121937 16914 leader_election.cc:304] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:30.123165 16914 leader_election.cc:304] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:30.120028 16246 leader_election.cc:304] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:30.124979 16914 leader_election.cc:304] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3
W20260709 13:06:30.114883 18785 consensus_meta.cc:287] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 0.688s	user 0.009s	sys 0.009s
I20260709 13:06:30.095515 18904 raft_consensus.cc:3060] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:30.130396 16914 leader_election.cc:304] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:30.132418 19024 raft_consensus.cc:2749] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:30.141611 19024 raft_consensus.cc:2804] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:30.142040 19024 raft_consensus.cc:493] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:30.116171 18984 raft_consensus.cc:3060] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:30.109251 18875 raft_consensus.cc:493] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:30.142417 19024 raft_consensus.cc:3060] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:30.144701 16914 leader_election.cc:304] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:30.125362 18944 raft_consensus.cc:2749] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:30.146168 18928 consensus_queue.cc:237] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:30.148494 18963 raft_consensus.cc:493] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:30.150853 18994 raft_consensus.cc:493] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:30.142684 18926 raft_consensus.cc:493] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:30.163308 16914 leader_election.cc:304] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:06:30.164335 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:30.173557 16204 raft_consensus.cc:2468] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 2.
I20260709 13:06:30.153800 18572 raft_consensus.cc:2804] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:30.151492 19033 raft_consensus.cc:2749] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:30.142438 18971 raft_consensus.cc:3060] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:06:30.168578 16247 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:30.179529 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 569480us
I20260709 13:06:30.188338 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:30.192644 16204 raft_consensus.cc:2393] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 7: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:06:30.143216 18785 raft_consensus.cc:515] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:30.168246 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:30.179533 16246 leader_election.cc:304] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:30.207252 16275 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45218 (request call id 1657) took 1164 ms. Trace:
I20260709 13:06:30.207751 16275 rpcz_store.cc:276] 0709 13:06:29.033208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:29.034505 (+  1297us) service_pool.cc:224] Handling call
0709 13:06:30.197558 (+1163053us) spinlock_profiling.cc:243] Waited 562 ms on lock 0x7b54002fa3d4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:06:30.198028 (+   470us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1292756224}
I20260709 13:06:30.180853 18572 raft_consensus.cc:493] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
W20260709 13:06:30.229342 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 49896us
I20260709 13:06:30.230494 19002 raft_consensus.cc:2804] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:30.231113 19002 raft_consensus.cc:493] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:30.231534 19002 raft_consensus.cc:3060] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:30.245533 16204 raft_consensus.cc:1240] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:30.252312 19049 consensus_queue.cc:1059] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:30.164932 18875 raft_consensus.cc:515] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:30.197892 18981 leader_election.cc:290] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:30.172010 18963 raft_consensus.cc:515] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:30.279273 19049 raft_consensus.cc:3055] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:30.276428 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:30.254472 18572 raft_consensus.cc:3060] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:30.178458 18926 raft_consensus.cc:515] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:30.223353 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
W20260709 13:06:30.287853 16247 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:30.175346 18994 raft_consensus.cc:515] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:30.279925 19049 raft_consensus.cc:740] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:06:30.300787 19007 raft_consensus.cc:493] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
W20260709 13:06:30.301383 19034 log.cc:927] Time spent T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.119s	user 0.001s	sys 0.001s
I20260709 13:06:30.226814 19033 consensus_queue.cc:1048] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 13:06:30.225356 19001 raft_consensus.cc:515] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:30.312613 19037 raft_consensus.cc:2804] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:30.313089 19038 raft_consensus.cc:2749] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:06:30.319519 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 112185us
I20260709 13:06:30.313565 18951 leader_election.cc:290] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:06:30.314219 19014 log.cc:927] Time spent T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.612s	user 0.000s	sys 0.004s
I20260709 13:06:30.308421 16322 leader_election.cc:304] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:30.313176 18875 leader_election.cc:290] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:30.301818 19007 raft_consensus.cc:515] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:30.332743 16322 leader_election.cc:304] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:30.338409 16322 leader_election.cc:304] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:30.339032 18380 raft_consensus.cc:2749] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:30.337029 18979 raft_consensus.cc:493] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:30.339646 18908 raft_consensus.cc:493] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:30.341778 18995 raft_consensus.cc:2749] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:30.341255 19037 raft_consensus.cc:697] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 LEADER]: Becoming Leader. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:06:30.385016 16349 raft_consensus.cc:1275] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:06:30.382097 18908 raft_consensus.cc:515] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:30.389154 19037 consensus_queue.cc:237] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:30.391351 18908 leader_election.cc:290] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:30.384949 16322 leader_election.cc:304] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:30.396598 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:30.397506 16322 leader_election.cc:304] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:06:30.398097 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:30.400642 16322 leader_election.cc:304] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:06:30.402115 16355 raft_consensus.cc:3060] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:30.406271 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 85121.5us
I20260709 13:06:30.394263 18995 raft_consensus.cc:2749] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:30.414402 16322 leader_election.cc:304] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:30.378747 18979 raft_consensus.cc:515] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:30.405547 18380 raft_consensus.cc:2804] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:30.402400 18785 leader_election.cc:290] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:30.423606 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:30.424379 16349 raft_consensus.cc:2376] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 8. Re-sending same reply.
I20260709 13:06:30.426201 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:30.425305 16914 leader_election.cc:304] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:30.429073 19001 leader_election.cc:290] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:06:30.429948 19036 log.cc:927] Time spent T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
I20260709 13:06:30.431196 19005 raft_consensus.cc:2749] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:30.432758 16350 raft_consensus.cc:1275] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:06:30.438311 16355 raft_consensus.cc:2468] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 6.
I20260709 13:06:30.441094 18926 leader_election.cc:290] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:30.441365 19025 raft_consensus.cc:493] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:30.441919 19025 raft_consensus.cc:515] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:30.442901 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:30.444024 16353 raft_consensus.cc:2393] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 7: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:06:30.444239 19025 leader_election.cc:290] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:30.449602 16280 raft_consensus.cc:2468] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 4.
I20260709 13:06:30.450838 19051 raft_consensus.cc:2749] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:30.452406 18994 leader_election.cc:290] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:30.394258 19049 consensus_queue.cc:260] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:30.453841 19049 raft_consensus.cc:3060] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:30.457700 19052 raft_consensus.cc:2749] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:30.450866 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:30.460068 16356 raft_consensus.cc:2368] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for earlier term 5. Current term is 6.
I20260709 13:06:30.466066 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:30.415091 18809 raft_consensus.cc:2749] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:30.467526 16350 raft_consensus.cc:1240] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:30.467792 16348 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd"
dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
mode: GRACEFUL
new_leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
 from {username='slave'} at 127.0.0.1:56792
I20260709 13:06:30.468379 16348 raft_consensus.cc:606] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Received request to transfer leadership to TS 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:06:30.468888 16348 raft_consensus.cc:614] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:30.450287 19017 raft_consensus.cc:493] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:30.476833 16248 leader_election.cc:304] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:30.421978 18380 raft_consensus.cc:493] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:30.426827 18963 leader_election.cc:290] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:30.487998 16353 raft_consensus.cc:1275] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:06:30.489110 16356 raft_consensus.cc:1240] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 7. Current term is 8. Ops: []
W20260709 13:06:30.491078 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 77273us
W20260709 13:06:30.494351 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 62354.1us
I20260709 13:06:30.494812 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:30.495523 16357 raft_consensus.cc:3060] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:30.496507 16173 leader_election.cc:304] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:30.483654 18380 raft_consensus.cc:3060] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:30.507503 16248 leader_election.cc:304] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:30.509599 16248 leader_election.cc:304] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:30.511276 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:30.494189 18971 raft_consensus.cc:2749] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:30.512058 16353 raft_consensus.cc:2468] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 8.
I20260709 13:06:30.514153 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:30.515054 16248 leader_election.cc:304] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:30.513904 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:30.506747 19018 consensus_queue.cc:1048] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:06:30.516974 16943 raft_consensus.cc:2468] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 6.
I20260709 13:06:30.518118 19021 raft_consensus.cc:2749] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:06:30.519445 19015 log.cc:927] Time spent T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.842s	user 0.000s	sys 0.004s
I20260709 13:06:30.519326 18909 consensus_queue.cc:1048] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:06:30.512722 18810 raft_consensus.cc:2804] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:30.522964 16201 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60138 (request call id 1729) took 1031 ms. Trace:
I20260709 13:06:30.497860 19001 consensus_queue.cc:1048] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 13:06:30.523353 16201 rpcz_store.cc:276] 0709 13:06:29.492051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:29.493867 (+  1816us) service_pool.cc:224] Handling call
0709 13:06:29.494233 (+   366us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:29.494622 (+   389us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:29.494651 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:29.495100 (+   449us) log.cc:844] Serialized 26 byte log entry
0709 13:06:29.587031 (+ 91931us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:29.587072 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:29.587137 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:30.446422 (+859285us) spinlock_profiling.cc:243] Waited 25.3 ms on lock 0x7b4400022b4c. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361c224db1 00007f361c2c2c85 00007f361c2c36a2 00007f361f0351db 00007f361f030aaf 00007f361f02486e 00007f361f023bb6 00007f361f0237d8 00007f361f02d221 00007f361f02d1d9 00007f361f02d169
0709 13:06:30.522640 (+ 76218us) raft_consensus.cc:1685] finished
0709 13:06:30.522663 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:30.522895 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1288,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":98,"spinlock_wait_cycles":58282368,"thread_start_us":91496,"threads_started":1,"wal-append.queue_time_us":179155}
I20260709 13:06:30.499432 18951 consensus_queue.cc:1048] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 13:06:30.514318 19022 raft_consensus.cc:2804] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:30.526448 18910 raft_consensus.cc:2749] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:30.531565 18810 raft_consensus.cc:697] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:30.532855 18979 leader_election.cc:290] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:30.533370 19007 leader_election.cc:290] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:30.507119 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:30.546402 19001 consensus_queue.cc:1059] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:30.485340 19017 raft_consensus.cc:515] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:30.534984 19022 raft_consensus.cc:493] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:30.553619 19022 raft_consensus.cc:3060] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:30.530701 16357 raft_consensus.cc:2468] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 7.
I20260709 13:06:30.542311 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:30.565245 16353 raft_consensus.cc:2468] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 6.
I20260709 13:06:30.568125 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:30.577356 16353 raft_consensus.cc:2468] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 3.
I20260709 13:06:30.589635 19001 raft_consensus.cc:3055] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:30.590385 19001 raft_consensus.cc:740] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:30.578027 18910 consensus_queue.cc:1048] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 13:06:30.591379 19001 consensus_queue.cc:260] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:30.592006 18910 consensus_queue.cc:1243] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer 363bb2f744eb486f9ad726f08214c98e log is divergent from this leader: its last log entry 4.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:06:30.592594 19001 raft_consensus.cc:3060] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:30.590330 19024 raft_consensus.cc:515] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:30.597325 19024 leader_election.cc:290] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 9 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:06:30.601096 19019 consensus_meta.cc:287] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3: Time spent flushing consensus metadata: real 0.608s	user 0.013s	sys 0.000s
I20260709 13:06:30.601984 19002 raft_consensus.cc:515] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:30.607401 18572 raft_consensus.cc:515] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:30.563805 18810 consensus_queue.cc:237] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:06:30.633237 16248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:30.677173 16275 raft_consensus.cc:1240] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 5. Current term is 6. Ops: []
W20260709 13:06:30.700440 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:30.775305 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 278833us
I20260709 13:06:30.995925 18934 raft_consensus.cc:493] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:30.948961 16352 raft_consensus.cc:2468] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 8.
I20260709 13:06:30.676975 16942 raft_consensus.cc:2468] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 6.
I20260709 13:06:30.985066 16949 raft_consensus.cc:1240] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 LEADER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:30.678689 18957 raft_consensus.cc:493] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:30.761806 18981 raft_consensus.cc:493] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:30.999161 18972 raft_consensus.cc:493] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:31.004468 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:30.988997 19066 raft_consensus.cc:493] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:31.013245 18971 raft_consensus.cc:493] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:31.012599 18957 raft_consensus.cc:515] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:31.014585 18910 raft_consensus.cc:493] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:31.008919 18972 raft_consensus.cc:515] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:30.722815 19019 raft_consensus.cc:515] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:06:31.005940 16282 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45210 (request call id 1555) took 1510 ms (client timeout 1710 ms). Trace:
I20260709 13:06:30.993630 19002 leader_election.cc:290] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:31.022342 16354 raft_consensus.cc:1275] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:06:30.992479 18572 leader_election.cc:290] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:06:31.023741 16355 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41830 (request call id 1620) took 1602 ms (client timeout 1882 ms). Trace:
W20260709 13:06:31.099903 16355 rpcz_store.cc:269] 0709 13:06:29.421017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:29.421139 (+   122us) service_pool.cc:224] Handling call
0709 13:06:31.021587 (+1600448us) spinlock_profiling.cc:243] Waited 980 ms on lock 0x7b54000d8ed4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:06:31.023160 (+  1573us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2253641088}
I20260709 13:06:31.003080 18928 raft_consensus.cc:493] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:31.001905 16279 raft_consensus.cc:1240] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:31.010885 18981 raft_consensus.cc:515] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:31.027482 16173 leader_election.cc:304] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:31.064886 16351 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41830 (request call id 1633) took 1604 ms. Trace:
W20260709 13:06:31.090235 16282 rpcz_store.cc:269] 0709 13:06:29.495589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:29.500472 (+  4883us) service_pool.cc:224] Handling call
0709 13:06:31.005643 (+1505171us) spinlock_profiling.cc:243] Waited 463 ms on lock 0x7b5400389854. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:06:31.005857 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1064278656}
I20260709 13:06:31.010977 18934 raft_consensus.cc:515] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } }
I20260709 13:06:31.056504 18909 raft_consensus.cc:493] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:31.064528 18963 raft_consensus.cc:493] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:30.919526 18380 raft_consensus.cc:515] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:31.078509 19066 raft_consensus.cc:515] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:31.084296 19001 raft_consensus.cc:493] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:31.107337 16351 rpcz_store.cc:276] 0709 13:06:29.447018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:29.448538 (+  1520us) service_pool.cc:224] Handling call
0709 13:06:29.449154 (+   616us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:29.451937 (+  2783us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:29.451967 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:29.540757 (+ 88790us) log.cc:844] Serialized 52 byte log entry
0709 13:06:29.819785 (+279028us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:29.843645 (+ 23860us) log.cc:844] Serialized 14 byte log entry
0709 13:06:30.167989 (+324344us) log.cc:844] Serialized 14 byte log entry
0709 13:06:30.279383 (+111394us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:30.279544 (+   161us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:30.447446 (+167902us) spinlock_profiling.cc:243] Waited 6.83 ms on lock 0x7b18002c83c0. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f3625264de1 00007f36252715b1 00007f361c39c3f3 00007f361c39e7c1 00007f361c39e779 00007f361c39e709 00007f361c39e6d1 00007f361c39d9cd 000000000038f354 000000000038f199 00007f361c37f83a
0709 13:06:30.522747 (+ 75301us) spinlock_profiling.cc:243] Waited 6.93 ms on lock 0x7b4800032358. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f36243b2aa1 00007f36243a9b37 00007f36243a99ca 00007f36244a126f 00007f36244a0f37 00007f36244b555c 00007f36244b5508 00007f36244b5488 00007f36244b5443 00007f36244b46ec 00007f36233dea96
0709 13:06:31.047859 (+525112us) spinlock_profiling.cc:243] Waited 25.7 ms on lock 0x7b18002c83c0. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f3625264de1 00007f36252715b1 00007f361c39c3f3 00007f361c39e7c1 00007f361c39e779 00007f361c39e709 00007f361c39e6d1 00007f361c39d9cd 000000000038f354 000000000038f199 00007f361c37f83a
0709 13:06:31.051459 (+  3600us) raft_consensus.cc:1685] finished
0709 13:06:31.051485 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:31.051650 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":327830,"prepare.queue_time_us":32320,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":68,"raft.queue_time_us":345188,"raft.run_cpu_time_us":3132,"raft.run_wall_time_us":355973,"spinlock_wait_cycles":90737664,"thread_start_us":331907,"threads_started":2,"wal-append.queue_time_us":278771}
I20260709 13:06:30.950380 19022 raft_consensus.cc:515] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:06:31.151988 19069 log.cc:927] Time spent T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63: Append to log took a long time: real 0.162s	user 0.000s	sys 0.001s
I20260709 13:06:31.141496 19068 raft_consensus.cc:3060] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:31.155443 16349 raft_consensus.cc:2393] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 8: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:06:31.093969 18910 raft_consensus.cc:515] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:31.083024 18971 raft_consensus.cc:515] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:06:31.166340 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 140316us
I20260709 13:06:31.169658 16173 leader_election.cc:304] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:06:31.172410 16279 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45218 (request call id 1661) took 1063 ms. Trace:
I20260709 13:06:31.174427 16173 leader_election.cc:304] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:06:31.174973 16351 pending_rounds.cc:85] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e: Aborting all ops after (but not including) 3
I20260709 13:06:31.175344 16351 pending_rounds.cc:107] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 13:06:31.175595 16351 raft_consensus.cc:2889] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:06:31.176090 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:31.173125 16279 rpcz_store.cc:276] 0709 13:06:30.106862 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.001304 (+894442us) service_pool.cc:224] Handling call
0709 13:06:31.001699 (+   395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:31.101521 (+ 99822us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:31.170159 (+ 68638us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:31.153610 18380 leader_election.cc:290] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:31.183211 18380 raft_consensus.cc:493] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:31.156267 18981 leader_election.cc:290] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:06:31.150779 19070 log.cc:927] Time spent T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
W20260709 13:06:31.187489 16248 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 1.882s (SENT) [suppressed 27 similar messages]
I20260709 13:06:31.212306 18380 raft_consensus.cc:515] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:31.157824 18972 leader_election.cc:290] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:31.158493 18957 leader_election.cc:290] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:31.218050 18971 leader_election.cc:290] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:31.162403 19001 raft_consensus.cc:515] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:31.185266 18984 raft_consensus.cc:2804] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:31.240136 18984 raft_consensus.cc:493] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:31.240672 18984 raft_consensus.cc:3060] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:31.153537 19066 leader_election.cc:290] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:31.166769 19019 leader_election.cc:290] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:31.223450 18933 raft_consensus.cc:493] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:31.250655 18933 raft_consensus.cc:515] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:31.218534 18910 leader_election.cc:290] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:31.145907 18963 raft_consensus.cc:515] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:31.141716 18909 raft_consensus.cc:515] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:31.220979 19022 leader_election.cc:290] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:31.219753 18934 leader_election.cc:290] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:31.141592 18928 raft_consensus.cc:515] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:31.283457 16354 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41830 (request call id 1630) took 1845 ms. Trace:
I20260709 13:06:31.284109 16354 rpcz_store.cc:276] 0709 13:06:29.438507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:29.438682 (+   175us) service_pool.cc:224] Handling call
0709 13:06:31.021891 (+1583209us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:31.094560 (+ 72669us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:31.283135 (+188575us) spinlock_profiling.cc:243] Waited 1.57 s on lock 0x7b54000d8ed0. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f4888ad 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:06:31.283367 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3614672256}
I20260709 13:06:31.309798 18380 leader_election.cc:290] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:31.311625 19001 leader_election.cc:290] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:31.313933 18933 leader_election.cc:290] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:31.325016 18909 leader_election.cc:290] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:31.283497 19076 raft_consensus.cc:493] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
W20260709 13:06:31.329190 16247 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:31.329890 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:31.330590 16349 raft_consensus.cc:3060] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:31.320760 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:31.313683 18984 raft_consensus.cc:515] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:31.344857 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:31.346082 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:31.332721 19076 raft_consensus.cc:515] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:31.344280 18971 raft_consensus.cc:493] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:31.344348 19019 raft_consensus.cc:493] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:31.346082 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:31.339231 19022 raft_consensus.cc:493] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:31.367075 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:31.420449 16275 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45210 (request call id 1570) took 1224 ms. Trace:
I20260709 13:06:31.420928 16275 rpcz_store.cc:276] 0709 13:06:30.196141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:30.303127 (+106986us) service_pool.cc:224] Handling call
0709 13:06:30.312927 (+  9800us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:30.763114 (+450187us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:31.420085 (+656971us) spinlock_profiling.cc:243] Waited 364 ms on lock 0x7b54001f68d4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f489e01 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6
0709 13:06:31.420321 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":837216128}
I20260709 13:06:31.369098 16942 raft_consensus.cc:1240] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:31.370970 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:31.424961 16274 raft_consensus.cc:2410] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for term 9 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:06:31.371865 18963 leader_election.cc:290] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:31.372257 16947 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35106 (request call id 599) took 1170 ms. Trace:
I20260709 13:06:31.372730 18928 leader_election.cc:290] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:31.431485 18928 raft_consensus.cc:2804] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:31.432209 18928 raft_consensus.cc:493] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:31.430958 16947 rpcz_store.cc:276] 0709 13:06:30.201399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:30.207533 (+  6134us) service_pool.cc:224] Handling call
0709 13:06:31.371339 (+1163806us) spinlock_profiling.cc:243] Waited 15.4 ms on lock 0x7b58001a3d98. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361c224db1 00007f361c364e9c 00007f361c364a5b 00007f362527dc09 00007f36243d7ee0 00007f36244a10ab 00007f36244a1131 00007f3624462fc0 00007f362444d929 00007f362444d3d2 00007f361d9c4bd4
0709 13:06:31.371559 (+   220us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:31.371822 (+   263us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:31.371863 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:31.371926 (+    63us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:31.371975 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:31.372047 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:31.372185 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":36156032}
I20260709 13:06:31.432693 18928 raft_consensus.cc:3060] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:31.350884 16349 raft_consensus.cc:2468] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 7.
I20260709 13:06:31.375274 19019 raft_consensus.cc:515] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:31.376468 16354 raft_consensus.cc:3060] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:31.436836 19019 leader_election.cc:290] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:31.374783 18971 raft_consensus.cc:515] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:31.439811 18971 leader_election.cc:290] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:31.377239 18974 leader_election.cc:290] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 election: Requested vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:31.378926 19076 leader_election.cc:290] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:31.380918 19068 raft_consensus.cc:2749] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:31.443056 19068 raft_consensus.cc:493] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:31.443812 19068 raft_consensus.cc:515] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:06:31.445065 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 257602us
I20260709 13:06:31.374974 16282 raft_consensus.cc:2410] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:06:31.370328 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:31.416855 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:31.411907 16283 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42740 (request call id 338) took 1407 ms. Trace:
I20260709 13:06:31.449940 16352 raft_consensus.cc:2468] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 8.
I20260709 13:06:31.449941 16283 rpcz_store.cc:276] 0709 13:06:30.004403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.410903 (+1406500us) service_pool.cc:224] Handling call
0709 13:06:31.411318 (+   415us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:31.411529 (+   211us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:31.411562 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:31.411613 (+    51us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:31.411647 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:31.411710 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:31.411834 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:31.446996 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:31.365707 16940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:31.455107 16354 raft_consensus.cc:2468] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 4.
I20260709 13:06:31.400745 18984 leader_election.cc:290] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:31.380153 19017 leader_election.cc:290] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:31.490953 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:31.490903 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:06:31.494099 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:31.496176 16277 raft_consensus.cc:3060] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:31.496963 16947 raft_consensus.cc:3060] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:31.497951 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:31.498508 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:06:31.498232 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 324565us
I20260709 13:06:31.479019 18974 raft_consensus.cc:493] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:31.385762 19022 raft_consensus.cc:515] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:31.501149 16173 leader_election.cc:304] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:31.517517 16173 leader_election.cc:304] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:31.521330 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
W20260709 13:06:31.504503 16248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:31.493443 19076 raft_consensus.cc:493] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:31.495170 18963 raft_consensus.cc:493] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:31.487703 19026 raft_consensus.cc:493] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:31.499011 18957 raft_consensus.cc:493] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:31.506485 16276 raft_consensus.cc:3055] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:31.529431 16201 raft_consensus.cc:1275] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:06:31.495690 18810 raft_consensus.cc:493] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:31.502653 18910 raft_consensus.cc:493] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:31.517809 18981 raft_consensus.cc:493] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:31.502573 18984 raft_consensus.cc:493] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:31.536461 16276 raft_consensus.cc:740] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:31.537109 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:31.522413 16949 raft_consensus.cc:2468] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 6.
I20260709 13:06:31.524788 19002 raft_consensus.cc:493] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:31.560108 16208 raft_consensus.cc:1275] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:06:31.563301 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 244760us
I20260709 13:06:31.565382 16914 leader_election.cc:304] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:06:31.543201 18919 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.019s	user 0.015s	sys 0.028s
I20260709 13:06:31.568981 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:31.569650 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:31.569741 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:31.532665 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:31.534499 18963 raft_consensus.cc:515] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:31.607612 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bc3c8ff9b84838a2664335d7e1582b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:31.566522 19002 raft_consensus.cc:515] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:31.586884 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c15d8e9be8414c84912ab77b66bfb1" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:31.583060 16248 leader_election.cc:304] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:06:31.538813 19026 raft_consensus.cc:515] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:31.542904 18957 raft_consensus.cc:515] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:31.560451 18910 raft_consensus.cc:515] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:31.523766 18974 raft_consensus.cc:515] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } }
I20260709 13:06:31.567354 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:31.542572 19076 raft_consensus.cc:515] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:31.533265 18988 consensus_queue.cc:1059] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 13:06:31.581228 16949 raft_consensus.cc:2468] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 5.
I20260709 13:06:31.541786 18951 consensus_queue.cc:1059] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.111s
I20260709 13:06:31.609532 16277 raft_consensus.cc:2468] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 8.
I20260709 13:06:31.598682 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:31.594779 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:31.599961 16281 raft_consensus.cc:1275] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:06:31.536296 19083 raft_consensus.cc:493] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:31.553071 18810 raft_consensus.cc:515] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:31.604414 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:31.664521 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c15d8e9be8414c84912ab77b66bfb1" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:31.645323 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:31.623086 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:31.582916 16200 raft_consensus.cc:2468] T b9e1324823f04d8da5a4b3ddbd061c0e P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 6.
I20260709 13:06:31.602813 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:06:31.644766 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 79455.1us
I20260709 13:06:31.598009 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:06:31.798782 16277 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45218 (request call id 1662) took 1690 ms (client timeout 1611 ms). Trace:
I20260709 13:06:31.596299 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:31.628136 16202 raft_consensus.cc:2393] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 5: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:06:31.645617 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
W20260709 13:06:31.600574 16320 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:31.691334 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:31.622756 16248 leader_election.cc:304] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:06:31.709095 16351 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41830 (request call id 1657) took 1103 ms. Trace:
I20260709 13:06:31.663898 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:31.598346 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:31.801366 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:31.610607 16947 raft_consensus.cc:2468] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 8.
I20260709 13:06:31.599064 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:31.601449 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:06:31.740232 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 222786us
I20260709 13:06:31.803426 16173 leader_election.cc:304] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:31.800835 16352 raft_consensus.cc:2468] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 6.
I20260709 13:06:31.803344 16354 raft_consensus.cc:3060] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:31.620996 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:31.649749 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:31.598922 16322 leader_election.cc:304] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:31.807060 16279 raft_consensus.cc:2393] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 8: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:06:31.801366 16208 raft_consensus.cc:3060] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:31.803983 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:31.800956 16351 rpcz_store.cc:276] 0709 13:06:30.605565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.174367 (+568802us) service_pool.cc:224] Handling call
0709 13:06:31.174756 (+   389us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:31.201720 (+ 26964us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:31.201753 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:31.230456 (+ 28703us) log.cc:844] Serialized 52 byte log entry
0709 13:06:31.447923 (+217467us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:31.611105 (+163182us) log.cc:844] Serialized 14 byte log entry
0709 13:06:31.708561 (+ 97456us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:31.708687 (+   126us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:31.708753 (+    66us) raft_consensus.cc:1685] finished
0709 13:06:31.708774 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:31.708998 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":96815,"prepare.queue_time_us":343849,"raft.queue_time_us":207990,"raft.run_cpu_time_us":296,"raft.run_wall_time_us":6776,"thread_start_us":338822,"threads_started":2,"wal-append.queue_time_us":292137}
I20260709 13:06:31.800328 16349 raft_consensus.cc:2468] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 5.
I20260709 13:06:31.811889 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:31.812654 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:31.812987 16351 raft_consensus.cc:1275] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 13:06:31.813630 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 214786us
I20260709 13:06:31.649461 19001 raft_consensus.cc:493] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:31.821938 16278 raft_consensus.cc:2393] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 7: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:06:31.621444 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:31.800132 16353 raft_consensus.cc:2376] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 6. Re-sending same reply.
I20260709 13:06:31.808888 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:31.823342 16201 raft_consensus.cc:3060] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:31.799402 16277 rpcz_store.cc:269] 0709 13:06:30.108102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.465252 (+1357150us) service_pool.cc:224] Handling call
0709 13:06:31.798712 (+333460us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:31.824219 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 201538us
I20260709 13:06:31.824580 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:31.816179 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:31.802075 16350 raft_consensus.cc:2468] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 2.
I20260709 13:06:31.818920 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:06:31.576339 18919 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.052s	user 0.016s	sys 0.029s
I20260709 13:06:31.816018 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:31.827936 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:31.587751 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:06:31.784647 19080 raft_consensus.cc:2749] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:06:31.651304 18972 raft_consensus.cc:2804] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:31.861862 16280 raft_consensus.cc:2468] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 8.
I20260709 13:06:31.647758 19050 raft_consensus.cc:493] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:31.831173 16914 leader_election.cc:304] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
W20260709 13:06:31.882786 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 51682us
I20260709 13:06:31.565541 18981 raft_consensus.cc:515] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:31.590975 16940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:31.658196 19017 raft_consensus.cc:2804] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:31.826170 16206 raft_consensus.cc:2468] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 8.
I20260709 13:06:31.583138 19068 leader_election.cc:290] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:31.834751 16282 raft_consensus.cc:2393] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 5: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
W20260709 13:06:31.874109 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 54395.1us
I20260709 13:06:31.801630 19027 raft_consensus.cc:493] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:31.876592 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 43880.2us
I20260709 13:06:31.865911 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bc3c8ff9b84838a2664335d7e1582b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:31.621518 18960 raft_consensus.cc:493] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:31.801630 19025 raft_consensus.cc:493] T b9e1324823f04d8da5a4b3ddbd061c0e P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:31.592024 19022 leader_election.cc:290] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:31.814752 19079 raft_consensus.cc:2749] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:06:31.896601 16200 raft_consensus.cc:1240] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:31.894533 16201 raft_consensus.cc:2410] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:06:31.578774 18984 raft_consensus.cc:515] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:31.717708 19087 raft_consensus.cc:2804] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:31.881717 18972 raft_consensus.cc:493] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:31.678212 18928 raft_consensus.cc:515] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:31.907306 16354 raft_consensus.cc:2468] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 9.
I20260709 13:06:31.815210 18572 raft_consensus.cc:3055] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:31.815176 18908 raft_consensus.cc:2749] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:06:31.911103 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 85784.9us
I20260709 13:06:31.932466 16248 leader_election.cc:304] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:06:31.933462 16248 leader_election.cc:304] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:06:31.916682 16208 raft_consensus.cc:2468] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 4.
I20260709 13:06:31.864766 18971 raft_consensus.cc:2804] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:31.808874 19092 raft_consensus.cc:493] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
W20260709 13:06:31.921815 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 106514us
I20260709 13:06:31.844465 18988 consensus_queue.cc:1243] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer 1109f76a0b7b443a84c0327c8707bc63 log is divergent from this leader: its last log entry 8.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:06:31.863543 18809 consensus_queue.cc:1048] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.067s
I20260709 13:06:31.895025 18850 raft_consensus.cc:2749] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:06:31.862403 19001 raft_consensus.cc:515] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:31.937201 16248 leader_election.cc:304] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:06:31.811190 19083 raft_consensus.cc:515] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:31.898844 19017 raft_consensus.cc:493] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:31.927990 16942 raft_consensus.cc:2393] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 8: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:06:31.911302 19080 consensus_queue.cc:1048] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 13:06:31.951229 16208 raft_consensus.cc:1275] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:06:31.951113 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:31.975342 16200 raft_consensus.cc:2468] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 8.
I20260709 13:06:31.930888 18972 raft_consensus.cc:3060] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:31.925190 19025 raft_consensus.cc:515] T b9e1324823f04d8da5a4b3ddbd061c0e P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:31.931886 18572 raft_consensus.cc:740] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:31.964803 16201 raft_consensus.cc:1240] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:31.939674 18814 raft_consensus.cc:2804] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:31.942340 19022 raft_consensus.cc:2804] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:31.901965 16322 leader_election.cc:304] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:06:31.941411 18971 raft_consensus.cc:493] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:31.898506 19050 raft_consensus.cc:515] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:31.949934 18909 consensus_queue.cc:1059] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 13:06:31.924966 18960 raft_consensus.cc:515] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:31.999042 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:31.921589 19027 raft_consensus.cc:515] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:31.968046 19017 raft_consensus.cc:3060] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:31.966799 18988 raft_consensus.cc:2804] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:06:32.007434 19094 log.cc:927] Time spent T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.184s	user 0.001s	sys 0.000s
I20260709 13:06:31.939931 19087 raft_consensus.cc:697] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [term 6 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:31.949270 18875 consensus_queue.cc:1048] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 13:06:31.949952 19092 raft_consensus.cc:515] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:06:32.013149 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 52982.5us
I20260709 13:06:32.006996 18971 raft_consensus.cc:3060] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:32.038580 16248 leader_election.cc:304] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
W20260709 13:06:32.057320 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 114315us
I20260709 13:06:32.050133 19076 leader_election.cc:290] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:32.062484 16173 leader_election.cc:304] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:32.047693 19022 raft_consensus.cc:697] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:32.068696 16912 leader_election.cc:304] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:32.067672 19103 consensus_queue.cc:1048] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 13:06:32.062927 18981 leader_election.cc:290] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:32.063092 19002 leader_election.cc:290] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:32.071782 19105 raft_consensus.cc:2804] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:32.074409 19105 raft_consensus.cc:493] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:32.074808 19105 raft_consensus.cc:3060] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:32.067113 19080 consensus_queue.cc:1048] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.012s
I20260709 13:06:32.086040 19087 consensus_queue.cc:237] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:32.098469 16173 leader_election.cc:400] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 election: Vote denied by peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107) with higher term. Message: Invalid argument: T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for earlier term 5. Current term is 6.
I20260709 13:06:32.098979 16173 leader_election.cc:403] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:06:32.105535 16173 leader_election.cc:304] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
W20260709 13:06:32.126613 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 77616.9us
I20260709 13:06:32.127481 16248 leader_election.cc:304] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:06:32.089547 19026 leader_election.cc:290] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:32.068171 18814 raft_consensus.cc:697] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:32.071408 19083 leader_election.cc:290] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:32.127755 19068 raft_consensus.cc:2804] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:32.070498 19101 raft_consensus.cc:2749] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:06:32.183449 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 190342us
I20260709 13:06:32.184572 16940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:32.139204 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:32.247251 16949 raft_consensus.cc:2468] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 5.
W20260709 13:06:32.221987 19088 log.cc:927] Time spent T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
W20260709 13:06:32.222988 16173 connection.cc:256] RPC call timeout handler was delayed by -1.7833405540001195s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16870000000000002s for a response
I20260709 13:06:32.138265 18875 raft_consensus.cc:2804] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:06:32.251520 16949 raft_consensus.cc:1240] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:32.133955 18988 raft_consensus.cc:697] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:32.214430 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:32.242755 18919 raft_consensus.cc:493] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.126014 19102 raft_consensus.cc:2749] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:32.212224 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:32.208582 18910 leader_election.cc:290] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:32.262890 18919 raft_consensus.cc:515] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:32.265865 18919 leader_election.cc:290] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:32.266825 18960 leader_election.cc:290] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:32.188889 16941 raft_consensus.cc:1240] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 LEADER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 13:06:32.125669 19080 raft_consensus.cc:2749] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107) with higher term. Message: Invalid argument: T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for earlier term 5. Current term is 6.
I20260709 13:06:32.222296 19050 leader_election.cc:290] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:32.200754 19098 raft_consensus.cc:493] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.139689 18984 leader_election.cc:290] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:32.239728 18908 raft_consensus.cc:493] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:32.273422 16246 leader_election.cc:304] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:32.213618 16946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:32.247767 18972 raft_consensus.cc:515] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:32.273695 19098 raft_consensus.cc:515] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:32.277311 18972 leader_election.cc:290] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:32.247843 19068 raft_consensus.cc:697] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [term 8 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:32.278101 18908 raft_consensus.cc:515] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:32.279111 19068 consensus_queue.cc:237] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:32.279757 18971 raft_consensus.cc:515] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:32.280334 18908 leader_election.cc:290] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:32.277426 19098 leader_election.cc:290] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:32.282091 18971 leader_election.cc:290] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 election: Requested vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:32.283752 19092 leader_election.cc:290] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:32.240435 19022 consensus_queue.cc:237] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:32.262094 19105 raft_consensus.cc:515] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:32.292580 19105 leader_election.cc:290] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:32.294384 16246 leader_election.cc:304] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:32.295347 19019 raft_consensus.cc:2749] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:32.295078 18988 consensus_queue.cc:237] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:32.295814 18572 consensus_queue.cc:260] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:32.296974 18572 raft_consensus.cc:3060] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:32.297801 19019 consensus_queue.cc:1059] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:32.297947 18875 raft_consensus.cc:697] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:32.257828 19097 raft_consensus.cc:493] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.299026 19097 raft_consensus.cc:515] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:32.297828 16246 leader_election.cc:304] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:32.299293 18875 consensus_queue.cc:237] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:32.300590 19107 consensus_queue.cc:1048] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:32.302297 19107 raft_consensus.cc:3055] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:32.302735 19107 raft_consensus.cc:740] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:32.302913 19027 leader_election.cc:290] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:32.300861 18957 leader_election.cc:290] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:32.304059 19107 consensus_queue.cc:260] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:32.305383 19107 raft_consensus.cc:3060] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:32.306763 18957 raft_consensus.cc:2804] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:32.307229 18957 raft_consensus.cc:493] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:32.306972 16276 consensus_queue.cc:260] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:32.307597 18957 raft_consensus.cc:3060] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:32.308002 16276 raft_consensus.cc:3060] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:32.322218 16246 leader_election.cc:304] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:06:32.330796 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 55982.5us
I20260709 13:06:32.335089 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:32.337668 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:32.345322 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:32.333798 19097 leader_election.cc:290] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:32.338085 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:32.320312 19109 raft_consensus.cc:2749] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:32.347785 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:32.338466 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:32.333420 19105 raft_consensus.cc:2749] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:32.342103 16276 raft_consensus.cc:1275] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 9. (term mismatch)
I20260709 13:06:32.341498 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:32.338896 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c15d8e9be8414c84912ab77b66bfb1" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:32.411543 16207 raft_consensus.cc:2468] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 5.
I20260709 13:06:32.365355 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:32.414119 16200 raft_consensus.cc:2468] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 6.
I20260709 13:06:32.339557 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:32.341781 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:32.416653 16202 raft_consensus.cc:3060] T b9e1324823f04d8da5a4b3ddbd061c0e P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:06:32.337540 16246 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:32.429790 18928 leader_election.cc:290] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:32.435964 19025 leader_election.cc:290] T b9e1324823f04d8da5a4b3ddbd061c0e P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:32.332948 18971 consensus_queue.cc:1059] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.112s
I20260709 13:06:32.445969 18971 raft_consensus.cc:3055] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:32.446532 18971 raft_consensus.cc:740] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:32.340564 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:32.448725 16199 raft_consensus.cc:2468] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 7.
W20260709 13:06:32.448839 19091 log.cc:927] Time spent T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.619s	user 0.005s	sys 0.000s
I20260709 13:06:32.452606 19017 raft_consensus.cc:515] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:32.459841 16248 leader_election.cc:304] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:06:32.461434 19017 leader_election.cc:290] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 9 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:32.462756 19001 leader_election.cc:290] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:32.463514 19001 raft_consensus.cc:2804] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:32.463925 19001 raft_consensus.cc:493] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:32.464360 19001 raft_consensus.cc:3060] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:32.398463 16276 pending_rounds.cc:85] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3: Aborting all ops after (but not including) 8
I20260709 13:06:32.467280 16276 pending_rounds.cc:107] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3: Aborting uncommitted NO_OP operation due to leader change: 7.9
I20260709 13:06:32.467573 16276 raft_consensus.cc:2889] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:32.352061 16173 leader_election.cc:304] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:32.479907 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:06:32.480109 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 128139us
I20260709 13:06:32.481621 16276 raft_consensus.cc:1240] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:32.482443 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:32.484508 18988 raft_consensus.cc:493] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:32.485236 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:32.485145 18988 raft_consensus.cc:515] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:32.486701 18810 leader_election.cc:290] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:32.484618 18908 raft_consensus.cc:2804] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:32.487071 16274 raft_consensus.cc:1240] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 LEADER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:32.487406 18908 raft_consensus.cc:697] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:32.487979 16946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f022e2e63ae4461d834e476ff2666991" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:32.488538 18908 consensus_queue.cc:237] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:32.490947 18974 leader_election.cc:290] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:32.492178 16202 raft_consensus.cc:2468] T b9e1324823f04d8da5a4b3ddbd061c0e P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 7.
I20260709 13:06:32.494516 16281 raft_consensus.cc:1275] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:06:32.494024 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:32.495304 16276 raft_consensus.cc:2468] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 8.
I20260709 13:06:32.493532 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:06:32.487653 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:06:32.496407 18988 leader_election.cc:290] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:06:32.498343 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 501818us
I20260709 13:06:32.399089 18814 consensus_queue.cc:237] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:32.499228 18957 raft_consensus.cc:515] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:06:32.499811 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 597969us
I20260709 13:06:32.500038 18935 raft_consensus.cc:2749] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:32.501945 19085 raft_consensus.cc:493] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:32.510277 16355 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41830 (request call id 1656) took 1905 ms. Trace:
I20260709 13:06:32.577476 18971 consensus_queue.cc:260] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:32.588025 18971 raft_consensus.cc:3060] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:32.544111 16947 raft_consensus.cc:1240] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:32.543838 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:32.585584 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:32.592195 16355 rpcz_store.cc:276] 0709 13:06:30.605269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.132245 (+526976us) service_pool.cc:224] Handling call
0709 13:06:31.132648 (+   403us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:31.478843 (+346195us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:31.478875 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:31.512012 (+ 33137us) log.cc:844] Serialized 52 byte log entry
0709 13:06:31.864042 (+352030us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:31.937040 (+ 72998us) log.cc:844] Serialized 14 byte log entry
0709 13:06:32.305245 (+368205us) spinlock_profiling.cc:243] Waited 2.67 ms on lock 0x7b1800434380. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f3625264de1 00007f36252715b1 00007f361c316c0a 00007f3625a56219 00007f361c39ea40 00007f361c3994e4 00007f361c399455 00007f3622e813c7 00007f361f4939a7 00007f361f4a30bf 00007f361f4a3038
0709 13:06:32.305476 (+   231us) log.cc:844] Serialized 14 byte log entry
0709 13:06:32.442840 (+137364us) spinlock_profiling.cc:243] Waited 4.52 ms on lock 0x7b1800434380. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f3625264de1 00007f36252715b1 00007f361c39c3f3 00007f361c39e7c1 00007f361c39e779 00007f361c39e709 00007f361c39e6d1 00007f361c39d9cd 000000000038f354 000000000038f199 00007f361c37f83a
0709 13:06:32.506496 (+ 63656us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:32.506604 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:32.506660 (+    56us) raft_consensus.cc:1685] finished
0709 13:06:32.506676 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:32.510184 (+  3508us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":580578,"prepare.queue_time_us":472849,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":68,"raft.queue_time_us":916343,"raft.run_cpu_time_us":360,"raft.run_wall_time_us":5895,"spinlock_wait_cycles":16537728,"thread_start_us":641741,"threads_started":2,"wal-append.queue_time_us":404747}
I20260709 13:06:32.594957 16320 leader_election.cc:304] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:32.517001 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:32.596963 16322 leader_election.cc:304] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:32.526580 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:32.611570 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:06:32.613879 16249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:32.631449 16322 leader_election.cc:304] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:32.554558 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:32.632911 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:32.633940 16277 raft_consensus.cc:2468] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 4.
I20260709 13:06:32.506083 19083 raft_consensus.cc:493] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:32.586426 16942 raft_consensus.cc:3060] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:06:32.640724 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 45849.7us
I20260709 13:06:32.536746 16943 raft_consensus.cc:3060] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:32.643721 16278 raft_consensus.cc:2468] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 9.
I20260709 13:06:32.628074 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:32.544780 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:32.589538 18963 leader_election.cc:290] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:32.651175 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:32.646690 16356 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33486 (request call id 270) took 1478 ms. Trace:
I20260709 13:06:32.624194 19079 raft_consensus.cc:2749] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:32.656204 16283 raft_consensus.cc:2393] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 9: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:06:32.624882 19085 raft_consensus.cc:515] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:32.668076 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:32.668586 16322 leader_election.cc:304] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:32.624243 19084 consensus_queue.cc:1059] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 13:06:32.518797 18984 consensus_queue.cc:1059] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.141s
W20260709 13:06:32.662379 16249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:32.675824 18809 consensus_queue.cc:1048] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 13:06:32.676586 16320 leader_election.cc:304] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:32.667486 19122 raft_consensus.cc:2749] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:32.681548 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:32.683384 16322 leader_election.cc:304] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:32.669682 19007 raft_consensus.cc:2804] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:06:32.679440 16249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:32.686755 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:32.679675 16278 raft_consensus.cc:2393] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 7: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:06:32.684937 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:32.685387 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:32.696380 16914 leader_election.cc:304] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:32.696627 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:32.698454 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:32.699304 16276 raft_consensus.cc:2468] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 4.
I20260709 13:06:32.702337 18850 raft_consensus.cc:2804] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:32.702725 18951 raft_consensus.cc:493] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.698490 19049 raft_consensus.cc:493] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:32.703284 18951 raft_consensus.cc:515] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:32.703928 19049 raft_consensus.cc:515] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:32.704337 19052 consensus_queue.cc:1048] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:06:32.705818 18951 leader_election.cc:290] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:32.706192 19049 leader_election.cc:290] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:32.702875 18850 raft_consensus.cc:493] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:32.706708 16248 leader_election.cc:304] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:32.711972 18850 raft_consensus.cc:3060] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:32.712265 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:32.712541 16248 leader_election.cc:304] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:32.713056 16204 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60154 (request call id 1648) took 1193 ms. Trace:
I20260709 13:06:32.664965 16356 rpcz_store.cc:276] 0709 13:06:31.168109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.432984 (+264875us) service_pool.cc:224] Handling call
0709 13:06:31.433320 (+   336us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:31.445690 (+ 12370us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:31.445723 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:31.454441 (+  8718us) log.cc:844] Serialized 52 byte log entry
0709 13:06:31.748085 (+293644us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:31.918712 (+170627us) log.cc:844] Serialized 14 byte log entry
0709 13:06:31.937128 (+ 18416us) log.cc:844] Serialized 14 byte log entry
0709 13:06:32.072458 (+135330us) spinlock_profiling.cc:243] Waited 2.81 ms on lock 0x7b180045bc20. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f3625264de1 00007f36252715b1 00007f361c39c522 00007f361c39e7c1 00007f361c39e779 00007f361c39e709 00007f361c39e6d1 00007f361c39d9cd 000000000038f354 000000000038f199 00007f361c37f83a
0709 13:06:32.448185 (+375727us) spinlock_profiling.cc:243] Waited 30.6 ms on lock 0x7b4400022b4c. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361c224db1 00007f361c2c2c85 00007f361c2c36a2 00007f361f0351db 00007f361f030aaf 00007f361f02486e 00007f361f023bb6 00007f361f0237d8 00007f361f02d221 00007f361f02d1d9 00007f361f02d169
0709 13:06:32.497193 (+ 49008us) spinlock_profiling.cc:243] Waited 986 us on lock 0x7b180045bc20. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f3625264de1 00007f36252715b1 00007f361c316c0a 00007f3625a56219 00007f361c39ea40 00007f361c3994e4 00007f361c399455 00007f361f481060 00007f361f493716 00007f361f4a4287 00007f361f4a4208
0709 13:06:32.646297 (+149104us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:32.646389 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:32.646431 (+    42us) raft_consensus.cc:1685] finished
0709 13:06:32.646443 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:32.646625 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":494464,"prepare.queue_time_us":533279,"prepare.run_cpu_time_us":94,"prepare.run_wall_time_us":1381,"raft.queue_time_us":577321,"raft.run_cpu_time_us":431,"raft.run_wall_time_us":21315,"spinlock_wait_cycles":79044096,"thread_start_us":496344,"threads_started":3,"wal-append.queue_time_us":324742}
I20260709 13:06:32.690977 18935 raft_consensus.cc:3060] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:32.710863 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:32.649364 19083 raft_consensus.cc:515] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:32.691601 19079 raft_consensus.cc:2749] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:32.713747 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:32.713457 16204 rpcz_store.cc:276] 0709 13:06:31.519293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.519413 (+   120us) service_pool.cc:224] Handling call
0709 13:06:31.519707 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:31.947499 (+427792us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:31.947547 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:31.947607 (+    60us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:31.947652 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:32.712836 (+765184us) spinlock_profiling.cc:243] Waited 428 ms on lock 0x7b540038aed4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f489e01 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6
0709 13:06:32.712877 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:32.712999 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":983283456}
I20260709 13:06:32.801700 16276 raft_consensus.cc:2468] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 5.
I20260709 13:06:32.702822 19100 raft_consensus.cc:3060] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:32.739511 19049 raft_consensus.cc:493] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:32.802942 16943 raft_consensus.cc:2468] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 7.
I20260709 13:06:32.714986 16248 leader_election.cc:304] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:32.743085 19105 raft_consensus.cc:2749] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:32.691773 19007 raft_consensus.cc:493] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:32.828251 16942 raft_consensus.cc:2468] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 7.
I20260709 13:06:32.743436 18909 raft_consensus.cc:2749] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:32.829123 18850 raft_consensus.cc:515] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:32.830101 19085 leader_election.cc:290] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:32.736060 18928 raft_consensus.cc:3055] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:32.829181 18957 leader_election.cc:290] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:32.743057 19001 raft_consensus.cc:515] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:06:32.836288 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 121753us
I20260709 13:06:32.837193 19104 raft_consensus.cc:2749] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:32.859622 16248 leader_election.cc:304] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:06:32.855834 18928 raft_consensus.cc:740] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:32.864171 16947 raft_consensus.cc:1240] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:32.864622 16248 leader_election.cc:304] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:32.845352 19007 raft_consensus.cc:3060] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:32.872078 16248 leader_election.cc:304] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:06:32.837293 19049 raft_consensus.cc:515] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:32.875533 18974 raft_consensus.cc:2804] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:06:32.876248 18974 raft_consensus.cc:697] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:32.877614 19049 leader_election.cc:290] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:32.877323 18974 consensus_queue.cc:237] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:32.878296 19037 consensus_queue.cc:1048] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:06:32.880332 18850 leader_election.cc:290] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 7 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:32.882233 18909 raft_consensus.cc:2804] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:32.883029 16941 raft_consensus.cc:1275] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:06:32.873878 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f022e2e63ae4461d834e476ff2666991" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:32.883003 18909 raft_consensus.cc:697] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:32.886677 18909 consensus_queue.cc:237] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:32.837253 18984 consensus_queue.cc:1059] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:06:32.891055 19097 raft_consensus.cc:3055] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:32.891641 19097 raft_consensus.cc:740] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:32.892207 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:32.892858 16206 raft_consensus.cc:2468] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 8.
I20260709 13:06:32.892660 19097 consensus_queue.cc:260] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:32.894362 19097 raft_consensus.cc:3060] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:32.903379 19001 leader_election.cc:290] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:32.904918 16280 raft_consensus.cc:2393] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 in current term 6: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:06:32.913702 16274 raft_consensus.cc:2468] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 7.
I20260709 13:06:32.917300 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:32.904650 19007 raft_consensus.cc:515] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } }
I20260709 13:06:32.914397 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:32.914362 16246 leader_election.cc:304] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:32.921291 16203 raft_consensus.cc:2468] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 4.
I20260709 13:06:32.915882 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:32.868988 18957 raft_consensus.cc:2804] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:32.929051 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:32.925755 16246 leader_election.cc:304] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
W20260709 13:06:32.917439 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 209926us
I20260709 13:06:32.934685 18572 raft_consensus.cc:2804] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:32.935199 18572 raft_consensus.cc:493] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:32.935622 18572 raft_consensus.cc:3060] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:32.936941 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:06:32.924626 19104 raft_consensus.cc:2749] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:32.926846 18957 raft_consensus.cc:493] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:32.939088 18957 raft_consensus.cc:3060] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:32.944267 19083 leader_election.cc:290] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:32.863619 18928 consensus_queue.cc:260] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:32.946030 18928 raft_consensus.cc:3060] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:06:32.948745 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:32.947551 18572 raft_consensus.cc:515] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:32.914858 19001 raft_consensus.cc:493] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:32.951409 19001 raft_consensus.cc:515] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:32.932375 16246 leader_election.cc:304] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:32.959656 16246 leader_election.cc:304] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:32.962158 19105 raft_consensus.cc:2804] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:32.962632 19049 raft_consensus.cc:493] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.962842 19105 raft_consensus.cc:493] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:32.963225 19105 raft_consensus.cc:3060] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:32.963188 19049 raft_consensus.cc:515] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:32.964614 19085 raft_consensus.cc:493] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:32.965175 19085 raft_consensus.cc:515] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:32.965509 19049 leader_election.cc:290] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:32.967816 16246 leader_election.cc:304] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:32.963498 19125 raft_consensus.cc:493] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:32.971439 18988 raft_consensus.cc:2804] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:32.972170 18988 raft_consensus.cc:697] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:32.976828 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:32.977591 16354 raft_consensus.cc:1240] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:32.980516 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:32.981140 16352 raft_consensus.cc:3060] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:32.985973 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:32.986410 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:32.980073 18963 raft_consensus.cc:493] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.989392 16353 raft_consensus.cc:1240] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 6. Current term is 7. Ops: [5.3-6.4]
I20260709 13:06:32.989740 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:32.991163 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:32.981886 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:32.994385 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:32.968834 19001 leader_election.cc:290] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:32.996385 18935 raft_consensus.cc:2749] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:32.997743 16350 raft_consensus.cc:1275] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:06:32.998760 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:32.968993 18971 raft_consensus.cc:2804] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:32.999960 16102 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38842 (request call id 212) took 8672 ms. Trace:
I20260709 13:06:33.000054 16357 raft_consensus.cc:1240] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:33.000629 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:33.006717 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:32.997759 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:33.008102 16354 raft_consensus.cc:2468] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 8.
I20260709 13:06:32.999349 16350 raft_consensus.cc:2468] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 6.
I20260709 13:06:33.002857 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:06:33.010926 16249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:33.012202 16352 raft_consensus.cc:2468] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 9.
I20260709 13:06:32.973487 19079 raft_consensus.cc:493] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:33.005721 16102 rpcz_store.cc:276] 0709 13:06:24.316500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:24.340608 (+ 24108us) service_pool.cc:224] Handling call
0709 13:06:32.988785 (+8648177us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:29.857929 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:29.858525 (+   596us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:29.858586 (+    61us) write_op.cc:435] Acquired schema lock
0709 13:06:29.858606 (+    20us) tablet.cc:662] Decoding operations
0709 13:06:30.146166 (+287560us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:30.146232 (+    66us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:30.146259 (+    27us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:06:30.146863 (+   604us) tablet.cc:701] Row locks acquired
0709 13:06:30.146883 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:06:30.147041 (+   158us) write_op.cc:270] Start()
0709 13:06:30.147171 (+   130us) write_op.cc:276] Timestamp: P: 1783602390146992 usec, L: 0
0709 13:06:30.147194 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:06:30.147869 (+   675us) log.cc:844] Serialized 2477 byte log entry
0709 13:06:30.423950 (+276081us) op_driver.cc:464] REPLICATION: finished
0709 13:06:30.575866 (+151916us) write_op.cc:301] APPLY: starting
0709 13:06:30.575975 (+   109us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:30.576195 (+   220us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:30.576316 (+   121us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:30.583999 (+  7683us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:30.587771 (+  3772us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 13:06:30.587852 (+    81us) write_op.cc:312] APPLY: finished
0709 13:06:30.588276 (+   424us) log.cc:844] Serialized 53 byte log entry
0709 13:06:30.591000 (+  2724us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:30.624348 (+ 33348us) write_op.cc:454] Released schema lock
0709 13:06:30.734917 (+110569us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:30.961096 (+226179us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:30.961143 (+    47us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4117,"reported_tablets":44,"child_traces":[["op",{"apply.queue_time_us":149606,"apply.run_cpu_time_us":3990,"apply.run_wall_time_us":284200,"num_ops":6,"prepare.queue_time_us":79040,"prepare.run_cpu_time_us":20907,"prepare.run_wall_time_us":363450,"raft.queue_time_us":93914,"raft.run_cpu_time_us":32900,"raft.run_wall_time_us":127774,"replication_time_us":259450,"spinlock_wait_cycles":14080,"thread_start_us":254415,"threads_started":4,"wal-append.queue_time_us":122833,"wal-append.run_cpu_time_us":14133,"wal-append.run_wall_time_us":1317727}]]}
I20260709 13:06:33.020509 16173 leader_election.cc:304] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:06:33.023866 16348 raft_consensus.cc:1275] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:06:33.007087 18971 raft_consensus.cc:493] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:33.027166 16173 leader_election.cc:304] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:33.029822 16173 leader_election.cc:304] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:06:33.014415 19049 raft_consensus.cc:493] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.983037 19125 raft_consensus.cc:515] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:32.992112 18963 raft_consensus.cc:515] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:33.031795 16173 leader_election.cc:304] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:06:33.030889 18971 raft_consensus.cc:3060] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:33.030903 19112 consensus_queue.cc:1059] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 13:06:33.024992 19097 consensus_queue.cc:1048] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 13:06:33.027009 19080 raft_consensus.cc:2749] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:33.033636 18984 raft_consensus.cc:2749] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:33.044234 16173 leader_election.cc:304] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:33.024849 18908 consensus_queue.cc:1059] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 13:06:33.005373 18988 consensus_queue.cc:237] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:33.043038 19087 raft_consensus.cc:2749] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:33.030745 19068 raft_consensus.cc:2804] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:33.025532 19100 raft_consensus.cc:2749] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:33.088156 16356 raft_consensus.cc:1275] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:06:33.077665 16351 raft_consensus.cc:2468] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 6.
I20260709 13:06:33.020645 19079 raft_consensus.cc:515] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:33.089583 16353 raft_consensus.cc:3060] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:06:33.091396 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 97977.6us
I20260709 13:06:33.028952 19095 consensus_queue.cc:1059] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.033s
W20260709 13:06:33.092190 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 96465.1us
I20260709 13:06:33.095199 16322 leader_election.cc:304] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:33.098176 16322 leader_election.cc:304] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:06:33.086995 19068 raft_consensus.cc:493] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
W20260709 13:06:33.102138 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 57949.7us
I20260709 13:06:33.102586 19068 raft_consensus.cc:3060] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:06:33.103047 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 128823us
I20260709 13:06:33.103468 16173 leader_election.cc:304] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:33.104619 16173 leader_election.cc:304] T b9e1324823f04d8da5a4b3ddbd061c0e P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:06:33.105432 19080 raft_consensus.cc:2804] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:06:33.034305 19049 raft_consensus.cc:515] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:33.099184 18974 raft_consensus.cc:493] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:33.091848 18850 raft_consensus.cc:493] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:33.110873 19079 leader_election.cc:290] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:33.112012 18899 raft_consensus.cc:3055] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:33.113056 19025 raft_consensus.cc:3055] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:33.110747 16246 leader_election.cc:304] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:33.114570 19007 leader_election.cc:290] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:33.125552 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:33.091157 19085 leader_election.cc:290] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:33.127293 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:33.127569 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:33.125840 16322 leader_election.cc:304] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:06:33.097457 19087 raft_consensus.cc:2804] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:33.173003 16353 raft_consensus.cc:2468] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 7.
W20260709 13:06:33.174211 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 63566.8us
I20260709 13:06:33.178761 16199 raft_consensus.cc:2393] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 7: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:06:33.176790 16204 raft_consensus.cc:3060] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:33.179150 16246 leader_election.cc:304] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
W20260709 13:06:33.176954 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 51244.5us
I20260709 13:06:33.100660 19135 raft_consensus.cc:2804] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:33.184201 16322 leader_election.cc:304] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:33.180778 16246 leader_election.cc:304] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:33.188369 16274 raft_consensus.cc:1240] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:33.107061 19095 consensus_queue.cc:1243] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer 0aea40d6e4374085a2e38a70a71f63e3 log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:06:33.119035 19122 raft_consensus.cc:2749] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:33.094364 18957 raft_consensus.cc:515] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:33.213924 16206 raft_consensus.cc:3055] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:33.214359 16206 raft_consensus.cc:740] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:33.195426 16281 raft_consensus.cc:1275] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:06:33.149089 19139 raft_consensus.cc:2749] T b9e1324823f04d8da5a4b3ddbd061c0e P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:33.194008 16283 raft_consensus.cc:1240] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:33.198717 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:33.200232 16914 leader_election.cc:304] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:33.200796 16202 raft_consensus.cc:1275] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:33.193975 16199 raft_consensus.cc:1275] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:06:33.219677 16199 pending_rounds.cc:85] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f: Aborting all ops after (but not including) 3
I20260709 13:06:33.219933 16199 pending_rounds.cc:107] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:06:33.220311 16199 raft_consensus.cc:2889] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:33.194216 16276 raft_consensus.cc:1240] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:33.205955 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c15d8e9be8414c84912ab77b66bfb1" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:33.153386 19025 raft_consensus.cc:740] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:33.208144 16353 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba"
dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
mode: GRACEFUL
new_leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
 from {username='slave'} at 127.0.0.1:56792
I20260709 13:06:33.153067 18899 raft_consensus.cc:740] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:06:33.196039 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:33.222966 16353 raft_consensus.cc:606] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Received request to transfer leadership to TS 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:06:33.178579 18809 raft_consensus.cc:2749] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:06:33.178469 19087 raft_consensus.cc:493] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:33.183280 18909 raft_consensus.cc:2749] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:33.223498 16353 raft_consensus.cc:614] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:33.203496 19107 raft_consensus.cc:2804] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:06:33.227034 16249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:33.150605 18974 raft_consensus.cc:515] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:33.185904 18572 leader_election.cc:290] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:33.199406 19007 raft_consensus.cc:2749] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:33.232395 16277 raft_consensus.cc:1240] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:33.234933 16204 raft_consensus.cc:2468] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 9.
I20260709 13:06:33.235208 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:33.219290 16206 consensus_queue.cc:260] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:33.253075 16206 raft_consensus.cc:3060] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:33.235884 16348 raft_consensus.cc:1275] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:06:33.175827 19092 consensus_queue.cc:1048] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 13:06:33.185552 19001 raft_consensus.cc:2804] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:33.198745 19135 raft_consensus.cc:493] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:33.150511 18850 raft_consensus.cc:515] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:06:33.249318 16173 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:33.267765 16355 raft_consensus.cc:1275] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:06:33.230273 19037 raft_consensus.cc:3060] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:33.237601 19087 raft_consensus.cc:3060] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:33.290962 16206 raft_consensus.cc:1275] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:06:33.295200 16206 pending_rounds.cc:85] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f: Aborting all ops after (but not including) 3
I20260709 13:06:33.239082 19107 raft_consensus.cc:493] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:33.300413 19107 raft_consensus.cc:3060] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:33.297392 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:33.293805 19022 consensus_queue.cc:1048] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 13:06:33.230497 19105 raft_consensus.cc:515] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:33.268971 19001 raft_consensus.cc:493] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:33.295866 16206 pending_rounds.cc:107] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:06:33.245865 19080 raft_consensus.cc:697] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 9 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
W20260709 13:06:33.355082 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:33.359666 16206 raft_consensus.cc:2889] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:33.267128 19135 raft_consensus.cc:3060] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:33.381304 16106 catalog_manager.cc:5697] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:33.385509 16106 catalog_manager.cc:5697] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f reported cstate change: term changed from 1 to 4, leader changed from 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) to e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65). New cstate: current_term: 4 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:33.399559 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 175952us
W20260709 13:06:33.380225 19121 log.cc:927] Time spent T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 13:06:33.368136 19001 raft_consensus.cc:3060] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:33.377583 18809 raft_consensus.cc:493] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:33.379688 19079 raft_consensus.cc:493] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:33.417529 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c15d8e9be8414c84912ab77b66bfb1" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:33.429493 16348 raft_consensus.cc:2468] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 5.
I20260709 13:06:33.367395 18899 consensus_queue.cc:260] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:33.420738 19105 leader_election.cc:290] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:33.413290 16106 catalog_manager.cc:5697] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } }
I20260709 13:06:33.422152 18971 raft_consensus.cc:515] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:33.424564 18974 leader_election.cc:290] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:33.299429 19025 consensus_queue.cc:260] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:33.407557 19125 leader_election.cc:290] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:33.465664 16246 leader_election.cc:304] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:33.477917 18963 leader_election.cc:290] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:33.479900 18957 leader_election.cc:290] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 election: Requested vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:33.471953 18951 raft_consensus.cc:493] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:33.483353 18951 raft_consensus.cc:515] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:33.485877 18951 leader_election.cc:290] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:33.487874 19146 consensus_queue.cc:1048] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:33.495360 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:06:33.499055 18971 leader_election.cc:290] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:33.467445 19080 consensus_queue.cc:237] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:33.500836 19025 raft_consensus.cc:3060] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:33.523334 16356 raft_consensus.cc:1240] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 6. Current term is 7. Ops: []
W20260709 13:06:33.529829 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 45163.7us
W20260709 13:06:33.530917 16249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:33.432770 18809 raft_consensus.cc:515] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:33.532491 16943 raft_consensus.cc:1275] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:06:33.533581 18809 leader_election.cc:290] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:33.490092 19146 consensus_queue.cc:1048] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 13:06:33.486505 18951 raft_consensus.cc:2749] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:33.447213 19079 raft_consensus.cc:515] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:33.490419 19049 leader_election.cc:290] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:33.528301 18899 raft_consensus.cc:3060] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:33.552688 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:33.553484 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:33.553857 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:33.555130 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
W20260709 13:06:33.534904 19120 log.cc:927] Time spent T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 13:06:33.562986 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:33.544912 19107 raft_consensus.cc:515] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:33.563488 19153 raft_consensus.cc:493] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:33.610148 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:06:33.597469 16173 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:33.622108 16203 raft_consensus.cc:2410] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:06:33.563483 16208 raft_consensus.cc:3060] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:33.602421 19001 raft_consensus.cc:515] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } }
I20260709 13:06:33.605990 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:33.618510 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:33.623816 16173 leader_election.cc:304] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:33.627305 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:33.634147 18861 raft_consensus.cc:493] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:33.621008 18984 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 13:06:33.649925 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:33.651752 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:33.635950 19107 leader_election.cc:290] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:33.651996 16356 raft_consensus.cc:3060] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:33.652572 16348 raft_consensus.cc:2468] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 6.
W20260709 13:06:33.653081 19137 log.cc:927] Time spent T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.354s	user 0.000s	sys 0.004s
W20260709 13:06:33.660478 16249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:33.661763 16356 raft_consensus.cc:2468] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 7.
I20260709 13:06:33.636302 19153 raft_consensus.cc:515] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:06:33.637048 19142 log.cc:927] Time spent T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.334s	user 0.003s	sys 0.001s
W20260709 13:06:33.638245 19068 consensus_meta.cc:287] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f: Time spent flushing consensus metadata: real 0.535s	user 0.012s	sys 0.000s
I20260709 13:06:33.619601 19112 raft_consensus.cc:3055] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:33.697469 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:33.708709 16349 raft_consensus.cc:3060] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:06:33.710184 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:33.710742 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:33.710788 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:33.710932 16353 raft_consensus.cc:2468] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 7.
I20260709 13:06:33.711826 16357 raft_consensus.cc:2393] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 9: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:06:33.711697 16352 raft_consensus.cc:2468] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 8.
I20260709 13:06:33.644646 19049 raft_consensus.cc:493] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:33.703962 16173 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:33.736402 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:33.738739 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:33.739064 16357 raft_consensus.cc:2468] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 3.
W20260709 13:06:33.740595 16173 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:33.741447 16208 raft_consensus.cc:2468] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 7.
I20260709 13:06:33.745217 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:33.746240 16356 raft_consensus.cc:2468] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 6.
I20260709 13:06:33.747502 19097 consensus_queue.cc:1059] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:33.748869 19092 raft_consensus.cc:3055] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:33.749316 19092 raft_consensus.cc:740] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:33.696255 19079 leader_election.cc:290] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:33.676945 19001 leader_election.cc:290] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:33.733952 16320 leader_election.cc:304] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
W20260709 13:06:33.753974 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 115047us
I20260709 13:06:33.763193 16349 raft_consensus.cc:2468] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 7.
I20260709 13:06:33.773056 16281 raft_consensus.cc:1240] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 LEADER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 13:06:33.708258 19112 raft_consensus.cc:740] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:33.707777 18988 raft_consensus.cc:493] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:33.776605 16356 raft_consensus.cc:1275] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:06:33.714466 18908 raft_consensus.cc:2804] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:33.778625 18988 raft_consensus.cc:515] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:33.673305 18861 raft_consensus.cc:515] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:33.784058 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:33.783420 16246 leader_election.cc:304] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
W20260709 13:06:33.791002 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 49626.7us
I20260709 13:06:33.723878 19143 consensus_queue.cc:1059] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.062s
I20260709 13:06:33.738314 18928 consensus_queue.cc:1048] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.059s
I20260709 13:06:33.735500 19087 raft_consensus.cc:515] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:33.751560 19049 raft_consensus.cc:515] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:06:33.892313 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:33.899187 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c15d8e9be8414c84912ab77b66bfb1" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:33.827162 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:33.900347 16355 raft_consensus.cc:3060] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:33.795082 16353 raft_consensus.cc:1275] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:06:33.716290 19068 raft_consensus.cc:515] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:33.896711 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:33.897583 16200 raft_consensus.cc:2393] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 9: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:06:33.897897 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:33.913043 16352 raft_consensus.cc:1275] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:06:33.750368 19092 consensus_queue.cc:260] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:33.904071 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:33.923146 16208 raft_consensus.cc:3060] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:33.913991 16348 raft_consensus.cc:3060] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:06:33.833365 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 55678.1us
I20260709 13:06:33.916206 16201 raft_consensus.cc:1240] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 4. Current term is 5. Ops: []
W20260709 13:06:33.906237 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 122928us
I20260709 13:06:33.782356 19079 raft_consensus.cc:2804] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:06:33.797353 18908 raft_consensus.cc:697] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:33.927589 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:33.938464 16352 raft_consensus.cc:3060] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:33.928939 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:33.939577 16354 raft_consensus.cc:3060] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:33.929610 16353 raft_consensus.cc:1275] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:06:33.826299 16943 raft_consensus.cc:1275] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:06:33.953244 16355 raft_consensus.cc:2468] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 6.
W20260709 13:06:33.950977 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 171894us
I20260709 13:06:33.976115 16208 raft_consensus.cc:2468] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 5.
I20260709 13:06:33.912973 18814 raft_consensus.cc:2804] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:34.001575 16205 raft_consensus.cc:1240] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:34.012487 16206 raft_consensus.cc:1275] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 4. (term mismatch)
I20260709 13:06:34.013036 16206 pending_rounds.cc:85] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f: Aborting all ops after (but not including) 3
I20260709 13:06:34.013303 16206 pending_rounds.cc:107] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f: Aborting uncommitted NO_OP operation due to leader change: 8.4
I20260709 13:06:34.013581 16206 raft_consensus.cc:2889] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:33.713929 19157 consensus_queue.cc:1059] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.385s
I20260709 13:06:33.756285 19139 consensus_queue.cc:1059] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.380s
I20260709 13:06:34.059293 16276 raft_consensus.cc:1240] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:06:34.264034 16274 raft_consensus.cc:1240] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 5. Current term is 6. Ops: []
W20260709 13:06:34.172236 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:34.059796 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 49496us
W20260709 13:06:34.258389 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 362287us
I20260709 13:06:34.053500 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:34.399231 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:34.196460 16348 raft_consensus.cc:2468] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 9.
W20260709 13:06:34.174177 16174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:34.471854 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:34.368953 16205 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60154 (request call id 1680) took 1245 ms. Trace:
I20260709 13:06:34.097069 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:34.473369 16275 raft_consensus.cc:2468] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 9.
I20260709 13:06:34.247062 16350 raft_consensus.cc:1275] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 5 index: 2. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 13:06:34.244091 16354 raft_consensus.cc:2468] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 7.
I20260709 13:06:34.473742 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:34.247012 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:34.474422 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:34.474628 16274 raft_consensus.cc:2393] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 7: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:06:34.474946 16356 raft_consensus.cc:3060] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:06:34.251659 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:34.475221 16276 raft_consensus.cc:2393] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 9: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:06:34.290879 16322 leader_election.cc:304] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:06:34.322070 19164 log.cc:927] Time spent T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.179s	user 0.000s	sys 0.001s
I20260709 13:06:34.348340 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
W20260709 13:06:34.477003 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 50377us
I20260709 13:06:34.079265 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
W20260709 13:06:34.070385 16249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:34.483631 16249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:34.289901 16946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:34.400525 16352 raft_consensus.cc:2468] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 3.
W20260709 13:06:34.320016 19166 log.cc:927] Time spent T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.188s	user 0.000s	sys 0.000s
I20260709 13:06:34.287199 19007 raft_consensus.cc:493] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:34.479918 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 189147us
I20260709 13:06:34.489650 19007 raft_consensus.cc:515] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:34.472568 16205 rpcz_store.cc:276] 0709 13:06:33.123522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:33.125197 (+  1675us) service_pool.cc:224] Handling call
0709 13:06:33.150024 (+ 24827us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:34.004788 (+854764us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:34.368627 (+363839us) spinlock_profiling.cc:243] Waited 806 ms on lock 0x7b54001194d4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f489e01 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6
0709 13:06:34.368875 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1854266752}
W20260709 13:06:34.402400 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:34.491390 19139 raft_consensus.cc:493] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:34.491907 19007 leader_election.cc:290] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:34.491716 16322 leader_election.cc:304] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:34.492671 19007 raft_consensus.cc:493] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:34.484261 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:34.055105 18814 raft_consensus.cc:697] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:34.494661 18814 consensus_queue.cc:237] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:34.403079 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:34.484704 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:34.486274 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:34.496304 16348 raft_consensus.cc:2468] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 6.
I20260709 13:06:34.496393 19100 raft_consensus.cc:2749] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:34.477326 19122 raft_consensus.cc:493] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
W20260709 13:06:34.364355 19135 consensus_meta.cc:287] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 0.973s	user 0.010s	sys 0.000s
I20260709 13:06:34.244382 19153 leader_election.cc:290] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:34.498840 19135 raft_consensus.cc:515] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:06:34.308256 19165 log.cc:927] Time spent T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.305s	user 0.001s	sys 0.000s
I20260709 13:06:34.500939 16356 raft_consensus.cc:2468] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 5.
I20260709 13:06:34.501571 19135 leader_election.cc:290] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:06:34.501773 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:34.320732 19160 log.cc:927] Time spent T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.321s	user 0.000s	sys 0.001s
I20260709 13:06:34.237547 19112 consensus_queue.cc:260] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:34.502972 19112 raft_consensus.cc:3060] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:34.485146 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:34.503571 16351 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41830 (request call id 1679) took 1075 ms. Trace:
I20260709 13:06:34.491930 19139 raft_consensus.cc:515] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:34.504136 16282 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42740 (request call id 365) took 1314 ms. Trace:
I20260709 13:06:34.504523 16282 rpcz_store.cc:276] 0709 13:06:33.189620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:33.197233 (+  7613us) service_pool.cc:224] Handling call
0709 13:06:33.218428 (+ 21195us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:33.256848 (+ 38420us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:33.256881 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:33.270859 (+ 13978us) log.cc:844] Serialized 26 byte log entry
0709 13:06:33.705173 (+434314us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:06:33.705218 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:33.705303 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:34.503950 (+798647us) raft_consensus.cc:1685] finished
0709 13:06:34.503973 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:34.504087 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8341,"raft.queue_time_us":46768,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":195,"thread_start_us":468277,"threads_started":2,"wal-append.queue_time_us":631483}
I20260709 13:06:34.505846 19139 leader_election.cc:290] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:34.482956 16277 raft_consensus.cc:1240] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:34.495012 16322 leader_election.cc:304] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:34.497888 19007 raft_consensus.cc:515] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:34.497726 19122 raft_consensus.cc:515] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:06:34.093493 19037 consensus_meta.cc:287] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63: Time spent flushing consensus metadata: real 0.800s	user 0.001s	sys 0.011s
I20260709 13:06:34.503973 16351 rpcz_store.cc:276] 0709 13:06:33.428053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:33.428283 (+   230us) service_pool.cc:224] Handling call
0709 13:06:33.428598 (+   315us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:33.432214 (+  3616us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:33.432249 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:33.432715 (+   466us) log.cc:844] Serialized 26 byte log entry
0709 13:06:33.683180 (+250465us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:33.707756 (+ 24576us) log.cc:844] Serialized 14 byte log entry
0709 13:06:33.707974 (+   218us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:33.708057 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:34.366695 (+658638us) spinlock_profiling.cc:243] Waited 7.76 ms on lock 0x7b18002628a0. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f3625264de1 00007f36252715b1 00007f361c39c3f3 00007f361c39e7c1 00007f361c39e779 00007f361c39e709 00007f361c39e6d1 00007f361c39d9cd 000000000038f354 000000000038f199 00007f361c37f83a
0709 13:06:34.503302 (+136607us) raft_consensus.cc:1685] finished
0709 13:06:34.503399 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:34.503517 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16476,"prepare.queue_time_us":24917,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":48,"raft.queue_time_us":14900,"raft.run_cpu_time_us":271,"raft.run_wall_time_us":35957,"spinlock_wait_cycles":17843456,"thread_start_us":177446,"threads_started":1,"wal-append.queue_time_us":439315}
I20260709 13:06:34.512779 16946 raft_consensus.cc:1240] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:34.513733 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:34.498348 16348 raft_consensus.cc:1240] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:34.362356 18861 leader_election.cc:290] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:06:34.321412 19167 log.cc:927] Time spent T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
W20260709 13:06:34.322777 19169 log.cc:927] Time spent T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 13:06:34.325333 18988 leader_election.cc:290] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:06:34.514998 16173 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:34.532773 16208 raft_consensus.cc:1275] T b9e1324823f04d8da5a4b3ddbd061c0e P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260709 13:06:34.481778 19143 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.534s	user 0.018s	sys 0.027s
W20260709 13:06:34.521814 19085 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.620s	user 0.004s	sys 0.013s
I20260709 13:06:34.483439 19049 leader_election.cc:290] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:34.326862 15057 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:06:34.555874 19007 leader_election.cc:290] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:34.556444 16246 leader_election.cc:304] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:34.556620 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:34.579238 16279 raft_consensus.cc:3060] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:34.557027 19149 raft_consensus.cc:493] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:34.558571 19122 leader_election.cc:290] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:06:34.575413 19085 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.679s	user 0.005s	sys 0.014s
I20260709 13:06:34.558661 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:34.522497 19100 raft_consensus.cc:2804] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:34.536038 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:34.512343 18809 raft_consensus.cc:2764] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
W20260709 13:06:34.569121 16173 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:34.629210 16173 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:34.510771 19135 raft_consensus.cc:493] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:34.510962 19087 leader_election.cc:290] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:34.327277 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:34.216521 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:34.512758 18971 raft_consensus.cc:493] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.585253 18974 raft_consensus.cc:2804] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:34.535462 19037 raft_consensus.cc:2749] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:34.590847 18957 consensus_queue.cc:1048] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:34.592463 19149 raft_consensus.cc:515] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:34.597329 16206 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60138 (request call id 1798) took 1178 ms. Trace:
I20260709 13:06:34.618944 19100 raft_consensus.cc:493] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:34.599406 19175 raft_consensus.cc:493] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:34.660384 19175 raft_consensus.cc:515] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:06:34.662469 19170 log.cc:927] Time spent T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.408s	user 0.000s	sys 0.005s
I20260709 13:06:34.602969 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
W20260709 13:06:34.663935 19177 log.cc:927] Time spent T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:06:34.605696 19122 consensus_queue.cc:1059] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:34.550968 19068 leader_election.cc:290] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:34.615558 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:34.612040 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:34.644467 19141 raft_consensus.cc:493] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:34.630944 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:34.676769 16207 raft_consensus.cc:2468] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 9.
I20260709 13:06:34.226254 18908 consensus_queue.cc:237] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:34.633781 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:34.636368 16173 leader_election.cc:304] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
W20260709 13:06:34.682938 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 46686.9us
W20260709 13:06:34.640508 16174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:34.512429 19079 raft_consensus.cc:697] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 9 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:06:34.638428 19135 raft_consensus.cc:515] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:34.648095 16940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:34.650974 18850 leader_election.cc:290] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:34.653278 18984 raft_consensus.cc:3055] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:34.655017 19092 raft_consensus.cc:3060] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:34.598770 19178 raft_consensus.cc:493] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:34.645802 16206 rpcz_store.cc:276] 0709 13:06:33.418476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:33.418631 (+   155us) service_pool.cc:224] Handling call
0709 13:06:33.418932 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:34.014106 (+595174us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:34.597013 (+582907us) spinlock_profiling.cc:243] Waited 593 ms on lock 0x7b54003773d4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f489e01 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6
0709 13:06:34.597247 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1363987328}
I20260709 13:06:34.658504 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:06:34.641651 19169 log.cc:927] Time spent T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:06:34.659425 19100 raft_consensus.cc:3060] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:34.665979 16204 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60138 (request call id 1807) took 1049 ms. Trace:
I20260709 13:06:34.631791 19179 consensus_queue.cc:1059] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.038s
I20260709 13:06:34.627441 16279 raft_consensus.cc:2468] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 5.
I20260709 13:06:34.687282 16173 leader_election.cc:304] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:34.717628 19143 raft_consensus.cc:3060] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:34.656200 18974 raft_consensus.cc:697] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
W20260709 13:06:34.692710 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 174624us
I20260709 13:06:34.720466 18974 consensus_queue.cc:237] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:34.674290 16942 raft_consensus.cc:1240] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:34.644801 18971 raft_consensus.cc:515] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:34.724063 16173 leader_election.cc:304] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:06:34.724977 18971 leader_election.cc:290] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:34.725914 19025 raft_consensus.cc:2804] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:34.726213 16282 raft_consensus.cc:1275] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:06:34.726606 19025 raft_consensus.cc:493] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:34.727257 19025 raft_consensus.cc:3060] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:34.733767 19143 raft_consensus.cc:2749] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:34.734261 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:34.740351 19139 consensus_queue.cc:1048] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:34.682960 16941 raft_consensus.cc:2393] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 9: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
I20260709 13:06:34.711572 16204 rpcz_store.cc:276] 0709 13:06:33.616417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:33.617695 (+  1278us) service_pool.cc:224] Handling call
0709 13:06:33.618069 (+   374us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:33.722382 (+104313us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:33.722410 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:33.722889 (+   479us) log.cc:844] Serialized 26 byte log entry
0709 13:06:33.915332 (+192443us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:33.915386 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:34.604899 (+689513us) spinlock_profiling.cc:243] Waited 40.6 ms on lock 0x7b540020dd54. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f489e01 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6
0709 13:06:34.605377 (+   478us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:34.661912 (+ 56535us) spinlock_profiling.cc:243] Waited 14 ms on lock 0x7b4400022b4c. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361c224db1 00007f361c2c2c85 00007f361c2c36a2 00007f361f0351db 00007f361f030aaf 00007f361f02486e 00007f361f023bb6 00007f361f0237d8 00007f361f02d221 00007f361f02d1d9 00007f361f02d169
0709 13:06:34.665792 (+  3880us) raft_consensus.cc:1685] finished
0709 13:06:34.665813 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:34.665920 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":63210,"raft.queue_time_us":89416,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":93,"spinlock_wait_cycles":125457024,"thread_start_us":192161,"threads_started":1,"wal-append.queue_time_us":372266}
I20260709 13:06:34.691138 19068 raft_consensus.cc:2749] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:34.757727 16173 leader_election.cc:304] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:06:34.762954 19139 raft_consensus.cc:2804] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:34.763761 19139 raft_consensus.cc:493] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:34.764437 19139 raft_consensus.cc:3060] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:34.708901 19178 raft_consensus.cc:515] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:34.691476 19080 raft_consensus.cc:493] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:34.783399 19175 leader_election.cc:290] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:06:34.784716 19182 log.cc:927] Time spent T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:06:34.698683 18928 consensus_queue.cc:1048] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.088s
W20260709 13:06:34.794430 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 74941.6us
W20260709 13:06:34.781539 18899 consensus_meta.cc:287] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 1.207s	user 0.011s	sys 0.002s
W20260709 13:06:34.795621 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 151546us
I20260709 13:06:34.696991 18984 raft_consensus.cc:740] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:34.798192 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:34.800993 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:34.805437 16278 raft_consensus.cc:2468] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 4.
I20260709 13:06:34.806497 16280 raft_consensus.cc:1240] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:06:34.808446 16322 leader_election.cc:304] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:34.811348 16322 leader_election.cc:304] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:06:34.802242 19087 raft_consensus.cc:493] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:34.812639 19087 raft_consensus.cc:515] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:34.813405 15057 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:34.689594 19141 raft_consensus.cc:515] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:34.815047 19087 leader_election.cc:290] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:34.811744 16320 leader_election.cc:304] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:34.815819 19141 leader_election.cc:290] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:34.715009 18814 consensus_queue.cc:1048] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.098s
I20260709 13:06:34.818336 19079 consensus_queue.cc:237] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } }
I20260709 13:06:34.796661 19085 raft_consensus.cc:3055] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:34.823498 16322 leader_election.cc:304] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:34.827762 16322 leader_election.cc:304] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:34.833387 19194 raft_consensus.cc:493] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.835175 19194 raft_consensus.cc:515] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:34.841826 19180 raft_consensus.cc:2804] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:34.843729 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:34.844488 16205 raft_consensus.cc:2468] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 5.
I20260709 13:06:34.848748 16322 leader_election.cc:304] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:34.849722 16322 leader_election.cc:304] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:34.796270 19143 consensus_queue.cc:1048] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 13:06:34.854718 19190 consensus_queue.cc:1059] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:06:34.855017 18984 consensus_queue.cc:260] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:34.822871 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:34.828637 18899 raft_consensus.cc:2749] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:34.867384 19135 leader_election.cc:290] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:34.842375 19180 raft_consensus.cc:493] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:34.881721 19180 raft_consensus.cc:3060] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:34.828055 19085 raft_consensus.cc:740] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:06:34.883505 19085 consensus_queue.cc:260] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:34.884690 19085 raft_consensus.cc:3060] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:34.872479 16912 leader_election.cc:304] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:34.886339 19178 leader_election.cc:290] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:34.799644 19080 raft_consensus.cc:515] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:34.887426 19078 raft_consensus.cc:2749] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:34.889447 19080 leader_election.cc:290] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:34.890246 19149 leader_election.cc:290] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:34.880493 18899 raft_consensus.cc:2749] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:34.881225 19135 raft_consensus.cc:2749] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:34.886775 18850 raft_consensus.cc:2804] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:34.856468 19122 raft_consensus.cc:2804] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:06:34.911088 16249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:34.904680 19122 raft_consensus.cc:493] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:34.920970 19122 raft_consensus.cc:3060] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:34.904012 18850 raft_consensus.cc:493] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:34.927044 18850 raft_consensus.cc:3060] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:34.942117 19186 raft_consensus.cc:3055] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:34.942840 19186 raft_consensus.cc:740] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:06:34.944152 19186 consensus_queue.cc:260] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:34.946031 19186 raft_consensus.cc:3060] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:34.946969 18850 raft_consensus.cc:515] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:34.952097 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:34.952991 16204 raft_consensus.cc:3060] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:34.969022 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:34.969976 16276 raft_consensus.cc:2468] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 9.
I20260709 13:06:34.892647 18984 raft_consensus.cc:3060] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:34.970242 16204 raft_consensus.cc:2468] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 6.
I20260709 13:06:34.981069 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:06:34.987839 16174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:34.902992 19191 raft_consensus.cc:2749] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:34.859125 19025 raft_consensus.cc:515] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:06:35.027957 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 178285us
I20260709 13:06:35.029670 16322 leader_election.cc:304] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:35.011381 18809 raft_consensus.cc:493] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:35.019578 18957 raft_consensus.cc:493] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:35.025175 18850 leader_election.cc:290] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 6 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:35.046933 16322 leader_election.cc:304] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:06:35.049885 19193 log.cc:927] Time spent T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63: Append to log took a long time: real 0.148s	user 0.000s	sys 0.001s
I20260709 13:06:35.035563 18861 raft_consensus.cc:493] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:35.051514 19052 raft_consensus.cc:3055] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:35.054181 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:35.056039 16353 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41830 (request call id 1708) took 1091 ms. Trace:
I20260709 13:06:35.056424 16354 raft_consensus.cc:1275] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:06:35.059237 16355 raft_consensus.cc:1240] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:35.035982 19189 raft_consensus.cc:2749] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:35.082398 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:35.082993 19097 raft_consensus.cc:3055] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:35.083388 19097 raft_consensus.cc:740] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:35.056557 16353 rpcz_store.cc:276] 0709 13:06:33.964879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:33.989013 (+ 24134us) service_pool.cc:224] Handling call
0709 13:06:35.054026 (+1065013us) spinlock_profiling.cc:243] Waited 7.11 ms on lock 0x7b5800024698. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361c224db1 00007f361c364b71 00007f361c364a22 00007f362527dc09 00007f36243d7ee0 00007f36244a10ab 00007f36244a1131 00007f362444f0a0 00007f362444e984 00007f361d9c96d4 00007f361d9c9662
0709 13:06:35.055960 (+  1934us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16352512}
I20260709 13:06:35.053457 19079 raft_consensus.cc:2749] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:35.084434 19097 consensus_queue.cc:260] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:35.085794 19097 raft_consensus.cc:3060] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:35.087833 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:35.089759 19100 raft_consensus.cc:515] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:35.076521 16355 raft_consensus.cc:1240] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:35.080420 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:35.064563 16912 leader_election.cc:304] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
W20260709 13:06:35.124847 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 138195us
I20260709 13:06:35.118021 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:35.085893 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:35.126461 16943 raft_consensus.cc:2393] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 7: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
I20260709 13:06:35.126844 19185 raft_consensus.cc:493] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:35.113224 16940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:06:35.127535 19185 raft_consensus.cc:515] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:35.129671 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:35.129923 19185 leader_election.cc:290] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:35.130393 16949 raft_consensus.cc:2468] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 9.
I20260709 13:06:35.039949 18809 raft_consensus.cc:515] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:35.091149 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:35.132653 18809 leader_election.cc:290] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:35.101284 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:35.133993 16208 raft_consensus.cc:1240] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:35.072638 16942 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35106 (request call id 616) took 1369 ms. Trace:
I20260709 13:06:35.042117 18957 raft_consensus.cc:515] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:35.134763 16942 rpcz_store.cc:276] 0709 13:06:33.703068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:33.707746 (+  4678us) service_pool.cc:224] Handling call
0709 13:06:33.775314 (+ 67568us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:34.722850 (+947536us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:35.072352 (+349502us) spinlock_profiling.cc:243] Waited 882 ms on lock 0x7b54005f0ad4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f489e01 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6
0709 13:06:35.072564 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2028291840}
I20260709 13:06:35.136592 18957 leader_election.cc:290] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:35.060263 19052 raft_consensus.cc:740] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:06:35.138990 16940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:35.139510 19052 consensus_queue.cc:260] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:35.140925 19052 raft_consensus.cc:3060] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:35.034094 19179 consensus_queue.cc:1059] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 13:06:35.143036 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:35.143373 19179 raft_consensus.cc:3055] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:35.143759 19179 raft_consensus.cc:740] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:06:35.145007 16943 raft_consensus.cc:1275] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:06:35.144701 19179 consensus_queue.cc:260] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:06:35.102900 16249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:35.119477 18861 raft_consensus.cc:515] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:35.120858 19078 raft_consensus.cc:3055] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:35.148856 19078 raft_consensus.cc:740] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:06:35.149739 19078 consensus_queue.cc:260] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:06:35.096786 16248 connection.cc:256] RPC call timeout handler was delayed by -1.2247584840000627s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.193s for a response
I20260709 13:06:35.150782 19078 raft_consensus.cc:3060] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:06:35.150971 16248 connection.cc:256] RPC call timeout handler was delayed by -1.1994156069999917s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1582s for a response
W20260709 13:06:35.151367 16248 connection.cc:256] RPC call timeout handler was delayed by -1.1310156069999948s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1658s for a response
W20260709 13:06:35.151695 16248 connection.cc:256] RPC call timeout handler was delayed by -1.1050584839999829s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20630000000000004s for a response
I20260709 13:06:35.103482 19025 leader_election.cc:290] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:35.119849 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:35.120543 16352 raft_consensus.cc:1275] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:06:35.071290 19195 log.cc:927] Time spent T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:06:35.118822 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:35.113233 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:35.155536 16947 raft_consensus.cc:2393] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 9: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
W20260709 13:06:35.106076 19112 consensus_meta.cc:287] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f: Time spent flushing consensus metadata: real 0.603s	user 0.012s	sys 0.000s
I20260709 13:06:35.107748 19139 raft_consensus.cc:515] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:35.159204 19139 leader_election.cc:290] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:35.121419 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:35.114249 16357 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41830 (request call id 1711) took 1145 ms. Trace:
I20260709 13:06:35.161583 16357 rpcz_store.cc:276] 0709 13:06:33.968415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:34.483730 (+515315us) service_pool.cc:224] Handling call
0709 13:06:35.114057 (+630327us) spinlock_profiling.cc:243] Waited 529 ms on lock 0x7b5400194454. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:06:35.114188 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1215558016}
I20260709 13:06:35.162185 19185 raft_consensus.cc:493] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:35.104893 19194 leader_election.cc:290] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:35.128077 19037 raft_consensus.cc:2804] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:35.163563 19037 raft_consensus.cc:697] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [term 6 LEADER]: Becoming Leader. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:06:35.163007 19185 raft_consensus.cc:515] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:35.164533 19037 consensus_queue.cc:237] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:35.167804 18909 consensus_queue.cc:1048] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:35.168421 18810 consensus_queue.cc:1048] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:35.169160 19153 raft_consensus.cc:493] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:35.169701 19153 raft_consensus.cc:515] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:35.174217 16248 leader_election.cc:304] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:06:35.176750 18809 raft_consensus.cc:493] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:35.197342 16353 raft_consensus.cc:2468] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 9.
I20260709 13:06:35.197732 18809 raft_consensus.cc:515] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:35.196787 19179 raft_consensus.cc:3060] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:35.199965 18809 leader_election.cc:290] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:35.201220 18810 raft_consensus.cc:2804] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:35.201678 18810 raft_consensus.cc:493] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:35.208572 18810 raft_consensus.cc:3060] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:35.207134 18861 leader_election.cc:290] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:06:35.176828 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 55097us
I20260709 13:06:35.212709 19180 raft_consensus.cc:515] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:35.213651 16353 raft_consensus.cc:1275] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:06:35.123286 16354 raft_consensus.cc:1240] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:35.184175 16357 raft_consensus.cc:1275] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:06:35.189779 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:35.191541 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:35.215912 18957 consensus_queue.cc:1059] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:35.217025 19149 raft_consensus.cc:3055] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:35.215942 16352 raft_consensus.cc:2468] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 9.
I20260709 13:06:35.217798 19149 raft_consensus.cc:740] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:35.192878 19185 leader_election.cc:290] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:35.219033 19149 consensus_queue.cc:260] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:35.194993 19153 leader_election.cc:290] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:35.195991 19122 raft_consensus.cc:515] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:35.196748 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:06:35.232111 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 58004.8us
I20260709 13:06:35.233104 16248 leader_election.cc:304] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:35.234674 18909 raft_consensus.cc:2749] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:35.250710 16350 raft_consensus.cc:2468] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 5.
I20260709 13:06:35.251497 18809 raft_consensus.cc:493] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:35.253656 16204 raft_consensus.cc:1240] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:35.278750 18809 raft_consensus.cc:515] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:35.279345 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:35.256031 16202 raft_consensus.cc:1240] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:35.282883 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:35.283674 16204 raft_consensus.cc:2468] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 5.
I20260709 13:06:35.257071 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:06:35.257560 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 289429us
I20260709 13:06:35.257632 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:35.257699 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:35.288246 16914 leader_election.cc:304] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:35.289039 19152 raft_consensus.cc:493] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:35.289126 16320 leader_election.cc:304] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:35.289551 19152 raft_consensus.cc:515] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:35.290198 19201 raft_consensus.cc:2804] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:35.290719 19201 raft_consensus.cc:493] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:35.291087 19201 raft_consensus.cc:3060] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:35.292075 19152 leader_election.cc:290] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:35.292654 19152 raft_consensus.cc:493] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:35.293366 18850 raft_consensus.cc:493] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:35.293098 19152 raft_consensus.cc:515] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:35.262610 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:35.293882 18850 raft_consensus.cc:515] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:35.295598 19035 raft_consensus.cc:2749] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:06:35.296022 18850 leader_election.cc:290] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:35.276167 19092 raft_consensus.cc:493] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:35.256985 16201 raft_consensus.cc:1240] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:35.258980 16349 raft_consensus.cc:2410] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:06:35.299136 19092 raft_consensus.cc:515] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:35.280009 16200 raft_consensus.cc:2468] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 7.
I20260709 13:06:35.304481 19186 consensus_queue.cc:1059] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:35.305966 19186 raft_consensus.cc:3055] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:35.306447 19186 raft_consensus.cc:740] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:06:35.307523 19186 consensus_queue.cc:260] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:35.308866 19186 raft_consensus.cc:3060] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:35.304574 16320 leader_election.cc:304] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:35.298522 16199 raft_consensus.cc:2468] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 9.
I20260709 13:06:35.311563 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:35.322829 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:35.323040 16356 raft_consensus.cc:2468] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 9.
I20260709 13:06:35.324218 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:06:35.314427 16173 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.000s	sys 0.008s
W20260709 13:06:35.326068 16173 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.527s	user 0.000s	sys 0.008s
I20260709 13:06:35.326323 19122 leader_election.cc:290] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:06:35.326635 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 527540us
I20260709 13:06:35.328049 16173 leader_election.cc:304] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:35.329038 19175 raft_consensus.cc:2804] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:35.329602 19175 raft_consensus.cc:697] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:35.330856 19175 consensus_queue.cc:237] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:35.334089 18861 raft_consensus.cc:493] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:35.335856 18861 raft_consensus.cc:515] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:35.336077 18957 consensus_queue.cc:1048] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:06:35.337037 16249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:35.338071 19153 consensus_queue.cc:1048] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:35.339083 16320 leader_election.cc:304] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:35.316938 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:35.340620 19153 raft_consensus.cc:493] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:35.340847 16173 leader_election.cc:304] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:35.320076 19203 raft_consensus.cc:2804] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:35.341683 19203 raft_consensus.cc:493] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:35.342279 19203 raft_consensus.cc:3060] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:35.313071 16914 leader_election.cc:304] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:06:35.351755 19203 raft_consensus.cc:515] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:35.325467 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:35.371143 16356 raft_consensus.cc:2468] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 9.
I20260709 13:06:35.321666 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:06:35.321784 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 106073us
I20260709 13:06:35.315804 19092 leader_election.cc:290] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:35.341733 18984 raft_consensus.cc:2804] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:35.376901 18984 raft_consensus.cc:493] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:35.377460 18984 raft_consensus.cc:3060] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:35.328190 18809 leader_election.cc:290] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:35.319311 19100 leader_election.cc:290] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:35.311154 19152 leader_election.cc:290] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:35.317569 19180 leader_election.cc:290] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:35.341694 19122 raft_consensus.cc:2804] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:06:35.380470 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 67474.4us
I20260709 13:06:35.381027 19122 raft_consensus.cc:697] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 9 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:06:35.382609 19203 leader_election.cc:290] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:35.358049 19149 raft_consensus.cc:3060] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:35.313446 16322 leader_election.cc:304] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:06:35.396217 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 82842us
I20260709 13:06:35.397107 16322 leader_election.cc:304] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:35.362705 16351 raft_consensus.cc:2468] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 6.
I20260709 13:06:35.398465 16322 leader_election.cc:304] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:06:35.399303 19180 raft_consensus.cc:2749] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:06:35.315338 16174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:35.341190 19153 raft_consensus.cc:515] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:35.400007 19180 raft_consensus.cc:2749] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:35.401561 19153 leader_election.cc:290] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:06:35.366823 19146 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.771s	user 0.009s	sys 0.009s
I20260709 13:06:35.401880 16322 leader_election.cc:304] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:06:35.402206 19146 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.807s	user 0.009s	sys 0.009s
I20260709 13:06:35.402695 19180 raft_consensus.cc:2749] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:06:35.404172 16174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:35.404454 16322 leader_election.cc:304] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:35.382005 19122 consensus_queue.cc:237] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:35.356395 19035 raft_consensus.cc:2804] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:35.405222 19035 raft_consensus.cc:493] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:35.405609 19035 raft_consensus.cc:3060] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:35.408761 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:35.398411 18809 raft_consensus.cc:2749] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:35.384265 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:35.338299 18861 leader_election.cc:290] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:35.386752 19092 consensus_queue.cc:1048] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:35.338326 16248 leader_election.cc:304] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:06:35.414412 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 76176.8us
I20260709 13:06:35.418133 16248 leader_election.cc:304] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:35.398300 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:35.415046 18957 raft_consensus.cc:2749] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:35.309934 19201 raft_consensus.cc:515] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:35.421344 16278 raft_consensus.cc:1240] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 8. Current term is 9. Ops: [8.6-8.6]
W20260709 13:06:35.320856 19204 log.cc:927] Time spent T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 13:06:35.423548 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:35.423637 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:35.424329 16206 raft_consensus.cc:3060] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:06:35.425125 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:35.426381 16946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:35.423692 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:35.429061 18809 raft_consensus.cc:2749] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:35.429462 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:35.432004 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:35.433147 16206 raft_consensus.cc:2468] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 7.
I20260709 13:06:35.436208 16103 catalog_manager.cc:5697] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: term changed from 4 to 5, leader changed from 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) to 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66). New cstate: current_term: 5 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:06:35.437284 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:35.438439 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:35.439404 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:35.448962 16103 catalog_manager.cc:5697] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: term changed from 2 to 5, leader changed from 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) to e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65). New cstate: current_term: 5 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:06:35.450358 16320 leader_election.cc:304] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:35.441062 19201 leader_election.cc:290] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:35.441438 16200 raft_consensus.cc:1240] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:35.442266 19104 raft_consensus.cc:2749] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:35.443101 16203 raft_consensus.cc:1275] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:06:35.451460 19201 raft_consensus.cc:2804] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:35.452054 19201 raft_consensus.cc:697] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 7 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:06:35.452934 19201 consensus_queue.cc:237] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:35.443203 16248 leader_election.cc:304] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:35.457402 19104 raft_consensus.cc:2804] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:35.457834 19104 raft_consensus.cc:493] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:35.458221 19104 raft_consensus.cc:3060] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:35.462270 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:35.462615 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:35.463214 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:35.465188 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:35.465188 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:35.433202 19035 raft_consensus.cc:515] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:35.450536 16103 catalog_manager.cc:5697] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: term changed from 4 to 5, leader changed from 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) to e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65). New cstate: current_term: 5 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:06:35.470135 16103 catalog_manager.cc:5697] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: term changed from 4 to 6, leader changed from 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) to e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65). New cstate: current_term: 6 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:06:35.473112 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:35.472728 16103 catalog_manager.cc:5697] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: term changed from 2 to 5, leader changed from 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) to 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66). New cstate: current_term: 5 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:06:35.472759 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:06:35.445070 16173 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:35.444689 18810 raft_consensus.cc:515] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:35.476493 16278 raft_consensus.cc:2368] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for earlier term 9. Current term is 10.
I20260709 13:06:35.477747 19092 consensus_queue.cc:1048] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:35.479326 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:35.480753 16276 raft_consensus.cc:2393] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 in current term 10: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:06:35.481065 16173 leader_election.cc:304] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:35.481935 19194 consensus_queue.cc:1059] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:06:35.483830 16248 leader_election.cc:304] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:35.485603 16173 leader_election.cc:304] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:35.474323 16103 catalog_manager.cc:5697] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "1109f76a0b7b443a84c0327c8707bc63" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:06:35.490734 16174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:35.490831 16199 raft_consensus.cc:2468] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 7.
I20260709 13:06:35.489099 16103 catalog_manager.cc:5697] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: term changed from 3 to 4, leader changed from 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) to e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65). New cstate: current_term: 4 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:06:35.494351 16914 leader_election.cc:304] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:35.497913 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:06:35.498786 16947 raft_consensus.cc:2368] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for earlier term 9. Current term is 10.
I20260709 13:06:35.499562 16276 raft_consensus.cc:1275] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:06:35.503223 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:35.492751 16320 leader_election.cc:304] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:35.506385 16914 leader_election.cc:304] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:35.509380 16914 leader_election.cc:304] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:35.502005 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:35.511360 16276 raft_consensus.cc:2468] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 6.
I20260709 13:06:35.521399 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:35.523712 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:06:35.524683 16947 raft_consensus.cc:2393] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 7: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
I20260709 13:06:35.519857 16103 catalog_manager.cc:5697] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: term changed from 4 to 5, leader changed from 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) to 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68). New cstate: current_term: 5 leader_uuid: "1109f76a0b7b443a84c0327c8707bc63" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:06:35.534070 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 50340.6us
I20260709 13:06:35.532354 16322 leader_election.cc:304] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:06:35.535053 16248 leader_election.cc:304] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:35.531114 19180 raft_consensus.cc:493] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:35.525863 19203 raft_consensus.cc:493] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:35.517226 19173 raft_consensus.cc:2749] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:35.511621 19092 raft_consensus.cc:3055] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:35.505564 19175 raft_consensus.cc:2749] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:35.528126 19186 raft_consensus.cc:493] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:35.512351 19052 raft_consensus.cc:2749] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:35.512194 18850 raft_consensus.cc:2749] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:35.517190 19194 raft_consensus.cc:2749] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:06:35.531412 18909 consensus_queue.cc:1048] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 13:06:35.528910 19104 raft_consensus.cc:515] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:35.539320 16322 leader_election.cc:304] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:35.479360 18810 leader_election.cc:290] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 election: Requested vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:35.574257 16322 leader_election.cc:304] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:35.471741 19035 leader_election.cc:290] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 10 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:35.489549 18984 raft_consensus.cc:515] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:35.536757 18809 raft_consensus.cc:2804] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:35.540225 19149 consensus_queue.cc:1059] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 13:06:35.537832 19100 raft_consensus.cc:493] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:35.540210 19180 raft_consensus.cc:515] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:35.547674 19203 raft_consensus.cc:515] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:35.552248 19146 raft_consensus.cc:2804] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:35.533354 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:06:35.528632 19143 consensus_queue.cc:1048] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 13:06:35.541126 19132 raft_consensus.cc:2804] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:06:35.555233 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:35.540721 19179 raft_consensus.cc:2749] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:35.556479 19186 raft_consensus.cc:515] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:35.547685 19092 raft_consensus.cc:740] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:35.591696 19122 raft_consensus.cc:2749] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:06:35.576236 16106 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38830 (request call id 221) took 14041 ms (client timeout 15000 ms). Trace:
I20260709 13:06:35.580169 19076 raft_consensus.cc:2749] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:35.586115 19104 leader_election.cc:290] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:35.586758 18957 raft_consensus.cc:3055] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:35.621097 18957 raft_consensus.cc:740] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:35.621147 19092 consensus_queue.cc:260] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:35.592590 16322 leader_election.cc:304] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:35.575330 16206 raft_consensus.cc:1275] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:06:35.617969 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 82376.3us
W20260709 13:06:35.619861 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 84937.5us
I20260709 13:06:35.593575 18809 raft_consensus.cc:697] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 7 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:06:35.594916 19146 raft_consensus.cc:493] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:35.627519 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:35.629294 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:35.630213 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:35.630609 16277 raft_consensus.cc:1240] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:35.631649 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:35.627195 16248 leader_election.cc:304] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:35.628600 16322 leader_election.cc:400] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 election: Vote denied by peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823) with higher term. Message: Invalid argument: T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for earlier term 9. Current term is 10.
I20260709 13:06:35.632334 16322 leader_election.cc:403] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:06:35.633124 16283 raft_consensus.cc:2393] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 6: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:06:35.599385 19132 raft_consensus.cc:493] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:35.634001 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:35.634687 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c15d8e9be8414c84912ab77b66bfb1" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:35.635326 16276 raft_consensus.cc:2468] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 6.
I20260709 13:06:35.635401 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:35.636950 16322 leader_election.cc:304] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:35.633915 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:35.640672 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:35.638742 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:35.643877 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:35.593761 19100 raft_consensus.cc:515] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:35.642202 16357 raft_consensus.cc:2468] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 7.
I20260709 13:06:35.647544 19201 consensus_queue.cc:1048] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 13:06:35.641147 19122 raft_consensus.cc:2749] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:35.622211 18957 consensus_queue.cc:260] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:35.633986 18971 raft_consensus.cc:2749] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:35.631603 19146 raft_consensus.cc:3060] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:35.648226 19179 raft_consensus.cc:2749] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:35.645915 19076 raft_consensus.cc:3060] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:35.674378 16173 leader_election.cc:304] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:06:35.675877 19025 raft_consensus.cc:2749] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:35.678064 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:35.680265 16282 raft_consensus.cc:1275] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:06:35.680873 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:35.650696 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:35.649281 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:35.682240 16357 raft_consensus.cc:2393] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 in current term 6: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:06:35.651115 16914 leader_election.cc:304] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:35.681294 16351 raft_consensus.cc:2468] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 8.
I20260709 13:06:35.674255 16280 raft_consensus.cc:1240] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:35.652002 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:35.685209 16276 raft_consensus.cc:3060] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:35.685593 16173 leader_election.cc:304] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:06:35.651732 16322 leader_election.cc:304] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:06:35.680296 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:35.687322 16356 raft_consensus.cc:2468] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 7.
I20260709 13:06:35.651989 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:35.685680 16207 raft_consensus.cc:1275] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:06:35.693048 16248 leader_election.cc:304] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:35.694377 16248 leader_election.cc:304] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:35.687770 16173 leader_election.cc:304] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
W20260709 13:06:35.619078 16106 rpcz_store.cc:269] 0709 13:06:21.534515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:21.534803 (+   288us) service_pool.cc:224] Handling call
0709 13:06:35.576134 (+14041331us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:33.937945 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:34.347524 (+409579us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:34.349043 (+  1519us) write_op.cc:435] Acquired schema lock
0709 13:06:34.354340 (+  5297us) tablet.cc:662] Decoding operations
0709 13:06:34.559015 (+204675us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:34.559071 (+    56us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:34.559103 (+    32us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:06:34.559449 (+   346us) tablet.cc:701] Row locks acquired
0709 13:06:34.559469 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:06:34.559620 (+   151us) write_op.cc:270] Start()
0709 13:06:34.559725 (+   105us) write_op.cc:276] Timestamp: P: 1783602394559572 usec, L: 0
0709 13:06:34.559746 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:06:34.560447 (+   701us) log.cc:844] Serialized 1317 byte log entry
0709 13:06:34.820347 (+259900us) spinlock_profiling.cc:243] Waited 49 ms on lock 0x7b4400022b4c. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361c224db1 00007f361c2c2c85 00007f361c2c36a2 00007f361f0351db 00007f361f030aaf 00007f361c37f0ac 00007f36251d9ab9 00007f361c39b69b 00007f361c39993f 00007f361c39bc02 00007f361f02320b
0709 13:06:35.087305 (+266958us) spinlock_profiling.cc:243] Waited 5.09 ms on lock 0x7b4400022b4c. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361c224db1 00007f361c2c2c85 00007f361c2c36a2 00007f361f0351db 00007f361f030aaf 00007f361f02486e 00007f361f023bb6 00007f361f0237d8 00007f361f02d221 00007f361f02d1d9 00007f361f02d169
0709 13:06:35.284994 (+197689us) op_driver.cc:464] REPLICATION: finished
0709 13:06:35.335958 (+ 50964us) write_op.cc:301] APPLY: starting
0709 13:06:35.336041 (+    83us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:35.336175 (+   134us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:35.336195 (+    20us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:35.356751 (+ 20556us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:35.356980 (+   229us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 13:06:35.357026 (+    46us) write_op.cc:312] APPLY: finished
0709 13:06:35.357264 (+   238us) log.cc:844] Serialized 35 byte log entry
0709 13:06:35.358114 (+   850us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:35.358217 (+   103us) write_op.cc:454] Released schema lock
0709 13:06:35.358258 (+    41us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:35.358668 (+   410us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:35.358699 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":11881,"reported_tablets":48,"spinlock_wait_cycles":1721088,"child_traces":[["op",{"apply.queue_time_us":50699,"apply.run_cpu_time_us":1913,"apply.run_wall_time_us":22655,"num_ops":3,"prepare.queue_time_us":385338,"prepare.run_cpu_time_us":81563,"prepare.run_wall_time_us":1010137,"raft.queue_time_us":196027,"raft.run_cpu_time_us":2737,"raft.run_wall_time_us":68449,"replication_time_us":725100,"spinlock_wait_cycles":124532224,"thread_start_us":844304,"threads_started":4,"wal-append.queue_time_us":469764}]]}
I20260709 13:06:35.697894 19104 raft_consensus.cc:2749] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:06:35.659101 18809 consensus_queue.cc:237] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:35.699317 19143 raft_consensus.cc:2804] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:35.699782 19143 raft_consensus.cc:493] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:35.700115 19143 raft_consensus.cc:3060] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:06:35.652755 19223 log.cc:927] Time spent T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.076s	user 0.004s	sys 0.000s
I20260709 13:06:35.633308 16943 raft_consensus.cc:2393] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 9: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
I20260709 13:06:35.696628 18971 consensus_queue.cc:1048] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:35.697146 19025 raft_consensus.cc:2749] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:35.703917 16173 leader_election.cc:304] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
W20260709 13:06:35.715394 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 63737.5us
I20260709 13:06:35.717790 16322 leader_election.cc:304] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:06:35.717957 16914 leader_election.cc:304] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:06:35.637912 19132 raft_consensus.cc:3060] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:35.716177 16276 raft_consensus.cc:2468] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 7.
W20260709 13:06:35.656260 19218 log.cc:927] Time spent T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.078s	user 0.002s	sys 0.000s
I20260709 13:06:35.721866 16199 raft_consensus.cc:1240] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:35.710582 16281 raft_consensus.cc:2468] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 9.
I20260709 13:06:35.666285 19092 raft_consensus.cc:3060] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:35.663224 18957 raft_consensus.cc:3060] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:35.668705 19203 leader_election.cc:290] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:35.732309 16322 leader_election.cc:304] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:35.738291 16322 leader_election.cc:400] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 election: Vote denied by peer 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875) with higher term. Message: Invalid argument: T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for earlier term 9. Current term is 10.
I20260709 13:06:35.666527 19180 leader_election.cc:290] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:35.712003 19037 raft_consensus.cc:2749] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:06:35.747872 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c15d8e9be8414c84912ab77b66bfb1" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:35.748827 16348 raft_consensus.cc:2468] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 6.
I20260709 13:06:35.749763 16352 raft_consensus.cc:1240] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:35.744618 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:35.751049 16349 raft_consensus.cc:3060] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:35.746151 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:35.746438 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:35.754792 16355 raft_consensus.cc:3060] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:35.742501 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:35.758571 19221 consensus_queue.cc:1048] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:35.740346 18861 consensus_queue.cc:1059] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:06:35.716739 19085 raft_consensus.cc:2749] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:35.684859 19035 consensus_queue.cc:1048] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 13:06:35.712117 19149 consensus_queue.cc:1048] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 13:06:35.737123 18909 raft_consensus.cc:2749] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:35.754285 16353 raft_consensus.cc:2468] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 9.
I20260709 13:06:35.735530 16248 leader_election.cc:304] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:35.732105 19175 raft_consensus.cc:2749] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:35.742461 19052 raft_consensus.cc:2804] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:35.802515 19052 raft_consensus.cc:493] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:35.802982 19052 raft_consensus.cc:3060] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:06:35.804100 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 68706.5us
I20260709 13:06:35.743978 19189 raft_consensus.cc:2749] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:35.790079 16349 raft_consensus.cc:2468] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 9.
I20260709 13:06:35.748622 19186 leader_election.cc:290] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:06:35.791899 16246 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:35.793406 16355 raft_consensus.cc:2468] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 7.
I20260709 13:06:35.794333 16357 raft_consensus.cc:1275] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:06:35.725554 19191 consensus_queue.cc:1048] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 13:06:35.798183 16354 raft_consensus.cc:1240] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:35.739871 19206 raft_consensus.cc:2749] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:35.814857 15057 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:35.818040 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:35.740089 19104 consensus_queue.cc:1048] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.066s
I20260709 13:06:35.821565 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:35.826128 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:35.839413 16946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:35.839483 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:35.797426 19100 leader_election.cc:290] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:35.840446 16946 raft_consensus.cc:2468] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 8.
I20260709 13:06:35.848642 16322 leader_election.cc:304] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:35.816927 19222 raft_consensus.cc:2804] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:35.853039 16322 leader_election.cc:304] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:35.859483 16322 leader_election.cc:304] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:06:35.872529 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:35.873728 19191 raft_consensus.cc:2749] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:35.881912 19222 raft_consensus.cc:697] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:35.883271 19222 consensus_queue.cc:237] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:35.854411 18984 leader_election.cc:290] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:35.896466 19185 raft_consensus.cc:493] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:35.897091 19185 raft_consensus.cc:515] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:35.907181 16206 raft_consensus.cc:1275] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:06:35.912261 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 126524us
W20260709 13:06:35.913784 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 138792us
I20260709 13:06:35.907691 19100 raft_consensus.cc:2749] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:35.889773 18809 raft_consensus.cc:2804] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:35.934651 18809 raft_consensus.cc:493] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:35.948084 18809 raft_consensus.cc:3060] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:06:35.948994 19235 log.cc:927] Time spent T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.119s	user 0.000s	sys 0.007s
I20260709 13:06:35.947296 19185 leader_election.cc:290] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:06:35.955567 19226 log.cc:927] Time spent T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.159s	user 0.001s	sys 0.000s
I20260709 13:06:35.926584 19189 consensus_queue.cc:1048] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
W20260709 13:06:35.977713 19228 log.cc:927] Time spent T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.141s	user 0.002s	sys 0.000s
I20260709 13:06:35.974771 19146 raft_consensus.cc:515] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:35.983794 19076 raft_consensus.cc:2749] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823) with higher term. Message: Invalid argument: T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for earlier term 9. Current term is 10.
I20260709 13:06:35.984797 19146 leader_election.cc:290] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:35.989542 19132 raft_consensus.cc:515] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:35.989379 19143 raft_consensus.cc:515] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:06:35.995955 19231 log.cc:927] Time spent T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.164s	user 0.004s	sys 0.000s
W20260709 13:06:36.041266 16174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:36.045452 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:06:36.050794 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 122576us
I20260709 13:06:36.072912 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:36.075206 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:36.083357 16278 raft_consensus.cc:1240] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:36.085517 16279 raft_consensus.cc:1240] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:36.093649 19143 leader_election.cc:290] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:36.095417 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:36.108034 19052 raft_consensus.cc:515] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:36.119334 16943 raft_consensus.cc:2393] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 8: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
I20260709 13:06:36.128007 19194 raft_consensus.cc:493] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:36.129340 19194 raft_consensus.cc:515] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:36.131119 16283 raft_consensus.cc:1275] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:06:36.133795 19194 leader_election.cc:290] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:36.136801 16947 raft_consensus.cc:1275] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:06:35.993204 19132 leader_election.cc:290] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:36.141477 16322 leader_election.cc:304] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:06:36.142125 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 336953us
I20260709 13:06:36.143890 16248 leader_election.cc:304] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:36.148206 19052 leader_election.cc:290] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 8 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:36.147887 19132 raft_consensus.cc:2804] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:06:36.150141 19132 raft_consensus.cc:697] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:36.158751 19143 raft_consensus.cc:493] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:36.159749 19143 raft_consensus.cc:515] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:36.160568 16200 raft_consensus.cc:1275] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:06:36.162900 19143 leader_election.cc:290] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:36.176434 19186 raft_consensus.cc:2749] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:36.184566 19122 consensus_queue.cc:1048] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:06:36.195001 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 112531us
I20260709 13:06:36.082300 16277 raft_consensus.cc:2468] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 7.
W20260709 13:06:36.208808 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 65246.6us
I20260709 13:06:36.209095 19132 consensus_queue.cc:237] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:36.202741 19186 consensus_queue.cc:1048] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 13:06:36.213963 19220 raft_consensus.cc:3055] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:36.214679 19220 raft_consensus.cc:740] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:06:36.216024 19220 consensus_queue.cc:260] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:36.218022 19220 raft_consensus.cc:3060] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:36.229449 16207 raft_consensus.cc:1275] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:06:36.232738 16946 raft_consensus.cc:1275] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:06:36.235783 16914 leader_election.cc:304] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:06:36.235980 16322 leader_election.cc:304] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:06:36.235821 19185 consensus_queue.cc:1048] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:06:36.239099 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:06:36.243181 19157 raft_consensus.cc:2804] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:36.243794 19157 raft_consensus.cc:493] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:36.244226 19157 raft_consensus.cc:3060] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:06:36.251048 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 47955.8us
I20260709 13:06:36.253258 19186 raft_consensus.cc:3060] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:36.254105 16914 leader_election.cc:304] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:36.255386 19035 raft_consensus.cc:3060] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:36.258926 19185 consensus_queue.cc:1048] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:36.260206 19243 consensus_queue.cc:1048] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:36.274839 16248 leader_election.cc:304] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:36.276063 19104 raft_consensus.cc:2749] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:36.278683 16248 leader_election.cc:304] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:06:36.286643 16350 raft_consensus.cc:2468] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 10.
I20260709 13:06:36.288267 19143 consensus_queue.cc:1059] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:36.289718 16173 leader_election.cc:304] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
W20260709 13:06:36.291193 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 55416us
I20260709 13:06:36.309851 19139 raft_consensus.cc:3055] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:36.310582 19139 raft_consensus.cc:740] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:36.315130 19139 consensus_queue.cc:260] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:36.326882 19139 raft_consensus.cc:3060] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:36.335434 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c15d8e9be8414c84912ab77b66bfb1" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:36.336359 16351 raft_consensus.cc:3060] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:36.336701 19035 raft_consensus.cc:2749] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:36.311403 19185 consensus_queue.cc:1048] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:06:36.338800 16356 raft_consensus.cc:1275] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:06:36.340360 18809 raft_consensus.cc:515] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:36.341051 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:36.341959 16348 raft_consensus.cc:2468] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 9.
I20260709 13:06:36.342622 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:36.336400 19157 raft_consensus.cc:515] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:36.343513 16352 raft_consensus.cc:2468] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 7.
W20260709 13:06:36.345543 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 56169us
I20260709 13:06:36.347159 16173 leader_election.cc:304] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:06:36.348047 18809 leader_election.cc:290] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:36.349094 16173 leader_election.cc:304] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:36.349108 19025 raft_consensus.cc:2804] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:36.350234 19025 raft_consensus.cc:493] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:36.352572 19025 raft_consensus.cc:3060] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:36.351675 19092 consensus_queue.cc:1048] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:36.350958 18984 raft_consensus.cc:2804] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:06:36.355535 18984 raft_consensus.cc:697] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 9 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:36.356961 18984 consensus_queue.cc:237] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:06:36.360266 16174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:36.363164 19207 raft_consensus.cc:493] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:36.363960 19207 raft_consensus.cc:515] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:36.366792 18809 raft_consensus.cc:493] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:36.367172 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:36.371105 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:36.373565 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:36.378185 19207 leader_election.cc:290] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:36.379067 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c15d8e9be8414c84912ab77b66bfb1" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:36.381579 16282 raft_consensus.cc:1275] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:06:36.345472 18909 raft_consensus.cc:2804] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:36.388804 18909 raft_consensus.cc:697] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:36.390146 18909 consensus_queue.cc:237] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:36.367805 18809 raft_consensus.cc:515] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:36.405958 16943 raft_consensus.cc:2468] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 5.
I20260709 13:06:36.410809 16351 raft_consensus.cc:2468] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 7.
I20260709 13:06:36.404933 19143 raft_consensus.cc:2749] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:06:36.431123 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 80586us
W20260709 13:06:36.404160 19242 log.cc:927] Time spent T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.074s	user 0.000s	sys 0.002s
I20260709 13:06:36.442410 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:36.424229 19157 leader_election.cc:290] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 9 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:36.457444 16173 leader_election.cc:304] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
W20260709 13:06:36.469760 19245 log.cc:927] Time spent T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.150s	user 0.000s	sys 0.001s
W20260709 13:06:36.468369 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 189926us
W20260709 13:06:36.474763 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 46638.5us
I20260709 13:06:36.477866 16248 leader_election.cc:304] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:36.461187 19185 raft_consensus.cc:493] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:36.481014 19186 raft_consensus.cc:2749] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:36.481657 19185 raft_consensus.cc:515] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:36.482987 19104 raft_consensus.cc:493] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:36.483767 19104 raft_consensus.cc:515] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:36.484423 19185 leader_election.cc:290] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:36.479600 19132 raft_consensus.cc:2749] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:06:36.486696 19139 raft_consensus.cc:2804] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:36.503224 18809 leader_election.cc:290] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:36.507956 16173 leader_election.cc:304] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:36.509370 16173 leader_election.cc:304] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:36.514232 16248 leader_election.cc:304] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:36.521716 16173 leader_election.cc:304] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:36.529968 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:06:36.531116 16943 raft_consensus.cc:2393] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 9: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
I20260709 13:06:36.486490 19104 leader_election.cc:290] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:36.524703 19052 raft_consensus.cc:493] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:36.537894 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:36.540079 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:36.542697 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:36.543506 16351 raft_consensus.cc:1275] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:06:36.545408 18809 raft_consensus.cc:493] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:36.546151 18809 raft_consensus.cc:515] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:36.534957 19025 raft_consensus.cc:515] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:06:36.547817 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 51168.1us
I20260709 13:06:36.548550 19025 leader_election.cc:290] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:06:36.549810 19246 log.cc:927] Time spent T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.092s	user 0.004s	sys 0.000s
I20260709 13:06:36.551518 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:36.552372 16278 raft_consensus.cc:2468] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 8.
I20260709 13:06:36.519212 19143 raft_consensus.cc:2804] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:36.518982 19207 raft_consensus.cc:2804] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:36.487232 16102 catalog_manager.cc:5697] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 5 to 8, leader changed from 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) to 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66). New cstate: current_term: 8 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:36.581422 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 66407.1us
I20260709 13:06:36.548455 18809 leader_election.cc:290] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:36.592415 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:36.593328 16351 raft_consensus.cc:2393] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 in current term 9: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:06:36.580364 19207 raft_consensus.cc:493] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:36.525421 19092 consensus_queue.cc:1048] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.069s
I20260709 13:06:36.571451 19143 raft_consensus.cc:493] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:36.575416 19132 raft_consensus.cc:2749] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:36.537969 19052 raft_consensus.cc:515] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:36.604048 16914 leader_election.cc:304] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:06:36.604553 19207 raft_consensus.cc:3060] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:36.609616 19143 raft_consensus.cc:3060] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:36.627403 19043 raft_consensus.cc:2804] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:36.628091 19043 raft_consensus.cc:697] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 10 LEADER]: Becoming Leader. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:06:36.629321 19043 consensus_queue.cc:237] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:06:36.623301 19253 log.cc:927] Time spent T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63: Append to log took a long time: real 0.104s	user 0.001s	sys 0.001s
I20260709 13:06:36.624166 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:36.625618 19152 consensus_queue.cc:1048] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:36.615056 19025 raft_consensus.cc:2804] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:36.605768 18809 raft_consensus.cc:493] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:36.650687 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 170865us
I20260709 13:06:36.656801 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:36.644276 16949 raft_consensus.cc:2468] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 3.
W20260709 13:06:36.657632 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 77351.1us
I20260709 13:06:36.659998 16322 leader_election.cc:304] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:36.616608 19139 raft_consensus.cc:697] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 7 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
W20260709 13:06:36.661790 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 54620.6us
I20260709 13:06:36.637666 16352 raft_consensus.cc:2468] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 8.
I20260709 13:06:36.680152 19194 consensus_queue.cc:1048] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:36.680449 19025 raft_consensus.cc:697] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:36.670141 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:36.672029 16322 leader_election.cc:304] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:06:36.707537 19052 leader_election.cc:290] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:36.699368 16201 raft_consensus.cc:2468] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 7.
W20260709 13:06:36.720769 16912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:36.735294 19100 raft_consensus.cc:2749] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:36.740599 19259 raft_consensus.cc:493] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:36.740921 19257 consensus_queue.cc:1059] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.127s
I20260709 13:06:36.741348 19259 raft_consensus.cc:515] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:36.742501 19194 consensus_queue.cc:1059] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.013s
W20260709 13:06:36.744248 19247 log.cc:927] Time spent T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.131s	user 0.000s	sys 0.000s
I20260709 13:06:36.756755 19194 consensus_queue.cc:1059] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:36.757876 19194 consensus_queue.cc:1048] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:36.749858 19092 raft_consensus.cc:3055] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:36.759055 19092 raft_consensus.cc:740] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:36.760000 19092 consensus_queue.cc:260] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:36.754523 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:36.752064 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:36.746527 19203 raft_consensus.cc:2804] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:36.764719 19203 raft_consensus.cc:493] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:36.735824 19139 consensus_queue.cc:237] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:36.765273 19203 raft_consensus.cc:3060] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:06:36.767887 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 95943.2us
I20260709 13:06:36.738404 16248 leader_election.cc:304] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:36.709147 19025 consensus_queue.cc:237] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:36.728159 18984 raft_consensus.cc:493] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:36.794319 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:36.797128 16283 raft_consensus.cc:2393] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 8: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:06:36.751426 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:36.799088 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:36.727172 18809 raft_consensus.cc:515] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:36.803275 16173 leader_election.cc:304] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:06:36.758389 19259 leader_election.cc:290] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:36.791906 19092 raft_consensus.cc:3060] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:06:36.817123 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 101420us
I20260709 13:06:36.805672 18810 raft_consensus.cc:2749] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:06:36.813674 19259 raft_consensus.cc:493] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:36.827167 19259 raft_consensus.cc:515] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:36.829668 19259 leader_election.cc:290] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:36.830950 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:36.831707 16274 raft_consensus.cc:2468] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 6.
I20260709 13:06:36.833917 16103 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55244 (request call id 123) took 10359 ms. Trace:
I20260709 13:06:36.857559 16102 catalog_manager.cc:5697] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 3 to 7, leader changed from e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) to 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66). New cstate: current_term: 7 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:36.893573 19256 log.cc:927] Time spent T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63: Append to log took a long time: real 0.136s	user 0.000s	sys 0.001s
I20260709 13:06:36.894122 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:36.895946 19269 raft_consensus.cc:3055] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:36.896517 19269 raft_consensus.cc:740] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:36.896916 16248 leader_election.cc:304] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:36.897516 19269 consensus_queue.cc:260] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:36.898002 18971 consensus_queue.cc:1048] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:36.898608 19263 raft_consensus.cc:3055] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:36.899966 19132 raft_consensus.cc:2749] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:36.878257 18984 raft_consensus.cc:515] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:36.878625 19259 raft_consensus.cc:2804] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:36.881981 16102 catalog_manager.cc:5697] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "1109f76a0b7b443a84c0327c8707bc63" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:06:36.937777 16201 raft_consensus.cc:1240] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:36.944897 16102 catalog_manager.cc:5697] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:36.946847 16102 catalog_manager.cc:5697] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 6 to 7, leader changed from 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) to e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65). New cstate: current_term: 7 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } }
I20260709 13:06:36.948475 16102 catalog_manager.cc:5697] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 4 to 7. New cstate: current_term: 7 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:36.945607 19251 log.cc:927] Time spent T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.434s	user 0.003s	sys 0.000s
W20260709 13:06:36.952514 18909 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.011s	sys 0.005s
W20260709 13:06:36.953096 18909 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.011s	sys 0.005s
I20260709 13:06:36.957336 19259 raft_consensus.cc:697] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:36.940025 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:36.915222 19263 raft_consensus.cc:740] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:36.968888 19269 raft_consensus.cc:3060] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:36.979328 18809 leader_election.cc:290] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:36.947598 19203 raft_consensus.cc:515] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:36.967926 16102 catalog_manager.cc:5697] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } }
W20260709 13:06:37.039450 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 141064us
I20260709 13:06:36.918481 19143 raft_consensus.cc:515] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:37.035006 16947 raft_consensus.cc:2468] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 6.
I20260709 13:06:37.057843 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:37.058022 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:37.059060 16351 raft_consensus.cc:2368] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for earlier term 8. Current term is 9.
I20260709 13:06:37.056545 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:37.069633 16356 raft_consensus.cc:3060] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:37.063622 16102 catalog_manager.cc:5697] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 4 to 6, leader changed from e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) to 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66). New cstate: current_term: 6 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:37.077157 16173 leader_election.cc:304] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:37.056641 18809 raft_consensus.cc:493] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:37.091943 19268 raft_consensus.cc:493] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:37.092767 19268 raft_consensus.cc:515] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:37.094043 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:37.096009 19261 raft_consensus.cc:2804] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:37.096422 16357 raft_consensus.cc:2468] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 7.
I20260709 13:06:37.096582 19261 raft_consensus.cc:493] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:37.094722 19049 raft_consensus.cc:493] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:37.097041 19261 raft_consensus.cc:3060] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:37.097522 19049 raft_consensus.cc:515] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:37.095340 19180 raft_consensus.cc:493] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:37.099040 19180 raft_consensus.cc:515] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:37.100095 19049 leader_election.cc:290] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:37.082563 19085 raft_consensus.cc:493] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:37.101450 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:37.101907 19085 raft_consensus.cc:515] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:37.102313 16354 raft_consensus.cc:2468] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 3.
I20260709 13:06:37.095674 16349 raft_consensus.cc:1275] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:06:37.086485 18810 consensus_queue.cc:1048] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:06:37.094100 16322 leader_election.cc:304] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:06:37.055473 19207 raft_consensus.cc:515] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:37.116272 16102 catalog_manager.cc:5697] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:37.125460 19203 leader_election.cc:290] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:06:37.126004 19278 log.cc:927] Time spent T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
W20260709 13:06:37.127259 19267 log.cc:927] Time spent T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63: Append to log took a long time: real 0.187s	user 0.003s	sys 0.000s
I20260709 13:06:37.127821 19275 raft_consensus.cc:493] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:37.128535 19085 leader_election.cc:290] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:37.128398 19275 raft_consensus.cc:515] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:06:37.130259 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 362618us
I20260709 13:06:37.133625 16322 leader_election.cc:304] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:06:37.144938 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:36.838064 16103 rpcz_store.cc:276] 0709 13:06:26.474769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:26.475085 (+   316us) service_pool.cc:224] Handling call
0709 13:06:36.833702 (+10358617us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:35.696535 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:35.697130 (+   595us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:35.697170 (+    40us) write_op.cc:435] Acquired schema lock
0709 13:06:35.697198 (+    28us) tablet.cc:662] Decoding operations
0709 13:06:35.731327 (+ 34129us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:35.739362 (+  8035us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:35.748738 (+  9376us) tablet.cc:685] Acquiring locks for 8 operations
0709 13:06:35.905123 (+156385us) tablet.cc:701] Row locks acquired
0709 13:06:35.905154 (+    31us) write_op.cc:260] PREPARE: finished
0709 13:06:35.905377 (+   223us) write_op.cc:270] Start()
0709 13:06:35.905557 (+   180us) write_op.cc:276] Timestamp: P: 1783602395905316 usec, L: 0
0709 13:06:35.905590 (+    33us) op_driver.cc:348] REPLICATION: starting
0709 13:06:35.958732 (+ 53142us) log.cc:844] Serialized 3218 byte log entry
0709 13:06:35.999055 (+ 40323us) op_driver.cc:464] REPLICATION: finished
0709 13:06:36.000657 (+  1602us) write_op.cc:301] APPLY: starting
0709 13:06:36.191442 (+190785us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:36.191791 (+   349us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:36.191973 (+   182us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:36.223781 (+ 31808us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:36.224308 (+   527us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0709 13:06:36.224388 (+    80us) write_op.cc:312] APPLY: finished
0709 13:06:36.224937 (+   549us) log.cc:844] Serialized 65 byte log entry
0709 13:06:36.225243 (+   306us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:36.225657 (+   414us) write_op.cc:454] Released schema lock
0709 13:06:36.225742 (+    85us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:36.240451 (+ 14709us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:36.240489 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":88217,"reported_tablets":17,"child_traces":[["op",{"apply.queue_time_us":1267,"apply.run_cpu_time_us":5968,"apply.run_wall_time_us":239739,"num_ops":8,"prepare.queue_time_us":127420,"prepare.run_cpu_time_us":6108,"prepare.run_wall_time_us":262690,"replication_time_us":93228,"spinlock_wait_cycles":1920,"thread_start_us":63627,"threads_started":2}]]}
I20260709 13:06:37.148561 16248 leader_election.cc:304] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:37.160249 19268 leader_election.cc:290] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:37.053689 19263 consensus_queue.cc:260] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:06:37.167976 19254 log.cc:927] Time spent T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.348s	user 0.002s	sys 0.004s
I20260709 13:06:37.154191 16914 leader_election.cc:304] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:06:37.172072 16206 raft_consensus.cc:2468] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 9.
I20260709 13:06:37.173787 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:37.174259 16356 raft_consensus.cc:2468] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 10.
I20260709 13:06:37.105919 18809 raft_consensus.cc:515] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:37.136533 19092 raft_consensus.cc:493] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:37.170805 16102 catalog_manager.cc:5697] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:37.101500 19180 leader_election.cc:290] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:37.174113 18810 raft_consensus.cc:2804] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:06:37.219681 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 43574.7us
I20260709 13:06:37.168025 19263 raft_consensus.cc:3060] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:37.220570 16102 catalog_manager.cc:5697] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 2 to 8, leader changed from 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) to 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66). New cstate: current_term: 8 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:37.223788 16914 leader_election.cc:304] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
W20260709 13:06:37.226027 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 121341us
I20260709 13:06:37.106706 19259 consensus_queue.cc:237] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:37.223866 19203 raft_consensus.cc:2804] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:37.213089 18810 raft_consensus.cc:493] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:37.270877 19281 raft_consensus.cc:493] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:37.271750 19281 raft_consensus.cc:515] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:37.274164 19281 leader_election.cc:290] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:37.274681 19206 raft_consensus.cc:2749] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:06:37.267750 18810 raft_consensus.cc:3060] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:37.277758 19268 raft_consensus.cc:493] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:37.278362 19268 raft_consensus.cc:515] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:37.219980 19092 raft_consensus.cc:515] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:37.281286 19132 raft_consensus.cc:493] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:37.281996 19132 raft_consensus.cc:515] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:37.282876 19092 leader_election.cc:290] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:37.278700 19282 raft_consensus.cc:2804] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:06:37.289486 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 62820.2us
I20260709 13:06:37.290274 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:37.313795 16203 raft_consensus.cc:3060] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:06:37.263235 19203 raft_consensus.cc:493] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:37.296396 16947 raft_consensus.cc:1240] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 8. Current term is 9. Ops: [6.7-8.8]
I20260709 13:06:37.292747 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:06:37.288797 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 118984us
I20260709 13:06:37.280783 19268 leader_election.cc:290] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:37.284286 18984 leader_election.cc:290] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:06:37.338632 16174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:37.335035 16102 catalog_manager.cc:5697] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 4 to 5, leader changed from 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) to 363bb2f744eb486f9ad726f08214c98e (127.14.180.67). New cstate: current_term: 5 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } }
I20260709 13:06:37.312435 19282 raft_consensus.cc:697] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [term 8 LEADER]: Becoming Leader. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:06:37.325065 19203 raft_consensus.cc:3060] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:37.314677 19143 leader_election.cc:290] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:06:37.373854 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 60048.2us
I20260709 13:06:37.371261 16102 catalog_manager.cc:5697] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 2 to 7, leader changed from e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) to 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66). New cstate: current_term: 7 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:37.381181 16914 leader_election.cc:304] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:06:37.420673 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:37.424537 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:37.425367 16947 raft_consensus.cc:2468] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 6.
I20260709 13:06:37.425503 16173 leader_election.cc:400] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 pre-election: Vote denied by peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107) with higher term. Message: Invalid argument: T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for earlier term 8. Current term is 9.
I20260709 13:06:37.428189 16173 leader_election.cc:403] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:06:37.428944 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 59004.1us
I20260709 13:06:37.426328 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:37.431819 16276 raft_consensus.cc:2468] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 8.
I20260709 13:06:37.438441 16173 leader_election.cc:304] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:37.440855 16173 leader_election.cc:304] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:06:37.441819 19279 raft_consensus.cc:2804] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:37.442127 19257 consensus_queue.cc:1048] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:37.442909 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:37.443921 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:06:37.445677 19286 log.cc:927] Time spent T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 13:06:37.447033 19296 raft_consensus.cc:493] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:37.447707 19296 raft_consensus.cc:515] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:37.451947 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:37.457259 19288 raft_consensus.cc:2804] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:06:37.457809 19288 raft_consensus.cc:493] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:37.458158 19288 raft_consensus.cc:3060] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:37.425704 16102 catalog_manager.cc:5697] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 3 to 6, leader changed from 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) to 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68). New cstate: current_term: 6 leader_uuid: "1109f76a0b7b443a84c0327c8707bc63" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:06:37.464718 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:37.393224 19243 raft_consensus.cc:493] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:37.427841 19207 leader_election.cc:290] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:37.471993 16102 catalog_manager.cc:5697] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:37.466363 19290 raft_consensus.cc:493] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:37.514078 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:37.485980 19085 raft_consensus.cc:493] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:37.499373 18809 leader_election.cc:290] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:37.489112 16102 catalog_manager.cc:5697] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 6 to 8, leader changed from 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) to 363bb2f744eb486f9ad726f08214c98e (127.14.180.67). New cstate: current_term: 8 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } }
I20260709 13:06:37.476876 18810 raft_consensus.cc:515] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:37.513564 18861 raft_consensus.cc:2749] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:06:37.545784 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:37.546630 19260 raft_consensus.cc:2804] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:37.547108 19260 raft_consensus.cc:493] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:37.547492 19260 raft_consensus.cc:3060] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:37.569901 16173 leader_election.cc:304] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
W20260709 13:06:37.527664 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 97699.1us
I20260709 13:06:37.485534 19293 raft_consensus.cc:493] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:37.482861 19268 raft_consensus.cc:493] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:37.479393 19243 raft_consensus.cc:515] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:37.499362 19296 leader_election.cc:290] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:37.538792 19206 raft_consensus.cc:493] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:37.597186 16102 catalog_manager.cc:5697] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:37.599900 16940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:37.601432 19295 raft_consensus.cc:493] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:37.601002 16102 catalog_manager.cc:5697] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:37.591048 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 166096us
I20260709 13:06:37.520220 19290 raft_consensus.cc:515] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:37.540782 19085 raft_consensus.cc:515] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:37.596835 19269 raft_consensus.cc:2804] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:37.622229 16102 catalog_manager.cc:5697] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 5 to 7, leader changed from 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) to 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68). New cstate: current_term: 7 leader_uuid: "1109f76a0b7b443a84c0327c8707bc63" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:06:37.592438 19279 raft_consensus.cc:697] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 10 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:37.571301 18809 raft_consensus.cc:493] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:37.514256 19282 consensus_queue.cc:237] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:37.625428 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:37.628583 16356 raft_consensus.cc:1275] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:06:37.628391 16102 catalog_manager.cc:5697] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:37.628683 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:37.633630 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:37.612397 19132 leader_election.cc:290] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:37.626250 19269 raft_consensus.cc:493] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:37.635891 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:37.636236 16349 raft_consensus.cc:1240] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 8. Current term is 9. Ops: [6.7-8.8]
I20260709 13:06:37.636940 16354 raft_consensus.cc:2393] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 10: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
I20260709 13:06:37.637598 19243 leader_election.cc:290] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:37.639621 19290 leader_election.cc:290] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:37.642321 18810 leader_election.cc:290] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:37.642980 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:37.643507 19288 raft_consensus.cc:515] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:37.644192 16203 raft_consensus.cc:2468] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 9.
I20260709 13:06:37.602089 19295 raft_consensus.cc:515] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:37.650425 16356 raft_consensus.cc:1275] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:06:37.658174 18809 raft_consensus.cc:515] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:37.660562 19295 leader_election.cc:290] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:06:37.667110 19297 log.cc:927] Time spent T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.121s	user 0.000s	sys 0.001s
I20260709 13:06:37.667986 19085 leader_election.cc:290] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:37.649559 19269 raft_consensus.cc:3060] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:37.670854 16348 raft_consensus.cc:2468] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 7.
I20260709 13:06:37.625638 19293 raft_consensus.cc:515] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:37.674962 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:37.609525 19206 raft_consensus.cc:515] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:06:37.676802 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 98910.3us
I20260709 13:06:37.677397 19293 leader_election.cc:290] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:37.678740 19206 leader_election.cc:290] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:37.680485 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:06:37.656155 19143 raft_consensus.cc:2749] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107) with higher term. Message: Invalid argument: T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for earlier term 8. Current term is 9.
I20260709 13:06:37.634435 19268 raft_consensus.cc:515] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:37.684296 15057 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:37.650599 16102 catalog_manager.cc:5697] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 1 to 6, leader changed from e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) to 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68). New cstate: current_term: 6 leader_uuid: "1109f76a0b7b443a84c0327c8707bc63" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:06:37.688709 16102 catalog_manager.cc:5697] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 4 to 7, leader changed from e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) to 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66). New cstate: current_term: 7 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:37.691565 16102 catalog_manager.cc:5697] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 4 to 5, leader changed from 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) to 363bb2f744eb486f9ad726f08214c98e (127.14.180.67). New cstate: current_term: 5 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } }
I20260709 13:06:37.660615 18809 leader_election.cc:290] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:37.695072 19279 consensus_queue.cc:237] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:37.698941 19203 raft_consensus.cc:515] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:06:37.700383 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 55051.1us
I20260709 13:06:37.714649 16320 leader_election.cc:304] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:37.712765 19288 leader_election.cc:290] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 4 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:37.737605 16320 leader_election.cc:304] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:37.728134 19085 raft_consensus.cc:2804] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:37.753183 16946 raft_consensus.cc:1240] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [term 8 LEADER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:06:37.758994 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:37.738624 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:37.754392 19085 raft_consensus.cc:493] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:37.765930 19268 leader_election.cc:290] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:37.765972 19085 raft_consensus.cc:3060] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:37.771090 19269 raft_consensus.cc:515] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:37.755293 19304 raft_consensus.cc:2804] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:06:37.774312 19304 raft_consensus.cc:697] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 9 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:06:37.775586 19269 leader_election.cc:290] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 election: Requested vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:37.775444 19304 consensus_queue.cc:237] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:37.773507 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:37.779213 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:37.780333 19085 raft_consensus.cc:515] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:37.779309 16205 raft_consensus.cc:2468] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 9.
I20260709 13:06:37.782673 19085 leader_election.cc:290] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 10 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:37.790686 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:37.795823 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:37.791790 16199 raft_consensus.cc:2468] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 6.
I20260709 13:06:37.796938 16208 raft_consensus.cc:3060] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:37.804677 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:37.802129 16320 leader_election.cc:304] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:37.810070 19085 raft_consensus.cc:2804] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:37.810122 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:06:37.811028 16942 raft_consensus.cc:3060] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:37.801117 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:37.820153 16200 raft_consensus.cc:2393] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 7: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:06:37.815902 19085 raft_consensus.cc:493] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:37.823604 19261 consensus_meta.cc:287] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f: Time spent flushing consensus metadata: real 0.726s	user 0.014s	sys 0.000s
I20260709 13:06:37.841223 19085 raft_consensus.cc:3060] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:06:37.867609 19263 consensus_meta.cc:287] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f: Time spent flushing consensus metadata: real 0.626s	user 0.005s	sys 0.007s
I20260709 13:06:37.870289 16942 raft_consensus.cc:2468] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 7.
I20260709 13:06:37.872546 19260 raft_consensus.cc:515] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:37.843256 19261 raft_consensus.cc:515] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:37.855744 19203 leader_election.cc:290] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:37.879670 19085 raft_consensus.cc:515] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:37.881453 16208 raft_consensus.cc:2468] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 10.
I20260709 13:06:37.881916 16173 leader_election.cc:304] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:37.886648 19194 raft_consensus.cc:2804] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:37.887245 19194 raft_consensus.cc:697] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:37.888195 19194 consensus_queue.cc:237] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:37.896396 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:37.899299 16279 raft_consensus.cc:3060] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:37.899623 19261 leader_election.cc:290] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:37.899405 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:37.903054 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:06:37.905333 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:37.908082 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:37.910508 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:37.904316 16942 raft_consensus.cc:3060] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:37.911494 16208 raft_consensus.cc:2393] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 in current term 7: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:06:37.915055 19275 leader_election.cc:290] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:06:37.918375 19285 log.cc:927] Time spent T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.628s	user 0.000s	sys 0.003s
I20260709 13:06:37.919036 18971 consensus_queue.cc:1059] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 9.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:37.920451 18971 raft_consensus.cc:3055] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:06:37.920821 18971 raft_consensus.cc:740] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:37.921707 18971 consensus_queue.cc:260] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:06:37.922796 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 295365us
I20260709 13:06:37.924266 18971 raft_consensus.cc:3060] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:37.917698 19085 leader_election.cc:290] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 10 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:37.927407 18909 raft_consensus.cc:493] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:37.928072 18909 raft_consensus.cc:515] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:37.934610 16940 raft_consensus.cc:1240] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:37.930250 19260 leader_election.cc:290] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:37.937018 16940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f022e2e63ae4461d834e476ff2666991" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:37.939128 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:37.942152 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:37.959250 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:37.964434 16279 raft_consensus.cc:2468] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 9.
I20260709 13:06:37.966696 16942 raft_consensus.cc:2468] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 7.
I20260709 13:06:37.971040 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:37.971185 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:37.972143 16274 raft_consensus.cc:2468] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 9.
I20260709 13:06:37.972366 16276 raft_consensus.cc:1275] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:06:37.972654 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f022e2e63ae4461d834e476ff2666991" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:37.975191 16201 raft_consensus.cc:1240] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:37.983243 16322 leader_election.cc:304] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:37.987607 16173 leader_election.cc:304] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:37.988667 16320 leader_election.cc:304] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:37.992635 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:37.993269 16208 raft_consensus.cc:3060] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:37.994458 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:37.930253 18909 leader_election.cc:290] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:37.996693 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:37.997033 16320 leader_election.cc:304] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:37.998423 19279 raft_consensus.cc:2804] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:37.998802 18810 consensus_queue.cc:1048] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:37.994645 19085 raft_consensus.cc:2804] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:38.003255 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:37.998896 16248 leader_election.cc:304] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:38.011390 16322 leader_election.cc:304] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:38.013283 16282 raft_consensus.cc:1275] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:06:37.990353 19139 raft_consensus.cc:493] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:38.022179 19294 raft_consensus.cc:2749] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:38.026593 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:38.027388 16277 raft_consensus.cc:3060] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:38.036067 19268 raft_consensus.cc:493] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.036854 19268 raft_consensus.cc:515] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:06:38.038070 16247 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:38.039495 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:38.040217 16349 raft_consensus.cc:3060] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:38.038081 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:38.040745 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:38.041586 16356 raft_consensus.cc:2393] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 10: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:06:38.014762 19279 raft_consensus.cc:697] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:38.025159 19085 raft_consensus.cc:493] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:38.040081 19076 raft_consensus.cc:2804] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:38.041152 16354 raft_consensus.cc:2468] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 6.
I20260709 13:06:38.059625 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:38.060370 16351 raft_consensus.cc:3060] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:38.032413 19104 raft_consensus.cc:2749] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:38.056505 19085 raft_consensus.cc:3060] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:38.064836 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:38.071961 16355 raft_consensus.cc:3060] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:38.064632 19221 consensus_queue.cc:1059] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:38.075225 19221 raft_consensus.cc:3055] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:38.075670 19221 raft_consensus.cc:740] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:38.066150 16357 raft_consensus.cc:1275] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:06:38.041468 19139 raft_consensus.cc:515] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:38.066732 19076 raft_consensus.cc:697] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 10 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:06:38.066849 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:38.082199 16354 raft_consensus.cc:3060] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:38.067571 19279 consensus_queue.cc:237] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:06:38.068288 19308 log.cc:927] Time spent T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.288s	user 0.003s	sys 0.000s
I20260709 13:06:38.034446 19304 raft_consensus.cc:2749] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:38.086805 16208 raft_consensus.cc:2468] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 10.
I20260709 13:06:38.079795 16248 leader_election.cc:304] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:38.087270 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:38.090106 16282 raft_consensus.cc:3055] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:38.090744 16282 raft_consensus.cc:740] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:38.092305 16320 leader_election.cc:304] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:38.095158 18810 raft_consensus.cc:2749] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:38.096630 19281 raft_consensus.cc:2804] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:38.097496 19281 raft_consensus.cc:697] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 10 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:06:38.099368 19281 consensus_queue.cc:237] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:38.103543 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:38.104362 16349 raft_consensus.cc:2468] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 8.
I20260709 13:06:38.111351 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:38.116050 16357 raft_consensus.cc:1240] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 7. Current term is 8. Ops: [5.3-7.4]
I20260709 13:06:38.124439 16357 raft_consensus.cc:1240] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 9. Current term is 10. Ops: [7.3-9.4]
I20260709 13:06:38.126266 16357 raft_consensus.cc:1240] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:38.127931 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:06:38.135244 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 73122.2us
I20260709 13:06:38.143448 18957 raft_consensus.cc:493] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.144289 18957 raft_consensus.cc:515] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:38.148113 19268 leader_election.cc:290] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:38.148212 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:06:38.133865 19318 log.cc:927] Time spent T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 13:06:38.154476 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:38.148953 16274 raft_consensus.cc:1275] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:06:38.155716 16354 raft_consensus.cc:2468] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 7.
I20260709 13:06:38.155843 16942 raft_consensus.cc:2393] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 7: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:06:38.135192 16282 consensus_queue.cc:260] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:38.157898 16277 raft_consensus.cc:2468] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 7.
I20260709 13:06:38.158298 16352 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41832 (request call id 1673) took 1154 ms. Trace:
I20260709 13:06:38.158898 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:38.159226 16352 rpcz_store.cc:276] 0709 13:06:36.995416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:37.034754 (+ 39338us) service_pool.cc:224] Handling call
0709 13:06:37.057118 (+ 22364us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:37.328420 (+271302us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:06:37.328470 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:37.361499 (+ 33029us) log.cc:844] Serialized 26 byte log entry
0709 13:06:37.735514 (+374015us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:37.735590 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:37.876778 (+141188us) spinlock_profiling.cc:243] Waited 184 ms on lock 0x7b5400269654. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f489e01 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6
0709 13:06:37.876831 (+    53us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:38.067575 (+190744us) spinlock_profiling.cc:243] Waited 5.83 ms on lock 0x7b4400022b4c. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361c224db1 00007f361c2c2c85 00007f361c2c36a2 00007f361f0351db 00007f361f030aaf 00007f361f02486e 00007f361f023bb6 00007f361f0237d8 00007f361f02d221 00007f361f02d1d9 00007f361f02d169
0709 13:06:38.149754 (+ 82179us) raft_consensus.cc:1685] finished
0709 13:06:38.149786 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:38.149942 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48494,"raft.queue_time_us":12237,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":16700,"spinlock_wait_cycles":436876288,"thread_start_us":284637,"threads_started":1,"wal-append.queue_time_us":388190}
I20260709 13:06:38.167351 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:38.170486 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:38.085465 19221 consensus_queue.cc:260] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:38.136140 19304 raft_consensus.cc:493] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:38.175048 16282 raft_consensus.cc:3060] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:38.176221 16351 raft_consensus.cc:2468] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 10.
I20260709 13:06:38.177539 16357 raft_consensus.cc:1240] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:38.178948 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:38.183702 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:38.184762 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:38.183813 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:38.183965 16276 raft_consensus.cc:2468] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 5.
I20260709 13:06:38.148913 19139 leader_election.cc:290] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:38.103436 16278 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "16a307cee8ef431184c620fec029af19"
dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
mode: GRACEFUL
new_leader_uuid: "363bb2f744eb486f9ad726f08214c98e"
 from {username='slave'} at 127.0.0.1:39058
I20260709 13:06:38.188457 16274 raft_consensus.cc:2468] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 9.
I20260709 13:06:38.179339 19320 consensus_queue.cc:1059] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 13:06:38.190091 19320 consensus_queue.cc:1243] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer 1109f76a0b7b443a84c0327c8707bc63 log is divergent from this leader: its last log entry 8.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:06:38.194998 18957 leader_election.cc:290] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:38.196895 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:38.197151 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:38.197749 16276 raft_consensus.cc:3060] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:06:38.199517 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:38.202383 19052 consensus_queue.cc:1048] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:06:38.205457 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:06:38.206229 19221 raft_consensus.cc:3060] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:38.206737 16947 raft_consensus.cc:2393] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 4: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
I20260709 13:06:38.188539 16278 raft_consensus.cc:606] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 LEADER]: Received request to transfer leadership to TS 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:38.213253 19076 consensus_queue.cc:237] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:38.216894 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:38.218425 16348 raft_consensus.cc:1240] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 3. Current term is 4. Ops: []
I20260709 13:06:38.218578 16282 raft_consensus.cc:1275] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:06:38.219745 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:38.220386 16283 raft_consensus.cc:3060] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:38.170046 18909 consensus_queue.cc:1059] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 13:06:38.222481 18909 raft_consensus.cc:3055] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:06:38.222954 16276 raft_consensus.cc:2468] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 10.
I20260709 13:06:38.223129 19304 raft_consensus.cc:515] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:38.226207 19139 raft_consensus.cc:493] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.229233 19092 consensus_queue.cc:1048] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:38.233445 16173 leader_election.cc:304] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:38.238444 16283 raft_consensus.cc:2468] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 10.
I20260709 13:06:38.246474 16248 leader_election.cc:304] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:38.247749 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:38.252350 16350 raft_consensus.cc:1240] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:06:38.263466 16355 raft_consensus.cc:2468] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 8.
I20260709 13:06:38.236260 19092 raft_consensus.cc:2804] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:06:38.267102 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 87002.9us
I20260709 13:06:38.222930 18909 raft_consensus.cc:740] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:38.234354 19085 raft_consensus.cc:515] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:38.234939 19139 raft_consensus.cc:515] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:38.254316 19321 raft_consensus.cc:2749] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:38.289301 19304 leader_election.cc:290] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:06:38.293815 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 49101.8us
I20260709 13:06:38.295359 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:38.298409 16354 raft_consensus.cc:2368] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 6. Current term is 7.
I20260709 13:06:38.302281 16248 leader_election.cc:304] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:38.290099 19092 raft_consensus.cc:697] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 8 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:38.308409 16322 leader_election.cc:304] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:38.309087 19189 raft_consensus.cc:493] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.309882 16322 leader_election.cc:304] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:38.309626 19189 raft_consensus.cc:515] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:38.316526 16248 leader_election.cc:304] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:38.310267 19304 raft_consensus.cc:2749] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:38.328781 16942 raft_consensus.cc:1275] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:06:38.329489 19092 consensus_queue.cc:237] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:38.330509 18971 raft_consensus.cc:3055] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:38.331943 19294 raft_consensus.cc:2749] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:38.341734 18971 raft_consensus.cc:740] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:38.352090 16248 leader_election.cc:304] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:38.355367 19104 raft_consensus.cc:2749] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:06:38.356940 19104 raft_consensus.cc:2749] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:06:38.359342 19320 consensus_queue.cc:1059] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:06:38.343915 19085 leader_election.cc:290] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:38.360203 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:38.361578 16279 raft_consensus.cc:2393] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 in current term 7: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:06:38.363951 19264 consensus_queue.cc:1048] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:38.371845 19104 raft_consensus.cc:3055] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:38.372340 19104 raft_consensus.cc:740] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:38.373499 19104 consensus_queue.cc:260] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:38.332393 19139 leader_election.cc:290] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:38.325366 18957 raft_consensus.cc:2749] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:06:38.333710 19189 leader_election.cc:290] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:06:38.380703 19329 log.cc:927] Time spent T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:06:38.345567 18971 consensus_queue.cc:260] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:38.384248 18971 raft_consensus.cc:3060] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:38.386978 19143 raft_consensus.cc:493] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:38.387881 19143 raft_consensus.cc:515] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } }
I20260709 13:06:38.393342 19263 raft_consensus.cc:493] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:38.316507 18909 consensus_queue.cc:260] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:38.394179 19263 raft_consensus.cc:515] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:38.395816 18909 raft_consensus.cc:3060] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:06:38.397594 19263 leader_election.cc:290] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:38.398458 19263 raft_consensus.cc:493] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:38.399592 19263 raft_consensus.cc:515] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:38.402590 19104 raft_consensus.cc:3060] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:38.419670 16246 leader_election.cc:304] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:38.434728 19321 raft_consensus.cc:493] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:38.435429 19321 raft_consensus.cc:515] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:38.437668 19321 leader_election.cc:290] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:38.438174 19321 raft_consensus.cc:493] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.440497 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:38.425320 19263 leader_election.cc:290] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:38.443734 19321 raft_consensus.cc:515] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:38.446992 16275 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d"
dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
mode: GRACEFUL
new_leader_uuid: "363bb2f744eb486f9ad726f08214c98e"
 from {username='slave'} at 127.0.0.1:39058
I20260709 13:06:38.448203 16275 raft_consensus.cc:606] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Received request to transfer leadership to TS 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:38.448700 16275 raft_consensus.cc:614] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:38.453437 19321 leader_election.cc:290] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:38.455276 19264 raft_consensus.cc:493] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.456113 19264 raft_consensus.cc:515] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:38.459126 19143 leader_election.cc:290] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:38.460258 19139 raft_consensus.cc:493] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:38.461128 19139 raft_consensus.cc:515] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:38.461946 16947 raft_consensus.cc:1275] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:06:38.463415 19139 leader_election.cc:290] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:38.464664 19263 consensus_queue.cc:1048] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:06:38.475337 19104 raft_consensus.cc:2749] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:06:38.475524 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 55946.6us
I20260709 13:06:38.477460 19104 consensus_queue.cc:1059] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:38.477591 16246 leader_election.cc:304] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:38.479830 19243 raft_consensus.cc:2749] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:38.478636 19104 consensus_queue.cc:1243] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer e10b16d536674c0bb350a31d7ce5ff7f log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:06:38.482095 19321 raft_consensus.cc:3055] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:06:38.482834 19189 raft_consensus.cc:493] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:38.482852 19321 raft_consensus.cc:740] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:38.483559 19189 raft_consensus.cc:515] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:38.484733 19321 consensus_queue.cc:260] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:38.486541 19321 raft_consensus.cc:3060] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:38.488062 16275 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd"
dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
mode: GRACEFUL
new_leader_uuid: "363bb2f744eb486f9ad726f08214c98e"
 from {username='slave'} at 127.0.0.1:39058
I20260709 13:06:38.488788 16275 raft_consensus.cc:606] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Received request to transfer leadership to TS 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:38.489252 16275 raft_consensus.cc:614] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:38.486065 19189 leader_election.cc:290] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:38.501784 19104 raft_consensus.cc:493] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:38.502681 19104 raft_consensus.cc:515] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:06:38.506458 16249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:38.508127 19104 leader_election.cc:290] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:38.514611 19264 leader_election.cc:290] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:38.534902 16275 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157"
dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
mode: GRACEFUL
new_leader_uuid: "363bb2f744eb486f9ad726f08214c98e"
 from {username='slave'} at 127.0.0.1:39058
W20260709 13:06:38.535337 16247 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:38.536343 16275 raft_consensus.cc:606] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 LEADER]: Received request to transfer leadership to TS 363bb2f744eb486f9ad726f08214c98e
W20260709 13:06:38.545728 16248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:38.546525 16248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:38.548924 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 71471.1us
I20260709 13:06:38.560849 16914 leader_election.cc:304] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:38.565553 19189 raft_consensus.cc:493] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:38.578891 16275 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba"
dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
mode: GRACEFUL
new_leader_uuid: "363bb2f744eb486f9ad726f08214c98e"
 from {username='slave'} at 127.0.0.1:39058
I20260709 13:06:38.587342 16201 raft_consensus.cc:1240] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 LEADER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:38.580555 16275 raft_consensus.cc:606] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 LEADER]: Received request to transfer leadership to TS 363bb2f744eb486f9ad726f08214c98e
W20260709 13:06:38.592597 16246 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:38.592597 16205 raft_consensus.cc:1240] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:38.595161 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:38.600056 16173 leader_election.cc:304] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:38.602108 16276 raft_consensus.cc:1275] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:06:38.596064 16202 raft_consensus.cc:2468] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 6.
I20260709 13:06:38.608598 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:38.581104 19264 raft_consensus.cc:493] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:38.580904 19207 raft_consensus.cc:493] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:38.593688 19157 raft_consensus.cc:2749] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:38.612344 15057 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:06:38.617847 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:38.618539 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:06:38.617134 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 307309us
I20260709 13:06:38.618973 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:38.620193 16279 raft_consensus.cc:2468] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 7.
I20260709 13:06:38.621747 16283 raft_consensus.cc:3060] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:38.622102 16322 leader_election.cc:304] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:06:38.625694 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:38.625694 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:38.627957 16322 leader_election.cc:304] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:38.631105 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:38.617291 19261 consensus_queue.cc:1048] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:06:38.640234 16280 raft_consensus.cc:1240] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:38.641170 19194 consensus_queue.cc:1048] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 13:06:38.592483 19263 raft_consensus.cc:493] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:38.658113 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:38.658294 16322 leader_election.cc:304] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:38.615592 19260 raft_consensus.cc:2764] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
W20260709 13:06:38.639168 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 327972us
I20260709 13:06:38.640147 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:38.619860 15057 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:38.578133 19189 raft_consensus.cc:515] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:38.632087 16276 raft_consensus.cc:2468] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 9.
I20260709 13:06:38.625960 19185 raft_consensus.cc:2749] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:38.672780 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:38.608453 19288 consensus_queue.cc:1048] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.057s
I20260709 13:06:38.662084 19281 raft_consensus.cc:493] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:38.673272 16322 leader_election.cc:304] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:38.675959 16173 leader_election.cc:304] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:38.644572 19194 consensus_queue.cc:1243] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer 0aea40d6e4374085a2e38a70a71f63e3 log is divergent from this leader: its last log entry 6.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:06:38.677227 16283 raft_consensus.cc:1275] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:06:38.633788 19264 raft_consensus.cc:515] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:38.686213 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:38.687012 16206 raft_consensus.cc:1275] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:06:38.691032 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:38.692055 16203 raft_consensus.cc:2468] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 8.
I20260709 13:06:38.681342 19295 raft_consensus.cc:493] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:38.693575 16276 raft_consensus.cc:1275] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 7. (term mismatch)
I20260709 13:06:38.694079 16276 pending_rounds.cc:85] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3: Aborting all ops after (but not including) 6
I20260709 13:06:38.694336 16276 pending_rounds.cc:107] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 13:06:38.694770 16276 raft_consensus.cc:2889] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:38.700479 16173 leader_election.cc:304] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:38.669190 19085 raft_consensus.cc:2749] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:38.705399 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:38.671157 19294 raft_consensus.cc:2749] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:38.706108 16207 raft_consensus.cc:3060] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:38.642813 19207 raft_consensus.cc:515] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:38.659806 19263 raft_consensus.cc:515] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:38.702842 19260 raft_consensus.cc:2804] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:38.716112 16320 leader_election.cc:304] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:38.745478 16208 raft_consensus.cc:1240] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 8 LEADER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:38.661253 19279 consensus_queue.cc:1048] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
W20260709 13:06:38.747709 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 74954.8us
I20260709 13:06:38.749365 16322 leader_election.cc:304] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:38.683090 19143 consensus_queue.cc:1048] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:06:38.710750 19261 raft_consensus.cc:2804] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:38.706382 19259 consensus_queue.cc:1059] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
W20260709 13:06:38.765933 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 49909.5us
I20260709 13:06:38.693635 19295 raft_consensus.cc:515] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:38.783938 19207 leader_election.cc:290] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:38.787681 19189 leader_election.cc:290] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:38.788154 19304 raft_consensus.cc:2749] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:38.717955 19203 consensus_queue.cc:1048] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 13:06:38.789374 16207 raft_consensus.cc:2468] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 7.
I20260709 13:06:38.797501 19294 raft_consensus.cc:2804] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:38.716631 19139 consensus_queue.cc:1048] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 13:06:38.755651 19206 raft_consensus.cc:2749] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:38.799224 19264 leader_election.cc:290] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:38.758908 19261 raft_consensus.cc:493] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:38.687152 19281 raft_consensus.cc:515] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:38.811920 19263 leader_election.cc:290] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:38.820868 19259 raft_consensus.cc:3055] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:06:38.747892 19260 raft_consensus.cc:493] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:38.836862 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 67750.8us
W20260709 13:06:38.837164 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 234201us
I20260709 13:06:38.847491 16246 leader_election.cc:304] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:38.871948 16246 leader_election.cc:304] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:38.851511 16201 raft_consensus.cc:1275] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:06:38.875368 16914 leader_election.cc:304] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:38.868163 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:38.880975 18971 raft_consensus.cc:2804] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:38.881296 16320 leader_election.cc:304] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:38.876372 19321 raft_consensus.cc:2749] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:38.882409 16207 raft_consensus.cc:1275] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:06:38.885646 19295 leader_election.cc:290] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:38.876546 19260 raft_consensus.cc:3060] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:38.904289 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:38.929919 16349 raft_consensus.cc:2393] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 in current term 4: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:06:38.904539 19281 leader_election.cc:290] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:38.849395 19294 raft_consensus.cc:493] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:38.852231 19302 consensus_queue.cc:1059] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.060s
I20260709 13:06:38.864055 19261 raft_consensus.cc:3060] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:38.870036 19259 raft_consensus.cc:740] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:38.937207 16350 raft_consensus.cc:1275] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:06:38.937659 19259 consensus_queue.cc:260] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:38.939133 19259 raft_consensus.cc:3060] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:38.926786 16322 leader_election.cc:304] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:38.940670 19185 raft_consensus.cc:2749] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:38.919335 18971 raft_consensus.cc:493] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:38.943123 18971 raft_consensus.cc:3060] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:38.944584 16322 leader_election.cc:304] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:38.945865 19185 raft_consensus.cc:2749] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:38.947736 16322 leader_election.cc:304] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:06:38.934645 19294 raft_consensus.cc:3060] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:38.954742 19185 raft_consensus.cc:2749] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:38.931340 19076 consensus_queue.cc:1048] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:06:38.956954 16322 leader_election.cc:304] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
W20260709 13:06:38.933218 16247 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:38.966745 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:38.967114 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:38.970885 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:38.974140 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:38.980561 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:38.981457 16283 raft_consensus.cc:2468] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 10.
I20260709 13:06:38.981726 16248 leader_election.cc:304] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:38.969334 16173 leader_election.cc:304] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:06:38.923358 19206 raft_consensus.cc:2804] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:38.986023 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:06:38.986748 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 54030.5us
I20260709 13:06:38.987201 16282 raft_consensus.cc:2393] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 8: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:06:38.928259 19265 raft_consensus.cc:2749] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:38.994344 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:39.000077 16276 raft_consensus.cc:1275] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:06:39.023495 16275 raft_consensus.cc:1275] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:06:39.023803 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 90299us
I20260709 13:06:38.983026 19076 raft_consensus.cc:2749] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:06:39.031780 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 50153.2us
I20260709 13:06:39.033017 16248 leader_election.cc:304] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:39.036746 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:39.039270 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:39.004705 19092 raft_consensus.cc:2804] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:39.048969 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:39.057744 16248 leader_election.cc:304] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:39.059772 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:39.060803 16350 raft_consensus.cc:2468] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 6.
I20260709 13:06:39.061898 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:39.036774 16940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:39.067322 16283 pending_rounds.cc:85] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3: Aborting all ops after (but not including) 2
I20260709 13:06:39.071437 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:39.071946 16283 pending_rounds.cc:107] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3: Aborting uncommitted NO_OP operation due to leader change: 6.3
I20260709 13:06:39.072346 16283 raft_consensus.cc:2889] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:39.072579 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:39.066169 16173 leader_election.cc:304] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:06:39.072973 16356 raft_consensus.cc:1275] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:06:39.028031 19206 raft_consensus.cc:697] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 7 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:06:39.035869 19302 raft_consensus.cc:2749] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:06:39.076748 16249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:38.998651 19189 consensus_queue.cc:1048] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 13:06:39.079747 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:39.080641 16282 raft_consensus.cc:1275] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:06:39.099421 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:39.102416 16279 raft_consensus.cc:2393] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 7: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:06:39.087498 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:39.081755 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:39.112960 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:39.113713 16348 raft_consensus.cc:2468] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 7.
I20260709 13:06:39.114632 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:39.118300 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:06:39.124827 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 67231.4us
I20260709 13:06:39.125660 16276 raft_consensus.cc:2393] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 10: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:06:39.119103 16356 raft_consensus.cc:2468] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 8.
I20260709 13:06:39.110266 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:39.128068 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:39.128880 16356 raft_consensus.cc:2468] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 7.
I20260709 13:06:39.132231 16356 raft_consensus.cc:1275] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:06:39.080642 19092 raft_consensus.cc:697] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:39.100867 18909 raft_consensus.cc:2749] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:06:39.099848 19279 raft_consensus.cc:2804] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:39.147068 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:39.148543 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:39.137156 16356 raft_consensus.cc:1240] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:39.084657 19104 raft_consensus.cc:493] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:39.084486 18957 raft_consensus.cc:2749] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:39.074668 19282 consensus_queue.cc:1048] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.061s
W20260709 13:06:39.191514 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:39.191883 19345 log.cc:927] Time spent T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
I20260709 13:06:39.235651 16946 raft_consensus.cc:1275] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:06:39.167482 19104 raft_consensus.cc:515] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:06:39.259986 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 190721us
I20260709 13:06:39.261732 19104 leader_election.cc:290] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:39.246272 16353 raft_consensus.cc:1275] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 5 index: 2. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:06:39.230661 19206 consensus_queue.cc:237] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:39.247673 19092 consensus_queue.cc:237] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:39.253095 19264 raft_consensus.cc:493] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:39.267452 19264 raft_consensus.cc:515] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:39.276580 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:39.270475 19264 leader_election.cc:290] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:06:39.305302 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 179176us
I20260709 13:06:39.323734 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:39.324494 16352 raft_consensus.cc:2468] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 6.
I20260709 13:06:39.326648 16248 leader_election.cc:400] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107) with higher term. Message: Invalid argument: T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 6. Current term is 7.
I20260709 13:06:39.331957 16322 leader_election.cc:304] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
W20260709 13:06:39.392251 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 47801us
I20260709 13:06:39.393522 16914 leader_election.cc:304] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:39.397826 19092 consensus_queue.cc:1048] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:39.399252 19052 raft_consensus.cc:2749] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:06:39.399838 19351 log.cc:927] Time spent T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.169s	user 0.000s	sys 0.000s
I20260709 13:06:39.420696 19360 raft_consensus.cc:493] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:39.421933 16280 raft_consensus.cc:1275] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:06:39.422292 16248 leader_election.cc:304] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:06:39.516201 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 94020.9us
I20260709 13:06:39.519603 16173 leader_election.cc:304] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:06:39.520407 19359 raft_consensus.cc:2804] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:39.518339 16248 leader_election.cc:304] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:06:39.436066 19344 log.cc:927] Time spent T b9e1324823f04d8da5a4b3ddbd061c0e P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.324s	user 0.001s	sys 0.000s
W20260709 13:06:39.501515 19356 log.cc:927] Time spent T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.269s	user 0.001s	sys 0.000s
I20260709 13:06:39.558385 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:06:39.563863 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 44383us
W20260709 13:06:39.572742 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 54556us
I20260709 13:06:39.522616 19279 raft_consensus.cc:697] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
W20260709 13:06:39.557008 18971 consensus_meta.cc:287] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3: Time spent flushing consensus metadata: real 0.613s	user 0.016s	sys 0.004s
I20260709 13:06:39.583958 19243 raft_consensus.cc:493] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.571635 19359 raft_consensus.cc:493] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:39.583484 19143 raft_consensus.cc:2804] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:39.649362 19143 raft_consensus.cc:493] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:39.649891 19143 raft_consensus.cc:3060] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:39.635257 19243 raft_consensus.cc:515] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:39.638823 19203 raft_consensus.cc:493] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
W20260709 13:06:39.654369 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 260887us
I20260709 13:06:39.656430 19203 raft_consensus.cc:515] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:39.639225 19263 consensus_queue.cc:1048] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
W20260709 13:06:39.627024 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 52677.4us
I20260709 13:06:39.659699 19203 leader_election.cc:290] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:39.660617 16173 leader_election.cc:304] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:39.638074 19359 raft_consensus.cc:3060] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:39.667680 16173 leader_election.cc:304] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:39.669440 16173 leader_election.cc:304] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
W20260709 13:06:39.670205 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 587258us
W20260709 13:06:39.637717 19294 consensus_meta.cc:287] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 0.688s	user 0.010s	sys 0.000s
W20260709 13:06:39.637823 19261 consensus_meta.cc:287] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f: Time spent flushing consensus metadata: real 0.680s	user 0.011s	sys 0.000s
I20260709 13:06:39.712450 15057 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:06:39.714107 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 52914.3us
I20260709 13:06:39.665870 19263 raft_consensus.cc:2749] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:06:39.733925 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 64611.5us
I20260709 13:06:39.734907 16173 leader_election.cc:304] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:06:39.671883 19092 raft_consensus.cc:2749] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:39.742362 16173 leader_election.cc:304] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:39.744866 16173 leader_election.cc:304] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:39.620404 18971 raft_consensus.cc:515] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:39.668923 19270 raft_consensus.cc:493] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:39.619330 19360 raft_consensus.cc:515] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:06:39.754237 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 422333us
I20260709 13:06:39.760517 16322 leader_election.cc:304] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:39.753980 19243 leader_election.cc:290] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:06:39.767205 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 52265.7us
I20260709 13:06:39.757349 16173 leader_election.cc:304] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:39.737071 19354 raft_consensus.cc:2749] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:39.778357 16274 raft_consensus.cc:3060] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:39.751893 19367 raft_consensus.cc:2749] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:06:39.716882 19261 raft_consensus.cc:515] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:39.761633 19304 raft_consensus.cc:2804] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:39.711512 19294 raft_consensus.cc:515] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:39.758699 19139 raft_consensus.cc:2749] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:39.787753 16322 leader_election.cc:304] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:39.746140 19365 raft_consensus.cc:2804] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:39.746522 19375 raft_consensus.cc:2749] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:06:39.790050 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 115972us
W20260709 13:06:39.754321 19355 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.040s	sys 0.049s
W20260709 13:06:39.784576 19259 consensus_meta.cc:287] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f: Time spent flushing consensus metadata: real 0.845s	user 0.009s	sys 0.006s
I20260709 13:06:39.778767 19263 raft_consensus.cc:2749] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:39.747884 19104 consensus_queue.cc:1059] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.041s
W20260709 13:06:39.830093 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 256376us
I20260709 13:06:39.831645 16248 leader_election.cc:304] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:39.782790 19360 leader_election.cc:290] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:39.762457 19264 consensus_queue.cc:1048] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
W20260709 13:06:39.795159 19355 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.602s	user 0.040s	sys 0.050s
I20260709 13:06:39.789479 19304 raft_consensus.cc:493] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:39.785801 19092 raft_consensus.cc:493] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:39.789433 19194 raft_consensus.cc:493] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:39.793286 19365 raft_consensus.cc:493] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:39.803161 19281 raft_consensus.cc:2749] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:06:39.858791 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 66861.6us
I20260709 13:06:39.843413 19185 raft_consensus.cc:2749] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:39.852381 19304 raft_consensus.cc:3060] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:39.845877 19360 raft_consensus.cc:493] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:39.777794 19279 consensus_queue.cc:237] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:39.862528 19104 raft_consensus.cc:2749] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:06:39.874583 19378 log.cc:927] Time spent T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 13:06:39.858562 19365 raft_consensus.cc:3060] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:39.759485 19373 consensus_queue.cc:1048] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.124s
I20260709 13:06:39.871771 19221 raft_consensus.cc:3055] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:39.860513 19092 raft_consensus.cc:515] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:39.861761 19194 raft_consensus.cc:515] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:06:39.897213 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 107230us
W20260709 13:06:39.897995 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 69532.8us
I20260709 13:06:39.904635 16322 leader_election.cc:304] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:39.882802 19076 consensus_queue.cc:1048] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 13:06:39.883594 19360 raft_consensus.cc:515] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:39.912181 16322 leader_election.cc:304] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:06:39.915031 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 86736.8us
I20260709 13:06:39.917773 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:39.898761 19221 raft_consensus.cc:740] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:39.919677 16201 raft_consensus.cc:2368] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for earlier term 9. Current term is 10.
I20260709 13:06:39.928484 19281 raft_consensus.cc:3060] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:39.910194 19379 raft_consensus.cc:493] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.918738 19335 raft_consensus.cc:2749] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:39.948271 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:39.922627 18971 leader_election.cc:290] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:39.913720 19357 consensus_queue.cc:1048] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:06:39.907799 19206 consensus_queue.cc:1048] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:06:39.948801 19104 raft_consensus.cc:493] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.941960 18909 raft_consensus.cc:493] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.975672 19387 raft_consensus.cc:493] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.967110 19335 raft_consensus.cc:493] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:39.961299 19294 leader_election.cc:290] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:39.987520 16201 raft_consensus.cc:2468] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 8.
I20260709 13:06:39.988258 15057 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:39.953867 19355 consensus_queue.cc:1048] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 13:06:39.990144 16274 raft_consensus.cc:2468] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 7.
I20260709 13:06:39.763280 19270 raft_consensus.cc:515] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:39.949169 19379 raft_consensus.cc:515] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:40.007398 19335 raft_consensus.cc:515] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:06:39.989818 19260 consensus_meta.cc:287] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f: Time spent flushing consensus metadata: real 1.026s	user 0.016s	sys 0.000s
I20260709 13:06:39.982393 19387 raft_consensus.cc:515] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:39.973624 19104 raft_consensus.cc:515] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:39.972476 18909 raft_consensus.cc:515] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:40.022236 19294 raft_consensus.cc:493] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:40.021420 19390 raft_consensus.cc:493] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:39.994937 19221 consensus_queue.cc:260] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:40.024501 19260 raft_consensus.cc:515] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:06:40.048491 19382 log.cc:927] Time spent T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 13:06:40.039001 19092 leader_election.cc:290] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:40.063525 16205 raft_consensus.cc:2368] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for earlier term 7. Current term is 8.
I20260709 13:06:40.035681 19294 raft_consensus.cc:515] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:40.046169 19194 leader_election.cc:290] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:40.087932 19379 leader_election.cc:290] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:40.089802 19104 leader_election.cc:290] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:40.041045 19390 raft_consensus.cc:515] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:40.115228 19390 leader_election.cc:290] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:40.093713 19335 leader_election.cc:290] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:06:40.116489 19350 log.cc:927] Time spent T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.925s	user 0.000s	sys 0.012s
I20260709 13:06:40.117388 19294 leader_election.cc:290] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:40.094288 19359 raft_consensus.cc:515] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:40.119141 16357 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33486 (request call id 319) took 1198 ms. Trace:
I20260709 13:06:40.101600 18909 leader_election.cc:290] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:40.094138 16355 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41832 (request call id 1697) took 1053 ms. Trace:
I20260709 13:06:40.103842 19387 leader_election.cc:290] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:40.112934 19260 leader_election.cc:290] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:40.128334 16282 raft_consensus.cc:1240] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:40.119741 16357 rpcz_store.cc:276] 0709 13:06:38.920306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:38.920417 (+   111us) service_pool.cc:224] Handling call
0709 13:06:38.920691 (+   274us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:38.927065 (+  6374us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:38.927094 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:38.931210 (+  4116us) log.cc:844] Serialized 26 byte log entry
0709 13:06:38.939668 (+  8458us) spinlock_profiling.cc:243] Waited 1.51 ms on lock 0x7b1800394360. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f3625264de1 00007f36252715b1 00007f361c37ee07 00007f36251d9ab9 00007f361c39b69b 00007f361c39993f 00007f361c39bc02 00007f361f02320b 00007f361f028d23 00007f361f0290d1 00007f361f444a0f
0709 13:06:39.076750 (+137082us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:39.076801 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:39.076907 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:40.115825 (+1038918us) spinlock_profiling.cc:243] Waited 43.9 ms on lock 0x7b4400022b4c. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361c224db1 00007f361c2c2c85 00007f361c2c36a2 00007f361f0351db 00007f361f030aaf 00007f361f02486e 00007f361f023bb6 00007f361f0237d8 00007f361f02d221 00007f361f02d1d9 00007f361f02d169
0709 13:06:40.118814 (+  2989us) raft_consensus.cc:1685] finished
0709 13:06:40.118844 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:40.119060 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":739,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":5813,"spinlock_wait_cycles":104541312,"thread_start_us":136867,"threads_started":1,"wal-append.queue_time_us":228717}
W20260709 13:06:40.131352 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 64303.9us
I20260709 13:06:40.122238 16355 rpcz_store.cc:276] 0709 13:06:39.040295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:39.040426 (+   131us) service_pool.cc:224] Handling call
0709 13:06:39.071932 (+ 31506us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:39.669285 (+597353us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:39.669316 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:39.669950 (+   634us) log.cc:844] Serialized 52 byte log entry
0709 13:06:39.882902 (+212952us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:06:39.882971 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:39.883071 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:40.093878 (+210807us) raft_consensus.cc:1685] finished
0709 13:06:40.093904 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:40.094069 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":619381,"raft.queue_time_us":605028,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":18880,"thread_start_us":136742,"threads_started":1,"wal-append.queue_time_us":188928}
W20260709 13:06:40.145939 19376 log.cc:927] Time spent T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.260s	user 0.000s	sys 0.002s
W20260709 13:06:40.157073 19395 log.cc:927] Time spent T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260709 13:06:40.157831 19359 leader_election.cc:290] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:40.120893 19143 raft_consensus.cc:515] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:40.148608 19207 raft_consensus.cc:493] T b9e1324823f04d8da5a4b3ddbd061c0e P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
W20260709 13:06:40.162307 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 208725us
I20260709 13:06:40.164979 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:40.166733 16283 raft_consensus.cc:2393] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 9: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:06:40.169059 19304 raft_consensus.cc:515] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:40.170496 16320 leader_election.cc:400] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Vote denied by peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073) with higher term. Message: Invalid argument: T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for earlier term 9. Current term is 10.
I20260709 13:06:40.172351 16320 leader_election.cc:403] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:40.171504 19143 leader_election.cc:290] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:40.173501 19271 raft_consensus.cc:3060] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:06:40.174114 19304 leader_election.cc:290] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:40.163693 19281 raft_consensus.cc:2749] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:40.177790 19365 raft_consensus.cc:515] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:40.180356 19365 leader_election.cc:290] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:40.183151 19207 raft_consensus.cc:515] T b9e1324823f04d8da5a4b3ddbd061c0e P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:40.184554 18909 raft_consensus.cc:493] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:40.185145 18909 raft_consensus.cc:515] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:40.189829 19359 raft_consensus.cc:493] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:40.188508 19390 raft_consensus.cc:493] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:40.190536 19359 raft_consensus.cc:515] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:40.191682 19390 raft_consensus.cc:515] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:40.193361 19359 leader_election.cc:290] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:40.190717 19104 raft_consensus.cc:493] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:40.193733 19390 leader_election.cc:290] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:40.191299 18909 leader_election.cc:290] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:40.186334 19207 leader_election.cc:290] T b9e1324823f04d8da5a4b3ddbd061c0e P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:40.199316 16274 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45210 (request call id 1677) took 1216 ms. Trace:
I20260709 13:06:40.200157 16274 rpcz_store.cc:276] 0709 13:06:38.980472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:38.980625 (+   153us) service_pool.cc:224] Handling call
0709 13:06:40.196148 (+1215523us) spinlock_profiling.cc:243] Waited 783 ms on lock 0x7b540004e554. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:06:40.196278 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1800433920}
I20260709 13:06:40.201934 19391 raft_consensus.cc:493] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:40.202522 19391 raft_consensus.cc:515] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:40.205057 19391 leader_election.cc:290] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:40.195552 19379 raft_consensus.cc:493] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:40.207719 19379 raft_consensus.cc:515] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:40.210040 19379 leader_election.cc:290] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:40.216502 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:40.217644 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:40.219456 19270 leader_election.cc:290] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:40.221773 16275 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "16a307cee8ef431184c620fec029af19"
dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
mode: GRACEFUL
new_leader_uuid: "363bb2f744eb486f9ad726f08214c98e"
 from {username='slave'} at 127.0.0.1:39058
I20260709 13:06:40.222404 16275 raft_consensus.cc:606] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 LEADER]: Received request to transfer leadership to TS 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:40.197783 18909 raft_consensus.cc:493] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:40.227509 18909 raft_consensus.cc:515] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } }
I20260709 13:06:40.227993 19360 leader_election.cc:290] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:40.194386 19104 raft_consensus.cc:515] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:40.229828 18909 leader_election.cc:290] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:06:40.233613 19370 log.cc:927] Time spent T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.486s	user 0.003s	sys 0.001s
I20260709 13:06:40.241000 16278 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45218 (request call id 1745) took 1191 ms. Trace:
I20260709 13:06:40.242136 16946 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35106 (request call id 644) took 1305 ms. Trace:
I20260709 13:06:40.242635 16946 rpcz_store.cc:276] 0709 13:06:38.937065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:38.976345 (+ 39280us) service_pool.cc:224] Handling call
0709 13:06:38.976807 (+   462us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:39.259369 (+282562us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:40.241873 (+982504us) spinlock_profiling.cc:243] Waited 220 ms on lock 0x7b54005f0ad4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f489e01 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6
0709 13:06:40.242047 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":506857856}
I20260709 13:06:40.261440 16279 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42740 (request call id 424) took 1193 ms. Trace:
I20260709 13:06:40.241597 16278 rpcz_store.cc:276] 0709 13:06:39.049176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:39.050953 (+  1777us) service_pool.cc:224] Handling call
0709 13:06:39.073580 (+ 22627us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:39.280442 (+206862us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:39.280471 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:39.280968 (+   497us) log.cc:844] Serialized 26 byte log entry
0709 13:06:39.501128 (+220160us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:39.501270 (+   142us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:39.501344 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:40.233038 (+731694us) spinlock_profiling.cc:243] Waited 21.5 ms on lock 0x7b4400022b4c. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361c224db1 00007f361c2c2c85 00007f361c2c36a2 00007f361f0351db 00007f361f030aaf 00007f361f02486e 00007f361f023bb6 00007f361f0237d8 00007f361f02d221 00007f361f02d1d9 00007f361f02d169
0709 13:06:40.239209 (+  6171us) raft_consensus.cc:1685] finished
0709 13:06:40.239230 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:40.240867 (+  1637us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14388,"raft.queue_time_us":41818,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":4716,"spinlock_wait_cycles":49535872,"thread_start_us":413624,"threads_started":2,"wal-append.queue_time_us":290843}
I20260709 13:06:40.230408 19104 leader_election.cc:290] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:40.261909 16279 rpcz_store.cc:276] 0709 13:06:39.068071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:39.115671 (+ 47600us) service_pool.cc:224] Handling call
0709 13:06:39.138618 (+ 22947us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:39.139007 (+   389us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:39.139036 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:39.145435 (+  6399us) log.cc:844] Serialized 26 byte log entry
0709 13:06:40.117464 (+972029us) spinlock_profiling.cc:243] Waited 6.94 ms on lock 0x7b18003b7340. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f3625264de1 00007f36252715b1 00007f361c37ee07 00007f36251d9ab9 00007f361c39b69b 00007f361c39993f 00007f361c39bc02 00007f361f02320b 00007f361f028d23 00007f361f0290d1 00007f361f444a0f
0709 13:06:40.198189 (+ 80725us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:40.198217 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:40.198267 (+    50us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:40.259681 (+ 61414us) raft_consensus.cc:1685] finished
0709 13:06:40.259701 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:40.261366 (+  1665us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6994,"raft.queue_time_us":41471,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":49779,"spinlock_wait_cycles":15954304,"thread_start_us":79236,"threads_started":1,"wal-append.queue_time_us":1060664}
W20260709 13:06:40.268359 15057 auto_leader_rebalancer.cc:438] leader transfer for tablet 16a307cee8ef431184c620fec029af19 from 0aea40d6e4374085a2e38a70a71f63e3 to 363bb2f744eb486f9ad726f08214c98e failed: Remote error: Service unavailable: leadership transfer for 16a307cee8ef431184c620fec029af19 already in progress
I20260709 13:06:40.269397 16320 leader_election.cc:304] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:40.274976 19271 raft_consensus.cc:2749] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073) with higher term. Message: Invalid argument: T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for earlier term 9. Current term is 10.
I20260709 13:06:40.277747 19259 consensus_queue.cc:1048] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:40.280330 19259 raft_consensus.cc:493] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:40.280936 19203 raft_consensus.cc:2804] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:40.281528 19203 raft_consensus.cc:697] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 8 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:06:40.282498 19203 consensus_queue.cc:237] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:40.280980 19259 raft_consensus.cc:515] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:40.267562 18810 raft_consensus.cc:993] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3: : Instructing follower 363bb2f744eb486f9ad726f08214c98e to start an election
I20260709 13:06:40.302506 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bc3c8ff9b84838a2664335d7e1582b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:40.304611 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:40.308039 19207 raft_consensus.cc:493] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:40.310632 19207 raft_consensus.cc:515] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:40.311106 16199 raft_consensus.cc:1240] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:40.308892 16203 raft_consensus.cc:2368] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 6. Current term is 7.
I20260709 13:06:40.316394 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:40.318049 19321 raft_consensus.cc:1081] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 LEADER]: Signalling peer 363bb2f744eb486f9ad726f08214c98e to start an election
I20260709 13:06:40.328118 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:40.336339 16276 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f"
dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
mode: GRACEFUL
new_leader_uuid: "363bb2f744eb486f9ad726f08214c98e"
 from {username='slave'} at 127.0.0.1:39058
I20260709 13:06:40.323974 19259 leader_election.cc:290] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:40.337347 16276 raft_consensus.cc:606] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Received request to transfer leadership to TS 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:40.340298 16276 raft_consensus.cc:614] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:40.340596 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:40.344728 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:40.347946 19263 raft_consensus.cc:493] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:40.355515 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:40.358677 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:40.313261 19092 consensus_queue.cc:1059] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 13:06:40.356539 16200 raft_consensus.cc:2468] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 9.
W20260709 13:06:40.352488 19410 log.cc:927] Time spent T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:06:40.365561 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bc3c8ff9b84838a2664335d7e1582b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:40.344658 19207 leader_election.cc:290] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:40.384402 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:40.385418 16350 raft_consensus.cc:2468] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 4.
I20260709 13:06:40.381784 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:40.391489 16356 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41830 (request call id 1749) took 1272 ms. Trace:
I20260709 13:06:40.391942 16356 rpcz_store.cc:276] 0709 13:06:39.119172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:39.161480 (+ 42308us) service_pool.cc:224] Handling call
0709 13:06:39.161734 (+   254us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:39.709772 (+548038us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:39.709805 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:39.741430 (+ 31625us) log.cc:844] Serialized 26 byte log entry
0709 13:06:40.217707 (+476277us) spinlock_profiling.cc:243] Waited 2.87 ms on lock 0x7b1800144880. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f3625264de1 00007f36252715b1 00007f361c37ee07 00007f36251d9ab9 00007f361c39b69b 00007f361c39993f 00007f361c39bc02 00007f361f02320b 00007f361f028d23 00007f361f0290d1 00007f361f444a0f
0709 13:06:40.328251 (+110544us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:40.343777 (+ 15526us) log.cc:844] Serialized 14 byte log entry
0709 13:06:40.346042 (+  2265us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:40.346153 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:40.346210 (+    57us) raft_consensus.cc:1685] finished
0709 13:06:40.355104 (+  8894us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:40.391407 (+ 36303us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":577363,"prepare.queue_time_us":14110,"prepare.run_wall_time_us":1526,"raft.queue_time_us":570592,"raft.run_cpu_time_us":447,"raft.run_wall_time_us":17152,"spinlock_wait_cycles":10749696,"thread_start_us":110337,"threads_started":1,"wal-append.queue_time_us":580317}
I20260709 13:06:40.395859 19365 raft_consensus.cc:3055] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:40.396364 19365 raft_consensus.cc:740] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:40.397363 19365 consensus_queue.cc:260] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:40.355666 19401 raft_consensus.cc:493] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:40.359773 19263 raft_consensus.cc:515] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:40.396279 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:40.404141 16276 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8"
dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
mode: GRACEFUL
new_leader_uuid: "363bb2f744eb486f9ad726f08214c98e"
 from {username='slave'} at 127.0.0.1:39058
I20260709 13:06:40.404908 16276 raft_consensus.cc:606] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Received request to transfer leadership to TS 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:40.405319 16276 raft_consensus.cc:614] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:40.411613 16205 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60154 (request call id 1800) took 1438 ms. Trace:
I20260709 13:06:40.412187 16205 rpcz_store.cc:276] 0709 13:06:38.973675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:38.973840 (+   165us) service_pool.cc:224] Handling call
0709 13:06:40.411237 (+1437397us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b54003d1b54. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:06:40.411496 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2484483840}
I20260709 13:06:40.419229 19360 raft_consensus.cc:993] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3: : Instructing follower 363bb2f744eb486f9ad726f08214c98e to start an election
I20260709 13:06:40.420114 19321 raft_consensus.cc:1081] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 LEADER]: Signalling peer 363bb2f744eb486f9ad726f08214c98e to start an election
I20260709 13:06:40.421478 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:40.422865 19294 raft_consensus.cc:493] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:40.423512 19294 raft_consensus.cc:515] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:40.427747 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:40.430382 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:40.431193 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:40.432446 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:40.432089 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:40.437261 16354 raft_consensus.cc:2468] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 9.
I20260709 13:06:40.433701 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:40.438599 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:40.438982 16352 raft_consensus.cc:2468] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 8.
I20260709 13:06:40.439136 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:40.439275 16942 raft_consensus.cc:2468] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 9.
I20260709 13:06:40.432278 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:40.440100 16947 raft_consensus.cc:2468] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 7.
I20260709 13:06:40.432740 19365 raft_consensus.cc:3060] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:40.431444 16200 raft_consensus.cc:2468] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 8.
I20260709 13:06:40.442726 16351 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33486 (request call id 313) took 1539 ms. Trace:
I20260709 13:06:40.435164 16246 leader_election.cc:400] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 election: Vote denied by peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073) with higher term. Message: Invalid argument: T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 6. Current term is 7.
I20260709 13:06:40.443616 16246 leader_election.cc:403] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:06:40.443181 16351 rpcz_store.cc:276] 0709 13:06:38.903112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:38.905228 (+  2116us) service_pool.cc:224] Handling call
0709 13:06:38.905787 (+   559us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:38.906414 (+   627us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:38.906463 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:38.907316 (+   853us) log.cc:844] Serialized 26 byte log entry
0709 13:06:39.000126 (+ 92810us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:39.034768 (+ 34642us) log.cc:844] Serialized 14 byte log entry
0709 13:06:39.637229 (+602461us) spinlock_profiling.cc:243] Waited 4.39 ms on lock 0x7b1800432be0. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f3625264de1 00007f36252715b1 00007f361c316c0a 00007f3625a56219 00007f361c39ea40 00007f361c3994e4 00007f361c399455 00007f361f481060 00007f361f493716 00007f361f4a4287 00007f361f4a4208
0709 13:06:39.637426 (+   197us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:39.637510 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:40.410340 (+772830us) spinlock_profiling.cc:243] Waited 8.06 ms on lock 0x7b1800432be0. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f3625264de1 00007f36252715b1 00007f361c39c3f3 00007f361c39e7c1 00007f361c39e779 00007f361c39e709 00007f361c39e6d1 00007f361c39d9cd 000000000038f354 000000000038f199 00007f361c37f83a
0709 13:06:40.442499 (+ 32159us) raft_consensus.cc:1685] finished
0709 13:06:40.442522 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:40.442669 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31847,"prepare.queue_time_us":37219,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":55,"raft.queue_time_us":605147,"raft.run_cpu_time_us":300,"raft.run_wall_time_us":301,"spinlock_wait_cycles":28617984,"thread_start_us":92297,"threads_started":1,"wal-append.queue_time_us":202157}
I20260709 13:06:40.448827 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:40.450814 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:40.451104 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:40.456092 16246 leader_election.cc:304] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:40.457724 16246 leader_election.cc:304] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:40.435810 19384 raft_consensus.cc:493] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:40.461453 16276 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b"
dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
mode: GRACEFUL
new_leader_uuid: "363bb2f744eb486f9ad726f08214c98e"
 from {username='slave'} at 127.0.0.1:39058
I20260709 13:06:40.467167 16276 raft_consensus.cc:606] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Received request to transfer leadership to TS 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:40.467558 16276 raft_consensus.cc:614] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:40.463856 16351 raft_consensus.cc:1240] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 7. Current term is 8. Ops: [5.4-7.5]
I20260709 13:06:40.450373 19321 raft_consensus.cc:2749] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073) with higher term. Message: Invalid argument: T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 6. Current term is 7.
I20260709 13:06:40.473313 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:40.442216 16940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:40.460327 19320 consensus_queue.cc:1059] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 13:06:40.476358 16206 raft_consensus.cc:1240] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 6. Current term is 7. Ops: []
W20260709 13:06:40.476696 19414 log.cc:927] Time spent T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.141s	user 0.002s	sys 0.000s
I20260709 13:06:40.476621 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:40.478194 19374 raft_consensus.cc:493] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:40.481174 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:40.482276 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:06:40.482963 16248 leader_election.cc:304] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:40.438129 19401 raft_consensus.cc:515] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:40.500383 16283 raft_consensus.cc:1275] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:06:40.502529 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:40.466257 18971 raft_consensus.cc:2804] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:40.453586 19263 leader_election.cc:290] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:40.511179 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:40.466073 18957 raft_consensus.cc:2804] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:40.512665 16276 raft_consensus.cc:2410] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:06:40.511179 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:40.513835 19295 raft_consensus.cc:493] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:40.514685 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:40.473593 19207 raft_consensus.cc:493] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:40.517761 16248 leader_election.cc:304] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:06:40.519312 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:40.520391 16320 leader_election.cc:400] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 pre-election: Vote denied by peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073) with higher term. Message: Invalid argument: T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for earlier term 7. Current term is 8.
I20260709 13:06:40.521844 16320 leader_election.cc:403] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:40.514760 16357 raft_consensus.cc:1275] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:06:40.520617 16354 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157"
dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
 from {username='slave'} at 127.0.0.1:41830
I20260709 13:06:40.495041 16351 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "16a307cee8ef431184c620fec029af19"
dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
 from {username='slave'} at 127.0.0.1:41830
I20260709 13:06:40.538815 16354 raft_consensus.cc:493] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:40.539290 16354 raft_consensus.cc:3060] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:40.538854 16351 raft_consensus.cc:493] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:40.541785 16351 raft_consensus.cc:3060] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:40.515726 18971 raft_consensus.cc:493] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:40.553664 18971 raft_consensus.cc:3060] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:40.511456 19092 raft_consensus.cc:493] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:40.495519 16940 raft_consensus.cc:2468] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 4.
I20260709 13:06:40.516005 18957 raft_consensus.cc:493] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
W20260709 13:06:40.567962 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 50312us
I20260709 13:06:40.524892 19360 raft_consensus.cc:2749] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:40.570086 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:40.564354 16354 raft_consensus.cc:515] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:40.574733 18957 raft_consensus.cc:3060] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:40.595728 16248 leader_election.cc:304] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:40.597728 16248 leader_election.cc:304] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:06:40.575161 19321 raft_consensus.cc:2804] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:40.523418 19295 raft_consensus.cc:515] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:40.532979 19207 raft_consensus.cc:515] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:40.520298 19265 raft_consensus.cc:493] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:40.523718 19263 raft_consensus.cc:493] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:40.545270 19281 raft_consensus.cc:3060] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:06:40.580444 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:40.612066 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:40.612732 16202 raft_consensus.cc:3060] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:40.580225 19092 raft_consensus.cc:515] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:40.603641 16248 leader_election.cc:304] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:06:40.591367 16351 raft_consensus.cc:515] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:40.610636 16354 leader_election.cc:290] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:40.622908 16248 leader_election.cc:304] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:40.612286 19320 raft_consensus.cc:2804] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:40.628763 16279 raft_consensus.cc:1275] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:06:40.630403 19207 leader_election.cc:290] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:40.515856 19374 raft_consensus.cc:515] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:40.634651 19363 raft_consensus.cc:2804] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:40.635233 19363 raft_consensus.cc:493] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:40.635599 19363 raft_consensus.cc:3060] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:40.608237 19388 raft_consensus.cc:2749] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:40.508194 19384 raft_consensus.cc:515] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:40.648324 16205 raft_consensus.cc:1275] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:06:40.630472 16351 leader_election.cc:290] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:40.652122 16248 leader_election.cc:304] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:40.626428 19265 raft_consensus.cc:515] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:40.628791 19320 raft_consensus.cc:493] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:40.655190 19400 raft_consensus.cc:493] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:40.655839 19400 raft_consensus.cc:515] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:40.656445 19092 leader_election.cc:290] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:40.658074 19400 leader_election.cc:290] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:40.659286 19401 leader_election.cc:290] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:40.660436 19374 leader_election.cc:290] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:40.604795 19321 raft_consensus.cc:493] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:40.661541 19321 raft_consensus.cc:3060] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:40.621584 19380 raft_consensus.cc:493] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:40.664754 19380 raft_consensus.cc:515] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:40.646829 19263 raft_consensus.cc:515] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:40.668880 19263 leader_election.cc:290] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:40.679143 16202 raft_consensus.cc:2468] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 3.
W20260709 13:06:40.683038 16248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:40.691552 16248 leader_election.cc:304] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:06:40.655212 19320 raft_consensus.cc:3060] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:40.694657 16351 raft_consensus.cc:1275] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:06:40.695525 16248 leader_election.cc:304] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:40.699584 16248 leader_election.cc:304] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:40.675800 19189 raft_consensus.cc:493] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:40.708531 16275 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7"
dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
mode: GRACEFUL
new_leader_uuid: "363bb2f744eb486f9ad726f08214c98e"
 from {username='slave'} at 127.0.0.1:39058
I20260709 13:06:40.709518 16275 raft_consensus.cc:606] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Received request to transfer leadership to TS 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:40.709983 16275 raft_consensus.cc:614] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:40.702816 18909 raft_consensus.cc:2749] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:06:40.712883 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 207629us
I20260709 13:06:40.711172 19390 raft_consensus.cc:2749] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:40.716141 19364 raft_consensus.cc:2749] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:40.700356 19359 raft_consensus.cc:2804] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:40.723301 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:40.726948 16914 leader_election.cc:304] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:40.730463 15057 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:06:40.741926 19380 leader_election.cc:290] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:40.744751 18957 raft_consensus.cc:515] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } }
I20260709 13:06:40.746044 16283 raft_consensus.cc:1240] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 9. Current term is 10. Ops: []
W20260709 13:06:40.747896 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:40.773180 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:40.722335 19360 raft_consensus.cc:493] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:40.732031 19359 raft_consensus.cc:493] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:40.711107 19189 raft_consensus.cc:515] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:06:40.788757 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 164113us
I20260709 13:06:40.767138 19288 raft_consensus.cc:2749] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:40.788759 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:40.790912 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:40.792145 16202 raft_consensus.cc:3060] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:40.795953 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:40.778927 19342 raft_consensus.cc:493] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:40.799171 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:40.783499 19359 raft_consensus.cc:3060] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:06:40.794907 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 176549us
I20260709 13:06:40.807717 16202 raft_consensus.cc:2468] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 8.
I20260709 13:06:40.797791 19389 raft_consensus.cc:2749] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:40.817745 19401 raft_consensus.cc:493] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:40.818498 19401 raft_consensus.cc:515] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:40.822281 18957 leader_election.cc:290] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:40.824056 19384 leader_election.cc:290] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:40.789901 19265 leader_election.cc:290] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:40.844796 19189 leader_election.cc:290] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:40.844583 19359 raft_consensus.cc:515] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:40.847051 19359 leader_election.cc:290] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:40.850978 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:40.856465 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:06:40.857156 16947 raft_consensus.cc:3060] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:06:40.859993 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 58205.2us
I20260709 13:06:40.861032 16320 leader_election.cc:304] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:40.858399 19342 raft_consensus.cc:515] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:40.877326 19427 raft_consensus.cc:2804] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:40.783872 19360 raft_consensus.cc:515] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:40.878307 19427 raft_consensus.cc:697] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 3 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:06:40.879750 16940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:40.886315 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:40.886741 16940 raft_consensus.cc:2468] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 5.
I20260709 13:06:40.887009 19427 consensus_queue.cc:237] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:06:40.994084 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 102572us
I20260709 13:06:40.892674 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:40.894449 16248 leader_election.cc:304] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
W20260709 13:06:41.008662 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 114332us
I20260709 13:06:40.889248 19360 leader_election.cc:290] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:41.016767 16320 leader_election.cc:304] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:40.878400 19342 leader_election.cc:290] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:41.031061 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:41.031430 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:41.039157 16204 raft_consensus.cc:1275] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:06:40.890647 19281 raft_consensus.cc:2749] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073) with higher term. Message: Invalid argument: T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for earlier term 7. Current term is 8.
I20260709 13:06:41.044893 19085 raft_consensus.cc:2804] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:41.044970 16199 raft_consensus.cc:2393] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 7: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:06:40.865895 18971 raft_consensus.cc:515] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:41.012663 18957 raft_consensus.cc:493] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:41.012872 19379 raft_consensus.cc:493] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:41.012517 18909 raft_consensus.cc:2804] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:41.081540 16947 raft_consensus.cc:2468] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 8.
I20260709 13:06:41.014672 19426 raft_consensus.cc:493] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:40.885535 19320 raft_consensus.cc:515] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:41.094841 16248 leader_election.cc:304] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:06:41.071198 19380 raft_consensus.cc:493] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:40.891776 19363 raft_consensus.cc:515] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:41.099203 19294 leader_election.cc:290] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:41.087098 19085 raft_consensus.cc:697] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 8 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:06:41.102730 16274 raft_consensus.cc:2368] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for earlier term 8. Current term is 9.
W20260709 13:06:41.123991 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 83049.1us
I20260709 13:06:41.124752 19359 raft_consensus.cc:493] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:41.125537 19359 raft_consensus.cc:515] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:41.128780 19431 consensus_queue.cc:1048] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:41.129897 19359 leader_election.cc:290] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:41.131130 19085 consensus_queue.cc:237] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:41.091342 18909 raft_consensus.cc:493] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:41.087464 18957 raft_consensus.cc:515] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:41.111104 19360 raft_consensus.cc:2804] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:41.141731 19363 leader_election.cc:290] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:41.146781 19320 leader_election.cc:290] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 election: Requested vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:41.148067 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:06:41.161883 16947 raft_consensus.cc:3060] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:41.149312 19401 leader_election.cc:290] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:06:41.133639 16173 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 1.725s (SENT) [suppressed 9 similar messages]
I20260709 13:06:41.093668 19379 raft_consensus.cc:515] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:41.136691 18909 raft_consensus.cc:3060] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:41.115545 19380 raft_consensus.cc:515] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:41.107833 19426 raft_consensus.cc:515] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:41.182534 16947 raft_consensus.cc:2468] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 10.
W20260709 13:06:41.176450 19321 consensus_meta.cc:287] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3: Time spent flushing consensus metadata: real 0.511s	user 0.009s	sys 0.003s
I20260709 13:06:41.169952 19360 raft_consensus.cc:697] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:41.188068 16248 leader_election.cc:304] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:06:41.216310 18971 leader_election.cc:290] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:41.199915 19398 raft_consensus.cc:493] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:41.217478 19398 raft_consensus.cc:515] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:06:41.220652 16248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:41.191386 19363 raft_consensus.cc:2804] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:41.227375 19363 raft_consensus.cc:697] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:41.228323 19363 consensus_queue.cc:237] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:41.236480 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:41.241938 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:06:41.247805 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:41.248303 16281 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45218 (request call id 1755) took 1270 ms. Trace:
I20260709 13:06:41.257750 19360 consensus_queue.cc:237] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:41.261291 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:41.248739 16281 rpcz_store.cc:276] 0709 13:06:39.978401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:39.978532 (+   131us) service_pool.cc:224] Handling call
0709 13:06:39.978883 (+   351us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:40.030871 (+ 51988us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:40.030922 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:40.034299 (+  3377us) log.cc:844] Serialized 26 byte log entry
0709 13:06:40.159825 (+125526us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:40.159887 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:41.247880 (+1087993us) spinlock_profiling.cc:243] Waited 49.4 ms on lock 0x7b540004db54. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f489e01 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6
0709 13:06:41.247946 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:41.247989 (+    43us) raft_consensus.cc:1685] finished
0709 13:06:41.248002 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:41.248229 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":120,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":4646,"spinlock_wait_cycles":113705216,"thread_start_us":109487,"threads_started":1,"wal-append.queue_time_us":122107,"wal-append.run_cpu_time_us":2022,"wal-append.run_wall_time_us":1008415}
I20260709 13:06:41.190456 19321 raft_consensus.cc:515] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:41.288960 16208 raft_consensus.cc:2468] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 8.
I20260709 13:06:41.278146 19243 raft_consensus.cc:493] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:41.307807 19373 raft_consensus.cc:493] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:41.313957 19342 raft_consensus.cc:493] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:41.343161 19261 leader_election.cc:290] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:41.322245 19379 leader_election.cc:290] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:41.327512 18957 leader_election.cc:290] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:41.358565 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:41.362824 16207 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60138 (request call id 1921) took 1055 ms. Trace:
I20260709 13:06:41.361157 19321 leader_election.cc:290] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 election: Requested vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:41.347716 19373 raft_consensus.cc:515] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:41.380739 19373 leader_election.cc:290] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:41.329445 19243 raft_consensus.cc:515] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:41.383047 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:41.369938 19426 leader_election.cc:290] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:41.353435 19386 raft_consensus.cc:493] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:41.385790 19386 raft_consensus.cc:515] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:41.389945 19386 leader_election.cc:290] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:41.402853 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:41.403474 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:41.404027 16203 raft_consensus.cc:1240] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:41.404155 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:41.404702 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:41.405290 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:41.373227 19380 leader_election.cc:290] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:41.376302 15057 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:41.348452 19342 raft_consensus.cc:515] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:41.412743 16914 leader_election.cc:304] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:41.363214 16207 rpcz_store.cc:276] 0709 13:06:40.307137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.358238 (+1051101us) service_pool.cc:224] Handling call
0709 13:06:41.362757 (+  4519us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:41.428853 19270 raft_consensus.cc:2749] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:41.413573 19342 leader_election.cc:290] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:41.415287 19400 raft_consensus.cc:493] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:41.421289 18810 raft_consensus.cc:3055] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:41.430840 18810 raft_consensus.cc:740] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:41.430858 19400 raft_consensus.cc:515] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:41.432247 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:41.433161 16348 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41830 (request call id 1767) took 1065 ms. Trace:
I20260709 13:06:41.391577 19243 leader_election.cc:290] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:41.433507 19400 leader_election.cc:290] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:41.433528 16348 rpcz_store.cc:276] 0709 13:06:40.367792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:40.397503 (+ 29711us) service_pool.cc:224] Handling call
0709 13:06:41.432071 (+1034568us) spinlock_profiling.cc:243] Waited 23.4 ms on lock 0x7b5800024698. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361c224db1 00007f361c364b71 00007f361c364a22 00007f362527dc09 00007f36243d7ee0 00007f36244a10ab 00007f36244a1131 00007f362444f0a0 00007f362444e984 00007f361d9c96d4 00007f361d9c9662
0709 13:06:41.433093 (+  1022us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":53766912}
I20260709 13:06:41.432332 18810 consensus_queue.cc:260] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:06:41.437306 19430 log.cc:927] Time spent T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.340s	user 0.002s	sys 0.001s
I20260709 13:06:41.443248 19302 consensus_queue.cc:1059] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:41.444459 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:41.445708 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:41.446372 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:41.444886 19302 raft_consensus.cc:3055] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:41.446514 16201 raft_consensus.cc:2393] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 10: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:06:41.447814 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:41.450079 16322 leader_election.cc:304] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:41.448110 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c15d8e9be8414c84912ab77b66bfb1" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:41.452028 19304 raft_consensus.cc:2749] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:41.452807 19304 consensus_queue.cc:1048] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:41.452236 16322 leader_election.cc:304] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:41.454483 19304 raft_consensus.cc:2749] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:41.454751 16322 leader_election.cc:304] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:41.455999 19203 raft_consensus.cc:2749] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:41.457119 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:41.448278 19302 raft_consensus.cc:740] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:41.459391 19302 consensus_queue.cc:260] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:41.460858 19302 raft_consensus.cc:3060] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:41.465634 16322 leader_election.cc:400] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 election: Vote denied by peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823) with higher term. Message: Invalid argument: T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for earlier term 8. Current term is 9.
I20260709 13:06:41.467445 19189 consensus_queue.cc:1059] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:41.467968 16946 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40078 (request call id 269) took 1038 ms. Trace:
I20260709 13:06:41.468590 16322 leader_election.cc:304] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:06:41.469647 19076 raft_consensus.cc:2749] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:06:41.469923 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:41.470882 16349 raft_consensus.cc:2468] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 10.
I20260709 13:06:41.460923 18909 raft_consensus.cc:515] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:41.463415 19401 consensus_queue.cc:1048] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:41.442209 19295 leader_election.cc:290] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:41.468418 16946 rpcz_store.cc:276] 0709 13:06:40.429579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:40.430203 (+   624us) service_pool.cc:224] Handling call
0709 13:06:40.430456 (+   253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:40.645763 (+215307us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:40.645806 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:40.645849 (+    43us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:40.645881 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:41.467710 (+821829us) spinlock_profiling.cc:243] Waited 215 ms on lock 0x7b540006b3d4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f489e01 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6
0709 13:06:41.467760 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:41.467905 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":494501632}
I20260709 13:06:41.474833 16350 raft_consensus.cc:1240] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:41.475106 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:41.477106 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:41.483194 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:41.483908 16348 raft_consensus.cc:2468] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 6.
I20260709 13:06:41.475862 16246 leader_election.cc:304] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:41.485289 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:06:41.479621 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 346004us
I20260709 13:06:41.485848 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:41.480409 16349 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41830 (request call id 1765) took 1104 ms. Trace:
I20260709 13:06:41.324290 19221 raft_consensus.cc:3060] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:41.488550 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:41.492256 16356 raft_consensus.cc:2468] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 7.
I20260709 13:06:41.488593 16200 raft_consensus.cc:2393] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 8: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:06:41.487398 16349 rpcz_store.cc:276] 0709 13:06:40.367137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:40.389711 (+ 22574us) service_pool.cc:224] Handling call
0709 13:06:41.469586 (+1079875us) spinlock_profiling.cc:243] Waited 8.01 ms on lock 0x7b5800024698. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361c224db1 00007f361c364b71 00007f361c364a22 00007f362527dc09 00007f36243d7ee0 00007f36244a10ab 00007f36244a1131 00007f362444f0a0 00007f362444e984 00007f361d9c96d4 00007f361d9c9662
0709 13:06:41.471466 (+  1880us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18413952}
I20260709 13:06:41.492483 16354 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41832 (request call id 1715) took 1015 ms. Trace:
I20260709 13:06:41.486056 16348 raft_consensus.cc:2468] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 4.
I20260709 13:06:41.497154 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:41.497195 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:41.498235 16278 raft_consensus.cc:3055] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:41.498848 16278 raft_consensus.cc:740] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:41.497575 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:41.500403 16275 raft_consensus.cc:3055] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:41.500756 16275 raft_consensus.cc:740] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:41.504182 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:41.504004 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:41.505262 16947 raft_consensus.cc:2468] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 4.
I20260709 13:06:41.494577 16354 rpcz_store.cc:276] 0709 13:06:40.476701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:40.630860 (+154159us) service_pool.cc:224] Handling call
0709 13:06:40.631265 (+   405us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:40.774859 (+143594us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:40.774896 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:40.783905 (+  9009us) log.cc:844] Serialized 26 byte log entry
0709 13:06:41.043147 (+259242us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:41.082121 (+ 38974us) log.cc:844] Serialized 14 byte log entry
0709 13:06:41.083147 (+  1026us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:41.083259 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:41.436682 (+353423us) spinlock_profiling.cc:243] Waited 5.05 ms on lock 0x7b4400022b4c. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361c224db1 00007f361c2c2c85 00007f361c2c36a2 00007f361f0351db 00007f361f030aaf 00007f361f02486e 00007f361f023bb6 00007f361f0237d8 00007f361f02d221 00007f361f02d1d9 00007f361f02d169
0709 13:06:41.490990 (+ 54308us) raft_consensus.cc:1685] finished
0709 13:06:41.492212 (+  1222us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:41.492386 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31434,"prepare.queue_time_us":38503,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":46,"raft.queue_time_us":25858,"raft.run_cpu_time_us":271,"raft.run_wall_time_us":13312,"spinlock_wait_cycles":11617152,"thread_start_us":340004,"threads_started":2,"wal-append.queue_time_us":274294}
I20260709 13:06:41.508342 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:41.491101 19380 raft_consensus.cc:2804] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:41.511668 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:41.508193 16278 consensus_queue.cc:260] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:41.512513 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:41.506150 16275 consensus_queue.cc:260] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:41.518882 16278 raft_consensus.cc:3060] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:41.522176 16947 raft_consensus.cc:1240] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:06:41.525048 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:41.534191 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:41.535250 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:41.536172 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:41.538880 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:41.541059 16281 raft_consensus.cc:1240] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:41.542138 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:41.545234 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:41.546801 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:41.547514 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:41.541712 16946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:41.548971 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:41.548110 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:41.558976 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:41.566363 16940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:41.543442 19380 raft_consensus.cc:697] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:41.575032 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:41.576102 16352 raft_consensus.cc:3060] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:41.576785 19380 consensus_queue.cc:237] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:41.581161 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:41.496214 19426 consensus_queue.cc:1048] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 13:06:41.588280 16353 raft_consensus.cc:1275] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:06:41.588750 19265 consensus_queue.cc:1059] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:06:41.592166 19425 raft_consensus.cc:3055] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:41.593215 19425 raft_consensus.cc:740] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:06:41.597095 19398 leader_election.cc:290] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:41.609157 16275 raft_consensus.cc:3060] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:41.615149 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c15d8e9be8414c84912ab77b66bfb1" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:41.619956 16914 leader_election.cc:304] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:41.623448 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:41.625833 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:41.632498 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:41.633409 16353 raft_consensus.cc:2468] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 10.
I20260709 13:06:41.647178 16352 raft_consensus.cc:2468] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 7.
I20260709 13:06:41.655311 18909 leader_election.cc:290] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:06:41.669512 19436 log.cc:927] Time spent T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.177s	user 0.008s	sys 0.000s
I20260709 13:06:41.691859 19270 raft_consensus.cc:2804] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:41.692507 19270 raft_consensus.cc:493] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:41.692972 19270 raft_consensus.cc:3060] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:41.700590 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:41.702973 16278 raft_consensus.cc:2468] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 3.
I20260709 13:06:41.703696 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:41.710770 16348 raft_consensus.cc:2468] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 8.
I20260709 13:06:41.713116 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:41.714864 16275 raft_consensus.cc:2468] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 8.
I20260709 13:06:41.631028 19076 raft_consensus.cc:3055] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:06:41.730022 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 445133us
W20260709 13:06:41.731181 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 239171us
W20260709 13:06:41.736742 16248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:41.736881 16246 leader_election.cc:304] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:41.738036 18909 raft_consensus.cc:2749] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:41.740866 16940 raft_consensus.cc:1275] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:06:41.744467 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:06:41.745394 16942 raft_consensus.cc:3060] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:41.718327 19076 raft_consensus.cc:740] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:06:41.748513 16207 raft_consensus.cc:1240] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:41.605024 19425 consensus_queue.cc:260] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:41.761477 16352 raft_consensus.cc:1240] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 3 LEADER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:41.762001 16349 raft_consensus.cc:1240] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:41.762923 18909 raft_consensus.cc:493] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:41.763453 19359 raft_consensus.cc:493] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:41.764153 19389 raft_consensus.cc:493] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:41.766849 19243 raft_consensus.cc:493] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:41.766774 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:41.790979 16274 raft_consensus.cc:3060] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:41.792928 16942 raft_consensus.cc:2468] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 5.
I20260709 13:06:41.767594 19388 raft_consensus.cc:493] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:41.770287 16275 raft_consensus.cc:1240] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:41.771502 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:41.775266 16281 raft_consensus.cc:1240] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:06:41.780758 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:41.781347 16355 raft_consensus.cc:1240] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 8 LEADER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:41.781596 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:41.779210 18909 raft_consensus.cc:515] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:41.782634 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:41.783506 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:41.744575 19321 raft_consensus.cc:493] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:41.786778 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:41.789916 19243 raft_consensus.cc:515] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:41.761202 16348 raft_consensus.cc:2468] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 10.
I20260709 13:06:41.829053 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:41.802716 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:41.805877 16357 raft_consensus.cc:3060] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:41.777189 16946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:06:41.810353 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
W20260709 13:06:41.813128 16914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:41.833480 16355 raft_consensus.cc:3060] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:41.812374 16274 raft_consensus.cc:2468] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 10.
I20260709 13:06:41.814630 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:41.835632 16279 raft_consensus.cc:3060] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:41.815116 16277 raft_consensus.cc:2468] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 7.
I20260709 13:06:41.774399 16248 leader_election.cc:304] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:41.820787 19302 raft_consensus.cc:493] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:41.820801 19076 consensus_queue.cc:260] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } }
I20260709 13:06:41.821915 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:41.826668 19388 raft_consensus.cc:515] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:06:41.837091 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 62792.5us
I20260709 13:06:41.843766 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:41.853688 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:41.854367 16348 raft_consensus.cc:3060] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:41.817565 19425 raft_consensus.cc:3060] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:41.866952 16914 leader_election.cc:304] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:41.868453 16914 leader_election.cc:304] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:41.869837 16914 leader_election.cc:304] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:41.780844 19359 raft_consensus.cc:515] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:41.864244 19076 raft_consensus.cc:3060] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:41.904691 18909 leader_election.cc:290] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:41.907217 18810 raft_consensus.cc:3060] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:41.908746 19388 leader_election.cc:290] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:41.852717 19302 raft_consensus.cc:515] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:41.874348 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c15d8e9be8414c84912ab77b66bfb1" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:41.874819 19420 raft_consensus.cc:2804] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:41.875180 19373 raft_consensus.cc:2749] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:41.878024 19386 raft_consensus.cc:2804] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:41.880268 19243 leader_election.cc:290] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:06:41.864754 19203 consensus_queue.cc:1175] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" responder_term: 9 status { last_received { term: 9 index: 5 } last_committed_idx: 5 last_received_current_leader { term: 9 index: 5 } }
I20260709 13:06:41.882599 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:41.838666 19221 raft_consensus.cc:2749] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:41.831377 19321 raft_consensus.cc:515] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:41.797647 19389 raft_consensus.cc:515] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:41.911455 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:41.939998 16282 raft_consensus.cc:1275] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:06:41.940712 16351 raft_consensus.cc:2393] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 10: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:06:41.942502 16352 raft_consensus.cc:2393] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 8: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:06:41.942416 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:41.912101 16279 raft_consensus.cc:2468] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 8.
W20260709 13:06:41.913446 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 53507us
I20260709 13:06:41.924427 19420 raft_consensus.cc:493] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:41.916970 16278 raft_consensus.cc:1240] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:41.920077 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:41.923355 16355 raft_consensus.cc:2468] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 10.
I20260709 13:06:41.924569 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c15d8e9be8414c84912ab77b66bfb1" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:41.916054 16357 raft_consensus.cc:2468] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 9.
I20260709 13:06:41.933971 16348 raft_consensus.cc:2468] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 5.
I20260709 13:06:41.934177 16275 raft_consensus.cc:1275] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:06:41.924237 19386 raft_consensus.cc:493] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:41.954356 19302 leader_election.cc:290] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:41.959983 16207 raft_consensus.cc:1275] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:41.935590 19270 raft_consensus.cc:515] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:41.975740 16322 leader_election.cc:304] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:41.955260 19359 leader_election.cc:290] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:41.980895 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:41.981484 16322 leader_election.cc:304] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:41.981688 16281 raft_consensus.cc:2468] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 7.
I20260709 13:06:41.965777 19386 raft_consensus.cc:3060] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:41.964416 19420 raft_consensus.cc:3060] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:41.986497 19076 raft_consensus.cc:2804] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:41.979197 19432 consensus_queue.cc:1048] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
W20260709 13:06:41.987959 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 432387us
I20260709 13:06:41.991870 16322 leader_election.cc:304] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:06:42.010843 16247 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:42.014112 16322 leader_election.cc:304] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:42.017629 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:41.979553 18957 raft_consensus.cc:493] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:42.026252 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:42.026966 16277 raft_consensus.cc:2468] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 7.
I20260709 13:06:42.027096 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:42.027681 16278 raft_consensus.cc:2468] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 10.
I20260709 13:06:42.033772 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:42.034740 16275 raft_consensus.cc:2468] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 2.
I20260709 13:06:41.987251 19076 raft_consensus.cc:493] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:42.039906 16349 raft_consensus.cc:2468] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 10.
I20260709 13:06:41.992950 19295 raft_consensus.cc:2749] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:42.054651 16207 raft_consensus.cc:1275] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:06:42.056583 16322 leader_election.cc:304] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:42.022794 19189 raft_consensus.cc:2749] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:42.059509 16322 leader_election.cc:304] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:06:42.062270 16322 leader_election.cc:304] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:06:42.063390 19185 raft_consensus.cc:2749] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:42.062414 16283 raft_consensus.cc:1275] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:06:42.064960 16283 pending_rounds.cc:85] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3: Aborting all ops after (but not including) 4
I20260709 13:06:42.065951 16283 pending_rounds.cc:107] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:06:42.065605 19271 consensus_queue.cc:1059] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:42.067591 16283 raft_consensus.cc:2889] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:42.046221 19076 raft_consensus.cc:3060] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:42.070232 16322 leader_election.cc:304] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:42.042675 19398 raft_consensus.cc:2749] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:42.016184 19365 consensus_queue.cc:1059] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:06:42.107491 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:42.109757 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:42.111091 16283 raft_consensus.cc:2468] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 9.
I20260709 13:06:42.033401 18957 raft_consensus.cc:515] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:06:42.115134 19440 log.cc:927] Time spent T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.149s	user 0.000s	sys 0.000s
I20260709 13:06:42.116777 18957 leader_election.cc:290] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:42.117512 16279 raft_consensus.cc:2468] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 4.
W20260709 13:06:42.124138 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 53984.6us
I20260709 13:06:42.125607 19261 raft_consensus.cc:3055] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:42.126108 19261 raft_consensus.cc:740] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:42.127511 19271 raft_consensus.cc:2749] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:42.060349 19401 raft_consensus.cc:2749] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:42.068574 19321 leader_election.cc:290] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:42.130579 16322 leader_election.cc:304] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:06:42.167271 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 150913us
I20260709 13:06:42.097318 19427 consensus_queue.cc:1048] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
W20260709 13:06:42.173754 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 320795us
I20260709 13:06:42.183293 16173 leader_election.cc:304] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:42.184803 16248 leader_election.cc:304] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:06:42.186748 18957 raft_consensus.cc:2804] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:42.187551 18957 raft_consensus.cc:697] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:42.188519 18957 consensus_queue.cc:237] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:42.188781 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:42.174778 19401 raft_consensus.cc:2764] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
W20260709 13:06:42.192297 16321 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:42.192684 16946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:42.196893 16322 leader_election.cc:304] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:42.189529 19264 consensus_queue.cc:1048] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.011s
W20260709 13:06:42.202342 19441 log.cc:927] Time spent T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.211s	user 0.003s	sys 0.000s
I20260709 13:06:42.203039 19264 raft_consensus.cc:2749] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:42.177484 19270 leader_election.cc:290] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 7 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:42.177567 19389 leader_election.cc:290] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:42.233578 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:42.212277 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:42.180974 19443 consensus_queue.cc:1048] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.025s
W20260709 13:06:42.208693 19444 log.cc:927] Time spent T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
W20260709 13:06:42.209772 19445 log.cc:927] Time spent T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 13:06:42.190229 19360 consensus_queue.cc:1048] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 13:06:42.221330 16274 raft_consensus.cc:2468] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 8.
I20260709 13:06:42.234354 16942 raft_consensus.cc:2468] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 11.
W20260709 13:06:42.237545 16249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:42.238408 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 55180.4us
I20260709 13:06:42.245270 16947 raft_consensus.cc:1275] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:06:42.257689 16946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:42.258883 16280 raft_consensus.cc:2393] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 in current term 6: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:06:42.264441 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:42.266644 16106 catalog_manager.cc:5697] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e reported cstate change: term changed from 1 to 9, leader changed from e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) to 363bb2f744eb486f9ad726f08214c98e (127.14.180.67). New cstate: current_term: 9 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:42.236093 19380 raft_consensus.cc:493] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:42.275403 19380 raft_consensus.cc:515] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:42.190321 19261 consensus_queue.cc:260] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:42.279636 19261 raft_consensus.cc:3060] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:06:42.283047 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 64903.1us
W20260709 13:06:42.258986 16246 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:42.288873 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 53459.9us
I20260709 13:06:42.306532 16280 raft_consensus.cc:1275] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:06:42.278383 19380 leader_election.cc:290] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:42.311712 16246 leader_election.cc:304] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:42.330847 16204 raft_consensus.cc:1240] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:42.332235 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:42.333578 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:42.334928 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:42.336230 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:42.336846 16208 raft_consensus.cc:2468] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 10.
I20260709 13:06:42.338161 16208 raft_consensus.cc:1275] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:06:42.339337 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:42.340636 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:42.342108 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:42.322204 19386 raft_consensus.cc:515] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:42.348567 19427 raft_consensus.cc:2749] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:06:42.375927 19436 log.cc:927] Time spent T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:06:42.320652 19452 raft_consensus.cc:2749] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:42.299490 19385 consensus_queue.cc:1048] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 13:06:42.315986 19433 raft_consensus.cc:493] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:42.283124 19076 raft_consensus.cc:515] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:42.305258 19363 raft_consensus.cc:493] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:42.305505 19387 raft_consensus.cc:493] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
W20260709 13:06:42.432161 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 129611us
I20260709 13:06:42.436529 19426 raft_consensus.cc:3055] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:06:42.439877 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 122729us
I20260709 13:06:42.444790 16246 leader_election.cc:304] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:42.417346 15057 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:42.459769 16173 leader_election.cc:304] T b9e1324823f04d8da5a4b3ddbd061c0e P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:42.448638 19433 raft_consensus.cc:515] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:42.473611 16914 leader_election.cc:304] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:42.463816 19426 raft_consensus.cc:740] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:06:42.474659 18957 raft_consensus.cc:2804] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:42.498452 19270 raft_consensus.cc:3060] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:42.487371 16106 catalog_manager.cc:5697] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e reported cstate change: term changed from 7 to 9, leader changed from 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) to 363bb2f744eb486f9ad726f08214c98e (127.14.180.67). New cstate: current_term: 9 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:42.455171 19363 raft_consensus.cc:515] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:42.504345 16106 catalog_manager.cc:5697] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "1109f76a0b7b443a84c0327c8707bc63" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:06:42.509332 16173 leader_election.cc:304] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:42.519299 16106 catalog_manager.cc:5697] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e reported cstate change: term changed from 5 to 6, leader changed from 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) to e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65). New cstate: current_term: 6 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:06:42.483338 19185 raft_consensus.cc:2749] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:42.476802 19389 consensus_queue.cc:1048] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:06:42.472576 19420 raft_consensus.cc:515] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:42.507428 19400 raft_consensus.cc:493] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:42.586931 19400 raft_consensus.cc:515] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:42.502972 18957 raft_consensus.cc:493] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:42.589601 18957 raft_consensus.cc:3060] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:42.589983 19400 leader_election.cc:290] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:42.507349 19264 raft_consensus.cc:2749] T b9e1324823f04d8da5a4b3ddbd061c0e P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:42.469542 19387 raft_consensus.cc:515] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:42.603142 19387 leader_election.cc:290] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:42.552093 16102 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38840 (request call id 195) took 7426 ms. Trace:
I20260709 13:06:42.604615 16102 rpcz_store.cc:276] 0709 13:06:35.125374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:35.130564 (+  5190us) service_pool.cc:224] Handling call
0709 13:06:35.166450 (+ 35886us) spinlock_profiling.cc:243] Waited 22.6 ms on lock 0x7b54002b0110. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361c224db1 00007f361c364b71 00007f361c3650b2 00007f36252dea89 00007f3625276da6 00007f3625248088 00007f362534637e 00007f36238072a4 00007f3623807232 00007f3623807161 00007f36238070dc
0709 13:06:42.551983 (+7385533us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:37.847677 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:37.849036 (+  1359us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:37.849115 (+    79us) write_op.cc:435] Acquired schema lock
0709 13:06:37.849146 (+    31us) tablet.cc:662] Decoding operations
0709 13:06:37.943828 (+ 94682us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:37.943927 (+    99us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:37.943954 (+    27us) tablet.cc:685] Acquiring locks for 23 operations
0709 13:06:38.071558 (+127604us) tablet.cc:701] Row locks acquired
0709 13:06:38.071622 (+    64us) write_op.cc:260] PREPARE: finished
0709 13:06:38.071814 (+   192us) write_op.cc:270] Start()
0709 13:06:38.071983 (+   169us) write_op.cc:276] Timestamp: P: 1783602398071732 usec, L: 0
0709 13:06:38.072008 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:06:38.072886 (+   878us) log.cc:844] Serialized 9102 byte log entry
0709 13:06:38.809695 (+736809us) op_driver.cc:464] REPLICATION: finished
0709 13:06:39.071024 (+261329us) write_op.cc:301] APPLY: starting
0709 13:06:39.071119 (+    95us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:39.431195 (+360076us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:39.431348 (+   153us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:39.952115 (+520767us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:40.020734 (+ 68619us) spinlock_profiling.cc:243] Waited 25 ms on lock 0x7b5400137754. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48632a 00007f361f40bf14 00007f361f40bec3 00007f361f40be38 00007f361f40bdf3 00007f361f40b0dc 00007f361f434e16 00007f361f41ccbb 00007f361f40739d 00007f361f40ad75
0709 13:06:40.053771 (+ 33037us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=23
0709 13:06:40.059511 (+  5740us) write_op.cc:312] APPLY: finished
0709 13:06:40.104613 (+ 45102us) log.cc:844] Serialized 158 byte log entry
0709 13:06:40.156576 (+ 51963us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:40.156800 (+   224us) write_op.cc:454] Released schema lock
0709 13:06:40.156869 (+    69us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:40.185608 (+ 28739us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:40.185644 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":280339,"reported_tablets":42,"spinlock_wait_cycles":52032768,"child_traces":[["op",{"apply.queue_time_us":244749,"apply.run_cpu_time_us":22790,"apply.run_wall_time_us":1099054,"num_ops":23,"prepare.queue_time_us":33965,"prepare.run_cpu_time_us":58677,"prepare.run_wall_time_us":335466,"raft.queue_time_us":389040,"raft.run_cpu_time_us":75270,"raft.run_wall_time_us":1305396,"replication_time_us":684611,"spinlock_wait_cycles":57575168,"thread_start_us":659301,"threads_started":5,"wal-append.queue_time_us":261257,"wal-append.run_cpu_time_us":24883,"wal-append.run_wall_time_us":2445855}]]}
I20260709 13:06:42.551934 19426 consensus_queue.cc:260] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:42.554666 19363 leader_election.cc:290] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:42.555236 19386 leader_election.cc:290] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 5 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:42.545778 19459 raft_consensus.cc:2804] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:42.556579 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:42.557821 19189 raft_consensus.cc:493] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:42.554293 19076 leader_election.cc:290] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:42.559928 19420 leader_election.cc:290] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 8 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:42.559847 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:42.518108 19443 consensus_queue.cc:1048] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.055s
I20260709 13:06:42.574935 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:42.537732 16173 leader_election.cc:304] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:42.631867 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:42.576550 19270 raft_consensus.cc:2749] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:42.576661 19433 leader_election.cc:290] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:42.583226 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:06:42.632009 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 94400.8us
I20260709 13:06:42.584018 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:42.611761 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:42.621361 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:42.622030 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:42.622855 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:42.624262 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:42.628760 16349 raft_consensus.cc:1275] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:06:42.632091 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 150178us
I20260709 13:06:42.632592 16355 raft_consensus.cc:2468] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 9.
I20260709 13:06:42.680068 16357 raft_consensus.cc:2468] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 8.
I20260709 13:06:42.680661 16348 raft_consensus.cc:2468] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 10.
W20260709 13:06:42.634230 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 340479us
I20260709 13:06:42.829532 16248 leader_election.cc:304] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:42.679278 16354 raft_consensus.cc:2393] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 11: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:06:42.831285 19389 raft_consensus.cc:2749] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:42.683569 16173 leader_election.cc:304] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:42.618256 19459 raft_consensus.cc:493] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:42.646193 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:06:42.832055 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 148594us
I20260709 13:06:42.624982 19189 raft_consensus.cc:515] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:42.832765 16173 leader_election.cc:304] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:42.834255 19189 leader_election.cc:290] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:42.834736 19443 raft_consensus.cc:2804] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:42.834914 19264 raft_consensus.cc:2804] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:06:42.835289 16246 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:42.835317 19443 raft_consensus.cc:697] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:42.838460 16274 raft_consensus.cc:1240] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 LEADER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:42.838949 19443 consensus_queue.cc:237] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:42.832090 19459 raft_consensus.cc:3060] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:42.846939 19264 raft_consensus.cc:697] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [term 10 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:42.848183 19264 consensus_queue.cc:237] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:42.850440 16940 raft_consensus.cc:1240] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:42.801029 19261 raft_consensus.cc:2804] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:42.851217 16248 leader_election.cc:304] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:42.851558 19261 raft_consensus.cc:697] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:42.852532 19261 consensus_queue.cc:237] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:42.853233 16248 leader_election.cc:304] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:42.853958 16940 raft_consensus.cc:1240] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 7. Current term is 8. Ops: []
W20260709 13:06:42.740643 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 106948us
W20260709 13:06:42.748512 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 61843.1us
I20260709 13:06:42.819567 18957 raft_consensus.cc:515] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:42.855489 18810 raft_consensus.cc:2749] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:42.857234 18810 raft_consensus.cc:2749] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:06:42.857491 18957 leader_election.cc:290] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:42.686098 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:42.860128 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:42.862360 16949 raft_consensus.cc:1240] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 6. Current term is 7. Ops: []
W20260709 13:06:42.863330 16173 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:42.865106 16280 raft_consensus.cc:1240] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:06:42.864955 19076 consensus_queue.cc:1048] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:06:42.872226 16173 leader_election.cc:304] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:42.885720 16946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:42.886514 16946 raft_consensus.cc:2468] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 7.
I20260709 13:06:42.871701 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:06:42.889573 19457 consensus_queue.cc:1059] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:42.901839 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:42.903592 16348 raft_consensus.cc:1240] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 8. Current term is 9. Ops: [5.3-8.5]
I20260709 13:06:42.907341 16348 raft_consensus.cc:1240] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:42.910100 16248 leader_election.cc:304] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:42.908802 19304 raft_consensus.cc:493] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:42.937276 19304 raft_consensus.cc:515] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:42.939760 19304 leader_election.cc:290] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:06:42.908782 19483 log.cc:927] Time spent T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.063s	user 0.002s	sys 0.007s
I20260709 13:06:42.890718 19468 raft_consensus.cc:2749] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:42.969841 19459 raft_consensus.cc:515] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:06:42.954509 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 46902.6us
I20260709 13:06:42.953558 16248 leader_election.cc:304] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:42.955765 18957 raft_consensus.cc:2749] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:42.981097 16322 leader_election.cc:304] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:42.985446 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:42.985935 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:42.987762 16914 leader_election.cc:304] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:42.994247 19203 raft_consensus.cc:2749] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:42.974412 19363 raft_consensus.cc:2749] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:42.993211 19035 raft_consensus.cc:2749] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:06:43.019233 16912 leader_election.cc:304] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:43.030079 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
W20260709 13:06:43.030418 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 136756us
I20260709 13:06:43.030983 16206 raft_consensus.cc:2393] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 11: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:06:43.004616 16248 leader_election.cc:304] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:43.033879 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:43.034799 16207 raft_consensus.cc:2393] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 8: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:06:43.035369 16248 leader_election.cc:304] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:42.981938 19443 consensus_queue.cc:1059] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 13:06:43.039435 16912 leader_election.cc:304] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:43.036480 16173 leader_election.cc:304] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:06:43.045042 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:43.053200 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:43.058719 16248 leader_election.cc:304] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:43.063138 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:43.034533 19452 raft_consensus.cc:2749] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:43.070714 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:43.067449 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:43.076104 16274 raft_consensus.cc:2393] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 8: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:06:43.047137 19363 raft_consensus.cc:2749] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:43.058920 19420 raft_consensus.cc:2749] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:06:43.062932 19342 raft_consensus.cc:2749] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:43.097836 16322 leader_election.cc:304] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:43.077718 19387 raft_consensus.cc:493] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
W20260709 13:06:43.111179 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:43.111409 19203 raft_consensus.cc:2749] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:43.112200 16322 leader_election.cc:304] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:43.091977 19452 raft_consensus.cc:2804] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:06:43.114223 19076 raft_consensus.cc:2749] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:43.114792 16322 leader_election.cc:304] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:43.115713 19432 raft_consensus.cc:2749] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:43.116189 16322 leader_election.cc:304] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:43.117224 19203 raft_consensus.cc:2749] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:43.119246 19264 raft_consensus.cc:2804] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:43.124276 19264 raft_consensus.cc:493] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:43.124922 19264 raft_consensus.cc:3060] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:43.125113 19387 raft_consensus.cc:515] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:06:43.145849 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 96200.5us
I20260709 13:06:43.093115 19488 consensus_queue.cc:1048] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.097s
W20260709 13:06:43.175381 19475 log.cc:927] Time spent T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 13:06:43.146219 19295 raft_consensus.cc:493] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
W20260709 13:06:43.191524 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 120890us
I20260709 13:06:43.175841 19452 raft_consensus.cc:697] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:43.190388 19488 consensus_queue.cc:1243] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer 0aea40d6e4374085a2e38a70a71f63e3 log is divergent from this leader: its last log entry 9.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:06:43.189240 19459 leader_election.cc:290] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 11 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:06:43.202956 16321 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:43.209012 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 172739us
W20260709 13:06:43.195497 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 136969us
I20260709 13:06:43.220707 16173 leader_election.cc:304] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:43.223124 16173 leader_election.cc:304] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:06:43.226325 16173 leader_election.cc:304] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:43.228595 16173 leader_election.cc:304] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:06:43.232622 16248 leader_election.cc:304] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:43.201366 19360 raft_consensus.cc:493] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:43.236867 19360 raft_consensus.cc:515] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:43.239252 19360 leader_election.cc:290] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:43.239910 19452 consensus_queue.cc:237] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:43.228091 19443 raft_consensus.cc:2804] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:43.227885 19261 raft_consensus.cc:2804] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:06:43.197347 19295 raft_consensus.cc:515] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:43.263283 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:43.254043 19443 raft_consensus.cc:493] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:43.261528 19261 raft_consensus.cc:493] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:43.307121 19365 raft_consensus.cc:3055] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:06:43.311292 19490 log.cc:927] Time spent T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
W20260709 13:06:43.312170 19492 log.cc:927] Time spent T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
W20260709 13:06:43.312629 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 48076.2us
I20260709 13:06:43.313697 15057 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:43.324224 16248 leader_election.cc:304] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:06:43.322286 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 93801.9us
I20260709 13:06:43.304874 19496 consensus_queue.cc:1048] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:43.283784 19360 raft_consensus.cc:2804] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:43.328750 19360 raft_consensus.cc:697] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:43.329871 19360 consensus_queue.cc:237] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } }
I20260709 13:06:43.279697 19468 consensus_queue.cc:1048] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.053s
I20260709 13:06:43.352500 16248 leader_election.cc:304] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:43.290961 19503 raft_consensus.cc:2804] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:43.317569 19443 raft_consensus.cc:3060] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:43.340042 19427 raft_consensus.cc:493] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:43.321750 19261 raft_consensus.cc:3060] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:43.359742 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:43.381982 16949 raft_consensus.cc:1275] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:06:43.360023 16357 raft_consensus.cc:1275] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:06:43.360623 16351 raft_consensus.cc:3060] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:43.362201 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:43.386181 16348 raft_consensus.cc:3060] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:43.321261 19365 raft_consensus.cc:740] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:43.362941 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:06:43.377849 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 49979.1us
I20260709 13:06:43.380792 16322 leader_election.cc:304] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:43.389065 16946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:43.344408 19474 raft_consensus.cc:493] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:43.360707 19503 raft_consensus.cc:493] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:43.360281 19495 raft_consensus.cc:2804] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:43.341760 19500 raft_consensus.cc:2804] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:43.400966 19295 leader_election.cc:290] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:43.407485 19476 raft_consensus.cc:3060] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:43.390090 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:43.388262 19363 raft_consensus.cc:2804] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:43.420166 16173 leader_election.cc:304] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:43.444342 16351 raft_consensus.cc:1275] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:06:43.417773 19495 raft_consensus.cc:493] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:43.417567 19503 raft_consensus.cc:3060] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:43.449383 16348 raft_consensus.cc:2468] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 11.
I20260709 13:06:43.426223 19500 raft_consensus.cc:493] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:43.433604 19363 raft_consensus.cc:493] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:43.391171 19427 raft_consensus.cc:515] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:43.438067 19387 leader_election.cc:290] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:43.417631 19474 raft_consensus.cc:515] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:43.454011 19468 raft_consensus.cc:2804] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:43.452417 19189 raft_consensus.cc:493] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:43.511458 19468 raft_consensus.cc:697] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 8 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:43.456601 19500 raft_consensus.cc:3060] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:43.511385 19189 raft_consensus.cc:515] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:43.454702 19495 raft_consensus.cc:3060] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:43.488895 19363 raft_consensus.cc:3060] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:06:43.514854 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 94852.2us
I20260709 13:06:43.419421 19365 consensus_queue.cc:260] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:06:43.521147 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:43.523504 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:43.524705 16281 raft_consensus.cc:2393] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 11: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:06:43.530480 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:43.531713 16348 raft_consensus.cc:2393] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 11: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:06:43.535661 16946 raft_consensus.cc:1240] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:43.543143 16280 raft_consensus.cc:1275] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:06:43.546661 16281 pending_rounds.cc:85] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3: Aborting all ops after (but not including) 4
I20260709 13:06:43.546826 16348 raft_consensus.cc:1275] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:06:43.547159 16281 pending_rounds.cc:107] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 13:06:43.547421 16281 raft_consensus.cc:2889] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:43.540408 19365 raft_consensus.cc:3060] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:43.554210 19261 raft_consensus.cc:515] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:43.565174 19261 leader_election.cc:290] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:43.567827 19474 leader_election.cc:290] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:43.569038 19426 raft_consensus.cc:3060] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:43.569063 19489 raft_consensus.cc:3055] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:43.571691 19489 raft_consensus.cc:740] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:43.572585 19489 consensus_queue.cc:260] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:43.573896 19489 raft_consensus.cc:3060] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:43.574936 19468 consensus_queue.cc:237] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:43.581516 19264 raft_consensus.cc:515] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:43.584383 19264 leader_election.cc:290] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:43.585700 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:43.586380 16277 raft_consensus.cc:2468] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 10.
I20260709 13:06:43.587212 16203 raft_consensus.cc:1240] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:43.588438 19427 leader_election.cc:290] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:43.590305 16274 raft_consensus.cc:1275] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:06:43.591202 16248 leader_election.cc:304] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:06:43.592005 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 48249.6us
I20260709 13:06:43.593034 16173 leader_election.cc:304] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:43.595232 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:43.595829 19459 raft_consensus.cc:2749] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:06:43.597685 19513 log.cc:927] Time spent T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.085s	user 0.004s	sys 0.000s
I20260709 13:06:43.599696 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:43.601016 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:43.608660 19488 consensus_queue.cc:1059] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:43.609915 19457 raft_consensus.cc:3055] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:43.611200 19476 raft_consensus.cc:2749] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:43.610342 19457 raft_consensus.cc:740] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:43.605654 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:43.627643 16248 leader_election.cc:304] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:43.628937 16248 leader_election.cc:304] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:43.634155 16248 leader_election.cc:304] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:43.637930 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:43.639393 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:43.641794 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:43.642685 16248 leader_election.cc:304] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:43.646576 16946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:43.648499 16946 raft_consensus.cc:2393] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 8: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
I20260709 13:06:43.602138 19363 raft_consensus.cc:515] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:43.649591 16322 leader_election.cc:304] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:06:43.641706 18810 raft_consensus.cc:2749] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:43.684973 16206 raft_consensus.cc:1240] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 2. Current term is 3. Ops: []
I20260709 13:06:43.646663 19221 raft_consensus.cc:2749] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:43.644721 19496 raft_consensus.cc:2804] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:43.650981 19360 raft_consensus.cc:2749] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:43.647125 19433 raft_consensus.cc:493] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:43.647305 19510 raft_consensus.cc:2749] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:06:43.700367 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 66686.6us
I20260709 13:06:43.686921 19076 raft_consensus.cc:2804] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:43.645506 19443 raft_consensus.cc:515] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:43.648481 19264 consensus_queue.cc:1059] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 13:06:43.653688 19428 consensus_queue.cc:1059] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 13:06:43.712325 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:43.715528 16275 raft_consensus.cc:1240] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:43.711988 19342 consensus_queue.cc:1059] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 13:06:43.708747 19433 raft_consensus.cc:515] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:43.717381 19342 raft_consensus.cc:3055] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:06:43.717780 19342 raft_consensus.cc:740] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:06:43.710253 19270 raft_consensus.cc:493] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.718536 19433 leader_election.cc:290] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:43.718420 19270 raft_consensus.cc:515] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:43.651594 19365 consensus_queue.cc:1059] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.061s
I20260709 13:06:43.718921 16946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:06:43.720008 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:43.722673 16279 raft_consensus.cc:1275] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:06:43.696902 19496 raft_consensus.cc:493] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:43.724982 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:43.725548 16348 raft_consensus.cc:1275] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:06:43.718713 19342 consensus_queue.cc:260] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:43.734660 16351 raft_consensus.cc:1275] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:06:43.725227 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
W20260709 13:06:43.735594 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 85160.2us
I20260709 13:06:43.641376 19457 consensus_queue.cc:260] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:43.742044 16322 leader_election.cc:304] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:06:43.710434 19076 raft_consensus.cc:493] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:43.651028 19509 consensus_queue.cc:1048] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.079s
I20260709 13:06:43.747730 16320 leader_election.cc:304] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:43.738008 19496 raft_consensus.cc:3060] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:43.734187 19510 raft_consensus.cc:493] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.759204 19443 leader_election.cc:290] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:43.751209 19076 raft_consensus.cc:3060] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:43.750272 19400 raft_consensus.cc:2749] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:43.753580 19468 consensus_queue.cc:1059] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
W20260709 13:06:43.773047 19522 log.cc:927] Time spent T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:06:43.752359 16940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:06:43.788071 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:43.782660 19386 raft_consensus.cc:493] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:43.789326 19386 raft_consensus.cc:515] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:43.789762 19363 leader_election.cc:290] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:43.760188 19494 raft_consensus.cc:3055] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:43.790783 19494 raft_consensus.cc:740] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:43.764421 19342 raft_consensus.cc:3060] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:43.764238 19453 raft_consensus.cc:3060] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:43.791621 19494 consensus_queue.cc:260] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:43.803423 19494 raft_consensus.cc:3060] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:43.807688 19496 raft_consensus.cc:515] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:43.810007 19373 raft_consensus.cc:3055] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:43.810703 19373 raft_consensus.cc:740] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:06:43.810107 19496 leader_election.cc:290] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 election: Requested vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:43.811870 19503 raft_consensus.cc:515] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:43.763345 19510 raft_consensus.cc:515] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:43.815853 19510 leader_election.cc:290] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:43.818979 19453 raft_consensus.cc:2749] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:43.820115 19503 leader_election.cc:290] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:43.791616 19386 leader_election.cc:290] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:43.752774 19495 raft_consensus.cc:515] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:43.811625 19373 consensus_queue.cc:260] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:43.823426 19373 raft_consensus.cc:3060] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:43.824083 19495 leader_election.cc:290] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:43.825280 16276 raft_consensus.cc:1240] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:06:43.827893 19270 leader_election.cc:290] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:43.860299 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:43.863689 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:43.872126 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:43.877432 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:06:43.878409 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 133432us
I20260709 13:06:43.886901 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:43.886991 19500 raft_consensus.cc:515] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:43.889700 19500 leader_election.cc:290] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:43.893375 19523 consensus_queue.cc:1048] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:43.894539 16203 raft_consensus.cc:1240] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:43.898291 19500 consensus_queue.cc:1059] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:06:43.898947 16206 raft_consensus.cc:1275] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:06:43.899376 16206 pending_rounds.cc:85] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f: Aborting all ops after (but not including) 4
I20260709 13:06:43.899595 16206 pending_rounds.cc:107] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:06:43.899709 19500 raft_consensus.cc:3055] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:06:43.899803 16206 raft_consensus.cc:2889] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:43.900218 19500 raft_consensus.cc:740] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:43.870304 19386 raft_consensus.cc:493] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.907426 19386 raft_consensus.cc:515] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:43.909741 19386 leader_election.cc:290] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:43.910409 19516 consensus_queue.cc:1048] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:43.910890 19500 consensus_queue.cc:260] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:43.913830 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:43.915479 16912 leader_election.cc:304] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:43.924178 16173 leader_election.cc:304] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:43.925366 19480 consensus_queue.cc:1059] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:43.927033 19480 raft_consensus.cc:3055] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:43.927533 19480 raft_consensus.cc:740] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:06:43.929225 19389 consensus_queue.cc:1048] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:43.934401 19523 consensus_queue.cc:1048] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:43.884336 19497 consensus_queue.cc:1048] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 13:06:43.937577 19506 consensus_queue.cc:1048] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:43.939529 19468 raft_consensus.cc:2749] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:06:43.939967 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:43.940266 19499 raft_consensus.cc:2749] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:43.944744 19457 raft_consensus.cc:3060] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:43.948261 16946 raft_consensus.cc:2468] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 3.
W20260709 13:06:43.949355 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 192606us
I20260709 13:06:43.950491 16320 leader_election.cc:304] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:43.951514 16320 leader_election.cc:304] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:43.953214 19387 raft_consensus.cc:2749] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:43.953285 19524 raft_consensus.cc:2749] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:43.911863 19489 raft_consensus.cc:493] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:43.958289 19459 consensus_queue.cc:1048] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:43.961077 19261 raft_consensus.cc:3055] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:43.961375 16940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:06:43.961601 19261 raft_consensus.cc:740] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:43.950497 19076 raft_consensus.cc:515] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:43.964936 19076 leader_election.cc:290] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:43.967592 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
W20260709 13:06:43.968267 19514 log.cc:927] Time spent T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.260s	user 0.004s	sys 0.000s
I20260709 13:06:43.968386 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:43.929118 19480 consensus_queue.cc:260] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:43.932173 19500 raft_consensus.cc:3060] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:43.970723 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:43.989409 16173 leader_election.cc:304] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:06:43.996979 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:43.997709 16356 raft_consensus.cc:2468] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 5.
I20260709 13:06:44.004998 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:44.005668 16278 raft_consensus.cc:3060] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:44.006811 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:44.008572 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:43.962447 19261 consensus_queue.cc:260] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:44.010294 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:44.010985 19261 raft_consensus.cc:3060] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:44.011011 16356 raft_consensus.cc:2468] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 5.
I20260709 13:06:44.018379 19506 raft_consensus.cc:2749] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:06:43.971601 19420 raft_consensus.cc:493] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.021968 19426 raft_consensus.cc:493] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:44.021759 19420 raft_consensus.cc:515] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:44.022329 16914 leader_election.cc:304] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:06:44.022617 19426 raft_consensus.cc:515] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:44.023627 16914 leader_election.cc:304] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:06:44.024837 19426 leader_election.cc:290] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:44.025059 19452 raft_consensus.cc:493] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.025413 16173 leader_election.cc:304] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:06:44.025664 19452 raft_consensus.cc:515] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:44.026254 19460 raft_consensus.cc:2804] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:44.026851 19460 raft_consensus.cc:493] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:44.027216 19488 raft_consensus.cc:2804] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:06:44.027540 19469 raft_consensus.cc:2804] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:44.027824 19488 raft_consensus.cc:697] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:44.028192 19469 raft_consensus.cc:493] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:44.028779 19469 raft_consensus.cc:3060] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:44.028914 19488 consensus_queue.cc:237] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:43.971246 19189 leader_election.cc:290] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:44.027258 19460 raft_consensus.cc:3060] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:43.974479 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 331903us
I20260709 13:06:43.983978 16208 raft_consensus.cc:3060] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:44.033674 16103 catalog_manager.cc:5697] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: term changed from 5 to 6, leader changed from 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) to 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68). New cstate: current_term: 6 leader_uuid: "1109f76a0b7b443a84c0327c8707bc63" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:44.035576 16173 leader_election.cc:304] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:44.036593 16103 catalog_manager.cc:5697] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: term changed from 4 to 10, leader changed from 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) to 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68). New cstate: current_term: 10 leader_uuid: "1109f76a0b7b443a84c0327c8707bc63" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:44.043473 16278 raft_consensus.cc:2468] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 11.
I20260709 13:06:44.045917 16173 leader_election.cc:304] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:44.052740 16248 leader_election.cc:304] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:44.053373 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c15d8e9be8414c84912ab77b66bfb1" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:06:44.053532 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 53521.6us
I20260709 13:06:44.028085 19452 leader_election.cc:290] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:43.968981 19489 raft_consensus.cc:515] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:44.072329 16322 leader_election.cc:304] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:06:44.072357 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:44.028941 19420 leader_election.cc:290] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:44.075464 16353 raft_consensus.cc:2468] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 11.
I20260709 13:06:44.085381 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:44.086114 16278 raft_consensus.cc:2468] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 11.
I20260709 13:06:44.086961 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:44.089319 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
W20260709 13:06:44.093616 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 142169us
I20260709 13:06:44.054849 19494 raft_consensus.cc:2749] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:06:44.094795 16914 leader_election.cc:304] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:06:44.078150 19452 raft_consensus.cc:2749] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:44.076493 19528 raft_consensus.cc:2749] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:06:44.104219 16276 raft_consensus.cc:1240] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:44.106185 16208 raft_consensus.cc:1275] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:06:44.070482 19389 consensus_queue.cc:1048] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:06:44.117070 16320 leader_election.cc:304] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:44.117687 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:44.118821 16357 raft_consensus.cc:1275] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:06:44.120167 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:44.120981 16348 raft_consensus.cc:2393] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 11: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:06:44.102715 19185 raft_consensus.cc:2804] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:06:44.121627 16282 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45210 (request call id 1735) took 1058 ms. Trace:
I20260709 13:06:44.124248 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:44.128225 16947 raft_consensus.cc:2468] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 11.
I20260709 13:06:44.130367 16208 raft_consensus.cc:1240] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:44.133000 16208 raft_consensus.cc:1240] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:44.133117 16106 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38842 (request call id 213) took 7777 ms. Trace:
I20260709 13:06:44.108592 19459 raft_consensus.cc:493] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.135208 19459 raft_consensus.cc:515] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } }
I20260709 13:06:44.139312 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:44.140924 16248 leader_election.cc:304] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:44.125574 16282 rpcz_store.cc:276] 0709 13:06:43.063654 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:43.063774 (+   120us) service_pool.cc:224] Handling call
0709 13:06:43.064141 (+   367us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:43.414322 (+350181us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:43.414371 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:43.415094 (+   723us) log.cc:844] Serialized 26 byte log entry
0709 13:06:43.456969 (+ 41875us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:43.500814 (+ 43845us) log.cc:844] Serialized 14 byte log entry
0709 13:06:43.516787 (+ 15973us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:43.516888 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:43.808260 (+291372us) spinlock_profiling.cc:243] Waited 3.02 ms on lock 0x7b1800400f00. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f3625264de1 00007f36252715b1 00007f361c39c522 00007f361c39e7c1 00007f361c39e779 00007f361c39e709 00007f361c39e6d1 00007f361c39d9cd 000000000038f354 000000000038f199 00007f361c37f83a
0709 13:06:43.836952 (+ 28692us) spinlock_profiling.cc:243] Waited 3.56 ms on lock 0x7b480015c258. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f36243b2aa1 00007f36243a9b37 00007f36243a99ca 00007f36244a126f 00007f36244a0f37 00007f36244b555c 00007f36244b5508 00007f36244b5488 00007f36244b5443 00007f36244b46ec 00007f36233dea96
0709 13:06:43.990512 (+153560us) spinlock_profiling.cc:243] Waited 2.58 ms on lock 0x7b1800400f00. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f3625264de1 00007f36252715b1 00007f361c36a2a6 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f3625264de1 00007f36252715b1 00007f361c39c3f3 00007f361c39e7c1
0709 13:06:43.991314 (+   802us) spinlock_profiling.cc:243] Waited 4.45 ms on lock 0x7b1800400f00. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f3625264de1 00007f36252715b1 00007f361c39c3f3 00007f361c39e7c1 00007f361c39e779 00007f361c39e709 00007f361c39e6d1 00007f361c39d9cd 000000000038f354 000000000038f199 00007f361c37f83a
0709 13:06:44.121316 (+130002us) raft_consensus.cc:1685] finished
0709 13:06:44.121343 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:44.121545 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36117,"prepare.queue_time_us":55742,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":3478,"raft.queue_time_us":49918,"raft.run_cpu_time_us":3314,"raft.run_wall_time_us":344908,"spinlock_wait_cycles":31304448,"thread_start_us":356373,"threads_started":2,"wal-append.queue_time_us":92974}
I20260709 13:06:44.144600 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c15d8e9be8414c84912ab77b66bfb1" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:44.106750 19480 raft_consensus.cc:3060] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:44.147375 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:44.148392 16357 raft_consensus.cc:1275] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:06:44.139182 16103 catalog_manager.cc:5697] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: term changed from 6 to 7, leader changed from e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) to 363bb2f744eb486f9ad726f08214c98e (127.14.180.67). New cstate: current_term: 7 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:06:44.153610 16103 catalog_manager.cc:5697] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: term changed from 7 to 8, leader changed from 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) to 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68). New cstate: current_term: 8 leader_uuid: "1109f76a0b7b443a84c0327c8707bc63" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:44.150768 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:44.156827 16348 raft_consensus.cc:2468] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 8.
I20260709 13:06:44.163236 16248 leader_election.cc:304] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:44.164587 16248 leader_election.cc:304] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:44.146987 19304 raft_consensus.cc:2749] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:44.168876 19530 raft_consensus.cc:2749] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:44.169759 19379 raft_consensus.cc:2749] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:44.169670 19530 consensus_queue.cc:1048] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:44.171594 16248 leader_election.cc:304] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:44.108739 19523 consensus_queue.cc:1059] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 13:06:44.176658 19489 leader_election.cc:290] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:44.193526 19363 raft_consensus.cc:2749] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:44.194528 19510 consensus_queue.cc:1048] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:44.195358 19507 raft_consensus.cc:2804] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:06:44.195814 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 87867.7us
I20260709 13:06:44.198807 16248 leader_election.cc:304] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:44.146277 19342 raft_consensus.cc:2804] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:44.133486 16106 rpcz_store.cc:276] 0709 13:06:36.356059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:36.356437 (+   378us) service_pool.cc:224] Handling call
0709 13:06:44.133056 (+7776619us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:42.858121 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:42.858938 (+   817us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:42.858977 (+    39us) write_op.cc:435] Acquired schema lock
0709 13:06:42.859002 (+    25us) tablet.cc:662] Decoding operations
0709 13:06:42.859584 (+   582us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:42.859652 (+    68us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:42.859888 (+   236us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:06:42.860280 (+   392us) tablet.cc:701] Row locks acquired
0709 13:06:42.860296 (+    16us) write_op.cc:260] PREPARE: finished
0709 13:06:42.860431 (+   135us) write_op.cc:270] Start()
0709 13:06:42.860544 (+   113us) write_op.cc:276] Timestamp: P: 1783602402860387 usec, L: 0
0709 13:06:42.860562 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 13:06:42.865437 (+  4875us) log.cc:844] Serialized 1687 byte log entry
0709 13:06:43.344330 (+478893us) op_driver.cc:464] REPLICATION: finished
0709 13:06:43.510886 (+166556us) write_op.cc:301] APPLY: starting
0709 13:06:43.510969 (+    83us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:43.511123 (+   154us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:43.511255 (+   132us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:43.511855 (+   600us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:43.512047 (+   192us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 13:06:43.512096 (+    49us) write_op.cc:312] APPLY: finished
0709 13:06:43.527975 (+ 15879us) log.cc:844] Serialized 41 byte log entry
0709 13:06:43.536869 (+  8894us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:43.541682 (+  4813us) write_op.cc:454] Released schema lock
0709 13:06:43.550059 (+  8377us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:43.579978 (+ 29919us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:43.580008 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1038444,"reported_tablets":36,"child_traces":[["op",{"apply.queue_time_us":153198,"apply.run_cpu_time_us":2927,"apply.run_wall_time_us":69096,"num_ops":4,"prepare.queue_time_us":273213,"prepare.run_cpu_time_us":23213,"prepare.run_wall_time_us":110823,"raft.queue_time_us":350515,"raft.run_cpu_time_us":30708,"raft.run_wall_time_us":98535,"replication_time_us":483568,"spinlock_wait_cycles":116480,"thread_start_us":588670,"threads_started":4,"wal-append.queue_time_us":103233}]]}
I20260709 13:06:44.205380 19427 consensus_queue.cc:1059] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:44.218032 19427 raft_consensus.cc:3055] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:06:44.207490 19432 consensus_queue.cc:1059] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:44.219220 19432 raft_consensus.cc:3055] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:44.219575 19432 raft_consensus.cc:740] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:06:44.219651 19531 raft_consensus.cc:493] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.220399 19531 raft_consensus.cc:515] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } }
I20260709 13:06:44.212994 19524 raft_consensus.cc:493] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:44.222681 19532 log.cc:927] Time spent T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
I20260709 13:06:44.222512 19524 raft_consensus.cc:515] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:44.224790 19524 leader_election.cc:290] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:44.225589 19432 consensus_queue.cc:260] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:44.226714 19507 raft_consensus.cc:697] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
W20260709 13:06:44.253835 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 55157.2us
I20260709 13:06:44.254915 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:44.256084 16274 raft_consensus.cc:2393] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 9: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:06:44.183965 19185 raft_consensus.cc:697] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 11 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:06:44.218418 19427 raft_consensus.cc:740] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:06:44.266000 16248 leader_election.cc:304] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:06:44.266038 19522 log.cc:927] Time spent T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 13:06:44.268010 19507 consensus_queue.cc:237] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:44.271762 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 10 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:44.280498 16248 leader_election.cc:304] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:44.260880 19510 raft_consensus.cc:2749] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:06:44.230916 19221 consensus_queue.cc:1048] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 13:06:44.286295 19459 leader_election.cc:290] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:44.285650 19530 raft_consensus.cc:2749] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:06:44.290829 19534 log.cc:927] Time spent T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.131s	user 0.004s	sys 0.000s
I20260709 13:06:44.291970 19342 raft_consensus.cc:493] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:44.292470 19342 raft_consensus.cc:3060] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:44.293001 19427 consensus_queue.cc:260] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:44.294382 19427 raft_consensus.cc:3060] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:44.295248 19452 raft_consensus.cc:2749] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:06:44.304594 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 10 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:06:44.307431 19533 log.cc:927] Time spent T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:06:44.309116 19460 raft_consensus.cc:515] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:44.310150 19185 consensus_queue.cc:237] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:44.311474 19460 leader_election.cc:290] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 6 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:44.312191 19518 raft_consensus.cc:3055] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:44.313076 19189 raft_consensus.cc:493] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.355162 19189 raft_consensus.cc:515] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:44.357383 19189 leader_election.cc:290] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:44.314512 16320 leader_election.cc:304] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:06:44.360430 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 46039.1us
I20260709 13:06:44.361940 19433 raft_consensus.cc:2749] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:44.367270 19342 raft_consensus.cc:515] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:44.283690 19432 raft_consensus.cc:3060] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:06:44.350342 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 48904.8us
I20260709 13:06:44.372462 16322 leader_election.cc:304] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:44.374735 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:44.348899 19494 consensus_queue.cc:1059] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 13:06:44.352200 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:44.414682 16349 raft_consensus.cc:2468] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 9.
I20260709 13:06:44.352771 16356 raft_consensus.cc:1275] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:06:44.349417 19518 raft_consensus.cc:740] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:44.368547 19469 raft_consensus.cc:515] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:44.331190 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:44.436771 16353 raft_consensus.cc:2468] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 10.
I20260709 13:06:44.388406 19342 leader_election.cc:290] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 12 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:44.398854 19189 raft_consensus.cc:2749] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:44.408087 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:44.439499 16199 raft_consensus.cc:2468] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 8.
I20260709 13:06:44.411414 19433 raft_consensus.cc:493] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:44.413664 16274 raft_consensus.cc:1240] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:06:44.423249 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:44.424352 16281 raft_consensus.cc:1275] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:06:44.438122 16940 raft_consensus.cc:2468] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 5.
I20260709 13:06:44.442936 16320 leader_election.cc:304] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:44.289290 18957 consensus_queue.cc:1048] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.124s
W20260709 13:06:44.450827 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 172841us
I20260709 13:06:44.456624 16348 raft_consensus.cc:1240] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 11 LEADER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:44.448189 16200 raft_consensus.cc:2468] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 10.
I20260709 13:06:44.458796 16320 leader_election.cc:304] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:44.459652 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:44.461061 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:44.461772 16279 raft_consensus.cc:3060] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:06:44.460137 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 169862us
I20260709 13:06:44.474094 16248 leader_election.cc:304] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:44.451131 19261 raft_consensus.cc:3055] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:44.483975 19379 consensus_queue.cc:1048] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:06:44.489228 19546 log.cc:927] Time spent T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.125s	user 0.002s	sys 0.000s
I20260709 13:06:44.466260 19432 raft_consensus.cc:2804] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:06:44.515509 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 45936.2us
I20260709 13:06:44.518230 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:44.519291 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:44.520066 16354 raft_consensus.cc:3060] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:44.490643 19518 consensus_queue.cc:260] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:44.471516 19474 raft_consensus.cc:2804] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:06:44.533017 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 59068.6us
I20260709 13:06:44.456809 19433 raft_consensus.cc:515] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:06:44.516947 19534 log.cc:927] Time spent T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:06:44.545226 16279 raft_consensus.cc:2468] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 12.
I20260709 13:06:44.468547 19506 consensus_queue.cc:1048] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.063s
I20260709 13:06:44.541401 16949 raft_consensus.cc:1240] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 5. Current term is 6. Ops: [3.6-5.7]
I20260709 13:06:44.491657 19261 raft_consensus.cc:740] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:44.556221 19261 consensus_queue.cc:260] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:44.551858 19495 raft_consensus.cc:2804] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:44.557397 19495 raft_consensus.cc:493] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:44.557595 19261 raft_consensus.cc:3060] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:44.557830 19495 raft_consensus.cc:3060] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:44.516835 19432 raft_consensus.cc:493] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:44.566825 19432 raft_consensus.cc:3060] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:44.531356 19474 raft_consensus.cc:493] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:44.569715 19474 raft_consensus.cc:3060] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:44.572547 16914 leader_election.cc:304] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:06:44.539743 16248 leader_election.cc:304] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:44.583374 16354 raft_consensus.cc:2468] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 12.
I20260709 13:06:44.537407 19457 consensus_queue.cc:1059] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.051s
I20260709 13:06:44.587852 16914 leader_election.cc:304] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:44.588806 19428 raft_consensus.cc:2804] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:06:44.589378 19428 raft_consensus.cc:697] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 12 LEADER]: Becoming Leader. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:06:44.589795 19518 raft_consensus.cc:3060] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:44.586295 19548 raft_consensus.cc:2764] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader election decision vote started in defunct term 11: won
I20260709 13:06:44.590332 19428 consensus_queue.cc:237] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:44.592470 19543 raft_consensus.cc:2749] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:44.595022 19531 leader_election.cc:290] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:44.595551 19433 leader_election.cc:290] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:44.598002 19469 leader_election.cc:290] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 6 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:44.630597 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
W20260709 13:06:44.669237 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 129578us
W20260709 13:06:44.675846 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 208732us
I20260709 13:06:44.681433 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:44.666158 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:44.682300 16274 raft_consensus.cc:2468] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 9.
I20260709 13:06:44.698092 16173 leader_election.cc:304] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:06:44.686733 19389 raft_consensus.cc:493] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:44.703369 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:44.708339 16173 leader_election.cc:304] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:06:44.712162 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:44.714293 16282 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b"
dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
mode: GRACEFUL
new_leader_uuid: "363bb2f744eb486f9ad726f08214c98e"
 from {username='slave'} at 127.0.0.1:39058
I20260709 13:06:44.714984 16282 raft_consensus.cc:606] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Received request to transfer leadership to TS 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:44.715305 16282 raft_consensus.cc:614] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:44.712860 16205 raft_consensus.cc:2468] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 10.
I20260709 13:06:44.672938 19474 raft_consensus.cc:515] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } }
I20260709 13:06:44.705871 19506 raft_consensus.cc:2804] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:44.755687 16275 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "16a307cee8ef431184c620fec029af19"
dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
mode: GRACEFUL
new_leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
 from {username='slave'} at 127.0.0.1:39058
I20260709 13:06:44.756520 16275 raft_consensus.cc:606] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Received request to transfer leadership to TS e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:44.756914 16275 raft_consensus.cc:614] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:44.741712 19373 raft_consensus.cc:493] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.757982 19373 raft_consensus.cc:515] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:44.761021 19373 leader_election.cc:290] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:44.771481 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:06:44.773660 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 71148.9us
I20260709 13:06:44.786267 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:44.787542 16282 raft_consensus.cc:2393] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 10: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:06:44.785737 16281 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94"
dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
mode: GRACEFUL
new_leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
 from {username='slave'} at 127.0.0.1:39058
I20260709 13:06:44.790529 16281 raft_consensus.cc:606] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Received request to transfer leadership to TS e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:44.791096 16281 raft_consensus.cc:614] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:44.796003 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:44.796305 16947 raft_consensus.cc:1240] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 5. Current term is 6. Ops: []
W20260709 13:06:44.802055 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:44.707671 19523 consensus_queue.cc:1048] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.070s
I20260709 13:06:44.711777 19452 consensus_queue.cc:1059] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.072s
I20260709 13:06:44.749629 19506 raft_consensus.cc:493] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:44.858774 19506 raft_consensus.cc:3060] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:44.827913 19494 raft_consensus.cc:2804] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:06:44.830935 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 51593.5us
W20260709 13:06:44.863471 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 154581us
I20260709 13:06:44.870278 16914 leader_election.cc:304] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:44.872453 19542 raft_consensus.cc:2749] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:44.849700 19474 leader_election.cc:290] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:06:44.851938 16174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:44.712113 19389 raft_consensus.cc:515] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:44.876058 19389 leader_election.cc:290] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:44.877362 16275 raft_consensus.cc:2468] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 6.
I20260709 13:06:44.879215 19452 raft_consensus.cc:3055] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:44.880190 19452 raft_consensus.cc:740] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:44.885131 19076 raft_consensus.cc:493] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:44.885766 19076 raft_consensus.cc:515] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:44.888478 16320 leader_election.cc:304] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:44.879060 19432 raft_consensus.cc:515] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:44.889693 16940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:45.081398 16940 raft_consensus.cc:2468] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 6.
I20260709 13:06:45.080706 16281 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aee913c41fb9437587affa768953f637"
dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
mode: GRACEFUL
new_leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
 from {username='slave'} at 127.0.0.1:39058
I20260709 13:06:44.890805 16173 leader_election.cc:304] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:06:45.083379 16281 raft_consensus.cc:606] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Received request to transfer leadership to TS e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:45.084357 16281 raft_consensus.cc:614] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:06:45.083806 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 193137us
I20260709 13:06:45.080456 16914 leader_election.cc:304] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:06:44.930433 19452 consensus_queue.cc:260] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:45.088219 19452 raft_consensus.cc:3060] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:44.894825 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:45.078716 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:45.096081 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:45.106148 19518 raft_consensus.cc:2804] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:45.106815 19518 raft_consensus.cc:697] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:45.107759 19518 consensus_queue.cc:237] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:45.108610 19460 raft_consensus.cc:2804] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:45.109203 19460 raft_consensus.cc:493] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:45.109596 19460 raft_consensus.cc:3060] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:45.059739 19525 raft_consensus.cc:493] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:45.110733 19498 raft_consensus.cc:493] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.111063 19525 raft_consensus.cc:515] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:45.111280 19498 raft_consensus.cc:515] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:44.895263 19221 consensus_queue.cc:1059] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.218s
I20260709 13:06:45.113380 19525 leader_election.cc:290] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:45.113377 19498 leader_election.cc:290] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:44.919171 19494 raft_consensus.cc:493] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
W20260709 13:06:44.966235 19488 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.609s	user 0.000s	sys 0.014s
I20260709 13:06:45.114524 19494 raft_consensus.cc:3060] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:45.116125 16248 leader_election.cc:304] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:06:45.117781 19548 raft_consensus.cc:2804] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:45.118189 19548 raft_consensus.cc:493] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:45.118602 19548 raft_consensus.cc:3060] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:45.126017 16282 raft_consensus.cc:3060] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:06:45.131421 16200 raft_consensus.cc:1275] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
W20260709 13:06:45.114658 19488 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.758s	user 0.000s	sys 0.026s
I20260709 13:06:45.136718 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:45.142050 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:44.898114 19185 raft_consensus.cc:2804] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:44.928359 19503 raft_consensus.cc:493] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.146744 18957 raft_consensus.cc:3055] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:44.923372 19545 raft_consensus.cc:493] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.147384 19460 raft_consensus.cc:515] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:06:45.148480 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 43724.6us
I20260709 13:06:45.150382 19203 consensus_queue.cc:1048] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:45.152676 16276 raft_consensus.cc:1275] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:06:45.144327 16207 raft_consensus.cc:2468] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 7.
I20260709 13:06:44.919338 19076 leader_election.cc:290] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:45.163504 16275 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece"
dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
mode: GRACEFUL
new_leader_uuid: "363bb2f744eb486f9ad726f08214c98e"
 from {username='slave'} at 127.0.0.1:39058
I20260709 13:06:45.204042 16320 leader_election.cc:304] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:45.205854 16275 raft_consensus.cc:606] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 LEADER]: Received request to transfer leadership to TS 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:44.964345 19495 raft_consensus.cc:515] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:45.161207 19185 raft_consensus.cc:493] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:45.166891 18957 raft_consensus.cc:740] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:45.171466 19506 raft_consensus.cc:515] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:45.223245 16349 raft_consensus.cc:1240] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:06:45.220167 19076 raft_consensus.cc:2804] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:45.224506 19076 raft_consensus.cc:493] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:45.224995 19076 raft_consensus.cc:3060] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:45.225250 19506 leader_election.cc:290] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:45.231825 19460 leader_election.cc:290] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 7 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:45.234992 15057 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:06:45.218956 19185 raft_consensus.cc:3060] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:45.236950 15057 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:45.237300 16279 raft_consensus.cc:1240] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 13:06:45.238287 16352 raft_consensus.cc:1275] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:06:45.242491 16200 raft_consensus.cc:1275] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:06:45.192869 19503 raft_consensus.cc:515] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:45.261658 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:45.261827 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:45.269953 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:45.270727 16207 raft_consensus.cc:2468] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 5.
I20260709 13:06:45.271131 19496 consensus_queue.cc:1059] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:45.271716 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:45.272033 19496 raft_consensus.cc:3055] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:45.272382 19496 raft_consensus.cc:740] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:45.273190 19496 consensus_queue.cc:260] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } }
I20260709 13:06:45.242671 19428 raft_consensus.cc:493] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.278302 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:45.209915 19545 raft_consensus.cc:515] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:45.280429 16279 raft_consensus.cc:1275] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:06:45.281164 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:45.284072 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:45.284653 16203 raft_consensus.cc:3060] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:45.283926 16206 raft_consensus.cc:2468] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 6.
I20260709 13:06:45.233731 19076 raft_consensus.cc:515] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:45.296545 16203 raft_consensus.cc:2468] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 10.
I20260709 13:06:45.298342 16320 leader_election.cc:304] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:45.303244 19496 raft_consensus.cc:3060] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:45.313292 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:45.314442 16353 raft_consensus.cc:2468] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 5.
I20260709 13:06:45.315157 16348 raft_consensus.cc:1275] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:06:45.319113 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:45.319711 16276 raft_consensus.cc:3060] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:45.324461 16914 leader_election.cc:304] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:06:45.325809 19270 raft_consensus.cc:2804] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:45.326299 19270 raft_consensus.cc:493] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:45.326699 19270 raft_consensus.cc:3060] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:45.327428 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 44777.6us
I20260709 13:06:45.332747 19524 consensus_queue.cc:1048] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:45.288231 19507 consensus_queue.cc:1048] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 13:06:45.344375 16322 leader_election.cc:304] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:45.286304 19428 raft_consensus.cc:515] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:45.347005 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:45.320045 19433 raft_consensus.cc:2804] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:45.322010 19432 leader_election.cc:290] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 10 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:45.324838 19363 raft_consensus.cc:493] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:45.365767 16947 raft_consensus.cc:2393] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 7: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
I20260709 13:06:45.364676 19453 raft_consensus.cc:493] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.302340 19548 raft_consensus.cc:515] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:45.354403 19525 raft_consensus.cc:2749] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:45.334139 19480 consensus_queue.cc:1048] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 13:06:45.379674 16276 raft_consensus.cc:2468] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 10.
I20260709 13:06:45.359527 19528 consensus_queue.cc:1059] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 13:06:45.302132 18957 consensus_queue.cc:260] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:45.361940 19433 raft_consensus.cc:697] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 10 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:06:45.348558 19494 raft_consensus.cc:515] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } }
I20260709 13:06:45.397665 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:45.399771 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:45.400764 16206 raft_consensus.cc:2468] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 8.
I20260709 13:06:45.404172 16912 leader_election.cc:304] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:45.405337 16949 raft_consensus.cc:2393] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 7: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
I20260709 13:06:45.369808 19453 raft_consensus.cc:515] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:45.382777 19495 leader_election.cc:290] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:45.370710 19363 raft_consensus.cc:515] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:45.398675 19503 leader_election.cc:290] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:45.431381 19373 raft_consensus.cc:2804] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:45.402755 19469 consensus_queue.cc:1048] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:06:45.454312 19428 leader_election.cc:290] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:06:45.476557 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 133646us
W20260709 13:06:45.462774 19565 log.cc:927] Time spent T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.173s	user 0.001s	sys 0.000s
W20260709 13:06:45.482937 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 79047.7us
W20260709 13:06:45.485252 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 118437us
I20260709 13:06:45.487669 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:45.488437 16206 raft_consensus.cc:2468] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 7.
I20260709 13:06:45.465504 19373 raft_consensus.cc:493] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:45.492275 16912 leader_election.cc:304] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:45.468631 19545 leader_election.cc:290] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:45.493937 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:06:45.473435 19433 consensus_queue.cc:237] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:06:45.507906 19576 log.cc:927] Time spent T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 13:06:45.491485 19507 raft_consensus.cc:493] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:45.495990 19373 raft_consensus.cc:3060] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:45.495600 19076 leader_election.cc:290] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:45.503036 19498 raft_consensus.cc:2804] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:45.524319 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:45.518978 19548 leader_election.cc:290] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:06:45.521136 19568 log.cc:927] Time spent T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63: Append to log took a long time: real 0.133s	user 0.000s	sys 0.001s
W20260709 13:06:45.521997 19573 log.cc:927] Time spent T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.143s	user 0.000s	sys 0.001s
I20260709 13:06:45.522058 19453 leader_election.cc:290] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:45.523554 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:45.527551 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:06:45.514456 19572 log.cc:927] Time spent T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
I20260709 13:06:45.528023 16276 raft_consensus.cc:2468] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 7.
I20260709 13:06:45.528400 16348 raft_consensus.cc:2468] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 8.
I20260709 13:06:45.525218 16357 raft_consensus.cc:2468] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 7.
I20260709 13:06:45.538978 16322 leader_election.cc:304] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:06:45.540783 19476 raft_consensus.cc:2804] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:45.541306 19476 raft_consensus.cc:493] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:45.541777 19476 raft_consensus.cc:3060] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:45.545643 19459 raft_consensus.cc:3055] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:45.526451 19498 raft_consensus.cc:493] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:45.526998 19503 raft_consensus.cc:493] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.575631 19503 raft_consensus.cc:515] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:45.577836 19503 leader_election.cc:290] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:45.571096 19363 leader_election.cc:290] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:45.568953 19575 raft_consensus.cc:493] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.574344 19270 raft_consensus.cc:515] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:45.606413 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:45.601148 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:45.624675 16204 raft_consensus.cc:3060] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:45.628942 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:45.630098 16207 raft_consensus.cc:2468] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 8.
I20260709 13:06:45.546365 19459 raft_consensus.cc:740] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:45.636076 16275 raft_consensus.cc:2410] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:06:45.594494 19509 raft_consensus.cc:993] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3: : Instructing follower 363bb2f744eb486f9ad726f08214c98e to start an election
I20260709 13:06:45.519690 19507 raft_consensus.cc:515] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:45.620662 19498 raft_consensus.cc:3060] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:45.600656 19270 leader_election.cc:290] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 6 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:06:45.660270 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 171204us
I20260709 13:06:45.662956 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:45.663691 16348 raft_consensus.cc:3060] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:45.663959 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 175474us
I20260709 13:06:45.673576 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:45.673506 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:45.674476 16276 raft_consensus.cc:2393] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 in current term 7: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:06:45.598212 19575 raft_consensus.cc:515] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:45.649576 19221 raft_consensus.cc:1081] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 LEADER]: Signalling peer 363bb2f744eb486f9ad726f08214c98e to start an election
I20260709 13:06:45.684165 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:45.685302 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:45.693130 16279 raft_consensus.cc:2368] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for earlier term 9. Current term is 10.
I20260709 13:06:45.692946 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:45.693773 16282 raft_consensus.cc:2393] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 7: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:06:45.698688 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:45.699370 16207 raft_consensus.cc:3060] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:45.699630 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:45.700342 16206 raft_consensus.cc:2393] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 8: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:06:45.702189 16173 leader_election.cc:400] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 election: Vote denied by peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823) with higher term. Message: Invalid argument: T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for earlier term 9. Current term is 10.
I20260709 13:06:45.702668 16173 leader_election.cc:403] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:06:45.717880 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:45.730602 16348 raft_consensus.cc:2468] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 6.
I20260709 13:06:45.670743 19480 raft_consensus.cc:493] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:45.670975 19582 consensus_queue.cc:1048] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 13:06:45.766614 19480 raft_consensus.cc:515] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:45.785734 19480 leader_election.cc:290] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:06:45.805549 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 146741us
W20260709 13:06:45.802965 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 100996us
I20260709 13:06:45.808045 16173 leader_election.cc:304] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:06:45.668828 19459 consensus_queue.cc:260] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:06:45.812647 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 107800us
W20260709 13:06:45.822993 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 153771us
I20260709 13:06:45.822319 16207 raft_consensus.cc:2468] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 7.
I20260709 13:06:45.827610 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:45.829998 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:06:45.830834 16947 raft_consensus.cc:2393] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 7: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
I20260709 13:06:45.832664 16246 leader_election.cc:304] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:45.833468 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:45.834910 16914 leader_election.cc:304] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:45.802970 19468 raft_consensus.cc:493] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.813244 19506 raft_consensus.cc:2749] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823) with higher term. Message: Invalid argument: T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for earlier term 9. Current term is 10.
W20260709 13:06:45.887334 19590 log.cc:927] Time spent T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.151s	user 0.000s	sys 0.000s
I20260709 13:06:45.889629 19596 raft_consensus.cc:2749] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:45.892122 19594 raft_consensus.cc:2749] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:06:45.907163 16204 raft_consensus.cc:2468] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 6.
W20260709 13:06:45.899569 19589 log.cc:927] Time spent T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:06:45.910539 16912 leader_election.cc:304] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:45.853631 19452 raft_consensus.cc:2804] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:06:45.902130 19185 consensus_meta.cc:287] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 0.632s	user 0.012s	sys 0.002s
I20260709 13:06:45.857841 19548 raft_consensus.cc:493] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:45.952487 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:45.957270 16204 raft_consensus.cc:2468] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 8.
I20260709 13:06:45.959199 16912 leader_election.cc:304] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
W20260709 13:06:45.962414 19577 log.cc:927] Time spent T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.508s	user 0.007s	sys 0.006s
I20260709 13:06:45.965425 16200 raft_consensus.cc:2468] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 7.
I20260709 13:06:45.976033 19452 raft_consensus.cc:697] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:45.977540 19452 consensus_queue.cc:237] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:45.981395 19507 leader_election.cc:290] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:45.852663 19468 raft_consensus.cc:515] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:46.009786 19468 leader_election.cc:290] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:45.942536 19460 raft_consensus.cc:2804] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:45.942291 19506 raft_consensus.cc:493] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:46.011394 19506 raft_consensus.cc:515] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:46.010846 19460 raft_consensus.cc:697] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [term 6 LEADER]: Becoming Leader. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:06:46.010744 19373 raft_consensus.cc:515] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:46.013605 19506 leader_election.cc:290] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:45.953892 19185 raft_consensus.cc:515] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:46.015210 19373 leader_election.cc:290] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 9 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:46.017783 19185 leader_election.cc:290] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 10 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:46.017073 19460 consensus_queue.cc:237] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:45.986706 19548 raft_consensus.cc:515] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:46.024372 19548 leader_election.cc:290] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:46.024878 19476 raft_consensus.cc:515] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:46.026422 16354 raft_consensus.cc:2368] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 8. Current term is 9.
I20260709 13:06:46.028756 19476 leader_election.cc:290] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:45.994570 19386 raft_consensus.cc:2804] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:46.039172 19386 raft_consensus.cc:493] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:46.039669 19386 raft_consensus.cc:3060] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:46.040299 19459 raft_consensus.cc:3060] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:46.047039 19575 leader_election.cc:290] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:46.064168 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:46.065090 16204 raft_consensus.cc:3060] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:46.081887 16203 raft_consensus.cc:2410] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:06:46.084519 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:46.087218 19426 raft_consensus.cc:493] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:46.088050 19426 raft_consensus.cc:515] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:46.099377 19426 leader_election.cc:290] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:46.100464 19494 leader_election.cc:290] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 11 election: Requested vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:06:46.109902 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 56551.9us
I20260709 13:06:46.112914 18957 raft_consensus.cc:3060] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:46.123509 19474 raft_consensus.cc:493] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:46.124147 19474 raft_consensus.cc:515] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:46.129730 19591 raft_consensus.cc:493] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:46.130468 19591 raft_consensus.cc:515] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:46.130847 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:46.131631 16277 raft_consensus.cc:2393] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 10: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:06:46.132848 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:46.133745 16207 raft_consensus.cc:2393] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 8: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:06:46.136658 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:46.137570 16947 raft_consensus.cc:2393] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 5: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:06:46.140769 16354 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece"
dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
 from {username='slave'} at 127.0.0.1:41830
I20260709 13:06:46.141445 16354 raft_consensus.cc:493] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:46.141825 16354 raft_consensus.cc:3060] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:46.143626 16275 raft_consensus.cc:3060] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:46.145041 16940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:46.145983 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:46.147172 16278 raft_consensus.cc:2468] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 7.
I20260709 13:06:46.150082 16947 raft_consensus.cc:1240] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:46.154528 16204 raft_consensus.cc:2468] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 9.
I20260709 13:06:46.161350 16354 raft_consensus.cc:515] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:06:46.160079 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 48843.1us
I20260709 13:06:46.126363 19474 leader_election.cc:290] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:46.164552 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:46.174324 16278 raft_consensus.cc:3060] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:06:46.176883 16248 leader_election.cc:400] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107) with higher term. Message: Invalid argument: T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 8. Current term is 9.
I20260709 13:06:46.177423 16248 leader_election.cc:403] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:46.178889 16322 leader_election.cc:304] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:46.192514 16275 raft_consensus.cc:1275] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:06:46.132858 19591 leader_election.cc:290] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:46.215844 16320 leader_election.cc:304] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:06:46.223762 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:46.154479 19557 raft_consensus.cc:493] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:46.147305 19432 raft_consensus.cc:493] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
W20260709 13:06:46.174069 19295 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.501s	user 0.010s	sys 0.071s
I20260709 13:06:46.262450 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:46.304401 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:46.288843 18957 raft_consensus.cc:493] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:46.332149 18957 raft_consensus.cc:515] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:46.335490 18957 leader_election.cc:290] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:06:46.314579 19569 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.926s	user 0.021s	sys 0.000s
W20260709 13:06:46.337404 19569 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.952s	user 0.022s	sys 0.000s
I20260709 13:06:46.330567 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:06:46.231633 19571 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.825s	user 0.009s	sys 0.004s
I20260709 13:06:46.271687 16912 leader_election.cc:304] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
W20260709 13:06:46.344991 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 73433.7us
I20260709 13:06:46.345101 19428 raft_consensus.cc:2804] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:06:46.345818 19428 raft_consensus.cc:697] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 9 LEADER]: Becoming Leader. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:06:46.346846 16278 raft_consensus.cc:2468] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 9.
I20260709 13:06:46.346791 19428 consensus_queue.cc:237] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:06:46.347685 19571 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.950s	user 0.010s	sys 0.009s
I20260709 13:06:46.352136 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:46.354069 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:46.356582 16277 raft_consensus.cc:2468] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 9.
I20260709 13:06:46.185684 19426 raft_consensus.cc:2749] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:06:46.357798 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:46.281705 19557 raft_consensus.cc:515] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:46.372208 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:46.213042 19574 raft_consensus.cc:493] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:46.374332 19574 raft_consensus.cc:515] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:46.374925 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:46.375525 16356 raft_consensus.cc:2393] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 11: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:06:46.375614 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:46.376444 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:46.377278 16283 raft_consensus.cc:2393] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 9: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:06:46.378275 16351 raft_consensus.cc:2468] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 10.
I20260709 13:06:46.380223 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:46.381057 16203 raft_consensus.cc:3060] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:46.238186 19474 raft_consensus.cc:2804] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:46.383042 19474 raft_consensus.cc:697] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 7 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:06:46.279578 19506 raft_consensus.cc:493] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:46.384083 19474 consensus_queue.cc:237] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:46.384474 19506 raft_consensus.cc:515] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:46.289994 19432 raft_consensus.cc:515] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:46.356423 19530 raft_consensus.cc:2749] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107) with higher term. Message: Invalid argument: T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 8. Current term is 9.
W20260709 13:06:46.366823 19601 log.cc:927] Time spent T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
W20260709 13:06:46.368861 19498 consensus_meta.cc:287] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63: Time spent flushing consensus metadata: real 0.702s	user 0.006s	sys 0.005s
I20260709 13:06:46.386734 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:46.375013 16280 raft_consensus.cc:2468] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 11.
I20260709 13:06:46.353895 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:06:46.399471 16914 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.021s	sys 0.025s
I20260709 13:06:46.399036 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:46.420969 16204 raft_consensus.cc:2468] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 10.
W20260709 13:06:46.422114 16914 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.573s	user 0.021s	sys 0.025s
W20260709 13:06:46.422696 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 580986us
I20260709 13:06:46.424319 16914 leader_election.cc:304] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:46.401566 16949 raft_consensus.cc:1275] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:06:46.409965 16202 raft_consensus.cc:2468] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 10.
I20260709 13:06:46.418627 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:46.419471 16199 raft_consensus.cc:2468] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 9.
I20260709 13:06:46.417318 16203 raft_consensus.cc:2468] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 9.
I20260709 13:06:46.402098 19570 raft_consensus.cc:493] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:46.411417 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:46.460562 16206 raft_consensus.cc:3060] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:46.504866 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 113384us
I20260709 13:06:46.505914 16246 leader_election.cc:304] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:46.507635 16246 leader_election.cc:304] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:46.511193 18957 raft_consensus.cc:2749] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:06:46.525652 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 86750us
I20260709 13:06:46.527364 16320 leader_election.cc:304] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:46.531385 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:46.532366 16199 raft_consensus.cc:2410] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
W20260709 13:06:46.540365 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 116159us
I20260709 13:06:46.540508 19509 raft_consensus.cc:2749] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:46.500711 19498 raft_consensus.cc:515] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:46.579502 19574 leader_election.cc:290] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:46.513659 19570 raft_consensus.cc:515] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:46.582270 19570 leader_election.cc:290] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:46.566345 19506 leader_election.cc:290] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:46.559492 19476 raft_consensus.cc:2804] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:46.576565 19583 raft_consensus.cc:2749] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:46.587317 19476 raft_consensus.cc:493] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:46.624418 19600 log.cc:927] Time spent T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.269s	user 0.000s	sys 0.001s
W20260709 13:06:46.630184 19386 consensus_meta.cc:287] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63: Time spent flushing consensus metadata: real 0.590s	user 0.009s	sys 0.002s
I20260709 13:06:46.630896 19386 raft_consensus.cc:515] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:46.641049 19557 leader_election.cc:290] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:46.619095 19476 raft_consensus.cc:3060] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:46.679533 19386 leader_election.cc:290] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 9 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:46.683352 19498 leader_election.cc:290] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 8 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:46.686035 19432 leader_election.cc:290] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:06:46.747602 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 209082us
I20260709 13:06:46.753715 16279 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45218 (request call id 1819) took 1059 ms. Trace:
I20260709 13:06:46.754896 16276 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42740 (request call id 506) took 1074 ms. Trace:
I20260709 13:06:46.755575 16276 rpcz_store.cc:276] 0709 13:06:45.680260 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.680790 (+   530us) service_pool.cc:224] Handling call
0709 13:06:45.681206 (+   416us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:45.681627 (+   421us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:45.681670 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:45.682296 (+   626us) log.cc:844] Serialized 26 byte log entry
0709 13:06:46.030189 (+347893us) spinlock_profiling.cc:243] Waited 2.94 ms on lock 0x7b180040c000. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f3625264de1 00007f36252715b1 00007f361c37ee07 00007f36251d9ab9 00007f361c39b69b 00007f361c39993f 00007f361c39bc02 00007f361f02320b 00007f361f028d23 00007f361f0290d1 00007f361f444a0f
0709 13:06:46.315243 (+285054us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:06:46.315329 (+    86us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:46.315479 (+   150us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:46.753966 (+438487us) raft_consensus.cc:1685] finished
0709 13:06:46.754006 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:46.754620 (+   614us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":106,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":18291,"spinlock_wait_cycles":6768384,"thread_start_us":284627,"threads_started":1,"wal-append.queue_time_us":984442}
I20260709 13:06:46.754787 16279 rpcz_store.cc:276] 0709 13:06:45.694430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.694674 (+   244us) service_pool.cc:224] Handling call
0709 13:06:45.695014 (+   340us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:45.695229 (+   215us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:45.695251 (+    22us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:45.695695 (+   444us) log.cc:844] Serialized 26 byte log entry
0709 13:06:45.938776 (+243081us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:45.938834 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:45.938942 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:46.752908 (+813966us) raft_consensus.cc:1685] finished
0709 13:06:46.752972 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:46.753430 (+   458us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":181976,"threads_started":1,"wal-append.queue_time_us":459132}
I20260709 13:06:46.765021 16352 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41830 (request call id 1848) took 1090 ms. Trace:
W20260709 13:06:46.765295 16173 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:46.765635 16352 rpcz_store.cc:276] 0709 13:06:45.674287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.674942 (+   655us) service_pool.cc:224] Handling call
0709 13:06:45.703112 (+ 28170us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:46.167986 (+464874us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:46.168033 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:46.187610 (+ 19577us) log.cc:844] Serialized 26 byte log entry
0709 13:06:46.403771 (+216161us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:46.403809 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:46.404104 (+   295us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:46.764067 (+359963us) raft_consensus.cc:1685] finished
0709 13:06:46.764122 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:46.764775 (+   653us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3643,"raft.queue_time_us":26045,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":23456,"thread_start_us":679454,"threads_started":2,"wal-append.queue_time_us":484646}
I20260709 13:06:46.768523 16173 leader_election.cc:304] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:06:46.770959 15057 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:46.771910 16355 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33486 (request call id 386) took 1116 ms. Trace:
I20260709 13:06:46.826843 16355 rpcz_store.cc:276] 0709 13:06:45.655452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.656028 (+   576us) service_pool.cc:224] Handling call
0709 13:06:45.656436 (+   408us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:45.675457 (+ 19021us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:06:45.728527 (+ 53070us) log.cc:844] Serialized 14 byte log entry
0709 13:06:45.943941 (+215414us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:45.944526 (+   585us) log.cc:844] Serialized 26 byte log entry
0709 13:06:45.944720 (+   194us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:06:45.944769 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:45.944875 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:46.771195 (+826320us) raft_consensus.cc:1685] finished
0709 13:06:46.771244 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:46.771644 (+   400us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50196,"prepare.queue_time_us":53308,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":58,"raft.queue_time_us":122142,"raft.run_cpu_time_us":254,"raft.run_wall_time_us":7383,"thread_start_us":182904,"threads_started":1,"wal-append.queue_time_us":510104}
I20260709 13:06:46.773653 16354 leader_election.cc:290] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:46.831175 16351 raft_consensus.cc:1240] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:46.778966 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:46.784905 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:46.784843 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:46.788436 16277 raft_consensus.cc:1275] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:06:46.790807 16200 raft_consensus.cc:1275] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:06:46.801491 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:46.802935 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: true dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:46.811252 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:46.812680 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:46.814338 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:46.814668 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:46.857736 16278 raft_consensus.cc:2468] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 7.
I20260709 13:06:46.858848 19076 raft_consensus.cc:493] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:46.859400 16275 raft_consensus.cc:3055] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:46.859932 16275 raft_consensus.cc:740] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:46.861876 16275 consensus_queue.cc:260] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:46.865720 16275 raft_consensus.cc:3060] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:46.868285 19494 raft_consensus.cc:493] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:46.875077 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:46.875262 19494 raft_consensus.cc:515] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:46.875941 16281 raft_consensus.cc:2468] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 9.
I20260709 13:06:46.876111 16207 raft_consensus.cc:3060] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:46.877741 16940 raft_consensus.cc:2368] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 8. Current term is 9.
I20260709 13:06:46.878008 19304 raft_consensus.cc:493] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:46.869354 19506 consensus_queue.cc:1048] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:46.880960 19452 raft_consensus.cc:493] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:46.881695 19506 raft_consensus.cc:493] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:46.883095 19603 raft_consensus.cc:2804] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:46.883663 19603 raft_consensus.cc:493] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:46.883900 19494 leader_election.cc:290] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:46.888046 16276 raft_consensus.cc:2468] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 9.
I20260709 13:06:46.889272 19495 raft_consensus.cc:493] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:46.892971 19304 raft_consensus.cc:515] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:46.895066 19509 raft_consensus.cc:493] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:46.903945 19304 leader_election.cc:290] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:46.904505 19604 raft_consensus.cc:493] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:46.905238 19604 raft_consensus.cc:515] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:46.898178 16275 raft_consensus.cc:2468] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 6.
I20260709 13:06:46.870795 19189 raft_consensus.cc:493] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:46.873353 19295 raft_consensus.cc:493] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:46.884068 19603 raft_consensus.cc:3060] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:46.884898 16353 raft_consensus.cc:2410] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:06:46.886003 19428 raft_consensus.cc:493] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:46.886494 16280 raft_consensus.cc:2468] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 6.
I20260709 13:06:46.887243 16946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:46.882858 19506 raft_consensus.cc:515] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:46.872826 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:46.874053 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:46.896055 19509 raft_consensus.cc:515] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:46.881985 19452 raft_consensus.cc:515] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:46.948823 16208 raft_consensus.cc:1275] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:06:46.952824 16206 raft_consensus.cc:2468] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 6.
W20260709 13:06:46.953990 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 186127us
I20260709 13:06:46.955220 19426 raft_consensus.cc:493] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:46.859983 19076 raft_consensus.cc:515] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:46.945787 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:46.963728 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:46.967093 19507 raft_consensus.cc:493] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:46.966962 19428 raft_consensus.cc:515] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:46.959661 19189 raft_consensus.cc:515] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:46.967921 19507 raft_consensus.cc:515] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:46.969293 19498 raft_consensus.cc:493] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:46.969952 19428 leader_election.cc:290] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:46.970484 19189 leader_election.cc:290] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:46.970944 16946 raft_consensus.cc:2393] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 6: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
I20260709 13:06:46.978686 19426 raft_consensus.cc:515] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:46.988704 19604 leader_election.cc:290] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:46.967797 16354 raft_consensus.cc:3060] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:46.992758 19426 leader_election.cc:290] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:06:46.993387 19614 log.cc:927] Time spent T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 13:06:46.978710 16355 raft_consensus.cc:2468] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 8.
I20260709 13:06:46.982486 19076 leader_election.cc:290] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:46.995481 19509 leader_election.cc:290] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:46.998776 16199 raft_consensus.cc:1240] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:46.992117 19295 raft_consensus.cc:515] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:47.003674 16207 raft_consensus.cc:2468] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 8.
W20260709 13:06:47.004209 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 57213.6us
I20260709 13:06:46.927773 19495 raft_consensus.cc:515] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:46.969977 19498 raft_consensus.cc:515] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:47.002153 19506 leader_election.cc:290] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:47.014241 19452 leader_election.cc:290] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:47.026886 19386 raft_consensus.cc:493] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.027426 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f022e2e63ae4461d834e476ff2666991" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:47.027681 19386 raft_consensus.cc:515] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:47.029845 19386 leader_election.cc:290] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:47.031289 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:47.033099 19545 consensus_queue.cc:1048] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:47.032080 19295 leader_election.cc:290] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:47.034884 16946 raft_consensus.cc:1275] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:06:47.036986 16248 leader_election.cc:304] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:47.038383 19569 raft_consensus.cc:2749] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:47.039130 19452 consensus_queue.cc:1048] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:06:47.039438 16912 leader_election.cc:304] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:47.040812 19428 raft_consensus.cc:2804] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:47.041345 19428 raft_consensus.cc:697] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [term 8 LEADER]: Becoming Leader. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:06:47.059494 19498 leader_election.cc:290] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:47.064615 19507 leader_election.cc:290] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:47.068571 19495 leader_election.cc:290] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:47.075193 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:47.075904 16275 raft_consensus.cc:3060] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:06:47.042393 19428 consensus_queue.cc:237] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:47.079563 16940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:47.080385 16940 raft_consensus.cc:2468] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 6.
I20260709 13:06:47.081254 19495 raft_consensus.cc:493] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.081974 19495 raft_consensus.cc:515] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:47.084589 19495 leader_election.cc:290] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:47.084848 16946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f022e2e63ae4461d834e476ff2666991" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:47.079797 16248 leader_election.cc:400] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875) with higher term. Message: Invalid argument: T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 8. Current term is 9.
I20260709 13:06:47.085690 16248 leader_election.cc:403] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:47.091408 16248 leader_election.cc:304] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:47.097173 16354 raft_consensus.cc:2468] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 9.
I20260709 13:06:47.096828 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:47.099201 16280 raft_consensus.cc:2410] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:06:47.100490 19506 consensus_queue.cc:1048] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:47.101832 16248 leader_election.cc:304] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:06:47.103148 19507 raft_consensus.cc:2749] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:47.104156 19509 consensus_queue.cc:1048] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:06:47.104660 19507 raft_consensus.cc:2804] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:47.105108 19507 raft_consensus.cc:493] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:47.105449 19507 raft_consensus.cc:3060] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:47.108274 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:47.112485 16940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:47.118803 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:47.122184 16940 raft_consensus.cc:2468] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 6.
I20260709 13:06:47.122540 16248 leader_election.cc:304] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:47.127848 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:47.130874 16248 leader_election.cc:304] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:06:47.126047 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:47.126013 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:47.134920 19548 raft_consensus.cc:2804] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:47.135510 19548 raft_consensus.cc:493] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:47.139024 16246 leader_election.cc:304] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:47.135099 19609 raft_consensus.cc:2749] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:06:47.139611 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 496411us
I20260709 13:06:47.146170 16173 leader_election.cc:304] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:47.138454 19548 raft_consensus.cc:3060] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:47.151437 16277 raft_consensus.cc:2468] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 5.
I20260709 13:06:47.157191 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:47.151665 19494 raft_consensus.cc:493] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:47.159554 19494 raft_consensus.cc:515] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:47.160204 19506 raft_consensus.cc:2804] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:47.160882 19506 raft_consensus.cc:493] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:47.161298 19506 raft_consensus.cc:3060] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:47.168685 19605 raft_consensus.cc:493] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:47.169731 19605 raft_consensus.cc:515] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:47.172372 19605 leader_election.cc:290] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:47.170042 16320 leader_election.cc:304] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:06:47.174232 19295 raft_consensus.cc:493] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:47.174942 19295 raft_consensus.cc:515] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:47.177314 19295 leader_election.cc:290] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:47.179309 16320 leader_election.cc:304] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:47.180747 19295 raft_consensus.cc:2804] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:47.183494 19076 raft_consensus.cc:2804] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:47.183948 19076 raft_consensus.cc:493] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:47.184322 19076 raft_consensus.cc:3060] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:47.184999 19426 raft_consensus.cc:493] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:47.185827 19426 raft_consensus.cc:515] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:47.189016 19426 leader_election.cc:290] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:47.190934 19295 raft_consensus.cc:697] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 10 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:06:47.192384 19295 consensus_queue.cc:237] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:47.196719 16275 raft_consensus.cc:2468] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 9.
I20260709 13:06:47.162343 19494 leader_election.cc:290] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:47.197968 19452 raft_consensus.cc:2749] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875) with higher term. Message: Invalid argument: T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 8. Current term is 9.
I20260709 13:06:47.202837 16207 raft_consensus.cc:2468] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 10.
W20260709 13:06:47.223857 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 59884.4us
I20260709 13:06:47.230487 16173 leader_election.cc:304] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:47.239202 16320 leader_election.cc:304] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
W20260709 13:06:47.243860 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 62205.4us
I20260709 13:06:47.252465 19626 raft_consensus.cc:2804] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:06:47.253000 16914 leader_election.cc:304] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:47.253983 19498 raft_consensus.cc:2749] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:47.255293 16103 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55244 (request call id 124) took 8937 ms. Trace:
I20260709 13:06:47.255743 16103 rpcz_store.cc:276] 0709 13:06:38.318243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:38.318460 (+   217us) service_pool.cc:224] Handling call
0709 13:06:47.255065 (+8936605us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:44.466917 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:44.584631 (+117714us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:44.584671 (+    40us) write_op.cc:435] Acquired schema lock
0709 13:06:44.584688 (+    17us) tablet.cc:662] Decoding operations
0709 13:06:44.585339 (+   651us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:44.585439 (+   100us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:44.585466 (+    27us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:06:44.585856 (+   390us) tablet.cc:701] Row locks acquired
0709 13:06:44.585875 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:06:44.586031 (+   156us) write_op.cc:270] Start()
0709 13:06:44.586165 (+   134us) write_op.cc:276] Timestamp: P: 1783602404585985 usec, L: 0
0709 13:06:44.586189 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:06:44.601824 (+ 15635us) log.cc:844] Serialized 1686 byte log entry
0709 13:06:45.367774 (+765950us) op_driver.cc:464] REPLICATION: finished
0709 13:06:46.052548 (+684774us) spinlock_profiling.cc:243] Waited 6.06 ms on lock 0x7b4400022b4c. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361c224db1 00007f361c2c2c85 00007f361c2c36a2 00007f361f0351db 00007f361f030aaf 00007f361c37f0ac 00007f36251d9ab9 00007f361c39b69b 00007f361c39993f 00007f361c39bc02 00007f3622ebfef0
0709 13:06:46.561663 (+509115us) write_op.cc:301] APPLY: starting
0709 13:06:46.568441 (+  6778us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:46.586648 (+ 18207us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:46.586688 (+    40us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:46.598867 (+ 12179us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:46.599153 (+   286us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 13:06:46.599229 (+    76us) write_op.cc:312] APPLY: finished
0709 13:06:46.606162 (+  6933us) log.cc:844] Serialized 41 byte log entry
0709 13:06:46.973465 (+367303us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:46.973933 (+   468us) write_op.cc:454] Released schema lock
0709 13:06:46.974078 (+   145us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:46.974868 (+   790us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:46.974901 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":230606,"reported_tablets":14,"spinlock_wait_cycles":2816,"child_traces":[["op",{"apply.queue_time_us":1159947,"apply.run_cpu_time_us":68081,"apply.run_wall_time_us":427064,"num_ops":4,"prepare.queue_time_us":259698,"prepare.run_cpu_time_us":10831,"prepare.run_wall_time_us":350600,"raft.queue_time_us":104863,"raft.run_cpu_time_us":20351,"raft.run_wall_time_us":1005081,"replication_time_us":770697,"spinlock_wait_cycles":13941632,"thread_start_us":1775277,"threads_started":5,"wal-append.queue_time_us":1043145,"wal-append.run_cpu_time_us":7733,"wal-append.run_wall_time_us":1067025}]]}
I20260709 13:06:47.255293 16914 leader_election.cc:304] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:47.261878 16914 leader_election.cc:304] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:06:47.262881 19498 raft_consensus.cc:2804] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:47.263404 19498 raft_consensus.cc:493] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:47.263813 19498 raft_consensus.cc:3060] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:47.266168 19588 raft_consensus.cc:2804] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:06:47.268968 19588 raft_consensus.cc:697] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 9 LEADER]: Becoming Leader. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:06:47.268057 16320 leader_election.cc:304] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:47.267606 19432 raft_consensus.cc:2804] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:06:47.270186 19569 raft_consensus.cc:493] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:47.273998 16246 leader_election.cc:304] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:47.281453 19495 raft_consensus.cc:2804] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:47.281672 19569 raft_consensus.cc:515] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:47.281481 16102 catalog_manager.cc:5697] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 4 to 7, leader changed from 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) to e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65). New cstate: current_term: 7 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } }
I20260709 13:06:47.284245 19530 raft_consensus.cc:2749] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:47.285197 19569 leader_election.cc:290] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:47.286331 19548 raft_consensus.cc:515] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:47.287333 19495 raft_consensus.cc:493] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:47.287871 19495 raft_consensus.cc:3060] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:47.289103 19548 leader_election.cc:290] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 election: Requested vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:47.292538 16205 raft_consensus.cc:1275] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:06:47.293744 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:47.294312 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:47.295055 19432 raft_consensus.cc:697] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 9 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:06:47.295833 19426 raft_consensus.cc:2804] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:47.296475 19426 raft_consensus.cc:697] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 6 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:06:47.296342 19432 consensus_queue.cc:237] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:47.297654 19426 consensus_queue.cc:237] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:47.301628 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:47.274501 19076 raft_consensus.cc:515] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:47.302757 19588 consensus_queue.cc:237] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:47.305356 19076 leader_election.cc:290] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:47.308429 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:06:47.309453 16947 raft_consensus.cc:3060] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:47.310679 16322 leader_election.cc:304] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:06:47.311944 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 84825.1us
I20260709 13:06:47.312885 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:47.313364 16322 leader_election.cc:304] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:47.315094 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:47.284930 16102 catalog_manager.cc:5697] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:47.295857 16173 leader_election.cc:304] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:47.324848 19620 raft_consensus.cc:2749] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:47.325424 19189 raft_consensus.cc:2749] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:06:47.332248 19476 consensus_meta.cc:287] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 0.677s	user 0.003s	sys 0.014s
I20260709 13:06:47.333009 19476 raft_consensus.cc:515] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:47.333933 16199 raft_consensus.cc:1240] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:47.335980 19476 leader_election.cc:290] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:47.335361 16102 catalog_manager.cc:5697] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } }
I20260709 13:06:47.274273 19507 raft_consensus.cc:515] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:47.337680 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:47.343176 16947 raft_consensus.cc:2468] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 7.
W20260709 13:06:47.342585 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 46778.9us
I20260709 13:06:47.356389 19605 raft_consensus.cc:2804] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:47.356979 19605 raft_consensus.cc:493] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:47.357389 19605 raft_consensus.cc:3060] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:47.359297 19498 raft_consensus.cc:515] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:47.352181 16102 catalog_manager.cc:5697] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 2 to 3, leader changed from 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) to 363bb2f744eb486f9ad726f08214c98e (127.14.180.67). New cstate: current_term: 3 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } }
I20260709 13:06:47.376353 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:47.376921 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:47.376098 16102 catalog_manager.cc:5697] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:47.343199 19603 raft_consensus.cc:515] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:47.379746 16203 raft_consensus.cc:2393] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 in current term 9: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:06:47.381006 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:47.367158 19495 raft_consensus.cc:515] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:47.368769 16946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:47.369768 19507 leader_election.cc:290] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 election: Requested vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:06:47.370591 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 57377.4us
I20260709 13:06:47.367385 19506 raft_consensus.cc:515] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:47.371618 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:06:47.412787 16942 raft_consensus.cc:3060] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:47.413151 19506 leader_election.cc:290] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 11 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:47.384318 19603 leader_election.cc:290] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:47.420352 19498 leader_election.cc:290] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 6 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:47.400099 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:47.422616 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:47.423610 16206 raft_consensus.cc:2393] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 11: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:06:47.425887 16248 leader_election.cc:304] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:06:47.378490 16102 catalog_manager.cc:5697] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 9 to 10, leader changed from 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) to 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66). New cstate: current_term: 10 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:47.394691 19626 raft_consensus.cc:697] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:47.401822 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:47.406898 16940 raft_consensus.cc:1240] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:06:47.434330 16102 catalog_manager.cc:5697] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } }
I20260709 13:06:47.430433 16942 raft_consensus.cc:2468] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 7.
I20260709 13:06:47.422029 19476 consensus_queue.cc:1048] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 13:06:47.441201 19620 consensus_queue.cc:1048] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:47.447014 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:47.453794 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:47.454372 19569 raft_consensus.cc:2804] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:47.455188 19569 raft_consensus.cc:697] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:47.456379 19569 consensus_queue.cc:237] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:47.456991 16322 leader_election.cc:304] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:06:47.460788 19626 consensus_queue.cc:237] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } }
I20260709 13:06:47.463959 16248 leader_election.cc:304] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:06:47.464205 19189 raft_consensus.cc:2804] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:47.464717 19189 raft_consensus.cc:493] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:47.464886 19509 raft_consensus.cc:2804] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:47.465152 19189 raft_consensus.cc:3060] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:47.465299 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:47.465471 19509 raft_consensus.cc:697] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:47.469794 16914 leader_election.cc:304] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:47.472152 19498 raft_consensus.cc:2749] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:47.477267 19603 raft_consensus.cc:493] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.477936 19603 raft_consensus.cc:515] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:47.478399 19634 raft_consensus.cc:493] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.479156 19634 raft_consensus.cc:515] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:47.480453 19603 leader_election.cc:290] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:47.481483 19634 leader_election.cc:290] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:47.482749 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:47.485553 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:47.486516 16207 raft_consensus.cc:1275] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:06:47.490707 19469 consensus_queue.cc:1048] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:06:47.486433 16354 raft_consensus.cc:2468] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 5.
I20260709 13:06:47.466826 19509 consensus_queue.cc:237] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:47.491024 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:47.498670 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:47.507939 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:47.508738 16353 raft_consensus.cc:3060] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:06:47.510022 19495 leader_election.cc:290] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:47.476824 16102 catalog_manager.cc:5697] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 5 to 8, leader changed from e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) to 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66). New cstate: current_term: 8 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:47.517096 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:47.519642 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:47.520390 16206 raft_consensus.cc:3060] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:47.522223 16102 catalog_manager.cc:5697] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:47.525799 19432 consensus_queue.cc:1059] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:06:47.532491 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:47.534436 16248 leader_election.cc:304] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:47.536532 19432 raft_consensus.cc:3055] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:47.537036 19432 raft_consensus.cc:740] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:06:47.536790 19605 raft_consensus.cc:515] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:47.538851 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:47.540490 19548 raft_consensus.cc:2749] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:47.542929 19189 raft_consensus.cc:515] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:47.544227 16203 raft_consensus.cc:2368] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for earlier term 9. Current term is 10.
I20260709 13:06:47.537979 19432 consensus_queue.cc:260] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:47.545632 19189 leader_election.cc:290] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:47.544235 16355 raft_consensus.cc:2468] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 6.
I20260709 13:06:47.556232 16206 raft_consensus.cc:2468] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 11.
I20260709 13:06:47.546397 19432 raft_consensus.cc:3060] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:47.562608 16320 leader_election.cc:400] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 election: Vote denied by peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073) with higher term. Message: Invalid argument: T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for earlier term 9. Current term is 10.
I20260709 13:06:47.562932 16320 leader_election.cc:403] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:06:47.562219 16940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:47.560711 16102 catalog_manager.cc:5697] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 4 to 7, leader changed from 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) to e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65). New cstate: current_term: 7 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } }
I20260709 13:06:47.562088 16353 raft_consensus.cc:2468] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 7.
I20260709 13:06:47.572587 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:47.577795 16246 leader_election.cc:304] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:47.586051 16949 raft_consensus.cc:1240] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [term 8 LEADER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:47.589722 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:47.589324 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:47.570919 19295 raft_consensus.cc:3060] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:47.587858 16102 catalog_manager.cc:5697] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 2 to 5, leader changed from 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) to 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66). New cstate: current_term: 5 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:47.588467 19609 raft_consensus.cc:2804] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:06:47.625110 16940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:47.625805 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:47.626183 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:47.627980 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:47.641812 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:47.645470 16102 catalog_manager.cc:5697] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 5 to 7, leader changed from e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) to 363bb2f744eb486f9ad726f08214c98e (127.14.180.67). New cstate: current_term: 7 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } }
I20260709 13:06:47.653898 16322 leader_election.cc:304] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:47.654844 19604 raft_consensus.cc:2749] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:47.655840 16322 leader_election.cc:304] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:47.656562 19604 raft_consensus.cc:2749] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:47.657824 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:47.658057 16355 raft_consensus.cc:1275] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:06:47.622467 19605 leader_election.cc:290] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:47.659332 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:47.664809 16102 catalog_manager.cc:5697] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } }
I20260709 13:06:47.669747 16949 raft_consensus.cc:2368] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for earlier term 6. Current term is 7.
I20260709 13:06:47.672789 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:47.665683 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:47.711433 16348 raft_consensus.cc:2410] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:06:47.711520 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:47.717281 16351 raft_consensus.cc:1275] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:06:47.725597 16276 raft_consensus.cc:2393] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 9: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:06:47.732713 16102 catalog_manager.cc:5697] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 2 to 10, leader changed from e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) to 363bb2f744eb486f9ad726f08214c98e (127.14.180.67). New cstate: current_term: 10 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } }
I20260709 13:06:47.659003 19452 raft_consensus.cc:493] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:47.763543 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:47.764282 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:06:47.765766 16949 raft_consensus.cc:2368] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for earlier term 6. Current term is 7.
I20260709 13:06:47.765902 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:06:47.768693 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 55376.9us
I20260709 13:06:47.716316 19569 raft_consensus.cc:493] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
W20260709 13:06:47.813306 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 43810.3us
I20260709 13:06:47.827935 16322 leader_election.cc:304] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:47.772670 19509 raft_consensus.cc:493] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:47.844535 16201 raft_consensus.cc:1240] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 10. Current term is 11. Ops: []
W20260709 13:06:47.836414 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 168806us
I20260709 13:06:47.852022 16102 catalog_manager.cc:5697] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } }
W20260709 13:06:47.859443 19637 log.cc:927] Time spent T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63: Append to log took a long time: real 0.133s	user 0.001s	sys 0.000s
I20260709 13:06:47.860455 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:47.861207 16280 raft_consensus.cc:3060] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Advancing to term 11
W20260709 13:06:47.861636 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 202314us
I20260709 13:06:47.863359 19389 raft_consensus.cc:493] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:47.864019 19389 raft_consensus.cc:515] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:47.865513 19386 consensus_queue.cc:1048] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:47.866214 19389 leader_election.cc:290] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:47.870702 16353 raft_consensus.cc:2410] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:06:47.876034 16280 raft_consensus.cc:2468] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 11.
I20260709 13:06:47.878474 16207 raft_consensus.cc:1275] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:06:47.880364 16207 raft_consensus.cc:1275] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:06:47.882740 19386 consensus_queue.cc:1048] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:06:47.884258 19386 consensus_queue.cc:1048] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:06:47.889956 16102 catalog_manager.cc:5697] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 9 to 10, leader changed from 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) to e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65). New cstate: current_term: 10 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } }
I20260709 13:06:47.836077 19569 raft_consensus.cc:515] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:47.844090 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:47.906595 16102 catalog_manager.cc:5697] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 4 to 5, leader changed from 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) to e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65). New cstate: current_term: 5 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } }
I20260709 13:06:47.909294 16102 catalog_manager.cc:5697] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } }
W20260709 13:06:47.917933 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 86499.8us
I20260709 13:06:47.829782 19452 raft_consensus.cc:515] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:47.891906 19604 raft_consensus.cc:493] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:47.925462 16102 catalog_manager.cc:5697] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 7 to 8, leader changed from 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) to 363bb2f744eb486f9ad726f08214c98e (127.14.180.67). New cstate: current_term: 8 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } }
W20260709 13:06:47.931376 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 103546us
I20260709 13:06:47.932899 16322 leader_election.cc:304] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:06:47.898590 19620 raft_consensus.cc:493] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:47.927616 16173 leader_election.cc:304] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
W20260709 13:06:47.976459 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 83247.2us
I20260709 13:06:47.935866 19426 raft_consensus.cc:2749] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:47.981755 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:47.912758 19509 raft_consensus.cc:515] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:47.969220 19603 raft_consensus.cc:2749] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:47.937258 19604 raft_consensus.cc:515] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:06:47.979650 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 49746.1us
I20260709 13:06:48.025360 16248 leader_election.cc:304] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:47.971089 19620 raft_consensus.cc:515] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:06:48.031178 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 98361.5us
I20260709 13:06:48.032351 16322 leader_election.cc:304] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:48.046794 16322 leader_election.cc:400] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Vote denied by peer 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875) with higher term. Message: Invalid argument: T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for earlier term 6. Current term is 7.
I20260709 13:06:48.047181 16322 leader_election.cc:403] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:48.020622 19426 raft_consensus.cc:2749] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:48.056830 16322 leader_election.cc:400] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 election: Vote denied by peer 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875) with higher term. Message: Invalid argument: T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for earlier term 6. Current term is 7.
I20260709 13:06:48.058842 16322 leader_election.cc:403] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:06:47.977926 19609 raft_consensus.cc:697] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
W20260709 13:06:48.060876 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 139056us
I20260709 13:06:48.026857 19432 consensus_queue.cc:1059] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:06:48.075625 19476 raft_consensus.cc:2749] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875) with higher term. Message: Invalid argument: T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for earlier term 6. Current term is 7.
I20260709 13:06:48.074599 19649 raft_consensus.cc:493] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.080773 19530 raft_consensus.cc:2749] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:48.083518 19647 raft_consensus.cc:3060] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:48.100315 19649 raft_consensus.cc:515] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:48.101233 19654 raft_consensus.cc:493] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:48.101969 19654 raft_consensus.cc:515] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:48.097390 19426 raft_consensus.cc:3055] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:48.103106 19426 raft_consensus.cc:740] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:06:48.103999 19426 consensus_queue.cc:260] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:48.104866 19474 raft_consensus.cc:2749] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:48.106138 19620 leader_election.cc:290] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:06:48.108215 19642 log.cc:927] Time spent T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.137s	user 0.000s	sys 0.001s
W20260709 13:06:48.109637 19639 log.cc:927] Time spent T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.275s	user 0.001s	sys 0.000s
I20260709 13:06:48.115370 19649 leader_election.cc:290] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:48.121745 19545 consensus_queue.cc:1048] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:06:48.126258 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 55740.8us
I20260709 13:06:48.127383 16914 leader_election.cc:304] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:48.139487 15057 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:48.104434 19654 leader_election.cc:290] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:48.147564 19569 leader_election.cc:290] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:48.150334 19588 raft_consensus.cc:2749] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:06:48.197849 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 217634us
I20260709 13:06:48.167277 19452 leader_election.cc:290] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:06:48.199903 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 44197.9us
I20260709 13:06:48.150584 19509 leader_election.cc:290] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:06:48.206930 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 148093us
I20260709 13:06:48.194610 19649 raft_consensus.cc:493] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:48.257910 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:06:48.211189 19569 raft_consensus.cc:493] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.272357 19645 raft_consensus.cc:493] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:48.273196 19645 raft_consensus.cc:515] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:48.168077 19609 consensus_queue.cc:237] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:48.281323 19649 raft_consensus.cc:515] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:48.283861 19649 leader_election.cc:290] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:48.285832 19569 raft_consensus.cc:515] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } }
I20260709 13:06:48.288395 19569 leader_election.cc:290] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:06:48.292622 19295 consensus_meta.cc:287] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 0.672s	user 0.005s	sys 0.007s
I20260709 13:06:48.250398 19604 leader_election.cc:290] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:48.298511 19530 raft_consensus.cc:493] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:48.303252 19672 raft_consensus.cc:493] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:48.303468 19530 raft_consensus.cc:515] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:48.303948 19672 raft_consensus.cc:515] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:06:48.299031 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 57002.2us
I20260709 13:06:48.308911 19657 raft_consensus.cc:493] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:48.298211 19660 log.cc:927] Time spent T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63: Append to log took a long time: real 0.078s	user 0.000s	sys 0.002s
I20260709 13:06:48.309719 19657 raft_consensus.cc:515] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } }
I20260709 13:06:48.362089 19657 leader_election.cc:290] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:48.306404 19672 leader_election.cc:290] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:48.373116 19530 leader_election.cc:290] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:48.373484 16200 raft_consensus.cc:1275] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:06:48.374822 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:48.378850 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:48.383854 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:48.359481 19295 raft_consensus.cc:2749] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073) with higher term. Message: Invalid argument: T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for earlier term 9. Current term is 10.
I20260709 13:06:48.392673 16322 leader_election.cc:304] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:48.363417 19509 raft_consensus.cc:493] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:48.364539 19569 raft_consensus.cc:493] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:48.367650 19605 raft_consensus.cc:493] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:48.397676 16322 leader_election.cc:304] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:48.408102 16322 leader_election.cc:304] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:48.398604 19672 raft_consensus.cc:2749] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:48.408962 19569 raft_consensus.cc:515] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:48.410951 19672 raft_consensus.cc:2749] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:48.411504 19645 leader_election.cc:290] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:48.400202 16202 raft_consensus.cc:1275] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:06:48.400833 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:48.402515 16357 raft_consensus.cc:1275] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:06:48.413137 16357 pending_rounds.cc:85] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e: Aborting all ops after (but not including) 7
I20260709 13:06:48.412336 19665 raft_consensus.cc:2804] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:06:48.385411 19657 raft_consensus.cc:493] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:48.394866 19647 raft_consensus.cc:2749] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875) with higher term. Message: Invalid argument: T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for earlier term 6. Current term is 7.
W20260709 13:06:48.418803 16246 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.592s	user 0.002s	sys 0.007s
W20260709 13:06:48.419822 16246 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.002s	sys 0.007s
W20260709 13:06:48.420486 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 593625us
I20260709 13:06:48.413417 16357 pending_rounds.cc:107] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:06:48.421638 16357 raft_consensus.cc:2889] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:48.406091 19648 raft_consensus.cc:493] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
W20260709 13:06:48.437949 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 50726.9us
I20260709 13:06:48.448137 19657 raft_consensus.cc:515] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:06:48.450944 19677 log.cc:927] Time spent T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.145s	user 0.000s	sys 0.002s
I20260709 13:06:48.453379 19665 raft_consensus.cc:697] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 11 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:06:48.443506 16173 leader_election.cc:304] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:48.411000 19605 raft_consensus.cc:515] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:48.433359 19509 raft_consensus.cc:515] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:48.462373 19626 raft_consensus.cc:2749] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:06:48.463128 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 55119.4us
I20260709 13:06:48.465675 16173 leader_election.cc:304] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:06:48.454636 19665 consensus_queue.cc:237] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:48.475391 16277 raft_consensus.cc:1240] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 LEADER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:48.479828 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:48.463779 19668 consensus_queue.cc:1048] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.013s
I20260709 13:06:48.480712 16207 raft_consensus.cc:2468] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 9.
I20260709 13:06:48.485229 16173 leader_election.cc:304] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:48.491850 19605 leader_election.cc:290] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:48.455587 19648 raft_consensus.cc:515] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:48.529315 16173 leader_election.cc:304] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:48.529398 19685 consensus_queue.cc:1059] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:48.494827 19506 raft_consensus.cc:2749] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:48.523936 19657 leader_election.cc:290] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:48.547030 19672 raft_consensus.cc:493] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
W20260709 13:06:48.567625 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:48.567823 19509 leader_election.cc:290] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:48.568953 19506 raft_consensus.cc:493] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.577102 19672 raft_consensus.cc:515] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:48.578063 16320 leader_election.cc:304] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:48.578954 19432 consensus_queue.cc:1048] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:48.579265 19668 raft_consensus.cc:2804] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:48.582854 19668 raft_consensus.cc:493] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:48.593144 19648 leader_election.cc:290] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:48.554973 19569 leader_election.cc:290] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:48.569774 19506 raft_consensus.cc:515] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:06:48.600867 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 105506us
I20260709 13:06:48.561131 19689 raft_consensus.cc:2749] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:48.583519 19668 raft_consensus.cc:3060] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:48.614204 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:48.630178 19506 leader_election.cc:290] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:06:48.632638 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 211249us
W20260709 13:06:48.639544 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:48.655535 19426 raft_consensus.cc:3060] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:48.644380 19679 raft_consensus.cc:2749] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:48.658005 19665 raft_consensus.cc:493] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:48.658741 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
W20260709 13:06:48.659224 19680 log.cc:927] Time spent T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.187s	user 0.004s	sys 0.000s
I20260709 13:06:48.658787 19665 raft_consensus.cc:515] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:48.666002 16949 raft_consensus.cc:1275] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:06:48.672238 16354 raft_consensus.cc:1275] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:06:48.674932 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:48.677692 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:48.672040 19687 raft_consensus.cc:493] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:48.678544 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
W20260709 13:06:48.686161 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 52725.5us
I20260709 13:06:48.691115 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:48.692606 19665 leader_election.cc:290] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:48.692658 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:48.693120 16281 raft_consensus.cc:1275] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:06:48.693320 19509 raft_consensus.cc:493] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:48.680269 19659 raft_consensus.cc:493] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.694839 19659 raft_consensus.cc:515] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:48.686139 19389 raft_consensus.cc:493] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:48.693948 19509 raft_consensus.cc:515] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:48.689276 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:48.683192 19569 raft_consensus.cc:493] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.701011 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:48.702883 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:48.703836 16276 raft_consensus.cc:2410] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:06:48.706468 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:48.712006 19676 raft_consensus.cc:493] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:48.712724 19676 raft_consensus.cc:515] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:48.699910 19389 raft_consensus.cc:515] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:48.715147 19669 consensus_queue.cc:1048] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 13:06:48.716742 19389 leader_election.cc:290] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:48.719231 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:48.717895 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:48.720049 16276 raft_consensus.cc:2393] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 9: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:06:48.720952 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:48.721239 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:48.722311 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:48.721879 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:48.723493 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:48.724709 19509 leader_election.cc:290] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:48.729753 19668 raft_consensus.cc:515] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:48.732465 19668 leader_election.cc:290] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:06:48.734031 19675 log.cc:927] Time spent T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.363s	user 0.001s	sys 0.001s
I20260709 13:06:48.685559 19687 raft_consensus.cc:515] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:48.737834 16351 raft_consensus.cc:2468] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 10.
I20260709 13:06:48.739248 16348 raft_consensus.cc:2468] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 9.
I20260709 13:06:48.745463 19672 leader_election.cc:290] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:48.745924 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:48.748692 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:48.750030 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:48.750756 16204 raft_consensus.cc:2468] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 9.
I20260709 13:06:48.751601 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:48.752712 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:48.753826 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:48.717315 19569 raft_consensus.cc:515] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:48.754761 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:48.755985 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:48.756735 19569 leader_election.cc:290] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:48.758309 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:48.759503 19606 consensus_queue.cc:1048] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:06:48.761912 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:48.763692 19659 leader_election.cc:290] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:48.763852 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:48.754876 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:48.764770 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:48.765537 16355 raft_consensus.cc:1275] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:06:48.766379 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:48.767045 16353 raft_consensus.cc:2468] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 11.
I20260709 13:06:48.772218 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:48.737864 19687 leader_election.cc:290] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:48.781908 19676 leader_election.cc:290] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:48.793967 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:48.795352 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:48.795998 19683 raft_consensus.cc:3055] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:48.796430 19683 raft_consensus.cc:740] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:48.796535 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:48.797349 19679 raft_consensus.cc:493] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:48.797793 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:48.797464 19683 consensus_queue.cc:260] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:48.798087 19679 raft_consensus.cc:515] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:48.800138 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:48.801741 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:48.801836 19679 leader_election.cc:290] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:48.802181 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:48.804544 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:48.802642 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bc3c8ff9b84838a2664335d7e1582b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:48.797461 16357 raft_consensus.cc:2410] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:06:48.811843 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:48.813333 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:48.800942 19683 raft_consensus.cc:3060] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:48.815922 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bc3c8ff9b84838a2664335d7e1582b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:48.826004 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:48.826870 16281 raft_consensus.cc:2393] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 9: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
I20260709 13:06:48.827927 19673 raft_consensus.cc:493] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:48.828928 16348 raft_consensus.cc:1275] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:06:48.828685 19673 raft_consensus.cc:515] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:48.831053 19673 leader_election.cc:290] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:48.832201 16281 raft_consensus.cc:1275] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:06:48.816413 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:48.818037 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c15d8e9be8414c84912ab77b66bfb1" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:48.822165 16947 raft_consensus.cc:1275] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:06:48.834146 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:48.815886 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:48.837004 19679 consensus_queue.cc:1048] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:48.837009 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c15d8e9be8414c84912ab77b66bfb1" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:48.838773 19673 consensus_queue.cc:1048] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:48.840407 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:48.841077 16275 raft_consensus.cc:2468] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 9.
I20260709 13:06:48.842404 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:48.843616 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:48.845624 16281 raft_consensus.cc:2393] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 11: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:06:48.855254 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:48.857980 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:48.858719 16280 raft_consensus.cc:2468] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 5.
I20260709 13:06:48.860030 16173 leader_election.cc:304] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:48.860962 19679 raft_consensus.cc:2804] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:48.861467 19679 raft_consensus.cc:697] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:48.864172 16173 leader_election.cc:304] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:48.865393 16207 raft_consensus.cc:2468] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 9.
I20260709 13:06:48.869484 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:48.873947 16281 raft_consensus.cc:2393] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 9: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:06:48.875083 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:48.875948 16280 raft_consensus.cc:3060] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:48.870172 16248 leader_election.cc:304] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:06:48.882603 19673 consensus_queue.cc:1048] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 13:06:48.884122 19507 raft_consensus.cc:2804] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:48.877523 19689 raft_consensus.cc:2804] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:48.884593 19507 raft_consensus.cc:493] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:48.900043 16320 leader_election.cc:304] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:48.910864 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:48.913314 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:48.914029 16275 raft_consensus.cc:2468] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 6.
I20260709 13:06:48.913821 16322 leader_election.cc:304] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:48.916006 16248 leader_election.cc:304] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:48.872649 19679 consensus_queue.cc:237] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:48.885075 19689 raft_consensus.cc:493] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:48.946305 19689 raft_consensus.cc:3060] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:48.950870 19687 raft_consensus.cc:2749] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:48.908793 19507 raft_consensus.cc:3060] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:48.959043 16322 leader_election.cc:304] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:06:48.965408 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:48.956277 19659 raft_consensus.cc:2749] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:48.918479 19655 raft_consensus.cc:2804] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:06:48.985323 16322 leader_election.cc:304] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:48.993268 16102 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38840 (request call id 196) took 5092 ms. Trace:
I20260709 13:06:48.957839 19687 consensus_queue.cc:1048] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:06:48.987660 19389 raft_consensus.cc:493] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:48.995559 19389 raft_consensus.cc:515] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:48.997932 19389 leader_election.cc:290] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:48.987461 19569 raft_consensus.cc:493] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:48.998991 19569 raft_consensus.cc:515] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:49.001366 19569 leader_election.cc:290] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:48.993721 16102 rpcz_store.cc:276] 0709 13:06:43.901237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:43.901415 (+   178us) service_pool.cc:224] Handling call
0709 13:06:48.993181 (+5091766us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:48.289174 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:48.289970 (+   796us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:48.290031 (+    61us) write_op.cc:435] Acquired schema lock
0709 13:06:48.290053 (+    22us) tablet.cc:662] Decoding operations
0709 13:06:48.292000 (+  1947us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:48.292137 (+   137us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:48.292172 (+    35us) tablet.cc:685] Acquiring locks for 19 operations
0709 13:06:48.293870 (+  1698us) tablet.cc:701] Row locks acquired
0709 13:06:48.293940 (+    70us) write_op.cc:260] PREPARE: finished
0709 13:06:48.294157 (+   217us) write_op.cc:270] Start()
0709 13:06:48.294328 (+   171us) write_op.cc:276] Timestamp: P: 1783602408294070 usec, L: 0
0709 13:06:48.294375 (+    47us) op_driver.cc:348] REPLICATION: starting
0709 13:06:48.360269 (+ 65894us) log.cc:844] Serialized 7503 byte log entry
0709 13:06:48.579407 (+219138us) op_driver.cc:464] REPLICATION: finished
0709 13:06:48.694980 (+115573us) write_op.cc:301] APPLY: starting
0709 13:06:48.695083 (+   103us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:48.695480 (+   397us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:48.695623 (+   143us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:48.785476 (+ 89853us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:48.785832 (+   356us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=19
0709 13:06:48.785902 (+    70us) write_op.cc:312] APPLY: finished
0709 13:06:48.786376 (+   474us) log.cc:844] Serialized 132 byte log entry
0709 13:06:48.786574 (+   198us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:48.786762 (+   188us) write_op.cc:454] Released schema lock
0709 13:06:48.786837 (+    75us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:48.872674 (+ 85837us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:48.872715 (+    41us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":126393,"reported_tablets":33,"child_traces":[["op",{"apply.queue_time_us":103634,"apply.run_cpu_time_us":8771,"apply.run_wall_time_us":177650,"num_ops":19,"prepare.queue_time_us":165197,"prepare.run_cpu_time_us":53425,"prepare.run_wall_time_us":145666,"raft.queue_time_us":87151,"raft.run_cpu_time_us":18492,"raft.run_wall_time_us":53912,"replication_time_us":284823,"thread_start_us":251829,"threads_started":4,"wal-append.queue_time_us":100766}]]}
I20260709 13:06:49.004108 19569 raft_consensus.cc:493] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:49.004944 19506 raft_consensus.cc:493] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:48.990604 19647 raft_consensus.cc:2749] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:48.984453 19295 raft_consensus.cc:493] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:49.004782 19569 raft_consensus.cc:515] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:49.033820 16322 leader_election.cc:304] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:49.005640 19506 raft_consensus.cc:515] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:49.021374 19655 raft_consensus.cc:697] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 9 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:06:49.036262 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:49.025362 19076 raft_consensus.cc:2749] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:49.025910 19676 raft_consensus.cc:493] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.045847 16322 leader_election.cc:304] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:49.049816 16322 leader_election.cc:304] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:49.052759 16280 raft_consensus.cc:2468] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 10.
I20260709 13:06:49.054731 16322 leader_election.cc:304] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:49.042284 19476 raft_consensus.cc:2749] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:49.039849 19604 raft_consensus.cc:493] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:49.050786 19665 raft_consensus.cc:2749] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:49.062652 16207 raft_consensus.cc:1275] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:06:49.038254 19295 raft_consensus.cc:515] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:49.056702 19474 raft_consensus.cc:2749] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:49.065057 16105 catalog_manager.cc:5697] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f reported cstate change: term changed from 8 to 9, leader changed from 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) to e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65). New cstate: current_term: 9 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:49.067505 19506 leader_election.cc:290] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:49.034526 16279 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f"
dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
mode: GRACEFUL
new_leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
 from {username='slave'} at 127.0.0.1:39058
I20260709 13:06:49.067742 19655 consensus_queue.cc:237] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:49.048702 19647 consensus_queue.cc:1048] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.015s
I20260709 13:06:49.048503 19676 raft_consensus.cc:515] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:49.083972 16105 catalog_manager.cc:5697] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f reported cstate change: term changed from 2 to 9. New cstate: current_term: 9 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:49.085601 19676 leader_election.cc:290] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:49.058025 19691 raft_consensus.cc:2804] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:49.086788 19691 raft_consensus.cc:493] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:49.080178 16279 raft_consensus.cc:606] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 LEADER]: Received request to transfer leadership to TS e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:49.087356 19691 raft_consensus.cc:3060] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:49.088203 19295 leader_election.cc:290] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:49.092849 19689 raft_consensus.cc:515] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:49.094282 19189 consensus_queue.cc:1048] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:49.097765 16279 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "26565509c81343bc818483042146461a"
dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
mode: GRACEFUL
new_leader_uuid: "363bb2f744eb486f9ad726f08214c98e"
 from {username='slave'} at 127.0.0.1:39058
I20260709 13:06:49.097985 19569 leader_election.cc:290] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:49.098492 16279 raft_consensus.cc:606] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 LEADER]: Received request to transfer leadership to TS 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:49.100136 16275 raft_consensus.cc:1275] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:06:49.102846 16276 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953"
dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
mode: GRACEFUL
new_leader_uuid: "363bb2f744eb486f9ad726f08214c98e"
 from {username='slave'} at 127.0.0.1:39058
I20260709 13:06:49.103520 16276 raft_consensus.cc:606] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 LEADER]: Received request to transfer leadership to TS 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:49.106178 16207 raft_consensus.cc:1275] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:06:49.106350 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:49.106449 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:49.107323 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:49.111382 16279 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aee913c41fb9437587affa768953f637"
dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
mode: GRACEFUL
new_leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
 from {username='slave'} at 127.0.0.1:39058
I20260709 13:06:49.111774 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:49.112212 16279 raft_consensus.cc:606] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Received request to transfer leadership to TS e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:49.112687 16279 raft_consensus.cc:614] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:49.112705 16201 raft_consensus.cc:2393] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 10: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:06:49.115582 16322 leader_election.cc:304] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:06:49.115620 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:49.130692 19691 raft_consensus.cc:515] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:49.134284 16173 leader_election.cc:304] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:06:49.137583 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:49.132109 19569 raft_consensus.cc:493] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:49.146638 16173 leader_election.cc:304] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:49.151649 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:49.151170 19506 raft_consensus.cc:2749] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:49.164276 16352 raft_consensus.cc:1275] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 8. (term mismatch)
I20260709 13:06:49.132385 19295 raft_consensus.cc:2749] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:49.165498 16352 pending_rounds.cc:85] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e: Aborting all ops after (but not including) 7
I20260709 13:06:49.165916 16352 pending_rounds.cc:107] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 13:06:49.166236 16352 raft_consensus.cc:2889] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:49.168805 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:49.164206 19691 leader_election.cc:290] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:49.175228 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:06:49.177045 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:49.079228 19604 raft_consensus.cc:515] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:49.155007 19679 raft_consensus.cc:2749] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:06:49.180331 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:49.191474 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:49.188395 16105 catalog_manager.cc:5697] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f reported cstate change: term changed from 6 to 8, leader changed from 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) to e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65). New cstate: current_term: 8 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:49.210834 16280 raft_consensus.cc:1275] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:06:49.143822 19569 raft_consensus.cc:515] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:49.232082 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:49.241472 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:06:49.250514 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 103962us
I20260709 13:06:49.251587 16173 leader_election.cc:304] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:49.255241 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:49.267078 19708 raft_consensus.cc:2749] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:06:49.275086 16173 leader_election.cc:304] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:49.240501 19606 raft_consensus.cc:493] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:49.274580 19702 log.cc:927] Time spent T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.222s	user 0.001s	sys 0.000s
I20260709 13:06:49.285056 19708 raft_consensus.cc:2804] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:49.285606 19708 raft_consensus.cc:493] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:49.286594 16173 leader_election.cc:304] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:49.255730 19432 raft_consensus.cc:493] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:49.243288 19669 consensus_queue.cc:1048] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:06:49.304735 16322 leader_election.cc:304] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:49.289903 19708 raft_consensus.cc:3060] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:49.254231 19507 raft_consensus.cc:515] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } }
I20260709 13:06:49.329483 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:06:49.306329 19703 log.cc:927] Time spent T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.161s	user 0.000s	sys 0.001s
I20260709 13:06:49.324388 16173 leader_election.cc:304] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:49.324512 19668 raft_consensus.cc:2749] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:49.307963 19656 raft_consensus.cc:2749] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:49.380792 16277 raft_consensus.cc:1240] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:49.382138 16355 raft_consensus.cc:1240] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:49.388832 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:49.296262 19606 raft_consensus.cc:515] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:49.321139 19688 consensus_queue.cc:1048] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
W20260709 13:06:49.394924 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 46735us
I20260709 13:06:49.321324 19432 raft_consensus.cc:515] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:06:49.394068 19701 log.cc:927] Time spent T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.238s	user 0.001s	sys 0.000s
I20260709 13:06:49.399240 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:49.405830 16246 leader_election.cc:304] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:49.407763 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:06:49.397373 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 73089.1us
I20260709 13:06:49.419405 19507 leader_election.cc:290] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:49.400301 19693 raft_consensus.cc:2749] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:06:49.437968 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 144693us
W20260709 13:06:49.426337 19705 log.cc:927] Time spent T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.230s	user 0.001s	sys 0.000s
I20260709 13:06:49.445959 16352 raft_consensus.cc:1275] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:06:49.430274 19604 leader_election.cc:290] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:49.451035 19569 leader_election.cc:290] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:49.472887 19432 leader_election.cc:290] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:49.478183 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:49.483033 19606 leader_election.cc:290] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:49.488448 16320 leader_election.cc:304] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:49.492569 19689 leader_election.cc:290] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:06:49.498018 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 261251us
W20260709 13:06:49.520917 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 115224us
I20260709 13:06:49.522033 16246 leader_election.cc:304] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:49.522704 19659 raft_consensus.cc:2749] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:49.509495 19691 raft_consensus.cc:2749] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:49.530472 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:49.536504 19569 raft_consensus.cc:2749] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:49.544387 19708 raft_consensus.cc:515] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:49.547257 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:49.540186 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:49.549456 16203 raft_consensus.cc:2410] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
W20260709 13:06:49.563436 19704 log.cc:927] Time spent T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.441s	user 0.001s	sys 0.005s
I20260709 13:06:49.571167 16246 leader_election.cc:304] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:49.573237 16246 leader_election.cc:304] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:49.576886 16246 leader_election.cc:304] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:06:49.579125 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 69271.7us
I20260709 13:06:49.578320 19676 raft_consensus.cc:2749] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:49.580729 19507 raft_consensus.cc:2749] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:49.578024 16322 leader_election.cc:304] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:06:49.585526 19687 raft_consensus.cc:2749] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:49.587145 16277 raft_consensus.cc:1275] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:06:49.588171 19621 consensus_queue.cc:1048] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:06:49.597386 16246 leader_election.cc:304] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:49.605471 16246 leader_election.cc:304] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:06:49.611680 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 112916us
I20260709 13:06:49.612881 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:06:49.629725 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 162373us
I20260709 13:06:49.631395 19676 raft_consensus.cc:993] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3: : Instructing follower e10b16d536674c0bb350a31d7ce5ff7f to start an election
I20260709 13:06:49.601684 19507 raft_consensus.cc:2749] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:49.594786 19655 consensus_queue.cc:1048] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:06:49.663237 19708 leader_election.cc:290] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:06:49.670215 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 47403.5us
I20260709 13:06:49.673262 16248 leader_election.cc:304] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
W20260709 13:06:49.670387 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 65111.2us
I20260709 13:06:49.675972 16246 leader_election.cc:304] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:49.679078 19724 raft_consensus.cc:2749] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:49.676661 19646 raft_consensus.cc:1081] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 LEADER]: Signalling peer e10b16d536674c0bb350a31d7ce5ff7f to start an election
I20260709 13:06:49.672869 19507 consensus_queue.cc:1048] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.010s
I20260709 13:06:49.673125 19609 raft_consensus.cc:2749] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:49.687290 16246 leader_election.cc:304] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:49.697849 16205 raft_consensus.cc:1240] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:49.697954 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
W20260709 13:06:49.730852 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 44004.7us
I20260709 13:06:49.732692 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:49.733206 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:49.690683 19609 raft_consensus.cc:2749] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:49.750633 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:49.762868 16279 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef"
dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
mode: GRACEFUL
new_leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
 from {username='slave'} at 127.0.0.1:39058
I20260709 13:06:49.763657 16279 raft_consensus.cc:606] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Received request to transfer leadership to TS e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:49.764050 16279 raft_consensus.cc:614] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:49.729872 19676 raft_consensus.cc:2749] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:49.770397 19389 raft_consensus.cc:2804] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:49.748335 19689 consensus_queue.cc:1059] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 13:06:49.748660 19693 consensus_queue.cc:1048] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 13:06:49.786257 19722 raft_consensus.cc:493] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:49.820421 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 88574.1us
W20260709 13:06:49.835285 19726 log.cc:927] Time spent T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:06:49.835825 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:49.851266 16246 leader_election.cc:304] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:49.873520 19389 raft_consensus.cc:493] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:49.874522 19389 raft_consensus.cc:3060] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:49.880117 16246 leader_election.cc:304] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:49.888192 16246 leader_election.cc:304] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:06:49.888402 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 128675us
I20260709 13:06:49.891906 16246 leader_election.cc:304] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:49.893301 19725 raft_consensus.cc:2749] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:49.893702 19509 consensus_queue.cc:1048] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:06:49.896859 19509 raft_consensus.cc:2749] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:49.898826 16246 leader_election.cc:304] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:49.904006 16205 raft_consensus.cc:1240] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:49.901093 16246 leader_election.cc:304] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:49.907123 16320 leader_election.cc:304] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:49.910758 19620 raft_consensus.cc:2749] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:49.890503 19673 raft_consensus.cc:2749] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:49.841871 19722 raft_consensus.cc:515] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:49.916107 19722 leader_election.cc:290] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:49.887956 19676 raft_consensus.cc:2749] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:49.916990 19476 consensus_queue.cc:1059] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:49.917837 19509 raft_consensus.cc:2749] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:49.918514 19687 raft_consensus.cc:3055] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:49.918987 19687 raft_consensus.cc:740] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:06:49.919893 19687 consensus_queue.cc:260] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:49.921994 19673 raft_consensus.cc:3060] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:49.933841 15057 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:06:49.941579 16248 leader_election.cc:304] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:49.936306 15057 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:49.944152 19673 raft_consensus.cc:2749] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:49.945600 19659 raft_consensus.cc:2749] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:49.946915 16246 leader_election.cc:304] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:49.951293 16246 leader_election.cc:304] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:49.953900 16246 leader_election.cc:304] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:06:49.960232 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 72026.1us
I20260709 13:06:49.963456 16246 leader_election.cc:304] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:49.964082 19676 raft_consensus.cc:2749] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:49.964674 19735 raft_consensus.cc:2749] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:49.959808 19509 raft_consensus.cc:2749] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:49.970311 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:49.976673 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:49.978929 19723 raft_consensus.cc:3055] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:49.979461 19723 raft_consensus.cc:740] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:49.980400 19723 consensus_queue.cc:260] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:49.981627 19723 raft_consensus.cc:3060] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:49.970729 19530 raft_consensus.cc:2749] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:49.987758 19389 raft_consensus.cc:515] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:49.995769 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:50.000968 19658 consensus_queue.cc:1059] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 13:06:50.002632 19658 raft_consensus.cc:3055] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:06:50.003067 19658 raft_consensus.cc:740] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:06:50.003916 19658 consensus_queue.cc:260] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:50.005204 19658 raft_consensus.cc:3060] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:50.008476 19679 consensus_queue.cc:1059] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:50.009851 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:50.010300 16282 raft_consensus.cc:1275] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:06:50.013065 16205 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f"
dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
 from {username='slave'} at 127.0.0.1:60138
I20260709 13:06:50.015085 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:50.018239 16173 leader_election.cc:304] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:50.019687 19708 raft_consensus.cc:2749] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:50.020567 16205 raft_consensus.cc:493] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:50.025816 16173 leader_election.cc:304] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:50.030098 19679 raft_consensus.cc:2749] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:06:50.032167 16279 raft_consensus.cc:1240] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:50.033459 19389 leader_election.cc:290] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:50.035209 16276 raft_consensus.cc:1240] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:50.044538 16173 leader_election.cc:304] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:50.027886 16205 raft_consensus.cc:3060] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:50.050690 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:50.058177 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:50.052522 19722 raft_consensus.cc:2749] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:06:50.070495 16914 leader_election.cc:304] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:50.075481 16246 leader_election.cc:304] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:50.080422 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:50.063843 19626 consensus_queue.cc:1048] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:50.077922 19720 raft_consensus.cc:2749] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:50.091300 19735 raft_consensus.cc:2749] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:06:50.115741 16173 leader_election.cc:304] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
W20260709 13:06:50.141121 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 47918.3us
W20260709 13:06:50.149869 16321 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:50.151393 16283 consensus_queue.cc:237] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:50.136881 19683 raft_consensus.cc:2749] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:50.137811 19719 raft_consensus.cc:3055] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:06:50.173859 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:50.173489 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 83998.3us
I20260709 13:06:50.181854 19569 raft_consensus.cc:993] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3: : Instructing follower 363bb2f744eb486f9ad726f08214c98e to start an election
I20260709 13:06:50.182600 19569 raft_consensus.cc:1081] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 LEADER]: Signalling peer 363bb2f744eb486f9ad726f08214c98e to start an election
I20260709 13:06:50.184971 19687 raft_consensus.cc:3060] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:50.169968 19719 raft_consensus.cc:740] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:50.190454 19676 raft_consensus.cc:993] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3: : Instructing follower 363bb2f744eb486f9ad726f08214c98e to start an election
I20260709 13:06:50.220909 19676 raft_consensus.cc:1081] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 LEADER]: Signalling peer 363bb2f744eb486f9ad726f08214c98e to start an election
I20260709 13:06:50.192415 19719 consensus_queue.cc:260] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } }
I20260709 13:06:50.223573 19719 raft_consensus.cc:3060] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:06:50.231007 19743 log.cc:927] Time spent T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 13:06:50.237785 16205 raft_consensus.cc:515] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:06:50.273958 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 133906us
W20260709 13:06:50.251986 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 76280.7us
I20260709 13:06:50.362509 16205 leader_election.cc:290] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:50.363902 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:50.369415 16351 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "26565509c81343bc818483042146461a"
dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
 from {username='slave'} at 127.0.0.1:41830
I20260709 13:06:50.370024 16351 raft_consensus.cc:493] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:50.370391 16351 raft_consensus.cc:3060] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:50.352540 16208 raft_consensus.cc:1240] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:50.363250 19750 consensus_queue.cc:1059] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:50.375392 19668 raft_consensus.cc:3055] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:06:50.375562 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 240372us
I20260709 13:06:50.375882 19668 raft_consensus.cc:740] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:06:50.376803 19668 consensus_queue.cc:260] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:50.377982 19668 raft_consensus.cc:3060] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:50.384400 16351 raft_consensus.cc:515] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:06:50.387715 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 104699us
I20260709 13:06:50.389827 16282 raft_consensus.cc:1240] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:06:50.394793 19724 consensus_queue.cc:1059] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:50.397368 19530 raft_consensus.cc:3055] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:06:50.397866 19530 raft_consensus.cc:740] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:50.400872 19530 consensus_queue.cc:260] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:50.402396 19530 raft_consensus.cc:3060] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:50.406536 19723 raft_consensus.cc:493] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.407236 19723 raft_consensus.cc:515] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:50.409657 19723 leader_election.cc:290] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:50.412144 19708 raft_consensus.cc:493] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:50.412848 19708 raft_consensus.cc:515] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:50.415264 19708 leader_election.cc:290] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:50.415223 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: true dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:50.422834 16349 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953"
dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
 from {username='slave'} at 127.0.0.1:41830
I20260709 13:06:50.423497 16349 raft_consensus.cc:493] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:50.423646 16105 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38830 (request call id 222) took 9603 ms. Trace:
I20260709 13:06:50.423882 16349 raft_consensus.cc:3060] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:50.426793 16356 raft_consensus.cc:1240] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:50.427528 16354 raft_consensus.cc:1275] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:06:50.435509 16351 leader_election.cc:290] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:50.439815 16106 catalog_manager.cc:5697] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e reported cstate change: term changed from 7 to 10, leader changed from e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) to 363bb2f744eb486f9ad726f08214c98e (127.14.180.67). New cstate: current_term: 10 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } }
W20260709 13:06:50.444036 16246 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:50.446442 16248 leader_election.cc:304] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:50.438329 16349 raft_consensus.cc:515] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:06:50.448838 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 85771.3us
I20260709 13:06:50.449100 16348 raft_consensus.cc:1240] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:50.452310 16349 leader_election.cc:290] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:50.443255 16106 catalog_manager.cc:5697] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e reported cstate change: term changed from 7 to 8, leader changed from 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) to e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65). New cstate: current_term: 8 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } }
I20260709 13:06:50.454293 19747 raft_consensus.cc:493] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:50.468578 16106 catalog_manager.cc:5697] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "1109f76a0b7b443a84c0327c8707bc63" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:06:50.465675 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:50.473093 16208 raft_consensus.cc:3060] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:50.473910 16106 catalog_manager.cc:5697] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e reported cstate change: term changed from 10 to 11, leader changed from e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) to 363bb2f744eb486f9ad726f08214c98e (127.14.180.67). New cstate: current_term: 11 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:50.476476 16106 catalog_manager.cc:5697] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } }
I20260709 13:06:50.453501 16105 rpcz_store.cc:276] 0709 13:06:40.820391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:40.820596 (+   205us) service_pool.cc:224] Handling call
0709 13:06:50.423398 (+9602802us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:49.487465 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:49.574758 (+ 87293us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:49.574813 (+    55us) write_op.cc:435] Acquired schema lock
0709 13:06:49.574841 (+    28us) tablet.cc:662] Decoding operations
0709 13:06:49.637532 (+ 62691us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:49.637594 (+    62us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:49.637624 (+    30us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:06:49.637950 (+   326us) tablet.cc:701] Row locks acquired
0709 13:06:49.637968 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:06:49.638134 (+   166us) write_op.cc:270] Start()
0709 13:06:49.638254 (+   120us) write_op.cc:276] Timestamp: P: 1783602409638082 usec, L: 0
0709 13:06:49.638277 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:06:49.639849 (+  1572us) log.cc:844] Serialized 1317 byte log entry
0709 13:06:49.821201 (+181352us) op_driver.cc:464] REPLICATION: finished
0709 13:06:49.955187 (+133986us) write_op.cc:301] APPLY: starting
0709 13:06:49.955285 (+    98us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:49.955487 (+   202us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:49.955609 (+   122us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:49.956066 (+   457us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:49.956273 (+   207us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 13:06:49.956328 (+    55us) write_op.cc:312] APPLY: finished
0709 13:06:49.956570 (+   242us) log.cc:844] Serialized 35 byte log entry
0709 13:06:49.956769 (+   199us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:49.956876 (+   107us) write_op.cc:454] Released schema lock
0709 13:06:49.956919 (+    43us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:49.957322 (+   403us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:49.957354 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":362931,"reported_tablets":48,"child_traces":[["op",{"apply.queue_time_us":131183,"apply.run_cpu_time_us":2092,"apply.run_wall_time_us":2098,"num_ops":3,"prepare.queue_time_us":220979,"prepare.run_cpu_time_us":3947,"prepare.run_wall_time_us":152751,"replication_time_us":153574,"spinlock_wait_cycles":59136,"thread_start_us":235525,"threads_started":2}]]}
I20260709 13:06:50.468808 19747 raft_consensus.cc:515] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:50.464116 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: true dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:50.479765 16279 raft_consensus.cc:3055] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:50.480093 16279 raft_consensus.cc:740] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:50.480906 16279 consensus_queue.cc:260] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:50.481879 16279 raft_consensus.cc:3060] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:50.485644 19747 leader_election.cc:290] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:50.486650 16946 raft_consensus.cc:1275] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:06:50.491884 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:50.493786 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: true dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:50.494525 16348 raft_consensus.cc:3060] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:50.499213 16279 raft_consensus.cc:2468] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 11.
I20260709 13:06:50.504643 16348 raft_consensus.cc:2468] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 10.
I20260709 13:06:50.507264 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:50.507421 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:50.508075 16942 raft_consensus.cc:2468] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 6.
I20260709 13:06:50.508184 16279 raft_consensus.cc:3055] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:50.508663 16279 raft_consensus.cc:740] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:50.509728 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:50.509919 16279 consensus_queue.cc:260] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:50.511207 16279 raft_consensus.cc:3060] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:50.511678 16173 leader_election.cc:304] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:50.512962 19719 raft_consensus.cc:2804] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:50.513464 19719 raft_consensus.cc:493] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:50.513898 19719 raft_consensus.cc:3060] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:50.478000 16106 catalog_manager.cc:5697] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e reported cstate change: term changed from 9 to 11, leader changed from e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) to 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66). New cstate: current_term: 11 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } }
I20260709 13:06:50.516034 16106 catalog_manager.cc:5697] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e reported cstate change: term changed from 6 to 7, leader changed from 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) to e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65). New cstate: current_term: 7 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } }
I20260709 13:06:50.518035 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: true dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:06:50.518816 16942 raft_consensus.cc:3060] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:50.522847 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:50.517714 16106 catalog_manager.cc:5697] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } }
I20260709 13:06:50.523605 16278 raft_consensus.cc:2468] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 5.
I20260709 13:06:50.527244 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:06:50.528025 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 81685.3us
I20260709 13:06:50.528179 16208 raft_consensus.cc:2468] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 6.
I20260709 13:06:50.542217 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:50.557957 16914 leader_election.cc:304] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:50.538738 19673 raft_consensus.cc:2749] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:06:50.561061 19389 consensus_queue.cc:1048] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 13:06:50.566952 16320 leader_election.cc:304] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:50.571398 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:50.562932 19718 raft_consensus.cc:2749] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:50.583989 16942 raft_consensus.cc:2468] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 11.
W20260709 13:06:50.591306 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 62379.3us
I20260709 13:06:50.592130 16279 raft_consensus.cc:2468] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 6.
I20260709 13:06:50.599186 16173 leader_election.cc:304] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:06:50.603544 16322 leader_election.cc:304] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:06:50.578835 19668 raft_consensus.cc:2804] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:50.605119 19748 raft_consensus.cc:2749] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:50.595703 19609 consensus_queue.cc:1048] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:06:50.623492 19668 raft_consensus.cc:697] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 6 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:06:50.628647 19668 consensus_queue.cc:237] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:50.629581 16173 leader_election.cc:304] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:50.613502 19655 raft_consensus.cc:2804] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:06:50.639626 19655 raft_consensus.cc:697] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 11 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:06:50.639511 19719 raft_consensus.cc:515] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:50.641070 19655 consensus_queue.cc:237] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:50.642134 19719 leader_election.cc:290] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:50.638162 19748 raft_consensus.cc:2804] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:50.655020 19748 raft_consensus.cc:697] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 10 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:50.656095 19748 consensus_queue.cc:237] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:50.670128 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:06:50.671109 16942 raft_consensus.cc:3060] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:50.685503 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:50.686581 16279 raft_consensus.cc:3060] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:06:50.693068 16280 raft_consensus.cc:2468] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 10.
I20260709 13:06:50.716897 16942 raft_consensus.cc:2468] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 7.
I20260709 13:06:50.729316 16279 raft_consensus.cc:2468] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 7.
I20260709 13:06:50.740996 16173 leader_election.cc:304] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:50.744884 19723 raft_consensus.cc:2804] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:50.745464 19723 raft_consensus.cc:697] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:50.746409 19723 consensus_queue.cc:237] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:50.762741 19609 raft_consensus.cc:2955] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 LEADER]: Committing config change with OpId 7.7: config changed from index 5 to 7, VOTER e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:06:50.774045 16946 raft_consensus.cc:2955] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 5 to 7, VOTER e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:06:50.856087 16348 raft_consensus.cc:2955] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 5 to 7, VOTER e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:06:50.943775 15057 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:50.973251 16092 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b9e1324823f04d8da5a4b3ddbd061c0e with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:50.987265 16103 catalog_manager.cc:5697] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: term changed from 6 to 8, leader changed from e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) to 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68). New cstate: current_term: 8 leader_uuid: "1109f76a0b7b443a84c0327c8707bc63" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:50.989166 16103 catalog_manager.cc:5697] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: term changed from 4 to 7, leader changed from 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) to 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66). New cstate: current_term: 7 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:06:50.991712 16106 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38842 (request call id 214) took 3927 ms. Trace:
I20260709 13:06:50.992141 16106 rpcz_store.cc:276] 0709 13:06:47.064106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:47.064479 (+   373us) service_pool.cc:224] Handling call
0709 13:06:50.991602 (+3927123us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:50.732203 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:50.732838 (+   635us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:50.732876 (+    38us) write_op.cc:435] Acquired schema lock
0709 13:06:50.732896 (+    20us) tablet.cc:662] Decoding operations
0709 13:06:50.733865 (+   969us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:50.733948 (+    83us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:50.733987 (+    39us) tablet.cc:685] Acquiring locks for 8 operations
0709 13:06:50.776453 (+ 42466us) tablet.cc:701] Row locks acquired
0709 13:06:50.776493 (+    40us) write_op.cc:260] PREPARE: finished
0709 13:06:50.776705 (+   212us) write_op.cc:270] Start()
0709 13:06:50.776876 (+   171us) write_op.cc:276] Timestamp: P: 1783602410776647 usec, L: 0
0709 13:06:50.776914 (+    38us) op_driver.cc:348] REPLICATION: starting
0709 13:06:50.777849 (+   935us) log.cc:844] Serialized 3253 byte log entry
0709 13:06:50.874590 (+ 96741us) op_driver.cc:464] REPLICATION: finished
0709 13:06:50.911364 (+ 36774us) write_op.cc:301] APPLY: starting
0709 13:06:50.911464 (+   100us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:50.911766 (+   302us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:50.911898 (+   132us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:50.913247 (+  1349us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:50.913566 (+   319us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0709 13:06:50.913632 (+    66us) write_op.cc:312] APPLY: finished
0709 13:06:50.914240 (+   608us) log.cc:844] Serialized 65 byte log entry
0709 13:06:50.922773 (+  8533us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:50.922904 (+   131us) write_op.cc:454] Released schema lock
0709 13:06:50.922960 (+    56us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:50.925558 (+  2598us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:50.925593 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":34812,"reported_tablets":36,"child_traces":[["op",{"apply.queue_time_us":36475,"apply.run_cpu_time_us":3740,"apply.run_wall_time_us":14141,"num_ops":8,"prepare.queue_time_us":115431,"prepare.run_cpu_time_us":4686,"prepare.run_wall_time_us":59914,"replication_time_us":97461,"thread_start_us":140875,"threads_started":2}]]}
I20260709 13:06:50.996868 16103 catalog_manager.cc:5697] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: term changed from 4 to 6, leader changed from e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) to 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68). New cstate: current_term: 6 leader_uuid: "1109f76a0b7b443a84c0327c8707bc63" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:51.000041 16103 catalog_manager.cc:5697] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: term changed from 2 to 3, leader changed from 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) to e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65). New cstate: current_term: 3 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:06:51.005934 16103 catalog_manager.cc:5697] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: term changed from 5 to 9, leader changed from e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) to 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68). New cstate: current_term: 9 leader_uuid: "1109f76a0b7b443a84c0327c8707bc63" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:51.008011 16103 catalog_manager.cc:5697] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "1109f76a0b7b443a84c0327c8707bc63" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:51.065416 16103 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55244 (request call id 125) took 3142 ms. Trace:
I20260709 13:06:51.073470 16102 catalog_manager.cc:5697] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 4 to 5, leader changed from 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) to e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65). New cstate: current_term: 5 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:06:51.065845 16103 rpcz_store.cc:276] 0709 13:06:47.923579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:47.928536 (+  4957us) service_pool.cc:224] Handling call
0709 13:06:51.065342 (+3136806us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:51.012295 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:51.012884 (+   589us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:51.012921 (+    37us) write_op.cc:435] Acquired schema lock
0709 13:06:51.012941 (+    20us) tablet.cc:662] Decoding operations
0709 13:06:51.013775 (+   834us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:51.013837 (+    62us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:51.013873 (+    36us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:06:51.014458 (+   585us) tablet.cc:701] Row locks acquired
0709 13:06:51.014480 (+    22us) write_op.cc:260] PREPARE: finished
0709 13:06:51.014680 (+   200us) write_op.cc:270] Start()
0709 13:06:51.014801 (+   121us) write_op.cc:276] Timestamp: P: 1783602411014623 usec, L: 0
0709 13:06:51.014824 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:06:51.016616 (+  1792us) log.cc:844] Serialized 2452 byte log entry
0709 13:06:51.019824 (+  3208us) op_driver.cc:464] REPLICATION: finished
0709 13:06:51.020309 (+   485us) write_op.cc:301] APPLY: starting
0709 13:06:51.020389 (+    80us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:51.020602 (+   213us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:51.020710 (+   108us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:51.037175 (+ 16465us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:51.037387 (+   212us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 13:06:51.037439 (+    52us) write_op.cc:312] APPLY: finished
0709 13:06:51.037721 (+   282us) log.cc:844] Serialized 53 byte log entry
0709 13:06:51.037894 (+   173us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:51.038011 (+   117us) write_op.cc:454] Released schema lock
0709 13:06:51.038059 (+    48us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:51.038453 (+   394us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:51.038487 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":39880,"reported_tablets":13,"spinlock_wait_cycles":2816,"child_traces":[["op",{"apply.queue_time_us":266,"apply.run_cpu_time_us":2755,"apply.run_wall_time_us":18090,"num_ops":6,"prepare.queue_time_us":123,"prepare.run_cpu_time_us":3551,"prepare.run_wall_time_us":4632,"replication_time_us":4825}]]}
I20260709 13:06:51.075402 16102 catalog_manager.cc:5697] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 9 to 11, leader changed from e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) to 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66). New cstate: current_term: 11 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:51.089831 16102 catalog_manager.cc:5697] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:51.108126 16102 catalog_manager.cc:5697] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:51.109843 16102 catalog_manager.cc:5697] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 5 to 6, leader changed from 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) to 363bb2f744eb486f9ad726f08214c98e (127.14.180.67). New cstate: current_term: 6 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } }
I20260709 13:06:51.111945 16102 catalog_manager.cc:5697] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } }
I20260709 13:06:51.157140 16278 raft_consensus.cc:1275] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:06:51.165951 19687 consensus_queue.cc:1048] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 13:06:51.169493 16274 raft_consensus.cc:1275] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:06:51.159473 19668 raft_consensus.cc:493] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.172840 16274 raft_consensus.cc:1275] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:06:51.176436 19668 raft_consensus.cc:515] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:51.177054 19756 consensus_queue.cc:1048] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 13:06:51.178846 19655 consensus_queue.cc:1048] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 13:06:51.227102 16946 raft_consensus.cc:1275] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:06:51.230815 16205 raft_consensus.cc:1275] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:06:51.241432 19721 consensus_queue.cc:1048] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 13:06:51.262501 19668 leader_election.cc:290] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:51.264719 16348 raft_consensus.cc:1275] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:06:51.272187 15057 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:51.282394 16279 raft_consensus.cc:1275] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:06:51.287171 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:51.287873 16279 raft_consensus.cc:2468] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 10.
W20260709 13:06:51.294795 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 51753.4us
I20260709 13:06:51.291222 16322 leader_election.cc:304] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:06:51.303404 16102 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38840 (request call id 197) took 1054 ms. Trace:
I20260709 13:06:51.307202 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:51.307957 16205 raft_consensus.cc:2468] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 10.
W20260709 13:06:51.303340 19678 log.cc:927] Time spent T 00000000000000000000000000000000 P 4dc6f08597514f4d85fd451b999b403e: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:06:51.304502 16102 rpcz_store.cc:276] 0709 13:06:50.237049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:50.237279 (+   230us) service_pool.cc:224] Handling call
0709 13:06:51.291563 (+1054284us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:51.136879 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:51.177243 (+ 40364us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:51.178500 (+  1257us) write_op.cc:435] Acquired schema lock
0709 13:06:51.178521 (+    21us) tablet.cc:662] Decoding operations
0709 13:06:51.216652 (+ 38131us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:51.219293 (+  2641us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:51.219323 (+    30us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:06:51.219863 (+   540us) tablet.cc:701] Row locks acquired
0709 13:06:51.219877 (+    14us) write_op.cc:260] PREPARE: finished
0709 13:06:51.220023 (+   146us) write_op.cc:270] Start()
0709 13:06:51.220171 (+   148us) write_op.cc:276] Timestamp: P: 1783602411219980 usec, L: 0
0709 13:06:51.220195 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:06:51.220904 (+   709us) log.cc:844] Serialized 2467 byte log entry
0709 13:06:51.223128 (+  2224us) op_driver.cc:464] REPLICATION: finished
0709 13:06:51.223639 (+   511us) write_op.cc:301] APPLY: starting
0709 13:06:51.223725 (+    86us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:51.223909 (+   184us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:51.224015 (+   106us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:51.224703 (+   688us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:51.224914 (+   211us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 13:06:51.224964 (+    50us) write_op.cc:312] APPLY: finished
0709 13:06:51.225238 (+   274us) log.cc:844] Serialized 53 byte log entry
0709 13:06:51.225411 (+   173us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:51.225527 (+   116us) write_op.cc:454] Released schema lock
0709 13:06:51.225592 (+    65us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:51.225955 (+   363us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:51.225986 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":110430,"reported_tablets":25,"child_traces":[["op",{"apply.queue_time_us":259,"apply.run_cpu_time_us":2281,"apply.run_wall_time_us":2280,"num_ops":6,"prepare.queue_time_us":3724,"prepare.run_cpu_time_us":4954,"prepare.run_wall_time_us":86263,"replication_time_us":2774}]]}
I20260709 13:06:51.282645 19723 consensus_queue.cc:1048] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:06:51.312803 19647 raft_consensus.cc:2804] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:51.291105 19687 consensus_queue.cc:1048] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 13:06:51.291275 19719 consensus_queue.cc:1048] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:06:51.322532 19647 raft_consensus.cc:493] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:51.364938 16105 catalog_manager.cc:5697] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:51.369382 16105 catalog_manager.cc:5697] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f reported cstate change: term changed from 9 to 10, leader changed from 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) to e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65). New cstate: current_term: 10 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:51.372285 16105 catalog_manager.cc:5697] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } }
I20260709 13:06:51.376686 16105 catalog_manager.cc:5697] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:51.383499 19668 raft_consensus.cc:493] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:51.384193 19668 raft_consensus.cc:515] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } }
I20260709 13:06:51.389477 16276 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f"
dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
mode: GRACEFUL
new_leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
 from {username='slave'} at 127.0.0.1:39058
I20260709 13:06:51.390326 16276 raft_consensus.cc:606] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Received request to transfer leadership to TS e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:51.390733 16276 raft_consensus.cc:614] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:51.374714 19647 raft_consensus.cc:3060] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:51.416751 16279 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953"
dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
mode: GRACEFUL
new_leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
 from {username='slave'} at 127.0.0.1:39058
I20260709 13:06:51.418429 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:51.419704 16282 raft_consensus.cc:2393] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 12: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:06:51.409773 19668 leader_election.cc:290] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:51.466605 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:51.467398 16207 raft_consensus.cc:2468] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 12.
W20260709 13:06:51.504400 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 66731.4us
I20260709 13:06:51.512279 19773 raft_consensus.cc:493] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:51.513201 19773 raft_consensus.cc:515] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:51.517904 19773 leader_election.cc:290] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:51.521507 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:51.522285 16200 raft_consensus.cc:2468] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 6.
I20260709 13:06:51.526669 16246 leader_election.cc:304] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:51.541574 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:51.542825 16351 raft_consensus.cc:2393] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 6: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:06:51.547559 19389 raft_consensus.cc:2804] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:51.548203 19389 raft_consensus.cc:493] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:51.548731 19389 raft_consensus.cc:3060] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:51.581393 19782 raft_consensus.cc:493] T b9e1324823f04d8da5a4b3ddbd061c0e P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:51.586691 16279 raft_consensus.cc:606] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Received request to transfer leadership to TS e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:51.587203 16279 raft_consensus.cc:614] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:06:51.588879 19780 log.cc:927] Time spent T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 13:06:51.588253 19782 raft_consensus.cc:515] T b9e1324823f04d8da5a4b3ddbd061c0e P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:51.639374 19782 leader_election.cc:290] T b9e1324823f04d8da5a4b3ddbd061c0e P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:51.642932 16320 leader_election.cc:304] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:06:51.646847 19655 raft_consensus.cc:2804] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:51.647348 19655 raft_consensus.cc:493] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:51.647753 19655 raft_consensus.cc:3060] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:51.648789 19389 raft_consensus.cc:515] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:51.627293 19658 raft_consensus.cc:493] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.656340 19658 raft_consensus.cc:515] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:51.665057 16946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:51.665678 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:51.673024 16949 raft_consensus.cc:1275] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:06:51.688549 16173 leader_election.cc:304] T b9e1324823f04d8da5a4b3ddbd061c0e P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:51.715593 19773 raft_consensus.cc:493] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:51.716501 19773 raft_consensus.cc:515] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:51.717103 19721 raft_consensus.cc:493] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.717756 19721 raft_consensus.cc:515] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:51.725344 19773 leader_election.cc:290] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:51.699096 19788 raft_consensus.cc:493] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:51.733182 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 148403us
I20260709 13:06:51.752267 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:51.753132 16207 raft_consensus.cc:2393] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 7: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:06:51.742010 19655 raft_consensus.cc:515] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } }
I20260709 13:06:51.699046 19756 consensus_queue.cc:1048] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:06:51.733271 19784 raft_consensus.cc:2749] T b9e1324823f04d8da5a4b3ddbd061c0e P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:06:51.754470 19678 log.cc:927] Time spent T 00000000000000000000000000000000 P 4dc6f08597514f4d85fd451b999b403e: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:06:51.768977 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:51.762490 19647 raft_consensus.cc:515] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:51.775055 19658 leader_election.cc:290] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:51.775357 19721 leader_election.cc:290] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:51.774520 19647 leader_election.cc:290] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:51.782735 19389 leader_election.cc:290] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:51.747977 19788 raft_consensus.cc:515] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:51.784981 19655 leader_election.cc:290] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 12 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:51.788166 19788 leader_election.cc:290] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:51.770085 16207 raft_consensus.cc:2468] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 6.
W20260709 13:06:51.823271 19790 log.cc:927] Time spent T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.173s	user 0.004s	sys 0.000s
W20260709 13:06:51.826095 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 103731us
I20260709 13:06:51.831866 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:06:51.836186 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 82182.3us
I20260709 13:06:51.867713 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:51.882129 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:51.861948 19723 raft_consensus.cc:493] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.890000 19723 raft_consensus.cc:515] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:51.892587 19723 leader_election.cc:290] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:51.882913 16283 raft_consensus.cc:2468] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 6.
I20260709 13:06:51.899473 16351 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d"
dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
mode: GRACEFUL
new_leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
 from {username='slave'} at 127.0.0.1:56792
I20260709 13:06:51.900218 16351 raft_consensus.cc:606] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Received request to transfer leadership to TS e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:51.900586 16351 raft_consensus.cc:614] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:06:51.900975 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 132602us
I20260709 13:06:51.902628 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:51.903111 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:51.903486 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:51.905232 16202 raft_consensus.cc:3060] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:51.907626 16353 raft_consensus.cc:2393] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 6: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:06:51.903419 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:51.908349 16200 raft_consensus.cc:2468] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 7.
I20260709 13:06:51.911276 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:51.905135 16354 raft_consensus.cc:2468] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 7.
I20260709 13:06:51.915537 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:51.916843 16207 raft_consensus.cc:2468] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 6.
I20260709 13:06:51.916270 16200 raft_consensus.cc:2468] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 9.
I20260709 13:06:51.925698 16202 raft_consensus.cc:2468] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 11.
I20260709 13:06:51.927047 19789 raft_consensus.cc:493] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:51.933367 19789 raft_consensus.cc:515] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:51.937288 19789 leader_election.cc:290] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:51.943549 16205 raft_consensus.cc:2468] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 12.
I20260709 13:06:51.948693 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:51.949477 16279 raft_consensus.cc:2468] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 6.
I20260709 13:06:51.951614 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:51.952600 16282 raft_consensus.cc:2393] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 12: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:06:51.958914 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:51.959618 16282 raft_consensus.cc:2468] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 10.
I20260709 13:06:51.960709 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:51.964947 16283 raft_consensus.cc:3060] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:51.965991 16320 leader_election.cc:304] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:51.980656 19807 raft_consensus.cc:2804] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:51.981240 19807 raft_consensus.cc:493] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:51.982003 19807 raft_consensus.cc:3060] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:51.987423 16320 leader_election.cc:304] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:51.995884 16246 leader_election.cc:304] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:52.004345 19389 raft_consensus.cc:2804] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:52.004985 19389 raft_consensus.cc:697] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:52.005645 19658 raft_consensus.cc:2804] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:52.006203 19658 raft_consensus.cc:493] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:52.006671 19658 raft_consensus.cc:3060] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:52.007241 16248 leader_election.cc:304] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:52.008864 19801 raft_consensus.cc:2804] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:52.009303 19801 raft_consensus.cc:493] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:52.009668 19801 raft_consensus.cc:3060] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:52.011445 16320 leader_election.cc:304] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:52.012899 19655 raft_consensus.cc:2804] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:52.013327 19655 raft_consensus.cc:493] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:52.013685 16283 raft_consensus.cc:2468] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 11.
I20260709 13:06:52.013700 19655 raft_consensus.cc:3060] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:52.005986 19389 consensus_queue.cc:237] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:52.017693 16320 leader_election.cc:304] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:52.028100 16102 catalog_manager.cc:5697] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 10 to 11, leader changed from 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) to 363bb2f744eb486f9ad726f08214c98e (127.14.180.67). New cstate: current_term: 11 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:06:52.030542 16102 catalog_manager.cc:5697] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 5 to 6, leader changed from 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) to 363bb2f744eb486f9ad726f08214c98e (127.14.180.67). New cstate: current_term: 6 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } }
I20260709 13:06:52.031260 16320 leader_election.cc:304] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:52.037806 16105 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38830 (request call id 223) took 1079 ms. Trace:
I20260709 13:06:52.039911 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:52.034103 16102 catalog_manager.cc:5697] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: config changed from index 5 to 7, VOTER e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) evicted. New cstate: current_term: 7 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:52.051190 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:52.052620 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:52.030573 19805 raft_consensus.cc:2804] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:06:52.059549 19805 raft_consensus.cc:697] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 11 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:06:52.060758 19805 consensus_queue.cc:237] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:52.050453 16105 rpcz_store.cc:276] 0709 13:06:50.958025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:50.958220 (+   195us) service_pool.cc:224] Handling call
0709 13:06:52.037715 (+1079495us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:51.458834 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:51.553943 (+ 95109us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:51.558597 (+  4654us) write_op.cc:435] Acquired schema lock
0709 13:06:51.565143 (+  6546us) tablet.cc:662] Decoding operations
0709 13:06:51.655088 (+ 89945us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:51.655149 (+    61us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:51.655178 (+    29us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:06:51.655613 (+   435us) tablet.cc:701] Row locks acquired
0709 13:06:51.655634 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:06:51.655808 (+   174us) write_op.cc:270] Start()
0709 13:06:51.655958 (+   150us) write_op.cc:276] Timestamp: P: 1783602411655759 usec, L: 0
0709 13:06:51.655982 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:06:51.656638 (+   656us) log.cc:844] Serialized 1697 byte log entry
0709 13:06:51.939105 (+282467us) op_driver.cc:464] REPLICATION: finished
0709 13:06:51.977905 (+ 38800us) write_op.cc:301] APPLY: starting
0709 13:06:51.977996 (+    91us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:51.978155 (+   159us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:51.978297 (+   142us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:51.978821 (+   524us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:51.979027 (+   206us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 13:06:51.979079 (+    52us) write_op.cc:312] APPLY: finished
0709 13:06:51.979327 (+   248us) log.cc:844] Serialized 41 byte log entry
0709 13:06:51.979518 (+   191us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:51.979622 (+   104us) write_op.cc:454] Released schema lock
0709 13:06:51.979679 (+    57us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:51.986823 (+  7144us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:51.986853 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":13732,"reported_tablets":36,"child_traces":[["op",{"apply.queue_time_us":38566,"apply.run_cpu_time_us":2163,"apply.run_wall_time_us":8899,"num_ops":4,"prepare.queue_time_us":171,"prepare.run_cpu_time_us":4698,"prepare.run_wall_time_us":203677,"replication_time_us":282911,"spinlock_wait_cycles":3328,"thread_start_us":7391,"threads_started":1}]]}
I20260709 13:06:52.059576 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:52.050792 19788 raft_consensus.cc:2804] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:06:52.068805 16282 raft_consensus.cc:2393] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 10: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:06:52.069073 19788 raft_consensus.cc:697] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 12 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:06:52.070533 19788 consensus_queue.cc:237] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } }
I20260709 13:06:52.075436 19807 raft_consensus.cc:515] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:52.103184 16356 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece"
dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
mode: GRACEFUL
new_leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
 from {username='slave'} at 127.0.0.1:56792
I20260709 13:06:52.056072 19658 raft_consensus.cc:515] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:52.127301 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:52.127970 16200 raft_consensus.cc:3060] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:52.128310 19655 raft_consensus.cc:515] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:52.129542 16354 raft_consensus.cc:2368] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for earlier term 10. Current term is 11.
I20260709 13:06:52.031903 19801 raft_consensus.cc:515] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:52.134380 16275 raft_consensus.cc:2468] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 7.
I20260709 13:06:52.140246 16351 raft_consensus.cc:2393] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 8: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:06:52.139951 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:52.140770 16207 raft_consensus.cc:3060] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:06:52.140898 16356 raft_consensus.cc:606] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Received request to transfer leadership to TS e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:52.141297 16356 raft_consensus.cc:614] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:52.126350 19658 leader_election.cc:290] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:52.132895 19655 leader_election.cc:290] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:52.153401 19801 leader_election.cc:290] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:52.154357 16200 raft_consensus.cc:2468] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 8.
W20260709 13:06:52.160442 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 43852.3us
I20260709 13:06:52.161582 16173 leader_election.cc:304] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:52.163727 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:52.164301 16320 leader_election.cc:304] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:52.164657 16203 raft_consensus.cc:2368] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 7. Current term is 8.
I20260709 13:06:52.177258 16207 raft_consensus.cc:2468] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 11.
I20260709 13:06:52.180199 19797 raft_consensus.cc:2804] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:52.180943 19797 raft_consensus.cc:697] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 8 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:06:52.186332 16320 leader_election.cc:304] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:52.181879 19797 consensus_queue.cc:237] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:52.172060 19723 raft_consensus.cc:2764] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:06:52.198252 19773 raft_consensus.cc:493] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.198904 19773 raft_consensus.cc:515] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } }
I20260709 13:06:52.200766 19807 leader_election.cc:290] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:52.201290 19773 leader_election.cc:290] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:52.202953 19807 raft_consensus.cc:2804] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:06:52.208756 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:52.209579 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:52.210697 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:52.215924 16203 raft_consensus.cc:3060] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:52.216378 16246 leader_election.cc:400] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 election: Vote denied by peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073) with higher term. Message: Invalid argument: T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 7. Current term is 8.
I20260709 13:06:52.216773 16246 leader_election.cc:403] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:06:52.218264 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:52.218446 19735 raft_consensus.cc:3060] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:52.225244 16207 raft_consensus.cc:2410] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:06:52.226051 16203 raft_consensus.cc:2468] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 7.
I20260709 13:06:52.230751 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:52.231678 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:52.233031 16275 raft_consensus.cc:3060] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:52.232326 16106 catalog_manager.cc:5697] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e reported cstate change: term changed from 10 to 11, leader changed from 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) to e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65). New cstate: current_term: 11 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } }
I20260709 13:06:52.234412 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:52.239524 16320 leader_election.cc:304] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:52.242935 16173 leader_election.cc:400] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 pre-election: Vote denied by peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107) with higher term. Message: Invalid argument: T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for earlier term 10. Current term is 11.
I20260709 13:06:52.243561 16173 leader_election.cc:403] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:52.246842 15057 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:06:52.249132 15057 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:52.272323 16248 leader_election.cc:304] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:52.273321 19796 raft_consensus.cc:2749] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:52.250242 16191 tablet_service.cc:1558] Processing DeleteTablet for tablet b9e1324823f04d8da5a4b3ddbd061c0e with delete_type TABLET_DATA_TOMBSTONED (TS e10b16d536674c0bb350a31d7ce5ff7f not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:60124
I20260709 13:06:52.262051 19789 raft_consensus.cc:2749] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107) with higher term. Message: Invalid argument: T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for earlier term 10. Current term is 11.
I20260709 13:06:52.265849 19687 raft_consensus.cc:2804] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:52.239001 19807 raft_consensus.cc:697] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 11 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:06:52.299297 19807 consensus_queue.cc:237] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:52.304697 16275 raft_consensus.cc:2468] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 11.
I20260709 13:06:52.316236 16103 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55244 (request call id 126) took 1189 ms. Trace:
I20260709 13:06:52.312093 16102 catalog_manager.cc:5697] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 5 to 6, leader changed from e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) to 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66). New cstate: current_term: 6 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:52.317423 16103 rpcz_store.cc:276] 0709 13:06:51.126685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:51.131341 (+  4656us) service_pool.cc:224] Handling call
0709 13:06:52.316167 (+1184826us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14613,"reported_tablets":7}
I20260709 13:06:52.313954 19687 raft_consensus.cc:697] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [term 7 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:06:52.321542 19687 consensus_queue.cc:237] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:52.306466 19735 raft_consensus.cc:2749] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073) with higher term. Message: Invalid argument: T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 7. Current term is 8.
I20260709 13:06:52.338959 16279 raft_consensus.cc:2468] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 8.
W20260709 13:06:52.391054 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 50052.3us
I20260709 13:06:52.403189 16106 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38842 (request call id 215) took 1365 ms. Trace:
I20260709 13:06:52.427572 19815 tablet_replica.cc:333] T b9e1324823f04d8da5a4b3ddbd061c0e P e10b16d536674c0bb350a31d7ce5ff7f: stopping tablet replica
I20260709 13:06:52.406276 16106 rpcz_store.cc:276] 0709 13:06:51.038042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:51.038944 (+   902us) service_pool.cc:224] Handling call
0709 13:06:52.403119 (+1364175us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:52.255037 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:52.255668 (+   631us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:52.255712 (+    44us) write_op.cc:435] Acquired schema lock
0709 13:06:52.255730 (+    18us) tablet.cc:662] Decoding operations
0709 13:06:52.256155 (+   425us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:52.256221 (+    66us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:52.256255 (+    34us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:06:52.256465 (+   210us) tablet.cc:701] Row locks acquired
0709 13:06:52.256481 (+    16us) write_op.cc:260] PREPARE: finished
0709 13:06:52.256660 (+   179us) write_op.cc:270] Start()
0709 13:06:52.256796 (+   136us) write_op.cc:276] Timestamp: P: 1783602412256605 usec, L: 0
0709 13:06:52.256818 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:06:52.257545 (+   727us) log.cc:844] Serialized 537 byte log entry
0709 13:06:52.275507 (+ 17962us) op_driver.cc:464] REPLICATION: finished
0709 13:06:52.275982 (+   475us) write_op.cc:301] APPLY: starting
0709 13:06:52.276062 (+    80us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:52.276160 (+    98us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:52.276251 (+    91us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:52.276457 (+   206us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:52.276649 (+   192us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:06:52.276704 (+    55us) write_op.cc:312] APPLY: finished
0709 13:06:52.276917 (+   213us) log.cc:844] Serialized 23 byte log entry
0709 13:06:52.277098 (+   181us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:52.277179 (+    81us) write_op.cc:454] Released schema lock
0709 13:06:52.277234 (+    55us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:52.277588 (+   354us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:52.277619 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":32756,"reported_tablets":21,"spinlock_wait_cycles":87424,"child_traces":[["op",{"apply.queue_time_us":253,"apply.run_cpu_time_us":1552,"apply.run_wall_time_us":1552,"num_ops":1,"prepare.queue_time_us":1880,"prepare.run_cpu_time_us":2868,"prepare.run_wall_time_us":2867,"replication_time_us":18560}]]}
I20260709 13:06:53.445842 19723 raft_consensus.cc:493] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:53.448386 19723 raft_consensus.cc:515] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:53.477545 19819 raft_consensus.cc:493] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:53.478202 19819 raft_consensus.cc:515] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:53.480859 19819 leader_election.cc:290] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:53.482590 19819 raft_consensus.cc:493] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:53.488234 19819 raft_consensus.cc:515] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:53.501044 19819 leader_election.cc:290] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:53.507107 19723 leader_election.cc:290] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:53.519253 19823 raft_consensus.cc:493] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:53.520035 19823 raft_consensus.cc:515] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:53.526317 19823 leader_election.cc:290] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:53.253603 15057 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:53.552351 19826 raft_consensus.cc:493] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:53.544647 19823 raft_consensus.cc:493] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:53.601020 19821 raft_consensus.cc:493] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:53.601830 19821 raft_consensus.cc:515] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:53.602990 19823 raft_consensus.cc:515] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:53.604705 19821 leader_election.cc:290] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:53.605392 19821 raft_consensus.cc:493] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:53.605963 19821 raft_consensus.cc:515] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:53.602331 19723 raft_consensus.cc:493] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:53.606428 19823 leader_election.cc:290] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:53.553682 19826 raft_consensus.cc:515] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:53.887375 19824 raft_consensus.cc:493] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:53.959611 19823 raft_consensus.cc:493] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:53.959995 19824 raft_consensus.cc:515] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:53.960405 19823 raft_consensus.cc:515] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:53.961613 19826 leader_election.cc:290] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:53.607167 19820 raft_consensus.cc:493] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:53.970930 19820 raft_consensus.cc:515] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:53.973990 19820 leader_election.cc:290] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:53.962541 19723 raft_consensus.cc:515] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:54.056881 19723 leader_election.cc:290] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:53.965416 19821 leader_election.cc:290] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:53.904708 19822 raft_consensus.cc:493] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:54.057960 19822 raft_consensus.cc:515] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:54.059561 19825 raft_consensus.cc:493] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:54.060161 19825 raft_consensus.cc:515] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:54.061446 19815 raft_consensus.cc:2243] T b9e1324823f04d8da5a4b3ddbd061c0e P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:54.061859 19822 leader_election.cc:290] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:53.985287 19827 raft_consensus.cc:493] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:54.062362 19825 leader_election.cc:290] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:54.062533 19827 raft_consensus.cc:515] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:54.066022 19827 leader_election.cc:290] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:54.066706 19827 raft_consensus.cc:493] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:54.067325 19827 raft_consensus.cc:515] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:54.069669 19827 leader_election.cc:290] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:54.070945 19821 raft_consensus.cc:493] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:54.071130 19825 raft_consensus.cc:493] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:54.071647 19821 raft_consensus.cc:515] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:54.071815 19825 raft_consensus.cc:515] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:54.074653 19821 leader_election.cc:290] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:54.074867 19723 raft_consensus.cc:493] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:54.075558 19723 raft_consensus.cc:515] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:54.077822 19723 leader_election.cc:290] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:54.078454 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:54.079344 16352 raft_consensus.cc:2468] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 7.
W20260709 13:06:54.080596 16323 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.004s	sys 0.019s
W20260709 13:06:54.080991 16323 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.004s	sys 0.019s
I20260709 13:06:54.027495 19833 raft_consensus.cc:493] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:54.043345 19834 raft_consensus.cc:493] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:53.980268 19828 raft_consensus.cc:493] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:53.962235 19824 leader_election.cc:290] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:54.094937 19838 raft_consensus.cc:493] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
W20260709 13:06:54.095764 16915 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.006s	sys 0.003s
W20260709 13:06:54.113125 16915 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.566s	user 0.006s	sys 0.003s
I20260709 13:06:54.078375 19723 raft_consensus.cc:493] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:54.074309 19825 leader_election.cc:290] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:54.062444 19815 raft_consensus.cc:2272] T b9e1324823f04d8da5a4b3ddbd061c0e P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:54.108556 19830 raft_consensus.cc:493] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:54.070355 19827 raft_consensus.cc:493] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
W20260709 13:06:54.098048 16171 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.006s	sys 0.007s
W20260709 13:06:54.128089 16171 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.576s	user 0.006s	sys 0.007s
W20260709 13:06:54.117309 16173 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.016s	sys 0.024s
I20260709 13:06:54.092180 19826 raft_consensus.cc:493] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:54.121611 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:54.124084 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:54.126986 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c15d8e9be8414c84912ab77b66bfb1" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:54.131803 16357 raft_consensus.cc:2468] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 7.
W20260709 13:06:54.133052 16173 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.016s	sys 0.024s
W20260709 13:06:54.133683 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 593462us
I20260709 13:06:54.122951 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:54.110671 19833 raft_consensus.cc:515] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:54.113848 19828 raft_consensus.cc:515] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:54.117621 19723 raft_consensus.cc:515] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:54.115415 19838 raft_consensus.cc:515] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:54.112058 19834 raft_consensus.cc:515] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:54.168989 19829 raft_consensus.cc:493] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:54.148027 19825 raft_consensus.cc:493] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:54.183583 19825 raft_consensus.cc:515] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:54.184005 19837 raft_consensus.cc:493] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:54.184628 19837 raft_consensus.cc:515] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:54.147625 19826 raft_consensus.cc:515] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:54.145020 19827 raft_consensus.cc:515] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:54.186503 19825 leader_election.cc:290] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:54.192951 19825 raft_consensus.cc:493] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:54.194074 19825 raft_consensus.cc:515] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:54.165475 19835 raft_consensus.cc:493] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:54.145766 19830 raft_consensus.cc:515] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:54.198050 19839 raft_consensus.cc:493] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:54.203573 19839 raft_consensus.cc:515] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:54.204481 19825 leader_election.cc:290] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:54.204756 19830 leader_election.cc:290] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:54.205344 19825 raft_consensus.cc:493] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:54.208994 19825 raft_consensus.cc:515] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:54.202313 19829 raft_consensus.cc:515] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:54.206845 19842 raft_consensus.cc:493] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:54.202776 19835 raft_consensus.cc:515] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:54.189399 19826 leader_election.cc:290] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:54.207973 19834 leader_election.cc:290] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:54.192083 19827 leader_election.cc:290] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:54.186309 19820 raft_consensus.cc:493] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:54.193337 19723 leader_election.cc:290] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:54.164794 19823 leader_election.cc:290] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:06:54.231618 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 105379us
I20260709 13:06:54.179492 19824 raft_consensus.cc:493] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:54.206044 19839 leader_election.cc:290] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:54.180950 19831 raft_consensus.cc:493] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:54.219444 19838 leader_election.cc:290] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:54.191936 19828 leader_election.cc:290] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:54.265983 19723 raft_consensus.cc:493] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:54.270048 19849 raft_consensus.cc:493] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
W20260709 13:06:54.273761 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 59416.9us
W20260709 13:06:54.351516 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 90017.8us
I20260709 13:06:54.254613 19833 leader_election.cc:290] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:54.274811 19840 raft_consensus.cc:493] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:54.277120 19844 raft_consensus.cc:493] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:54.277539 19837 leader_election.cc:290] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:54.253510 19842 raft_consensus.cc:515] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:54.300971 19838 raft_consensus.cc:493] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:54.259917 19820 raft_consensus.cc:515] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:54.354794 19830 raft_consensus.cc:493] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:54.352574 19723 raft_consensus.cc:515] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:54.387796 19844 raft_consensus.cc:515] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:54.417557 19844 leader_election.cc:290] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:54.417979 19723 leader_election.cc:290] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:54.419414 19825 leader_election.cc:290] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:54.420097 19830 raft_consensus.cc:515] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:54.420707 19842 leader_election.cc:290] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:54.421092 16103 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55244 (request call id 127) took 2025 ms. Trace:
I20260709 13:06:54.421522 16103 rpcz_store.cc:276] 0709 13:06:52.395385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:52.396653 (+  1268us) service_pool.cc:224] Handling call
0709 13:06:52.409693 (+ 13040us) spinlock_profiling.cc:243] Waited 11.3 ms on lock 0x7b5400137754. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f3090 00007f361f491f3a 00007f36252481cc 00007f362534637e 00007f36238072a4 00007f3623807232 00007f3623807161 00007f36238070dc 00007f3623806392 00007f361d7c448c 00007f361d7c38c6
0709 13:06:54.421017 (+2011324us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14585,"reported_tablets":2,"spinlock_wait_cycles":25953024}
I20260709 13:06:54.422528 19830 leader_election.cc:290] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:54.429874 19853 raft_consensus.cc:493] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:54.355903 19849 raft_consensus.cc:515] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:54.274401 19824 raft_consensus.cc:515] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:54.392105 19835 leader_election.cc:290] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:06:54.393443 16970 debug-util.cc:398] Leaking SignalData structure 0x7b0800333a00 after lost signal to thread 15060
W20260709 13:06:54.465830 16970 debug-util.cc:398] Leaking SignalData structure 0x7b080008d4a0 after lost signal to thread 16140
I20260709 13:06:54.367305 19840 raft_consensus.cc:515] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:54.394680 19851 raft_consensus.cc:493] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:54.398809 19855 raft_consensus.cc:493] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:54.399298 19823 raft_consensus.cc:493] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:54.413056 19838 raft_consensus.cc:515] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:54.360994 19841 raft_consensus.cc:493] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:54.388759 19847 raft_consensus.cc:493] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:54.413894 19815 ts_tablet_manager.cc:1916] T b9e1324823f04d8da5a4b3ddbd061c0e P e10b16d536674c0bb350a31d7ce5ff7f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:54.422531 19829 leader_election.cc:290] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:54.368863 19822 raft_consensus.cc:493] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:54.466640 19723 raft_consensus.cc:493] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:54.285725 19831 raft_consensus.cc:515] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:54.390659 19846 raft_consensus.cc:493] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:54.399816 19834 raft_consensus.cc:493] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:54.482172 16351 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33486 (request call id 476) took 1971 ms. Trace:
I20260709 13:06:54.483101 19821 raft_consensus.cc:493] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:54.483778 19861 raft_consensus.cc:493] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:54.484354 19609 raft_consensus.cc:493] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:54.484901 19833 raft_consensus.cc:493] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:54.485639 19845 raft_consensus.cc:493] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:54.486320 19836 raft_consensus.cc:493] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
W20260709 13:06:54.487648 16970 debug-util.cc:398] Leaking SignalData structure 0x7b080034b1a0 after lost signal to thread 16232
I20260709 13:06:54.435679 19820 leader_election.cc:290] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:54.467351 19819 raft_consensus.cc:493] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:54.505983 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:54.506345 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:54.506827 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:54.539402 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:54.470356 19825 raft_consensus.cc:493] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:54.541846 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:54.546021 16351 rpcz_store.cc:276] 0709 13:06:52.511193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.399610 (+1888417us) service_pool.cc:224] Handling call
0709 13:06:54.400014 (+   404us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:54.437341 (+ 37327us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:54.437374 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:54.437425 (+    51us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:54.437453 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:54.481920 (+ 44467us) spinlock_profiling.cc:243] Waited 37.1 ms on lock 0x7b5400269154. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f489e01 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6
0709 13:06:54.481969 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:54.482106 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":85315968}
I20260709 13:06:54.469584 19851 raft_consensus.cc:515] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:54.464639 19853 raft_consensus.cc:515] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:06:54.573046 16970 debug-util.cc:398] Leaking SignalData structure 0x7b080028cf40 after lost signal to thread 16307
I20260709 13:06:54.570799 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:54.569007 19861 raft_consensus.cc:515] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:54.576963 19838 leader_election.cc:290] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:54.571521 19609 raft_consensus.cc:515] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:54.629216 19824 leader_election.cc:290] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:54.630749 19840 leader_election.cc:290] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:54.583366 19839 raft_consensus.cc:493] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:54.631681 19839 raft_consensus.cc:515] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:54.634063 19839 leader_election.cc:290] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:54.497885 19847 raft_consensus.cc:515] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:54.564646 19846 raft_consensus.cc:515] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:54.577522 19845 raft_consensus.cc:515] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:54.636659 19846 leader_election.cc:290] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:54.491849 19841 raft_consensus.cc:515] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:54.637699 19845 leader_election.cc:290] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:54.585878 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:54.487712 19823 raft_consensus.cc:515] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:54.638511 16949 raft_consensus.cc:2468] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 7.
I20260709 13:06:54.639137 19841 leader_election.cc:290] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:54.564100 19834 raft_consensus.cc:515] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:54.640635 19823 leader_election.cc:290] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:54.551992 19844 raft_consensus.cc:493] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:54.641784 19844 raft_consensus.cc:515] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:54.642468 19834 leader_election.cc:290] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:54.593513 19820 raft_consensus.cc:493] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:54.643376 19820 raft_consensus.cc:515] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:54.644081 19861 leader_election.cc:290] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:54.644817 19844 leader_election.cc:290] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:54.565862 16946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f022e2e63ae4461d834e476ff2666991" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:54.602773 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:54.645530 19820 leader_election.cc:290] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:54.646202 19847 leader_election.cc:290] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:54.646333 19860 raft_consensus.cc:493] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
W20260709 13:06:54.602969 16970 debug-util.cc:398] Leaking SignalData structure 0x7b08003cc560 after lost signal to thread 16381
I20260709 13:06:54.646936 19860 raft_consensus.cc:515] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:06:54.647940 16970 debug-util.cc:398] Leaking SignalData structure 0x7b08003740e0 after lost signal to thread 16973
I20260709 13:06:54.649132 19860 leader_election.cc:290] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:54.541023 19822 raft_consensus.cc:515] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:54.544979 19723 raft_consensus.cc:515] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } }
I20260709 13:06:54.652086 19822 leader_election.cc:290] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:54.606887 19862 raft_consensus.cc:493] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:54.599781 19819 raft_consensus.cc:515] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:54.652789 19862 raft_consensus.cc:515] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:54.654268 19819 leader_election.cc:290] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:54.601552 19825 raft_consensus.cc:515] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:54.616140 19831 leader_election.cc:290] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:54.616855 19868 raft_consensus.cc:493] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:54.616955 19871 raft_consensus.cc:493] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:54.618655 19829 raft_consensus.cc:493] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:54.621675 19858 raft_consensus.cc:493] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:54.684640 19858 raft_consensus.cc:515] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:54.684864 19829 raft_consensus.cc:515] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:54.685827 19825 leader_election.cc:290] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:54.686977 19858 leader_election.cc:290] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:54.612546 19842 raft_consensus.cc:493] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:54.687381 19829 leader_election.cc:290] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:54.687817 19842 raft_consensus.cc:515] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:54.688372 19871 raft_consensus.cc:515] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:54.564435 19821 raft_consensus.cc:515] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:54.690656 19868 raft_consensus.cc:515] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:54.692293 19821 leader_election.cc:290] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:54.488341 19855 raft_consensus.cc:515] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:54.693657 19868 leader_election.cc:290] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:54.571841 19843 raft_consensus.cc:493] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:54.626605 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:54.627830 19849 leader_election.cc:290] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:54.627983 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:54.584097 19833 raft_consensus.cc:515] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:54.630895 19609 leader_election.cc:290] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:54.641109 19853 leader_election.cc:290] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:06:54.654915 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 302107us
I20260709 13:06:54.578368 19836 raft_consensus.cc:515] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:54.659279 16940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:54.652086 19723 leader_election.cc:290] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:54.625630 19851 leader_election.cc:290] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:54.690270 19842 leader_election.cc:290] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:06:54.699730 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 346214us
I20260709 13:06:54.715379 16248 leader_election.cc:304] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:06:54.719309 19868 raft_consensus.cc:493] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:54.720052 19868 raft_consensus.cc:515] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:54.721829 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:54.722719 19829 raft_consensus.cc:493] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:54.723273 19829 raft_consensus.cc:515] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:54.724941 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:54.725756 16947 raft_consensus.cc:2468] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 7.
I20260709 13:06:54.725448 19829 leader_election.cc:290] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:54.722286 19868 leader_election.cc:290] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:54.725670 16946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:54.727206 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:54.727223 16946 raft_consensus.cc:2468] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 9.
I20260709 13:06:54.728013 16949 raft_consensus.cc:2468] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 8.
W20260709 13:06:54.727294 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 174908us
I20260709 13:06:54.694538 19855 leader_election.cc:290] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:54.738488 16280 raft_consensus.cc:3055] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:54.707363 19861 raft_consensus.cc:493] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:54.738967 16280 raft_consensus.cc:740] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:54.739280 19861 raft_consensus.cc:515] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:54.739872 16280 consensus_queue.cc:260] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:54.740839 16280 raft_consensus.cc:3060] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:54.707989 19834 raft_consensus.cc:493] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:54.741606 19861 leader_election.cc:290] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:54.741740 19834 raft_consensus.cc:515] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:54.697865 19843 raft_consensus.cc:515] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:54.744123 19834 leader_election.cc:290] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:54.744767 19843 leader_election.cc:290] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:54.745268 19871 leader_election.cc:290] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:54.745564 19862 leader_election.cc:290] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:54.710929 19857 raft_consensus.cc:493] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:54.746524 19857 raft_consensus.cc:515] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:54.751188 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:54.751523 16278 raft_consensus.cc:1275] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:06:54.746968 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:54.746210 16103 catalog_manager.cc:5697] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:54.756600 16103 catalog_manager.cc:5697] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e reported cstate change: term changed from 11 to 12, leader changed from e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) to 363bb2f744eb486f9ad726f08214c98e (127.14.180.67). New cstate: current_term: 12 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:54.758787 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 43505.8us
I20260709 13:06:54.760078 16103 catalog_manager.cc:5697] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e reported cstate change: term changed from 7 to 11, leader changed from 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) to 363bb2f744eb486f9ad726f08214c98e (127.14.180.67). New cstate: current_term: 11 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:54.767280 19857 leader_election.cc:290] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:54.768276 16280 raft_consensus.cc:1275] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 13:06:54.768664 16280 pending_rounds.cc:85] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3: Aborting all ops after (but not including) 4
I20260709 13:06:54.768891 16280 pending_rounds.cc:107] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 13:06:54.769170 16280 raft_consensus.cc:2889] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:54.708169 19821 raft_consensus.cc:493] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:54.774019 19821 raft_consensus.cc:515] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:54.776662 19821 leader_election.cc:290] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:54.712193 19820 raft_consensus.cc:493] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:54.777568 19820 raft_consensus.cc:515] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:54.780128 19820 leader_election.cc:290] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:54.782111 19833 leader_election.cc:290] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:54.747538 19836 leader_election.cc:290] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:54.762965 16103 catalog_manager.cc:5697] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:54.785924 16103 catalog_manager.cc:5697] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e reported cstate change: term changed from 6 to 7, leader changed from 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) to 363bb2f744eb486f9ad726f08214c98e (127.14.180.67). New cstate: current_term: 7 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } }
W20260709 13:06:54.735663 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 188347us
I20260709 13:06:54.791925 19868 raft_consensus.cc:493] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:54.792573 19868 raft_consensus.cc:515] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:54.792896 19844 consensus_queue.cc:1048] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:54.795277 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:54.795765 19868 leader_election.cc:290] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:54.796187 19874 raft_consensus.cc:2804] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:54.796708 19874 raft_consensus.cc:493] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:54.797155 19874 raft_consensus.cc:3060] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:54.796430 19868 raft_consensus.cc:493] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:54.797920 19868 raft_consensus.cc:515] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:54.799660 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:54.801491 19855 raft_consensus.cc:493] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:54.800482 19868 leader_election.cc:290] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:54.801867 19871 raft_consensus.cc:493] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:54.802263 19868 raft_consensus.cc:493] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:54.802394 19871 raft_consensus.cc:515] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:54.803812 16940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:54.804739 19871 leader_election.cc:290] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:54.765018 19609 raft_consensus.cc:493] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:54.806376 19609 raft_consensus.cc:515] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:54.809152 19872 raft_consensus.cc:493] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:54.810730 19849 raft_consensus.cc:493] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:54.811309 19849 raft_consensus.cc:515] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:54.812057 16202 raft_consensus.cc:1275] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:06:54.802964 19868 raft_consensus.cc:515] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:54.813625 19849 leader_election.cc:290] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:54.802114 19855 raft_consensus.cc:515] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:54.723284 19876 raft_consensus.cc:493] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:54.820518 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:54.820542 19876 raft_consensus.cc:515] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:54.822705 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:54.823340 19876 leader_election.cc:290] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:54.825004 16206 raft_consensus.cc:1275] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:06:54.825381 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:54.825925 19837 raft_consensus.cc:493] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:54.826120 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:54.826519 19837 raft_consensus.cc:515] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:54.826838 19821 raft_consensus.cc:493] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:54.827175 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:54.827557 19821 raft_consensus.cc:515] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:54.828816 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:54.829713 19869 raft_consensus.cc:493] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:54.814267 19849 raft_consensus.cc:493] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:54.830312 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:54.830341 19869 raft_consensus.cc:515] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:54.830928 19849 raft_consensus.cc:515] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:54.833140 19849 leader_election.cc:290] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:54.825026 19836 raft_consensus.cc:493] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:54.833880 19836 raft_consensus.cc:515] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:54.836199 19836 leader_election.cc:290] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:54.837186 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:54.837404 19855 leader_election.cc:290] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:54.809875 19872 raft_consensus.cc:515] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:54.837954 16202 raft_consensus.cc:2468] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 5.
I20260709 13:06:54.839089 16204 raft_consensus.cc:2468] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 9.
I20260709 13:06:54.839811 19872 leader_election.cc:290] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:54.840735 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:54.823405 16205 raft_consensus.cc:2468] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 8.
I20260709 13:06:54.833156 19869 leader_election.cc:290] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:54.815814 16207 raft_consensus.cc:1275] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:06:54.817235 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:54.843375 19877 consensus_queue.cc:1048] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:54.793123 16945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:54.809358 19609 leader_election.cc:290] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:54.830189 19821 leader_election.cc:290] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:54.848842 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:54.849294 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:54.849628 16276 raft_consensus.cc:2468] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 10.
I20260709 13:06:54.849875 16282 raft_consensus.cc:2468] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 10.
I20260709 13:06:54.845096 19868 leader_election.cc:290] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:54.851338 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:54.852038 16207 raft_consensus.cc:2468] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 5.
I20260709 13:06:54.852162 16945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:54.853583 19609 raft_consensus.cc:493] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:54.828713 19837 leader_election.cc:290] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:54.854460 19837 raft_consensus.cc:493] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:54.855096 19837 raft_consensus.cc:515] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } }
I20260709 13:06:54.854197 19609 raft_consensus.cc:515] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:54.839620 19874 raft_consensus.cc:515] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:54.860244 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:54.858443 16205 raft_consensus.cc:1275] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:06:54.864393 16276 raft_consensus.cc:2468] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 10.
I20260709 13:06:54.864969 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:54.859844 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:54.869211 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:54.857643 19837 leader_election.cc:290] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:54.870424 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:54.870689 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:54.870887 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:54.862664 19815 ts_tablet_manager.cc:1929] T b9e1324823f04d8da5a4b3ddbd061c0e P e10b16d536674c0bb350a31d7ce5ff7f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 7.6
I20260709 13:06:54.871598 16280 raft_consensus.cc:2468] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 11.
I20260709 13:06:54.871831 19815 log.cc:1199] T b9e1324823f04d8da5a4b3ddbd061c0e P e10b16d536674c0bb350a31d7ce5ff7f: Deleting WAL directory at /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602283040513-15057-0/minicluster-data/ts-0-root/wals/b9e1324823f04d8da5a4b3ddbd061c0e
I20260709 13:06:54.872519 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:06:54.851327 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 63472.3us
I20260709 13:06:54.874641 16173 leader_election.cc:304] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:54.857795 19609 leader_election.cc:290] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:54.877146 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:54.877637 16945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:54.877899 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:54.879496 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:54.880203 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:54.880461 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bc3c8ff9b84838a2664335d7e1582b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:54.880738 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:54.881098 16278 raft_consensus.cc:2468] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 6.
I20260709 13:06:54.881754 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:54.881978 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:54.883272 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:54.891665 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:54.892143 16274 raft_consensus.cc:1275] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:06:54.883508 16278 raft_consensus.cc:2468] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 6.
I20260709 13:06:54.892094 16282 raft_consensus.cc:2468] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 5.
I20260709 13:06:54.893522 19815 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:60124 (request call id 79) took 2643 ms. Trace:
I20260709 13:06:54.882009 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:54.894600 16276 raft_consensus.cc:2468] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 10.
I20260709 13:06:54.894737 16281 raft_consensus.cc:1240] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:54.884045 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:06:54.895828 16248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:54.896960 16248 leader_election.cc:304] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:06:54.897292 19874 leader_election.cc:290] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:54.900041 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:54.902462 16281 raft_consensus.cc:1275] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:06:54.903012 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:54.903913 16945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:54.904304 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:54.905112 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:54.894009 19815 rpcz_store.cc:276] 0709 13:06:52.249324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:52.249903 (+   579us) service_pool.cc:224] Handling call
0709 13:06:52.427181 (+177278us) ts_tablet_manager.cc:1151] Deleting tablet b9e1324823f04d8da5a4b3ddbd061c0e
0709 13:06:52.427282 (+   101us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:06:54.767546 (+2340264us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:54.862406 (+ 94860us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:54.893023 (+ 30617us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1632438,"tablet-delete.queue_time_us":150085,"thread_start_us":63245,"threads_started":1}
I20260709 13:06:54.906754 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:54.907064 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:54.909420 16204 raft_consensus.cc:2468] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 8.
I20260709 13:06:54.909512 16173 leader_election.cc:304] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:54.908345 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:54.908268 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:54.910646 16173 leader_election.cc:304] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:54.912041 19869 raft_consensus.cc:2804] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:54.912509 19869 raft_consensus.cc:493] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:54.912536 16945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:54.913147 19869 raft_consensus.cc:3060] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:54.913911 16279 raft_consensus.cc:1275] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:06:54.912559 19872 raft_consensus.cc:2804] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:54.917171 19872 raft_consensus.cc:493] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:54.916251 19877 consensus_queue.cc:1048] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:06:54.912923 19868 raft_consensus.cc:2804] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:54.917630 19872 raft_consensus.cc:3060] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:54.917829 19868 raft_consensus.cc:493] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:54.918275 19868 raft_consensus.cc:3060] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:54.918874 19862 consensus_queue.cc:1048] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:06:54.911034 16283 raft_consensus.cc:2468] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 12.
I20260709 13:06:54.925187 16320 leader_election.cc:304] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:06:54.925747 19855 raft_consensus.cc:2804] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:54.926433 19855 raft_consensus.cc:493] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:54.926643 19862 raft_consensus.cc:2804] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:54.926837 16090 catalog_manager.cc:5028] TS e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): tablet b9e1324823f04d8da5a4b3ddbd061c0e (table test-workload [id=f364cfe226234c5b99453e3013c8717e]) successfully deleted
I20260709 13:06:54.927026 19855 raft_consensus.cc:3060] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:54.927165 19862 raft_consensus.cc:493] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:54.927718 19862 raft_consensus.cc:3060] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:54.928534 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:54.932976 16320 leader_election.cc:304] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:54.933986 19877 raft_consensus.cc:2804] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:54.933990 16945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:54.934660 19877 raft_consensus.cc:493] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:54.935108 19877 raft_consensus.cc:3060] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:54.937090 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:54.937422 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:54.941905 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:54.942895 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:54.944427 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:54.946194 16945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:54.946931 16320 leader_election.cc:304] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:06:54.947978 19852 raft_consensus.cc:2804] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:54.948383 19852 raft_consensus.cc:493] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:54.948764 19852 raft_consensus.cc:3060] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:54.950742 19853 consensus_queue.cc:1048] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:54.951260 19872 raft_consensus.cc:515] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:54.952486 16205 raft_consensus.cc:2393] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 in current term 10: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:06:54.953830 16320 leader_election.cc:304] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:54.953958 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:54.954819 19853 raft_consensus.cc:2804] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:54.954895 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:54.955302 19853 raft_consensus.cc:493] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:54.955778 19853 raft_consensus.cc:3060] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:54.956312 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:54.956837 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:54.957149 16912 leader_election.cc:304] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:54.957521 16276 raft_consensus.cc:2468] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 10.
I20260709 13:06:54.957731 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:54.959017 19842 raft_consensus.cc:2804] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:54.959461 19842 raft_consensus.cc:493] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:54.959843 19842 raft_consensus.cc:3060] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:54.960604 16914 leader_election.cc:304] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:54.965723 19868 raft_consensus.cc:515] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:54.962488 19850 raft_consensus.cc:2749] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:55.051020 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:55.051743 16350 raft_consensus.cc:2468] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 6.
I20260709 13:06:55.052027 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:55.052698 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:55.053544 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:55.053794 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:54.989639 16202 raft_consensus.cc:1240] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:55.054920 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:55.055130 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:55.055737 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:54.990337 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:55.056017 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:54.981225 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:55.056785 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:55.057363 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:55.057816 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:55.058161 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:54.985008 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:55.059139 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:54.967132 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:55.020812 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:55.025097 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:55.060307 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f022e2e63ae4461d834e476ff2666991" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:55.060585 16207 raft_consensus.cc:2468] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 4.
I20260709 13:06:55.061069 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:54.977478 16945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:55.025903 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:55.026893 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:55.062608 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c15d8e9be8414c84912ab77b66bfb1" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:55.063140 16199 raft_consensus.cc:2468] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 7.
I20260709 13:06:55.063208 19853 raft_consensus.cc:515] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:54.985298 19830 consensus_queue.cc:1048] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 13:06:55.065529 19853 leader_election.cc:290] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:54.966517 19869 raft_consensus.cc:515] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:55.031972 19821 raft_consensus.cc:493] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:55.048347 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:55.031901 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:55.068321 16202 raft_consensus.cc:2468] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 11.
I20260709 13:06:55.053866 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:55.033078 19872 leader_election.cc:290] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 election: Requested vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:54.984323 19877 raft_consensus.cc:515] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:54.984071 19852 raft_consensus.cc:515] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:54.973155 19842 raft_consensus.cc:515] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:55.086047 19842 leader_election.cc:290] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 9 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:54.982203 19855 raft_consensus.cc:515] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:55.088380 19855 leader_election.cc:290] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:55.091154 19852 leader_election.cc:290] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:55.067016 19821 raft_consensus.cc:515] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:55.039386 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f022e2e63ae4461d834e476ff2666991" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:55.095208 16173 leader_election.cc:304] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:55.039759 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:55.040483 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:55.042317 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:55.098465 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:55.098758 19849 raft_consensus.cc:2749] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:55.099761 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:55.099864 16173 leader_election.cc:304] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:55.100886 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:55.101195 16173 leader_election.cc:304] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:55.101524 16206 raft_consensus.cc:2468] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 5.
I20260709 13:06:55.043820 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:55.045138 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:55.102751 16173 leader_election.cc:304] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:55.045449 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:55.104090 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:55.046532 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:55.047776 16356 raft_consensus.cc:1240] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [term 7 LEADER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:55.048426 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:55.049296 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:55.044433 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:55.056092 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:55.103039 16275 raft_consensus.cc:2468] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 7.
I20260709 13:06:55.059824 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:54.988217 16205 raft_consensus.cc:1275] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:06:55.107744 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:55.108738 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:55.102962 16278 raft_consensus.cc:2468] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 6.
I20260709 13:06:55.061398 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:55.029770 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:55.061398 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:55.110203 16276 raft_consensus.cc:2468] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 11.
I20260709 13:06:55.111445 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:55.061124 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:55.026714 16914 leader_election.cc:304] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:06:55.058393 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bc3c8ff9b84838a2664335d7e1582b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:55.079095 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:55.080123 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f022e2e63ae4461d834e476ff2666991" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:55.082818 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:55.112947 16208 raft_consensus.cc:1240] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:55.084096 19877 leader_election.cc:290] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 10 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:55.102421 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:55.029492 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:55.113296 16350 raft_consensus.cc:2468] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 5.
I20260709 13:06:55.109493 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:55.114624 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:55.115135 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:55.075067 16248 leader_election.cc:304] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:06:55.109809 16207 raft_consensus.cc:2468] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 5.
W20260709 13:06:55.116166 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 89526.3us
I20260709 13:06:55.115458 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:55.126668 16200 raft_consensus.cc:2393] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 in current term 8: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:06:55.127277 16351 raft_consensus.cc:2468] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 8.
I20260709 13:06:55.117349 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:55.118948 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:06:55.115862 16247 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:55.115876 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:55.133427 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:55.133795 16352 raft_consensus.cc:1240] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:55.135667 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:55.144418 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:06:55.149498 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 74494.3us
W20260709 13:06:55.163929 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 82156.4us
I20260709 13:06:55.165376 16320 leader_election.cc:304] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:55.167510 16320 leader_election.cc:304] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:55.180086 16349 raft_consensus.cc:1240] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:55.188841 19875 consensus_queue.cc:1059] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:06:55.189760 19868 leader_election.cc:290] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:55.190050 19875 raft_consensus.cc:2804] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:55.190582 19875 raft_consensus.cc:493] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:55.190971 19875 raft_consensus.cc:3060] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:55.191285 19860 raft_consensus.cc:3055] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:06:55.117013 19869 leader_election.cc:290] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:55.191673 19860 raft_consensus.cc:740] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:06:55.266572 16947 raft_consensus.cc:1240] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 8. Current term is 9. Ops: []
W20260709 13:06:55.242473 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 104076us
I20260709 13:06:55.216771 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:06:55.192260 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:06:55.217300 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 54120.3us
I20260709 13:06:55.308357 16173 leader_election.cc:304] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
W20260709 13:06:55.268731 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 101296us
I20260709 13:06:55.289459 16277 consensus_queue.cc:237] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:06:55.154860 19842 raft_consensus.cc:2804] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:55.144568 19865 raft_consensus.cc:2749] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:55.177882 19867 raft_consensus.cc:2749] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:55.269862 19844 raft_consensus.cc:2804] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:55.321671 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:55.181715 19874 raft_consensus.cc:2804] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:55.307438 19821 leader_election.cc:290] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:06:55.274300 16246 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.180.65:46073 timed out after 1.634s (SENT) [suppressed 1 similar messages]
I20260709 13:06:55.327169 15057 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:55.327405 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:55.336545 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:55.315191 19609 raft_consensus.cc:493] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.331915 16200 raft_consensus.cc:1240] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:55.266867 19723 raft_consensus.cc:493] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.330392 19874 raft_consensus.cc:493] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:55.355299 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:55.321065 19842 raft_consensus.cc:493] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:55.334450 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:55.334450 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:55.113292 19862 raft_consensus.cc:515] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:55.345925 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:55.347395 16202 raft_consensus.cc:1240] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:55.361927 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bc3c8ff9b84838a2664335d7e1582b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:55.347651 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:55.314975 19872 raft_consensus.cc:2749] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:55.111023 19849 raft_consensus.cc:2749] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:55.356684 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:55.362908 16201 raft_consensus.cc:3060] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:55.357712 19874 raft_consensus.cc:3060] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:55.365700 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:55.320216 19820 consensus_queue.cc:1059] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.014s
I20260709 13:06:55.363653 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:55.364126 16357 raft_consensus.cc:1240] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:55.329210 19844 raft_consensus.cc:493] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:55.368458 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:55.323046 19877 consensus_queue.cc:1048] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:06:55.382009 19862 leader_election.cc:290] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:55.362417 19842 raft_consensus.cc:3060] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:55.359356 19609 raft_consensus.cc:515] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:55.377496 19844 raft_consensus.cc:3060] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:55.355731 19723 raft_consensus.cc:515] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:55.415648 19875 raft_consensus.cc:515] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:55.418622 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:55.420393 16173 leader_election.cc:304] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:06:55.428488 16173 leader_election.cc:304] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:55.429955 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:55.435593 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:55.436854 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:55.437199 19871 raft_consensus.cc:2804] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:55.437662 19871 raft_consensus.cc:493] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:55.437885 19875 leader_election.cc:290] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:55.438081 19871 raft_consensus.cc:3060] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:55.438455 19873 raft_consensus.cc:2749] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:06:55.439850 16248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:55.438158 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:55.436184 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:55.365617 19860 consensus_queue.cc:260] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:55.443867 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:55.443583 16173 leader_election.cc:304] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:55.463716 16173 leader_election.cc:304] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:55.438274 19723 leader_election.cc:290] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:06:55.467128 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 192842us
I20260709 13:06:55.479053 16205 raft_consensus.cc:1240] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:55.480343 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
W20260709 13:06:55.481112 16246 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:55.467499 16173 leader_election.cc:304] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:55.482986 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:55.462134 19876 raft_consensus.cc:2804] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:55.487075 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:55.487481 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:55.489245 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:55.496642 16201 raft_consensus.cc:2468] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 9.
I20260709 13:06:55.498065 19872 raft_consensus.cc:2804] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:55.498723 19872 raft_consensus.cc:493] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:55.499226 19872 raft_consensus.cc:3060] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:55.499164 16200 raft_consensus.cc:1240] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 8. Current term is 9. Ops: []
W20260709 13:06:55.507365 16247 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:55.507339 16173 leader_election.cc:304] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:55.508690 19865 raft_consensus.cc:2804] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:55.509126 19865 raft_consensus.cc:493] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:55.509507 19865 raft_consensus.cc:3060] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:55.511205 16173 leader_election.cc:304] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:55.512445 19855 raft_consensus.cc:2804] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:55.512847 19855 raft_consensus.cc:493] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:55.513236 19855 raft_consensus.cc:3060] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:55.513602 16173 leader_election.cc:304] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:55.516081 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:55.467760 19873 raft_consensus.cc:2804] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:55.514530 16173 leader_election.cc:304] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:55.522436 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:55.549674 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:55.531981 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:55.553215 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:55.555606 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:55.565335 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:55.566887 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:55.527736 19873 raft_consensus.cc:493] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
W20260709 13:06:55.569449 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 54978.1us
I20260709 13:06:55.574913 16173 leader_election.cc:304] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:55.576988 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:55.581280 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:55.527801 19856 raft_consensus.cc:2804] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:55.492161 19876 raft_consensus.cc:493] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:55.551604 19874 raft_consensus.cc:515] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:55.595983 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:55.577534 19873 raft_consensus.cc:3060] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:55.563525 19837 raft_consensus.cc:3055] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:55.603199 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:06:55.576056 19831 raft_consensus.cc:2804] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:55.612320 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:06:55.607465 19875 raft_consensus.cc:493] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:55.614567 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:55.615052 19875 raft_consensus.cc:515] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:55.615794 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:06:55.617296 19875 leader_election.cc:290] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:55.617499 16914 leader_election.cc:304] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:55.618609 19859 raft_consensus.cc:2749] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:55.598538 19723 raft_consensus.cc:2804] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:55.619378 19723 raft_consensus.cc:493] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:55.619805 19723 raft_consensus.cc:3060] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:55.577188 19830 consensus_queue.cc:1059] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 13:06:55.603854 19876 raft_consensus.cc:3060] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:55.625809 19872 raft_consensus.cc:515] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:55.619699 16914 leader_election.cc:304] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:55.640376 16912 leader_election.cc:304] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:55.626900 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:55.625872 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:55.627244 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:55.626461 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bc3c8ff9b84838a2664335d7e1582b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:55.647939 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:55.630126 19831 raft_consensus.cc:493] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:55.652686 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:55.633942 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:55.631091 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:06:55.635104 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:55.636425 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:55.642199 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:06:55.630321 16322 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:55.650022 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:55.504905 19849 consensus_queue.cc:1059] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:55.653848 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:55.656221 16355 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b"
dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
mode: GRACEFUL
new_leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
 from {username='slave'} at 127.0.0.1:56792
I20260709 13:06:55.657377 19890 raft_consensus.cc:493] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.659786 16355 raft_consensus.cc:606] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 11 LEADER]: Received request to transfer leadership to TS e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:55.660398 19850 raft_consensus.cc:3060] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:06:55.660663 16249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:55.663539 19849 raft_consensus.cc:3055] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:55.664000 19849 raft_consensus.cc:740] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:55.664815 19849 consensus_queue.cc:260] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:55.665660 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:06:55.659261 19831 raft_consensus.cc:3060] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:06:55.668289 19886 log.cc:927] Time spent T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:06:55.681001 16203 raft_consensus.cc:1240] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:55.689396 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:55.607615 19837 raft_consensus.cc:740] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:55.644292 19866 raft_consensus.cc:2749] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:55.682651 19874 leader_election.cc:290] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:55.700819 19860 raft_consensus.cc:3060] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:55.701543 19844 raft_consensus.cc:515] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:55.711179 19872 leader_election.cc:290] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 11 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:55.714118 19842 raft_consensus.cc:515] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:55.716248 16942 raft_consensus.cc:1240] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:55.692456 19890 raft_consensus.cc:515] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:55.717168 19609 leader_election.cc:290] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:55.717779 19723 raft_consensus.cc:515] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:55.719229 19890 leader_election.cc:290] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:55.720723 19844 leader_election.cc:290] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:55.726373 19837 consensus_queue.cc:260] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:55.727857 19837 raft_consensus.cc:3060] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:55.732797 19849 raft_consensus.cc:3060] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:55.733466 16205 raft_consensus.cc:2393] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 in current term 9: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:06:55.720439 19876 raft_consensus.cc:515] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:55.761451 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:55.721685 19842 leader_election.cc:290] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 12 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:55.721621 19855 raft_consensus.cc:515] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:55.723814 19865 raft_consensus.cc:515] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } }
I20260709 13:06:55.659976 16914 leader_election.cc:304] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:06:55.793941 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 137070us
I20260709 13:06:55.794807 16322 leader_election.cc:304] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:55.797679 16246 leader_election.cc:304] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:55.800720 19822 raft_consensus.cc:2749] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:55.808907 19865 leader_election.cc:290] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 13 election: Requested vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:55.812157 19876 leader_election.cc:290] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:55.819188 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:55.819401 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c15d8e9be8414c84912ab77b66bfb1" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:55.821084 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:55.826637 16322 leader_election.cc:304] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:55.827185 16103 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38842 (request call id 216) took 1216 ms. Trace:
I20260709 13:06:55.827927 16322 leader_election.cc:304] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:55.828547 16203 raft_consensus.cc:1275] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:06:55.849759 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 79745.3us
W20260709 13:06:55.831708 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 234642us
I20260709 13:06:55.831818 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:06:55.831382 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 248307us
I20260709 13:06:55.793190 19856 raft_consensus.cc:493] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:55.777961 19871 raft_consensus.cc:515] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:55.834486 19855 leader_election.cc:290] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 11 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:55.836230 19852 raft_consensus.cc:2804] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:55.814270 19831 raft_consensus.cc:515] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:55.843003 16352 raft_consensus.cc:2468] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 10.
I20260709 13:06:55.843904 19723 leader_election.cc:290] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:55.846753 19873 raft_consensus.cc:515] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:55.865260 19873 leader_election.cc:290] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:55.849839 16246 leader_election.cc:304] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:55.851637 16320 leader_election.cc:304] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:55.871153 19869 raft_consensus.cc:2804] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:55.832898 19877 raft_consensus.cc:2804] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:55.871611 19869 raft_consensus.cc:493] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:55.871913 19877 raft_consensus.cc:493] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:55.872125 19869 raft_consensus.cc:3060] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:55.872454 19877 raft_consensus.cc:3060] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:55.835801 19850 raft_consensus.cc:2749] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:55.871624 19896 raft_consensus.cc:2804] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:06:55.876480 16246 leader_election.cc:304] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:55.877202 19835 consensus_queue.cc:1059] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:55.877701 19890 raft_consensus.cc:2749] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:55.878036 16246 leader_election.cc:304] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:55.852344 19899 raft_consensus.cc:2804] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:55.879251 19899 raft_consensus.cc:493] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:55.879345 19830 raft_consensus.cc:3055] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:55.879730 19899 raft_consensus.cc:3060] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:55.879768 19830 raft_consensus.cc:740] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:06:55.880752 19830 consensus_queue.cc:260] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:55.882043 19830 raft_consensus.cc:3060] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:55.827586 16103 rpcz_store.cc:276] 0709 13:06:54.610847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.611660 (+   813us) service_pool.cc:224] Handling call
0709 13:06:55.827120 (+1215460us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:54.927616 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:54.928438 (+   822us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:54.928483 (+    45us) write_op.cc:435] Acquired schema lock
0709 13:06:54.928634 (+   151us) tablet.cc:662] Decoding operations
0709 13:06:54.929377 (+   743us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:54.929474 (+    97us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:54.929501 (+    27us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:06:54.930119 (+   618us) tablet.cc:701] Row locks acquired
0709 13:06:54.930157 (+    38us) write_op.cc:260] PREPARE: finished
0709 13:06:54.930383 (+   226us) write_op.cc:270] Start()
0709 13:06:54.930530 (+   147us) write_op.cc:276] Timestamp: P: 1783602414930312 usec, L: 0
0709 13:06:54.930586 (+    56us) op_driver.cc:348] REPLICATION: starting
0709 13:06:54.931416 (+   830us) log.cc:844] Serialized 2090 byte log entry
0709 13:06:55.621613 (+690197us) op_driver.cc:464] REPLICATION: finished
0709 13:06:55.813238 (+191625us) write_op.cc:301] APPLY: starting
0709 13:06:55.813352 (+   114us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:55.813621 (+   269us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:55.813780 (+   159us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:55.814506 (+   726us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:55.814849 (+   343us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 13:06:55.814898 (+    49us) write_op.cc:312] APPLY: finished
0709 13:06:55.815233 (+   335us) log.cc:844] Serialized 47 byte log entry
0709 13:06:55.815425 (+   192us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:55.815557 (+   132us) write_op.cc:454] Released schema lock
0709 13:06:55.815618 (+    61us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:55.816088 (+   470us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:55.816124 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":8,"child_traces":[["op",{"apply.queue_time_us":191333,"apply.run_cpu_time_us":2842,"apply.run_wall_time_us":2847,"num_ops":5,"prepare.queue_time_us":108416,"prepare.run_cpu_time_us":41444,"prepare.run_wall_time_us":380545,"raft.queue_time_us":189908,"raft.run_cpu_time_us":57090,"raft.run_wall_time_us":173747,"replication_time_us":690812,"thread_start_us":710054,"threads_started":4,"wal-append.queue_time_us":475906}]]}
I20260709 13:06:55.854115 16322 leader_election.cc:304] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:55.860505 16248 leader_election.cc:304] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:06:55.884466 19831 leader_election.cc:290] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:55.884723 16322 leader_election.cc:304] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:06:55.886839 16322 leader_election.cc:304] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:06:55.852212 19856 raft_consensus.cc:3060] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:55.888016 19841 raft_consensus.cc:2749] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:55.888721 19841 consensus_queue.cc:1048] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:55.888911 16322 leader_election.cc:304] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:55.890287 16322 leader_election.cc:304] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:06:55.887485 19875 raft_consensus.cc:2749] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:06:55.893622 16249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:55.892375 16322 leader_election.cc:304] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:55.891377 16246 leader_election.cc:304] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:55.900095 16246 leader_election.cc:304] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:55.896427 19894 consensus_queue.cc:1048] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:06:55.905756 16202 raft_consensus.cc:1240] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:55.905877 16203 raft_consensus.cc:1240] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 12. Current term is 13. Ops: []
I20260709 13:06:55.903939 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:55.890513 19841 consensus_queue.cc:1048] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 13:06:55.905819 16206 raft_consensus.cc:1240] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:55.902467 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:55.855688 19852 raft_consensus.cc:493] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:55.908529 19821 raft_consensus.cc:2749] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:55.858144 19860 raft_consensus.cc:2804] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:55.887163 19892 raft_consensus.cc:2804] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:55.894083 19839 raft_consensus.cc:2749] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:55.909723 19875 raft_consensus.cc:2749] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:55.906075 19890 raft_consensus.cc:2804] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:55.891671 19854 raft_consensus.cc:2749] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:55.912029 19894 raft_consensus.cc:2749] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:55.904533 16248 leader_election.cc:304] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
W20260709 13:06:55.915195 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 255279us
I20260709 13:06:55.915647 16246 leader_election.cc:304] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:55.919046 16173 leader_election.cc:304] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:06:55.923243 16199 raft_consensus.cc:1240] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:55.960222 16914 leader_election.cc:304] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:55.945298 16208 raft_consensus.cc:2468] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 8.
I20260709 13:06:55.946885 16206 raft_consensus.cc:1240] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:55.950281 16204 raft_consensus.cc:1240] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 6. Current term is 7. Ops: []
W20260709 13:06:55.964535 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 60058.9us
I20260709 13:06:55.930179 19837 raft_consensus.cc:2749] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:06:55.967196 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 51641.5us
I20260709 13:06:55.969106 16246 leader_election.cc:304] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:55.970877 16248 leader_election.cc:304] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:55.959810 19896 raft_consensus.cc:697] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 9 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:06:55.972862 19820 raft_consensus.cc:2749] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:55.973991 19820 raft_consensus.cc:2749] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:55.959627 16173 leader_election.cc:304] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:06:55.930611 19852 raft_consensus.cc:3060] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:55.981439 16914 leader_election.cc:304] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:55.981974 16248 leader_election.cc:304] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
W20260709 13:06:55.983431 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 91166.4us
I20260709 13:06:55.957424 19890 raft_consensus.cc:493] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:55.973239 19896 consensus_queue.cc:237] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:55.976281 16246 leader_election.cc:304] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:55.954165 16280 raft_consensus.cc:2468] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 9.
I20260709 13:06:55.977308 16173 leader_election.cc:304] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:06:55.941964 19860 raft_consensus.cc:493] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:55.941598 19892 raft_consensus.cc:493] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:55.967527 19849 raft_consensus.cc:2749] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:55.986799 19831 raft_consensus.cc:2749] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:56.009153 19871 leader_election.cc:290] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:56.009580 19860 raft_consensus.cc:3060] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:56.010668 19907 consensus_queue.cc:1059] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:55.967799 19821 raft_consensus.cc:2749] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:55.986486 19890 raft_consensus.cc:3060] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:55.986694 19609 raft_consensus.cc:2749] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:56.021634 16248 leader_election.cc:304] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:56.088104 19874 raft_consensus.cc:2749] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:56.088572 19854 consensus_queue.cc:1059] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
W20260709 13:06:56.089231 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 67819.1us
I20260709 13:06:55.994642 19850 raft_consensus.cc:3060] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:06:56.015185 16247 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:56.019886 16173 leader_election.cc:304] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:56.090413 16248 leader_election.cc:304] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63
W20260709 13:06:56.032691 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 56487.3us
I20260709 13:06:55.996553 19866 raft_consensus.cc:2749] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:56.001315 19820 raft_consensus.cc:2749] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:56.123255 19869 raft_consensus.cc:515] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:56.125480 19869 leader_election.cc:290] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:56.011439 19892 raft_consensus.cc:3060] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:56.126655 19876 raft_consensus.cc:2749] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:56.128893 19877 raft_consensus.cc:515] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:56.011204 19875 consensus_queue.cc:1059] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.110s
I20260709 13:06:56.090166 19862 raft_consensus.cc:993] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e: : Instructing follower e10b16d536674c0bb350a31d7ce5ff7f to start an election
W20260709 13:06:56.075683 19905 log.cc:927] Time spent T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:06:55.994866 19837 raft_consensus.cc:2749] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:06:56.134591 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 149528us
W20260709 13:06:56.144002 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 53705.4us
I20260709 13:06:56.145275 16248 leader_election.cc:304] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:06:56.135449 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 135589us
I20260709 13:06:56.089994 19853 raft_consensus.cc:3055] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:56.131896 19877 leader_election.cc:290] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:06:56.135996 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 124873us
I20260709 13:06:56.000368 19855 raft_consensus.cc:2749] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:06:56.118948 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 99192us
I20260709 13:06:56.154654 16173 leader_election.cc:304] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:56.155750 16201 raft_consensus.cc:1240] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 5. Current term is 6. Ops: []
W20260709 13:06:56.143374 16247 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:56.155596 16248 leader_election.cc:304] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:06:56.147166 16246 leader_election.cc:304] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:56.158298 16173 leader_election.cc:304] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:56.160657 16173 leader_election.cc:304] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:56.165094 16173 leader_election.cc:304] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:56.148178 19853 raft_consensus.cc:740] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:06:56.163998 19877 consensus_queue.cc:1059] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:06:56.167070 16246 leader_election.cc:304] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:56.166046 19873 raft_consensus.cc:2749] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:56.172079 19903 raft_consensus.cc:3055] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:06:56.175249 19841 raft_consensus.cc:3055] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:56.150512 19830 raft_consensus.cc:1081] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 11 LEADER]: Signalling peer e10b16d536674c0bb350a31d7ce5ff7f to start an election
I20260709 13:06:56.166760 19723 raft_consensus.cc:2749] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:56.176625 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:56.179478 19871 raft_consensus.cc:2749] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:56.182318 19835 raft_consensus.cc:493] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:56.177603 19866 consensus_queue.cc:1059] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 13:06:56.157979 19837 raft_consensus.cc:2749] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:56.152288 19869 raft_consensus.cc:2804] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:56.022271 19844 consensus_queue.cc:1059] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.147s
I20260709 13:06:56.186887 16173 leader_election.cc:304] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:56.164448 19609 raft_consensus.cc:2804] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:56.057474 19895 consensus_queue.cc:1059] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.094s
I20260709 13:06:56.187721 19903 raft_consensus.cc:740] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:06:56.185461 19911 raft_consensus.cc:2749] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:56.183856 19853 consensus_queue.cc:260] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:56.166036 19874 raft_consensus.cc:2749] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:56.167080 19876 raft_consensus.cc:2749] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:56.207026 16322 leader_election.cc:304] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:56.209978 16203 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b"
dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
 from {username='slave'} at 127.0.0.1:60154
I20260709 13:06:56.229866 16203 raft_consensus.cc:493] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:56.230400 16203 raft_consensus.cc:3060] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:56.189347 19841 raft_consensus.cc:740] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:06:56.218607 16173 leader_election.cc:304] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:56.219704 19837 consensus_queue.cc:1059] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:06:56.176187 19820 consensus_queue.cc:1059] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:06:56.225843 16202 raft_consensus.cc:1240] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 12. Current term is 13. Ops: []
I20260709 13:06:56.187666 19875 consensus_queue.cc:1059] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:06:56.208173 19869 raft_consensus.cc:493] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:56.257784 19854 raft_consensus.cc:3055] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:56.254479 19850 raft_consensus.cc:2749] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:56.258353 19854 raft_consensus.cc:740] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:06:56.255945 19913 raft_consensus.cc:3055] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:56.259140 19913 raft_consensus.cc:740] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:06:56.259538 19854 consensus_queue.cc:260] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:56.260830 19854 raft_consensus.cc:3060] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:56.260165 19913 consensus_queue.cc:260] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:56.262127 19913 raft_consensus.cc:3060] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:56.248359 16173 leader_election.cc:304] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:56.249888 19853 raft_consensus.cc:3060] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:56.219089 19609 raft_consensus.cc:493] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:56.255453 19856 raft_consensus.cc:515] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:56.256994 19830 raft_consensus.cc:2749] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:56.256994 19869 raft_consensus.cc:3060] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:56.295893 19876 raft_consensus.cc:2749] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:56.296942 16204 raft_consensus.cc:1240] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:56.285676 16203 raft_consensus.cc:515] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:56.264339 19874 raft_consensus.cc:3055] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:56.300304 19874 raft_consensus.cc:740] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:56.264765 19821 raft_consensus.cc:3055] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:56.301359 19821 raft_consensus.cc:740] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:56.301194 19874 consensus_queue.cc:260] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:56.302476 19821 consensus_queue.cc:260] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:56.290235 19856 leader_election.cc:290] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:56.263427 19875 raft_consensus.cc:3055] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:06:56.256532 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 49602.3us
I20260709 13:06:56.303911 19875 raft_consensus.cc:740] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:06:56.304373 16322 leader_election.cc:304] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:56.304811 19875 consensus_queue.cc:260] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:56.305792 19830 raft_consensus.cc:2749] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:56.306141 19875 raft_consensus.cc:3060] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:56.306995 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:56.307719 19830 consensus_queue.cc:1059] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:56.308676 16355 raft_consensus.cc:1275] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:06:56.308802 19830 raft_consensus.cc:3055] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:56.309186 19830 raft_consensus.cc:740] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:06:56.258026 19860 raft_consensus.cc:515] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:56.310356 19830 consensus_queue.cc:260] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:56.311759 19860 leader_election.cc:290] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:56.271473 19852 raft_consensus.cc:515] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:56.312531 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:56.311595 19830 raft_consensus.cc:3060] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:56.313999 19852 leader_election.cc:290] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:06:56.242715 16249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:56.274354 19916 raft_consensus.cc:3055] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:56.321677 19916 raft_consensus.cc:740] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:06:56.276362 19903 consensus_queue.cc:260] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } }
I20260709 13:06:56.208235 19835 raft_consensus.cc:515] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:56.218607 19899 raft_consensus.cc:515] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:56.228075 19872 raft_consensus.cc:2749] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:56.281584 16173 leader_election.cc:304] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:56.286162 19609 raft_consensus.cc:3060] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:56.263382 19841 consensus_queue.cc:260] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:56.305569 19892 raft_consensus.cc:515] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:06:56.342007 16249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:56.316455 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:56.267429 19723 raft_consensus.cc:2749] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:56.318696 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:56.320116 16203 leader_election.cc:290] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:56.320807 16352 raft_consensus.cc:1240] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:56.330049 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:56.332826 16322 leader_election.cc:304] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:56.325804 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:56.345485 16322 leader_election.cc:304] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:06:56.335219 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 148591us
W20260709 13:06:56.337491 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 55988.9us
I20260709 13:06:56.349081 16173 leader_election.cc:304] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:56.349805 16322 leader_election.cc:304] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:56.350867 16246 leader_election.cc:304] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:06:56.337611 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 169973us
I20260709 13:06:56.351315 16173 leader_election.cc:304] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:56.353000 16173 leader_election.cc:304] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:56.355531 16173 leader_election.cc:304] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:56.358840 16173 leader_election.cc:304] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:56.361068 16173 leader_election.cc:304] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:56.363134 16355 raft_consensus.cc:1240] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:56.363569 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:56.322829 19916 consensus_queue.cc:260] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:56.376842 16354 raft_consensus.cc:1240] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:56.371884 16173 leader_election.cc:304] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:56.340200 19860 raft_consensus.cc:493] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:56.342849 19856 raft_consensus.cc:2749] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:06:56.349413 19914 log.cc:927] Time spent T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:06:56.368323 19853 raft_consensus.cc:2749] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:06:56.447078 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 75324.3us
I20260709 13:06:56.459509 16173 leader_election.cc:304] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:56.461125 16355 raft_consensus.cc:1240] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 10. Current term is 11. Ops: []
W20260709 13:06:56.422006 16249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:56.450613 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:56.457526 16351 raft_consensus.cc:2468] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 10.
I20260709 13:06:56.358631 19877 raft_consensus.cc:2749] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:56.336210 19894 consensus_queue.cc:1059] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:06:56.466534 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:56.360594 19871 raft_consensus.cc:2749] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:56.360338 19849 raft_consensus.cc:2749] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:56.348714 19852 raft_consensus.cc:2749] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:06:56.469017 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 101958us
W20260709 13:06:56.476274 16320 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:56.376842 19723 raft_consensus.cc:2749] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:06:56.469403 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 82612.9us
I20260709 13:06:56.360044 19873 raft_consensus.cc:2749] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:56.369122 19897 raft_consensus.cc:2749] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:56.478926 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
W20260709 13:06:56.479616 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 84485.4us
I20260709 13:06:56.479732 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:56.483984 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:56.379308 19831 raft_consensus.cc:2749] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:56.485513 16351 raft_consensus.cc:2468] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 11.
I20260709 13:06:56.447960 19841 raft_consensus.cc:3060] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:56.448323 19911 raft_consensus.cc:2749] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:56.468334 19872 raft_consensus.cc:2749] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:56.360875 19844 consensus_queue.cc:1059] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.115s
I20260709 13:06:56.588709 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
W20260709 13:06:56.590509 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 72313.9us
I20260709 13:06:56.548596 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:56.458624 19855 raft_consensus.cc:2749] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:56.594107 16248 leader_election.cc:304] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:56.595896 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:56.598264 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:56.600334 16282 raft_consensus.cc:3060] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:56.468926 19860 raft_consensus.cc:515] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:56.683844 16173 leader_election.cc:304] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:06:56.674623 16322 leader_election.cc:304] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:06:56.662636 16913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:56.602536 16321 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:56.604681 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:56.612071 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: true dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:56.602217 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:56.702993 16204 raft_consensus.cc:1240] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:56.614290 16203 raft_consensus.cc:1275] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:06:56.481864 19869 raft_consensus.cc:515] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:56.658288 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bc3c8ff9b84838a2664335d7e1582b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:56.698109 16276 raft_consensus.cc:3060] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:56.600999 16246 leader_election.cc:304] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:56.703738 16278 raft_consensus.cc:3060] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:56.607631 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:56.702968 16353 raft_consensus.cc:3055] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:06:56.725145 16353 raft_consensus.cc:740] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:06:56.726341 16282 raft_consensus.cc:2468] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 11.
I20260709 13:06:56.728482 16355 raft_consensus.cc:2468] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 7.
I20260709 13:06:56.709728 16173 leader_election.cc:304] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:56.712014 19897 consensus_queue.cc:1059] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:06:56.713141 19831 raft_consensus.cc:2804] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:56.715008 19844 raft_consensus.cc:3055] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:06:56.659263 19899 leader_election.cc:290] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:56.627908 19873 consensus_queue.cc:1059] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.093s
I20260709 13:06:56.605576 19892 leader_election.cc:290] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 election: Requested vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:56.678223 19609 raft_consensus.cc:515] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:56.623406 19849 consensus_queue.cc:1059] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.095s
I20260709 13:06:56.601738 19853 raft_consensus.cc:493] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
W20260709 13:06:56.719614 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 45129.9us
I20260709 13:06:56.738054 19876 raft_consensus.cc:2804] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:06:56.720641 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c15d8e9be8414c84912ab77b66bfb1" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:56.737988 19852 raft_consensus.cc:2749] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:06:56.691468 16320 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:56.736145 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:56.737564 16249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:56.739534 16199 raft_consensus.cc:1240] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 11. Current term is 12. Ops: []
W20260709 13:06:56.735184 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 141159us
W20260709 13:06:56.676963 19890 consensus_meta.cc:287] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3: Time spent flushing consensus metadata: real 0.543s	user 0.010s	sys 0.000s
I20260709 13:06:56.751853 19929 raft_consensus.cc:2749] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:56.741497 19921 raft_consensus.cc:2749] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:06:56.742410 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 141559us
I20260709 13:06:56.791131 16246 leader_election.cc:304] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:56.756381 16351 raft_consensus.cc:2468] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 7.
I20260709 13:06:56.593638 19919 consensus_queue.cc:1059] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.192s
I20260709 13:06:56.720578 16352 raft_consensus.cc:2468] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 11.
I20260709 13:06:56.733803 19923 raft_consensus.cc:493] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:56.793533 16357 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db"
dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
mode: GRACEFUL
new_leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
 from {username='slave'} at 127.0.0.1:56792
I20260709 13:06:56.794600 16357 raft_consensus.cc:606] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 11 LEADER]: Received request to transfer leadership to TS e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:56.725996 16353 consensus_queue.cc:260] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:56.796259 16353 raft_consensus.cc:3060] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:56.798128 16246 leader_election.cc:304] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:56.741930 19844 raft_consensus.cc:740] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:06:56.785465 16942 raft_consensus.cc:1240] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:56.799466 16246 leader_election.cc:304] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:56.742458 19907 raft_consensus.cc:493] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:56.805445 19930 consensus_queue.cc:1048] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 13:06:56.808970 16246 leader_election.cc:304] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:56.810789 19837 raft_consensus.cc:2749] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:56.820118 16246 leader_election.cc:304] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:56.824998 16246 leader_election.cc:304] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:56.797663 19922 raft_consensus.cc:493] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
W20260709 13:06:56.823385 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 85629.5us
I20260709 13:06:56.798691 19854 raft_consensus.cc:493] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:56.831611 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:06:56.809223 19835 leader_election.cc:290] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:56.741680 19927 consensus_queue.cc:1059] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.077s
I20260709 13:06:56.819496 19821 raft_consensus.cc:3060] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:56.773752 19853 raft_consensus.cc:515] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:56.825095 19929 raft_consensus.cc:2749] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:56.811635 19852 consensus_queue.cc:1059] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:06:56.822204 19856 raft_consensus.cc:3055] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:06:56.843050 16248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:56.843549 16246 leader_election.cc:304] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:56.850857 16246 leader_election.cc:304] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:56.821926 19876 raft_consensus.cc:697] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 11 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:56.801733 19890 raft_consensus.cc:515] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:56.846685 19837 raft_consensus.cc:2749] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:06:56.841727 16278 raft_consensus.cc:2468] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 11.
I20260709 13:06:56.826704 19892 raft_consensus.cc:2749] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:56.841596 16942 raft_consensus.cc:1240] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:56.862675 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c15d8e9be8414c84912ab77b66bfb1" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:56.809377 19923 raft_consensus.cc:515] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:56.800498 19911 consensus_queue.cc:1059] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.038s
I20260709 13:06:56.820415 19896 consensus_queue.cc:1048] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
W20260709 13:06:56.858055 16321 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:56.876575 16353 raft_consensus.cc:2468] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 12.
I20260709 13:06:56.876931 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:56.820894 19907 raft_consensus.cc:515] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:56.865913 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:56.867884 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:56.904021 16322 leader_election.cc:304] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:56.871376 16351 raft_consensus.cc:1240] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:56.872998 16357 raft_consensus.cc:1240] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:56.857885 16106 catalog_manager.cc:5697] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e reported cstate change: term changed from 8 to 9, leader changed from 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) to 363bb2f744eb486f9ad726f08214c98e (127.14.180.67). New cstate: current_term: 9 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:56.886483 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:56.887039 16276 raft_consensus.cc:2468] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 11.
I20260709 13:06:56.889806 19609 leader_election.cc:290] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 election: Requested vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:56.891063 19876 consensus_queue.cc:237] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:56.892381 16275 raft_consensus.cc:1240] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:56.893424 19890 leader_election.cc:290] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:06:56.861297 19830 consensus_meta.cc:287] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 0.547s	user 0.011s	sys 0.002s
I20260709 13:06:56.894526 19860 leader_election.cc:290] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:56.894654 19920 raft_consensus.cc:2749] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:56.896253 19853 leader_election.cc:290] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:06:56.896869 16248 consensus_peers.cc:597] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 -> Peer 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875): Couldn't send request to peer 1109f76a0b7b443a84c0327c8707bc63. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 73757c6fea8949e090aa4e55902a41d4. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:56.899585 19931 log.cc:927] Time spent T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
W20260709 13:06:56.933779 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 80768us
I20260709 13:06:56.887311 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:56.854264 19919 raft_consensus.cc:2749] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:06:56.925110 16247 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:56.837847 19922 raft_consensus.cc:515] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:56.856593 19921 raft_consensus.cc:2749] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:56.842073 19854 raft_consensus.cc:515] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:06:56.948447 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 97669us
I20260709 13:06:56.851702 19856 raft_consensus.cc:740] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:56.949261 16246 leader_election.cc:304] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:56.860523 19899 raft_consensus.cc:2749] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:56.928689 19855 raft_consensus.cc:3055] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:56.940969 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:56.845124 19844 consensus_queue.cc:260] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:06:56.957683 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 103960us
I20260709 13:06:56.932523 16322 leader_election.cc:304] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:56.929780 19839 raft_consensus.cc:2804] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:06:56.957911 16202 raft_consensus.cc:2468] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 8.
I20260709 13:06:56.964453 19854 leader_election.cc:290] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:06:56.971288 16915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:56.973623 16350 raft_consensus.cc:2468] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 7.
I20260709 13:06:56.938377 19831 raft_consensus.cc:697] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 10 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:56.977119 16356 raft_consensus.cc:2468] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 8.
W20260709 13:06:56.976200 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 43776.7us
I20260709 13:06:56.976089 16320 leader_election.cc:304] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:56.951399 19869 leader_election.cc:290] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 election: Requested vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:56.980057 16322 leader_election.cc:304] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:56.954653 19855 raft_consensus.cc:740] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:56.985924 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c15d8e9be8414c84912ab77b66bfb1" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:56.983737 16173 leader_election.cc:304] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:56.986878 16276 raft_consensus.cc:2393] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 8: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:06:56.981631 19830 raft_consensus.cc:2804] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:06:56.988006 19830 raft_consensus.cc:697] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 11 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:06:56.989737 19907 leader_election.cc:290] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:56.993866 16173 leader_election.cc:304] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:56.989394 19830 consensus_queue.cc:237] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:56.994499 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:57.000280 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:56.999454 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:57.001363 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:57.001876 16278 raft_consensus.cc:2393] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 8: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:06:57.010162 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:57.004483 16173 leader_election.cc:304] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:56.982611 19839 raft_consensus.cc:697] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 11 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:06:56.993162 19844 raft_consensus.cc:3060] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:56.992883 19875 raft_consensus.cc:2804] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:06:57.027933 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:56.995291 19896 raft_consensus.cc:2804] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:57.034538 16351 raft_consensus.cc:1240] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:57.019886 19854 raft_consensus.cc:493] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:57.039022 19841 raft_consensus.cc:493] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:57.038887 19831 consensus_queue.cc:237] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:57.039742 19841 raft_consensus.cc:515] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:57.044353 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:57.023685 19871 raft_consensus.cc:2804] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:06:56.997839 19856 consensus_queue.cc:260] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:57.049762 19937 raft_consensus.cc:2804] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:57.038928 19854 raft_consensus.cc:515] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:57.049497 16322 leader_election.cc:304] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:57.050913 19841 leader_election.cc:290] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:57.031195 19896 raft_consensus.cc:493] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:57.058794 19903 raft_consensus.cc:3060] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:06:57.061280 19938 log.cc:927] Time spent T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 13:06:57.073823 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:57.081096 16204 raft_consensus.cc:2468] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 11.
W20260709 13:06:57.051267 19913 consensus_meta.cc:287] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 0.782s	user 0.013s	sys 0.000s
I20260709 13:06:57.042972 19849 raft_consensus.cc:2804] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:57.084182 19839 consensus_queue.cc:237] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:57.088848 19923 leader_election.cc:290] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:57.089286 19854 leader_election.cc:290] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:57.045455 19875 raft_consensus.cc:697] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 11 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
W20260709 13:06:57.090791 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:57.091682 19875 consensus_queue.cc:237] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:57.091881 16320 leader_election.cc:304] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:57.092763 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:57.090821 19922 leader_election.cc:290] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:57.095216 19922 raft_consensus.cc:2804] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:57.095592 19922 raft_consensus.cc:493] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:57.096005 19922 raft_consensus.cc:3060] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:57.097898 19937 raft_consensus.cc:697] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [term 7 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:57.098959 19937 consensus_queue.cc:237] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:57.099684 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:57.100291 16206 raft_consensus.cc:2468] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 11.
I20260709 13:06:57.076474 19871 raft_consensus.cc:697] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 11 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:57.102775 19849 raft_consensus.cc:697] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:57.103142 19871 consensus_queue.cc:237] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:57.104552 19849 consensus_queue.cc:237] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:57.108990 19916 raft_consensus.cc:3060] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:57.078267 19896 raft_consensus.cc:3060] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:57.076983 16322 leader_election.cc:304] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:06:57.116212 19853 raft_consensus.cc:2749] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:57.080478 19907 raft_consensus.cc:3060] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:57.117836 16357 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1"
dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
mode: GRACEFUL
new_leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
 from {username='slave'} at 127.0.0.1:56792
I20260709 13:06:57.118494 16357 raft_consensus.cc:606] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 7 LEADER]: Received request to transfer leadership to TS e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:06:57.120909 16321 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:57.120711 19866 raft_consensus.cc:3055] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:06:57.121595 19866 raft_consensus.cc:740] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:06:57.123441 19856 raft_consensus.cc:3060] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:57.124552 19915 raft_consensus.cc:3055] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:06:57.125753 19917 consensus_queue.cc:1059] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:06:57.140378 16322 leader_election.cc:304] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:06:57.141006 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:57.142638 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:57.142938 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:57.144266 19874 raft_consensus.cc:3060] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:57.145246 19897 raft_consensus.cc:3055] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:57.147511 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:57.148573 19911 raft_consensus.cc:3055] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:57.154397 16320 leader_election.cc:304] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:57.168677 16349 raft_consensus.cc:2468] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 6.
I20260709 13:06:57.175832 16943 raft_consensus.cc:2468] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 7.
I20260709 13:06:57.201445 16322 leader_election.cc:304] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:57.192147 19911 raft_consensus.cc:740] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:57.205415 19852 raft_consensus.cc:2804] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:57.208303 19852 raft_consensus.cc:493] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:57.208735 19852 raft_consensus.cc:3060] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:57.171643 19915 raft_consensus.cc:740] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:06:57.173842 19920 raft_consensus.cc:2749] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:57.215113 16322 leader_election.cc:304] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:06:57.191161 19854 raft_consensus.cc:2749] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:57.190259 19897 raft_consensus.cc:740] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:57.220314 19877 raft_consensus.cc:2749] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:57.238937 19897 consensus_queue.cc:260] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:57.240463 19897 raft_consensus.cc:3060] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:57.245505 19896 raft_consensus.cc:515] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:57.225194 19841 raft_consensus.cc:2804] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:57.249982 19841 raft_consensus.cc:493] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:57.251320 19841 raft_consensus.cc:3060] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:57.235188 19911 consensus_queue.cc:260] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:57.254752 19915 consensus_queue.cc:260] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:57.255436 19911 raft_consensus.cc:3060] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:57.256201 19915 raft_consensus.cc:3060] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:57.222424 19894 consensus_queue.cc:1059] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 13:06:57.259548 19894 raft_consensus.cc:3055] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:57.260000 19894 raft_consensus.cc:740] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:06:57.260977 19894 consensus_queue.cc:260] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:57.261804 19896 leader_election.cc:290] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:57.262509 19894 raft_consensus.cc:3060] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:57.330240 19951 log.cc:927] Time spent T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
W20260709 13:06:57.366394 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 361686us
I20260709 13:06:57.369185 16173 leader_election.cc:304] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:57.372756 16173 leader_election.cc:304] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:57.374840 16173 leader_election.cc:304] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:57.159242 16199 raft_consensus.cc:1240] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:57.142078 16200 raft_consensus.cc:2468] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 7.
W20260709 13:06:57.149302 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 212612us
I20260709 13:06:57.398876 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:57.400686 16283 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45210 (request call id 2002) took 1062 ms. Trace:
W20260709 13:06:57.150674 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 201455us
I20260709 13:06:57.404500 16246 leader_election.cc:304] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:57.408396 16246 leader_election.cc:304] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:06:57.421741 16322 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:57.410737 16247 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:57.401433 16283 rpcz_store.cc:276] 0709 13:06:56.337844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.338015 (+   171us) service_pool.cc:224] Handling call
0709 13:06:56.338368 (+   353us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:56.338808 (+   440us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:56.338844 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:56.339349 (+   505us) log.cc:844] Serialized 26 byte log entry
0709 13:06:56.594712 (+255363us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:57.024703 (+429991us) log.cc:844] Serialized 14 byte log entry
0709 13:06:57.399898 (+375195us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:57.400075 (+   177us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:57.400173 (+    98us) raft_consensus.cc:1685] finished
0709 13:06:57.400191 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:57.400428 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":400240,"prepare.queue_time_us":117578,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":25,"raft.queue_time_us":1045,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":17897,"thread_start_us":667745,"threads_started":2,"wal-append.queue_time_us":332815}
W20260709 13:06:57.427980 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:57.434674 16280 raft_consensus.cc:1240] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:57.435289 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:57.437891 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:57.439406 16280 raft_consensus.cc:2393] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 8: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:06:57.441969 16246 leader_election.cc:304] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:57.456732 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:57.485968 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:06:57.500442 19856 raft_consensus.cc:2804] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:57.497910 19821 raft_consensus.cc:2749] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:06:57.500496 19831 raft_consensus.cc:2804] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:57.502312 19821 raft_consensus.cc:2749] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:57.502367 19831 raft_consensus.cc:697] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:57.505273 19831 consensus_queue.cc:237] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:57.501405 19856 raft_consensus.cc:697] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [term 7 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:57.517000 19856 consensus_queue.cc:237] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:57.517880 19869 consensus_queue.cc:1059] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:57.501446 19609 raft_consensus.cc:2749] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:57.279178 19866 consensus_queue.cc:260] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:57.520962 19821 raft_consensus.cc:3055] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:57.521667 19821 raft_consensus.cc:740] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:57.515188 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:06:57.523346 19821 consensus_queue.cc:260] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:57.502038 19855 consensus_queue.cc:260] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:57.498154 19849 raft_consensus.cc:2804] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:06:57.554091 16202 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.507s	user 0.017s	sys 0.016s
I20260709 13:06:57.556816 16204 raft_consensus.cc:2468] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 8.
I20260709 13:06:57.568703 16246 leader_election.cc:304] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:06:57.565274 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 140214us
I20260709 13:06:57.583702 19855 raft_consensus.cc:3060] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:57.315790 19907 raft_consensus.cc:2749] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:57.598819 19849 raft_consensus.cc:697] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 12 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:57.600133 19955 raft_consensus.cc:2749] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:57.600543 19849 consensus_queue.cc:237] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:57.276721 19922 raft_consensus.cc:515] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:57.615723 16276 raft_consensus.cc:1275] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:06:57.617344 19922 leader_election.cc:290] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 12 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:06:57.617762 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:57.637291 19874 consensus_queue.cc:1059] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 13:06:57.639285 19874 raft_consensus.cc:3055] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:57.640091 19874 raft_consensus.cc:740] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:57.642128 19874 consensus_queue.cc:260] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:57.643903 19874 raft_consensus.cc:3060] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:57.643990 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 188274us
I20260709 13:06:57.645331 16246 leader_election.cc:304] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:57.649783 19932 raft_consensus.cc:493] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:57.651232 19932 raft_consensus.cc:515] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:57.647570 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:57.666275 16320 leader_election.cc:304] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:57.653950 19955 raft_consensus.cc:2749] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:06:57.672138 19932 leader_election.cc:290] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:57.678712 16206 raft_consensus.cc:3060] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:57.681599 19906 consensus_queue.cc:1059] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:57.683426 19906 raft_consensus.cc:3055] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:06:57.684027 16351 raft_consensus.cc:1240] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:57.684175 19906 raft_consensus.cc:740] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
W20260709 13:06:57.687160 16174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:57.687772 16357 raft_consensus.cc:1240] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 11 LEADER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:57.685892 19906 consensus_queue.cc:260] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:57.693934 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:57.699294 16246 leader_election.cc:304] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:57.704186 19920 consensus_queue.cc:1048] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:06:57.707086 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:57.709956 16280 raft_consensus.cc:2393] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 9: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
I20260709 13:06:57.711496 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:57.716871 19932 raft_consensus.cc:2749] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:06:57.725088 16321 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:57.727736 19852 consensus_meta.cc:287] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 0.505s	user 0.013s	sys 0.009s
I20260709 13:06:57.728605 19852 raft_consensus.cc:515] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:57.732611 19852 leader_election.cc:290] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 12 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:57.734158 16353 raft_consensus.cc:1275] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:06:57.734820 16351 raft_consensus.cc:1275] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:06:57.736384 16357 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a"
dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
mode: GRACEFUL
new_leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
 from {username='slave'} at 127.0.0.1:56792
I20260709 13:06:57.737627 16356 raft_consensus.cc:1275] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:06:57.738238 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 105581us
I20260709 13:06:57.738454 16348 raft_consensus.cc:1275] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:06:57.744619 19906 raft_consensus.cc:3060] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:57.743122 19821 raft_consensus.cc:3060] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:57.740005 19941 raft_consensus.cc:2804] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:57.737632 16248 leader_election.cc:304] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:57.745285 16207 raft_consensus.cc:1275] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:06:57.745438 16280 raft_consensus.cc:1240] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:57.742262 19841 raft_consensus.cc:515] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:57.755405 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:57.757575 16275 raft_consensus.cc:1240] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:57.761103 16357 raft_consensus.cc:606] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 6 LEADER]: Received request to transfer leadership to TS 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:06:57.787457 16274 raft_consensus.cc:1240] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:57.785336 16206 raft_consensus.cc:2468] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 12.
I20260709 13:06:57.785566 16283 raft_consensus.cc:2468] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 8.
W20260709 13:06:57.799633 16249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:57.800020 19911 raft_consensus.cc:2749] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:06:57.781613 19941 raft_consensus.cc:697] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 8 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:06:57.801012 16279 raft_consensus.cc:1240] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:57.801959 19841 leader_election.cc:290] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:57.801666 19941 consensus_queue.cc:237] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:57.806505 19855 raft_consensus.cc:493] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:57.807873 19855 raft_consensus.cc:515] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:06:57.810684 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 162375us
W20260709 13:06:57.814579 19915 consensus_meta.cc:287] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 0.558s	user 0.010s	sys 0.008s
I20260709 13:06:57.815351 19855 leader_election.cc:290] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:06:57.816087 19903 consensus_meta.cc:287] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 0.689s	user 0.010s	sys 0.007s
I20260709 13:06:57.819653 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:57.829914 16944 raft_consensus.cc:1275] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:06:57.830334 16320 leader_election.cc:304] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:57.848896 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:57.850108 16279 raft_consensus.cc:3060] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:06:57.850780 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:57.860893 19894 consensus_meta.cc:287] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 0.519s	user 0.012s	sys 0.003s
W20260709 13:06:57.864252 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 47269.6us
I20260709 13:06:57.868047 19822 raft_consensus.cc:493] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.868811 19822 raft_consensus.cc:515] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:57.871505 19866 raft_consensus.cc:3060] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:57.873499 16274 raft_consensus.cc:1240] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:57.877033 16349 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41832 (request call id 1915) took 1279 ms. Trace:
I20260709 13:06:57.877665 16349 rpcz_store.cc:276] 0709 13:06:56.597850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.597992 (+   142us) service_pool.cc:224] Handling call
0709 13:06:57.876577 (+1278585us) spinlock_profiling.cc:243] Waited 386 ms on lock 0x7b54003093d4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:06:57.876802 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":888270720}
I20260709 13:06:57.874729 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
W20260709 13:06:57.875373 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 45193.6us
I20260709 13:06:57.899935 16320 leader_election.cc:304] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:57.900460 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:57.901731 16275 raft_consensus.cc:2393] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 9: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
I20260709 13:06:57.901770 19903 raft_consensus.cc:2804] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:06:57.902949 19903 raft_consensus.cc:697] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 12 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:06:57.904417 19903 consensus_queue.cc:237] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:57.837610 19831 consensus_queue.cc:1048] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.068s
W20260709 13:06:57.907143 16174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:57.907003 19896 consensus_queue.cc:1048] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:06:57.912366 16202 raft_consensus.cc:1275] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:06:57.879760 19894 raft_consensus.cc:2804] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:57.880743 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:57.915155 16280 raft_consensus.cc:3060] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:57.882419 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:57.916975 16202 raft_consensus.cc:1275] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:06:57.917131 16274 raft_consensus.cc:3060] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:57.882984 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:57.923585 19850 raft_consensus.cc:493] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:57.923997 16277 raft_consensus.cc:2393] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 6: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:06:57.924340 19850 raft_consensus.cc:515] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:57.925045 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: true dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:57.883708 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:06:57.925696 16247 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:57.926136 16207 raft_consensus.cc:2468] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 5.
I20260709 13:06:57.925731 16277 raft_consensus.cc:3060] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:57.884817 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:57.927307 16278 raft_consensus.cc:3060] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:57.885111 19822 leader_election.cc:290] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:57.928929 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:57.930274 16207 raft_consensus.cc:2468] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 8.
W20260709 13:06:57.932014 16249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:57.887207 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:57.894137 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:57.873744 19862 raft_consensus.cc:993] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e: : Instructing follower e10b16d536674c0bb350a31d7ce5ff7f to start an election
I20260709 13:06:57.934443 19862 raft_consensus.cc:1081] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 7 LEADER]: Signalling peer e10b16d536674c0bb350a31d7ce5ff7f to start an election
I20260709 13:06:57.930420 19894 raft_consensus.cc:493] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:57.937803 19894 raft_consensus.cc:3060] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:57.955543 19897 raft_consensus.cc:493] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
W20260709 13:06:57.956046 16321 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:57.956269 19897 raft_consensus.cc:515] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:57.960487 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:57.961566 19932 raft_consensus.cc:493] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:57.962347 19932 raft_consensus.cc:515] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:57.964998 16276 raft_consensus.cc:1275] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:06:57.965212 19850 leader_election.cc:290] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:57.965540 19932 leader_election.cc:290] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:57.967483 19897 leader_election.cc:290] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:57.968936 16282 raft_consensus.cc:1275] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:06:57.895903 16248 leader_election.cc:304] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:57.928145 16912 leader_election.cc:304] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:57.886175 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bc3c8ff9b84838a2664335d7e1582b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:57.985185 16281 raft_consensus.cc:3060] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:57.985469 19850 raft_consensus.cc:2804] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:57.985574 16277 raft_consensus.cc:2468] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 12.
I20260709 13:06:57.986191 19850 raft_consensus.cc:493] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:57.986791 19850 raft_consensus.cc:3060] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:06:57.985209 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 57271.7us
I20260709 13:06:57.990347 16912 leader_election.cc:304] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:57.992578 19822 raft_consensus.cc:2804] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:57.993021 19822 raft_consensus.cc:493] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:57.993371 19822 raft_consensus.cc:3060] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:06:58.000130 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:58.010918 19896 raft_consensus.cc:493] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.011741 19896 raft_consensus.cc:515] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:58.012226 16281 raft_consensus.cc:2468] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 7.
I20260709 13:06:58.014369 19822 raft_consensus.cc:515] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:06:58.015255 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 119531us
I20260709 13:06:58.016213 16248 leader_election.cc:304] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:58.017834 19869 raft_consensus.cc:2749] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:58.016844 19932 raft_consensus.cc:2749] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:06:58.022161 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:58.024505 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:58.025391 16201 raft_consensus.cc:3060] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:58.028235 16354 raft_consensus.cc:2468] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 13.
I20260709 13:06:58.031201 16354 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41832 (request call id 1911) took 1553 ms. Trace:
I20260709 13:06:58.014261 19896 leader_election.cc:290] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:58.045944 16279 raft_consensus.cc:2468] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 11.
I20260709 13:06:58.046588 16354 rpcz_store.cc:276] 0709 13:06:56.478298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.478497 (+   199us) service_pool.cc:224] Handling call
0709 13:06:58.031007 (+1552510us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b5400194454. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:06:58.031150 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2801465088}
I20260709 13:06:58.049446 16201 raft_consensus.cc:2468] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 9.
I20260709 13:06:58.052942 16275 raft_consensus.cc:1275] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:06:58.055127 16274 raft_consensus.cc:2468] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 11.
I20260709 13:06:58.064857 16278 raft_consensus.cc:2468] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 7.
I20260709 13:06:58.061699 16912 leader_election.cc:304] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:58.056748 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:58.069576 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:58.047168 19869 raft_consensus.cc:493] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:58.084621 16201 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1"
dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
 from {username='slave'} at 127.0.0.1:60154
I20260709 13:06:58.085466 16201 raft_consensus.cc:493] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:58.085898 16201 raft_consensus.cc:3060] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:58.087078 19869 raft_consensus.cc:515] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:58.089440 19869 leader_election.cc:290] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:58.073559 19932 raft_consensus.cc:493] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.090729 19932 raft_consensus.cc:515] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:58.091703 19917 raft_consensus.cc:2804] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:06:58.062661 19821 raft_consensus.cc:493] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:58.092355 19941 consensus_queue.cc:1048] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:58.092905 19821 raft_consensus.cc:515] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:58.093448 19932 leader_election.cc:290] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:58.095427 19821 leader_election.cc:290] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:58.091387 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:58.097329 16205 raft_consensus.cc:2468] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 5.
I20260709 13:06:58.098831 19850 raft_consensus.cc:515] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:58.100453 19822 leader_election.cc:290] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 9 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:58.101087 16106 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38842 (request call id 217) took 1633 ms. Trace:
I20260709 13:06:58.103458 19966 ts_tablet_manager.cc:933] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63: Initiating tablet copy from peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:58.103510 16201 raft_consensus.cc:515] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:58.109381 19917 raft_consensus.cc:697] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 9 LEADER]: Becoming Leader. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:06:58.111063 19917 consensus_queue.cc:237] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:58.112923 19821 raft_consensus.cc:493] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:58.113629 19821 raft_consensus.cc:515] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:58.121452 16202 raft_consensus.cc:3060] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:58.101513 16106 rpcz_store.cc:276] 0709 13:06:56.467105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.467299 (+   194us) service_pool.cc:224] Handling call
0709 13:06:58.100839 (+1633540us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:57.037790 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:57.212061 (+174271us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:57.212848 (+   787us) write_op.cc:435] Acquired schema lock
0709 13:06:57.217243 (+  4395us) tablet.cc:662] Decoding operations
0709 13:06:57.250924 (+ 33681us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:57.251015 (+    91us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:57.251057 (+    42us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:06:57.251278 (+   221us) tablet.cc:701] Row locks acquired
0709 13:06:57.251297 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:06:57.251453 (+   156us) write_op.cc:270] Start()
0709 13:06:57.251563 (+   110us) write_op.cc:276] Timestamp: P: 1783602417251404 usec, L: 0
0709 13:06:57.251584 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:06:57.252369 (+   785us) log.cc:844] Serialized 541 byte log entry
0709 13:06:57.676438 (+424069us) spinlock_profiling.cc:243] Waited 246 ms on lock 0x7b1800181d20. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f3625264de1 00007f36252715b1 00007f361c39c3f3 00007f361c39e7c1 00007f361c39e779 00007f361c39e709 00007f361c39e6d1 00007f361c39d9cd 000000000038f354 000000000038f199 00007f361c37f83a
0709 13:06:57.676994 (+   556us) op_driver.cc:464] REPLICATION: finished
0709 13:06:57.681275 (+  4281us) spinlock_profiling.cc:243] Waited 2.05 ms on lock 0x7b1800181d20. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f3625264de1 00007f36252715b1 00007f361c36a2a6 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f3625264de1 00007f36252715b1 00007f361c39c557 00007f361c39e7c1
0709 13:06:57.682089 (+   814us) spinlock_profiling.cc:243] Waited 2.98 ms on lock 0x7b1800181d20. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f3625264de1 00007f36252715b1 00007f361c39c557 00007f361c39e7c1 00007f361c39e779 00007f361c39e709 00007f361c39e6d1 00007f361c39d9cd 000000000038f354 000000000038f199 00007f361c37f83a
0709 13:06:58.085410 (+403321us) write_op.cc:301] APPLY: starting
0709 13:06:58.085539 (+   129us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:58.085686 (+   147us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:58.085729 (+    43us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:58.086118 (+   389us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:58.086442 (+   324us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:06:58.086504 (+    62us) write_op.cc:312] APPLY: finished
0709 13:06:58.094517 (+  8013us) log.cc:844] Serialized 23 byte log entry
0709 13:06:58.098305 (+  3788us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:58.098575 (+   270us) write_op.cc:454] Released schema lock
0709 13:06:58.098670 (+    95us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":385959,"apply.run_cpu_time_us":2906,"apply.run_wall_time_us":18076,"num_ops":1,"prepare.queue_time_us":125698,"prepare.run_cpu_time_us":32339,"prepare.run_wall_time_us":299085,"raft.queue_time_us":1268,"raft.run_cpu_time_us":26971,"raft.run_wall_time_us":156079,"replication_time_us":425152,"spinlock_wait_cycles":578136960,"thread_start_us":336155,"threads_started":4,"wal-append.queue_time_us":81386}]]}
I20260709 13:06:58.128123 16274 raft_consensus.cc:1275] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:06:58.133322 19821 leader_election.cc:290] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:58.135234 19948 consensus_queue.cc:1059] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:58.137756 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:58.101352 19850 leader_election.cc:290] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 7 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:58.118850 19932 raft_consensus.cc:493] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:58.139256 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:58.139336 19932 raft_consensus.cc:515] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:58.140256 16943 raft_consensus.cc:2393] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 12: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
I20260709 13:06:58.141078 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:58.141772 16278 raft_consensus.cc:2376] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 11. Re-sending same reply.
I20260709 13:06:58.143251 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:58.144014 16204 raft_consensus.cc:3060] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:06:58.144691 16283 raft_consensus.cc:1275] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:06:58.144905 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:58.145964 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:58.146247 16277 raft_consensus.cc:2410] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:06:58.146736 16283 raft_consensus.cc:2468] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 6.
I20260709 13:06:58.147467 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:58.148396 16277 raft_consensus.cc:2376] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 11. Re-sending same reply.
I20260709 13:06:58.152141 16277 raft_consensus.cc:1275] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:06:58.153407 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:58.154847 16281 raft_consensus.cc:2468] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 5.
I20260709 13:06:58.155421 16278 raft_consensus.cc:1275] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:06:58.152944 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:58.156270 16943 raft_consensus.cc:2468] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 9.
I20260709 13:06:58.148836 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: true dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:58.149205 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:58.157279 16282 raft_consensus.cc:2376] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 8. Re-sending same reply.
I20260709 13:06:58.150182 16276 raft_consensus.cc:3060] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:58.159479 15057 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:06:58.159122 16283 raft_consensus.cc:3060] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:58.160867 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f022e2e63ae4461d834e476ff2666991" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:58.163091 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:58.163414 16248 leader_election.cc:304] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:06:58.168018 19821 raft_consensus.cc:2804] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:58.168578 19821 raft_consensus.cc:493] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:58.169024 19821 raft_consensus.cc:3060] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:58.169921 19897 consensus_queue.cc:1048] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:06:58.171330 19849 consensus_queue.cc:1048] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:06:58.172363 19948 raft_consensus.cc:3055] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:58.174374 16201 leader_election.cc:290] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:58.166988 16280 raft_consensus.cc:2468] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 7.
I20260709 13:06:58.172851 19948 raft_consensus.cc:740] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:58.176220 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:58.177109 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:06:58.176906 19869 raft_consensus.cc:2955] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 LEADER]: Committing config change with OpId 7.5: config changed from index -1 to 5, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:06:58.202039 19852 consensus_queue.cc:1048] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:06:58.062057 19862 consensus_queue.cc:1048] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.104s
I20260709 13:06:58.201282 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:58.199803 16279 raft_consensus.cc:1275] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:06:58.188395 16320 leader_election.cc:304] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:58.209527 16353 raft_consensus.cc:2468] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 12.
I20260709 13:06:58.166715 19932 leader_election.cc:290] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:58.213351 16349 raft_consensus.cc:1240] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:58.223987 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:58.187336 19855 consensus_queue.cc:1048] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 13:06:58.226423 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:58.227398 16350 raft_consensus.cc:2468] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 12.
I20260709 13:06:58.213565 19841 consensus_queue.cc:1048] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 13:06:58.237826 16202 raft_consensus.cc:2468] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 12.
I20260709 13:06:58.239777 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:58.249817 16276 raft_consensus.cc:1275] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:06:58.260658 16943 raft_consensus.cc:3060] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:06:58.263247 16174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:58.236919 19852 raft_consensus.cc:2804] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:58.213299 19897 consensus_queue.cc:1048] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:06:58.286948 16348 raft_consensus.cc:2393] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 8: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:06:58.287911 19907 consensus_queue.cc:1048] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 13:06:58.190333 19894 raft_consensus.cc:515] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:06:58.296680 19894 leader_election.cc:290] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:06:58.297469 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 167061us
I20260709 13:06:58.300879 19966 tablet_copy_client.cc:323] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Beginning tablet copy session from remote peer at address 127.14.180.66:45823
I20260709 13:06:58.304474 16202 raft_consensus.cc:1240] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:58.307122 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:58.306465 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:58.308118 16201 raft_consensus.cc:2393] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 6: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:06:58.310480 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:58.312649 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:58.234055 19948 consensus_queue.cc:260] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:58.314155 19948 raft_consensus.cc:3060] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:06:58.319772 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 44805.5us
I20260709 13:06:58.302405 16352 raft_consensus.cc:1240] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:58.327293 16354 raft_consensus.cc:2468] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 6.
I20260709 13:06:58.326933 15057 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:58.275324 19852 raft_consensus.cc:493] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:58.347213 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:58.356563 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f022e2e63ae4461d834e476ff2666991" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:58.357364 16207 raft_consensus.cc:2468] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 9.
I20260709 13:06:58.346117 16204 raft_consensus.cc:2468] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 7.
I20260709 13:06:58.364820 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:58.343321 19822 raft_consensus.cc:493] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:58.368665 16206 raft_consensus.cc:2393] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 12: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:06:58.368665 16103 catalog_manager.cc:5697] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f reported cstate change: term changed from 7 to 8, leader changed from 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) to e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65). New cstate: current_term: 8 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:58.369971 19822 raft_consensus.cc:515] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:58.371521 19874 raft_consensus.cc:493] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:58.372251 19874 raft_consensus.cc:515] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:58.371378 16103 catalog_manager.cc:5697] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f reported cstate change: term changed from 9 to 10, leader changed from 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) to e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65). New cstate: current_term: 10 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:58.372844 19822 leader_election.cc:290] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:58.356523 19854 raft_consensus.cc:493] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.374042 16103 catalog_manager.cc:5697] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f reported cstate change: term changed from 10 to 11, leader changed from 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) to e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65). New cstate: current_term: 11 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:58.374866 19854 raft_consensus.cc:515] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:58.376057 19874 leader_election.cc:290] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:58.369179 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:58.375975 16103 catalog_manager.cc:5697] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f reported cstate change: term changed from 6 to 7, leader changed from 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) to e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65). New cstate: current_term: 7 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:58.377027 19854 leader_election.cc:290] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:58.377912 16103 catalog_manager.cc:5697] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f reported cstate change: term changed from 6 to 7, leader changed from 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) to e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65). New cstate: current_term: 7 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:58.380231 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:58.349759 19852 raft_consensus.cc:3060] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:58.406942 16103 catalog_manager.cc:5697] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f reported cstate change: term changed from 6 to 7, leader changed from 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) to e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65). New cstate: current_term: 7 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:58.412614 16912 leader_election.cc:304] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:58.418401 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:58.420135 16103 catalog_manager.cc:5697] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f reported cstate change: term changed from 10 to 11, leader changed from 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) to e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65). New cstate: current_term: 11 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:58.427343 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 217267us
I20260709 13:06:58.415726 19874 raft_consensus.cc:493] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.435998 16103 catalog_manager.cc:5697] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f reported cstate change: term changed from 11 to 12, leader changed from 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) to e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65). New cstate: current_term: 12 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:58.423606 19917 raft_consensus.cc:2804] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:06:58.440974 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 232969us
I20260709 13:06:58.442447 16320 leader_election.cc:304] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:58.443459 16283 raft_consensus.cc:2468] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 8.
W20260709 13:06:58.448701 16247 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:58.455197 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:06:58.462662 16174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:58.466524 19841 raft_consensus.cc:493] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.467250 19841 raft_consensus.cc:515] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:58.469974 19841 leader_election.cc:290] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:06:58.470651 19952 log.cc:927] Time spent T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:06:58.470846 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:58.472841 19896 raft_consensus.cc:993] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e: : Instructing follower 0aea40d6e4374085a2e38a70a71f63e3 to start an election
W20260709 13:06:58.475608 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:58.450891 19917 raft_consensus.cc:697] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 LEADER]: Becoming Leader. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
W20260709 13:06:58.494863 16249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:58.456732 19941 raft_consensus.cc:2804] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:06:58.512848 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 60512.7us
I20260709 13:06:58.523445 16348 raft_consensus.cc:1275] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:06:58.524241 19970 log.cc:927] Time spent T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 13:06:58.523445 16354 raft_consensus.cc:1275] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:06:58.525756 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:58.526743 16352 raft_consensus.cc:2393] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 5: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:06:58.526767 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:58.456336 19874 raft_consensus.cc:515] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:58.464181 19831 consensus_queue.cc:1059] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 13:06:58.504596 19841 raft_consensus.cc:1081] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 6 LEADER]: Signalling peer 0aea40d6e4374085a2e38a70a71f63e3 to start an election
I20260709 13:06:58.519378 19941 raft_consensus.cc:697] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 12 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
W20260709 13:06:58.536119 19967 log.cc:927] Time spent T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
I20260709 13:06:58.546139 16348 raft_consensus.cc:1275] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:06:58.512632 19907 raft_consensus.cc:493] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.515300 19821 raft_consensus.cc:515] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:58.527761 19894 consensus_queue.cc:1048] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 13:06:58.543849 19831 raft_consensus.cc:3055] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:58.587934 19932 raft_consensus.cc:493] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:06:58.589184 19932 raft_consensus.cc:515] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:06:58.590588 16914 leader_election.cc:336] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Timed out: RequestConsensusVote RPC to 127.14.180.66:45823 timed out after 1.546s (SENT)
I20260709 13:06:58.591187 16352 raft_consensus.cc:1275] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:06:58.591198 16914 leader_election.cc:304] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:58.593152 19848 raft_consensus.cc:2749] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:06:58.596035 19821 leader_election.cc:290] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:58.599148 16200 raft_consensus.cc:1275] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:06:58.600195 16173 leader_election.cc:304] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:06:58.600069 19907 raft_consensus.cc:515] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:06:58.603063 19981 log.cc:927] Time spent T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:06:58.584606 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: true dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:58.605451 16348 raft_consensus.cc:3055] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:58.605765 16348 raft_consensus.cc:740] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:06:58.616273 19869 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:42736 (request call id 4) took 3401 ms. Trace:
I20260709 13:06:58.616465 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:58.607053 19849 raft_consensus.cc:2749] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:06:58.604928 19831 raft_consensus.cc:740] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:58.659078 16207 raft_consensus.cc:1240] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:58.670223 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:58.673154 16276 raft_consensus.cc:3060] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:58.673574 16279 raft_consensus.cc:1240] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:58.674108 19856 raft_consensus.cc:493] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:58.674683 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:58.674777 19856 raft_consensus.cc:515] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:58.677322 19856 leader_election.cc:290] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:58.677558 19874 leader_election.cc:290] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:58.671469 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:58.678085 19941 consensus_queue.cc:237] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:58.679035 16282 raft_consensus.cc:2468] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 6.
I20260709 13:06:58.647919 19855 raft_consensus.cc:493] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:58.679888 19855 raft_consensus.cc:515] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:58.670948 16280 raft_consensus.cc:1240] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:58.665432 16348 consensus_queue.cc:260] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:58.682124 16348 raft_consensus.cc:3060] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:58.684998 16276 raft_consensus.cc:2468] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 12.
I20260709 13:06:58.612457 19862 consensus_queue.cc:1048] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 13:06:58.612767 19907 leader_election.cc:290] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:58.689874 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:58.696342 16277 raft_consensus.cc:2468] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 8.
I20260709 13:06:58.701692 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:58.617218 19917 consensus_queue.cc:237] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:58.708735 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:58.708988 16278 raft_consensus.cc:1240] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:58.709503 16283 raft_consensus.cc:3060] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:58.714846 19856 consensus_queue.cc:1048] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:58.714895 19855 leader_election.cc:290] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:58.714900 19978 raft_consensus.cc:493] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.717708 19978 raft_consensus.cc:515] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:58.719367 16293 tablet_copy_service.cc:140] P 0aea40d6e4374085a2e38a70a71f63e3: Received BeginTabletCopySession request for tablet 73757c6fea8949e090aa4e55902a41d4 from peer 1109f76a0b7b443a84c0327c8707bc63 ({username='slave'} at 127.0.0.1:42740)
I20260709 13:06:58.720034 16293 tablet_copy_service.cc:161] P 0aea40d6e4374085a2e38a70a71f63e3: Beginning new tablet copy session on tablet 73757c6fea8949e090aa4e55902a41d4 from peer 1109f76a0b7b443a84c0327c8707bc63 at {username='slave'} at 127.0.0.1:42740: session id = 1109f76a0b7b443a84c0327c8707bc63-73757c6fea8949e090aa4e55902a41d4
I20260709 13:06:58.720281 19978 leader_election.cc:290] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:58.723282 16207 raft_consensus.cc:1240] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:58.724732 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:58.726435 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:58.727178 16208 raft_consensus.cc:3060] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:58.727244 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:58.728000 16278 raft_consensus.cc:2376] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 12. Re-sending same reply.
I20260709 13:06:58.728936 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:58.730707 16275 raft_consensus.cc:2368] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 for earlier term 9. Current term is 10.
I20260709 13:06:58.737154 16943 raft_consensus.cc:2468] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 8.
I20260709 13:06:58.745447 16283 raft_consensus.cc:2468] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 9.
I20260709 13:06:58.756717 16173 leader_election.cc:304] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:58.758581 16207 raft_consensus.cc:1275] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:06:58.760277 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:58.761484 16199 raft_consensus.cc:2393] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 7: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
I20260709 13:06:58.666361 19869 rpcz_store.cc:276] 0709 13:06:55.214401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:55.214668 (+   267us) service_pool.cc:224] Handling call
0709 13:06:55.357553 (+142885us) log.cc:844] Serialized 506 byte log entry
0709 13:06:55.676348 (+318795us) spinlock_profiling.cc:243] Waited 1.71 ms on lock 0x7b18001e1fc0. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f3625264de1 00007f36252715b1 00007f361c39c3f3 00007f361c39e7c1 00007f361c39e779 00007f361c39e709 00007f361c39e6d1 00007f361c39d9cd 000000000038f354 000000000038f199 00007f361c37f83a
0709 13:06:58.616053 (+2939705us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":15158,"raft.run_cpu_time_us":2439,"raft.run_wall_time_us":78515,"spinlock_wait_cycles":3944192,"thread_start_us":96218,"threads_started":1,"wal-append.queue_time_us":185091,"wal-append.run_cpu_time_us":3280,"wal-append.run_wall_time_us":1107231}
I20260709 13:06:58.766604 19852 raft_consensus.cc:515] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:58.769424 19852 leader_election.cc:290] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:58.770058 19907 raft_consensus.cc:493] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.770231 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:58.771828 16354 raft_consensus.cc:2368] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for earlier term 6. Current term is 7.
I20260709 13:06:58.771123 16275 raft_consensus.cc:2468] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 5.
I20260709 13:06:58.705214 19906 raft_consensus.cc:493] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.775776 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:58.776499 16283 raft_consensus.cc:2468] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 11.
I20260709 13:06:58.777664 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:58.780174 16276 raft_consensus.cc:1275] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:06:58.770772 19907 raft_consensus.cc:515] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:58.788126 16281 raft_consensus.cc:1240] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:58.787160 19995 raft_consensus.cc:2749] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:58.790875 16275 raft_consensus.cc:3055] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:06:58.791268 16173 leader_election.cc:304] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:58.786072 19852 raft_consensus.cc:493] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.792546 19852 raft_consensus.cc:515] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:58.792968 19831 consensus_queue.cc:260] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:58.793919 16293 tablet_copy_source_session.cc:215] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:58.794415 19831 raft_consensus.cc:3060] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:58.794667 19842 raft_consensus.cc:493] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.795202 19842 raft_consensus.cc:515] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:58.796906 19907 leader_election.cc:290] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:58.797405 19932 leader_election.cc:290] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:58.791326 16275 raft_consensus.cc:740] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:58.798976 16275 consensus_queue.cc:260] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:58.800107 16275 raft_consensus.cc:3060] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:58.800765 19906 raft_consensus.cc:515] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:58.797415 19842 leader_election.cc:290] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:58.803133 19906 leader_election.cc:290] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:58.808075 19901 consensus_queue.cc:1059] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:06:58.809752 19848 consensus_queue.cc:1059] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:58.811421 19848 raft_consensus.cc:3055] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:58.811829 19848 raft_consensus.cc:740] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:06:58.812786 19848 consensus_queue.cc:260] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:58.813995 19848 raft_consensus.cc:3060] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:58.821730 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:58.822671 16943 raft_consensus.cc:2468] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 10.
I20260709 13:06:58.823534 16348 raft_consensus.cc:2468] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 8.
I20260709 13:06:58.809738 19842 raft_consensus.cc:3055] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:06:58.831166 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 76387.9us
I20260709 13:06:58.756675 19948 consensus_queue.cc:1048] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.062s
I20260709 13:06:58.837096 19911 consensus_queue.cc:1059] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:06:58.838447 19911 raft_consensus.cc:493] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.839103 19911 raft_consensus.cc:515] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:58.840723 19988 raft_consensus.cc:3055] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:06:58.841163 19988 raft_consensus.cc:740] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:58.841434 16248 leader_election.cc:304] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:06:58.841641 19911 leader_election.cc:290] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:58.842072 19988 consensus_queue.cc:260] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:58.787169 19927 consensus_queue.cc:1059] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 13:06:58.842481 16248 leader_election.cc:304] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:58.844791 16322 leader_election.cc:304] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:06:58.874202 16208 raft_consensus.cc:2468] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 10.
I20260709 13:06:58.847997 16281 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a"
dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
 from {username='slave'} at 127.0.0.1:45210
I20260709 13:06:58.825974 19995 raft_consensus.cc:2804] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:58.876318 16281 raft_consensus.cc:493] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:58.876758 16281 raft_consensus.cc:3060] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:58.862394 19982 raft_consensus.cc:2804] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:58.864126 19927 raft_consensus.cc:3055] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:58.874171 16173 leader_election.cc:304] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:58.872409 16246 leader_election.cc:304] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:58.882334 16246 leader_election.cc:304] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:58.851588 19852 leader_election.cc:290] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:58.832252 19842 raft_consensus.cc:740] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
W20260709 13:06:58.856950 19974 log.cc:927] Time spent T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63: Append to log took a long time: real 0.340s	user 0.005s	sys 0.000s
I20260709 13:06:58.893501 16173 leader_election.cc:304] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63
W20260709 13:06:58.888756 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 44029.3us
I20260709 13:06:58.901506 16322 leader_election.cc:304] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:58.891551 16275 raft_consensus.cc:1275] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 13:06:58.895093 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 52689.6us
I20260709 13:06:58.912385 16248 leader_election.cc:304] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:06:58.916440 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:58.920595 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:58.921371 16943 raft_consensus.cc:1240] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 7. Current term is 8. Ops: []
W20260709 13:06:58.925895 16249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:58.890575 19849 raft_consensus.cc:2804] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:58.928637 19849 raft_consensus.cc:493] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:58.929105 19849 raft_consensus.cc:3060] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:58.930088 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:58.931015 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:58.879299 19927 raft_consensus.cc:740] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:06:58.892757 19915 raft_consensus.cc:2804] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:58.883852 19982 raft_consensus.cc:493] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:06:58.879060 19995 raft_consensus.cc:493] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:06:58.887890 19874 raft_consensus.cc:2749] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:58.892572 19932 raft_consensus.cc:2749] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:58.933205 16281 raft_consensus.cc:515] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:58.965086 19915 raft_consensus.cc:697] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 8 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:06:58.966234 19915 consensus_queue.cc:237] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:58.966841 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:58.967592 19849 raft_consensus.cc:515] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:58.893078 19980 consensus_queue.cc:1048] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.091s
I20260709 13:06:58.941866 19985 raft_consensus.cc:2749] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:06:58.942726 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 60513.1us
I20260709 13:06:58.944020 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:58.976759 16246 leader_election.cc:304] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:58.944134 19896 raft_consensus.cc:493] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:58.978675 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 48975.9us
I20260709 13:06:58.979544 16173 leader_election.cc:304] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:58.979106 19896 raft_consensus.cc:515] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:58.983440 19821 raft_consensus.cc:2749] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:06:58.944777 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:58.892374 19897 consensus_queue.cc:1048] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 13:06:58.986927 19897 raft_consensus.cc:2804] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:58.987780 19897 raft_consensus.cc:697] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:06:58.988981 19897 consensus_queue.cc:237] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:58.942006 16351 raft_consensus.cc:1240] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 12 LEADER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:58.927295 19941 raft_consensus.cc:2804] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:58.990453 19941 raft_consensus.cc:493] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:58.990933 19941 raft_consensus.cc:3060] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:58.991070 19896 leader_election.cc:290] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:58.930830 19988 raft_consensus.cc:3060] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:58.967592 16349 raft_consensus.cc:2468] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 6.
I20260709 13:06:58.989722 16246 leader_election.cc:304] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:58.930698 19911 raft_consensus.cc:2764] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:06:58.992218 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:58.992393 16248 leader_election.cc:304] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:58.947316 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:06:58.995520 19991 consensus_queue.cc:1048] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
W20260709 13:06:58.995832 19993 log.cc:927] Time spent T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:06:58.947655 19982 raft_consensus.cc:3060] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:58.936412 19856 raft_consensus.cc:2764] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Leader election decision vote started in defunct term 8: won
I20260709 13:06:59.006515 16322 leader_election.cc:304] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:59.008430 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:06:58.947520 19995 raft_consensus.cc:3060] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:59.013228 16248 leader_election.cc:304] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:59.002763 19849 leader_election.cc:290] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:59.018173 16246 leader_election.cc:304] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:06:59.022063 16322 leader_election.cc:304] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:59.024772 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:59.025791 16275 raft_consensus.cc:2376] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 7. Re-sending same reply.
I20260709 13:06:59.026062 16274 raft_consensus.cc:1275] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:06:58.970737 19948 consensus_queue.cc:1048] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 13:06:59.026983 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:59.027921 16283 raft_consensus.cc:2393] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 6: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:06:59.029170 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:59.029359 19842 consensus_queue.cc:260] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:59.030057 16275 raft_consensus.cc:2393] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 6: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:06:59.030897 19842 raft_consensus.cc:3060] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:59.008965 19980 consensus_queue.cc:1048] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:06:59.038954 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:59.039933 16282 raft_consensus.cc:2468] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 8.
I20260709 13:06:59.043310 19940 raft_consensus.cc:2749] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:06:59.044447 16348 raft_consensus.cc:3060] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:59.013015 16944 raft_consensus.cc:3060] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:59.049008 19927 consensus_queue.cc:260] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:59.050729 19927 raft_consensus.cc:3060] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:59.053503 16281 leader_election.cc:290] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:06:59.021028 19849 consensus_queue.cc:1048] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:06:59.063261 16205 raft_consensus.cc:2468] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 8.
I20260709 13:06:59.008639 19932 raft_consensus.cc:2749] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:06:59.071485 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 49512.2us
I20260709 13:06:59.072340 16322 leader_election.cc:304] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:59.072865 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:59.073485 16278 raft_consensus.cc:3060] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:59.076665 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:59.078992 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:59.079074 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:59.080879 16276 raft_consensus.cc:3060] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:59.082525 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:06:59.084075 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:59.084510 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:59.074155 16914 leader_election.cc:304] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:59.021134 19821 raft_consensus.cc:2749] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:59.088248 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:59.019778 19850 consensus_queue.cc:1048] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 13:06:59.089323 16208 raft_consensus.cc:3060] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:59.085794 19940 raft_consensus.cc:2804] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:06:59.097611 16246 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.079916 19985 raft_consensus.cc:2804] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:59.106164 16353 raft_consensus.cc:1240] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 8 LEADER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:59.082747 19852 raft_consensus.cc:2804] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:59.103713 16348 raft_consensus.cc:2468] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 7.
W20260709 13:06:59.100731 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 87588.5us
I20260709 13:06:59.094374 19869 raft_consensus.cc:2804] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:59.148713 19869 raft_consensus.cc:697] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:59.148849 16276 raft_consensus.cc:2468] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 13.
I20260709 13:06:59.144383 19901 raft_consensus.cc:2804] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:06:59.151634 19901 raft_consensus.cc:697] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 12 LEADER]: Becoming Leader. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:06:59.153045 19915 raft_consensus.cc:493] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:59.153832 19915 raft_consensus.cc:515] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:59.156617 19915 leader_election.cc:290] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:06:59.099275 19940 raft_consensus.cc:493] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:59.158581 19940 raft_consensus.cc:3060] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:59.160398 16106 catalog_manager.cc:5697] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: config changed from index -1 to 5, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New cstate: current_term: 7 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:59.150208 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:59.162318 19985 raft_consensus.cc:697] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:59.174028 19985 consensus_queue.cc:237] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:59.124286 16283 raft_consensus.cc:2468] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 5.
I20260709 13:06:59.127969 16281 raft_consensus.cc:2468] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 8.
I20260709 13:06:59.099488 19978 consensus_queue.cc:1048] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.064s
I20260709 13:06:59.166318 16276 raft_consensus.cc:2468] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 8.
I20260709 13:06:59.152710 19901 consensus_queue.cc:237] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:06:59.156966 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 82903.1us
I20260709 13:06:59.139513 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:06:59.188759 16912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.188956 16282 raft_consensus.cc:2468] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 12.
I20260709 13:06:59.138470 16322 leader_election.cc:304] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:59.149819 19869 consensus_queue.cc:237] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:59.191102 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:59.194759 16276 raft_consensus.cc:1275] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 13:06:59.195823 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 57472.6us
I20260709 13:06:59.194494 16283 raft_consensus.cc:2468] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 6.
I20260709 13:06:59.198378 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:59.199049 16348 raft_consensus.cc:2376] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 13. Re-sending same reply.
I20260709 13:06:59.205520 16278 raft_consensus.cc:2468] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 7.
I20260709 13:06:59.185906 16248 leader_election.cc:304] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:59.219237 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:59.219954 16350 raft_consensus.cc:2376] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 6. Re-sending same reply.
I20260709 13:06:59.221047 19903 raft_consensus.cc:2749] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:59.219401 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:59.225708 16355 raft_consensus.cc:2393] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 6: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:06:59.218830 16322 leader_election.cc:304] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:06:59.274221 16208 raft_consensus.cc:2468] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 7.
I20260709 13:06:59.096930 19941 raft_consensus.cc:515] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:59.297588 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:06:59.189443 19852 raft_consensus.cc:493] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:59.272439 16283 raft_consensus.cc:1240] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 6. Current term is 7. Ops: []
W20260709 13:06:59.298686 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 90053us
I20260709 13:06:59.300168 16351 raft_consensus.cc:2393] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 8: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:06:59.139549 20005 consensus_queue.cc:1048] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.200s
W20260709 13:06:59.307175 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 88431.7us
I20260709 13:06:59.308240 16322 leader_election.cc:304] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:06:59.301857 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:06:59.195816 16944 raft_consensus.cc:2468] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 10.
I20260709 13:06:59.309422 16278 raft_consensus.cc:2468] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 7.
W20260709 13:06:59.300750 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 289752us
I20260709 13:06:59.192552 19874 consensus_queue.cc:1059] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.105s
I20260709 13:06:59.321957 16322 leader_election.cc:304] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
W20260709 13:06:59.323486 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 52118.9us
I20260709 13:06:59.328411 16356 raft_consensus.cc:2393] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 in current term 11: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:06:59.298246 19915 raft_consensus.cc:493] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:59.293810 19932 raft_consensus.cc:2749] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:59.332940 19911 consensus_queue.cc:1059] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:06:59.302964 19852 raft_consensus.cc:3060] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:59.336440 16322 leader_election.cc:304] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
W20260709 13:06:59.339604 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.347014 16173 leader_election.cc:400] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 pre-election: Vote denied by peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107) with higher term. Message: Invalid argument: T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for earlier term 6. Current term is 7.
I20260709 13:06:59.313268 19841 raft_consensus.cc:2804] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:59.331565 19978 raft_consensus.cc:2804] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:59.355872 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:59.360471 16246 leader_election.cc:304] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:06:59.354702 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:06:59.363418 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 58166us
I20260709 13:06:59.370594 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:59.376055 16200 raft_consensus.cc:1275] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:06:59.340250 19854 raft_consensus.cc:2804] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:59.377346 16246 leader_election.cc:304] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:06:59.374423 16201 raft_consensus.cc:2955] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Committing config change with OpId 7.5: config changed from index -1 to 5, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:06:59.384003 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:59.385159 16206 raft_consensus.cc:2468] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 7.
I20260709 13:06:59.331004 19976 consensus_queue.cc:1048] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 13:06:59.364444 19894 raft_consensus.cc:2804] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:59.385677 19821 consensus_queue.cc:1059] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 13:06:59.337141 19849 consensus_queue.cc:1048] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 13:06:59.394937 20009 raft_consensus.cc:3055] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:06:59.395298 19998 log.cc:927] Time spent T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.301s	user 0.001s	sys 0.000s
I20260709 13:06:59.366135 19978 raft_consensus.cc:493] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:59.355382 19841 raft_consensus.cc:493] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:59.355304 19856 raft_consensus.cc:493] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
W20260709 13:06:59.439390 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 86465.5us
I20260709 13:06:59.409217 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:59.409499 19821 consensus_queue.cc:1243] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer 363bb2f744eb486f9ad726f08214c98e log is divergent from this leader: its last log entry 8.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:06:59.382887 19854 raft_consensus.cc:493] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:59.431953 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:06:59.387765 19911 raft_consensus.cc:2804] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:59.471472 16205 raft_consensus.cc:1240] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:59.353339 19915 raft_consensus.cc:515] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:59.398343 16914 leader_election.cc:304] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:06:59.462361 16202 raft_consensus.cc:1275] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:06:59.403971 19907 consensus_queue.cc:1059] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 13:06:59.459777 16203 raft_consensus.cc:2468] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 6.
I20260709 13:06:59.467397 19854 raft_consensus.cc:3060] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:59.473850 15057 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:59.443794 19978 raft_consensus.cc:3060] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:59.460014 19841 raft_consensus.cc:3060] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:06:59.477262 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 79028.7us
W20260709 13:06:59.477357 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 100099us
I20260709 13:06:59.411190 20009 raft_consensus.cc:740] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:06:59.416967 19894 raft_consensus.cc:697] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 7 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:06:59.465906 19932 raft_consensus.cc:493] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:59.468372 19911 raft_consensus.cc:493] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:59.413897 19940 raft_consensus.cc:515] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:59.444298 19995 raft_consensus.cc:515] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:59.498310 19911 raft_consensus.cc:3060] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:59.479136 19856 raft_consensus.cc:515] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:06:59.500983 19897 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.012s	sys 0.007s
W20260709 13:06:59.647598 19897 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.650s	user 0.013s	sys 0.012s
I20260709 13:06:59.499656 19932 raft_consensus.cc:515] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:06:59.667927 20004 log.cc:927] Time spent T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.306s	user 0.001s	sys 0.000s
W20260709 13:06:59.669561 20016 log.cc:927] Time spent T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.176s	user 0.000s	sys 0.001s
W20260709 13:06:59.675479 20006 log.cc:927] Time spent T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.364s	user 0.002s	sys 0.000s
I20260709 13:06:59.688086 20009 consensus_queue.cc:260] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:06:59.501170 19822 consensus_queue.cc:1048] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.146s
I20260709 13:06:59.668728 20018 raft_consensus.cc:2749] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:59.669902 20026 raft_consensus.cc:493] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:59.690147 19894 consensus_queue.cc:237] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:06:59.667325 20017 raft_consensus.cc:2749] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:59.839313 16279 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45210 (request call id 2049) took 1095 ms. Trace:
W20260709 13:06:59.843003 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 477041us
I20260709 13:06:59.873773 16204 raft_consensus.cc:1275] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:06:59.836212 19985 raft_consensus.cc:493] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:59.900628 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:06:59.907021 16203 raft_consensus.cc:3060] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:06:59.888751 16279 rpcz_store.cc:276] 0709 13:06:58.744392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.750924 (+  6532us) service_pool.cc:224] Handling call
0709 13:06:58.757938 (+  7014us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:58.791686 (+ 33748us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:58.791723 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:58.792262 (+   539us) log.cc:844] Serialized 26 byte log entry
0709 13:06:58.934123 (+141861us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:58.934168 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:58.934242 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:59.028959 (+ 94717us) spinlock_profiling.cc:243] Waited 7.37 ms on lock 0x7b480015c258. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f36243b2aa1 00007f36243a9b37 00007f36243a99ca 00007f36244a126f 00007f36244a0f37 00007f36244b555c 00007f36244b5508 00007f36244b5488 00007f36244b5443 00007f36244b46ec 00007f36233dea96
0709 13:06:59.645535 (+616576us) raft_consensus.cc:1685] finished
0709 13:06:59.817520 (+171985us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:59.839236 (+ 21716us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":81642,"raft.queue_time_us":72930,"raft.run_cpu_time_us":3516,"raft.run_wall_time_us":196985,"spinlock_wait_cycles":16948096,"thread_start_us":141484,"threads_started":1,"wal-append.queue_time_us":219528}
W20260709 13:06:59.889460 20023 log.cc:927] Time spent T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.240s	user 0.004s	sys 0.006s
W20260709 13:06:59.973416 19869 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.021s	sys 0.010s
W20260709 13:06:59.973930 19869 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.530s	user 0.021s	sys 0.010s
I20260709 13:06:59.891577 19941 leader_election.cc:290] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:06:59.897760 19848 raft_consensus.cc:493] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
W20260709 13:06:59.995990 16207 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.020s	sys 0.018s
W20260709 13:06:59.996542 16207 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.581s	user 0.020s	sys 0.018s
I20260709 13:06:59.919515 20018 raft_consensus.cc:493] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
W20260709 13:06:59.949417 19896 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.005s	sys 0.018s
I20260709 13:07:00.001966 16173 leader_election.cc:304] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
W20260709 13:07:00.011263 19975 log.cc:927] Time spent T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.196s	user 0.007s	sys 0.006s
I20260709 13:06:59.999287 19848 raft_consensus.cc:515] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:06:59.999084 19980 raft_consensus.cc:493] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:00.015313 19980 raft_consensus.cc:515] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:00.016726 19911 raft_consensus.cc:515] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:07:00.015847 20025 log.cc:927] Time spent T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63: Append to log took a long time: real 0.153s	user 0.001s	sys 0.000s
I20260709 13:06:59.961014 19862 raft_consensus.cc:493] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
W20260709 13:07:00.029359 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 504309us
W20260709 13:07:00.009564 19896 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.613s	user 0.005s	sys 0.019s
I20260709 13:06:59.993619 19966 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73757c6fea8949e090aa4e55902a41d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:59.978632 19979 raft_consensus.cc:493] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:06:59.889851 20026 raft_consensus.cc:515] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:00.064828 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:06:59.936658 19985 raft_consensus.cc:515] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:00.023860 19915 leader_election.cc:290] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:00.018424 19980 leader_election.cc:290] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:07:00.088443 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 81654.9us
I20260709 13:07:00.080894 16353 raft_consensus.cc:3055] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:00.065143 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:00.081966 16914 leader_election.cc:304] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:00.026908 19940 leader_election.cc:290] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 12 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:00.092821 20014 raft_consensus.cc:3060] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:00.105602 16353 raft_consensus.cc:740] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:00.089498 16173 leader_election.cc:304] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:00.085136 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:07:00.085757 19941 raft_consensus.cc:493] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
W20260709 13:07:00.153297 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 63893.5us
I20260709 13:07:00.155287 16173 leader_election.cc:304] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
W20260709 13:07:00.158300 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 108535us
W20260709 13:07:00.157891 19841 consensus_meta.cc:287] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 0.656s	user 0.025s	sys 0.007s
W20260709 13:07:00.144901 19842 consensus_meta.cc:287] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63: Time spent flushing consensus metadata: real 1.114s	user 0.009s	sys 0.006s
I20260709 13:07:00.143571 16353 consensus_queue.cc:260] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:00.168063 16353 raft_consensus.cc:3060] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:00.112107 19896 raft_consensus.cc:493] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:00.112039 19995 leader_election.cc:290] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:00.107877 19980 raft_consensus.cc:2804] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:00.020804 20018 raft_consensus.cc:515] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:00.081979 19979 raft_consensus.cc:515] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:07:00.163389 19982 consensus_meta.cc:287] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3: Time spent flushing consensus metadata: real 1.081s	user 0.016s	sys 0.005s
I20260709 13:07:00.174283 16322 leader_election.cc:304] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:07:00.080852 19862 raft_consensus.cc:515] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:00.192598 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
W20260709 13:07:00.163894 19988 consensus_meta.cc:287] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3: Time spent flushing consensus metadata: real 1.156s	user 0.012s	sys 0.007s
W20260709 13:07:00.168511 19852 consensus_meta.cc:287] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 0.795s	user 0.011s	sys 0.003s
I20260709 13:07:00.160625 19940 raft_consensus.cc:493] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.160027 19848 leader_election.cc:290] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:00.221004 16282 raft_consensus.cc:1275] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
W20260709 13:07:00.215003 20002 log.cc:927] Time spent T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:07:00.196213 19980 raft_consensus.cc:493] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:00.228406 20045 raft_consensus.cc:493] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.204743 19849 raft_consensus.cc:2804] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:00.229710 20018 leader_election.cc:290] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:00.173084 19841 raft_consensus.cc:515] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:00.230217 20044 raft_consensus.cc:493] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.204663 19897 raft_consensus.cc:2804] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:00.232715 20059 raft_consensus.cc:493] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:00.172803 19941 raft_consensus.cc:515] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:00.213979 20014 raft_consensus.cc:2749] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:00.216404 20017 raft_consensus.cc:493] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.243837 16203 raft_consensus.cc:2468] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 11.
I20260709 13:07:00.216148 19915 raft_consensus.cc:493] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.202106 19896 raft_consensus.cc:515] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:00.226056 19856 leader_election.cc:290] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:07:00.266963 19854 consensus_meta.cc:287] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 0.774s	user 0.006s	sys 0.006s
I20260709 13:07:00.218254 19940 raft_consensus.cc:515] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } }
W20260709 13:07:00.284489 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 110286us
I20260709 13:07:00.226573 19988 raft_consensus.cc:493] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:00.219485 19852 raft_consensus.cc:515] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:00.256557 19980 raft_consensus.cc:3060] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:00.213786 19982 raft_consensus.cc:515] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:00.275399 19911 leader_election.cc:290] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:07:00.298717 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 136324us
I20260709 13:07:00.283272 20036 raft_consensus.cc:493] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.285277 20017 raft_consensus.cc:515] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:00.301720 20036 raft_consensus.cc:515] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:00.303828 20017 leader_election.cc:290] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:00.304533 20036 leader_election.cc:290] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:00.283874 19849 raft_consensus.cc:697] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [term 5 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:07:00.285331 20059 raft_consensus.cc:515] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:00.285079 19897 raft_consensus.cc:697] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:07:00.309090 16353 raft_consensus.cc:2468] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 7.
I20260709 13:07:00.310348 16280 raft_consensus.cc:2393] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 12: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
W20260709 13:07:00.311867 20038 log.cc:927] Time spent T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.166s	user 0.000s	sys 0.001s
I20260709 13:07:00.311734 20040 consensus_queue.cc:1048] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:07:00.313277 16275 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45218 (request call id 2013) took 1248 ms. Trace:
W20260709 13:07:00.314198 20042 log.cc:927] Time spent T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.147s	user 0.001s	sys 0.000s
I20260709 13:07:00.291929 20044 raft_consensus.cc:515] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:00.314697 16356 raft_consensus.cc:2368] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for earlier term 5. Current term is 6.
I20260709 13:07:00.315024 20026 leader_election.cc:290] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:07:00.315387 20049 log.cc:927] Time spent T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
I20260709 13:07:00.316583 20044 leader_election.cc:290] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:00.285877 20011 consensus_queue.cc:1048] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.224s
W20260709 13:07:00.319295 20024 log.cc:927] Time spent T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.307s	user 0.000s	sys 0.002s
I20260709 13:07:00.319873 19985 leader_election.cc:290] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:00.320295 19982 leader_election.cc:290] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:00.298967 19988 raft_consensus.cc:515] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:00.321897 19941 leader_election.cc:290] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:00.322032 19862 leader_election.cc:290] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:07:00.322810 20041 log.cc:927] Time spent T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.234s	user 0.001s	sys 0.000s
I20260709 13:07:00.323809 19988 leader_election.cc:290] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:00.324033 20059 leader_election.cc:290] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:07:00.316740 20060 log.cc:927] Time spent T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 13:07:00.285347 19915 raft_consensus.cc:515] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:00.325009 19897 consensus_queue.cc:237] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } }
I20260709 13:07:00.326732 19915 leader_election.cc:290] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:07:00.327323 16321 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:00.330085 16248 leader_election.cc:304] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:00.313691 16275 rpcz_store.cc:276] 0709 13:06:59.064378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:59.064500 (+   122us) service_pool.cc:224] Handling call
0709 13:06:59.065992 (+  1492us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:59.303095 (+237103us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:59.303124 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:59.329127 (+ 26003us) log.cc:844] Serialized 26 byte log entry
0709 13:06:59.841504 (+512377us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:59.841560 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:59.841680 (+   120us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:00.313046 (+471366us) raft_consensus.cc:1685] finished
0709 13:07:00.313071 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:00.313211 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20368,"raft.queue_time_us":53643,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":26989,"thread_start_us":649729,"threads_started":2,"wal-append.queue_time_us":670308}
W20260709 13:07:00.340328 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 183971us
I20260709 13:07:00.345762 16947 raft_consensus.cc:1275] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:07:00.346005 20067 raft_consensus.cc:493] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.344954 19907 raft_consensus.cc:493] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.295994 19854 raft_consensus.cc:515] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:00.346840 19841 leader_election.cc:290] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:00.369190 19874 raft_consensus.cc:3055] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:00.369854 19874 raft_consensus.cc:740] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:07:00.265087 20045 raft_consensus.cc:515] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:00.364409 19988 raft_consensus.cc:493] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:00.364899 16944 raft_consensus.cc:2468] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 11.
I20260709 13:07:00.365842 16173 leader_election.cc:304] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:07:00.366667 19907 raft_consensus.cc:515] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:00.367660 19932 leader_election.cc:290] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:00.361181 16246 leader_election.cc:304] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:00.385149 19915 consensus_queue.cc:1048] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:00.380761 20014 raft_consensus.cc:493] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.396099 20045 leader_election.cc:290] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:00.372529 19911 raft_consensus.cc:2749] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:00.400988 16173 leader_election.cc:304] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:00.387357 16320 leader_election.cc:304] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
W20260709 13:07:00.413786 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 52752.4us
I20260709 13:07:00.309700 19849 consensus_queue.cc:237] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:07:00.423473 19978 consensus_meta.cc:287] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 0.938s	user 0.015s	sys 0.000s
I20260709 13:07:00.424059 19978 raft_consensus.cc:515] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:00.425350 16349 raft_consensus.cc:1240] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:07:00.429539 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:00.435213 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:00.407387 20059 raft_consensus.cc:2804] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:00.394389 20014 raft_consensus.cc:515] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:00.347565 20067 raft_consensus.cc:515] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:00.493147 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:00.415853 20011 raft_consensus.cc:3060] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:00.413254 19874 consensus_queue.cc:260] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:00.398820 19988 raft_consensus.cc:515] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:00.419589 19896 leader_election.cc:290] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:00.494841 16354 raft_consensus.cc:1275] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:07:00.495961 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:00.523324 16942 raft_consensus.cc:2468] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 7.
I20260709 13:07:00.494871 19862 raft_consensus.cc:493] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:00.437623 19841 raft_consensus.cc:2804] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:07:00.503629 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 80351.1us
I20260709 13:07:00.512845 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:00.517554 20065 raft_consensus.cc:2804] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:00.520970 20046 raft_consensus.cc:493] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:00.521498 20081 log.cc:927] Time spent T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
W20260709 13:07:00.522343 20077 log.cc:927] Time spent T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
W20260709 13:07:00.496811 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 81908us
I20260709 13:07:00.496371 20044 raft_consensus.cc:493] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:00.563913 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:00.536031 16943 raft_consensus.cc:2468] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 7.
I20260709 13:07:00.539703 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:00.565385 16205 raft_consensus.cc:2468] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 11.
I20260709 13:07:00.538908 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:00.540365 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bc3c8ff9b84838a2664335d7e1582b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:00.505650 20059 raft_consensus.cc:697] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:07:00.507891 20045 raft_consensus.cc:493] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:00.568274 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:00.575573 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:00.580027 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:00.513183 19979 leader_election.cc:290] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:00.585304 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:00.543963 20011 raft_consensus.cc:2749] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:00.611410 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:00.612601 16201 raft_consensus.cc:2393] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 12: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:07:00.614431 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:00.587548 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c15d8e9be8414c84912ab77b66bfb1" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:00.542939 19852 leader_election.cc:290] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:00.565953 20065 raft_consensus.cc:697] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:07:00.613770 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:00.618571 16207 raft_consensus.cc:2468] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 8.
I20260709 13:07:00.627069 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:00.577500 19940 leader_election.cc:290] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:00.632783 16282 raft_consensus.cc:1275] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:07:00.586606 20017 raft_consensus.cc:493] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:00.639367 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:00.633427 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:00.634155 16200 raft_consensus.cc:2468] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 6.
W20260709 13:07:00.633507 16173 leader_election.cc:336] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Timed out: RequestConsensusVote RPC to 127.14.180.66:45823 timed out after 2.102s (SENT)
I20260709 13:07:00.641440 16173 leader_election.cc:304] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:00.638940 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:00.642859 16283 raft_consensus.cc:2368] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for earlier term 6. Current term is 7.
I20260709 13:07:00.586797 20056 raft_consensus.cc:493] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:00.541304 19862 raft_consensus.cc:515] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:00.643754 16281 raft_consensus.cc:2393] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 12: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:07:00.632145 19866 raft_consensus.cc:493] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.621325 19911 raft_consensus.cc:493] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.655850 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c15d8e9be8414c84912ab77b66bfb1" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:00.581851 20044 raft_consensus.cc:515] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:00.623919 19917 raft_consensus.cc:493] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:00.583467 20045 raft_consensus.cc:515] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:00.651477 19866 raft_consensus.cc:515] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:00.681622 20067 leader_election.cc:290] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:00.683569 16282 raft_consensus.cc:2468] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 8.
I20260709 13:07:00.682799 16199 raft_consensus.cc:1275] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:07:00.694967 20059 consensus_queue.cc:237] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:00.633281 19856 raft_consensus.cc:493] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:00.703115 19862 leader_election.cc:290] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:07:00.704269 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 70782.9us
I20260709 13:07:00.705127 20031 raft_consensus.cc:2749] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:00.642311 19854 leader_election.cc:290] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:00.768639 20051 raft_consensus.cc:493] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:00.769454 19866 leader_election.cc:290] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:00.771240 20032 raft_consensus.cc:493] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
W20260709 13:07:00.782447 19906 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 13:07:00.706387 19907 leader_election.cc:290] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:00.707672 19988 leader_election.cc:290] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:00.710916 20010 raft_consensus.cc:493] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:00.711500 19966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:40078 (request call id 409) took 2895 ms. Trace:
I20260709 13:07:00.711696 19911 raft_consensus.cc:515] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:00.712574 19821 raft_consensus.cc:493] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:00.713030 20014 leader_election.cc:290] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:00.724639 16320 leader_election.cc:304] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:00.726454 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:00.728035 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
W20260709 13:07:00.807217 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 82712.4us
I20260709 13:07:00.710237 20074 raft_consensus.cc:493] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.738831 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:00.758251 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:00.764842 16173 leader_election.cc:400] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 election: Vote denied by peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823) with higher term. Message: Invalid argument: T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for earlier term 6. Current term is 7.
I20260709 13:07:00.810256 16173 leader_election.cc:403] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:07:00.791261 19948 raft_consensus.cc:493] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:00.810811 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 46226us
I20260709 13:07:00.563755 20046 raft_consensus.cc:515] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:00.807367 16206 raft_consensus.cc:3060] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:00.649340 20017 raft_consensus.cc:515] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:00.772141 20032 raft_consensus.cc:515] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:00.652966 20056 raft_consensus.cc:515] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:00.737316 19841 raft_consensus.cc:697] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 11 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:00.703262 20065 consensus_queue.cc:237] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:00.818320 16277 raft_consensus.cc:1275] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:07:00.815765 20074 raft_consensus.cc:515] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:00.769326 20051 raft_consensus.cc:515] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:00.731148 20040 raft_consensus.cc:2804] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:00.765635 19856 raft_consensus.cc:515] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:00.836450 16320 leader_election.cc:304] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:00.811934 19906 raft_consensus.cc:2804] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:00.815132 20035 raft_consensus.cc:3060] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:00.801928 20010 raft_consensus.cc:515] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:00.806146 19980 raft_consensus.cc:515] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:00.809134 19821 raft_consensus.cc:515] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:00.732549 19917 raft_consensus.cc:515] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:00.853055 19906 raft_consensus.cc:493] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:00.817906 19948 raft_consensus.cc:515] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:00.859066 20070 raft_consensus.cc:2804] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:00.893550 16202 raft_consensus.cc:3060] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:00.862763 20045 leader_election.cc:290] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:00.898089 16206 raft_consensus.cc:2468] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 9.
I20260709 13:07:00.906478 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:00.890904 19906 raft_consensus.cc:3060] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:00.911877 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:00.912923 16199 raft_consensus.cc:2468] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 4.
I20260709 13:07:00.890188 20053 raft_consensus.cc:493] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:00.896893 20070 raft_consensus.cc:493] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:00.922194 16320 leader_election.cc:304] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:00.894743 20030 raft_consensus.cc:493] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:00.903267 20075 raft_consensus.cc:493] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:00.932600 16202 raft_consensus.cc:2468] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 9.
I20260709 13:07:00.932775 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:07:00.934121 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 116910us
I20260709 13:07:00.935544 19988 raft_consensus.cc:493] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:00.936161 20071 raft_consensus.cc:2804] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:00.940675 20071 raft_consensus.cc:493] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:00.941202 20071 raft_consensus.cc:3060] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:00.798452 19966 rpcz_store.cc:276] 0709 13:06:57.816077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.817598 (+  1521us) service_pool.cc:224] Handling call
0709 13:06:58.104006 (+286408us) ts_tablet_manager.cc:934] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63: Initiating tablet copy from peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
0709 13:06:59.494965 (+1390959us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:07:00.683245 (+1188280us) tablet_metadata.cc:665] Metadata flushed
0709 13:07:00.683403 (+   158us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:07:00.710199 (+ 26796us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:07:00.710736 (+   537us) tablet_replica.cc:206] Creating consensus instance
0709 13:07:00.711252 (+   516us) ts_tablet_manager.cc:989] Replica registered.
0709 13:07:00.711358 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":28215,"tablet-copy.queue_time_us":284971,"thread_start_us":397057,"threads_started":2}
I20260709 13:07:00.944147 20010 leader_election.cc:290] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:00.944975 19966 tablet_copy_client.cc:806] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:00.945417 20066 raft_consensus.cc:493] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.945730 19966 tablet_copy_client.cc:670] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Starting download of 1 WAL segments...
W20260709 13:07:00.936825 16246 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:00.911237 19841 consensus_queue.cc:237] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:00.951205 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:00.923211 20070 raft_consensus.cc:3060] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:00.946280 20066 raft_consensus.cc:515] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:07:00.961288 19917 leader_election.cc:290] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:00.946708 20075 raft_consensus.cc:515] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:00.973986 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:00.921468 20021 consensus_queue.cc:1048] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.174s
W20260709 13:07:01.022199 20088 log.cc:927] Time spent T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 13:07:01.023914 20074 leader_election.cc:290] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:01.024678 20074 raft_consensus.cc:493] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:00.939179 19988 raft_consensus.cc:515] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:00.967276 20067 raft_consensus.cc:493] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:00.928480 20053 raft_consensus.cc:515] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:01.036652 20053 leader_election.cc:290] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:07:01.037925 20079 log.cc:927] Time spent T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.234s	user 0.002s	sys 0.000s
I20260709 13:07:01.009864 20044 leader_election.cc:290] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:07:01.043241 20086 log.cc:927] Time spent T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.200s	user 0.001s	sys 0.000s
I20260709 13:07:01.044389 19856 leader_election.cc:290] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:01.043217 20103 raft_consensus.cc:493] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:01.025309 20074 raft_consensus.cc:515] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:01.014034 19911 leader_election.cc:290] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:01.069954 20098 raft_consensus.cc:493] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:01.070752 20098 raft_consensus.cc:515] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:01.073338 20098 leader_election.cc:290] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:01.073452 20106 raft_consensus.cc:493] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:01.073916 20017 leader_election.cc:290] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:07:01.094472 19855 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.085s	user 0.016s	sys 0.015s
I20260709 13:07:01.094810 20091 raft_consensus.cc:493] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:01.083638 19980 leader_election.cc:290] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:01.052996 20067 raft_consensus.cc:515] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:01.084646 20101 raft_consensus.cc:493] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:01.096307 20052 raft_consensus.cc:493] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
W20260709 13:07:01.099571 19855 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.096s	user 0.016s	sys 0.016s
W20260709 13:07:01.110394 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 168329us
I20260709 13:07:01.095961 19911 raft_consensus.cc:493] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:01.114367 16173 leader_election.cc:304] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:01.101974 20051 leader_election.cc:290] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:00.959231 20030 raft_consensus.cc:515] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:01.102247 19948 leader_election.cc:290] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:01.083909 20103 raft_consensus.cc:515] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:07:01.126791 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:01.127835 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:01.121593 19980 raft_consensus.cc:2804] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:01.127810 20030 leader_election.cc:290] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:01.122654 20052 raft_consensus.cc:515] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:01.134366 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f022e2e63ae4461d834e476ff2666991" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:01.123684 19911 raft_consensus.cc:515] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:01.128767 16203 consensus_queue.cc:237] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
W20260709 13:07:01.128862 20063 log.cc:927] Time spent T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.063s	user 0.006s	sys 0.003s
I20260709 13:07:01.139127 16351 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41830 (request call id 2059) took 1103 ms. Trace:
I20260709 13:07:01.143373 16351 rpcz_store.cc:276] 0709 13:07:00.033080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.033213 (+   133us) service_pool.cc:224] Handling call
0709 13:07:00.065599 (+ 32386us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:00.224224 (+158625us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:00.224275 (+    51us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:00.224341 (+    66us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:00.224389 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:01.136288 (+911899us) spinlock_profiling.cc:243] Waited 158 ms on lock 0x7b540028b4d4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f489e01 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6
0709 13:07:01.136341 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:01.136470 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":364083456}
I20260709 13:07:01.094986 20106 raft_consensus.cc:515] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:01.131641 19980 raft_consensus.cc:493] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:01.150000 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:01.151168 16947 raft_consensus.cc:2468] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 10.
I20260709 13:07:01.196403 16173 leader_election.cc:304] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:01.116246 20091 raft_consensus.cc:515] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:01.153698 19980 raft_consensus.cc:3060] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:01.219597 16944 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35122 (request call id 554) took 1174 ms. Trace:
I20260709 13:07:01.220373 16944 rpcz_store.cc:276] 0709 13:07:00.045363 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.048551 (+  3188us) service_pool.cc:224] Handling call
0709 13:07:01.219216 (+1170665us) spinlock_profiling.cc:243] Waited 139 ms on lock 0x7b540043a654. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:07:01.219441 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":320784768}
W20260709 13:07:01.221695 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:01.224944 16208 raft_consensus.cc:2468] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 12.
W20260709 13:07:01.225772 20095 log.cc:927] Time spent T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.189s	user 0.000s	sys 0.001s
I20260709 13:07:01.198026 19988 leader_election.cc:290] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:07:01.231097 20102 log.cc:927] Time spent T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
I20260709 13:07:01.234977 19911 leader_election.cc:290] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:01.236511 20067 leader_election.cc:290] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:01.228585 20108 raft_consensus.cc:2804] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:01.237507 20108 raft_consensus.cc:493] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:01.237847 20108 raft_consensus.cc:3060] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:01.119907 20101 raft_consensus.cc:515] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:01.225914 19906 raft_consensus.cc:515] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:01.248834 20035 raft_consensus.cc:2749] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823) with higher term. Message: Invalid argument: T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for earlier term 6. Current term is 7.
I20260709 13:07:01.244032 20103 leader_election.cc:290] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:01.198379 19856 raft_consensus.cc:493] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:01.267102 16201 raft_consensus.cc:1275] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:07:01.251607 20070 raft_consensus.cc:515] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:01.276892 19980 raft_consensus.cc:515] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:01.281723 19988 raft_consensus.cc:493] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:01.312165 19988 raft_consensus.cc:515] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:01.314836 19906 leader_election.cc:290] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:01.315747 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:01.308813 20104 raft_consensus.cc:493] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:01.288262 20021 raft_consensus.cc:493] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:01.315907 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f022e2e63ae4461d834e476ff2666991" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:01.317178 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:01.304441 20070 leader_election.cc:290] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:01.317576 16283 raft_consensus.cc:2468] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 6.
I20260709 13:07:01.285468 19911 raft_consensus.cc:493] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:01.286643 20112 raft_consensus.cc:493] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:01.285130 20051 raft_consensus.cc:493] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:01.324265 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:01.270385 19856 raft_consensus.cc:515] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:01.346774 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:07:01.386725 20116 log.cc:927] Time spent T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 13:07:01.321939 20030 raft_consensus.cc:493] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:01.435958 20091 leader_election.cc:290] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:01.435922 20101 leader_election.cc:290] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:07:01.438444 20113 log.cc:927] Time spent T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.184s	user 0.000s	sys 0.001s
I20260709 13:07:01.326977 19911 raft_consensus.cc:515] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:01.441048 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:01.388269 20017 raft_consensus.cc:493] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:01.388023 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:01.436520 19980 leader_election.cc:290] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:01.316550 20104 raft_consensus.cc:515] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:01.438736 19856 leader_election.cc:290] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:07:01.450762 16173 consensus_peers.cc:597] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f -> Peer 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875): Couldn't send request to peer 1109f76a0b7b443a84c0327c8707bc63. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 540bfc4ad793452faea5b865343aacf7. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:01.452324 20065 raft_consensus.cc:493] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:01.453066 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c15d8e9be8414c84912ab77b66bfb1" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:07:01.522158 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 202793us
I20260709 13:07:01.522477 16279 raft_consensus.cc:2468] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 8.
I20260709 13:07:01.523662 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bc3c8ff9b84838a2664335d7e1582b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:01.524874 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:01.525144 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:01.525544 19988 leader_election.cc:290] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:01.526255 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:01.387688 20112 raft_consensus.cc:515] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:01.316875 20021 raft_consensus.cc:515] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:01.518616 16277 raft_consensus.cc:2468] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 8.
I20260709 13:07:01.520864 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:01.523357 20017 raft_consensus.cc:515] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:01.435765 20051 raft_consensus.cc:515] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:01.524874 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:01.529973 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:01.530407 16279 raft_consensus.cc:2468] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 11.
I20260709 13:07:01.530674 16277 raft_consensus.cc:2468] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 4.
I20260709 13:07:01.531697 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:07:01.526299 16173 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 1.522s (SENT) [suppressed 14 similar messages]
I20260709 13:07:01.537200 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:01.538793 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:01.539601 16275 raft_consensus.cc:2468] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 9.
I20260709 13:07:01.540753 16279 raft_consensus.cc:2393] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 7: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:07:01.549958 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:01.552759 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:01.553506 16275 raft_consensus.cc:2468] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 12.
I20260709 13:07:01.526393 20065 raft_consensus.cc:515] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:01.558648 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c15d8e9be8414c84912ab77b66bfb1" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:01.519439 20030 raft_consensus.cc:515] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:01.559311 16279 raft_consensus.cc:3060] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:01.576496 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:01.587951 20017 leader_election.cc:290] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:01.589444 19911 leader_election.cc:290] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:01.592008 20021 leader_election.cc:290] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:01.535007 20108 raft_consensus.cc:515] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:01.554733 20044 raft_consensus.cc:493] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
W20260709 13:07:01.597918 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:01.599416 20044 raft_consensus.cc:515] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:01.612682 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:07:01.601595 20111 log.cc:927] Time spent T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.329s	user 0.000s	sys 0.001s
I20260709 13:07:01.603819 20104 leader_election.cc:290] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:07:01.601214 20071 consensus_meta.cc:287] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 0.659s	user 0.015s	sys 0.001s
I20260709 13:07:01.613765 16276 raft_consensus.cc:2468] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 3.
I20260709 13:07:01.625067 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:01.625923 16276 raft_consensus.cc:2468] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 6.
I20260709 13:07:01.627225 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:01.628000 16276 raft_consensus.cc:2468] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 9.
I20260709 13:07:01.632618 16279 raft_consensus.cc:2468] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 9.
I20260709 13:07:01.648360 16276 raft_consensus.cc:1275] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:07:01.659005 19980 raft_consensus.cc:493] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:01.661932 20018 raft_consensus.cc:493] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:01.661715 19980 raft_consensus.cc:515] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:01.664160 19980 leader_election.cc:290] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:01.665871 20051 leader_election.cc:290] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:01.667061 20074 leader_election.cc:290] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:01.669680 20065 leader_election.cc:290] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:01.671507 20066 leader_election.cc:290] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:01.674598 20030 leader_election.cc:290] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:01.632088 20071 raft_consensus.cc:515] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:01.675916 20112 leader_election.cc:290] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:01.678669 20056 leader_election.cc:290] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:01.678673 20071 leader_election.cc:290] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:01.683712 20108 leader_election.cc:290] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 11 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:01.659422 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:01.685616 16279 raft_consensus.cc:2368] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 for earlier term 8. Current term is 9.
I20260709 13:07:01.691398 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:01.692119 16204 raft_consensus.cc:2468] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 9.
I20260709 13:07:01.688992 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f022e2e63ae4461d834e476ff2666991" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:01.693205 16203 raft_consensus.cc:2468] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 6.
I20260709 13:07:01.694595 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:01.698079 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:01.699126 16350 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41832 (request call id 1950) took 1528 ms. Trace:
I20260709 13:07:01.702277 16203 raft_consensus.cc:1240] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
W20260709 13:07:01.704733 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 178464us
I20260709 13:07:01.699960 20009 raft_consensus.cc:3060] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:01.699563 16350 rpcz_store.cc:276] 0709 13:07:00.170566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.170696 (+   130us) service_pool.cc:224] Handling call
0709 13:07:00.194454 (+ 23758us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:00.213733 (+ 19279us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:00.213764 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:00.244018 (+ 30254us) log.cc:844] Serialized 26 byte log entry
0709 13:07:01.674985 (+1430967us) spinlock_profiling.cc:243] Waited 17.1 ms on lock 0x7b4800032358. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f36243b2aa1 00007f36243a9b37 00007f36243a99ca 00007f36244a126f 00007f36244a0f37 00007f36244b555c 00007f36244b5508 00007f36244b5488 00007f36244b5443 00007f36244b46ec 00007f36233dea96
0709 13:07:01.698572 (+ 23587us) spinlock_profiling.cc:243] Waited 2.69 ms on lock 0x7b18003b6500. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f3625264de1 00007f36252715b1 00007f361f0314bc 00007f361c37f48b 00007f36251d9ab9 00007f361c39b69b 00007f361c39993f 00007f361c39bc02 00007f361f02320b 00007f361f028d23 00007f361f0290d1
0709 13:07:01.698730 (+   158us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:01.698780 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:01.698868 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:01.698913 (+    45us) raft_consensus.cc:1685] finished
0709 13:07:01.698930 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:01.699066 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":105480,"raft.run_cpu_time_us":23400,"raft.run_wall_time_us":1368895,"spinlock_wait_cycles":45540608,"thread_start_us":69704,"threads_started":2,"wal-append.queue_time_us":159459,"wal-append.run_cpu_time_us":1779,"wal-append.run_wall_time_us":1018620}
I20260709 13:07:01.709803 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:01.662457 20018 raft_consensus.cc:515] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:01.716789 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:01.718609 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:01.726400 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:01.728479 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:07:01.729374 16947 raft_consensus.cc:3060] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:01.732791 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:01.733799 16203 raft_consensus.cc:2468] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 4.
I20260709 13:07:01.712656 20108 raft_consensus.cc:493] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:01.742820 20108 raft_consensus.cc:515] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:01.726786 20036 raft_consensus.cc:493] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:01.757845 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:01.758893 16206 raft_consensus.cc:2468] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 5.
I20260709 13:07:01.762637 20108 leader_election.cc:290] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:01.754047 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:01.769901 16206 raft_consensus.cc:1275] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:07:01.777086 16208 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60154 (request call id 2342) took 1051 ms. Trace:
I20260709 13:07:01.777549 16208 rpcz_store.cc:276] 0709 13:07:00.726064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.726182 (+   118us) service_pool.cc:224] Handling call
0709 13:07:01.776891 (+1050709us) spinlock_profiling.cc:243] Waited 418 ms on lock 0x7b54000b4ad4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:07:01.776992 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":960271744}
I20260709 13:07:01.775064 20032 leader_election.cc:290] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:01.782487 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:01.781065 16947 raft_consensus.cc:2468] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 11.
I20260709 13:07:01.760677 20036 raft_consensus.cc:515] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:01.788218 16349 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41832 (request call id 1951) took 1617 ms. Trace:
I20260709 13:07:01.788780 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:01.789608 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:01.790072 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:01.788841 20036 leader_election.cc:290] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:01.791360 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:01.788836 16349 rpcz_store.cc:276] 0709 13:07:00.170876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.171241 (+   365us) service_pool.cc:224] Handling call
0709 13:07:00.171731 (+   490us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:00.425803 (+254072us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:01.787910 (+1362107us) spinlock_profiling.cc:243] Waited 253 ms on lock 0x7b540026a554. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f489e01 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6
0709 13:07:01.788142 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":582424960}
W20260709 13:07:01.788916 16280 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45218 (request call id 2004) took 2761 ms (client timeout 2102 ms). Trace:
I20260709 13:07:01.790417 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:07:01.792584 16280 rpcz_store.cc:269] 0709 13:06:59.024491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:59.024640 (+   149us) service_pool.cc:224] Handling call
0709 13:07:01.785339 (+2760699us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b540004e554. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:07:01.785463 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2829537536}
I20260709 13:07:01.779078 20044 leader_election.cc:290] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:01.794845 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:01.795807 16206 raft_consensus.cc:2468] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 11.
I20260709 13:07:01.800251 20018 leader_election.cc:290] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:07:01.806581 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 55894.1us
I20260709 13:07:01.801885 20126 raft_consensus.cc:493] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:01.801499 20040 raft_consensus.cc:493] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:01.808780 20125 consensus_queue.cc:1048] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.007s
I20260709 13:07:01.812438 20040 raft_consensus.cc:3060] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:01.826833 16356 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41832 (request call id 1947) took 1657 ms (client timeout 1522 ms). Trace:
I20260709 13:07:01.812103 20126 raft_consensus.cc:515] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:07:01.827345 16356 rpcz_store.cc:269] 0709 13:07:00.169568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.169786 (+   218us) service_pool.cc:224] Handling call
0709 13:07:01.826513 (+1656727us) spinlock_profiling.cc:243] Waited 103 ms on lock 0x7b540032bc54. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:07:01.826750 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":235863296}
I20260709 13:07:01.860455 20052 leader_election.cc:290] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:01.850067 19821 leader_election.cc:290] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:01.868590 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:01.869361 16208 raft_consensus.cc:2468] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 7.
I20260709 13:07:01.870460 20126 leader_election.cc:290] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:07:01.871649 16246 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:01.876447 20053 raft_consensus.cc:493] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:01.877101 20053 raft_consensus.cc:515] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
W20260709 13:07:01.879010 16202 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60154 (request call id 2332) took 1340 ms (client timeout 1782 ms). Trace:
W20260709 13:07:01.879467 16202 rpcz_store.cc:269] 0709 13:07:00.538890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.539013 (+   123us) service_pool.cc:224] Handling call
0709 13:07:01.878841 (+1339828us) spinlock_profiling.cc:243] Waited 324 ms on lock 0x7b54000b5ed4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:07:01.878951 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":746240384}
I20260709 13:07:01.879037 16283 raft_consensus.cc:2468] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 8.
I20260709 13:07:01.880821 19831 raft_consensus.cc:493] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:01.881435 19831 raft_consensus.cc:515] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:01.883713 19831 leader_election.cc:290] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:01.888415 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:01.888432 20108 consensus_queue.cc:1048] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:01.889325 16206 raft_consensus.cc:2468] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 6.
I20260709 13:07:01.891841 16356 raft_consensus.cc:1275] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:07:01.891937 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:01.892841 16349 raft_consensus.cc:2468] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 8.
I20260709 13:07:01.835340 19978 leader_election.cc:290] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:01.893891 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:01.894711 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:01.895201 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:01.895439 16350 raft_consensus.cc:2468] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 6.
I20260709 13:07:01.896561 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:01.896756 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:01.897307 16173 leader_election.cc:304] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:07:01.893977 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:01.898134 20108 raft_consensus.cc:2804] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:01.898661 20108 raft_consensus.cc:493] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:01.898953 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:01.899030 20108 raft_consensus.cc:3060] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:01.899479 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:01.898072 16205 raft_consensus.cc:2468] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 9.
I20260709 13:07:01.900586 20075 leader_election.cc:290] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:01.894809 16351 raft_consensus.cc:2468] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 8.
I20260709 13:07:01.906610 20046 leader_election.cc:290] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:01.911844 16200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60154 (request call id 2331) took 1373 ms. Trace:
I20260709 13:07:01.912371 16200 rpcz_store.cc:276] 0709 13:07:00.538452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.538635 (+   183us) service_pool.cc:224] Handling call
0709 13:07:01.911570 (+1372935us) spinlock_profiling.cc:243] Waited 67.6 ms on lock 0x7b540038a9d4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:07:01.911757 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":155464960}
W20260709 13:07:01.889377 20127 log.cc:927] Time spent T 00000000000000000000000000000000 P 4dc6f08597514f4d85fd451b999b403e: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 13:07:01.904541 16173 leader_election.cc:304] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:07:01.899025 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:01.917789 16355 raft_consensus.cc:2468] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 10.
I20260709 13:07:01.918332 20036 raft_consensus.cc:2749] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:01.919163 16203 raft_consensus.cc:1275] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:07:01.919339 20040 raft_consensus.cc:515] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:01.922030 20040 leader_election.cc:290] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:01.923075 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:01.923870 16353 raft_consensus.cc:2468] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 5.
I20260709 13:07:01.925830 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:01.926620 16353 raft_consensus.cc:2468] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 8.
I20260709 13:07:01.928869 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:01.929589 16355 raft_consensus.cc:2468] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 7.
W20260709 13:07:01.932127 20118 log.cc:927] Time spent T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.545s	user 0.000s	sys 0.004s
I20260709 13:07:01.932240 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:01.934089 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:01.934670 16173 leader_election.cc:304] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:01.935694 20036 raft_consensus.cc:2764] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Leader election decision vote started in defunct term 8: won
I20260709 13:07:01.935860 16173 leader_election.cc:304] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:01.936900 16173 leader_election.cc:304] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:01.938498 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:01.939385 16200 raft_consensus.cc:3060] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:07:01.939656 16173 leader_election.cc:304] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:01.936877 20036 raft_consensus.cc:2804] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:07:01.940382 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 140976us
I20260709 13:07:01.945278 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c15d8e9be8414c84912ab77b66bfb1" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:01.951085 16173 leader_election.cc:304] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
W20260709 13:07:01.948966 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 137994us
I20260709 13:07:01.951181 16205 raft_consensus.cc:2393] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 9: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:07:01.952458 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:01.947337 16348 raft_consensus.cc:2468] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 12.
I20260709 13:07:01.954900 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:01.951012 16914 leader_election.cc:304] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:07:01.958636 16914 leader_election.cc:304] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:07:01.960018 16914 leader_election.cc:304] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:07:01.960368 20048 consensus_queue.cc:1048] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:01.961989 20130 raft_consensus.cc:2804] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:01.962540 20130 raft_consensus.cc:493] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:01.963039 20130 raft_consensus.cc:3060] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:01.966733 16914 leader_election.cc:400] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823) with higher term. Message: Invalid argument: T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 for earlier term 8. Current term is 9.
I20260709 13:07:01.966830 16320 leader_election.cc:304] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:01.970781 16914 leader_election.cc:403] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:01.943809 20027 raft_consensus.cc:2804] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:01.977594 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:07:01.988381 16947 raft_consensus.cc:3060] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:07:01.949661 20105 raft_consensus.cc:2804] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:01.990082 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:01.993629 16206 raft_consensus.cc:3060] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:01.991454 16320 leader_election.cc:304] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:01.952291 19978 raft_consensus.cc:493] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:01.952105 20046 raft_consensus.cc:493] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.007071 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:01.970358 20039 raft_consensus.cc:2804] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:01.999850 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:01.954205 20036 raft_consensus.cc:493] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:01.970139 19850 raft_consensus.cc:2804] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:01.998044 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:02.007720 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:07:02.011665 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 60656.7us
I20260709 13:07:02.013291 16352 raft_consensus.cc:2393] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 13: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:07:02.004350 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:01.969632 19941 raft_consensus.cc:493] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:01.999646 20066 raft_consensus.cc:2804] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:02.011708 16942 raft_consensus.cc:2468] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 7.
I20260709 13:07:01.988020 20027 raft_consensus.cc:493] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:01.993459 20105 raft_consensus.cc:493] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:02.024381 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:02.029716 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:02.030889 16173 leader_election.cc:304] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:02.009248 19940 raft_consensus.cc:2804] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:02.011399 19850 raft_consensus.cc:493] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:02.011219 20036 raft_consensus.cc:3060] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:02.011234 20039 raft_consensus.cc:493] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:02.041698 16947 raft_consensus.cc:2468] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 9.
I20260709 13:07:02.015885 20074 raft_consensus.cc:2804] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:01.998673 20064 consensus_queue.cc:1048] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 13:07:02.022450 20066 raft_consensus.cc:493] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:02.025730 20027 raft_consensus.cc:3060] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:02.021622 19941 raft_consensus.cc:515] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:02.048954 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:02.051437 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:02.028136 20105 raft_consensus.cc:3060] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:02.055393 16206 raft_consensus.cc:2468] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 5.
I20260709 13:07:02.006910 19978 raft_consensus.cc:515] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:02.063041 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:02.066190 16173 leader_election.cc:304] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:07:02.010984 20046 raft_consensus.cc:515] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } }
I20260709 13:07:02.056388 19850 raft_consensus.cc:3060] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:02.053326 16944 raft_consensus.cc:1240] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:02.025442 20091 consensus_queue.cc:1048] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
W20260709 13:07:02.068912 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 67029.5us
I20260709 13:07:02.075057 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:02.091265 16202 raft_consensus.cc:2368] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 for earlier term 8. Current term is 9.
I20260709 13:07:02.051959 19940 raft_consensus.cc:493] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:02.092182 19940 raft_consensus.cc:3060] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:02.095082 16320 leader_election.cc:304] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:02.096601 16320 leader_election.cc:304] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:02.061648 20039 raft_consensus.cc:3060] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:07:02.079610 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:02.101737 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:02.080837 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:02.103098 16353 raft_consensus.cc:2468] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 12.
I20260709 13:07:02.067179 20101 raft_consensus.cc:2804] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:02.084396 19978 leader_election.cc:290] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:02.086526 19941 leader_election.cc:290] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:02.102411 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:02.083878 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f022e2e63ae4461d834e476ff2666991" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
W20260709 13:07:02.109331 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 97321.4us
I20260709 13:07:02.119625 16206 raft_consensus.cc:1240] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:02.105331 16202 raft_consensus.cc:1275] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:07:02.069434 20066 raft_consensus.cc:3060] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:02.060477 20132 raft_consensus.cc:2749] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823) with higher term. Message: Invalid argument: T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 for earlier term 8. Current term is 9.
I20260709 13:07:02.099839 16320 leader_election.cc:304] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:02.110471 20052 raft_consensus.cc:2804] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:02.071107 20074 raft_consensus.cc:697] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:07:02.119895 16208 raft_consensus.cc:2468] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 7.
I20260709 13:07:02.097756 19850 raft_consensus.cc:515] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:02.140550 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:02.147017 16353 raft_consensus.cc:2393] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 6: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:07:02.107399 19862 raft_consensus.cc:2804] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:02.151361 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:02.105991 20101 raft_consensus.cc:493] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:02.168514 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:07:02.176700 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 85776.4us
I20260709 13:07:02.180734 16945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:02.181566 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:02.181984 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:02.119706 19869 raft_consensus.cc:493] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:02.126243 19978 raft_consensus.cc:2804] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:02.141950 20075 raft_consensus.cc:493] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.241366 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:02.243765 16353 raft_consensus.cc:2468] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 8.
I20260709 13:07:02.241992 16200 raft_consensus.cc:2468] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 13.
I20260709 13:07:02.189147 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:07:02.236368 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 47305.8us
I20260709 13:07:02.259132 16322 leader_election.cc:304] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:07:02.165509 20052 raft_consensus.cc:697] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:07:02.175680 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:02.179055 20101 raft_consensus.cc:3060] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:02.270869 16246 leader_election.cc:304] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:02.267727 16322 leader_election.cc:304] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:07:02.238473 19966 tablet_copy_client.cc:538] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:02.238265 20064 raft_consensus.cc:2804] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:02.285409 16246 leader_election.cc:304] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:02.282569 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:02.189808 20142 raft_consensus.cc:493] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.197930 19978 raft_consensus.cc:493] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:02.225654 19982 raft_consensus.cc:493] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:02.287569 16246 leader_election.cc:304] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:02.291617 16945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:02.314872 20026 raft_consensus.cc:2804] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:02.315575 20026 raft_consensus.cc:493] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:02.316006 20026 raft_consensus.cc:3060] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:02.319680 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:02.321468 16942 raft_consensus.cc:1240] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:02.287096 20064 raft_consensus.cc:493] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:02.291865 19985 raft_consensus.cc:2804] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:02.226361 19869 raft_consensus.cc:515] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:02.288728 20010 raft_consensus.cc:2804] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:02.339690 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:02.293087 19978 raft_consensus.cc:3060] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:02.344568 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:02.341715 16945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:02.346825 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:02.347625 16277 raft_consensus.cc:3060] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:02.353279 16945 raft_consensus.cc:2393] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 7: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
I20260709 13:07:02.274731 20075 raft_consensus.cc:515] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:02.333811 19821 raft_consensus.cc:2804] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:02.341576 20064 raft_consensus.cc:3060] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:02.364823 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 237687us
I20260709 13:07:02.361596 19862 raft_consensus.cc:697] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 9 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:02.340490 19985 raft_consensus.cc:493] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:02.379014 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:02.303334 19982 raft_consensus.cc:515] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:02.387897 16276 raft_consensus.cc:2468] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 13.
I20260709 13:07:02.394932 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:02.359516 16912 leader_election.cc:400] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 8 pre-election: Vote denied by peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073) with higher term. Message: Invalid argument: T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 for earlier term 8. Current term is 9.
I20260709 13:07:02.291589 20142 raft_consensus.cc:515] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:07:02.403474 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 58396.7us
I20260709 13:07:02.332351 20144 consensus_queue.cc:1048] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.062s
I20260709 13:07:02.402117 16277 raft_consensus.cc:2468] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 6.
I20260709 13:07:02.289135 20074 consensus_queue.cc:237] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:02.363324 20010 raft_consensus.cc:697] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:07:02.403100 16945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:02.412561 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:02.418798 16278 raft_consensus.cc:3060] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:02.386705 20148 log.cc:927] Time spent T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
I20260709 13:07:02.376200 19821 raft_consensus.cc:493] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:02.393230 19985 raft_consensus.cc:3060] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:02.359675 20143 consensus_queue.cc:1048] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.060s
W20260709 13:07:02.417464 20141 log.cc:927] Time spent T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 13:07:02.420794 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:07:02.419435 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 131933us
I20260709 13:07:02.421970 16281 raft_consensus.cc:3060] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:02.428989 16352 raft_consensus.cc:1275] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:07:02.424853 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:02.427826 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:07:02.422091 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 98511us
I20260709 13:07:02.437970 16276 raft_consensus.cc:2468] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 12.
W20260709 13:07:02.443168 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 377032us
I20260709 13:07:02.444434 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:02.444914 16173 leader_election.cc:304] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:07:02.359676 20052 consensus_queue.cc:237] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:07:02.455165 16322 connection.cc:256] RPC call timeout handler was delayed by -1.7681919379999727s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1795s for a response
I20260709 13:07:02.424983 19821 raft_consensus.cc:3060] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:02.459746 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:02.473459 16276 raft_consensus.cc:3060] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:02.463636 16283 raft_consensus.cc:1275] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:07:02.468616 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:02.468530 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:07:02.432080 20150 raft_consensus.cc:2804] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:02.430073 19980 raft_consensus.cc:493] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:02.478688 16246 leader_election.cc:304] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:02.479185 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c15d8e9be8414c84912ab77b66bfb1" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:02.484412 16280 raft_consensus.cc:2393] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 9: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:07:02.427345 20133 consensus_queue.cc:1059] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 13:07:02.465441 20106 leader_election.cc:290] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:02.459146 20140 raft_consensus.cc:2749] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:02.464915 19850 leader_election.cc:290] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 7 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:02.516436 16278 raft_consensus.cc:2468] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 7.
I20260709 13:07:02.519011 16281 raft_consensus.cc:2410] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:07:02.520649 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:02.469527 19862 consensus_queue.cc:237] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:07:02.533993 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 95260.6us
I20260709 13:07:02.535213 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:02.535954 16278 raft_consensus.cc:2468] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 8.
I20260709 13:07:02.534901 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:02.482889 20150 raft_consensus.cc:493] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:02.496738 20046 leader_election.cc:290] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:07:02.545210 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 85041.6us
I20260709 13:07:02.512856 20033 raft_consensus.cc:493] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
W20260709 13:07:02.554948 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 76310.2us
I20260709 13:07:02.554194 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:02.556921 16280 raft_consensus.cc:3060] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:02.558709 16276 raft_consensus.cc:2468] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 13.
I20260709 13:07:02.558313 16246 leader_election.cc:304] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:07:02.533803 20106 raft_consensus.cc:493] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.536453 20144 raft_consensus.cc:493] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:02.496930 19980 raft_consensus.cc:515] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:02.542297 20150 raft_consensus.cc:3060] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:02.564002 20130 consensus_meta.cc:287] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63: Time spent flushing consensus metadata: real 0.600s	user 0.012s	sys 0.000s
I20260709 13:07:02.575577 16280 raft_consensus.cc:2468] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 8.
W20260709 13:07:02.597097 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 213797us
I20260709 13:07:02.564723 19991 consensus_queue.cc:1059] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:07:02.575858 20053 leader_election.cc:290] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:02.569020 20033 raft_consensus.cc:515] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:02.546921 20010 consensus_queue.cc:237] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:02.576282 20075 leader_election.cc:290] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:02.575865 20152 raft_consensus.cc:493] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:02.572788 20154 raft_consensus.cc:2804] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:02.613274 16320 leader_election.cc:304] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:02.584790 20153 raft_consensus.cc:493] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:02.688000 20108 consensus_meta.cc:287] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f: Time spent flushing consensus metadata: real 0.788s	user 0.008s	sys 0.005s
I20260709 13:07:02.629504 20162 raft_consensus.cc:2804] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:07:02.688452 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 75274.8us
I20260709 13:07:02.688184 19821 raft_consensus.cc:515] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:02.650309 20149 raft_consensus.cc:493] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:02.565949 20161 consensus_queue.cc:1059] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
W20260709 13:07:02.619359 20151 log.cc:927] Time spent T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
W20260709 13:07:02.613274 20158 log.cc:927] Time spent T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
W20260709 13:07:02.703987 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 133655us
I20260709 13:07:02.598839 19982 leader_election.cc:290] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:02.612572 20165 raft_consensus.cc:493] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:02.711517 16349 raft_consensus.cc:1240] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:02.570941 20144 raft_consensus.cc:515] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:02.686726 20053 consensus_queue.cc:1048] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:02.687072 20142 leader_election.cc:290] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:02.687566 20167 raft_consensus.cc:493] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:02.688802 20162 raft_consensus.cc:493] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
W20260709 13:07:02.594139 20146 log.cc:927] Time spent T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63: Append to log took a long time: real 0.176s	user 0.001s	sys 0.000s
I20260709 13:07:02.567095 20106 raft_consensus.cc:515] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:02.584586 20130 raft_consensus.cc:515] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:02.708580 16246 leader_election.cc:304] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:02.712819 16322 leader_election.cc:304] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:02.722338 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:02.722048 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:02.717149 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:02.723181 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:02.681226 20154 raft_consensus.cc:493] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:02.726054 16351 raft_consensus.cc:1275] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:07:02.730230 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:02.746924 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:02.758635 16356 raft_consensus.cc:2468] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 8.
I20260709 13:07:02.693397 20075 consensus_queue.cc:1048] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
W20260709 13:07:02.765664 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 54656.8us
I20260709 13:07:02.774819 16946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:02.767051 20167 raft_consensus.cc:515] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:02.777751 20167 leader_election.cc:290] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:02.778450 20167 raft_consensus.cc:2804] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:02.778993 20167 raft_consensus.cc:697] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 5 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:02.780030 20167 consensus_queue.cc:237] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:02.783942 19821 leader_election.cc:290] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:02.784798 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:02.770499 16349 raft_consensus.cc:3060] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Advancing to term 7
W20260709 13:07:02.791627 20066 consensus_meta.cc:287] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 0.640s	user 0.010s	sys 0.003s
I20260709 13:07:02.792433 20066 raft_consensus.cc:515] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:02.795393 20066 leader_election.cc:290] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:02.803153 20066 consensus_queue.cc:1048] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:02.804925 20033 leader_election.cc:290] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:02.811318 16943 raft_consensus.cc:2393] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 10: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
I20260709 13:07:02.811039 16349 raft_consensus.cc:2468] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 7.
I20260709 13:07:02.812837 20130 leader_election.cc:290] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 10 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:02.815589 20106 leader_election.cc:290] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:07:02.816605 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 108100us
I20260709 13:07:02.818002 16246 leader_election.cc:304] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:07:02.820801 20161 raft_consensus.cc:2764] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:07:02.821696 20161 raft_consensus.cc:2804] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:02.822198 20161 raft_consensus.cc:493] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:02.822736 20161 raft_consensus.cc:3060] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:02.689610 20149 raft_consensus.cc:515] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:02.688472 20108 raft_consensus.cc:515] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:02.838073 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:07:02.852607 16246 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:02.844332 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:02.846696 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:07:02.847818 16200 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.112s	sys 0.089s
I20260709 13:07:02.847981 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:02.688234 20153 raft_consensus.cc:515] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:02.714910 20160 raft_consensus.cc:493] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:02.761885 20162 raft_consensus.cc:3060] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:02.859148 16200 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.524s	user 0.112s	sys 0.089s
I20260709 13:07:02.863984 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f022e2e63ae4461d834e476ff2666991" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
W20260709 13:07:02.852023 19940 consensus_meta.cc:287] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 0.759s	user 0.013s	sys 0.000s
W20260709 13:07:02.853083 16246 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:02.862756 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:02.772455 20154 raft_consensus.cc:3060] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:02.712767 20152 raft_consensus.cc:515] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:02.898272 16277 raft_consensus.cc:1240] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:02.896680 16202 raft_consensus.cc:1240] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:02.764207 20046 consensus_queue.cc:1059] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.119s
I20260709 13:07:02.882766 16348 raft_consensus.cc:2468] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 10.
I20260709 13:07:02.903650 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:07:02.869850 20157 log.cc:927] Time spent T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.289s	user 0.001s	sys 0.000s
I20260709 13:07:02.727082 20165 raft_consensus.cc:515] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:02.917562 16276 raft_consensus.cc:1240] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:02.878239 20106 raft_consensus.cc:493] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.896133 20171 raft_consensus.cc:2804] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:02.924543 20171 raft_consensus.cc:493] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:02.924619 16940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:02.925110 20171 raft_consensus.cc:3060] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:02.927322 16276 raft_consensus.cc:1275] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:07:02.930507 20011 raft_consensus.cc:3055] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:02.931062 20011 raft_consensus.cc:740] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:07:02.931903 20011 consensus_queue.cc:260] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:02.880203 20160 raft_consensus.cc:515] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:02.936319 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:07:02.923096 20026 consensus_meta.cc:287] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 0.603s	user 0.009s	sys 0.006s
I20260709 13:07:02.933153 20011 raft_consensus.cc:3060] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:02.954926 16278 raft_consensus.cc:1240] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 12. Current term is 13. Ops: []
W20260709 13:07:02.952335 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 364940us
I20260709 13:07:02.961238 16248 leader_election.cc:304] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:07:02.935104 20106 raft_consensus.cc:515] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:02.912066 19940 raft_consensus.cc:515] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:07:02.976555 16277 raft_consensus.cc:1240] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:02.973951 16248 leader_election.cc:304] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:02.987175 16278 raft_consensus.cc:1240] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 6. Current term is 7. Ops: []
W20260709 13:07:02.987284 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 212632us
I20260709 13:07:02.989517 16248 leader_election.cc:304] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:07:02.974378 20105 consensus_meta.cc:287] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f: Time spent flushing consensus metadata: real 0.894s	user 0.011s	sys 0.002s
I20260709 13:07:02.966463 20168 raft_consensus.cc:2804] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:07:02.996821 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 355604us
I20260709 13:07:02.956576 20026 raft_consensus.cc:515] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:02.972062 19980 leader_election.cc:290] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:03.006877 16940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:03.007577 16940 raft_consensus.cc:2468] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 9.
I20260709 13:07:03.008260 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:07:02.989775 20036 consensus_meta.cc:287] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f: Time spent flushing consensus metadata: real 0.923s	user 0.005s	sys 0.009s
W20260709 13:07:02.995810 20039 consensus_meta.cc:287] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63: Time spent flushing consensus metadata: real 0.897s	user 0.012s	sys 0.001s
W20260709 13:07:03.015863 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 326252us
I20260709 13:07:03.016378 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:02.987812 19932 raft_consensus.cc:2749] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:03.013924 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:03.031584 16277 raft_consensus.cc:3060] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:03.028056 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:03.020781 20026 leader_election.cc:290] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:03.016901 16248 leader_election.cc:304] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63
W20260709 13:07:03.024374 16173 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:03.002938 20168 raft_consensus.cc:493] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:03.035418 16320 leader_election.cc:304] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:03.040907 20152 leader_election.cc:290] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:03.041685 20108 leader_election.cc:290] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:03.043073 20165 leader_election.cc:290] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:03.015187 20149 leader_election.cc:290] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:07:03.044615 19978 consensus_meta.cc:287] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 0.665s	user 0.011s	sys 0.000s
I20260709 13:07:03.027411 20142 consensus_queue.cc:1048] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 13:07:03.018362 20036 raft_consensus.cc:515] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:07:03.029335 20027 consensus_meta.cc:287] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f: Time spent flushing consensus metadata: real 0.950s	user 0.011s	sys 0.003s
I20260709 13:07:03.048208 19874 raft_consensus.cc:3060] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:03.030097 20039 raft_consensus.cc:515] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:03.052343 20106 leader_election.cc:290] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:03.074468 19821 raft_consensus.cc:493] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:03.055227 19940 leader_election.cc:290] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:07:03.058219 20101 consensus_meta.cc:287] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f: Time spent flushing consensus metadata: real 0.754s	user 0.010s	sys 0.002s
I20260709 13:07:03.059087 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:03.060421 16203 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60138 (request call id 2240) took 1315 ms. Trace:
I20260709 13:07:03.050190 20153 leader_election.cc:290] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:03.015412 20053 raft_consensus.cc:2749] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:03.068853 20009 raft_consensus.cc:493] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:03.132640 20009 raft_consensus.cc:515] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:03.134171 20036 leader_election.cc:290] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:03.070809 20000 raft_consensus.cc:493] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.136013 19966 tablet_bootstrap.cc:492] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap starting.
I20260709 13:07:03.135658 20000 raft_consensus.cc:515] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:03.135763 20126 consensus_queue.cc:1059] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:03.138077 20000 leader_election.cc:290] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:07:03.073556 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 56775us
I20260709 13:07:03.139004 16248 leader_election.cc:304] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:03.140172 16248 leader_election.cc:304] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:03.140218 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bc3c8ff9b84838a2664335d7e1582b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:03.141412 16248 leader_election.cc:304] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:03.076323 16277 raft_consensus.cc:2468] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 7.
I20260709 13:07:03.143169 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
W20260709 13:07:03.105504 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 69905.9us
I20260709 13:07:03.144894 16322 leader_election.cc:304] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:07:03.145460 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:03.001138 20105 raft_consensus.cc:515] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:03.146272 20132 raft_consensus.cc:3055] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:03.147074 20132 raft_consensus.cc:740] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:07:03.148026 20132 consensus_queue.cc:260] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:03.148713 20105 leader_election.cc:290] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:03.016477 20172 ts_tablet_manager.cc:933] T 540bfc4ad793452faea5b865343aacf7 P 1109f76a0b7b443a84c0327c8707bc63: Initiating tablet copy from peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073)
I20260709 13:07:03.075973 20168 raft_consensus.cc:3060] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:03.149623 19932 raft_consensus.cc:2764] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:07:03.126148 16278 raft_consensus.cc:2468] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 12.
I20260709 13:07:03.144896 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:03.101076 20160 leader_election.cc:290] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:03.126133 16203 rpcz_store.cc:276] 0709 13:07:01.744929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:01.745084 (+   155us) service_pool.cc:224] Handling call
0709 13:07:01.917315 (+172231us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:01.919637 (+  2322us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:03.060187 (+1140550us) spinlock_profiling.cc:243] Waited 172 ms on lock 0x7b540038a9d0. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f4888ad 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:07:03.060331 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":395145600}
I20260709 13:07:03.152799 16248 leader_election.cc:304] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:03.153805 16322 leader_election.cc:304] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:03.158980 16103 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38830 (request call id 228) took 4929 ms. Trace:
I20260709 13:07:03.036458 20161 raft_consensus.cc:515] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:03.110757 20026 raft_consensus.cc:2804] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:03.110944 20163 raft_consensus.cc:493] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.192816 16322 leader_election.cc:304] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:07:03.195595 16947 raft_consensus.cc:2393] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 4: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
I20260709 13:07:03.112128 20032 consensus_queue.cc:1059] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 13:07:03.105399 20173 consensus_queue.cc:1059] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 13:07:03.114812 19831 consensus_queue.cc:1048] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.077s
I20260709 13:07:03.120064 20175 raft_consensus.cc:493] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
W20260709 13:07:03.213059 20071 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.092s	user 0.015s	sys 0.020s
I20260709 13:07:03.148767 19869 leader_election.cc:290] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:03.188189 20010 raft_consensus.cc:2804] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:03.193537 20160 raft_consensus.cc:2749] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:03.120754 19978 raft_consensus.cc:515] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:07:03.240155 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 141194us
I20260709 13:07:03.264067 16914 leader_election.cc:304] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:07:03.162698 16248 leader_election.cc:304] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
W20260709 13:07:03.245266 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 209917us
I20260709 13:07:03.265522 20172 tablet_copy_client.cc:323] T 540bfc4ad793452faea5b865343aacf7 P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Beginning tablet copy session from remote peer at address 127.14.180.65:46073
I20260709 13:07:03.265908 16320 leader_election.cc:304] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:03.194029 19940 raft_consensus.cc:2749] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:03.124287 20108 consensus_queue.cc:1059] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.105s
I20260709 13:07:03.155391 20144 leader_election.cc:290] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:07:03.267437 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 104891us
I20260709 13:07:03.267923 20173 raft_consensus.cc:3055] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:03.268399 16248 leader_election.cc:304] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:03.268497 20173 raft_consensus.cc:740] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:07:03.213624 20009 leader_election.cc:290] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:03.193055 20026 raft_consensus.cc:493] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:03.159667 20153 raft_consensus.cc:2749] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:03.212853 20167 raft_consensus.cc:2749] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:03.230186 20164 raft_consensus.cc:2804] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:03.159909 20043 raft_consensus.cc:2749] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:03.277259 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:03.280681 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:03.281955 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:03.283021 19940 raft_consensus.cc:2804] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:03.284637 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:03.125718 20027 raft_consensus.cc:515] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:07:03.255388 20071 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.149s	user 0.015s	sys 0.022s
I20260709 13:07:03.295245 16322 leader_election.cc:304] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:03.156630 19821 raft_consensus.cc:515] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:03.240875 16103 rpcz_store.cc:276] 0709 13:06:58.223678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.237996 (+ 14318us) service_pool.cc:224] Handling call
0709 13:07:03.150119 (+4912123us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:58.803157 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:58.804126 (+   969us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:58.804195 (+    69us) write_op.cc:435] Acquired schema lock
0709 13:06:58.804217 (+    22us) tablet.cc:662] Decoding operations
0709 13:06:58.805571 (+  1354us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:58.805710 (+   139us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:58.805754 (+    44us) tablet.cc:685] Acquiring locks for 8 operations
0709 13:06:58.893188 (+ 87434us) tablet.cc:701] Row locks acquired
0709 13:06:58.930592 (+ 37404us) write_op.cc:260] PREPARE: finished
0709 13:06:58.976018 (+ 45426us) write_op.cc:270] Start()
0709 13:06:59.017402 (+ 41384us) write_op.cc:276] Timestamp: P: 1783602418947167 usec, L: 0
0709 13:06:59.020512 (+  3110us) op_driver.cc:348] REPLICATION: starting
0709 13:06:59.061103 (+ 40591us) log.cc:844] Serialized 3253 byte log entry
0709 13:07:01.277350 (+2216247us) op_driver.cc:464] REPLICATION: finished
0709 13:07:01.554129 (+276779us) write_op.cc:301] APPLY: starting
0709 13:07:01.555495 (+  1366us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:01.600280 (+ 44785us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:01.611962 (+ 11682us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:01.671655 (+ 59693us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:01.671977 (+   322us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0709 13:07:01.672049 (+    72us) write_op.cc:312] APPLY: finished
0709 13:07:01.672456 (+   407us) log.cc:844] Serialized 65 byte log entry
0709 13:07:01.672675 (+   219us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:01.672843 (+   168us) write_op.cc:454] Released schema lock
0709 13:07:01.672911 (+    68us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:01.673430 (+   519us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:01.673476 (+    46us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":6006,"reported_tablets":11,"child_traces":[["op",{"apply.queue_time_us":258320,"apply.run_cpu_time_us":4425,"apply.run_wall_time_us":129725,"num_ops":8,"prepare.queue_time_us":186098,"prepare.run_cpu_time_us":7019,"prepare.run_wall_time_us":258394,"replication_time_us":2255730,"thread_start_us":94219,"threads_started":2}]]}
I20260709 13:07:03.306146 19978 leader_election.cc:290] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:03.306869 16353 raft_consensus.cc:1240] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:03.159230 20101 raft_consensus.cc:515] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:07:03.308413 16201 raft_consensus.cc:3060] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:03.259150 20010 raft_consensus.cc:493] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:03.211845 20163 raft_consensus.cc:515] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:03.319686 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:07:03.323486 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 66904.5us
I20260709 13:07:03.421959 16208 raft_consensus.cc:1240] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 4. Current term is 5. Ops: []
W20260709 13:07:03.423111 16246 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:03.428752 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:07:03.427737 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 159409us
W20260709 13:07:03.429818 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 134659us
I20260709 13:07:03.430518 16322 leader_election.cc:304] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:03.430749 16248 leader_election.cc:304] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:03.431715 16322 leader_election.cc:304] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:03.431774 16248 leader_election.cc:304] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:03.433899 16248 leader_election.cc:304] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:07:03.436172 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:03.288887 20026 raft_consensus.cc:3060] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:03.314128 20009 raft_consensus.cc:2749] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:03.319448 20053 raft_consensus.cc:493] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:03.244549 20175 raft_consensus.cc:515] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:03.430934 20010 raft_consensus.cc:3060] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:03.468721 16246 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:03.321453 19940 raft_consensus.cc:697] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 13 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:03.315039 20128 raft_consensus.cc:3055] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:03.314307 20160 raft_consensus.cc:2749] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:03.307281 20192 raft_consensus.cc:2804] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:03.474844 16199 raft_consensus.cc:2468] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 8.
W20260709 13:07:03.484593 16915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:03.444681 20036 raft_consensus.cc:493] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:03.493434 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:03.493572 16322 leader_election.cc:304] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:03.318925 20194 consensus_queue.cc:1048] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.167s
I20260709 13:07:03.512683 16201 raft_consensus.cc:2468] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 13.
I20260709 13:07:03.489377 20128 raft_consensus.cc:740] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
W20260709 13:07:03.524199 20177 log.cc:927] Time spent T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.321s	user 0.000s	sys 0.001s
I20260709 13:07:03.298892 20173 consensus_queue.cc:260] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:07:03.493871 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 207490us
I20260709 13:07:03.434970 20171 raft_consensus.cc:515] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:03.479312 20053 raft_consensus.cc:515] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:07:03.675385 20186 log.cc:927] Time spent T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.361s	user 0.001s	sys 0.000s
W20260709 13:07:03.696441 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 262557us
W20260709 13:07:03.735847 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 232915us
I20260709 13:07:03.467674 19831 raft_consensus.cc:493] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:03.480285 20033 raft_consensus.cc:493] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:03.679075 19940 consensus_queue.cc:237] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:03.456724 19978 raft_consensus.cc:2749] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:03.467447 19841 raft_consensus.cc:2804] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:03.758782 16322 leader_election.cc:304] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:03.653853 20182 consensus_queue.cc:1048] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.048s
W20260709 13:07:03.772282 16173 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.662s	user 0.000s	sys 0.015s
W20260709 13:07:03.887184 16173 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.777s	user 0.000s	sys 0.015s
W20260709 13:07:03.887621 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 777954us
I20260709 13:07:03.797570 16201 raft_consensus.cc:1240] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:03.771035 20153 raft_consensus.cc:2749] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:07:03.890794 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 386091us
I20260709 13:07:03.807520 20132 raft_consensus.cc:3060] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:03.811694 16348 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33486 (request call id 540) took 1105 ms. Trace:
W20260709 13:07:03.826601 16947 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40078 (request call id 430) took 1764 ms (client timeout 1766 ms). Trace:
I20260709 13:07:03.827637 16948 raft_consensus.cc:1240] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:03.832804 16353 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33486 (request call id 547) took 1122 ms. Trace:
I20260709 13:07:03.833531 16217 tablet_copy_service.cc:140] P e10b16d536674c0bb350a31d7ce5ff7f: Received BeginTabletCopySession request for tablet 540bfc4ad793452faea5b865343aacf7 from peer 1109f76a0b7b443a84c0327c8707bc63 ({username='slave'} at 127.0.0.1:39674)
W20260709 13:07:03.778332 20185 log.cc:927] Time spent T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.310s	user 0.006s	sys 0.003s
I20260709 13:07:03.758596 19979 raft_consensus.cc:2749] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:07:03.786227 20179 log.cc:927] Time spent T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.667s	user 0.001s	sys 0.014s
W20260709 13:07:03.791235 20064 consensus_meta.cc:287] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 1.388s	user 0.012s	sys 0.013s
W20260709 13:07:03.790853 20150 consensus_meta.cc:287] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 1.212s	user 0.022s	sys 0.000s
I20260709 13:07:03.773584 20144 raft_consensus.cc:2804] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:03.767030 20192 raft_consensus.cc:697] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 LEADER]: Becoming Leader. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:07:03.773420 20140 raft_consensus.cc:493] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.854000 16248 leader_election.cc:304] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:07:03.876093 16281 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.779s	user 0.031s	sys 0.041s
W20260709 13:07:03.880815 16247 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.030s	sys 0.029s
I20260709 13:07:03.892200 16322 leader_election.cc:304] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:03.891629 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:03.888602 16173 leader_election.cc:304] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:03.767059 20036 raft_consensus.cc:515] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:07:04.113947 16247 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.803s	user 0.030s	sys 0.049s
I20260709 13:07:03.896251 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
W20260709 13:07:04.116868 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 224737us
I20260709 13:07:04.090149 16202 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39674 (request call id 821) took 1543 ms. Trace:
W20260709 13:07:04.108631 16943 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40078 (request call id 426) took 2120 ms (client timeout 2199 ms). Trace:
I20260709 13:07:04.118221 16322 leader_election.cc:304] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:04.117019 16106 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38840 (request call id 204) took 5082 ms. Trace:
I20260709 13:07:04.111393 16276 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45218 (request call id 2059) took 1172 ms. Trace:
W20260709 13:07:04.120086 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 231528us
I20260709 13:07:04.120059 16202 rpcz_store.cc:276] 0709 13:07:02.546596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.546802 (+   206us) service_pool.cc:224] Handling call
0709 13:07:02.560229 (+ 13427us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:02.905279 (+345050us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:04.089778 (+1184499us) spinlock_profiling.cc:243] Waited 336 ms on lock 0x7b54003769d4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f489e01 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6
0709 13:07:04.090065 (+   287us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":773315840}
W20260709 13:07:04.119666 16281 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.022s	user 0.031s	sys 0.052s
I20260709 13:07:04.119524 16200 raft_consensus.cc:2468] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 11.
I20260709 13:07:04.121250 16173 leader_election.cc:304] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:07:03.852375 20199 raft_consensus.cc:2749] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:04.118956 16353 rpcz_store.cc:276] 0709 13:07:02.710438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.749004 (+ 38566us) service_pool.cc:224] Handling call
0709 13:07:02.803106 (+ 54102us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:03.442518 (+639412us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:03.832547 (+390029us) spinlock_profiling.cc:243] Waited 503 ms on lock 0x7b5400296dd4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f489e01 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6
0709 13:07:03.832744 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1157973760}
W20260709 13:07:04.118116 16943 rpcz_store.cc:269] 0709 13:07:01.988318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:01.988560 (+   242us) service_pool.cc:224] Handling call
0709 13:07:04.108271 (+2119711us) spinlock_profiling.cc:243] Waited 803 ms on lock 0x7b540040f1d4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:07:04.108493 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1847390976}
W20260709 13:07:04.113950 16947 rpcz_store.cc:269] 0709 13:07:02.062353 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.062597 (+   244us) service_pool.cc:224] Handling call
0709 13:07:03.826304 (+1763707us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b54005d9154. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:07:03.826496 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2578016128}
I20260709 13:07:04.125501 16173 leader_election.cc:304] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:07:03.853986 20039 leader_election.cc:290] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 4 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:03.883813 19966 tablet_bootstrap.cc:700] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63: Time spent opening tablet: real 0.183s	user 0.005s	sys 0.002s
I20260709 13:07:04.120481 16276 rpcz_store.cc:276] 0709 13:07:02.939025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.939252 (+   227us) service_pool.cc:224] Handling call
0709 13:07:02.958658 (+ 19406us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:02.959146 (+   488us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:02.959186 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:02.977848 (+ 18662us) log.cc:844] Serialized 506 byte log entry
0709 13:07:03.125263 (+147415us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:03.153942 (+ 28679us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:03.154041 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:04.111030 (+956989us) raft_consensus.cc:1685] finished
0709 13:07:04.111064 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:04.111293 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":105604,"threads_started":1,"wal-append.queue_time_us":207516}
I20260709 13:07:03.887247 19841 raft_consensus.cc:493] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:03.857636 20160 raft_consensus.cc:2804] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:07:04.094750 20184 log.cc:927] Time spent T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.245s	user 0.001s	sys 0.000s
W20260709 13:07:04.174201 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 48769.2us
I20260709 13:07:03.875469 19831 raft_consensus.cc:515] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:04.169236 16322 leader_election.cc:304] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:04.205034 16201 raft_consensus.cc:1275] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 13:07:04.093843 20188 log.cc:927] Time spent T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.309s	user 0.000s	sys 0.001s
W20260709 13:07:04.146203 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 292273us
W20260709 13:07:04.130813 20026 consensus_meta.cc:287] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 0.668s	user 0.002s	sys 0.009s
W20260709 13:07:04.100925 20162 consensus_meta.cc:287] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3: Time spent flushing consensus metadata: real 1.187s	user 0.001s	sys 0.015s
I20260709 13:07:04.147262 16281 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45218 (request call id 2053) took 1243 ms. Trace:
I20260709 13:07:04.192782 16348 rpcz_store.cc:276] 0709 13:07:02.705958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.706090 (+   132us) service_pool.cc:224] Handling call
0709 13:07:03.811427 (+1105337us) spinlock_profiling.cc:243] Waited 124 ms on lock 0x7b5400308ed4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:07:03.811604 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":285629184}
W20260709 13:07:04.136129 20168 consensus_meta.cc:287] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3: Time spent flushing consensus metadata: real 0.986s	user 0.011s	sys 0.003s
I20260709 13:07:04.231034 20168 raft_consensus.cc:515] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:04.232117 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f022e2e63ae4461d834e476ff2666991" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:07:03.998466 20053 leader_election.cc:290] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:03.996845 20027 leader_election.cc:290] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:04.233275 20168 leader_election.cc:290] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 election: Requested vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:04.233522 20027 raft_consensus.cc:2749] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:04.234114 20182 raft_consensus.cc:2749] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:07:04.135150 19862 raft_consensus.cc:2804] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:04.234889 19862 raft_consensus.cc:697] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 8 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:04.235843 19862 consensus_queue.cc:237] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:04.119313 16106 rpcz_store.cc:276] 0709 13:06:59.035106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:59.035262 (+   156us) service_pool.cc:224] Handling call
0709 13:06:59.084170 (+ 48908us) spinlock_profiling.cc:243] Waited 25.3 ms on lock 0x7b5400137754. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f3090 00007f361f491f3a 00007f36252481cc 00007f362534637e 00007f36238072a4 00007f3623807232 00007f3623807161 00007f36238070dc 00007f3623806392 00007f361d7c448c 00007f361d7c38c6
0709 13:07:04.116953 (+5032783us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:59.214699 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:59.403244 (+188545us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:59.406081 (+  2837us) write_op.cc:435] Acquired schema lock
0709 13:06:59.406104 (+    23us) tablet.cc:662] Decoding operations
0709 13:06:59.476725 (+ 70621us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:59.482760 (+  6035us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:59.486344 (+  3584us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:06:59.520958 (+ 34614us) tablet.cc:701] Row locks acquired
0709 13:06:59.520986 (+    28us) write_op.cc:260] PREPARE: finished
0709 13:06:59.833100 (+312114us) write_op.cc:270] Start()
0709 13:06:59.856329 (+ 23229us) write_op.cc:276] Timestamp: P: 1783602419817650 usec, L: 0
0709 13:06:59.856385 (+    56us) op_driver.cc:348] REPLICATION: starting
0709 13:07:01.437177 (+1580792us) log.cc:844] Serialized 599 byte log entry
0709 13:07:01.683376 (+246199us) spinlock_profiling.cc:243] Waited 51.1 ms on lock 0x7b4400022b4c. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361c224db1 00007f361c2c2c85 00007f361c2c36a2 00007f361f0351db 00007f361f030aaf 00007f361c37f0ac 00007f36251d9ab9 00007f361c39b69b 00007f361c39993f 00007f361c39bc02 00007f361f02320b
0709 13:07:02.092823 (+409447us) spinlock_profiling.cc:243] Waited 1.46 s on lock 0x7b5400137754. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f484e28 00007f3622ebf581 00007f3622ebed58 00007f3622ec39f1 00007f3622ec39a9 00007f3622ec3939 00007f3622ec3901 00007f3622ec2b2d 000000000038f354 000000000038f199
0709 13:07:02.123492 (+ 30669us) op_driver.cc:464] REPLICATION: finished
0709 13:07:02.178766 (+ 55274us) write_op.cc:301] APPLY: starting
0709 13:07:02.185982 (+  7216us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:02.239616 (+ 53634us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:02.244658 (+  5042us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:02.283565 (+ 38907us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:02.307396 (+ 23831us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:07:02.328414 (+ 21018us) write_op.cc:312] APPLY: finished
0709 13:07:02.352748 (+ 24334us) log.cc:844] Serialized 23 byte log entry
0709 13:07:02.367121 (+ 14373us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:02.381076 (+ 13955us) write_op.cc:454] Released schema lock
0709 13:07:02.384631 (+  3555us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:02.426960 (+ 42329us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:02.429576 (+  2616us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":756645,"reported_tablets":1,"spinlock_wait_cycles":58123648,"child_traces":[["op",{"apply.queue_time_us":15545,"apply.run_cpu_time_us":2711,"apply.run_wall_time_us":236109,"num_ops":1,"prepare.queue_time_us":1533,"prepare.run_cpu_time_us":55391,"prepare.run_wall_time_us":2895110,"raft.queue_time_us":149463,"raft.run_cpu_time_us":989,"raft.run_wall_time_us":80046,"replication_time_us":2217981,"spinlock_wait_cycles":3471989760,"thread_start_us":405509,"threads_started":2,"wal-append.queue_time_us":356133,"wal-append.run_cpu_time_us":16305,"wal-append.run_wall_time_us":1638694}]]}
I20260709 13:07:04.176566 19869 raft_consensus.cc:2749] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:07:04.204128 19874 consensus_meta.cc:287] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3: Time spent flushing consensus metadata: real 1.077s	user 0.013s	sys 0.007s
I20260709 13:07:04.092523 20171 leader_election.cc:290] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:04.100962 20161 leader_election.cc:290] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:04.243757 16274 raft_consensus.cc:1275] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:07:04.209010 20150 raft_consensus.cc:515] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:04.105048 20163 leader_election.cc:290] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:07:04.226208 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 57103.6us
I20260709 13:07:04.245857 20150 leader_election.cc:290] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:04.246023 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:04.246457 16353 raft_consensus.cc:1240] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:04.246888 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:04.249431 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:04.250676 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:07:03.881209 20033 raft_consensus.cc:515] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:07:04.253752 16173 connection.cc:256] RPC call timeout handler was delayed by -1.1694651409999324s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21280000000000002s for a response
W20260709 13:07:04.254415 16173 connection.cc:256] RPC call timeout handler was delayed by -1.1541651409999076s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21450000000000002s for a response
I20260709 13:07:04.227449 16281 rpcz_store.cc:276] 0709 13:07:02.903599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.903798 (+   199us) service_pool.cc:224] Handling call
0709 13:07:02.922084 (+ 18286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:02.922390 (+   306us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:07:03.097185 (+174795us) log.cc:844] Serialized 14 byte log entry
0709 13:07:04.146726 (+1049541us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:04.146811 (+    85us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:04.146880 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:04.146982 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:04.147178 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24269,"prepare.queue_time_us":232299,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":10575,"thread_start_us":1168881,"threads_started":2}
W20260709 13:07:04.254897 16173 connection.cc:256] RPC call timeout handler was delayed by -1.135252252999976s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1511s for a response
I20260709 13:07:04.229338 16201 raft_consensus.cc:1240] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:04.272838 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:04.273578 16357 raft_consensus.cc:2393] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 7: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:07:04.229969 20046 raft_consensus.cc:493] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.274614 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:04.274907 20046 raft_consensus.cc:515] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:04.276285 20074 raft_consensus.cc:3055] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:04.128751 20180 raft_consensus.cc:2749] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:04.234243 20027 raft_consensus.cc:2804] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:03.995652 19982 raft_consensus.cc:3055] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:04.226171 16248 leader_election.cc:304] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:04.244478 20159 raft_consensus.cc:493] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.254586 16277 raft_consensus.cc:2393] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 in current term 10: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:07:04.228628 20162 raft_consensus.cc:515] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:04.257790 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:04.012485 19849 raft_consensus.cc:493] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.292917 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:04.293823 16348 raft_consensus.cc:2368] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for earlier term 8. Current term is 9.
I20260709 13:07:04.208575 16217 tablet_copy_service.cc:161] P e10b16d536674c0bb350a31d7ce5ff7f: Beginning new tablet copy session on tablet 540bfc4ad793452faea5b865343aacf7 from peer 1109f76a0b7b443a84c0327c8707bc63 at {username='slave'} at 127.0.0.1:39674: session id = 1109f76a0b7b443a84c0327c8707bc63-540bfc4ad793452faea5b865343aacf7
W20260709 13:07:04.139261 20202 log.cc:927] Time spent T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.356s	user 0.003s	sys 0.000s
I20260709 13:07:03.902340 20071 raft_consensus.cc:2804] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:04.086032 20164 raft_consensus.cc:493] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:04.069684 20101 leader_election.cc:290] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:04.123536 20105 raft_consensus.cc:2804] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:04.264653 16352 raft_consensus.cc:1275] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:07:03.948841 20048 raft_consensus.cc:493] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:04.323488 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c15d8e9be8414c84912ab77b66bfb1" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:04.006868 19821 leader_election.cc:290] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:04.269201 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:04.269528 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:04.269311 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c15d8e9be8414c84912ab77b66bfb1" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:04.271224 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:04.330349 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f022e2e63ae4461d834e476ff2666991" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:04.174873 20144 raft_consensus.cc:697] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 6 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:04.205453 19841 raft_consensus.cc:3060] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:04.348839 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:04.297936 20159 raft_consensus.cc:515] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:04.355034 19831 leader_election.cc:290] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:07:04.355710 20010 consensus_meta.cc:287] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3: Time spent flushing consensus metadata: real 0.861s	user 0.009s	sys 0.003s
I20260709 13:07:04.356151 20010 raft_consensus.cc:515] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:04.129884 20175 leader_election.cc:290] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:04.360533 20162 leader_election.cc:290] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:07:04.279635 16913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:04.278501 16173 connection.cc:256] RPC call timeout handler was delayed by -1.1101110109999581s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20520000000000002s for a response
W20260709 13:07:04.287034 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 60961.4us
W20260709 13:07:04.287998 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 496611us
I20260709 13:07:04.206670 20160 raft_consensus.cc:493] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
W20260709 13:07:04.265247 20154 consensus_meta.cc:287] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3: Time spent flushing consensus metadata: real 1.344s	user 0.011s	sys 0.005s
I20260709 13:07:04.279436 19982 raft_consensus.cc:740] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:07:04.279953 20027 raft_consensus.cc:493] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:04.296419 19849 raft_consensus.cc:515] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:04.298383 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:04.276731 20074 raft_consensus.cc:740] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:07:04.301040 16357 raft_consensus.cc:1275] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:07:04.123214 20064 raft_consensus.cc:515] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:04.305886 16204 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60138 (request call id 2257) took 1312 ms. Trace:
I20260709 13:07:04.306828 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:07:04.299333 19985 consensus_meta.cc:287] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3: Time spent flushing consensus metadata: real 1.858s	user 0.011s	sys 0.013s
I20260709 13:07:04.132571 20140 raft_consensus.cc:515] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:04.311005 16279 raft_consensus.cc:1240] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 5. Current term is 6. Ops: []
W20260709 13:07:04.313151 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:04.263576 20026 raft_consensus.cc:515] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:04.324349 16352 raft_consensus.cc:2393] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 9: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:07:04.321802 16282 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42740 (request call id 651) took 2076 ms. Trace:
I20260709 13:07:04.334810 16281 raft_consensus.cc:2393] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 7: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:07:04.305393 20046 leader_election.cc:290] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:04.304306 20197 raft_consensus.cc:2749] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:03.941700 20128 consensus_queue.cc:260] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:04.302624 20164 raft_consensus.cc:3060] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:04.317358 20105 raft_consensus.cc:493] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:04.334084 20048 raft_consensus.cc:515] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:04.320223 20071 raft_consensus.cc:697] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 7 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
W20260709 13:07:04.337672 20052 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.500s	user 0.018s	sys 0.029s
I20260709 13:07:04.370296 16320 leader_election.cc:304] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:04.376442 16348 raft_consensus.cc:2468] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 6.
I20260709 13:07:04.377094 16280 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45218 (request call id 2056) took 1455 ms. Trace:
I20260709 13:07:04.329239 20192 consensus_queue.cc:237] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:04.429136 16206 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60154 (request call id 2376) took 1151 ms. Trace:
I20260709 13:07:04.428086 16280 rpcz_store.cc:276] 0709 13:07:02.921398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.921567 (+   169us) service_pool.cc:224] Handling call
0709 13:07:02.949872 (+ 28305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:02.950257 (+   385us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:02.950286 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:02.962301 (+ 12015us) log.cc:844] Serialized 26 byte log entry
0709 13:07:03.211930 (+249629us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:03.211989 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:03.216566 (+  4577us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:04.376777 (+1160211us) raft_consensus.cc:1685] finished
0709 13:07:04.376810 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:04.377020 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":298,"raft.run_cpu_time_us":201,"raft.run_wall_time_us":11964,"thread_start_us":224778,"threads_started":1,"wal-append.queue_time_us":531956}
I20260709 13:07:04.429538 16206 rpcz_store.cc:276] 0709 13:07:03.277505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:03.654426 (+376921us) service_pool.cc:224] Handling call
0709 13:07:03.758752 (+104326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:04.258235 (+499483us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:04.258265 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:04.258303 (+    38us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:04.258334 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:04.428878 (+170544us) spinlock_profiling.cc:243] Waited 499 ms on lock 0x7b54000b63d4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f489e01 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6
0709 13:07:04.428933 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:04.429076 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1148081024}
I20260709 13:07:04.430707 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:04.431178 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:04.431396 16280 raft_consensus.cc:3060] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:04.375272 16204 rpcz_store.cc:276] 0709 13:07:02.993480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.993632 (+   152us) service_pool.cc:224] Handling call
0709 13:07:02.994131 (+   499us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:02.995903 (+  1772us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:02.995956 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:03.009765 (+ 13809us) log.cc:844] Serialized 26 byte log entry
0709 13:07:03.207981 (+198216us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:07:03.208023 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:03.208105 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:04.305623 (+1097518us) raft_consensus.cc:1685] finished
0709 13:07:04.305646 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:04.305799 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2004,"raft.run_cpu_time_us":205,"raft.run_wall_time_us":11464,"thread_start_us":165025,"threads_started":1,"wal-append.queue_time_us":620474}
I20260709 13:07:04.364774 20180 raft_consensus.cc:493] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.381295 16203 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60154 (request call id 2369) took 1106 ms. Trace:
I20260709 13:07:04.367460 20160 raft_consensus.cc:3060] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:04.438277 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:04.441749 16348 raft_consensus.cc:2393] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 8: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:07:04.380731 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:07:04.427091 20052 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.590s	user 0.018s	sys 0.030s
I20260709 13:07:04.444754 16353 raft_consensus.cc:2468] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 7.
I20260709 13:07:04.423014 20105 raft_consensus.cc:3060] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:07:04.451016 16912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:04.405511 16282 rpcz_store.cc:276] 0709 13:07:02.245526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.245687 (+   161us) service_pool.cc:224] Handling call
0709 13:07:02.268791 (+ 23104us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:02.286857 (+ 18066us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:02.286925 (+    68us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:02.287402 (+   477us) log.cc:844] Serialized 26 byte log entry
0709 13:07:03.001071 (+713669us) spinlock_profiling.cc:243] Waited 7.44 ms on lock 0x7b18001c7ce0. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f3625264de1 00007f36252715b1 00007f361c37ee07 00007f36251d9ab9 00007f361c39b69b 00007f361c39993f 00007f361c39bc02 00007f361f02320b 00007f361f028d23 00007f361f0290d1 00007f361f444a0f
0709 13:07:03.160710 (+159639us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:03.160773 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:03.160877 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:04.306187 (+1145310us) raft_consensus.cc:1685] finished
0709 13:07:04.306218 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:04.321715 (+ 15497us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":675,"raft.run_cpu_time_us":204,"raft.run_wall_time_us":18811,"spinlock_wait_cycles":17105792,"thread_start_us":159390,"threads_started":1,"wal-append.queue_time_us":1005804}
I20260709 13:07:04.372242 20027 raft_consensus.cc:3060] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:04.364625 16248 leader_election.cc:304] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:07:04.380599 19985 raft_consensus.cc:515] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:04.423166 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:04.433518 19831 raft_consensus.cc:493] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:04.415923 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
W20260709 13:07:04.427603 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 57482.7us
W20260709 13:07:04.433141 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 70187.5us
I20260709 13:07:04.434110 16201 raft_consensus.cc:1240] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:04.434475 16203 rpcz_store.cc:276] 0709 13:07:03.275308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:03.278355 (+  3047us) service_pool.cc:224] Handling call
0709 13:07:03.278858 (+   503us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:03.279223 (+   365us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:03.279249 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:03.294675 (+ 15426us) log.cc:844] Serialized 26 byte log entry
0709 13:07:03.317946 (+ 23271us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:03.317991 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:03.318066 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:04.105909 (+787843us) spinlock_profiling.cc:243] Waited 12.9 ms on lock 0x7b4400022b4c. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361c224db1 00007f361c2c2c85 00007f361c2c36a2 00007f361f0351db 00007f361f030aaf 00007f361f02486e 00007f361f023bb6 00007f361f0237d8 00007f361f02d221 00007f361f02d1d9 00007f361f02d169
0709 13:07:04.376191 (+270282us) raft_consensus.cc:1685] finished
0709 13:07:04.376225 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:04.381209 (+  4984us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":87,"raft.run_cpu_time_us":226,"raft.run_wall_time_us":16462,"spinlock_wait_cycles":29766016,"thread_start_us":10910,"threads_started":1,"wal-append.queue_time_us":141383}
I20260709 13:07:04.409965 20218 raft_consensus.cc:493] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.373035 20154 raft_consensus.cc:515] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:04.416450 16207 raft_consensus.cc:1275] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:07:04.365366 20033 leader_election.cc:290] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:04.434185 20171 raft_consensus.cc:2804] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:04.574322 16275 raft_consensus.cc:1240] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 9. Current term is 10. Ops: []
W20260709 13:07:04.540658 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 176109us
I20260709 13:07:04.542232 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:04.542855 20182 consensus_queue.cc:1059] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:04.543159 20026 leader_election.cc:290] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:04.441954 20180 raft_consensus.cc:515] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:04.545028 20071 consensus_queue.cc:237] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:04.441663 20128 raft_consensus.cc:3060] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:04.445672 20159 leader_election.cc:290] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:04.549481 19985 leader_election.cc:290] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:04.459908 20144 consensus_queue.cc:237] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:04.422698 19982 consensus_queue.cc:260] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:04.543732 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:04.552076 20101 raft_consensus.cc:493] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:04.560315 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:04.621191 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:04.560563 20046 raft_consensus.cc:493] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:04.561777 20207 consensus_queue.cc:1059] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:04.598013 16352 raft_consensus.cc:1240] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:04.578675 16248 leader_election.cc:304] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:04.630774 16278 raft_consensus.cc:1240] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:04.380731 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:04.612396 16281 raft_consensus.cc:2468] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 8.
I20260709 13:07:04.615861 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:04.573635 20197 raft_consensus.cc:2804] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:07:04.545059 20213 log.cc:927] Time spent T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.180s	user 0.000s	sys 0.001s
I20260709 13:07:04.622784 16280 raft_consensus.cc:2468] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 4.
I20260709 13:07:04.646104 16276 raft_consensus.cc:3060] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:07:04.650508 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 71976.3us
I20260709 13:07:04.616174 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:07:04.613420 20206 log.cc:927] Time spent T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.349s	user 0.000s	sys 0.001s
I20260709 13:07:04.590112 20180 leader_election.cc:290] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:04.679616 16208 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39674 (request call id 818) took 2325 ms. Trace:
I20260709 13:07:04.681696 16208 rpcz_store.cc:276] 0709 13:07:02.327600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.327756 (+   156us) service_pool.cc:224] Handling call
0709 13:07:02.328116 (+   360us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:03.435674 (+1107558us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:04.653005 (+1217331us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b54003d0754. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f489e01 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6
0709 13:07:04.653213 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2515088128}
I20260709 13:07:04.684087 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f022e2e63ae4461d834e476ff2666991" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:07:04.613009 20010 leader_election.cc:290] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:07:04.686148 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 306049us
I20260709 13:07:04.687932 16349 raft_consensus.cc:1240] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 8 LEADER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:04.629163 20165 raft_consensus.cc:3055] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:04.691087 20165 raft_consensus.cc:740] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
W20260709 13:07:04.690631 16914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:04.443903 20074 consensus_queue.cc:260] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:04.576013 19831 raft_consensus.cc:515] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:04.596197 20218 raft_consensus.cc:515] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:04.891129 15057 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:04.835749 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:05.429034 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:04.771811 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:05.430825 16278 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42740 (request call id 659) took 2360 ms. Trace:
I20260709 13:07:05.431747 16279 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42740 (request call id 657) took 2363 ms. Trace:
W20260709 13:07:05.432780 16277 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42740 (request call id 658) took 2364 ms (client timeout 1570 ms). Trace:
W20260709 13:07:04.746264 16913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:04.907838 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:04.969007 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:05.431514 16275 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45210 (request call id 2095) took 3014 ms. Trace:
I20260709 13:07:05.461822 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:05.462049 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:05.462523 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
W20260709 13:07:04.934013 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:05.463323 16947 raft_consensus.cc:2468] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 7.
I20260709 13:07:04.835510 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:04.764441 16274 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45210 (request call id 2073) took 3449 ms. Trace:
I20260709 13:07:04.786758 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:04.741231 16276 raft_consensus.cc:2468] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 12.
I20260709 13:07:05.435359 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:04.706120 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c15d8e9be8414c84912ab77b66bfb1" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:07:05.449714 16912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:04.760736 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 180619us
I20260709 13:07:05.466842 16282 raft_consensus.cc:2468] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 7.
W20260709 13:07:05.433212 16277 rpcz_store.cc:269] 0709 13:07:03.068188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:03.142843 (+ 74655us) service_pool.cc:224] Handling call
0709 13:07:05.432570 (+2289727us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b540031c754. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:07:05.432696 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2554006784}
I20260709 13:07:05.470403 16355 raft_consensus.cc:2393] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 9: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:07:05.432411 16279 rpcz_store.cc:276] 0709 13:07:03.067922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:03.149107 (+ 81185us) service_pool.cc:224] Handling call
0709 13:07:03.149404 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:04.379281 (+1229877us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:05.431513 (+1052232us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b54001f54d4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f489e01 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6
0709 13:07:05.431690 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2670747392}
I20260709 13:07:05.471979 16282 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45218 (request call id 2069) took 1156 ms. Trace:
W20260709 13:07:05.472676 16173 leader_election.cc:336] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 1.522s (SENT)
I20260709 13:07:05.477775 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
W20260709 13:07:04.906525 20155 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.983s	user 0.019s	sys 0.022s
W20260709 13:07:05.017010 20132 consensus_meta.cc:287] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63: Time spent flushing consensus metadata: real 0.892s	user 0.006s	sys 0.006s
I20260709 13:07:05.476296 16282 rpcz_store.cc:276] 0709 13:07:04.316049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.755569 (+439520us) service_pool.cc:224] Handling call
0709 13:07:05.471926 (+716357us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:05.491397 16350 raft_consensus.cc:1275] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:07:04.677022 20159 raft_consensus.cc:2749] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:05.481138 16276 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45218 (request call id 2073) took 1147 ms. Trace:
I20260709 13:07:05.492977 16276 rpcz_store.cc:276] 0709 13:07:04.320784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.348433 (+ 27649us) service_pool.cc:224] Handling call
0709 13:07:05.468495 (+1120062us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:05.431262 16278 rpcz_store.cc:276] 0709 13:07:03.070483 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:03.150610 (+ 80127us) service_pool.cc:224] Handling call
0709 13:07:03.196348 (+ 45738us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:04.653514 (+1457166us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:05.430568 (+777054us) spinlock_profiling.cc:243] Waited 1.43 s on lock 0x7b5400389354. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f489e01 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6
0709 13:07:05.430767 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3297761536}
I20260709 13:07:05.466181 16274 rpcz_store.cc:276] 0709 13:07:01.310005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:01.310938 (+   933us) service_pool.cc:224] Handling call
0709 13:07:01.311196 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:04.244242 (+2933046us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:04.758927 (+514685us) spinlock_profiling.cc:243] Waited 2.93 s on lock 0x7b5400337cd4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f489e01 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6
0709 13:07:04.759108 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6743106816}
W20260709 13:07:05.434468 20164 consensus_meta.cc:287] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3: Time spent flushing consensus metadata: real 1.001s	user 0.012s	sys 0.001s
I20260709 13:07:05.497653 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:05.498903 16944 raft_consensus.cc:2468] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 7.
W20260709 13:07:04.686441 20219 log.cc:927] Time spent T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.140s	user 0.001s	sys 0.000s
I20260709 13:07:04.614570 19979 consensus_queue.cc:1048] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.866s
I20260709 13:07:04.650193 20171 raft_consensus.cc:697] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 13 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:04.679883 19982 raft_consensus.cc:3060] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:04.676972 20197 raft_consensus.cc:493] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:05.475935 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
W20260709 13:07:05.501742 20155 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.636s	user 0.028s	sys 0.034s
W20260709 13:07:05.079769 20221 log.cc:927] Time spent T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
W20260709 13:07:05.315723 19841 consensus_meta.cc:287] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 0.967s	user 0.013s	sys 0.000s
I20260709 13:07:04.628405 20101 raft_consensus.cc:515] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:05.240238 20010 raft_consensus.cc:493] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:04.648718 20046 raft_consensus.cc:515] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:05.014387 20033 raft_consensus.cc:493] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:05.497615 16949 raft_consensus.cc:1275] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:07:05.499528 16942 raft_consensus.cc:2468] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 10.
I20260709 13:07:04.691578 20064 leader_election.cc:290] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:04.847513 19849 leader_election.cc:290] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:05.258662 20154 leader_election.cc:290] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:04.765230 20103 raft_consensus.cc:493] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:05.526053 20197 raft_consensus.cc:3060] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:05.502061 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:07:05.504472 16321 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.851s	user 0.011s	sys 0.020s
W20260709 13:07:05.551961 16321 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.899s	user 0.012s	sys 0.021s
I20260709 13:07:05.472347 16275 rpcz_store.cc:276] 0709 13:07:02.420314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.460099 (+ 39785us) service_pool.cc:224] Handling call
0709 13:07:02.482437 (+ 22338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:04.598375 (+2115938us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:05.431163 (+832788us) spinlock_profiling.cc:243] Waited 2.08 s on lock 0x7b5400336dd4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f489e01 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6
0709 13:07:05.431424 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4786988288}
I20260709 13:07:05.556535 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:05.556748 20218 leader_election.cc:290] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:05.557221 16275 raft_consensus.cc:3060] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:05.508221 16940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:07:05.508437 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:05.558599 16940 raft_consensus.cc:3060] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:05.559005 16281 raft_consensus.cc:2468] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 11.
I20260709 13:07:04.893394 20048 leader_election.cc:290] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:04.706634 20052 raft_consensus.cc:3055] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:05.567195 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
W20260709 13:07:05.466941 20207 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.710s	user 0.006s	sys 0.015s
I20260709 13:07:05.496794 20074 raft_consensus.cc:3060] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:05.518692 16199 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60138 (request call id 2252) took 2669 ms (client timeout 1686 ms). Trace:
I20260709 13:07:05.544728 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:05.520592 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
W20260709 13:07:05.047351 20220 log.cc:927] Time spent T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.362s	user 0.000s	sys 0.000s
I20260709 13:07:05.500010 16217 tablet_copy_source_session.cc:215] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:07:05.498359 20164 raft_consensus.cc:515] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:07:05.518827 20071 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.013s	sys 0.025s
W20260709 13:07:05.533390 16246 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:05.533584 20105 consensus_meta.cc:287] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f: Time spent flushing consensus metadata: real 0.996s	user 0.011s	sys 0.003s
I20260709 13:07:05.544516 16946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:04.692484 20165 consensus_queue.cc:260] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:05.524128 20159 raft_consensus.cc:493] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
W20260709 13:07:05.474596 16914 connection.cc:256] RPC call timeout handler was delayed by -1.0955908539999655s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24860000000000004s for a response
I20260709 13:07:05.540020 20001 raft_consensus.cc:493] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:05.589800 16217 rpcz_store.cc:275] Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.0.0.1:39674 (request call id 830) took 1758 ms. Trace:
I20260709 13:07:05.547304 20033 raft_consensus.cc:515] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:07:05.657845 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 45780.5us
W20260709 13:07:05.583122 20207 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.877s	user 0.007s	sys 0.015s
I20260709 13:07:05.563859 16943 raft_consensus.cc:2468] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 7.
I20260709 13:07:05.571986 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:05.520781 16353 raft_consensus.cc:2368] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for earlier term 8. Current term is 9.
I20260709 13:07:05.566808 20052 raft_consensus.cc:740] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:07:05.534500 19841 raft_consensus.cc:515] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } }
W20260709 13:07:05.564670 20128 consensus_meta.cc:287] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63: Time spent flushing consensus metadata: real 0.972s	user 0.013s	sys 0.002s
I20260709 13:07:05.585695 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:05.552582 20103 raft_consensus.cc:515] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:05.593578 19831 leader_election.cc:290] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:05.700076 20001 raft_consensus.cc:515] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:05.543488 20010 raft_consensus.cc:515] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:05.585788 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:05.760036 16274 raft_consensus.cc:2393] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 9: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:07:05.588596 16277 raft_consensus.cc:3060] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:07:05.760443 16322 connection.cc:256] RPC call timeout handler was delayed by -1.670524283000077s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1532s for a response
I20260709 13:07:05.563902 20154 raft_consensus.cc:493] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
W20260709 13:07:05.594309 20027 consensus_meta.cc:287] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f: Time spent flushing consensus metadata: real 1.057s	user 0.014s	sys 0.000s
W20260709 13:07:05.606906 20071 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.653s	user 0.013s	sys 0.026s
W20260709 13:07:05.583096 16199 rpcz_store.cc:269] 0709 13:07:02.841564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.841769 (+   205us) service_pool.cc:224] Handling call
0709 13:07:05.510890 (+2669121us) spinlock_profiling.cc:243] Waited 615 ms on lock 0x7b540020dd54. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:07:05.511008 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1414773120}
I20260709 13:07:05.730780 16278 raft_consensus.cc:2393] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 7: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
W20260709 13:07:05.599093 20160 consensus_meta.cc:287] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3: Time spent flushing consensus metadata: real 1.148s	user 0.015s	sys 0.000s
I20260709 13:07:05.693938 20159 raft_consensus.cc:515] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:07:05.796090 20159 leader_election.cc:290] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:05.587427 20234 raft_consensus.cc:493] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:05.796849 20234 raft_consensus.cc:515] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:05.797379 20197 raft_consensus.cc:515] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:05.746992 16205 raft_consensus.cc:3060] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:05.798844 16945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:07:05.799674 16945 raft_consensus.cc:2393] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 10: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
I20260709 13:07:05.603912 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:07:05.800060 20103 leader_election.cc:290] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:05.800588 16945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:07:05.801033 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:05.750835 16281 raft_consensus.cc:2468] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 12.
I20260709 13:07:05.801687 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:07:05.802626 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:05.803752 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:05.804306 16281 raft_consensus.cc:2468] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 8.
I20260709 13:07:05.804777 16281 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42740 (request call id 663) took 1357 ms. Trace:
I20260709 13:07:05.805068 16281 rpcz_store.cc:276] 0709 13:07:04.447870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.803501 (+1355631us) service_pool.cc:224] Handling call
0709 13:07:05.804725 (+  1224us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:05.805953 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:07:05.751976 16248 connection.cc:256] RPC call timeout handler was delayed by -2.0137013860000934s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1766s for a response
I20260709 13:07:05.807416 16248 leader_election.cc:304] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:05.808658 16248 leader_election.cc:304] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:05.752074 16940 raft_consensus.cc:2468] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 8.
I20260709 13:07:05.810344 19841 leader_election.cc:290] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:05.811220 20052 consensus_queue.cc:260] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:05.812758 20052 raft_consensus.cc:3060] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:05.755277 16275 raft_consensus.cc:2468] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 9.
W20260709 13:07:05.760952 16322 connection.cc:256] RPC call timeout handler was delayed by -1.5976242830000729s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1613s for a response
W20260709 13:07:05.814893 16322 connection.cc:256] RPC call timeout handler was delayed by -1.2790242830000125s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1967s for a response
W20260709 13:07:05.815272 16322 connection.cc:256] RPC call timeout handler was delayed by -1.1215242829999852s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2142s for a response
W20260709 13:07:05.759799 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 232208us
I20260709 13:07:05.816567 16949 raft_consensus.cc:1240] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:05.816956 16277 raft_consensus.cc:2468] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 13.
I20260709 13:07:05.818776 20237 consensus_queue.cc:1048] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:07:05.819144 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:07:05.813906 20009 raft_consensus.cc:493] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:05.820044 20009 raft_consensus.cc:515] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:05.821462 20234 leader_election.cc:290] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:07:05.815562 16322 connection.cc:256] RPC call timeout handler was delayed by -1.0837242830000378s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21840000000000004s for a response
I20260709 13:07:05.822618 20036 leader_election.cc:290] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:05.822739 20234 raft_consensus.cc:2749] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:05.823458 20033 leader_election.cc:290] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:05.823840 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:05.824532 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:05.825146 16281 raft_consensus.cc:2468] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 8.
I20260709 13:07:05.825176 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:05.825608 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:05.826030 16355 raft_consensus.cc:2393] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 9: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:07:05.756052 20128 raft_consensus.cc:493] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:05.826718 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:05.827072 20128 raft_consensus.cc:515] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:05.828140 16281 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45218 (request call id 2071) took 1511 ms. Trace:
I20260709 13:07:05.828502 16281 rpcz_store.cc:276] 0709 13:07:04.316651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.825996 (+1509345us) service_pool.cc:224] Handling call
0709 13:07:05.826253 (+   257us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:05.826413 (+   160us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:05.826436 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:05.826476 (+    40us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:05.826506 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:05.827982 (+  1476us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:05.828085 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:05.762267 20228 log.cc:927] Time spent T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63: Append to log took a long time: real 0.177s	user 0.000s	sys 0.001s
I20260709 13:07:05.694773 20236 raft_consensus.cc:493] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:05.830024 20236 raft_consensus.cc:515] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:05.832123 20010 leader_election.cc:290] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:05.729578 20046 leader_election.cc:290] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:05.763870 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:05.832938 16356 raft_consensus.cc:1240] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 7 LEADER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:05.786453 16946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:05.833307 16274 raft_consensus.cc:2468] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 11.
I20260709 13:07:05.789324 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:07:05.732218 20131 raft_consensus.cc:493] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:05.785125 20027 raft_consensus.cc:515] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:05.573400 20171 consensus_queue.cc:237] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:05.746932 20192 raft_consensus.cc:493] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:05.791173 16914 leader_election.cc:304] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:05.766393 16351 raft_consensus.cc:1240] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:05.697413 20155 raft_consensus.cc:2955] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 LEADER]: Committing config change with OpId 8.6: config changed from index -1 to 6, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:07:05.818817 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:05.657150 16217 rpcz_store.cc:276] 0709 13:07:03.831526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:03.833280 (+  1754us) service_pool.cc:224] Handling call
0709 13:07:05.589690 (+1756410us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:05.793385 20226 log.cc:927] Time spent T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.230s	user 0.001s	sys 0.001s
I20260709 13:07:05.837026 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:05.830369 20182 raft_consensus.cc:3055] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:05.659545 20105 raft_consensus.cc:515] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:05.835178 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:05.835683 16205 raft_consensus.cc:2468] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 7.
W20260709 13:07:05.838240 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 308501us
I20260709 13:07:05.790622 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
W20260709 13:07:05.841166 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 50047.2us
I20260709 13:07:05.822026 20159 raft_consensus.cc:2749] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:05.841985 16275 raft_consensus.cc:3060] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:05.848097 20230 log.cc:927] Time spent T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.298s	user 0.003s	sys 0.000s
I20260709 13:07:05.786993 20154 raft_consensus.cc:515] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:05.851452 20239 raft_consensus.cc:2749] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:05.879944 20140 leader_election.cc:290] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:05.876845 16322 leader_election.cc:304] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
W20260709 13:07:05.877383 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:05.880482 20182 raft_consensus.cc:740] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:05.858867 16355 raft_consensus.cc:2393] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 9: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:07:05.881512 16283 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42740 (request call id 660) took 2457 ms. Trace:
I20260709 13:07:05.897889 16283 rpcz_store.cc:276] 0709 13:07:03.423767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:03.423945 (+   178us) service_pool.cc:224] Handling call
0709 13:07:03.424489 (+   544us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:03.882871 (+458382us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:03.882925 (+    54us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:03.883012 (+    87us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:03.883063 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:05.881204 (+1998141us) spinlock_profiling.cc:243] Waited 458 ms on lock 0x7b54000ac3d4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f489e01 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6
0709 13:07:05.881266 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:05.881429 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1053236992}
I20260709 13:07:05.899806 16322 leader_election.cc:304] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:07:05.899971 16283 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45218 (request call id 2078) took 1521 ms. Trace:
I20260709 13:07:05.834638 19841 raft_consensus.cc:493] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:05.900421 16283 rpcz_store.cc:276] 0709 13:07:04.378851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.899139 (+1520288us) service_pool.cc:224] Handling call
0709 13:07:05.899471 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:05.899646 (+   175us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:05.899673 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:05.899720 (+    47us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:05.899755 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:05.899812 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:05.899913 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:05.882140 20164 leader_election.cc:290] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:05.835458 20160 raft_consensus.cc:515] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:05.883319 16349 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41832 (request call id 1986) took 1339 ms. Trace:
I20260709 13:07:05.887962 16202 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60154 (request call id 2384) took 1475 ms. Trace:
W20260709 13:07:05.878134 20233 log.cc:927] Time spent T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
I20260709 13:07:05.888754 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:05.892205 16277 raft_consensus.cc:1275] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:07:05.915901 16277 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45218 (request call id 2070) took 1599 ms. Trace:
W20260709 13:07:05.895810 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 86097.3us
I20260709 13:07:05.916257 16277 rpcz_store.cc:276] 0709 13:07:04.316357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.835640 (+1519283us) service_pool.cc:224] Handling call
0709 13:07:05.891840 (+ 56200us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:05.915658 (+ 23818us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:05.915847 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:05.916899 16275 raft_consensus.cc:2468] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 9.
I20260709 13:07:05.917173 16248 leader_election.cc:304] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:07:05.832442 20236 leader_election.cc:290] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:05.823374 20036 raft_consensus.cc:493] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:05.901002 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:05.902101 16283 raft_consensus.cc:1240] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:05.886309 16941 raft_consensus.cc:2468] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 7.
I20260709 13:07:05.899998 16914 leader_election.cc:304] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:05.907558 16278 raft_consensus.cc:1240] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:05.908393 16349 rpcz_store.cc:276] 0709 13:07:04.543662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.543987 (+   325us) service_pool.cc:224] Handling call
0709 13:07:04.544314 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:04.689272 (+144958us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:05.882997 (+1193725us) spinlock_profiling.cc:243] Waited 143 ms on lock 0x7b5400195854. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f489e01 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6
0709 13:07:05.883228 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":329645696}
W20260709 13:07:05.928478 16248 leader_election.cc:336] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 1.695s (SENT)
I20260709 13:07:05.908493 16202 rpcz_store.cc:276] 0709 13:07:04.413065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.413308 (+   243us) service_pool.cc:224] Handling call
0709 13:07:04.432275 (+ 18967us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:04.432614 (+   339us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:04.432645 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:04.443676 (+ 11031us) log.cc:844] Serialized 26 byte log entry
0709 13:07:04.844458 (+400782us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:04.844532 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:04.844712 (+   180us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:05.887747 (+1043035us) raft_consensus.cc:1685] finished
0709 13:07:05.887764 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:05.887885 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":107461,"raft.run_cpu_time_us":231,"raft.run_wall_time_us":42478,"thread_start_us":294429,"threads_started":1,"wal-append.queue_time_us":998081}
I20260709 13:07:05.913559 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:05.928965 16248 leader_election.cc:304] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:05.918066 16322 leader_election.cc:304] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:05.842406 20207 raft_consensus.cc:493] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:05.877054 20027 leader_election.cc:290] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:05.883361 20101 leader_election.cc:290] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:05.876004 20128 leader_election.cc:290] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:05.924265 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:05.916323 16173 leader_election.cc:304] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
W20260709 13:07:06.057013 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 140742us
I20260709 13:07:05.899477 20173 raft_consensus.cc:3060] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:05.947029 16283 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45218 (request call id 2080) took 1536 ms. Trace:
I20260709 13:07:05.973169 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:07:06.070238 16320 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:06.070149 16283 rpcz_store.cc:276] 0709 13:07:04.410367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.901450 (+1491083us) service_pool.cc:224] Handling call
0709 13:07:05.901847 (+   397us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:05.946578 (+ 44731us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:05.946927 (+   349us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:06.057905 16173 leader_election.cc:304] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:05.904758 20237 consensus_queue.cc:1059] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.099s
I20260709 13:07:05.978152 20236 raft_consensus.cc:2749] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:05.926163 20159 raft_consensus.cc:2804] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:05.907111 19841 raft_consensus.cc:515] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:05.974664 20036 raft_consensus.cc:515] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:05.972790 20174 raft_consensus.cc:2749] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:05.842391 20131 raft_consensus.cc:515] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:05.889493 20192 raft_consensus.cc:515] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:06.074347 20243 raft_consensus.cc:2804] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:06.115769 20243 raft_consensus.cc:493] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:06.116291 20243 raft_consensus.cc:3060] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:06.074926 16944 raft_consensus.cc:2393] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 10: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
W20260709 13:07:06.100613 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 118169us
W20260709 13:07:06.104051 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 46232.7us
I20260709 13:07:06.125147 16173 leader_election.cc:304] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:05.977785 20239 raft_consensus.cc:2804] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:05.975374 16946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
W20260709 13:07:05.977936 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 59972.8us
I20260709 13:07:05.975920 16275 raft_consensus.cc:1240] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:06.138366 16275 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42740 (request call id 661) took 1716 ms. Trace:
I20260709 13:07:06.138994 16275 rpcz_store.cc:276] 0709 13:07:04.421984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.917802 (+1495818us) service_pool.cc:224] Handling call
0709 13:07:05.975672 (+ 57870us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:06.138090 (+162418us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.138302 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:05.990000 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 90060.1us
I20260709 13:07:05.991122 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:05.911585 20232 raft_consensus.cc:2749] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:07:06.047042 16913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:06.055514 16912 leader_election.cc:304] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:06.055565 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:06.143393 16350 raft_consensus.cc:3060] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:05.926728 16204 raft_consensus.cc:1240] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:06.145306 16322 leader_election.cc:304] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:06.106328 20001 leader_election.cc:290] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:06.109484 20160 leader_election.cc:290] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 election: Requested vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:06.085778 20237 raft_consensus.cc:3055] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:06.147537 20237 raft_consensus.cc:740] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:07:06.148612 20237 consensus_queue.cc:260] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:06.101575 20244 consensus_queue.cc:1048] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:07:06.149927 20237 raft_consensus.cc:3060] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:06.108088 20154 leader_election.cc:290] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:06.151495 20239 raft_consensus.cc:697] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 LEADER]: Becoming Leader. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:07:06.104156 20027 raft_consensus.cc:2804] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:06.152269 20027 raft_consensus.cc:697] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:07:06.152522 20239 consensus_queue.cc:237] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:06.153446 20027 consensus_queue.cc:237] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:05.994246 20207 raft_consensus.cc:515] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:05.974139 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:06.163196 16357 raft_consensus.cc:3060] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:07:06.141237 16355 raft_consensus.cc:2468] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 7.
I20260709 13:07:06.085335 16277 raft_consensus.cc:1240] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:06.167359 16277 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42740 (request call id 664) took 1609 ms. Trace:
W20260709 13:07:06.164996 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 109560us
I20260709 13:07:06.167918 16277 rpcz_store.cc:276] 0709 13:07:04.558431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.976210 (+1417779us) service_pool.cc:224] Handling call
0709 13:07:06.085147 (+108937us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:06.166967 (+ 81820us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.167274 (+   307us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:06.103855 16283 raft_consensus.cc:3060] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:06.168767 20128 raft_consensus.cc:2804] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:06.169178 16349 raft_consensus.cc:2393] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 12: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:07:06.169209 20128 raft_consensus.cc:493] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:06.169926 20128 raft_consensus.cc:3060] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:06.167366 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:06.090684 20167 raft_consensus.cc:493] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.099094 20182 consensus_queue.cc:260] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:06.100234 20105 leader_election.cc:290] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 13 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:06.090826 20071 raft_consensus.cc:493] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:06.189275 20071 raft_consensus.cc:515] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:06.190163 16914 leader_election.cc:304] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:07:06.091622 20159 raft_consensus.cc:493] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:06.103384 20225 raft_consensus.cc:2804] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:06.093745 19841 leader_election.cc:290] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:06.096076 20036 leader_election.cc:290] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:06.113656 20197 leader_election.cc:290] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 election: Requested vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:07:05.975026 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 46577us
I20260709 13:07:06.171208 16355 raft_consensus.cc:2468] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 10.
I20260709 13:07:06.162575 16200 raft_consensus.cc:1275] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:07:06.218724 16200 pending_rounds.cc:85] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f: Aborting all ops after (but not including) 3
W20260709 13:07:06.176728 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 51664.3us
W20260709 13:07:06.183308 16246 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:06.186105 20167 raft_consensus.cc:515] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:06.223778 16173 leader_election.cc:304] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
W20260709 13:07:06.069137 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:06.228628 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:06.229868 16948 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35106 (request call id 740) took 3507 ms. Trace:
I20260709 13:07:06.229962 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:06.231949 16351 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41832 (request call id 1970) took 1972 ms. Trace:
W20260709 13:07:06.056948 16943 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35106 (request call id 743) took 1825 ms (client timeout 1873 ms). Trace:
W20260709 13:07:06.206126 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 60857.2us
I20260709 13:07:06.207141 16275 raft_consensus.cc:1240] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:06.233708 16322 leader_election.cc:304] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:06.234717 20174 raft_consensus.cc:2749] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:06.234963 16322 leader_election.cc:304] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:06.236091 20174 raft_consensus.cc:2749] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:06.236310 16322 leader_election.cc:304] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: 
W20260709 13:07:06.239670 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:06.240780 16322 leader_election.cc:304] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:06.232558 16351 rpcz_store.cc:276] 0709 13:07:04.259740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.259889 (+   149us) service_pool.cc:224] Handling call
0709 13:07:04.275752 (+ 15863us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:05.841689 (+1565937us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.231630 (+389941us) spinlock_profiling.cc:243] Waited 1.49 s on lock 0x7b5400194454. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f489e01 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6
0709 13:07:06.231861 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3427440000}
W20260709 13:07:06.248919 16321 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:06.219105 16200 pending_rounds.cc:107] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f: Aborting uncommitted NO_OP operation due to leader change: 5.4
W20260709 13:07:06.232877 16943 rpcz_store.cc:269] 0709 13:07:04.231518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.231736 (+   218us) service_pool.cc:224] Handling call
0709 13:07:06.056661 (+1824925us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b5400642b54. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:07:06.056859 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2923087616}
I20260709 13:07:06.255769 16200 raft_consensus.cc:2889] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:06.230329 16948 rpcz_store.cc:276] 0709 13:07:02.712513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.787195 (+ 74682us) service_pool.cc:224] Handling call
0709 13:07:03.827244 (+1040049us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:04.126683 (+299439us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.220026 (+2093343us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b54005d9150. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f4888ad 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:07:06.220221 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2390497664}
I20260709 13:07:06.262013 16322 leader_election.cc:304] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:07:06.269665 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:06.270391 20242 raft_consensus.cc:2804] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:06.206421 20232 raft_consensus.cc:2749] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:06.272065 16173 leader_election.cc:304] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:06.207223 20159 raft_consensus.cc:3060] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:06.230614 20046 raft_consensus.cc:493] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.283932 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:06.285048 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:06.278488 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bc3c8ff9b84838a2664335d7e1582b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:07:06.278522 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:06.287529 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:06.286240 16201 raft_consensus.cc:2393] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 in current term 10: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:07:06.287488 16351 raft_consensus.cc:2468] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 7.
I20260709 13:07:06.228477 19982 raft_consensus.cc:493] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:06.298835 19982 raft_consensus.cc:515] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:06.299834 20167 leader_election.cc:290] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:06.276351 20040 raft_consensus.cc:2749] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:06.301270 19982 leader_election.cc:290] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:06.206529 20121 consensus_queue.cc:1059] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.070s
I20260709 13:07:06.298007 20128 raft_consensus.cc:515] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:06.303045 20207 leader_election.cc:290] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:06.304586 20128 leader_election.cc:290] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 12 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:06.229086 20225 raft_consensus.cc:697] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:07:06.275825 20231 raft_consensus.cc:2804] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:06.243124 19941 raft_consensus.cc:2804] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:06.305797 20231 raft_consensus.cc:697] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 7 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:06.306174 19941 raft_consensus.cc:697] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 8 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:06.289633 20140 raft_consensus.cc:2804] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:06.307157 20140 raft_consensus.cc:493] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:06.306824 20231 consensus_queue.cc:237] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:06.307618 20140 raft_consensus.cc:3060] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:06.228617 20164 raft_consensus.cc:493] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:06.308764 20164 raft_consensus.cc:515] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:06.293697 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:06.294402 20173 consensus_queue.cc:1048] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:06.273025 20242 raft_consensus.cc:493] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:06.296213 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c15d8e9be8414c84912ab77b66bfb1" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:06.297307 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:06.255368 20197 consensus_queue.cc:1048] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 13:07:06.307469 16246 leader_election.cc:304] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:06.292732 20046 raft_consensus.cc:515] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:06.292681 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c15d8e9be8414c84912ab77b66bfb1" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:06.344815 16351 raft_consensus.cc:2468] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 9.
I20260709 13:07:06.317476 20001 consensus_queue.cc:1059] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 13:07:06.291160 16173 leader_election.cc:304] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
W20260709 13:07:06.346982 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 55949.2us
I20260709 13:07:06.277887 20033 raft_consensus.cc:2804] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:06.302392 20121 raft_consensus.cc:2804] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:06.318027 16199 raft_consensus.cc:1240] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 LEADER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:07:06.319626 20164 leader_election.cc:290] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:06.311914 16350 raft_consensus.cc:2468] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 8.
I20260709 13:07:06.310381 16202 raft_consensus.cc:2468] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 9.
W20260709 13:07:06.353673 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 163562us
I20260709 13:07:06.354811 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:06.327816 16207 raft_consensus.cc:3060] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:06.275540 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 182835us
I20260709 13:07:06.355787 16248 leader_election.cc:304] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:06.342044 16357 raft_consensus.cc:2468] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 10.
W20260709 13:07:06.327103 20052 consensus_meta.cc:287] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f: Time spent flushing consensus metadata: real 0.514s	user 0.010s	sys 0.002s
W20260709 13:07:06.357585 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 187504us
I20260709 13:07:06.347940 16173 leader_election.cc:304] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:06.359468 16948 raft_consensus.cc:1240] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:06.364650 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:06.361756 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:06.366773 16351 raft_consensus.cc:2393] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 in current term 10: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:07:06.363078 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:06.363372 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:06.368465 16206 raft_consensus.cc:1275] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:07:06.371598 16173 leader_election.cc:304] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:07:06.340792 20242 raft_consensus.cc:3060] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:06.374193 16351 raft_consensus.cc:1240] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
W20260709 13:07:06.375910 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:06.345126 20071 leader_election.cc:290] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:06.381070 16248 leader_election.cc:304] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:06.385679 16248 leader_election.cc:304] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:06.350124 20238 raft_consensus.cc:493] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.353044 20128 raft_consensus.cc:3055] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:06.350169 19982 raft_consensus.cc:2749] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:06.414815 19982 raft_consensus.cc:2749] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:06.417017 20046 leader_election.cc:290] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:06.356770 20121 raft_consensus.cc:493] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:06.387908 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:06.351514 19831 raft_consensus.cc:2749] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:06.360164 20010 raft_consensus.cc:2749] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:06.410209 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:06.305812 20225 consensus_queue.cc:237] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:07:06.444428 16350 raft_consensus.cc:1240] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:07:06.407198 20105 raft_consensus.cc:2804] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:06.387290 20236 raft_consensus.cc:2749] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:07:06.428658 16174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:06.382230 20164 raft_consensus.cc:493] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.480865 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:06.377664 20035 raft_consensus.cc:2804] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:06.514338 16199 raft_consensus.cc:2468] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 9.
I20260709 13:07:06.424031 20001 raft_consensus.cc:3055] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:07:06.525231 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 141367us
I20260709 13:07:06.522902 20105 raft_consensus.cc:697] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:07:06.421947 20128 raft_consensus.cc:740] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:07:06.426633 20121 raft_consensus.cc:3060] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:06.530458 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 101236us
I20260709 13:07:06.387225 20052 consensus_queue.cc:1048] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.142s
I20260709 13:07:06.518966 20035 raft_consensus.cc:493] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:06.419453 20238 raft_consensus.cc:515] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:06.526211 20001 raft_consensus.cc:740] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:07:06.533712 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:06.536387 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:07:06.537210 16173 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 2.061s (SENT) [suppressed 41 similar messages]
W20260709 13:07:06.659590 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 127800us
W20260709 13:07:06.665987 16321 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:06.671281 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 134082us
W20260709 13:07:06.684504 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 298946us
I20260709 13:07:06.685464 16248 leader_election.cc:304] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:06.544132 20035 raft_consensus.cc:3060] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:06.411641 19941 consensus_queue.cc:237] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:06.695106 16248 leader_election.cc:304] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:06.525389 20164 raft_consensus.cc:515] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:06.689704 20173 raft_consensus.cc:493] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.707114 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:06.714159 16248 leader_election.cc:304] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:06.715999 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:07:06.707696 20251 log.cc:927] Time spent T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.168s	user 0.000s	sys 0.000s
I20260709 13:07:06.709761 20238 leader_election.cc:290] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:07:06.710609 20250 log.cc:927] Time spent T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.230s	user 0.000s	sys 0.001s
I20260709 13:07:06.711457 16207 raft_consensus.cc:2468] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 6.
I20260709 13:07:06.737974 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:06.739213 16207 raft_consensus.cc:2393] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 5: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:07:06.740665 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:06.694032 20010 raft_consensus.cc:2749] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:07:06.750772 16320 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:06.720072 20046 raft_consensus.cc:2749] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:06.751798 20256 consensus_queue.cc:1048] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:06.720268 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:06.755605 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:06.756798 19966 tablet_bootstrap.cc:492] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:06.757633 16356 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41832 (request call id 1974) took 2467 ms. Trace:
I20260709 13:07:06.720086 20105 consensus_queue.cc:237] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:06.720304 20173 raft_consensus.cc:515] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:06.721913 20164 leader_election.cc:290] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:06.710907 20001 consensus_queue.cc:260] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:07:06.723105 20248 log.cc:927] Time spent T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.311s	user 0.001s	sys 0.000s
I20260709 13:07:06.724634 20035 raft_consensus.cc:515] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:06.681373 20236 raft_consensus.cc:493] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.717747 16282 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45210 (request call id 2110) took 1210 ms. Trace:
I20260709 13:07:06.728150 16322 leader_election.cc:304] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:06.768527 16275 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45210 (request call id 2111) took 1260 ms. Trace:
I20260709 13:07:06.779645 16282 rpcz_store.cc:276] 0709 13:07:05.507338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.241994 (+734656us) service_pool.cc:224] Handling call
0709 13:07:06.282054 (+ 40060us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:06.282380 (+   326us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:07:06.428863 (+146483us) log.cc:844] Serialized 14 byte log entry
0709 13:07:06.717329 (+288466us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:06.717388 (+    59us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:06.717494 (+   106us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.717561 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:06.717692 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4983,"prepare.queue_time_us":263843,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":41,"raft.queue_time_us":8566,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":135,"thread_start_us":382824,"threads_started":2,"wal-append.queue_time_us":335045}
I20260709 13:07:06.756868 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:06.764721 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:06.758080 16356 rpcz_store.cc:276] 0709 13:07:04.290022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.291462 (+  1440us) service_pool.cc:224] Handling call
0709 13:07:04.302759 (+ 11297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:05.836652 (+1533893us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.757340 (+920688us) spinlock_profiling.cc:243] Waited 1.51 s on lock 0x7b54003093d4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f489e01 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6
0709 13:07:06.757538 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3475006336}
I20260709 13:07:06.787310 16352 raft_consensus.cc:2393] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 13: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:07:06.779621 16275 rpcz_store.cc:276] 0709 13:07:05.507708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.234102 (+726394us) service_pool.cc:224] Handling call
0709 13:07:06.234383 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:06.237082 (+  2699us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:07:06.346084 (+109002us) log.cc:844] Serialized 14 byte log entry
0709 13:07:06.767978 (+421894us) spinlock_profiling.cc:243] Waited 4.54 ms on lock 0x7b18003f89e0. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f3625264de1 00007f36252715b1 00007f361f0314bc 00007f361c37f48b 00007f36251d9ab9 00007f361c39b69b 00007f361c39993f 00007f361c39bc02 00007f361f02320b 00007f361f028d23 00007f361f02923a
0709 13:07:06.768163 (+   185us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:06.768216 (+    53us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:06.768259 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.768328 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:06.768464 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":285334,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":48,"spinlock_wait_cycles":10437376,"thread_start_us":267494,"threads_started":2}
I20260709 13:07:06.735441 16248 leader_election.cc:304] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
W20260709 13:07:06.742363 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:06.742316 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:06.742852 19982 raft_consensus.cc:2804] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:06.758267 19966 tablet_bootstrap.cc:492] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap complete.
W20260709 13:07:06.788275 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 60210.9us
W20260709 13:07:06.793859 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 58589.9us
I20260709 13:07:06.722385 20253 consensus_queue.cc:1059] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 13:07:06.717389 20155 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:39040 (request call id 0) took 5590 ms. Trace:
I20260709 13:07:06.810019 16248 leader_election.cc:304] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:06.813632 16322 leader_election.cc:304] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:07:06.761085 20243 consensus_meta.cc:287] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 0.644s	user 0.008s	sys 0.004s
W20260709 13:07:06.820787 16248 leader_election.cc:336] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 1.788s (SENT)
I20260709 13:07:06.821491 16322 leader_election.cc:304] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:06.697233 20239 consensus_queue.cc:1059] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.102s
I20260709 13:07:06.821594 16248 leader_election.cc:304] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:06.825254 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:06.825467 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:06.826519 16207 raft_consensus.cc:2393] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 10: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:07:06.799211 20256 raft_consensus.cc:2804] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:06.798439 20164 raft_consensus.cc:2749] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:06.831468 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:06.798271 19982 raft_consensus.cc:493] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:06.843045 16282 raft_consensus.cc:2393] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 6: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:07:06.844833 19982 raft_consensus.cc:3060] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:06.845985 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:06.846626 16322 leader_election.cc:304] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:07:06.848183 16322 leader_election.cc:304] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:06.851025 16322 leader_election.cc:304] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:06.851166 16351 raft_consensus.cc:1240] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 8 LEADER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:06.851716 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:06.760090 20159 raft_consensus.cc:515] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:06.853725 16199 raft_consensus.cc:2410] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:07:06.826984 20010 raft_consensus.cc:2804] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:06.849262 20167 raft_consensus.cc:2804] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:06.791209 20236 raft_consensus.cc:515] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:07:06.842410 20140 consensus_meta.cc:287] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f: Time spent flushing consensus metadata: real 0.534s	user 0.006s	sys 0.004s
I20260709 13:07:06.859627 16948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:07:06.876549 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:06.862025 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:07:06.871515 20035 leader_election.cc:290] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 election: Requested vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:06.744051 20128 consensus_queue.cc:260] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:06.878510 20009 leader_election.cc:290] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:06.851814 19966 ts_tablet_manager.cc:1403] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63: Time spent bootstrapping tablet: real 3.716s	user 0.048s	sys 0.054s
I20260709 13:07:06.885536 20182 raft_consensus.cc:3060] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:06.869045 20173 leader_election.cc:290] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:06.843154 20261 raft_consensus.cc:2749] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:06.861337 20010 raft_consensus.cc:493] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:06.830905 20001 raft_consensus.cc:3060] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:06.828668 20266 raft_consensus.cc:2749] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:06.842702 20249 raft_consensus.cc:3060] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:06.832713 20256 raft_consensus.cc:493] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:06.874089 20121 raft_consensus.cc:515] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:06.827044 20243 raft_consensus.cc:515] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:06.897718 16949 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40078 (request call id 444) took 1133 ms. Trace:
I20260709 13:07:06.917284 16280 raft_consensus.cc:2468] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 12.
I20260709 13:07:06.896351 19941 raft_consensus.cc:2804] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:06.923913 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:06.867452 16942 raft_consensus.cc:1275] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 13:07:06.927279 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 79785.4us
I20260709 13:07:06.928606 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
W20260709 13:07:06.930197 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 253764us
I20260709 13:07:06.929839 20256 raft_consensus.cc:3060] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:06.932060 16949 rpcz_store.cc:276] 0709 13:07:05.754211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.754418 (+   207us) service_pool.cc:224] Handling call
0709 13:07:05.816366 (+ 61948us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:05.817052 (+   686us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.887343 (+1070291us) spinlock_profiling.cc:243] Waited 29 ms on lock 0x7b54006455d0. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f4888ad 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:07:06.887594 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":66765056}
I20260709 13:07:06.949879 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:06.905632 20140 raft_consensus.cc:515] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:06.924108 19831 consensus_queue.cc:1048] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 13:07:06.897836 20108 consensus_queue.cc:1059] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.030s
W20260709 13:07:06.943310 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:06.917119 20275 raft_consensus.cc:2804] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:06.999125 20275 raft_consensus.cc:697] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 9 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:06.999358 16200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60154 (request call id 2411) took 1025 ms. Trace:
I20260709 13:07:06.926290 20010 raft_consensus.cc:3060] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:06.999807 16200 rpcz_store.cc:276] 0709 13:07:05.974304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.974443 (+   139us) service_pool.cc:224] Handling call
0709 13:07:05.974771 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:06.256452 (+281681us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.999085 (+742633us) spinlock_profiling.cc:243] Waited 187 ms on lock 0x7b54000b4fd4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f489e01 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6
0709 13:07:06.999280 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":430621952}
W20260709 13:07:06.946165 20237 consensus_meta.cc:287] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63: Time spent flushing consensus metadata: real 0.796s	user 0.015s	sys 0.000s
I20260709 13:07:06.901417 20167 raft_consensus.cc:493] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:06.957839 16278 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45218 (request call id 2076) took 2591 ms. Trace:
I20260709 13:07:06.959139 16281 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45218 (request call id 2075) took 2617 ms. Trace:
I20260709 13:07:06.959730 20159 leader_election.cc:290] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 election: Requested vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:06.960268 20165 raft_consensus.cc:3060] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:06.961565 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:06.961902 20236 leader_election.cc:290] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:06.928143 20035 consensus_queue.cc:1048] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:07:06.992012 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:06.816896 20155 rpcz_store.cc:276] 0709 13:07:01.109798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:01.110328 (+   530us) service_pool.cc:224] Handling call
0709 13:07:01.203875 (+ 93547us) log.cc:844] Serialized 506 byte log entry
0709 13:07:06.690133 (+5486258us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34708,"raft.queue_time_us":28247,"raft.run_cpu_time_us":8070,"raft.run_wall_time_us":120419,"spinlock_wait_cycles":1936768,"thread_start_us":18859,"threads_started":1,"wal-append.queue_time_us":40885,"wal-append.run_cpu_time_us":3898,"wal-append.run_wall_time_us":1197748}
W20260709 13:07:06.993969 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 63579.1us
I20260709 13:07:06.994098 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:06.934084 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:06.944336 19941 raft_consensus.cc:697] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [term 9 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:06.992702 20140 leader_election.cc:290] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:07.001430 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:07.001471 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:06.951982 20128 raft_consensus.cc:3060] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:07.018644 16200 raft_consensus.cc:2468] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 11.
I20260709 13:07:07.003116 16278 rpcz_store.cc:276] 0709 13:07:04.367002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.894066 (+1527064us) service_pool.cc:224] Handling call
0709 13:07:05.894435 (+   369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:05.930256 (+ 35821us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.957565 (+1027309us) spinlock_profiling.cc:243] Waited 12.9 ms on lock 0x7b54000762d4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f489e01 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6
0709 13:07:06.957766 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":29676928}
I20260709 13:07:07.003221 16281 rpcz_store.cc:276] 0709 13:07:04.341561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.837716 (+1496155us) service_pool.cc:224] Handling call
0709 13:07:05.843299 (+  5583us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:05.843695 (+   396us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:05.843736 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:05.844301 (+   565us) log.cc:844] Serialized 26 byte log entry
0709 13:07:06.766496 (+922195us) spinlock_profiling.cc:243] Waited 13.2 ms on lock 0x7b180044b4e0. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f3625264de1 00007f36252715b1 00007f361c37ee07 00007f36251d9ab9 00007f361c39b69b 00007f361c39993f 00007f361c39bc02 00007f361f02320b 00007f361f028d23 00007f361f0290d1 00007f361f444a0f
0709 13:07:06.830246 (+ 63750us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:06.830292 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.830378 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:06.958833 (+128455us) raft_consensus.cc:1685] finished
0709 13:07:06.958854 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:06.959075 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":93,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":40829,"spinlock_wait_cycles":30341376,"thread_start_us":62604,"threads_started":1,"wal-append.queue_time_us":1100164}
I20260709 13:07:07.019996 16282 raft_consensus.cc:2410] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:07:07.020025 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:07:07.006031 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 147310us
I20260709 13:07:07.020952 16278 raft_consensus.cc:2393] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 10: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:07:07.021575 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:07.023041 16278 raft_consensus.cc:2410] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:07:07.022857 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:07.023370 16200 raft_consensus.cc:1240] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:07.006116 20167 raft_consensus.cc:3060] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:07:07.006639 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 87817.2us
I20260709 13:07:06.992354 20121 leader_election.cc:290] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 9 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:07.008261 16354 raft_consensus.cc:2468] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 8.
I20260709 13:07:07.031038 16354 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41830 (request call id 2095) took 1205 ms. Trace:
I20260709 13:07:07.031432 16354 rpcz_store.cc:276] 0709 13:07:05.825144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.827586 (+  2442us) service_pool.cc:224] Handling call
0709 13:07:06.961391 (+1133805us) spinlock_profiling.cc:243] Waited 7.89 ms on lock 0x7b5800024698. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361c224db1 00007f361c364b71 00007f361c364a22 00007f362527dc09 00007f36243d7ee0 00007f36244a10ab 00007f36244a1131 00007f362444f0a0 00007f362444e984 00007f361d9c96d4 00007f361d9c9662
0709 13:07:07.030971 (+ 69580us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18148736}
I20260709 13:07:07.010917 16277 raft_consensus.cc:2468] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 10.
I20260709 13:07:07.032706 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:07.033088 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:07.033337 16278 raft_consensus.cc:3060] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:07.033702 16277 raft_consensus.cc:2468] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 13.
I20260709 13:07:07.026158 16322 leader_election.cc:304] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:07.034639 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:07.035686 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:07.036573 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:07.014114 16207 raft_consensus.cc:1240] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:07:07.016271 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:07:07.016220 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:07.038148 16942 raft_consensus.cc:3060] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:07.030279 16199 pending_rounds.cc:85] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f: Aborting all ops after (but not including) 4
I20260709 13:07:07.028224 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:07.038741 16199 pending_rounds.cc:107] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 13:07:07.038919 16281 raft_consensus.cc:2468] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 13.
I20260709 13:07:07.039079 16199 raft_consensus.cc:2889] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:07.038769 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:07.040702 16282 raft_consensus.cc:2393] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 in current term 8: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:07:07.042639 20149 raft_consensus.cc:2749] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:07:07.043387 16281 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45210 (request call id 2118) took 1492 ms. Trace:
I20260709 13:07:07.043754 16281 rpcz_store.cc:276] 0709 13:07:05.550916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.039814 (+1488898us) service_pool.cc:224] Handling call
0709 13:07:07.042908 (+  3094us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:07.043078 (+   170us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:07.043102 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:07.043140 (+    38us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:07.043167 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:07.043228 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:07.043335 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:07.047348 16282 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42740 (request call id 666) took 1434 ms. Trace:
I20260709 13:07:07.047860 16282 rpcz_store.cc:276] 0709 13:07:05.613412 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.046775 (+1433363us) service_pool.cc:224] Handling call
0709 13:07:07.046995 (+   220us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:07.047113 (+   118us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:07.047133 (+    20us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:07.047160 (+    27us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:07:07.047178 (+    18us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:07.047210 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:07.047275 (+    65us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:07.057837 16282 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45218 (request call id 2082) took 1326 ms. Trace:
I20260709 13:07:07.058384 16282 rpcz_store.cc:276] 0709 13:07:05.731401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.049159 (+1317758us) service_pool.cc:224] Handling call
0709 13:07:07.049551 (+   392us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:07.049793 (+   242us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:07.049836 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:07.049898 (+    62us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:07.049947 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:07.057570 (+  7623us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:07.057745 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:07.060490 16278 raft_consensus.cc:2468] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 9.
I20260709 13:07:07.062717 16278 raft_consensus.cc:1275] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:07:07.070483 16278 raft_consensus.cc:1275] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:07:07.075008 16282 raft_consensus.cc:1240] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:07.075790 16282 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45218 (request call id 2083) took 1330 ms. Trace:
W20260709 13:07:07.075834 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 48308.3us
I20260709 13:07:07.076217 16282 rpcz_store.cc:276] 0709 13:07:05.745080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.059563 (+1314483us) service_pool.cc:224] Handling call
0709 13:07:07.060004 (+   441us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:07.075508 (+ 15504us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:07.075735 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:07.078236 16282 raft_consensus.cc:2955] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Committing config change with OpId 8.6: config changed from index -1 to 6, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:07:07.097384 16173 leader_election.cc:304] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:07.096060 20172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 540bfc4ad793452faea5b865343aacf7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:07.101960 16277 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45210 (request call id 2117) took 1556 ms. Trace:
I20260709 13:07:07.102629 16277 rpcz_store.cc:276] 0709 13:07:05.545508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.037092 (+1491584us) service_pool.cc:224] Handling call
0709 13:07:07.101254 (+ 64162us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:07.101485 (+   231us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:07.101526 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:07.101592 (+    66us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:07.101637 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:07.101714 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:07.101865 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:07.022486 20159 consensus_queue.cc:1059] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.068s
W20260709 13:07:07.139250 20277 log.cc:927] Time spent T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
I20260709 13:07:07.019050 20236 consensus_queue.cc:1048] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 13:07:07.120725 20149 consensus_queue.cc:1048] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:07.122471 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:07.122390 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:07.123798 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:07.123704 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:07.123674 16348 raft_consensus.cc:2468] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 12.
I20260709 13:07:07.124239 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:07.125334 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:07.136592 16277 raft_consensus.cc:1240] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:07.136904 20140 raft_consensus.cc:2749] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:07:07.137660 20281 log.cc:927] Time spent T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
I20260709 13:07:07.137846 20027 consensus_queue.cc:1059] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 13:07:07.130152 16942 raft_consensus.cc:2468] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 8.
I20260709 13:07:07.136643 16173 leader_election.cc:304] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:07.144538 16282 raft_consensus.cc:1240] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:07.154110 16349 raft_consensus.cc:2468] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 8.
I20260709 13:07:07.164317 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:07.165578 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:07.166040 16349 raft_consensus.cc:2468] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 8.
I20260709 13:07:07.166839 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:07.167505 16349 raft_consensus.cc:3060] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:07.168133 16173 leader_election.cc:304] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:07.169624 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:07.170773 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:07.099097 19982 raft_consensus.cc:515] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:07.171691 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:07.172765 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:07.172818 16173 leader_election.cc:304] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:07.175222 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:07.175606 16173 leader_election.cc:304] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:07.176785 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:07.177516 16352 raft_consensus.cc:3060] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:07.177826 20033 raft_consensus.cc:493] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:07.178364 20033 raft_consensus.cc:3060] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:07.000330 20275 consensus_queue.cc:237] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:07:07.153748 20207 raft_consensus.cc:493] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.180508 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:07.186283 16914 leader_election.cc:304] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:07.187400 16248 leader_election.cc:304] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:07.151825 20243 leader_election.cc:290] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:07.187464 16277 raft_consensus.cc:1275] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:07:07.190964 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:07.106175 20261 consensus_queue.cc:1048] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.069s
W20260709 13:07:07.238142 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 51945.5us
W20260709 13:07:07.193749 16348 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41832 (request call id 1995) took 2157 ms (client timeout 1635 ms). Trace:
W20260709 13:07:07.243780 16348 rpcz_store.cc:269] 0709 13:07:05.036154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.461471 (+425317us) service_pool.cc:224] Handling call
0709 13:07:07.193501 (+1732030us) spinlock_profiling.cc:243] Waited 1.65 s on lock 0x7b54003aff54. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:07:07.193655 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3798935936}
I20260709 13:07:07.245034 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:07.246646 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:07.222666 16173 leader_election.cc:400] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 election: Vote denied by peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107) with higher term. Message: Invalid argument: T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for earlier term 8. Current term is 9.
I20260709 13:07:07.191851 16282 raft_consensus.cc:1240] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:07.191774 16942 raft_consensus.cc:1240] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:07.195694 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:07.170629 20052 raft_consensus.cc:2749] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:07.212476 20159 raft_consensus.cc:2749] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:07.353628 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:07.299347 19966 raft_consensus.cc:359] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:07:07.348706 16201 raft_consensus.cc:1240] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:07:07.369522 16279 raft_consensus.cc:1275] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:07:07.411350 16320 leader_election.cc:304] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:07.359392 16204 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60154 (request call id 2388) took 2944 ms. Trace:
I20260709 13:07:07.423149 16204 rpcz_store.cc:276] 0709 13:07:04.416541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:04.432413 (+ 15872us) service_pool.cc:224] Handling call
0709 13:07:04.432845 (+   432us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:06.146900 (+1714055us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:07.359106 (+1212206us) spinlock_profiling.cc:243] Waited 1.49 s on lock 0x7b5400259754. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f489e01 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6
0709 13:07:07.359317 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3423063424}
I20260709 13:07:07.424474 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
W20260709 13:07:07.376376 20288 log.cc:927] Time spent T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 13:07:07.352342 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
W20260709 13:07:07.274730 20242 consensus_meta.cc:287] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f: Time spent flushing consensus metadata: real 0.868s	user 0.010s	sys 0.002s
I20260709 13:07:07.314904 20125 raft_consensus.cc:3055] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:07.323546 16947 raft_consensus.cc:1275] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:07:07.282224 20249 raft_consensus.cc:2749] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:07.257640 20266 consensus_queue.cc:1059] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 13:07:07.312064 20131 leader_election.cc:290] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:07.257349 16948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:07:07.446780 20174 raft_consensus.cc:2749] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:07.255518 16248 leader_election.cc:304] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:07:07.289417 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:07.360386 20263 raft_consensus.cc:3055] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:07.278391 19982 leader_election.cc:290] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:07.258244 16949 raft_consensus.cc:1240] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:07.183221 20105 raft_consensus.cc:2749] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:07.257421 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:07.239691 20027 consensus_queue.cc:1048] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.103s
I20260709 13:07:07.316615 19831 raft_consensus.cc:3055] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:07.309839 20010 raft_consensus.cc:515] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:07.179895 20155 raft_consensus.cc:2749] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:07.332509 20009 raft_consensus.cc:3055] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:07.330415 16351 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41830 (request call id 2103) took 1495 ms. Trace:
I20260709 13:07:07.435322 20032 raft_consensus.cc:493] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:07.469988 16351 rpcz_store.cc:276] 0709 13:07:05.834640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.383530 (+548890us) service_pool.cc:224] Handling call
0709 13:07:06.419612 (+ 36082us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:06.856018 (+436406us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:07.330072 (+474054us) spinlock_profiling.cc:243] Waited 431 ms on lock 0x7b540028b4d4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f489e01 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6
0709 13:07:07.330315 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":991995648}
I20260709 13:07:07.338955 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:07.472244 16275 raft_consensus.cc:2468] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 7.
I20260709 13:07:07.331522 16274 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45218 (request call id 2072) took 3014 ms. Trace:
I20260709 13:07:07.328855 16206 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60154 (request call id 2402) took 1492 ms. Trace:
I20260709 13:07:07.473632 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:07.473873 16206 rpcz_store.cc:276] 0709 13:07:05.836641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.836845 (+   204us) service_pool.cc:224] Handling call
0709 13:07:05.837081 (+   236us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:06.369113 (+532032us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:07.328471 (+959358us) spinlock_profiling.cc:243] Waited 531 ms on lock 0x7b5400238054. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f489e01 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6
0709 13:07:07.328761 (+   290us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1220909952}
I20260709 13:07:07.475920 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:07.359586 16276 raft_consensus.cc:1275] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:07:07.478283 16348 raft_consensus.cc:2468] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 9.
W20260709 13:07:07.348470 16205 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60154 (request call id 2396) took 1883 ms (client timeout 2023 ms). Trace:
I20260709 13:07:07.397066 16914 leader_election.cc:304] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:07.399966 16349 raft_consensus.cc:2468] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 9.
W20260709 13:07:07.480567 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 83598.1us
I20260709 13:07:07.476758 16206 raft_consensus.cc:2468] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 6.
I20260709 13:07:07.166917 19941 consensus_queue.cc:237] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:07:07.400837 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.179983 20225 raft_consensus.cc:2749] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:07.403196 16355 raft_consensus.cc:2468] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 10.
I20260709 13:07:07.406008 16246 leader_election.cc:304] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:07:07.378921 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
W20260709 13:07:07.483017 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 77153.7us
I20260709 13:07:07.473153 16274 rpcz_store.cc:276] 0709 13:07:04.316950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.834038 (+1517088us) service_pool.cc:224] Handling call
0709 13:07:05.834353 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:05.889901 (+ 55548us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:07:05.889950 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:05.890012 (+    62us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:05.890063 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:07.331220 (+1441157us) spinlock_profiling.cc:243] Waited 55.1 ms on lock 0x7b540004db54. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f489e01 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6
0709 13:07:07.331279 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:07.331444 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5977,"raft.queue_time_us":3180,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":10726,"spinlock_wait_cycles":126742272}
I20260709 13:07:07.485034 16246 leader_election.cc:304] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:07.252743 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:07.486135 16277 raft_consensus.cc:2468] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 11.
I20260709 13:07:07.276945 20241 raft_consensus.cc:493] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.409789 16352 raft_consensus.cc:2468] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 13.
W20260709 13:07:07.407701 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 190568us
I20260709 13:07:07.415583 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:07.488288 16208 raft_consensus.cc:2468] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 3.
I20260709 13:07:07.417214 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:07.432262 16944 raft_consensus.cc:3060] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:07.436050 16207 raft_consensus.cc:1275] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:07:07.419776 20167 raft_consensus.cc:515] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:07.399684 20132 raft_consensus.cc:2749] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:07.440187 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:07.505932 16204 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f"
dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
mode: GRACEFUL
new_leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
 from {username='slave'} at 127.0.0.1:58160
I20260709 13:07:07.506594 16204 raft_consensus.cc:606] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Received request to transfer leadership to TS 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:07:07.486965 20032 raft_consensus.cc:515] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:07.506961 16204 raft_consensus.cc:614] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:07.507294 20010 leader_election.cc:290] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:07.444834 20242 raft_consensus.cc:515] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:07.508643 20032 leader_election.cc:290] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:07.509779 20242 leader_election.cc:290] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:07.440878 20125 raft_consensus.cc:740] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:07:07.491264 19982 raft_consensus.cc:2804] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:07.511005 20125 consensus_queue.cc:260] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:07.511734 19982 raft_consensus.cc:493] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:07.512130 20125 raft_consensus.cc:3060] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:07.512192 19982 raft_consensus.cc:3060] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:07.223184 20207 raft_consensus.cc:515] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:07.515436 16350 raft_consensus.cc:2376] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 12. Re-sending same reply.
I20260709 13:07:07.517752 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:07.518080 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:07.485991 20234 raft_consensus.cc:2804] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:07.463570 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:07.518953 16208 raft_consensus.cc:2410] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for term 13 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:07:07.519438 16354 raft_consensus.cc:2393] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 in current term 10: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:07:07.520270 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:07.521311 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:07.521549 20192 leader_election.cc:290] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:07.522019 16354 raft_consensus.cc:2393] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 in current term 10: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:07:07.452164 16320 leader_election.cc:304] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:07.523097 20026 raft_consensus.cc:2749] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:07:07.523197 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 71177.6us
I20260709 13:07:07.524199 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:07.525003 16351 raft_consensus.cc:2393] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 in current term 11: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:07:07.525727 20040 consensus_queue.cc:1059] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:07.472843 20009 raft_consensus.cc:740] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:07:07.465883 19831 raft_consensus.cc:740] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:07:07.527387 16280 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45218 (request call id 2089) took 1118 ms. Trace:
I20260709 13:07:07.462478 20174 consensus_queue.cc:1048] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:07:07.528031 20040 consensus_queue.cc:1059] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:07.528479 16200 raft_consensus.cc:1240] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:07.529067 20152 consensus_queue.cc:1048] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:07.530488 20152 raft_consensus.cc:3055] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:07.530915 20152 raft_consensus.cc:740] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:07.430905 19966 raft_consensus.cc:740] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 LEARNER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Initialized, Role: LEARNER
I20260709 13:07:07.531744 20152 consensus_queue.cc:260] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:07.532146 19966 consensus_queue.cc:260] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:07:07.533057 20152 raft_consensus.cc:3060] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:07.294127 20144 consensus_queue.cc:1059] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:07.449389 20263 raft_consensus.cc:740] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:07:07.546293 20263 consensus_queue.cc:260] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:07.548228 20263 raft_consensus.cc:3060] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:07.548450 19966 ts_tablet_manager.cc:1434] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63: Time spent starting tablet: real 0.628s	user 0.010s	sys 0.003s
W20260709 13:07:07.549014 19966 ts_tablet_manager.cc:1467] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63: Tablet startup took 636ms
I20260709 13:07:07.399832 20256 raft_consensus.cc:515] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:07.551000 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:07.437232 16282 raft_consensus.cc:1240] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 8. Current term is 9. Ops: [8.9-8.9]
W20260709 13:07:07.479940 16205 rpcz_store.cc:269] 0709 13:07:05.465250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.477486 (+ 12236us) service_pool.cc:224] Handling call
0709 13:07:07.348167 (+1870681us) spinlock_profiling.cc:243] Waited 256 ms on lock 0x7b540038a9d4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:07:07.348371 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":587807488}
I20260709 13:07:07.492102 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:07.489213 16199 raft_consensus.cc:2468] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 10.
I20260709 13:07:07.553445 16205 raft_consensus.cc:1240] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:07.490012 16353 raft_consensus.cc:2393] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 14: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:07:07.495716 16173 leader_election.cc:304] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:07.495702 16914 leader_election.cc:304] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:07:07.458613 20249 consensus_queue.cc:1048] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.011s
I20260709 13:07:07.494014 16322 leader_election.cc:304] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:07.503182 16278 raft_consensus.cc:1240] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 7. Current term is 8. Ops: []
W20260709 13:07:07.467599 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 212195us
I20260709 13:07:07.527967 16280 rpcz_store.cc:276] 0709 13:07:06.408716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.694586 (+285870us) service_pool.cc:224] Handling call
0709 13:07:07.527153 (+832567us) spinlock_profiling.cc:243] Waited 201 ms on lock 0x7b5400126454. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:07:07.527308 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":463415680}
I20260709 13:07:07.534080 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:07.535461 16944 raft_consensus.cc:2468] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 10.
W20260709 13:07:07.567716 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 72172.8us
I20260709 13:07:07.568678 16206 raft_consensus.cc:2468] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 13.
I20260709 13:07:07.486513 20159 raft_consensus.cc:493] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.552126 16357 raft_consensus.cc:2393] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 12: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:07:07.552798 16202 raft_consensus.cc:2376] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 7. Re-sending same reply.
I20260709 13:07:07.566933 16248 leader_election.cc:304] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:07:07.568846 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 73175us
I20260709 13:07:07.571558 16173 leader_election.cc:304] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:07:07.571925 16353 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41830 (request call id 2088) took 1748 ms. Trace:
I20260709 13:07:07.572343 16353 rpcz_store.cc:276] 0709 13:07:05.823109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.831084 (+  7975us) service_pool.cc:224] Handling call
0709 13:07:07.473417 (+1642333us) spinlock_profiling.cc:243] Waited 4.46 ms on lock 0x7b5800024698. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361c224db1 00007f361c364b71 00007f361c364a22 00007f362527dc09 00007f36243d7ee0 00007f36244a10ab 00007f36244a1131 00007f362444f0a0 00007f362444e984 00007f361d9c96d4 00007f361d9c9662
0709 13:07:07.571857 (+ 98440us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10261248}
I20260709 13:07:07.573447 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:07.539109 16200 raft_consensus.cc:1275] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:07:07.497846 20236 raft_consensus.cc:2749] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:07.575806 16173 leader_election.cc:304] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
W20260709 13:07:07.576103 20128 consensus_meta.cc:287] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63: Time spent flushing consensus metadata: real 0.554s	user 0.012s	sys 0.000s
I20260709 13:07:07.576227 20159 raft_consensus.cc:515] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:07.581845 20192 consensus_queue.cc:1048] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:07.585471 20256 leader_election.cc:290] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 12 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:07.582279 20032 raft_consensus.cc:2749] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:07.527403 20009 consensus_queue.cc:260] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:07.583024 20266 raft_consensus.cc:2749] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:07.567323 20010 raft_consensus.cc:493] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:07.579085 20242 raft_consensus.cc:2804] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:07.587477 20242 raft_consensus.cc:493] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:07.587472 20010 raft_consensus.cc:515] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:07.588176 20242 raft_consensus.cc:3060] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:07.577152 20225 raft_consensus.cc:2749] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:07.583218 20033 raft_consensus.cc:515] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:07.590034 16946 raft_consensus.cc:1275] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:07:07.591449 20033 leader_election.cc:290] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:07.579082 20132 raft_consensus.cc:2804] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:07.592434 20132 raft_consensus.cc:697] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 9 LEADER]: Becoming Leader. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:07:07.584112 16248 leader_election.cc:304] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:07.576455 20131 raft_consensus.cc:2749] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:07.593236 16203 raft_consensus.cc:1240] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:07.518965 20234 raft_consensus.cc:493] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:07.578231 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:07.597872 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:07.494328 16246 leader_election.cc:304] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
W20260709 13:07:07.611390 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 117122us
I20260709 13:07:07.612520 16206 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858"
dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
mode: GRACEFUL
new_leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
 from {username='slave'} at 127.0.0.1:58160
I20260709 13:07:07.613088 16246 leader_election.cc:304] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:07.499046 20105 consensus_queue.cc:1059] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.081s
I20260709 13:07:07.615267 16353 raft_consensus.cc:2393] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 7: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:07:07.586922 20009 raft_consensus.cc:3060] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:07.571595 16199 consensus_queue.cc:237] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:07:07.629943 16946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:07:07.631585 16946 raft_consensus.cc:3060] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:07.501009 20241 raft_consensus.cc:515] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:07.618206 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:07.618832 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:07.590083 20010 leader_election.cc:290] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:07.640358 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:07.608384 16941 raft_consensus.cc:2468] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 6.
I20260709 13:07:07.641546 16351 raft_consensus.cc:2468] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 13.
I20260709 13:07:07.653844 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c15d8e9be8414c84912ab77b66bfb1" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:07.654731 16353 raft_consensus.cc:2393] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 9: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:07:07.577491 19940 consensus_queue.cc:1059] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.053s
W20260709 13:07:07.658022 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 164107us
I20260709 13:07:07.615996 20234 raft_consensus.cc:3060] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:07.658896 16322 leader_election.cc:304] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:07.655797 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:07.664599 20132 consensus_queue.cc:237] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:07.617602 20154 raft_consensus.cc:2804] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:07.665874 20154 raft_consensus.cc:493] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:07.666308 20154 raft_consensus.cc:3060] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:07.665488 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:07.668318 19979 raft_consensus.cc:3055] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:07.678623 20244 raft_consensus.cc:3055] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:07.678839 19979 raft_consensus.cc:740] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:07.679109 20244 raft_consensus.cc:740] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:07:07.679394 16949 raft_consensus.cc:1275] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:07:07.680014 20244 consensus_queue.cc:260] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:07.680478 20140 consensus_queue.cc:1059] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:07.669754 19940 raft_consensus.cc:2804] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:07.681350 20244 raft_consensus.cc:3060] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:07.681414 19940 raft_consensus.cc:493] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:07.681794 20101 raft_consensus.cc:3055] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:07.681962 19940 raft_consensus.cc:3060] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:07.674878 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:07.676960 20159 leader_election.cc:290] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:07.677793 20180 raft_consensus.cc:3055] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:07.670838 20071 consensus_queue.cc:1059] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:07.679884 19979 consensus_queue.cc:260] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:07.690003 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:07.690740 16350 raft_consensus.cc:2376] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 7. Re-sending same reply.
I20260709 13:07:07.688540 16914 leader_election.cc:304] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:07.691902 16946 raft_consensus.cc:2468] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 8.
I20260709 13:07:07.694131 16914 leader_election.cc:304] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:07.696246 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:07.699270 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:07.683607 16173 leader_election.cc:304] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:07.703328 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:07.682261 20101 raft_consensus.cc:740] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:07:07.706213 16201 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60138 (request call id 2266) took 1417 ms. Trace:
I20260709 13:07:07.617249 20160 consensus_queue.cc:1059] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.073s
W20260709 13:07:07.728130 16915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.712242 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:07.708384 16173 leader_election.cc:304] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:07.623836 20048 consensus_queue.cc:1059] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.084s
I20260709 13:07:07.716683 16201 rpcz_store.cc:276] 0709 13:07:06.289102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.289242 (+   140us) service_pool.cc:224] Handling call
0709 13:07:07.348364 (+1059122us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:07.434915 (+ 86551us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:07.705914 (+270999us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b540038a9d0. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f4888ad 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:07:07.706122 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2421263232}
I20260709 13:07:07.678663 20275 raft_consensus.cc:2804] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:07:07.749755 16174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:07.749956 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 44786.4us
I20260709 13:07:07.743692 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:07.751001 16173 leader_election.cc:304] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
W20260709 13:07:07.745709 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 132708us
I20260709 13:07:07.752236 16914 leader_election.cc:304] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:07.752362 16173 leader_election.cc:304] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:07.689597 20180 raft_consensus.cc:740] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
W20260709 13:07:07.754683 16355 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41830 (request call id 2110) took 1878 ms (client timeout 2067 ms). Trace:
I20260709 13:07:07.752528 16246 leader_election.cc:304] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:07.706907 20236 raft_consensus.cc:2804] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:07.715997 20032 raft_consensus.cc:2749] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:07:07.755110 16355 rpcz_store.cc:269] 0709 13:07:05.876139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.229703 (+353564us) service_pool.cc:224] Handling call
0709 13:07:07.754488 (+1524785us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b54000d8ed4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:07:07.754623 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2506312960}
I20260709 13:07:07.775933 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:07:07.776747 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.753397 19979 raft_consensus.cc:3060] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:07.716321 20256 raft_consensus.cc:3055] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:07.704139 20125 raft_consensus.cc:2749] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:07.760187 16246 leader_election.cc:304] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:07.717103 20192 raft_consensus.cc:3060] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:07.769749 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 185711us
I20260709 13:07:07.758060 20252 raft_consensus.cc:2749] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:07:07.781222 20290 log.cc:927] Time spent T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
W20260709 13:07:07.549485 19966 ts_tablet_manager.cc:1469] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63: Trace:
0709 13:06:57.816077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.817598 (+  1521us) service_pool.cc:224] Handling call
0709 13:06:58.104006 (+286408us) ts_tablet_manager.cc:934] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63: Initiating tablet copy from peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
0709 13:06:59.494965 (+1390959us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:07:00.683245 (+1188280us) tablet_metadata.cc:665] Metadata flushed
0709 13:07:00.683403 (+   158us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:07:00.710199 (+ 26796us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:07:00.710736 (+   537us) tablet_replica.cc:206] Creating consensus instance
0709 13:07:00.711252 (+   516us) ts_tablet_manager.cc:989] Replica registered.
0709 13:07:00.711358 (+   106us) inbound_call.cc:177] Queueing success response
0709 13:07:03.135620 (+2424262us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:07:06.920513 (+3784893us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:07:06.991725 (+ 71212us) tablet_replica.cc:261] Starting instrumentation
0709 13:07:06.992397 (+   672us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":28215,"raft.queue_time_us":790,"raft.run_cpu_time_us":202,"raft.run_wall_time_us":12594,"tablet-copy.queue_time_us":284971,"tablet-download-pool.queue_time_us":179,"tablet-download-pool.run_cpu_time_us":1678,"tablet-download-pool.run_wall_time_us":1239396,"thread_start_us":397057,"threads_started":2}
I20260709 13:07:07.757946 20155 raft_consensus.cc:2804] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:07.748446 20275 raft_consensus.cc:493] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:07.763119 20052 raft_consensus.cc:2804] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:07.769038 19994 raft_consensus.cc:493] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.773223 20212 raft_consensus.cc:3055] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:07.773732 20160 raft_consensus.cc:2804] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:07.828302 20160 raft_consensus.cc:493] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:07.828971 20160 raft_consensus.cc:3060] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:07.828426 19994 raft_consensus.cc:515] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:07.797577 16246 leader_election.cc:304] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:07.810230 16248 leader_election.cc:304] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63
W20260709 13:07:07.988296 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 190606us
I20260709 13:07:08.102917 16278 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45218 (request call id 2092) took 1689 ms. Trace:
I20260709 13:07:08.103626 16278 rpcz_store.cc:276] 0709 13:07:06.413556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.073161 (+659605us) service_pool.cc:224] Handling call
0709 13:07:07.073546 (+   385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:07.561712 (+488166us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.102180 (+540468us) spinlock_profiling.cc:243] Waited 427 ms on lock 0x7b5400389d54. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f489e01 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6
0709 13:07:08.102700 (+   520us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":981739776}
W20260709 13:07:07.800071 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 45806.6us
I20260709 13:07:07.999225 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f022e2e63ae4461d834e476ff2666991" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:08.002131 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:08.005017 16283 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45210 (request call id 2116) took 2466 ms. Trace:
W20260709 13:07:08.005240 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.820781 16352 raft_consensus.cc:1240] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
W20260709 13:07:08.116207 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 306006us
I20260709 13:07:07.763999 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:08.118844 16353 raft_consensus.cc:2393] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 7: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:07:08.118767 16248 leader_election.cc:304] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63
W20260709 13:07:07.836210 16912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:07.804064 16356 raft_consensus.cc:1240] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 6 LEADER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:08.053504 16349 raft_consensus.cc:1240] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:08.050051 16350 raft_consensus.cc:1275] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:07:08.125885 16948 raft_consensus.cc:1240] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:07:08.030179 19831 consensus_queue.cc:260] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:08.127470 19831 raft_consensus.cc:3060] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:08.131251 16948 raft_consensus.cc:1240] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:07.832966 19982 raft_consensus.cc:515] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:07.893338 19994 leader_election.cc:290] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:08.064383 19941 raft_consensus.cc:493] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.066043 20009 raft_consensus.cc:2804] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:08.067168 16277 raft_consensus.cc:1275] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:07:07.821602 20052 raft_consensus.cc:493] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:08.159730 20052 raft_consensus.cc:3060] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:08.163753 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:08.164327 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:08.164997 16204 raft_consensus.cc:2376] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 6. Re-sending same reply.
I20260709 13:07:07.817829 20101 consensus_queue.cc:260] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:07.938338 20192 raft_consensus.cc:2749] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:07.927090 20242 raft_consensus.cc:515] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:08.170091 20242 leader_election.cc:290] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 election: Requested vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:07.786993 20256 raft_consensus.cc:740] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:07.915171 20262 raft_consensus.cc:3055] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:08.179275 20262 raft_consensus.cc:740] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:08.180984 20262 consensus_queue.cc:260] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:07.816154 20303 raft_consensus.cc:2804] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:08.182149 20033 consensus_queue.cc:1059] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:08.182638 20303 raft_consensus.cc:493] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:08.183293 20303 raft_consensus.cc:3060] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:08.183617 20011 raft_consensus.cc:3055] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:08.184197 20011 raft_consensus.cc:740] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
W20260709 13:07:07.904304 20296 log.cc:927] Time spent T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:07:07.805815 20155 raft_consensus.cc:493] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:08.147339 20009 raft_consensus.cc:493] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:08.186966 20009 raft_consensus.cc:3060] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:08.187103 20155 raft_consensus.cc:3060] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:07.817970 20167 leader_election.cc:290] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:07.808036 20173 raft_consensus.cc:2804] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:08.168710 16207 raft_consensus.cc:1240] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:08.186156 20011 consensus_queue.cc:260] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:07.808079 20180 consensus_queue.cc:260] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:07.934916 20234 raft_consensus.cc:515] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:07:08.193398 20011 raft_consensus.cc:3060] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:08.193797 16173 leader_election.cc:304] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:07:07.906913 20241 leader_election.cc:290] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:07.808178 20275 raft_consensus.cc:3060] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:08.196561 20283 raft_consensus.cc:3060] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:08.096267 20244 raft_consensus.cc:493] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.199366 20244 raft_consensus.cc:515] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:08.112696 20302 raft_consensus.cc:2804] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:08.101110 20132 raft_consensus.cc:493] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.205350 20132 raft_consensus.cc:515] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:08.107556 16283 rpcz_store.cc:276] 0709 13:07:05.538898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:06.268592 (+729694us) service_pool.cc:224] Handling call
0709 13:07:06.269000 (+   408us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:06.277851 (+  8851us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:06.277889 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:06.286213 (+  8324us) log.cc:844] Serialized 26 byte log entry
0709 13:07:07.279105 (+992892us) spinlock_profiling.cc:243] Waited 7.83 ms on lock 0x7b180043f4e0. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f3625264de1 00007f36252715b1 00007f361c37ee07 00007f36251d9ab9 00007f361c39b69b 00007f361c39993f 00007f361c39bc02 00007f361f02320b 00007f361f028d23 00007f361f0290d1 00007f361f444a0f
0709 13:07:07.462428 (+183323us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:07.462475 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:07.462578 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:08.004193 (+541615us) raft_consensus.cc:1685] finished
0709 13:07:08.004259 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:08.004725 (+   466us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":724,"raft.queue_time_us":126,"raft.run_cpu_time_us":212,"raft.run_wall_time_us":12152,"spinlock_wait_cycles":18002176,"thread_start_us":183102,"threads_started":1,"wal-append.queue_time_us":1325346}
I20260709 13:07:08.134153 20159 raft_consensus.cc:3055] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:08.207224 20159 raft_consensus.cc:740] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
W20260709 13:07:08.135717 16913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:08.135356 20252 consensus_queue.cc:1059] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:07:08.210422 20252 raft_consensus.cc:3055] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:08.211114 20252 raft_consensus.cc:740] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:07:08.212294 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:08.213371 16204 raft_consensus.cc:2393] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 10: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:07:08.155784 19941 raft_consensus.cc:515] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:08.171186 20144 raft_consensus.cc:493] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:08.171656 19982 leader_election.cc:290] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:07.823901 20212 raft_consensus.cc:740] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:07:08.181452 20027 consensus_queue.cc:1059] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:08.190873 16201 raft_consensus.cc:2468] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 5.
I20260709 13:07:08.203904 20131 consensus_queue.cc:1048] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:07:08.063565 16247 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:08.201995 16173 leader_election.cc:304] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:07:08.208844 20159 consensus_queue.cc:260] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:08.136520 20236 raft_consensus.cc:493] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:08.178324 20256 consensus_queue.cc:260] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:08.215756 20234 leader_election.cc:290] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:08.191781 20173 raft_consensus.cc:493] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:08.284314 20173 raft_consensus.cc:3060] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:08.166364 20225 raft_consensus.cc:3055] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:08.220384 20262 raft_consensus.cc:3060] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:08.219262 20244 leader_election.cc:290] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:08.176921 16105 catalog_manager.cc:5697] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e reported cstate change: term changed from 10 to 11, leader changed from e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) to 363bb2f744eb486f9ad726f08214c98e (127.14.180.67). New cstate: current_term: 11 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:08.228256 20132 leader_election.cc:290] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:08.261896 16912 leader_election.cc:304] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:08.259533 20302 raft_consensus.cc:697] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:07:08.279912 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bc3c8ff9b84838a2664335d7e1582b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:08.254369 20275 raft_consensus.cc:515] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:08.212999 20252 consensus_queue.cc:260] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:08.289602 20144 raft_consensus.cc:515] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:07:08.292871 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 174527us
I20260709 13:07:08.296519 20256 raft_consensus.cc:3060] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:08.280550 20236 raft_consensus.cc:3060] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:08.297001 19941 leader_election.cc:290] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:08.286746 20283 raft_consensus.cc:2749] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:08.284123 20212 consensus_queue.cc:260] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:07:08.291707 20010 raft_consensus.cc:2804] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:08.287053 20225 raft_consensus.cc:740] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
W20260709 13:07:08.316704 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:08.346930 16915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:08.348106 20225 consensus_queue.cc:260] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } }
I20260709 13:07:08.349807 20225 raft_consensus.cc:3060] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:08.351933 20252 raft_consensus.cc:3060] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:08.352387 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:08.316984 16248 leader_election.cc:304] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:07:08.322585 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 171590us
I20260709 13:07:08.323366 20132 raft_consensus.cc:2749] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:08.326960 20234 raft_consensus.cc:493] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.333918 20207 leader_election.cc:290] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:08.334769 20159 raft_consensus.cc:3060] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:08.335666 16283 raft_consensus.cc:1275] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:07:08.335997 19856 raft_consensus.cc:2804] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:08.316802 20266 raft_consensus.cc:2749] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:08.339882 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:08.339748 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:08.341341 16349 raft_consensus.cc:1240] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:08.341794 16353 raft_consensus.cc:1240] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:07:08.342643 16355 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41832 (request call id 2005) took 1142 ms. Trace:
I20260709 13:07:08.343557 16352 raft_consensus.cc:1275] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:07:08.345708 20302 consensus_queue.cc:237] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:08.343492 20010 raft_consensus.cc:697] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
W20260709 13:07:08.353820 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 152183us
W20260709 13:07:08.362920 19940 consensus_meta.cc:287] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 0.667s	user 0.011s	sys 0.008s
I20260709 13:07:08.364071 20234 raft_consensus.cc:515] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:08.364964 16281 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45210 (request call id 2120) took 2785 ms. Trace:
I20260709 13:07:08.364657 20155 raft_consensus.cc:515] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:08.365463 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:08.366927 16279 raft_consensus.cc:1240] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:08.368288 20212 raft_consensus.cc:3060] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:08.368633 20101 raft_consensus.cc:3060] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:08.368820 20144 leader_election.cc:290] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:08.369745 20242 raft_consensus.cc:3055] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:08.384970 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:08.377936 16350 raft_consensus.cc:2468] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 7.
W20260709 13:07:08.391651 16174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:08.399827 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:08.419476 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:08.382623 19856 raft_consensus.cc:697] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
W20260709 13:07:08.431313 16174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:08.434924 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f022e2e63ae4461d834e476ff2666991" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:08.442184 16276 raft_consensus.cc:1240] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:08.436048 16282 raft_consensus.cc:2468] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 7.
I20260709 13:07:08.419875 20242 raft_consensus.cc:740] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:07:08.445293 16173 leader_election.cc:304] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:08.446712 20271 raft_consensus.cc:3055] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:08.447536 20271 raft_consensus.cc:740] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:07:08.448194 20155 leader_election.cc:290] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 11 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:07:08.448508 20152 consensus_meta.cc:287] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 0.881s	user 0.014s	sys 0.004s
I20260709 13:07:08.446311 20242 consensus_queue.cc:260] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:08.449491 16354 raft_consensus.cc:2468] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 12.
I20260709 13:07:08.450703 20180 raft_consensus.cc:3060] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:08.450737 20242 raft_consensus.cc:3060] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:08.451733 16354 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41830 (request call id 2115) took 1321 ms. Trace:
I20260709 13:07:08.453142 20010 consensus_queue.cc:237] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:08.455540 16279 raft_consensus.cc:1240] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 9. Current term is 10. Ops: []
W20260709 13:07:08.458135 20154 consensus_meta.cc:287] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3: Time spent flushing consensus metadata: real 0.791s	user 0.011s	sys 0.009s
W20260709 13:07:08.458887 19979 consensus_meta.cc:287] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 0.649s	user 0.007s	sys 0.010s
W20260709 13:07:08.460898 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 144174us
I20260709 13:07:08.464741 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:08.465044 16357 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41830 (request call id 2127) took 1329 ms. Trace:
I20260709 13:07:08.452135 16354 rpcz_store.cc:276] 0709 13:07:07.130402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.579744 (+449342us) service_pool.cc:224] Handling call
0709 13:07:08.451443 (+871699us) spinlock_profiling.cc:243] Waited 813 ms on lock 0x7b54003494d4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:07:08.451668 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1870849280}
I20260709 13:07:08.430136 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:08.380983 16355 rpcz_store.cc:276] 0709 13:07:07.124657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.772185 (+647528us) service_pool.cc:224] Handling call
0709 13:07:07.772552 (+   367us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:07.772828 (+   276us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:07:08.007086 (+234258us) log.cc:844] Serialized 14 byte log entry
0709 13:07:08.108124 (+101038us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:08.143050 (+ 34926us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:08.154300 (+ 11250us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.228386 (+ 74086us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:08.267320 (+ 38934us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":74311,"prepare.queue_time_us":43768,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":7439,"raft.run_cpu_time_us":368,"raft.run_wall_time_us":42713,"thread_start_us":276663,"threads_started":2,"wal-append.queue_time_us":115861}
I20260709 13:07:08.390211 19940 raft_consensus.cc:515] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:08.391178 20244 raft_consensus.cc:2749] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:08.469147 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:08.388211 16281 rpcz_store.cc:276] 0709 13:07:05.579135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.044661 (+1465526us) service_pool.cc:224] Handling call
0709 13:07:07.528789 (+484128us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:07.529285 (+   496us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:07.529327 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:07.529953 (+   626us) log.cc:844] Serialized 26 byte log entry
0709 13:07:07.700948 (+170995us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:07.767600 (+ 66652us) log.cc:844] Serialized 14 byte log entry
0709 13:07:07.767842 (+   242us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:07.767920 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:08.128494 (+360574us) spinlock_profiling.cc:243] Waited 2.56 ms on lock 0x7b180046aec0. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f3625264de1 00007f36252715b1 00007f361c39c522 00007f361c39e7c1 00007f361c39e779 00007f361c39e709 00007f361c39e6d1 00007f361c39d9cd 000000000038f354 000000000038f199 00007f361c37f83a
0709 13:07:08.209247 (+ 80753us) raft_consensus.cc:1685] finished
0709 13:07:08.209385 (+   138us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:08.364589 (+155204us) spinlock_profiling.cc:243] Waited 484 ms on lock 0x7b5400126450. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f4888ad 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:07:08.364769 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2555,"prepare.queue_time_us":90554,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":9719,"raft.run_cpu_time_us":309,"raft.run_wall_time_us":26261,"spinlock_wait_cycles":1118436992,"thread_start_us":170506,"threads_started":1,"wal-append.queue_time_us":246126}
I20260709 13:07:08.449215 20271 consensus_queue.cc:260] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:08.475490 16105 catalog_manager.cc:5697] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e reported cstate change: term changed from 7 to 8, leader changed from e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) to 363bb2f744eb486f9ad726f08214c98e (127.14.180.67). New cstate: current_term: 8 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:08.490173 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:08.476080 20283 raft_consensus.cc:493] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:08.494437 20283 raft_consensus.cc:515] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:08.497833 20173 raft_consensus.cc:515] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:08.499128 16200 raft_consensus.cc:3055] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:08.499800 16200 raft_consensus.cc:740] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:07:08.501566 20173 leader_election.cc:290] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 14 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:07:08.502776 16914 leader_election.cc:336] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 1.733s (SENT)
W20260709 13:07:08.504657 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 62703.4us
I20260709 13:07:08.506490 16293 tablet_copy_service.cc:342] P 0aea40d6e4374085a2e38a70a71f63e3: Request end of tablet copy session 1109f76a0b7b443a84c0327c8707bc63-73757c6fea8949e090aa4e55902a41d4 received from {username='slave'} at 127.0.0.1:42740
I20260709 13:07:08.507513 16293 tablet_copy_service.cc:434] P 0aea40d6e4374085a2e38a70a71f63e3: ending tablet copy session 1109f76a0b7b443a84c0327c8707bc63-73757c6fea8949e090aa4e55902a41d4 on tablet 73757c6fea8949e090aa4e55902a41d4 with peer 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:07:08.512154 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:08.512989 16208 raft_consensus.cc:3060] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:08.515904 16248 leader_election.cc:304] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:08.520197 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:08.521493 16278 raft_consensus.cc:2468] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 5.
I20260709 13:07:08.525054 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:08.537389 20155 raft_consensus.cc:2804] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:08.538627 20155 raft_consensus.cc:697] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:07:08.540414 20155 consensus_queue.cc:237] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:08.446292 19856 consensus_queue.cc:237] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:08.544009 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:08.546816 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:08.548331 16203 raft_consensus.cc:2393] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 5: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:07:08.549669 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:08.546350 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f022e2e63ae4461d834e476ff2666991" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:08.473760 16357 rpcz_store.cc:276] 0709 13:07:07.143025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.827382 (+684357us) service_pool.cc:224] Handling call
0709 13:07:08.007646 (+180264us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:08.089211 (+ 81565us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:08.089245 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:08.115204 (+ 25959us) log.cc:844] Serialized 26 byte log entry
0709 13:07:08.265899 (+150695us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:08.278014 (+ 12115us) log.cc:844] Serialized 14 byte log entry
0709 13:07:08.278277 (+   263us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:08.278352 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:08.345300 (+ 66948us) spinlock_profiling.cc:243] Waited 5.61 ms on lock 0x7b180029cf80. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f3625264de1 00007f36252715b1 00007f361c39c3f3 00007f361c39e7c1 00007f361c39e779 00007f361c39e709 00007f361c39e6d1 00007f361c39d9cd 000000000038f354 000000000038f199 00007f361c37f83a
0709 13:07:08.464496 (+119196us) raft_consensus.cc:1685] finished
0709 13:07:08.464621 (+   125us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:08.464811 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":13562,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":2688,"raft.queue_time_us":74998,"raft.run_cpu_time_us":729,"raft.run_wall_time_us":22694,"spinlock_wait_cycles":12893440,"thread_start_us":230346,"threads_started":2,"wal-append.queue_time_us":191412}
I20260709 13:07:08.501472 16200 consensus_queue.cc:260] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:07:08.570864 19979 consensus_queue.cc:1059] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:07:08.570892 19982 raft_consensus.cc:493] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.574159 19982 raft_consensus.cc:515] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:08.574586 19979 raft_consensus.cc:3055] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:08.575187 19979 raft_consensus.cc:740] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:08.576932 19982 leader_election.cc:290] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:08.576723 19979 consensus_queue.cc:260] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:08.577359 20318 raft_consensus.cc:2749] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:08.578800 16105 catalog_manager.cc:5697] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e reported cstate change: term changed from 11 to 12, leader changed from 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) to 363bb2f744eb486f9ad726f08214c98e (127.14.180.67). New cstate: current_term: 12 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:08.481920 19831 consensus_queue.cc:1048] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.087s
I20260709 13:07:08.572953 20271 raft_consensus.cc:3060] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:08.583288 16353 raft_consensus.cc:1240] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 9 LEADER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:08.585762 16351 raft_consensus.cc:1240] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:08.585922 20052 raft_consensus.cc:515] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:08.586925 20275 leader_election.cc:290] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:08.562320 20266 raft_consensus.cc:493] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
W20260709 13:07:08.587541 16320 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:08.587481 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:08.596619 20266 raft_consensus.cc:515] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:07:08.598299 16913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:08.572062 16246 leader_election.cc:304] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:07:08.600332 19982 raft_consensus.cc:2804] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:08.601016 19982 raft_consensus.cc:697] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:07:08.482333 20154 raft_consensus.cc:515] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:08.602241 19982 consensus_queue.cc:237] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:08.603420 20052 leader_election.cc:290] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 14 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:08.604346 20154 leader_election.cc:290] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:08.605863 16914 leader_election.cc:304] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
W20260709 13:07:08.606686 20172 consensus_meta.cc:287] T 540bfc4ad793452faea5b865343aacf7 P 1109f76a0b7b443a84c0327c8707bc63: Time spent flushing consensus metadata: real 0.696s	user 0.012s	sys 0.009s
I20260709 13:07:08.607940 20130 raft_consensus.cc:2804] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:08.608475 20130 raft_consensus.cc:493] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:08.608358 16246 leader_election.cc:304] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:08.608762 20172 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:35106 (request call id 736) took 6154 ms. Trace:
I20260709 13:07:08.609057 20130 raft_consensus.cc:3060] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:08.610919 20132 consensus_queue.cc:1059] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:08.595824 16105 catalog_manager.cc:5697] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e reported cstate change: term changed from 11 to 12, leader changed from 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) to 363bb2f744eb486f9ad726f08214c98e (127.14.180.67). New cstate: current_term: 12 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:08.612514 20131 raft_consensus.cc:3055] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:08.612970 20131 raft_consensus.cc:740] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:07:08.592779 16349 raft_consensus.cc:1240] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 10. Current term is 11. Ops: []
W20260709 13:07:08.615871 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:08.588619 16173 leader_election.cc:304] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:07:08.617343 20236 raft_consensus.cc:515] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:08.595794 16352 raft_consensus.cc:1240] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:07:08.614200 20131 consensus_queue.cc:260] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:07:08.626893 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:08.613727 16105 catalog_manager.cc:5697] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e reported cstate change: term changed from 10 to 11, leader changed from e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) to 363bb2f744eb486f9ad726f08214c98e (127.14.180.67). New cstate: current_term: 11 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:08.561619 20009 raft_consensus.cc:515] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:07:08.639891 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:08.632046 19940 leader_election.cc:290] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:07:08.632453 16248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:08.632968 20131 raft_consensus.cc:3060] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:08.634706 16174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:08.633180 16105 catalog_manager.cc:5697] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e reported cstate change: term changed from 10 to 11, leader changed from e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) to 363bb2f744eb486f9ad726f08214c98e (127.14.180.67). New cstate: current_term: 11 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } }
W20260709 13:07:08.638921 16321 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:08.609215 20172 rpcz_store.cc:276] 0709 13:07:02.453876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.507914 (+ 54038us) service_pool.cc:224] Handling call
0709 13:07:03.149449 (+641535us) ts_tablet_manager.cc:934] T 540bfc4ad793452faea5b865343aacf7 P 1109f76a0b7b443a84c0327c8707bc63: Initiating tablet copy from peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073)
0709 13:07:07.003789 (+3854340us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:07:07.909619 (+905830us) tablet_metadata.cc:665] Metadata flushed
0709 13:07:07.909768 (+   149us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:07:08.607297 (+697529us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:07:08.608131 (+   834us) tablet_replica.cc:206] Creating consensus instance
0709 13:07:08.608528 (+   397us) ts_tablet_manager.cc:989] Replica registered.
0709 13:07:08.608646 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":385,"tablet-copy.queue_time_us":430847,"thread_start_us":414691,"threads_started":2}
I20260709 13:07:08.621863 20011 raft_consensus.cc:2764] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:07:08.651696 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:08.655490 20172 tablet_copy_client.cc:806] T 540bfc4ad793452faea5b865343aacf7 P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:08.656435 20172 tablet_copy_client.cc:670] T 540bfc4ad793452faea5b865343aacf7 P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:08.657466 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:08.658934 16200 raft_consensus.cc:3060] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:08.662380 20160 consensus_meta.cc:287] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3: Time spent flushing consensus metadata: real 0.735s	user 0.013s	sys 0.002s
I20260709 13:07:08.647466 19979 raft_consensus.cc:3060] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:08.662957 20160 raft_consensus.cc:515] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:08.666371 16948 raft_consensus.cc:3060] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 LEARNER]: Advancing to term 8
I20260709 13:07:08.642004 20244 raft_consensus.cc:2749] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:07:08.648277 20283 leader_election.cc:290] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:07:08.674230 16174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:08.677381 16208 raft_consensus.cc:2468] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 10.
W20260709 13:07:08.689049 16913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:08.690588 19831 raft_consensus.cc:493] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.691471 19831 raft_consensus.cc:515] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:08.693946 19831 leader_election.cc:290] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:08.701103 16199 raft_consensus.cc:1275] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
W20260709 13:07:08.703621 16321 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:08.708909 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 100611us
I20260709 13:07:08.712267 20009 leader_election.cc:290] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:08.715448 20236 leader_election.cc:290] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:08.718657 16320 leader_election.cc:304] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
W20260709 13:07:08.721539 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 334429us
I20260709 13:07:08.724678 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:08.725545 16357 raft_consensus.cc:2393] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 8: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:07:08.725842 20234 leader_election.cc:290] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:08.726189 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:08.727069 19940 raft_consensus.cc:2804] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:08.725243 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:07:08.727682 20303 consensus_meta.cc:287] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3: Time spent flushing consensus metadata: real 0.544s	user 0.009s	sys 0.006s
W20260709 13:07:08.728111 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 60482.5us
I20260709 13:07:08.728193 20303 raft_consensus.cc:515] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:08.729803 20256 consensus_queue.cc:1048] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:08.702913 20266 leader_election.cc:290] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:08.732996 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:08.733860 16351 raft_consensus.cc:1240] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:08.734934 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:08.735088 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:08.735296 16201 raft_consensus.cc:1275] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 7. (term mismatch)
I20260709 13:07:08.735524 16350 raft_consensus.cc:1240] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [term 9 LEADER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:08.735679 16354 raft_consensus.cc:3060] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:08.735875 16351 raft_consensus.cc:2376] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 10. Re-sending same reply.
I20260709 13:07:08.736120 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:08.736778 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:08.737649 16350 raft_consensus.cc:2393] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 14: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
W20260709 13:07:08.740814 16914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:08.735709 16201 pending_rounds.cc:85] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f: Aborting all ops after (but not including) 6
I20260709 13:07:08.737264 16351 raft_consensus.cc:1240] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:08.738736 16105 catalog_manager.cc:5697] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e reported cstate change: term changed from 7 to 8, leader changed from 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) to 363bb2f744eb486f9ad726f08214c98e (127.14.180.67). New cstate: current_term: 8 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:08.740792 16246 leader_election.cc:304] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:08.741501 16201 pending_rounds.cc:107] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 8.7
I20260709 13:07:08.727679 19940 raft_consensus.cc:697] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 7 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:08.745883 16200 raft_consensus.cc:1275] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 13:07:08.743214 16348 raft_consensus.cc:2468] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 13.
I20260709 13:07:08.749346 16914 leader_election.cc:304] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:07:08.746255 16200 pending_rounds.cc:85] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f: Aborting all ops after (but not including) 5
I20260709 13:07:08.753082 16200 pending_rounds.cc:107] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:07:08.755676 19940 consensus_queue.cc:237] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:08.758069 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:08.758881 20180 raft_consensus.cc:493] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.759339 16350 raft_consensus.cc:2393] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 13: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:07:08.759495 20180 raft_consensus.cc:515] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } }
I20260709 13:07:08.761117 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:07:08.761449 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:08.762038 16349 raft_consensus.cc:1240] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 11. Current term is 13. Ops: []
I20260709 13:07:08.762116 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:08.768579 16204 raft_consensus.cc:2393] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 8: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:07:08.744225 16201 raft_consensus.cc:2917] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Aborting config change with OpId 8.7: Aborted: Op aborted by new leader
I20260709 13:07:08.764635 16173 leader_election.cc:304] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:08.753405 16200 raft_consensus.cc:2889] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:08.771051 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:08.771066 16201 raft_consensus.cc:2889] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:07:08.778775 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 129200us
W20260709 13:07:08.779238 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:08.784124 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:08.785589 20303 leader_election.cc:290] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:08.785446 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:08.787956 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:08.708878 16356 raft_consensus.cc:2955] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Committing config change with OpId 8.6: config changed from index -1 to 6, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:07:08.794396 16354 raft_consensus.cc:2468] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 11.
I20260709 13:07:08.795919 16355 raft_consensus.cc:2468] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 12.
I20260709 13:07:08.771130 20266 raft_consensus.cc:2804] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:08.798281 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:08.792105 16105 catalog_manager.cc:5697] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e reported cstate change: term changed from 5 to 7, leader changed from 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) to 363bb2f744eb486f9ad726f08214c98e (127.14.180.67). New cstate: current_term: 7 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:08.803610 16355 raft_consensus.cc:2393] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 8: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:07:08.804533 16353 raft_consensus.cc:1240] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:08.813089 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:08.812983 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:08.805879 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
W20260709 13:07:08.814689 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 63160.6us
I20260709 13:07:08.814657 16349 raft_consensus.cc:2376] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 8. Re-sending same reply.
I20260709 13:07:08.808243 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:08.818655 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:08.818701 16275 raft_consensus.cc:3060] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:08.820225 16354 raft_consensus.cc:2368] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 12. Current term is 13.
I20260709 13:07:08.817555 16208 raft_consensus.cc:2468] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 6.
I20260709 13:07:08.826139 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
W20260709 13:07:08.827195 16247 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:08.830022 16278 raft_consensus.cc:1240] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:08.840706 16282 raft_consensus.cc:3060] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:08.840641 16201 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:39040 (request call id 1) took 1358 ms. Trace:
I20260709 13:07:08.814167 20266 raft_consensus.cc:697] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:07:08.842491 16248 leader_election.cc:304] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:08.847291 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:08.851675 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bc3c8ff9b84838a2664335d7e1582b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:08.837800 20101 raft_consensus.cc:3060] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:08.816418 20262 consensus_queue.cc:1048] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:07:08.840937 20252 raft_consensus.cc:2804] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:07:08.858623 16915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:08.860567 16912 leader_election.cc:304] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:08.862591 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
W20260709 13:07:08.862655 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 113409us
I20260709 13:07:08.864544 16349 raft_consensus.cc:2376] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 10. Re-sending same reply.
I20260709 13:07:08.868440 20302 raft_consensus.cc:2804] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:08.877336 20302 raft_consensus.cc:697] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:07:08.877873 16357 raft_consensus.cc:2468] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 10.
W20260709 13:07:08.878347 20326 log.cc:927] Time spent T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 13:07:08.878576 20302 consensus_queue.cc:237] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:08.883078 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:08.883316 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:08.865680 16105 catalog_manager.cc:5697] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e reported cstate change: term changed from 9 to 11, leader changed from 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) to 363bb2f744eb486f9ad726f08214c98e (127.14.180.67). New cstate: current_term: 11 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:08.886927 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:08.869395 16280 raft_consensus.cc:1240] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:08.842890 16201 rpcz_store.cc:276] 0709 13:07:07.460770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.553674 (+ 92904us) service_pool.cc:224] Handling call
0709 13:07:07.654440 (+100766us) log.cc:844] Serialized 506 byte log entry
0709 13:07:08.180074 (+525634us) spinlock_profiling.cc:243] Waited 12.3 ms on lock 0x7b54001e3d20. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f402142 00007f361f3e2eaa 00007f361f3e9d53 00007f361f3e9cd9 00007f361f3e9c69 00007f361f3e9c31 00007f361f3e8dfd 000000000038f354 000000000038f199 00007f361c39c475
0709 13:07:08.819015 (+638941us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":219315,"raft.queue_time_us":399521,"raft.run_cpu_time_us":5526,"raft.run_wall_time_us":114774,"spinlock_wait_cycles":28304128,"thread_start_us":117438,"threads_started":1,"wal-append.queue_time_us":275681}
I20260709 13:07:08.855340 20180 leader_election.cc:290] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:08.886925 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:08.893131 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c15d8e9be8414c84912ab77b66bfb1" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:07:08.892182 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 51286.7us
W20260709 13:07:08.893199 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 128684us
I20260709 13:07:08.865782 20252 raft_consensus.cc:493] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:08.894827 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
W20260709 13:07:08.896847 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 54512.3us
I20260709 13:07:08.918815 20266 consensus_queue.cc:237] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:08.918666 20271 raft_consensus.cc:493] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.923913 20271 raft_consensus.cc:515] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:08.924363 20303 raft_consensus.cc:493] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.925201 20303 raft_consensus.cc:515] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:08.927321 20180 consensus_queue.cc:1059] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:08.928651 20264 raft_consensus.cc:3055] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:08.929405 20264 raft_consensus.cc:740] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
W20260709 13:07:08.930030 16154 auto_rebalancer.cc:629] Failed to schedule move for tablet 5054b6ad2e4141cab2232a3fecd7c858: Aborted: Op aborted by new leader
I20260709 13:07:08.930279 20271 leader_election.cc:290] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:08.930719 20264 consensus_queue.cc:260] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:08.931728 20303 leader_election.cc:290] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:08.932859 20264 raft_consensus.cc:3060] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:08.911837 20322 log.cc:927] Time spent T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.403s	user 0.007s	sys 0.000s
I20260709 13:07:08.954366 20130 raft_consensus.cc:515] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:07:08.959249 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 46696us
I20260709 13:07:08.968094 20132 consensus_queue.cc:1059] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:08.969614 20132 consensus_queue.cc:1048] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:08.933900 16173 leader_election.cc:304] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 363bb2f744eb486f9ad726f08214c98e
W20260709 13:07:08.973826 16914 leader_election.cc:336] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 2.078s (SENT)
I20260709 13:07:08.982856 16944 raft_consensus.cc:1240] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 7. Current term is 8. Ops: [7.7-7.7]
W20260709 13:07:08.986160 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 59620us
I20260709 13:07:08.979624 16200 consensus_queue.cc:237] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
W20260709 13:07:08.993114 20329 log.cc:927] Time spent T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.149s	user 0.001s	sys 0.000s
W20260709 13:07:09.002045 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:08.900344 20252 raft_consensus.cc:3060] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:09.011906 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:09.013192 20160 leader_election.cc:290] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:09.013619 16206 raft_consensus.cc:606] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Received request to transfer leadership to TS 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:07:09.028409 16206 raft_consensus.cc:614] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:09.017315 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:09.017315 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:09.029335 16274 raft_consensus.cc:2468] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 10.
I20260709 13:07:09.016640 20130 leader_election.cc:290] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 8 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:09.018921 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:09.020514 16914 leader_election.cc:304] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:07:09.037148 16174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.036083 16201 raft_consensus.cc:2468] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 7.
I20260709 13:07:08.998266 20131 raft_consensus.cc:2804] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:09.043864 16275 raft_consensus.cc:2468] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 8.
W20260709 13:07:09.048846 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.054364 16282 raft_consensus.cc:2468] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 14.
W20260709 13:07:09.055270 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.060773 16320 leader_election.cc:304] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:09.058427 16948 raft_consensus.cc:1275] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 LEARNER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:07:09.052440 20212 raft_consensus.cc:2804] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:07:09.072046 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 153469us
W20260709 13:07:09.072645 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.055425 20131 raft_consensus.cc:493] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:09.066152 16246 leader_election.cc:304] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:09.071365 16206 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:58160 (request call id 5) took 1463 ms. Trace:
W20260709 13:07:09.076951 16913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.076805 16206 rpcz_store.cc:276] 0709 13:07:07.594892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:07.598626 (+  3734us) service_pool.cc:224] Handling call
0709 13:07:09.053107 (+1454481us) spinlock_profiling.cc:243] Waited 1.4 s on lock 0x7b540038aed4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f483853 00007f362445160a 00007f361d9d77d4 00007f361d9d7762 00007f361d9d7691 00007f361d9d760c 00007f361d9d68c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:07:09.057580 (+  4473us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3219709312}
W20260709 13:07:09.090941 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 130542us
W20260709 13:07:09.093081 16174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.075314 20212 raft_consensus.cc:493] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:09.077747 20264 raft_consensus.cc:2804] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:09.078367 20131 raft_consensus.cc:3060] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:09.093111 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 119411us
I20260709 13:07:09.098536 16280 raft_consensus.cc:1240] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:09.098624 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:09.107463 16201 raft_consensus.cc:1240] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:09.111006 20318 raft_consensus.cc:493] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:09.112114 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:09.145557 16207 raft_consensus.cc:2468] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 5.
I20260709 13:07:09.146242 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:07:09.115602 20334 log.cc:927] Time spent T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:07:09.117982 20154 raft_consensus.cc:493] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:09.118673 19831 consensus_queue.cc:1059] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:09.121740 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:09.124835 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f022e2e63ae4461d834e476ff2666991" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
W20260709 13:07:09.130574 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.134343 20264 raft_consensus.cc:493] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:09.130952 20262 consensus_queue.cc:1048] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:09.086539 20160 raft_consensus.cc:2804] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:07:09.139640 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 50786.2us
W20260709 13:07:09.142411 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.151638 16203 raft_consensus.cc:2410] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:07:09.153560 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
W20260709 13:07:09.156467 20330 log.cc:927] Time spent T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.273s	user 0.001s	sys 0.001s
I20260709 13:07:09.135035 20212 raft_consensus.cc:3060] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:09.152158 20318 raft_consensus.cc:515] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:09.149235 20159 raft_consensus.cc:493] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.148741 20155 consensus_queue.cc:1048] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:07:09.173244 16199 raft_consensus.cc:3060] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:09.071261 19979 consensus_queue.cc:1048] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.082s
W20260709 13:07:09.181150 16174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.160501 16204 raft_consensus.cc:1240] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:07:09.152046 20101 raft_consensus.cc:2749] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:09.170604 16914 leader_election.cc:304] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:09.196660 16205 raft_consensus.cc:1275] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:09.164114 20336 raft_consensus.cc:3055] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:09.174530 20160 raft_consensus.cc:493] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:09.190025 20264 raft_consensus.cc:3060] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:09.168012 20236 raft_consensus.cc:493] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
W20260709 13:07:09.222384 16321 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.171396 19831 raft_consensus.cc:3055] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:09.190919 19856 raft_consensus.cc:493] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.162355 20154 raft_consensus.cc:515] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:09.194636 19982 raft_consensus.cc:493] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:09.228207 20303 consensus_queue.cc:1048] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:09.232638 19856 raft_consensus.cc:515] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:09.221869 20160 raft_consensus.cc:3060] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:09.201494 20336 raft_consensus.cc:740] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:07:09.243014 16206 raft_consensus.cc:2468] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 7.
I20260709 13:07:09.172741 16207 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aee913c41fb9437587affa768953f637"
dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
mode: GRACEFUL
new_leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
 from {username='slave'} at 127.0.0.1:58160
I20260709 13:07:09.247733 16207 raft_consensus.cc:606] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Received request to transfer leadership to TS 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:07:09.248389 16207 raft_consensus.cc:614] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:09.231498 19831 raft_consensus.cc:740] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
W20260709 13:07:09.251401 16174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.251729 19831 consensus_queue.cc:260] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:09.253300 19831 raft_consensus.cc:3060] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:09.255074 19856 leader_election.cc:290] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:09.255767 20336 consensus_queue.cc:260] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:09.257011 20154 leader_election.cc:290] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:09.257349 20336 raft_consensus.cc:3060] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:09.257699 19982 raft_consensus.cc:515] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:09.260015 19982 leader_election.cc:290] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:09.201282 20159 raft_consensus.cc:515] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:09.265653 16199 raft_consensus.cc:2468] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 13.
I20260709 13:07:09.235293 20256 consensus_queue.cc:1059] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:07:09.264199 20132 raft_consensus.cc:2749] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:09.240286 20236 raft_consensus.cc:515] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:09.346956 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:07:09.348666 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.325400 20266 raft_consensus.cc:493] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:09.350503 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:09.353826 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:09.314112 20271 raft_consensus.cc:2749] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:09.332674 19982 raft_consensus.cc:493] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
W20260709 13:07:09.376443 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 155230us
I20260709 13:07:09.370096 16203 raft_consensus.cc:2468] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 8.
I20260709 13:07:09.383423 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:07:09.396963 16320 leader_election.cc:304] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:09.428910 16246 leader_election.cc:304] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
W20260709 13:07:09.430399 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 68131us
W20260709 13:07:09.443342 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:09.444007 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:09.444866 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.433323 20275 raft_consensus.cc:2804] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:09.396847 19940 raft_consensus.cc:493] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.387197 20302 raft_consensus.cc:493] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:09.428411 20154 raft_consensus.cc:493] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.465620 16248 leader_election.cc:304] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
W20260709 13:07:09.468977 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 298491us
I20260709 13:07:09.472335 16948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:09.383853 20266 raft_consensus.cc:515] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:09.486927 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f022e2e63ae4461d834e476ff2666991" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:09.486747 20154 raft_consensus.cc:515] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:09.487897 16949 raft_consensus.cc:2393] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 8: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
I20260709 13:07:09.488466 20262 raft_consensus.cc:3055] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:09.488943 20262 raft_consensus.cc:740] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:09.489626 20154 leader_election.cc:290] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:09.491001 20159 leader_election.cc:290] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:09.490664 20302 raft_consensus.cc:515] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:09.493407 20302 leader_election.cc:290] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:09.495879 19940 raft_consensus.cc:515] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:07:09.497884 20339 log.cc:927] Time spent T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.167s	user 0.001s	sys 0.001s
I20260709 13:07:09.500558 16948 raft_consensus.cc:2410] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:07:09.449647 20132 raft_consensus.cc:493] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.477526 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:09.446765 20009 raft_consensus.cc:2804] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:09.526491 20009 raft_consensus.cc:493] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:09.526960 20009 raft_consensus.cc:3060] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:09.540206 20266 leader_election.cc:290] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:09.541239 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:09.542654 20101 raft_consensus.cc:493] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.543468 20101 raft_consensus.cc:515] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:07:09.548029 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.382391 15057 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:07:09.425419 19856 consensus_queue.cc:1059] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 13:07:09.463826 20234 raft_consensus.cc:493] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.514947 16946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:07:09.490150 20262 consensus_queue.cc:260] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:07:09.519469 20345 log.cc:927] Time spent T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:07:09.521646 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:09.523815 20244 raft_consensus.cc:2749] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:07:09.561040 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.370599 20318 leader_election.cc:290] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:07:09.578065 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.580844 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f022e2e63ae4461d834e476ff2666991" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:09.585601 16282 raft_consensus.cc:3060] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:09.582294 16912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:09.586318 16912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:09.587147 16912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.381567 19982 raft_consensus.cc:515] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:09.607633 16914 leader_election.cc:304] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
W20260709 13:07:09.578974 20252 consensus_meta.cc:287] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63: Time spent flushing consensus metadata: real 0.527s	user 0.007s	sys 0.005s
W20260709 13:07:09.611603 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 146117us
I20260709 13:07:09.614449 20341 raft_consensus.cc:2804] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:09.583657 19940 leader_election.cc:290] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:09.629667 16944 raft_consensus.cc:1240] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:07:09.631343 16281 raft_consensus.cc:1240] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 LEADER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:09.607853 20357 raft_consensus.cc:493] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:09.609349 20266 raft_consensus.cc:493] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.639991 16278 raft_consensus.cc:1240] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 13:07:09.576355 20131 raft_consensus.cc:515] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:09.619907 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
W20260709 13:07:09.641624 16913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.615093 20347 raft_consensus.cc:493] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.642927 16948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:09.649220 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:07:09.650786 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 298014us
I20260709 13:07:09.617586 20236 leader_election.cc:290] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:09.631110 20341 raft_consensus.cc:493] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:09.653046 16912 leader_election.cc:304] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:09.650182 16283 raft_consensus.cc:2468] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 12.
I20260709 13:07:09.604353 20132 raft_consensus.cc:515] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:09.663810 16948 raft_consensus.cc:2468] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 7.
I20260709 13:07:09.615396 20234 raft_consensus.cc:515] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:09.651233 20262 raft_consensus.cc:3060] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:09.668076 16173 leader_election.cc:304] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
W20260709 13:07:09.671582 16174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:09.674981 16174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.675124 16283 raft_consensus.cc:1275] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:07:09.673291 16276 raft_consensus.cc:1240] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:09.648418 20155 raft_consensus.cc:3055] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:09.627966 20252 raft_consensus.cc:515] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:07:09.678638 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 226010us
I20260709 13:07:09.687433 16282 raft_consensus.cc:2468] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 8.
I20260709 13:07:09.691790 16949 raft_consensus.cc:1240] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:09.662249 20101 leader_election.cc:290] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:09.662510 20341 raft_consensus.cc:3060] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:09.699975 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:09.700565 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:09.701225 16206 raft_consensus.cc:2468] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 8.
I20260709 13:07:09.703543 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:09.703682 16201 raft_consensus.cc:1275] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:07:09.704396 16206 raft_consensus.cc:2468] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 8.
I20260709 13:07:09.695130 16173 leader_election.cc:304] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:09.706333 16279 raft_consensus.cc:1240] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:07:09.682668 20172 tablet_copy_client.cc:538] T 540bfc4ad793452faea5b865343aacf7 P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:09.690677 19940 raft_consensus.cc:493] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.723642 16944 raft_consensus.cc:1275] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:07:09.689941 20155 raft_consensus.cc:740] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:07:09.693508 20275 raft_consensus.cc:697] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 13 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:09.664031 20212 raft_consensus.cc:515] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:09.654098 20266 raft_consensus.cc:515] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:07:09.656426 20347 raft_consensus.cc:515] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:09.731130 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:09.734511 16246 leader_election.cc:304] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:09.726711 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:09.734581 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:09.692795 20355 raft_consensus.cc:2804] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:09.654282 20357 raft_consensus.cc:515] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:09.745746 20155 consensus_queue.cc:260] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:09.747174 20155 raft_consensus.cc:3060] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:09.748335 20357 leader_election.cc:290] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:09.741598 20355 raft_consensus.cc:493] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:09.749444 20355 raft_consensus.cc:3060] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:09.750689 20351 log.cc:927] Time spent T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.085s	user 0.001s	sys 0.001s
I20260709 13:07:09.739029 20152 raft_consensus.cc:493] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
W20260709 13:07:09.752102 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.751848 20152 raft_consensus.cc:515] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:09.753175 20275 consensus_queue.cc:237] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:09.721089 20244 raft_consensus.cc:493] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:09.755474 20359 log.cc:927] Time spent T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:07:09.755035 20244 raft_consensus.cc:515] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:07:09.755954 16942 raft_consensus.cc:1275] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:07:09.741492 20101 raft_consensus.cc:2804] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:07:09.756645 20362 log.cc:927] Time spent T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:07:09.758349 16208 raft_consensus.cc:1240] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:09.758765 20367 raft_consensus.cc:2804] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:09.759393 20367 raft_consensus.cc:697] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 14 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:07:09.760816 16943 raft_consensus.cc:3060] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 LEARNER]: Advancing to term 9
I20260709 13:07:09.760425 20367 consensus_queue.cc:237] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:09.743611 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:07:09.761523 20354 log.cc:927] Time spent T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.126s	user 0.000s	sys 0.001s
I20260709 13:07:09.762714 20361 raft_consensus.cc:493] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.763372 20361 raft_consensus.cc:515] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:09.763959 16282 raft_consensus.cc:1240] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 7. Current term is 8. Ops: []
W20260709 13:07:09.765460 20346 log.cc:927] Time spent T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.266s	user 0.000s	sys 0.001s
I20260709 13:07:09.765877 16282 pending_rounds.cc:85] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3: Aborting all ops after (but not including) 8
I20260709 13:07:09.766176 16282 pending_rounds.cc:107] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:07:09.766422 16282 raft_consensus.cc:2889] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:09.766513 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:09.767210 16283 raft_consensus.cc:2468] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 5.
I20260709 13:07:09.754312 20152 leader_election.cc:290] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:09.768301 16277 raft_consensus.cc:1275] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:07:09.768955 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:09.734238 19940 raft_consensus.cc:515] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:09.771332 20357 raft_consensus.cc:493] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.771955 20357 raft_consensus.cc:515] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:09.772346 16200 raft_consensus.cc:1240] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:09.773597 20101 raft_consensus.cc:697] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 8 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:07:09.773808 20182 raft_consensus.cc:493] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.774326 20182 raft_consensus.cc:515] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:09.775416 20101 consensus_queue.cc:237] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:09.775928 20256 raft_consensus.cc:493] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:09.776563 20256 raft_consensus.cc:515] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:07:09.778218 16321 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.778065 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:09.778942 16205 raft_consensus.cc:2468] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 10.
I20260709 13:07:09.758378 20212 leader_election.cc:290] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 13 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:09.745967 19982 leader_election.cc:290] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:07:09.744789 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.731236 20159 raft_consensus.cc:493] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.762640 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:07:09.744342 16174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.808097 20130 consensus_queue.cc:1048] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:07:09.819757 16174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.823258 16206 raft_consensus.cc:2393] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 13: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:07:09.824229 16946 raft_consensus.cc:2468] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 10.
W20260709 13:07:09.826578 16248 leader_election.cc:336] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 1.505s (SENT)
I20260709 13:07:09.826608 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:09.827579 16208 raft_consensus.cc:3060] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:09.731881 20358 raft_consensus.cc:493] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.839392 16248 leader_election.cc:304] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:09.840437 16205 raft_consensus.cc:1275] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:07:09.823606 16915 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.610s	user 0.010s	sys 0.009s
W20260709 13:07:09.844808 16915 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.631s	user 0.010s	sys 0.009s
I20260709 13:07:09.847615 16949 raft_consensus.cc:2468] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 8.
W20260709 13:07:09.801285 16173 connection.cc:256] RPC call timeout handler was delayed by -1.033983815000056s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.25680000000000003s for a response
I20260709 13:07:09.809487 20236 raft_consensus.cc:2804] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:09.763375 20132 leader_election.cc:290] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:07:09.865705 16173 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:09.866307 16173 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:09.866837 16173 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.864372 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:09.835687 20212 raft_consensus.cc:493] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:09.865273 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:09.872296 16205 raft_consensus.cc:2393] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 9: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
W20260709 13:07:09.857510 20336 consensus_meta.cc:287] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63: Time spent flushing consensus metadata: real 0.599s	user 0.012s	sys 0.007s
I20260709 13:07:09.877696 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bc3c8ff9b84838a2664335d7e1582b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:09.885192 16199 raft_consensus.cc:2468] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 8.
I20260709 13:07:09.896399 16279 raft_consensus.cc:2468] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 10.
I20260709 13:07:09.834329 20159 raft_consensus.cc:515] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:07:09.916941 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.863727 20236 raft_consensus.cc:493] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
W20260709 13:07:09.927937 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:09.932376 16320 leader_election.cc:304] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:09.937568 16281 raft_consensus.cc:1275] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:07:09.879348 19982 raft_consensus.cc:2749] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:09.914397 16208 raft_consensus.cc:2468] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 6.
W20260709 13:07:09.952049 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 210936us
I20260709 13:07:09.957573 16912 leader_election.cc:304] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:09.963734 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:09.956904 16246 leader_election.cc:304] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
W20260709 13:07:09.939445 20328 log.cc:927] Time spent T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 13:07:09.873808 20132 consensus_queue.cc:1059] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.066s
I20260709 13:07:09.905398 20252 leader_election.cc:290] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 6 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:09.977643 16283 raft_consensus.cc:1275] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
I20260709 13:07:09.850772 20358 raft_consensus.cc:515] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:09.939254 20225 raft_consensus.cc:493] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.934762 20236 raft_consensus.cc:3060] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:09.935096 20271 raft_consensus.cc:493] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.978091 16283 pending_rounds.cc:85] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3: Aborting all ops after (but not including) 7
I20260709 13:07:09.938946 19940 leader_election.cc:290] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:09.985795 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:09.985834 16283 pending_rounds.cc:107] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 13:07:09.987380 16283 raft_consensus.cc:2889] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:09.986747 16281 raft_consensus.cc:2468] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 12.
I20260709 13:07:09.905462 19979 consensus_queue.cc:1059] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.074s
I20260709 13:07:09.957437 20234 leader_election.cc:290] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:09.964121 20131 leader_election.cc:290] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 6 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:09.965469 19831 raft_consensus.cc:493] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
W20260709 13:07:09.995338 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 69657.8us
I20260709 13:07:09.981391 20302 raft_consensus.cc:2804] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:09.918710 20212 raft_consensus.cc:515] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:07:09.999687 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 62878.9us
I20260709 13:07:10.008647 16914 leader_election.cc:304] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:09.976061 20154 consensus_queue.cc:1048] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 13:07:09.992607 20256 leader_election.cc:290] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:09.993463 20357 leader_election.cc:290] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:09.980528 20361 leader_election.cc:290] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:10.026764 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:10.000138 20241 raft_consensus.cc:493] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.027849 16274 raft_consensus.cc:3060] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:10.003993 20342 raft_consensus.cc:493] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.997279 20252 raft_consensus.cc:493] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.017042 16320 leader_election.cc:304] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:09.989851 20225 raft_consensus.cc:515] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:10.069195 20225 leader_election.cc:290] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:10.070286 15057 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:10.069892 20252 raft_consensus.cc:515] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:10.013240 20182 leader_election.cc:290] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:07:10.071714 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:10.071908 20159 leader_election.cc:290] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:10.072357 20252 leader_election.cc:290] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:10.004496 20271 raft_consensus.cc:515] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:10.078449 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:10.080507 20271 leader_election.cc:290] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:10.018579 16945 raft_consensus.cc:1275] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:10.081347 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:10.083266 20212 leader_election.cc:290] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:10.084426 20380 consensus_queue.cc:1048] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:10.004551 19831 raft_consensus.cc:515] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:07:10.023367 20375 log.cc:927] Time spent T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 13:07:09.995481 20180 raft_consensus.cc:2804] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:10.000833 20302 raft_consensus.cc:493] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:10.026993 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:10.004370 20130 raft_consensus.cc:2804] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:10.035303 16943 raft_consensus.cc:1275] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63 [term 9 LEARNER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:07:10.018523 20383 consensus_queue.cc:1059] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:07:10.039994 20266 leader_election.cc:290] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:10.039886 20360 consensus_queue.cc:1059] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.085s
I20260709 13:07:10.043004 20358 leader_election.cc:290] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:10.130659 20302 raft_consensus.cc:3060] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:10.130164 20252 raft_consensus.cc:2804] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:10.046890 16095 maintenance_manager.cc:419] P 4dc6f08597514f4d85fd451b999b403e: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033380
I20260709 13:07:10.048143 20244 leader_election.cc:290] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:07:10.050766 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 88026.5us
I20260709 13:07:10.146512 16173 leader_election.cc:304] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
W20260709 13:07:10.056018 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:10.147698 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:10.148381 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:10.057881 20152 raft_consensus.cc:3055] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:10.046104 20236 raft_consensus.cc:515] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:10.059216 20347 leader_election.cc:290] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:07:10.061558 16321 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:10.061784 20357 raft_consensus.cc:493] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:10.061612 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 44640.7us
W20260709 13:07:10.063560 20009 consensus_meta.cc:287] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3: Time spent flushing consensus metadata: real 0.536s	user 0.010s	sys 0.008s
I20260709 13:07:10.171046 19940 raft_consensus.cc:493] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:10.170938 20009 raft_consensus.cc:515] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:10.163322 20252 raft_consensus.cc:697] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 LEADER]: Becoming Leader. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:07:10.171775 19940 raft_consensus.cc:515] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:07:10.064486 20256 raft_consensus.cc:2804] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:10.065164 20241 raft_consensus.cc:515] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:10.173473 20212 raft_consensus.cc:3055] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:10.187093 20212 raft_consensus.cc:740] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:07:10.188078 20241 leader_election.cc:290] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:10.007992 20371 consensus_queue.cc:1048] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.068s
I20260709 13:07:10.156250 20152 raft_consensus.cc:740] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:10.066381 20342 raft_consensus.cc:515] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:10.188326 20212 consensus_queue.cc:260] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:10.189397 20152 consensus_queue.cc:260] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:10.022996 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:10.190780 20152 raft_consensus.cc:3060] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:10.191121 16199 raft_consensus.cc:2393] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 14: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
W20260709 13:07:10.095448 16174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:10.192647 16174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:10.100821 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:10.156459 20130 raft_consensus.cc:697] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [term 6 LEADER]: Becoming Leader. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
W20260709 13:07:10.194643 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:10.194753 20387 raft_consensus.cc:493] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.195495 20130 consensus_queue.cc:237] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:10.195559 20387 raft_consensus.cc:515] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:07:10.097172 20160 consensus_meta.cc:287] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3: Time spent flushing consensus metadata: real 0.816s	user 0.012s	sys 0.000s
I20260709 13:07:10.197140 20160 raft_consensus.cc:515] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:10.198733 20225 raft_consensus.cc:493] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.199317 20225 raft_consensus.cc:515] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } }
W20260709 13:07:10.101001 20264 consensus_meta.cc:287] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 0.838s	user 0.011s	sys 0.002s
I20260709 13:07:10.087647 20384 raft_consensus.cc:493] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.099717 20180 raft_consensus.cc:493] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:10.167685 16274 raft_consensus.cc:2468] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 6.
I20260709 13:07:10.173609 16280 raft_consensus.cc:1240] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:10.172658 20252 consensus_queue.cc:237] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:07:10.198755 20388 log.cc:927] Time spent T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.163s	user 0.001s	sys 0.000s
I20260709 13:07:10.215588 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:10.216578 16203 raft_consensus.cc:2468] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 8.
I20260709 13:07:10.208429 20342 leader_election.cc:290] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:10.147233 20358 raft_consensus.cc:3055] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:10.218585 20358 raft_consensus.cc:740] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:10.219482 20358 consensus_queue.cc:260] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:10.220669 20358 raft_consensus.cc:3060] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:10.201498 20225 leader_election.cc:290] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:10.223219 20373 raft_consensus.cc:493] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:10.223955 20182 raft_consensus.cc:493] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.223814 20373 raft_consensus.cc:515] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:10.224491 20182 raft_consensus.cc:515] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:10.226169 20373 leader_election.cc:290] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:07:10.184322 16321 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:10.185801 20256 raft_consensus.cc:493] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
W20260709 13:07:10.208452 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 62074.9us
I20260709 13:07:10.226490 20182 leader_election.cc:290] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:10.226974 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:10.238757 16173 leader_election.cc:304] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:10.207263 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:10.100760 20341 raft_consensus.cc:515] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:07:10.212209 16174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:10.213914 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:10.208565 20357 raft_consensus.cc:515] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:10.214725 20180 raft_consensus.cc:3060] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:10.166627 20385 consensus_queue.cc:1048] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 13:07:10.214944 20264 raft_consensus.cc:515] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:07:10.212203 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:10.155691 20244 raft_consensus.cc:493] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:10.247244 16200 raft_consensus.cc:2468] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 11.
I20260709 13:07:10.190276 20212 raft_consensus.cc:3060] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:10.176807 20360 raft_consensus.cc:2749] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:10.237521 20256 raft_consensus.cc:3060] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:10.236770 20172 tablet_bootstrap.cc:492] T 540bfc4ad793452faea5b865343aacf7 P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap starting.
W20260709 13:07:10.254122 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 240767us
W20260709 13:07:10.295928 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 314019us
I20260709 13:07:10.335811 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:07:10.300117 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:10.249723 20225 raft_consensus.cc:2749] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:10.329082 16320 leader_election.cc:304] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:10.345016 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:10.345752 16320 leader_election.cc:304] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:10.347451 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:07:10.351854 20382 log.cc:927] Time spent T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
W20260709 13:07:10.353309 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 282272us
I20260709 13:07:10.354271 16322 leader_election.cc:304] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:10.355362 20371 raft_consensus.cc:2749] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:10.355881 20373 consensus_queue.cc:1059] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:10.358083 20373 raft_consensus.cc:3055] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:10.358487 20373 raft_consensus.cc:740] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:10.359328 20182 raft_consensus.cc:2804] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:10.360023 20182 raft_consensus.cc:493] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:10.359398 20373 consensus_queue.cc:260] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:10.360421 20182 raft_consensus.cc:3060] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:10.361176 20373 raft_consensus.cc:3060] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:10.356575 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:10.356606 20383 consensus_queue.cc:1048] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:10.364616 20383 raft_consensus.cc:2804] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:10.365087 20383 raft_consensus.cc:493] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:10.365440 20383 raft_consensus.cc:3060] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:07:10.367374 16248 leader_election.cc:336] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 1.529s (SENT)
I20260709 13:07:10.367897 16248 leader_election.cc:304] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:10.368772 20318 raft_consensus.cc:2749] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:07:10.370921 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 132256us
I20260709 13:07:10.371848 16173 leader_election.cc:304] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:10.376986 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:10.377996 16277 raft_consensus.cc:2468] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 8.
W20260709 13:07:10.385731 16248 leader_election.cc:336] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 1.549s (SENT)
I20260709 13:07:10.249127 20101 consensus_queue.cc:1048] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.096s
W20260709 13:07:10.387998 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 355660us
I20260709 13:07:10.386302 16248 leader_election.cc:304] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:10.334990 20387 leader_election.cc:290] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:10.393541 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:10.401002 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c15d8e9be8414c84912ab77b66bfb1" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:10.294480 20244 raft_consensus.cc:515] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:10.386355 16941 raft_consensus.cc:2393] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 11: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
I20260709 13:07:10.390457 16283 raft_consensus.cc:2468] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 10.
I20260709 13:07:10.421444 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:10.392741 20225 raft_consensus.cc:2749] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:10.420090 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:10.454324 16322 leader_election.cc:304] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:10.396600 20302 raft_consensus.cc:515] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:10.416610 20318 raft_consensus.cc:2749] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:10.416632 20234 raft_consensus.cc:493] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:10.459462 20236 leader_election.cc:290] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:10.223788 20275 raft_consensus.cc:2955] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 9 LEADER]: Committing config change with OpId 7.5: config changed from index -1 to 5, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:07:10.462540 20244 leader_election.cc:290] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:10.463544 20264 leader_election.cc:290] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:10.465525 19831 leader_election.cc:290] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:07:10.468271 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:10.477109 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:10.246963 20384 raft_consensus.cc:515] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:10.419605 19940 leader_election.cc:290] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:10.494831 16207 raft_consensus.cc:3060] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:10.496687 20132 raft_consensus.cc:493] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.475402 20347 raft_consensus.cc:493] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:10.495374 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 124786us
I20260709 13:07:10.477627 20241 raft_consensus.cc:2749] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:10.500089 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:10.502449 16945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:10.515976 16940 raft_consensus.cc:1275] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:07:10.519544 16943 raft_consensus.cc:2393] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 10: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:07:10.522706 16946 raft_consensus.cc:1275] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:10.481312 20380 consensus_queue.cc:1048] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:07:10.485862 20234 raft_consensus.cc:515] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:10.539336 16173 leader_election.cc:304] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
W20260709 13:07:10.549537 20394 log.cc:927] Time spent T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
W20260709 13:07:10.550664 16321 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:10.547019 20360 raft_consensus.cc:2749] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:07:10.552465 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:10.542851 20355 consensus_meta.cc:287] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63: Time spent flushing consensus metadata: real 0.793s	user 0.013s	sys 0.007s
W20260709 13:07:10.556128 16248 leader_election.cc:336] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 1.569s (SENT)
I20260709 13:07:10.556720 16248 leader_election.cc:304] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:07:10.554319 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 71970.5us
I20260709 13:07:10.561007 16173 leader_election.cc:304] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:10.521661 20347 raft_consensus.cc:515] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:10.527659 20132 raft_consensus.cc:515] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:10.569001 16173 leader_election.cc:304] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:10.587812 16322 leader_election.cc:304] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:07:10.597235 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 51938.7us
I20260709 13:07:10.605125 16207 raft_consensus.cc:2468] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 11.
W20260709 13:07:10.592044 20396 log.cc:927] Time spent T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
I20260709 13:07:10.606894 16912 leader_election.cc:304] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:10.567313 20101 raft_consensus.cc:2749] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:10.575366 20357 leader_election.cc:290] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:10.588737 20384 leader_election.cc:290] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:10.595777 20302 leader_election.cc:290] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:10.575507 20236 raft_consensus.cc:2749] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:10.596128 20347 leader_election.cc:290] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:07:10.622603 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 59037us
I20260709 13:07:10.627331 16322 leader_election.cc:304] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:07:10.632586 20182 raft_consensus.cc:515] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:10.612846 20264 raft_consensus.cc:2749] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:10.612788 20387 consensus_queue.cc:1048] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:07:10.568584 20360 consensus_queue.cc:1059] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 13:07:10.617358 20130 raft_consensus.cc:2804] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:10.637167 16201 raft_consensus.cc:1275] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 7. (term mismatch)
I20260709 13:07:10.658800 16201 pending_rounds.cc:85] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f: Aborting all ops after (but not including) 6
I20260709 13:07:10.659116 16201 pending_rounds.cc:107] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 13:07:10.659287 16201 raft_consensus.cc:2889] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:10.637701 20132 leader_election.cc:290] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:07:10.651292 16248 leader_election.cc:336] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 1.617s (SENT)
I20260709 13:07:10.652339 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:10.661046 16248 leader_election.cc:304] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:10.641860 20367 raft_consensus.cc:3060] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:10.566769 20355 raft_consensus.cc:515] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:10.670205 20414 raft_consensus.cc:2749] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:07:10.671226 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:10.671978 16208 raft_consensus.cc:3060] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:10.681061 16208 raft_consensus.cc:2468] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 8.
I20260709 13:07:10.683583 16912 leader_election.cc:304] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:10.684911 20347 raft_consensus.cc:2804] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:10.685627 20347 raft_consensus.cc:697] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 LEADER]: Becoming Leader. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
W20260709 13:07:10.690733 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 63489.5us
I20260709 13:07:10.692233 16322 leader_election.cc:304] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:07:10.692474 16914 leader_election.cc:304] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:10.694676 20009 leader_election.cc:290] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:10.694990 20371 raft_consensus.cc:2749] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:10.694789 20414 consensus_queue.cc:1059] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:10.696424 20371 consensus_queue.cc:1059] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:10.696592 20414 raft_consensus.cc:3055] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:10.697189 20414 raft_consensus.cc:740] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:10.697832 20413 raft_consensus.cc:3055] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:10.698299 20413 raft_consensus.cc:740] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:10.699127 20399 raft_consensus.cc:2749] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:07:10.700680 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 51973.7us
I20260709 13:07:10.703492 20302 raft_consensus.cc:2749] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:10.694531 16322 leader_election.cc:304] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:10.699318 20413 consensus_queue.cc:260] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:10.694312 16914 leader_election.cc:304] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
W20260709 13:07:10.699431 16321 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:10.634315 20383 raft_consensus.cc:515] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:10.718693 16914 leader_election.cc:304] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:07:10.682150 20355 leader_election.cc:290] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 8 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:07:10.716432 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 47182.8us
I20260709 13:07:10.705885 16248 leader_election.cc:304] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:10.717527 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:10.698416 20414 consensus_queue.cc:260] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:10.722051 20413 raft_consensus.cc:3060] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:10.722275 20360 consensus_queue.cc:1059] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:10.722926 20399 consensus_queue.cc:1048] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:10.742893 20264 raft_consensus.cc:493] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.743486 20264 raft_consensus.cc:515] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:10.723681 20132 raft_consensus.cc:2804] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:10.744339 20132 raft_consensus.cc:493] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:10.744836 20132 raft_consensus.cc:3060] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:10.745679 20264 leader_election.cc:290] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:10.724084 16941 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40078 (request call id 464) took 1147 ms. Trace:
W20260709 13:07:10.724336 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:10.664881 20130 raft_consensus.cc:697] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 LEADER]: Becoming Leader. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:07:10.724843 20241 raft_consensus.cc:2804] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:10.725813 20374 raft_consensus.cc:2804] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:10.718883 20212 raft_consensus.cc:3055] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:07:10.722054 20406 log.cc:927] Time spent T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:07:10.728595 16173 leader_election.cc:304] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:07:10.715849 20342 raft_consensus.cc:493] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.758898 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:10.759121 20342 raft_consensus.cc:515] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:10.759792 16204 raft_consensus.cc:2410] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:07:10.760839 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:10.761584 16204 raft_consensus.cc:2393] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 13: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:07:10.731863 20302 raft_consensus.cc:2749] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:10.763008 20130 consensus_queue.cc:237] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:10.753105 20241 raft_consensus.cc:493] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:10.765237 20241 raft_consensus.cc:3060] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:10.769665 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:10.770664 16203 raft_consensus.cc:2393] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 8: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
I20260709 13:07:10.772845 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:07:10.732767 20262 consensus_meta.cc:287] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 1.040s	user 0.010s	sys 0.007s
I20260709 13:07:10.732892 16248 leader_election.cc:304] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:10.733537 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:10.731256 20383 leader_election.cc:290] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:10.740779 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:10.742111 20360 raft_consensus.cc:3055] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:10.725894 20234 leader_election.cc:290] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:10.757108 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:10.757535 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:10.752771 20374 raft_consensus.cc:493] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:10.758414 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:10.783583 16274 raft_consensus.cc:3060] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:10.775069 16277 raft_consensus.cc:1275] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:07:10.778218 16207 raft_consensus.cc:3060] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:10.738737 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 44292.5us
I20260709 13:07:10.775964 20341 leader_election.cc:290] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 11 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:10.761475 20342 leader_election.cc:290] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:07:10.790030 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 57246us
W20260709 13:07:10.792356 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:10.793159 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:10.794162 16208 raft_consensus.cc:3060] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:10.802712 16322 leader_election.cc:304] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:10.753082 20212 raft_consensus.cc:740] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:07:10.808825 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:10.809396 16248 leader_election.cc:304] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:10.809521 16203 raft_consensus.cc:3060] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:07:10.787163 20225 raft_consensus.cc:2804] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:10.782764 20360 raft_consensus.cc:740] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:07:10.788009 20374 raft_consensus.cc:3060] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:10.823338 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 94846.3us
I20260709 13:07:10.812690 16322 leader_election.cc:304] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:10.815819 16274 raft_consensus.cc:2468] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 11.
I20260709 13:07:10.797078 20234 raft_consensus.cc:2749] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:10.818638 20341 consensus_queue.cc:1048] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 13:07:10.822974 20373 raft_consensus.cc:2749] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:10.827982 20131 raft_consensus.cc:3055] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:10.841089 16208 raft_consensus.cc:2468] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 9.
I20260709 13:07:10.748128 16941 rpcz_store.cc:276] 0709 13:07:09.576644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.578437 (+  1793us) service_pool.cc:224] Handling call
0709 13:07:10.723813 (+1145376us) spinlock_profiling.cc:243] Waited 649 ms on lock 0x7b5400550354. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:07:10.723997 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1493809920}
I20260709 13:07:10.834753 16248 leader_election.cc:304] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:07:10.798437 20264 consensus_queue.cc:1048] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:07:10.852288 20160 leader_election.cc:290] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:10.843724 20358 raft_consensus.cc:2749] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:10.855248 20212 consensus_queue.cc:260] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:10.857385 16203 raft_consensus.cc:2468] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 13.
I20260709 13:07:10.859303 16173 leader_election.cc:304] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:07:10.879484 16949 raft_consensus.cc:1275] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:07:10.880847 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
W20260709 13:07:10.860512 20412 log.cc:927] Time spent T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
I20260709 13:07:10.860922 20009 consensus_queue.cc:1048] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:10.881531 16279 raft_consensus.cc:3060] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:10.867769 20360 consensus_queue.cc:260] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:10.884816 20360 raft_consensus.cc:3060] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:10.868882 16277 raft_consensus.cc:1275] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:07:10.868966 20244 consensus_queue.cc:1048] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:10.886579 19831 raft_consensus.cc:2804] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:10.887408 19831 raft_consensus.cc:697] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 10 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:07:10.846912 20302 raft_consensus.cc:2749] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:10.887470 20417 consensus_queue.cc:1048] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:10.888460 20342 consensus_queue.cc:1048] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:10.889528 20182 leader_election.cc:290] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:10.831144 20225 raft_consensus.cc:697] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 12 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:07:10.895794 16276 raft_consensus.cc:1240] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:10.873857 20234 raft_consensus.cc:2804] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:10.926375 20234 raft_consensus.cc:493] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:10.926925 20234 raft_consensus.cc:3060] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:10.927878 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:10.928604 16203 raft_consensus.cc:2468] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 9.
I20260709 13:07:10.929730 16947 raft_consensus.cc:1275] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:07:10.877025 20212 raft_consensus.cc:3060] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:10.930850 20374 raft_consensus.cc:515] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:07:10.933485 16173 leader_election.cc:336] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 1.714s (SENT)
I20260709 13:07:10.897174 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:10.897833 16940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:10.935009 16282 raft_consensus.cc:2468] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 8.
W20260709 13:07:10.938010 20416 log.cc:927] Time spent T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.180s	user 0.004s	sys 0.000s
I20260709 13:07:10.809046 20347 consensus_queue.cc:237] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:10.888473 19831 consensus_queue.cc:237] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:10.902997 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:07:10.904886 16248 leader_election.cc:336] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 2.067s (SENT)
I20260709 13:07:10.897845 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:10.896234 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:10.949740 16248 leader_election.cc:304] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:10.950098 16274 raft_consensus.cc:2468] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 9.
I20260709 13:07:10.946305 16912 leader_election.cc:304] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:10.909669 16279 raft_consensus.cc:2468] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 13.
I20260709 13:07:10.912642 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:10.953408 16941 raft_consensus.cc:2393] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 12: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
I20260709 13:07:10.914129 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:10.954396 16281 raft_consensus.cc:2468] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 13.
I20260709 13:07:10.914892 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:10.914801 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:10.917309 16278 raft_consensus.cc:1275] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:07:10.916397 16280 raft_consensus.cc:1275] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:07:10.919902 16207 raft_consensus.cc:2468] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 9.
W20260709 13:07:10.893316 20180 consensus_meta.cc:287] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 0.568s	user 0.009s	sys 0.004s
I20260709 13:07:10.834035 20131 raft_consensus.cc:740] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:07:10.916304 16246 leader_election.cc:304] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:10.935086 16940 raft_consensus.cc:2468] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 10.
W20260709 13:07:10.994370 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 78161.1us
I20260709 13:07:10.898344 20225 consensus_queue.cc:237] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:10.947692 16173 leader_election.cc:304] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
W20260709 13:07:10.983237 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 78379.4us
I20260709 13:07:10.951176 20374 leader_election.cc:290] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 11 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:07:10.989439 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 181508us
I20260709 13:07:10.957662 20341 raft_consensus.cc:2804] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:07:10.997959 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 185324us
W20260709 13:07:10.998422 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 50815.3us
I20260709 13:07:10.972038 20160 raft_consensus.cc:2749] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:11.000622 16246 leader_election.cc:304] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:11.000623 16173 leader_election.cc:304] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:11.010756 16173 leader_election.cc:304] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:10.984395 20357 raft_consensus.cc:493] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.002893 16320 leader_election.cc:304] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:11.018643 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:11.019541 16356 raft_consensus.cc:3060] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:10.999346 20009 raft_consensus.cc:2804] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:07:11.007400 20256 consensus_meta.cc:287] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 0.666s	user 0.013s	sys 0.000s
I20260709 13:07:11.001670 20341 raft_consensus.cc:493] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:11.001327 20360 raft_consensus.cc:2764] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:07:11.008565 20367 raft_consensus.cc:2749] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:11.034456 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:11.034701 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:11.036547 16353 raft_consensus.cc:3060] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:11.038062 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:11.038952 16207 raft_consensus.cc:3060] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:11.031651 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:11.040628 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:11.040923 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:11.042191 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:11.017431 20101 raft_consensus.cc:2804] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:11.017604 20361 raft_consensus.cc:2804] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:11.043138 16275 raft_consensus.cc:3060] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:10.997133 20180 raft_consensus.cc:515] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:11.043879 16248 leader_election.cc:304] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:11.040676 16350 raft_consensus.cc:2468] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 13.
I20260709 13:07:11.020150 20244 raft_consensus.cc:2804] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:11.050974 16352 raft_consensus.cc:1240] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:07:11.025735 20413 raft_consensus.cc:2804] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:11.057670 16354 raft_consensus.cc:1240] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 7. Current term is 8. Ops: []
W20260709 13:07:11.059733 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 47764.1us
I20260709 13:07:11.063010 16356 raft_consensus.cc:2468] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 9.
I20260709 13:07:11.034485 20358 raft_consensus.cc:493] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.017182 20155 consensus_queue.cc:1048] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:07:11.068141 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:11.035606 20341 raft_consensus.cc:3060] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:11.042889 20384 raft_consensus.cc:493] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.025700 19940 consensus_queue.cc:1059] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:07:11.047669 20009 raft_consensus.cc:697] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:07:11.027305 20357 raft_consensus.cc:515] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:11.077028 16349 raft_consensus.cc:2393] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 11: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:07:11.046203 20101 raft_consensus.cc:493] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:11.051524 20361 raft_consensus.cc:493] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:11.083249 16946 raft_consensus.cc:1240] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 10. Current term is 11. Ops: []
W20260709 13:07:11.105244 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 71665.6us
I20260709 13:07:11.084236 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:11.106577 16355 raft_consensus.cc:2468] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 9.
I20260709 13:07:11.064217 20160 raft_consensus.cc:3060] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:11.095700 19940 raft_consensus.cc:3055] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:11.076105 20360 consensus_queue.cc:1048] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:07:11.069676 20244 raft_consensus.cc:697] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
W20260709 13:07:11.120283 16321 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:11.127269 16353 raft_consensus.cc:2468] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 14.
I20260709 13:07:11.053960 20131 consensus_queue.cc:260] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:11.132496 16248 leader_election.cc:304] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:11.104465 16207 raft_consensus.cc:2468] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 9.
I20260709 13:07:11.134961 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:11.135691 16353 raft_consensus.cc:2468] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 14.
I20260709 13:07:11.100802 16348 raft_consensus.cc:2468] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 11.
I20260709 13:07:11.113615 15057 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:11.043762 20256 raft_consensus.cc:515] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:11.109354 19940 raft_consensus.cc:740] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:11.115605 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:11.130151 16357 raft_consensus.cc:2410] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:07:11.102451 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:11.080771 20413 raft_consensus.cc:697] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 13 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:11.147974 16356 raft_consensus.cc:2393] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 9: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:07:11.108351 20101 raft_consensus.cc:3060] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:11.109759 20361 raft_consensus.cc:3060] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:11.149873 16248 leader_election.cc:304] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:11.156489 16275 raft_consensus.cc:2468] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 11.
W20260709 13:07:11.151831 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 90903.6us
I20260709 13:07:11.076304 20358 raft_consensus.cc:515] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:11.164604 20234 raft_consensus.cc:515] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:11.161257 20236 raft_consensus.cc:2749] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:11.081094 20384 raft_consensus.cc:515] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:07:11.185709 16248 leader_election.cc:336] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 1.609s (SENT)
I20260709 13:07:11.186470 16248 leader_election.cc:304] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:11.144543 20302 raft_consensus.cc:2749] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:11.127457 20380 raft_consensus.cc:493] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.188099 16173 leader_election.cc:304] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:11.182277 16351 raft_consensus.cc:2468] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 13.
I20260709 13:07:11.166513 20234 leader_election.cc:290] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 election: Requested vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:11.192348 16353 raft_consensus.cc:1275] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:07:11.195580 16354 raft_consensus.cc:1240] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:11.196846 20357 leader_election.cc:290] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:11.197206 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:11.197489 19940 consensus_queue.cc:260] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:11.198010 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
W20260709 13:07:11.199952 20427 log.cc:927] Time spent T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260709 13:07:11.233964 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 45994.7us
I20260709 13:07:11.153060 20132 raft_consensus.cc:515] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:11.229051 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:11.237957 16351 raft_consensus.cc:2410] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for term 14 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:07:11.232722 16356 raft_consensus.cc:1275] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:07:11.187641 20131 raft_consensus.cc:3060] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:11.245599 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:11.246716 16353 raft_consensus.cc:2393] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 12: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:07:11.248699 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:11.250079 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:11.245641 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:11.248799 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:07:11.251354 16354 raft_consensus.cc:2393] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 11: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:07:11.256979 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:11.261245 16943 raft_consensus.cc:2393] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 9: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
W20260709 13:07:11.262931 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 77280.7us
I20260709 13:07:11.265208 16248 leader_election.cc:304] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:11.265064 20417 consensus_queue.cc:1048] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:07:11.238260 20236 raft_consensus.cc:2749] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:11.277441 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:11.278928 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:11.283958 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:11.285105 16320 leader_election.cc:304] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:11.289546 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:11.271173 20302 raft_consensus.cc:2749] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:11.251436 20380 raft_consensus.cc:515] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:11.252354 20241 raft_consensus.cc:515] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:11.327620 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:11.287791 20420 raft_consensus.cc:493] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.329043 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:11.330199 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:11.330632 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:11.330899 16353 raft_consensus.cc:2468] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 8.
I20260709 13:07:11.332082 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:11.332857 16353 raft_consensus.cc:2468] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 13.
I20260709 13:07:11.275441 20431 raft_consensus.cc:2764] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:07:11.259140 20413 consensus_queue.cc:237] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:11.238536 20009 consensus_queue.cc:237] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:11.345026 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:11.326131 20262 raft_consensus.cc:2804] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:11.350749 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:11.355157 16348 raft_consensus.cc:1240] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:07:11.357843 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:11.359323 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:11.360400 16351 raft_consensus.cc:2393] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 11: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:07:11.358033 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:11.361402 16353 raft_consensus.cc:2376] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 9. Re-sending same reply.
I20260709 13:07:11.289013 20417 consensus_queue.cc:1048] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.057s
I20260709 13:07:11.335071 20180 leader_election.cc:290] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:11.287118 20428 consensus_queue.cc:1059] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.065s
I20260709 13:07:11.377127 16351 raft_consensus.cc:1275] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:07:11.380314 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:11.395080 16353 raft_consensus.cc:2410] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:07:11.274425 20244 consensus_queue.cc:237] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:07:11.384029 20432 log.cc:927] Time spent T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:07:11.387666 16207 raft_consensus.cc:1275] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
W20260709 13:07:11.383147 20426 log.cc:927] Time spent T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63: Append to log took a long time: real 0.195s	user 0.001s	sys 0.000s
I20260709 13:07:11.400028 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:11.403250 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:11.410815 16351 raft_consensus.cc:2468] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 8.
I20260709 13:07:11.413717 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:11.329244 20420 raft_consensus.cc:515] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:11.416628 20256 leader_election.cc:290] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:07:11.426225 16915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:11.432018 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 163677us
I20260709 13:07:11.394405 20262 raft_consensus.cc:697] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 9 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
W20260709 13:07:11.429930 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 185533us
I20260709 13:07:11.433146 16248 leader_election.cc:304] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:11.434355 16353 raft_consensus.cc:1275] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:07:11.437987 16173 leader_election.cc:304] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:11.444470 16173 leader_election.cc:304] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:11.445617 16354 raft_consensus.cc:2393] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 12: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:07:11.446755 16173 leader_election.cc:304] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:11.449160 16173 leader_election.cc:304] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:07:11.415052 20132 leader_election.cc:290] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 9 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:11.451265 20155 raft_consensus.cc:2804] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:11.451978 20155 raft_consensus.cc:493] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:11.452390 20155 raft_consensus.cc:3060] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:11.456771 20160 raft_consensus.cc:2749] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:11.448369 20302 raft_consensus.cc:2804] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:11.467388 20302 raft_consensus.cc:493] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:11.467854 20302 raft_consensus.cc:3060] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:11.469460 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:11.448836 19831 raft_consensus.cc:2804] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:11.471444 19831 raft_consensus.cc:493] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:11.471949 19831 raft_consensus.cc:3060] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:11.483680 20380 leader_election.cc:290] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:11.448493 20384 leader_election.cc:290] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:11.485569 19940 raft_consensus.cc:3060] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:11.451352 20360 raft_consensus.cc:2804] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:11.444612 20358 leader_election.cc:290] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:07:11.537849 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 43818.3us
I20260709 13:07:11.495033 20225 consensus_queue.cc:1048] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:11.539171 16275 raft_consensus.cc:1275] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:07:11.541069 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:11.550757 16277 raft_consensus.cc:2393] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 in current term 9: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:07:11.565949 20414 raft_consensus.cc:3060] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:07:11.572530 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:11.544023 16351 raft_consensus.cc:1275] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:07:11.575021 16351 pending_rounds.cc:85] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e: Aborting all ops after (but not including) 7
I20260709 13:07:11.441146 20439 raft_consensus.cc:3055] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:11.576659 20439 raft_consensus.cc:740] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:07:11.574481 16207 raft_consensus.cc:1275] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:07:11.578023 20439 consensus_queue.cc:260] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:07:11.580190 20439 raft_consensus.cc:3060] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:11.575429 16351 pending_rounds.cc:107] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:07:11.582832 16351 raft_consensus.cc:2889] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:07:11.614828 16248 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 1.692s (SENT) [suppressed 25 similar messages]
W20260709 13:07:11.643568 16320 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:11.655539 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:11.655859 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:11.658069 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:11.659046 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:11.659673 16348 raft_consensus.cc:2376] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 11. Re-sending same reply.
W20260709 13:07:11.660866 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 211771us
I20260709 13:07:11.662698 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:11.663733 16356 raft_consensus.cc:2393] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 13: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:07:11.667456 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:11.674355 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
W20260709 13:07:11.650564 20341 consensus_meta.cc:287] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63: Time spent flushing consensus metadata: real 0.569s	user 0.010s	sys 0.003s
I20260709 13:07:11.688391 20436 raft_consensus.cc:493] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.715610 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
W20260709 13:07:11.694329 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 128856us
I20260709 13:07:11.719698 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bc3c8ff9b84838a2664335d7e1582b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
W20260709 13:07:11.695493 16914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:11.696659 20438 consensus_queue.cc:1048] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:11.702817 20262 consensus_queue.cc:237] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:11.443593 20101 raft_consensus.cc:515] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:11.690511 20437 consensus_queue.cc:1048] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:11.727520 16914 leader_election.cc:304] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:07:11.739138 16350 raft_consensus.cc:2468] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 12.
I20260709 13:07:11.742733 20403 raft_consensus.cc:2804] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:11.743672 20403 raft_consensus.cc:697] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 LEADER]: Becoming Leader. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:07:11.744278 16205 raft_consensus.cc:2468] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 8.
I20260709 13:07:11.744633 20403 consensus_queue.cc:237] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:11.716068 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:11.752624 16206 raft_consensus.cc:2468] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 14.
I20260709 13:07:11.638825 20360 raft_consensus.cc:697] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 13 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:07:11.654939 20225 raft_consensus.cc:2749] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:11.726126 20436 raft_consensus.cc:515] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:11.736517 20355 consensus_queue.cc:1048] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:11.512838 20155 raft_consensus.cc:515] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } }
W20260709 13:07:11.780857 16248 leader_election.cc:336] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 2.104s (SENT)
I20260709 13:07:11.789541 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bc3c8ff9b84838a2664335d7e1582b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:11.656080 20367 consensus_queue.cc:1048] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.096s
I20260709 13:07:11.790498 16354 raft_consensus.cc:2393] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 8: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:07:11.787798 16320 leader_election.cc:304] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:11.796362 16320 leader_election.cc:304] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:11.723282 20241 leader_election.cc:290] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:11.797768 16248 leader_election.cc:304] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:11.814481 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:11.815461 16354 raft_consensus.cc:2393] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 10: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:07:11.724474 20341 raft_consensus.cc:515] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:11.819283 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:07:11.828135 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 47316.4us
I20260709 13:07:11.802270 20414 raft_consensus.cc:2804] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:11.808506 20421 raft_consensus.cc:2804] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:11.813210 20009 raft_consensus.cc:2749] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:11.847222 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:11.846585 20101 leader_election.cc:290] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 14 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:11.810735 20399 consensus_queue.cc:1048] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 13:07:11.858031 16206 raft_consensus.cc:1275] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:11.833042 20414 raft_consensus.cc:493] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:11.860267 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:11.869221 20436 leader_election.cc:290] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:11.883074 16349 raft_consensus.cc:2468] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 9.
W20260709 13:07:11.895522 20446 log.cc:927] Time spent T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63: Append to log took a long time: real 0.210s	user 0.000s	sys 0.002s
I20260709 13:07:11.853235 20360 consensus_queue.cc:237] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:11.873004 20130 raft_consensus.cc:493] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
W20260709 13:07:11.873550 20444 log.cc:927] Time spent T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63: Append to log took a long time: real 0.187s	user 0.002s	sys 0.002s
I20260709 13:07:11.855281 20447 raft_consensus.cc:493] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:11.853524 20420 leader_election.cc:290] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:07:11.911513 16248 leader_election.cc:336] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 2.145s (SENT)
I20260709 13:07:11.918426 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:11.929857 16248 leader_election.cc:304] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:11.854313 20421 raft_consensus.cc:697] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e [term 8 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:11.862534 20390 raft_consensus.cc:493] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.862200 20414 raft_consensus.cc:3060] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:11.930040 16205 raft_consensus.cc:3060] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:11.902173 19940 raft_consensus.cc:493] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.927505 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:11.912633 20172 tablet_bootstrap.cc:492] T 540bfc4ad793452faea5b865343aacf7 P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap replayed 1/1 log segments. Stats: ops{read=6 overwritten=0 applied=5 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
W20260709 13:07:11.898530 20435 log.cc:927] Time spent T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.246s	user 0.001s	sys 0.000s
I20260709 13:07:11.947139 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:11.899832 20341 leader_election.cc:290] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 10 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:11.941476 20417 raft_consensus.cc:2749] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:11.960968 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:07:11.969934 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 58451.8us
I20260709 13:07:11.972440 16205 raft_consensus.cc:2468] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 10.
I20260709 13:07:11.918978 20342 consensus_queue.cc:1048] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
W20260709 13:07:11.976873 16248 leader_election.cc:336] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 2.212s (SENT)
I20260709 13:07:11.913139 20130 raft_consensus.cc:515] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:07:11.971698 20302 consensus_meta.cc:287] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3: Time spent flushing consensus metadata: real 0.503s	user 0.010s	sys 0.001s
I20260709 13:07:11.984786 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:11.991995 16354 raft_consensus.cc:2376] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 12. Re-sending same reply.
I20260709 13:07:11.942263 19940 raft_consensus.cc:515] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:11.934928 20447 raft_consensus.cc:515] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:07:12.008899 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 346959us
I20260709 13:07:11.941859 20390 raft_consensus.cc:515] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:07:12.001977 20361 consensus_meta.cc:287] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f: Time spent flushing consensus metadata: real 0.821s	user 0.012s	sys 0.002s
I20260709 13:07:12.013744 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:11.958264 20421 consensus_queue.cc:237] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:12.021390 20390 leader_election.cc:290] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:12.022286 16354 raft_consensus.cc:2393] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 11: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:07:12.017784 16173 leader_election.cc:304] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:07:12.025717 16350 raft_consensus.cc:2410] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for term 14 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:07:12.015811 20172 tablet_bootstrap.cc:492] T 540bfc4ad793452faea5b865343aacf7 P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap complete.
W20260709 13:07:12.033970 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 101767us
I20260709 13:07:12.010943 20341 raft_consensus.cc:493] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:12.009357 20155 leader_election.cc:290] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 15 election: Requested vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:12.047019 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:12.054349 16354 raft_consensus.cc:2468] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 8.
W20260709 13:07:12.038211 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 61404.2us
W20260709 13:07:12.057842 16248 leader_election.cc:336] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 2.284s (SENT)
W20260709 13:07:12.070706 16173 consensus_peers.cc:597] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f -> Peer 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875): Couldn't send request to peer 1109f76a0b7b443a84c0327c8707bc63. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4b962ceebb5c48c1914459ae0c0eff1b. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:12.092110 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 50341.5us
W20260709 13:07:12.092612 16320 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:12.083063 20443 log.cc:927] Time spent T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.215s	user 0.000s	sys 0.001s
I20260709 13:07:11.998144 20302 raft_consensus.cc:515] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:12.029407 20361 raft_consensus.cc:515] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:12.078678 20172 ts_tablet_manager.cc:1403] T 540bfc4ad793452faea5b865343aacf7 P 1109f76a0b7b443a84c0327c8707bc63: Time spent bootstrapping tablet: real 1.842s	user 0.048s	sys 0.008s
I20260709 13:07:12.071069 20152 raft_consensus.cc:493] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.036765 20452 consensus_queue.cc:1048] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 13:07:12.041111 20436 raft_consensus.cc:2749] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:12.100471 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
W20260709 13:07:12.086391 19831 consensus_meta.cc:287] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f: Time spent flushing consensus metadata: real 0.614s	user 0.012s	sys 0.001s
I20260709 13:07:12.103556 16281 raft_consensus.cc:3060] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:12.057612 20341 raft_consensus.cc:515] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:12.123080 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:12.123268 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:12.124008 16274 raft_consensus.cc:3060] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:07:12.130105 16208 raft_consensus.cc:2393] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 11: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:07:12.130802 16275 raft_consensus.cc:1240] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 10. Current term is 11. Ops: [10.8-10.8]
W20260709 13:07:12.132694 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 74899.6us
I20260709 13:07:12.143993 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:12.153330 16282 raft_consensus.cc:3060] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:12.152321 16283 raft_consensus.cc:2468] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 11.
W20260709 13:07:12.160670 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:12.172514 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:07:12.155010 20448 log.cc:927] Time spent T 00000000000000000000000000000000 P 4dc6f08597514f4d85fd451b999b403e: Append to log took a long time: real 0.154s	user 0.002s	sys 0.000s
W20260709 13:07:12.178570 16914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:12.179138 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:12.170395 16274 raft_consensus.cc:2468] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 14.
I20260709 13:07:12.180188 16354 raft_consensus.cc:2468] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 9.
I20260709 13:07:12.187105 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:12.187963 16283 raft_consensus.cc:3060] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:12.121842 19831 raft_consensus.cc:515] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:12.120895 20152 raft_consensus.cc:515] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:07:12.203254 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:12.179324 20131 consensus_meta.cc:287] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63: Time spent flushing consensus metadata: real 0.925s	user 0.010s	sys 0.004s
I20260709 13:07:12.211859 16282 raft_consensus.cc:1275] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 13:07:12.215732 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 115726us
W20260709 13:07:12.222071 16173 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:12.212543 20457 log.cc:927] Time spent T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.123s	user 0.000s	sys 0.001s
I20260709 13:07:12.196499 19940 leader_election.cc:290] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:12.230355 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:07:12.218355 20413 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.004s	sys 0.022s
I20260709 13:07:12.226408 20447 leader_election.cc:290] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:07:12.234138 20413 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.534s	user 0.005s	sys 0.022s
I20260709 13:07:12.249691 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:12.276582 16281 raft_consensus.cc:1275] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 13:07:12.241323 20459 log.cc:927] Time spent T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
W20260709 13:07:12.247079 20434 log.cc:927] Time spent T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.188s	user 0.003s	sys 0.000s
I20260709 13:07:12.251853 20152 leader_election.cc:290] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:12.253434 19831 leader_election.cc:290] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:12.328056 20447 raft_consensus.cc:493] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.296162 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:12.296986 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:12.329319 16356 raft_consensus.cc:2393] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 13: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:07:12.298970 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:12.299201 20361 leader_election.cc:290] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 11 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:12.300665 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:12.329936 16348 raft_consensus.cc:2468] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 13.
I20260709 13:07:12.330399 16278 raft_consensus.cc:2468] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 10.
I20260709 13:07:12.301432 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:12.302126 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:12.332763 16943 raft_consensus.cc:2368] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for earlier term 9. Current term is 10.
I20260709 13:07:12.304903 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:12.304111 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bc3c8ff9b84838a2664335d7e1582b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:12.307008 20302 leader_election.cc:290] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:12.308065 20341 leader_election.cc:290] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:12.311435 16281 raft_consensus.cc:1240] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:12.248801 20172 raft_consensus.cc:359] T 540bfc4ad793452faea5b865343aacf7 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 NON_PARTICIPANT]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:12.323619 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:12.333547 16283 raft_consensus.cc:2468] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 15.
I20260709 13:07:12.355734 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:12.333900 16280 raft_consensus.cc:2393] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 8: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:07:12.363672 16946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:12.367821 16940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:12.368876 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:12.370921 16946 raft_consensus.cc:2393] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 6: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
I20260709 13:07:12.371063 16943 raft_consensus.cc:2468] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 8.
I20260709 13:07:12.356065 16278 raft_consensus.cc:1275] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:07:12.376459 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:12.288790 20414 raft_consensus.cc:515] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:12.386077 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:12.395268 16278 raft_consensus.cc:2393] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 9: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:07:12.396875 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c15d8e9be8414c84912ab77b66bfb1" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:12.399127 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:12.352859 20447 raft_consensus.cc:515] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:12.406191 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:12.407516 16940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:12.409756 16278 raft_consensus.cc:2393] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 11: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
I20260709 13:07:12.410480 16940 raft_consensus.cc:2410] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:07:12.411563 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:12.412467 16280 raft_consensus.cc:2410] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:07:12.413461 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:12.414078 16280 raft_consensus.cc:3060] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:12.414659 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:12.415268 16274 raft_consensus.cc:3060] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:12.416887 16943 raft_consensus.cc:1240] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:07:12.420900 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:12.421663 16200 raft_consensus.cc:2468] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 13.
I20260709 13:07:12.422472 16946 raft_consensus.cc:1240] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:07:12.428556 16946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:07:12.428849 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:12.429747 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:12.430462 16207 raft_consensus.cc:2468] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 11.
I20260709 13:07:12.433027 16282 raft_consensus.cc:2468] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 8.
I20260709 13:07:12.436862 16278 raft_consensus.cc:1275] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:07:12.448087 16274 raft_consensus.cc:2468] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 10.
I20260709 13:07:12.449456 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:12.447377 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:12.455905 16946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:07:12.456646 16946 raft_consensus.cc:3060] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:12.456849 16320 leader_election.cc:304] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:12.458879 20152 raft_consensus.cc:493] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.459546 20152 raft_consensus.cc:515] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:12.451071 20172 raft_consensus.cc:740] T 540bfc4ad793452faea5b865343aacf7 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 LEARNER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Initialized, Role: LEARNER
I20260709 13:07:12.460934 20172 consensus_queue.cc:260] T 540bfc4ad793452faea5b865343aacf7 P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:07:12.461926 20152 leader_election.cc:290] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:07:12.463274 16355 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41832 (request call id 2053) took 1353 ms (client timeout 1695 ms). Trace:
W20260709 13:07:12.463739 16355 rpcz_store.cc:269] 0709 13:07:11.109540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:11.109708 (+   168us) service_pool.cc:224] Handling call
0709 13:07:12.463001 (+1353293us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b54002288d4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:07:12.463177 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2621666560}
I20260709 13:07:12.464120 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:12.464840 16277 raft_consensus.cc:2468] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 14.
I20260709 13:07:12.465848 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:12.467219 20361 consensus_queue.cc:1059] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:12.467690 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:12.468315 16281 raft_consensus.cc:2468] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 12.
I20260709 13:07:12.469254 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:12.469551 20361 raft_consensus.cc:3055] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:12.470006 20361 raft_consensus.cc:740] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:07:12.470448 20452 consensus_queue.cc:1048] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:12.472714 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:12.458186 16320 leader_election.cc:304] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:12.474334 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:12.469815 16281 raft_consensus.cc:3060] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:12.478494 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:12.514978 16280 raft_consensus.cc:2468] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 11.
I20260709 13:07:12.516026 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:12.511189 16944 raft_consensus.cc:2468] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 11.
I20260709 13:07:12.516232 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:12.511544 16277 raft_consensus.cc:2468] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 13.
I20260709 13:07:12.512831 16282 raft_consensus.cc:3060] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Advancing to term 13
W20260709 13:07:12.512720 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 54622.1us
I20260709 13:07:12.512100 16946 raft_consensus.cc:2468] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 13.
I20260709 13:07:12.520862 16942 raft_consensus.cc:1275] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:07:12.516933 16278 raft_consensus.cc:2468] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 10.
I20260709 13:07:12.525872 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bc3c8ff9b84838a2664335d7e1582b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:12.532437 16274 raft_consensus.cc:2393] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 8: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:07:12.524204 16281 raft_consensus.cc:2468] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 9.
I20260709 13:07:12.531073 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:12.533696 16350 raft_consensus.cc:2468] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 10.
I20260709 13:07:12.536022 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:12.536919 16350 raft_consensus.cc:2468] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 8.
I20260709 13:07:12.542929 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:12.545244 16354 raft_consensus.cc:1275] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:07:12.545797 16274 raft_consensus.cc:1240] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:12.546639 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:12.544725 16351 raft_consensus.cc:1240] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:12.547875 16207 raft_consensus.cc:1275] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:07:12.548426 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:12.549661 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:12.550369 16349 raft_consensus.cc:2468] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 8.
I20260709 13:07:12.550568 16948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:12.551455 16278 raft_consensus.cc:1240] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:07:12.548439 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:12.554343 16274 raft_consensus.cc:1240] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:12.562204 16274 raft_consensus.cc:1240] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:12.554332 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:12.561981 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:12.563537 16351 raft_consensus.cc:2468] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 9.
I20260709 13:07:12.563675 16282 raft_consensus.cc:1275] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:07:12.554855 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:12.564939 16357 raft_consensus.cc:2468] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 8.
I20260709 13:07:12.554817 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:12.567062 16349 raft_consensus.cc:2468] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 9.
I20260709 13:07:12.568259 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:12.569011 16349 raft_consensus.cc:2468] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 11.
I20260709 13:07:12.570160 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:12.574872 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:12.576531 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:12.576826 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:12.577795 16912 leader_election.cc:304] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
W20260709 13:07:12.578665 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 50356.1us
I20260709 13:07:12.576611 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:12.580056 16914 leader_election.cc:304] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:07:12.580601 16354 raft_consensus.cc:2468] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 10.
I20260709 13:07:12.582007 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:12.576534 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:12.583601 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:12.584347 16348 raft_consensus.cc:2393] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 in current term 8: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:07:12.512429 20241 raft_consensus.cc:2804] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:12.588318 16322 leader_election.cc:400] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Vote denied by peer 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875) with higher term. Message: Invalid argument: T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for earlier term 9. Current term is 10.
I20260709 13:07:12.558704 16173 leader_election.cc:304] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:12.581835 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:12.582859 16354 raft_consensus.cc:3060] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:12.586957 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:12.590284 16351 raft_consensus.cc:2376] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 9. Re-sending same reply.
I20260709 13:07:12.585215 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:12.524492 20390 raft_consensus.cc:2804] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:07:12.588217 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 396615us
I20260709 13:07:12.593122 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:12.590619 16322 leader_election.cc:403] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:12.588236 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:12.591488 16353 raft_consensus.cc:2468] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 13.
I20260709 13:07:12.594236 16355 raft_consensus.cc:2468] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 9.
I20260709 13:07:12.589564 16173 leader_election.cc:304] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:12.593961 16351 raft_consensus.cc:2376] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 11. Re-sending same reply.
I20260709 13:07:12.577817 16349 raft_consensus.cc:3060] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:12.597213 16322 leader_election.cc:304] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:12.602030 16282 raft_consensus.cc:1240] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 LEADER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:12.604348 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:12.555015 20440 raft_consensus.cc:493] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:12.606979 16348 raft_consensus.cc:3060] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:12.611989 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:12.615895 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:12.624835 16355 raft_consensus.cc:2393] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 11: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:07:12.616683 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:12.617343 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:07:12.625063 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:07:12.618886 20482 log.cc:927] Time spent T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
W20260709 13:07:12.619949 20478 log.cc:927] Time spent T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:07:12.518739 19831 consensus_queue.cc:1048] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.074s
I20260709 13:07:12.594399 20241 raft_consensus.cc:493] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:12.636264 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:12.625895 16351 raft_consensus.cc:3060] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:12.623046 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:12.617358 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:12.639602 16352 raft_consensus.cc:2368] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for earlier term 14. Current term is 15.
I20260709 13:07:12.639500 16353 raft_consensus.cc:2376] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 14. Re-sending same reply.
I20260709 13:07:12.633884 16248 leader_election.cc:304] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:12.595523 20390 raft_consensus.cc:493] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:12.518672 20460 consensus_queue.cc:1059] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.088s
I20260709 13:07:12.598364 20438 raft_consensus.cc:2804] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:12.598179 20437 raft_consensus.cc:2804] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:12.652318 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:12.623862 20380 raft_consensus.cc:3060] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:12.668831 16354 raft_consensus.cc:2468] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 10.
I20260709 13:07:12.598531 20399 consensus_queue.cc:1048] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.055s
I20260709 13:07:12.632865 20453 raft_consensus.cc:2804] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:12.671579 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:12.672359 16355 raft_consensus.cc:2468] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 8.
I20260709 13:07:12.675405 16248 leader_election.cc:304] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:12.670418 16348 raft_consensus.cc:2468] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 11.
I20260709 13:07:12.706384 16352 raft_consensus.cc:1275] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:12.708041 16354 raft_consensus.cc:1275] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:07:12.645725 20477 raft_consensus.cc:493] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.647877 20241 raft_consensus.cc:3060] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:12.654210 20132 raft_consensus.cc:2804] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:12.656291 20390 raft_consensus.cc:3060] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:12.634467 20466 consensus_queue.cc:1048] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.084s
I20260709 13:07:12.633036 20440 raft_consensus.cc:515] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:12.701372 20437 raft_consensus.cc:493] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:12.706522 20244 raft_consensus.cc:3060] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:12.585261 20361 consensus_queue.cc:260] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
W20260709 13:07:12.715903 20478 log.cc:927] Time spent T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 13:07:12.728559 16351 raft_consensus.cc:2468] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 14.
W20260709 13:07:12.718773 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 83402.4us
I20260709 13:07:12.713171 20438 raft_consensus.cc:697] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [term 10 LEADER]: Becoming Leader. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:07:12.713186 20414 leader_election.cc:290] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:12.719898 19940 raft_consensus.cc:2804] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:12.767259 16353 raft_consensus.cc:1275] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:07:12.733973 20172 ts_tablet_manager.cc:1434] T 540bfc4ad793452faea5b865343aacf7 P 1109f76a0b7b443a84c0327c8707bc63: Time spent starting tablet: real 0.607s	user 0.010s	sys 0.006s
I20260709 13:07:12.775982 20437 raft_consensus.cc:3060] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:12.777877 16912 leader_election.cc:304] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:12.724038 20453 raft_consensus.cc:697] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 14 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:07:12.768397 20480 raft_consensus.cc:2749] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:12.772994 20152 raft_consensus.cc:493] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.774816 20355 raft_consensus.cc:493] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.777596 20447 leader_election.cc:290] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:07:12.780529 20417 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.005s	sys 0.014s
I20260709 13:07:12.733671 20486 consensus_queue.cc:1048] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.067s
W20260709 13:07:12.782943 20172 ts_tablet_manager.cc:1467] T 540bfc4ad793452faea5b865343aacf7 P 1109f76a0b7b443a84c0327c8707bc63: Tablet startup took 674ms
I20260709 13:07:12.733172 20477 raft_consensus.cc:515] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:07:12.807473 20417 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.583s	user 0.005s	sys 0.014s
W20260709 13:07:12.823434 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 233962us
I20260709 13:07:12.809593 20361 raft_consensus.cc:3060] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:12.826431 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
W20260709 13:07:12.839279 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 259297us
I20260709 13:07:12.854894 16949 raft_consensus.cc:2376] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 13. Re-sending same reply.
I20260709 13:07:12.856593 16914 leader_election.cc:304] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:12.803381 20152 raft_consensus.cc:515] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:12.860499 16914 leader_election.cc:304] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3
W20260709 13:07:12.860855 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 341199us
W20260709 13:07:12.863790 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 266626us
I20260709 13:07:12.867779 16322 leader_election.cc:304] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:12.859498 20460 raft_consensus.cc:493] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.869452 20460 raft_consensus.cc:515] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:07:12.870183 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 92408.3us
I20260709 13:07:12.874718 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:12.875463 16208 raft_consensus.cc:3060] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:12.802835 20355 raft_consensus.cc:515] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:07:12.892370 16320 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:12.865525 16173 leader_election.cc:304] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:12.897953 16173 leader_election.cc:304] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
W20260709 13:07:12.906868 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 46427.7us
I20260709 13:07:12.928347 16208 raft_consensus.cc:2468] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 15.
I20260709 13:07:12.860648 20447 consensus_queue.cc:1048] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.069s
I20260709 13:07:12.870846 20436 consensus_queue.cc:1048] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.077s
I20260709 13:07:12.927320 20414 raft_consensus.cc:493] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:12.995880 16174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:12.828944 20438 consensus_queue.cc:237] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:12.999402 16349 raft_consensus.cc:2468] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 15.
W20260709 13:07:13.000231 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 102357us
I20260709 13:07:12.948393 19831 consensus_queue.cc:1059] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 13:07:12.991241 20498 raft_consensus.cc:2749] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:12.990020 20495 raft_consensus.cc:2804] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:12.998673 20413 raft_consensus.cc:2749] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:13.001904 20466 raft_consensus.cc:493] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:13.002367 20483 log.cc:927] Time spent T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.277s	user 0.000s	sys 0.001s
I20260709 13:07:13.016507 16173 leader_election.cc:304] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:13.014071 20513 raft_consensus.cc:2804] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:13.017272 20447 raft_consensus.cc:2804] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:13.028944 20152 leader_election.cc:290] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:13.015174 20491 consensus_queue.cc:1059] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
W20260709 13:07:13.039151 20487 log.cc:927] Time spent T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.225s	user 0.000s	sys 0.001s
W20260709 13:07:13.039551 20485 log.cc:927] Time spent T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.254s	user 0.001s	sys 0.001s
I20260709 13:07:13.040906 20460 leader_election.cc:290] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:13.018163 20496 consensus_queue.cc:1059] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 13:07:13.043784 19831 raft_consensus.cc:3055] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:13.044184 19940 raft_consensus.cc:493] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:12.997781 20414 raft_consensus.cc:515] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:13.002177 20347 consensus_queue.cc:1048] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 13:07:12.911682 20453 consensus_queue.cc:237] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:07:13.012621 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 109397us
I20260709 13:07:13.048610 20403 raft_consensus.cc:2804] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:13.142037 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:07:13.136861 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 461535us
I20260709 13:07:13.147373 16275 raft_consensus.cc:1275] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260709 13:07:13.151161 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 234679us
I20260709 13:07:13.169379 16322 leader_election.cc:304] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:13.171972 16208 raft_consensus.cc:1275] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:07:13.173770 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:13.176301 16282 raft_consensus.cc:2468] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 13.
I20260709 13:07:13.053249 20513 raft_consensus.cc:493] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:13.056393 20436 raft_consensus.cc:2804] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:13.052750 20495 raft_consensus.cc:697] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
W20260709 13:07:13.139786 20497 log.cc:927] Time spent T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.105s	user 0.002s	sys 0.000s
I20260709 13:07:13.048564 20440 leader_election.cc:290] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:13.168190 16248 leader_election.cc:304] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:07:13.292050 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 123969us
I20260709 13:07:13.292975 16248 leader_election.cc:304] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:13.052568 20466 raft_consensus.cc:515] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
W20260709 13:07:13.241904 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 72673.7us
I20260709 13:07:13.249830 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:13.154994 19940 raft_consensus.cc:3060] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:13.143977 19831 raft_consensus.cc:740] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:07:13.149874 20130 leader_election.cc:290] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:13.168167 20452 raft_consensus.cc:493] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.246114 20491 raft_consensus.cc:3055] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:13.260211 20417 raft_consensus.cc:493] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:13.271576 20436 raft_consensus.cc:697] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 11 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:07:13.173619 20403 raft_consensus.cc:493] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:13.167914 20447 raft_consensus.cc:697] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
W20260709 13:07:13.270360 20485 log.cc:927] Time spent T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
I20260709 13:07:13.295253 16248 leader_election.cc:304] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:07:13.345257 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 50258.1us
I20260709 13:07:13.057569 20498 raft_consensus.cc:493] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:12.830158 15057 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:13.301288 20009 raft_consensus.cc:2749] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:13.243937 20460 raft_consensus.cc:493] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.254315 20496 raft_consensus.cc:2749] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:13.271916 20513 raft_consensus.cc:3060] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:13.240746 20152 raft_consensus.cc:3055] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:13.316756 16322 leader_election.cc:304] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:07:13.338915 20403 raft_consensus.cc:3060] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:13.340127 20499 log.cc:927] Time spent T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.284s	user 0.000s	sys 0.001s
W20260709 13:07:13.341488 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 99453.6us
I20260709 13:07:13.322631 20491 raft_consensus.cc:740] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:13.356058 16248 leader_election.cc:304] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:13.339668 20436 consensus_queue.cc:237] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:13.315343 20355 leader_election.cc:290] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:13.383064 20413 consensus_queue.cc:1059] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:13.361701 20460 raft_consensus.cc:515] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:13.361560 20152 raft_consensus.cc:740] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:13.349519 20302 raft_consensus.cc:2804] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:13.376061 20421 raft_consensus.cc:2749] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:13.307996 20473 consensus_queue.cc:1048] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.059s
I20260709 13:07:13.352481 20440 raft_consensus.cc:2749] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:13.393188 16173 leader_election.cc:304] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
W20260709 13:07:13.383764 20488 log.cc:927] Time spent T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:07:13.365664 20523 consensus_queue.cc:1048] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.057s
W20260709 13:07:13.383149 20516 log.cc:927] Time spent T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.132s	user 0.000s	sys 0.001s
W20260709 13:07:13.430540 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 80860us
I20260709 13:07:13.436506 16248 leader_election.cc:304] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:13.384755 20514 raft_consensus.cc:493] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.376541 20496 consensus_queue.cc:1048] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.056s
I20260709 13:07:13.334443 20452 raft_consensus.cc:515] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:13.333899 20417 raft_consensus.cc:515] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:07:13.443181 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 76717.5us
I20260709 13:07:13.411072 20413 consensus_queue.cc:1243] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer 0aea40d6e4374085a2e38a70a71f63e3 log is divergent from this leader: its last log entry 6.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
W20260709 13:07:13.430181 20361 consensus_meta.cc:287] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f: Time spent flushing consensus metadata: real 0.563s	user 0.012s	sys 0.001s
W20260709 13:07:13.424698 20380 consensus_meta.cc:287] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 0.712s	user 0.013s	sys 0.000s
I20260709 13:07:13.419745 20508 raft_consensus.cc:2804] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:13.447703 16320 leader_election.cc:304] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:13.450045 16248 leader_election.cc:304] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:13.354727 20498 raft_consensus.cc:515] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:07:13.471340 16914 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.013s	sys 0.020s
W20260709 13:07:13.471720 16914 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.559s	user 0.013s	sys 0.020s
W20260709 13:07:13.443581 20390 consensus_meta.cc:287] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 0.663s	user 0.011s	sys 0.003s
W20260709 13:07:13.471997 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 561543us
W20260709 13:07:13.520030 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 70119.8us
I20260709 13:07:13.521023 16248 leader_election.cc:304] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:13.528702 16248 leader_election.cc:304] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:13.475929 20101 raft_consensus.cc:3055] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:13.530514 20101 raft_consensus.cc:740] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:07:13.447705 20514 raft_consensus.cc:515] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:13.531536 20101 consensus_queue.cc:260] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:13.532819 20101 raft_consensus.cc:3060] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:13.476593 20440 raft_consensus.cc:2749] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:13.476409 20361 raft_consensus.cc:2749] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:13.535226 20361 raft_consensus.cc:493] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:13.535542 20466 leader_election.cc:290] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:13.535804 20361 raft_consensus.cc:515] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:13.410598 19831 consensus_queue.cc:260] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:07:12.817188 20172 ts_tablet_manager.cc:1469] T 540bfc4ad793452faea5b865343aacf7 P 1109f76a0b7b443a84c0327c8707bc63: Trace:
0709 13:07:02.453876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.507914 (+ 54038us) service_pool.cc:224] Handling call
0709 13:07:03.149449 (+641535us) ts_tablet_manager.cc:934] T 540bfc4ad793452faea5b865343aacf7 P 1109f76a0b7b443a84c0327c8707bc63: Initiating tablet copy from peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073)
0709 13:07:07.003789 (+3854340us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:07:07.909619 (+905830us) tablet_metadata.cc:665] Metadata flushed
0709 13:07:07.909768 (+   149us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:07:08.607297 (+697529us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:07:08.608131 (+   834us) tablet_replica.cc:206] Creating consensus instance
0709 13:07:08.608528 (+   397us) ts_tablet_manager.cc:989] Replica registered.
0709 13:07:08.608646 (+   118us) inbound_call.cc:177] Queueing success response
0709 13:07:10.236344 (+1627698us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:07:12.123812 (+1887468us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:07:12.135864 (+ 12052us) tablet_replica.cc:261] Starting instrumentation
0709 13:07:12.136789 (+   925us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":385,"raft.queue_time_us":4715,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":105,"tablet-copy.queue_time_us":430847,"tablet-download-pool.queue_time_us":1881,"tablet-download-pool.run_cpu_time_us":1713,"tablet-download-pool.run_wall_time_us":1008840,"thread_start_us":414691,"threads_started":2}
I20260709 13:07:13.539328 20534 raft_consensus.cc:493] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:13.540072 20534 raft_consensus.cc:515] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:13.541173 16278 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45210 (request call id 2186) took 1101 ms. Trace:
I20260709 13:07:13.543124 20460 leader_election.cc:290] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:13.543272 20527 raft_consensus.cc:493] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.541734 16278 rpcz_store.cc:276] 0709 13:07:12.439553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:12.559591 (+120038us) service_pool.cc:224] Handling call
0709 13:07:12.559929 (+   338us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:12.585998 (+ 26069us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:12.586042 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:12.586594 (+   552us) log.cc:844] Serialized 26 byte log entry
0709 13:07:12.783436 (+196842us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:12.800455 (+ 17019us) log.cc:844] Serialized 14 byte log entry
0709 13:07:12.901076 (+100621us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:12.901178 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:13.540895 (+639717us) raft_consensus.cc:1685] finished
0709 13:07:13.540925 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:13.541084 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10914,"prepare.queue_time_us":16098,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":4033,"raft.queue_time_us":123282,"raft.run_cpu_time_us":297,"raft.run_wall_time_us":32247,"thread_start_us":235204,"threads_started":2,"wal-append.queue_time_us":432147}
I20260709 13:07:13.543826 20527 raft_consensus.cc:515] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:13.546597 20528 raft_consensus.cc:2804] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:13.555922 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:13.557778 16248 leader_election.cc:304] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:13.546240 20527 leader_election.cc:290] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:07:13.606431 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 48796.1us
I20260709 13:07:13.607686 16248 leader_election.cc:304] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:13.548070 20414 leader_election.cc:290] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:13.612860 20442 raft_consensus.cc:2749] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:13.613756 20442 raft_consensus.cc:493] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:13.614324 20442 raft_consensus.cc:515] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:07:13.466912 20380 raft_consensus.cc:2749] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875) with higher term. Message: Invalid argument: T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for earlier term 9. Current term is 10.
I20260709 13:07:13.447415 20520 raft_consensus.cc:2749] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:13.628417 16248 leader_election.cc:304] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:13.521723 20508 raft_consensus.cc:697] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:07:13.615710 20466 raft_consensus.cc:2749] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:13.636710 16946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:13.575500 20440 raft_consensus.cc:493] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:13.405429 20495 consensus_queue.cc:237] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } }
I20260709 13:07:13.434239 20447 consensus_queue.cc:237] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:13.638728 16248 leader_election.cc:304] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:07:13.642577 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 180332us
I20260709 13:07:13.641786 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:13.647357 20532 raft_consensus.cc:493] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.639760 16941 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35106 (request call id 768) took 1297 ms. Trace:
I20260709 13:07:13.627439 20527 raft_consensus.cc:493] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.522541 20390 raft_consensus.cc:515] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:13.661813 16357 raft_consensus.cc:2468] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 10.
I20260709 13:07:13.662438 16274 raft_consensus.cc:2468] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 12.
I20260709 13:07:13.465719 20152 consensus_queue.cc:260] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:13.615633 20256 consensus_queue.cc:1048] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:07:13.634342 20473 raft_consensus.cc:2749] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:07:13.646759 20438 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.602s	user 0.007s	sys 0.007s
I20260709 13:07:13.667721 16248 leader_election.cc:304] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:13.648545 20442 leader_election.cc:290] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:13.627859 20528 raft_consensus.cc:697] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 15 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:13.692293 20528 consensus_queue.cc:237] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:13.520293 20491 consensus_queue.cc:260] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:13.694271 20491 raft_consensus.cc:3060] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:13.694821 20522 raft_consensus.cc:2749] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:13.674010 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:13.695596 16248 leader_election.cc:304] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:13.696187 16208 raft_consensus.cc:2468] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 12.
I20260709 13:07:13.696831 20466 raft_consensus.cc:2749] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:13.676366 16207 raft_consensus.cc:1240] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:13.697157 16248 leader_election.cc:304] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:13.669032 20479 raft_consensus.cc:493] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:13.669718 20520 raft_consensus.cc:2749] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:13.695757 20522 raft_consensus.cc:2764] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
W20260709 13:07:13.699741 20437 consensus_meta.cc:287] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f: Time spent flushing consensus metadata: real 0.905s	user 0.004s	sys 0.009s
W20260709 13:07:13.687636 20241 consensus_meta.cc:287] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 0.916s	user 0.011s	sys 0.002s
W20260709 13:07:13.686978 20438 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.642s	user 0.007s	sys 0.007s
I20260709 13:07:13.643429 20523 raft_consensus.cc:2804] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:13.673192 20498 leader_election.cc:290] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:13.700004 16350 raft_consensus.cc:2393] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 in current term 12: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:07:13.700556 16248 leader_election.cc:304] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:13.712064 20460 raft_consensus.cc:493] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:13.662385 16941 rpcz_store.cc:276] 0709 13:07:12.336259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:12.351660 (+ 15401us) service_pool.cc:224] Handling call
0709 13:07:12.391689 (+ 40029us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:12.429845 (+ 38156us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:12.431470 (+  1625us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:12.444055 (+ 12585us) log.cc:844] Serialized 26 byte log entry
0709 13:07:12.900208 (+456153us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:12.905342 (+  5134us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:12.926373 (+ 21031us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:13.620077 (+693704us) raft_consensus.cc:1685] finished
0709 13:07:13.620966 (+   889us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:13.630156 (+  9190us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7861,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":6035,"thread_start_us":405706,"threads_started":1,"wal-append.queue_time_us":841822}
I20260709 13:07:13.715224 20460 raft_consensus.cc:515] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:13.717729 20460 leader_election.cc:290] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:13.714699 20241 raft_consensus.cc:515] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:13.720587 20417 leader_election.cc:290] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:13.721271 20152 raft_consensus.cc:3060] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:13.720669 20241 leader_election.cc:290] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:13.722924 16206 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39674 (request call id 878) took 1134 ms. Trace:
I20260709 13:07:13.724279 20523 raft_consensus.cc:697] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:07:13.723402 16206 rpcz_store.cc:276] 0709 13:07:12.588770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:12.589058 (+   288us) service_pool.cc:224] Handling call
0709 13:07:12.607823 (+ 18765us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:12.782183 (+174360us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:12.782235 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:12.794317 (+ 12082us) log.cc:844] Serialized 26 byte log entry
0709 13:07:13.139682 (+345365us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:13.139733 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:13.139804 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:13.722635 (+582831us) raft_consensus.cc:1685] finished
0709 13:07:13.722659 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:13.722838 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":52851,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":34955,"thread_start_us":480343,"threads_started":2,"wal-append.queue_time_us":852925}
I20260709 13:07:13.725385 20523 consensus_queue.cc:237] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:07:13.714520 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 237866us
W20260709 13:07:13.730827 20517 consensus_queue.cc:1175] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" responder_term: 5 status { last_received { term: 5 index: 7 } last_committed_idx: 7 last_received_current_leader { term: 5 index: 7 } }
W20260709 13:07:13.722285 20503 log.cc:927] Time spent T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63: Append to log took a long time: real 0.680s	user 0.001s	sys 0.002s
I20260709 13:07:13.732831 16940 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35122 (request call id 599) took 1260 ms. Trace:
I20260709 13:07:13.733054 20477 leader_election.cc:290] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:13.733278 16940 rpcz_store.cc:276] 0709 13:07:12.472028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:12.512196 (+ 40168us) service_pool.cc:224] Handling call
0709 13:07:12.552121 (+ 39925us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:12.588357 (+ 36236us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:12.588389 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:12.595862 (+  7473us) log.cc:844] Serialized 26 byte log entry
0709 13:07:12.920155 (+324293us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:13.156907 (+236752us) log.cc:844] Serialized 14 byte log entry
0709 13:07:13.162642 (+  5735us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:13.162724 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:13.721948 (+559224us) spinlock_profiling.cc:243] Waited 4.69 ms on lock 0x7b24000c2618. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361c224db1 00007f361c2229c4 00007f361c220acb 00007f361c3dbdc9 00007f361c3dba55 00007f361c3db09d 00007f361f00d10e 00007f361f02488c 00007f361f023bb6 00007f361f0237d8 00007f361f02d221
0709 13:07:13.732487 (+ 10539us) raft_consensus.cc:1685] finished
0709 13:07:13.732609 (+   122us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:13.732759 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8977,"prepare.queue_time_us":221239,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":105511,"raft.run_cpu_time_us":329,"raft.run_wall_time_us":18607,"spinlock_wait_cycles":10785152,"thread_start_us":376090,"threads_started":2,"wal-append.queue_time_us":343300}
I20260709 13:07:13.737855 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:13.738574 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:13.739581 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:13.739866 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:13.740340 16280 raft_consensus.cc:2468] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 6.
I20260709 13:07:13.741468 16207 raft_consensus.cc:1275] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:07:13.710433 20479 raft_consensus.cc:515] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:13.744226 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:13.744565 20479 leader_election.cc:290] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:13.744948 16208 raft_consensus.cc:2468] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 13.
I20260709 13:07:13.748075 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:13.750065 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:13.752292 16914 leader_election.cc:304] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
W20260709 13:07:13.703792 16320 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.701642 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bc3c8ff9b84838a2664335d7e1582b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:07:13.692330 20529 log.cc:927] Time spent T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 13:07:13.706799 20508 consensus_queue.cc:237] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:07:13.709028 20244 consensus_meta.cc:287] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3: Time spent flushing consensus metadata: real 0.934s	user 0.003s	sys 0.008s
I20260709 13:07:13.678720 20531 raft_consensus.cc:493] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:13.754786 16274 raft_consensus.cc:2468] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 8.
I20260709 13:07:13.656967 20440 raft_consensus.cc:515] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:07:13.755242 16320 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.709290 20390 leader_election.cc:290] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 12 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:13.666616 20527 raft_consensus.cc:515] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:07:13.758993 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 44506.9us
I20260709 13:07:13.762117 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:13.764144 16912 leader_election.cc:304] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:13.774124 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:13.793664 16204 raft_consensus.cc:3060] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:13.704279 20473 raft_consensus.cc:2749] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:13.766495 16173 leader_election.cc:304] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:13.794050 16248 leader_election.cc:304] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:13.754020 16246 leader_election.cc:304] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:13.775774 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:13.796269 16203 raft_consensus.cc:2468] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 8.
W20260709 13:07:13.800061 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 46098.9us
I20260709 13:07:13.802012 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:07:13.798209 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 443156us
I20260709 13:07:13.803972 16322 leader_election.cc:304] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:13.771055 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:13.809046 16248 leader_election.cc:304] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:13.816563 16940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:13.802769 16202 raft_consensus.cc:2468] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 6.
I20260709 13:07:13.822408 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:13.770339 20130 raft_consensus.cc:2804] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:13.823439 16205 raft_consensus.cc:3060] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:07:13.824532 16282 raft_consensus.cc:2468] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 11.
I20260709 13:07:13.825740 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:13.834515 16246 leader_election.cc:304] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:13.815251 16248 leader_election.cc:304] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:13.770622 20244 raft_consensus.cc:2749] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:07:13.839875 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:13.839466 16248 leader_election.cc:304] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:13.797722 20494 raft_consensus.cc:2749] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:13.714282 20437 raft_consensus.cc:515] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:13.791356 20477 raft_consensus.cc:493] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:13.836489 16246 leader_election.cc:304] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:13.666960 20532 raft_consensus.cc:515] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:07:13.846017 16322 leader_election.cc:304] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:13.877528 16322 leader_election.cc:304] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:13.878899 16322 leader_election.cc:304] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:13.880076 16322 leader_election.cc:304] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:13.881229 16322 leader_election.cc:304] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:07:13.846724 16912 leader_election.cc:304] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:13.882462 20380 raft_consensus.cc:2749] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:13.883226 20380 raft_consensus.cc:2749] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:13.883859 20380 raft_consensus.cc:3060] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:13.884341 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:13.885222 20390 raft_consensus.cc:2749] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:13.886031 20390 raft_consensus.cc:2749] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:13.847231 16320 leader_election.cc:304] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:13.886926 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:13.888438 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:13.823772 20480 raft_consensus.cc:2749] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:13.889564 20480 raft_consensus.cc:493] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.890080 20480 raft_consensus.cc:515] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } }
I20260709 13:07:13.890226 16205 raft_consensus.cc:2468] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 15.
I20260709 13:07:13.819162 20417 raft_consensus.cc:2749] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:07:13.893122 20417 raft_consensus.cc:2804] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:13.893541 20417 raft_consensus.cc:493] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:13.893916 20417 raft_consensus.cc:3060] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:13.897126 20496 raft_consensus.cc:2804] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:13.897725 20496 raft_consensus.cc:493] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:13.898087 20496 raft_consensus.cc:3060] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:13.764683 20479 consensus_queue.cc:1048] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.082s
I20260709 13:07:13.839095 20130 raft_consensus.cc:493] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:13.845741 20466 raft_consensus.cc:2764] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
W20260709 13:07:13.914803 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 148386us
I20260709 13:07:13.798826 20537 consensus_queue.cc:1048] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.116s
I20260709 13:07:13.792327 20531 raft_consensus.cc:515] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:13.937306 16322 leader_election.cc:304] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:07:13.924023 16208 raft_consensus.cc:2468] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 9.
I20260709 13:07:13.920642 16320 leader_election.cc:304] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:13.937573 16173 leader_election.cc:304] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:13.910773 20355 raft_consensus.cc:2749] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:07:13.965695 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 45205.2us
I20260709 13:07:13.965209 16322 leader_election.cc:304] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:13.981668 16322 leader_election.cc:304] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:13.978721 16173 leader_election.cc:304] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:13.904577 20477 raft_consensus.cc:515] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:13.917388 20130 raft_consensus.cc:3060] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:07:13.989543 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 153150us
I20260709 13:07:13.967389 20390 raft_consensus.cc:2749] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:14.079120 16248 leader_election.cc:304] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:13.979677 20241 raft_consensus.cc:2804] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:13.985203 20453 raft_consensus.cc:2804] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:07:14.075407 20516 log.cc:927] Time spent T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:07:13.963660 20421 consensus_queue.cc:1048] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.130s
I20260709 13:07:14.061861 20420 raft_consensus.cc:2804] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:14.061565 20492 raft_consensus.cc:2749] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:07:14.142421 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 160860us
I20260709 13:07:14.141170 16248 leader_election.cc:304] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:13.917830 20528 consensus_queue.cc:1059] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.210s
I20260709 13:07:14.143739 20420 raft_consensus.cc:493] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:14.127521 20453 raft_consensus.cc:493] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:14.123131 20523 raft_consensus.cc:2749] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:14.135608 16217 tablet_copy_service.cc:342] P e10b16d536674c0bb350a31d7ce5ff7f: Request end of tablet copy session 1109f76a0b7b443a84c0327c8707bc63-540bfc4ad793452faea5b865343aacf7 received from {username='slave'} at 127.0.0.1:39674
I20260709 13:07:14.177183 16204 raft_consensus.cc:2468] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 12.
I20260709 13:07:14.148252 16279 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45218 (request call id 2138) took 2046 ms. Trace:
W20260709 13:07:14.169456 16174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:14.139953 20241 raft_consensus.cc:697] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 15 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
W20260709 13:07:14.194200 20547 log.cc:927] Time spent T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 13:07:14.194348 20241 consensus_queue.cc:237] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:14.176769 20460 raft_consensus.cc:2804] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:14.195696 20460 raft_consensus.cc:493] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:14.196095 20460 raft_consensus.cc:3060] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:14.144956 16322 leader_election.cc:304] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:07:14.188479 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 199355us
I20260709 13:07:14.148523 20380 raft_consensus.cc:2749] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:14.186779 20533 raft_consensus.cc:2749] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:07:14.149140 20403 consensus_meta.cc:287] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63: Time spent flushing consensus metadata: real 0.765s	user 0.010s	sys 0.003s
I20260709 13:07:14.190672 20527 leader_election.cc:290] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:14.181634 20453 raft_consensus.cc:3060] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:14.150605 20489 raft_consensus.cc:2804] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:14.179713 20493 raft_consensus.cc:2804] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:14.143927 20510 raft_consensus.cc:2804] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:14.185169 16279 rpcz_store.cc:276] 0709 13:07:12.102139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:12.102276 (+   137us) service_pool.cc:224] Handling call
0709 13:07:12.109464 (+  7188us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:12.109932 (+   468us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:07:12.124794 (+ 14862us) log.cc:844] Serialized 14 byte log entry
0709 13:07:12.300419 (+175625us) spinlock_profiling.cc:243] Waited 1.56 ms on lock 0x7b18003c1180. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f3625264de1 00007f36252715b1 00007f361c37ee07 00007f36251d9ab9 00007f361c39b69b 00007f361c39993f 00007f361c39bc02 00007f361f02320b 00007f361f028d23 00007f361f02923a 00007f361f493a2a
0709 13:07:12.569186 (+268767us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:12.584253 (+ 15067us) log.cc:844] Serialized 26 byte log entry
0709 13:07:12.584400 (+   147us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:12.584432 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:12.584493 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:13.040463 (+455970us) spinlock_profiling.cc:243] Waited 5.09 ms on lock 0x7b480015c258. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f36243b2aa1 00007f36243a9b37 00007f36243a99ca 00007f36244a126f 00007f36244a0f37 00007f36244b555c 00007f36244b5508 00007f36244b5488 00007f36244b5443 00007f36244b46ec 00007f36233dea96
0709 13:07:14.147415 (+1106952us) spinlock_profiling.cc:243] Waited 15.1 ms on lock 0x7b24002a6f08. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361c224db1 00007f361c2229c4 00007f361c220acb 00007f361c3dbdc9 00007f361c3dba55 00007f361c3dafb0 00007f361f051488 00007f361f051be8 00007f361f029398 00007f361f02476a 00007f361f023bb6
0709 13:07:14.148009 (+   594us) raft_consensus.cc:1685] finished
0709 13:07:14.148029 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:14.148191 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21749,"prepare.queue_time_us":46883,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":50,"raft.queue_time_us":8640,"raft.run_cpu_time_us":3894,"raft.run_wall_time_us":480096,"spinlock_wait_cycles":50047616,"thread_start_us":268373,"threads_started":1,"wal-append.queue_time_us":576095}
I20260709 13:07:14.206511 16217 tablet_copy_service.cc:434] P e10b16d536674c0bb350a31d7ce5ff7f: ending tablet copy session 1109f76a0b7b443a84c0327c8707bc63-540bfc4ad793452faea5b865343aacf7 on tablet 540bfc4ad793452faea5b865343aacf7 with peer 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:07:14.176205 20244 raft_consensus.cc:2749] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:14.179927 20420 raft_consensus.cc:3060] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:14.207710 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:14.155439 20511 raft_consensus.cc:3060] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:07:14.192945 20543 log.cc:927] Time spent T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.206s	user 0.000s	sys 0.000s
I20260709 13:07:14.176895 20480 leader_election.cc:290] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:07:14.165324 20502 log.cc:927] Time spent T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.751s	user 0.006s	sys 0.008s
W20260709 13:07:14.200462 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 55578.1us
I20260709 13:07:14.271394 16322 leader_election.cc:304] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:07:14.273648 16322 leader_election.cc:304] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:14.162333 20452 leader_election.cc:290] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:14.156860 20532 leader_election.cc:290] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:14.204442 20492 raft_consensus.cc:2749] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:07:14.228631 20489 raft_consensus.cc:493] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:14.233932 20493 raft_consensus.cc:493] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:14.232220 20527 raft_consensus.cc:493] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:14.228281 20403 raft_consensus.cc:515] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:14.288691 16322 leader_election.cc:304] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
W20260709 13:07:14.285419 20513 consensus_meta.cc:287] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63: Time spent flushing consensus metadata: real 0.889s	user 0.013s	sys 0.000s
I20260709 13:07:14.302039 20539 consensus_queue.cc:1048] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 13:07:14.233593 20510 raft_consensus.cc:493] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:14.325032 16914 leader_election.cc:336] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 1.993s (SENT)
I20260709 13:07:14.287250 20390 raft_consensus.cc:2804] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:14.266709 20437 leader_election.cc:290] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:07:14.357861 20544 log.cc:927] Time spent T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.382s	user 0.000s	sys 0.002s
I20260709 13:07:14.358330 20558 consensus_queue.cc:1059] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.069s
I20260709 13:07:14.292344 20489 raft_consensus.cc:3060] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:14.363127 20132 raft_consensus.cc:493] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:14.365516 20477 leader_election.cc:290] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:14.367205 16277 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45210 (request call id 2179) took 1965 ms. Trace:
W20260709 13:07:14.368767 19940 consensus_meta.cc:287] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 1.048s	user 0.006s	sys 0.005s
I20260709 13:07:14.370712 20531 leader_election.cc:290] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:14.288002 20421 raft_consensus.cc:2749] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:14.319104 16322 leader_election.cc:304] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:07:14.385842 16940 raft_consensus.cc:1240] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:14.286747 20528 consensus_queue.cc:1059] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.100s
I20260709 13:07:14.305869 20493 raft_consensus.cc:3060] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:14.351639 20492 raft_consensus.cc:2749] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:14.320688 20452 raft_consensus.cc:493] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:14.399362 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:14.355844 20510 raft_consensus.cc:3060] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:14.375888 20390 raft_consensus.cc:493] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:14.431854 20390 raft_consensus.cc:3060] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:14.432461 16356 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33486 (request call id 578) took 1903 ms. Trace:
I20260709 13:07:14.385038 20442 raft_consensus.cc:2749] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:14.434814 20452 raft_consensus.cc:515] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:07:14.408486 20152 consensus_meta.cc:287] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 0.687s	user 0.010s	sys 0.001s
I20260709 13:07:14.409521 20361 leader_election.cc:290] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:14.437343 20413 raft_consensus.cc:2749] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:07:14.439708 20491 consensus_meta.cc:287] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 0.745s	user 0.011s	sys 0.000s
I20260709 13:07:14.440261 20390 raft_consensus.cc:515] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:14.443077 20403 leader_election.cc:290] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 10 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:14.445720 20440 leader_election.cc:290] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:14.404865 19940 raft_consensus.cc:515] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:14.449980 19940 leader_election.cc:290] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:14.424554 20521 raft_consensus.cc:3055] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:14.452463 20521 raft_consensus.cc:740] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:14.401343 16277 rpcz_store.cc:276] 0709 13:07:12.401880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:12.564644 (+162764us) service_pool.cc:224] Handling call
0709 13:07:12.565039 (+   395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:12.565318 (+   279us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:07:12.628901 (+ 63583us) log.cc:844] Serialized 14 byte log entry
0709 13:07:14.366487 (+1737586us) spinlock_profiling.cc:243] Waited 6.37 ms on lock 0x7b18003ee840. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f3625264de1 00007f36252715b1 00007f361f0314bc 00007f361c37f48b 00007f36251d9ab9 00007f361c39b69b 00007f361c39993f 00007f361c399455 00007f361f481060 00007f361f493716 00007f361f4a4287
0709 13:07:14.366660 (+   173us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:14.366736 (+    76us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:14.366806 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:14.366925 (+   119us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:14.367105 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16485,"prepare.queue_time_us":50162,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":127221,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":28817,"spinlock_wait_cycles":14657408,"thread_start_us":297253,"threads_started":2,"wal-append.queue_time_us":805848}
I20260709 13:07:14.423298 16102 catalog_manager.cc:5697] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: term changed from 7 to 9, leader changed from 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) to 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68). New cstate: current_term: 9 leader_uuid: "1109f76a0b7b443a84c0327c8707bc63" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:14.320591 20527 raft_consensus.cc:515] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:14.314934 20496 raft_consensus.cc:515] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:07:14.428959 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 109987us
I20260709 13:07:14.450296 20511 raft_consensus.cc:2749] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:14.401077 20132 raft_consensus.cc:3060] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:14.432943 16356 rpcz_store.cc:276] 0709 13:07:12.529097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:12.530512 (+  1415us) service_pool.cc:224] Handling call
0709 13:07:12.589544 (+ 59032us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:12.589906 (+   362us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:12.589935 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:12.599866 (+  9931us) log.cc:844] Serialized 26 byte log entry
0709 13:07:12.857501 (+257635us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:13.013046 (+155545us) log.cc:844] Serialized 14 byte log entry
0709 13:07:13.124589 (+111543us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:13.124777 (+   188us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:14.164529 (+1039752us) spinlock_profiling.cc:243] Waited 37.1 ms on lock 0x7b4400022b4c. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361c224db1 00007f361c2c2c85 00007f361c2c36a2 00007f361f0351db 00007f361f030aaf 00007f361f02486e 00007f361f023bb6 00007f361f0237d8 00007f361f02d221 00007f361f02d1d9 00007f361f02d169
0709 13:07:14.428303 (+263774us) raft_consensus.cc:1685] finished
0709 13:07:14.432180 (+  3877us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:14.432356 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":397548,"prepare.run_cpu_time_us":83,"prepare.run_wall_time_us":6222,"raft.queue_time_us":65321,"raft.run_cpu_time_us":391,"raft.run_wall_time_us":74296,"spinlock_wait_cycles":85377792,"thread_start_us":286681,"threads_started":2,"wal-append.queue_time_us":739398}
I20260709 13:07:14.401871 20130 raft_consensus.cc:515] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:14.383848 20513 raft_consensus.cc:515] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:14.452519 19831 raft_consensus.cc:3060] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:14.459379 20390 leader_election.cc:290] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:14.460239 20527 leader_election.cc:290] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:14.479440 20511 raft_consensus.cc:493] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
W20260709 13:07:14.481820 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 98951.9us
W20260709 13:07:14.487713 16173 leader_election.cc:336] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 1.941s (SENT)
I20260709 13:07:14.488286 16173 leader_election.cc:304] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
W20260709 13:07:14.482074 20101 consensus_meta.cc:287] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f: Time spent flushing consensus metadata: real 0.949s	user 0.011s	sys 0.005s
I20260709 13:07:14.500636 16946 raft_consensus.cc:2393] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 9: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
I20260709 13:07:14.498268 16914 leader_election.cc:304] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:14.453519 20521 consensus_queue.cc:260] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:14.503223 16941 raft_consensus.cc:2368] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 13. Current term is 14.
I20260709 13:07:14.498593 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:14.502717 16277 raft_consensus.cc:1240] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 LEADER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 8. Current term is 9. Ops: []
W20260709 13:07:14.500233 16173 leader_election.cc:336] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 2.014s (SENT)
I20260709 13:07:14.507431 16173 leader_election.cc:304] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:14.508946 16914 leader_election.cc:304] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:14.484850 19940 consensus_queue.cc:1059] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:07:14.493237 20511 raft_consensus.cc:515] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:14.511291 19940 raft_consensus.cc:3055] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:14.511759 19940 raft_consensus.cc:740] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:14.512475 20511 leader_election.cc:290] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:14.505393 20341 raft_consensus.cc:2749] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:14.516958 20513 leader_election.cc:290] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 9 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:14.516567 19940 consensus_queue.cc:260] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:14.518000 20452 leader_election.cc:290] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:14.518391 19940 raft_consensus.cc:3060] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:14.519899 20262 raft_consensus.cc:3055] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:14.520399 20262 raft_consensus.cc:740] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:14.521301 20262 consensus_queue.cc:260] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:14.522149 20130 leader_election.cc:290] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 14 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:14.500208 20532 raft_consensus.cc:2749] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:14.527236 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:14.527420 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:07:14.527962 16277 raft_consensus.cc:2468] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 13.
I20260709 13:07:14.528115 16947 raft_consensus.cc:3060] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:14.529922 16914 leader_election.cc:304] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:14.567692 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:14.568920 16277 raft_consensus.cc:3060] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:14.661451 16279 raft_consensus.cc:1275] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:07:14.661731 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:14.662349 16282 raft_consensus.cc:3060] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:14.662840 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:14.665297 20101 raft_consensus.cc:2749] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:07:14.666522 20452 raft_consensus.cc:493] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
W20260709 13:07:14.666967 20490 log.cc:927] Time spent T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63: Append to log took a long time: real 1.708s	user 0.004s	sys 0.014s
I20260709 13:07:14.667143 20452 raft_consensus.cc:515] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:14.668845 20440 raft_consensus.cc:493] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.669466 20440 raft_consensus.cc:515] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:14.669806 16945 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35106 (request call id 769) took 2333 ms. Trace:
I20260709 13:07:14.670347 16945 rpcz_store.cc:276] 0709 13:07:12.336556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:12.336693 (+   137us) service_pool.cc:224] Handling call
0709 13:07:12.368646 (+ 31953us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:12.376872 (+  8226us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:12.376900 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:12.400461 (+ 23561us) log.cc:844] Serialized 26 byte log entry
0709 13:07:12.773611 (+373150us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:12.773672 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:12.773771 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:14.666604 (+1892833us) spinlock_profiling.cc:243] Waited 19.4 ms on lock 0x7b24000c2618. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361c224db1 00007f361c2229c4 00007f361c220acb 00007f361c3dbdc9 00007f361c3dba55 00007f361c3db09d 00007f361f00d10e 00007f361f02488c 00007f361f023bb6 00007f361f0237d8 00007f361f02d221
0709 13:07:14.669444 (+  2840us) raft_consensus.cc:1685] finished
0709 13:07:14.669467 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:14.669718 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7985,"raft.run_cpu_time_us":196,"raft.run_wall_time_us":9912,"spinlock_wait_cycles":44537728,"thread_start_us":340541,"threads_started":1,"wal-append.queue_time_us":442630}
I20260709 13:07:14.672303 20440 leader_election.cc:290] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:07:14.673452 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 173362us
W20260709 13:07:14.674285 16173 leader_election.cc:336] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 2.019s (SENT)
I20260709 13:07:14.674996 16173 leader_election.cc:304] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:14.675277 16947 raft_consensus.cc:2468] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 12.
I20260709 13:07:14.676800 20536 raft_consensus.cc:2749] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:14.678582 20390 raft_consensus.cc:493] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:14.679167 20390 raft_consensus.cc:515] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:07:14.680169 16322 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:14.680943 16322 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:14.681170 20390 leader_election.cc:290] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:14.681806 20413 raft_consensus.cc:493] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.682240 20256 raft_consensus.cc:493] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.682374 20539 raft_consensus.cc:493] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.682472 20413 raft_consensus.cc:515] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:14.682956 20256 raft_consensus.cc:515] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:14.683081 20539 raft_consensus.cc:515] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:14.685169 20413 leader_election.cc:290] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:14.681874 20152 raft_consensus.cc:493] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.685353 20539 leader_election.cc:290] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:14.685411 20256 leader_election.cc:290] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:14.685935 20152 raft_consensus.cc:515] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:14.686596 20262 raft_consensus.cc:3060] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:14.686888 20390 raft_consensus.cc:493] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.687474 20390 raft_consensus.cc:515] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:14.688302 20152 leader_election.cc:290] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:14.690227 20390 leader_election.cc:290] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:14.690909 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:07:14.692099 20130 raft_consensus.cc:2749] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:14.691807 20390 raft_consensus.cc:493] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.693468 20460 raft_consensus.cc:515] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:14.693086 20390 raft_consensus.cc:515] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:14.696108 20510 raft_consensus.cc:515] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:14.696477 20390 leader_election.cc:290] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:14.697337 16276 raft_consensus.cc:1240] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:07:14.697547 20152 raft_consensus.cc:493] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.698691 20256 raft_consensus.cc:493] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:14.700457 20256 raft_consensus.cc:515] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:14.701449 16351 raft_consensus.cc:1240] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:07:14.698989 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:14.698693 16356 raft_consensus.cc:1275] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260709 13:07:14.703176 20417 consensus_meta.cc:287] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3: Time spent flushing consensus metadata: real 0.809s	user 0.012s	sys 0.000s
W20260709 13:07:14.703022 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:14.703889 16349 raft_consensus.cc:2393] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 11: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:07:14.703666 20417 raft_consensus.cc:515] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:14.702838 20256 leader_election.cc:290] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:14.705554 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:14.705889 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:14.706099 20417 leader_election.cc:290] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:14.706317 16349 raft_consensus.cc:2468] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 9.
I20260709 13:07:14.706943 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:14.706681 16352 raft_consensus.cc:2468] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 8.
I20260709 13:07:14.706372 16278 raft_consensus.cc:1240] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:14.708846 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:14.709122 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:14.709830 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:14.709178 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:14.710959 16348 raft_consensus.cc:2393] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 13: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:07:14.711057 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:14.711918 16355 raft_consensus.cc:2393] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 12: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:07:14.712019 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:14.712661 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:14.712793 16348 raft_consensus.cc:2468] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 13.
I20260709 13:07:14.713243 16355 raft_consensus.cc:3060] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:14.709440 16356 raft_consensus.cc:2468] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 6.
I20260709 13:07:14.715124 16352 raft_consensus.cc:2468] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 9.
I20260709 13:07:14.715837 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:14.716212 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:14.716864 16356 raft_consensus.cc:2393] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 13: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
W20260709 13:07:14.717971 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 191445us
I20260709 13:07:14.719067 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:14.719753 16348 raft_consensus.cc:3060] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:14.721372 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bc3c8ff9b84838a2664335d7e1582b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:14.723097 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:14.723757 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:14.700109 20152 raft_consensus.cc:515] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:07:14.728586 20566 log.cc:927] Time spent T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.221s	user 0.001s	sys 0.000s
I20260709 13:07:14.760723 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:14.733143 16355 raft_consensus.cc:2468] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 12.
I20260709 13:07:14.761773 16349 raft_consensus.cc:2468] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 13.
I20260709 13:07:14.762512 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:14.762960 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:14.730896 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:14.736189 16352 raft_consensus.cc:3060] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:14.763867 16283 raft_consensus.cc:2468] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 11.
I20260709 13:07:14.739516 16282 raft_consensus.cc:2468] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 15.
I20260709 13:07:14.763880 16355 raft_consensus.cc:2368] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 12. Current term is 13.
I20260709 13:07:14.735113 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:14.760980 16280 raft_consensus.cc:1275] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:07:14.765477 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:14.764272 16349 raft_consensus.cc:2468] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 15.
I20260709 13:07:14.767635 16355 raft_consensus.cc:2393] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 8: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:07:14.768539 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:14.772198 16356 raft_consensus.cc:2393] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 in current term 8: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:07:14.774523 16348 raft_consensus.cc:2468] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 9.
I20260709 13:07:14.776096 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:14.776886 16348 raft_consensus.cc:2376] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 11. Re-sending same reply.
I20260709 13:07:14.773424 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:14.779326 16356 raft_consensus.cc:2468] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 9.
I20260709 13:07:14.781529 16356 raft_consensus.cc:1275] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:07:14.722473 20510 leader_election.cc:290] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:14.782050 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:14.782593 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:14.788692 16348 raft_consensus.cc:1275] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 13:07:14.797113 20530 log.cc:927] Time spent T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 1.101s	user 0.004s	sys 0.000s
I20260709 13:07:14.799348 16281 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45218 (request call id 2150) took 1681 ms. Trace:
I20260709 13:07:14.800000 16281 rpcz_store.cc:276] 0709 13:07:13.117985 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.118272 (+   287us) service_pool.cc:224] Handling call
0709 13:07:13.118787 (+   515us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:13.119244 (+   457us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:13.119287 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:13.157569 (+ 38282us) log.cc:844] Serialized 26 byte log entry
0709 13:07:13.319689 (+162120us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:13.319749 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:13.319839 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:14.796305 (+1476466us) spinlock_profiling.cc:243] Waited 1.72 ms on lock 0x7b4400022b4c. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361c224db1 00007f361c2c2c85 00007f361c2c36a2 00007f361f0351db 00007f361f030aaf 00007f361f02486e 00007f361f023bb6 00007f361f0237d8 00007f361f02d221 00007f361f02d1d9 00007f361f02d169
0709 13:07:14.798518 (+  2213us) raft_consensus.cc:1685] finished
0709 13:07:14.798588 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:14.799211 (+   623us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":72228,"raft.queue_time_us":1097,"raft.run_cpu_time_us":337,"raft.run_wall_time_us":16926,"spinlock_wait_cycles":3966336,"thread_start_us":42790,"threads_started":1,"wal-append.queue_time_us":407100}
I20260709 13:07:14.771992 20341 consensus_queue.cc:1048] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:07:14.772303 20489 raft_consensus.cc:515] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:07:14.810796 20489 leader_election.cc:290] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:07:14.782650 20420 consensus_meta.cc:287] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 0.518s	user 0.011s	sys 0.000s
I20260709 13:07:14.811934 16208 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60138 (request call id 2352) took 1043 ms. Trace:
I20260709 13:07:14.811787 20420 raft_consensus.cc:515] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:14.812368 16208 rpcz_store.cc:276] 0709 13:07:13.768608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.768778 (+   170us) service_pool.cc:224] Handling call
0709 13:07:14.811750 (+1042972us) spinlock_profiling.cc:243] Waited 115 ms on lock 0x7b54003d1b54. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:07:14.811874 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":264455424}
I20260709 13:07:14.814007 20420 leader_election.cc:290] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:14.763993 20528 raft_consensus.cc:493] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.858084 16352 raft_consensus.cc:2468] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 10.
I20260709 13:07:14.859851 16349 raft_consensus.cc:1240] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:07:14.862056 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:14.862216 16207 raft_consensus.cc:1275] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:07:14.863220 20399 raft_consensus.cc:493] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:14.870512 16355 raft_consensus.cc:1275] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:07:14.871301 20496 leader_election.cc:290] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:14.871984 20528 raft_consensus.cc:515] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:14.883679 16277 raft_consensus.cc:2468] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 15.
I20260709 13:07:14.878667 16322 leader_election.cc:304] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:07:14.886994 16352 raft_consensus.cc:2468] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 11.
I20260709 13:07:14.898880 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:14.906894 16352 raft_consensus.cc:2393] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 8: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:07:14.908064 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:14.905062 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:14.912225 16208 raft_consensus.cc:3060] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:14.913807 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:14.897856 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:14.869995 20132 raft_consensus.cc:515] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:14.914682 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:14.923156 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f022e2e63ae4461d834e476ff2666991" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:14.923174 16914 leader_election.cc:304] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:07:14.924845 16248 leader_election.cc:400] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107) with higher term. Message: Invalid argument: T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 12. Current term is 13.
I20260709 13:07:14.925222 16248 leader_election.cc:403] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:14.926978 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:07:14.894230 20532 raft_consensus.cc:493] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.933779 16914 leader_election.cc:304] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:07:14.933842 16945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:14.930902 16248 leader_election.cc:304] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:07:14.939070 16914 leader_election.cc:304] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:14.910730 20539 raft_consensus.cc:2804] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:14.941802 16248 leader_election.cc:304] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:07:14.951453 16947 raft_consensus.cc:1240] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:14.943252 20460 leader_election.cc:290] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:14.950019 20489 raft_consensus.cc:2804] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:14.957712 20489 raft_consensus.cc:493] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:14.958182 20489 raft_consensus.cc:3060] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:14.949944 20403 consensus_queue.cc:1048] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.009s
I20260709 13:07:14.950208 20513 raft_consensus.cc:2804] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:14.961660 20558 raft_consensus.cc:3055] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:14.962119 20558 raft_consensus.cc:740] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
W20260709 13:07:14.962827 20493 consensus_meta.cc:287] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f: Time spent flushing consensus metadata: real 0.532s	user 0.003s	sys 0.007s
I20260709 13:07:14.963009 20558 consensus_queue.cc:260] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:14.928218 20505 raft_consensus.cc:2804] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:14.964035 20505 raft_consensus.cc:493] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:14.964176 20558 raft_consensus.cc:3060] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:14.964468 20505 raft_consensus.cc:3060] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:14.958135 16208 raft_consensus.cc:2468] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 9.
I20260709 13:07:14.963280 20493 raft_consensus.cc:515] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:14.976539 20493 leader_election.cc:290] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 14 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:14.982416 16914 leader_election.cc:304] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:07:14.933363 20510 raft_consensus.cc:3060] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:07:14.987761 20494 raft_consensus.cc:2749] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:14.894049 20399 raft_consensus.cc:515] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:07:15.086850 16321 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:14.979931 20417 raft_consensus.cc:2804] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:15.153967 20417 raft_consensus.cc:493] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:15.154654 20417 raft_consensus.cc:3060] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:15.162076 16274 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42740 (request call id 724) took 1357 ms. Trace:
I20260709 13:07:15.163414 16944 raft_consensus.cc:2468] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 7.
I20260709 13:07:14.955394 16248 leader_election.cc:304] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:07:15.151499 20528 leader_election.cc:290] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:14.978919 20539 raft_consensus.cc:697] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 12 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:15.163501 16274 rpcz_store.cc:276] 0709 13:07:13.805083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.805345 (+   262us) service_pool.cc:224] Handling call
0709 13:07:13.806131 (+   786us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:14.124740 (+318609us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:14.124793 (+    53us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:14.124861 (+    68us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:14.124913 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:15.161814 (+1036901us) spinlock_profiling.cc:243] Waited 318 ms on lock 0x7b54003363d4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f489e01 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6
0709 13:07:15.161864 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:15.162009 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":732017536}
W20260709 13:07:15.165972 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 211231us
I20260709 13:07:14.996978 20513 raft_consensus.cc:697] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 9 LEADER]: Becoming Leader. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:07:15.031584 20152 leader_election.cc:290] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:14.943488 20532 raft_consensus.cc:515] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:15.130252 20494 raft_consensus.cc:2804] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:15.129578 20511 raft_consensus.cc:493] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:15.179085 20508 raft_consensus.cc:2804] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:07:15.226588 19831 consensus_meta.cc:287] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f: Time spent flushing consensus metadata: real 0.743s	user 0.008s	sys 0.003s
I20260709 13:07:15.180668 20437 raft_consensus.cc:493] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:15.231951 20437 raft_consensus.cc:515] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:07:15.235021 20460 raft_consensus.cc:493] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.235863 20460 raft_consensus.cc:515] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:15.252704 20399 leader_election.cc:290] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:15.255803 20534 leader_election.cc:290] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:15.257041 20009 raft_consensus.cc:493] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:15.257786 20009 raft_consensus.cc:515] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:07:15.259544 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:15.260715 20009 leader_election.cc:290] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:15.261483 20009 raft_consensus.cc:493] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:15.204034 20548 raft_consensus.cc:493] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:15.263422 20548 raft_consensus.cc:515] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:15.269188 20514 leader_election.cc:290] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:15.272305 20414 raft_consensus.cc:1064] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e: attempting to promote NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 to VOTER
I20260709 13:07:15.282882 20452 leader_election.cc:290] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:15.288282 20241 raft_consensus.cc:3055] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:15.288909 20241 raft_consensus.cc:740] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
W20260709 13:07:15.290406 16357 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33486 (request call id 593) took 2749 ms (client timeout 2217 ms). Trace:
W20260709 13:07:15.291030 16357 rpcz_store.cc:269] 0709 13:07:12.540626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:12.584735 (+ 44109us) service_pool.cc:224] Handling call
0709 13:07:15.290074 (+2705339us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b54002292d4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:07:15.290276 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2326350080}
I20260709 13:07:15.294070 16945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:15.296636 16940 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40078 (request call id 487) took 1413 ms. Trace:
I20260709 13:07:15.297231 16940 rpcz_store.cc:276] 0709 13:07:13.883633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.883845 (+   212us) service_pool.cc:224] Handling call
0709 13:07:13.884251 (+   406us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:14.415299 (+531048us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:15.296278 (+880979us) spinlock_profiling.cc:243] Waited 501 ms on lock 0x7b54005401d4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f489e01 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6
0709 13:07:15.296535 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1153097088}
I20260709 13:07:15.299114 20539 consensus_queue.cc:237] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:15.302672 20494 raft_consensus.cc:697] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [term 10 LEADER]: Becoming Leader. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:07:15.303479 16278 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42740 (request call id 726) took 1239 ms. Trace:
I20260709 13:07:15.303987 16278 rpcz_store.cc:276] 0709 13:07:14.064387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.064762 (+   375us) service_pool.cc:224] Handling call
0709 13:07:14.065176 (+   414us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:14.708378 (+643202us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:15.303168 (+594790us) spinlock_profiling.cc:243] Waited 641 ms on lock 0x7b5400389354. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f489e01 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6
0709 13:07:15.303402 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1474022656}
I20260709 13:07:15.304096 20494 consensus_queue.cc:237] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:07:15.305814 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:15.306135 20556 raft_consensus.cc:493] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:15.306835 20556 raft_consensus.cc:515] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:07:15.302677 16941 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40078 (request call id 488) took 1418 ms (client timeout 1507 ms). Trace:
W20260709 13:07:15.312055 16941 rpcz_store.cc:269] 0709 13:07:13.883978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.884099 (+   121us) service_pool.cc:224] Handling call
0709 13:07:15.302367 (+1418268us) spinlock_profiling.cc:243] Waited 608 ms on lock 0x7b54006437d4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:07:15.302594 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1398933760}
I20260709 13:07:15.325085 16173 leader_election.cc:304] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:07:15.203431 20563 raft_consensus.cc:493] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:15.261967 20009 raft_consensus.cc:515] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:15.339110 16322 leader_election.cc:304] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:15.336855 16940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:15.329880 20562 consensus_queue.cc:1048] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 13:07:15.222457 20508 raft_consensus.cc:493] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:15.333626 20361 consensus_queue.cc:1059] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:07:15.322909 20514 raft_consensus.cc:493] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:15.326761 19831 raft_consensus.cc:493] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
W20260709 13:07:15.332187 20453 consensus_meta.cc:287] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f: Time spent flushing consensus metadata: real 1.098s	user 0.010s	sys 0.003s
W20260709 13:07:15.356705 16356 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.016s	sys 0.066s
W20260709 13:07:15.369411 16356 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.016s	sys 0.066s
I20260709 13:07:15.378118 16354 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d"
dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
mode: GRACEFUL
new_leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
 from {username='slave'} at 127.0.0.1:56792
I20260709 13:07:15.379128 16354 raft_consensus.cc:606] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 15 LEADER]: Received request to transfer leadership to TS 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:07:15.337815 20132 leader_election.cc:290] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 9 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:15.221931 20511 raft_consensus.cc:515] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:15.361197 20508 raft_consensus.cc:3060] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:15.356207 20548 leader_election.cc:290] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:15.357578 20528 raft_consensus.cc:2804] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:07:15.397114 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 415046us
I20260709 13:07:15.335740 20534 consensus_queue.cc:1048] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 13:07:15.335057 20489 raft_consensus.cc:515] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } }
I20260709 13:07:15.404374 16353 raft_consensus.cc:1275] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:07:15.369797 20437 leader_election.cc:290] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:15.356258 20563 raft_consensus.cc:515] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:15.377532 20514 raft_consensus.cc:515] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:15.379117 19831 raft_consensus.cc:515] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:15.402582 20548 raft_consensus.cc:493] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:15.359513 20517 consensus_queue.cc:1048] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:07:15.359097 20452 consensus_queue.cc:1048] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
W20260709 13:07:15.421571 16321 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:15.378903 20152 consensus_queue.cc:1048] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:07:15.396130 20528 raft_consensus.cc:493] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:15.448086 16946 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35106 (request call id 771) took 1811 ms. Trace:
I20260709 13:07:15.448675 16946 rpcz_store.cc:276] 0709 13:07:13.636243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:13.636414 (+   171us) service_pool.cc:224] Handling call
0709 13:07:15.447866 (+1811452us) spinlock_profiling.cc:243] Waited 859 ms on lock 0x7b54005a2654. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:07:15.448012 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1974972672}
I20260709 13:07:15.449314 20511 leader_election.cc:290] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:15.449890 20511 raft_consensus.cc:493] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:15.387426 20262 consensus_queue.cc:1059] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 13:07:15.382315 20453 raft_consensus.cc:515] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:15.455127 16353 raft_consensus.cc:1275] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:07:15.370718 20513 consensus_queue.cc:237] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:15.437680 20437 raft_consensus.cc:2804] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:15.378120 20241 consensus_queue.cc:260] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:15.456041 20528 raft_consensus.cc:3060] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:15.481272 16202 raft_consensus.cc:1240] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:15.448154 19831 leader_election.cc:290] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:15.456326 20556 leader_election.cc:290] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:15.437436 20355 consensus_queue.cc:1048] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
W20260709 13:07:15.473327 16949 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.003s	sys 0.045s
W20260709 13:07:15.487305 16949 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.535s	user 0.003s	sys 0.045s
W20260709 13:07:15.488564 16350 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33486 (request call id 586) took 2950 ms (client timeout 2322 ms). Trace:
I20260709 13:07:15.450479 20511 raft_consensus.cc:515] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
W20260709 13:07:15.489199 16350 rpcz_store.cc:269] 0709 13:07:12.538603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:12.542455 (+  3852us) service_pool.cc:224] Handling call
0709 13:07:15.488275 (+2945820us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b5400308ed4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:07:15.488455 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2649281408}
I20260709 13:07:15.452659 20548 raft_consensus.cc:515] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:15.475255 20437 raft_consensus.cc:493] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:15.513684 20534 raft_consensus.cc:493] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:15.514351 20534 raft_consensus.cc:515] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:15.507872 20241 raft_consensus.cc:3060] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:15.501462 20532 leader_election.cc:290] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:07:15.511102 20558 consensus_meta.cc:287] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 0.546s	user 0.013s	sys 0.000s
I20260709 13:07:15.453752 20414 consensus_queue.cc:237] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 5, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:07:15.516008 20580 log.cc:927] Time spent T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
W20260709 13:07:15.515697 20578 log.cc:927] Time spent T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:07:15.514518 20437 raft_consensus.cc:3060] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:15.518229 20521 raft_consensus.cc:3060] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:15.526860 19940 raft_consensus.cc:493] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.543010 20534 leader_election.cc:290] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:07:15.570871 16321 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:15.535833 20420 raft_consensus.cc:493] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.562682 20009 leader_election.cc:290] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:15.574250 16943 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35106 (request call id 775) took 1080 ms. Trace:
W20260709 13:07:15.594772 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:15.575042 20438 raft_consensus.cc:2804] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:15.566651 19940 raft_consensus.cc:515] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:07:15.602962 16914 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.608s	user 0.013s	sys 0.015s
W20260709 13:07:15.610831 16914 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.616s	user 0.013s	sys 0.016s
W20260709 13:07:15.611380 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 629000us
I20260709 13:07:15.584300 20520 raft_consensus.cc:493] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:15.612720 16275 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45210 (request call id 2207) took 1083 ms. Trace:
I20260709 13:07:15.594121 20489 leader_election.cc:290] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:15.625478 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:15.628594 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:15.631115 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:15.631389 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:07:15.632332 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 307324us
I20260709 13:07:15.645823 16277 raft_consensus.cc:2410] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:07:15.648102 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:15.633106 16281 raft_consensus.cc:1240] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:15.651854 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:15.652814 16281 raft_consensus.cc:2468] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 11.
I20260709 13:07:15.654057 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:15.574836 20420 raft_consensus.cc:515] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:15.579313 16943 rpcz_store.cc:276] 0709 13:07:14.493520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.493786 (+   266us) service_pool.cc:224] Handling call
0709 13:07:14.502453 (+  8667us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:14.502695 (+   242us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:07:14.770679 (+267984us) log.cc:844] Serialized 14 byte log entry
0709 13:07:15.573697 (+803018us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:15.573782 (+    85us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:15.573850 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:15.574054 (+   204us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:15.574188 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":109397,"prepare.queue_time_us":489521,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":311044,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":152,"spinlock_wait_cycles":18768256,"thread_start_us":926786,"threads_started":3,"wal-append.queue_time_us":619682}
I20260709 13:07:15.636133 16279 raft_consensus.cc:1240] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 3. Current term is 4. Ops: []
I20260709 13:07:15.629834 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:15.646937 16173 leader_election.cc:304] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:15.662873 16173 leader_election.cc:304] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:15.684900 20453 leader_election.cc:290] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:07:15.692886 20417 consensus_meta.cc:287] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3: Time spent flushing consensus metadata: real 0.537s	user 0.015s	sys 0.000s
I20260709 13:07:15.690860 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:15.731329 16351 raft_consensus.cc:2376] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 15. Re-sending same reply.
I20260709 13:07:15.690896 20538 raft_consensus.cc:3055] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:15.642712 20520 raft_consensus.cc:515] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:15.699740 20420 leader_election.cc:290] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:15.599555 20563 leader_election.cc:290] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:15.664471 16274 raft_consensus.cc:2410] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:07:15.678126 16276 raft_consensus.cc:1240] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:07:15.663447 16278 raft_consensus.cc:1275] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:07:15.689186 20262 raft_consensus.cc:493] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.691169 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:15.650365 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:15.690325 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:15.668610 20361 raft_consensus.cc:2764] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
W20260709 13:07:15.711522 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 48739.5us
I20260709 13:07:15.760128 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:15.760790 16173 leader_election.cc:304] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63
W20260709 13:07:15.711570 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 229623us
I20260709 13:07:15.687913 20460 leader_election.cc:290] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:15.728163 20511 leader_election.cc:290] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:15.718055 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bc3c8ff9b84838a2664335d7e1582b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:15.691924 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
W20260709 13:07:15.682674 20580 log.cc:927] Time spent T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:07:15.771787 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:07:15.721536 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 182502us
I20260709 13:07:15.772181 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:15.772555 16350 raft_consensus.cc:2468] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 7.
I20260709 13:07:15.772833 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:15.670735 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:15.663811 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:15.770285 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:15.670828 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:15.726162 16322 leader_election.cc:304] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:07:15.680817 20548 leader_election.cc:290] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:15.681082 20591 raft_consensus.cc:493] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.668908 20132 consensus_queue.cc:1059] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 13:07:15.736723 16204 raft_consensus.cc:1240] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:15.777961 16274 raft_consensus.cc:1275] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:07:15.738174 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:15.740625 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:15.779001 16351 raft_consensus.cc:2468] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 7.
I20260709 13:07:15.779780 16351 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aee913c41fb9437587affa768953f637"
dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
mode: GRACEFUL
new_leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
 from {username='slave'} at 127.0.0.1:56792
I20260709 13:07:15.719388 20536 raft_consensus.cc:3060] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:15.754185 16279 raft_consensus.cc:1275] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:07:15.755040 16277 raft_consensus.cc:2468] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 9.
I20260709 13:07:15.755355 16349 raft_consensus.cc:2376] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 10. Re-sending same reply.
I20260709 13:07:15.756611 16355 raft_consensus.cc:2468] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 6.
I20260709 13:07:15.759332 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:15.623334 16275 rpcz_store.cc:276] 0709 13:07:14.528914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.529137 (+   223us) service_pool.cc:224] Handling call
0709 13:07:14.731999 (+202862us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:14.732381 (+   382us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:14.732412 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:14.732950 (+   538us) log.cc:844] Serialized 26 byte log entry
0709 13:07:15.161897 (+428947us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:15.596209 (+434312us) log.cc:844] Serialized 14 byte log entry
0709 13:07:15.612192 (+ 15983us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:15.612307 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:15.612371 (+    64us) raft_consensus.cc:1685] finished
0709 13:07:15.612391 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:15.612618 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":124687,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":32,"raft.queue_time_us":98,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":109,"thread_start_us":862357,"threads_started":2,"wal-append.queue_time_us":645101}
I20260709 13:07:15.728729 20514 leader_election.cc:290] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:15.774281 16348 raft_consensus.cc:2468] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 9.
I20260709 13:07:15.773451 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:15.787037 16351 raft_consensus.cc:606] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Received request to transfer leadership to TS 0aea40d6e4374085a2e38a70a71f63e3
W20260709 13:07:15.787228 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 61153.1us
I20260709 13:07:15.787609 16351 raft_consensus.cc:614] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:15.775957 16173 leader_election.cc:304] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:15.776214 16280 raft_consensus.cc:2468] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 12.
I20260709 13:07:15.781191 16208 raft_consensus.cc:1275] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:07:15.762522 20522 raft_consensus.cc:493] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:15.734941 20538 raft_consensus.cc:740] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:15.795085 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:15.797216 16356 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33486 (request call id 601) took 1086 ms. Trace:
I20260709 13:07:15.798210 16274 raft_consensus.cc:2468] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 4.
I20260709 13:07:15.760001 20594 raft_consensus.cc:493] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:15.792150 16173 leader_election.cc:304] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:15.801851 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:15.799575 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:15.803040 16203 raft_consensus.cc:2410] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:07:15.804203 16274 raft_consensus.cc:2393] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 7: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:07:15.798166 16356 rpcz_store.cc:276] 0709 13:07:14.711189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.790193 (+ 79004us) service_pool.cc:224] Handling call
0709 13:07:14.790586 (+   393us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:14.790941 (+   355us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:14.790968 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:14.791466 (+   498us) log.cc:844] Serialized 26 byte log entry
0709 13:07:15.369893 (+578427us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:15.397081 (+ 27188us) log.cc:844] Serialized 14 byte log entry
0709 13:07:15.399291 (+  2210us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:15.399381 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:15.796995 (+397614us) raft_consensus.cc:1685] finished
0709 13:07:15.797014 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:15.797152 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1821,"prepare.queue_time_us":26880,"prepare.run_cpu_time_us":612,"prepare.run_wall_time_us":9067,"raft.queue_time_us":4763,"raft.run_cpu_time_us":333,"raft.run_wall_time_us":15328,"thread_start_us":578004,"threads_started":1,"wal-append.queue_time_us":993748}
I20260709 13:07:15.763164 20592 raft_consensus.cc:493] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:15.805591 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:07:15.818744 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:15.821138 16321 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:15.821646 16321 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:15.738893 20417 raft_consensus.cc:515] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
W20260709 13:07:15.796737 20586 log.cc:927] Time spent T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:07:15.824731 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:15.826303 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:15.782694 20460 raft_consensus.cc:2804] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:15.827561 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:15.828670 16274 raft_consensus.cc:2393] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 14: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:07:15.782701 20494 raft_consensus.cc:493] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
W20260709 13:07:15.830765 20510 consensus_meta.cc:287] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3: Time spent flushing consensus metadata: real 0.842s	user 0.009s	sys 0.005s
I20260709 13:07:15.783463 20511 raft_consensus.cc:493] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.832072 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:15.779307 20489 raft_consensus.cc:493] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:15.763164 20262 raft_consensus.cc:515] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:15.832916 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bc3c8ff9b84838a2664335d7e1582b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:15.830130 20494 raft_consensus.cc:515] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:15.820204 20380 consensus_queue.cc:1048] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 13:07:15.820333 20594 raft_consensus.cc:515] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:15.837327 20417 leader_election.cc:290] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:15.823552 20592 raft_consensus.cc:515] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:15.854269 20563 raft_consensus.cc:493] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:15.884310 20592 leader_election.cc:290] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:15.884581 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:15.885385 16280 raft_consensus.cc:2468] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 9.
I20260709 13:07:15.886322 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:15.887895 16280 raft_consensus.cc:2393] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 4: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:07:15.884311 20563 raft_consensus.cc:515] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:15.832646 20361 consensus_queue.cc:1048] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.069s
I20260709 13:07:15.838193 20538 consensus_queue.cc:260] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:15.786254 20591 raft_consensus.cc:515] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:15.826094 20514 raft_consensus.cc:2804] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:15.842532 16201 raft_consensus.cc:1275] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:07:15.843335 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:15.908960 16205 raft_consensus.cc:3060] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:15.844064 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:15.844434 20520 leader_election.cc:290] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:15.845160 16199 raft_consensus.cc:1275] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:07:15.801297 20548 raft_consensus.cc:2804] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:15.846129 16352 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41830 (request call id 2202) took 1111 ms. Trace:
I20260709 13:07:15.846324 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:15.832808 16283 raft_consensus.cc:2468] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 11.
I20260709 13:07:15.847404 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
W20260709 13:07:15.919312 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 129089us
I20260709 13:07:15.806488 20517 raft_consensus.cc:2804] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:07:15.854662 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 92926.2us
I20260709 13:07:15.924343 16248 leader_election.cc:304] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:15.855126 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:15.876708 20494 leader_election.cc:290] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:15.880013 20594 leader_election.cc:290] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:15.832610 20510 raft_consensus.cc:2749] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107) with higher term. Message: Invalid argument: T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 12. Current term is 13.
I20260709 13:07:15.897364 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:15.930497 16943 raft_consensus.cc:2468] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 9.
I20260709 13:07:15.900233 16357 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41830 (request call id 2203) took 1164 ms. Trace:
I20260709 13:07:15.911469 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:15.931893 16944 raft_consensus.cc:2468] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 6.
I20260709 13:07:15.845642 20302 raft_consensus.cc:493] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:15.914477 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:15.932356 16173 leader_election.cc:304] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:15.832118 20460 raft_consensus.cc:493] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:15.915352 16946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:07:15.806658 20522 raft_consensus.cc:515] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:15.898448 20262 leader_election.cc:290] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:15.918879 16352 rpcz_store.cc:276] 0709 13:07:14.735014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.909265 (+174251us) service_pool.cc:224] Handling call
0709 13:07:14.909749 (+   484us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:14.921963 (+ 12214us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:14.921997 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:14.937923 (+ 15926us) log.cc:844] Serialized 52 byte log entry
0709 13:07:15.509487 (+571564us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:07:15.513769 (+  4282us) log.cc:844] Serialized 14 byte log entry
0709 13:07:15.514709 (+   940us) log.cc:844] Serialized 14 byte log entry
0709 13:07:15.514941 (+   232us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:15.515048 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:15.845905 (+330857us) raft_consensus.cc:1685] finished
0709 13:07:15.845925 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:15.846077 (+   152us) inbound_call.cc:177] Queueing success response
0709 13:07:15.897882 (+ 51805us) spinlock_profiling.cc:243] Waited 17.8 ms on lock 0x7b4800032358. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f36243b2aa1 00007f36243a9b37 00007f36243a99ca 00007f36244a126f 00007f36244a0f37 00007f36244b555c 00007f36244b5508 00007f36244b5488 00007f36244b5443 00007f36244b46ec 00007f36233dea96
Metrics: {"prepare.queue_time_us":5550,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":56,"raft.queue_time_us":7554,"raft.run_cpu_time_us":1759,"raft.run_wall_time_us":390457,"spinlock_wait_cycles":81520256,"thread_start_us":393908,"threads_started":1,"wal-append.queue_time_us":870591}
I20260709 13:07:15.910296 16200 raft_consensus.cc:2468] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 11.
I20260709 13:07:15.931609 16357 rpcz_store.cc:276] 0709 13:07:14.735352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:15.292400 (+557048us) service_pool.cc:224] Handling call
0709 13:07:15.292863 (+   463us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:15.309244 (+ 16381us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:15.309283 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:15.311229 (+  1946us) log.cc:844] Serialized 26 byte log entry
0709 13:07:15.658707 (+347478us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:15.676689 (+ 17982us) log.cc:844] Serialized 14 byte log entry
0709 13:07:15.676928 (+   239us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:15.677003 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:15.877498 (+200495us) spinlock_profiling.cc:243] Waited 1.42 ms on lock 0x7b1800452da0. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f3625264de1 00007f36252715b1 00007f361c39c3f3 00007f361c39e7c1 00007f361c39e779 00007f361c39e709 00007f361c39e6d1 00007f361c39d9cd 000000000038f354 000000000038f199 00007f361c37f83a
0709 13:07:15.884611 (+  7113us) spinlock_profiling.cc:243] Waited 3.9 ms on lock 0x7b1800452da0. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f3625264de1 00007f36252715b1 00007f361c39c3f3 00007f361c39e7c1 00007f361c39e779 00007f361c39e709 00007f361c39e6d1 00007f361c39d9cd 000000000038f354 000000000038f199 00007f361c37f83a
0709 13:07:15.899899 (+ 15288us) raft_consensus.cc:1685] finished
0709 13:07:15.899931 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:15.900155 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8761,"prepare.queue_time_us":18248,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":4073,"raft.queue_time_us":30394,"raft.run_cpu_time_us":297,"raft.run_wall_time_us":6857,"spinlock_wait_cycles":42643456,"thread_start_us":252119,"threads_started":1,"wal-append.queue_time_us":386167}
I20260709 13:07:15.935622 16320 leader_election.cc:304] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:15.896620 20605 raft_consensus.cc:493] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.894842 19940 leader_election.cc:290] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:15.831530 20511 raft_consensus.cc:515] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:15.923234 20548 raft_consensus.cc:493] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:15.889760 20563 leader_election.cc:290] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:15.923547 20514 raft_consensus.cc:697] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:07:15.944090 16320 leader_election.cc:304] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:15.969101 16320 leader_election.cc:304] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:15.969535 16202 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39674 (request call id 889) took 1152 ms. Trace:
I20260709 13:07:15.942660 16940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:15.921507 16322 leader_election.cc:304] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:07:15.970361 16940 raft_consensus.cc:2468] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 10.
I20260709 13:07:15.947234 16205 raft_consensus.cc:2468] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 13.
I20260709 13:07:15.969915 16202 rpcz_store.cc:276] 0709 13:07:14.816812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:14.853564 (+ 36752us) service_pool.cc:224] Handling call
0709 13:07:14.854763 (+  1199us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:15.483695 (+628932us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:15.969299 (+485604us) spinlock_profiling.cc:243] Waited 623 ms on lock 0x7b54003d0754. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f489e01 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6
0709 13:07:15.969475 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1433688960}
I20260709 13:07:15.935865 20302 raft_consensus.cc:3060] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:15.903676 20437 raft_consensus.cc:515] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:15.939177 16946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:15.935477 20460 raft_consensus.cc:3060] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:07:15.970680 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 49230.2us
I20260709 13:07:15.956058 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:15.973852 16200 raft_consensus.cc:2368] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 12. Current term is 13.
I20260709 13:07:15.958014 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:15.976454 16914 leader_election.cc:304] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:07:15.916813 20479 raft_consensus.cc:493] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.965161 16281 raft_consensus.cc:2468] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 13.
I20260709 13:07:15.936455 20538 raft_consensus.cc:3060] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:15.942030 20594 raft_consensus.cc:2749] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:15.854468 20489 raft_consensus.cc:515] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:15.935088 20534 raft_consensus.cc:493] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.927206 20517 raft_consensus.cc:493] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:15.978742 16173 leader_election.cc:304] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:15.980787 16199 raft_consensus.cc:2393] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 7: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:07:15.936282 20599 raft_consensus.cc:493] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:15.981684 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:15.983971 16320 leader_election.cc:304] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:15.972054 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:15.999634 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:16.000420 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f022e2e63ae4461d834e476ff2666991" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:15.959424 20548 raft_consensus.cc:3060] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:15.955499 20533 raft_consensus.cc:2749] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:16.003393 20539 consensus_queue.cc:1048] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 13:07:15.975554 19940 raft_consensus.cc:2749] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:07:15.981812 20505 consensus_meta.cc:287] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63: Time spent flushing consensus metadata: real 1.017s	user 0.009s	sys 0.006s
I20260709 13:07:15.980520 20262 raft_consensus.cc:2804] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:07:16.006209 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 54994.6us
I20260709 13:07:16.038138 16248 leader_election.cc:400] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875) with higher term. Message: Invalid argument: T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 13. Current term is 14.
I20260709 13:07:16.038671 16248 leader_election.cc:403] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:16.012997 16200 raft_consensus.cc:2468] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 11.
I20260709 13:07:16.025894 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:16.039803 16283 raft_consensus.cc:3060] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:07:16.040294 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:15.955633 20605 raft_consensus.cc:515] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:15.981930 20532 raft_consensus.cc:2764] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
W20260709 13:07:16.030138 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 51491.6us
I20260709 13:07:16.002297 20479 raft_consensus.cc:515] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:16.088546 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:16.050874 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:16.094667 16173 leader_election.cc:304] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:07:16.078444 16912 leader_election.cc:304] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:16.095439 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:16.085870 16940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:16.096393 16276 raft_consensus.cc:2393] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 in current term 11: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:07:16.073542 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:16.034899 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:16.002617 20399 raft_consensus.cc:2804] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:16.003386 20607 raft_consensus.cc:493] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.004508 20241 raft_consensus.cc:2749] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:07:16.010628 20508 consensus_meta.cc:287] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3: Time spent flushing consensus metadata: real 0.610s	user 0.006s	sys 0.007s
I20260709 13:07:16.015600 16203 raft_consensus.cc:2393] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 10: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:07:15.958781 20602 consensus_queue.cc:1059] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.076s
I20260709 13:07:16.044715 16322 leader_election.cc:304] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:07:16.097889 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:16.105177 16282 raft_consensus.cc:2468] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 14.
W20260709 13:07:16.105293 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 121415us
I20260709 13:07:16.084448 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:16.099761 16246 leader_election.cc:400] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Vote denied by peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073) with higher term. Message: Invalid argument: T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 12. Current term is 13.
I20260709 13:07:16.041937 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:16.116055 20513 raft_consensus.cc:493] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:16.157171 16199 raft_consensus.cc:2468] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 5.
I20260709 13:07:16.159014 20442 consensus_queue.cc:1048] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:16.134300 20403 raft_consensus.cc:2804] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:16.109277 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:16.107630 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:16.036702 20563 raft_consensus.cc:2804] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:07:16.162294 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 117703us
I20260709 13:07:16.164096 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:07:16.161425 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 61869.2us
I20260709 13:07:16.064628 20522 leader_election.cc:290] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:16.167095 16276 raft_consensus.cc:2410] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for term 11 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:07:16.121249 16173 leader_election.cc:304] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:07:16.163177 16322 leader_election.cc:304] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:07:16.114172 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:16.036243 20262 raft_consensus.cc:493] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:16.012844 20510 consensus_queue.cc:1059] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.103s
I20260709 13:07:16.101493 20399 raft_consensus.cc:493] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:16.170914 16283 raft_consensus.cc:2468] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 14.
I20260709 13:07:16.161489 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:16.015024 20517 raft_consensus.cc:3060] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:16.180613 20380 raft_consensus.cc:2804] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:16.188275 20380 raft_consensus.cc:493] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:16.024287 20534 raft_consensus.cc:515] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:07:16.188763 20380 raft_consensus.cc:3060] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:16.063419 20591 leader_election.cc:290] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:16.190755 20534 leader_election.cc:290] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:16.083626 20511 leader_election.cc:290] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:16.065160 20437 leader_election.cc:290] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:16.154184 20523 raft_consensus.cc:3055] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:16.192387 20523 raft_consensus.cc:740] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:07:16.193423 20523 consensus_queue.cc:260] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:16.194501 20510 raft_consensus.cc:3055] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:16.116400 20607 raft_consensus.cc:515] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:16.195950 16201 raft_consensus.cc:2393] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 14: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:07:16.197523 16201 raft_consensus.cc:1240] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:16.134619 20453 raft_consensus.cc:493] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.081936 20514 consensus_queue.cc:237] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:16.211001 20453 raft_consensus.cc:515] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:16.041585 20505 raft_consensus.cc:515] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:16.215226 20505 leader_election.cc:290] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 14 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:16.121547 20508 raft_consensus.cc:515] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:16.221326 20508 leader_election.cc:290] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:16.168505 16322 leader_election.cc:304] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:07:16.078783 20535 consensus_queue.cc:1059] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.109s
I20260709 13:07:16.042325 20612 consensus_queue.cc:1048] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.154s
I20260709 13:07:16.134286 20440 raft_consensus.cc:493] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:16.195120 20510 raft_consensus.cc:740] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:07:16.179765 20536 raft_consensus.cc:2749] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:16.115701 19940 raft_consensus.cc:2749] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:16.205945 16283 raft_consensus.cc:1240] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:16.203518 20539 raft_consensus.cc:493] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:16.180727 20262 raft_consensus.cc:3060] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:16.209035 20527 raft_consensus.cc:2804] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:16.270843 20527 raft_consensus.cc:493] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:16.271392 20527 raft_consensus.cc:3060] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:16.166800 20563 raft_consensus.cc:493] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:16.274895 20563 raft_consensus.cc:3060] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:16.083034 20438 raft_consensus.cc:493] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:16.279011 20438 raft_consensus.cc:3060] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:16.167502 16246 leader_election.cc:304] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:16.244971 20558 raft_consensus.cc:493] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:16.283444 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 116023us
I20260709 13:07:16.283191 20558 raft_consensus.cc:515] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:16.284610 16246 leader_election.cc:304] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:16.285602 20508 raft_consensus.cc:2749] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:16.158408 20609 raft_consensus.cc:493] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.286862 20609 raft_consensus.cc:515] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:16.286458 20508 raft_consensus.cc:2749] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:16.289686 20609 leader_election.cc:290] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:07:16.290009 20615 log.cc:927] Time spent T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.282s	user 0.003s	sys 0.000s
I20260709 13:07:16.186496 20390 raft_consensus.cc:2804] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:16.157976 20513 raft_consensus.cc:515] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:16.197443 20607 leader_election.cc:290] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:16.176849 20403 raft_consensus.cc:493] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:16.387993 20403 raft_consensus.cc:3060] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:16.291474 20453 leader_election.cc:290] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:16.115906 20588 raft_consensus.cc:493] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:16.264829 20612 raft_consensus.cc:2804] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:16.292356 20479 leader_election.cc:290] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:16.292963 20539 raft_consensus.cc:515] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:16.024839 20599 raft_consensus.cc:515] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:16.295073 16206 raft_consensus.cc:2468] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 12.
I20260709 13:07:16.191416 20534 raft_consensus.cc:2804] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:16.223321 20399 raft_consensus.cc:3060] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:16.186030 20592 raft_consensus.cc:2749] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875) with higher term. Message: Invalid argument: T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 13. Current term is 14.
I20260709 13:07:16.240351 16205 raft_consensus.cc:2468] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 8.
I20260709 13:07:16.368672 20562 raft_consensus.cc:3055] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:07:16.371073 20581 log.cc:927] Time spent T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63: Append to log took a long time: real 0.929s	user 0.008s	sys 0.000s
I20260709 13:07:16.359885 20380 raft_consensus.cc:515] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:16.321762 20523 raft_consensus.cc:3060] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:16.243469 20440 raft_consensus.cc:515] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:16.386466 20510 consensus_queue.cc:260] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:16.345393 20390 raft_consensus.cc:493] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:16.377892 20528 consensus_meta.cc:287] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 0.890s	user 0.005s	sys 0.011s
I20260709 13:07:16.395881 16320 leader_election.cc:304] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:07:16.456413 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 60646us
I20260709 13:07:16.457666 16320 leader_election.cc:304] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:16.281879 20548 raft_consensus.cc:515] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:07:16.185039 20602 consensus_queue.cc:1048] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.161s
I20260709 13:07:16.307008 20489 leader_election.cc:290] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:16.417039 20152 raft_consensus.cc:493] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
W20260709 13:07:16.423803 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 302682us
I20260709 13:07:16.392859 20558 leader_election.cc:290] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:16.405632 20612 raft_consensus.cc:493] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:16.452427 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 295747us
I20260709 13:07:16.407848 20588 raft_consensus.cc:515] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:16.415815 20517 raft_consensus.cc:515] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:07:16.468441 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 299993us
I20260709 13:07:16.447628 20589 raft_consensus.cc:3055] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:16.435232 20271 raft_consensus.cc:493] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:16.436910 20562 raft_consensus.cc:740] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:07:16.477327 16320 leader_election.cc:304] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:16.379215 20302 raft_consensus.cc:515] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:07:16.455893 20390 raft_consensus.cc:3060] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:16.422933 20534 raft_consensus.cc:493] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
W20260709 13:07:16.484563 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 213988us
I20260709 13:07:16.482726 20612 raft_consensus.cc:3060] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:16.408070 20241 consensus_queue.cc:1048] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 13:07:16.485780 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:16.485981 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:16.487936 16354 raft_consensus.cc:1275] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:07:16.488761 16940 raft_consensus.cc:1240] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:16.489418 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:16.475447 20420 raft_consensus.cc:2749] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:16.475800 20521 raft_consensus.cc:2749] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:07:16.491643 16351 raft_consensus.cc:1240] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:07:16.493538 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:16.496778 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:16.497248 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:16.519117 16355 raft_consensus.cc:2468] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 13.
I20260709 13:07:16.501173 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:16.484320 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:16.490407 20510 raft_consensus.cc:3060] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:16.462567 20528 raft_consensus.cc:515] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:16.500881 20513 leader_election.cc:290] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:16.505057 16248 leader_election.cc:304] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:16.513643 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:16.514372 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:16.531862 16352 raft_consensus.cc:2468] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 9.
I20260709 13:07:16.492558 20589 raft_consensus.cc:740] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:07:16.535108 16348 raft_consensus.cc:1240] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:07:16.523842 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c15d8e9be8414c84912ab77b66bfb1" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:16.518956 16356 raft_consensus.cc:2468] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 8.
I20260709 13:07:16.503970 20618 raft_consensus.cc:2804] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:16.520318 16353 raft_consensus.cc:2468] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 4.
I20260709 13:07:16.487320 20489 consensus_queue.cc:1048] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:07:16.527940 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:16.481246 20152 raft_consensus.cc:515] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:16.503729 20534 raft_consensus.cc:3060] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:16.517091 16278 raft_consensus.cc:2368] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for earlier term 10. Current term is 11.
I20260709 13:07:16.520068 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:16.545274 16349 raft_consensus.cc:1240] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 13:07:16.536641 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:16.498008 20271 raft_consensus.cc:515] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:16.546965 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:16.539355 16350 raft_consensus.cc:2468] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 7.
I20260709 13:07:16.482589 20533 consensus_queue.cc:1048] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 13:07:16.555114 20380 leader_election.cc:290] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:16.556208 20152 leader_election.cc:290] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:16.559568 16353 raft_consensus.cc:1240] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:07:16.561527 20438 raft_consensus.cc:515] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:16.537279 20479 raft_consensus.cc:493] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.570843 16914 leader_election.cc:304] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:16.572547 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:16.573271 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:16.534596 20420 raft_consensus.cc:493] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:16.580192 16207 raft_consensus.cc:2393] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 10: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:07:16.581809 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:16.588693 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:16.537781 20621 raft_consensus.cc:2749] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:16.550427 20618 raft_consensus.cc:697] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 13 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:16.595122 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:16.596385 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:16.600229 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c15d8e9be8414c84912ab77b66bfb1" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:16.602699 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:16.604710 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:16.606387 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:16.607482 16207 raft_consensus.cc:2410] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:07:16.608382 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:16.608635 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:16.609445 16281 raft_consensus.cc:2393] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 8: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:07:16.609829 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:16.610687 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:16.611642 16281 raft_consensus.cc:2393] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 7: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:07:16.610277 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:16.610775 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:16.612408 16277 raft_consensus.cc:1240] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:16.612919 16283 raft_consensus.cc:2468] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 11.
I20260709 13:07:16.613802 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:16.614250 16283 raft_consensus.cc:2468] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 8.
I20260709 13:07:16.613915 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:16.609758 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:16.614972 16277 raft_consensus.cc:2468] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 15.
I20260709 13:07:16.587450 20535 raft_consensus.cc:2749] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:16.615635 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:16.624362 16275 raft_consensus.cc:2468] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 9.
I20260709 13:07:16.616252 16279 raft_consensus.cc:2393] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 9: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:07:16.616997 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:16.614987 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:16.617805 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:16.620177 16281 raft_consensus.cc:1240] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:16.633349 16283 raft_consensus.cc:1275] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:07:16.616736 20626 log.cc:927] Time spent T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:07:16.653175 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
W20260709 13:07:16.631742 20627 log.cc:927] Time spent T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 13:07:16.655922 20588 leader_election.cc:290] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:16.537528 20562 consensus_queue.cc:260] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:16.680971 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:16.681730 16356 raft_consensus.cc:2468] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 8.
I20260709 13:07:16.681948 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:16.683553 16949 raft_consensus.cc:1275] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:07:16.687346 16940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:07:16.688275 16946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:16.689097 16946 raft_consensus.cc:2393] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 14: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
I20260709 13:07:16.652829 20517 leader_election.cc:290] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 12 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:16.689306 20399 raft_consensus.cc:515] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:16.603229 20507 consensus_queue.cc:1059] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.062s
I20260709 13:07:16.693193 16940 raft_consensus.cc:2393] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 8: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
I20260709 13:07:16.662714 20605 leader_election.cc:290] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:16.694840 20618 consensus_queue.cc:237] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:07:16.696988 20460 consensus_meta.cc:287] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f: Time spent flushing consensus metadata: real 0.690s	user 0.009s	sys 0.006s
I20260709 13:07:16.660486 20548 leader_election.cc:290] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:16.587523 20597 raft_consensus.cc:493] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:16.697813 20460 raft_consensus.cc:515] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:16.660441 16353 raft_consensus.cc:1275] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:07:16.604287 20539 leader_election.cc:290] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:16.587680 20479 raft_consensus.cc:515] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:16.616427 20438 leader_election.cc:290] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 9 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:16.592778 20420 raft_consensus.cc:515] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:16.588616 20262 raft_consensus.cc:515] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:16.655977 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:16.664925 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:16.734583 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
W20260709 13:07:16.665638 16246 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.180.65:46073 timed out after 1.605s (SENT) [suppressed 27 similar messages]
I20260709 13:07:16.662815 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
W20260709 13:07:16.660826 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 89022.1us
I20260709 13:07:16.667320 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:16.736642 16351 raft_consensus.cc:3060] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:16.669692 20625 log.cc:927] Time spent T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:07:16.740343 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:16.618023 20271 leader_election.cc:290] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:16.659359 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:16.721868 16322 leader_election.cc:304] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:07:16.668190 20607 raft_consensus.cc:493] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.753893 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:16.736769 16279 raft_consensus.cc:2376] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 14. Re-sending same reply.
I20260709 13:07:16.755271 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:16.756955 16352 raft_consensus.cc:1240] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:16.757378 16353 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a"
dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
mode: GRACEFUL
new_leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
 from {username='slave'} at 127.0.0.1:56792
I20260709 13:07:16.758004 16353 raft_consensus.cc:606] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Received request to transfer leadership to TS 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:07:16.758369 16353 raft_consensus.cc:614] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:16.758582 16281 raft_consensus.cc:1275] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:07:16.759474 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:16.760697 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:16.761287 16356 raft_consensus.cc:3060] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:16.761600 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:16.762136 16281 raft_consensus.cc:3060] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:16.719129 20597 raft_consensus.cc:515] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:16.764362 20597 leader_election.cc:290] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:16.765311 16351 raft_consensus.cc:2468] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 10.
I20260709 13:07:16.765775 20479 leader_election.cc:290] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:16.767120 20399 leader_election.cc:290] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 8 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:16.767000 20403 raft_consensus.cc:515] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:16.769356 20403 leader_election.cc:290] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 11 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:16.742198 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:16.666740 20563 raft_consensus.cc:515] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:16.738037 16173 leader_election.cc:304] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:16.746771 16276 raft_consensus.cc:2468] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 13.
I20260709 13:07:16.748557 16201 raft_consensus.cc:1240] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:16.749074 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:16.779655 16173 leader_election.cc:304] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:16.772356 16277 raft_consensus.cc:2468] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 9.
I20260709 13:07:16.773305 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:16.755299 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c15d8e9be8414c84912ab77b66bfb1" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:16.782639 16351 raft_consensus.cc:3060] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:16.774695 16354 raft_consensus.cc:1240] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:16.777097 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:16.791424 16353 raft_consensus.cc:2393] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 11: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:07:16.739077 20548 raft_consensus.cc:493] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.800290 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:16.805889 16173 leader_election.cc:304] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:07:16.799803 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:16.812218 16283 raft_consensus.cc:2468] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 10.
I20260709 13:07:16.813824 16356 raft_consensus.cc:2468] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 16.
I20260709 13:07:16.815907 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c15d8e9be8414c84912ab77b66bfb1" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:16.817165 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:16.817814 16356 raft_consensus.cc:2468] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 9.
I20260709 13:07:16.807475 16354 raft_consensus.cc:2468] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 9.
I20260709 13:07:16.831162 16281 raft_consensus.cc:2468] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 12.
I20260709 13:07:16.820747 16173 leader_election.cc:304] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:16.832854 16351 raft_consensus.cc:2468] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 10.
I20260709 13:07:16.836908 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:16.794128 20597 raft_consensus.cc:2804] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:16.829859 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:16.875816 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:16.880599 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:16.881945 16351 raft_consensus.cc:2468] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 7.
I20260709 13:07:16.882689 16356 raft_consensus.cc:2410] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:07:16.887559 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:16.891618 16248 leader_election.cc:304] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:16.788861 20527 raft_consensus.cc:515] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:16.772850 20607 raft_consensus.cc:515] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:16.919130 16248 leader_election.cc:304] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
W20260709 13:07:16.897604 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 76914.7us
I20260709 13:07:16.888572 16353 raft_consensus.cc:2468] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 10.
I20260709 13:07:16.903527 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:16.922724 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:16.923597 16353 raft_consensus.cc:3060] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:16.923955 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:16.911247 16280 raft_consensus.cc:1275] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:07:16.898375 20453 raft_consensus.cc:2749] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:07:16.838657 20514 raft_consensus.cc:2749] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:16.931355 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:16.881524 20597 raft_consensus.cc:493] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:16.933876 16283 raft_consensus.cc:2393] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 14: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
I20260709 13:07:16.922204 16173 leader_election.cc:304] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:16.819759 20548 raft_consensus.cc:515] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:16.818897 20633 raft_consensus.cc:2804] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:16.837661 20624 consensus_queue.cc:1048] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.096s
W20260709 13:07:16.943867 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 278231us
I20260709 13:07:16.956648 16322 leader_election.cc:304] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:07:16.943195 16356 raft_consensus.cc:2393] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 in current term 9: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:07:16.962970 16353 raft_consensus.cc:2468] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 14.
I20260709 13:07:16.958781 16207 raft_consensus.cc:1240] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:16.939435 16102 catalog_manager.cc:5697] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "1109f76a0b7b443a84c0327c8707bc63" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:16.899240 20479 raft_consensus.cc:2749] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:16.976490 16246 leader_election.cc:304] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:16.939878 20510 raft_consensus.cc:2749] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:16.955878 16173 leader_election.cc:304] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:16.938297 16248 leader_election.cc:304] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:07:16.968502 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:16.983065 16204 raft_consensus.cc:1275] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 13:07:16.984974 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 46804.2us
I20260709 13:07:16.986279 16353 raft_consensus.cc:2393] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 in current term 8: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:07:16.985946 16248 leader_election.cc:304] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:07:16.945375 20597 raft_consensus.cc:3060] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:16.996569 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:16.990312 16246 leader_election.cc:304] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:16.985867 16322 leader_election.cc:304] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:07:16.997335 16356 raft_consensus.cc:2468] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 13.
I20260709 13:07:16.952515 20594 consensus_queue.cc:1059] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 13:07:16.944372 20539 raft_consensus.cc:493] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:16.963442 20565 raft_consensus.cc:2804] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:16.976042 20262 leader_election.cc:290] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:16.961100 20622 raft_consensus.cc:2749] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:16.978157 20533 raft_consensus.cc:2749] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:16.939162 20523 consensus_queue.cc:1059] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 13:07:17.003826 20009 raft_consensus.cc:2749] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:07:17.008950 20514 raft_consensus.cc:2749] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:17.005738 20511 raft_consensus.cc:2804] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:07:17.046962 20610 log.cc:927] Time spent T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:07:16.965379 20152 consensus_queue.cc:1048] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.080s
I20260709 13:07:17.011701 20521 raft_consensus.cc:2804] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:17.044734 20479 raft_consensus.cc:2804] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:17.055596 20565 raft_consensus.cc:493] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:17.079263 16353 raft_consensus.cc:1240] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:17.047817 20621 raft_consensus.cc:2749] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:17.076591 16278 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45218 (request call id 2163) took 1316 ms. Trace:
I20260709 13:07:17.096352 16278 rpcz_store.cc:276] 0709 13:07:15.762656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:15.771906 (+  9250us) service_pool.cc:224] Handling call
0709 13:07:17.076274 (+1304368us) spinlock_profiling.cc:243] Waited 744 ms on lock 0x7b5400125a54. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:07:17.076481 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1710817152}
I20260709 13:07:17.098788 16320 leader_election.cc:304] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:17.080268 20460 leader_election.cc:290] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 election: Requested vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:17.068106 20510 raft_consensus.cc:3055] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:17.068532 20523 raft_consensus.cc:3055] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:07:17.121140 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 165376us
I20260709 13:07:17.105301 20565 raft_consensus.cc:3060] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:17.082902 20420 leader_election.cc:290] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:17.072746 20527 leader_election.cc:290] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:17.105159 20533 raft_consensus.cc:493] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:17.117892 16320 leader_election.cc:304] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:07:17.066561 20612 consensus_meta.cc:287] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 0.553s	user 0.009s	sys 0.009s
I20260709 13:07:17.097862 20521 raft_consensus.cc:493] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:17.073464 20563 leader_election.cc:290] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:17.097615 20511 raft_consensus.cc:697] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:07:17.058748 20539 raft_consensus.cc:515] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:17.095345 20479 raft_consensus.cc:493] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:17.095343 19940 raft_consensus.cc:493] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:17.114104 20629 raft_consensus.cc:2749] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:17.134091 16320 leader_election.cc:304] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:17.127681 16173 leader_election.cc:304] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:07:17.118923 20510 raft_consensus.cc:740] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:07:17.121483 20523 raft_consensus.cc:740] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
W20260709 13:07:17.182240 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 48246.3us
W20260709 13:07:17.186733 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 196507us
I20260709 13:07:17.137064 20521 raft_consensus.cc:3060] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:17.178426 20479 raft_consensus.cc:3060] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:17.194941 16246 leader_election.cc:304] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:17.187412 20152 raft_consensus.cc:2749] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:07:17.202960 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 217048us
I20260709 13:07:17.137807 20420 consensus_queue.cc:1059] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 13:07:17.136582 20612 raft_consensus.cc:515] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:07:17.199954 20390 consensus_meta.cc:287] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 0.693s	user 0.007s	sys 0.007s
I20260709 13:07:17.185678 19940 raft_consensus.cc:515] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:17.220479 16248 leader_election.cc:304] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:07:17.223281 16246 leader_election.cc:304] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:17.202970 20629 raft_consensus.cc:2749] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:17.245987 20302 leader_election.cc:290] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:07:17.247900 20642 log.cc:927] Time spent T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
I20260709 13:07:17.249109 20589 consensus_queue.cc:260] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:17.199579 20607 leader_election.cc:290] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:17.219393 20591 raft_consensus.cc:2749] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:17.264984 16200 raft_consensus.cc:1240] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 LEADER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:17.243428 20009 raft_consensus.cc:2804] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:07:17.246106 20640 log.cc:927] Time spent T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.134s	user 0.000s	sys 0.001s
I20260709 13:07:17.239812 16248 leader_election.cc:304] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
W20260709 13:07:17.235014 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 107430us
W20260709 13:07:17.252575 16208 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60154 (request call id 2562) took 1455 ms (client timeout 1699 ms). Trace:
W20260709 13:07:17.270759 16208 rpcz_store.cc:269] 0709 13:07:15.797072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:15.799313 (+  2241us) service_pool.cc:224] Handling call
0709 13:07:17.251867 (+1452554us) spinlock_profiling.cc:243] Waited 694 ms on lock 0x7b5400376ed4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:07:17.252255 (+   388us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1596507520}
I20260709 13:07:17.271903 16173 leader_election.cc:304] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
W20260709 13:07:17.273752 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 50699us
I20260709 13:07:17.137355 20533 raft_consensus.cc:515] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:17.227707 20548 leader_election.cc:290] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:17.274628 16246 leader_election.cc:304] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:07:17.251636 20648 log.cc:927] Time spent T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:07:17.250512 20589 raft_consensus.cc:3060] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:17.274051 16248 leader_election.cc:304] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:07:17.235697 19831 raft_consensus.cc:2749] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:07:17.251101 20643 log.cc:927] Time spent T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
I20260709 13:07:17.289695 20591 raft_consensus.cc:2804] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:17.290241 20591 raft_consensus.cc:493] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:17.272925 16173 leader_election.cc:304] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:17.251917 20539 leader_election.cc:290] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:17.268502 20009 raft_consensus.cc:493] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:17.292258 20612 leader_election.cc:290] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:17.281905 20660 raft_consensus.cc:3055] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:07:17.301023 20644 log.cc:927] Time spent T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:07:17.302268 20597 raft_consensus.cc:515] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:07:17.262866 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 264312us
I20260709 13:07:17.300942 20660 raft_consensus.cc:740] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:17.279996 20302 raft_consensus.cc:2749] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:17.257388 20390 raft_consensus.cc:515] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:17.299280 16173 leader_election.cc:304] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:07:17.308264 20009 raft_consensus.cc:3060] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:17.319718 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 131731us
I20260709 13:07:17.313005 16246 leader_election.cc:304] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:17.281574 20556 raft_consensus.cc:2804] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:17.315274 16350 raft_consensus.cc:1275] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:07:17.311779 19831 raft_consensus.cc:2804] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:17.323948 19831 raft_consensus.cc:493] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:17.324370 19831 raft_consensus.cc:3060] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:17.324489 16350 raft_consensus.cc:1275] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:07:17.236276 20523 consensus_queue.cc:260] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:17.326874 20661 raft_consensus.cc:2749] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:17.327234 20523 raft_consensus.cc:3060] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:17.328152 20390 leader_election.cc:290] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 10 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:17.329569 20440 leader_election.cc:290] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:17.314177 16322 leader_election.cc:304] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
W20260709 13:07:17.289722 20619 log.cc:927] Time spent T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.753s	user 0.005s	sys 0.000s
I20260709 13:07:17.295634 20659 raft_consensus.cc:2764] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader election decision vote started in defunct term 10: won
I20260709 13:07:17.297796 20591 raft_consensus.cc:3060] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:17.322100 16173 leader_election.cc:304] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:17.349488 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:17.280212 20624 consensus_queue.cc:1059] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
W20260709 13:07:17.317090 20534 consensus_meta.cc:287] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f: Time spent flushing consensus metadata: real 0.751s	user 0.015s	sys 0.000s
I20260709 13:07:17.241650 20510 consensus_queue.cc:260] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:17.339754 16246 leader_election.cc:304] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:17.264922 20511 consensus_queue.cc:237] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } }
I20260709 13:07:17.341472 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:07:17.342032 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:17.343037 16940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:17.313336 20662 raft_consensus.cc:3060] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:17.355463 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:07:17.345127 20302 raft_consensus.cc:2749] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:17.393258 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:17.334070 20556 raft_consensus.cc:493] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:17.356891 16248 leader_election.cc:304] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:07:17.404618 16275 raft_consensus.cc:3060] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:17.395314 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
W20260709 13:07:17.397071 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 74070.2us
I20260709 13:07:17.405304 16947 raft_consensus.cc:3060] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:17.395314 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:17.398252 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:17.401206 16943 raft_consensus.cc:3060] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:17.407119 16350 raft_consensus.cc:2468] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 4.
I20260709 13:07:17.408202 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:17.409080 16350 raft_consensus.cc:2468] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 8.
I20260709 13:07:17.344727 20617 raft_consensus.cc:2804] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:17.401432 16949 raft_consensus.cc:2393] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 14: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
I20260709 13:07:17.356415 16945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:17.400746 16322 leader_election.cc:304] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:07:17.403918 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:07:17.410324 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:17.411921 16350 raft_consensus.cc:3060] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:17.411979 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 72311.4us
I20260709 13:07:17.413425 16246 leader_election.cc:304] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:07:17.413951 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 57119.5us
I20260709 13:07:17.357443 20661 raft_consensus.cc:2804] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:17.415027 16248 leader_election.cc:304] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:07:17.356833 20437 raft_consensus.cc:493] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.418664 16246 leader_election.cc:304] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:07:17.428584 16913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:17.426721 16322 leader_election.cc:304] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:07:17.342646 20414 consensus_queue.cc:1048] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.062s
I20260709 13:07:17.393139 19831 raft_consensus.cc:515] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:17.431679 16943 raft_consensus.cc:2468] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 7.
I20260709 13:07:17.436167 16947 raft_consensus.cc:2468] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 10.
I20260709 13:07:17.358593 20548 consensus_queue.cc:1059] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.071s
W20260709 13:07:17.439204 16246 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:17.422443 20520 raft_consensus.cc:2749] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:17.417167 20556 raft_consensus.cc:3060] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:17.490499 16351 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece"
dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
mode: GRACEFUL
new_leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
 from {username='slave'} at 127.0.0.1:56792
I20260709 13:07:17.497794 16275 raft_consensus.cc:2468] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 10.
I20260709 13:07:17.395514 20534 raft_consensus.cc:515] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:17.431227 20621 raft_consensus.cc:2804] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:17.448403 16357 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33486 (request call id 616) took 1433 ms. Trace:
W20260709 13:07:17.463828 16913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:17.448596 20302 raft_consensus.cc:2749] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:17.452569 19940 leader_election.cc:290] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:17.517321 19940 raft_consensus.cc:493] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.517836 19940 raft_consensus.cc:515] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:17.486014 20440 raft_consensus.cc:493] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.518885 20440 raft_consensus.cc:515] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:17.521102 20440 leader_election.cc:290] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:17.521726 16914 leader_election.cc:304] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:17.437083 20437 raft_consensus.cc:515] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:17.523142 19940 leader_election.cc:290] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:17.524933 20437 leader_election.cc:290] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:17.489074 20592 raft_consensus.cc:493] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:17.428180 20489 raft_consensus.cc:493] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:17.429590 20390 raft_consensus.cc:2749] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:07:17.488044 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 131618us
I20260709 13:07:17.422736 20661 raft_consensus.cc:493] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:17.512073 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:17.512225 16203 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39674 (request call id 903) took 1023 ms. Trace:
I20260709 13:07:17.512676 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:17.533373 16279 raft_consensus.cc:2368] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for earlier term 10. Current term is 11.
I20260709 13:07:17.513314 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:17.427742 20658 raft_consensus.cc:493] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.430335 20617 raft_consensus.cc:697] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 12 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:17.514879 16357 rpcz_store.cc:276] 0709 13:07:16.014646 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.014790 (+   144us) service_pool.cc:224] Handling call
0709 13:07:16.015170 (+   380us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:16.015434 (+   264us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:16.015474 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:16.022457 (+  6983us) log.cc:844] Serialized 26 byte log entry
0709 13:07:16.405401 (+382944us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:16.405463 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:16.405576 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:17.269251 (+863675us) spinlock_profiling.cc:243] Waited 3.6 ms on lock 0x7b4400022b4c. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361c224db1 00007f361c2c2c85 00007f361c2c36a2 00007f361f0351db 00007f361f030aaf 00007f361f02486e 00007f361f023bb6 00007f361f0237d8 00007f361f02d221 00007f361f02d1d9 00007f361f02d169
0709 13:07:17.435477 (+166226us) raft_consensus.cc:1685] finished
0709 13:07:17.435499 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:17.448315 (+ 12816us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8279424,"thread_start_us":377744,"threads_started":1,"wal-append.queue_time_us":471855}
I20260709 13:07:17.490013 20612 raft_consensus.cc:2749] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:07:17.422873 20657 raft_consensus.cc:2749] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:17.359661 20660 consensus_queue.cc:260] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:17.532426 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:17.533114 16203 rpcz_store.cc:276] 0709 13:07:16.488585 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.632476 (+143891us) service_pool.cc:224] Handling call
0709 13:07:16.653761 (+ 21285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:16.763339 (+109578us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:16.763371 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:16.763411 (+    40us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:16.763444 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:17.511970 (+748526us) spinlock_profiling.cc:243] Waited 109 ms on lock 0x7b54003d2a54. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f489e01 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6
0709 13:07:17.512019 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:17.512164 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":251529088}
I20260709 13:07:17.514775 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:17.546727 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:17.510409 16350 raft_consensus.cc:2468] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 11.
I20260709 13:07:17.422961 20659 raft_consensus.cc:2804] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:17.537431 16914 leader_election.cc:304] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:07:17.539075 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:17.507455 20624 raft_consensus.cc:3055] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:07:17.526125 20592 raft_consensus.cc:515] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:07:17.559906 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 133241us
I20260709 13:07:17.560907 16173 leader_election.cc:304] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:17.564957 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:17.586598 16173 leader_election.cc:304] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:17.514717 20621 raft_consensus.cc:493] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:17.536049 20355 raft_consensus.cc:2804] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:17.588308 16274 raft_consensus.cc:2393] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 in current term 11: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:07:17.536034 20661 raft_consensus.cc:3060] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:17.588435 16173 leader_election.cc:304] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:07:17.549392 20622 raft_consensus.cc:493] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:17.537518 20587 consensus_queue.cc:1048] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:07:17.590894 16248 leader_election.cc:304] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:07:17.595506 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:17.593175 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:17.602487 16947 raft_consensus.cc:2393] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 9: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
I20260709 13:07:17.601578 16248 leader_election.cc:304] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:07:17.521759 20565 raft_consensus.cc:515] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:07:17.593803 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:17.604471 16173 leader_election.cc:304] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:07:17.604853 16275 raft_consensus.cc:2468] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 9.
I20260709 13:07:17.566939 20659 raft_consensus.cc:493] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:17.568892 20597 leader_election.cc:290] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:17.609658 16274 raft_consensus.cc:1275] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:07:17.566294 20624 raft_consensus.cc:740] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:07:17.613682 20602 raft_consensus.cc:2804] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:17.614662 20513 raft_consensus.cc:2804] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:17.617745 16280 raft_consensus.cc:1275] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 13:07:17.645277 16280 pending_rounds.cc:85] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3: Aborting all ops after (but not including) 6
I20260709 13:07:17.645644 16280 pending_rounds.cc:107] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:07:17.646006 16280 raft_consensus.cc:2889] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:17.619537 20617 consensus_queue.cc:237] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:17.646917 16200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60138 (request call id 2363) took 1749 ms. Trace:
I20260709 13:07:17.647363 16200 rpcz_store.cc:276] 0709 13:07:15.897709 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.176203 (+278494us) service_pool.cc:224] Handling call
0709 13:07:17.255042 (+1078839us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:17.266193 (+ 11151us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:17.646662 (+380469us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b5400376ed0. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f4888ad 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:07:17.646852 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2480002304}
I20260709 13:07:17.619086 20534 leader_election.cc:290] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 election: Requested vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:17.538448 20658 raft_consensus.cc:515] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:17.652213 20658 leader_election.cc:290] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:17.621127 20355 raft_consensus.cc:697] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 14 LEADER]: Becoming Leader. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:07:17.653439 16276 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45218 (request call id 2179) took 1044 ms. Trace:
I20260709 13:07:17.654083 16276 rpcz_store.cc:276] 0709 13:07:16.608568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.610057 (+  1489us) service_pool.cc:224] Handling call
0709 13:07:17.653225 (+1043168us) spinlock_profiling.cc:243] Waited 134 ms on lock 0x7b54003ec6d4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:07:17.653365 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":308243712}
I20260709 13:07:17.653788 20355 consensus_queue.cc:237] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:17.655673 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:17.660331 16276 raft_consensus.cc:2410] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:07:17.660586 20563 raft_consensus.cc:3055] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:17.661152 20563 raft_consensus.cc:740] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:07:17.664446 16203 raft_consensus.cc:1240] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 15. Current term is 16. Ops: [15.8-15.8]
W20260709 13:07:17.664912 20645 log.cc:927] Time spent T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.434s	user 0.001s	sys 0.000s
I20260709 13:07:17.591792 20654 raft_consensus.cc:2749] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:17.538760 20009 raft_consensus.cc:515] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:17.564330 20514 consensus_queue.cc:1048] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.057s
W20260709 13:07:17.565665 20603 consensus_queue.cc:1175] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "0aea40d6e4374085a2e38a70a71f63e3" responder_term: 8 status { last_received { term: 8 index: 6 } last_committed_idx: 6 last_received_current_leader { term: 8 index: 6 } }
I20260709 13:07:17.666564 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:17.671595 20510 raft_consensus.cc:3060] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:17.672828 20603 raft_consensus.cc:493] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:17.672971 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:17.673508 20603 raft_consensus.cc:515] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:17.676012 20654 raft_consensus.cc:493] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.662267 20563 consensus_queue.cc:260] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:17.677227 16201 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39674 (request call id 901) took 1556 ms. Trace:
I20260709 13:07:17.677626 16201 rpcz_store.cc:276] 0709 13:07:16.121178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.209976 (+ 88798us) service_pool.cc:224] Handling call
0709 13:07:16.223771 (+ 13795us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:16.779505 (+555734us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:17.676951 (+897446us) spinlock_profiling.cc:243] Waited 525 ms on lock 0x7b54000b54d4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f489e01 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6
0709 13:07:17.677163 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1206418304}
I20260709 13:07:17.679901 16203 raft_consensus.cc:1240] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:17.681633 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:07:17.676056 16205 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60138 (request call id 2367) took 1732 ms (client timeout 1605 ms). Trace:
I20260709 13:07:17.683820 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
W20260709 13:07:17.626724 20674 log.cc:927] Time spent T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 13:07:17.631444 20657 raft_consensus.cc:2804] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:17.591440 20548 raft_consensus.cc:2804] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:17.605132 20437 raft_consensus.cc:2804] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:17.700876 16202 raft_consensus.cc:1275] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:07:17.539572 20489 raft_consensus.cc:515] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:17.635618 16173 leader_election.cc:304] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:07:17.701077 16102 catalog_manager.cc:5697] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: term changed from 11 to 12, leader changed from 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) to 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68). New cstate: current_term: 12 leader_uuid: "1109f76a0b7b443a84c0327c8707bc63" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:07:17.702258 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 66746.9us
I20260709 13:07:17.640102 20436 raft_consensus.cc:2804] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:17.589201 20660 raft_consensus.cc:3060] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:17.606487 16275 raft_consensus.cc:1240] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:17.642563 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:07:17.611948 20666 log.cc:927] Time spent T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:07:17.645467 20633 raft_consensus.cc:493] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:17.652297 16349 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41832 (request call id 2103) took 1155 ms. Trace:
I20260709 13:07:17.667824 20602 raft_consensus.cc:493] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:17.673921 16208 raft_consensus.cc:3060] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:17.603418 20622 raft_consensus.cc:515] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:17.612987 20565 leader_election.cc:290] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:17.625349 16941 raft_consensus.cc:1275] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63 [term 9 LEARNER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:07:17.622846 20592 leader_election.cc:290] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:17.676594 20654 raft_consensus.cc:515] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:07:17.636714 20652 log.cc:927] Time spent T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.320s	user 0.000s	sys 0.001s
I20260709 13:07:17.565934 20623 consensus_queue.cc:1059] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.072s
W20260709 13:07:17.683712 16205 rpcz_store.cc:269] 0709 13:07:15.943737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:15.971709 (+ 27972us) service_pool.cc:224] Handling call
0709 13:07:17.675861 (+1704152us) spinlock_profiling.cc:243] Waited 191 ms on lock 0x7b54001c8254. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:07:17.675985 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":438801792}
I20260709 13:07:17.667879 16322 leader_election.cc:304] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:07:17.591852 20621 raft_consensus.cc:3060] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:17.697319 16348 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41832 (request call id 2101) took 1201 ms. Trace:
W20260709 13:07:17.698048 16206 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60154 (request call id 2561) took 1925 ms (client timeout 1801 ms). Trace:
I20260709 13:07:17.712961 20597 raft_consensus.cc:2804] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:07:17.713775 20436 raft_consensus.cc:493] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:17.703332 16173 leader_election.cc:304] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:17.638404 16248 leader_election.cc:304] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:07:17.692721 20657 raft_consensus.cc:493] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:17.639580 20659 raft_consensus.cc:3060] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:17.706122 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 168778us
I20260709 13:07:17.706638 16320 leader_election.cc:304] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:17.705068 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:17.665997 20521 raft_consensus.cc:515] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:17.766489 20657 raft_consensus.cc:3060] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:17.774959 16277 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45210 (request call id 2234) took 1086 ms. Trace:
I20260709 13:07:17.775355 20599 leader_election.cc:290] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:17.775976 20521 leader_election.cc:290] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 10 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:17.714594 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:17.777077 16203 raft_consensus.cc:2468] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 14.
I20260709 13:07:17.774116 16204 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60154 (request call id 2578) took 1203 ms. Trace:
I20260709 13:07:17.667724 19831 leader_election.cc:290] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 16 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:17.669701 20533 leader_election.cc:290] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:17.692480 20563 raft_consensus.cc:3060] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:17.685101 16200 raft_consensus.cc:3060] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:17.719728 16349 rpcz_store.cc:276] 0709 13:07:16.497161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.497731 (+   570us) service_pool.cc:224] Handling call
0709 13:07:16.498053 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:16.545837 (+ 47784us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:17.651971 (+1106134us) spinlock_profiling.cc:243] Waited 46.9 ms on lock 0x7b540001a754. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f489e01 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6
0709 13:07:17.652218 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":107768576}
I20260709 13:07:17.669800 20009 leader_election.cc:290] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:17.701519 20548 raft_consensus.cc:493] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:17.728094 16174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:17.701092 20437 raft_consensus.cc:493] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
W20260709 13:07:17.722116 20663 log.cc:927] Time spent T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.223s	user 0.001s	sys 0.000s
I20260709 13:07:17.752871 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:17.775379 16277 rpcz_store.cc:276] 0709 13:07:16.688338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.790629 (+102291us) service_pool.cc:224] Handling call
0709 13:07:16.791310 (+   681us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:16.799413 (+  8103us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:16.799480 (+    67us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:16.830838 (+ 31358us) log.cc:844] Serialized 52 byte log entry
0709 13:07:17.177393 (+346555us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:17.189772 (+ 12379us) log.cc:844] Serialized 14 byte log entry
0709 13:07:17.190495 (+   723us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:17.191818 (+  1323us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:17.774724 (+582906us) raft_consensus.cc:1685] finished
0709 13:07:17.774748 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:17.774900 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7826,"prepare.queue_time_us":11928,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":2956,"raft.queue_time_us":9024,"raft.run_cpu_time_us":341,"raft.run_wall_time_us":31977,"thread_start_us":273980,"threads_started":1,"wal-append.queue_time_us":409938}
I20260709 13:07:17.817946 16205 raft_consensus.cc:2468] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 12.
I20260709 13:07:17.758718 20597 raft_consensus.cc:493] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:17.819028 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:17.820575 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:17.821322 16205 raft_consensus.cc:2468] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 6.
W20260709 13:07:17.755352 16206 rpcz_store.cc:269] 0709 13:07:15.772377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:15.772601 (+   224us) service_pool.cc:224] Handling call
0709 13:07:17.697844 (+1925243us) spinlock_profiling.cc:243] Waited 521 ms on lock 0x7b54003d3454. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:07:17.697971 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1199214848}
I20260709 13:07:17.822925 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:17.638846 20414 raft_consensus.cc:493] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.754181 16348 rpcz_store.cc:276] 0709 13:07:16.496404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.497286 (+   882us) service_pool.cc:224] Handling call
0709 13:07:16.497630 (+   344us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:16.535528 (+ 37898us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:17.696988 (+1161460us) spinlock_profiling.cc:243] Waited 37.2 ms on lock 0x7b54003494d4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f489e01 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6
0709 13:07:17.697248 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":85575040}
W20260709 13:07:17.760447 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 122129us
I20260709 13:07:17.812951 20548 raft_consensus.cc:3060] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:17.817368 20437 raft_consensus.cc:3060] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:17.827183 20414 raft_consensus.cc:515] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:17.813182 19831 raft_consensus.cc:493] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.828974 20009 consensus_queue.cc:1059] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:07:17.829234 19831 raft_consensus.cc:515] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:17.829872 20009 raft_consensus.cc:3055] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:07:17.761574 16105 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38842 (request call id 218) took 14700 ms (client timeout 15000 ms). Trace:
I20260709 13:07:17.776852 20592 raft_consensus.cc:2804] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:17.726052 20675 consensus_queue.cc:1059] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.097s
I20260709 13:07:17.854425 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:17.855561 16205 raft_consensus.cc:2368] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 for earlier term 11. Current term is 12.
I20260709 13:07:17.778272 16351 raft_consensus.cc:606] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Received request to transfer leadership to TS 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:07:17.856567 16351 raft_consensus.cc:614] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:17.714061 20658 consensus_queue.cc:1059] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 13:07:17.727631 20602 raft_consensus.cc:3060] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:17.785305 16201 raft_consensus.cc:1275] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:07:17.777895 16204 rpcz_store.cc:276] 0709 13:07:16.570464 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.756764 (+186300us) service_pool.cc:224] Handling call
0709 13:07:16.757056 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:16.984989 (+227933us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:17.773842 (+788853us) spinlock_profiling.cc:243] Waited 226 ms on lock 0x7b54001423d4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f489e01 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6
0709 13:07:17.774050 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":518678400}
I20260709 13:07:17.753808 20629 raft_consensus.cc:2749] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:17.765532 20514 raft_consensus.cc:2749] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:17.762192 20436 raft_consensus.cc:3060] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:17.812799 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 109572us
W20260709 13:07:17.815860 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 147954us
I20260709 13:07:17.834659 20597 raft_consensus.cc:3060] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:17.726051 20633 raft_consensus.cc:3060] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:07:17.766535 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 59989us
I20260709 13:07:17.785935 20420 raft_consensus.cc:2749] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:17.825493 20599 raft_consensus.cc:493] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:17.830226 20009 raft_consensus.cc:740] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:07:17.830173 20414 leader_election.cc:290] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:17.733776 20624 consensus_queue.cc:260] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } }
I20260709 13:07:17.875368 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:17.882979 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:17.882375 16173 leader_election.cc:304] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
W20260709 13:07:17.932716 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 50444.7us
I20260709 13:07:17.932895 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:17.753738 20523 consensus_queue.cc:1059] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.066s
W20260709 13:07:17.935181 20591 consensus_meta.cc:287] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3: Time spent flushing consensus metadata: real 0.540s	user 0.012s	sys 0.019s
I20260709 13:07:17.935331 20453 raft_consensus.cc:2804] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:17.935742 20591 raft_consensus.cc:515] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:17.884828 16322 leader_election.cc:304] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:07:17.814963 20587 consensus_queue.cc:1048] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.065s
W20260709 13:07:17.938971 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 56485us
I20260709 13:07:17.939554 16173 leader_election.cc:304] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:07:17.941891 16200 raft_consensus.cc:2468] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 12.
I20260709 13:07:17.943213 20520 raft_consensus.cc:3055] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:17.943888 20520 raft_consensus.cc:740] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:07:17.955005 20399 consensus_queue.cc:1048] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:07:17.956357 16913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:17.960438 16208 raft_consensus.cc:2468] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 7.
I20260709 13:07:17.960829 20420 raft_consensus.cc:2804] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:17.961627 20420 raft_consensus.cc:697] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 10 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:17.961686 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:17.962603 16208 raft_consensus.cc:3060] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:17.963769 20622 leader_election.cc:290] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:17.964571 20361 consensus_queue.cc:1059] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:17.966590 20009 consensus_queue.cc:260] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:17.967942 20009 raft_consensus.cc:3060] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:17.968153 20527 raft_consensus.cc:3055] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:17.968840 20527 raft_consensus.cc:740] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:07:17.969702 20556 raft_consensus.cc:515] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:07:17.971132 16205 raft_consensus.cc:2368] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 8. Current term is 9.
I20260709 13:07:17.968475 20437 raft_consensus.cc:515] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:17.973623 20437 leader_election.cc:290] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:17.876251 20592 raft_consensus.cc:697] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:07:17.982688 16208 raft_consensus.cc:2468] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 11.
I20260709 13:07:17.880535 20539 raft_consensus.cc:3055] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:07:17.937271 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 149868us
I20260709 13:07:17.940146 16322 leader_election.cc:304] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:07:17.963057 20420 consensus_queue.cc:237] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:07:17.925781 20479 consensus_meta.cc:287] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3: Time spent flushing consensus metadata: real 0.708s	user 0.022s	sys 0.001s
I20260709 13:07:17.936093 20453 raft_consensus.cc:493] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:17.979341 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:07:17.988147 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 48099.3us
I20260709 13:07:17.924746 20629 raft_consensus.cc:3055] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:07:17.993013 16281 raft_consensus.cc:2368] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for earlier term 7. Current term is 8.
I20260709 13:07:17.995138 16355 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33486 (request call id 617) took 1107 ms. Trace:
I20260709 13:07:17.976639 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:17.898041 20513 raft_consensus.cc:697] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 14 LEADER]: Becoming Leader. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
W20260709 13:07:17.830658 16105 rpcz_store.cc:269] 0709 13:07:03.053851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:03.056332 (+  2481us) service_pool.cc:224] Handling call
0709 13:07:17.753633 (+14697301us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:09.332269 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:09.519987 (+187718us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:09.520047 (+    60us) write_op.cc:435] Acquired schema lock
0709 13:07:09.520090 (+    43us) tablet.cc:662] Decoding operations
0709 13:07:09.521298 (+  1208us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:09.521393 (+    95us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:09.521428 (+    35us) tablet.cc:685] Acquiring locks for 9 operations
0709 13:07:09.522398 (+   970us) tablet.cc:701] Row locks acquired
0709 13:07:09.522454 (+    56us) write_op.cc:260] PREPARE: finished
0709 13:07:09.582867 (+ 60413us) write_op.cc:270] Start()
0709 13:07:09.621027 (+ 38160us) write_op.cc:276] Timestamp: P: 1783602429576981 usec, L: 0
0709 13:07:09.633480 (+ 12453us) op_driver.cc:348] REPLICATION: starting
0709 13:07:09.707420 (+ 73940us) log.cc:844] Serialized 3632 byte log entry
0709 13:07:10.534895 (+827475us) op_driver.cc:464] REPLICATION: finished
0709 13:07:10.866054 (+331159us) spinlock_profiling.cc:243] Waited 9.08 ms on lock 0x7b4400022b4c. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361c224db1 00007f361c2c2c85 00007f361c2c36a2 00007f361f0351db 00007f361f030aaf 00007f361c37f0ac 00007f36251d9ab9 00007f361c39b69b 00007f361c39993f 00007f361c39bc02 00007f3622ebfef0
0709 13:07:11.129264 (+263210us) write_op.cc:301] APPLY: starting
0709 13:07:11.133985 (+  4721us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:11.475163 (+341178us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:11.475205 (+    42us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:11.476102 (+   897us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:11.476390 (+   288us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=18
0709 13:07:11.476437 (+    47us) write_op.cc:312] APPLY: finished
0709 13:07:11.476811 (+   374us) log.cc:844] Serialized 71 byte log entry
0709 13:07:11.816596 (+339785us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:11.827404 (+ 10808us) write_op.cc:454] Released schema lock
0709 13:07:11.827490 (+    86us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:11.843572 (+ 16082us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:11.843602 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1060677,"reported_tablets":21,"child_traces":[["op",{"apply.queue_time_us":518544,"apply.run_cpu_time_us":38590,"apply.run_wall_time_us":733797,"num_ops":9,"prepare.queue_time_us":335811,"prepare.run_cpu_time_us":27420,"prepare.run_wall_time_us":634140,"raft.queue_time_us":468439,"raft.run_cpu_time_us":18062,"raft.run_wall_time_us":507417,"replication_time_us":878544,"spinlock_wait_cycles":20875008,"thread_start_us":1395377,"threads_started":5,"wal-append.queue_time_us":741015,"wal-append.run_cpu_time_us":24169,"wal-append.run_wall_time_us":2715993}]]}
I20260709 13:07:18.033030 16202 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60138 (request call id 2361) took 2135 ms. Trace:
I20260709 13:07:18.033631 16202 rpcz_store.cc:276] 0709 13:07:15.897106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:16.166671 (+269565us) service_pool.cc:224] Handling call
0709 13:07:17.698125 (+1531454us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:17.701311 (+  3186us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:17.996776 (+295465us) spinlock_profiling.cc:243] Waited 1.53 s on lock 0x7b54003d3450. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f4888ad 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:07:18.032940 (+ 36164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3521119488}
I20260709 13:07:18.035382 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:18.036202 16202 raft_consensus.cc:3060] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:18.031633 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 47080.7us
I20260709 13:07:18.038322 16208 raft_consensus.cc:1240] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 6. Current term is 7. Ops: []
W20260709 13:07:18.041118 16247 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:18.017359 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:17.995407 19831 leader_election.cc:290] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:18.039732 16355 rpcz_store.cc:276] 0709 13:07:16.887536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.185059 (+297523us) service_pool.cc:224] Handling call
0709 13:07:17.185430 (+   371us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:17.295540 (+110110us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:17.295592 (+    52us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:17.295668 (+    76us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:17.295716 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:17.994790 (+699074us) spinlock_profiling.cc:243] Waited 110 ms on lock 0x7b540032ad54. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f489e01 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6
0709 13:07:17.994861 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:17.995048 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":252525824}
W20260709 13:07:18.025585 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:18.010434 20453 raft_consensus.cc:3060] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:17.996420 20479 raft_consensus.cc:515] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:17.990110 20565 consensus_queue.cc:1048] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.070s
I20260709 13:07:17.988147 20539 raft_consensus.cc:740] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:17.969947 20527 consensus_queue.cc:260] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:17.997629 20654 leader_election.cc:290] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:17.937846 20599 raft_consensus.cc:515] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:18.427112 20599 leader_election.cc:290] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:18.032845 20629 raft_consensus.cc:740] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:18.113066 20528 leader_election.cc:290] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:18.429499 20453 raft_consensus.cc:515] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:07:18.432919 20436 consensus_meta.cc:287] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f: Time spent flushing consensus metadata: real 0.527s	user 0.008s	sys 0.002s
I20260709 13:07:18.433472 20436 raft_consensus.cc:515] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:18.435770 20527 raft_consensus.cc:3060] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:18.436645 20563 consensus_meta.cc:287] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f: Time spent flushing consensus metadata: real 0.637s	user 0.014s	sys 0.020s
I20260709 13:07:18.438910 20479 leader_election.cc:290] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 election: Requested vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:18.384563 20603 leader_election.cc:290] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:18.177302 20513 consensus_queue.cc:237] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:18.049744 20302 consensus_queue.cc:1048] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:18.037680 19940 consensus_queue.cc:1048] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 13:07:18.050262 20592 consensus_queue.cc:237] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:07:18.441210 20562 raft_consensus.cc:3060] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:17.987278 20623 raft_consensus.cc:2804] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:18.406072 20665 raft_consensus.cc:493] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:18.442750 20436 leader_election.cc:290] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:18.442895 20623 raft_consensus.cc:697] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
W20260709 13:07:18.403846 20510 consensus_meta.cc:287] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3: Time spent flushing consensus metadata: real 0.732s	user 0.011s	sys 0.012s
I20260709 13:07:18.443315 20665 raft_consensus.cc:515] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:18.444114 20623 consensus_queue.cc:237] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:07:18.412845 20662 consensus_meta.cc:287] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3: Time spent flushing consensus metadata: real 0.979s	user 0.011s	sys 0.038s
W20260709 13:07:18.419049 20677 log.cc:927] Time spent T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.351s	user 0.003s	sys 0.006s
W20260709 13:07:18.396008 16382 heartbeater.cc:646] Failed to heartbeat to 127.14.180.126:35965 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.14.180.126:35965 timed out after 15.000s (SENT)
W20260709 13:07:18.396595 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 356279us
I20260709 13:07:18.454455 16320 leader_election.cc:304] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:18.455711 16320 leader_election.cc:304] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:18.456651 16320 leader_election.cc:304] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
W20260709 13:07:18.399045 20660 consensus_meta.cc:287] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 0.682s	user 0.014s	sys 0.013s
W20260709 13:07:18.399590 20602 consensus_meta.cc:287] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3: Time spent flushing consensus metadata: real 0.524s	user 0.023s	sys 0.002s
W20260709 13:07:18.404137 16913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:18.391641 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 354060us
I20260709 13:07:18.408555 16912 leader_election.cc:304] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:07:18.478379 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 69943.1us
I20260709 13:07:18.469543 20618 raft_consensus.cc:2804] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:07:18.424139 20621 consensus_meta.cc:287] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3: Time spent flushing consensus metadata: real 0.664s	user 0.012s	sys 0.008s
I20260709 13:07:18.424644 20691 raft_consensus.cc:493] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:18.424820 20009 raft_consensus.cc:493] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.427969 20489 leader_election.cc:290] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:07:18.426299 20657 consensus_meta.cc:287] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3: Time spent flushing consensus metadata: real 0.651s	user 0.004s	sys 0.025s
W20260709 13:07:18.375336 20589 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.005s	sys 0.005s
W20260709 13:07:18.412287 20661 consensus_meta.cc:287] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f: Time spent flushing consensus metadata: real 0.790s	user 0.012s	sys 0.018s
I20260709 13:07:18.470242 20617 raft_consensus.cc:2804] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:18.406838 20591 leader_election.cc:290] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:18.453236 20662 raft_consensus.cc:2749] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:07:18.432969 20548 consensus_meta.cc:287] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f: Time spent flushing consensus metadata: real 0.605s	user 0.009s	sys 0.015s
I20260709 13:07:18.445432 20665 leader_election.cc:290] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:18.463766 20603 raft_consensus.cc:2749] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:18.445353 20453 leader_election.cc:290] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:18.422766 20539 consensus_queue.cc:260] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:18.445626 20597 raft_consensus.cc:515] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:18.468533 20683 raft_consensus.cc:493] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:18.485806 20009 raft_consensus.cc:515] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:18.490530 20657 raft_consensus.cc:515] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:18.511195 20683 raft_consensus.cc:515] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:18.487703 20688 raft_consensus.cc:2749] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:18.477252 20355 raft_consensus.cc:493] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:18.487246 20589 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.674s	user 0.005s	sys 0.005s
I20260709 13:07:18.482007 20618 raft_consensus.cc:493] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:18.482887 20556 leader_election.cc:290] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:18.489318 20617 raft_consensus.cc:493] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:18.008349 20262 raft_consensus.cc:2804] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:18.530325 20683 leader_election.cc:290] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:18.531035 20262 raft_consensus.cc:493] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:18.525194 20355 raft_consensus.cc:515] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:18.483875 20621 raft_consensus.cc:515] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:18.491508 20661 raft_consensus.cc:515] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:18.488286 20691 raft_consensus.cc:515] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:18.471110 20602 raft_consensus.cc:515] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:18.512812 20657 leader_election.cc:290] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:18.496122 20548 raft_consensus.cc:515] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:07:18.292589 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 353264us
W20260709 13:07:18.327425 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 289809us
I20260709 13:07:18.057591 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:18.387427 16208 raft_consensus.cc:1275] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 13:07:18.543304 20633 consensus_meta.cc:287] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 0.613s	user 0.016s	sys 0.004s
I20260709 13:07:18.466027 16320 leader_election.cc:304] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
W20260709 13:07:18.415637 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 376424us
W20260709 13:07:18.473270 16913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:18.469856 19940 consensus_queue.cc:1048] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 13:07:18.512778 20009 leader_election.cc:290] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:18.724185 16246 leader_election.cc:400] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 election: Vote denied by peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073) with higher term. Message: Invalid argument: T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 8. Current term is 9.
I20260709 13:07:18.531958 20262 raft_consensus.cc:3060] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:18.532889 20617 raft_consensus.cc:3060] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:18.725556 20678 raft_consensus.cc:493] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.526832 20618 raft_consensus.cc:3060] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:18.726629 20678 raft_consensus.cc:515] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:18.729879 20678 leader_election.cc:290] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:18.532512 20539 raft_consensus.cc:3060] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:18.732111 20629 consensus_queue.cc:260] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:07:18.547890 20659 consensus_meta.cc:287] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3: Time spent flushing consensus metadata: real 0.783s	user 0.009s	sys 0.024s
I20260709 13:07:18.522802 20679 consensus_queue.cc:1059] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
W20260709 13:07:18.551180 20680 log.cc:927] Time spent T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.134s	user 0.000s	sys 0.001s
I20260709 13:07:18.735536 20659 raft_consensus.cc:515] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:18.394584 16202 raft_consensus.cc:2468] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 10.
I20260709 13:07:18.555174 20691 leader_election.cc:290] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:18.740350 20687 raft_consensus.cc:3055] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:18.741140 20687 raft_consensus.cc:740] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:07:18.677850 16200 raft_consensus.cc:2393] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 14: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:07:18.592916 16203 raft_consensus.cc:1240] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:18.734700 20629 raft_consensus.cc:3060] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:18.648906 20597 leader_election.cc:290] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:18.724711 16246 leader_election.cc:403] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
W20260709 13:07:18.627760 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:18.678253 20440 raft_consensus.cc:493] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.627684 20355 leader_election.cc:290] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:18.643162 20621 leader_election.cc:290] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:18.622896 16199 raft_consensus.cc:1240] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:18.643394 20548 leader_election.cc:290] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 14 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:18.650962 20602 leader_election.cc:290] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:18.605708 16282 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45218 (request call id 2202) took 1061 ms. Trace:
I20260709 13:07:18.602573 16281 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45218 (request call id 2199) took 1088 ms. Trace:
I20260709 13:07:18.641170 20603 raft_consensus.cc:493] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.596844 16206 raft_consensus.cc:2468] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 4.
I20260709 13:07:18.603401 16283 raft_consensus.cc:2468] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 8.
W20260709 13:07:18.689831 16247 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:18.653864 20520 consensus_queue.cc:260] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:07:18.691591 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:18.691733 20657 raft_consensus.cc:493] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.702415 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:18.703009 20633 raft_consensus.cc:515] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:18.704030 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:18.705452 20662 raft_consensus.cc:493] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:18.705426 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:18.707000 20591 raft_consensus.cc:493] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:18.708806 20694 raft_consensus.cc:493] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:18.711018 20489 raft_consensus.cc:493] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:18.711951 20607 raft_consensus.cc:493] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:18.712766 20523 raft_consensus.cc:493] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:18.712821 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:07:18.714017 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 228539us
W20260709 13:07:18.715363 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 249279us
I20260709 13:07:18.716099 20665 raft_consensus.cc:2804] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:18.720329 20624 raft_consensus.cc:3060] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:18.558894 20661 leader_election.cc:290] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:18.743953 20687 consensus_queue.cc:260] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:18.764943 16203 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60154 (request call id 2592) took 1091 ms. Trace:
I20260709 13:07:18.787231 16199 raft_consensus.cc:1240] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:18.789042 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:18.790855 20440 raft_consensus.cc:515] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:18.793918 20440 leader_election.cc:290] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:18.794194 20657 raft_consensus.cc:515] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:18.796839 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:07:18.797287 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:07:18.797821 20657 leader_election.cc:290] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:18.798637 16947 raft_consensus.cc:2368] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for earlier term 6. Current term is 7.
I20260709 13:07:18.798729 20694 raft_consensus.cc:515] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:18.772150 20591 raft_consensus.cc:515] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:18.801898 20694 leader_election.cc:290] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:18.801599 20262 raft_consensus.cc:515] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:18.802775 20691 raft_consensus.cc:3060] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:18.802438 20521 consensus_queue.cc:1048] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:18.830195 16206 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60138 (request call id 2388) took 1014 ms. Trace:
I20260709 13:07:18.831164 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:18.831705 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:18.779736 20662 raft_consensus.cc:515] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:18.832132 16349 raft_consensus.cc:3060] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:18.832168 20602 raft_consensus.cc:493] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:18.833115 20602 raft_consensus.cc:515] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:18.805353 20591 leader_election.cc:290] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:18.830826 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:18.806329 16207 raft_consensus.cc:1240] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 LEADER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:18.836477 16201 raft_consensus.cc:3060] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:18.837285 16207 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60138 (request call id 2387) took 1022 ms. Trace:
I20260709 13:07:18.799302 20687 raft_consensus.cc:3060] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:18.760522 16281 rpcz_store.cc:276] 0709 13:07:17.513729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.513845 (+   116us) service_pool.cc:224] Handling call
0709 13:07:18.602016 (+1088171us) spinlock_profiling.cc:243] Waited 427 ms on lock 0x7b54001f5ed4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:07:18.602295 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":982469888}
W20260709 13:07:18.838300 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:18.760378 16282 rpcz_store.cc:276] 0709 13:07:17.543750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.543895 (+   145us) service_pool.cc:224] Handling call
0709 13:07:17.544309 (+   414us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:17.728527 (+184218us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:07:18.158810 (+430283us) log.cc:844] Serialized 14 byte log entry
0709 13:07:18.603444 (+444634us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:18.603551 (+   107us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:18.603703 (+   152us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:18.605116 (+  1413us) spinlock_profiling.cc:243] Waited 184 ms on lock 0x7b5400126454. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f489e01 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6
0709 13:07:18.605178 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:18.605470 (+   292us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":667817,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":40,"raft.queue_time_us":68324,"raft.run_cpu_time_us":431,"raft.run_wall_time_us":7307,"spinlock_wait_cycles":422810368,"thread_start_us":601780,"threads_started":2,"wal-append.queue_time_us":159809}
I20260709 13:07:18.797859 16941 raft_consensus.cc:3060] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:18.811004 16351 raft_consensus.cc:2368] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for earlier term 10. Current term is 11.
I20260709 13:07:18.811594 20603 raft_consensus.cc:515] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:18.815486 20520 raft_consensus.cc:3060] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:18.815755 20420 raft_consensus.cc:493] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.830826 16206 rpcz_store.cc:276] 0709 13:07:17.815510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.822576 (+  7066us) service_pool.cc:224] Handling call
0709 13:07:18.829951 (+1007375us) spinlock_profiling.cc:243] Waited 773 ms on lock 0x7b54000b40d4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:07:18.830112 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1777029504}
I20260709 13:07:18.843261 20420 raft_consensus.cc:515] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:18.834326 20662 leader_election.cc:290] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:18.777297 20489 raft_consensus.cc:515] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:18.776700 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:18.846987 16200 raft_consensus.cc:3060] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:18.811053 20523 raft_consensus.cc:515] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:18.785323 20665 raft_consensus.cc:697] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 7 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:18.837944 16207 rpcz_store.cc:276] 0709 13:07:17.815230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:18.638542 (+823312us) service_pool.cc:224] Handling call
0709 13:07:18.639169 (+   627us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:18.836189 (+197020us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:18.836938 (+   749us) spinlock_profiling.cc:243] Waited 167 ms on lock 0x7b54003d0c54. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f489e01 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6
0709 13:07:18.837214 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":383172992}
I20260709 13:07:18.851413 20665 consensus_queue.cc:237] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:18.822438 16283 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42740 (request call id 745) took 1276 ms. Trace:
I20260709 13:07:18.854347 16283 rpcz_store.cc:276] 0709 13:07:17.546186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.546352 (+   166us) service_pool.cc:224] Handling call
0709 13:07:18.782164 (+1235812us) spinlock_profiling.cc:243] Waited 883 ms on lock 0x7b5400125f54. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:07:18.822364 (+ 40200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2031348992}
I20260709 13:07:18.816637 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:18.855542 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:18.855937 16202 raft_consensus.cc:2468] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 7.
I20260709 13:07:18.856117 20262 leader_election.cc:290] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:18.775537 16203 rpcz_store.cc:276] 0709 13:07:17.670297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.777969 (+107672us) service_pool.cc:224] Handling call
0709 13:07:17.784679 (+  6710us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:18.745650 (+960971us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:18.748500 (+  2850us) spinlock_profiling.cc:243] Waited 807 ms on lock 0x7b540038aed4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f489e01 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6
0709 13:07:18.762008 (+ 13508us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1856599296}
I20260709 13:07:18.822908 20660 raft_consensus.cc:493] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.861217 20660 raft_consensus.cc:515] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:18.779736 20607 raft_consensus.cc:515] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:18.842145 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:18.863536 16205 raft_consensus.cc:2393] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 14: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:07:18.863754 20660 leader_election.cc:290] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:18.807909 19940 raft_consensus.cc:493] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.864557 19940 raft_consensus.cc:515] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:18.857985 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f022e2e63ae4461d834e476ff2666991" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:18.868312 20659 leader_election.cc:290] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:18.875342 20420 leader_election.cc:290] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:18.875365 20523 leader_election.cc:290] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:18.876400 20633 leader_election.cc:290] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:18.877730 20521 raft_consensus.cc:493] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.891345 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:18.895315 19940 leader_election.cc:290] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:18.891213 20607 leader_election.cc:290] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:18.897881 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:18.898361 20603 leader_election.cc:290] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:18.898896 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:18.900285 16354 raft_consensus.cc:1275] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:07:18.904290 20414 raft_consensus.cc:493] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.904793 20548 raft_consensus.cc:493] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.958763 20414 raft_consensus.cc:515] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:18.959038 20548 raft_consensus.cc:515] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:18.961521 20414 leader_election.cc:290] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:18.961647 20548 leader_election.cc:290] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:18.907596 20420 raft_consensus.cc:493] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
W20260709 13:07:18.909061 16249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:18.906123 20617 raft_consensus.cc:515] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:18.963048 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:18.964249 16203 raft_consensus.cc:2410] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
W20260709 13:07:18.910857 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 201249us
W20260709 13:07:18.888422 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 273337us
I20260709 13:07:18.875365 20489 leader_election.cc:290] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:18.920344 16204 raft_consensus.cc:2468] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 9.
I20260709 13:07:18.934141 20691 raft_consensus.cc:2749] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073) with higher term. Message: Invalid argument: T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 8. Current term is 9.
I20260709 13:07:18.935760 16349 raft_consensus.cc:2468] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 10.
I20260709 13:07:18.937134 16200 raft_consensus.cc:2468] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 5.
I20260709 13:07:18.962746 20420 raft_consensus.cc:515] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:18.920147 16206 raft_consensus.cc:1275] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 10. (term mismatch)
I20260709 13:07:18.974414 16941 raft_consensus.cc:2468] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 12.
I20260709 13:07:18.976497 16353 raft_consensus.cc:2410] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:07:18.982008 16201 raft_consensus.cc:2468] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 8.
I20260709 13:07:18.975854 16206 pending_rounds.cc:85] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f: Aborting all ops after (but not including) 9
I20260709 13:07:18.964571 20617 leader_election.cc:290] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:18.988637 16206 pending_rounds.cc:107] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f: Aborting uncommitted NO_OP operation due to leader change: 15.10
I20260709 13:07:18.995194 16206 raft_consensus.cc:2889] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:18.995886 20623 raft_consensus.cc:493] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.996702 20623 raft_consensus.cc:515] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:18.995054 16912 leader_election.cc:304] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:19.001950 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
W20260709 13:07:19.010460 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 44266us
I20260709 13:07:19.017907 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:19.018923 16348 raft_consensus.cc:2410] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for term 16 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:07:19.021850 20513 raft_consensus.cc:2749] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:19.027220 16203 raft_consensus.cc:1275] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:07:19.016525 20548 raft_consensus.cc:493] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.020025 20602 leader_election.cc:290] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:19.020521 20521 raft_consensus.cc:515] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:07:19.038728 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 43926.4us
W20260709 13:07:19.046352 16247 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.053975 16204 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39674 (request call id 906) took 1241 ms. Trace:
I20260709 13:07:19.034296 20548 raft_consensus.cc:515] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } }
I20260709 13:07:19.054466 16204 rpcz_store.cc:276] 0709 13:07:17.803203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:17.937528 (+134325us) service_pool.cc:224] Handling call
0709 13:07:19.042861 (+1105333us) spinlock_profiling.cc:243] Waited 867 ms on lock 0x7b54003782d4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:07:19.044970 (+  2109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1995116288}
I20260709 13:07:19.057140 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:19.052490 20618 raft_consensus.cc:515] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:07:19.062840 16321 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.063285 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:19.064476 20548 leader_election.cc:290] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:19.067857 20489 consensus_queue.cc:1059] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:19.069252 16246 leader_election.cc:304] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:19.070243 20489 consensus_queue.cc:1059] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:19.070739 16912 leader_election.cc:304] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:07:19.070926 20420 leader_election.cc:290] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:19.075707 20521 leader_election.cc:290] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:19.071179 20523 raft_consensus.cc:3055] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:19.079043 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:19.077694 16320 leader_election.cc:304] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:19.081525 16354 raft_consensus.cc:2468] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 9.
I20260709 13:07:19.081099 20523 raft_consensus.cc:740] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:07:19.084818 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:19.085426 16912 leader_election.cc:400] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 11 election: Vote denied by peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073) with higher term. Message: Invalid argument: T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 for earlier term 11. Current term is 12.
I20260709 13:07:19.085827 16912 leader_election.cc:403] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:07:19.085877 16353 raft_consensus.cc:2368] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for earlier term 9. Current term is 10.
I20260709 13:07:19.086143 20523 consensus_queue.cc:260] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:19.086771 20679 raft_consensus.cc:2804] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:19.087687 16356 raft_consensus.cc:2468] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 7.
I20260709 13:07:19.090770 20355 raft_consensus.cc:2749] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073) with higher term. Message: Invalid argument: T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 for earlier term 11. Current term is 12.
W20260709 13:07:19.092092 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 53233.6us
W20260709 13:07:19.082696 16173 connection.cc:256] RPC call timeout handler was delayed by -1.0530558750000409s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19310000000000002s for a response
I20260709 13:07:19.088830 20679 raft_consensus.cc:493] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:19.095067 20679 raft_consensus.cc:3060] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:19.097741 20624 raft_consensus.cc:493] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:19.099954 20624 raft_consensus.cc:515] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:19.102161 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:19.102931 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:19.103758 16351 raft_consensus.cc:3060] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:19.104398 20624 leader_election.cc:290] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:19.105434 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:19.106248 16354 raft_consensus.cc:3060] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:19.106451 20618 leader_election.cc:290] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:19.107235 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:19.107921 16352 raft_consensus.cc:3060] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:19.099960 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:19.111143 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:19.113989 20523 raft_consensus.cc:3060] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:19.114509 20355 consensus_queue.cc:1048] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:19.116104 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:19.118458 16348 raft_consensus.cc:2468] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 9.
I20260709 13:07:19.119097 16941 raft_consensus.cc:2393] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 12: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
W20260709 13:07:19.121794 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 59566.2us
I20260709 13:07:19.124461 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
W20260709 13:07:19.124577 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 55459us
I20260709 13:07:19.124831 20633 raft_consensus.cc:2804] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:19.125334 16941 raft_consensus.cc:2468] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 9.
I20260709 13:07:19.125684 20633 raft_consensus.cc:697] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 10 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:19.125315 20420 raft_consensus.cc:493] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.126572 20420 raft_consensus.cc:515] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:19.126951 20617 raft_consensus.cc:493] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:19.127487 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:19.127099 20633 consensus_queue.cc:237] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:19.127898 20617 raft_consensus.cc:515] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:19.128492 16941 raft_consensus.cc:2468] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 11.
I20260709 13:07:19.129235 20420 leader_election.cc:290] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:19.130213 20617 leader_election.cc:290] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:19.131310 16246 leader_election.cc:304] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:19.131160 20548 consensus_queue.cc:1048] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:19.131704 16946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:19.132411 16946 raft_consensus.cc:2468] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 7.
I20260709 13:07:19.133208 16173 leader_election.cc:400] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 election: Vote denied by peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823) with higher term. Message: Invalid argument: T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for earlier term 10. Current term is 11.
I20260709 13:07:19.133623 16173 leader_election.cc:403] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:07:19.133978 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:19.131948 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:07:19.100344 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:19.143028 20489 consensus_queue.cc:1243] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer e10b16d536674c0bb350a31d7ce5ff7f log is divergent from this leader: its last log entry 10.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:07:19.125516 20603 raft_consensus.cc:493] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.143603 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:19.144362 20603 raft_consensus.cc:515] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:19.144886 20562 raft_consensus.cc:2749] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823) with higher term. Message: Invalid argument: T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for earlier term 10. Current term is 11.
I20260709 13:07:19.146214 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:19.146979 16349 raft_consensus.cc:3060] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:19.125486 20602 raft_consensus.cc:2804] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:19.147524 20602 raft_consensus.cc:493] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:19.147817 16348 raft_consensus.cc:1275] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:07:19.147954 20602 raft_consensus.cc:3060] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:19.149758 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:19.146838 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:19.151348 16357 raft_consensus.cc:2393] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 14: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:07:19.151216 20603 leader_election.cc:290] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:19.152570 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:19.154063 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:19.144248 16350 raft_consensus.cc:1240] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:07:19.154659 16943 raft_consensus.cc:3060] T 540bfc4ad793452faea5b865343aacf7 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 LEARNER]: Advancing to term 11
I20260709 13:07:19.155059 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:19.155449 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:19.156242 16348 raft_consensus.cc:2468] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 14.
I20260709 13:07:19.160058 16349 raft_consensus.cc:2468] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 8.
I20260709 13:07:19.155714 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:19.160974 16352 raft_consensus.cc:2468] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 14.
I20260709 13:07:19.162358 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:19.163029 16352 raft_consensus.cc:2393] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 14: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:07:19.164398 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:19.165753 16351 raft_consensus.cc:2468] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 9.
I20260709 13:07:19.167704 16350 raft_consensus.cc:1240] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:19.171079 16357 raft_consensus.cc:3060] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:19.172710 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:19.174415 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:19.175812 16943 raft_consensus.cc:1275] T 540bfc4ad793452faea5b865343aacf7 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 LEARNER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:07:19.178855 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:19.179494 16352 raft_consensus.cc:3060] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:19.180792 16356 raft_consensus.cc:2468] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 7.
I20260709 13:07:19.163910 20679 raft_consensus.cc:515] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:07:19.190563 16249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.190366 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:19.190851 20489 raft_consensus.cc:493] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.191363 20607 raft_consensus.cc:493] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:19.192580 20694 raft_consensus.cc:2804] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:07:19.208109 20694 raft_consensus.cc:697] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:07:19.193419 20440 raft_consensus.cc:493] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:19.209862 16351 raft_consensus.cc:2393] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 13: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:07:19.209589 20489 raft_consensus.cc:515] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:19.209775 20440 raft_consensus.cc:515] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:07:19.210675 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.192888 20592 raft_consensus.cc:493] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:19.211089 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:19.193552 20659 raft_consensus.cc:493] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:19.193552 16350 raft_consensus.cc:1275] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:07:19.211508 20592 raft_consensus.cc:515] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:19.194227 16322 leader_election.cc:304] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:07:19.194676 20657 raft_consensus.cc:493] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:19.215225 20440 leader_election.cc:290] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:19.216187 20657 raft_consensus.cc:515] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:19.212792 20659 raft_consensus.cc:515] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:19.217764 16352 raft_consensus.cc:2468] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 5.
I20260709 13:07:19.219200 20659 leader_election.cc:290] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:19.218223 20618 raft_consensus.cc:2749] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:19.190761 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:19.197122 16947 raft_consensus.cc:1240] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:19.195048 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bc3c8ff9b84838a2664335d7e1582b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:19.225731 16356 raft_consensus.cc:2468] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 9.
W20260709 13:07:19.190966 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 59782.3us
I20260709 13:07:19.207356 20607 raft_consensus.cc:515] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:19.239688 20489 leader_election.cc:290] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:19.239897 20607 leader_election.cc:290] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:19.240876 20694 consensus_queue.cc:237] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:19.246011 20657 leader_election.cc:290] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:19.191193 20591 raft_consensus.cc:493] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:19.248303 16354 raft_consensus.cc:2468] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 8.
I20260709 13:07:19.247649 16173 leader_election.cc:304] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:07:19.254985 16357 raft_consensus.cc:2468] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 10.
I20260709 13:07:19.252936 16246 leader_election.cc:304] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:19.255174 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:07:19.261657 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 201170us
I20260709 13:07:19.266428 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:19.267746 16943 raft_consensus.cc:2393] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 12: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:07:19.267343 20562 raft_consensus.cc:2749] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:19.268883 16946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f022e2e63ae4461d834e476ff2666991" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:19.270526 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:19.272784 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:19.274816 20592 leader_election.cc:290] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:07:19.275022 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 45740.1us
I20260709 13:07:19.276247 16173 leader_election.cc:304] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:07:19.277266 20624 raft_consensus.cc:2749] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:19.247332 20591 raft_consensus.cc:515] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:19.281227 20591 leader_election.cc:290] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:19.285581 20624 raft_consensus.cc:493] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.286247 20624 raft_consensus.cc:515] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:19.291447 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:19.290035 16353 raft_consensus.cc:2468] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 8.
I20260709 13:07:19.299232 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:19.300932 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bc3c8ff9b84838a2664335d7e1582b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:19.301791 16201 raft_consensus.cc:2468] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 9.
I20260709 13:07:19.302461 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:19.299253 16203 raft_consensus.cc:2468] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 7.
I20260709 13:07:19.304246 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:19.305534 20679 leader_election.cc:290] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 7 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:07:19.306497 16247 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.307155 20624 leader_election.cc:290] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:19.304284 20657 raft_consensus.cc:2804] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:19.300778 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:19.309239 16205 raft_consensus.cc:3060] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:19.310453 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:19.287313 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:19.313338 20623 leader_election.cc:290] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:07:19.321044 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 57649.3us
W20260709 13:07:19.317780 20714 log.cc:927] Time spent T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.288s	user 0.000s	sys 0.002s
I20260709 13:07:19.350155 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:19.357062 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:19.365808 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:19.366922 16201 raft_consensus.cc:2393] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 5: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:07:19.298207 20602 raft_consensus.cc:515] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:19.375203 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:19.382970 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:19.383261 16205 raft_consensus.cc:2468] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 15.
I20260709 13:07:19.383859 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:19.333294 20657 raft_consensus.cc:697] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:07:19.390368 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:19.392192 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:07:19.395413 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.398507 20520 raft_consensus.cc:3055] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:19.399044 20520 raft_consensus.cc:740] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:07:19.402271 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:19.403510 16201 raft_consensus.cc:2468] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 12.
I20260709 13:07:19.404228 16199 raft_consensus.cc:2393] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 7: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
W20260709 13:07:19.407560 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 119979us
I20260709 13:07:19.408865 20623 consensus_queue.cc:1048] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:19.333967 20592 consensus_queue.cc:1048] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 13:07:19.416761 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:19.421041 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bc3c8ff9b84838a2664335d7e1582b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:19.423930 16206 raft_consensus.cc:2393] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 9: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:07:19.428258 16282 raft_consensus.cc:1275] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:07:19.431981 20657 consensus_queue.cc:237] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:19.436764 16320 leader_election.cc:304] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:19.436932 20660 consensus_queue.cc:1048] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:19.437736 20665 raft_consensus.cc:2804] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:19.438169 20665 raft_consensus.cc:493] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:19.438570 20665 raft_consensus.cc:3060] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:19.435838 16203 raft_consensus.cc:2393] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 14: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
W20260709 13:07:19.439834 16321 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.398068 20618 consensus_queue.cc:1059] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 13:07:19.446681 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:19.451184 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:19.452625 16320 leader_election.cc:304] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:19.415622 20523 raft_consensus.cc:493] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:19.454159 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:19.453717 20489 raft_consensus.cc:493] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:19.466885 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:19.400038 20520 consensus_queue.cc:260] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:19.471675 16278 raft_consensus.cc:1240] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:19.472048 20520 raft_consensus.cc:3060] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:19.460943 20694 raft_consensus.cc:493] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.473546 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:19.477582 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:19.478523 16206 raft_consensus.cc:2393] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 10: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:07:19.463913 20602 leader_election.cc:290] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:19.484316 16248 leader_election.cc:304] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:07:19.478940 20617 raft_consensus.cc:2804] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:19.487600 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:19.484175 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:19.488190 20617 raft_consensus.cc:697] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 15 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:19.490670 20489 raft_consensus.cc:515] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:19.491499 20617 consensus_queue.cc:237] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:19.493340 20687 raft_consensus.cc:493] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.494551 16278 raft_consensus.cc:2393] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 in current term 8: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:07:19.493434 20489 leader_election.cc:290] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:19.490005 16281 raft_consensus.cc:2468] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 14.
I20260709 13:07:19.500427 20602 raft_consensus.cc:493] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:19.479573 20523 raft_consensus.cc:515] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:19.476826 20694 raft_consensus.cc:515] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:19.500857 16248 leader_election.cc:304] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:19.502873 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:19.504452 16173 leader_election.cc:400] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 election: Vote denied by peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823) with higher term. Message: Invalid argument: T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for earlier term 7. Current term is 8.
I20260709 13:07:19.502866 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:19.506839 16173 leader_election.cc:403] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:07:19.507941 16947 raft_consensus.cc:2410] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:07:19.503160 20602 raft_consensus.cc:515] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:19.512140 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:19.512491 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:19.512617 16278 raft_consensus.cc:2393] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 10: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:07:19.494122 20687 raft_consensus.cc:515] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:19.514142 16207 raft_consensus.cc:2410] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:07:19.501746 20592 raft_consensus.cc:2804] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:19.515630 16200 raft_consensus.cc:1275] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:07:19.512624 20623 raft_consensus.cc:2749] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823) with higher term. Message: Invalid argument: T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for earlier term 7. Current term is 8.
I20260709 13:07:19.531374 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f022e2e63ae4461d834e476ff2666991" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:19.515976 20592 raft_consensus.cc:493] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:19.530714 16173 leader_election.cc:400] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 election: Vote denied by peer 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875) with higher term. Message: Invalid argument: T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for earlier term 6. Current term is 7.
I20260709 13:07:19.536443 16173 leader_election.cc:403] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:07:19.537425 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:19.530092 20618 consensus_queue.cc:1048] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 13:07:19.538483 16200 raft_consensus.cc:2410] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:07:19.538285 20523 leader_election.cc:290] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:19.530112 20489 raft_consensus.cc:2804] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:19.526630 19940 raft_consensus.cc:3055] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:19.544782 16281 raft_consensus.cc:1275] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:07:19.567507 19940 raft_consensus.cc:740] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:19.568389 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:19.568662 19940 consensus_queue.cc:260] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:07:19.546478 20721 log.cc:927] Time spent T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.143s	user 0.003s	sys 0.000s
I20260709 13:07:19.572777 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:19.573805 20623 raft_consensus.cc:2749] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875) with higher term. Message: Invalid argument: T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for earlier term 6. Current term is 7.
I20260709 13:07:19.547971 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:19.548295 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:19.552376 20687 leader_election.cc:290] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:19.574378 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:19.578013 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:19.547776 20602 leader_election.cc:290] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:19.549531 20694 leader_election.cc:290] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:19.554661 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:19.559119 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:19.535117 20592 raft_consensus.cc:3060] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:19.579638 16275 raft_consensus.cc:3060] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:19.554531 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:19.556034 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:07:19.564271 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 63560.1us
I20260709 13:07:19.583519 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:19.583803 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:19.552938 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:19.584441 16278 raft_consensus.cc:3060] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:19.585376 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:19.585767 16248 leader_election.cc:304] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:19.551036 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:07:19.566475 16912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.587930 16912 leader_election.cc:304] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:19.545895 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:19.544356 20489 raft_consensus.cc:493] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:19.590500 16276 raft_consensus.cc:2376] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 8. Re-sending same reply.
I20260709 13:07:19.590924 20489 raft_consensus.cc:3060] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:19.591638 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:19.584437 16280 raft_consensus.cc:2393] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 12: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:07:19.593894 20679 raft_consensus.cc:2804] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:19.594520 20679 raft_consensus.cc:697] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [term 9 LEADER]: Becoming Leader. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:07:19.595541 20679 consensus_queue.cc:237] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:19.585990 16279 raft_consensus.cc:3060] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:19.601712 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:07:19.569113 16281 raft_consensus.cc:2468] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 13.
I20260709 13:07:19.612226 16943 raft_consensus.cc:2393] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 9: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
I20260709 13:07:19.597168 20592 raft_consensus.cc:515] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:19.613726 16282 raft_consensus.cc:1240] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:19.614415 16277 raft_consensus.cc:2393] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 in current term 10: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:07:19.614367 20602 consensus_queue.cc:1048] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:19.617818 16277 raft_consensus.cc:1275] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:07:19.599510 16912 leader_election.cc:304] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
W20260709 13:07:19.600494 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 71866us
I20260709 13:07:19.570307 19940 raft_consensus.cc:3060] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:19.629225 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:19.634081 16275 raft_consensus.cc:2468] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 12.
I20260709 13:07:19.645390 16279 raft_consensus.cc:2410] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for term 14 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 13:07:19.646441 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:19.646513 16206 raft_consensus.cc:1217] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 LEADER]: Deduplicated request from leader. Original: 8.6->[9.7-9.7]   Dedup: 9.7->[]
W20260709 13:07:19.649744 16247 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.621428 20602 consensus_queue.cc:1059] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 13:07:19.655465 16278 raft_consensus.cc:2410] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for term 16 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:07:19.655584 16203 raft_consensus.cc:1275] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:07:19.657182 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:19.648648 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f022e2e63ae4461d834e476ff2666991" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:19.663312 16206 raft_consensus.cc:1240] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 LEADER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:07:19.616622 20592 leader_election.cc:290] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 election: Requested vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:19.665509 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:19.672581 16278 raft_consensus.cc:3060] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:19.662369 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:19.671088 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
W20260709 13:07:19.673867 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 46148.1us
I20260709 13:07:19.674294 16200 raft_consensus.cc:3060] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:19.630312 20623 raft_consensus.cc:493] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.681649 16276 raft_consensus.cc:1240] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:19.635821 20694 raft_consensus.cc:2749] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:19.687386 16279 raft_consensus.cc:2393] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 14: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:07:19.687203 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:19.690867 16282 raft_consensus.cc:3060] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:19.654757 20687 raft_consensus.cc:2804] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:19.695663 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:19.696372 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:19.698567 16246 leader_election.cc:304] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:19.701483 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bc3c8ff9b84838a2664335d7e1582b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:19.675344 20355 consensus_queue.cc:1048] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.029s
I20260709 13:07:19.712419 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:19.713588 16281 raft_consensus.cc:2368] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for earlier term 9. Current term is 10.
I20260709 13:07:19.668722 20633 raft_consensus.cc:493] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.715003 20633 raft_consensus.cc:515] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:07:19.702246 16283 raft_consensus.cc:2468] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 8.
I20260709 13:07:19.717427 20633 leader_election.cc:290] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:19.717837 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:19.719331 20440 raft_consensus.cc:2804] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:19.719823 20440 raft_consensus.cc:493] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:19.720150 20440 raft_consensus.cc:3060] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:19.720661 16246 leader_election.cc:304] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:19.721673 20592 raft_consensus.cc:2749] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:19.723452 16283 raft_consensus.cc:2410] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:07:19.723219 20489 raft_consensus.cc:515] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:19.698974 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c15d8e9be8414c84912ab77b66bfb1" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:19.725540 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:19.726024 16246 leader_election.cc:304] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:19.694833 16914 leader_election.cc:304] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:19.734164 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:19.733726 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:19.688160 20523 raft_consensus.cc:493] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.736760 16173 leader_election.cc:304] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:19.738131 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:19.732203 16278 raft_consensus.cc:2468] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 15.
I20260709 13:07:19.739024 16200 raft_consensus.cc:2468] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 8.
I20260709 13:07:19.697441 20687 raft_consensus.cc:493] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:19.739468 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 58505.6us
W20260709 13:07:19.733490 20723 log.cc:927] Time spent T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:07:19.749006 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:19.751180 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:19.752138 16283 raft_consensus.cc:2410] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:07:19.752080 16246 leader_election.cc:304] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:19.630257 20665 raft_consensus.cc:515] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:07:19.760993 16247 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.757817 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:19.758602 16277 raft_consensus.cc:2393] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 8: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
W20260709 13:07:19.760033 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 77957.3us
I20260709 13:07:19.763091 16278 raft_consensus.cc:3060] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:19.765900 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
W20260709 13:07:19.766346 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 90711.4us
I20260709 13:07:19.766702 16941 raft_consensus.cc:2468] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 7.
I20260709 13:07:19.697746 20623 raft_consensus.cc:515] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:19.745458 20592 raft_consensus.cc:2749] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:19.750705 20702 raft_consensus.cc:2749] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:19.751219 20687 raft_consensus.cc:3060] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:19.757388 20602 raft_consensus.cc:2749] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:19.783804 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:19.776648 16947 raft_consensus.cc:1275] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:07:19.802270 16275 raft_consensus.cc:2468] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 14.
W20260709 13:07:19.809942 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.810217 16943 raft_consensus.cc:2468] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 8.
I20260709 13:07:19.811834 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:19.817755 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:19.818800 16277 raft_consensus.cc:2468] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 8.
I20260709 13:07:19.757285 20523 raft_consensus.cc:515] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:19.759385 20659 consensus_queue.cc:1048] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 13:07:19.822395 16279 raft_consensus.cc:2468] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 9.
I20260709 13:07:19.824133 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:19.786294 20624 raft_consensus.cc:2804] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:19.827450 16946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
W20260709 13:07:19.853250 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 77193.6us
I20260709 13:07:19.809831 20691 raft_consensus.cc:493] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.855175 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
W20260709 13:07:19.854894 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 189767us
I20260709 13:07:19.858635 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:19.858635 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:19.859375 16356 raft_consensus.cc:2468] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 9.
I20260709 13:07:19.857640 16349 raft_consensus.cc:1240] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:19.861655 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:19.861794 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:19.864387 16278 raft_consensus.cc:2468] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 15.
I20260709 13:07:19.868050 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:19.868496 16352 raft_consensus.cc:1275] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:07:19.811017 20660 raft_consensus.cc:493] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:19.871909 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bc3c8ff9b84838a2664335d7e1582b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:19.872614 16283 raft_consensus.cc:2468] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 8.
I20260709 13:07:19.872400 16278 raft_consensus.cc:1240] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:19.878114 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:19.849571 20603 raft_consensus.cc:493] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.880038 16275 raft_consensus.cc:2393] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 14: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:07:19.882229 16351 raft_consensus.cc:1275] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:07:19.850239 20592 raft_consensus.cc:493] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.890280 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:19.905717 20624 raft_consensus.cc:697] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
W20260709 13:07:19.908068 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 231492us
I20260709 13:07:19.811204 20679 consensus_queue.cc:1059] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.062s
I20260709 13:07:19.913620 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:07:19.914052 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:19.916272 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:19.920392 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c15d8e9be8414c84912ab77b66bfb1" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:19.921861 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:19.922449 16352 raft_consensus.cc:2468] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 14.
I20260709 13:07:19.927321 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:19.930356 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:19.931290 16351 raft_consensus.cc:2393] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 15: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:07:19.933290 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:19.933957 16352 raft_consensus.cc:3060] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:19.934015 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:19.936038 16279 raft_consensus.cc:1275] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:07:19.944486 16946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:07:19.945319 16946 raft_consensus.cc:3060] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:19.938314 16277 raft_consensus.cc:2468] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 12.
I20260709 13:07:19.954782 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:19.956772 16275 raft_consensus.cc:1240] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 10. Current term is 11. Ops: [10.6-10.6]
W20260709 13:07:19.964937 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 108090us
I20260709 13:07:19.959264 20660 raft_consensus.cc:515] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:19.969602 20660 leader_election.cc:290] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:19.971206 16277 raft_consensus.cc:1240] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:19.972671 16277 raft_consensus.cc:1240] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:19.973184 16352 raft_consensus.cc:2468] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 10.
W20260709 13:07:19.965700 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 97297.2us
I20260709 13:07:19.907668 20624 consensus_queue.cc:237] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:07:19.982013 20733 log.cc:927] Time spent T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
W20260709 13:07:19.984890 20728 log.cc:927] Time spent T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.161s	user 0.001s	sys 0.000s
I20260709 13:07:19.986104 20665 leader_election.cc:290] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 10 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:19.910346 20603 raft_consensus.cc:515] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:19.869997 20691 raft_consensus.cc:515] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:07:19.987864 16321 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:19.985363 16354 raft_consensus.cc:2468] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 14.
I20260709 13:07:19.978803 16349 raft_consensus.cc:2468] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 11.
W20260709 13:07:19.995179 16912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.012470 16248 leader_election.cc:304] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:20.033882 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bc3c8ff9b84838a2664335d7e1582b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:19.924520 20592 raft_consensus.cc:515] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:19.999965 16352 raft_consensus.cc:1240] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 14. Current term is 15. Ops: []
W20260709 13:07:20.002166 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 123662us
I20260709 13:07:20.014042 16281 raft_consensus.cc:2468] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 8.
I20260709 13:07:20.035081 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:07:20.039737 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 65043.9us
I20260709 13:07:20.041872 16348 raft_consensus.cc:2393] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 10: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:07:20.038338 16248 leader_election.cc:304] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:20.039435 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:20.041956 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:20.044296 16356 raft_consensus.cc:2368] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for earlier term 4. Current term is 5.
I20260709 13:07:19.997817 16282 raft_consensus.cc:2468] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 10.
I20260709 13:07:20.046137 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:20.041383 16350 raft_consensus.cc:2468] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 16.
I20260709 13:07:20.041571 16352 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157"
dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
mode: GRACEFUL
new_leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
 from {username='slave'} at 127.0.0.1:56792
I20260709 13:07:20.050580 16349 raft_consensus.cc:2468] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 9.
I20260709 13:07:20.050634 16352 raft_consensus.cc:606] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Received request to transfer leadership to TS 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:07:20.051318 16352 raft_consensus.cc:614] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:20.030963 20659 raft_consensus.cc:2749] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:20.059527 16914 leader_election.cc:304] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:20.056847 16248 leader_election.cc:304] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:20.060269 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:20.061162 16322 leader_election.cc:304] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:07:20.061494 16357 raft_consensus.cc:2468] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 11.
I20260709 13:07:20.064036 16351 raft_consensus.cc:1275] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:07:20.039811 20702 raft_consensus.cc:493] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:20.032065 20742 consensus_queue.cc:1048] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 13:07:20.081315 16173 leader_election.cc:304] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:20.096873 20661 raft_consensus.cc:2749] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:20.098057 16173 leader_election.cc:304] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:20.077889 20702 raft_consensus.cc:515] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:20.103072 20702 leader_election.cc:290] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:20.077279 20659 raft_consensus.cc:2749] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:07:20.107933 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 48482.7us
I20260709 13:07:20.061200 20562 consensus_queue.cc:1059] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 13:07:20.111186 20440 raft_consensus.cc:515] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:20.053180 20520 raft_consensus.cc:2749] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:07:20.114995 20736 log.cc:927] Time spent T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:07:20.118233 16946 raft_consensus.cc:2468] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 10.
I20260709 13:07:20.088531 20623 leader_election.cc:290] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:20.114749 20748 consensus_queue.cc:1048] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.008s
I20260709 13:07:20.090250 20523 leader_election.cc:290] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:20.121803 16914 leader_election.cc:304] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 363bb2f744eb486f9ad726f08214c98e
W20260709 13:07:20.069316 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 157906us
I20260709 13:07:20.116432 20618 raft_consensus.cc:2749] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:20.071691 20746 consensus_queue.cc:1059] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.054s
I20260709 13:07:20.134971 20440 leader_election.cc:290] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:20.131108 16949 raft_consensus.cc:2955] T 540bfc4ad793452faea5b865343aacf7 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 LEARNER]: Committing config change with OpId 8.6: config changed from index -1 to 6, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:07:20.143903 20592 leader_election.cc:290] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:20.146488 20617 raft_consensus.cc:493] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.147243 20617 raft_consensus.cc:515] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:20.151324 20603 leader_election.cc:290] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:07:20.154402 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:20.154860 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 120985us
I20260709 13:07:20.155767 16322 leader_election.cc:304] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:20.156723 20603 raft_consensus.cc:2749] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:20.158694 20747 raft_consensus.cc:2749] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:20.159081 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:20.159734 20603 raft_consensus.cc:493] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:20.160068 16203 raft_consensus.cc:2468] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 11.
W20260709 13:07:20.160715 16249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.160396 20603 raft_consensus.cc:515] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:20.163420 20603 leader_election.cc:290] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:20.166909 16206 raft_consensus.cc:1275] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:07:20.118162 20752 raft_consensus.cc:2749] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:20.172782 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:20.171789 16322 leader_election.cc:304] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:20.176358 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bc3c8ff9b84838a2664335d7e1582b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:20.177109 16203 raft_consensus.cc:3060] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:20.127967 20661 raft_consensus.cc:3055] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:20.181206 16173 leader_election.cc:400] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 election: Vote denied by peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107) with higher term. Message: Invalid argument: T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for earlier term 10. Current term is 11.
W20260709 13:07:20.181399 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 124649us
I20260709 13:07:20.184168 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:20.150413 20617 leader_election.cc:290] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:20.187176 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:20.188839 20749 raft_consensus.cc:2804] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:20.189509 20746 raft_consensus.cc:493] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:20.191987 20623 raft_consensus.cc:3055] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:20.192395 20691 leader_election.cc:290] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:20.181025 20661 raft_consensus.cc:740] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:07:20.222380 16173 leader_election.cc:304] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
W20260709 13:07:20.224032 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 105490us
I20260709 13:07:20.214744 16203 raft_consensus.cc:2468] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 10.
I20260709 13:07:20.186086 20603 raft_consensus.cc:493] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.228479 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:07:20.231315 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 59629.8us
I20260709 13:07:20.231530 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:20.232481 16322 leader_election.cc:304] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:20.234405 16322 leader_election.cc:304] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:20.236707 20617 raft_consensus.cc:2749] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:20.236837 20745 raft_consensus.cc:2749] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:20.179550 20687 raft_consensus.cc:515] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:07:20.248600 16247 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.215636 20623 raft_consensus.cc:740] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
W20260709 13:07:20.260399 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 43638us
I20260709 13:07:20.260885 16322 leader_election.cc:304] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:07:20.261694 16248 leader_election.cc:304] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:20.217449 20749 raft_consensus.cc:697] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 8 LEADER]: Becoming Leader. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:07:20.272558 16941 raft_consensus.cc:2393] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 8: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
I20260709 13:07:20.260862 20761 raft_consensus.cc:493] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.267077 20747 raft_consensus.cc:2804] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:20.233714 20746 raft_consensus.cc:515] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:20.236375 20603 raft_consensus.cc:515] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:20.287199 16173 leader_election.cc:304] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:20.290099 20747 raft_consensus.cc:697] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:07:20.290570 20749 consensus_queue.cc:237] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:20.293438 20591 raft_consensus.cc:3055] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:20.297510 20687 leader_election.cc:290] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 8 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:20.297755 20760 raft_consensus.cc:2804] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:20.298039 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:20.283424 20745 raft_consensus.cc:2804] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:20.285737 20691 raft_consensus.cc:2749] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:20.297592 16248 leader_election.cc:304] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:07:20.308429 16320 leader_election.cc:304] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:20.298923 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:20.299749 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:20.275899 20751 consensus_queue.cc:1048] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 13:07:20.325727 16204 raft_consensus.cc:1275] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:07:20.324170 20624 raft_consensus.cc:2749] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:07:20.332983 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.350194 16203 raft_consensus.cc:2468] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 10.
I20260709 13:07:20.299438 20661 consensus_queue.cc:260] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:20.373907 20661 raft_consensus.cc:3060] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:20.316479 20760 raft_consensus.cc:493] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:20.374893 20760 raft_consensus.cc:3060] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:20.375528 20751 raft_consensus.cc:2804] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:20.376118 20751 raft_consensus.cc:493] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:20.376518 20751 raft_consensus.cc:3060] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:20.320645 20745 raft_consensus.cc:493] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:20.379276 20745 raft_consensus.cc:3060] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:20.207649 16094 maintenance_manager.cc:643] P 4dc6f08597514f4d85fd451b999b403e: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 10.061s	user 0.220s	sys 0.064s Metrics: {"bytes_written":30041,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":119345,"dirs.run_cpu_time_us":593,"dirs.run_wall_time_us":35721,"drs_written":1,"lbm_read_time_us":957,"lbm_reads_lt_1ms":4,"lbm_write_time_us":230608,"lbm_writes_1-10_ms":2,"lbm_writes_10-100_ms":7,"lbm_writes_lt_1ms":25,"peak_mem_usage":0,"reinsert_count":0,"rows_written":63,"thread_start_us":34794,"threads_started":1,"update_count":9}
I20260709 13:07:20.310703 20591 raft_consensus.cc:740] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:07:20.331983 20623 consensus_queue.cc:260] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:20.386736 20591 consensus_queue.cc:260] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:20.311976 20761 raft_consensus.cc:515] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:20.399374 16248 leader_election.cc:304] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:07:20.398669 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 110431us
W20260709 13:07:20.397974 19940 consensus_meta.cc:287] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 0.748s	user 0.014s	sys 0.000s
W20260709 13:07:20.539340 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 140142us
I20260709 13:07:20.540628 16248 leader_election.cc:304] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:20.386392 16095 maintenance_manager.cc:419] P 4dc6f08597514f4d85fd451b999b403e: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 9632 bytes on disk
W20260709 13:07:20.423796 16102 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55244 (request call id 130) took 19110 ms (client timeout 15000 ms). Trace:
W20260709 13:07:20.558941 20730 log.cc:927] Time spent T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.152s	user 0.001s	sys 0.000s
I20260709 13:07:20.435220 16246 leader_election.cc:304] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
W20260709 13:07:20.586068 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 150942us
I20260709 13:07:20.472519 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:20.475695 16200 raft_consensus.cc:1275] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:07:20.477447 20737 raft_consensus.cc:3055] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:07:20.545953 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 136804us
W20260709 13:07:20.546782 20753 log.cc:927] Time spent T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.119s	user 0.000s	sys 0.001s
I20260709 13:07:20.547292 20759 raft_consensus.cc:2804] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:20.547921 20746 leader_election.cc:290] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:20.381561 20747 consensus_queue.cc:237] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:07:20.558933 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 139133us
I20260709 13:07:20.575140 20694 raft_consensus.cc:2749] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:20.600726 16914 leader_election.cc:304] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:07:20.398365 20591 raft_consensus.cc:3060] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:20.542418 16248 leader_election.cc:304] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:20.428587 20489 leader_election.cc:290] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:20.538785 20691 raft_consensus.cc:2749] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:07:20.596732 16208 raft_consensus.cc:2393] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 in current term 8: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
W20260709 13:07:20.658516 16249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.660696 20659 raft_consensus.cc:493] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.598767 20759 raft_consensus.cc:493] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:20.698958 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:20.695308 20603 leader_election.cc:290] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:07:20.660684 16321 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:20.715565 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 173256us
I20260709 13:07:20.680012 16207 raft_consensus.cc:1275] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:07:20.660005 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:07:20.581642 16102 rpcz_store.cc:269] 0709 13:07:01.312660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:01.312896 (+   236us) service_pool.cc:224] Handling call
0709 13:07:02.647613 (+1334717us) spinlock_profiling.cc:243] Waited 442 ms on lock 0x7b5400137754. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f3090 00007f361f491f3a 00007f36252481cc 00007f362534637e 00007f36238072a4 00007f3623807232 00007f3623807161 00007f36238070dc 00007f3623806392 00007f361d7c448c 00007f361d7c38c6
0709 13:07:20.423470 (+17775857us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:18.401658 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:18.402287 (+   629us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:18.402322 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:07:18.402347 (+    25us) tablet.cc:662] Decoding operations
0709 13:07:18.472164 (+ 69817us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:18.474360 (+  2196us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:18.478658 (+  4298us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:07:18.505881 (+ 27223us) tablet.cc:701] Row locks acquired
0709 13:07:18.513895 (+  8014us) write_op.cc:260] PREPARE: finished
0709 13:07:18.527298 (+ 13403us) write_op.cc:270] Start()
0709 13:07:18.533209 (+  5911us) write_op.cc:276] Timestamp: P: 1783602438524998 usec, L: 0
0709 13:07:18.534644 (+  1435us) op_driver.cc:348] REPLICATION: starting
0709 13:07:18.552359 (+ 17715us) log.cc:844] Serialized 1302 byte log entry
0709 13:07:18.747856 (+195497us) op_driver.cc:464] REPLICATION: finished
0709 13:07:18.970715 (+222859us) write_op.cc:301] APPLY: starting
0709 13:07:19.004724 (+ 34009us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:19.062440 (+ 57716us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:19.088395 (+ 25955us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:19.516083 (+427688us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:19.562700 (+ 46617us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=3,key_file_lookups=3,delta_file_lookups=3,mrs_lookups=6
0709 13:07:19.562751 (+    51us) write_op.cc:312] APPLY: finished
0709 13:07:19.563170 (+   419us) log.cc:844] Serialized 53 byte log entry
0709 13:07:19.635328 (+ 72158us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:19.635511 (+   183us) write_op.cc:454] Released schema lock
0709 13:07:19.668511 (+ 33000us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:19.706553 (+ 38042us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:19.706604 (+    51us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":6650810,"reported_tablets":4,"spinlock_wait_cycles":1016796032,"child_traces":[["op",{"apply.queue_time_us":124183,"apply.run_cpu_time_us":25567,"apply.run_wall_time_us":819173,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4180,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6217,"cfile_init":2,"lbm_read_time_us":48747,"lbm_reads_1-10_ms":4,"lbm_reads_10-100_ms":1,"lbm_reads_lt_1ms":7,"num_ops":3,"prepare.queue_time_us":639566,"prepare.run_cpu_time_us":6105,"prepare.run_wall_time_us":152232,"raft.queue_time_us":186281,"raft.run_cpu_time_us":10271,"raft.run_wall_time_us":33347,"replication_time_us":209468,"thread_start_us":372677,"threads_started":5,"wal-append.queue_time_us":132265,"wal-append.run_cpu_time_us":2808,"wal-append.run_wall_time_us":1002838}]]}
W20260709 13:07:20.728549 20727 log.cc:927] Time spent T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.850s	user 0.006s	sys 0.000s
I20260709 13:07:20.654577 20748 raft_consensus.cc:2764] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:07:20.672139 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:20.661701 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:07:20.697000 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 394186us
W20260709 13:07:20.659729 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 60427.7us
I20260709 13:07:20.603416 16094 maintenance_manager.cc:643] P 4dc6f08597514f4d85fd451b999b403e: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.017s	user 0.002s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":447,"lbm_reads_lt_1ms":4}
I20260709 13:07:20.596571 20657 raft_consensus.cc:2804] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:20.656260 16914 leader_election.cc:304] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:20.593261 20737 raft_consensus.cc:740] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
W20260709 13:07:20.705610 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 418483us
I20260709 13:07:20.673276 20767 raft_consensus.cc:493] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:20.672351 20752 consensus_queue.cc:1059] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.043s
W20260709 13:07:20.734287 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 78153.7us
I20260709 13:07:20.729585 16205 raft_consensus.cc:2468] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 16.
I20260709 13:07:20.760878 16248 leader_election.cc:304] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:20.624574 20758 consensus_queue.cc:1048] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.090s
I20260709 13:07:20.714370 20759 raft_consensus.cc:3060] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:20.794911 20738 raft_consensus.cc:493] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.860741 16106 catalog_manager.cc:5697] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 8 to 11, leader changed from 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) to e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65). New cstate: current_term: 11 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
W20260709 13:07:20.834935 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 102159us
I20260709 13:07:20.818320 20761 leader_election.cc:290] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:07:20.818971 20770 log.cc:927] Time spent T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
W20260709 13:07:20.834895 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 102611us
I20260709 13:07:20.922428 16322 leader_election.cc:304] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
W20260709 13:07:20.820297 16174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:20.926853 16174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.714666 20659 raft_consensus.cc:515] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:20.723662 20694 raft_consensus.cc:493] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.733422 20742 raft_consensus.cc:2749] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:07:20.877524 20760 consensus_meta.cc:287] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 0.502s	user 0.012s	sys 0.001s
I20260709 13:07:20.845827 20745 raft_consensus.cc:515] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:07:20.767657 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:20.847138 20751 raft_consensus.cc:515] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:07:20.856014 20749 raft_consensus.cc:2749] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:20.855461 20657 raft_consensus.cc:697] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:07:20.945240 20760 raft_consensus.cc:515] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:20.822180 20623 raft_consensus.cc:3060] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:20.948580 20764 raft_consensus.cc:2749] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:07:20.918233 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 157528us
I20260709 13:07:20.949900 16248 leader_election.cc:304] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:07:20.931218 16246 leader_election.cc:304] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:20.950860 20702 consensus_queue.cc:1048] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:07:20.951515 16248 leader_election.cc:304] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:20.952948 20607 raft_consensus.cc:2804] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:20.953399 20607 raft_consensus.cc:493] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
W20260709 13:07:20.938835 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 202694us
I20260709 13:07:20.947481 20739 consensus_queue.cc:1048] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:20.954042 20607 raft_consensus.cc:3060] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:20.798734 20772 log.cc:927] Time spent T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.078s	user 0.000s	sys 0.004s
I20260709 13:07:20.953300 16248 leader_election.cc:304] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:20.954774 20687 consensus_queue.cc:1048] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.003s
I20260709 13:07:20.947919 20745 leader_election.cc:290] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:20.946305 20657 consensus_queue.cc:237] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:20.963409 20760 leader_election.cc:290] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:20.924005 20489 raft_consensus.cc:2749] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:20.960026 16320 leader_election.cc:304] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:20.967474 20489 raft_consensus.cc:2749] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:07:20.975190 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 52908.3us
I20260709 13:07:20.975940 16322 leader_election.cc:304] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:07:20.936841 20691 consensus_queue.cc:1048] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 13:07:20.961649 20591 raft_consensus.cc:3060] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:20.981012 20782 raft_consensus.cc:493] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.941195 20661 consensus_queue.cc:1048] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:07:20.940562 20694 raft_consensus.cc:515] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:20.970090 20742 raft_consensus.cc:2804] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:20.935110 20738 raft_consensus.cc:515] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:20.985373 20774 raft_consensus.cc:493] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:20.986478 20761 raft_consensus.cc:2749] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:20.986032 20782 raft_consensus.cc:515] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:20.987421 20737 consensus_queue.cc:260] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:20.974860 20521 raft_consensus.cc:2804] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:20.985908 16322 leader_election.cc:304] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:20.981308 16173 leader_election.cc:304] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:20.937704 20767 raft_consensus.cc:515] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:21.016149 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:07:21.029711 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 76687.8us
I20260709 13:07:21.017699 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:21.020232 16106 catalog_manager.cc:5697] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 7 to 8, leader changed from e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) to 363bb2f744eb486f9ad726f08214c98e (127.14.180.67). New cstate: current_term: 8 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } }
I20260709 13:07:20.978797 20489 raft_consensus.cc:493] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:21.023422 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:20.998618 20742 raft_consensus.cc:493] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:21.032593 16203 raft_consensus.cc:2393] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 7: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:07:21.034257 16106 catalog_manager.cc:5697] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 11 to 12, leader changed from 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) to e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65). New cstate: current_term: 12 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } }
I20260709 13:07:21.035050 20776 raft_consensus.cc:493] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:21.034333 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 53113us
I20260709 13:07:21.040987 16173 leader_election.cc:304] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:07:21.035830 20767 leader_election.cc:290] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:21.036051 20603 raft_consensus.cc:3060] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:21.036476 20521 raft_consensus.cc:697] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e [term 10 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:21.036351 20691 consensus_queue.cc:1048] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:21.037549 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c15d8e9be8414c84912ab77b66bfb1" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:07:21.038908 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 107880us
I20260709 13:07:21.030117 16206 raft_consensus.cc:2468] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 16.
W20260709 13:07:21.034332 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 48530.4us
I20260709 13:07:21.013329 20355 raft_consensus.cc:493] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.035738 20661 raft_consensus.cc:2749] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:21.045022 16173 leader_election.cc:400] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 election: Vote denied by peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107) with higher term. Message: Invalid argument: T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for earlier term 9. Current term is 10.
I20260709 13:07:21.055599 16173 leader_election.cc:403] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:07:21.021926 20745 consensus_queue.cc:1048] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:07:21.040352 20742 raft_consensus.cc:3060] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:21.071303 16322 leader_election.cc:304] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:21.073972 16106 catalog_manager.cc:5697] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: config changed from index -1 to 6, term changed from 8 to 9, leader changed from e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) to <none>, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New cstate: current_term: 9 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:07:21.075183 20694 leader_election.cc:290] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:21.077137 16106 catalog_manager.cc:5697] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "1109f76a0b7b443a84c0327c8707bc63" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:07:21.045234 20776 raft_consensus.cc:515] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:21.079241 16106 catalog_manager.cc:5697] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } }
I20260709 13:07:21.080894 16106 catalog_manager.cc:5697] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 5 to 6, leader changed from 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) to 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66). New cstate: current_term: 6 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:21.081802 20776 leader_election.cc:290] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:07:21.089779 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 51845.1us
I20260709 13:07:21.091084 16248 leader_election.cc:304] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:21.084007 16320 leader_election.cc:304] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:21.054683 20624 raft_consensus.cc:2804] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:21.099500 16248 leader_election.cc:304] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:07:21.116868 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:21.043315 20489 raft_consensus.cc:515] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:21.091439 20737 raft_consensus.cc:3060] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:21.026505 20774 raft_consensus.cc:515] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:21.119429 16173 leader_election.cc:304] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:21.063344 20767 consensus_queue.cc:1048] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 13:07:21.128147 20786 raft_consensus.cc:2804] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:07:21.128602 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 74848.4us
I20260709 13:07:21.128901 20786 raft_consensus.cc:697] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:07:21.130693 20521 consensus_queue.cc:237] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:21.103511 20624 raft_consensus.cc:493] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
W20260709 13:07:21.146168 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 46775.7us
I20260709 13:07:21.142458 16322 leader_election.cc:304] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:21.147182 16248 leader_election.cc:304] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:21.106416 20660 raft_consensus.cc:2804] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:21.119431 20760 raft_consensus.cc:2749] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:07:21.063694 20355 raft_consensus.cc:515] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:21.105059 20694 raft_consensus.cc:2804] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:21.166747 20694 raft_consensus.cc:493] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:21.167263 20694 raft_consensus.cc:3060] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:21.125610 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:21.150864 20660 raft_consensus.cc:493] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:21.170998 16199 raft_consensus.cc:2468] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 10.
I20260709 13:07:21.171451 20660 raft_consensus.cc:3060] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:21.143173 16106 catalog_manager.cc:5697] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } }
I20260709 13:07:21.172806 16106 catalog_manager.cc:5697] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 12 to 13, leader changed from 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) to e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65). New cstate: current_term: 13 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } }
I20260709 13:07:21.140414 20774 leader_election.cc:290] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:21.149979 16322 leader_election.cc:304] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:21.153182 16248 leader_election.cc:304] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:21.176292 16248 leader_election.cc:304] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:21.177426 16248 leader_election.cc:304] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:07:21.150485 20624 raft_consensus.cc:3060] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:21.178455 20592 raft_consensus.cc:2749] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:21.157379 20776 raft_consensus.cc:2749] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:21.179908 20776 raft_consensus.cc:2804] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:21.179919 20592 raft_consensus.cc:2804] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:21.156277 20623 raft_consensus.cc:2804] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:21.180946 20592 raft_consensus.cc:493] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:21.181429 20623 raft_consensus.cc:697] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:07:21.181587 20592 raft_consensus.cc:3060] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:21.178748 20787 raft_consensus.cc:2749] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:07:21.160830 20785 log.cc:927] Time spent T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:07:21.130048 20786 consensus_queue.cc:237] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:21.182446 20623 consensus_queue.cc:237] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:21.184619 20607 raft_consensus.cc:515] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:21.180449 20776 raft_consensus.cc:697] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 15 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:21.188629 16322 leader_election.cc:304] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:21.187525 16320 leader_election.cc:304] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:21.178342 16248 leader_election.cc:304] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:21.192955 16248 leader_election.cc:304] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:21.199143 16322 leader_election.cc:304] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:07:21.202446 16943 raft_consensus.cc:1240] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:21.148361 20659 leader_election.cc:290] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:21.217366 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:07:21.206332 16322 leader_election.cc:304] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:21.157197 20657 raft_consensus.cc:2749] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:21.204550 16106 catalog_manager.cc:5697] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 6 to 7, leader changed from 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) to 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66). New cstate: current_term: 7 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:21.228588 16322 leader_election.cc:304] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:21.158007 20562 raft_consensus.cc:493] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:21.230297 16249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.229828 16106 catalog_manager.cc:5697] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } }
I20260709 13:07:21.232208 20760 raft_consensus.cc:2749] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:07:21.232823 20739 raft_consensus.cc:2749] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:21.233356 20764 consensus_queue.cc:1048] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:21.235426 16322 leader_election.cc:304] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:21.197759 20691 raft_consensus.cc:2749] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:21.203459 20617 raft_consensus.cc:2804] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:21.220645 19940 raft_consensus.cc:2804] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:21.203893 20787 raft_consensus.cc:2749] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:21.227546 20745 raft_consensus.cc:2749] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:21.276216 20745 raft_consensus.cc:2749] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:07:21.253417 20784 log.cc:927] Time spent T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
I20260709 13:07:21.261178 16106 catalog_manager.cc:5697] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 12 to 13, leader changed from 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) to 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66). New cstate: current_term: 13 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:21.278928 16106 catalog_manager.cc:5697] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 3 to 4, leader changed from e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) to 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68). New cstate: current_term: 4 leader_uuid: "1109f76a0b7b443a84c0327c8707bc63" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:07:21.267405 16248 leader_election.cc:304] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:21.268946 20786 raft_consensus.cc:493] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:21.245819 20562 raft_consensus.cc:515] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:21.283286 16248 leader_election.cc:304] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:07:21.286247 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:21.286983 16943 raft_consensus.cc:2468] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63 [term 9 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 9.
I20260709 13:07:21.288537 16949 raft_consensus.cc:1275] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:07:21.288817 20489 leader_election.cc:290] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:21.260185 20746 raft_consensus.cc:2749] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107) with higher term. Message: Invalid argument: T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for earlier term 9. Current term is 10.
W20260709 13:07:21.280901 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 161606us
I20260709 13:07:21.290356 20489 raft_consensus.cc:1064] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3: attempting to promote NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 to VOTER
I20260709 13:07:21.295854 16106 catalog_manager.cc:5697] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 7 to 9, leader changed from 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) to 363bb2f744eb486f9ad726f08214c98e (127.14.180.67). New cstate: current_term: 9 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } }
I20260709 13:07:21.297423 16248 leader_election.cc:304] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:21.267210 20617 raft_consensus.cc:493] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:21.280095 19940 raft_consensus.cc:493] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:21.291314 15057 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:07:21.310137 16946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:07:21.310781 16173 leader_election.cc:304] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:21.301822 16248 leader_election.cc:304] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:07:21.302405 20489 raft_consensus.cc:1068] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3: Unable to promote non-voter 1109f76a0b7b443a84c0327c8707bc63: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:07:21.304695 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
W20260709 13:07:21.313614 16174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.307389 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:21.312561 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:07:21.295244 20787 raft_consensus.cc:2804] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:21.292145 20659 raft_consensus.cc:2749] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:21.317554 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bc3c8ff9b84838a2664335d7e1582b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:21.279711 20776 consensus_queue.cc:237] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:21.355810 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:07:21.309774 20617 raft_consensus.cc:3060] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:21.363214 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.365312 16283 raft_consensus.cc:1275] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:07:21.313261 20691 raft_consensus.cc:2804] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:21.369792 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:07:21.318712 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 60643.8us
I20260709 13:07:21.337288 16279 raft_consensus.cc:1240] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 LEADER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:21.330101 16946 raft_consensus.cc:2468] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 7.
I20260709 13:07:21.328153 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:21.358073 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:21.371747 16278 raft_consensus.cc:2410] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:07:21.367803 16276 raft_consensus.cc:1275] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:07:21.367312 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:21.327653 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:07:21.344352 16174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:21.373733 16203 raft_consensus.cc:2468] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 11.
I20260709 13:07:21.320530 16173 leader_election.cc:304] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:21.360539 15057 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:21.364423 16106 catalog_manager.cc:5697] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 8 to 9, leader changed from 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) to 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66). New cstate: current_term: 9 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:21.291885 20786 raft_consensus.cc:515] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:21.380677 16199 raft_consensus.cc:1275] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:07:21.381119 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:21.383260 16205 raft_consensus.cc:2410] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:07:21.378360 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:21.360771 20603 raft_consensus.cc:2749] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:21.313445 19940 raft_consensus.cc:3060] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:21.387008 16246 leader_election.cc:304] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:21.387008 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:21.389053 16106 catalog_manager.cc:5697] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 9 to 10, leader changed from 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) to 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66). New cstate: current_term: 10 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:21.379223 20787 raft_consensus.cc:697] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:07:21.402127 20787 consensus_queue.cc:237] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:21.403623 20738 leader_election.cc:290] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:07:21.404615 20793 log.cc:927] Time spent T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63: Append to log took a long time: real 0.145s	user 0.001s	sys 0.000s
I20260709 13:07:21.381892 20739 raft_consensus.cc:493] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:21.356554 20355 leader_election.cc:290] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:21.406159 20739 raft_consensus.cc:515] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:21.364328 20623 raft_consensus.cc:2804] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:21.392791 16283 raft_consensus.cc:1240] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:21.393115 16201 raft_consensus.cc:2393] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 10: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:07:21.358253 20562 leader_election.cc:290] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:21.357728 20591 raft_consensus.cc:2749] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:21.394981 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:21.409556 16281 raft_consensus.cc:1275] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:21.384882 16274 raft_consensus.cc:2468] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 9.
I20260709 13:07:21.425155 16949 raft_consensus.cc:2468] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63 [term 9 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 9.
W20260709 13:07:21.400514 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 84068.6us
I20260709 13:07:21.376797 20691 raft_consensus.cc:493] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:21.372640 20798 raft_consensus.cc:2804] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:21.382393 20764 raft_consensus.cc:493] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:21.427044 16173 leader_election.cc:304] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:21.427603 20691 raft_consensus.cc:3060] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:21.360250 20742 raft_consensus.cc:515] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:21.432585 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:21.436544 16275 raft_consensus.cc:3060] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:21.421336 20489 raft_consensus.cc:2804] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:21.459165 16173 leader_election.cc:400] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 election: Vote denied by peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107) with higher term. Message: Invalid argument: T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for earlier term 4. Current term is 5.
I20260709 13:07:21.459792 16173 leader_election.cc:403] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:07:21.429438 20623 raft_consensus.cc:697] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [term 9 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:07:21.472790 16282 raft_consensus.cc:2393] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 17: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:07:21.427780 20798 raft_consensus.cc:493] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:21.424939 20694 raft_consensus.cc:515] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:21.443300 20489 raft_consensus.cc:493] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:21.444391 20774 raft_consensus.cc:2804] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:21.486661 20795 raft_consensus.cc:2804] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:07:21.499312 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 86043.9us
I20260709 13:07:21.498237 16275 raft_consensus.cc:2468] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 9.
I20260709 13:07:21.504364 16280 raft_consensus.cc:3060] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:21.504580 16248 leader_election.cc:304] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:21.505487 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c15d8e9be8414c84912ab77b66bfb1" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:21.506129 16275 raft_consensus.cc:2468] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 9.
I20260709 13:07:21.485394 20657 raft_consensus.cc:493] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.468597 20747 consensus_queue.cc:1059] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 13:07:21.486129 20798 raft_consensus.cc:3060] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:21.439653 20764 raft_consensus.cc:515] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:21.495630 20489 raft_consensus.cc:3060] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:21.522727 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:21.526304 16352 raft_consensus.cc:2468] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 10.
I20260709 13:07:21.529632 20660 raft_consensus.cc:515] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:21.532891 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:21.533643 16352 raft_consensus.cc:2468] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 11.
I20260709 13:07:21.549885 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:21.550017 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:21.551079 16354 raft_consensus.cc:2468] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 12.
I20260709 13:07:21.552954 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:21.554137 16357 raft_consensus.cc:2393] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 17: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:07:21.514024 20795 raft_consensus.cc:697] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [term 8 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:07:21.558331 16348 raft_consensus.cc:1240] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:21.559077 20801 raft_consensus.cc:493] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.559763 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:21.615736 16275 raft_consensus.cc:2468] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 10.
W20260709 13:07:21.560137 20804 log.cc:927] Time spent T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:07:21.560663 20806 raft_consensus.cc:493] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.561523 20800 raft_consensus.cc:493] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.562505 20739 leader_election.cc:290] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:07:21.563468 20802 log.cc:927] Time spent T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.136s	user 0.001s	sys 0.000s
I20260709 13:07:21.608556 16274 raft_consensus.cc:1240] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:07:21.516075 20657 raft_consensus.cc:515] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:21.619019 16354 raft_consensus.cc:1240] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:07:21.619181 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:21.544051 20660 leader_election.cc:290] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 17 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:21.557914 20745 raft_consensus.cc:493] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.620849 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:21.626847 16357 raft_consensus.cc:3060] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:21.628784 16356 raft_consensus.cc:1275] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:07:21.631500 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
W20260709 13:07:21.632176 20799 log.cc:927] Time spent T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.237s	user 0.000s	sys 0.001s
W20260709 13:07:21.633499 20759 consensus_meta.cc:287] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3: Time spent flushing consensus metadata: real 0.708s	user 0.009s	sys 0.002s
I20260709 13:07:21.627445 20800 raft_consensus.cc:515] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:21.628438 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:21.691936 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:21.624923 20774 raft_consensus.cc:697] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 8 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:07:21.702033 16348 raft_consensus.cc:2468] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 10.
I20260709 13:07:21.735982 20774 consensus_queue.cc:237] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:21.625774 20806 raft_consensus.cc:515] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:21.749554 16348 raft_consensus.cc:1275] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:07:21.750329 20800 leader_election.cc:290] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:21.751201 20806 leader_election.cc:290] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:21.732043 20694 leader_election.cc:290] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:21.757169 20657 leader_election.cc:290] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:21.757889 20742 leader_election.cc:290] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 17 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:21.759158 16349 raft_consensus.cc:2410] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
W20260709 13:07:21.759563 20807 log.cc:927] Time spent T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.150s	user 0.000s	sys 0.000s
I20260709 13:07:21.762789 20798 raft_consensus.cc:515] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:21.768739 20798 leader_election.cc:290] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 15 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:07:21.792757 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 333799us
I20260709 13:07:21.794778 16357 raft_consensus.cc:2468] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 8.
I20260709 13:07:21.628137 20786 leader_election.cc:290] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:21.811594 16280 raft_consensus.cc:2468] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 10.
I20260709 13:07:21.796386 16355 raft_consensus.cc:1240] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:21.701097 20759 raft_consensus.cc:515] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:21.620428 20801 raft_consensus.cc:515] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:21.813076 16173 leader_election.cc:304] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:21.814613 16173 leader_election.cc:304] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:21.818876 16173 leader_election.cc:304] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:21.705214 20758 raft_consensus.cc:493] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:21.811143 20592 consensus_meta.cc:287] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3: Time spent flushing consensus metadata: real 0.629s	user 0.007s	sys 0.007s
I20260709 13:07:21.616755 20623 consensus_queue.cc:237] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:07:21.721508 20815 raft_consensus.cc:2749] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:21.865922 16278 raft_consensus.cc:1240] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:21.874117 16353 raft_consensus.cc:1275] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:07:21.831480 20747 raft_consensus.cc:2804] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:21.885926 20607 leader_election.cc:290] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 election: Requested vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:21.937971 20746 raft_consensus.cc:2804] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:21.938614 20746 raft_consensus.cc:493] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:21.939054 20746 raft_consensus.cc:3060] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:21.940387 20355 raft_consensus.cc:493] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:21.941185 20355 raft_consensus.cc:515] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:21.956967 16914 leader_election.cc:304] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:21.692477 20745 raft_consensus.cc:515] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:21.958671 20748 raft_consensus.cc:2749] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:21.834095 20814 raft_consensus.cc:493] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:21.881970 20809 raft_consensus.cc:493] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:21.884668 20562 raft_consensus.cc:3055] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:21.865895 20751 leader_election.cc:290] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 12 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:21.970899 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:21.912307 20782 leader_election.cc:290] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:21.932631 20800 raft_consensus.cc:493] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:21.944013 20747 raft_consensus.cc:493] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:21.973594 16282 raft_consensus.cc:2468] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 10.
I20260709 13:07:21.971249 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:22.043022 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:21.869745 20592 raft_consensus.cc:515] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:21.946172 20816 raft_consensus.cc:2804] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:07:21.996434 16200 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.000s	sys 0.031s
W20260709 13:07:22.095743 16200 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.688s	user 0.005s	sys 0.032s
W20260709 13:07:21.992748 20624 consensus_meta.cc:287] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f: Time spent flushing consensus metadata: real 0.814s	user 0.010s	sys 0.003s
I20260709 13:07:22.079792 16281 raft_consensus.cc:2468] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 12.
I20260709 13:07:21.969238 20562 raft_consensus.cc:740] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:07:22.108142 16322 leader_election.cc:304] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:22.141158 16354 raft_consensus.cc:1240] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:22.176644 16276 raft_consensus.cc:1240] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:21.839502 20795 consensus_queue.cc:237] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:07:22.166956 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 328690us
W20260709 13:07:22.177999 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 69999.1us
I20260709 13:07:22.017396 20752 consensus_queue.cc:1048] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.119s
I20260709 13:07:21.863235 20758 raft_consensus.cc:515] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:21.975152 20489 raft_consensus.cc:515] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:22.075917 20782 raft_consensus.cc:493] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:22.182662 16322 leader_election.cc:304] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:22.092132 20747 raft_consensus.cc:3060] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:22.097321 20661 raft_consensus.cc:2749] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107) with higher term. Message: Invalid argument: T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for earlier term 4. Current term is 5.
I20260709 13:07:22.101289 20816 raft_consensus.cc:493] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:22.076767 20748 consensus_queue.cc:1059] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.109s
W20260709 13:07:22.203377 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:22.203001 16248 leader_election.cc:304] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:22.205178 16248 leader_election.cc:304] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:22.208555 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:22.208890 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:22.209676 16274 raft_consensus.cc:2393] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 9: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:07:21.976950 20809 raft_consensus.cc:515] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:22.224409 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:22.184960 20751 raft_consensus.cc:2804] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:22.103346 20800 raft_consensus.cc:515] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:21.970425 20814 raft_consensus.cc:515] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:22.235234 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:22.204982 16173 leader_election.cc:304] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:22.244788 16282 raft_consensus.cc:2393] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 17: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:07:22.236258 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:22.245754 16275 raft_consensus.cc:2468] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 8.
I20260709 13:07:22.211735 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:22.131345 20817 consensus_queue.cc:1048] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.251s
I20260709 13:07:22.127301 20624 raft_consensus.cc:515] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:22.217805 20798 raft_consensus.cc:2804] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:22.212621 20816 raft_consensus.cc:3060] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:22.184298 20591 consensus_queue.cc:1048] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 13:07:22.257117 16248 leader_election.cc:304] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:22.237571 20751 raft_consensus.cc:493] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:22.261270 20657 raft_consensus.cc:2749] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:07:22.261888 16171 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.610s	user 0.011s	sys 0.006s
I20260709 13:07:22.261754 16248 leader_election.cc:304] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:07:22.262323 16171 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.647s	user 0.011s	sys 0.006s
I20260709 13:07:22.261401 20811 raft_consensus.cc:2749] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:22.242318 20813 raft_consensus.cc:493] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:22.270795 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:07:22.272483 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 170359us
I20260709 13:07:22.263561 16248 leader_election.cc:304] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:07:22.279719 16914 leader_election.cc:304] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:07:22.200748 20782 raft_consensus.cc:515] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:22.223626 20810 consensus_queue.cc:1048] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.067s
I20260709 13:07:22.256430 20798 raft_consensus.cc:493] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:22.296360 16914 leader_election.cc:304] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:07:22.264448 20751 raft_consensus.cc:3060] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:22.285933 19940 consensus_meta.cc:287] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 0.856s	user 0.009s	sys 0.004s
I20260709 13:07:22.259871 20742 consensus_queue.cc:1059] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 13:07:22.311542 20748 raft_consensus.cc:2804] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:22.312601 20758 leader_election.cc:290] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:22.313171 20814 leader_election.cc:290] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:22.313336 20821 raft_consensus.cc:2804] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:22.313874 20830 raft_consensus.cc:2749] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:07:22.298365 16914 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 1.791s (SENT) [suppressed 6 similar messages]
W20260709 13:07:22.335813 16174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:22.336330 16174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:22.336114 16322 leader_election.cc:304] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:22.259159 20786 consensus_queue.cc:1059] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 13:07:22.264430 20694 consensus_queue.cc:1048] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.038s
I20260709 13:07:22.319234 20829 raft_consensus.cc:493] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:22.301106 20752 raft_consensus.cc:2804] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:22.330717 20826 raft_consensus.cc:2804] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:22.331455 20819 raft_consensus.cc:2804] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:22.335446 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:22.358265 16204 raft_consensus.cc:3060] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:22.295884 20813 raft_consensus.cc:515] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:22.338812 16322 leader_election.cc:304] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:22.339721 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:22.265944 20562 consensus_queue.cc:260] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:22.315543 19940 raft_consensus.cc:515] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:22.320740 20748 raft_consensus.cc:493] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:22.332253 20624 leader_election.cc:290] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 election: Requested vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:22.341557 20761 consensus_queue.cc:1048] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
W20260709 13:07:22.353485 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 148557us
I20260709 13:07:22.355783 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:22.299952 20798 raft_consensus.cc:3060] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:22.361457 16949 raft_consensus.cc:1275] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:07:22.329051 20809 leader_election.cc:290] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:22.328851 20742 raft_consensus.cc:493] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.350934 20752 raft_consensus.cc:493] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:22.371884 20782 leader_election.cc:290] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:22.372282 20489 leader_election.cc:290] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:22.406893 20752 raft_consensus.cc:3060] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:22.333657 20821 raft_consensus.cc:493] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:22.372891 20800 leader_election.cc:290] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:22.372763 20829 raft_consensus.cc:515] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:07:22.376621 16200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60138 (request call id 2439) took 1051 ms. Trace:
I20260709 13:07:22.395920 20819 raft_consensus.cc:697] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:07:22.376518 20747 raft_consensus.cc:515] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } }
W20260709 13:07:22.378750 20691 consensus_meta.cc:287] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3: Time spent flushing consensus metadata: real 0.918s	user 0.008s	sys 0.005s
I20260709 13:07:22.379257 20830 raft_consensus.cc:493] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:22.385808 16357 raft_consensus.cc:1240] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 14. Current term is 15. Ops: [14.13-14.13]
I20260709 13:07:22.392757 19940 leader_election.cc:290] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:22.341694 20776 raft_consensus.cc:2749] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:07:22.362874 20617 consensus_meta.cc:287] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 0.983s	user 0.015s	sys 0.000s
I20260709 13:07:22.351398 20814 raft_consensus.cc:493] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.364177 20826 raft_consensus.cc:493] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:22.411424 16204 raft_consensus.cc:2468] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 17.
I20260709 13:07:22.415119 16945 raft_consensus.cc:1275] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:07:22.414765 20742 raft_consensus.cc:515] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:22.394797 20811 raft_consensus.cc:2749] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:22.440904 20821 raft_consensus.cc:3060] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:22.377066 20764 leader_election.cc:290] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:22.443419 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:22.441306 16200 rpcz_store.cc:276] 0709 13:07:21.324845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:21.325102 (+   257us) service_pool.cc:224] Handling call
0709 13:07:21.325462 (+   360us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:21.370899 (+ 45437us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:21.370937 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:21.391435 (+ 20498us) log.cc:844] Serialized 26 byte log entry
0709 13:07:22.096508 (+705073us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:07:22.096588 (+    80us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:22.096691 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:22.376345 (+279654us) raft_consensus.cc:1685] finished
0709 13:07:22.376365 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:22.376520 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":38556,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":8290,"thread_start_us":688793,"threads_started":1,"wal-append.queue_time_us":893148}
I20260709 13:07:22.447206 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:22.446324 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bc3c8ff9b84838a2664335d7e1582b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:22.450039 16202 raft_consensus.cc:1275] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:07:22.452111 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:22.488363 16199 raft_consensus.cc:1240] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 16. Current term is 17. Ops: []
I20260709 13:07:22.453691 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:22.442565 20562 raft_consensus.cc:3060] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:22.466213 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:22.396214 20748 raft_consensus.cc:3060] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:22.471459 20814 raft_consensus.cc:515] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:22.457371 20691 raft_consensus.cc:515] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:22.495724 16207 raft_consensus.cc:2393] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 17: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:07:22.408073 20810 consensus_queue.cc:1048] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.052s
W20260709 13:07:22.491981 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 126985us
I20260709 13:07:22.491446 16201 raft_consensus.cc:2368] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 9. Current term is 10.
W20260709 13:07:22.490823 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 192498us
I20260709 13:07:22.498462 16322 leader_election.cc:304] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:07:22.515156 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 114434us
I20260709 13:07:22.516340 16173 leader_election.cc:304] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:22.465013 20826 raft_consensus.cc:3060] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:22.519630 16322 leader_election.cc:304] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:07:22.525068 16207 raft_consensus.cc:1240] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:22.460973 20617 raft_consensus.cc:515] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:22.469931 20812 raft_consensus.cc:493] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:22.533061 16173 leader_election.cc:304] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 363bb2f744eb486f9ad726f08214c98e
W20260709 13:07:22.520872 20746 consensus_meta.cc:287] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f: Time spent flushing consensus metadata: real 0.581s	user 0.008s	sys 0.004s
I20260709 13:07:22.533887 16322 leader_election.cc:304] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:22.555058 20829 leader_election.cc:290] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:22.554805 20819 consensus_queue.cc:237] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:22.554419 20842 consensus_queue.cc:1048] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 13:07:22.560614 20814 leader_election.cc:290] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:22.568260 20747 leader_election.cc:290] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 17 election: Requested vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:22.576341 20742 leader_election.cc:290] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:22.524191 20764 raft_consensus.cc:2749] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:22.578343 20746 raft_consensus.cc:515] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:22.583813 20776 consensus_queue.cc:1059] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:22.584908 20747 raft_consensus.cc:2804] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:22.469980 20830 raft_consensus.cc:515] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:22.532073 20811 raft_consensus.cc:2804] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:07:22.594074 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 94132.3us
I20260709 13:07:22.527478 20836 raft_consensus.cc:2749] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:22.550349 20592 leader_election.cc:290] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 15 election: Requested vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:22.584849 20839 raft_consensus.cc:493] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:22.579092 20761 raft_consensus.cc:2804] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:07:22.599259 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 66329.1us
I20260709 13:07:22.592172 20747 raft_consensus.cc:493] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:22.608793 16354 raft_consensus.cc:1275] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:07:22.608582 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bc3c8ff9b84838a2664335d7e1582b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:22.609333 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:22.610954 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:22.619879 16356 raft_consensus.cc:2468] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 10.
I20260709 13:07:22.614077 16349 raft_consensus.cc:2393] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 17: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:07:22.617658 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:22.622288 16350 raft_consensus.cc:3060] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:22.601159 20761 raft_consensus.cc:493] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:22.630347 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:22.633189 16173 leader_election.cc:304] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:22.606302 20811 raft_consensus.cc:697] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 9 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:22.619525 20747 raft_consensus.cc:3060] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:22.639108 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:22.640254 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:22.605006 20813 leader_election.cc:290] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:22.641036 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:22.644021 16208 raft_consensus.cc:2468] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 8.
I20260709 13:07:22.641219 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:22.644761 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:22.616223 20617 leader_election.cc:290] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:22.589309 20812 raft_consensus.cc:515] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:22.633905 20761 raft_consensus.cc:3060] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:22.603849 20758 consensus_queue.cc:1059] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:07:22.653018 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:22.607944 20814 consensus_queue.cc:1059] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
W20260709 13:07:22.647585 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:22.650641 20833 log.cc:927] Time spent T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:07:22.662410 16173 leader_election.cc:304] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:07:22.656796 16199 raft_consensus.cc:3060] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:22.645628 20521 raft_consensus.cc:493] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.645897 20836 raft_consensus.cc:2749] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:07:22.603132 20839 raft_consensus.cc:515] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:22.674181 16173 leader_election.cc:304] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:22.670195 20521 raft_consensus.cc:515] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:22.677261 20521 leader_election.cc:290] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:22.664008 20851 raft_consensus.cc:493] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.678596 20851 raft_consensus.cc:515] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:22.680151 20812 leader_election.cc:290] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:22.680814 20829 raft_consensus.cc:2749] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:22.681522 20829 raft_consensus.cc:2749] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:22.683280 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:22.684037 16202 raft_consensus.cc:2468] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 6.
I20260709 13:07:22.685113 20851 leader_election.cc:290] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:22.685561 16173 leader_election.cc:400] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 election: Vote denied by peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823) with higher term. Message: Invalid argument: T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for earlier term 9. Current term is 10.
I20260709 13:07:22.688282 20839 leader_election.cc:290] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:22.689148 16350 raft_consensus.cc:2468] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 15.
I20260709 13:07:22.690439 16173 leader_election.cc:304] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:22.691427 20839 raft_consensus.cc:2764] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:07:22.693928 20839 consensus_queue.cc:1059] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:07:22.695089 20812 raft_consensus.cc:3055] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:22.695482 20812 raft_consensus.cc:740] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:07:22.696517 20812 consensus_queue.cc:260] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:22.697945 20812 raft_consensus.cc:3060] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:22.699935 20746 leader_election.cc:290] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 13 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:22.707942 20816 raft_consensus.cc:515] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:22.709291 16207 raft_consensus.cc:1240] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:22.713430 16353 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41830 (request call id 2275) took 1191 ms. Trace:
I20260709 13:07:22.713941 16353 rpcz_store.cc:276] 0709 13:07:21.521987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:21.522118 (+   131us) service_pool.cc:224] Handling call
0709 13:07:21.549785 (+ 27667us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:21.874849 (+325064us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:22.713116 (+838267us) spinlock_profiling.cc:243] Waited 319 ms on lock 0x7b540032bc54. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f489e01 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6
0709 13:07:22.713330 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":733214080}
I20260709 13:07:22.721179 20819 raft_consensus.cc:493] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.722067 20819 raft_consensus.cc:515] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:22.722914 20815 raft_consensus.cc:3055] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:22.723444 20815 raft_consensus.cc:740] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:07:22.724395 20815 consensus_queue.cc:260] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:22.725453 20819 leader_election.cc:290] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:22.725670 20815 raft_consensus.cc:3060] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:22.726115 20830 leader_election.cc:290] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:22.724211 20811 consensus_queue.cc:237] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:07:22.728677 16249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:22.671547 20691 leader_election.cc:290] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:07:22.740474 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 74780.1us
I20260709 13:07:22.741014 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:22.742075 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:22.742446 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:22.742937 16200 raft_consensus.cc:2468] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 6.
I20260709 13:07:22.742659 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:07:22.744482 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:22.746011 16246 leader_election.cc:400] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 election: Vote denied by peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073) with higher term. Message: Invalid argument: T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 9. Current term is 10.
I20260709 13:07:22.746603 16246 leader_election.cc:403] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
W20260709 13:07:22.748632 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 54954.5us
I20260709 13:07:22.761222 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:22.761947 16202 raft_consensus.cc:3060] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:22.769286 16173 leader_election.cc:304] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:22.770663 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:22.771919 16208 raft_consensus.cc:2393] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 13: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:07:22.764813 16320 leader_election.cc:304] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:22.777446 16248 leader_election.cc:304] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:22.710430 20816 leader_election.cc:290] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 election: Requested vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:22.780884 16246 leader_election.cc:304] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:22.784237 16320 leader_election.cc:304] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:22.717792 20748 raft_consensus.cc:515] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:22.791853 20786 consensus_queue.cc:1048] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:07:22.792575 20819 raft_consensus.cc:2749] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:22.794086 20822 raft_consensus.cc:2749] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073) with higher term. Message: Invalid argument: T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 9. Current term is 10.
I20260709 13:07:22.806632 20744 consensus_queue.cc:1059] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.045s
I20260709 13:07:22.766254 20489 raft_consensus.cc:493] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.806279 16945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:22.820654 16274 raft_consensus.cc:1275] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:07:22.780056 20591 raft_consensus.cc:493] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.824481 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:22.774106 20746 raft_consensus.cc:493] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:22.816342 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:22.828758 16945 raft_consensus.cc:2393] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 7: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
I20260709 13:07:22.763986 20691 consensus_queue.cc:1059] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 13:07:22.831678 16279 raft_consensus.cc:2393] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 12: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:07:22.821213 16282 raft_consensus.cc:1240] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 12. Current term is 13. Ops: []
W20260709 13:07:22.818387 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 133330us
I20260709 13:07:22.811755 20782 raft_consensus.cc:2804] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:22.823935 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:07:22.824152 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:22.825327 16281 raft_consensus.cc:2468] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 9.
I20260709 13:07:22.859182 16276 raft_consensus.cc:1275] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:07:22.827666 16199 raft_consensus.cc:2468] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 11.
I20260709 13:07:22.862597 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:22.863299 16949 raft_consensus.cc:2468] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 7.
W20260709 13:07:22.864750 16173 connection.cc:256] RPC call timeout handler was delayed by -1.5811774580000701s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1602s for a response
W20260709 13:07:22.865300 16173 connection.cc:256] RPC call timeout handler was delayed by -1.563177458000041s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1622s for a response
I20260709 13:07:22.812825 16320 leader_election.cc:304] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:22.761969 20813 consensus_queue.cc:1048] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:07:22.767436 20814 consensus_queue.cc:1059] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 13:07:22.880064 20814 raft_consensus.cc:3055] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:22.880503 20814 raft_consensus.cc:740] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:07:22.881475 20814 consensus_queue.cc:260] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:22.813866 20752 raft_consensus.cc:515] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:22.886484 20752 leader_election.cc:290] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 11 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:22.887679 20747 raft_consensus.cc:515] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:22.888435 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:22.889065 16947 raft_consensus.cc:2468] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 10.
I20260709 13:07:22.890022 20747 leader_election.cc:290] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 14 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:22.890183 16946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:07:22.890777 20745 leader_election.cc:290] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:22.891605 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:22.892932 20801 leader_election.cc:290] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:07:22.893442 20661 consensus_queue.cc:1175] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "1109f76a0b7b443a84c0327c8707bc63" responder_term: 11 status { last_received { term: 11 index: 9 } last_committed_idx: 9 last_received_current_leader { term: 11 index: 9 } }
I20260709 13:07:22.895113 20814 raft_consensus.cc:3060] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:22.865295 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:22.863714 20817 raft_consensus.cc:2764] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Leader election decision vote started in defunct term 10: won
I20260709 13:07:22.898030 16279 raft_consensus.cc:1275] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:07:22.898756 20694 consensus_queue.cc:1048] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:22.899134 20759 leader_election.cc:290] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 15 election: Requested vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:22.766806 20842 consensus_queue.cc:1059] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.045s
W20260709 13:07:22.866995 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 54272.8us
I20260709 13:07:22.900961 16320 leader_election.cc:304] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
W20260709 13:07:22.903474 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:22.828635 20758 raft_consensus.cc:3055] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:22.904558 20758 raft_consensus.cc:740] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:07:22.898291 20826 raft_consensus.cc:515] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:22.831854 20591 raft_consensus.cc:515] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:22.906896 20819 raft_consensus.cc:493] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:22.907559 20819 raft_consensus.cc:515] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:22.908020 20591 leader_election.cc:290] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:22.908743 16283 raft_consensus.cc:1240] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:22.909971 20819 leader_election.cc:290] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:22.912119 20826 leader_election.cc:290] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:22.868431 16173 leader_election.cc:304] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
W20260709 13:07:22.876139 20848 log.cc:927] Time spent T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
I20260709 13:07:22.876575 20803 raft_consensus.cc:3060] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:22.859771 20821 raft_consensus.cc:515] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:22.894790 20798 raft_consensus.cc:515] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:22.912763 20851 raft_consensus.cc:3055] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:22.861205 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:07:22.915928 16280 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45210 (request call id 2283) took 1617 ms (client timeout 1975 ms). Trace:
I20260709 13:07:22.867007 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:22.829440 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:07:22.917450 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 49126.3us
I20260709 13:07:22.924983 16202 raft_consensus.cc:2468] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 12.
I20260709 13:07:22.973642 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:22.813722 20603 raft_consensus.cc:2804] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:07:22.904055 20761 raft_consensus.cc:515] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:22.975260 20826 raft_consensus.cc:493] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:23.070212 20809 raft_consensus.cc:2804] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:23.051481 16355 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33486 (request call id 638) took 1423 ms. Trace:
W20260709 13:07:23.058905 16174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:23.074671 16174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:22.980273 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 79382.9us
I20260709 13:07:23.076954 16282 raft_consensus.cc:2468] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 14.
I20260709 13:07:22.981110 16352 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33486 (request call id 643) took 1029 ms. Trace:
I20260709 13:07:23.081229 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c15d8e9be8414c84912ab77b66bfb1" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:22.859422 20782 raft_consensus.cc:493] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:23.079862 16280 rpcz_store.cc:269] 0709 13:07:21.298871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:21.301399 (+  2528us) service_pool.cc:224] Handling call
0709 13:07:22.915638 (+1614239us) spinlock_profiling.cc:243] Waited 138 ms on lock 0x7b5400389d54. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:07:22.915834 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":317160832}
I20260709 13:07:23.073735 16355 rpcz_store.cc:276] 0709 13:07:21.628051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:21.704070 (+ 76019us) service_pool.cc:224] Handling call
0709 13:07:21.795554 (+ 91484us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:21.815591 (+ 20037us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:23.050378 (+1234787us) spinlock_profiling.cc:243] Waited 64.1 ms on lock 0x7b540032ad50. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f4888ad 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:07:23.051380 (+  1002us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":147479936}
I20260709 13:07:22.820977 20751 raft_consensus.cc:515] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:23.071853 20809 raft_consensus.cc:697] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [term 11 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:23.084046 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:23.096474 16277 raft_consensus.cc:1240] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:23.071652 20603 raft_consensus.cc:697] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 17 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:22.860426 20746 raft_consensus.cc:515] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:23.051013 20819 raft_consensus.cc:493] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.061085 20562 raft_consensus.cc:2749] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:22.952637 20760 raft_consensus.cc:2804] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:23.071606 20826 raft_consensus.cc:515] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:23.104239 16208 raft_consensus.cc:2393] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 10: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:07:23.079715 20851 raft_consensus.cc:740] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:07:22.828511 20489 raft_consensus.cc:515] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:23.085556 20738 raft_consensus.cc:3055] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:23.063060 20752 raft_consensus.cc:493] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:23.050738 20813 raft_consensus.cc:493] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:23.084785 20782 raft_consensus.cc:3060] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:23.084331 20830 consensus_queue.cc:1048] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:07:23.118464 20746 leader_election.cc:290] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:23.121268 20760 raft_consensus.cc:493] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:23.155745 16248 leader_election.cc:304] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:23.144099 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:23.142091 20694 raft_consensus.cc:493] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.160202 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:23.165059 16282 raft_consensus.cc:2393] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 15: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:07:23.171329 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:23.171600 16276 raft_consensus.cc:1275] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:07:23.157841 16942 raft_consensus.cc:2468] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 7.
I20260709 13:07:23.138944 20761 leader_election.cc:290] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 10 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:23.128019 20798 leader_election.cc:290] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:23.174535 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:23.178385 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:23.179280 16283 raft_consensus.cc:3060] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:23.179704 16281 raft_consensus.cc:2393] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 11: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:07:23.147030 20738 raft_consensus.cc:740] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:07:23.182036 16940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:07:23.157015 20760 raft_consensus.cc:3060] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:23.121590 20819 raft_consensus.cc:515] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:07:23.214689 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:23.213227 16940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:07:23.158267 20861 raft_consensus.cc:493] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.173319 20591 raft_consensus.cc:2749] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:23.216414 16940 raft_consensus.cc:3060] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63 [term 9 LEARNER]: Advancing to term 10
I20260709 13:07:23.242367 20861 raft_consensus.cc:515] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:23.246798 20861 leader_election.cc:290] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:23.183758 20801 raft_consensus.cc:493] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.156344 20752 raft_consensus.cc:515] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:23.213399 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:07:23.255865 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:23.256665 16281 raft_consensus.cc:2468] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 8.
W20260709 13:07:23.250041 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 90200.2us
I20260709 13:07:23.156849 20813 raft_consensus.cc:515] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:23.262296 16322 leader_election.cc:304] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:23.259951 16248 leader_election.cc:304] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:23.208204 20748 leader_election.cc:290] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 13 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:23.268229 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:23.183990 20786 consensus_queue.cc:1048] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.069s
I20260709 13:07:23.219898 20761 raft_consensus.cc:493] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.239559 20827 raft_consensus.cc:493] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.272172 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f022e2e63ae4461d834e476ff2666991" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:23.272246 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c15d8e9be8414c84912ab77b66bfb1" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:23.275599 16248 leader_election.cc:304] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:23.186340 20694 raft_consensus.cc:515] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:23.165539 20809 consensus_queue.cc:237] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:23.298534 16248 leader_election.cc:304] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:23.286669 16280 raft_consensus.cc:2468] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 10.
I20260709 13:07:23.177376 20603 consensus_queue.cc:237] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:23.213883 20858 consensus_queue.cc:1059] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.077s
I20260709 13:07:23.187233 20851 consensus_queue.cc:260] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:23.307924 20819 leader_election.cc:290] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:07:23.309403 20859 log.cc:927] Time spent T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 13:07:23.310640 20592 raft_consensus.cc:2804] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:23.305076 20591 raft_consensus.cc:2749] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:07:23.318186 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 105836us
I20260709 13:07:23.280507 20821 leader_election.cc:290] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:07:23.338658 16247 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:23.334317 16912 leader_election.cc:304] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
W20260709 13:07:23.302425 20854 log.cc:927] Time spent T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.236s	user 0.001s	sys 0.000s
I20260709 13:07:23.262276 20801 raft_consensus.cc:515] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:23.284492 20815 raft_consensus.cc:2804] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:23.282665 20737 consensus_queue.cc:1059] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 13:07:23.345512 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:23.347028 20851 raft_consensus.cc:3060] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:23.294335 20761 raft_consensus.cc:515] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:07:23.354910 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 92678.5us
I20260709 13:07:23.356541 16248 leader_election.cc:304] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:23.359759 16941 raft_consensus.cc:1275] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:07:23.360232 20819 raft_consensus.cc:2749] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:07:23.341684 20607 consensus_queue.cc:1048] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 13:07:23.351429 20815 raft_consensus.cc:493] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:23.345602 20858 raft_consensus.cc:2804] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:07:23.356181 20860 log.cc:927] Time spent T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.136s	user 0.001s	sys 0.001s
I20260709 13:07:23.300505 20827 raft_consensus.cc:515] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:23.353602 20776 raft_consensus.cc:493] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.344842 20592 raft_consensus.cc:697] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:07:23.343192 20810 raft_consensus.cc:2804] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:23.371541 16322 leader_election.cc:304] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:07:23.302733 20738 consensus_queue.cc:260] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:23.372823 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:23.373327 20858 raft_consensus.cc:493] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:23.369493 20826 leader_election.cc:290] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:23.354513 20759 raft_consensus.cc:493] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:23.391059 20880 raft_consensus.cc:493] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:23.405498 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:23.388939 20757 consensus_queue.cc:1059] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.005s
I20260709 13:07:23.372548 20815 raft_consensus.cc:3060] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:23.353001 20842 consensus_queue.cc:1059] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 13:07:23.375473 20797 raft_consensus.cc:3055] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:23.391256 20592 consensus_queue.cc:237] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:23.408478 20881 raft_consensus.cc:2749] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:23.378643 20489 leader_election.cc:290] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:07:23.416769 20867 log.cc:927] Time spent T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 13:07:23.417312 20694 leader_election.cc:290] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:23.419890 20806 raft_consensus.cc:493] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.374356 20786 consensus_queue.cc:1048] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 13:07:23.421823 20761 leader_election.cc:290] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:23.423259 20876 raft_consensus.cc:493] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:23.415030 20759 raft_consensus.cc:515] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:23.398283 20858 raft_consensus.cc:3060] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:23.444924 20797 raft_consensus.cc:740] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:07:23.426225 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:23.411947 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:07:23.449400 16173 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:23.479283 16280 raft_consensus.cc:3060] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:23.479365 16174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:23.479657 16279 raft_consensus.cc:2410] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for term 15 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 13:07:23.452951 20884 raft_consensus.cc:493] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.488773 20876 raft_consensus.cc:515] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:23.454895 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:23.500308 16207 raft_consensus.cc:3060] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:23.457391 16206 raft_consensus.cc:1240] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:23.466365 16283 raft_consensus.cc:2468] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 11.
I20260709 13:07:23.450824 20810 raft_consensus.cc:697] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 7 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:23.390254 20776 raft_consensus.cc:515] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:23.385085 20751 leader_election.cc:290] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:23.444482 20880 raft_consensus.cc:515] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:23.490646 20827 leader_election.cc:290] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:23.490060 20801 leader_election.cc:290] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:23.453804 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:07:23.460693 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:23.506364 16940 raft_consensus.cc:2468] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 LEARNER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 10.
I20260709 13:07:23.513379 16208 raft_consensus.cc:2410] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for term 15 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 13:07:23.478629 20752 leader_election.cc:290] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:23.511157 20759 leader_election.cc:290] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:23.522532 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:23.511950 20803 raft_consensus.cc:2749] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:23.522599 16280 raft_consensus.cc:2468] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 11.
I20260709 13:07:23.505244 20795 raft_consensus.cc:3055] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:23.477663 20806 raft_consensus.cc:515] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:07:23.523941 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 66311.3us
I20260709 13:07:23.527604 16354 raft_consensus.cc:1240] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:23.530422 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:23.502508 20760 raft_consensus.cc:515] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:23.532177 16355 raft_consensus.cc:2468] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 11.
I20260709 13:07:23.533130 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:23.534207 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:23.534891 16356 raft_consensus.cc:2468] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 14.
I20260709 13:07:23.535930 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:23.536233 16350 raft_consensus.cc:2393] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 9: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:07:23.524564 20657 raft_consensus.cc:493] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.530329 20355 leader_election.cc:290] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:23.552139 20776 leader_election.cc:290] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:23.542104 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:23.524559 20795 raft_consensus.cc:740] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:07:23.554922 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:23.555701 16348 raft_consensus.cc:3060] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:23.555804 20795 consensus_queue.cc:260] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:23.557521 20795 raft_consensus.cc:3060] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:23.559357 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:23.560235 16356 raft_consensus.cc:3060] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:23.554941 16354 raft_consensus.cc:3060] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:23.533674 20760 leader_election.cc:290] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:23.562526 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:23.563385 16206 raft_consensus.cc:2393] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 13: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:07:23.564023 16355 raft_consensus.cc:2393] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 12: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:07:23.538062 20786 raft_consensus.cc:493] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:23.569741 20887 log.cc:927] Time spent T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 13:07:23.569941 20876 leader_election.cc:290] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:23.563805 20657 raft_consensus.cc:515] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:23.573756 20751 consensus_queue.cc:1059] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:23.576009 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:23.577050 20815 raft_consensus.cc:515] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:23.579887 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:23.594688 16354 raft_consensus.cc:2468] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 10.
I20260709 13:07:23.581301 20822 raft_consensus.cc:3055] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:07:23.583985 20806 leader_election.cc:290] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:23.502269 20884 raft_consensus.cc:515] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:23.588066 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:23.588492 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f022e2e63ae4461d834e476ff2666991" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:23.597179 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:23.592689 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:23.597618 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:23.598948 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:23.599612 16205 raft_consensus.cc:2468] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 14.
I20260709 13:07:23.600373 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:23.595582 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:23.601626 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:23.602073 16354 raft_consensus.cc:2393] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 15: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:07:23.593247 16356 raft_consensus.cc:2468] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 17.
I20260709 13:07:23.604260 16173 leader_election.cc:304] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:23.604895 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:23.606779 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:23.603782 16246 leader_election.cc:304] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:23.564975 20810 consensus_queue.cc:237] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:23.604481 20806 raft_consensus.cc:3055] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:23.609442 20806 raft_consensus.cc:740] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:23.609515 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:23.610596 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:23.610489 20806 consensus_queue.cc:260] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:23.611274 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:23.611861 20806 raft_consensus.cc:3060] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:23.611964 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:23.613965 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:23.607641 16173 leader_election.cc:304] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:23.614840 20839 consensus_queue.cc:1048] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:23.615116 20747 consensus_queue.cc:1048] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:23.616907 20839 raft_consensus.cc:2804] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:23.615267 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:23.617388 20839 raft_consensus.cc:493] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:23.617846 20839 raft_consensus.cc:3060] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:23.608940 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:23.618397 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:23.615353 20843 raft_consensus.cc:493] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.618800 20830 raft_consensus.cc:2804] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:23.619417 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:23.619249 20843 raft_consensus.cc:515] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:23.619825 16279 raft_consensus.cc:1240] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 LEADER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:23.595881 20822 raft_consensus.cc:740] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:07:23.623062 16275 raft_consensus.cc:3060] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:23.630722 16357 raft_consensus.cc:1275] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:07:23.632189 16283 raft_consensus.cc:1240] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:07:23.594106 20659 raft_consensus.cc:493] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.593489 20891 raft_consensus.cc:493] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.635493 16200 raft_consensus.cc:1240] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 16. Current term is 17. Ops: []
I20260709 13:07:23.634397 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:23.595373 20592 raft_consensus.cc:493] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.596148 20803 raft_consensus.cc:493] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.645557 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:23.690894 16355 raft_consensus.cc:3060] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:23.691066 20815 leader_election.cc:290] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:07:23.652645 16320 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:23.652640 16246 leader_election.cc:304] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:07:23.678297 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:23.695232 16174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:23.593595 20786 raft_consensus.cc:515] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:23.696013 16246 leader_election.cc:304] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
W20260709 13:07:23.643764 20814 consensus_meta.cc:287] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f: Time spent flushing consensus metadata: real 0.738s	user 0.013s	sys 0.000s
I20260709 13:07:23.713308 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:23.708819 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:23.710053 16351 raft_consensus.cc:1240] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:23.539664 20797 consensus_queue.cc:260] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:07:23.701531 20815 raft_consensus.cc:2749] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:23.652969 20355 raft_consensus.cc:493] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:23.718735 20808 raft_consensus.cc:2804] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:23.719971 20843 leader_election.cc:290] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:23.730401 20826 raft_consensus.cc:493] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:23.735452 20657 leader_election.cc:290] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:23.654377 20659 raft_consensus.cc:515] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:23.654621 20891 raft_consensus.cc:515] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:23.741218 16348 raft_consensus.cc:2468] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 13.
I20260709 13:07:23.714952 16356 raft_consensus.cc:3060] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:23.661229 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:23.745303 20607 raft_consensus.cc:2804] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:23.747861 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:07:23.749126 16275 raft_consensus.cc:2468] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 13.
I20260709 13:07:23.750499 16207 raft_consensus.cc:2468] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 11.
I20260709 13:07:23.750371 16940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:23.741994 20814 raft_consensus.cc:493] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:23.751690 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:23.701244 20803 raft_consensus.cc:515] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:23.702972 20592 raft_consensus.cc:515] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:23.619251 20830 raft_consensus.cc:493] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:23.751343 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:23.768193 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:23.768466 16353 raft_consensus.cc:2393] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 13: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:07:23.774380 16349 raft_consensus.cc:1240] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:23.774612 16348 raft_consensus.cc:1275] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:07:23.759388 20797 raft_consensus.cc:3060] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:23.777446 16280 raft_consensus.cc:2393] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 in current term 12: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:07:23.779326 16940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:23.823601 16356 raft_consensus.cc:2468] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 12.
I20260709 13:07:23.780607 20884 leader_election.cc:290] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:23.780758 20786 leader_election.cc:290] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:23.774747 20830 raft_consensus.cc:3060] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:23.781347 20814 raft_consensus.cc:515] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:23.781836 20748 raft_consensus.cc:3055] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:23.766930 20607 raft_consensus.cc:493] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:23.784515 20592 leader_election.cc:290] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:23.786530 20803 leader_election.cc:290] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:23.791939 16204 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60154 (request call id 2671) took 1154 ms. Trace:
W20260709 13:07:23.794082 20782 consensus_meta.cc:287] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3: Time spent flushing consensus metadata: real 0.633s	user 0.010s	sys 0.001s
I20260709 13:07:23.760785 20826 raft_consensus.cc:515] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:23.799718 16945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:07:23.801128 15057 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:07:23.758780 20694 consensus_queue.cc:1175] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" responder_term: 11 status { last_received { term: 11 index: 7 } last_committed_idx: 7 last_received_current_leader { term: 11 index: 7 } }
I20260709 13:07:23.753654 20355 raft_consensus.cc:515] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:23.808864 20659 leader_election.cc:290] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:23.809087 16946 raft_consensus.cc:1275] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 13:07:23.809557 16354 raft_consensus.cc:1275] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:07:23.862982 16946 pending_rounds.cc:85] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63: Aborting all ops after (but not including) 7
I20260709 13:07:23.863442 16946 pending_rounds.cc:107] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:07:23.812757 16349 raft_consensus.cc:1275] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:07:23.863785 16946 raft_consensus.cc:2889] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:23.813301 16353 raft_consensus.cc:1275] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:07:23.793569 20758 consensus_queue.cc:260] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:23.817415 16947 raft_consensus.cc:1240] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:23.822927 16351 raft_consensus.cc:1240] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:23.755371 20880 leader_election.cc:290] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:23.762233 20808 raft_consensus.cc:697] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:07:23.839640 20748 raft_consensus.cc:740] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:07:23.839448 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:23.843502 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:23.868350 16277 raft_consensus.cc:2393] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 13: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:07:23.842159 20607 raft_consensus.cc:3060] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:23.846587 16204 rpcz_store.cc:276] 0709 13:07:22.637720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:22.639211 (+  1491us) service_pool.cc:224] Handling call
0709 13:07:22.639444 (+   233us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:22.912238 (+272794us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:22.912288 (+    50us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:22.912344 (+    56us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:22.912381 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:23.791656 (+879275us) spinlock_profiling.cc:243] Waited 260 ms on lock 0x7b5400259754. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f489e01 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6
0709 13:07:23.791710 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:23.791867 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12173,"raft.queue_time_us":12826,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":96,"spinlock_wait_cycles":598435584}
I20260709 13:07:23.849422 16350 raft_consensus.cc:1240] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:07:23.852972 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:23.855039 16945 raft_consensus.cc:3060] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 LEARNER]: Advancing to term 11
I20260709 13:07:23.866420 16275 raft_consensus.cc:1240] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:23.766034 20822 consensus_queue.cc:260] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } }
I20260709 13:07:23.876255 16356 raft_consensus.cc:2468] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 8.
I20260709 13:07:23.879247 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:23.880142 16354 raft_consensus.cc:2468] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 14.
I20260709 13:07:23.890998 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:23.892225 16354 raft_consensus.cc:2368] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 10. Current term is 11.
W20260709 13:07:23.903046 16914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:23.856333 20782 raft_consensus.cc:515] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:23.914533 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:23.914822 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:23.928860 20748 consensus_queue.cc:260] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:23.885262 20758 raft_consensus.cc:3060] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:23.928369 16283 raft_consensus.cc:1240] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:23.947292 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:23.936923 16277 raft_consensus.cc:1240] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 LEADER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:23.938292 16275 raft_consensus.cc:3060] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:23.942888 16278 raft_consensus.cc:2368] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for earlier term 7. Current term is 8.
I20260709 13:07:23.938398 16945 raft_consensus.cc:2468] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 LEARNER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 11.
I20260709 13:07:23.976548 16282 raft_consensus.cc:1275] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:07:24.008234 16940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
W20260709 13:07:23.929399 20895 log.cc:927] Time spent T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:07:24.009457 16940 raft_consensus.cc:2468] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 9.
I20260709 13:07:24.008193 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
W20260709 13:07:23.933231 20877 log.cc:927] Time spent T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.582s	user 0.001s	sys 0.000s
W20260709 13:07:24.055500 16915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:24.048926 16203 raft_consensus.cc:2468] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 9.
I20260709 13:07:24.019238 16282 raft_consensus.cc:1275] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:07:24.056066 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:24.077991 16354 raft_consensus.cc:1275] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:07:24.014303 16277 raft_consensus.cc:1275] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:07:24.053725 16283 raft_consensus.cc:1240] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:07:23.930476 20800 raft_consensus.cc:3055] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:23.940915 20748 raft_consensus.cc:3060] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:24.021267 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:24.020825 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:24.021250 16349 raft_consensus.cc:1240] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 16. Current term is 17. Ops: []
I20260709 13:07:24.071180 16355 raft_consensus.cc:2468] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 10.
I20260709 13:07:24.099803 16914 leader_election.cc:304] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:24.079241 16945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:24.020359 16356 raft_consensus.cc:1275] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:24.102864 16945 raft_consensus.cc:2468] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 11.
W20260709 13:07:24.030747 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:24.054222 16173 leader_election.cc:304] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:23.930084 20826 leader_election.cc:290] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:24.097337 16353 raft_consensus.cc:2468] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 9.
I20260709 13:07:24.013271 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:24.110661 16357 raft_consensus.cc:3060] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:24.086140 16275 raft_consensus.cc:2468] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 14.
I20260709 13:07:23.920356 20603 raft_consensus.cc:493] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:23.927222 20355 leader_election.cc:290] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:23.928468 20827 raft_consensus.cc:493] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:23.912228 20822 raft_consensus.cc:3060] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:23.945262 20562 raft_consensus.cc:493] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.095029 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:07:24.095676 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 144808us
I20260709 13:07:24.082198 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:07:24.104610 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 50456.7us
I20260709 13:07:24.166354 16940 raft_consensus.cc:1240] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:23.930668 20858 raft_consensus.cc:515] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:24.167761 16173 leader_election.cc:304] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:07:24.166406 16351 raft_consensus.cc:2468] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 9.
I20260709 13:07:24.105641 20795 raft_consensus.cc:2804] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:24.112779 16276 raft_consensus.cc:1240] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 12. Current term is 13. Ops: [10.8-12.9]
I20260709 13:07:24.009442 20817 raft_consensus.cc:493] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:23.977541 20787 raft_consensus.cc:493] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:23.939405 20782 leader_election.cc:290] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:24.115651 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:24.179868 16349 raft_consensus.cc:2468] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 14.
I20260709 13:07:24.050953 20814 leader_election.cc:290] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:24.013252 20624 raft_consensus.cc:493] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:24.194288 20624 raft_consensus.cc:515] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:24.196198 16322 leader_election.cc:304] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:24.196661 20624 leader_election.cc:290] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:24.197402 20745 raft_consensus.cc:2749] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:24.197393 20624 consensus_queue.cc:1059] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:24.118773 16355 raft_consensus.cc:1240] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:07:24.120837 16945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:24.122467 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:24.199453 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:24.200090 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:24.118062 20855 consensus_queue.cc:1059] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.061s
I20260709 13:07:24.201277 20855 consensus_queue.cc:1243] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Peer 0aea40d6e4374085a2e38a70a71f63e3 log is divergent from this leader: its last log entry 8.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:07:24.127125 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:24.202364 16350 raft_consensus.cc:2468] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 11.
I20260709 13:07:24.084496 20800 raft_consensus.cc:740] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:24.204383 20800 consensus_queue.cc:260] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:24.205902 20800 raft_consensus.cc:3060] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:24.207790 20814 raft_consensus.cc:3055] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:24.208271 20814 raft_consensus.cc:740] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:07:24.140548 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
W20260709 13:07:24.145994 16912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:24.209218 20814 consensus_queue.cc:260] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:24.037408 20839 raft_consensus.cc:515] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:24.196218 20607 raft_consensus.cc:515] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:24.212700 20839 leader_election.cc:290] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 15 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:07:24.163690 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:24.166438 16248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:24.213754 16248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:24.214609 16248 leader_election.cc:304] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:24.216907 16248 leader_election.cc:304] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:07:24.166597 16354 raft_consensus.cc:2468] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 10.
I20260709 13:07:24.218147 20659 raft_consensus.cc:2749] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:07:24.218474 16174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:24.219442 20659 raft_consensus.cc:2804] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:24.219869 20659 raft_consensus.cc:493] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:24.220275 20659 raft_consensus.cc:3060] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:24.220531 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:24.222118 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:24.223171 16204 raft_consensus.cc:2410] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:07:24.224098 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:07:24.225291 20902 log.cc:927] Time spent T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63: Append to log took a long time: real 0.282s	user 0.001s	sys 0.001s
I20260709 13:07:24.226954 16248 leader_election.cc:304] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:07:24.227821 20489 raft_consensus.cc:2804] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:24.227522 20817 raft_consensus.cc:515] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:24.228267 20489 raft_consensus.cc:493] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:24.228699 20489 raft_consensus.cc:3060] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:07:24.228909 16278 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45218 (request call id 2236) took 1410 ms (client timeout 1796 ms). Trace:
W20260709 13:07:24.229346 16278 rpcz_store.cc:269] 0709 13:07:22.819018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:22.819171 (+   153us) service_pool.cc:224] Handling call
0709 13:07:24.228704 (+1409533us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b54001f54d4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:07:24.228849 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2490384256}
I20260709 13:07:24.230052 20817 leader_election.cc:290] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:24.230918 16202 raft_consensus.cc:3055] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:24.230700 20787 raft_consensus.cc:515] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:24.231348 16202 raft_consensus.cc:740] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:07:24.232237 16202 consensus_queue.cc:260] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:24.233348 16202 raft_consensus.cc:3060] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:24.233542 20787 leader_election.cc:290] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:24.116819 20752 raft_consensus.cc:2749] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:24.177261 20827 raft_consensus.cc:515] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:24.235878 16943 raft_consensus.cc:3055] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:24.236263 16943 raft_consensus.cc:740] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:07:24.236925 20827 leader_election.cc:290] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:24.237561 20827 raft_consensus.cc:493] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:24.173774 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:24.237075 16943 consensus_queue.cc:260] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:24.239353 16283 raft_consensus.cc:2468] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 8.
I20260709 13:07:24.183667 16357 raft_consensus.cc:2468] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 11.
I20260709 13:07:24.116367 20830 raft_consensus.cc:515] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:24.173251 20661 raft_consensus.cc:2804] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:24.171480 20562 raft_consensus.cc:515] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:24.173629 20795 raft_consensus.cc:493] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:24.186318 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:24.257064 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:24.165015 20603 raft_consensus.cc:515] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:24.192340 20858 leader_election.cc:290] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 8 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:24.193464 16947 raft_consensus.cc:2393] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 8: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
I20260709 13:07:24.044586 20808 consensus_queue.cc:237] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:24.197995 16322 leader_election.cc:304] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:24.213047 20607 leader_election.cc:290] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 15 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:24.240547 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:24.262857 16204 raft_consensus.cc:2468] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 12.
I20260709 13:07:24.263976 16204 raft_consensus.cc:1240] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:24.242627 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:24.266597 16207 raft_consensus.cc:2393] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 15: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:07:24.243330 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:24.246342 16943 raft_consensus.cc:3060] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:24.243290 20737 raft_consensus.cc:3055] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:24.257763 16208 raft_consensus.cc:3060] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Advancing to term 8
W20260709 13:07:24.238631 20806 consensus_meta.cc:287] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 0.626s	user 0.012s	sys 0.000s
I20260709 13:07:24.261711 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:24.245838 20746 raft_consensus.cc:493] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.245644 20661 raft_consensus.cc:493] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:24.258917 20795 raft_consensus.cc:3060] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:07:24.286299 20902 log.cc:927] Time spent T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63: Append to log took a long time: real 0.060s	user 0.003s	sys 0.000s
I20260709 13:07:24.239673 20827 raft_consensus.cc:515] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:24.633649 20746 raft_consensus.cc:515] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:24.640542 20746 leader_election.cc:290] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:24.641026 20827 leader_election.cc:290] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:24.272384 20737 raft_consensus.cc:740] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:07:24.642795 20737 consensus_queue.cc:260] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:24.644536 20737 raft_consensus.cc:3060] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:24.339452 16913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:24.361377 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 258898us
W20260709 13:07:24.647933 16913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:24.648705 16913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:24.648986 16914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:24.459864 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 285634us
W20260709 13:07:24.538883 16915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:24.246716 20839 raft_consensus.cc:493] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:24.650503 20839 raft_consensus.cc:515] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:24.613262 16948 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40078 (request call id 536) took 1488 ms. Trace:
I20260709 13:07:24.651508 16948 rpcz_store.cc:276] 0709 13:07:23.124851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:23.177024 (+ 52173us) service_pool.cc:224] Handling call
0709 13:07:23.185963 (+  8939us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:23.217488 (+ 31525us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:23.217517 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:23.268813 (+ 51296us) log.cc:844] Serialized 26 byte log entry
0709 13:07:23.820044 (+551231us) spinlock_profiling.cc:243] Waited 2.61 ms on lock 0x7b1800487480. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f3625264de1 00007f36252715b1 00007f361c37ee07 00007f36251d9ab9 00007f361c39b69b 00007f361c39993f 00007f361c39bc02 00007f361f02320b 00007f361f028d23 00007f361f0290d1 00007f361f444a0f
0709 13:07:23.948029 (+127985us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:23.948090 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:23.948187 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:24.282647 (+334460us) raft_consensus.cc:1685] finished
0709 13:07:24.282671 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:24.612984 (+330313us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16708,"raft.queue_time_us":74816,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":2208,"spinlock_wait_cycles":6004608,"thread_start_us":127710,"threads_started":1,"wal-append.queue_time_us":878665}
I20260709 13:07:24.652807 20839 leader_election.cc:290] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:24.613623 16199 raft_consensus.cc:2468] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 13.
I20260709 13:07:24.615651 20562 leader_election.cc:290] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:24.616525 20813 leader_election.cc:290] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:24.617362 16200 raft_consensus.cc:2468] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 8.
W20260709 13:07:24.619549 20748 consensus_meta.cc:287] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63: Time spent flushing consensus metadata: real 0.504s	user 0.010s	sys 0.006s
W20260709 13:07:24.629880 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 354847us
W20260709 13:07:24.633296 16247 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:24.629465 16208 raft_consensus.cc:2468] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 8.
W20260709 13:07:24.649803 16914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:24.663550 16914 leader_election.cc:304] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:24.665221 16914 leader_election.cc:304] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:24.650828 16173 leader_election.cc:304] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
W20260709 13:07:24.614528 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 416620us
I20260709 13:07:24.664238 20603 leader_election.cc:290] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:24.669638 20758 raft_consensus.cc:2804] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:24.661587 20787 raft_consensus.cc:493] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.670764 20855 raft_consensus.cc:3060] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:24.671981 20795 raft_consensus.cc:515] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:07:24.659811 16246 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:24.677943 16276 raft_consensus.cc:1240] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 LEADER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:24.677850 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:24.678870 16283 raft_consensus.cc:2393] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 in current term 8: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:07:24.678864 16948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:24.679448 20795 leader_election.cc:290] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 election: Requested vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:24.678436 20787 raft_consensus.cc:515] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:07:24.687922 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:24.687842 16202 raft_consensus.cc:1275] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 13:07:24.689225 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:24.670300 20758 raft_consensus.cc:697] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 13 LEADER]: Becoming Leader. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:07:24.690708 16943 raft_consensus.cc:1275] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:07:24.692148 20679 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
I20260709 13:07:24.691891 20758 consensus_queue.cc:237] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:24.692703 20839 raft_consensus.cc:2749] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:07:24.698660 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:24.636602 20617 raft_consensus.cc:2804] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:24.700409 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:24.703207 16943 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40078 (request call id 541) took 1523 ms. Trace:
I20260709 13:07:24.706996 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:24.710269 16173 leader_election.cc:304] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:24.715903 16246 leader_election.cc:304] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:24.716529 16202 raft_consensus.cc:2393] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 in current term 8: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:07:24.718360 20603 raft_consensus.cc:493] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.718006 20817 consensus_queue.cc:1059] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:24.718940 20603 raft_consensus.cc:515] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:24.720119 20817 raft_consensus.cc:3055] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:24.720363 20806 raft_consensus.cc:493] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.720716 20817 raft_consensus.cc:740] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:07:24.721019 20806 raft_consensus.cc:515] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:24.723102 20861 consensus_queue.cc:1048] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:07:24.724409 20900 log.cc:927] Time spent T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.782s	user 0.004s	sys 0.000s
I20260709 13:07:24.725162 16173 leader_election.cc:400] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 pre-election: Vote denied by peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823) with higher term. Message: Invalid argument: T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for earlier term 7. Current term is 8.
I20260709 13:07:24.725561 16173 leader_election.cc:403] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:24.726814 16201 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60138 (request call id 2463) took 1142 ms. Trace:
I20260709 13:07:24.727463 20562 consensus_queue.cc:1048] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:24.728776 20562 consensus_queue.cc:1243] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer 0aea40d6e4374085a2e38a70a71f63e3 log is divergent from this leader: its last log entry 6.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:07:24.727345 16201 rpcz_store.cc:276] 0709 13:07:23.584740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:23.584888 (+   148us) service_pool.cc:224] Handling call
0709 13:07:23.585246 (+   358us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:23.585633 (+   387us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:07:23.585994 (+   361us) log.cc:844] Serialized 14 byte log entry
0709 13:07:23.844925 (+258931us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:23.845612 (+   687us) log.cc:844] Serialized 26 byte log entry
0709 13:07:23.845793 (+   181us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:23.845824 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:23.846391 (+   567us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:24.057543 (+211152us) spinlock_profiling.cc:243] Waited 5.5 ms on lock 0x7b1800443e00. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f3625264de1 00007f36252715b1 00007f361c39c522 00007f361c39e7c1 00007f361c39e779 00007f361c39e709 00007f361c39e6d1 00007f361c39d9cd 000000000038f354 000000000038f199 00007f361c37f83a
0709 13:07:24.723646 (+666103us) spinlock_profiling.cc:243] Waited 3.89 ms on lock 0x7b4400022b4c. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361c224db1 00007f361c2c2c85 00007f361c2c36a2 00007f361f0351db 00007f361f030aaf 00007f361f02486e 00007f361f023bb6 00007f361f0237d8 00007f361f02d221 00007f361f02d1d9 00007f361f02d169
0709 13:07:24.726526 (+  2880us) raft_consensus.cc:1685] finished
0709 13:07:24.726567 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:24.726733 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":938,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":41,"raft.queue_time_us":2395,"raft.run_cpu_time_us":288,"raft.run_wall_time_us":13398,"spinlock_wait_cycles":21580544,"thread_start_us":258287,"threads_started":1,"wal-append.queue_time_us":298507}
I20260709 13:07:24.730762 20746 consensus_queue.cc:1059] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:24.732779 20797 raft_consensus.cc:2804] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:24.733412 20797 raft_consensus.cc:493] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:24.733857 20797 raft_consensus.cc:3060] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:24.740957 20827 consensus_queue.cc:1048] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:07:24.741503 16915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:24.743081 20827 raft_consensus.cc:3055] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:24.743643 20827 raft_consensus.cc:740] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:07:24.744710 20827 consensus_queue.cc:260] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:24.709537 20795 consensus_queue.cc:1059] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:07:24.715073 16943 rpcz_store.cc:276] 0709 13:07:23.179935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:23.313112 (+133177us) service_pool.cc:224] Handling call
0709 13:07:23.313524 (+   412us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:24.235770 (+922246us) spinlock_profiling.cc:243] Waited 57.6 ms on lock 0x7b54005c15a0. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f400dc0 00007f361f48b1c0 00007f361f48c231 00007f361f488d8f 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c
0709 13:07:24.691882 (+456112us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:24.702854 (+ 10972us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":132541824}
I20260709 13:07:24.747993 20795 raft_consensus.cc:3055] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:24.748423 20795 raft_consensus.cc:740] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:07:24.749389 20795 consensus_queue.cc:260] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:24.708817 20813 raft_consensus.cc:493] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
W20260709 13:07:24.772779 16912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:24.683404 20787 leader_election.cc:290] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:07:24.817065 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:24.746400 20827 raft_consensus.cc:3060] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:24.833487 16246 leader_election.cc:304] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
W20260709 13:07:24.877350 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 44021.3us
I20260709 13:07:24.878481 16246 leader_election.cc:304] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
W20260709 13:07:24.834088 16174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:24.730469 20562 raft_consensus.cc:2804] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:24.633356 20661 raft_consensus.cc:3060] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:24.713317 20617 raft_consensus.cc:493] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:24.776718 20746 raft_consensus.cc:2749] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823) with higher term. Message: Invalid argument: T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for earlier term 7. Current term is 8.
I20260709 13:07:24.775875 20858 raft_consensus.cc:493] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
W20260709 13:07:24.946404 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 113642us
I20260709 13:07:24.967437 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:24.968240 16200 raft_consensus.cc:2468] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 12.
I20260709 13:07:24.722023 20817 consensus_queue.cc:260] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:24.752476 20839 consensus_queue.cc:1048] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.193s
I20260709 13:07:24.865520 20738 raft_consensus.cc:3060] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:07:24.974846 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 249846us
I20260709 13:07:24.903735 20795 raft_consensus.cc:3060] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:24.947386 20787 raft_consensus.cc:2804] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:24.944085 20822 raft_consensus.cc:2804] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:25.001122 16246 leader_election.cc:304] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:24.967883 20617 raft_consensus.cc:3060] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:24.948172 20808 consensus_queue.cc:1048] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 13:07:25.007354 20817 raft_consensus.cc:3060] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:25.007695 20603 leader_election.cc:290] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:24.999406 20811 raft_consensus.cc:493] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.795107 20813 raft_consensus.cc:515] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:24.999832 16173 leader_election.cc:304] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
W20260709 13:07:25.015067 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 319520us
I20260709 13:07:25.010210 20855 raft_consensus.cc:2749] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:25.030167 16322 leader_election.cc:304] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:07:25.022001 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 357320us
I20260709 13:07:25.037674 16947 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40078 (request call id 548) took 1079 ms. Trace:
I20260709 13:07:25.039203 20617 raft_consensus.cc:515] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:25.040038 20813 leader_election.cc:290] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:25.041486 20617 leader_election.cc:290] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:24.963116 20562 raft_consensus.cc:697] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 14 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:07:24.978579 20858 raft_consensus.cc:515] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:25.038126 16947 rpcz_store.cc:276] 0709 13:07:23.959513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:23.977209 (+ 17696us) service_pool.cc:224] Handling call
0709 13:07:25.037372 (+1060163us) spinlock_profiling.cc:243] Waited 181 ms on lock 0x7b5400418cd4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:07:25.037579 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":416836352}
I20260709 13:07:25.015415 20822 raft_consensus.cc:493] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:25.053545 16322 leader_election.cc:304] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:07:25.055028 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 55284.7us
W20260709 13:07:25.021929 20659 consensus_meta.cc:287] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3: Time spent flushing consensus metadata: real 0.801s	user 0.018s	sys 0.006s
I20260709 13:07:25.020092 20742 raft_consensus.cc:2804] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:07:25.028510 20916 log.cc:927] Time spent T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.238s	user 0.001s	sys 0.000s
I20260709 13:07:25.016305 20787 raft_consensus.cc:697] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:07:25.028191 20748 raft_consensus.cc:493] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.025776 20806 leader_election.cc:290] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:25.045697 20813 raft_consensus.cc:493] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:25.064710 16322 leader_election.cc:304] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:25.057029 20745 raft_consensus.cc:3060] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:25.059113 20915 raft_consensus.cc:2804] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:25.055721 20694 raft_consensus.cc:493] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:25.056459 20624 raft_consensus.cc:493] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.054452 20603 raft_consensus.cc:493] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:25.074280 16322 leader_election.cc:304] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:07:25.061864 20822 raft_consensus.cc:3060] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:25.062359 20489 consensus_meta.cc:287] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3: Time spent flushing consensus metadata: real 0.832s	user 0.018s	sys 0.005s
I20260709 13:07:25.078019 16322 leader_election.cc:304] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:25.062606 20742 raft_consensus.cc:493] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:25.051879 20811 raft_consensus.cc:515] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:25.064378 20617 raft_consensus.cc:2804] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:07:25.080219 16174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:25.088424 16322 leader_election.cc:304] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:25.073783 20660 raft_consensus.cc:2749] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:25.093387 20660 raft_consensus.cc:2804] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:07:25.093660 16248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:25.093894 20660 raft_consensus.cc:697] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 11 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
W20260709 13:07:25.094156 16248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:25.079066 20624 raft_consensus.cc:515] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:25.094810 20607 consensus_queue.cc:1048] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:25.094937 20660 consensus_queue.cc:237] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:25.084956 20920 raft_consensus.cc:493] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:25.097568 20920 raft_consensus.cc:515] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:25.079205 20694 raft_consensus.cc:515] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:25.074851 20915 raft_consensus.cc:493] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:25.100246 20915 raft_consensus.cc:3060] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:25.079276 20603 raft_consensus.cc:515] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:25.128650 16202 raft_consensus.cc:1275] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 13:07:25.132864 20914 log.cc:927] Time spent T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
I20260709 13:07:23.078739 16352 rpcz_store.cc:276] 0709 13:07:21.951338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:21.951513 (+   175us) service_pool.cc:224] Handling call
0709 13:07:21.951968 (+   455us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:21.952287 (+   319us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:07:22.197824 (+245537us) log.cc:844] Serialized 14 byte log entry
0709 13:07:22.903593 (+705769us) spinlock_profiling.cc:243] Waited 5.99 ms on lock 0x7b1800463d80. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f3625264de1 00007f36252715b1 00007f361f0314bc 00007f361c37f48b 00007f36251d9ab9 00007f361c39b69b 00007f361c39993f 00007f361c39bc02 00007f361f02320b 00007f361f028d23 00007f361f02923a
0709 13:07:22.980628 (+ 77035us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:22.980708 (+    80us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:22.980771 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:22.980866 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:22.981032 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":76761,"prepare.queue_time_us":314044,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":55,"raft.queue_time_us":147874,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":9461,"spinlock_wait_cycles":13773056,"thread_start_us":321835,"threads_started":2,"wal-append.queue_time_us":164512}
I20260709 13:07:25.134536 16353 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41830 (request call id 2308) took 1113 ms. Trace:
I20260709 13:07:25.127548 20562 consensus_queue.cc:237] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:25.134948 16353 rpcz_store.cc:276] 0709 13:07:24.020936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:24.109353 (+ 88417us) service_pool.cc:224] Handling call
0709 13:07:24.122890 (+ 13537us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:24.123302 (+   412us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:24.123336 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:24.123902 (+   566us) log.cc:844] Serialized 26 byte log entry
0709 13:07:24.360993 (+237091us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:24.361052 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:24.361165 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:25.134291 (+773126us) raft_consensus.cc:1685] finished
0709 13:07:25.134319 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:25.134468 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":682,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":91,"thread_start_us":236571,"threads_started":1,"wal-append.queue_time_us":849221}
I20260709 13:07:25.063934 20659 raft_consensus.cc:515] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:25.092123 20489 raft_consensus.cc:515] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:25.091565 20922 raft_consensus.cc:2749] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:07:25.187861 16913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:25.151889 20811 leader_election.cc:290] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:25.127909 20764 raft_consensus.cc:493] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
W20260709 13:07:25.155194 16247 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:25.156101 20694 leader_election.cc:290] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:25.157063 20919 raft_consensus.cc:493] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.157236 20863 consensus_queue.cc:1048] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:25.158526 20624 leader_election.cc:290] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:07:25.170670 16915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:25.171000 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:25.171208 16914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:25.086647 20806 raft_consensus.cc:2804] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:25.175902 20787 consensus_queue.cc:237] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:25.090894 20617 raft_consensus.cc:493] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:25.086355 20742 raft_consensus.cc:3060] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:25.071738 20748 raft_consensus.cc:515] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:25.151736 20858 leader_election.cc:290] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:25.078421 20813 raft_consensus.cc:515] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:07:25.185822 20905 log.cc:927] Time spent T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 1.260s	user 0.013s	sys 0.000s
W20260709 13:07:25.201869 16913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:25.186177 20603 leader_election.cc:290] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:07:25.213886 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:25.202494 20617 raft_consensus.cc:3060] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:25.228694 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 140349us
I20260709 13:07:25.230630 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:25.233778 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:07:25.234483 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:25.280321 20489 leader_election.cc:290] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:07:25.320811 16914 leader_election.cc:336] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 1.791s (SENT)
I20260709 13:07:25.313616 20822 raft_consensus.cc:515] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:25.325577 20822 leader_election.cc:290] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:25.304185 20748 leader_election.cc:290] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:25.240361 16274 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45210 (request call id 2309) took 2083 ms. Trace:
I20260709 13:07:25.198977 20757 raft_consensus.cc:493] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.289471 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:25.234660 16283 raft_consensus.cc:2393] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 13: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:07:25.304366 20745 raft_consensus.cc:2749] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:25.258574 16281 raft_consensus.cc:1240] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:25.194410 20764 raft_consensus.cc:515] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:25.329392 16199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60138 (request call id 2485) took 1084 ms. Trace:
I20260709 13:07:25.329825 16281 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42740 (request call id 798) took 1105 ms. Trace:
W20260709 13:07:25.245056 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:25.330248 16281 rpcz_store.cc:276] 0709 13:07:24.224211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:24.241949 (+ 17738us) service_pool.cc:224] Handling call
0709 13:07:24.242281 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:25.258285 (+1016004us) spinlock_profiling.cc:243] Waited 8.45 ms on lock 0x7b54002c9fa0. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f400dc0 00007f361f48b1c0 00007f361f48c231 00007f361f488d8f 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c
0709 13:07:25.329552 (+ 71267us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:25.329768 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19423488}
I20260709 13:07:25.233778 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:25.286136 20795 raft_consensus.cc:493] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:25.260193 20737 consensus_meta.cc:287] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63: Time spent flushing consensus metadata: real 0.615s	user 0.016s	sys 0.019s
I20260709 13:07:25.332490 20795 raft_consensus.cc:515] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:25.268800 20661 raft_consensus.cc:515] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:25.323482 16914 leader_election.cc:304] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:25.198912 20919 raft_consensus.cc:515] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } }
W20260709 13:07:25.356410 20797 consensus_meta.cc:287] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3: Time spent flushing consensus metadata: real 0.622s	user 0.020s	sys 0.000s
I20260709 13:07:25.356945 20813 leader_election.cc:290] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:25.335538 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:25.359608 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:25.199267 20694 raft_consensus.cc:493] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.361377 16944 raft_consensus.cc:2410] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for term 15 because replica has last-logged OpId of term: 14 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
I20260709 13:07:25.360939 20694 raft_consensus.cc:515] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
W20260709 13:07:25.261169 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:25.329875 16199 rpcz_store.cc:276] 0709 13:07:24.242683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:24.242834 (+   151us) service_pool.cc:224] Handling call
0709 13:07:25.326992 (+1084158us) spinlock_profiling.cc:243] Waited 10.4 ms on lock 0x7b54003d1654. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:07:25.327118 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":23918464}
I20260709 13:07:25.336719 20757 raft_consensus.cc:515] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:25.199713 20806 raft_consensus.cc:493] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
W20260709 13:07:25.321712 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 353040us
I20260709 13:07:25.341101 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:25.365851 16276 raft_consensus.cc:2393] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 15: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:07:25.342852 16946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:25.346280 16248 leader_election.cc:304] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:25.350181 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
W20260709 13:07:25.303629 20912 log.cc:927] Time spent T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.678s	user 0.006s	sys 0.010s
I20260709 13:07:25.386117 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:25.284278 20659 leader_election.cc:290] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 election: Requested vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:25.310154 20920 leader_election.cc:290] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:25.355224 16948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:07:25.398274 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:25.399048 16948 raft_consensus.cc:3060] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:25.399644 16281 raft_consensus.cc:2393] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 11: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:07:25.356011 16203 raft_consensus.cc:1240] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:25.356866 20797 raft_consensus.cc:515] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:25.335283 20915 raft_consensus.cc:515] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:07:25.354305 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 222944us
W20260709 13:07:25.404449 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 64646us
I20260709 13:07:25.357901 20661 leader_election.cc:290] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 11 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:25.291090 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:25.407991 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:25.408727 16204 raft_consensus.cc:2468] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 15.
I20260709 13:07:25.408849 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:25.409123 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:25.326858 16274 rpcz_store.cc:276] 0709 13:07:23.157004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:23.157142 (+   138us) service_pool.cc:224] Handling call
0709 13:07:23.157471 (+   329us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:23.157840 (+   369us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:23.157904 (+    64us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:23.814628 (+656724us) spinlock_profiling.cc:243] Waited 3.68 ms on lock 0x7b2c0000ffe8. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361dd82a11 00007f361dd92372 00007f361f4c4a01 00007f361f48943a 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2
0709 13:07:23.815135 (+   507us) log.cc:844] Serialized 26 byte log entry
0709 13:07:23.869724 (+ 54589us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:23.869761 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:23.869830 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:25.065551 (+1195721us) spinlock_profiling.cc:243] Waited 22 ms on lock 0x7b4400022b4c. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361c224db1 00007f361c2c2c85 00007f361c2c36a2 00007f361f0351db 00007f361f030aaf 00007f361f02486e 00007f361f023bb6 00007f361f0237d8 00007f361f02d221 00007f361f02d1d9 00007f361f02d169
0709 13:07:25.240130 (+174579us) raft_consensus.cc:1685] finished
0709 13:07:25.240152 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:25.240293 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6287,"raft.queue_time_us":3248,"raft.run_cpu_time_us":217,"raft.run_wall_time_us":18730,"spinlock_wait_cycles":59063808,"thread_start_us":54190,"threads_started":1,"wal-append.queue_time_us":105570}
I20260709 13:07:25.409811 16208 raft_consensus.cc:2468] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 7.
W20260709 13:07:25.364042 16944 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35122 (request call id 648) took 1616 ms (client timeout 1768 ms). Trace:
I20260709 13:07:25.367141 16912 leader_election.cc:304] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:25.384048 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:25.362485 20834 raft_consensus.cc:493] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.410735 16946 raft_consensus.cc:2468] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 15.
I20260709 13:07:25.409821 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:25.410495 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:07:25.413686 16944 rpcz_store.cc:269] 0709 13:07:23.747482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:23.747605 (+   123us) service_pool.cc:224] Handling call
0709 13:07:25.363818 (+1616213us) spinlock_profiling.cc:243] Waited 1.6 s on lock 0x7b54005d3ed4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:07:25.363980 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3669127936}
I20260709 13:07:25.416720 16246 leader_election.cc:304] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:25.416874 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:25.417399 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:25.394515 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:25.419281 16276 raft_consensus.cc:2468] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 11.
I20260709 13:07:25.365417 20737 raft_consensus.cc:2749] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:25.420224 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:25.418045 16246 leader_election.cc:304] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:25.420832 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:25.421617 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:25.395126 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:25.422334 16282 raft_consensus.cc:2393] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 15: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:07:25.383350 20806 raft_consensus.cc:3060] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:25.422807 16278 raft_consensus.cc:2410] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for term 10 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
W20260709 13:07:25.423141 16174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:25.400992 16322 connection.cc:256] RPC call timeout handler was delayed by -1.1632923810000193s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1625s for a response
W20260709 13:07:25.402267 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 56081.6us
I20260709 13:07:25.409826 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:25.404206 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:25.407564 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:25.358923 16275 raft_consensus.cc:1240] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:25.425139 16204 raft_consensus.cc:2468] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 17.
I20260709 13:07:25.393613 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:25.415352 16206 raft_consensus.cc:2410] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:07:25.426285 16202 raft_consensus.cc:2468] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 12.
I20260709 13:07:25.364542 20694 leader_election.cc:290] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:25.357846 20919 leader_election.cc:290] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:25.427456 20808 raft_consensus.cc:2804] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:25.427786 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:25.428015 20808 raft_consensus.cc:493] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:25.428529 20808 raft_consensus.cc:3060] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:25.428707 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:25.429181 16202 raft_consensus.cc:1240] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:25.429582 16248 leader_election.cc:304] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:25.430403 16277 pending_rounds.cc:85] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3: Aborting all ops after (but not including) 4
I20260709 13:07:25.430100 20834 raft_consensus.cc:515] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:25.430858 20919 raft_consensus.cc:2749] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:07:25.431373 16246 leader_election.cc:304] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:25.431666 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:25.432341 16278 raft_consensus.cc:2468] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 11.
I20260709 13:07:25.433033 20797 leader_election.cc:290] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:25.433696 20797 raft_consensus.cc:2804] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:25.434093 20797 raft_consensus.cc:493] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:25.403473 20752 raft_consensus.cc:493] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.434996 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:25.434895 20752 raft_consensus.cc:515] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:25.435731 16274 raft_consensus.cc:2468] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 11.
I20260709 13:07:25.436321 20915 leader_election.cc:290] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:25.430683 20489 raft_consensus.cc:2804] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:25.437182 20489 raft_consensus.cc:493] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:25.437335 16274 raft_consensus.cc:1275] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:07:25.437666 20489 raft_consensus.cc:3060] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:25.440217 16248 leader_election.cc:304] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:25.441642 20659 raft_consensus.cc:2749] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:25.418184 16949 raft_consensus.cc:2468] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 8.
W20260709 13:07:25.444231 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 77187.1us
I20260709 13:07:25.446772 20738 raft_consensus.cc:2749] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:25.450858 16948 raft_consensus.cc:2468] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 8.
W20260709 13:07:25.451846 16322 connection.cc:256] RPC call timeout handler was delayed by -1.0345923810000386s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1768s for a response
W20260709 13:07:25.452050 16912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:25.452215 20814 raft_consensus.cc:3060] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:25.453054 16322 leader_election.cc:304] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:25.453905 20521 raft_consensus.cc:2749] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:25.454281 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:25.454816 20489 raft_consensus.cc:515] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:07:25.457679 20907 log.cc:927] Time spent T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 1.352s	user 0.006s	sys 0.004s
I20260709 13:07:25.458874 20919 consensus_queue.cc:1048] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:25.455278 16949 raft_consensus.cc:2393] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 11: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
I20260709 13:07:25.426940 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:25.462775 16205 raft_consensus.cc:3060] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:25.464092 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:25.466190 16248 leader_election.cc:304] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:25.464248 16207 raft_consensus.cc:2393] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 9: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:07:25.430774 16277 pending_rounds.cc:107] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 13:07:25.461361 16322 leader_election.cc:304] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:25.483413 16277 raft_consensus.cc:2889] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:25.392531 20827 raft_consensus.cc:493] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:25.392886 20817 raft_consensus.cc:493] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:25.406919 20822 raft_consensus.cc:493] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.472829 16943 raft_consensus.cc:2468] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 12.
I20260709 13:07:25.488468 16278 raft_consensus.cc:1275] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:07:25.417855 20813 raft_consensus.cc:2749] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:25.469805 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:25.470397 16274 raft_consensus.cc:1240] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:25.498482 16208 raft_consensus.cc:2468] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 11.
I20260709 13:07:25.470595 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:25.499313 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:25.495921 16248 leader_election.cc:304] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:25.411417 20759 raft_consensus.cc:493] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.412386 20920 raft_consensus.cc:493] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:25.389338 20746 raft_consensus.cc:493] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:25.473520 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:25.512633 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:25.497126 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:07:25.514030 16947 raft_consensus.cc:3060] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:25.453346 20808 raft_consensus.cc:515] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:25.501503 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:25.503196 16322 leader_election.cc:304] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:07:25.503903 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:25.434494 20797 raft_consensus.cc:3060] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:25.461311 20795 leader_election.cc:290] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:25.506848 20660 consensus_queue.cc:1059] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:25.492434 20787 raft_consensus.cc:493] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.531106 20800 raft_consensus.cc:3055] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:25.531607 20800 raft_consensus.cc:740] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:25.531352 20787 raft_consensus.cc:515] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:25.532543 20800 consensus_queue.cc:260] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:25.507325 20920 raft_consensus.cc:515] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:25.533756 20800 raft_consensus.cc:3060] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:25.508358 20659 consensus_queue.cc:1059] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:07:25.521854 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 158762us
I20260709 13:07:25.536638 16322 leader_election.cc:304] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:07:25.539240 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:25.539242 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:25.541702 16208 raft_consensus.cc:2468] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 13.
I20260709 13:07:25.533773 20787 leader_election.cc:290] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:25.501384 20521 raft_consensus.cc:2749] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:25.555814 16280 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45218 (request call id 2258) took 1503 ms. Trace:
I20260709 13:07:25.463744 20742 raft_consensus.cc:515] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:25.567217 16276 raft_consensus.cc:2393] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 14: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:07:25.567535 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:07:25.570123 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:25.502465 20878 raft_consensus.cc:493] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.558259 16280 rpcz_store.cc:276] 0709 13:07:24.052659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:24.056132 (+  3473us) service_pool.cc:224] Handling call
0709 13:07:24.056597 (+   465us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:24.057097 (+   500us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:24.057139 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:24.057795 (+   656us) log.cc:844] Serialized 26 byte log entry
0709 13:07:24.456523 (+398728us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:24.456573 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:24.456654 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:25.303034 (+846380us) spinlock_profiling.cc:243] Waited 888 us on lock 0x7b4400022b4c. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361c224db1 00007f361c2c2c85 00007f361c2c36a2 00007f361f0351db 00007f361f030aaf 00007f361f02486e 00007f361f023bb6 00007f361f0237d8 00007f361f02d221 00007f361f02d1d9 00007f361f02d169
0709 13:07:25.522503 (+219469us) raft_consensus.cc:1685] finished
0709 13:07:25.522539 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:25.555718 (+ 33179us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3416,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":11896,"spinlock_wait_cycles":2042112,"thread_start_us":398297,"threads_started":1,"wal-append.queue_time_us":567116}
I20260709 13:07:25.474042 20607 consensus_queue.cc:1048] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.072s
I20260709 13:07:25.576678 16205 raft_consensus.cc:2468] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 13.
I20260709 13:07:25.488561 20748 consensus_queue.cc:1048] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.064s
W20260709 13:07:25.582101 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:25.538743 20660 raft_consensus.cc:2749] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:07:25.583031 16915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:25.538743 20871 raft_consensus.cc:2749] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:25.544445 20795 raft_consensus.cc:493] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:25.503376 20880 consensus_queue.cc:1048] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 13:07:25.503705 20827 raft_consensus.cc:515] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:25.501642 20822 raft_consensus.cc:515] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:07:25.581015 16173 consensus_peers.cc:597] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f -> Peer 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875): Couldn't send request to peer 1109f76a0b7b443a84c0327c8707bc63. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4b962ceebb5c48c1914459ae0c0eff1b. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:25.701102 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 155891us
I20260709 13:07:25.497296 20817 raft_consensus.cc:515] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:25.544719 20661 raft_consensus.cc:493] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:25.556387 20764 leader_election.cc:290] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:25.694670 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:25.565394 20489 leader_election.cc:290] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:25.571942 20694 raft_consensus.cc:2804] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:25.581568 20878 raft_consensus.cc:515] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:07:25.683452 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 146933us
I20260709 13:07:25.719247 16278 raft_consensus.cc:2393] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 13: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:07:25.719602 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:25.721447 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:25.574188 20813 raft_consensus.cc:3055] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:25.542078 20746 raft_consensus.cc:515] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:07:25.688277 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 192453us
I20260709 13:07:25.837003 16248 leader_election.cc:304] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63
W20260709 13:07:25.835237 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 290027us
I20260709 13:07:25.550895 20915 raft_consensus.cc:493] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
W20260709 13:07:25.681416 20911 log.cc:927] Time spent T 00000000000000000000000000000000 P 4dc6f08597514f4d85fd451b999b403e: Append to log took a long time: real 1.047s	user 0.001s	sys 0.013s
I20260709 13:07:25.840481 20915 raft_consensus.cc:515] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:25.694615 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:25.841590 16280 raft_consensus.cc:2468] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 14.
W20260709 13:07:25.705711 16914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:25.841012 20752 leader_election.cc:290] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:25.844216 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:25.844916 16205 raft_consensus.cc:3060] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:25.702422 16173 leader_election.cc:304] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
W20260709 13:07:25.847294 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 144953us
I20260709 13:07:25.848567 16173 leader_election.cc:304] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:25.849447 16173 leader_election.cc:304] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
W20260709 13:07:25.690060 20909 log.cc:927] Time spent T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 13:07:25.850802 20562 raft_consensus.cc:2749] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:25.510099 20759 raft_consensus.cc:515] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:25.580194 20809 raft_consensus.cc:2804] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:07:25.730892 20617 consensus_meta.cc:287] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 0.502s	user 0.010s	sys 0.002s
I20260709 13:07:25.702028 20891 leader_election.cc:290] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:25.734414 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:25.736377 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:25.864949 16320 leader_election.cc:304] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:25.739827 16947 raft_consensus.cc:2468] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 10.
I20260709 13:07:25.737376 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:25.742883 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:25.877880 16944 raft_consensus.cc:1240] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:07:25.743690 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
W20260709 13:07:25.746730 20934 log.cc:927] Time spent T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:07:25.747187 16282 raft_consensus.cc:1240] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:25.747993 20808 leader_election.cc:290] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:25.755129 16283 raft_consensus.cc:1240] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:07:25.759919 20817 leader_election.cc:290] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:25.760809 20757 leader_election.cc:290] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:25.762286 20742 leader_election.cc:290] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:25.711462 20826 raft_consensus.cc:493] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:25.767503 16349 raft_consensus.cc:1240] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 9. Current term is 10. Ops: [8.8-9.9]
I20260709 13:07:25.718112 20661 raft_consensus.cc:515] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:25.779711 20878 leader_election.cc:290] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:25.780968 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:25.905893 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:07:25.781939 16174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:25.784081 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:25.907094 16199 raft_consensus.cc:3060] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:25.786132 20694 raft_consensus.cc:493] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
W20260709 13:07:25.795425 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:25.917124 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:25.797019 20830 leader_election.cc:290] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:25.802343 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:25.805686 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:25.806412 20827 leader_election.cc:290] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:07:25.809676 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:25.817627 20834 leader_election.cc:290] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:25.822154 16322 leader_election.cc:304] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:07:25.824128 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:25.825781 16200 raft_consensus.cc:2410] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
W20260709 13:07:25.927022 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 104972us
I20260709 13:07:25.927850 16322 leader_election.cc:304] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:25.929246 16322 leader_election.cc:304] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:25.826571 20822 leader_election.cc:290] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:25.831193 16203 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60138 (request call id 2483) took 1589 ms. Trace:
I20260709 13:07:25.935091 16203 rpcz_store.cc:276] 0709 13:07:24.241656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:24.241835 (+   179us) service_pool.cc:224] Handling call
0709 13:07:24.259104 (+ 17269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:25.400900 (+1141796us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:25.830821 (+429921us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b5400366854. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f489e01 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6
0709 13:07:25.831103 (+   282us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2522171776}
I20260709 13:07:25.934135 20922 raft_consensus.cc:2749] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:25.831133 20806 raft_consensus.cc:515] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:25.833366 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:25.939492 20745 raft_consensus.cc:2749] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:25.940176 16276 raft_consensus.cc:2393] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 11: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
W20260709 13:07:25.836066 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 53534.9us
I20260709 13:07:25.880218 20617 raft_consensus.cc:515] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:25.840976 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:25.946959 16202 raft_consensus.cc:3060] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:25.860589 16205 raft_consensus.cc:2468] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 10.
I20260709 13:07:25.864533 16248 leader_election.cc:304] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:25.808354 20797 raft_consensus.cc:515] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:25.832939 20813 raft_consensus.cc:740] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
W20260709 13:07:25.878207 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:25.697188 20795 raft_consensus.cc:515] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:25.882033 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:25.865409 20562 raft_consensus.cc:2804] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:25.865281 20809 raft_consensus.cc:493] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:25.866040 20814 raft_consensus.cc:2804] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:25.903978 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:25.958060 16353 raft_consensus.cc:2468] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 17.
I20260709 13:07:25.933946 20861 raft_consensus.cc:2749] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:25.879197 20592 raft_consensus.cc:2804] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:25.920259 16206 raft_consensus.cc:3060] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:07:25.899813 20915 leader_election.cc:290] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:25.888927 20891 raft_consensus.cc:2804] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:25.924417 16352 raft_consensus.cc:2393] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 15: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:07:25.968490 16275 raft_consensus.cc:1240] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:25.903223 20800 consensus_queue.cc:1059] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 13:07:25.969225 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:25.930539 16322 leader_election.cc:304] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:25.692030 16279 raft_consensus.cc:2368] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for earlier term 13. Current term is 14.
I20260709 13:07:25.941370 16246 leader_election.cc:304] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:25.971117 16199 raft_consensus.cc:2468] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 14.
I20260709 13:07:25.971470 16246 leader_election.cc:304] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:25.972051 16322 leader_election.cc:304] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:07:25.972626 20742 raft_consensus.cc:2804] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:25.973042 20742 raft_consensus.cc:493] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:25.972841 16246 leader_election.cc:304] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:25.973387 16322 leader_election.cc:304] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:25.973608 20742 raft_consensus.cc:3060] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:25.946138 16356 raft_consensus.cc:1240] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 10. Current term is 11. Ops: []
W20260709 13:07:25.976410 16915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:25.935472 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:25.919529 20694 raft_consensus.cc:3060] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:25.949689 16351 raft_consensus.cc:2468] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 11.
W20260709 13:07:25.951870 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 87442.6us
I20260709 13:07:25.984193 16248 leader_election.cc:304] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:07:25.984328 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:25.985694 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:25.951278 16348 raft_consensus.cc:2468] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 14.
I20260709 13:07:25.955014 16207 raft_consensus.cc:1275] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:07:25.904237 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:25.987427 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:25.987973 16357 raft_consensus.cc:2468] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 5.
I20260709 13:07:25.960213 16355 raft_consensus.cc:2393] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 9: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:07:25.907776 20826 raft_consensus.cc:515] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:25.980319 16202 raft_consensus.cc:2468] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 16.
I20260709 13:07:25.953058 20822 raft_consensus.cc:2749] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:25.982157 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:25.994679 16276 raft_consensus.cc:2468] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 15.
I20260709 13:07:25.979789 16349 raft_consensus.cc:3060] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:25.993513 16248 leader_election.cc:304] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:25.988942 16322 leader_election.cc:304] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:25.987387 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:25.957222 20809 raft_consensus.cc:3060] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:25.991555 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:07:26.001634 16912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:26.001969 16353 raft_consensus.cc:2468] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 9.
I20260709 13:07:25.999946 16914 leader_election.cc:304] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:07:26.002954 16248 leader_election.cc:304] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:25.957774 20814 raft_consensus.cc:493] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:26.010445 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:26.011725 16348 raft_consensus.cc:2468] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 11.
I20260709 13:07:26.004733 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:26.005810 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:25.993981 16199 raft_consensus.cc:1240] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:26.004418 16278 raft_consensus.cc:2468] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 15.
I20260709 13:07:26.021183 16357 raft_consensus.cc:2376] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 11. Re-sending same reply.
I20260709 13:07:25.968112 20745 raft_consensus.cc:493] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.960675 20562 raft_consensus.cc:697] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:07:25.992483 20878 raft_consensus.cc:2804] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:25.989925 20948 raft_consensus.cc:2749] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:26.023293 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:26.024178 16351 raft_consensus.cc:3060] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:26.024755 16205 raft_consensus.cc:1240] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:26.025693 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:25.992998 20946 raft_consensus.cc:2749] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:07:26.027148 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 177754us
I20260709 13:07:25.998571 20808 raft_consensus.cc:2804] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:25.967656 20592 raft_consensus.cc:493] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:26.033274 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:25.990540 20931 raft_consensus.cc:2804] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:26.078680 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bc3c8ff9b84838a2664335d7e1582b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:25.979161 20891 raft_consensus.cc:493] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:26.052695 16914 leader_election.cc:304] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:07:26.057631 16348 raft_consensus.cc:2468] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 12.
I20260709 13:07:26.015465 20746 leader_election.cc:290] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:26.013053 20691 raft_consensus.cc:2804] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:26.067369 16945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:07:26.014317 20814 raft_consensus.cc:3060] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:26.005566 20489 raft_consensus.cc:2804] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:26.072227 20800 raft_consensus.cc:493] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.073942 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:26.018980 20757 raft_consensus.cc:2804] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:25.998174 20880 consensus_queue.cc:1059] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.057s
W20260709 13:07:26.037351 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 48538.8us
I20260709 13:07:26.116899 16947 raft_consensus.cc:2468] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 7.
I20260709 13:07:26.032333 20942 raft_consensus.cc:2749] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:26.099997 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:26.122646 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:26.054479 20878 raft_consensus.cc:493] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Starting leader election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:26.132114 20878 raft_consensus.cc:3060] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:26.107244 20808 raft_consensus.cc:697] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:07:26.135759 20808 consensus_queue.cc:237] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:26.137095 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:07:26.137813 16942 raft_consensus.cc:3060] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:26.138160 20806 leader_election.cc:290] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:26.116094 20489 raft_consensus.cc:493] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:26.147564 20489 raft_consensus.cc:3060] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:26.047930 20745 raft_consensus.cc:515] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } }
I20260709 13:07:26.152750 16948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:26.103446 16349 raft_consensus.cc:2468] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 13.
I20260709 13:07:26.104327 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:26.078338 20592 raft_consensus.cc:3060] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:26.111016 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:26.053897 20947 raft_consensus.cc:2749] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:07:26.119604 16322 leader_election.cc:304] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:26.120210 20764 consensus_queue.cc:1048] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:26.120978 20660 consensus_queue.cc:1059] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:26.123726 16354 raft_consensus.cc:2468] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 13.
I20260709 13:07:26.089340 20891 raft_consensus.cc:3060] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:26.007972 20813 consensus_queue.cc:260] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:26.131314 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:26.176548 16353 raft_consensus.cc:2468] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 13.
I20260709 13:07:26.179692 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:26.104971 20691 raft_consensus.cc:493] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
W20260709 13:07:26.181270 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 61741.5us
I20260709 13:07:26.188302 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bc3c8ff9b84838a2664335d7e1582b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:26.157822 16351 raft_consensus.cc:2468] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 15.
W20260709 13:07:26.191682 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:26.179800 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:26.157577 20830 raft_consensus.cc:493] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:26.159528 20745 leader_election.cc:290] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:26.078760 20931 raft_consensus.cc:493] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:26.107455 20834 raft_consensus.cc:2804] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:26.194161 16349 raft_consensus.cc:2393] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 15: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:07:26.124667 20757 raft_consensus.cc:493] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:26.196803 16320 leader_election.cc:304] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:26.151778 20759 leader_election.cc:290] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:26.200071 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:26.167726 20752 raft_consensus.cc:493] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:26.232300 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 49744.6us
I20260709 13:07:26.230026 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:26.181109 20948 raft_consensus.cc:3055] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:26.238343 16205 raft_consensus.cc:2468] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 11.
I20260709 13:07:26.232019 20661 leader_election.cc:290] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:26.239636 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:26.241165 16205 raft_consensus.cc:1240] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:26.189095 20691 raft_consensus.cc:3060] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:26.242954 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:26.237761 16201 raft_consensus.cc:2468] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 17.
W20260709 13:07:26.243083 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 46398.6us
I20260709 13:07:26.245507 16205 raft_consensus.cc:1275] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:07:26.244609 16208 raft_consensus.cc:2468] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 10.
I20260709 13:07:26.249411 16205 raft_consensus.cc:1275] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:07:26.167282 20800 raft_consensus.cc:515] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:26.235536 20757 raft_consensus.cc:3060] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:26.280112 16353 raft_consensus.cc:1275] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:07:26.274348 20800 leader_election.cc:290] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:26.283434 16946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:26.268699 20920 leader_election.cc:290] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:07:26.249184 20907 log.cc:927] Time spent T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
W20260709 13:07:26.293164 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:26.292804 20694 raft_consensus.cc:515] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:07:26.187850 20562 consensus_queue.cc:237] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:26.233522 20834 raft_consensus.cc:493] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:26.300181 20834 raft_consensus.cc:3060] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:26.300843 20592 raft_consensus.cc:515] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:26.302155 16280 raft_consensus.cc:1240] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:26.303427 16320 leader_election.cc:304] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:26.304595 20764 raft_consensus.cc:2749] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:26.305284 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:26.268003 16322 leader_election.cc:304] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:07:26.306528 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 55735.7us
W20260709 13:07:26.253199 20950 log.cc:927] Time spent T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
W20260709 13:07:26.254115 20944 log.cc:927] Time spent T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.147s	user 0.001s	sys 0.000s
I20260709 13:07:26.240459 20948 raft_consensus.cc:740] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
W20260709 13:07:26.263840 20954 log.cc:927] Time spent T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:07:26.247746 20880 raft_consensus.cc:2764] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:07:26.266412 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:26.268371 20617 leader_election.cc:290] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:26.253170 20752 raft_consensus.cc:515] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:26.446204 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:07:26.368417 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:26.369894 20757 raft_consensus.cc:515] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:26.453989 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 18 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:26.454973 16276 raft_consensus.cc:2410] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for term 18 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:07:26.233064 20931 raft_consensus.cc:3060] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:26.367699 16320 leader_election.cc:304] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:26.402119 20795 leader_election.cc:290] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:26.387653 20915 raft_consensus.cc:493] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.415400 16942 raft_consensus.cc:2468] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 13.
I20260709 13:07:26.416625 16322 leader_election.cc:304] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:26.262326 16206 raft_consensus.cc:2468] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 14.
I20260709 13:07:26.384089 20878 raft_consensus.cc:515] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:26.375723 20891 raft_consensus.cc:515] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:26.230540 20929 raft_consensus.cc:2749] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:07:26.419095 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 50527.6us
I20260709 13:07:26.422526 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:26.431851 20797 leader_election.cc:290] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:26.420233 20745 raft_consensus.cc:3060] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:07:26.461630 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 94020.1us
I20260709 13:07:26.430076 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:26.434621 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:26.209082 20830 raft_consensus.cc:515] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:07:26.480561 16174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:26.480734 20830 leader_election.cc:290] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:07:26.446614 16912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:26.481976 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:26.482710 16203 raft_consensus.cc:2468] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 10.
I20260709 13:07:26.483467 16912 leader_election.cc:304] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:26.483780 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:26.484594 16205 raft_consensus.cc:2468] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 17.
I20260709 13:07:26.486263 20745 raft_consensus.cc:2749] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:26.486203 20797 consensus_queue.cc:1059] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:07:26.487798 20782 raft_consensus.cc:3055] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:26.488219 20782 raft_consensus.cc:740] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:07:26.489306 20782 consensus_queue.cc:260] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:26.435896 20764 raft_consensus.cc:493] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:26.471446 16278 raft_consensus.cc:2393] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 9: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:07:26.448987 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:26.486011 20758 raft_consensus.cc:2749] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:07:26.427356 20951 log.cc:927] Time spent T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63: Append to log took a long time: real 0.186s	user 0.002s	sys 0.002s
I20260709 13:07:26.491453 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c15d8e9be8414c84912ab77b66bfb1" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:26.473618 16942 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40078 (request call id 557) took 1014 ms. Trace:
I20260709 13:07:26.489822 16205 raft_consensus.cc:1275] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:26.422911 20742 raft_consensus.cc:515] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } }
I20260709 13:07:26.490512 20764 raft_consensus.cc:515] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:26.493184 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:26.494720 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:26.495481 16912 leader_election.cc:304] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:26.495657 20764 leader_election.cc:290] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:26.496296 20758 raft_consensus.cc:2804] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:26.496735 20758 raft_consensus.cc:493] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:26.497323 20758 raft_consensus.cc:3060] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:26.481276 20795 raft_consensus.cc:493] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.472788 16248 leader_election.cc:304] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:07:26.488132 16246 leader_election.cc:304] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:26.492139 20782 raft_consensus.cc:3060] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:26.522428 20752 leader_election.cc:290] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:07:26.525377 20809 consensus_meta.cc:287] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 0.508s	user 0.009s	sys 0.001s
I20260709 13:07:26.525887 20809 raft_consensus.cc:515] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:26.528280 20809 leader_election.cc:290] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:26.469619 20660 raft_consensus.cc:2749] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:26.530081 16199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60154 (request call id 2714) took 1028 ms. Trace:
I20260709 13:07:26.530566 16277 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45218 (request call id 2268) took 1121 ms. Trace:
I20260709 13:07:26.531765 16350 raft_consensus.cc:1240] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 7. Current term is 9. Ops: []
W20260709 13:07:26.532335 16248 leader_election.cc:336] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 1.600s (SENT)
I20260709 13:07:26.532953 16248 leader_election.cc:304] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:26.497860 16946 raft_consensus.cc:2393] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 16: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
I20260709 13:07:26.534516 20759 raft_consensus.cc:2749] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:26.457160 20592 leader_election.cc:290] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 election: Requested vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:26.509948 20919 raft_consensus.cc:2804] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:26.536191 20919 raft_consensus.cc:697] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:07:26.514348 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:26.537472 16357 raft_consensus.cc:2393] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 11: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
I20260709 13:07:26.537246 20919 consensus_queue.cc:237] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:26.531085 16277 rpcz_store.cc:276] 0709 13:07:25.409513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.429808 (+ 20295us) service_pool.cc:224] Handling call
0709 13:07:25.430191 (+   383us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:25.493374 (+ 63183us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:25.493420 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:25.500702 (+  7282us) log.cc:844] Serialized 52 byte log entry
0709 13:07:25.963316 (+462614us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:26.012916 (+ 49600us) log.cc:844] Serialized 14 byte log entry
0709 13:07:26.133493 (+120577us) spinlock_profiling.cc:243] Waited 16.8 ms on lock 0x7b18000aee80. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f3625264de1 00007f36252715b1 00007f361c37ee07 00007f36251d9ab9 00007f361c39b69b 00007f361c39993f 00007f361c399455 00007f361f481060 00007f361f493716 00007f361f4a4287 00007f361f4a4208
0709 13:07:26.194082 (+ 60589us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:26.194162 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:26.276892 (+ 82730us) spinlock_profiling.cc:243] Waited 5.91 ms on lock 0x7b18000aee80. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f3625264de1 00007f36252715b1 00007f361c39c522 00007f361c39e7c1 00007f361c39e779 00007f361c39e709 00007f361c39e6d1 00007f361c39d9cd 000000000038f354 000000000038f199 00007f361c37f83a
0709 13:07:26.527649 (+250757us) spinlock_profiling.cc:243] Waited 2.37 ms on lock 0x7b24002a6f08. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361c224db1 00007f361c2229c4 00007f361c220acb 00007f361c3dbdc9 00007f361c3dba55 00007f361c3dafb0 00007f361f051488 00007f361f051be8 00007f361f029398 00007f361f02476a 00007f361f023bb6
0709 13:07:26.530299 (+  2650us) raft_consensus.cc:1685] finished
0709 13:07:26.530321 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:26.530483 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9100,"prepare.queue_time_us":49389,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":50,"raft.queue_time_us":32068,"raft.run_cpu_time_us":315,"raft.run_wall_time_us":11684,"spinlock_wait_cycles":57816192,"thread_start_us":473871,"threads_started":2,"wal-append.queue_time_us":542041}
W20260709 13:07:26.511462 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 435220us
I20260709 13:07:26.540587 16200 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60154 (request call id 2694) took 1157 ms. Trace:
I20260709 13:07:26.540973 16200 rpcz_store.cc:276] 0709 13:07:25.383728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.385653 (+  1925us) service_pool.cc:224] Handling call
0709 13:07:26.540405 (+1154752us) spinlock_profiling.cc:243] Waited 416 ms on lock 0x7b540002bcd4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:07:26.540534 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":956278016}
I20260709 13:07:26.517817 20861 raft_consensus.cc:3055] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:26.542784 20861 raft_consensus.cc:740] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:26.543694 20861 consensus_queue.cc:260] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:26.544783 20861 raft_consensus.cc:3060] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:26.520479 20757 leader_election.cc:290] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 16 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:26.518870 20694 leader_election.cc:290] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:26.545229 20795 raft_consensus.cc:515] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:07:26.547216 20814 raft_consensus.cc:515] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:26.534482 16283 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45210 (request call id 2329) took 1140 ms. Trace:
I20260709 13:07:26.548750 16283 rpcz_store.cc:276] 0709 13:07:25.394306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.394769 (+   463us) service_pool.cc:224] Handling call
0709 13:07:25.421999 (+ 27230us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:25.881088 (+459089us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:26.534152 (+653064us) spinlock_profiling.cc:243] Waited 333 ms on lock 0x7b54002fadd4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f489e01 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6
0709 13:07:26.534403 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":765196672}
I20260709 13:07:26.549480 20814 leader_election.cc:290] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 13 election: Requested vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:26.550275 16208 raft_consensus.cc:1240] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:26.498178 20691 raft_consensus.cc:515] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:07:26.551417 16173 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:26.500988 16352 raft_consensus.cc:2368] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for earlier term 13. Current term is 14.
I20260709 13:07:26.530758 16199 rpcz_store.cc:276] 0709 13:07:25.501724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.971940 (+470216us) service_pool.cc:224] Handling call
0709 13:07:25.993736 (+ 21796us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:26.021224 (+ 27488us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:26.529775 (+508551us) spinlock_profiling.cc:243] Waited 21.4 ms on lock 0x7b540038a4d0. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f4888ad 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:07:26.529993 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":49321216}
W20260709 13:07:26.509227 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 92698.1us
I20260709 13:07:26.564116 16173 leader_election.cc:304] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:07:26.387109 20661 raft_consensus.cc:493] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.555938 16946 raft_consensus.cc:1275] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:07:26.557741 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 69687.7us
W20260709 13:07:26.502681 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:26.544409 20834 raft_consensus.cc:515] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:26.567823 16246 leader_election.cc:304] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:26.566174 16173 leader_election.cc:304] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
W20260709 13:07:26.563144 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 64094.6us
I20260709 13:07:26.502413 16942 rpcz_store.cc:276] 0709 13:07:25.459319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.459729 (+   410us) service_pool.cc:224] Handling call
0709 13:07:26.136975 (+677246us) spinlock_profiling.cc:243] Waited 954 us on lock 0x7b58001a3d98. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361c224db1 00007f361c364b71 00007f361c364eee 0000000000375939 00007f36243d81e0 00007f36244a10c4 00007f36244a1131 00007f362444f0a0 00007f362444e984 00007f361d9c96d4 00007f361d9c9662
0709 13:07:26.473560 (+336585us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2209536}
I20260709 13:07:26.548089 20811 raft_consensus.cc:3055] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:26.570757 16173 leader_election.cc:304] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:26.570698 16246 leader_election.cc:304] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:26.575106 16948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:07:26.577280 16246 leader_election.cc:304] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:26.500761 20880 raft_consensus.cc:2804] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:26.579419 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:26.580368 16200 raft_consensus.cc:2468] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 10.
I20260709 13:07:26.586866 16246 leader_election.cc:304] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:26.570055 20797 raft_consensus.cc:2804] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:26.574638 20814 raft_consensus.cc:2749] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:26.498682 20915 raft_consensus.cc:515] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:26.579912 20943 raft_consensus.cc:2804] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:26.606257 16279 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45218 (request call id 2263) took 1199 ms. Trace:
I20260709 13:07:26.596882 16320 leader_election.cc:304] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:07:26.576295 20955 raft_consensus.cc:2804] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:26.581363 20746 raft_consensus.cc:2804] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:07:26.599581 16915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:26.608525 16279 rpcz_store.cc:276] 0709 13:07:25.407013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.407242 (+   229us) service_pool.cc:224] Handling call
0709 13:07:26.606033 (+1198791us) spinlock_profiling.cc:243] Waited 194 ms on lock 0x7b5400127354. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:07:26.606171 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":445552896}
I20260709 13:07:26.572513 20811 raft_consensus.cc:740] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:26.593793 20952 raft_consensus.cc:2804] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:26.605204 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:26.642055 16200 raft_consensus.cc:3060] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:26.584879 20880 raft_consensus.cc:493] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:26.583839 20759 raft_consensus.cc:2804] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:07:26.615339 16946 raft_consensus.cc:1275] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 LEARNER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:07:26.616405 16948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:26.617754 20746 raft_consensus.cc:493] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:26.607182 20922 consensus_queue.cc:1048] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:07:26.623421 16348 raft_consensus.cc:1275] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:07:26.625954 20826 leader_election.cc:290] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:26.647082 20880 raft_consensus.cc:3060] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:26.641963 20806 consensus_queue.cc:1059] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 13:07:26.628999 20761 consensus_queue.cc:1059] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:26.669256 20922 raft_consensus.cc:3055] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:26.669965 20922 raft_consensus.cc:740] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:26.630125 20943 raft_consensus.cc:697] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:07:26.578074 20661 raft_consensus.cc:515] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:26.673028 20943 consensus_queue.cc:237] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:26.674079 20661 leader_election.cc:290] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:26.606197 20797 raft_consensus.cc:697] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:07:26.630951 20834 leader_election.cc:290] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 16 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:26.632122 20891 leader_election.cc:290] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:26.629660 20955 raft_consensus.cc:493] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:26.633816 16320 leader_election.cc:304] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:26.695207 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
W20260709 13:07:26.695638 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 61877.6us
I20260709 13:07:26.697080 16320 leader_election.cc:304] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:26.634377 20603 raft_consensus.cc:2804] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:26.699491 16200 raft_consensus.cc:2468] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 18.
I20260709 13:07:26.682659 16912 leader_election.cc:304] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:26.634974 20809 consensus_queue.cc:1059] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:26.635399 20795 leader_election.cc:290] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:26.636184 20489 raft_consensus.cc:515] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:26.636830 20878 leader_election.cc:290] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 12 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:26.591480 20822 raft_consensus.cc:2804] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:26.636883 16945 raft_consensus.cc:1240] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:26.679842 20759 raft_consensus.cc:697] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:07:26.587124 20660 consensus_queue.cc:1059] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:07:26.657347 20915 leader_election.cc:290] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:26.659952 20931 raft_consensus.cc:515] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:07:26.647200 20952 raft_consensus.cc:493] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:26.650218 20746 raft_consensus.cc:3060] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:26.579746 20694 consensus_queue.cc:1048] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
W20260709 13:07:26.675300 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:26.675349 16202 raft_consensus.cc:1275] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 9. (term mismatch)
I20260709 13:07:26.769934 16202 pending_rounds.cc:85] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f: Aborting all ops after (but not including) 8
I20260709 13:07:26.770419 16202 pending_rounds.cc:107] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f: Aborting uncommitted NO_OP operation due to leader change: 12.9
I20260709 13:07:26.770792 16202 raft_consensus.cc:2889] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:07:26.677966 16248 leader_election.cc:336] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 1.501s (SENT)
I20260709 13:07:26.691458 16946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:07:26.710275 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:26.772070 16248 leader_election.cc:304] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:26.711045 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:26.723678 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:26.723469 16105 catalog_manager.cc:5697] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: term changed from 10 to 12, leader changed from e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) to 363bb2f744eb486f9ad726f08214c98e (127.14.180.67). New cstate: current_term: 12 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:07:25.615536 15057 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:26.731911 20811 consensus_queue.cc:260] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:26.734794 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:26.775554 16282 raft_consensus.cc:2393] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 18: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:07:26.737690 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
W20260709 13:07:26.739053 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:26.742468 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 59973.5us
I20260709 13:07:26.743773 16914 leader_election.cc:304] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:26.743773 16246 leader_election.cc:304] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
W20260709 13:07:26.779079 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 101174us
W20260709 13:07:26.780050 16248 leader_election.cc:336] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 1.675s (SENT)
I20260709 13:07:26.780579 16248 leader_election.cc:304] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:07:26.752018 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 178382us
I20260709 13:07:26.782616 16200 raft_consensus.cc:1275] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:07:26.753815 16277 raft_consensus.cc:1275] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:07:26.751624 20929 consensus_queue.cc:1048] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 13:07:26.754892 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:26.757723 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:26.645196 20742 leader_election.cc:290] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 18 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:26.746870 20955 raft_consensus.cc:3060] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:26.752494 20800 raft_consensus.cc:2804] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:26.751428 20748 raft_consensus.cc:2804] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:07:26.756593 20940 log.cc:927] Time spent T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63: Append to log took a long time: real 0.054s	user 0.000s	sys 0.009s
I20260709 13:07:26.747082 20603 raft_consensus.cc:493] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:26.788215 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:26.854697 16278 raft_consensus.cc:3060] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:26.788725 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
W20260709 13:07:26.790633 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:26.769927 20952 raft_consensus.cc:3060] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:26.792155 20797 consensus_queue.cc:237] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:26.865643 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:26.773959 20822 raft_consensus.cc:697] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:07:26.785259 20947 raft_consensus.cc:3055] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:07:26.866984 20947 raft_consensus.cc:740] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:26.867594 20822 consensus_queue.cc:237] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:26.797765 20758 raft_consensus.cc:515] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:26.803186 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
W20260709 13:07:26.871147 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 79499.5us
I20260709 13:07:26.804637 16276 raft_consensus.cc:1240] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:26.805696 20813 raft_consensus.cc:3060] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:26.806715 20920 raft_consensus.cc:2804] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:07:26.809177 20915 raft_consensus.cc:2955] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [term 9 LEADER]: Committing config change with OpId 7.6: config changed from index -1 to 6, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:07:26.810724 20880 raft_consensus.cc:515] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:26.812083 16173 leader_election.cc:400] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 13 pre-election: Vote denied by peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823) with higher term. Message: Invalid argument: T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for earlier term 13. Current term is 14.
I20260709 13:07:26.813510 20919 raft_consensus.cc:2749] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:07:26.891746 16173 leader_election.cc:403] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:07:26.892367 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 80475.2us
I20260709 13:07:26.767170 20806 raft_consensus.cc:2804] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:07:26.852208 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 72198.4us
W20260709 13:07:26.853459 16174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:26.857846 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:26.858644 20748 raft_consensus.cc:493] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:26.867973 20947 consensus_queue.cc:260] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:26.860216 20809 raft_consensus.cc:493] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.795377 20489 leader_election.cc:290] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 election: Requested vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:26.874330 16948 raft_consensus.cc:2393] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 11: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
I20260709 13:07:26.881134 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:07:26.889418 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 111565us
I20260709 13:07:26.870699 20834 raft_consensus.cc:2749] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:26.850756 20800 raft_consensus.cc:493] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:26.897473 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:26.861768 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:26.936308 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:26.936890 16348 raft_consensus.cc:3060] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:26.937537 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:26.902977 16352 raft_consensus.cc:2376] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 12. Re-sending same reply.
I20260709 13:07:26.938617 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:26.939206 16352 raft_consensus.cc:3060] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:26.904867 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:07:26.904245 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 207262us
I20260709 13:07:26.901762 16322 leader_election.cc:304] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:07:26.859742 20764 raft_consensus.cc:493] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.898883 20806 raft_consensus.cc:493] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:26.921667 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:26.921941 16349 raft_consensus.cc:1240] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:07:26.870457 20758 leader_election.cc:290] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 11 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:26.904441 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:26.923142 16280 raft_consensus.cc:3060] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:26.927803 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:26.894461 16173 leader_election.cc:304] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:26.945814 16248 leader_election.cc:304] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:26.861984 20603 raft_consensus.cc:3060] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:26.951890 16348 raft_consensus.cc:2468] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 10.
I20260709 13:07:26.962167 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:26.873157 20659 raft_consensus.cc:2749] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:26.874330 20863 consensus_queue.cc:1048] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.071s
I20260709 13:07:26.906342 20920 raft_consensus.cc:697] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:07:26.978672 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:26.919195 16278 raft_consensus.cc:2468] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 16.
I20260709 13:07:26.889423 20787 consensus_queue.cc:1048] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 13:07:26.991115 16320 leader_election.cc:304] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:26.970916 16353 raft_consensus.cc:2393] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 14: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
W20260709 13:07:26.955991 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 54367.3us
I20260709 13:07:26.960836 16204 raft_consensus.cc:3060] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:26.922763 20748 raft_consensus.cc:3060] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:26.940802 20800 raft_consensus.cc:3060] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:26.907747 20966 raft_consensus.cc:2749] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823) with higher term. Message: Invalid argument: T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for earlier term 13. Current term is 14.
W20260709 13:07:26.997488 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 253771us
I20260709 13:07:27.001017 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c15d8e9be8414c84912ab77b66bfb1" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:26.925930 20814 consensus_queue.cc:1059] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 13:07:27.006536 16352 raft_consensus.cc:2468] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 10.
I20260709 13:07:27.006796 20758 consensus_queue.cc:1059] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:27.009855 16280 raft_consensus.cc:2468] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 16.
I20260709 13:07:26.980474 20947 raft_consensus.cc:3060] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:26.967648 20806 raft_consensus.cc:3060] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:27.017324 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 71611.3us
I20260709 13:07:27.038296 16248 leader_election.cc:304] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:07:27.040314 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 49322.1us
I20260709 13:07:27.042343 16248 leader_election.cc:304] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:27.042963 16204 raft_consensus.cc:2468] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 11.
W20260709 13:07:27.011978 16174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:26.936604 20809 raft_consensus.cc:515] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:26.997150 20972 raft_consensus.cc:2804] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:26.981305 20660 consensus_queue.cc:1048] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 13:07:27.049458 16248 leader_election.cc:304] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:07:27.049678 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 155289us
I20260709 13:07:26.967188 20764 raft_consensus.cc:515] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:26.939733 20759 consensus_queue.cc:237] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:27.018754 20797 raft_consensus.cc:2749] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:07:27.055917 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 62634.1us
I20260709 13:07:27.058243 16248 leader_election.cc:304] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:27.059204 16349 raft_consensus.cc:2393] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 10: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:07:27.046615 20659 raft_consensus.cc:2804] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:27.078029 16355 raft_consensus.cc:2410] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:07:27.049074 20972 raft_consensus.cc:493] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting leader election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:27.051756 20946 raft_consensus.cc:2749] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:27.054834 20782 raft_consensus.cc:2749] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:27.044529 20752 consensus_queue.cc:1059] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 13:07:27.098625 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:27.088832 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 18 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:27.069828 20871 raft_consensus.cc:2749] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:27.081544 20489 raft_consensus.cc:2804] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:27.110677 16354 raft_consensus.cc:1240] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:27.076603 20966 raft_consensus.cc:2749] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:27.113150 16248 leader_election.cc:304] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:27.082022 20972 raft_consensus.cc:3060] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:27.082623 20931 leader_election.cc:290] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:27.125161 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:27.084686 20659 raft_consensus.cc:697] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
W20260709 13:07:27.157310 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 44250.8us
I20260709 13:07:27.138983 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:27.081050 20861 consensus_queue.cc:1059] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 13:07:27.149736 16282 raft_consensus.cc:1240] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 7. Current term is 8. Ops: []
W20260709 13:07:27.168816 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:27.162117 20871 raft_consensus.cc:3060] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:27.085280 20764 leader_election.cc:290] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:27.166477 16353 raft_consensus.cc:2393] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 9: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:07:27.190997 16279 raft_consensus.cc:1240] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:27.141233 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:27.196489 16322 leader_election.cc:304] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:07:27.079033 20982 raft_consensus.cc:493] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:27.199658 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:27.200366 16279 raft_consensus.cc:2468] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 13.
I20260709 13:07:27.200541 20814 consensus_queue.cc:1048] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:07:27.124066 20976 log.cc:927] Time spent T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
W20260709 13:07:27.149331 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 101204us
I20260709 13:07:27.211676 16914 leader_election.cc:304] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:07:27.211783 16946 raft_consensus.cc:1275] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:07:27.058898 20920 consensus_queue.cc:237] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } }
I20260709 13:07:27.131186 20752 raft_consensus.cc:3055] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:27.216138 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:27.198359 16277 raft_consensus.cc:2393] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 12: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
W20260709 13:07:27.124446 20970 log.cc:927] Time spent T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.168s	user 0.000s	sys 0.001s
W20260709 13:07:27.164013 20969 log.cc:927] Time spent T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.289s	user 0.000s	sys 0.001s
I20260709 13:07:27.201562 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:07:27.129897 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:07:27.123423 20971 log.cc:927] Time spent T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 13:07:27.137315 20489 raft_consensus.cc:697] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:07:27.191565 20880 leader_election.cc:290] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:27.226035 16248 leader_election.cc:304] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:27.227558 20808 consensus_queue.cc:1048] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:27.228446 20742 raft_consensus.cc:2749] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:27.132504 20592 consensus_queue.cc:1048] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.084s
I20260709 13:07:27.099563 20929 consensus_queue.cc:1048] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 13:07:27.216986 16353 raft_consensus.cc:2468] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 15.
I20260709 13:07:27.221275 16322 leader_election.cc:304] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:27.195140 20562 raft_consensus.cc:493] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.230007 16248 leader_election.cc:304] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:27.233273 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:07:27.186058 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 103031us
I20260709 13:07:27.116271 20986 consensus_queue.cc:1059] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.108s
I20260709 13:07:27.241186 16322 leader_election.cc:304] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:07:27.241540 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:27.242599 16173 leader_election.cc:304] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:27.244585 16173 leader_election.cc:304] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:07:27.131989 20955 raft_consensus.cc:515] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:27.247475 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:27.251295 16277 raft_consensus.cc:3060] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:27.219137 20752 raft_consensus.cc:740] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:07:27.249351 16248 leader_election.cc:304] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:27.254693 16173 leader_election.cc:304] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:07:27.246390 20562 raft_consensus.cc:515] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:07:27.257992 20979 log.cc:927] Time spent T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.175s	user 0.000s	sys 0.001s
I20260709 13:07:27.259018 20562 leader_election.cc:290] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:27.258872 20489 consensus_queue.cc:237] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:27.230319 20946 raft_consensus.cc:2749] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:27.232779 20975 raft_consensus.cc:2804] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:07:27.251999 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:27.264498 16248 leader_election.cc:304] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:27.210507 20984 consensus_queue.cc:1048] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:07:27.272883 16350 raft_consensus.cc:2468] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 14.
I20260709 13:07:27.273809 16914 leader_election.cc:304] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:27.209846 20982 raft_consensus.cc:515] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:27.218458 20987 consensus_queue.cc:1059] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 13:07:27.277110 16353 raft_consensus.cc:2376] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 11. Re-sending same reply.
I20260709 13:07:27.250422 20759 raft_consensus.cc:2749] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:27.246737 20998 raft_consensus.cc:493] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:27.310644 20984 raft_consensus.cc:2804] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:27.311167 20984 raft_consensus.cc:493] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:27.310895 20998 raft_consensus.cc:515] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:27.311618 20984 raft_consensus.cc:3060] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:27.311899 20691 leader_election.cc:290] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 15 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:27.313496 20998 leader_election.cc:290] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:27.273545 20808 raft_consensus.cc:2749] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:27.303087 20999 raft_consensus.cc:493] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:27.275156 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:27.254314 20880 raft_consensus.cc:2749] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:07:27.307206 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 53347.9us
I20260709 13:07:27.253047 20931 consensus_queue.cc:1059] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 13:07:27.247908 20861 raft_consensus.cc:2749] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:27.300210 20919 raft_consensus.cc:493] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:27.316713 16914 leader_election.cc:304] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:07:27.308799 20562 raft_consensus.cc:2749] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:27.321190 16173 leader_election.cc:304] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
W20260709 13:07:27.316437 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 52047.3us
I20260709 13:07:27.332890 16277 raft_consensus.cc:2468] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 15.
I20260709 13:07:27.336102 16281 raft_consensus.cc:1240] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 LEADER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:07:27.304623 20985 consensus_queue.cc:1048] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.082s
I20260709 13:07:27.337139 20752 consensus_queue.cc:260] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:27.331864 20999 raft_consensus.cc:515] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:27.339020 20983 raft_consensus.cc:2764] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:07:27.315582 20996 consensus_queue.cc:1048] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 13:07:27.332324 20997 consensus_queue.cc:1048] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:07:27.321775 20691 raft_consensus.cc:2804] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:27.309679 20975 raft_consensus.cc:697] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 16 LEADER]: Becoming Leader. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:07:27.347869 16173 leader_election.cc:400] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 13 pre-election: Vote denied by peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107) with higher term. Message: Invalid argument: T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for earlier term 13. Current term is 14.
I20260709 13:07:27.357211 16942 raft_consensus.cc:1275] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:07:27.358592 20808 consensus_queue.cc:1048] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:27.352082 20987 raft_consensus.cc:2804] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:27.320309 20990 raft_consensus.cc:2749] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:27.344570 20782 raft_consensus.cc:3055] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:27.361948 20972 raft_consensus.cc:515] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:27.376001 16173 leader_election.cc:304] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:27.261482 20659 consensus_queue.cc:237] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:27.390647 16173 leader_election.cc:304] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:27.393678 16173 leader_election.cc:304] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:27.397018 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:27.397343 20562 raft_consensus.cc:3060] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:27.397735 16350 raft_consensus.cc:3060] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:27.398756 20994 raft_consensus.cc:2804] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:27.401396 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:27.347333 20919 raft_consensus.cc:515] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:27.354319 20748 raft_consensus.cc:515] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:27.385666 20752 raft_consensus.cc:3060] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:07:27.432312 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:27.434865 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bc3c8ff9b84838a2664335d7e1582b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:27.435114 16945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:27.432438 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:27.404115 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:07:27.436055 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:27.436406 16942 raft_consensus.cc:3060] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:27.437130 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:27.438007 16912 leader_election.cc:304] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:27.440627 16274 raft_consensus.cc:1240] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:27.441341 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:27.441776 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:27.386623 20782 raft_consensus.cc:740] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:07:27.447459 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:27.522799 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:27.390147 20987 raft_consensus.cc:697] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 LEADER]: Becoming Leader. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:07:27.378844 20592 consensus_queue.cc:1048] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 13:07:27.433730 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:27.534875 16279 raft_consensus.cc:1240] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:27.535745 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:27.523595 20982 leader_election.cc:290] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:27.537526 16947 raft_consensus.cc:2468] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 8.
W20260709 13:07:27.427558 20943 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.630s	user 0.027s	sys 0.010s
W20260709 13:07:27.530334 16914 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 1.611s (SENT) [suppressed 23 similar messages]
I20260709 13:07:27.404681 20814 raft_consensus.cc:2749] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:27.527352 16207 raft_consensus.cc:3060] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:07:27.546065 16277 raft_consensus.cc:2468] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 11.
I20260709 13:07:27.572100 16173 leader_election.cc:304] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
W20260709 13:07:27.548719 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 89970.4us
W20260709 13:07:27.540661 20746 consensus_meta.cc:287] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f: Time spent flushing consensus metadata: real 0.733s	user 0.006s	sys 0.006s
I20260709 13:07:27.383234 20691 raft_consensus.cc:697] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:07:27.576336 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:27.577354 16173 leader_election.cc:304] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:27.402223 21001 raft_consensus.cc:2749] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:27.573571 16350 raft_consensus.cc:2468] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 16.
I20260709 13:07:27.577406 16356 raft_consensus.cc:2376] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 15. Re-sending same reply.
I20260709 13:07:27.562302 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:07:27.575018 16912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:27.524017 20871 raft_consensus.cc:2749] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:07:27.552233 20943 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.754s	user 0.027s	sys 0.014s
I20260709 13:07:27.407156 20983 consensus_queue.cc:1059] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.174s
I20260709 13:07:27.623878 16201 raft_consensus.cc:2393] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 in current term 11: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:07:27.627774 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:27.403949 20984 raft_consensus.cc:515] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:27.544492 20915 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:39040 (request call id 2) took 18494 ms. Trace:
I20260709 13:07:27.631960 16942 raft_consensus.cc:2468] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 13.
I20260709 13:07:27.627626 16173 leader_election.cc:304] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:27.651247 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:27.652242 16356 raft_consensus.cc:3060] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:27.660774 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:27.661968 16350 raft_consensus.cc:2393] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 12: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
W20260709 13:07:27.639426 20954 log.cc:927] Time spent T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:07:27.666302 16208 raft_consensus.cc:1240] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 5. Current term is 6. Ops: []
W20260709 13:07:27.666967 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 136687us
I20260709 13:07:27.624200 20995 raft_consensus.cc:493] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.676939 16207 raft_consensus.cc:2468] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 13.
I20260709 13:07:27.678617 16246 leader_election.cc:304] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:27.678675 20994 raft_consensus.cc:697] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 15 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:07:27.680445 20994 consensus_queue.cc:237] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:27.639041 20996 raft_consensus.cc:493] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
W20260709 13:07:27.663313 20963 log.cc:927] Time spent T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:07:27.644855 20955 leader_election.cc:290] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:07:27.702598 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:27.646456 20814 raft_consensus.cc:2749] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:27.623800 20746 raft_consensus.cc:515] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:27.666649 20982 raft_consensus.cc:2804] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:27.659034 20986 raft_consensus.cc:493] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.730077 16356 raft_consensus.cc:2468] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 16.
I20260709 13:07:27.731729 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
W20260709 13:07:27.735165 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 107739us
I20260709 13:07:27.547232 20975 consensus_queue.cc:237] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:27.724028 20758 raft_consensus.cc:493] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.721632 21001 raft_consensus.cc:493] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:27.727756 20982 raft_consensus.cc:493] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:27.775820 16173 leader_election.cc:304] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:27.703719 20691 consensus_queue.cc:237] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:07:27.786943 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:27.784790 16173 leader_election.cc:304] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:27.787643 16200 raft_consensus.cc:3060] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:27.788514 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:27.774389 20974 raft_consensus.cc:2804] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:27.718452 20996 raft_consensus.cc:515] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:27.691994 20995 raft_consensus.cc:515] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:27.778613 20999 leader_election.cc:290] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:27.781172 20982 raft_consensus.cc:3060] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:27.811458 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:27.704423 20987 consensus_queue.cc:237] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:27.819103 21009 raft_consensus.cc:493] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.813690 21008 raft_consensus.cc:493] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.735249 20986 raft_consensus.cc:515] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:07:27.819582 21005 log.cc:927] Time spent T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:07:27.796535 20972 leader_election.cc:290] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:27.801828 20994 raft_consensus.cc:2804] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:27.781358 20758 raft_consensus.cc:515] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:27.840806 16200 raft_consensus.cc:2468] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 11.
I20260709 13:07:27.844208 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:27.816977 20919 leader_election.cc:290] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:27.846288 16912 leader_election.cc:304] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:27.816823 20974 raft_consensus.cc:697] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 LEADER]: Becoming Leader. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:07:27.849216 21011 raft_consensus.cc:2804] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:07:27.850266 21007 log.cc:927] Time spent T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:07:27.851819 20922 consensus_queue.cc:260] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:27.855273 16202 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39674 (request call id 962) took 1384 ms. Trace:
I20260709 13:07:27.855422 20746 leader_election.cc:290] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:07:27.858726 21004 log.cc:927] Time spent T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.282s	user 0.000s	sys 0.001s
W20260709 13:07:27.864545 20813 consensus_meta.cc:287] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3: Time spent flushing consensus metadata: real 0.960s	user 0.011s	sys 0.000s
I20260709 13:07:27.790331 21013 raft_consensus.cc:2749] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:07:27.866115 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 224260us
W20260709 13:07:27.843619 20952 consensus_meta.cc:287] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3: Time spent flushing consensus metadata: real 0.946s	user 0.007s	sys 0.011s
W20260709 13:07:27.876448 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 197986us
I20260709 13:07:27.876480 16202 rpcz_store.cc:276] 0709 13:07:26.471125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.471284 (+   159us) service_pool.cc:224] Handling call
0709 13:07:26.471624 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:26.771418 (+299794us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:27.855022 (+1083604us) spinlock_profiling.cc:243] Waited 203 ms on lock 0x7b540002b7d4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f489e01 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6
0709 13:07:27.855203 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":467659136}
W20260709 13:07:27.884171 21002 log.cc:927] Time spent T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.248s	user 0.000s	sys 0.001s
I20260709 13:07:27.889397 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:27.783704 21001 raft_consensus.cc:515] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:27.642148 20915 rpcz_store.cc:276] 0709 13:07:08.935645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.935839 (+   194us) service_pool.cc:224] Handling call
0709 13:07:09.090341 (+154502us) log.cc:844] Serialized 506 byte log entry
0709 13:07:09.963202 (+872861us) spinlock_profiling.cc:243] Waited 35.5 ms on lock 0x7b5400303f20. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f3fedbe 00007f361f409930 00007f361f4098d8 00007f361f409858 00007f361f409813 00007f361f408a9c 00007f36252f4626 00007f36252eedd8 00007f361f4457cb 00007f361f4482c0
0709 13:07:27.391047 (+17427845us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":103572,"raft.run_cpu_time_us":1534,"raft.run_wall_time_us":48753,"spinlock_wait_cycles":81754368,"thread_start_us":497806,"threads_started":2,"wal-append.queue_time_us":478352,"wal-append.run_cpu_time_us":6287,"wal-append.run_wall_time_us":1377976}
I20260709 13:07:27.855376 20984 leader_election.cc:290] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:27.846904 21008 raft_consensus.cc:515] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:27.873769 20990 raft_consensus.cc:2804] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:27.876103 21011 raft_consensus.cc:493] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:27.848147 20994 raft_consensus.cc:697] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 13 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
W20260709 13:07:27.884179 21006 log.cc:927] Time spent T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.240s	user 0.001s	sys 0.000s
I20260709 13:07:27.902216 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:27.916692 16278 raft_consensus.cc:3060] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:27.909373 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:27.885215 20759 raft_consensus.cc:2804] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:07:27.912338 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:27.912211 16356 raft_consensus.cc:2376] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 16. Re-sending same reply.
I20260709 13:07:27.913348 21010 ts_tablet_manager.cc:933] T 4b962ceebb5c48c1914459ae0c0eff1b P 1109f76a0b7b443a84c0327c8707bc63: Initiating tablet copy from peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073)
I20260709 13:07:27.923456 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:27.913975 16914 leader_election.cc:304] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:07:27.910166 20922 raft_consensus.cc:3060] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:27.834398 21009 raft_consensus.cc:515] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:07:27.911640 20800 consensus_meta.cc:287] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 0.896s	user 0.015s	sys 0.007s
I20260709 13:07:27.931253 16274 raft_consensus.cc:1240] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 LEADER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 9. Current term is 10. Ops: []
W20260709 13:07:27.942014 21016 log.cc:927] Time spent T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:07:27.946792 20800 raft_consensus.cc:515] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } }
I20260709 13:07:27.949700 16348 raft_consensus.cc:2393] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 18: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:07:27.916719 21011 raft_consensus.cc:3060] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:27.952663 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:27.927547 20617 raft_consensus.cc:493] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.957463 20996 leader_election.cc:290] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:07:27.952579 20806 consensus_meta.cc:287] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 0.904s	user 0.013s	sys 0.000s
I20260709 13:07:27.960071 21008 leader_election.cc:290] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:27.901422 20952 raft_consensus.cc:515] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:27.962980 20988 raft_consensus.cc:493] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.963447 20986 leader_election.cc:290] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:07:27.965554 20964 log.cc:927] Time spent T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 1.174s	user 0.000s	sys 0.003s
I20260709 13:07:27.975092 16946 raft_consensus.cc:1275] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:27.962141 21009 leader_election.cc:290] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:27.966332 20966 raft_consensus.cc:3055] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:07:27.986933 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 73046.5us
I20260709 13:07:27.992479 16278 raft_consensus.cc:2468] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 12.
I20260709 13:07:27.969246 20758 leader_election.cc:290] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:27.992386 21009 consensus_queue.cc:1048] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:07:27.997134 16283 raft_consensus.cc:1240] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 17. Current term is 18. Ops: []
I20260709 13:07:27.997786 20990 raft_consensus.cc:697] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 LEADER]: Becoming Leader. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
W20260709 13:07:27.998313 20968 log.cc:927] Time spent T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 1.055s	user 0.002s	sys 0.001s
I20260709 13:07:27.977186 20617 raft_consensus.cc:515] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:07:28.003444 20562 consensus_meta.cc:287] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f: Time spent flushing consensus metadata: real 0.605s	user 0.007s	sys 0.003s
I20260709 13:07:28.003574 20617 leader_election.cc:290] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:28.004063 20562 raft_consensus.cc:2749] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:27.980094 20806 raft_consensus.cc:515] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:28.004873 16356 raft_consensus.cc:2468] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 10.
I20260709 13:07:28.006531 20806 leader_election.cc:290] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:28.006872 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bc3c8ff9b84838a2664335d7e1582b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:28.007361 16354 raft_consensus.cc:2393] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 in current term 11: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:07:28.007436 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:28.008021 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:28.008740 16356 raft_consensus.cc:2368] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for earlier term 10. Current term is 11.
I20260709 13:07:28.008841 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:28.009747 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:28.010021 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:28.011641 20989 raft_consensus.cc:2804] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:07:28.011821 20947 consensus_meta.cc:287] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 0.967s	user 0.006s	sys 0.007s
I20260709 13:07:28.012858 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:28.013770 16350 raft_consensus.cc:2468] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 11.
I20260709 13:07:27.989243 20966 raft_consensus.cc:740] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:07:28.003433 16280 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42740 (request call id 824) took 1215 ms. Trace:
I20260709 13:07:28.018626 16280 rpcz_store.cc:276] 0709 13:07:26.787869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.788421 (+   552us) service_pool.cc:224] Handling call
0709 13:07:28.003222 (+1214801us) spinlock_profiling.cc:243] Waited 66 ms on lock 0x7b5400389854. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:07:28.003361 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":151703808}
W20260709 13:07:27.993640 20603 consensus_meta.cc:287] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 0.998s	user 0.007s	sys 0.007s
I20260709 13:07:28.008658 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:28.015228 16282 raft_consensus.cc:2410] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for term 12 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:07:27.932358 20974 consensus_queue.cc:237] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:28.019481 20989 raft_consensus.cc:697] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 16 LEADER]: Becoming Leader. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:07:28.022601 20800 leader_election.cc:290] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 18 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:28.023188 16942 raft_consensus.cc:1240] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:28.023497 20603 raft_consensus.cc:515] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:28.016691 16354 raft_consensus.cc:2393] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 11: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:07:28.021286 16946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:07:28.025104 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:28.027102 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:28.037974 16353 raft_consensus.cc:3060] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:28.038094 16350 raft_consensus.cc:2468] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 10.
I20260709 13:07:28.039397 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:28.038115 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:28.040052 16350 raft_consensus.cc:2376] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 14. Re-sending same reply.
I20260709 13:07:28.049954 16947 raft_consensus.cc:1240] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:07:28.050773 16354 raft_consensus.cc:3060] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:28.050978 21028 raft_consensus.cc:493] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:28.051646 21028 raft_consensus.cc:515] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:28.055732 21028 leader_election.cc:290] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:28.055989 20995 leader_election.cc:290] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:28.050060 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
W20260709 13:07:28.059365 20752 consensus_meta.cc:287] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63: Time spent flushing consensus metadata: real 0.536s	user 0.011s	sys 0.002s
I20260709 13:07:28.061582 16351 raft_consensus.cc:2468] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 8.
I20260709 13:07:28.060834 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:28.062616 16350 raft_consensus.cc:3060] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:28.059756 20966 consensus_queue.cc:260] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:28.065552 20851 raft_consensus.cc:3055] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:28.065703 20966 raft_consensus.cc:3060] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:28.066128 20851 raft_consensus.cc:740] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:07:27.991679 20994 consensus_queue.cc:237] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:27.999257 20990 consensus_queue.cc:237] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:28.080606 20851 consensus_queue.cc:260] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:28.079190 16946 raft_consensus.cc:2468] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 12.
W20260709 13:07:28.086073 21033 log.cc:927] Time spent T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 13:07:28.080996 20603 leader_election.cc:290] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:28.024137 20989 consensus_queue.cc:237] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:28.088076 20809 leader_election.cc:290] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:28.018481 20988 raft_consensus.cc:515] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:28.098848 20603 raft_consensus.cc:493] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.109927 20603 raft_consensus.cc:515] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:28.113520 20603 leader_election.cc:290] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:28.095959 20851 raft_consensus.cc:3060] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:28.098806 20952 leader_election.cc:290] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 18 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:28.106079 20782 consensus_queue.cc:260] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:28.097834 16350 raft_consensus.cc:2468] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 12.
I20260709 13:07:28.099964 20891 raft_consensus.cc:3055] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:28.110059 20988 leader_election.cc:290] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:28.119902 16355 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41830 (request call id 2346) took 1246 ms. Trace:
I20260709 13:07:28.118096 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:28.138134 16350 raft_consensus.cc:2393] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 15: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:07:28.140844 16354 raft_consensus.cc:2468] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 13.
I20260709 13:07:28.142570 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:28.137602 16355 rpcz_store.cc:276] 0709 13:07:26.873745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.873897 (+   152us) service_pool.cc:224] Handling call
0709 13:07:28.119630 (+1245733us) spinlock_profiling.cc:243] Waited 129 ms on lock 0x7b54003a43d4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:07:28.119804 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":297371520}
W20260709 13:07:28.149920 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 164659us
I20260709 13:07:28.151615 16322 leader_election.cc:304] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:07:28.153715 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:28.155177 16322 leader_election.cc:304] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:07:28.096469 20809 raft_consensus.cc:493] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.155968 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:28.159672 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:28.159778 16942 raft_consensus.cc:2468] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 13.
I20260709 13:07:28.160336 16173 leader_election.cc:304] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:28.160851 16354 raft_consensus.cc:2376] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 10. Re-sending same reply.
I20260709 13:07:28.162046 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:28.137682 20891 raft_consensus.cc:740] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:28.163853 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:28.164762 16354 raft_consensus.cc:2393] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 12: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:07:28.164407 20891 consensus_queue.cc:260] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:28.165436 20891 raft_consensus.cc:3060] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:28.165800 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:28.166738 20603 raft_consensus.cc:2804] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:28.167583 20603 raft_consensus.cc:697] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 15 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:28.168592 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:28.168865 20603 consensus_queue.cc:237] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:28.158905 20988 raft_consensus.cc:2804] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:28.171511 20988 raft_consensus.cc:493] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:28.172144 20988 raft_consensus.cc:3060] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:28.171749 16350 raft_consensus.cc:2376] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 13. Re-sending same reply.
I20260709 13:07:28.173499 20878 raft_consensus.cc:3055] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:28.174062 20748 leader_election.cc:290] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 11 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:28.178952 16351 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41830 (request call id 2354) took 1278 ms. Trace:
I20260709 13:07:28.190541 20878 raft_consensus.cc:740] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:28.137607 20782 raft_consensus.cc:3060] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:28.193069 16351 rpcz_store.cc:276] 0709 13:07:26.900763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.937292 (+ 36529us) service_pool.cc:224] Handling call
0709 13:07:28.178690 (+1241398us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b54003093d4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:07:28.178860 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2547390336}
I20260709 13:07:28.193730 20878 consensus_queue.cc:260] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:28.194294 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:28.194996 20878 raft_consensus.cc:3060] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:28.195986 16351 raft_consensus.cc:1240] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:28.196449 16356 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33486 (request call id 668) took 1063 ms. Trace:
I20260709 13:07:28.115821 21009 raft_consensus.cc:493] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:28.190274 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:28.190083 20830 raft_consensus.cc:2749] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:28.120761 21001 leader_election.cc:290] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:28.196638 16351 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33486 (request call id 665) took 1064 ms. Trace:
I20260709 13:07:28.075948 21010 tablet_copy_client.cc:323] T 4b962ceebb5c48c1914459ae0c0eff1b P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Beginning tablet copy session from remote peer at address 127.14.180.65:46073
I20260709 13:07:28.200199 16351 rpcz_store.cc:276] 0709 13:07:27.132484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:28.195498 (+1063014us) service_pool.cc:224] Handling call
0709 13:07:28.195806 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:28.196392 (+   586us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:28.196585 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:28.114313 20982 raft_consensus.cc:515] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:28.197007 16356 rpcz_store.cc:276] 0709 13:07:27.133446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:28.195563 (+1062117us) service_pool.cc:224] Handling call
0709 13:07:28.195939 (+   376us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:28.196123 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:28.196147 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:28.196184 (+    37us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:28.196220 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:28.196276 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:28.196390 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3968}
W20260709 13:07:28.200284 16914 leader_election.cc:336] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 2.069s (SENT)
I20260709 13:07:28.203675 16914 leader_election.cc:304] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:28.200637 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:28.205611 16356 raft_consensus.cc:1275] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:07:28.206295 16355 raft_consensus.cc:2468] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 10.
I20260709 13:07:28.208407 16945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:07:28.211092 16353 raft_consensus.cc:2468] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 15.
I20260709 13:07:28.213068 16353 raft_consensus.cc:1240] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 9. Current term is 10. Ops: [7.6-9.7]
I20260709 13:07:28.215054 16945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:28.206282 16356 pending_rounds.cc:85] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e: Aborting all ops after (but not including) 7
I20260709 13:07:28.216351 16356 pending_rounds.cc:107] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:07:28.216775 16356 raft_consensus.cc:2889] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:07:28.219501 16322 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:28.221421 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:07:28.221988 16322 leader_election.cc:304] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:07:28.223229 16356 raft_consensus.cc:1240] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 14. Current term is 15. Ops: [12.8-14.9]
I20260709 13:07:28.225706 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:28.231787 16356 raft_consensus.cc:1240] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:07:28.231557 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:28.233454 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:28.083978 20948 consensus_queue.cc:260] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:28.234300 16355 raft_consensus.cc:1240] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:07:28.219247 20757 raft_consensus.cc:2749] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:28.182611 20809 raft_consensus.cc:515] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:28.237278 16940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:28.244284 16355 raft_consensus.cc:1240] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 10. Current term is 11. Ops: []
W20260709 13:07:28.240106 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 59422.2us
W20260709 13:07:28.240767 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:28.245721 16173 leader_election.cc:304] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:28.247375 16173 leader_election.cc:304] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:28.202275 21009 raft_consensus.cc:515] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:28.249444 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:28.250562 16356 raft_consensus.cc:3060] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:28.235385 20891 raft_consensus.cc:2749] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:28.253340 16173 leader_election.cc:400] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 election: Vote denied by peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107) with higher term. Message: Invalid argument: T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for earlier term 10. Current term is 11.
I20260709 13:07:28.253763 16173 leader_election.cc:403] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:07:28.258121 21001 raft_consensus.cc:2749] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107) with higher term. Message: Invalid argument: T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for earlier term 10. Current term is 11.
I20260709 13:07:28.270664 16354 raft_consensus.cc:2468] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 13.
I20260709 13:07:28.260787 16173 leader_election.cc:304] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:28.272324 16173 leader_election.cc:304] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
W20260709 13:07:28.288117 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:28.255087 21030 log.cc:927] Time spent T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.193s	user 0.001s	sys 0.000s
I20260709 13:07:28.251019 20830 raft_consensus.cc:2749] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:07:28.249039 20748 raft_consensus.cc:493] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:28.251272 20994 raft_consensus.cc:2804] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:28.299507 16356 raft_consensus.cc:2468] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 11.
I20260709 13:07:28.297988 16173 leader_election.cc:304] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:28.300562 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:28.295658 20795 raft_consensus.cc:2749] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:28.301607 16355 raft_consensus.cc:2393] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 in current term 11: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:07:28.300629 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:28.304054 16173 leader_election.cc:304] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:07:28.292663 21001 raft_consensus.cc:2804] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:28.311133 21001 raft_consensus.cc:493] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:28.311587 20997 raft_consensus.cc:2804] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:28.311721 21001 raft_consensus.cc:3060] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:28.312402 20997 raft_consensus.cc:493] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:28.312238 16173 leader_election.cc:304] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:28.313035 20997 raft_consensus.cc:3060] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:28.314659 16173 leader_election.cc:304] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:28.298758 20994 raft_consensus.cc:493] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:28.316176 16173 leader_election.cc:304] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:07:28.313771 21017 raft_consensus.cc:2804] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:28.307426 20830 raft_consensus.cc:2749] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:28.298830 20748 raft_consensus.cc:515] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:28.321708 16173 leader_election.cc:304] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:28.355454 21009 leader_election.cc:290] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:28.356498 21017 raft_consensus.cc:697] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:07:28.356717 20996 raft_consensus.cc:2749] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:28.358472 16173 leader_election.cc:304] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:07:28.350004 20795 raft_consensus.cc:2764] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Leader election decision vote started in defunct term 10: won
I20260709 13:07:28.360494 16173 leader_election.cc:304] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:28.318631 21008 raft_consensus.cc:2749] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:28.320046 20994 raft_consensus.cc:3060] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:07:28.363387 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:28.363152 20996 raft_consensus.cc:2804] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:28.364671 20795 raft_consensus.cc:2804] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:28.369439 20830 consensus_queue.cc:1059] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 13:07:28.369256 20973 consensus_queue.cc:1059] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.136s
W20260709 13:07:28.369256 21037 log.cc:927] Time spent T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63: Append to log took a long time: real 0.143s	user 0.001s	sys 0.000s
I20260709 13:07:28.374641 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
W20260709 13:07:28.374260 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:28.364265 21011 raft_consensus.cc:515] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:28.388996 16940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:07:28.375303 20603 raft_consensus.cc:493] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:28.373976 20795 raft_consensus.cc:493] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:28.368377 20983 consensus_queue.cc:1059] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 13:07:28.366158 21009 consensus_queue.cc:1048] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 13:07:28.393061 20603 raft_consensus.cc:515] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:28.382025 20986 raft_consensus.cc:493] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:28.378806 20973 consensus_queue.cc:1243] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Peer 0aea40d6e4374085a2e38a70a71f63e3 log is divergent from this leader: its last log entry 10.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:07:28.374680 20996 raft_consensus.cc:697] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 13 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:07:28.384055 20982 leader_election.cc:290] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 election: Requested vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:28.374615 21008 consensus_queue.cc:1059] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 13:07:28.409943 20795 raft_consensus.cc:3060] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:28.395627 20809 leader_election.cc:290] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:28.377722 21029 consensus_queue.cc:1059] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:07:28.419328 20986 raft_consensus.cc:515] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:28.429171 20996 consensus_queue.cc:237] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:28.430297 20603 leader_election.cc:290] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:07:28.427949 21046 log.cc:927] Time spent T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 13:07:28.431589 20983 raft_consensus.cc:3055] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:07:28.439802 20659 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.860s	user 0.008s	sys 0.013s
I20260709 13:07:28.452371 16940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:07:28.453348 16940 raft_consensus.cc:3060] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:28.439960 20983 raft_consensus.cc:740] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
W20260709 13:07:28.455720 16948 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35122 (request call id 662) took 1842 ms (client timeout 1787 ms). Trace:
W20260709 13:07:28.456799 16948 rpcz_store.cc:269] 0709 13:07:26.613694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.616038 (+  2344us) service_pool.cc:224] Handling call
0709 13:07:28.455488 (+1839450us) spinlock_profiling.cc:243] Waited 224 ms on lock 0x7b54005a2654. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:07:28.455642 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":514721536}
W20260709 13:07:28.445149 20659 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.895s	user 0.008s	sys 0.014s
I20260709 13:07:28.376169 21017 consensus_queue.cc:237] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:28.439314 21001 raft_consensus.cc:515] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:07:28.501140 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:28.500818 20988 raft_consensus.cc:515] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:28.448702 20661 raft_consensus.cc:3055] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:07:28.505506 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:28.461320 16321 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:28.508651 16349 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41830 (request call id 2351) took 1615 ms (client timeout 1967 ms). Trace:
I20260709 13:07:28.509645 16283 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45210 (request call id 2350) took 1892 ms. Trace:
I20260709 13:07:28.510268 16353 raft_consensus.cc:1240] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:28.511745 16940 raft_consensus.cc:2468] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 9.
I20260709 13:07:28.510054 16283 rpcz_store.cc:276] 0709 13:07:26.617368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.617547 (+   179us) service_pool.cc:224] Handling call
0709 13:07:26.617887 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:27.997630 (+1379743us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:28.509411 (+511781us) spinlock_profiling.cc:243] Waited 1.38 s on lock 0x7b54000776d4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f489e01 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6
0709 13:07:28.509583 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3168925568}
W20260709 13:07:28.509224 16349 rpcz_store.cc:269] 0709 13:07:26.893634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.958864 (+ 65230us) service_pool.cc:224] Handling call
0709 13:07:28.508351 (+1549487us) spinlock_profiling.cc:243] Waited 54.5 ms on lock 0x7b540032c154. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:07:28.508565 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":125426560}
I20260709 13:07:28.444962 20748 leader_election.cc:290] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:28.487283 20986 leader_election.cc:290] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:07:28.486780 21043 log.cc:927] Time spent T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 13:07:28.454044 21011 leader_election.cc:290] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:28.518875 16173 leader_election.cc:304] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:28.511372 20661 raft_consensus.cc:740] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:07:28.459237 20983 consensus_queue.cc:260] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:28.524889 21029 raft_consensus.cc:2804] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:28.538775 21029 raft_consensus.cc:697] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [term 9 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:07:28.542451 21029 consensus_queue.cc:237] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:28.538870 20988 leader_election.cc:290] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:28.551330 20955 raft_consensus.cc:3055] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:28.551862 20955 raft_consensus.cc:740] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:07:28.547782 20983 raft_consensus.cc:3060] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:28.552837 20955 consensus_queue.cc:260] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:28.554097 20955 raft_consensus.cc:3060] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:28.555482 16350 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41830 (request call id 2361) took 1184 ms. Trace:
I20260709 13:07:28.555914 16350 rpcz_store.cc:276] 0709 13:07:27.371397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:28.199184 (+827787us) service_pool.cc:224] Handling call
0709 13:07:28.203228 (+  4044us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:28.214367 (+ 11139us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:28.214405 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:28.235000 (+ 20595us) log.cc:844] Serialized 26 byte log entry
0709 13:07:28.295650 (+ 60650us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:28.321757 (+ 26107us) log.cc:844] Serialized 14 byte log entry
0709 13:07:28.329049 (+  7292us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:28.329180 (+   131us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:28.555232 (+226052us) raft_consensus.cc:1685] finished
0709 13:07:28.555255 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:28.555415 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18664,"prepare.queue_time_us":29045,"raft.queue_time_us":15903,"raft.run_cpu_time_us":322,"raft.run_wall_time_us":19856,"spinlock_wait_cycles":19948288,"thread_start_us":54895,"threads_started":2,"wal-append.queue_time_us":108583}
I20260709 13:07:28.558785 16208 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60138 (request call id 2519) took 1127 ms. Trace:
I20260709 13:07:28.559293 16208 rpcz_store.cc:276] 0709 13:07:27.431658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:27.522075 (+ 90417us) service_pool.cc:224] Handling call
0709 13:07:27.522437 (+   362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:27.668983 (+146546us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:28.558496 (+889513us) spinlock_profiling.cc:243] Waited 141 ms on lock 0x7b54000b40d4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f489e01 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6
0709 13:07:28.558724 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":325137152}
I20260709 13:07:28.545882 20795 raft_consensus.cc:515] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:28.587816 20997 raft_consensus.cc:515] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:28.588649 20811 raft_consensus.cc:3060] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:28.582722 21041 log.cc:927] Time spent T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63: Append to log took a long time: real 0.218s	user 0.000s	sys 0.004s
I20260709 13:07:28.590423 20994 raft_consensus.cc:515] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:28.596688 16940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:07:28.596176 20997 leader_election.cc:290] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 11 election: Requested vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:07:28.601162 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 680386us
I20260709 13:07:28.602370 16173 leader_election.cc:304] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:28.607978 16203 raft_consensus.cc:1240] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:28.592599 16277 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42740 (request call id 825) took 1155 ms. Trace:
I20260709 13:07:28.610644 16277 rpcz_store.cc:276] 0709 13:07:27.437144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:27.573658 (+136514us) service_pool.cc:224] Handling call
0709 13:07:27.573996 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:27.574248 (+   252us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:07:27.777542 (+203294us) log.cc:844] Serialized 14 byte log entry
0709 13:07:27.880810 (+103268us) log.cc:844] Serialized 14 byte log entry
0709 13:07:28.010142 (+129332us) spinlock_profiling.cc:243] Waited 5.17 ms on lock 0x7b18003bf440. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f3625264de1 00007f36252715b1 00007f361c36a2a6 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f3625264de1 00007f36252715b1 00007f361c39c3f3 00007f361c39e7c1
0709 13:07:28.163017 (+152875us) spinlock_profiling.cc:243] Waited 4.4 ms on lock 0x7b18003bf440. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f3625264de1 00007f36252715b1 00007f361c39c3f3 00007f361c39e7c1 00007f361c39e779 00007f361c39e709 00007f361c39e6d1 00007f361c39d9cd 000000000038f354 000000000038f199 00007f361c37f83a
0709 13:07:28.175728 (+ 12711us) spinlock_profiling.cc:243] Waited 2.14 ms on lock 0x7b18003bf440. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f3625264de1 00007f36252715b1 00007f361c39c3f3 00007f361c39e7c1 00007f361c39e779 00007f361c39e709 00007f361c39e6d1 00007f361c39d9cd 000000000038f354 000000000038f199 00007f361c37f83a
0709 13:07:28.592044 (+416316us) spinlock_profiling.cc:243] Waited 11.7 ms on lock 0x7b18003bf440. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f3625264de1 00007f36252715b1 00007f361c316c0a 00007f3625a56219 00007f361c39ea40 00007f361c3994e4 00007f361c399455 00007f361f481060 00007f361f493716 00007f361f4a4287 00007f361f4a4208
0709 13:07:28.592232 (+   188us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:28.592284 (+    52us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:28.592348 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:28.592417 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:28.592537 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":137089,"prepare.queue_time_us":200077,"prepare.run_cpu_time_us":90,"prepare.run_wall_time_us":94,"raft.queue_time_us":776443,"raft.run_cpu_time_us":280,"raft.run_wall_time_us":7551,"spinlock_wait_cycles":53832576,"thread_start_us":156336,"threads_started":2,"wal-append.queue_time_us":121202}
I20260709 13:07:28.614795 20759 raft_consensus.cc:697] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:07:28.615325 16217 tablet_copy_service.cc:140] P e10b16d536674c0bb350a31d7ce5ff7f: Received BeginTabletCopySession request for tablet 4b962ceebb5c48c1914459ae0c0eff1b from peer 1109f76a0b7b443a84c0327c8707bc63 ({username='slave'} at 127.0.0.1:39674)
I20260709 13:07:28.616166 16217 tablet_copy_service.cc:161] P e10b16d536674c0bb350a31d7ce5ff7f: Beginning new tablet copy session on tablet 4b962ceebb5c48c1914459ae0c0eff1b from peer 1109f76a0b7b443a84c0327c8707bc63 at {username='slave'} at 127.0.0.1:39674: session id = 1109f76a0b7b443a84c0327c8707bc63-4b962ceebb5c48c1914459ae0c0eff1b
W20260709 13:07:28.620014 16912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:28.620878 16173 leader_election.cc:304] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:07:28.623742 16173 leader_election.cc:304] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
W20260709 13:07:28.629205 16348 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41830 (request call id 2356) took 1727 ms (client timeout 2066 ms). Trace:
W20260709 13:07:28.629701 16348 rpcz_store.cc:269] 0709 13:07:26.901409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.961843 (+ 60434us) service_pool.cc:224] Handling call
0709 13:07:28.628991 (+1667148us) spinlock_profiling.cc:243] Waited 987 ms on lock 0x7b5400194454. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:07:28.629136 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2268953344}
I20260709 13:07:28.631994 16202 raft_consensus.cc:1240] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:28.630183 16914 leader_election.cc:304] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:28.632732 16173 leader_election.cc:304] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:28.617866 20973 raft_consensus.cc:493] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.609359 20997 raft_consensus.cc:2749] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:07:28.640072 16249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:28.641981 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:28.646844 16200 raft_consensus.cc:2393] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 10: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:07:28.646770 16205 raft_consensus.cc:1217] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 LEADER]: Deduplicated request from leader. Original: 6.7->[7.8-7.8]   Dedup: 7.8->[]
I20260709 13:07:28.647343 16205 raft_consensus.cc:1240] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 LEADER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:07:28.649999 16200 raft_consensus.cc:1240] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [term 9 LEADER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:07:28.651091 16173 leader_election.cc:304] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:28.639639 20757 raft_consensus.cc:2804] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:28.651942 20757 raft_consensus.cc:493] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:28.652388 20757 raft_consensus.cc:3060] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:28.652927 16279 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45218 (request call id 2288) took 1217 ms. Trace:
I20260709 13:07:28.574676 20661 consensus_queue.cc:260] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:28.654771 20661 raft_consensus.cc:3060] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:28.625155 20851 raft_consensus.cc:493] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:28.669672 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:28.664664 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:28.626291 20814 raft_consensus.cc:2749] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:28.667163 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:28.748948 16274 raft_consensus.cc:2410] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:07:28.653367 16279 rpcz_store.cc:276] 0709 13:07:27.435927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:27.548823 (+112896us) service_pool.cc:224] Handling call
0709 13:07:27.549143 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:27.549339 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:07:28.568491 (+1019152us) spinlock_profiling.cc:243] Waited 969 us on lock 0x7b180035d2e0. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f3625264de1 00007f36252715b1 00007f361f0314bc 00007f361c37f48b 00007f36251d9ab9 00007f361c39b69b 00007f361c39993f 00007f361c399455 00007f3622e813c7 00007f361f4939a7 00007f361f4a30bf
0709 13:07:28.568659 (+   168us) log.cc:844] Serialized 14 byte log entry
0709 13:07:28.652446 (+ 83787us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:28.652548 (+   102us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:28.652618 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:28.652723 (+   105us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:28.652860 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":120435,"prepare.queue_time_us":172605,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"spinlock_wait_cycles":2228096,"thread_start_us":180198,"threads_started":2}
I20260709 13:07:28.749462 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:28.635908 21001 leader_election.cc:290] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:28.682817 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:28.755722 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:28.674623 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:28.756464 16283 raft_consensus.cc:2368] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for earlier term 15. Current term is 16.
I20260709 13:07:28.670614 16282 raft_consensus.cc:2393] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 11: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:07:28.676637 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c15d8e9be8414c84912ab77b66bfb1" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:28.759384 16278 raft_consensus.cc:2468] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 13.
I20260709 13:07:28.636965 21009 raft_consensus.cc:2749] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:28.752671 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:28.762253 16199 raft_consensus.cc:3060] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:28.763562 16275 raft_consensus.cc:1275] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:07:28.765334 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:07:28.753162 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 102178us
I20260709 13:07:28.769245 16173 leader_election.cc:304] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:28.639664 21011 raft_consensus.cc:2749] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:07:28.743057 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:28.755934 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:28.776876 16276 raft_consensus.cc:2468] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 11.
I20260709 13:07:28.630971 20998 consensus_queue.cc:1048] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.118s
I20260709 13:07:28.794867 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:28.795547 16201 raft_consensus.cc:2468] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 12.
I20260709 13:07:28.770499 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:28.796518 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c15d8e9be8414c84912ab77b66bfb1" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:28.793378 16199 raft_consensus.cc:2468] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 18.
I20260709 13:07:28.797204 16201 raft_consensus.cc:2468] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 10.
I20260709 13:07:28.797490 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:28.797801 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:28.792280 20787 raft_consensus.cc:493] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:28.755585 21008 raft_consensus.cc:2749] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:28.775894 20489 raft_consensus.cc:493] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:28.798542 20787 raft_consensus.cc:515] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:28.799042 20489 raft_consensus.cc:515] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:28.799505 20759 consensus_queue.cc:237] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:07:28.751580 20851 raft_consensus.cc:515] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:28.801343 20787 leader_election.cc:290] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:28.757026 20942 raft_consensus.cc:493] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:28.802469 16199 raft_consensus.cc:2393] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 11: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:07:28.802248 20942 raft_consensus.cc:515] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:28.803982 16199 raft_consensus.cc:1240] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 17. Current term is 18. Ops: [15.8-17.9]
I20260709 13:07:28.804899 20942 leader_election.cc:290] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:07:28.798430 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:28.805984 20987 consensus_queue.cc:1059] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:28.806710 16274 raft_consensus.cc:2468] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 10.
W20260709 13:07:28.807453 21048 log.cc:927] Time spent T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.447s	user 0.008s	sys 0.003s
I20260709 13:07:28.807330 20987 raft_consensus.cc:3055] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:28.808034 20987 raft_consensus.cc:740] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:07:28.811585 21023 raft_consensus.cc:3055] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:28.811902 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:28.812631 16351 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41830 (request call id 2363) took 1440 ms. Trace:
I20260709 13:07:28.813120 16351 rpcz_store.cc:276] 0709 13:07:27.372106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:28.202767 (+830661us) service_pool.cc:224] Handling call
0709 13:07:28.203827 (+  1060us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:28.220126 (+ 16299us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:28.220159 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:28.225903 (+  5744us) log.cc:844] Serialized 52 byte log entry
0709 13:07:28.361567 (+135664us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:28.369916 (+  8349us) log.cc:844] Serialized 14 byte log entry
0709 13:07:28.374572 (+  4656us) log.cc:844] Serialized 14 byte log entry
0709 13:07:28.374797 (+   225us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:28.374885 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:28.806808 (+431923us) spinlock_profiling.cc:243] Waited 1.47 ms on lock 0x7b4400022b4c. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361c224db1 00007f361c2c2c85 00007f361c2c36a2 00007f361f0351db 00007f361f030aaf 00007f361f02486e 00007f361f023bb6 00007f361f0237d8 00007f361f02d221 00007f361f02d1d9 00007f361f02d169
0709 13:07:28.812352 (+  5544us) raft_consensus.cc:1685] finished
0709 13:07:28.812378 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:28.812560 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26880,"prepare.queue_time_us":9004,"prepare.run_wall_time_us":1543,"raft.queue_time_us":22375,"raft.run_cpu_time_us":359,"raft.run_wall_time_us":19244,"spinlock_wait_cycles":8196224,"thread_start_us":110191,"threads_started":1,"wal-append.queue_time_us":119808}
W20260709 13:07:28.814782 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 45668.3us
I20260709 13:07:28.760422 21017 raft_consensus.cc:493] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.817847 16199 raft_consensus.cc:1240] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:28.664187 20966 consensus_queue.cc:1059] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.168s
I20260709 13:07:28.773864 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:28.816529 16173 leader_election.cc:304] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:28.823246 16246 leader_election.cc:304] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:28.801723 20489 leader_election.cc:290] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:28.771068 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:28.798043 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:28.798386 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:28.825750 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:28.825469 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:28.827070 16201 raft_consensus.cc:2410] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:07:28.793853 20757 raft_consensus.cc:515] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:28.871287 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:28.849851 16281 raft_consensus.cc:1275] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:07:28.884939 16201 raft_consensus.cc:2393] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 18: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:07:28.834954 16276 raft_consensus.cc:1275] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:07:28.885828 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:28.886907 16199 raft_consensus.cc:2410] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:07:28.859290 20822 raft_consensus.cc:2804] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:07:28.886916 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:28.819432 21011 raft_consensus.cc:493] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.851868 16320 leader_election.cc:304] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:28.816569 20795 leader_election.cc:290] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 11 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:28.890384 16208 raft_consensus.cc:2393] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 11: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
I20260709 13:07:28.812146 21023 raft_consensus.cc:740] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:07:28.648377 20973 raft_consensus.cc:515] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:28.822958 21017 raft_consensus.cc:515] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:07:29.072908 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.194703 20742 raft_consensus.cc:493] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:29.114475 20660 raft_consensus.cc:493] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.195873 20742 raft_consensus.cc:515] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:07:29.056869 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 210596us
I20260709 13:07:29.196962 20660 raft_consensus.cc:515] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:28.859663 20489 raft_consensus.cc:493] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.199332 20489 raft_consensus.cc:515] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:29.200551 20660 leader_election.cc:290] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:28.859591 20987 consensus_queue.cc:260] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:29.041807 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:28.914408 20985 raft_consensus.cc:2749] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:28.967173 20851 leader_election.cc:290] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:29.119071 20659 consensus_queue.cc:1059] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.089s
W20260709 13:07:29.045326 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.206522 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:29.089107 16350 raft_consensus.cc:1275] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:07:28.872361 20948 raft_consensus.cc:3060] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:28.828472 20955 raft_consensus.cc:2749] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:07:28.981946 20994 leader_election.cc:290] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 14 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:07:29.194291 16249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.196147 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f022e2e63ae4461d834e476ff2666991" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:07:29.039940 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 211218us
I20260709 13:07:29.049362 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:29.090947 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:29.051677 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:29.048537 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:29.087924 16354 raft_consensus.cc:1275] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:07:28.918184 20757 leader_election.cc:290] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 11 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:29.215246 20489 leader_election.cc:290] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:07:29.217784 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 52863.8us
I20260709 13:07:29.053989 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:29.051590 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:07:29.095602 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 338743us
I20260709 13:07:29.221800 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:29.056098 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:29.222874 16199 raft_consensus.cc:3060] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:07:28.828831 20787 consensus_queue.cc:1059] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.296s
I20260709 13:07:29.115486 20661 raft_consensus.cc:493] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.230993 20661 raft_consensus.cc:515] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:29.231498 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:29.233206 20787 raft_consensus.cc:3055] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:07:29.233795 20787 raft_consensus.cc:740] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
W20260709 13:07:29.234854 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.237042 20787 consensus_queue.cc:260] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:29.043736 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:29.084035 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:28.941220 20603 raft_consensus.cc:493] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.114406 20592 raft_consensus.cc:493] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:29.227023 20659 consensus_queue.cc:1243] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer e10b16d536674c0bb350a31d7ce5ff7f log is divergent from this leader: its last log entry 9.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:07:29.228266 16279 raft_consensus.cc:2468] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 9.
I20260709 13:07:29.229161 16202 raft_consensus.cc:2468] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 13.
I20260709 13:07:29.229534 21058 raft_consensus.cc:493] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.113857 20607 raft_consensus.cc:493] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
W20260709 13:07:28.898675 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 46936.1us
I20260709 13:07:28.934178 20822 raft_consensus.cc:697] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:07:28.831517 21008 raft_consensus.cc:2749] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:29.247177 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:29.234196 20661 leader_election.cc:290] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:28.888025 21013 raft_consensus.cc:3055] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:07:29.252652 16249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.123867 20759 consensus_queue.cc:1059] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.122s
I20260709 13:07:29.251895 16353 raft_consensus.cc:2376] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 16. Re-sending same reply.
I20260709 13:07:29.256237 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:29.256578 20659 raft_consensus.cc:493] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:29.257323 16202 raft_consensus.cc:2468] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 9.
I20260709 13:07:29.257503 20659 raft_consensus.cc:515] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:29.113948 20562 consensus_queue.cc:1059] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.136s
I20260709 13:07:29.257490 20787 raft_consensus.cc:3060] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:29.263031 21058 raft_consensus.cc:515] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:29.263106 16207 raft_consensus.cc:2393] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 6: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:07:29.261576 16205 raft_consensus.cc:2468] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 15.
I20260709 13:07:28.866653 20990 consensus_queue.cc:1048] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.405s
I20260709 13:07:29.256390 20592 raft_consensus.cc:515] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:29.271813 16946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:07:29.272526 20757 raft_consensus.cc:493] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:29.273526 20607 raft_consensus.cc:515] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:29.266348 21058 leader_election.cc:290] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:29.275197 16200 raft_consensus.cc:2393] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 11: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
I20260709 13:07:29.275287 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:29.275733 16948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
W20260709 13:07:29.280886 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.281157 20489 raft_consensus.cc:493] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.890763 20998 consensus_queue.cc:1048] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.386s
I20260709 13:07:29.283722 16348 raft_consensus.cc:2468] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 10.
I20260709 13:07:29.289939 16948 raft_consensus.cc:2468] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 10.
I20260709 13:07:29.292680 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:29.286741 20562 consensus_queue.cc:1243] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer 0aea40d6e4374085a2e38a70a71f63e3 log is divergent from this leader: its last log entry 10.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:07:29.036511 16105 catalog_manager.cc:5697] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "1109f76a0b7b443a84c0327c8707bc63" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:29.293026 21058 raft_consensus.cc:493] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:29.284992 20489 raft_consensus.cc:515] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:29.308218 16946 raft_consensus.cc:3060] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:29.303150 20742 leader_election.cc:290] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:28.901301 21011 raft_consensus.cc:515] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:29.320955 16206 raft_consensus.cc:2393] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 14: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:07:29.293820 20757 raft_consensus.cc:515] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:29.318085 21013 raft_consensus.cc:740] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:07:29.343710 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:29.349776 20592 leader_election.cc:290] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:07:29.351768 16173 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:29.355626 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 66865.8us
I20260709 13:07:29.346901 21058 raft_consensus.cc:515] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:29.359766 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:29.370591 20955 raft_consensus.cc:493] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.371913 16205 raft_consensus.cc:2468] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 13.
I20260709 13:07:29.371760 16248 leader_election.cc:304] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:29.374811 16246 leader_election.cc:304] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:29.393492 20757 leader_election.cc:290] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:29.395133 20659 leader_election.cc:290] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:29.396778 16207 raft_consensus.cc:1240] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:07:29.427452 16914 leader_election.cc:304] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
W20260709 13:07:29.434032 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 121683us
I20260709 13:07:29.435400 16207 raft_consensus.cc:1240] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 13 LEADER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:29.357039 20603 raft_consensus.cc:515] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:07:29.437067 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 61528.3us
I20260709 13:07:29.463467 16246 leader_election.cc:304] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:29.463634 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:29.465687 20822 consensus_queue.cc:237] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:29.444267 20659 raft_consensus.cc:2804] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:29.470006 16276 raft_consensus.cc:2468] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 11.
I20260709 13:07:29.491257 16204 raft_consensus.cc:2468] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 11.
I20260709 13:07:29.479038 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
W20260709 13:07:29.494715 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 50156.4us
W20260709 13:07:29.483217 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 164188us
I20260709 13:07:29.469275 20757 raft_consensus.cc:2804] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:29.496949 16199 raft_consensus.cc:2468] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 14.
I20260709 13:07:29.499768 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:29.505496 16246 leader_election.cc:304] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:29.507123 16205 raft_consensus.cc:1275] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:07:29.498214 20759 raft_consensus.cc:2804] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:29.483431 20985 raft_consensus.cc:493] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.493032 20811 raft_consensus.cc:493] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.498270 20757 raft_consensus.cc:493] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
W20260709 13:07:29.529894 21064 log.cc:927] Time spent T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.150s	user 0.000s	sys 0.001s
I20260709 13:07:29.470589 20659 raft_consensus.cc:493] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:29.530210 20757 raft_consensus.cc:3060] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:29.536453 20659 raft_consensus.cc:3060] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:29.450423 20955 raft_consensus.cc:515] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:29.501832 20742 raft_consensus.cc:2749] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:29.545562 20955 leader_election.cc:290] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:29.547586 20659 raft_consensus.cc:515] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:29.550011 20659 leader_election.cc:290] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:29.531167 20811 raft_consensus.cc:515] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:29.557404 20987 raft_consensus.cc:3060] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:29.559980 20811 leader_election.cc:290] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:29.562850 20942 raft_consensus.cc:2804] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:29.563495 20942 raft_consensus.cc:493] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:29.564077 20942 raft_consensus.cc:3060] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:29.573643 21017 leader_election.cc:290] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:29.575872 21058 leader_election.cc:290] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:29.582755 16207 raft_consensus.cc:2393] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 in current term 11: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
W20260709 13:07:29.585202 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.586059 16206 raft_consensus.cc:1240] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:29.518396 20759 raft_consensus.cc:493] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:29.518528 20607 leader_election.cc:290] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:29.592411 21011 leader_election.cc:290] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:29.594689 20811 raft_consensus.cc:493] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.595626 20811 raft_consensus.cc:515] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:29.591197 20759 raft_consensus.cc:3060] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:29.601187 20920 raft_consensus.cc:3055] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:29.601842 20920 raft_consensus.cc:740] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:07:29.603132 20943 raft_consensus.cc:3055] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:29.603703 20943 raft_consensus.cc:740] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
W20260709 13:07:29.603142 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 135746us
I20260709 13:07:29.605732 20973 leader_election.cc:290] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:29.605906 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:29.594333 16248 leader_election.cc:304] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:29.595732 16203 raft_consensus.cc:1275] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:07:29.606700 16207 raft_consensus.cc:2468] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 16.
I20260709 13:07:29.610224 20985 raft_consensus.cc:515] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:29.612179 16203 raft_consensus.cc:1275] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260709 13:07:29.612668 16203 pending_rounds.cc:85] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f: Aborting all ops after (but not including) 8
I20260709 13:07:29.612969 16203 pending_rounds.cc:107] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 13:07:29.613075 20985 leader_election.cc:290] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:29.613271 16203 raft_consensus.cc:2889] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:29.614488 16204 raft_consensus.cc:1275] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:07:29.618311 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:29.621147 20660 raft_consensus.cc:493] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.621846 20660 raft_consensus.cc:515] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:29.624325 20660 leader_election.cc:290] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:29.591382 16946 raft_consensus.cc:2468] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 14.
W20260709 13:07:29.633040 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.640069 16205 raft_consensus.cc:1275] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:07:29.644483 16200 raft_consensus.cc:1240] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 11. Current term is 12. Ops: []
W20260709 13:07:29.649296 16915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.654841 16207 raft_consensus.cc:1240] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:29.607664 20811 leader_election.cc:290] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:29.674431 16205 raft_consensus.cc:1275] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:07:29.683418 16940 raft_consensus.cc:1240] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 13:07:29.684151 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f022e2e63ae4461d834e476ff2666991" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:29.682229 16946 raft_consensus.cc:1240] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
W20260709 13:07:29.687263 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 199453us
I20260709 13:07:29.688823 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:29.521166 21013 consensus_queue.cc:260] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:29.694201 16200 raft_consensus.cc:1275] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:07:29.695843 16201 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60154 (request call id 2734) took 1029 ms. Trace:
I20260709 13:07:29.703262 20920 consensus_queue.cc:260] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:29.705289 20920 raft_consensus.cc:3060] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:29.711301 16322 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.712196 20603 leader_election.cc:290] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:29.715566 16351 raft_consensus.cc:1240] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:07:29.715889 16276 raft_consensus.cc:2468] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 6.
I20260709 13:07:29.714433 16350 raft_consensus.cc:1275] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:07:29.718773 16353 raft_consensus.cc:1275] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:07:29.720278 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:29.721107 16354 raft_consensus.cc:2468] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 10.
W20260709 13:07:29.727001 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 132963us
I20260709 13:07:29.729195 16248 leader_election.cc:304] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:07:29.729223 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 236240us
W20260709 13:07:29.730576 16320 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.732064 20787 raft_consensus.cc:2804] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:29.732712 20787 raft_consensus.cc:697] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
W20260709 13:07:29.733433 16249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.688441 21058 raft_consensus.cc:2749] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:07:29.734153 21073 log.cc:927] Time spent T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.052s	user 0.000s	sys 0.003s
I20260709 13:07:29.735582 16348 raft_consensus.cc:1275] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:07:29.736779 16208 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60154 (request call id 2732) took 1070 ms. Trace:
I20260709 13:07:29.726889 16173 leader_election.cc:304] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 363bb2f744eb486f9ad726f08214c98e
W20260709 13:07:29.736326 20948 consensus_meta.cc:287] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 0.523s	user 0.005s	sys 0.012s
I20260709 13:07:29.745432 20861 raft_consensus.cc:493] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.746075 20861 raft_consensus.cc:515] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:29.737195 16208 rpcz_store.cc:276] 0709 13:07:28.665922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.279206 (+613284us) service_pool.cc:224] Handling call
0709 13:07:29.331884 (+ 52678us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:29.394629 (+ 62745us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:29.394676 (+    47us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:29.396237 (+  1561us) log.cc:844] Serialized 590 byte log entry
0709 13:07:29.511806 (+115569us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:29.511846 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:29.511915 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:29.736539 (+224624us) raft_consensus.cc:1685] finished
0709 13:07:29.736558 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:29.736711 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3830,"raft.run_cpu_time_us":362,"raft.run_wall_time_us":53627,"thread_start_us":115034,"threads_started":1,"wal-append.queue_time_us":261825}
I20260709 13:07:29.747172 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:29.748263 16282 raft_consensus.cc:3060] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:29.751587 16356 raft_consensus.cc:2410] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:07:29.755927 20489 leader_election.cc:290] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:07:29.757858 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 58673.6us
I20260709 13:07:29.702703 16201 rpcz_store.cc:276] 0709 13:07:28.666396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.360785 (+694389us) service_pool.cc:224] Handling call
0709 13:07:29.367844 (+  7059us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:29.374370 (+  6526us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:07:29.467694 (+ 93324us) log.cc:844] Serialized 14 byte log entry
0709 13:07:29.695486 (+227792us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:29.695556 (+    70us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:29.695599 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:29.695662 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:29.695781 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":135117,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":2513,"raft.queue_time_us":15122,"raft.run_cpu_time_us":250,"raft.run_wall_time_us":43760,"thread_start_us":225331,"threads_started":2,"wal-append.queue_time_us":232998}
I20260709 13:07:29.733923 20787 consensus_queue.cc:237] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:29.736304 20757 raft_consensus.cc:515] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:29.772055 20948 raft_consensus.cc:493] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:29.772862 20948 raft_consensus.cc:515] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:07:29.774003 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:29.774663 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.776467 20948 leader_election.cc:290] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:29.777815 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:29.777942 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:07:29.779429 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 50422.1us
I20260709 13:07:29.779531 16354 raft_consensus.cc:1275] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:07:29.780624 16320 leader_election.cc:304] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:29.800853 20603 raft_consensus.cc:3060] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:29.802646 20660 consensus_queue.cc:1059] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:29.804512 20948 raft_consensus.cc:3055] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:07:29.804744 20660 consensus_queue.cc:1059] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:29.699330 20811 raft_consensus.cc:493] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.783355 20861 leader_election.cc:290] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:29.784061 20966 raft_consensus.cc:2804] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:29.787514 16349 raft_consensus.cc:1275] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:07:29.774077 20757 leader_election.cc:290] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 9 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:29.833086 20811 raft_consensus.cc:515] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:29.836335 16352 raft_consensus.cc:2468] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 9.
W20260709 13:07:29.821125 16356 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33486 (request call id 675) took 1576 ms (client timeout 2010 ms). Trace:
W20260709 13:07:29.837630 16356 rpcz_store.cc:269] 0709 13:07:28.244680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:28.300412 (+ 55732us) service_pool.cc:224] Handling call
0709 13:07:29.820816 (+1520404us) spinlock_profiling.cc:243] Waited 1.44 s on lock 0x7b5400348854. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:07:29.821039 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3312610048}
I20260709 13:07:29.838768 20811 leader_election.cc:290] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:29.821044 16105 catalog_manager.cc:5697] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: term changed from 8 to 9, leader changed from 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) to 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68). New cstate: current_term: 9 leader_uuid: "1109f76a0b7b443a84c0327c8707bc63" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:29.805028 20948 raft_consensus.cc:740] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:29.827062 20998 raft_consensus.cc:493] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:29.823374 20987 consensus_queue.cc:1048] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 13:07:29.810735 20822 raft_consensus.cc:493] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:29.823068 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 86566.8us
I20260709 13:07:29.809033 16248 leader_election.cc:304] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:07:29.831884 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 69502.5us
I20260709 13:07:29.826406 16357 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24"
dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
mode: GRACEFUL
new_leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
 from {username='slave'} at 127.0.0.1:56792
W20260709 13:07:29.809962 16249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.843739 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:29.846222 20973 consensus_queue.cc:1059] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:29.847851 21008 raft_consensus.cc:493] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.848737 20660 raft_consensus.cc:3055] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:29.741307 16202 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60154 (request call id 2736) took 1074 ms. Trace:
I20260709 13:07:29.787431 20759 raft_consensus.cc:515] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:29.849031 21017 raft_consensus.cc:493] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.789274 20942 raft_consensus.cc:515] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:07:29.825035 16106 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38840 (request call id 205) took 19237 ms (client timeout 15000 ms). Trace:
I20260709 13:07:29.878149 16282 raft_consensus.cc:2468] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 14.
I20260709 13:07:29.879910 16357 raft_consensus.cc:606] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 13 LEADER]: Received request to transfer leadership to TS e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:29.887212 20861 raft_consensus.cc:493] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.853623 20562 raft_consensus.cc:493] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.884537 16322 leader_election.cc:304] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:29.895296 16105 catalog_manager.cc:5697] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: term changed from 13 to 14, leader changed from 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) to 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68). New cstate: current_term: 14 leader_uuid: "1109f76a0b7b443a84c0327c8707bc63" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:29.907038 16173 leader_election.cc:304] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:07:29.903713 16320 leader_election.cc:304] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:29.894451 20660 raft_consensus.cc:740] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:29.918057 20942 leader_election.cc:290] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:29.863207 20943 consensus_queue.cc:260] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:29.918820 20759 leader_election.cc:290] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:29.919699 20943 raft_consensus.cc:3060] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:29.893548 20822 raft_consensus.cc:515] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:29.926023 21070 consensus_queue.cc:1048] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 13:07:29.926934 20955 raft_consensus.cc:493] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.928200 20811 raft_consensus.cc:2749] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:29.927682 20955 raft_consensus.cc:515] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:29.930017 20990 raft_consensus.cc:493] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:29.926309 20915 raft_consensus.cc:2749] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:29.930788 20990 raft_consensus.cc:515] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:29.925143 20562 raft_consensus.cc:515] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:29.935294 20966 raft_consensus.cc:493] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:29.915861 20489 raft_consensus.cc:2804] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:07:29.938138 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 53750us
I20260709 13:07:29.942773 20757 raft_consensus.cc:493] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.945348 20489 raft_consensus.cc:697] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:07:29.946798 20489 consensus_queue.cc:237] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:29.910436 20861 raft_consensus.cc:515] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:29.950667 20861 leader_election.cc:290] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:29.952554 20757 raft_consensus.cc:515] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:29.955250 20757 leader_election.cc:290] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:29.956189 20603 raft_consensus.cc:2749] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:29.956816 16322 leader_election.cc:400] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 election: Vote denied by peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823) with higher term. Message: Invalid argument: T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for earlier term 15. Current term is 16.
I20260709 13:07:29.957229 16322 leader_election.cc:403] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:07:29.910308 21017 raft_consensus.cc:515] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } }
I20260709 13:07:29.959024 20811 raft_consensus.cc:2749] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823) with higher term. Message: Invalid argument: T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for earlier term 15. Current term is 16.
I20260709 13:07:29.925135 20973 raft_consensus.cc:2749] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:07:29.953006 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 134427us
I20260709 13:07:29.959810 21017 leader_election.cc:290] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:07:29.963478 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 154647us
W20260709 13:07:29.895567 16106 rpcz_store.cc:269] 0709 13:07:10.587267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:10.588288 (+  1021us) service_pool.cc:224] Handling call
0709 13:07:11.218069 (+629781us) spinlock_profiling.cc:243] Waited 412 ms on lock 0x7b5400137754. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f3090 00007f361f491f3a 00007f36252481cc 00007f362534637e 00007f36238072a4 00007f3623807232 00007f3623807161 00007f36238070dc 00007f3623806392 00007f361d7c448c 00007f361d7c38c6
0709 13:07:29.824751 (+18606682us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:22.313784 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:22.314434 (+   650us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:22.314498 (+    64us) write_op.cc:435] Acquired schema lock
0709 13:07:22.314519 (+    21us) tablet.cc:662] Decoding operations
0709 13:07:22.376372 (+ 61853us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:22.376469 (+    97us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:22.376499 (+    30us) tablet.cc:685] Acquiring locks for 16 operations
0709 13:07:22.377866 (+  1367us) tablet.cc:701] Row locks acquired
0709 13:07:22.377930 (+    64us) write_op.cc:260] PREPARE: finished
0709 13:07:22.378117 (+   187us) write_op.cc:270] Start()
0709 13:07:22.378277 (+   160us) write_op.cc:276] Timestamp: P: 1783602442378053 usec, L: 0
0709 13:07:22.378311 (+    34us) op_driver.cc:348] REPLICATION: starting
0709 13:07:22.471450 (+ 93139us) log.cc:844] Serialized 6347 byte log entry
0709 13:07:23.117967 (+646517us) op_driver.cc:464] REPLICATION: finished
0709 13:07:23.373082 (+255115us) write_op.cc:301] APPLY: starting
0709 13:07:23.374353 (+  1271us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:23.557776 (+183423us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:23.557887 (+   111us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:24.056882 (+498995us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:24.057203 (+   321us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=32,key_file_lookups=32,delta_file_lookups=32,mrs_lookups=0
0709 13:07:24.057255 (+    52us) write_op.cc:312] APPLY: finished
0709 13:07:24.057651 (+   396us) log.cc:844] Serialized 148 byte log entry
0709 13:07:24.622887 (+565236us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:24.623131 (+   244us) write_op.cc:454] Released schema lock
0709 13:07:24.623213 (+    82us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:24.623857 (+   644us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:24.623884 (+    27us) write_op.cc:454] Released schema lock
0709 13:07:25.396876 (+772992us) spinlock_profiling.cc:243] Waited 2.19 ms on lock 0x7b4400022b4c. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361c224db1 00007f361c2c2c85 00007f361c2c36a2 00007f361f0351db 00007f361f030aaf 00007f361f02486e 00007f361f023bb6 00007f361f0237d8 00007f361f02d221 00007f361f02d1d9 00007f361f02d169
Metrics: {"mutex_wait_us":164,"reported_tablets":36,"spinlock_wait_cycles":947468160,"child_traces":[["op",{"apply.queue_time_us":238418,"apply.run_cpu_time_us":61499,"apply.run_wall_time_us":1256518,"cfile_cache_hit":66,"cfile_cache_hit_bytes":71007,"num_ops":16,"prepare.queue_time_us":529772,"prepare.run_cpu_time_us":26310,"prepare.run_wall_time_us":229354,"raft.queue_time_us":471639,"raft.run_cpu_time_us":16315,"raft.run_wall_time_us":214607,"replication_time_us":717871,"spinlock_wait_cycles":5041536,"thread_start_us":1060065,"threads_started":5,"wal-append.queue_time_us":674678,"wal-append.run_cpu_time_us":42896,"wal-append.run_wall_time_us":3512406}]]}
I20260709 13:07:29.965863 20562 leader_election.cc:290] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:29.926106 20948 consensus_queue.cc:260] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:29.968411 16105 catalog_manager.cc:5697] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "1109f76a0b7b443a84c0327c8707bc63" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:29.944497 20966 raft_consensus.cc:3060] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:29.941366 20955 leader_election.cc:290] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:29.995178 16105 catalog_manager.cc:5697] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: term changed from 9 to 10, leader changed from 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) to 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68). New cstate: current_term: 10 leader_uuid: "1109f76a0b7b443a84c0327c8707bc63" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:29.997094 20920 raft_consensus.cc:493] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.915334 21008 raft_consensus.cc:515] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:07:29.980391 16320 leader_election.cc:304] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:29.983918 21013 raft_consensus.cc:3060] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:29.915997 20998 raft_consensus.cc:515] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:29.895780 16202 rpcz_store.cc:276] 0709 13:07:28.666934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.621264 (+954330us) service_pool.cc:224] Handling call
0709 13:07:29.621647 (+   383us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:29.621948 (+   301us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:07:29.622287 (+   339us) log.cc:844] Serialized 14 byte log entry
0709 13:07:29.740055 (+117768us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:29.740114 (+    59us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:29.741018 (+   904us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:29.741106 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:29.741240 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":2928,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":41590,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":37791,"thread_start_us":75751,"threads_started":1,"wal-append.queue_time_us":270940}
I20260709 13:07:30.005249 20920 raft_consensus.cc:515] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:30.007814 16322 leader_election.cc:304] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:07:30.011552 21008 leader_election.cc:290] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:30.012850 20920 leader_election.cc:290] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:07:30.008620 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 120609us
I20260709 13:07:30.008818 16320 leader_election.cc:304] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:30.013895 16348 raft_consensus.cc:1275] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
I20260709 13:07:30.014734 16320 leader_election.cc:304] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:30.009488 20985 raft_consensus.cc:2749] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:30.018002 20985 raft_consensus.cc:2804] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:30.018472 20985 raft_consensus.cc:493] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:30.018851 20985 raft_consensus.cc:3060] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:30.019289 16947 raft_consensus.cc:1275] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:07:30.020480 16946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:30.021270 16946 raft_consensus.cc:2468] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 11.
I20260709 13:07:30.022791 20973 raft_consensus.cc:2804] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:30.023090 16941 raft_consensus.cc:1275] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:07:30.023324 20973 raft_consensus.cc:493] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:30.023940 16352 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41832 (request call id 2185) took 2926 ms (client timeout 2105 ms). Trace:
I20260709 13:07:30.024098 20973 raft_consensus.cc:3060] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:30.019124 16914 leader_election.cc:304] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:07:30.024464 16352 rpcz_store.cc:269] 0709 13:07:27.098088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:27.098279 (+   191us) service_pool.cc:224] Handling call
0709 13:07:30.023657 (+2925378us) spinlock_profiling.cc:243] Waited 2.38 s on lock 0x7b5400195854. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:07:30.023844 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5471798144}
I20260709 13:07:30.025662 21070 raft_consensus.cc:2804] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:30.026247 21070 raft_consensus.cc:697] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 LEADER]: Becoming Leader. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:07:30.026629 20861 raft_consensus.cc:2749] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:30.008602 20948 raft_consensus.cc:3060] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:30.013984 16322 leader_election.cc:304] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:30.014415 16348 pending_rounds.cc:85] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e: Aborting all ops after (but not including) 7
I20260709 13:07:30.005903 16105 catalog_manager.cc:5697] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:07:30.039644 16348 pending_rounds.cc:107] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 13:07:30.040202 16348 raft_consensus.cc:2889] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:30.028604 21008 consensus_queue.cc:1048] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.015s
I20260709 13:07:30.048207 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:30.051896 20822 leader_election.cc:290] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:30.051182 16322 leader_election.cc:304] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:30.054400 20990 leader_election.cc:290] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:30.055874 21023 consensus_queue.cc:260] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:07:30.057363 21023 raft_consensus.cc:3060] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:30.058169 21070 consensus_queue.cc:237] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:30.060729 16173 leader_election.cc:304] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:07:30.061693 21008 raft_consensus.cc:2804] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:30.062264 21008 raft_consensus.cc:493] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:30.062804 21008 raft_consensus.cc:3060] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:30.067859 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:30.068758 16207 raft_consensus.cc:2468] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 9.
I20260709 13:07:30.083389 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:30.084170 16207 raft_consensus.cc:2468] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 9.
I20260709 13:07:30.089902 20948 raft_consensus.cc:2749] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:07:30.094146 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:30.100922 16105 catalog_manager.cc:5697] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: term changed from 7 to 9, leader changed from 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) to 363bb2f744eb486f9ad726f08214c98e (127.14.180.67). New cstate: current_term: 9 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
W20260709 13:07:30.096009 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 78938.7us
I20260709 13:07:30.103096 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bc3c8ff9b84838a2664335d7e1582b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:30.031864 20660 consensus_queue.cc:260] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:30.026805 20811 consensus_queue.cc:1059] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.068s
I20260709 13:07:30.108742 16173 leader_election.cc:304] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:30.048283 20998 leader_election.cc:290] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:30.118445 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:30.135428 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:30.135773 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:30.136343 16278 raft_consensus.cc:2468] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 11.
I20260709 13:07:30.136778 16203 raft_consensus.cc:3060] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:30.144694 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
W20260709 13:07:30.145985 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 49832.2us
I20260709 13:07:30.149999 21011 raft_consensus.cc:2804] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:30.150763 21011 raft_consensus.cc:697] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:07:30.151885 21011 consensus_queue.cc:237] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:07:30.154955 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:30.156150 16173 leader_election.cc:304] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:30.157133 20973 raft_consensus.cc:515] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:30.158201 20562 consensus_queue.cc:1048] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:30.158999 20955 raft_consensus.cc:2804] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:30.161489 21017 consensus_queue.cc:1048] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:07:30.163200 16320 leader_election.cc:304] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:30.163663 20955 raft_consensus.cc:493] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:30.164162 20955 raft_consensus.cc:3060] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:30.160616 20985 raft_consensus.cc:515] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:30.174696 20985 leader_election.cc:290] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 12 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:30.175652 20985 raft_consensus.cc:3055] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:30.176055 20985 raft_consensus.cc:740] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:30.176682 20603 raft_consensus.cc:2749] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:07:30.178785 20955 raft_consensus.cc:515] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:30.180154 16279 raft_consensus.cc:1275] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:07:30.093865 21008 raft_consensus.cc:515] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:30.173130 20973 leader_election.cc:290] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:30.183022 20660 raft_consensus.cc:3060] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:30.201930 21008 leader_election.cc:290] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 14 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:30.129348 20861 raft_consensus.cc:2804] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:30.155275 16946 raft_consensus.cc:3060] T 540bfc4ad793452faea5b865343aacf7 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 LEARNER]: Advancing to term 13
I20260709 13:07:30.197088 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:30.147369 16105 catalog_manager.cc:5697] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: term changed from 8 to 11. New cstate: current_term: 11 leader_uuid: "1109f76a0b7b443a84c0327c8707bc63" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:30.203472 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:07:30.208591 16915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:30.230765 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 179663us
I20260709 13:07:30.236241 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:07:30.206408 20861 raft_consensus.cc:493] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:30.224562 21008 raft_consensus.cc:493] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.246779 16279 raft_consensus.cc:1275] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 13:07:30.246191 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:30.248431 16207 raft_consensus.cc:2468] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 9.
I20260709 13:07:30.177301 20985 consensus_queue.cc:260] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:30.232043 20822 raft_consensus.cc:493] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:30.252166 16203 raft_consensus.cc:2468] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 10.
I20260709 13:07:30.250619 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:30.248112 16279 pending_rounds.cc:85] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3: Aborting all ops after (but not including) 7
W20260709 13:07:30.256002 16248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:30.257726 16279 pending_rounds.cc:107] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3: Aborting uncommitted NO_OP operation due to leader change: 8.8
W20260709 13:07:30.256775 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 93759.7us
I20260709 13:07:30.258055 16279 raft_consensus.cc:2889] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:07:30.252249 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 219806us
I20260709 13:07:30.246176 20861 raft_consensus.cc:3060] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:30.262442 20822 raft_consensus.cc:515] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:30.258961 16105 catalog_manager.cc:5697] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "1109f76a0b7b443a84c0327c8707bc63" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:07:30.267596 21080 log.cc:927] Time spent T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.170s	user 0.002s	sys 0.002s
I20260709 13:07:30.268060 16105 catalog_manager.cc:5697] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "1109f76a0b7b443a84c0327c8707bc63" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:30.268916 20822 leader_election.cc:290] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:07:30.270251 21079 log.cc:927] Time spent T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.173s	user 0.000s	sys 0.002s
I20260709 13:07:30.271878 20955 leader_election.cc:290] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:30.262962 16278 raft_consensus.cc:1275] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:07:30.276540 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:07:30.277932 21081 log.cc:927] Time spent T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.178s	user 0.001s	sys 0.000s
I20260709 13:07:30.282241 16322 leader_election.cc:304] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:30.270048 16105 catalog_manager.cc:5697] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "1109f76a0b7b443a84c0327c8707bc63" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:07:30.284039 16249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:30.277392 20966 raft_consensus.cc:515] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:07:30.285940 16248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:30.287899 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:07:30.288906 20822 consensus_queue.cc:1059] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:30.290179 20787 raft_consensus.cc:3055] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:30.290721 20787 raft_consensus.cc:740] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:07:30.290948 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:30.291270 20973 raft_consensus.cc:2804] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:30.291743 20973 raft_consensus.cc:493] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:30.292204 20973 raft_consensus.cc:3060] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:30.291846 20787 consensus_queue.cc:260] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:30.293108 20787 raft_consensus.cc:3060] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:30.294485 20985 raft_consensus.cc:3060] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:30.288921 16248 leader_election.cc:304] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:30.295805 20489 raft_consensus.cc:2749] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:30.301671 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:30.302769 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:30.303381 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:30.304142 16277 raft_consensus.cc:2468] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 9.
I20260709 13:07:30.301879 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:30.305124 16282 raft_consensus.cc:1217] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 LEADER]: Deduplicated request from leader. Original: 7.5->[7.6-9.7]   Dedup: 9.7->[]
I20260709 13:07:30.305263 16274 raft_consensus.cc:2468] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 11.
I20260709 13:07:30.305701 16282 raft_consensus.cc:1240] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 LEADER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 9. Current term is 10. Ops: [7.6-9.7]
I20260709 13:07:30.290949 16322 leader_election.cc:304] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:07:30.307076 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:30.307428 21083 raft_consensus.cc:2804] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:30.307864 16275 raft_consensus.cc:2468] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 11.
I20260709 13:07:30.308109 21083 raft_consensus.cc:697] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 14 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:30.309283 21083 consensus_queue.cc:237] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:30.311913 16199 raft_consensus.cc:1275] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:07:30.314965 21017 consensus_queue.cc:1048] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:30.318624 16199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60138 (request call id 2532) took 1451 ms. Trace:
I20260709 13:07:30.319109 16199 rpcz_store.cc:276] 0709 13:07:28.867107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.606867 (+739760us) service_pool.cc:224] Handling call
0709 13:07:29.672505 (+ 65638us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:30.312405 (+639900us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:30.318320 (+  5915us) spinlock_profiling.cc:243] Waited 639 ms on lock 0x7b54001c8254. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f489e01 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6
0709 13:07:30.318502 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1470028288}
I20260709 13:07:30.320752 20943 raft_consensus.cc:493] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.321368 20943 raft_consensus.cc:515] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:30.325009 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:30.325570 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:30.336936 16283 raft_consensus.cc:3060] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:30.325915 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:30.338709 20757 raft_consensus.cc:493] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.339198 16357 raft_consensus.cc:1240] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:07:30.339295 20757 raft_consensus.cc:515] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:30.330708 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:30.330991 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:30.330502 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:30.322857 16105 catalog_manager.cc:5697] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "1109f76a0b7b443a84c0327c8707bc63" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:30.328104 16320 leader_election.cc:304] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:30.336705 16348 raft_consensus.cc:2376] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 9. Re-sending same reply.
I20260709 13:07:30.348233 16278 raft_consensus.cc:1275] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:07:30.346659 16946 raft_consensus.cc:1275] T 540bfc4ad793452faea5b865343aacf7 P 1109f76a0b7b443a84c0327c8707bc63 [term 13 LEARNER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:07:30.329715 21082 raft_consensus.cc:993] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e: : Instructing follower e10b16d536674c0bb350a31d7ce5ff7f to start an election
I20260709 13:07:30.350744 20759 raft_consensus.cc:493] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.350808 21087 raft_consensus.cc:2804] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:30.363251 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:30.364938 16320 leader_election.cc:304] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:07:30.372692 16281 raft_consensus.cc:2468] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 9.
I20260709 13:07:30.373764 16199 raft_consensus.cc:2393] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 in current term 8: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
W20260709 13:07:30.370976 16248 consensus_peers.cc:597] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 -> Peer 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875): Couldn't send request to peer 1109f76a0b7b443a84c0327c8707bc63. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4b962ceebb5c48c1914459ae0c0eff1b. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:30.323791 20943 leader_election.cc:290] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:07:30.377826 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 47364.4us
I20260709 13:07:30.322866 21008 raft_consensus.cc:515] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:30.387899 16348 raft_consensus.cc:1275] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:07:30.322523 20861 raft_consensus.cc:515] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:30.394225 20942 consensus_queue.cc:1048] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
W20260709 13:07:30.405038 16249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:30.371531 21087 raft_consensus.cc:493] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:30.391086 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
W20260709 13:07:30.423488 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:30.374295 21082 raft_consensus.cc:1081] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 13 LEADER]: Signalling peer e10b16d536674c0bb350a31d7ce5ff7f to start an election
W20260709 13:07:30.434885 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 70030.5us
I20260709 13:07:30.420580 21087 raft_consensus.cc:3060] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:30.418963 20861 leader_election.cc:290] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:30.419636 20948 raft_consensus.cc:2804] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:30.444693 16946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:30.458714 20973 raft_consensus.cc:515] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:30.460987 16348 raft_consensus.cc:1240] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 9. Current term is 10. Ops: [7.6-9.7]
I20260709 13:07:30.461412 20973 leader_election.cc:290] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:30.462847 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:30.463845 16357 raft_consensus.cc:3060] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:30.419970 20759 raft_consensus.cc:515] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:30.475768 20966 leader_election.cc:290] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 11 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:30.441145 20943 consensus_queue.cc:1048] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 13:07:30.445674 20822 consensus_queue.cc:1048] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:07:30.479714 20757 leader_election.cc:290] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:30.481738 16217 tablet_copy_source_session.cc:215] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:07:30.393515 20920 consensus_queue.cc:1048] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.093s
I20260709 13:07:30.486301 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:30.488297 16199 raft_consensus.cc:2468] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 15.
I20260709 13:07:30.489113 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:30.489840 16201 raft_consensus.cc:2468] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 11.
I20260709 13:07:30.491204 16205 raft_consensus.cc:1275] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:07:30.495286 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:30.495985 16348 raft_consensus.cc:3060] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:30.496940 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:30.497674 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:30.498483 16350 raft_consensus.cc:1275] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:07:30.499228 16354 raft_consensus.cc:1275] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:07:30.497673 16353 raft_consensus.cc:2468] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 14.
I20260709 13:07:30.500627 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:30.502866 16353 raft_consensus.cc:1240] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:30.503799 20759 leader_election.cc:290] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:07:30.506739 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 56255us
I20260709 13:07:30.508116 20811 consensus_queue.cc:1048] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:30.512612 16348 raft_consensus.cc:2468] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 11.
I20260709 13:07:30.520807 16283 raft_consensus.cc:2468] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 12.
I20260709 13:07:30.527297 16354 raft_consensus.cc:1240] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 14. Current term is 15. Ops: [12.8-14.9]
I20260709 13:07:30.529182 16217 rpcz_store.cc:275] Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.0.0.1:39674 (request call id 979) took 1921 ms. Trace:
I20260709 13:07:30.529726 16217 rpcz_store.cc:276] 0709 13:07:28.614712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:28.615051 (+   339us) service_pool.cc:224] Handling call
0709 13:07:30.481148 (+1866097us) spinlock_profiling.cc:243] Waited 1.43 s on lock 0x7b54001c8254. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f4933f7 00007f3624429036 00007f3624432a3e 00007f361bcf627b 00007f36244329ba 00007f362442dacc 00007f3624428c7b 00007f362441d8d1 00007f36234d14b4 00007f36234d1442
0709 13:07:30.529052 (+ 47904us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3278018304}
W20260709 13:07:30.535640 21092 log.cc:927] Time spent T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:07:30.535862 21008 leader_election.cc:290] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:30.537568 16207 raft_consensus.cc:1240] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:30.535135 20985 raft_consensus.cc:2955] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 11 LEADER]: Committing config change with OpId 9.7: config changed from index 5 to 7, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:07:30.552349 16357 raft_consensus.cc:2468] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 12.
I20260709 13:07:30.577854 16946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:30.578764 16946 raft_consensus.cc:2468] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 12.
I20260709 13:07:30.522899 21017 raft_consensus.cc:493] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:30.591183 16915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:30.595395 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:07:30.602602 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 178848us
W20260709 13:07:30.605878 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 264986us
I20260709 13:07:30.606849 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:30.610742 16357 raft_consensus.cc:2468] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 18.
W20260709 13:07:30.626784 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 254033us
I20260709 13:07:30.619273 16173 leader_election.cc:304] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:30.629349 16354 raft_consensus.cc:2468] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 11.
I20260709 13:07:30.634588 21008 raft_consensus.cc:2804] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:30.631584 20948 raft_consensus.cc:697] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 11 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:30.635200 21008 raft_consensus.cc:493] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:30.635849 21008 raft_consensus.cc:3060] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:30.640159 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 81095.4us
I20260709 13:07:30.634066 16173 leader_election.cc:304] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:30.641775 16248 leader_election.cc:304] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:07:30.632685 16914 leader_election.cc:304] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:30.658795 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:30.664217 16357 raft_consensus.cc:2468] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 10.
I20260709 13:07:30.665454 20822 consensus_queue.cc:1059] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:30.666514 20822 consensus_queue.cc:1243] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer e10b16d536674c0bb350a31d7ce5ff7f log is divergent from this leader: its last log entry 10.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:07:30.667091 21101 raft_consensus.cc:3055] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:30.667529 21101 raft_consensus.cc:740] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:07:30.668138 16914 leader_election.cc:304] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
W20260709 13:07:30.678781 16173 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:30.679382 16173 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:30.678447 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 170095us
I20260709 13:07:30.654877 21011 raft_consensus.cc:2804] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:30.630671 21017 raft_consensus.cc:515] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:30.682225 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:30.645669 21102 raft_consensus.cc:2804] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:30.690182 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:30.697976 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:30.699570 16208 raft_consensus.cc:2410] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:07:30.695202 16354 raft_consensus.cc:2468] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 13.
I20260709 13:07:30.647122 21087 raft_consensus.cc:515] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:30.704602 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:30.705955 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:30.735208 16246 leader_election.cc:304] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:30.679563 20757 raft_consensus.cc:2804] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:30.738895 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:30.744342 16205 raft_consensus.cc:2468] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 9.
I20260709 13:07:30.737766 16199 raft_consensus.cc:2376] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 14. Re-sending same reply.
I20260709 13:07:30.738152 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c15d8e9be8414c84912ab77b66bfb1" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:30.746459 16204 raft_consensus.cc:2468] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 10.
I20260709 13:07:30.740084 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:30.747097 16946 raft_consensus.cc:1275] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:07:30.687573 21011 raft_consensus.cc:493] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:30.742122 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:30.679697 20998 consensus_queue.cc:1048] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.057s
I20260709 13:07:30.742949 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:30.691890 21102 raft_consensus.cc:493] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:30.749426 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:30.755642 16246 leader_election.cc:304] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
W20260709 13:07:30.745215 20660 consensus_meta.cc:287] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 0.544s	user 0.013s	sys 0.000s
I20260709 13:07:30.758117 16356 raft_consensus.cc:2393] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 17: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:07:30.753629 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
W20260709 13:07:30.749550 16173 leader_election.cc:336] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 2.105s (SENT)
W20260709 13:07:30.748449 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 73568.7us
I20260709 13:07:30.760347 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:30.756886 16206 raft_consensus.cc:2393] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 14: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:07:30.750953 16201 raft_consensus.cc:2410] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:07:30.732331 20966 raft_consensus.cc:493] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:30.763391 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:30.764982 16202 raft_consensus.cc:2393] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 6: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:07:30.769312 16173 leader_election.cc:304] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:30.743719 20757 raft_consensus.cc:493] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:30.770430 16354 raft_consensus.cc:2393] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 14: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:07:30.668629 21101 consensus_queue.cc:260] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:30.750283 21011 raft_consensus.cc:3060] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:30.756268 21083 raft_consensus.cc:493] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.775131 16322 leader_election.cc:304] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:30.737128 20822 consensus_queue.cc:1048] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
W20260709 13:07:30.763550 21093 log.cc:927] Time spent T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.285s	user 0.000s	sys 0.002s
I20260709 13:07:30.780519 21104 consensus_queue.cc:1059] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.111s
I20260709 13:07:30.783912 20758 raft_consensus.cc:2749] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:30.762670 20787 raft_consensus.cc:2804] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:30.755942 21102 raft_consensus.cc:3060] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:30.787163 16320 leader_election.cc:304] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:30.791498 16352 raft_consensus.cc:2468] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 8.
I20260709 13:07:30.763283 21115 raft_consensus.cc:493] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.775066 20757 raft_consensus.cc:3060] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:07:30.797346 16914 leader_election.cc:336] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 2.115s (SENT)
W20260709 13:07:30.800844 21100 log.cc:927] Time spent T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.167s	user 0.000s	sys 0.001s
I20260709 13:07:30.805948 21010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b962ceebb5c48c1914459ae0c0eff1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:30.803531 16200 raft_consensus.cc:2955] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Committing config change with OpId 9.7: config changed from index 5 to 7, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:07:30.806650 21110 raft_consensus.cc:2804] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:30.811074 20955 raft_consensus.cc:2749] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:30.789068 20607 raft_consensus.cc:2804] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:30.818960 20607 raft_consensus.cc:493] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:30.795822 20787 raft_consensus.cc:493] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
W20260709 13:07:30.813771 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 46470.7us
W20260709 13:07:30.816780 16249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:30.816510 21115 raft_consensus.cc:515] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:30.817338 21110 raft_consensus.cc:493] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:30.796053 20660 raft_consensus.cc:2749] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:30.777122 20966 raft_consensus.cc:515] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:07:30.819447 20607 raft_consensus.cc:3060] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:30.812875 16201 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24"
dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
 from {username='slave'} at 127.0.0.1:60154
I20260709 13:07:30.838320 16201 raft_consensus.cc:493] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:30.838841 16201 raft_consensus.cc:3060] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:30.789847 21083 raft_consensus.cc:515] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:30.828451 20787 raft_consensus.cc:3060] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:30.790508 20948 consensus_queue.cc:237] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:07:30.852849 16248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:30.847024 21083 leader_election.cc:290] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:07:30.849308 21107 log.cc:927] Time spent T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63: Append to log took a long time: real 0.214s	user 0.002s	sys 0.000s
I20260709 13:07:30.849810 21017 leader_election.cc:290] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:30.828622 21110 raft_consensus.cc:3060] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:30.835553 21101 raft_consensus.cc:3060] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:07:30.859331 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:30.869772 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 114201us
I20260709 13:07:30.872532 16246 leader_election.cc:304] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
W20260709 13:07:30.888367 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 83748.8us
I20260709 13:07:30.889222 16320 leader_election.cc:304] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
W20260709 13:07:30.890493 16249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:30.865099 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 70942.7us
I20260709 13:07:30.891706 16246 leader_election.cc:304] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:07:30.893226 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 96309.8us
I20260709 13:07:30.897852 16322 leader_election.cc:304] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3
W20260709 13:07:30.894867 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 153869us
I20260709 13:07:30.905828 16246 leader_election.cc:304] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:30.911264 21008 raft_consensus.cc:515] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:30.917029 16207 raft_consensus.cc:2393] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 11: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:07:30.915454 21082 raft_consensus.cc:2804] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:30.913964 21011 raft_consensus.cc:515] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:30.919795 21011 leader_election.cc:290] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:30.917732 21082 raft_consensus.cc:493] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:30.922226 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 48810.5us
I20260709 13:07:30.895820 20943 raft_consensus.cc:2804] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:07:30.938572 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 49410.5us
I20260709 13:07:30.908651 21058 raft_consensus.cc:2749] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:07:30.938146 16246 leader_election.cc:304] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:30.923611 21070 raft_consensus.cc:493] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.928449 21082 raft_consensus.cc:3060] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:30.954761 16246 leader_election.cc:304] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:30.937307 20759 raft_consensus.cc:2804] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:30.937685 21011 raft_consensus.cc:493] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:30.935956 21087 leader_election.cc:290] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 17 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:30.988670 16202 raft_consensus.cc:1275] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:07:30.993816 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:30.954775 20811 raft_consensus.cc:2804] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:30.954130 20942 raft_consensus.cc:2804] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:30.947773 20943 raft_consensus.cc:697] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:07:30.994889 16201 raft_consensus.cc:515] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:30.996378 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:30.942263 20822 consensus_queue.cc:1048] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
W20260709 13:07:31.014299 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 87185.1us
I20260709 13:07:30.935482 21117 raft_consensus.cc:493] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:31.019804 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 162520us
I20260709 13:07:30.984916 21017 raft_consensus.cc:493] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:31.025161 20759 raft_consensus.cc:493] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:31.021878 20603 raft_consensus.cc:493] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:31.027974 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 74809.2us
I20260709 13:07:31.031544 16204 raft_consensus.cc:3060] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:31.032167 21124 raft_consensus.cc:2804] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:31.069589 16281 raft_consensus.cc:1240] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:30.966686 21070 raft_consensus.cc:515] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:31.020866 20955 raft_consensus.cc:493] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:31.080238 20955 raft_consensus.cc:515] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:31.081251 21116 raft_consensus.cc:3055] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:31.081773 21116 raft_consensus.cc:740] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:07:31.083112 16200 raft_consensus.cc:1240] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:31.043246 20759 raft_consensus.cc:3060] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:31.048003 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:31.035411 20942 raft_consensus.cc:493] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:31.049747 20603 raft_consensus.cc:515] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:31.050834 16201 leader_election.cc:290] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 14 election: Requested vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:31.056699 16280 raft_consensus.cc:1240] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:31.057826 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:07:31.058039 21123 log.cc:927] Time spent T 00000000000000000000000000000000 P 4dc6f08597514f4d85fd451b999b403e: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 13:07:31.062657 20966 leader_election.cc:290] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:31.063957 20943 consensus_queue.cc:237] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:31.032404 21119 consensus_queue.cc:1048] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 13:07:31.066459 21115 leader_election.cc:290] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:31.071909 16322 leader_election.cc:304] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:07:31.072590 16914 leader_election.cc:304] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
W20260709 13:07:31.079635 21108 log.cc:927] Time spent T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63: Append to log took a long time: real 0.329s	user 0.004s	sys 0.007s
I20260709 13:07:31.071038 20811 raft_consensus.cc:697] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 12 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:31.095448 16199 raft_consensus.cc:1275] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 13:07:31.044848 21117 raft_consensus.cc:515] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:31.095924 20973 consensus_queue.cc:1059] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:31.097219 21083 consensus_queue.cc:1048] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:31.097527 20603 leader_election.cc:290] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:31.088330 20942 raft_consensus.cc:3060] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:31.067934 21017 raft_consensus.cc:515] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:31.098929 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:31.130884 16201 raft_consensus.cc:2410] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:07:31.098891 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:31.035717 21011 raft_consensus.cc:515] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:31.079180 21013 consensus_queue.cc:1048] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:31.073881 21124 raft_consensus.cc:493] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:31.117739 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:31.141311 16281 raft_consensus.cc:3060] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:31.108915 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 113874us
W20260709 13:07:31.131601 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 59847.2us
I20260709 13:07:31.132647 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:31.145972 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
W20260709 13:07:31.145601 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 67950.7us
I20260709 13:07:31.146668 16279 raft_consensus.cc:3060] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:07:31.132936 16278 raft_consensus.cc:1275] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:07:31.133401 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c15d8e9be8414c84912ab77b66bfb1" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:31.134284 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:31.138212 16199 raft_consensus.cc:1275] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:07:31.128749 21116 consensus_queue.cc:260] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:31.149720 21116 raft_consensus.cc:3060] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:31.150363 16199 raft_consensus.cc:1240] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:07:31.151034 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:31.131974 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:31.153769 16275 raft_consensus.cc:3060] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:31.123634 21008 leader_election.cc:290] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 11 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:31.157066 16207 raft_consensus.cc:3060] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:31.147090 16173 leader_election.cc:304] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:07:31.162390 16204 raft_consensus.cc:2468] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 17.
I20260709 13:07:31.174265 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:31.175040 16204 raft_consensus.cc:2468] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 11.
I20260709 13:07:31.163533 21130 raft_consensus.cc:493] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.179821 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:31.181329 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:31.182853 16282 raft_consensus.cc:2468] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 9.
I20260709 13:07:31.183621 16208 raft_consensus.cc:1240] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 13:07:31.182461 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:31.137778 20955 leader_election.cc:290] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:31.115607 20966 consensus_queue.cc:1048] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 13:07:31.193871 16281 raft_consensus.cc:2468] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 11.
I20260709 13:07:31.199097 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:31.144618 21124 raft_consensus.cc:3060] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:31.214936 16204 raft_consensus.cc:1240] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:07:31.216619 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:31.220769 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:31.223312 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:31.227396 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:31.224324 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:31.233322 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:31.234000 16276 raft_consensus.cc:2468] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 11.
I20260709 13:07:31.239189 21105 consensus_queue.cc:1048] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:31.240262 21136 raft_consensus.cc:493] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:31.241300 21136 raft_consensus.cc:515] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:31.243700 21136 leader_election.cc:290] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:31.246412 20985 raft_consensus.cc:493] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:31.247143 20985 raft_consensus.cc:515] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:31.249109 20861 raft_consensus.cc:493] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.249667 20861 raft_consensus.cc:515] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:31.252781 21115 raft_consensus.cc:3055] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:31.253146 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:31.253484 21115 raft_consensus.cc:740] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:31.254159 16356 raft_consensus.cc:2393] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 in current term 9: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:07:31.231504 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:31.280514 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:07:31.281299 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:31.281323 16348 raft_consensus.cc:2393] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 in current term 8: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
W20260709 13:07:31.284751 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 136237us
I20260709 13:07:31.285662 16914 leader_election.cc:304] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:07:31.287824 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 140827us
I20260709 13:07:31.289094 21059 raft_consensus.cc:2749] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:31.289971 21059 raft_consensus.cc:493] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:31.290464 21059 raft_consensus.cc:515] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:31.299041 21121 raft_consensus.cc:2804] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:31.299690 21121 raft_consensus.cc:697] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [term 9 LEADER]: Becoming Leader. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:07:31.300593 21121 consensus_queue.cc:237] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:31.301517 20787 raft_consensus.cc:515] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:31.303962 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:31.304720 16357 raft_consensus.cc:2468] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 11.
I20260709 13:07:31.302944 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:31.302533 16279 raft_consensus.cc:2468] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 11.
I20260709 13:07:31.217729 20822 consensus_queue.cc:1048] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.062s
I20260709 13:07:31.295620 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:31.402110 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:31.402508 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:31.404022 16354 raft_consensus.cc:1275] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:07:31.274646 21008 raft_consensus.cc:2804] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:31.407735 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:31.407763 21008 raft_consensus.cc:697] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:07:31.405069 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:31.408872 16279 raft_consensus.cc:2468] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 12.
I20260709 13:07:31.409142 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:31.410022 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:31.410794 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:31.411191 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:31.412403 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:31.413862 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:31.415091 16356 raft_consensus.cc:2393] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 in current term 9: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:07:31.415091 16349 raft_consensus.cc:1275] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:07:31.417852 16276 raft_consensus.cc:2410] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:07:31.420871 16352 raft_consensus.cc:1275] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:07:31.422359 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:31.423120 16348 raft_consensus.cc:2468] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 10.
I20260709 13:07:31.423702 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: true dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:07:31.424345 16947 raft_consensus.cc:3060] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:07:31.423720 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 238482us
I20260709 13:07:31.302596 20811 consensus_queue.cc:237] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:31.279913 21128 raft_consensus.cc:2804] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:07:31.435173 16249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:31.194854 21130 raft_consensus.cc:515] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:31.438836 16946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:31.437309 16281 raft_consensus.cc:2410] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
W20260709 13:07:31.444515 16247 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:31.446055 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:07:31.458346 16249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:31.451496 16352 raft_consensus.cc:1275] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:07:31.458084 16348 raft_consensus.cc:1275] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:07:31.462453 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:31.462877 21153 consensus_queue.cc:1048] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:07:31.464637 16350 raft_consensus.cc:1240] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 5. Current term is 6. Ops: []
I20260709 13:07:31.464712 21153 consensus_queue.cc:1048] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:07:31.463240 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:31.466982 20787 leader_election.cc:290] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:31.467694 20787 consensus_queue.cc:1059] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:31.468582 20787 raft_consensus.cc:3055] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:31.468932 20787 raft_consensus.cc:740] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:07:31.472123 16349 raft_consensus.cc:1275] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
W20260709 13:07:31.489368 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:31.469883 20787 consensus_queue.cc:260] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:31.510253 16946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:07:31.439016 21128 raft_consensus.cc:493] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:31.515862 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:31.516772 16352 raft_consensus.cc:2393] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 9: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:07:31.521209 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bc3c8ff9b84838a2664335d7e1582b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:31.524056 16279 raft_consensus.cc:2468] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 6.
I20260709 13:07:31.526608 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:31.527446 16349 raft_consensus.cc:3060] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:31.522778 16320 leader_election.cc:304] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:31.528855 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:31.526196 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:31.534735 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:31.535640 16203 raft_consensus.cc:2393] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 12: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:07:31.537385 16350 raft_consensus.cc:2393] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 9: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:07:31.539562 16912 leader_election.cc:304] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
W20260709 13:07:31.562176 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 76737.9us
I20260709 13:07:31.404022 21115 consensus_queue.cc:260] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:31.519841 21128 raft_consensus.cc:3060] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:31.598404 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:31.601337 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:31.583906 16279 raft_consensus.cc:2955] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Committing config change with OpId 9.7: config changed from index 5 to 7, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:07:31.526108 16941 raft_consensus.cc:2955] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Committing config change with OpId 9.7: config changed from index 5 to 7, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
W20260709 13:07:31.632750 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 140227us
I20260709 13:07:31.634555 16350 raft_consensus.cc:1275] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:07:31.198252 21118 consensus_queue.cc:1175] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "0aea40d6e4374085a2e38a70a71f63e3" responder_term: 12 status { last_received { term: 10 index: 10 } last_committed_idx: 10 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 11. Current term is 12. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:07:31.596796 20948 raft_consensus.cc:2804] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:07:31.583106 21011 leader_election.cc:290] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:31.602511 20787 raft_consensus.cc:3060] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:31.535918 21058 consensus_queue.cc:1048] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.105s
W20260709 13:07:31.654825 16248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:31.671991 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:31.639956 21087 raft_consensus.cc:493] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.673570 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:31.673390 21087 raft_consensus.cc:515] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:31.674806 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:31.674935 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:31.675906 16348 raft_consensus.cc:2410] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for term 13 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:07:31.687009 21117 leader_election.cc:290] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:31.687194 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:31.690030 21149 raft_consensus.cc:493] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.690816 16350 raft_consensus.cc:1275] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:07:31.690627 21149 raft_consensus.cc:515] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:07:31.692999 16913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:31.694692 21131 raft_consensus.cc:493] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.695463 21131 raft_consensus.cc:515] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:07:31.698910 21145 log.cc:927] Time spent T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 13:07:31.693050 21137 raft_consensus.cc:493] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.702970 21137 raft_consensus.cc:515] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:31.682966 20948 raft_consensus.cc:697] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 17 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:31.632483 21138 consensus_queue.cc:1059] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.520s
I20260709 13:07:31.753417 21117 raft_consensus.cc:493] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:31.766371 21117 raft_consensus.cc:515] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:31.747838 21148 consensus_queue.cc:1048] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 13:07:31.768126 21109 raft_consensus.cc:493] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.768752 21109 raft_consensus.cc:515] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:31.591228 21008 consensus_queue.cc:237] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:31.748164 21153 raft_consensus.cc:2804] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:31.756183 20948 consensus_queue.cc:237] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:31.795718 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c15d8e9be8414c84912ab77b66bfb1" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:31.747829 21058 consensus_queue.cc:1048] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 13:07:31.829742 21159 raft_consensus.cc:493] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:31.917366 21159 raft_consensus.cc:515] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:31.782948 21059 leader_election.cc:290] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:31.793637 21153 raft_consensus.cc:493] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:31.958349 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:31.945046 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:31.953856 21153 raft_consensus.cc:3060] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:32.101257 21011 raft_consensus.cc:493] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.126166 21011 raft_consensus.cc:515] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:32.122901 20861 leader_election.cc:290] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:32.134217 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:07:32.300212 16913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:32.308751 16351 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41832 (request call id 2234) took 1811 ms (client timeout 1576 ms). Trace:
W20260709 13:07:32.309497 16351 rpcz_store.cc:269] 0709 13:07:30.497219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:30.500282 (+  3063us) service_pool.cc:224] Handling call
0709 13:07:32.132676 (+1632394us) spinlock_profiling.cc:243] Waited 946 ms on lock 0x7b5400019fd4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:07:32.308650 (+175974us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2174995712}
I20260709 13:07:32.347031 16281 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45210 (request call id 2391) took 1157 ms. Trace:
I20260709 13:07:32.347640 16281 rpcz_store.cc:276] 0709 13:07:31.153251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:31.227033 (+ 73782us) service_pool.cc:224] Handling call
0709 13:07:32.136844 (+909811us) spinlock_profiling.cc:243] Waited 204 ms on lock 0x7b54000028d4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:07:32.310831 (+173987us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":468870912}
I20260709 13:07:32.351506 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:07:32.353160 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 642776us
I20260709 13:07:32.365463 20920 consensus_queue.cc:1048] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:32.381848 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:07:32.378580 20990 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.777s	user 0.019s	sys 0.033s
W20260709 13:07:32.383297 20990 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.799s	user 0.019s	sys 0.033s
W20260709 13:07:32.384120 21102 consensus_meta.cc:287] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3: Time spent flushing consensus metadata: real 1.574s	user 0.024s	sys 0.006s
I20260709 13:07:32.384662 21102 raft_consensus.cc:515] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:32.386359 16283 raft_consensus.cc:2393] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 in current term 13: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:07:32.388386 21117 leader_election.cc:290] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:07:32.404700 20757 consensus_meta.cc:287] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63: Time spent flushing consensus metadata: real 1.576s	user 0.008s	sys 0.013s
I20260709 13:07:32.405216 21115 raft_consensus.cc:3060] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:32.406922 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:32.375733 20489 raft_consensus.cc:1064] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3: attempting to promote NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 to VOTER
I20260709 13:07:32.408555 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:32.412056 16353 raft_consensus.cc:2393] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 12: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
W20260709 13:07:32.415663 16279 consensus_meta.cc:287] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3: Time spent flushing consensus metadata: real 0.772s	user 0.009s	sys 0.032s
I20260709 13:07:32.419471 16351 raft_consensus.cc:1275] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 9. (term mismatch)
W20260709 13:07:32.420039 16941 consensus_meta.cc:287] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63: Time spent flushing consensus metadata: real 0.769s	user 0.029s	sys 0.010s
I20260709 13:07:32.420104 16351 pending_rounds.cc:85] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e: Aborting all ops after (but not including) 8
W20260709 13:07:32.420514 16247 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.935s	user 0.005s	sys 0.013s
I20260709 13:07:32.420735 16351 pending_rounds.cc:107] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e: Aborting uncommitted NO_OP operation due to leader change: 17.9
W20260709 13:07:32.421062 16247 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.936s	user 0.005s	sys 0.013s
I20260709 13:07:32.421446 16351 raft_consensus.cc:2889] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:32.432343 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:32.411330 20985 leader_election.cc:290] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:32.441998 16348 raft_consensus.cc:1275] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:07:32.446030 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:07:32.443768 16199 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.755s	user 0.012s	sys 0.013s
I20260709 13:07:32.432821 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:32.447024 16355 raft_consensus.cc:2468] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 10.
W20260709 13:07:32.447516 16199 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.759s	user 0.012s	sys 0.013s
I20260709 13:07:32.411545 21017 leader_election.cc:290] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:32.413643 21070 leader_election.cc:290] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:07:32.435052 21110 consensus_meta.cc:287] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 1.569s	user 0.018s	sys 0.013s
W20260709 13:07:32.415867 20489 raft_consensus.cc:1068] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3: Unable to promote non-voter 1109f76a0b7b443a84c0327c8707bc63: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:07:32.405427 20757 raft_consensus.cc:515] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:32.465665 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:07:32.457993 16912 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.804s	user 0.003s	sys 0.028s
W20260709 13:07:32.466765 16912 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.823s	user 0.004s	sys 0.029s
W20260709 13:07:32.429751 16947 consensus_meta.cc:287] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63: Time spent flushing consensus metadata: real 0.994s	user 0.018s	sys 0.011s
W20260709 13:07:32.467885 16207 consensus_meta.cc:287] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f: Time spent flushing consensus metadata: real 1.295s	user 0.015s	sys 0.007s
I20260709 13:07:32.470883 16207 raft_consensus.cc:1275] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:07:32.469084 16947 raft_consensus.cc:2468] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 14.
W20260709 13:07:32.436146 20811 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.694s	user 0.009s	sys 0.009s
W20260709 13:07:32.441814 21121 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.665s	user 0.004s	sys 0.016s
I20260709 13:07:32.466365 16351 raft_consensus.cc:2468] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 12.
W20260709 13:07:32.467322 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 927813us
W20260709 13:07:32.450361 16200 consensus_meta.cc:287] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f: Time spent flushing consensus metadata: real 0.921s	user 0.011s	sys 0.018s
I20260709 13:07:32.473222 16274 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42740 (request call id 849) took 1407 ms. Trace:
I20260709 13:07:32.480963 16200 raft_consensus.cc:2468] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 9.
I20260709 13:07:32.489828 16947 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35106 (request call id 837) took 1049 ms. Trace:
W20260709 13:07:32.501778 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:32.458396 21157 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.628s	user 0.013s	sys 0.012s
I20260709 13:07:32.490483 16947 rpcz_store.cc:276] 0709 13:07:31.423261 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:31.423430 (+   169us) service_pool.cc:224] Handling call
0709 13:07:32.472741 (+1049311us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:32.460896 21017 raft_consensus.cc:493] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:32.473080 20811 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.731s	user 0.010s	sys 0.009s
I20260709 13:07:32.534925 16949 raft_consensus.cc:2393] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 12: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
W20260709 13:07:32.478380 21121 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.710s	user 0.004s	sys 0.017s
I20260709 13:07:32.468386 21087 leader_election.cc:290] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:32.474013 21011 leader_election.cc:290] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:32.479389 16274 rpcz_store.cc:276] 0709 13:07:31.060401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:31.062731 (+  2330us) service_pool.cc:224] Handling call
0709 13:07:31.063165 (+   434us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:31.089126 (+ 25961us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:31.089164 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:31.115985 (+ 26821us) log.cc:844] Serialized 26 byte log entry
0709 13:07:31.422534 (+306549us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:31.427522 (+  4988us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:31.427643 (+   121us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:32.408124 (+980481us) spinlock_profiling.cc:243] Waited 28.6 ms on lock 0x7b24002a6f08. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361c224db1 00007f361c2229c4 00007f361c220acb 00007f361c3dbdc9 00007f361c3dba55 00007f361c3dafb0 00007f361f051488 00007f361f051be8 00007f361f029398 00007f361f02476a 00007f361f023bb6
0709 13:07:32.455025 (+ 46901us) raft_consensus.cc:1685] finished
0709 13:07:32.455059 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:32.468135 (+ 13076us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10201,"raft.queue_time_us":25793,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":6350,"spinlock_wait_cycles":65741056,"thread_start_us":248017,"threads_started":1,"wal-append.queue_time_us":317021}
W20260709 13:07:32.544693 21157 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.715s	user 0.019s	sys 0.014s
W20260709 13:07:32.536284 21158 log.cc:927] Time spent T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.157s	user 0.000s	sys 0.001s
I20260709 13:07:32.483966 21131 leader_election.cc:290] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:32.471710 21130 leader_election.cc:290] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:07:32.555716 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 452950us
I20260709 13:07:32.468461 21110 raft_consensus.cc:515] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:32.540416 21137 leader_election.cc:290] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:32.517832 21138 raft_consensus.cc:493] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:32.478636 21159 leader_election.cc:290] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:07:32.461531 20943 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.701s	user 0.016s	sys 0.010s
W20260709 13:07:32.547827 16914 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.131s	user 0.022s	sys 0.040s
I20260709 13:07:32.552577 21149 leader_election.cc:290] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:32.548659 21017 raft_consensus.cc:515] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:07:32.598256 16914 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.182s	user 0.023s	sys 0.040s
I20260709 13:07:32.559435 21011 raft_consensus.cc:493] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
W20260709 13:07:32.571678 16320 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.043s	user 0.035s	sys 0.074s
I20260709 13:07:32.600812 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:32.578178 21121 raft_consensus.cc:493] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:32.605407 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:32.610791 16202 raft_consensus.cc:2393] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 in current term 14: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:07:32.600857 16352 raft_consensus.cc:2393] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 10: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
W20260709 13:07:32.589766 20943 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.833s	user 0.016s	sys 0.010s
W20260709 13:07:32.607952 16320 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.079s	user 0.036s	sys 0.074s
W20260709 13:07:32.621922 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 1.09919e+06us
W20260709 13:07:32.608695 16275 consensus_meta.cc:287] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3: Time spent flushing consensus metadata: real 1.425s	user 0.027s	sys 0.014s
I20260709 13:07:32.580988 21058 raft_consensus.cc:493] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:32.628250 21058 raft_consensus.cc:515] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:07:32.634107 21082 consensus_meta.cc:287] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 1.639s	user 0.018s	sys 0.011s
I20260709 13:07:32.634793 21058 leader_election.cc:290] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:32.606374 21149 raft_consensus.cc:493] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.635691 21149 raft_consensus.cc:515] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:32.637758 21149 leader_election.cc:290] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:32.627345 20757 leader_election.cc:290] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 12 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:32.627471 16199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60154 (request call id 2785) took 1137 ms. Trace:
I20260709 13:07:32.634894 21017 leader_election.cc:290] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:32.581914 21070 raft_consensus.cc:493] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
W20260709 13:07:32.600910 20987 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.064s	user 0.010s	sys 0.051s
I20260709 13:07:32.623231 16275 raft_consensus.cc:2468] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 12.
W20260709 13:07:32.679477 16275 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45218 (request call id 2325) took 1559 ms (client timeout 1575 ms). Trace:
I20260709 13:07:32.638844 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:32.570497 20489 consensus_queue.cc:1059] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 13:07:32.638376 16199 rpcz_store.cc:276] 0709 13:07:31.490516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:31.515052 (+ 24536us) service_pool.cc:224] Handling call
0709 13:07:31.525705 (+ 10653us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:31.544861 (+ 19156us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:31.544892 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:31.638238 (+ 93346us) log.cc:844] Serialized 26 byte log entry
0709 13:07:32.448182 (+809944us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:32.448240 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:32.448333 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:32.627236 (+178903us) raft_consensus.cc:1685] finished
0709 13:07:32.627259 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:32.627389 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32821,"raft.queue_time_us":19726,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":36396,"thread_start_us":759155,"threads_started":1,"wal-append.queue_time_us":969449}
W20260709 13:07:32.670327 16349 consensus_meta.cc:287] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 1.089s	user 0.029s	sys 0.051s
W20260709 13:07:32.639286 20759 consensus_meta.cc:287] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3: Time spent flushing consensus metadata: real 1.525s	user 0.020s	sys 0.014s
W20260709 13:07:32.611480 16914 connection.cc:256] RPC call timeout handler was delayed by -1.0879499349999833s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18810000000000002s for a response
W20260709 13:07:32.679935 16275 rpcz_store.cc:269] 0709 13:07:31.120035 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:31.120180 (+   145us) service_pool.cc:224] Handling call
0709 13:07:32.679399 (+1559219us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:32.687403 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c15d8e9be8414c84912ab77b66bfb1" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:32.609952 21159 raft_consensus.cc:493] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:32.691852 16349 raft_consensus.cc:2468] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 10.
I20260709 13:07:32.697296 16349 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41830 (request call id 2388) took 1211 ms. Trace:
I20260709 13:07:32.620505 21109 leader_election.cc:290] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:32.599867 21138 raft_consensus.cc:515] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:32.697968 16349 rpcz_store.cc:276] 0709 13:07:31.486129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:31.487250 (+  1121us) service_pool.cc:224] Handling call
0709 13:07:32.697234 (+1209984us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:32.634809 21082 raft_consensus.cc:515] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:32.702209 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:07:32.692489 21101 consensus_meta.cc:287] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3: Time spent flushing consensus metadata: real 1.828s	user 0.024s	sys 0.024s
I20260709 13:07:32.710723 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:32.690264 20811 raft_consensus.cc:493] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:32.695140 21102 leader_election.cc:290] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 election: Requested vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:32.679235 21105 raft_consensus.cc:493] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
W20260709 13:07:32.686472 20987 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.158s	user 0.014s	sys 0.060s
I20260709 13:07:32.714653 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:32.728128 16204 raft_consensus.cc:2468] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 11.
I20260709 13:07:32.639122 21121 raft_consensus.cc:515] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:32.692648 21175 raft_consensus.cc:493] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.716260 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bc3c8ff9b84838a2664335d7e1582b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:32.694051 21166 raft_consensus.cc:493] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.717386 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:32.735954 16275 raft_consensus.cc:2393] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 16: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:07:32.712167 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:32.716917 16246 leader_election.cc:304] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
W20260709 13:07:32.706029 20942 consensus_meta.cc:287] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3: Time spent flushing consensus metadata: real 1.528s	user 0.020s	sys 0.010s
W20260709 13:07:32.703348 20607 consensus_meta.cc:287] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3: Time spent flushing consensus metadata: real 1.840s	user 0.022s	sys 0.032s
W20260709 13:07:32.713160 21116 consensus_meta.cc:287] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63: Time spent flushing consensus metadata: real 1.563s	user 0.010s	sys 0.019s
I20260709 13:07:32.680130 21070 raft_consensus.cc:515] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:32.679478 21011 raft_consensus.cc:515] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:32.732227 16356 raft_consensus.cc:2368] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 10. Current term is 11.
I20260709 13:07:32.713845 21087 raft_consensus.cc:493] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.697904 20759 raft_consensus.cc:515] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:32.717976 21148 raft_consensus.cc:493] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:32.742090 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:32.742528 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:32.747967 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:32.702730 21159 raft_consensus.cc:515] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:32.747361 16280 raft_consensus.cc:2468] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 6.
I20260709 13:07:32.734315 21121 leader_election.cc:290] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:07:32.761534 16914 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 1.544s (SENT) [suppressed 18 similar messages]
I20260709 13:07:32.786826 16349 raft_consensus.cc:2468] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 11.
I20260709 13:07:32.740667 21149 raft_consensus.cc:3055] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:07:32.790613 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:07:32.749029 21128 consensus_meta.cc:287] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 1.114s	user 0.007s	sys 0.022s
W20260709 13:07:32.811113 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 96805.7us
I20260709 13:07:32.817806 16278 raft_consensus.cc:2393] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 10: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
W20260709 13:07:32.818066 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 418942us
I20260709 13:07:32.746364 20489 raft_consensus.cc:493] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:32.820660 16172 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.004s	sys 0.006s
I20260709 13:07:32.739809 21166 raft_consensus.cc:515] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:07:32.823427 16172 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.520s	user 0.004s	sys 0.006s
I20260709 13:07:32.772629 20757 raft_consensus.cc:493] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:32.828166 16248 leader_election.cc:336] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 1.682s (SENT)
I20260709 13:07:32.818753 21176 raft_consensus.cc:493] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:32.745134 20607 raft_consensus.cc:515] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:32.739106 21105 raft_consensus.cc:515] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:32.819038 21102 raft_consensus.cc:2804] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:32.813566 21149 raft_consensus.cc:740] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:07:32.836790 16948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:32.739174 20811 raft_consensus.cc:515] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:07:32.848839 16248 leader_election.cc:336] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 1.860s (SENT)
W20260709 13:07:32.833691 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 200557us
I20260709 13:07:32.850499 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:07:32.850972 16946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:32.826470 21130 raft_consensus.cc:493] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:32.856663 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:32.741070 21175 raft_consensus.cc:515] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:32.768716 21087 raft_consensus.cc:515] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:32.745627 20942 raft_consensus.cc:515] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:32.860456 16947 raft_consensus.cc:3060] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:32.861078 16946 raft_consensus.cc:2410] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:07:32.884136 16248 leader_election.cc:304] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:32.888360 16282 raft_consensus.cc:2410] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:07:32.789599 21148 raft_consensus.cc:515] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:32.898675 16351 raft_consensus.cc:1240] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 17 LEADER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 16. Current term is 17. Ops: [16.11-16.11]
W20260709 13:07:32.902722 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 141231us
W20260709 13:07:32.914415 16914 leader_election.cc:336] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 2.010s (SENT)
I20260709 13:07:32.915041 16914 leader_election.cc:304] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:32.821918 21128 raft_consensus.cc:515] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:32.916013 21121 raft_consensus.cc:2749] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:07:32.917784 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 60011.6us
I20260709 13:07:32.849527 21110 leader_election.cc:290] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 10 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:32.860417 21017 raft_consensus.cc:493] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:32.827698 20489 raft_consensus.cc:515] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:32.885375 21102 raft_consensus.cc:697] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
W20260709 13:07:32.901618 21124 consensus_meta.cc:287] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3: Time spent flushing consensus metadata: real 1.664s	user 0.019s	sys 0.005s
I20260709 13:07:32.836589 20757 raft_consensus.cc:515] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:32.863376 21155 raft_consensus.cc:493] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.848997 21008 consensus_queue.cc:1048] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.073s
I20260709 13:07:32.925858 16246 leader_election.cc:304] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:32.945251 16357 raft_consensus.cc:2393] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 in current term 11: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:07:32.950846 21102 consensus_queue.cc:237] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:32.951968 21087 leader_election.cc:290] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:32.941367 20660 raft_consensus.cc:493] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:32.949090 16277 raft_consensus.cc:2393] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 16: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:07:32.956635 16947 raft_consensus.cc:2468] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 13.
W20260709 13:07:32.987751 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 127837us
I20260709 13:07:32.989115 16941 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35122 (request call id 692) took 1494 ms. Trace:
I20260709 13:07:32.850282 21176 raft_consensus.cc:515] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:32.995545 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:32.993585 16941 rpcz_store.cc:276] 0709 13:07:31.494976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:31.495468 (+   492us) service_pool.cc:224] Handling call
0709 13:07:31.525704 (+ 30236us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:31.525978 (+   274us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:07:32.422301 (+896323us) log.cc:844] Serialized 14 byte log entry
0709 13:07:32.988067 (+565766us) log.cc:844] Serialized 14 byte log entry
0709 13:07:32.988717 (+   650us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:32.988769 (+    52us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:32.988811 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:32.988874 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:32.989023 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":664,"raft.run_cpu_time_us":255,"raft.run_wall_time_us":19525,"thread_start_us":492358,"threads_started":2}
I20260709 13:07:32.735215 20943 raft_consensus.cc:2955] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 LEADER]: Committing config change with OpId 7.6: config changed from index -1 to 6, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:07:32.901125 21130 raft_consensus.cc:515] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:07:33.004587 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 78746.6us
I20260709 13:07:33.004920 16173 leader_election.cc:304] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:07:32.975816 21187 raft_consensus.cc:493] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:32.975987 21184 raft_consensus.cc:493] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:32.994640 21082 leader_election.cc:290] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:32.943377 21017 raft_consensus.cc:515] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:32.945921 21124 raft_consensus.cc:515] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:33.008405 21183 raft_consensus.cc:493] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
W20260709 13:07:33.027936 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:33.025517 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:32.999022 20660 raft_consensus.cc:515] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:33.034039 21163 raft_consensus.cc:493] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:33.038901 21128 leader_election.cc:290] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:33.039299 21163 raft_consensus.cc:515] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:33.041426 21196 raft_consensus.cc:2749] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:33.043211 21186 raft_consensus.cc:2804] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:33.041615 20660 leader_election.cc:290] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:32.993845 21155 raft_consensus.cc:515] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:33.044184 21186 raft_consensus.cc:493] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:33.067767 16276 raft_consensus.cc:1240] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:33.074046 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:33.009975 21189 consensus_queue.cc:1048] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:07:33.077787 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:33.074266 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:33.034868 21011 leader_election.cc:290] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:33.081497 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:33.085480 16355 raft_consensus.cc:2393] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 9: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:07:33.089238 16280 raft_consensus.cc:3060] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:33.089731 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:33.091665 16204 raft_consensus.cc:1240] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:33.093158 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:33.096189 16204 raft_consensus.cc:3060] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:33.097386 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 248550us
I20260709 13:07:33.074759 21186 raft_consensus.cc:3060] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:33.152362 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
W20260709 13:07:33.093087 21134 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.711s	user 0.001s	sys 0.030s
I20260709 13:07:33.153486 16348 raft_consensus.cc:2376] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 8. Re-sending same reply.
I20260709 13:07:33.022622 21184 raft_consensus.cc:515] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:33.025991 21187 raft_consensus.cc:515] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:07:33.162595 21134 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.781s	user 0.001s	sys 0.030s
I20260709 13:07:33.037225 21183 raft_consensus.cc:515] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:33.089007 21011 consensus_queue.cc:1048] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.083s
I20260709 13:07:33.184268 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: true dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:33.161604 20942 leader_election.cc:290] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:33.200505 16204 raft_consensus.cc:2468] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 10.
I20260709 13:07:33.153759 21105 leader_election.cc:290] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:33.173830 20811 leader_election.cc:290] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:07:33.226418 21180 log.cc:927] Time spent T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:07:33.227684 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:33.155364 21109 consensus_queue.cc:1059] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.067s
I20260709 13:07:33.238492 16349 raft_consensus.cc:3060] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:33.231495 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c15d8e9be8414c84912ab77b66bfb1" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:33.243795 16204 raft_consensus.cc:3060] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:33.227315 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:33.244638 16355 raft_consensus.cc:2468] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 10.
W20260709 13:07:33.223869 21182 log.cc:927] Time spent T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.227s	user 0.001s	sys 0.000s
I20260709 13:07:33.191529 20489 leader_election.cc:290] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:33.266009 16204 raft_consensus.cc:2468] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 11.
I20260709 13:07:33.228479 21189 raft_consensus.cc:493] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:33.187592 21166 leader_election.cc:290] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:33.278478 16349 raft_consensus.cc:2468] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 11.
I20260709 13:07:33.231535 21104 raft_consensus.cc:3055] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:33.290997 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:33.292117 16204 raft_consensus.cc:2468] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 12.
W20260709 13:07:33.296576 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 285696us
I20260709 13:07:33.237726 21175 leader_election.cc:290] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:33.271641 21130 leader_election.cc:290] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:33.301607 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bc3c8ff9b84838a2664335d7e1582b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:33.311210 21217 raft_consensus.cc:493] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:33.313794 21010 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:35106 (request call id 812) took 5902 ms. Trace:
I20260709 13:07:33.337558 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:33.186861 21149 consensus_queue.cc:260] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:33.227816 21203 consensus_queue.cc:1059] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.108s
I20260709 13:07:33.368230 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:33.369315 16349 raft_consensus.cc:2468] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 6.
I20260709 13:07:33.313972 21148 leader_election.cc:290] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:33.343773 16320 leader_election.cc:304] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:33.292532 21104 raft_consensus.cc:740] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
W20260709 13:07:33.355468 21190 log.cc:927] Time spent T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:07:33.357688 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 17 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
W20260709 13:07:33.359380 21197 log.cc:927] Time spent T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.181s	user 0.000s	sys 0.001s
I20260709 13:07:33.359951 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:33.360371 21149 raft_consensus.cc:3060] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:07:33.396014 16277 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45218 (request call id 2321) took 2278 ms (client timeout 1995 ms). Trace:
W20260709 13:07:33.396586 16277 rpcz_store.cc:269] 0709 13:07:31.117683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:31.118269 (+   586us) service_pool.cc:224] Handling call
0709 13:07:33.395696 (+2277427us) spinlock_profiling.cc:243] Waited 1.78 s on lock 0x7b5400124b54. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:07:33.395891 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4097731968}
I20260709 13:07:33.381034 16204 raft_consensus.cc:2468] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 9.
I20260709 13:07:33.385469 16940 raft_consensus.cc:1240] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 13. Current term is 14. Ops: []
W20260709 13:07:33.399962 16357 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33486 (request call id 693) took 1998 ms (client timeout 1880 ms). Trace:
I20260709 13:07:33.399963 16940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
W20260709 13:07:33.400645 16357 rpcz_store.cc:269] 0709 13:07:31.401904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:31.415894 (+ 13990us) service_pool.cc:224] Handling call
0709 13:07:33.399742 (+1983848us) spinlock_profiling.cc:243] Waited 1.5 s on lock 0x7b540028c3d4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:07:33.399891 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3445437312}
I20260709 13:07:33.401641 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:33.400668 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:07:33.402456 16940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:33.402894 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:33.402925 16943 raft_consensus.cc:3060] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:33.403180 16940 raft_consensus.cc:2468] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 8.
I20260709 13:07:33.377805 21109 raft_consensus.cc:2804] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:33.405988 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:33.291167 21189 raft_consensus.cc:515] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:33.406736 16204 raft_consensus.cc:2468] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 11.
I20260709 13:07:33.407655 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:07:33.408834 16278 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45210 (request call id 2394) took 2244 ms (client timeout 2078 ms). Trace:
I20260709 13:07:33.409031 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:33.408830 16320 leader_election.cc:304] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:33.411891 16320 leader_election.cc:304] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:33.413903 16199 raft_consensus.cc:2393] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 10: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:07:33.418591 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
W20260709 13:07:33.409327 16278 rpcz_store.cc:269] 0709 13:07:31.164038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:31.198215 (+ 34177us) service_pool.cc:224] Handling call
0709 13:07:33.408609 (+2210394us) spinlock_profiling.cc:243] Waited 1.6 s on lock 0x7b540031d654. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:07:33.408758 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3680316160}
I20260709 13:07:33.398191 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:33.417891 16246 leader_election.cc:304] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:33.426090 16277 raft_consensus.cc:2410] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 for term 15 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:07:33.422823 16246 leader_election.cc:304] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:33.427942 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:33.345783 21124 leader_election.cc:290] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:33.436736 16943 raft_consensus.cc:2468] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 11.
I20260709 13:07:33.433161 16204 raft_consensus.cc:2468] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 12.
I20260709 13:07:33.423039 21166 raft_consensus.cc:493] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.430106 20920 raft_consensus.cc:2804] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:07:33.453675 16283 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42740 (request call id 848) took 2396 ms (client timeout 1597 ms). Trace:
I20260709 13:07:33.446954 16246 leader_election.cc:304] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:33.425678 21109 raft_consensus.cc:697] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 10 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:33.456048 16199 raft_consensus.cc:1240] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 13:07:33.434989 21128 raft_consensus.cc:2804] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:33.430368 20985 raft_consensus.cc:2804] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:07:33.462812 16283 rpcz_store.cc:269] 0709 13:07:31.057402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:31.057557 (+   155us) service_pool.cc:224] Handling call
0709 13:07:33.453396 (+2395839us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b540031c754. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:07:33.453564 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2982611712}
W20260709 13:07:33.445411 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 426487us
I20260709 13:07:33.348559 21217 raft_consensus.cc:515] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:33.469590 16173 leader_election.cc:304] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:07:33.470693 16350 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41830 (request call id 2409) took 1006 ms. Trace:
I20260709 13:07:33.473498 16350 rpcz_store.cc:276] 0709 13:07:32.462158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:32.462371 (+   213us) service_pool.cc:224] Handling call
0709 13:07:32.462902 (+   531us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:32.463531 (+   629us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:32.463576 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:32.464435 (+   859us) log.cc:844] Serialized 52 byte log entry
0709 13:07:32.903396 (+438961us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:07:32.987868 (+ 84472us) log.cc:844] Serialized 14 byte log entry
0709 13:07:32.988602 (+   734us) log.cc:844] Serialized 14 byte log entry
0709 13:07:32.992204 (+  3602us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:32.992278 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:33.467760 (+475482us) raft_consensus.cc:1685] finished
0709 13:07:33.467792 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:33.467996 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":178295,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":74,"raft.queue_time_us":348,"raft.run_cpu_time_us":262,"raft.run_wall_time_us":266,"thread_start_us":489978,"threads_started":2,"wal-append.queue_time_us":561007}
I20260709 13:07:33.463801 21128 raft_consensus.cc:493] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:33.470384 21181 log.cc:927] Time spent T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
W20260709 13:07:33.478644 20787 consensus_meta.cc:287] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3: Time spent flushing consensus metadata: real 1.803s	user 0.008s	sys 0.032s
W20260709 13:07:33.493233 16322 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:33.472496 21211 raft_consensus.cc:2804] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:33.470577 20985 raft_consensus.cc:697] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [term 11 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:33.458423 21166 raft_consensus.cc:515] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:33.475309 20920 raft_consensus.cc:697] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:07:33.486064 21128 raft_consensus.cc:3060] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:33.489589 16173 leader_election.cc:304] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:07:33.515357 21217 leader_election.cc:290] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:33.515939 21214 raft_consensus.cc:493] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:33.516390 21201 raft_consensus.cc:2804] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:07:33.517268 21213 log.cc:927] Time spent T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
W20260709 13:07:33.519726 21153 consensus_meta.cc:287] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63: Time spent flushing consensus metadata: real 1.411s	user 0.013s	sys 0.013s
I20260709 13:07:33.534809 21153 raft_consensus.cc:515] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:33.491155 21134 raft_consensus.cc:2804] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:33.536778 21109 consensus_queue.cc:237] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:33.537292 21153 leader_election.cc:290] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 12 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:07:33.538488 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:33.539048 20985 consensus_queue.cc:237] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:33.488323 21221 raft_consensus.cc:2804] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:33.537277 21166 leader_election.cc:290] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:33.493697 21189 leader_election.cc:290] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:33.496959 21155 leader_election.cc:290] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:33.532459 21231 raft_consensus.cc:493] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.511852 21211 raft_consensus.cc:493] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:33.511071 21187 leader_election.cc:290] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:33.548051 21189 raft_consensus.cc:2804] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:07:33.550937 21189 raft_consensus.cc:493] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:33.535446 20920 consensus_queue.cc:237] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:33.544337 21134 raft_consensus.cc:697] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:07:33.558804 21189 raft_consensus.cc:3060] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:33.544201 21214 raft_consensus.cc:515] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:33.337852 21010 rpcz_store.cc:276] 0709 13:07:27.434015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:27.434690 (+   675us) service_pool.cc:224] Handling call
0709 13:07:27.942005 (+507315us) ts_tablet_manager.cc:934] T 4b962ceebb5c48c1914459ae0c0eff1b P 1109f76a0b7b443a84c0327c8707bc63: Initiating tablet copy from peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073)
0709 13:07:30.746587 (+2804582us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:07:32.771461 (+2024874us) tablet_metadata.cc:665] Metadata flushed
0709 13:07:32.802816 (+ 31355us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:07:33.283535 (+480719us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:07:33.313154 (+ 29619us) tablet_replica.cc:206] Creating consensus instance
0709 13:07:33.313550 (+   396us) ts_tablet_manager.cc:989] Replica registered.
0709 13:07:33.313690 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":45919,"tablet-copy.queue_time_us":385069,"thread_start_us":185732,"threads_started":2}
I20260709 13:07:33.562633 21134 consensus_queue.cc:237] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:33.563447 21010 tablet_copy_client.cc:806] T 4b962ceebb5c48c1914459ae0c0eff1b P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:33.564209 21010 tablet_copy_client.cc:670] T 4b962ceebb5c48c1914459ae0c0eff1b P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:33.552317 21183 leader_election.cc:290] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:33.567744 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:33.577781 21214 leader_election.cc:290] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:33.548826 21211 raft_consensus.cc:3060] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:33.580122 21186 raft_consensus.cc:515] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:33.569865 16351 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41830 (request call id 2411) took 1094 ms. Trace:
I20260709 13:07:33.581276 16351 rpcz_store.cc:276] 0709 13:07:32.475435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:32.517168 (+ 41733us) service_pool.cc:224] Handling call
0709 13:07:32.601090 (+ 83922us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:32.912137 (+311047us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:33.569539 (+657402us) spinlock_profiling.cc:243] Waited 297 ms on lock 0x7b5400290ed4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f489e01 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6
0709 13:07:33.569772 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":683427584}
I20260709 13:07:33.571904 16207 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60138 (request call id 2558) took 2496 ms. Trace:
I20260709 13:07:33.583516 16207 rpcz_store.cc:276] 0709 13:07:31.075289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:31.075546 (+   257us) service_pool.cc:224] Handling call
0709 13:07:31.075894 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:32.471435 (+1395541us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:33.571625 (+1100190us) spinlock_profiling.cc:243] Waited 81 ms on lock 0x7b54000dc0d4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f489e01 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6
0709 13:07:33.571810 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":186264320}
I20260709 13:07:33.545081 21221 raft_consensus.cc:493] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:33.524997 21184 leader_election.cc:290] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:33.602447 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:33.611208 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 19 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:33.607384 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:33.608588 16202 raft_consensus.cc:1275] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
W20260709 13:07:33.610037 16280 consensus_meta.cc:287] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3: Time spent flushing consensus metadata: real 0.515s	user 0.010s	sys 0.000s
I20260709 13:07:33.613794 16280 raft_consensus.cc:2468] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 12.
W20260709 13:07:33.568274 21115 consensus_meta.cc:287] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 1.162s	user 0.016s	sys 0.006s
I20260709 13:07:33.615298 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:33.622817 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:33.624857 16203 raft_consensus.cc:2468] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 11.
I20260709 13:07:33.628337 16207 raft_consensus.cc:1240] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:33.488822 21104 consensus_queue.cc:260] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:33.572095 20759 leader_election.cc:290] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:33.584286 21186 leader_election.cc:290] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:33.630937 16322 leader_election.cc:304] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:33.636605 16353 raft_consensus.cc:2468] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 11.
I20260709 13:07:33.640395 16351 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d"
dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
mode: GRACEFUL
new_leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
 from {username='slave'} at 127.0.0.1:56792
I20260709 13:07:33.641100 16351 raft_consensus.cc:606] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Received request to transfer leadership to TS 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:07:33.641458 16351 raft_consensus.cc:614] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:33.611462 21221 raft_consensus.cc:3060] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:33.615067 21214 consensus_queue.cc:1048] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:07:33.638025 21166 raft_consensus.cc:493] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.644927 21232 raft_consensus.cc:493] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.637246 20973 raft_consensus.cc:493] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.643572 21082 raft_consensus.cc:493] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:33.663071 16322 leader_election.cc:304] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:07:33.670333 16322 leader_election.cc:304] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:33.672896 16322 leader_election.cc:304] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:33.663836 21109 raft_consensus.cc:2749] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:33.685407 16322 leader_election.cc:304] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:33.687335 16322 leader_election.cc:304] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:33.688265 21228 raft_consensus.cc:2804] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:33.688845 21228 raft_consensus.cc:493] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:33.689041 21233 raft_consensus.cc:2804] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:33.689249 21228 raft_consensus.cc:3060] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:33.689556 21233 raft_consensus.cc:493] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:33.690050 21233 raft_consensus.cc:3060] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:33.691589 16353 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41830 (request call id 2403) took 1277 ms. Trace:
I20260709 13:07:33.692000 16353 rpcz_store.cc:276] 0709 13:07:32.414142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:32.414438 (+   296us) service_pool.cc:224] Handling call
0709 13:07:33.691400 (+1276962us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b540026aa54. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:07:33.691525 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2731289856}
I20260709 13:07:33.704993 16322 leader_election.cc:304] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:33.707329 16322 leader_election.cc:304] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:33.684727 20603 raft_consensus.cc:2749] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:33.740965 16322 leader_election.cc:304] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:33.741357 20603 raft_consensus.cc:2749] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:33.742390 20603 raft_consensus.cc:2804] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:33.749418 21163 leader_election.cc:290] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:07:33.751525 16352 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41830 (request call id 2391) took 2201 ms (client timeout 2850 ms). Trace:
W20260709 13:07:33.752153 16352 rpcz_store.cc:269] 0709 13:07:31.550683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:31.639626 (+ 88943us) service_pool.cc:224] Handling call
0709 13:07:33.751195 (+2111569us) spinlock_profiling.cc:243] Waited 928 ms on lock 0x7b5400195854. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:07:33.751437 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2134054784}
I20260709 13:07:33.770201 21207 raft_consensus.cc:3055] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:33.770959 21207 raft_consensus.cc:740] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:07:33.774665 21070 leader_election.cc:290] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:07:33.779821 16356 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41830 (request call id 2381) took 2361 ms (client timeout 1967 ms). Trace:
W20260709 13:07:33.780431 16356 rpcz_store.cc:269] 0709 13:07:31.418412 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:31.777274 (+358862us) service_pool.cc:224] Handling call
0709 13:07:33.779563 (+2002289us) spinlock_profiling.cc:243] Waited 913 ms on lock 0x7b540032c154. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:07:33.779733 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2099732352}
W20260709 13:07:33.784332 21169 log.cc:927] Time spent T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 1.097s	user 0.002s	sys 0.000s
W20260709 13:07:33.789372 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 690995us
W20260709 13:07:33.790450 16248 leader_election.cc:336] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 1.967s (SENT)
I20260709 13:07:33.790894 16248 leader_election.cc:304] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:33.792263 21194 raft_consensus.cc:493] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.793028 20759 raft_consensus.cc:2749] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:07:33.793619 16248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:33.793979 21138 leader_election.cc:290] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:07:33.794269 16248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:33.795146 16280 raft_consensus.cc:1240] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:33.797163 16248 leader_election.cc:304] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:07:33.794235 16283 raft_consensus.cc:1240] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:33.798620 20607 leader_election.cc:290] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:33.799515 20607 raft_consensus.cc:2804] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:33.800161 20607 raft_consensus.cc:697] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:07:33.801352 20607 consensus_queue.cc:237] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:33.804164 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:33.804208 16942 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40078 (request call id 589) took 1257 ms. Trace:
I20260709 13:07:33.806015 16942 rpcz_store.cc:276] 0709 13:07:32.546191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:32.575619 (+ 29428us) service_pool.cc:224] Handling call
0709 13:07:32.629270 (+ 53651us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:32.730806 (+101536us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:32.730835 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:32.730874 (+    39us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:07:32.730916 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:33.803824 (+1072908us) spinlock_profiling.cc:243] Waited 101 ms on lock 0x7b5400431f54. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f489e01 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6
0709 13:07:33.803870 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:33.804012 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":233039744}
I20260709 13:07:33.809379 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:33.809392 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:33.810281 16275 raft_consensus.cc:2468] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 11.
I20260709 13:07:33.811010 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 17 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:07:33.811609 21162 log.cc:927] Time spent T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63: Append to log took a long time: real 1.129s	user 0.003s	sys 0.000s
I20260709 13:07:33.797709 21159 leader_election.cc:290] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:33.813470 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:33.798620 16248 leader_election.cc:304] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:33.816720 16248 leader_election.cc:304] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:07:33.815183 16949 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35122 (request call id 685) took 2643 ms (client timeout 3256 ms). Trace:
W20260709 13:07:33.817515 16949 rpcz_store.cc:269] 0709 13:07:31.172244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:31.172640 (+   396us) service_pool.cc:224] Handling call
0709 13:07:33.814897 (+2642257us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b54005401d4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:07:33.815067 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3034641280}
I20260709 13:07:33.817986 16248 leader_election.cc:304] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:33.819119 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:33.819741 20822 raft_consensus.cc:2749] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:33.820837 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:33.821892 16348 raft_consensus.cc:3055] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:33.822465 16348 raft_consensus.cc:740] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:33.823575 16348 consensus_queue.cc:260] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:33.825126 16348 raft_consensus.cc:3060] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:07:33.828780 21168 log.cc:927] Time spent T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63: Append to log took a long time: real 1.142s	user 0.005s	sys 0.000s
I20260709 13:07:33.766398 21176 leader_election.cc:290] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:33.789685 20757 leader_election.cc:290] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:33.837077 16276 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45210 (request call id 2401) took 2602 ms. Trace:
I20260709 13:07:33.837575 16276 rpcz_store.cc:276] 0709 13:07:31.234702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:31.467288 (+232586us) service_pool.cc:224] Handling call
0709 13:07:31.467644 (+   356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:33.074955 (+1607311us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:33.836711 (+761756us) spinlock_profiling.cc:243] Waited 1.6 s on lock 0x7b54001a8bd4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f489e01 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6
0709 13:07:33.836948 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3671597312}
I20260709 13:07:33.839764 21159 raft_consensus.cc:2749] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:33.855087 16320 leader_election.cc:304] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:33.858613 21161 raft_consensus.cc:2804] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:33.859076 21161 raft_consensus.cc:493] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:33.859423 21161 raft_consensus.cc:3060] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:07:33.859895 16248 leader_election.cc:336] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 1.852s (SENT)
I20260709 13:07:33.860391 16248 leader_election.cc:304] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:07:33.861673 16282 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45210 (request call id 2397) took 2690 ms (client timeout 2279 ms). Trace:
I20260709 13:07:33.862826 21087 consensus_queue.cc:1048] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:07:33.862308 16282 rpcz_store.cc:269] 0709 13:07:31.171069 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:31.206978 (+ 35909us) service_pool.cc:224] Handling call
0709 13:07:33.861372 (+2654394us) spinlock_profiling.cc:243] Waited 1.66 s on lock 0x7b540031db54. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:07:33.861566 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3826854784}
I20260709 13:07:33.872560 21101 raft_consensus.cc:493] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.873174 21101 raft_consensus.cc:515] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:33.874852 20822 raft_consensus.cc:2749] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:33.877653 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:33.879824 21161 raft_consensus.cc:515] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:33.881649 21167 raft_consensus.cc:493] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:33.889752 16276 raft_consensus.cc:1240] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:33.893597 21104 raft_consensus.cc:3060] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:33.890563 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:33.893497 20759 consensus_queue.cc:1048] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:33.897344 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:33.898983 16275 raft_consensus.cc:2468] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 12.
I20260709 13:07:33.899114 16199 raft_consensus.cc:3060] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:33.899104 21124 consensus_queue.cc:1048] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:33.900133 21149 consensus_queue.cc:1048] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:33.904964 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:33.906731 21149 consensus_queue.cc:1048] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:33.908011 16199 raft_consensus.cc:2468] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 12.
I20260709 13:07:33.909250 16248 leader_election.cc:304] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:33.909312 16320 leader_election.cc:304] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:33.910228 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:33.914505 21087 raft_consensus.cc:2804] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:33.914844 16207 raft_consensus.cc:3060] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:33.915128 21087 raft_consensus.cc:697] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 12 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:33.916169 21087 consensus_queue.cc:237] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:33.916684 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:07:33.890069 16914 leader_election.cc:336] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 1.880s (SENT)
I20260709 13:07:33.918190 16914 leader_election.cc:304] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:33.919531 21070 raft_consensus.cc:2749] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:33.921142 21105 consensus_queue.cc:1048] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:33.927333 21161 leader_election.cc:290] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 12 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:33.930959 21070 consensus_queue.cc:1048] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:33.932447 16248 leader_election.cc:304] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:33.936764 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:33.937217 16207 raft_consensus.cc:2468] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 12.
I20260709 13:07:33.937878 16277 raft_consensus.cc:2393] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 10: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:07:33.941516 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:33.942919 16280 raft_consensus.cc:2393] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 12: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:07:33.944271 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c15d8e9be8414c84912ab77b66bfb1" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:33.945467 16283 raft_consensus.cc:3060] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:07:33.945606 21159 consensus_queue.cc:1048] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:07:33.950328 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 111958us
I20260709 13:07:33.951113 21159 consensus_queue.cc:1048] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:33.953512 16248 leader_election.cc:304] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:33.955839 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 19 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:33.959600 21159 raft_consensus.cc:2764] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:07:33.967676 16200 raft_consensus.cc:1240] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:33.689327 20660 raft_consensus.cc:2749] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:07:33.977001 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 50882.4us
I20260709 13:07:33.669504 20973 raft_consensus.cc:515] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:33.668846 21166 raft_consensus.cc:515] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } }
I20260709 13:07:33.673323 21082 raft_consensus.cc:515] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:33.739868 20985 raft_consensus.cc:2749] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:33.739274 21115 raft_consensus.cc:2749] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:07:33.982080 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
W20260709 13:07:33.970691 21223 log.cc:927] Time spent T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.338s	user 0.000s	sys 0.001s
I20260709 13:07:34.012873 16279 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45210 (request call id 2406) took 2773 ms. Trace:
I20260709 13:07:33.548731 21231 raft_consensus.cc:515] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:07:34.026126 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 59025.6us
I20260709 13:07:34.027771 16248 leader_election.cc:304] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:34.010293 16912 leader_election.cc:304] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:34.026140 16279 rpcz_store.cc:276] 0709 13:07:31.239003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:31.582087 (+343084us) service_pool.cc:224] Handling call
0709 13:07:31.583368 (+  1281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:31.583735 (+   367us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:07:32.416163 (+832428us) log.cc:844] Serialized 14 byte log entry
0709 13:07:34.003429 (+1587266us) log.cc:844] Serialized 14 byte log entry
0709 13:07:34.010446 (+  7017us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:34.010507 (+    61us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:34.010603 (+    96us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:34.012643 (+  2040us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:34.012809 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":637052,"prepare.queue_time_us":729380,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":152818,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":13494,"thread_start_us":929658,"threads_started":3,"wal-append.queue_time_us":554310}
I20260709 13:07:34.059480 16283 raft_consensus.cc:2468] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 11.
I20260709 13:07:33.894889 21167 raft_consensus.cc:515] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:34.072225 16278 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42740 (request call id 856) took 1253 ms. Trace:
I20260709 13:07:33.667346 21232 raft_consensus.cc:515] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:33.792775 21194 raft_consensus.cc:515] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:07:34.062937 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 52741.2us
W20260709 13:07:34.074754 16914 leader_election.cc:336] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 1.954s (SENT)
I20260709 13:07:34.084816 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:34.085358 16946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:34.012418 21130 raft_consensus.cc:493] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:34.061048 21010 tablet_copy_client.cc:538] T 4b962ceebb5c48c1914459ae0c0eff1b P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:34.072561 21159 raft_consensus.cc:2804] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:33.772159 21207 consensus_queue.cc:260] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:34.101042 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:34.105477 16944 raft_consensus.cc:2410] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for term 13 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:07:34.101781 16948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
W20260709 13:07:34.075508 21227 log.cc:927] Time spent T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.430s	user 0.001s	sys 0.000s
I20260709 13:07:34.109239 16948 raft_consensus.cc:2393] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 12: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
W20260709 13:07:34.074441 21236 log.cc:927] Time spent T 00000000000000000000000000000000 P 4dc6f08597514f4d85fd451b999b403e: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:07:34.110817 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f022e2e63ae4461d834e476ff2666991" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:34.072693 16278 rpcz_store.cc:276] 0709 13:07:32.819005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:33.421374 (+602369us) service_pool.cc:224] Handling call
0709 13:07:33.425479 (+  4105us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:33.425718 (+   239us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:07:33.659234 (+233516us) log.cc:844] Serialized 14 byte log entry
0709 13:07:34.071823 (+412589us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:34.071881 (+    58us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:07:34.071940 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:34.072021 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:34.072164 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":223340,"prepare.queue_time_us":262227,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":1288,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":6192,"thread_start_us":421891,"threads_started":2}
I20260709 13:07:34.116681 16348 raft_consensus.cc:2468] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 14.
I20260709 13:07:34.079175 21153 raft_consensus.cc:2804] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:34.132056 21153 raft_consensus.cc:697] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [term 12 LEADER]: Becoming Leader. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
W20260709 13:07:34.132625 20811 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 14 current term: 14 is higher.
I20260709 13:07:34.132146 21207 raft_consensus.cc:3060] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:07:34.140404 16323 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.009s	sys 0.044s
W20260709 13:07:34.097297 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 354524us
W20260709 13:07:34.140890 16323 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.510s	user 0.009s	sys 0.044s
I20260709 13:07:34.141360 16322 leader_election.cc:304] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:34.148357 16944 raft_consensus.cc:1240] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:34.133386 21153 consensus_queue.cc:237] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:34.025616 21163 consensus_queue.cc:1048] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.071s
I20260709 13:07:34.064114 20757 consensus_queue.cc:1048] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.059s
I20260709 13:07:34.172533 16322 leader_election.cc:304] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:34.109884 21159 raft_consensus.cc:493] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
W20260709 13:07:34.145802 21189 consensus_meta.cc:287] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f: Time spent flushing consensus metadata: real 0.586s	user 0.006s	sys 0.004s
I20260709 13:07:34.163656 21104 raft_consensus.cc:493] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:34.108335 20603 raft_consensus.cc:697] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 6 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:34.138967 21101 leader_election.cc:290] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:34.185096 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:34.166245 21109 raft_consensus.cc:2749] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:34.183466 16322 leader_election.cc:304] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:34.104238 21130 raft_consensus.cc:515] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:34.182119 21159 raft_consensus.cc:3060] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:34.206708 21109 consensus_queue.cc:1059] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:34.208081 21109 raft_consensus.cc:2749] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:34.207856 20603 consensus_queue.cc:237] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:34.209077 21109 raft_consensus.cc:3055] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:34.209692 21109 raft_consensus.cc:740] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:34.211506 21232 leader_election.cc:290] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:34.188119 21189 raft_consensus.cc:515] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } }
I20260709 13:07:34.216571 21189 leader_election.cc:290] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 19 election: Requested vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:07:34.219632 21128 consensus_meta.cc:287] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 0.676s	user 0.008s	sys 0.001s
I20260709 13:07:34.220089 21128 raft_consensus.cc:515] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:07:34.199599 21224 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.686s	user 0.006s	sys 0.022s
I20260709 13:07:34.227782 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f022e2e63ae4461d834e476ff2666991" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:34.234220 16914 leader_election.cc:304] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:34.231792 20660 raft_consensus.cc:2749] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:34.244935 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:34.245936 16201 raft_consensus.cc:2393] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 12: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:07:34.248514 16205 raft_consensus.cc:1240] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 19 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 18. Current term is 19. Ops: []
I20260709 13:07:34.250548 21109 consensus_queue.cc:260] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:34.251230 20990 raft_consensus.cc:2749] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:34.252064 21109 raft_consensus.cc:3060] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:34.257930 21231 leader_election.cc:290] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:34.258891 16248 leader_election.cc:304] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:34.262295 21017 leader_election.cc:290] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:34.262770 21167 leader_election.cc:290] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:34.263163 21082 leader_election.cc:290] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:07:34.263648 21233 consensus_meta.cc:287] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 0.571s	user 0.005s	sys 0.001s
I20260709 13:07:34.263585 21166 leader_election.cc:290] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:34.190724 21104 raft_consensus.cc:515] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:34.201908 21115 consensus_queue.cc:1059] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.063s
I20260709 13:07:34.264822 21194 leader_election.cc:290] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:34.265018 21115 raft_consensus.cc:3055] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:07:34.265460 21115 raft_consensus.cc:740] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:34.266096 21104 leader_election.cc:290] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:07:34.231462 21228 consensus_meta.cc:287] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 0.534s	user 0.012s	sys 0.000s
I20260709 13:07:34.266323 21115 consensus_queue.cc:260] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:34.266916 21228 raft_consensus.cc:515] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:34.267747 21115 raft_consensus.cc:3060] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:34.269279 21228 leader_election.cc:290] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 12 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:07:34.264282 21211 consensus_meta.cc:287] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3: Time spent flushing consensus metadata: real 0.686s	user 0.010s	sys 0.000s
I20260709 13:07:34.222355 21128 leader_election.cc:290] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:07:34.236622 21224 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.723s	user 0.006s	sys 0.022s
I20260709 13:07:34.282469 16948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:34.284549 16948 raft_consensus.cc:2468] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 14.
I20260709 13:07:34.289762 16201 raft_consensus.cc:1275] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:07:34.290076 16248 leader_election.cc:304] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:07:34.268759 21233 raft_consensus.cc:515] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:07:34.281299 21221 consensus_meta.cc:287] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3: Time spent flushing consensus metadata: real 0.628s	user 0.011s	sys 0.000s
I20260709 13:07:34.271230 21058 raft_consensus.cc:2749] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:07:34.293898 16320 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:34.298300 16173 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.756s	user 0.006s	sys 0.011s
W20260709 13:07:34.300545 16173 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.759s	user 0.006s	sys 0.011s
I20260709 13:07:34.279798 21214 consensus_queue.cc:1059] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 13:07:34.295429 21194 raft_consensus.cc:2804] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:07:34.296648 21134 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.631s	user 0.001s	sys 0.032s
W20260709 13:07:34.300935 16274 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.008s	sys 0.009s
W20260709 13:07:34.313163 16274 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.638s	user 0.008s	sys 0.009s
W20260709 13:07:34.314275 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 824723us
I20260709 13:07:34.318614 16173 leader_election.cc:304] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:07:34.282248 21211 raft_consensus.cc:515] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:34.341081 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:34.341893 16173 leader_election.cc:304] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
W20260709 13:07:34.338660 21134 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.678s	user 0.002s	sys 0.032s
W20260709 13:07:34.297917 21200 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.614s	user 0.010s	sys 0.000s
I20260709 13:07:34.299651 21221 raft_consensus.cc:515] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:07:34.388768 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 47255.8us
I20260709 13:07:34.337430 21194 raft_consensus.cc:493] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:34.338408 21155 raft_consensus.cc:493] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:34.391152 16274 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45218 (request call id 2328) took 1679 ms. Trace:
I20260709 13:07:34.378140 21017 raft_consensus.cc:2804] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:34.392050 21165 raft_consensus.cc:2749] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:34.405652 16173 leader_election.cc:304] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:34.396374 16274 rpcz_store.cc:276] 0709 13:07:32.711847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:32.716905 (+  5058us) service_pool.cc:224] Handling call
0709 13:07:32.725761 (+  8856us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:32.834689 (+108928us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:32.834737 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:32.835306 (+   569us) log.cc:844] Serialized 26 byte log entry
0709 13:07:33.073830 (+238524us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:34.338901 (+1265071us) log.cc:844] Serialized 14 byte log entry
0709 13:07:34.390656 (+ 51755us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:34.390782 (+   126us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:34.390847 (+    65us) raft_consensus.cc:1685] finished
0709 13:07:34.390868 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:34.391067 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":659603,"prepare.queue_time_us":612739,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":28,"raft.queue_time_us":73770,"raft.run_cpu_time_us":220,"raft.run_wall_time_us":58017,"spinlock_wait_cycles":44288,"thread_start_us":906829,"threads_started":3,"wal-append.queue_time_us":434304}
I20260709 13:07:34.407979 16173 leader_election.cc:304] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
W20260709 13:07:34.393594 21200 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.715s	user 0.011s	sys 0.000s
I20260709 13:07:34.413360 16205 raft_consensus.cc:1275] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:07:34.395630 21194 raft_consensus.cc:3060] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:34.418583 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:34.445246 21189 raft_consensus.cc:493] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.445793 21189 raft_consensus.cc:515] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:34.423627 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:34.426678 21207 raft_consensus.cc:2749] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:34.426779 21233 leader_election.cc:290] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:34.428570 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:07:34.451251 21243 log.cc:927] Time spent T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:07:34.430339 20973 leader_election.cc:290] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:34.430534 21201 raft_consensus.cc:493] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:34.452069 21221 leader_election.cc:290] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:07:34.454172 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:34.465004 16281 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.869s	user 0.002s	sys 0.017s
W20260709 13:07:34.465406 16281 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.869s	user 0.002s	sys 0.017s
I20260709 13:07:34.435737 21058 raft_consensus.cc:493] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.452109 21201 raft_consensus.cc:3060] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:34.443598 21010 tablet_bootstrap.cc:492] T 4b962ceebb5c48c1914459ae0c0eff1b P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap starting.
I20260709 13:07:34.413043 21249 raft_consensus.cc:2749] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:07:34.402670 21017 raft_consensus.cc:493] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Starting leader election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:34.409957 21155 raft_consensus.cc:515] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:07:34.504338 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 320954us
I20260709 13:07:34.505069 16202 raft_consensus.cc:1275] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
W20260709 13:07:34.504499 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 270362us
I20260709 13:07:34.507381 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:34.519891 16914 leader_election.cc:304] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:07:34.524135 16200 raft_consensus.cc:2468] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 14.
I20260709 13:07:34.527655 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:34.532357 16322 leader_election.cc:304] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:34.516705 16173 leader_election.cc:304] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:07:34.541148 16914 leader_election.cc:304] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:34.542932 16914 leader_election.cc:304] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:34.546535 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:34.640563 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:34.641458 16203 raft_consensus.cc:2468] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 8.
I20260709 13:07:34.642838 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:07:34.644692 21247 log.cc:927] Time spent T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.139s	user 0.000s	sys 0.000s
I20260709 13:07:34.646073 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:34.646812 16204 raft_consensus.cc:3060] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:34.649727 21101 raft_consensus.cc:3055] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:34.650482 21101 raft_consensus.cc:740] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:07:34.651400 20603 consensus_queue.cc:1048] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:07:34.656127 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 123892us
I20260709 13:07:34.661139 16204 raft_consensus.cc:2468] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 13.
I20260709 13:07:34.662155 16322 leader_election.cc:304] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:07:34.666198 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 123373us
I20260709 13:07:34.667187 16914 leader_election.cc:304] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:34.644762 16203 raft_consensus.cc:2468] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 11.
I20260709 13:07:34.666622 16320 leader_election.cc:304] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:34.518774 21017 raft_consensus.cc:3060] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:34.670413 16320 leader_election.cc:304] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:34.674299 21159 raft_consensus.cc:515] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:34.680358 21155 leader_election.cc:290] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:34.686703 21070 raft_consensus.cc:2749] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:34.702252 16322 leader_election.cc:304] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:34.454223 21194 raft_consensus.cc:515] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:34.692777 16206 raft_consensus.cc:1275] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:07:34.690177 16204 raft_consensus.cc:1275] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:07:34.655203 20990 raft_consensus.cc:2804] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:34.513754 21058 raft_consensus.cc:515] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:34.669968 21104 raft_consensus.cc:2804] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:34.729759 21161 raft_consensus.cc:2804] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:34.746429 21161 raft_consensus.cc:697] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [term 13 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:34.693735 20811 raft_consensus.cc:2749] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:34.655509 20973 consensus_queue.cc:1059] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.098s
W20260709 13:07:34.741990 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 235918us
I20260709 13:07:34.751994 16173 leader_election.cc:304] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:07:34.689339 21233 raft_consensus.cc:2749] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:34.716270 16322 leader_election.cc:304] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:07:34.734375 16320 leader_election.cc:304] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:34.688673 21175 raft_consensus.cc:2764] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Leader election decision vote started in defunct term 11: won
I20260709 13:07:34.747753 21161 consensus_queue.cc:237] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:34.651885 21101 consensus_queue.cc:260] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:34.691416 21109 raft_consensus.cc:2804] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:34.733151 20990 raft_consensus.cc:493] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:34.733668 21115 raft_consensus.cc:2749] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:34.759809 16322 leader_election.cc:304] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:07:34.751945 21070 raft_consensus.cc:2749] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:34.773633 20990 raft_consensus.cc:3060] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:34.774228 21166 raft_consensus.cc:2749] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:34.775868 16322 leader_election.cc:304] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:07:34.778146 16246 leader_election.cc:304] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:34.779748 21194 leader_election.cc:290] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 15 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:34.780295 21130 leader_election.cc:290] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:34.794539 16204 raft_consensus.cc:1275] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:07:34.782898 21101 raft_consensus.cc:3060] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:34.764385 20811 consensus_queue.cc:1048] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:07:34.770304 21109 raft_consensus.cc:493] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:34.760424 21231 raft_consensus.cc:2749] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:34.758724 21104 raft_consensus.cc:697] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [term 12 LEADER]: Becoming Leader. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:07:34.763257 20985 raft_consensus.cc:2804] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:34.764575 21211 leader_election.cc:290] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:34.834900 21159 leader_election.cc:290] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:34.806732 21165 consensus_queue.cc:1059] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.033s
I20260709 13:07:34.839782 21165 raft_consensus.cc:3055] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:07:34.840243 21165 raft_consensus.cc:740] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:07:34.841323 21165 consensus_queue.cc:260] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } }
I20260709 13:07:34.788103 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:34.789252 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:34.791558 16322 leader_election.cc:304] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:07:34.844499 16207 raft_consensus.cc:2468] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 11.
I20260709 13:07:34.791580 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:34.763891 21249 raft_consensus.cc:2804] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:07:34.765375 20973 raft_consensus.cc:3055] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:07:34.810828 16208 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.018s	sys 0.038s
W20260709 13:07:34.821265 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 69331.1us
W20260709 13:07:34.850533 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 59066.1us
I20260709 13:07:34.851253 16173 leader_election.cc:304] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:34.763008 20603 consensus_queue.cc:1048] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
W20260709 13:07:34.854513 16105 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55244 (request call id 131) took 15274 ms (client timeout 15000 ms). Trace:
I20260709 13:07:34.830749 21189 leader_election.cc:290] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:34.800742 21058 leader_election.cc:290] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:34.797672 21110 raft_consensus.cc:2749] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:34.830946 20920 consensus_queue.cc:1048] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:34.850342 20973 raft_consensus.cc:740] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:34.863790 20973 consensus_queue.cc:260] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:34.865355 20973 raft_consensus.cc:3060] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:34.830984 16246 leader_election.cc:304] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:34.797956 20822 raft_consensus.cc:2749] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:34.866886 21165 raft_consensus.cc:3060] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:34.867200 20822 raft_consensus.cc:2804] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:34.867720 20822 raft_consensus.cc:493] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:34.868074 20822 raft_consensus.cc:3060] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:34.832971 20985 raft_consensus.cc:493] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:34.869760 20985 raft_consensus.cc:3060] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:07:34.850646 16208 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.560s	user 0.019s	sys 0.038s
I20260709 13:07:34.829610 21214 consensus_queue.cc:1048] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:07:34.872400 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:34.820784 21109 raft_consensus.cc:3060] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:34.875527 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:34.883157 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:34.877229 16322 leader_election.cc:304] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:34.857882 21105 raft_consensus.cc:3060] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:07:34.855139 16105 rpcz_store.cc:269] 0709 13:07:19.575722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.576112 (+   390us) service_pool.cc:224] Handling call
0709 13:07:34.849757 (+15273645us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:30.781471 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:30.782269 (+   798us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:30.782318 (+    49us) write_op.cc:435] Acquired schema lock
0709 13:07:30.782336 (+    18us) tablet.cc:662] Decoding operations
0709 13:07:30.783529 (+  1193us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:30.783639 (+   110us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:30.783667 (+    28us) tablet.cc:685] Acquiring locks for 13 operations
0709 13:07:30.784885 (+  1218us) tablet.cc:701] Row locks acquired
0709 13:07:30.784936 (+    51us) write_op.cc:260] PREPARE: finished
0709 13:07:30.785135 (+   199us) write_op.cc:270] Start()
0709 13:07:30.785291 (+   156us) write_op.cc:276] Timestamp: P: 1783602450785039 usec, L: 0
0709 13:07:30.785328 (+    37us) op_driver.cc:348] REPLICATION: starting
0709 13:07:30.820239 (+ 34911us) log.cc:844] Serialized 5196 byte log entry
0709 13:07:31.801548 (+981309us) op_driver.cc:464] REPLICATION: finished
0709 13:07:32.687539 (+885991us) write_op.cc:301] APPLY: starting
0709 13:07:32.687655 (+   116us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:33.361523 (+673868us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:33.361661 (+   138us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:33.559754 (+198093us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:33.560126 (+   372us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=26,key_file_lookups=26,delta_file_lookups=26,mrs_lookups=0
0709 13:07:33.560174 (+    48us) write_op.cc:312] APPLY: finished
0709 13:07:33.560573 (+   399us) log.cc:844] Serialized 121 byte log entry
0709 13:07:33.666361 (+105788us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:33.671310 (+  4949us) write_op.cc:454] Released schema lock
0709 13:07:33.687868 (+ 16558us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:34.026658 (+338790us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:34.027558 (+   900us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3335314,"reported_tablets":23,"child_traces":[["op",{"apply.queue_time_us":857631,"apply.run_cpu_time_us":38835,"apply.run_wall_time_us":1293404,"cfile_cache_hit":54,"cfile_cache_hit_bytes":58467,"num_ops":13,"prepare.queue_time_us":182815,"prepare.run_cpu_time_us":10623,"prepare.run_wall_time_us":112100,"raft.queue_time_us":290653,"raft.run_cpu_time_us":34473,"raft.run_wall_time_us":824602,"replication_time_us":991443,"thread_start_us":1064797,"threads_started":5,"wal-append.queue_time_us":230474,"wal-append.run_cpu_time_us":57426,"wal-append.run_wall_time_us":1725924}]]}
I20260709 13:07:34.858335 21134 raft_consensus.cc:2804] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:34.899082 16206 raft_consensus.cc:2368] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 12. Current term is 13.
I20260709 13:07:34.906524 16322 leader_election.cc:304] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:07:34.909425 16248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:34.873242 21259 raft_consensus.cc:2749] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:34.876506 21249 raft_consensus.cc:697] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [term 8 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:07:34.916945 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:34.905850 21134 raft_consensus.cc:493] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:34.876950 21155 consensus_queue.cc:1048] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 13:07:34.906467 21233 raft_consensus.cc:493] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.932516 21249 consensus_queue.cc:237] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:34.933260 21233 raft_consensus.cc:515] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:34.935555 21233 leader_election.cc:290] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:07:34.942339 16174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:34.957906 16246 leader_election.cc:400] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 election: Vote denied by peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073) with higher term. Message: Invalid argument: T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 12. Current term is 13.
I20260709 13:07:34.958415 16246 leader_election.cc:403] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:07:34.927611 20920 raft_consensus.cc:1064] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3: attempting to promote NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 to VOTER
I20260709 13:07:34.927688 16103 catalog_manager.cc:5697] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f reported cstate change: term changed from 9 to 10, leader changed from 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) to e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65). New cstate: current_term: 10 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } }
W20260709 13:07:34.926680 16092 thread.cc:641] client-negotiator [worker] (thread pool) Time spent creating pthread: real 0.651s	user 0.021s	sys 0.052s
I20260709 13:07:34.950717 21259 raft_consensus.cc:2804] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:34.962754 21259 raft_consensus.cc:493] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:34.963289 21259 raft_consensus.cc:3060] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:34.963523 20920 consensus_queue.cc:237] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 7, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:34.914060 21104 consensus_queue.cc:237] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:07:34.966739 16092 thread.cc:608] client-negotiator [worker] (thread pool) Time spent starting thread: real 0.705s	user 0.021s	sys 0.053s
I20260709 13:07:34.922434 21087 raft_consensus.cc:2749] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:34.953256 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:34.951184 21134 raft_consensus.cc:3060] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:34.974942 21017 raft_consensus.cc:515] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:34.976415 16203 raft_consensus.cc:1240] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:34.979370 21200 raft_consensus.cc:3060] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:34.980064 21017 leader_election.cc:290] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 election: Requested vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:34.982000 21261 consensus_queue.cc:1059] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:34.982975 21261 raft_consensus.cc:3055] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:34.983321 21261 raft_consensus.cc:740] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:07:34.984285 21261 consensus_queue.cc:260] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:34.991230 21105 raft_consensus.cc:2749] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:34.968994 16103 catalog_manager.cc:5697] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f reported cstate change: term changed from 8 to 9, leader changed from e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) to 363bb2f744eb486f9ad726f08214c98e (127.14.180.67). New cstate: current_term: 9 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } }
I20260709 13:07:34.992590 16103 catalog_manager.cc:5697] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:34.973897 20822 raft_consensus.cc:515] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:35.010443 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:07:35.011418 16944 raft_consensus.cc:3060] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:35.013778 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
W20260709 13:07:35.019860 16248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:35.025951 16247 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:35.036108 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:35.036895 16949 raft_consensus.cc:2468] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 11.
W20260709 13:07:35.039764 16248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:35.034389 16103 catalog_manager.cc:5697] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f reported cstate change: term changed from 4 to 6, leader changed from 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) to 363bb2f744eb486f9ad726f08214c98e (127.14.180.67). New cstate: current_term: 6 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } }
I20260709 13:07:35.017678 21149 raft_consensus.cc:2749] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:34.942015 21201 raft_consensus.cc:515] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:07:35.054260 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:35.027748 21261 raft_consensus.cc:3060] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:35.029011 20985 raft_consensus.cc:515] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:35.109900 16103 catalog_manager.cc:5697] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f reported cstate change: term changed from 12 to 13, leader changed from 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) to e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65). New cstate: current_term: 13 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:35.116186 16248 leader_election.cc:304] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:35.128778 16248 leader_election.cc:304] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:35.145272 16103 catalog_manager.cc:5697] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f reported cstate change: term changed from 4 to 5, leader changed from 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) to 363bb2f744eb486f9ad726f08214c98e (127.14.180.67). New cstate: current_term: 5 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:07:35.102355 20990 raft_consensus.cc:515] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:35.155365 16948 raft_consensus.cc:1275] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:07:35.158840 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:35.160606 16199 raft_consensus.cc:3060] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:35.121984 20822 leader_election.cc:290] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 15 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:35.159119 21231 raft_consensus.cc:493] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.142889 21269 raft_consensus.cc:2804] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:35.172919 21269 raft_consensus.cc:493] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:35.173446 21269 raft_consensus.cc:3060] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:07:35.174670 21273 log.cc:927] Time spent T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:07:35.176285 21134 raft_consensus.cc:515] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:07:35.178925 21134 leader_election.cc:290] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 11 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:35.171480 21231 raft_consensus.cc:515] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:35.185593 21200 raft_consensus.cc:2749] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073) with higher term. Message: Invalid argument: T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 12. Current term is 13.
I20260709 13:07:35.187026 21231 leader_election.cc:290] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:35.162103 16103 catalog_manager.cc:5697] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } }
I20260709 13:07:35.138511 20920 raft_consensus.cc:2749] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:07:35.197834 16914 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.007s	sys 0.033s
W20260709 13:07:35.201642 16914 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.534s	user 0.007s	sys 0.033s
W20260709 13:07:35.203435 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 536283us
W20260709 13:07:35.210657 16912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:35.220957 16103 catalog_manager.cc:5697] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f reported cstate change: term changed from 7 to 8, leader changed from 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) to e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65). New cstate: current_term: 8 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:35.225936 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:07:35.231262 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 378115us
I20260709 13:07:35.232095 16173 leader_election.cc:304] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:35.189126 21109 raft_consensus.cc:515] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:35.200882 21270 raft_consensus.cc:493] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.252072 16914 leader_election.cc:304] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:07:35.252852 16247 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:35.254070 16205 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.000s	sys 0.016s
I20260709 13:07:35.201225 21105 raft_consensus.cc:493] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
W20260709 13:07:35.273571 16205 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.532s	user 0.000s	sys 0.016s
I20260709 13:07:35.276803 16283 raft_consensus.cc:1240] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:35.284291 16199 raft_consensus.cc:2468] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 15.
I20260709 13:07:35.276607 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:35.286778 16208 raft_consensus.cc:3060] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:35.291577 16944 raft_consensus.cc:2468] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 15.
I20260709 13:07:35.286214 16246 leader_election.cc:304] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:35.297868 16173 leader_election.cc:304] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:35.301219 16173 leader_election.cc:304] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:35.305085 16173 leader_election.cc:304] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:35.286566 21134 raft_consensus.cc:2804] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:35.278193 20985 leader_election.cc:290] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 12 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:35.286134 21224 raft_consensus.cc:2804] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:07:35.326365 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 419902us
I20260709 13:07:35.312398 16103 catalog_manager.cc:5697] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f reported cstate change: term changed from 7 to 10. New cstate: current_term: 10 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:35.308619 16173 leader_election.cc:304] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:35.287848 21070 raft_consensus.cc:2749] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:35.300165 21206 raft_consensus.cc:2804] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:35.303866 21201 leader_election.cc:290] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 15 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:35.328989 16103 catalog_manager.cc:5697] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } }
I20260709 13:07:35.307061 21189 raft_consensus.cc:2764] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
W20260709 13:07:35.347498 21277 log.cc:927] Time spent T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:07:35.337559 21231 raft_consensus.cc:493] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.348201 21231 raft_consensus.cc:515] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:07:35.351596 21109 leader_election.cc:290] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:35.353052 21231 leader_election.cc:290] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:35.353897 16281 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45218 (request call id 2329) took 2641 ms. Trace:
I20260709 13:07:35.354727 21206 raft_consensus.cc:697] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:07:35.327472 16322 leader_election.cc:304] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:07:35.357324 16322 leader_election.cc:304] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:07:35.343284 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:35.280114 21270 raft_consensus.cc:515] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:35.360440 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:35.361727 16356 raft_consensus.cc:1240] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:07:35.294981 21105 raft_consensus.cc:515] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:35.363101 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:35.364558 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:35.373864 16350 raft_consensus.cc:2468] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 10.
I20260709 13:07:35.370915 16348 raft_consensus.cc:2393] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 in current term 9: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:07:35.345794 16103 catalog_manager.cc:5697] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f reported cstate change: term changed from 7 to 8, leader changed from 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) to e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65). New cstate: current_term: 8 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:07:35.372601 16200 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.021s	sys 0.033s
I20260709 13:07:35.374356 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:35.375497 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:35.375733 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:07:35.376454 16200 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.591s	user 0.022s	sys 0.033s
I20260709 13:07:35.376329 16350 raft_consensus.cc:3060] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:35.296048 21259 raft_consensus.cc:515] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:35.354467 16281 rpcz_store.cc:276] 0709 13:07:32.712111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:32.716756 (+  4645us) service_pool.cc:224] Handling call
0709 13:07:32.725761 (+  9005us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:32.810103 (+ 84342us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:07:33.582339 (+772236us) spinlock_profiling.cc:243] Waited 2.92 ms on lock 0x7b1800457780. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f3625264de1 00007f36252715b1 00007f361c316c0a 00007f3625a56219 00007f361c39ea40 00007f361c3994e4 00007f361c399455 00007f3622e813c7 00007f361f4939a7 00007f361f4a30bf 00007f361f4a3038
0709 13:07:34.465770 (+883431us) log.cc:844] Serialized 14 byte log entry
0709 13:07:35.008755 (+542985us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:35.009421 (+   666us) log.cc:844] Serialized 52 byte log entry
0709 13:07:35.009557 (+   136us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:35.014910 (+  5353us) log.cc:844] Serialized 14 byte log entry
0709 13:07:35.015906 (+   996us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:35.016510 (+   604us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:35.353575 (+337065us) raft_consensus.cc:1685] finished
0709 13:07:35.353608 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:35.353816 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":85889,"prepare.queue_time_us":812870,"prepare.run_cpu_time_us":114,"prepare.run_wall_time_us":2268,"raft.queue_time_us":79772,"raft.run_cpu_time_us":438,"raft.run_wall_time_us":24585,"spinlock_wait_cycles":6755328,"thread_start_us":1241478,"threads_started":2,"wal-append.queue_time_us":755373}
I20260709 13:07:35.384217 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:35.382905 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:35.381927 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:35.387180 16357 raft_consensus.cc:2368] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 for earlier term 8. Current term is 9.
I20260709 13:07:35.388520 16354 raft_consensus.cc:1275] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:07:35.388545 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:35.387068 16353 raft_consensus.cc:2393] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 in current term 14: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:07:35.390089 16357 raft_consensus.cc:2393] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 in current term 9: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:07:35.391173 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:35.392359 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:35.324394 21175 consensus_queue.cc:1048] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.052s
I20260709 13:07:35.396445 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:35.395606 16355 raft_consensus.cc:2393] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 in current term 12: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:07:35.398198 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:35.399139 16356 raft_consensus.cc:2393] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 in current term 12: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:07:35.378404 21231 raft_consensus.cc:2804] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:35.378595 21109 raft_consensus.cc:2749] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:35.407258 16349 raft_consensus.cc:2393] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 in current term 9: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:07:35.391327 21201 raft_consensus.cc:2804] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:35.429064 16350 raft_consensus.cc:2468] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 12.
I20260709 13:07:35.415866 16208 raft_consensus.cc:2468] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 12.
I20260709 13:07:35.420719 21259 leader_election.cc:290] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:35.436383 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:35.421000 20990 leader_election.cc:290] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 13 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:35.422943 21206 consensus_queue.cc:237] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:35.424012 21231 raft_consensus.cc:697] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 11 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:35.430852 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:35.430989 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:35.440039 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:35.443504 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:35.437460 16351 raft_consensus.cc:2468] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 15.
I20260709 13:07:35.441565 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:35.443030 16353 raft_consensus.cc:2468] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 13.
I20260709 13:07:35.446301 16320 leader_election.cc:304] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:35.433530 21017 raft_consensus.cc:2764] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Leader election decision vote started in defunct term 11: won
I20260709 13:07:35.464920 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
W20260709 13:07:35.470729 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:35.471045 16353 raft_consensus.cc:2393] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 9: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:07:35.470211 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:35.442930 21201 raft_consensus.cc:697] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:07:35.483978 21105 leader_election.cc:290] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:35.486490 16205 raft_consensus.cc:1240] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:35.426962 21269 raft_consensus.cc:515] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:35.465426 21109 raft_consensus.cc:2804] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:07:35.497807 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 300621us
I20260709 13:07:35.493498 21283 raft_consensus.cc:2804] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:35.518313 21109 raft_consensus.cc:697] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 12 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:35.542593 16944 raft_consensus.cc:1275] T 540bfc4ad793452faea5b865343aacf7 P 1109f76a0b7b443a84c0327c8707bc63 [term 13 LEARNER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:07:35.523876 21283 raft_consensus.cc:697] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:07:35.553009 21109 consensus_queue.cc:237] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:07:35.561731 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 157514us
W20260709 13:07:35.563519 16914 leader_election.cc:336] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 1.544s (SENT)
I20260709 13:07:35.566699 16914 leader_election.cc:304] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:07:35.569832 21285 log.cc:927] Time spent T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.106s	user 0.000s	sys 0.001s
W20260709 13:07:35.579185 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 270664us
I20260709 13:07:35.555586 21270 leader_election.cc:290] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:07:35.591172 16248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:35.560319 21134 raft_consensus.cc:697] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
W20260709 13:07:35.601635 16914 leader_election.cc:336] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 1.597s (SENT)
I20260709 13:07:35.603272 16948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:35.603479 21270 consensus_queue.cc:1048] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:07:35.607409 21268 log.cc:927] Time spent T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.446s	user 0.004s	sys 0.001s
I20260709 13:07:35.618770 16914 leader_election.cc:304] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
W20260709 13:07:35.622592 16247 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:35.624472 21283 consensus_queue.cc:237] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:07:35.639173 21289 log.cc:927] Time spent T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 13:07:35.522647 21231 consensus_queue.cc:237] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:35.572544 21070 raft_consensus.cc:3060] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:35.601943 16248 leader_election.cc:304] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:35.544631 21201 consensus_queue.cc:237] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:07:35.645713 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 45414.1us
I20260709 13:07:35.653009 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:35.581542 16173 leader_election.cc:304] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:35.669049 16357 raft_consensus.cc:2410] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:07:35.653751 21138 raft_consensus.cc:2749] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:35.661598 21105 raft_consensus.cc:493] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.665807 16201 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60138 (request call id 2606) took 1372 ms. Trace:
W20260709 13:07:35.669063 16914 leader_election.cc:336] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 1.679s (SENT)
W20260709 13:07:35.669083 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 87669.1us
I20260709 13:07:35.672884 16173 leader_election.cc:304] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:35.672114 16201 rpcz_store.cc:276] 0709 13:07:34.293570 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:34.296284 (+  2714us) service_pool.cc:224] Handling call
0709 13:07:34.301484 (+  5200us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:34.301862 (+   378us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:34.301921 (+    59us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:34.304836 (+  2915us) log.cc:844] Serialized 26 byte log entry
0709 13:07:34.873419 (+568583us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:34.873466 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:34.873537 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:35.606680 (+733143us) spinlock_profiling.cc:243] Waited 3.59 ms on lock 0x7b4400022b4c. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361c224db1 00007f361c2c2c85 00007f361c2c36a2 00007f361f0351db 00007f361f030aaf 00007f361f02486e 00007f361f023bb6 00007f361f0237d8 00007f361f02d221 00007f361f02d1d9 00007f361f02d169
0709 13:07:35.665467 (+ 58787us) raft_consensus.cc:1685] finished
0709 13:07:35.665492 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:35.665735 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":110,"raft.run_cpu_time_us":220,"raft.run_wall_time_us":35131,"spinlock_wait_cycles":8245632,"thread_start_us":488701,"threads_started":1,"wal-append.queue_time_us":770105}
W20260709 13:07:35.673614 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 71821.6us
I20260709 13:07:35.680806 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:35.682636 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:35.683655 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:35.684962 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:35.685247 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:35.685954 16279 raft_consensus.cc:2393] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 10: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:07:35.685709 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:35.687158 16357 raft_consensus.cc:2410] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:07:35.688356 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:35.689250 16280 raft_consensus.cc:2410] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:07:35.695901 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:35.697145 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:07:35.699519 16247 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:35.676105 21252 raft_consensus.cc:2804] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:35.699290 16948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
W20260709 13:07:35.703006 16248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:35.705165 16248 leader_election.cc:336] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 1.503s (SENT)
I20260709 13:07:35.705814 16248 leader_election.cc:304] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:35.708901 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:35.667742 21269 leader_election.cc:290] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:35.716413 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:35.716563 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:07:35.720129 16947 raft_consensus.cc:3060] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:35.720240 16279 raft_consensus.cc:2393] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 12: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:07:35.721447 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:35.722286 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:35.722450 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:35.723518 16277 raft_consensus.cc:2468] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 15.
I20260709 13:07:35.678876 21214 raft_consensus.cc:2804] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:35.729724 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:35.730603 16949 raft_consensus.cc:2368] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for earlier term 14. Current term is 15.
I20260709 13:07:35.738653 16947 raft_consensus.cc:2468] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 12.
I20260709 13:07:35.730372 16357 raft_consensus.cc:2468] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 12.
I20260709 13:07:35.743832 16946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:35.744269 16948 raft_consensus.cc:1240] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:35.729157 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:35.707309 20985 raft_consensus.cc:493] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.764194 20985 raft_consensus.cc:515] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:35.741617 21295 raft_consensus.cc:3060] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:35.768251 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:35.769580 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:35.770676 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:35.748059 21214 raft_consensus.cc:697] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
W20260709 13:07:35.747529 16914 leader_election.cc:336] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 1.841s (SENT)
I20260709 13:07:35.710917 21252 raft_consensus.cc:493] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:35.772923 21214 consensus_queue.cc:237] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:35.773361 21252 raft_consensus.cc:3060] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:35.775014 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:35.689939 21105 raft_consensus.cc:515] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:35.777045 21280 raft_consensus.cc:493] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:35.777652 21280 raft_consensus.cc:515] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:35.756062 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:35.779273 16280 raft_consensus.cc:1240] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:35.779753 16281 raft_consensus.cc:2468] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 14.
I20260709 13:07:35.774219 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:07:35.758874 16173 connection.cc:256] RPC call timeout handler was delayed by -2.9569259999999531s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1593s for a response
I20260709 13:07:35.745405 21134 consensus_queue.cc:237] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:07:35.781337 16173 connection.cc:256] RPC call timeout handler was delayed by -2.9369770639999615s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18830000000000002s for a response
W20260709 13:07:35.782006 16173 connection.cc:256] RPC call timeout handler was delayed by -2.8831259999999475s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1675s for a response
I20260709 13:07:35.745963 21270 raft_consensus.cc:2749] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:07:35.782531 16173 connection.cc:256] RPC call timeout handler was delayed by -1.7311260000000175s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.29550000000000004s for a response
I20260709 13:07:35.783669 16942 raft_consensus.cc:2393] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 12: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
W20260709 13:07:35.783968 16173 connection.cc:256] RPC call timeout handler was delayed by -1.5619259999999713s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3143s for a response
I20260709 13:07:35.785948 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:35.786650 16357 raft_consensus.cc:2376] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 10. Re-sending same reply.
I20260709 13:07:35.789216 16942 raft_consensus.cc:1240] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:35.741274 21261 consensus_queue.cc:1059] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.058s
I20260709 13:07:35.800235 21261 raft_consensus.cc:3055] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:35.800585 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:35.800675 21261 raft_consensus.cc:740] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:07:35.804281 21261 consensus_queue.cc:260] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:35.806121 21261 raft_consensus.cc:3060] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:35.806900 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:35.807585 16354 raft_consensus.cc:2468] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 9.
I20260709 13:07:35.783368 21105 leader_election.cc:290] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:35.808488 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:35.802280 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:35.809270 16348 raft_consensus.cc:3060] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:35.806900 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:35.809265 16354 raft_consensus.cc:2393] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 9: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:07:35.766419 20985 leader_election.cc:290] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:35.810894 16276 raft_consensus.cc:2393] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 13: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:07:35.818233 16279 raft_consensus.cc:2468] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 19.
I20260709 13:07:35.820785 16275 raft_consensus.cc:1240] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 LEADER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:35.821425 16946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:07:35.825793 16277 raft_consensus.cc:1240] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:35.826499 16281 raft_consensus.cc:1275] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:07:35.825618 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:35.811153 16173 leader_election.cc:304] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:35.829944 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:35.836424 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:35.837767 16348 raft_consensus.cc:2468] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 13.
I20260709 13:07:35.838409 16173 leader_election.cc:304] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:35.838881 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bc3c8ff9b84838a2664335d7e1582b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:35.840648 16948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:35.846671 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:35.846803 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:35.845687 16173 leader_election.cc:400] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 14 pre-election: Vote denied by peer 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875) with higher term. Message: Invalid argument: T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for earlier term 14. Current term is 15.
I20260709 13:07:35.848290 16173 leader_election.cc:403] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:35.850690 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:07:35.855638 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:35.856701 16348 raft_consensus.cc:2393] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 14: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:07:35.857689 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:35.858973 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:35.859684 16348 raft_consensus.cc:2468] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 14.
I20260709 13:07:35.859867 16946 raft_consensus.cc:2468] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 12.
I20260709 13:07:35.860852 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:35.861560 16348 raft_consensus.cc:2376] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 13. Re-sending same reply.
I20260709 13:07:35.864763 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:35.866987 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:35.868774 16276 raft_consensus.cc:2410] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for term 17 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 13:07:35.868685 16914 leader_election.cc:304] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:35.835238 21249 raft_consensus.cc:2749] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:35.873723 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:35.887320 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:35.888154 16946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:07:35.850932 21167 consensus_queue.cc:1059] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
W20260709 13:07:35.888854 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 183750us
I20260709 13:07:35.889621 21104 raft_consensus.cc:3055] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:35.890053 21104 raft_consensus.cc:740] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:07:35.890981 21104 consensus_queue.cc:260] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:35.884122 16941 raft_consensus.cc:1240] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:35.888289 16276 raft_consensus.cc:3060] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:35.892324 21104 raft_consensus.cc:3060] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:35.900190 16276 raft_consensus.cc:2468] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 12.
I20260709 13:07:35.901294 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:35.902074 16276 raft_consensus.cc:2393] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 19: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:07:35.880017 16279 raft_consensus.cc:2468] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 13.
I20260709 13:07:35.883916 16357 raft_consensus.cc:2468] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 12.
I20260709 13:07:35.903599 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:35.850806 21298 raft_consensus.cc:3060] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:35.921857 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:35.921904 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:07:35.924113 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:35.916992 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:35.890246 21280 leader_election.cc:290] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:35.924916 16354 raft_consensus.cc:2376] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 10. Re-sending same reply.
I20260709 13:07:35.905370 21261 raft_consensus.cc:2804] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:07:35.934291 16915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:35.938432 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:35.944110 16348 raft_consensus.cc:2468] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 15.
I20260709 13:07:35.905623 21105 raft_consensus.cc:493] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.939702 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:35.947111 16276 raft_consensus.cc:3060] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:07:35.948623 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 103145us
W20260709 13:07:35.950351 16248 leader_election.cc:336] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 1.613s (SENT)
I20260709 13:07:35.949918 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:35.860059 21252 raft_consensus.cc:515] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:35.954416 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:07:35.956525 16248 leader_election.cc:336] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 1.647s (SENT)
I20260709 13:07:35.956395 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:35.958009 16348 raft_consensus.cc:2393] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 9: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:07:35.958999 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:35.932910 21249 raft_consensus.cc:3060] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:07:35.950351 21261 raft_consensus.cc:493] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:35.943085 21167 raft_consensus.cc:493] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.966058 16348 raft_consensus.cc:2393] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 12: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:07:35.973977 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:35.958185 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:35.975028 16357 raft_consensus.cc:3060] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:35.976410 16354 raft_consensus.cc:2410] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:07:35.975310 16276 raft_consensus.cc:2410] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:07:35.953025 21105 raft_consensus.cc:515] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:35.976907 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:35.972410 21261 raft_consensus.cc:3060] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:35.988050 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:35.956290 21283 consensus_queue.cc:1059] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
W20260709 13:07:36.007910 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 50093.4us
I20260709 13:07:36.009220 16173 leader_election.cc:304] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:36.019208 16357 raft_consensus.cc:2468] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 15.
I20260709 13:07:36.019897 16201 raft_consensus.cc:1240] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:36.021839 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:36.025240 21321 raft_consensus.cc:2804] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:36.026029 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:36.026883 16276 raft_consensus.cc:2376] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 12. Re-sending same reply.
I20260709 13:07:35.992103 21296 raft_consensus.cc:493] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:35.973872 21167 raft_consensus.cc:515] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:36.033679 16357 raft_consensus.cc:1275] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:07:36.028671 21283 consensus_queue.cc:1243] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer 1109f76a0b7b443a84c0327c8707bc63 log is divergent from this leader: its last log entry 11.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:07:36.042793 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:36.044366 16276 raft_consensus.cc:2393] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 12: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
W20260709 13:07:36.040315 21302 log.cc:927] Time spent T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.122s	user 0.000s	sys 0.001s
I20260709 13:07:36.042357 21295 raft_consensus.cc:2749] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:36.055316 21252 leader_election.cc:290] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:36.056756 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:36.057827 16274 raft_consensus.cc:2393] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 12: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:07:36.060262 21070 raft_consensus.cc:2749] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:36.061260 16942 raft_consensus.cc:2468] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 8.
W20260709 13:07:36.063053 21306 log.cc:927] Time spent T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
W20260709 13:07:36.067014 21309 log.cc:927] Time spent T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
W20260709 13:07:36.068583 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:36.068926 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:36.070271 16274 raft_consensus.cc:1275] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:07:36.049381 16357 raft_consensus.cc:1240] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 11 LEADER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:36.071904 21194 raft_consensus.cc:493] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.072594 21194 raft_consensus.cc:515] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:36.072999 21167 leader_election.cc:290] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:07:36.072136 21305 log.cc:927] Time spent T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
I20260709 13:07:36.033797 21296 raft_consensus.cc:515] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:36.079598 16274 raft_consensus.cc:1275] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:07:36.082020 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:07:36.076637 16248 leader_election.cc:336] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 1.798s (SENT)
I20260709 13:07:36.049163 21321 raft_consensus.cc:697] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:07:36.085253 16274 raft_consensus.cc:1240] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:36.079855 21224 raft_consensus.cc:493] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:36.078040 21194 leader_election.cc:290] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:36.090680 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:36.077371 21105 leader_election.cc:290] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:36.079434 21296 leader_election.cc:290] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:07:36.089109 16248 leader_election.cc:336] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 1.859s (SENT)
I20260709 13:07:36.097126 16274 raft_consensus.cc:1275] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 11. (term mismatch)
I20260709 13:07:36.103613 16274 pending_rounds.cc:85] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3: Aborting all ops after (but not including) 10
I20260709 13:07:36.104171 16274 pending_rounds.cc:107] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3: Aborting uncommitted NO_OP operation due to leader change: 16.11
I20260709 13:07:36.104635 16274 raft_consensus.cc:2889] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:36.102923 16248 leader_election.cc:304] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:07:36.110754 16248 leader_election.cc:336] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 1.863s (SENT)
I20260709 13:07:36.111531 16248 leader_election.cc:304] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:36.093654 21224 raft_consensus.cc:3060] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:36.114274 21105 raft_consensus.cc:2749] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:07:36.117005 21278 log.cc:927] Time spent T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.790s	user 0.001s	sys 0.002s
I20260709 13:07:36.127758 16276 raft_consensus.cc:1275] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 13:07:36.135133 16248 leader_election.cc:336] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 1.865s (SENT)
I20260709 13:07:36.135332 21105 raft_consensus.cc:2749] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:36.135926 16248 leader_election.cc:304] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:36.125707 21321 consensus_queue.cc:237] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:36.147540 21249 raft_consensus.cc:2749] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875) with higher term. Message: Invalid argument: T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for earlier term 14. Current term is 15.
I20260709 13:07:36.139434 21298 raft_consensus.cc:2749] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:36.150452 21134 raft_consensus.cc:3055] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:36.151086 21134 raft_consensus.cc:740] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:07:36.152750 21134 consensus_queue.cc:260] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:36.158659 21261 raft_consensus.cc:515] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:36.138983 21224 raft_consensus.cc:515] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:07:36.143157 21214 raft_consensus.cc:2749] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:07:36.163902 21224 leader_election.cc:290] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 14 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:36.161732 21261 leader_election.cc:290] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 14 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:36.185022 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:36.189812 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:07:36.198725 16912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:36.220309 16247 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:36.230031 16205 raft_consensus.cc:1240] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 13. Current term is 14. Ops: []
W20260709 13:07:36.238672 16247 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:36.226622 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:36.239194 16206 raft_consensus.cc:1240] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 14. Current term is 15. Ops: []
W20260709 13:07:36.230321 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 87520.8us
I20260709 13:07:36.229041 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:36.240439 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:36.237651 16208 raft_consensus.cc:1275] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:07:36.255184 16275 raft_consensus.cc:1275] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 13:07:36.258832 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 238372us
I20260709 13:07:36.197940 21224 raft_consensus.cc:493] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.265224 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:36.262241 16173 leader_election.cc:304] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:07:36.266242 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:36.269150 16199 raft_consensus.cc:2468] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 12.
I20260709 13:07:36.235883 21134 raft_consensus.cc:3060] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:36.270956 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:36.271098 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:36.271014 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:36.278190 16276 raft_consensus.cc:1240] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:36.281904 16283 raft_consensus.cc:2468] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 11.
I20260709 13:07:36.226071 21325 raft_consensus.cc:493] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:36.244194 21109 raft_consensus.cc:493] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.226097 21231 raft_consensus.cc:493] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.281893 16278 raft_consensus.cc:2468] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 14.
I20260709 13:07:36.255506 21259 raft_consensus.cc:493] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.262953 20973 raft_consensus.cc:493] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.235381 21194 consensus_queue.cc:1059] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 13:07:36.299491 16173 leader_election.cc:304] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:07:36.280820 21224 raft_consensus.cc:515] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:36.269235 21165 consensus_queue.cc:1048] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:07:36.288065 21321 raft_consensus.cc:2749] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:36.271967 21153 consensus_queue.cc:1048] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 13:07:36.320163 16173 leader_election.cc:304] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:36.326818 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:36.322324 21298 raft_consensus.cc:3060] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:36.314328 21231 raft_consensus.cc:515] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:36.297853 20973 raft_consensus.cc:515] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:36.332778 20973 leader_election.cc:290] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:36.333631 21321 raft_consensus.cc:2804] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:36.334128 21321 raft_consensus.cc:493] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:36.334510 21321 raft_consensus.cc:3060] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:36.310607 21259 raft_consensus.cc:515] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:36.365844 21259 leader_election.cc:290] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:36.368815 16173 leader_election.cc:304] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
W20260709 13:07:36.375089 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 113947us
I20260709 13:07:36.296002 21109 raft_consensus.cc:515] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:36.293833 21325 raft_consensus.cc:515] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:36.343958 20948 raft_consensus.cc:493] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:36.377728 16354 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33486 (request call id 714) took 1010 ms. Trace:
I20260709 13:07:36.381317 16173 leader_election.cc:304] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:36.390622 16246 leader_election.cc:304] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:36.393419 16281 raft_consensus.cc:1275] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:07:36.406582 16944 raft_consensus.cc:1275] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:07:36.366812 21058 raft_consensus.cc:3055] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:07:36.375597 21284 log.cc:927] Time spent T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.753s	user 0.004s	sys 0.000s
I20260709 13:07:36.416239 21261 consensus_queue.cc:1048] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:36.416239 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:36.417332 21231 leader_election.cc:290] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:36.411805 21058 raft_consensus.cc:740] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:07:36.395849 21165 consensus_queue.cc:1059] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 13:07:36.412611 20948 raft_consensus.cc:515] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:36.419067 21165 raft_consensus.cc:3055] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:36.419512 21165 raft_consensus.cc:740] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:07:36.420626 16914 leader_election.cc:304] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:07:36.420931 20948 leader_election.cc:290] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:36.414988 16202 raft_consensus.cc:1275] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:07:36.421531 21261 raft_consensus.cc:2804] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:36.378501 21249 raft_consensus.cc:2804] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:36.422042 21261 raft_consensus.cc:493] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:36.422289 21249 raft_consensus.cc:493] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:36.422508 21261 raft_consensus.cc:3060] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:36.422789 21249 raft_consensus.cc:3060] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:36.424165 16199 raft_consensus.cc:1275] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 13:07:36.426066 21332 log.cc:927] Time spent T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 13:07:36.421691 16914 leader_election.cc:304] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:36.328059 21280 consensus_queue.cc:1048] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.064s
W20260709 13:07:36.418413 16322 service_pool.cc:136] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:41830 dropped due to backpressure: service queue is full with 50 items
I20260709 13:07:36.432135 16914 leader_election.cc:304] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:36.403421 16354 rpcz_store.cc:276] 0709 13:07:35.366797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:35.991716 (+624919us) service_pool.cc:224] Handling call
0709 13:07:36.007406 (+ 15690us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:36.377241 (+369835us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:36.377290 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:36.377352 (+    62us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:36.377398 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:36.377491 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:36.377651 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":219161,"raft.queue_time_us":275557,"raft.run_cpu_time_us":217,"raft.run_wall_time_us":11130,"thread_start_us":150094,"threads_started":1}
I20260709 13:07:36.411032 21330 raft_consensus.cc:2804] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:07:36.468492 16274 raft_consensus.cc:1240] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:36.443256 21070 raft_consensus.cc:2749] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:07:36.447749 21104 raft_consensus.cc:2804] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:36.427857 20920 raft_consensus.cc:2804] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:36.395610 21189 consensus_queue.cc:1059] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.073s
W20260709 13:07:36.443591 21010 log.cc:927] Time spent T 4b962ceebb5c48c1914459ae0c0eff1b P 1109f76a0b7b443a84c0327c8707bc63: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:07:36.485046 16943 raft_consensus.cc:1275] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:07:36.395596 21200 consensus_queue.cc:1059] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.074s
I20260709 13:07:36.489385 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
W20260709 13:07:36.477291 21300 log.cc:927] Time spent T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:07:36.495747 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:36.496779 16274 raft_consensus.cc:3060] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:36.501765 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:36.429781 16322 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:41830 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41832 (request call id 2254)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41832 (request call id 2269)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41830 (request call id 2465)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41830 (request call id 2466)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41832 (request call id 2272)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33486 (request call id 721)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41830 (request call id 2467)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41830 (request call id 2464)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41830 (request call id 2468)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33486 (request call id 717)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33486 (request call id 722)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41832 (request call id 2271)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41832 (request call id 2256)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33486 (request call id 718)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33486 (request call id 723)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33486 (request call id 719)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41832 (request call id 2259)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41832 (request call id 2275)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41832 (request call id 2274)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41832 (request call id 2265)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41832 (request call id 2255)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41830 (request call id 2470)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41832 (request call id 2257)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41832 (request call id 2266)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33486 (request call id 720)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41832 (request call id 2262)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33486 (request call id 725)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41832 (request call id 2270)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41832 (request call id 2267)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41832 (request call id 2276)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41830 (request call id 2469)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41832 (request call id 2258)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41832 (request call id 2263)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33486 (request call id 724)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41830 (request call id 2444)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41830 (request call id 2445)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41830 (request call id 2447)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41830 (request call id 2448)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41830 (request call id 2449)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41830 (request call id 2457)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41830 (request call id 2459)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41832 (request call id 2260)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41832 (request call id 2261)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41832 (request call id 2264)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41832 (request call id 2268)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41832 (request call id 2273)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41832 (request call id 2277)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33486 (request call id 715)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33486 (request call id 716)
Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:51696 (request call id 0)
I20260709 13:07:36.475768 21295 raft_consensus.cc:493] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:36.481968 21252 raft_consensus.cc:493] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.485829 20920 raft_consensus.cc:493] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:36.483574 16351 raft_consensus.cc:2955] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Committing config change with OpId 7.6: config changed from index -1 to 6, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:07:36.523862 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:36.485579 21104 raft_consensus.cc:493] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:36.523336 16202 raft_consensus.cc:1275] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:07:36.528291 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:36.530828 16353 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33486 (request call id 713) took 1164 ms. Trace:
I20260709 13:07:36.485397 21175 consensus_queue.cc:1048] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 13:07:36.508953 21269 raft_consensus.cc:3055] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:36.544907 16205 raft_consensus.cc:1275] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:07:36.549790 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:36.555533 21109 leader_election.cc:290] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:07:36.548704 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 52564.8us
I20260709 13:07:36.527266 20920 raft_consensus.cc:3060] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:36.531596 16353 rpcz_store.cc:276] 0709 13:07:35.366533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:35.654801 (+288268us) service_pool.cc:224] Handling call
0709 13:07:35.655282 (+   481us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:35.671854 (+ 16572us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:35.671907 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:35.677820 (+  5913us) log.cc:844] Serialized 26 byte log entry
0709 13:07:35.956316 (+278496us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:36.040085 (+ 83769us) log.cc:844] Serialized 14 byte log entry
0709 13:07:36.530440 (+490355us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:36.530532 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:36.530603 (+    71us) raft_consensus.cc:1685] finished
0709 13:07:36.530617 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:36.530765 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":204779,"prepare.queue_time_us":65353,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":26,"raft.queue_time_us":255789,"raft.run_cpu_time_us":367,"raft.run_wall_time_us":18608,"thread_start_us":569937,"threads_started":3,"wal-append.queue_time_us":324728}
I20260709 13:07:36.526605 21104 raft_consensus.cc:3060] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:36.561563 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:36.604681 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:36.605103 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:07:36.606446 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:36.603636 16205 raft_consensus.cc:1240] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 15. Current term is 16. Ops: []
W20260709 13:07:36.607920 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 50691.6us
I20260709 13:07:36.612242 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:36.501812 21333 consensus_queue.cc:1059] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:07:36.619892 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:36.522262 21295 raft_consensus.cc:515] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:36.624234 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:36.625238 16353 raft_consensus.cc:2468] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 9.
I20260709 13:07:36.626484 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:36.525687 21252 raft_consensus.cc:515] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:36.563385 21344 raft_consensus.cc:493] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.550323 21269 raft_consensus.cc:740] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
W20260709 13:07:36.656831 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 214812us
I20260709 13:07:36.661630 21333 raft_consensus.cc:3055] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:36.663763 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:36.695051 16322 leader_election.cc:304] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:36.696134 16353 raft_consensus.cc:2410] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:07:36.636312 21330 raft_consensus.cc:697] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 19 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:07:36.603480 21201 consensus_queue.cc:1048] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.088s
I20260709 13:07:36.697630 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:07:36.665550 21323 log.cc:927] Time spent T 00000000000000000000000000000000 P 4dc6f08597514f4d85fd451b999b403e: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:07:36.700021 16353 raft_consensus.cc:2468] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 11.
I20260709 13:07:36.701248 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:36.701833 16353 raft_consensus.cc:2376] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 12. Re-sending same reply.
I20260709 13:07:36.655728 21224 leader_election.cc:290] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:36.669275 21333 raft_consensus.cc:740] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:36.668563 21134 consensus_queue.cc:1059] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 13:07:36.701251 21215 raft_consensus.cc:2749] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:36.670347 21249 raft_consensus.cc:515] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:36.666379 21344 raft_consensus.cc:515] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:36.807077 21189 consensus_queue.cc:1243] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer 0aea40d6e4374085a2e38a70a71f63e3 log is divergent from this leader: its last log entry 11.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
W20260709 13:07:36.847643 21355 log.cc:927] Time spent T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.147s	user 0.001s	sys 0.000s
I20260709 13:07:36.727478 20948 consensus_queue.cc:1059] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.115s
I20260709 13:07:36.704479 21336 consensus_queue.cc:1048] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.127s
I20260709 13:07:36.730216 21339 consensus_queue.cc:1059] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.103s
I20260709 13:07:36.821969 21325 leader_election.cc:290] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:36.874135 16350 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33486 (request call id 711) took 1508 ms. Trace:
I20260709 13:07:36.877462 16349 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41830 (request call id 2442) took 1201 ms. Trace:
I20260709 13:07:36.887483 16349 rpcz_store.cc:276] 0709 13:07:35.675688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:36.147952 (+472264us) service_pool.cc:224] Handling call
0709 13:07:36.148491 (+   539us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:36.410244 (+261753us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:36.410291 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:36.431896 (+ 21605us) log.cc:844] Serialized 26 byte log entry
0709 13:07:36.562165 (+130269us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:07:36.562191 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:36.562242 (+    51us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:36.877211 (+314969us) raft_consensus.cc:1685] finished
0709 13:07:36.877234 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:36.877395 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":130891,"raft.queue_time_us":166522,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":8249,"thread_start_us":217314,"threads_started":2,"wal-append.queue_time_us":363181}
W20260709 13:07:36.884029 21348 log.cc:927] Time spent T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.325s	user 0.001s	sys 0.000s
W20260709 13:07:36.833330 21010 log.cc:927] Time spent T 4b962ceebb5c48c1914459ae0c0eff1b P 1109f76a0b7b443a84c0327c8707bc63: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 13:07:36.885074 16350 rpcz_store.cc:276] 0709 13:07:35.366102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:35.444274 (+ 78172us) service_pool.cc:224] Handling call
0709 13:07:35.444742 (+   468us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:35.462037 (+ 17295us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:35.462089 (+    52us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:35.468897 (+  6808us) log.cc:844] Serialized 52 byte log entry
0709 13:07:35.558375 (+ 89478us) spinlock_profiling.cc:243] Waited 9.32 ms on lock 0x7b1800283000. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f3625264de1 00007f36252715b1 00007f361c37ee07 00007f36251d9ab9 00007f361c39b69b 00007f361c39993f 00007f361c39bc02 00007f361f02320b 00007f361f028d23 00007f361f0290d1 00007f361f444a0f
0709 13:07:35.836131 (+277756us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:07:35.952338 (+116207us) log.cc:844] Serialized 14 byte log entry
0709 13:07:36.374255 (+421917us) log.cc:844] Serialized 14 byte log entry
0709 13:07:36.405812 (+ 31557us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:36.873716 (+467904us) spinlock_profiling.cc:243] Waited 4.59 ms on lock 0x7b54001e78d4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f489e01 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6
0709 13:07:36.873794 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:36.873854 (+    60us) raft_consensus.cc:1685] finished
0709 13:07:36.873870 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:36.874059 (+   189us) inbound_call.cc:177] Queueing success response
0709 13:07:36.876210 (+  2151us) spinlock_profiling.cc:243] Waited 16.7 ms on lock 0x7b1800283000. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f3625264de1 00007f36252715b1 00007f361c39c3f3 00007f361c39e7c1 00007f361c39e779 00007f361c39e709 00007f361c39e6d1 00007f361c39d9cd 000000000038f354 000000000038f199 00007f361c37f83a
Metrics: {"mutex_wait_us":391640,"prepare.queue_time_us":228011,"prepare.run_cpu_time_us":119,"prepare.run_wall_time_us":3182,"raft.queue_time_us":344314,"raft.run_cpu_time_us":430,"raft.run_wall_time_us":11910,"spinlock_wait_cycles":70287360,"thread_start_us":473179,"threads_started":3,"wal-append.queue_time_us":471864}
I20260709 13:07:36.933533 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:36.934643 16349 raft_consensus.cc:2393] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 in current term 9: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:07:36.939118 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:36.940142 16349 raft_consensus.cc:2468] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 15.
I20260709 13:07:36.894739 21347 raft_consensus.cc:493] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.894486 21330 consensus_queue.cc:237] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } }
I20260709 13:07:36.967695 21339 consensus_queue.cc:1243] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer 0aea40d6e4374085a2e38a70a71f63e3 log is divergent from this leader: its last log entry 13.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:07:36.968706 21347 raft_consensus.cc:515] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:36.972396 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:36.972476 16355 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41830 (request call id 2440) took 1314 ms. Trace:
I20260709 13:07:36.986212 16354 raft_consensus.cc:2468] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 15.
W20260709 13:07:36.921619 21298 consensus_meta.cc:287] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f: Time spent flushing consensus metadata: real 0.592s	user 0.010s	sys 0.002s
I20260709 13:07:37.020220 21347 leader_election.cc:290] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:07:36.976466 21261 consensus_meta.cc:287] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63: Time spent flushing consensus metadata: real 0.553s	user 0.010s	sys 0.000s
I20260709 13:07:37.021624 21261 raft_consensus.cc:515] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:37.025245 21261 leader_election.cc:290] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 12 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:36.974351 21296 raft_consensus.cc:3055] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:37.026315 21296 raft_consensus.cc:740] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:07:37.027205 21296 consensus_queue.cc:260] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:37.028523 21296 raft_consensus.cc:3060] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:37.030336 21334 raft_consensus.cc:493] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:37.030946 21334 raft_consensus.cc:515] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:36.804234 21269 consensus_queue.cc:260] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:36.998454 16355 rpcz_store.cc:276] 0709 13:07:35.658304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:36.114528 (+456224us) service_pool.cc:224] Handling call
0709 13:07:36.114964 (+   436us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:36.259707 (+144743us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:07:36.309252 (+ 49545us) log.cc:844] Serialized 14 byte log entry
0709 13:07:36.496630 (+187378us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:36.525857 (+ 29227us) log.cc:844] Serialized 26 byte log entry
0709 13:07:36.526009 (+   152us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:07:36.526252 (+   243us) log.cc:844] Serialized 14 byte log entry
0709 13:07:36.610923 (+ 84671us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:36.611049 (+   126us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:36.972200 (+361151us) raft_consensus.cc:1685] finished
0709 13:07:36.972227 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:36.972403 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":346525,"prepare.queue_time_us":51883,"prepare.run_cpu_time_us":130,"prepare.run_wall_time_us":13683,"raft.queue_time_us":315581,"raft.run_cpu_time_us":557,"raft.run_wall_time_us":38697,"spinlock_wait_cycles":7591808,"thread_start_us":74504,"threads_started":1,"wal-append.queue_time_us":184499}
I20260709 13:07:37.056082 21339 raft_consensus.cc:493] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:37.056829 21339 raft_consensus.cc:515] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:36.981837 21058 consensus_queue.cc:260] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:07:37.073391 21295 leader_election.cc:290] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:07:37.073377 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 821255us
I20260709 13:07:37.038511 21298 raft_consensus.cc:2749] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:07:37.095510 16248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:37.066416 21329 log.cc:927] Time spent T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63: Append to log took a long time: real 0.695s	user 0.000s	sys 0.003s
W20260709 13:07:37.425724 16247 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:37.787014 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:07:37.151337 16912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:37.788055 16247 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:37.788271 16350 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41832 (request call id 2271) took 1483 ms (client timeout 1854 ms). Trace:
W20260709 13:07:37.788722 16247 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:37.788760 16350 rpcz_store.cc:269] 0709 13:07:36.304825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:36.933588 (+628763us) service_pool.cc:224] Handling call
0709 13:07:37.788135 (+854547us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:37.789685 16247 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:37.232344 16351 consensus_meta.cc:287] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 0.708s	user 0.013s	sys 0.000s
I20260709 13:07:37.786623 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:37.786060 16322 leader_election.cc:304] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:07:37.110865 16280 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.000s	sys 0.008s
W20260709 13:07:37.797883 16280 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.193s	user 0.003s	sys 0.015s
W20260709 13:07:37.735541 16348 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.100s	user 0.005s	sys 0.011s
I20260709 13:07:37.801501 16353 raft_consensus.cc:2393] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 in current term 12: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
W20260709 13:07:37.802791 16274 consensus_meta.cc:287] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3: Time spent flushing consensus metadata: real 1.305s	user 0.010s	sys 0.010s
I20260709 13:07:37.803406 16274 raft_consensus.cc:2468] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 7.
W20260709 13:07:37.804207 16274 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45218 (request call id 2355) took 1323 ms (client timeout 1583 ms). Trace:
W20260709 13:07:37.804647 16274 rpcz_store.cc:269] 0709 13:07:36.487178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:36.488441 (+  1263us) service_pool.cc:224] Handling call
0709 13:07:37.804140 (+1315699us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:37.806118 16353 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33486 (request call id 717) took 1463 ms (client timeout 1793 ms). Trace:
W20260709 13:07:37.806740 16353 rpcz_store.cc:269] 0709 13:07:36.342402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:36.702496 (+360094us) service_pool.cc:224] Handling call
0709 13:07:37.806031 (+1103535us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:37.629256 16352 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.644s	user 0.004s	sys 0.011s
W20260709 13:07:37.859040 16352 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.874s	user 0.004s	sys 0.012s
W20260709 13:07:37.868863 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:37.869493 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:07:37.870682 16353 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33486 (request call id 723) took 1503 ms (client timeout 1862 ms). Trace:
W20260709 13:07:37.871222 16353 rpcz_store.cc:269] 0709 13:07:36.366947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.869106 (+1502159us) service_pool.cc:224] Handling call
0709 13:07:37.870597 (+  1491us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:37.873848 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:37.874805 16349 raft_consensus.cc:2468] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 10.
W20260709 13:07:37.876946 16349 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33486 (request call id 718) took 1513 ms (client timeout 1852 ms). Trace:
W20260709 13:07:37.877862 16349 rpcz_store.cc:269] 0709 13:07:36.363712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.873468 (+1509756us) service_pool.cc:224] Handling call
0709 13:07:37.876847 (+  3379us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:37.711498 21104 consensus_meta.cc:287] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63: Time spent flushing consensus metadata: real 1.098s	user 0.010s	sys 0.004s
W20260709 13:07:37.567456 21308 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.199s	user 0.006s	sys 0.009s
W20260709 13:07:37.988862 21308 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.622s	user 0.007s	sys 0.012s
W20260709 13:07:37.879537 16248 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.783s	user 0.006s	sys 0.009s
W20260709 13:07:37.990885 16248 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.894s	user 0.007s	sys 0.010s
W20260709 13:07:37.991394 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 894985us
W20260709 13:07:37.992265 16248 leader_election.cc:336] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 2.072s (SENT)
W20260709 13:07:37.993476 16248 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 2.400s (SENT) [suppressed 34 similar messages]
I20260709 13:07:37.999174 21334 leader_election.cc:290] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:37.999984 21334 raft_consensus.cc:493] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:38.000394 20920 consensus_meta.cc:287] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3: Time spent flushing consensus metadata: real 1.392s	user 0.013s	sys 0.000s
I20260709 13:07:37.929349 21175 raft_consensus.cc:493] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:37.910168 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:38.009029 16353 raft_consensus.cc:2376] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 12. Re-sending same reply.
W20260709 13:07:38.009814 16353 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33486 (request call id 719) took 1644 ms (client timeout 1869 ms). Trace:
W20260709 13:07:38.010448 16353 rpcz_store.cc:269] 0709 13:07:36.365650 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.909777 (+1544127us) service_pool.cc:224] Handling call
0709 13:07:38.009728 (+ 99951us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:37.087575 21269 raft_consensus.cc:3060] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:07:37.368911 21321 consensus_meta.cc:287] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f: Time spent flushing consensus metadata: real 1.034s	user 0.007s	sys 0.006s
I20260709 13:07:37.086499 21252 leader_election.cc:290] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:07:37.119478 21341 log.cc:927] Time spent T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
W20260709 13:07:37.492456 21358 log.cc:927] Time spent T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.520s	user 0.000s	sys 0.004s
W20260709 13:07:37.170598 21010 log.cc:927] Time spent T 4b962ceebb5c48c1914459ae0c0eff1b P 1109f76a0b7b443a84c0327c8707bc63: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:07:37.337781 21349 raft_consensus.cc:3055] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:37.394313 21261 raft_consensus.cc:493] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.468564 21357 raft_consensus.cc:493] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:38.057142 21362 raft_consensus.cc:493] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.057083 21357 raft_consensus.cc:515] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:38.056739 21359 raft_consensus.cc:493] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.784229 21337 raft_consensus.cc:493] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:38.058717 21337 raft_consensus.cc:515] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:38.059769 21357 leader_election.cc:290] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:38.061126 21337 leader_election.cc:290] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:38.061640 16203 raft_consensus.cc:1240] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:38.062201 21252 raft_consensus.cc:493] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.062742 21252 raft_consensus.cc:515] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:38.063304 16200 raft_consensus.cc:1240] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:38.063566 21337 raft_consensus.cc:493] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:38.064354 21357 raft_consensus.cc:493] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.064242 21337 raft_consensus.cc:515] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:38.065007 21252 leader_election.cc:290] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:38.065059 21357 raft_consensus.cc:515] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:38.013870 21298 raft_consensus.cc:493] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:38.066860 16208 raft_consensus.cc:1275] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:07:38.063320 21359 raft_consensus.cc:515] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:38.067235 21298 raft_consensus.cc:515] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:37.885120 21058 raft_consensus.cc:3060] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:38.068337 21357 leader_election.cc:290] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:38.068903 21357 raft_consensus.cc:493] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.069324 16202 raft_consensus.cc:1240] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 6. Current term is 7. Ops: []
I20260709 13:07:38.069378 21357 raft_consensus.cc:515] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:38.069618 21261 raft_consensus.cc:515] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:38.071779 21359 leader_election.cc:290] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:07:37.689045 21206 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.573s	user 0.006s	sys 0.007s
I20260709 13:07:38.006309 20920 raft_consensus.cc:515] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:38.015496 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
W20260709 13:07:38.036461 16246 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:37.971635 21354 raft_consensus.cc:493] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.015203 21201 raft_consensus.cc:493] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:38.018004 21104 raft_consensus.cc:515] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:38.049075 21070 raft_consensus.cc:493] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.052212 21339 leader_election.cc:290] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:38.052556 16356 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41830 (request call id 2441) took 2384 ms. Trace:
W20260709 13:07:38.057475 16173 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:38.057888 21325 raft_consensus.cc:493] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:38.063416 16357 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41830 (request call id 2435) took 2457 ms. Trace:
I20260709 13:07:38.241591 16357 rpcz_store.cc:276] 0709 13:07:35.606497 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:36.076579 (+470082us) service_pool.cc:224] Handling call
0709 13:07:36.089218 (+ 12639us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:36.255289 (+166071us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:07:36.271596 (+ 16307us) log.cc:844] Serialized 14 byte log entry
0709 13:07:36.422881 (+151285us) spinlock_profiling.cc:243] Waited 4.21 ms on lock 0x7b18004908a0. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f3625264de1 00007f36252715b1 00007f361c39c3f3 00007f361c39e7c1 00007f361c39e779 00007f361c39e709 00007f361c39e6d1 00007f361c39d9cd 000000000038f354 000000000038f199 00007f361c37f83a
0709 13:07:36.475787 (+ 52906us) spinlock_profiling.cc:243] Waited 4.43 ms on lock 0x7b18004908a0. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f3625264de1 00007f36252715b1 00007f361c37ee07 00007f36251d9ab9 00007f361c39b69b 00007f361c39993f 00007f361c39bc02 00007f361f02320b 00007f361f028d23 00007f361f02923a 00007f361f493a2a
0709 13:07:36.697095 (+221308us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:36.707487 (+ 10392us) log.cc:844] Serialized 26 byte log entry
0709 13:07:36.707829 (+   342us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:36.708533 (+   704us) log.cc:844] Serialized 14 byte log entry
0709 13:07:36.708995 (+   462us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:36.709113 (+   118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:37.148134 (+439021us) spinlock_profiling.cc:243] Waited 64 ms on lock 0x7b18004908a0. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f3625264de1 00007f36252715b1 00007f361c36a2a6 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f3625264de1 00007f36252715b1 00007f361c39c3f3 00007f361c39e7c1
0709 13:07:37.360310 (+212176us) spinlock_profiling.cc:243] Waited 1.16 ms on lock 0x7b18004908a0. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f3625264de1 00007f36252715b1 00007f361c39c3f3 00007f361c39e7c1 00007f361c39e779 00007f361c39e709 00007f361c39e6d1 00007f361c39d9cd 000000000038f354 000000000038f199 00007f361c37f83a
0709 13:07:37.491481 (+131171us) spinlock_profiling.cc:243] Waited 28 ms on lock 0x7b4400022b4c. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361c224db1 00007f361c2c2c85 00007f361c2c36a2 00007f361f0351db 00007f361f030aaf 00007f361f02486e 00007f361f023bb6 00007f361f0237d8 00007f361f02d221 00007f361f02d1d9 00007f361f02d169
0709 13:07:38.063208 (+571727us) raft_consensus.cc:1685] finished
0709 13:07:38.063229 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:38.063358 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":180266,"prepare.queue_time_us":60967,"prepare.run_cpu_time_us":121,"prepare.run_wall_time_us":18511,"raft.queue_time_us":210077,"raft.run_cpu_time_us":497,"raft.run_wall_time_us":49820,"spinlock_wait_cycles":234117120,"thread_start_us":190907,"threads_started":1,"wal-append.queue_time_us":540114}
I20260709 13:07:38.065750 21252 raft_consensus.cc:493] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:37.313452 21335 raft_consensus.cc:3055] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:07:38.040714 21321 raft_consensus.cc:515] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:37.356849 21165 consensus_queue.cc:260] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:38.072187 21261 leader_election.cc:290] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:07:37.938892 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 153917us
I20260709 13:07:38.239836 16356 rpcz_store.cc:276] 0709 13:07:35.668213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:36.118570 (+450357us) service_pool.cc:224] Handling call
0709 13:07:36.118986 (+   416us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:36.268048 (+149062us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:36.268085 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:36.285854 (+ 17769us) log.cc:844] Serialized 52 byte log entry
0709 13:07:36.421647 (+135793us) spinlock_profiling.cc:243] Waited 6.43 ms on lock 0x7b4800032358. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f36243b2aa1 00007f36243a9b37 00007f36243a99ca 00007f36244a126f 00007f36244a0f37 00007f36244b555c 00007f36244b5508 00007f36244b5488 00007f36244b5443 00007f36244b46ec 00007f36233dea96
0709 13:07:36.492117 (+ 70470us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:36.520707 (+ 28590us) log.cc:844] Serialized 14 byte log entry
0709 13:07:36.521082 (+   375us) log.cc:844] Serialized 14 byte log entry
0709 13:07:36.548566 (+ 27484us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:36.548649 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:37.057858 (+509209us) spinlock_profiling.cc:243] Waited 3.97 ms on lock 0x7b1800269c80. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f3625264de1 00007f36252715b1 00007f361c36a2a6 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f3625264de1 00007f36252715b1 00007f361c39c3f3 00007f361c39e7c1
0709 13:07:37.067372 (+  9514us) spinlock_profiling.cc:243] Waited 12.4 ms on lock 0x7b1800269c80. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f3625264de1 00007f36252715b1 00007f361c39c3f3 00007f361c39e7c1 00007f361c39e779 00007f361c39e709 00007f361c39e6d1 00007f361c39d9cd 000000000038f354 000000000038f199 00007f361c37f83a
0709 13:07:38.052195 (+984823us) raft_consensus.cc:1685] finished
0709 13:07:38.052233 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:38.052450 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":285637,"prepare.queue_time_us":78767,"prepare.run_cpu_time_us":91,"prepare.run_wall_time_us":4557,"raft.queue_time_us":232353,"raft.run_cpu_time_us":1185,"raft.run_wall_time_us":108442,"spinlock_wait_cycles":52346752,"thread_start_us":124374,"threads_started":1,"wal-append.queue_time_us":239136}
I20260709 13:07:37.910416 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
W20260709 13:07:38.263852 16349 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41832 (request call id 2259) took 1967 ms (client timeout 1978 ms). Trace:
W20260709 13:07:38.264334 16349 rpcz_store.cc:269] 0709 13:07:36.296821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.910044 (+1613223us) service_pool.cc:224] Handling call
0709 13:07:38.263782 (+353738us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:38.264797 16947 raft_consensus.cc:1240] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:38.265372 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:38.266155 16349 raft_consensus.cc:2393] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 9: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:07:37.158591 20948 raft_consensus.cc:493] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:38.074079 16348 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.439s	user 0.005s	sys 0.017s
W20260709 13:07:37.934969 21296 consensus_meta.cc:287] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f: Time spent flushing consensus metadata: real 0.906s	user 0.008s	sys 0.005s
I20260709 13:07:38.079489 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:38.269373 16350 raft_consensus.cc:3060] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:38.013650 21017 raft_consensus.cc:493] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.000568 21334 raft_consensus.cc:515] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:07:38.213667 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 427697us
I20260709 13:07:38.216753 16202 raft_consensus.cc:1240] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:07:38.278102 16322 leader_election.cc:304] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:38.260694 21339 raft_consensus.cc:3060] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:38.053736 21349 raft_consensus.cc:740] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
W20260709 13:07:38.226436 16246 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:38.288120 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:38.289425 16356 raft_consensus.cc:2393] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 8: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
W20260709 13:07:38.289937 16356 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41832 (request call id 2255) took 1994 ms (client timeout 2072 ms). Trace:
W20260709 13:07:38.227466 16914 leader_election.cc:336] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 1.605s (SENT)
W20260709 13:07:38.211971 21206 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.016s	user 0.009s	sys 0.011s
W20260709 13:07:38.230324 16353 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41832 (request call id 2275) took 1924 ms (client timeout 2001 ms). Trace:
I20260709 13:07:38.231376 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
W20260709 13:07:38.297699 16353 rpcz_store.cc:269] 0709 13:07:36.306089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:38.015117 (+1709028us) service_pool.cc:224] Handling call
0709 13:07:38.230253 (+215136us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:38.069393 21298 leader_election.cc:290] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:38.016470 21175 raft_consensus.cc:515] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:38.243638 16351 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41830 (request call id 2436) took 2612 ms. Trace:
I20260709 13:07:38.057888 21362 raft_consensus.cc:515] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:38.249445 16946 raft_consensus.cc:1240] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:38.253149 16173 leader_election.cc:304] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:07:38.253670 21325 raft_consensus.cc:515] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:38.254528 21252 raft_consensus.cc:515] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:38.255345 21335 raft_consensus.cc:740] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:38.256119 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:38.258792 21370 raft_consensus.cc:493] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.245745 21070 raft_consensus.cc:515] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:38.225945 21363 raft_consensus.cc:493] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:38.267963 16349 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41830 (request call id 2470) took 1871 ms (client timeout 1983 ms). Trace:
I20260709 13:07:38.275242 16199 raft_consensus.cc:1240] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:38.000674 21336 consensus_queue.cc:1048] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 13:07:38.250645 21337 leader_election.cc:290] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:38.309945 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:07:38.291314 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 63877.9us
W20260709 13:07:38.290390 16356 rpcz_store.cc:269] 0709 13:07:36.295228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:38.267832 (+1972604us) service_pool.cc:224] Handling call
0709 13:07:38.289862 (+ 22030us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:38.311995 16247 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.017s	sys 0.033s
I20260709 13:07:38.296228 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:38.314013 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:07:38.314481 16247 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.524s	user 0.017s	sys 0.033s
I20260709 13:07:38.234915 21201 raft_consensus.cc:515] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:38.264144 21359 raft_consensus.cc:493] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:38.267431 21295 raft_consensus.cc:493] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:38.298501 16274 raft_consensus.cc:1275] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:07:38.300112 16351 rpcz_store.cc:276] 0709 13:07:35.641710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:36.080159 (+438449us) service_pool.cc:224] Handling call
0709 13:07:36.080758 (+   599us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:07:36.255193 (+174435us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:36.255227 (+    34us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:07:36.275821 (+ 20594us) log.cc:844] Serialized 558 byte log entry
0709 13:07:36.483398 (+207577us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:37.791296 (+1307898us) log.cc:844] Serialized 14 byte log entry
0709 13:07:38.054478 (+263182us) log.cc:844] Serialized 14 byte log entry
0709 13:07:38.090246 (+ 35768us) log.cc:844] Serialized 14 byte log entry
0709 13:07:38.205386 (+115140us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:38.205811 (+   425us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:38.206033 (+   222us) raft_consensus.cc:1685] finished
0709 13:07:38.206181 (+   148us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:38.236286 (+ 30105us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":208889,"prepare.queue_time_us":88839,"prepare.run_cpu_time_us":121,"prepare.run_wall_time_us":81109,"raft.queue_time_us":212929,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":13099,"thread_start_us":480140,"threads_started":3,"wal-append.queue_time_us":240365,"wal-append.run_cpu_time_us":2161,"wal-append.run_wall_time_us":1002175}
I20260709 13:07:38.267516 21261 raft_consensus.cc:493] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
W20260709 13:07:38.305308 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 52270us
I20260709 13:07:38.306383 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bc3c8ff9b84838a2664335d7e1582b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:38.328944 16173 leader_election.cc:304] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:38.233316 21354 raft_consensus.cc:515] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:07:38.307255 16357 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41832 (request call id 2265) took 2008 ms (client timeout 2059 ms). Trace:
I20260709 13:07:38.309433 16283 raft_consensus.cc:1275] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
W20260709 13:07:38.332201 16357 rpcz_store.cc:269] 0709 13:07:36.298467 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:38.255778 (+1957311us) service_pool.cc:224] Handling call
0709 13:07:38.307193 (+ 51415us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:38.310263 16349 rpcz_store.cc:269] 0709 13:07:36.396325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:38.265126 (+1868801us) service_pool.cc:224] Handling call
0709 13:07:38.267899 (+  2773us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:38.298345 21375 raft_consensus.cc:493] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:38.274894 20948 raft_consensus.cc:515] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:38.312908 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:38.313858 16276 raft_consensus.cc:2393] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 12: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:07:38.314880 16353 raft_consensus.cc:2468] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 9.
I20260709 13:07:38.335557 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:38.315860 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f022e2e63ae4461d834e476ff2666991" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:38.317552 16350 raft_consensus.cc:2468] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 12.
I20260709 13:07:38.324327 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:38.309564 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:07:38.315212 16247 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:38.333585 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:38.309897 21298 raft_consensus.cc:2749] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:38.338904 16351 raft_consensus.cc:2393] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 in current term 14: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:07:38.338863 16349 raft_consensus.cc:3060] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:07:38.336102 16353 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41832 (request call id 2257) took 2040 ms (client timeout 2088 ms). Trace:
W20260709 13:07:38.344748 16353 rpcz_store.cc:269] 0709 13:07:36.295849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:38.298531 (+2002682us) service_pool.cc:224] Handling call
0709 13:07:38.336031 (+ 37500us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:38.336542 21224 raft_consensus.cc:2804] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:07:38.346465 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:38.346127 21224 raft_consensus.cc:697] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:07:38.346869 21321 leader_election.cc:290] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 16 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:38.336825 16278 raft_consensus.cc:2468] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 13.
I20260709 13:07:38.307412 21378 raft_consensus.cc:493] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:38.336439 16356 raft_consensus.cc:2468] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 14.
W20260709 13:07:38.351995 16356 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41832 (request call id 2266) took 2049 ms (client timeout 2097 ms). Trace:
I20260709 13:07:38.352145 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:07:38.352471 16356 rpcz_store.cc:269] 0709 13:07:36.303118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:38.314395 (+2011277us) service_pool.cc:224] Handling call
0709 13:07:38.351919 (+ 37524us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:38.338014 16350 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41832 (request call id 2274) took 2032 ms (client timeout 2048 ms). Trace:
I20260709 13:07:38.337826 16281 raft_consensus.cc:2468] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 17.
I20260709 13:07:38.353173 16357 raft_consensus.cc:2468] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 11.
I20260709 13:07:38.283854 21017 raft_consensus.cc:515] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:38.316932 21386 raft_consensus.cc:493] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:38.353552 16350 rpcz_store.cc:269] 0709 13:07:36.305775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:38.079086 (+1773311us) service_pool.cc:224] Handling call
0709 13:07:38.337949 (+258863us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:38.357590 16351 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33486 (request call id 720) took 1991 ms (client timeout 2039 ms). Trace:
I20260709 13:07:38.357776 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
W20260709 13:07:38.358306 16351 rpcz_store.cc:269] 0709 13:07:36.365938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:38.323975 (+1958037us) service_pool.cc:224] Handling call
0709 13:07:38.357499 (+ 33524us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:38.358758 16350 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41832 (request call id 2276) took 2052 ms (client timeout 2189 ms). Trace:
W20260709 13:07:38.359158 16350 rpcz_store.cc:269] 0709 13:07:36.306378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:38.357469 (+2051091us) service_pool.cc:224] Handling call
0709 13:07:38.358702 (+  1233us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:38.359529 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:38.359895 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:38.360244 16351 raft_consensus.cc:2468] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 16.
W20260709 13:07:38.336031 21365 log.cc:927] Time spent T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.363s	user 0.001s	sys 0.001s
I20260709 13:07:38.362175 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:07:38.363427 16356 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41832 (request call id 2267) took 2060 ms (client timeout 2165 ms). Trace:
W20260709 13:07:38.363854 16356 rpcz_store.cc:269] 0709 13:07:36.303514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:38.353266 (+2049752us) service_pool.cc:224] Handling call
0709 13:07:38.363361 (+ 10095us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:38.364172 21308 raft_consensus.cc:493] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:38.364979 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:07:38.353950 16357 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41832 (request call id 2262) took 2056 ms (client timeout 2114 ms). Trace:
W20260709 13:07:38.360831 16351 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41830 (request call id 2471) took 1756 ms (client timeout 2023 ms). Trace:
W20260709 13:07:38.366297 16357 rpcz_store.cc:269] 0709 13:07:36.297637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:38.333125 (+2035488us) service_pool.cc:224] Handling call
0709 13:07:38.353873 (+ 20748us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:38.366361 16351 rpcz_store.cc:269] 0709 13:07:36.605085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:38.359261 (+1754176us) service_pool.cc:224] Handling call
0709 13:07:38.360774 (+  1513us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:38.367767 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:38.365808 16356 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41832 (request call id 2263) took 2067 ms. Trace:
I20260709 13:07:38.368739 16356 rpcz_store.cc:276] 0709 13:07:36.297899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:38.364652 (+2066753us) service_pool.cc:224] Handling call
0709 13:07:38.365746 (+  1094us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:38.369500 16350 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41832 (request call id 2258) took 2064 ms. Trace:
I20260709 13:07:38.370214 16350 rpcz_store.cc:276] 0709 13:07:36.296520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:38.359697 (+2063177us) service_pool.cc:224] Handling call
0709 13:07:38.360582 (+   885us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:38.371007 16943 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.037s	sys 0.050s
W20260709 13:07:38.371894 16943 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.586s	user 0.037s	sys 0.050s
I20260709 13:07:38.369449 16351 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41830 (request call id 2472) took 1737 ms. Trace:
I20260709 13:07:38.372942 16351 rpcz_store.cc:276] 0709 13:07:36.632661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:38.367227 (+1734566us) service_pool.cc:224] Handling call
0709 13:07:38.369375 (+  2148us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:38.374478 16349 raft_consensus.cc:2468] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 14.
I20260709 13:07:38.335896 21384 raft_consensus.cc:493] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
W20260709 13:07:38.375497 16349 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33486 (request call id 725) took 2007 ms (client timeout 2063 ms). Trace:
W20260709 13:07:38.377460 16349 rpcz_store.cc:269] 0709 13:07:36.367786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:38.333202 (+1965416us) service_pool.cc:224] Handling call
0709 13:07:38.375429 (+ 42227us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:38.378801 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:38.332746 21359 raft_consensus.cc:515] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:38.333809 21295 raft_consensus.cc:515] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:38.338649 21349 consensus_queue.cc:260] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:38.364866 21010 tablet_bootstrap.cc:492] T 4b962ceebb5c48c1914459ae0c0eff1b P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:38.434970 16356 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d"
dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
mode: GRACEFUL
new_leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
 from {username='slave'} at 127.0.0.1:56792
I20260709 13:07:38.316574 21363 raft_consensus.cc:515] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:38.335979 21261 raft_consensus.cc:515] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:07:38.405295 16914 leader_election.cc:336] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 1.776s (SENT)
I20260709 13:07:38.316425 21370 raft_consensus.cc:515] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:38.342942 21375 raft_consensus.cc:515] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:38.443782 16914 leader_election.cc:304] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:07:38.445097 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:38.445672 16206 raft_consensus.cc:2468] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 8.
I20260709 13:07:38.385202 21376 raft_consensus.cc:493] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:38.464749 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 59526.2us
W20260709 13:07:38.470883 16914 leader_election.cc:336] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 1.793s (SENT)
W20260709 13:07:38.471911 16914 leader_election.cc:336] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 1.852s (SENT)
I20260709 13:07:38.472298 16914 leader_election.cc:304] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:38.364862 21308 raft_consensus.cc:515] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:38.438167 20920 leader_election.cc:290] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:38.232712 21357 leader_election.cc:290] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:38.369585 21386 raft_consensus.cc:515] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:38.489462 16946 raft_consensus.cc:1275] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:07:38.481379 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:38.499560 16941 raft_consensus.cc:2468] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 15.
I20260709 13:07:38.490123 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
W20260709 13:07:38.476490 16914 leader_election.cc:336] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 1.862s (SENT)
W20260709 13:07:38.501219 16914 leader_election.cc:336] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 1.869s (SENT)
W20260709 13:07:38.501915 16914 leader_election.cc:336] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 2.039s (SENT)
I20260709 13:07:38.502239 16914 leader_election.cc:304] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:38.479379 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:38.503304 16357 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33486 (request call id 724) took 2136 ms. Trace:
I20260709 13:07:38.503614 16357 rpcz_store.cc:276] 0709 13:07:36.367505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:38.367227 (+1999722us) service_pool.cc:224] Handling call
0709 13:07:38.503245 (+136018us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:38.445432 21349 raft_consensus.cc:3060] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:38.499184 16348 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41830 (request call id 2413) took 3131 ms. Trace:
I20260709 13:07:38.507298 21010 tablet_bootstrap.cc:492] T 4b962ceebb5c48c1914459ae0c0eff1b P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap complete.
I20260709 13:07:38.462807 21017 leader_election.cc:290] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:38.369585 21378 raft_consensus.cc:515] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:07:38.475005 21380 raft_consensus.cc:2749] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:07:38.504057 21361 log.cc:927] Time spent T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.256s	user 0.000s	sys 0.002s
W20260709 13:07:38.504899 21367 log.cc:927] Time spent T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.250s	user 0.000s	sys 0.002s
I20260709 13:07:38.505920 16348 rpcz_store.cc:276] 0709 13:07:35.367230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:35.995694 (+628464us) service_pool.cc:224] Handling call
0709 13:07:35.996053 (+   359us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:36.507728 (+511675us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:36.507781 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:36.508416 (+   635us) log.cc:844] Serialized 26 byte log entry
0709 13:07:38.267320 (+1758904us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:38.284740 (+ 17420us) log.cc:844] Serialized 14 byte log entry
0709 13:07:38.481100 (+196360us) spinlock_profiling.cc:243] Waited 4.37 ms on lock 0x7b180046d2c0. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f3625264de1 00007f36252715b1 00007f361c316c0a 00007f3625a56219 00007f361c39ea40 00007f361c3994e4 00007f361c399455 00007f361f481060 00007f361f493716 00007f361f4a4287 00007f361f4a4208
0709 13:07:38.481275 (+   175us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:38.481344 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:38.481388 (+    44us) raft_consensus.cc:1685] finished
0709 13:07:38.498936 (+ 17548us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:38.499086 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":259939,"prepare.queue_time_us":17250,"prepare.run_cpu_time_us":83,"prepare.run_wall_time_us":4318,"raft.queue_time_us":266810,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":12964,"spinlock_wait_cycles":10046720,"thread_start_us":1912745,"threads_started":2,"wal-append.queue_time_us":1415205}
I20260709 13:07:38.473990 21104 leader_election.cc:290] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 15 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:38.519351 21390 raft_consensus.cc:2749] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:07:38.521651 20948 leader_election.cc:290] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:38.475206 21383 raft_consensus.cc:493] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.521814 16357 raft_consensus.cc:1275] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:07:38.508442 21321 raft_consensus.cc:493] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.482666 21381 raft_consensus.cc:2749] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:38.510157 21337 raft_consensus.cc:493] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.521720 16280 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42740 (request call id 883) took 2030 ms. Trace:
I20260709 13:07:38.514329 21010 ts_tablet_manager.cc:1403] T 4b962ceebb5c48c1914459ae0c0eff1b P 1109f76a0b7b443a84c0327c8707bc63: Time spent bootstrapping tablet: real 4.071s	user 0.080s	sys 0.064s
I20260709 13:07:38.383425 21384 raft_consensus.cc:515] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:38.511438 21354 leader_election.cc:290] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:38.512831 21070 leader_election.cc:290] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:38.525123 21352 raft_consensus.cc:493] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.524752 21370 leader_election.cc:290] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:38.517608 21334 leader_election.cc:290] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:38.480321 21376 raft_consensus.cc:515] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:38.531113 21375 leader_election.cc:290] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:38.531577 21261 leader_election.cc:290] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:38.536391 16357 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41830 (request call id 2445) took 2843 ms. Trace:
I20260709 13:07:38.536051 21377 raft_consensus.cc:493] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.467164 21224 consensus_queue.cc:237] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:38.538961 16280 rpcz_store.cc:276] 0709 13:07:36.491244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:36.491370 (+   126us) service_pool.cc:224] Handling call
0709 13:07:36.509968 (+ 18598us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:36.514433 (+  4465us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:36.514484 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:36.521772 (+  7288us) log.cc:844] Serialized 26 byte log entry
0709 13:07:37.798351 (+1276579us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:37.798424 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:37.798499 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:38.521496 (+722997us) raft_consensus.cc:1685] finished
0709 13:07:38.521519 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:38.521658 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3953,"raft.queue_time_us":4590,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":5769,"spinlock_wait_cycles":795392,"thread_start_us":1193774,"threads_started":1,"wal-append.queue_time_us":1467006}
I20260709 13:07:38.512720 21388 consensus_queue.cc:1048] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:07:38.525985 21175 leader_election.cc:290] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:38.540277 21362 leader_election.cc:290] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:38.546335 21378 leader_election.cc:290] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:38.546423 21386 leader_election.cc:290] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:38.536271 21382 raft_consensus.cc:493] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.548753 16357 rpcz_store.cc:276] 0709 13:07:35.692661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:38.505231 (+2812570us) service_pool.cc:224] Handling call
0709 13:07:38.517497 (+ 12266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:38.536061 (+ 18564us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:38.536326 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:38.479059 21335 consensus_queue.cc:260] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:38.538391 21383 raft_consensus.cc:515] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:38.556352 21333 consensus_queue.cc:260] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:38.565094 21325 leader_election.cc:290] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:38.563306 16350 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41830 (request call id 2448) took 2850 ms. Trace:
I20260709 13:07:38.539057 21321 raft_consensus.cc:515] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:38.548900 21252 leader_election.cc:290] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:38.572050 16350 rpcz_store.cc:276] 0709 13:07:35.712845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:38.562498 (+2849653us) service_pool.cc:224] Handling call
0709 13:07:38.562838 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:38.562989 (+   151us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:38.563006 (+    17us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:38.563036 (+    30us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:07:38.563056 (+    20us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:38.563093 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:38.563235 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:38.541654 21337 raft_consensus.cc:515] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:38.575400 16357 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41830 (request call id 2449) took 2846 ms. Trace:
I20260709 13:07:38.560370 21201 leader_election.cc:290] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:07:38.576363 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:38.578382 16357 rpcz_store.cc:276] 0709 13:07:35.728653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:38.567606 (+2838953us) service_pool.cc:224] Handling call
0709 13:07:38.574512 (+  6906us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:38.574721 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:38.574751 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:38.574971 (+   220us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:38.575038 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:38.575121 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:38.575345 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:38.579663 16947 raft_consensus.cc:2468] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 13.
I20260709 13:07:38.580228 16350 raft_consensus.cc:1275] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:07:38.580860 16350 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41830 (request call id 2457) took 2816 ms. Trace:
I20260709 13:07:38.581226 16350 rpcz_store.cc:276] 0709 13:07:35.764528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:38.574081 (+2809553us) service_pool.cc:224] Handling call
0709 13:07:38.574416 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:38.580580 (+  6164us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:38.580802 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:38.549619 21377 raft_consensus.cc:515] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:07:38.547176 21352 raft_consensus.cc:515] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:38.576094 21359 leader_election.cc:290] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:38.584338 16350 raft_consensus.cc:1240] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 13:07:38.585054 16350 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41832 (request call id 2260) took 2288 ms. Trace:
I20260709 13:07:38.585362 16350 rpcz_store.cc:276] 0709 13:07:36.297093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:38.583248 (+2286155us) service_pool.cc:224] Handling call
0709 13:07:38.583525 (+   277us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:38.584850 (+  1325us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:38.585012 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:38.587126 16357 raft_consensus.cc:1275] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:07:38.576061 21295 leader_election.cc:290] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:38.587821 16357 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41830 (request call id 2459) took 2822 ms. Trace:
I20260709 13:07:38.589176 16357 rpcz_store.cc:276] 0709 13:07:35.765015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:38.579752 (+2814737us) service_pool.cc:224] Handling call
0709 13:07:38.586677 (+  6925us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:38.587539 (+   862us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:38.587764 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:38.588455 16350 raft_consensus.cc:1240] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:07:38.580557 21335 raft_consensus.cc:3060] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:38.591217 16350 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41832 (request call id 2261) took 2293 ms. Trace:
I20260709 13:07:38.591581 16350 rpcz_store.cc:276] 0709 13:07:36.297368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:38.585950 (+2288582us) service_pool.cc:224] Handling call
0709 13:07:38.588233 (+  2283us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:38.590147 (+  1914us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:38.591172 (+  1025us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:38.581496 21333 raft_consensus.cc:3060] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:38.593600 16349 raft_consensus.cc:1240] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 13. Current term is 14. Ops: [11.9-13.10]
I20260709 13:07:38.594602 16350 raft_consensus.cc:1240] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:38.595705 16349 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41832 (request call id 2268) took 2291 ms. Trace:
I20260709 13:07:38.596167 16350 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41832 (request call id 2273) took 2290 ms. Trace:
I20260709 13:07:38.596253 16349 rpcz_store.cc:276] 0709 13:07:36.303842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:38.593056 (+2289214us) service_pool.cc:224] Handling call
0709 13:07:38.593386 (+   330us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:38.595382 (+  1996us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:38.595641 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:38.596711 16350 rpcz_store.cc:276] 0709 13:07:36.305456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:38.593675 (+2288219us) service_pool.cc:224] Handling call
0709 13:07:38.594420 (+   745us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:38.595514 (+  1094us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:38.596095 (+   581us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:38.597806 16349 raft_consensus.cc:1240] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:38.598469 16349 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41832 (request call id 2277) took 2291 ms. Trace:
I20260709 13:07:38.598914 16349 rpcz_store.cc:276] 0709 13:07:36.306726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:38.597291 (+2290565us) service_pool.cc:224] Handling call
0709 13:07:38.597632 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:38.598222 (+   590us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:38.598415 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:38.599617 16350 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33486 (request call id 715) took 2257 ms. Trace:
I20260709 13:07:38.600071 16349 raft_consensus.cc:1275] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:07:38.600903 16349 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33486 (request call id 716) took 2258 ms. Trace:
I20260709 13:07:38.600667 16350 rpcz_store.cc:276] 0709 13:07:36.341871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:38.597729 (+2255858us) service_pool.cc:224] Handling call
0709 13:07:38.599136 (+  1407us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:38.599322 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:38.599345 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:38.599384 (+    39us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:38.599416 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:38.599469 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:38.599565 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:38.601621 16349 rpcz_store.cc:276] 0709 13:07:36.342151 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:38.599537 (+2257386us) service_pool.cc:224] Handling call
0709 13:07:38.599771 (+   234us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:38.600641 (+   870us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:38.600852 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:38.602056 16350 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4"
dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:51696
I20260709 13:07:38.602919 16350 raft_consensus.cc:606] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 11 LEADER]: Received request to transfer leadership
I20260709 13:07:38.667135 16350 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:51696 (request call id 0) took 2927 ms. Trace:
I20260709 13:07:38.667838 16350 rpcz_store.cc:276] 0709 13:07:35.740098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:38.601904 (+2861806us) service_pool.cc:224] Handling call
0709 13:07:38.666996 (+ 65092us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:38.669348 16352 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.790s	user 0.005s	sys 0.003s
W20260709 13:07:38.669924 16352 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.791s	user 0.005s	sys 0.003s
I20260709 13:07:38.600970 21308 leader_election.cc:290] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:07:38.691059 16247 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:38.697567 16247 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:38.697942 16352 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41830 (request call id 2443) took 3019 ms. Trace:
W20260709 13:07:38.661731 21269 consensus_meta.cc:287] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3: Time spent flushing consensus metadata: real 0.643s	user 0.007s	sys 0.007s
W20260709 13:07:38.709193 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 436876us
I20260709 13:07:38.712178 16350 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4"
dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:51696
I20260709 13:07:38.698372 16352 rpcz_store.cc:276] 0709 13:07:35.678339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:36.244882 (+566543us) service_pool.cc:224] Handling call
0709 13:07:36.273822 (+ 28940us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:36.382912 (+109090us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:07:36.432664 (+ 49752us) log.cc:844] Serialized 14 byte log entry
0709 13:07:36.984747 (+552083us) spinlock_profiling.cc:243] Waited 5.26 ms on lock 0x7b180040dc20. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f3625264de1 00007f36252715b1 00007f361c37ee07 00007f36251d9ab9 00007f361c39b69b 00007f361c39993f 00007f361c39bc02 00007f361f02320b 00007f361f028d23 00007f361f02923a 00007f361f493a2a
0709 13:07:37.859800 (+875053us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:37.860447 (+   647us) log.cc:844] Serialized 26 byte log entry
0709 13:07:37.860613 (+   166us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:37.860996 (+   383us) log.cc:844] Serialized 14 byte log entry
0709 13:07:38.670564 (+809568us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:38.670679 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:38.697574 (+ 26895us) raft_consensus.cc:1685] finished
0709 13:07:38.697710 (+   136us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:38.697871 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":55107,"prepare.queue_time_us":57335,"prepare.run_cpu_time_us":126,"prepare.run_wall_time_us":6864,"raft.queue_time_us":467801,"raft.run_cpu_time_us":255,"raft.run_wall_time_us":13308,"spinlock_wait_cycles":12097920,"thread_start_us":1760725,"threads_started":3,"wal-append.queue_time_us":1557571}
I20260709 13:07:38.570113 21382 raft_consensus.cc:515] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:38.716446 16350 raft_consensus.cc:606] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 11 LEADER]: Received request to transfer leadership
I20260709 13:07:38.718528 16246 leader_election.cc:304] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:07:38.731413 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 389850us
I20260709 13:07:38.705113 21344 leader_election.cc:290] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:07:38.771651 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 53233.2us
I20260709 13:07:38.721344 21269 raft_consensus.cc:493] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.720505 21384 leader_election.cc:290] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:38.721575 21308 raft_consensus.cc:493] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:38.778823 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 500634us
W20260709 13:07:38.784291 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 51301.9us
I20260709 13:07:38.785287 16322 leader_election.cc:304] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:07:38.786566 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 283291us
W20260709 13:07:38.787084 16248 leader_election.cc:336] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 2.221s (SENT)
W20260709 13:07:38.788627 16247 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:38.790567 16912 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.769s	user 0.019s	sys 0.056s
W20260709 13:07:38.791016 16912 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.770s	user 0.019s	sys 0.056s
I20260709 13:07:38.768734 21376 leader_election.cc:290] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:38.783845 21058 raft_consensus.cc:2749] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:38.733508 21334 consensus_queue.cc:1059] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.059s
I20260709 13:07:38.784860 21357 raft_consensus.cc:2749] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:07:38.805249 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 71004.7us
I20260709 13:07:38.780654 21352 leader_election.cc:290] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:38.789319 21269 raft_consensus.cc:515] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } }
I20260709 13:07:38.741997 21390 consensus_queue.cc:1048] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 13:07:38.733393 21399 consensus_queue.cc:1059] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.080s
I20260709 13:07:38.801034 21321 leader_election.cc:290] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:38.931643 21382 leader_election.cc:290] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:38.933105 16355 raft_consensus.cc:2410] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
W20260709 13:07:38.933365 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 148182us
W20260709 13:07:38.934860 16355 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41830 (request call id 2469) took 2565 ms (client timeout 2744 ms). Trace:
I20260709 13:07:38.935148 16348 raft_consensus.cc:1275] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 13:07:38.939008 16348 pending_rounds.cc:85] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e: Aborting all ops after (but not including) 10
I20260709 13:07:38.939579 16348 pending_rounds.cc:107] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e: Aborting uncommitted NO_OP operation due to leader change: 12.11
W20260709 13:07:38.938907 16355 rpcz_store.cc:269] 0709 13:07:36.369603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:38.359384 (+1989781us) service_pool.cc:224] Handling call
0709 13:07:38.934620 (+575236us) spinlock_profiling.cc:243] Waited 553 ms on lock 0x7b5400195354. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:07:38.934797 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1271931136}
I20260709 13:07:38.940004 16348 raft_consensus.cc:2889] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:07:38.940932 16912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:38.941120 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:38.940918 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:38.798381 21249 leader_election.cc:290] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 15 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:38.795756 21383 leader_election.cc:290] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:38.828467 16357 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41832 (request call id 2264) took 2530 ms. Trace:
W20260709 13:07:38.891296 16092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 165009us
W20260709 13:07:38.855459 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:38.938061 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:38.823846 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:38.943430 16203 raft_consensus.cc:2410] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for term 15 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:07:38.941607 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:38.798676 21337 leader_election.cc:290] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:38.946342 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:38.941886 16202 raft_consensus.cc:2468] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 11.
I20260709 13:07:38.944028 16207 raft_consensus.cc:2468] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 11.
I20260709 13:07:38.948248 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:38.948186 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:38.949034 16207 raft_consensus.cc:2468] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 15.
I20260709 13:07:38.949981 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:38.940016 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:38.946416 16322 leader_election.cc:304] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:38.950915 16205 raft_consensus.cc:2468] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 12.
W20260709 13:07:38.944747 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 145314us
I20260709 13:07:38.952214 16207 raft_consensus.cc:2410] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
W20260709 13:07:38.952847 16173 leader_election.cc:336] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 1.978s (SENT)
I20260709 13:07:38.953313 16173 leader_election.cc:304] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:38.954672 16203 raft_consensus.cc:2393] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 11: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:07:38.955696 16348 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41830 (request call id 2447) took 3257 ms. Trace:
I20260709 13:07:38.794780 21167 raft_consensus.cc:493] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:38.956064 16943 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35106 (request call id 855) took 2236 ms. Trace:
W20260709 13:07:38.854095 21379 log.cc:927] Time spent T 540bfc4ad793452faea5b865343aacf7 P 1109f76a0b7b443a84c0327c8707bc63: Append to log took a long time: real 0.393s	user 0.004s	sys 0.000s
I20260709 13:07:38.956162 16348 rpcz_store.cc:276] 0709 13:07:35.698416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:38.523196 (+2824780us) service_pool.cc:224] Handling call
0709 13:07:38.934757 (+411561us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:38.940551 (+  5794us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:38.955472 (+ 14921us) spinlock_profiling.cc:243] Waited 411 ms on lock 0x7b5400195350. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f4888ad 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:07:38.955638 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":945739008}
I20260709 13:07:38.957758 16943 rpcz_store.cc:276] 0709 13:07:36.701654 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:36.701814 (+   160us) service_pool.cc:224] Handling call
0709 13:07:37.784925 (+1083111us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:38.372641 (+587716us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:38.372680 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:38.373952 (+  1272us) log.cc:844] Serialized 26 byte log entry
0709 13:07:38.784391 (+410439us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:07:38.784440 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:38.784525 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:38.837932 (+ 53407us) raft_consensus.cc:1685] finished
0709 13:07:38.837967 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:38.937554 (+ 99587us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":263493,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":86,"thread_start_us":933433,"threads_started":2,"wal-append.queue_time_us":438779}
W20260709 13:07:38.856578 21364 log.cc:927] Time spent T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.620s	user 0.009s	sys 0.006s
I20260709 13:07:38.965730 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:38.965350 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:38.972205 16204 raft_consensus.cc:2468] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 15.
W20260709 13:07:38.860800 21339 consensus_meta.cc:287] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 0.562s	user 0.008s	sys 0.003s
W20260709 13:07:38.849109 21373 log.cc:927] Time spent T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.481s	user 0.000s	sys 0.003s
I20260709 13:07:38.942364 16357 rpcz_store.cc:276] 0709 13:07:36.298170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:38.589890 (+2291720us) service_pool.cc:224] Handling call
0709 13:07:38.592565 (+  2675us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:38.593035 (+   470us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:38.593056 (+    21us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:38.593543 (+   487us) log.cc:844] Serialized 52 byte log entry
0709 13:07:38.702138 (+108595us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:07:38.731179 (+ 29041us) log.cc:844] Serialized 14 byte log entry
0709 13:07:38.731559 (+   380us) log.cc:844] Serialized 14 byte log entry
0709 13:07:38.731719 (+   160us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:38.731797 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:38.828182 (+ 96385us) raft_consensus.cc:1685] finished
0709 13:07:38.828228 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:38.828390 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":359581,"prepare.queue_time_us":29846,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":55,"raft.queue_time_us":132476,"raft.run_cpu_time_us":686,"raft.run_wall_time_us":369045,"thread_start_us":101326,"threads_started":1,"wal-append.queue_time_us":177541}
I20260709 13:07:38.859330 21165 raft_consensus.cc:3060] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:38.824393 21189 raft_consensus.cc:3055] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:38.854529 21363 leader_election.cc:290] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:38.792286 21214 consensus_queue.cc:1048] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.174s
I20260709 13:07:38.985318 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:38.984071 16912 leader_election.cc:304] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:38.846691 21371 raft_consensus.cc:2749] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:38.845290 21377 leader_election.cc:290] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:38.790699 21308 raft_consensus.cc:515] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:38.993080 16322 leader_election.cc:304] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:38.996611 16200 raft_consensus.cc:2410] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:07:38.793705 21369 consensus_queue.cc:1048] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.198s
I20260709 13:07:38.991581 16320 leader_election.cc:304] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:38.822926 21402 consensus_queue.cc:1059] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.172s
W20260709 13:07:39.056053 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:38.984906 21339 raft_consensus.cc:2749] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:38.795377 21010 raft_consensus.cc:359] T 4b962ceebb5c48c1914459ae0c0eff1b P 1109f76a0b7b443a84c0327c8707bc63 [term 10 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:07:38.988533 21189 raft_consensus.cc:740] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:07:38.991151 21385 raft_consensus.cc:493] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:38.978636 21333 raft_consensus.cc:2749] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:38.978097 21382 raft_consensus.cc:3055] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:38.993860 21249 raft_consensus.cc:2749] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:38.971330 21167 raft_consensus.cc:515] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:39.002348 21261 raft_consensus.cc:2804] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:07:39.088117 16248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:39.059288 21010 raft_consensus.cc:740] T 4b962ceebb5c48c1914459ae0c0eff1b P 1109f76a0b7b443a84c0327c8707bc63 [term 10 LEARNER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Initialized, Role: LEARNER
W20260709 13:07:39.049788 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 59164.1us
I20260709 13:07:39.059303 16173 leader_election.cc:304] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
W20260709 13:07:39.059988 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 53163.6us
W20260709 13:07:39.053583 21373 log.cc:927] Time spent T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 13:07:39.048918 21224 consensus_queue.cc:1059] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.019s
W20260709 13:07:39.061512 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 273886us
I20260709 13:07:39.064775 16944 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40078 (request call id 623) took 1275 ms. Trace:
I20260709 13:07:39.053982 21371 raft_consensus.cc:2749] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:39.062335 21295 consensus_queue.cc:1048] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.007s
I20260709 13:07:39.074215 21189 consensus_queue.cc:260] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:39.047143 21388 consensus_queue.cc:1048] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 13:07:39.057782 21334 raft_consensus.cc:2804] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:39.091128 16912 leader_election.cc:304] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
W20260709 13:07:39.061314 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 68294.8us
I20260709 13:07:39.090121 16320 leader_election.cc:304] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:39.060499 21363 consensus_queue.cc:1059] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.007s
W20260709 13:07:39.157799 16103 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38830 (request call id 229) took 26841 ms (client timeout 15000 ms). Trace:
I20260709 13:07:39.169152 16353 raft_consensus.cc:2468] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 19.
I20260709 13:07:39.147146 16357 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4"
dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:51696
W20260709 13:07:39.219959 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 129949us
I20260709 13:07:39.220707 16357 raft_consensus.cc:606] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 11 LEADER]: Received request to transfer leadership
I20260709 13:07:39.093195 16248 leader_election.cc:304] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63
W20260709 13:07:39.219246 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 128192us
W20260709 13:07:39.119360 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:39.093218 16173 leader_election.cc:304] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:39.219033 16944 rpcz_store.cc:276] 0709 13:07:37.788961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.789099 (+   138us) service_pool.cc:224] Handling call
0709 13:07:37.789622 (+   523us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:37.790028 (+   406us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:37.790061 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:37.911680 (+121619us) log.cc:844] Serialized 564 byte log entry
0709 13:07:38.375966 (+464286us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:38.376022 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:38.376096 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:38.853205 (+477109us) spinlock_profiling.cc:243] Waited 25.5 ms on lock 0x7b4400022b4c. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361c224db1 00007f361c2c2c85 00007f361c2c36a2 00007f361f0351db 00007f361f030aaf 00007f361f02486e 00007f361f023bb6 00007f361f0237d8 00007f361f02d221 00007f361f02d1d9 00007f361f02d169
0709 13:07:39.008939 (+155734us) raft_consensus.cc:1685] finished
0709 13:07:39.008974 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:39.064513 (+ 55539us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":58677120,"thread_start_us":463931,"threads_started":1,"wal-append.queue_time_us":549036}
W20260709 13:07:39.230475 16247 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:39.231570 16322 leader_election.cc:304] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:07:39.232255 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 139124us
I20260709 13:07:39.227047 16246 leader_election.cc:304] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
W20260709 13:07:39.235136 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 142052us
I20260709 13:07:39.233350 16248 leader_election.cc:304] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:39.236997 16322 leader_election.cc:304] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:07:39.241652 16248 leader_election.cc:304] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:07:39.177512 21403 log.cc:927] Time spent T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
I20260709 13:07:39.243547 16322 leader_election.cc:304] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:07:39.088078 21261 raft_consensus.cc:493] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:39.227214 21373 log.cc:927] Time spent T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260709 13:07:39.245878 16322 leader_election.cc:304] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:39.087117 21382 raft_consensus.cc:740] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:39.113346 21377 raft_consensus.cc:493] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.093501 21330 raft_consensus.cc:2804] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:39.227595 21334 raft_consensus.cc:493] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:39.264566 16248 leader_election.cc:304] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:39.229784 21280 raft_consensus.cc:2804] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:39.128980 21397 raft_consensus.cc:493] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.087426 21385 raft_consensus.cc:515] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:39.266858 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:39.229637 21395 raft_consensus.cc:2804] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:39.323063 16280 raft_consensus.cc:3060] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:39.239632 20948 raft_consensus.cc:2749] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:39.248478 21337 raft_consensus.cc:2804] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:07:39.321558 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 57241.8us
I20260709 13:07:39.244715 21336 raft_consensus.cc:2749] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:39.247066 21354 raft_consensus.cc:2804] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:39.309378 21334 raft_consensus.cc:3060] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:07:39.219796 16103 rpcz_store.cc:269] 0709 13:07:12.316171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:12.316452 (+   281us) service_pool.cc:224] Handling call
0709 13:07:39.157695 (+26841243us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:35.803200 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:35.803792 (+   592us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:35.803830 (+    38us) write_op.cc:435] Acquired schema lock
0709 13:07:35.803848 (+    18us) tablet.cc:662] Decoding operations
0709 13:07:35.805107 (+  1259us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:35.805186 (+    79us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:35.805214 (+    28us) tablet.cc:685] Acquiring locks for 11 operations
0709 13:07:35.806214 (+  1000us) tablet.cc:701] Row locks acquired
0709 13:07:35.806233 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:07:35.806361 (+   128us) write_op.cc:270] Start()
0709 13:07:35.806473 (+   112us) write_op.cc:276] Timestamp: P: 1783602455806324 usec, L: 0
0709 13:07:35.806493 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:07:35.945895 (+139402us) log.cc:844] Serialized 4407 byte log entry
0709 13:07:36.152714 (+206819us) op_driver.cc:464] REPLICATION: finished
0709 13:07:36.267940 (+115226us) write_op.cc:301] APPLY: starting
0709 13:07:36.279977 (+ 12037us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:36.335094 (+ 55117us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:36.335192 (+    98us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:36.552302 (+217110us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:36.552581 (+   279us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=22,key_file_lookups=22,delta_file_lookups=22,mrs_lookups=0
0709 13:07:36.552624 (+    43us) write_op.cc:312] APPLY: finished
0709 13:07:36.552987 (+   363us) log.cc:844] Serialized 105 byte log entry
0709 13:07:36.553193 (+   206us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:36.553342 (+   149us) write_op.cc:454] Released schema lock
0709 13:07:36.553389 (+    47us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:36.553822 (+   433us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:36.553853 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":899217,"reported_tablets":38,"child_traces":[["op",{"apply.queue_time_us":72987,"apply.run_cpu_time_us":17411,"apply.run_wall_time_us":303081,"cfile_cache_hit":46,"cfile_cache_hit_bytes":50107,"num_ops":11,"prepare.queue_time_us":288209,"prepare.run_cpu_time_us":23014,"prepare.run_wall_time_us":239617,"raft.queue_time_us":72532,"raft.run_cpu_time_us":4123,"raft.run_wall_time_us":25192,"replication_time_us":345961,"thread_start_us":362519,"threads_started":4,"wal-append.queue_time_us":124326,"wal-append.run_cpu_time_us":32656,"wal-append.run_wall_time_us":1654409}]]}
I20260709 13:07:39.312999 21269 leader_election.cc:290] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:39.310755 21280 raft_consensus.cc:493] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:39.256937 21371 raft_consensus.cc:2749] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:07:39.307538 21335 consensus_meta.cc:287] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 0.713s	user 0.009s	sys 0.004s
I20260709 13:07:39.244701 21189 raft_consensus.cc:3060] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:39.243127 21410 raft_consensus.cc:2804] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:39.248333 21261 raft_consensus.cc:3060] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:39.247331 21374 raft_consensus.cc:493] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:39.335476 16248 leader_election.cc:304] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:39.320495 21377 raft_consensus.cc:515] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:39.340893 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:39.375684 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:39.299382 21330 raft_consensus.cc:493] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:39.324678 16247 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:39.245362 21344 consensus_queue.cc:1048] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.083s
I20260709 13:07:39.344920 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:07:39.331336 21394 log.cc:927] Time spent T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 13:07:39.347852 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:39.308789 21339 raft_consensus.cc:2749] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:39.247707 21386 raft_consensus.cc:2749] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:39.246089 21378 consensus_queue.cc:1048] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.088s
I20260709 13:07:39.198737 21010 consensus_queue.cc:260] T 4b962ceebb5c48c1914459ae0c0eff1b P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:07:39.356353 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:39.368551 21410 raft_consensus.cc:493] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
W20260709 13:07:39.379302 21415 log.cc:927] Time spent T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.198s	user 0.002s	sys 0.000s
I20260709 13:07:39.308199 21402 consensus_queue.cc:1048] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 13:07:39.247395 21409 consensus_queue.cc:1059] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.110s
I20260709 13:07:39.360877 21280 raft_consensus.cc:3060] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:39.329346 21411 raft_consensus.cc:2749] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:39.367444 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:39.368189 16356 raft_consensus.cc:606] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Received request to transfer leadership to TS 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:07:39.343742 21354 raft_consensus.cc:493] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:39.247876 21401 raft_consensus.cc:2804] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:39.346499 21337 raft_consensus.cc:697] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:07:39.326174 21397 raft_consensus.cc:515] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:39.361806 21382 consensus_queue.cc:260] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:39.325878 21395 raft_consensus.cc:493] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:39.378890 21214 raft_consensus.cc:2749] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:39.381006 21330 raft_consensus.cc:3060] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:39.407325 16356 raft_consensus.cc:614] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:39.401782 21410 raft_consensus.cc:3060] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:39.368721 21308 leader_election.cc:290] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:39.403020 21352 raft_consensus.cc:3055] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:39.416219 21395 raft_consensus.cc:3060] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:07:39.423164 21416 log.cc:927] Time spent T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
W20260709 13:07:39.427336 21413 log.cc:927] Time spent T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:07:39.429430 21010 ts_tablet_manager.cc:1434] T 4b962ceebb5c48c1914459ae0c0eff1b P 1109f76a0b7b443a84c0327c8707bc63: Time spent starting tablet: real 0.888s	user 0.018s	sys 0.015s
I20260709 13:07:39.409329 21389 raft_consensus.cc:493] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:39.414731 21412 log.cc:927] Time spent T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.251s	user 0.002s	sys 0.000s
I20260709 13:07:39.430387 21389 raft_consensus.cc:515] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:39.420982 21352 raft_consensus.cc:740] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:39.411298 21354 raft_consensus.cc:3060] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:39.432232 21352 consensus_queue.cc:260] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:39.433696 21167 leader_election.cc:290] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:39.435070 21337 consensus_queue.cc:237] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:39.435774 21385 leader_election.cc:290] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:39.410882 21401 raft_consensus.cc:493] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:39.436654 21401 raft_consensus.cc:3060] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:07:39.429864 21010 ts_tablet_manager.cc:1467] T 4b962ceebb5c48c1914459ae0c0eff1b P 1109f76a0b7b443a84c0327c8707bc63: Tablet startup took 889ms
I20260709 13:07:39.371923 21374 raft_consensus.cc:515] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:39.448513 21377 leader_election.cc:290] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:39.457547 21397 leader_election.cc:290] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:39.451360 21382 raft_consensus.cc:3060] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:39.460366 21321 raft_consensus.cc:3055] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:39.460816 21349 raft_consensus.cc:3055] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:07:39.463541 21321 raft_consensus.cc:740] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:07:39.463430 21349 raft_consensus.cc:740] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:39.465675 21321 consensus_queue.cc:260] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:39.465855 21349 consensus_queue.cc:260] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:39.467243 21321 raft_consensus.cc:3060] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:39.467382 21349 raft_consensus.cc:3060] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:39.469051 21330 raft_consensus.cc:515] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:39.470317 21249 raft_consensus.cc:3055] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:39.470821 21249 raft_consensus.cc:740] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:07:39.471756 21249 consensus_queue.cc:260] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:39.473238 21352 raft_consensus.cc:3060] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:39.476033 21389 leader_election.cc:290] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:39.473233 21249 raft_consensus.cc:3060] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:39.480868 21401 raft_consensus.cc:515] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:39.483863 21410 raft_consensus.cc:515] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:39.485916 21410 leader_election.cc:290] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 election: Requested vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:39.470026 21261 raft_consensus.cc:515] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:39.489040 21374 leader_election.cc:290] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:39.489660 21401 leader_election.cc:290] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:39.491942 21354 raft_consensus.cc:515] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:39.486233 21395 raft_consensus.cc:515] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:39.493906 21334 raft_consensus.cc:515] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:39.494447 21354 leader_election.cc:290] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 14 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:39.494980 21395 leader_election.cc:290] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 16 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:07:39.524127 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 287926us
W20260709 13:07:39.532284 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:39.534377 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:39.538833 16102 catalog_manager.cc:5697] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e reported cstate change: term changed from 13 to 16, leader changed from e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) to 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66). New cstate: current_term: 16 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } }
I20260709 13:07:39.376475 16199 raft_consensus.cc:2468] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 8.
I20260709 13:07:39.374068 16248 leader_election.cc:304] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:07:39.543980 16174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:39.548413 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 174266us
W20260709 13:07:39.542809 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:39.552981 16248 leader_election.cc:304] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:39.399799 16275 raft_consensus.cc:3060] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:39.380348 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:39.565752 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:39.567384 16274 raft_consensus.cc:2468] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 12.
I20260709 13:07:39.567934 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:39.572618 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:39.573668 16204 raft_consensus.cc:2368] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 13. Current term is 14.
I20260709 13:07:39.370697 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:39.575392 16276 raft_consensus.cc:1240] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:39.575488 16282 raft_consensus.cc:2468] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 12.
I20260709 13:07:39.576297 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:39.577654 16281 raft_consensus.cc:2468] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 9.
W20260709 13:07:39.397082 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 151296us
I20260709 13:07:39.579404 16278 raft_consensus.cc:1240] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:39.579825 16354 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41830 (request call id 2444) took 3891 ms. Trace:
I20260709 13:07:39.407294 16279 raft_consensus.cc:2468] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 12.
I20260709 13:07:39.580300 16322 leader_election.cc:304] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:39.385551 16280 raft_consensus.cc:2468] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 12.
I20260709 13:07:39.588441 16912 leader_election.cc:304] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:39.589777 21334 leader_election.cc:290] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:39.575587 16277 raft_consensus.cc:2468] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 12.
I20260709 13:07:39.591648 21261 leader_election.cc:290] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 13 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:39.593127 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:39.595515 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f022e2e63ae4461d834e476ff2666991" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:39.595728 21374 raft_consensus.cc:2749] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:39.596903 21374 raft_consensus.cc:493] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.597594 21337 raft_consensus.cc:2804] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:39.598245 21337 raft_consensus.cc:493] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:39.598809 21337 raft_consensus.cc:3060] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:39.599563 21401 raft_consensus.cc:2749] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:07:39.599462 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:39.597748 21374 raft_consensus.cc:515] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:39.606602 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
W20260709 13:07:39.607779 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:39.471735 21330 leader_election.cc:290] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 16 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:39.606158 16275 raft_consensus.cc:2468] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 15.
I20260709 13:07:39.616329 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:39.617693 16204 raft_consensus.cc:2468] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 11.
I20260709 13:07:39.619436 21167 raft_consensus.cc:2804] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:39.622447 21167 raft_consensus.cc:493] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:39.622910 21167 raft_consensus.cc:3060] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:39.636026 16356 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:56792 (request call id 27) took 2966 ms. Trace:
I20260709 13:07:39.642988 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:39.644534 16200 raft_consensus.cc:2468] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 16.
I20260709 13:07:39.636570 16356 rpcz_store.cc:276] 0709 13:07:36.669073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:38.381656 (+1712583us) service_pool.cc:224] Handling call
0709 13:07:39.635564 (+1253908us) spinlock_profiling.cc:243] Waited 932 ms on lock 0x7b5400194e54. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f483853 00007f362445160a 00007f361d9d77d4 00007f361d9d7762 00007f361d9d7691 00007f361d9d760c 00007f361d9d68c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:07:39.635759 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2144502144}
I20260709 13:07:39.650808 21280 raft_consensus.cc:515] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:07:39.439777 21010 ts_tablet_manager.cc:1469] T 4b962ceebb5c48c1914459ae0c0eff1b P 1109f76a0b7b443a84c0327c8707bc63: Trace:
0709 13:07:27.434015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:27.434690 (+   675us) service_pool.cc:224] Handling call
0709 13:07:27.942005 (+507315us) ts_tablet_manager.cc:934] T 4b962ceebb5c48c1914459ae0c0eff1b P 1109f76a0b7b443a84c0327c8707bc63: Initiating tablet copy from peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073)
0709 13:07:30.746587 (+2804582us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:07:32.771461 (+2024874us) tablet_metadata.cc:665] Metadata flushed
0709 13:07:32.802816 (+ 31355us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:07:33.283535 (+480719us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:07:33.313154 (+ 29619us) tablet_replica.cc:206] Creating consensus instance
0709 13:07:33.313550 (+   396us) ts_tablet_manager.cc:989] Replica registered.
0709 13:07:33.313690 (+   140us) inbound_call.cc:177] Queueing success response
0709 13:07:34.442977 (+1129287us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:07:38.541731 (+4098754us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:07:38.545651 (+  3920us) tablet_replica.cc:261] Starting instrumentation
0709 13:07:38.546450 (+   799us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":45919,"mutex_wait_us":16653,"raft.queue_time_us":4431,"raft.run_cpu_time_us":251,"raft.run_wall_time_us":5137,"tablet-copy.queue_time_us":385069,"tablet-download-pool.queue_time_us":225,"tablet-download-pool.run_cpu_time_us":1474,"tablet-download-pool.run_wall_time_us":458993,"thread_start_us":185732,"threads_started":2}
W20260709 13:07:39.656219 16353 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41832 (request call id 2270) took 3351 ms (client timeout 2141 ms). Trace:
W20260709 13:07:39.657107 16353 rpcz_store.cc:269] 0709 13:07:36.304477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:38.345971 (+2041494us) service_pool.cc:224] Handling call
0709 13:07:39.655510 (+1309539us) spinlock_profiling.cc:243] Waited 715 ms on lock 0x7b5400194454. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:07:39.655802 (+   292us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1645479296}
I20260709 13:07:39.658164 16943 raft_consensus.cc:2368] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for earlier term 12. Current term is 13.
W20260709 13:07:39.664481 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 47640.8us
I20260709 13:07:39.675594 16204 raft_consensus.cc:1240] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:39.679458 21352 raft_consensus.cc:493] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.679883 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:39.680485 21352 raft_consensus.cc:515] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:39.687150 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:39.688134 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:39.689788 16203 raft_consensus.cc:3060] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:07:39.690193 16208 raft_consensus.cc:2468] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 18.
I20260709 13:07:39.692070 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:39.693542 16202 raft_consensus.cc:3060] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:39.580391 16354 rpcz_store.cc:276] 0709 13:07:35.688210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:38.463088 (+2774878us) service_pool.cc:224] Handling call
0709 13:07:38.482454 (+ 19366us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:07:38.733278 (+250824us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:38.733309 (+    31us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:07:38.776030 (+ 42721us) log.cc:844] Serialized 78 byte log entry
0709 13:07:39.089386 (+313356us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:39.148655 (+ 59269us) log.cc:844] Serialized 14 byte log entry
0709 13:07:39.149144 (+   489us) log.cc:844] Serialized 14 byte log entry
0709 13:07:39.164709 (+ 15565us) log.cc:844] Serialized 14 byte log entry
0709 13:07:39.164906 (+   197us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:39.164984 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:39.578925 (+413941us) raft_consensus.cc:1685] finished
0709 13:07:39.578983 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:39.579475 (+   492us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":356466,"prepare.queue_time_us":287918,"prepare.run_cpu_time_us":125,"prepare.run_wall_time_us":8528,"raft.queue_time_us":67304,"raft.run_cpu_time_us":641,"raft.run_wall_time_us":339914,"thread_start_us":477892,"threads_started":2,"wal-append.queue_time_us":517786}
I20260709 13:07:39.695127 16102 catalog_manager.cc:5697] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:39.697606 16201 raft_consensus.cc:1240] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 11. Current term is 12. Ops: []
W20260709 13:07:39.698310 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 135882us
I20260709 13:07:39.700240 16322 leader_election.cc:304] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:39.707829 16320 leader_election.cc:304] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:39.709369 21334 raft_consensus.cc:2804] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:07:39.708853 16102 catalog_manager.cc:5697] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e reported cstate change: term changed from 7 to 10, leader changed from 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) to e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65). New cstate: current_term: 10 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } }
I20260709 13:07:39.709836 21334 raft_consensus.cc:493] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:39.710306 21334 raft_consensus.cc:3060] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:39.704893 21280 leader_election.cc:290] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 16 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:39.710805 21401 consensus_queue.cc:1048] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:39.711587 21374 leader_election.cc:290] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:39.718508 16102 catalog_manager.cc:5697] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e reported cstate change: term changed from 11 to 13, leader changed from e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) to 363bb2f744eb486f9ad726f08214c98e (127.14.180.67). New cstate: current_term: 13 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:39.723315 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:39.728899 16278 raft_consensus.cc:2468] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 12.
I20260709 13:07:39.730057 16277 raft_consensus.cc:1275] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 6. (term mismatch)
I20260709 13:07:39.726039 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:39.722827 21374 raft_consensus.cc:2749] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:39.727012 21352 leader_election.cc:290] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:07:39.727530 16321 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:39.727551 16275 raft_consensus.cc:1240] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 11. Current term is 12. Ops: []
W20260709 13:07:39.734418 16912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:39.735602 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:39.736879 16276 raft_consensus.cc:1275] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:07:39.734197 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:39.738106 16943 raft_consensus.cc:1240] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:39.738722 16277 pending_rounds.cc:85] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3: Aborting all ops after (but not including) 5
I20260709 13:07:39.739212 16277 pending_rounds.cc:107] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:07:39.739694 16277 raft_consensus.cc:2889] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:39.740628 16102 catalog_manager.cc:5697] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e reported cstate change: term changed from 12 to 15. New cstate: current_term: 15 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:39.745319 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:39.747331 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:39.751513 16199 raft_consensus.cc:3060] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:07:39.758981 16202 raft_consensus.cc:2468] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 16.
I20260709 13:07:39.759886 21167 raft_consensus.cc:515] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:39.773414 21167 leader_election.cc:290] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 9 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:39.770854 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f022e2e63ae4461d834e476ff2666991" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:39.774955 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:39.775324 16320 leader_election.cc:304] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:39.776017 16206 raft_consensus.cc:2393] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 in current term 16: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:07:39.776636 21382 raft_consensus.cc:2804] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:07:39.777236 21382 raft_consensus.cc:697] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 16 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:39.778442 21382 consensus_queue.cc:237] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:39.768746 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:39.783252 16201 raft_consensus.cc:2468] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 16.
I20260709 13:07:39.788772 16203 raft_consensus.cc:2468] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 13.
I20260709 13:07:39.784796 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:39.794977 16949 raft_consensus.cc:1240] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:39.806938 16208 raft_consensus.cc:2410] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:07:39.812837 16199 raft_consensus.cc:2468] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 13.
I20260709 13:07:39.821950 16217 tablet_copy_service.cc:342] P e10b16d536674c0bb350a31d7ce5ff7f: Request end of tablet copy session 1109f76a0b7b443a84c0327c8707bc63-4b962ceebb5c48c1914459ae0c0eff1b received from {username='slave'} at 127.0.0.1:39674
I20260709 13:07:39.822849 16217 tablet_copy_service.cc:434] P e10b16d536674c0bb350a31d7ce5ff7f: ending tablet copy session 1109f76a0b7b443a84c0327c8707bc63-4b962ceebb5c48c1914459ae0c0eff1b on tablet 4b962ceebb5c48c1914459ae0c0eff1b with peer 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:07:39.825507 21167 raft_consensus.cc:493] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:39.826426 21167 raft_consensus.cc:515] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:39.830847 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:39.831199 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:39.832518 16944 raft_consensus.cc:2468] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 12.
I20260709 13:07:39.833562 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:39.834614 16941 raft_consensus.cc:2393] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 12: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
I20260709 13:07:39.834127 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:39.835804 16947 raft_consensus.cc:2393] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 13: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
I20260709 13:07:39.835740 21167 leader_election.cc:290] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:39.838461 16320 leader_election.cc:304] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:39.807399 21337 raft_consensus.cc:515] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:39.843927 16320 leader_election.cc:304] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:39.849502 21352 raft_consensus.cc:2804] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:39.851895 21352 raft_consensus.cc:697] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 13 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:39.853647 21352 consensus_queue.cc:237] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:39.849592 21349 raft_consensus.cc:2804] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:39.856575 21337 leader_election.cc:290] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:39.855013 16102 catalog_manager.cc:5697] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e reported cstate change: term changed from 7 to 9, leader changed from e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) to 363bb2f744eb486f9ad726f08214c98e (127.14.180.67). New cstate: current_term: 9 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:39.875362 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:39.878762 16208 raft_consensus.cc:1240] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 15. Current term is 16. Ops: [13.8-15.9]
I20260709 13:07:39.880714 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:39.881626 16202 raft_consensus.cc:1240] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:07:39.865677 21349 raft_consensus.cc:493] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:39.883039 21349 raft_consensus.cc:3060] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:07:39.885650 16173 connection.cc:256] RPC call timeout handler was delayed by -1.1474550399999544s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.30010000000000003s for a response
I20260709 13:07:39.885771 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:07:39.887627 16941 raft_consensus.cc:2393] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 16: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
I20260709 13:07:39.887607 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:07:39.888362 16944 raft_consensus.cc:3060] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:07:39.894096 16248 connection.cc:256] RPC call timeout handler was delayed by -2.367486311000107s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15300000000000002s for a response
I20260709 13:07:39.864539 21334 raft_consensus.cc:515] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:39.897105 21334 leader_election.cc:290] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 19 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:39.898087 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
W20260709 13:07:39.886312 16173 connection.cc:256] RPC call timeout handler was delayed by -1.0502550400000246s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3109s for a response
W20260709 13:07:39.900627 16248 connection.cc:256] RPC call timeout handler was delayed by -2.3629863110000997s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1535s for a response
W20260709 13:07:39.901139 16248 connection.cc:256] RPC call timeout handler was delayed by -2.323620376000008s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1665s for a response
W20260709 13:07:39.901526 16248 connection.cc:256] RPC call timeout handler was delayed by -2.2549863110000388s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1655s for a response
W20260709 13:07:39.901953 16248 connection.cc:256] RPC call timeout handler was delayed by -2.1598747269999876s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1736s for a response
W20260709 13:07:39.902321 16248 connection.cc:256] RPC call timeout handler was delayed by -1.8846581139999898s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19830000000000003s for a response
W20260709 13:07:39.902835 16248 connection.cc:256] RPC call timeout handler was delayed by -1.843595548000053s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20230000000000004s for a response
I20260709 13:07:39.907238 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:39.907485 16943 raft_consensus.cc:1240] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 16 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:39.908494 16941 raft_consensus.cc:2393] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 13: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
I20260709 13:07:39.913792 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c15d8e9be8414c84912ab77b66bfb1" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:39.916667 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:39.918829 16912 leader_election.cc:304] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:39.919281 16944 raft_consensus.cc:2468] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 14.
I20260709 13:07:39.921073 16208 raft_consensus.cc:2393] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 13: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
I20260709 13:07:39.922228 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:39.923744 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:39.925559 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:39.916064 21337 raft_consensus.cc:493] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:39.928927 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:39.931064 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f022e2e63ae4461d834e476ff2666991" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:07:39.935802 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f022e2e63ae4461d834e476ff2666991" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
W20260709 13:07:39.939098 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:39.928560 21167 raft_consensus.cc:2804] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:07:39.943822 16248 connection.cc:256] RPC call timeout handler was delayed by -1.2342330440000069s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.27440000000000003s for a response
I20260709 13:07:39.935603 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:07:39.950889 21409 raft_consensus.cc:493] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:39.951882 16206 raft_consensus.cc:2468] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 15.
I20260709 13:07:39.955395 21308 raft_consensus.cc:493] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:39.956224 21308 raft_consensus.cc:515] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:39.949519 21167 raft_consensus.cc:697] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 13 LEADER]: Becoming Leader. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
W20260709 13:07:39.962051 16246 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:39.960111 21337 raft_consensus.cc:515] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:39.951861 21409 raft_consensus.cc:515] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:07:39.969053 16174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:39.976836 16246 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:39.983917 16247 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:39.984315 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:39.991591 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:39.993646 16277 raft_consensus.cc:2468] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 12.
W20260709 13:07:39.998792 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:39.999274 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:40.001716 16275 raft_consensus.cc:1240] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:40.005606 16282 raft_consensus.cc:3060] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:07:40.005612 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 83181.9us
I20260709 13:07:40.006367 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c15d8e9be8414c84912ab77b66bfb1" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:40.011492 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:40.012202 16275 raft_consensus.cc:3060] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:40.012969 16102 catalog_manager.cc:5697] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:39.993487 21167 consensus_queue.cc:237] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:07:40.016966 16173 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:40.018137 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:40.018818 16277 raft_consensus.cc:1240] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:40.019089 16276 raft_consensus.cc:2468] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 16.
I20260709 13:07:40.023376 21337 leader_election.cc:290] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:07:40.023581 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 59979.3us
I20260709 13:07:40.023717 16283 raft_consensus.cc:1217] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 LEADER]: Deduplicated request from leader. Original: 11.10->[12.11-12.11]   Dedup: 12.11->[]
I20260709 13:07:40.022302 16278 raft_consensus.cc:2468] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 11.
I20260709 13:07:40.024369 16283 raft_consensus.cc:1240] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 LEADER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:07:40.028330 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:40.030540 21357 raft_consensus.cc:493] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:40.032053 21357 raft_consensus.cc:515] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:40.030431 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:40.036264 21409 leader_election.cc:290] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:40.036505 21357 leader_election.cc:290] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:07:40.043632 21435 log.cc:927] Time spent T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 13:07:40.045636 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:40.045789 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:40.048667 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:40.048956 21308 leader_election.cc:290] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:40.051051 16278 raft_consensus.cc:2393] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 13: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:07:40.051556 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:40.052574 16277 raft_consensus.cc:2468] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 16.
I20260709 13:07:40.050940 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:40.054905 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:40.056478 16276 raft_consensus.cc:2393] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 12: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
W20260709 13:07:40.060412 16154 auto_rebalancer.cc:893] Removing replace marker failed: Replica 363bb2f744eb486f9ad726f08214c98e is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 12 committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
W20260709 13:07:40.061225 16154 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 73757c6fea8949e090aa4e55902a41d4 already in progress
W20260709 13:07:40.061662 16154 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 73757c6fea8949e090aa4e55902a41d4 already in progress
I20260709 13:07:40.064321 16282 raft_consensus.cc:2468] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 15.
I20260709 13:07:40.065346 16283 raft_consensus.cc:1240] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 14. Current term is 15. Ops: [12.8-14.9]
I20260709 13:07:40.072419 21382 raft_consensus.cc:493] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:40.073148 21382 raft_consensus.cc:515] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:40.075063 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:40.075803 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:40.077026 16282 raft_consensus.cc:2410] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for term 15 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:07:40.079031 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:40.074501 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:40.075552 21382 leader_election.cc:290] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:40.084261 16282 raft_consensus.cc:1240] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:40.084599 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:40.085264 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:40.085464 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:40.086021 16279 raft_consensus.cc:2468] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 13.
I20260709 13:07:40.086683 16277 raft_consensus.cc:1275] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:07:40.085410 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f022e2e63ae4461d834e476ff2666991" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:40.088018 16283 raft_consensus.cc:2393] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 9: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:07:40.088693 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:40.089897 16276 raft_consensus.cc:3060] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:07:40.089829 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:40.092934 16275 raft_consensus.cc:2468] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 16.
I20260709 13:07:40.094280 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:40.095353 16278 raft_consensus.cc:3060] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:40.101401 16276 raft_consensus.cc:2468] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 14.
I20260709 13:07:40.086015 16102 catalog_manager.cc:5697] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e reported cstate change: term changed from 7 to 10, leader changed from 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) to 363bb2f744eb486f9ad726f08214c98e (127.14.180.67). New cstate: current_term: 10 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:40.109678 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:40.123740 21382 raft_consensus.cc:493] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:40.124627 21382 raft_consensus.cc:515] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:40.127045 21382 leader_election.cc:290] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:07:40.130702 21439 log.cc:927] Time spent T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
W20260709 13:07:40.132531 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:40.133713 16914 leader_election.cc:304] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:40.138379 16914 leader_election.cc:304] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:40.139439 21357 raft_consensus.cc:2764] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:07:40.139694 21349 raft_consensus.cc:515] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:40.140518 21357 raft_consensus.cc:2804] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:40.140995 21357 raft_consensus.cc:493] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:40.141501 21357 raft_consensus.cc:3060] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:40.143751 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:40.144604 16206 raft_consensus.cc:3060] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:40.141430 16914 leader_election.cc:304] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:07:40.133672 16102 catalog_manager.cc:5697] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } }
W20260709 13:07:40.149358 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 150926us
I20260709 13:07:40.149782 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:40.154306 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:40.154428 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:07:40.157052 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:40.157909 16278 raft_consensus.cc:2468] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 13.
I20260709 13:07:40.159235 16201 raft_consensus.cc:2393] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 16: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:07:40.150772 21308 consensus_queue.cc:1059] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:07:40.162871 16199 raft_consensus.cc:1275] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 9. (term mismatch)
I20260709 13:07:40.163854 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:07:40.161369 21437 log.cc:927] Time spent T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63: Append to log took a long time: real 0.116s	user 0.001s	sys 0.001s
I20260709 13:07:40.163444 16199 pending_rounds.cc:85] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f: Aborting all ops after (but not including) 8
I20260709 13:07:40.166226 16199 pending_rounds.cc:107] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f: Aborting uncommitted NO_OP operation due to leader change: 12.9
I20260709 13:07:40.166478 16199 raft_consensus.cc:2889] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:40.159364 21280 raft_consensus.cc:2804] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:40.171093 21280 raft_consensus.cc:697] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [term 12 LEADER]: Becoming Leader. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:07:40.172741 16207 raft_consensus.cc:2468] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 14.
I20260709 13:07:40.172384 21280 consensus_queue.cc:237] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:40.175288 21349 leader_election.cc:290] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 17 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:40.183458 16248 leader_election.cc:304] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:07:40.194664 16206 raft_consensus.cc:2468] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 17.
I20260709 13:07:40.199084 16320 leader_election.cc:304] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:40.198788 16914 leader_election.cc:304] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
W20260709 13:07:40.203625 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:40.206180 21401 raft_consensus.cc:2804] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:40.208451 21401 raft_consensus.cc:493] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:40.208858 21401 raft_consensus.cc:3060] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:40.206802 21349 raft_consensus.cc:2804] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:07:40.211655 21349 raft_consensus.cc:697] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 17 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:40.212849 21349 consensus_queue.cc:237] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:40.213413 21167 raft_consensus.cc:2804] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:40.214036 21167 raft_consensus.cc:493] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:40.215487 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 54385.7us
I20260709 13:07:40.214579 21167 raft_consensus.cc:3060] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:40.227152 16102 catalog_manager.cc:5697] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e reported cstate change: term changed from 11 to 15, leader changed from e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) to 363bb2f744eb486f9ad726f08214c98e (127.14.180.67). New cstate: current_term: 15 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:40.229053 21337 raft_consensus.cc:3055] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:40.229609 21337 raft_consensus.cc:740] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:07:40.229666 16102 catalog_manager.cc:5697] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e reported cstate change: term changed from 7 to 10, leader changed from e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) to 363bb2f744eb486f9ad726f08214c98e (127.14.180.67). New cstate: current_term: 10 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:40.243781 16914 leader_election.cc:304] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:40.245769 21280 raft_consensus.cc:2804] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:40.246443 21280 raft_consensus.cc:697] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 15 LEADER]: Becoming Leader. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:07:40.247656 21280 consensus_queue.cc:237] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:40.236084 21337 consensus_queue.cc:260] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:40.253013 21337 raft_consensus.cc:3060] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:40.256903 16173 leader_election.cc:400] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 pre-election: Vote denied by peer 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875) with higher term. Message: Invalid argument: T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for earlier term 12. Current term is 13.
I20260709 13:07:40.258020 16173 leader_election.cc:403] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:40.259896 21249 raft_consensus.cc:2749] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875) with higher term. Message: Invalid argument: T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for earlier term 12. Current term is 13.
I20260709 13:07:40.261092 16914 leader_election.cc:304] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:40.262607 21375 raft_consensus.cc:2804] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:40.263139 21375 raft_consensus.cc:493] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:40.263031 21261 consensus_queue.cc:1059] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:40.263717 21375 raft_consensus.cc:3060] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:40.264458 21261 raft_consensus.cc:3055] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:40.264878 21261 raft_consensus.cc:740] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:07:40.265995 21261 consensus_queue.cc:260] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:40.267611 21261 raft_consensus.cc:3060] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:40.294890 21444 consensus_queue.cc:1059] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:40.295822 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:40.297559 16102 catalog_manager.cc:5697] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:40.303514 16173 leader_election.cc:304] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
W20260709 13:07:40.311919 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 96679.4us
W20260709 13:07:40.312263 16248 leader_election.cc:336] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 1.530s (SENT)
I20260709 13:07:40.314222 16248 leader_election.cc:304] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:07:40.326759 16248 leader_election.cc:336] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 1.535s (SENT)
I20260709 13:07:40.327380 16248 leader_election.cc:304] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:07:40.329021 16248 leader_election.cc:336] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 1.655s (SENT)
I20260709 13:07:40.333550 16248 leader_election.cc:304] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:40.351400 21448 raft_consensus.cc:2749] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:40.352362 21448 raft_consensus.cc:2749] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:40.353194 21448 raft_consensus.cc:2749] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:07:40.337705 21249 raft_consensus.cc:2804] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:40.334658 21452 consensus_queue.cc:1059] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 13:07:40.377926 21280 raft_consensus.cc:493] T 540bfc4ad793452faea5b865343aacf7 P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:40.382440 16246 leader_election.cc:400] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 pre-election: Vote denied by peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073) with higher term. Message: Invalid argument: T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 13. Current term is 14.
I20260709 13:07:40.383095 16246 leader_election.cc:403] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:40.389175 21401 raft_consensus.cc:515] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:07:40.397959 16174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:40.428876 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 99918.3us
I20260709 13:07:40.428520 21280 raft_consensus.cc:515] T 540bfc4ad793452faea5b865343aacf7 P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:40.432463 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:40.433372 16206 raft_consensus.cc:2393] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 in current term 14: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:07:40.435985 21280 leader_election.cc:290] T 540bfc4ad793452faea5b865343aacf7 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:40.442925 21308 raft_consensus.cc:2749] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073) with higher term. Message: Invalid argument: T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 13. Current term is 14.
I20260709 13:07:40.445079 21163 raft_consensus.cc:3055] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:40.445694 21163 raft_consensus.cc:740] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
W20260709 13:07:40.456314 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 154293us
W20260709 13:07:40.461706 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 81864.2us
W20260709 13:07:40.459406 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 110996us
I20260709 13:07:40.472951 16246 leader_election.cc:304] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:40.485224 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:40.486204 16278 raft_consensus.cc:2393] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 13: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:07:40.488920 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:40.489053 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:40.489084 16914 leader_election.cc:304] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:40.489766 21163 consensus_queue.cc:260] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:40.491667 21163 raft_consensus.cc:3060] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:40.491832 16275 raft_consensus.cc:2468] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 12.
I20260709 13:07:40.501982 16206 raft_consensus.cc:1275] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:07:40.503212 21451 raft_consensus.cc:3055] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:07:40.503062 21455 raft_consensus.cc:2749] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:07:40.503789 21451 raft_consensus.cc:740] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:07:40.504199 21455 consensus_queue.cc:1048] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:40.453996 21375 raft_consensus.cc:515] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:40.510845 21375 leader_election.cc:290] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 13 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:40.511642 16246 leader_election.cc:304] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:40.512708 16246 leader_election.cc:304] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:40.514245 21308 raft_consensus.cc:2804] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:07:40.514500 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:40.514911 21458 raft_consensus.cc:2749] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:40.514878 21308 raft_consensus.cc:493] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:40.516039 21308 raft_consensus.cc:3060] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:40.525389 21308 raft_consensus.cc:515] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:40.529084 21308 leader_election.cc:290] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 17 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:40.528688 21451 consensus_queue.cc:260] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:40.530372 21451 raft_consensus.cc:3060] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:07:40.532184 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:40.533301 21401 leader_election.cc:290] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 election: Requested vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:40.534901 21357 raft_consensus.cc:515] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:40.536120 21167 raft_consensus.cc:515] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:40.538573 16949 raft_consensus.cc:2393] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 13: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
I20260709 13:07:40.541966 21357 leader_election.cc:290] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 10 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:40.544281 21167 leader_election.cc:290] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 13 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:07:40.546852 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 117003us
W20260709 13:07:40.550704 16248 leader_election.cc:336] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 1.736s (SENT)
I20260709 13:07:40.551280 16248 leader_election.cc:304] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:07:40.552330 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:40.559834 16247 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:40.558637 21444 raft_consensus.cc:2804] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:07:40.573300 16248 leader_election.cc:336] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 1.983s (SENT)
W20260709 13:07:40.574905 16248 leader_election.cc:336] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 2.023s (SENT)
I20260709 13:07:40.575526 16248 leader_election.cc:304] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:40.547883 21249 raft_consensus.cc:697] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:07:40.570214 21444 raft_consensus.cc:493] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:40.568778 21401 raft_consensus.cc:2749] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:40.587908 16246 leader_election.cc:304] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:40.584882 21444 raft_consensus.cc:3060] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:40.585528 21454 consensus_queue.cc:1059] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 13:07:40.590701 21308 raft_consensus.cc:2749] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:40.578220 21249 consensus_queue.cc:237] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:07:40.591215 16248 leader_election.cc:336] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 2.046s (SENT)
I20260709 13:07:40.591528 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:07:40.615257 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 111593us
I20260709 13:07:40.617944 16248 leader_election.cc:304] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:07:40.612094 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 137032us
I20260709 13:07:40.634871 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
W20260709 13:07:40.646684 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:40.646776 21401 raft_consensus.cc:2749] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:40.649601 21349 raft_consensus.cc:493] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:40.650398 21349 raft_consensus.cc:515] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:40.652787 21349 leader_election.cc:290] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:40.654722 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:40.655712 16206 raft_consensus.cc:2410] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
W20260709 13:07:40.656308 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 65147.9us
W20260709 13:07:40.657451 16248 leader_election.cc:336] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 2.080s (SENT)
W20260709 13:07:40.659147 16248 leader_election.cc:336] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 2.744s (SENT)
W20260709 13:07:40.661933 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 74112.6us
I20260709 13:07:40.663770 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
W20260709 13:07:40.664644 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 151344us
I20260709 13:07:40.656641 21337 raft_consensus.cc:2749] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:40.666519 16199 raft_consensus.cc:3060] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:07:40.674252 16913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:40.674801 21464 consensus_queue.cc:1048] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:07:40.676772 16248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:40.679510 16248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:40.681463 21458 raft_consensus.cc:3055] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:07:40.681833 16201 raft_consensus.cc:1275] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:07:40.681951 21458 raft_consensus.cc:740] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:07:40.683048 21458 consensus_queue.cc:260] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:40.684419 21458 raft_consensus.cc:3060] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:40.699003 21462 consensus_queue.cc:1048] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:40.702265 21462 consensus_queue.cc:1048] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:40.702301 16246 leader_election.cc:304] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:40.710287 21454 raft_consensus.cc:2749] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:40.710351 16246 leader_election.cc:304] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:40.711624 21444 raft_consensus.cc:515] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:07:40.714052 21444 leader_election.cc:290] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:40.715128 16208 raft_consensus.cc:1275] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:07:40.716087 16275 raft_consensus.cc:2368] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for earlier term 11. Current term is 12.
I20260709 13:07:40.719204 21461 consensus_queue.cc:1059] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:07:40.719884 21308 raft_consensus.cc:2804] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:40.723333 21308 raft_consensus.cc:493] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:40.723838 21308 raft_consensus.cc:3060] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:40.724794 16199 raft_consensus.cc:2468] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 13.
I20260709 13:07:40.733963 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:40.736519 16914 leader_election.cc:304] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:40.723834 21461 raft_consensus.cc:3055] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:07:40.738035 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:40.732512 21464 consensus_queue.cc:1048] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.031s
I20260709 13:07:40.761916 16277 raft_consensus.cc:1275] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
W20260709 13:07:40.753674 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:40.735769 21454 consensus_queue.cc:1048] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:07:40.767895 21454 consensus_queue.cc:1243] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer e10b16d536674c0bb350a31d7ce5ff7f log is divergent from this leader: its last log entry 10.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:07:40.763268 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:40.768961 16283 raft_consensus.cc:2468] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 17.
I20260709 13:07:40.771227 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:40.772154 16200 raft_consensus.cc:2393] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 17: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:07:40.740840 21167 raft_consensus.cc:2749] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:07:40.774672 21382 consensus_queue.cc:1048] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:40.782267 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:40.736680 16173 leader_election.cc:304] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:40.797283 21349 raft_consensus.cc:493] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:40.799288 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 79164.3us
I20260709 13:07:40.799530 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:40.798781 21321 raft_consensus.cc:2804] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:07:40.797612 21468 log.cc:927] Time spent T 00000000000000000000000000000000 P 4dc6f08597514f4d85fd451b999b403e: Append to log took a long time: real 0.068s	user 0.002s	sys 0.000s
I20260709 13:07:40.800989 21321 raft_consensus.cc:493] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:40.799110 16283 raft_consensus.cc:1240] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:07:40.799650 21349 raft_consensus.cc:515] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:40.764703 21461 raft_consensus.cc:740] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:07:40.823040 16173 leader_election.cc:304] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:40.824556 16173 leader_election.cc:304] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:07:40.824684 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:40.805083 21321 raft_consensus.cc:3060] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:40.829037 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:40.827950 16280 raft_consensus.cc:2468] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 14.
I20260709 13:07:40.840996 16281 raft_consensus.cc:3060] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:40.830282 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:40.841591 16203 raft_consensus.cc:3060] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:07:40.829980 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 55902.3us
I20260709 13:07:40.847263 16201 raft_consensus.cc:1217] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Deduplicated request from leader. Original: 8.6->[9.7-13.9]   Dedup: 9.7->[11.8-13.9]
W20260709 13:07:40.847765 16174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:40.848074 16201 pending_rounds.cc:85] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f: Aborting all ops after (but not including) 7
I20260709 13:07:40.848465 16201 pending_rounds.cc:107] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 13:07:40.848795 16201 raft_consensus.cc:2889] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:40.730571 21453 consensus_queue.cc:1048] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.097s
I20260709 13:07:40.859237 21473 raft_consensus.cc:493] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:40.860505 16274 raft_consensus.cc:1275] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:07:40.867798 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:40.876223 21475 raft_consensus.cc:493] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:40.877238 21475 raft_consensus.cc:515] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:40.839996 21462 raft_consensus.cc:2749] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:40.881649 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:40.882462 16282 raft_consensus.cc:3060] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:40.881961 16274 raft_consensus.cc:2393] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 in current term 13: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:07:40.824546 21401 consensus_queue.cc:1048] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 13:07:40.894901 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:40.892856 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
W20260709 13:07:40.926425 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 60809.7us
I20260709 13:07:40.926919 16173 leader_election.cc:304] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:40.943506 16203 raft_consensus.cc:2468] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 12.
I20260709 13:07:40.904521 21462 raft_consensus.cc:493] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:40.948745 16914 leader_election.cc:304] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:40.952275 21280 raft_consensus.cc:2749] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:07:40.960260 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 54759us
I20260709 13:07:40.962059 16282 raft_consensus.cc:2468] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 13.
W20260709 13:07:40.963851 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 87984.3us
I20260709 13:07:40.880880 21473 raft_consensus.cc:515] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:40.958823 21375 consensus_queue.cc:1048] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.046s
I20260709 13:07:41.003222 21349 leader_election.cc:290] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:41.003913 21349 raft_consensus.cc:493] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.004493 21479 raft_consensus.cc:493] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.005070 21479 raft_consensus.cc:515] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:41.008070 21479 leader_election.cc:290] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:41.008638 21479 raft_consensus.cc:493] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:41.009109 21479 raft_consensus.cc:515] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:41.012009 21473 leader_election.cc:290] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:40.971987 21461 consensus_queue.cc:260] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:40.992535 21451 consensus_queue.cc:1048] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
W20260709 13:07:40.996582 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 46641.9us
I20260709 13:07:41.023880 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:07:41.043226 16281 raft_consensus.cc:2468] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 13.
W20260709 13:07:41.001566 16914 leader_election.cc:336] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 2.063s (SENT)
I20260709 13:07:41.051584 16949 raft_consensus.cc:2393] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 13: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
I20260709 13:07:41.052039 16914 leader_election.cc:304] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:40.962080 21462 raft_consensus.cc:515] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:41.000432 21456 raft_consensus.cc:2804] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:07:41.016191 21467 log.cc:927] Time spent T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
W20260709 13:07:41.061596 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:41.091629 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 137340us
I20260709 13:07:41.019953 21457 raft_consensus.cc:2764] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 13:07:41.019825 21461 raft_consensus.cc:3060] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:41.065589 16173 leader_election.cc:304] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
W20260709 13:07:41.104573 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:41.105490 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 140660us
I20260709 13:07:41.015048 21308 raft_consensus.cc:515] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:07:41.094370 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.108104 16246 leader_election.cc:304] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:41.110807 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:41.121335 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:41.122002 16276 raft_consensus.cc:1275] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:07:41.122243 16199 raft_consensus.cc:2393] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 13: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
W20260709 13:07:41.123490 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 67904.3us
I20260709 13:07:41.128497 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:41.004546 21349 raft_consensus.cc:515] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:41.062613 21456 raft_consensus.cc:493] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:41.131039 16207 raft_consensus.cc:2468] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 16.
I20260709 13:07:41.101125 21167 raft_consensus.cc:2749] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:07:41.137298 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.137995 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:41.141430 16208 raft_consensus.cc:2468] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 15.
I20260709 13:07:41.143105 21477 raft_consensus.cc:493] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:41.143514 21471 log.cc:927] Time spent T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.143s	user 0.001s	sys 0.000s
I20260709 13:07:41.143781 21477 raft_consensus.cc:515] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:07:41.146946 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 145415us
I20260709 13:07:41.147064 21482 raft_consensus.cc:2804] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:41.147957 21482 raft_consensus.cc:697] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 15 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:07:41.149051 21482 consensus_queue.cc:237] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:41.149609 16914 leader_election.cc:304] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
W20260709 13:07:41.153115 21469 log.cc:927] Time spent T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 13:07:41.154822 16173 leader_election.cc:304] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:41.155815 21249 raft_consensus.cc:2804] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:41.155948 16173 leader_election.cc:304] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:07:41.156332 21249 raft_consensus.cc:493] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:41.156780 21249 raft_consensus.cc:3060] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:41.132514 21475 leader_election.cc:290] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:41.160713 21490 raft_consensus.cc:2804] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:41.161396 21490 raft_consensus.cc:697] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:07:41.162635 21490 consensus_queue.cc:237] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:07:41.164846 21491 raft_consensus.cc:493] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.165518 21491 raft_consensus.cc:515] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:41.169620 21491 leader_election.cc:290] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:41.171509 21308 leader_election.cc:290] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:41.174055 21249 raft_consensus.cc:515] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:41.175326 21479 leader_election.cc:290] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:07:41.177106 21474 log.cc:927] Time spent T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.173s	user 0.001s	sys 0.000s
I20260709 13:07:41.188226 21462 leader_election.cc:290] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:41.189098 21462 raft_consensus.cc:2749] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:07:41.146287 21477 leader_election.cc:290] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:07:41.183715 16913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.139948 21456 raft_consensus.cc:3060] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:07:41.198853 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 77166.7us
I20260709 13:07:41.133839 21478 raft_consensus.cc:493] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.210871 16281 raft_consensus.cc:1275] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:07:41.186733 21475 raft_consensus.cc:493] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
W20260709 13:07:41.213824 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 57964.6us
I20260709 13:07:41.200870 21455 raft_consensus.cc:2804] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:41.215402 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:41.216536 16201 raft_consensus.cc:3060] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:41.220090 16173 leader_election.cc:304] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:07:41.221979 16173 leader_election.cc:304] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:41.222864 21457 consensus_queue.cc:1048] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:07:41.225001 21457 raft_consensus.cc:3060] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:41.228765 21495 raft_consensus.cc:2804] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:07:41.229431 21495 raft_consensus.cc:697] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 16 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:07:41.215454 21491 raft_consensus.cc:493] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:41.230695 21495 consensus_queue.cc:237] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:41.235837 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:41.236316 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:41.237891 16353 raft_consensus.cc:3060] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:41.239486 21452 consensus_queue.cc:1048] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:07:41.243992 16357 raft_consensus.cc:1275] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:07:41.264508 21479 raft_consensus.cc:493] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:41.265389 21479 raft_consensus.cc:515] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:41.213265 21375 consensus_queue.cc:1048] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
W20260709 13:07:41.280417 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 48673.8us
W20260709 13:07:41.280026 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 61735.4us
I20260709 13:07:41.281559 16356 raft_consensus.cc:1275] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 9. (term mismatch)
I20260709 13:07:41.285363 16201 raft_consensus.cc:2468] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 16.
I20260709 13:07:41.295137 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:41.208945 21478 raft_consensus.cc:515] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:41.298771 16173 leader_election.cc:304] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:41.300544 16246 leader_election.cc:304] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:41.282068 16356 pending_rounds.cc:85] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e: Aborting all ops after (but not including) 8
I20260709 13:07:41.313771 16356 pending_rounds.cc:107] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e: Aborting uncommitted NO_OP operation due to leader change: 11.9
I20260709 13:07:41.314195 16356 raft_consensus.cc:2889] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:41.231630 21475 raft_consensus.cc:515] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:41.259754 21462 raft_consensus.cc:493] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:41.299527 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:41.319428 16357 raft_consensus.cc:2468] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 14.
I20260709 13:07:41.324743 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:41.260011 21491 raft_consensus.cc:515] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:41.343449 21462 raft_consensus.cc:515] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:41.325518 16355 raft_consensus.cc:2468] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 12.
I20260709 13:07:41.332285 16348 raft_consensus.cc:1275] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:07:41.319545 21448 raft_consensus.cc:2804] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:07:41.381906 16354 raft_consensus.cc:2468] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 7.
W20260709 13:07:41.379127 21458 consensus_meta.cc:287] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3: Time spent flushing consensus metadata: real 0.694s	user 0.020s	sys 0.000s
I20260709 13:07:41.405014 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:41.324294 21455 raft_consensus.cc:697] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63 [term 13 LEADER]: Becoming Leader. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:07:41.416603 21455 consensus_queue.cc:237] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:41.419235 16278 raft_consensus.cc:2410] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:07:41.414484 16355 raft_consensus.cc:1275] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:07:41.415036 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:41.423672 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:41.424610 16354 raft_consensus.cc:2468] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 16.
I20260709 13:07:41.425288 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:41.425748 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:41.426642 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:41.426965 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:41.427284 16349 raft_consensus.cc:2468] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 12.
I20260709 13:07:41.427639 16355 raft_consensus.cc:2468] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 8.
I20260709 13:07:41.428361 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:41.428521 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:41.429065 16355 raft_consensus.cc:2468] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 13.
I20260709 13:07:41.429155 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:41.379386 21503 raft_consensus.cc:2804] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:41.431002 21503 raft_consensus.cc:493] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:41.431514 21503 raft_consensus.cc:3060] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:41.426335 16354 raft_consensus.cc:2468] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 10.
I20260709 13:07:41.434837 21349 leader_election.cc:290] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:41.435703 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:41.435950 21462 leader_election.cc:290] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:41.389257 21448 raft_consensus.cc:697] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:07:41.388224 21482 consensus_queue.cc:1048] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.054s
I20260709 13:07:41.441602 16353 raft_consensus.cc:2468] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 14.
I20260709 13:07:41.443151 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:07:41.384654 21321 consensus_meta.cc:287] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f: Time spent flushing consensus metadata: real 0.518s	user 0.006s	sys 0.007s
W20260709 13:07:41.444368 16248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.438256 16349 raft_consensus.cc:2468] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 15.
W20260709 13:07:41.453037 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 127707us
I20260709 13:07:41.455431 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:41.459811 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c15d8e9be8414c84912ab77b66bfb1" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:41.461199 21249 leader_election.cc:290] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 15 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:41.463390 16351 raft_consensus.cc:1240] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:41.464860 21457 raft_consensus.cc:2749] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:41.465175 21475 leader_election.cc:290] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:41.386757 21477 raft_consensus.cc:493] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:41.468456 21477 raft_consensus.cc:515] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:41.457849 21321 raft_consensus.cc:515] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:41.471228 21321 leader_election.cc:290] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 17 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:41.471935 21478 leader_election.cc:290] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:41.472159 16203 raft_consensus.cc:2393] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 17: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
W20260709 13:07:41.466431 21497 log.cc:927] Time spent T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:07:41.475099 21491 leader_election.cc:290] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:41.476263 21491 raft_consensus.cc:493] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:41.477787 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:41.453182 16357 raft_consensus.cc:2468] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 16.
I20260709 13:07:41.485059 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:41.486130 16282 raft_consensus.cc:2368] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for earlier term 12. Current term is 13.
I20260709 13:07:41.491405 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:41.496001 16357 raft_consensus.cc:2468] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 15.
W20260709 13:07:41.496927 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 120764us
I20260709 13:07:41.498898 16949 raft_consensus.cc:1240] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:41.501062 16202 raft_consensus.cc:2410] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for term 15 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:07:41.507513 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:41.508314 16353 raft_consensus.cc:2376] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 7. Re-sending same reply.
I20260709 13:07:41.515120 16942 raft_consensus.cc:1275] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:07:41.515394 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:41.516099 16281 raft_consensus.cc:2468] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 13.
I20260709 13:07:41.438167 21448 consensus_queue.cc:237] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:41.528226 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:41.476828 21491 raft_consensus.cc:515] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:41.528960 16283 raft_consensus.cc:2468] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 12.
I20260709 13:07:41.531978 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:41.533890 16280 raft_consensus.cc:3060] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Advancing to term 15
W20260709 13:07:41.527498 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 160489us
I20260709 13:07:41.544621 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:41.545586 16353 raft_consensus.cc:2376] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 16. Re-sending same reply.
I20260709 13:07:41.507851 21477 leader_election.cc:290] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:07:41.553205 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.559710 21456 raft_consensus.cc:515] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:41.563064 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:41.563247 16320 leader_election.cc:304] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:41.564352 16320 leader_election.cc:304] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:41.564443 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:41.565156 16205 raft_consensus.cc:2468] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 16.
I20260709 13:07:41.565670 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:41.566020 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:41.566241 21475 raft_consensus.cc:2804] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:41.566787 21475 raft_consensus.cc:493] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:41.566906 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:41.567185 21475 raft_consensus.cc:3060] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:07:41.568307 21504 log.cc:927] Time spent T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
W20260709 13:07:41.562304 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.569653 21477 raft_consensus.cc:2804] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:41.570086 21477 raft_consensus.cc:493] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:41.570429 21456 leader_election.cc:290] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:41.570447 21477 raft_consensus.cc:3060] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:41.572233 16202 raft_consensus.cc:1240] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 11. Current term is 12. Ops: []
W20260709 13:07:41.579994 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:41.589941 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 88341.8us
I20260709 13:07:41.593535 16320 leader_election.cc:304] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:41.597489 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:41.598436 16353 raft_consensus.cc:2468] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 9.
W20260709 13:07:41.597409 16173 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:41.614192 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 114414us
I20260709 13:07:41.624696 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:41.625918 16353 raft_consensus.cc:2393] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 19: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:07:41.599056 21473 raft_consensus.cc:2804] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:07:41.637370 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.638751 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:41.649073 16351 raft_consensus.cc:3060] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:41.638840 21456 raft_consensus.cc:493] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:41.646054 16280 raft_consensus.cc:2468] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 15.
W20260709 13:07:41.663048 16913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:41.690347 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:41.691290 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 44816.9us
I20260709 13:07:41.692935 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:41.693886 16357 raft_consensus.cc:2410] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for term 16 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:07:41.696750 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:41.697839 16353 raft_consensus.cc:2376] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 12. Re-sending same reply.
W20260709 13:07:41.716835 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 81829.2us
I20260709 13:07:41.717784 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:41.633442 21321 raft_consensus.cc:493] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.718513 16356 raft_consensus.cc:2468] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 12.
I20260709 13:07:41.647655 21473 raft_consensus.cc:493] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:41.725441 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:41.731721 16357 raft_consensus.cc:2393] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 8: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:07:41.733804 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:41.738493 16353 raft_consensus.cc:1275] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:07:41.745735 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:41.746424 16353 raft_consensus.cc:2468] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 11.
W20260709 13:07:41.751070 16248 leader_election.cc:336] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 1.857s (SENT)
W20260709 13:07:41.751612 21506 log.cc:927] Time spent T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.146s	user 0.001s	sys 0.000s
I20260709 13:07:41.752931 21509 raft_consensus.cc:493] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.753551 21509 raft_consensus.cc:515] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:41.722026 21382 raft_consensus.cc:493] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.735730 21473 raft_consensus.cc:3060] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:41.772606 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:41.779629 16357 raft_consensus.cc:2468] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 14.
I20260709 13:07:41.773353 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:41.775883 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:41.777510 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:41.780720 16276 raft_consensus.cc:3060] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:41.781054 16354 raft_consensus.cc:2468] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 14.
I20260709 13:07:41.738041 21502 raft_consensus.cc:493] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:41.786813 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:41.786975 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:41.787544 16354 raft_consensus.cc:2376] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 14. Re-sending same reply.
I20260709 13:07:41.792346 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:41.793192 16348 raft_consensus.cc:3060] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:41.794180 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c15d8e9be8414c84912ab77b66bfb1" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
W20260709 13:07:41.796722 16173 leader_election.cc:336] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 1.562s (SENT)
I20260709 13:07:41.771402 21382 raft_consensus.cc:515] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:07:41.789319 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 193442us
I20260709 13:07:41.799454 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:41.738330 21456 raft_consensus.cc:515] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:41.802771 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:41.805161 16173 leader_election.cc:304] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:41.762379 21321 raft_consensus.cc:515] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:41.812127 21249 raft_consensus.cc:2749] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:41.797588 21479 leader_election.cc:290] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:41.814702 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:07:41.815434 16173 leader_election.cc:336] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 1.583s (SENT)
W20260709 13:07:41.816686 16173 leader_election.cc:336] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 1.584s (SENT)
I20260709 13:07:41.800753 21502 raft_consensus.cc:515] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:07:41.817978 16173 leader_election.cc:336] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 1.637s (SENT)
I20260709 13:07:41.818207 16356 raft_consensus.cc:2468] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 9.
I20260709 13:07:41.818697 21507 consensus_queue.cc:1059] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:07:41.819469 21502 leader_election.cc:290] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:41.819664 21249 raft_consensus.cc:3055] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:41.820117 21249 raft_consensus.cc:740] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:07:41.820139 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:41.815457 16357 raft_consensus.cc:2468] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 12.
I20260709 13:07:41.818446 16173 leader_election.cc:304] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:41.823148 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:41.815346 21321 leader_election.cc:290] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:41.783416 21461 consensus_queue.cc:1059] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:07:41.836398 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:41.837147 16354 raft_consensus.cc:2468] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 13.
I20260709 13:07:41.832813 16351 raft_consensus.cc:2468] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 11.
I20260709 13:07:41.841710 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:41.856181 21456 leader_election.cc:290] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:41.857151 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:41.858013 16947 raft_consensus.cc:2393] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 10: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
I20260709 13:07:41.860790 21509 leader_election.cc:290] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:41.861764 21491 leader_election.cc:290] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:41.863184 21249 consensus_queue.cc:260] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:41.864640 21249 raft_consensus.cc:3060] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:41.864447 21503 raft_consensus.cc:515] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:41.865736 16200 raft_consensus.cc:1240] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 17. Current term is 18. Ops: []
I20260709 13:07:41.819698 21470 consensus_queue.cc:1059] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.082s
I20260709 13:07:41.866710 21475 raft_consensus.cc:515] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:41.867442 21470 raft_consensus.cc:3055] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:41.867877 21470 raft_consensus.cc:740] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:41.868968 21475 leader_election.cc:290] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 17 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:41.871246 21451 raft_consensus.cc:493] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.872025 21451 raft_consensus.cc:515] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:41.874248 21451 leader_election.cc:290] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:41.876001 21461 raft_consensus.cc:3055] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:41.876549 21321 raft_consensus.cc:2749] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:41.877700 21475 consensus_queue.cc:1059] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:07:41.878795 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:41.932127 21488 raft_consensus.cc:493] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.968667 16357 raft_consensus.cc:3060] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:41.969112 21488 raft_consensus.cc:515] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:07:41.970017 16102 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38842 (request call id 219) took 16876 ms (client timeout 15000 ms). Trace:
I20260709 13:07:41.972085 21488 leader_election.cc:290] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:41.880235 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:41.883175 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:41.975224 16356 raft_consensus.cc:2468] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 13.
I20260709 13:07:41.976109 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:41.976378 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:41.977309 16356 raft_consensus.cc:2393] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 in current term 14: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:07:41.977383 16353 raft_consensus.cc:2393] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 in current term 9: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:07:41.883491 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:41.980664 16352 raft_consensus.cc:2468] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 12.
I20260709 13:07:41.886989 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:41.894717 21382 leader_election.cc:290] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:07:41.895310 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 77358.2us
I20260709 13:07:41.981758 16350 raft_consensus.cc:3060] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:41.909030 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c15d8e9be8414c84912ab77b66bfb1" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:41.869218 21470 consensus_queue.cc:260] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:07:41.970498 16102 rpcz_store.cc:269] 0709 13:07:25.093552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.127261 (+ 33709us) service_pool.cc:224] Handling call
0709 13:07:41.969901 (+16842640us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:40.592062 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:40.592754 (+   692us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:40.592807 (+    53us) write_op.cc:435] Acquired schema lock
0709 13:07:40.592843 (+    36us) tablet.cc:662] Decoding operations
0709 13:07:40.594024 (+  1181us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:40.594129 (+   105us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:40.594156 (+    27us) tablet.cc:685] Acquiring locks for 12 operations
0709 13:07:40.688313 (+ 94157us) tablet.cc:701] Row locks acquired
0709 13:07:40.688359 (+    46us) write_op.cc:260] PREPARE: finished
0709 13:07:40.688554 (+   195us) write_op.cc:270] Start()
0709 13:07:40.688714 (+   160us) write_op.cc:276] Timestamp: P: 1783602460688480 usec, L: 0
0709 13:07:40.688752 (+    38us) op_driver.cc:348] REPLICATION: starting
0709 13:07:40.689381 (+   629us) log.cc:844] Serialized 4796 byte log entry
0709 13:07:41.174722 (+485341us) op_driver.cc:464] REPLICATION: finished
0709 13:07:41.332237 (+157515us) write_op.cc:301] APPLY: starting
0709 13:07:41.384646 (+ 52409us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:41.517990 (+133344us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:41.518127 (+   137us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:41.765020 (+246893us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:41.765379 (+   359us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=24,key_file_lookups=24,delta_file_lookups=24,mrs_lookups=0
0709 13:07:41.765434 (+    55us) write_op.cc:312] APPLY: finished
0709 13:07:41.765928 (+   494us) log.cc:844] Serialized 113 byte log entry
0709 13:07:41.766162 (+   234us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:41.766309 (+   147us) write_op.cc:454] Released schema lock
0709 13:07:41.766384 (+    75us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:41.766898 (+   514us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:41.766952 (+    54us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":133694,"reported_tablets":45,"child_traces":[["op",{"apply.queue_time_us":97406,"apply.run_cpu_time_us":22897,"apply.run_wall_time_us":455401,"cfile_cache_hit":50,"cfile_cache_hit_bytes":54287,"num_ops":12,"prepare.queue_time_us":132918,"prepare.run_cpu_time_us":9672,"prepare.run_wall_time_us":144359,"raft.queue_time_us":268906,"raft.run_cpu_time_us":17823,"raft.run_wall_time_us":34297,"replication_time_us":485718,"thread_start_us":376076,"threads_started":4,"wal-append.queue_time_us":39941}]]}
I20260709 13:07:41.921478 16276 raft_consensus.cc:2468] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 17.
I20260709 13:07:41.921708 16204 raft_consensus.cc:1275] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:07:41.922410 21503 leader_election.cc:290] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 18 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:41.985545 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:41.986115 21470 raft_consensus.cc:3060] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:41.923285 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c15d8e9be8414c84912ab77b66bfb1" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:41.929113 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:41.930646 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:07:41.932296 16248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.927515 16348 raft_consensus.cc:2468] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 15.
I20260709 13:07:41.933364 16947 raft_consensus.cc:3060] T 4b962ceebb5c48c1914459ae0c0eff1b P 1109f76a0b7b443a84c0327c8707bc63 [term 10 LEARNER]: Advancing to term 12
I20260709 13:07:41.979310 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:41.907929 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:41.982822 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:41.978262 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:07:41.983991 16173 leader_election.cc:336] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 1.854s (SENT)
I20260709 13:07:41.912364 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:41.990352 21167 raft_consensus.cc:493] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.000291 16357 raft_consensus.cc:2468] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 17.
I20260709 13:07:42.041769 16353 raft_consensus.cc:2468] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 10.
I20260709 13:07:42.046133 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:42.046887 16282 raft_consensus.cc:2468] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 14.
I20260709 13:07:42.047827 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:42.047935 16173 leader_election.cc:304] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:42.048630 16352 raft_consensus.cc:3060] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:41.937212 21461 raft_consensus.cc:740] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:07:42.050983 16356 raft_consensus.cc:2393] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 in current term 9: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:07:42.050689 16914 leader_election.cc:304] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:07:42.041757 16941 raft_consensus.cc:2468] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 9.
I20260709 13:07:42.053644 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:42.109956 16348 raft_consensus.cc:3060] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:42.054904 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:42.105139 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
W20260709 13:07:42.109061 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:42.107916 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:42.112001 16357 raft_consensus.cc:2468] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 12.
I20260709 13:07:42.120039 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:42.120235 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:42.120929 16357 raft_consensus.cc:2468] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 10.
I20260709 13:07:42.121388 16351 raft_consensus.cc:2376] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 14. Re-sending same reply.
I20260709 13:07:42.120997 16208 raft_consensus.cc:2468] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 8.
I20260709 13:07:42.141139 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:42.055226 21382 raft_consensus.cc:3055] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:07:41.926487 21473 raft_consensus.cc:515] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:42.143666 21461 consensus_queue.cc:260] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:42.139429 21321 raft_consensus.cc:2749] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:42.140134 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:42.148649 16246 leader_election.cc:304] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:07:42.159329 16321 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:42.168437 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:42.145583 21494 consensus_queue.cc:1048] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 13:07:42.172884 16246 leader_election.cc:304] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:42.174813 16353 raft_consensus.cc:3055] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:42.176167 16353 raft_consensus.cc:740] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:42.177851 21510 raft_consensus.cc:2804] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:42.178458 21510 raft_consensus.cc:493] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:42.178879 21510 raft_consensus.cc:3060] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:42.179060 16353 consensus_queue.cc:260] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:42.180284 16353 raft_consensus.cc:3060] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:42.182868 21498 raft_consensus.cc:493] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.183490 21498 raft_consensus.cc:515] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:42.054831 21477 raft_consensus.cc:515] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:07:42.193665 21531 log.cc:927] Time spent T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:07:42.054092 21167 raft_consensus.cc:515] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:07:42.193924 21520 log.cc:927] Time spent T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 13:07:42.148404 21382 raft_consensus.cc:740] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:42.210286 16348 raft_consensus.cc:2468] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 13.
I20260709 13:07:42.219223 21451 raft_consensus.cc:493] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.219969 21451 raft_consensus.cc:515] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:42.191248 21458 raft_consensus.cc:3060] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:42.223537 16349 raft_consensus.cc:2368] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for earlier term 15. Current term is 16.
I20260709 13:07:42.234128 16353 raft_consensus.cc:1275] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 13:07:42.234802 16353 pending_rounds.cc:85] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e: Aborting all ops after (but not including) 9
I20260709 13:07:42.235119 16353 pending_rounds.cc:107] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 13:07:42.235461 16353 raft_consensus.cc:2889] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:07:42.238444 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 256447us
W20260709 13:07:42.240777 16320 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:42.242036 16248 leader_election.cc:336] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 2.400s (SENT)
I20260709 13:07:42.243095 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:42.244763 16348 raft_consensus.cc:2376] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 13. Re-sending same reply.
I20260709 13:07:42.211714 21502 raft_consensus.cc:2804] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:42.251093 16248 leader_election.cc:304] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
W20260709 13:07:42.252672 16173 leader_election.cc:336] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 1.906s (SENT)
I20260709 13:07:42.256912 16173 leader_election.cc:304] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:42.225961 21461 raft_consensus.cc:3060] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:42.266185 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:42.267005 16353 raft_consensus.cc:2468] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 13.
I20260709 13:07:42.288322 21167 leader_election.cc:290] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:07:42.288877 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 66784.2us
I20260709 13:07:42.292356 21473 leader_election.cc:290] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 16 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:42.303339 21477 leader_election.cc:290] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 16 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:42.308269 21308 raft_consensus.cc:493] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:42.309171 21308 raft_consensus.cc:515] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:42.310951 21382 consensus_queue.cc:260] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:42.312208 21382 raft_consensus.cc:3060] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:42.314121 21308 leader_election.cc:290] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:42.264019 21490 raft_consensus.cc:2749] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:07:42.317624 16913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:42.267452 21503 raft_consensus.cc:2749] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:42.318907 16354 raft_consensus.cc:2468] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 12.
I20260709 13:07:42.255932 21163 raft_consensus.cc:493] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.256538 21502 raft_consensus.cc:493] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:42.343807 16352 raft_consensus.cc:2468] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 13.
I20260709 13:07:42.347873 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:42.351172 16947 raft_consensus.cc:1275] T 4b962ceebb5c48c1914459ae0c0eff1b P 1109f76a0b7b443a84c0327c8707bc63 [term 12 LEARNER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
W20260709 13:07:42.343552 21524 log.cc:927] Time spent T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.126s	user 0.007s	sys 0.000s
I20260709 13:07:42.344013 21502 raft_consensus.cc:3060] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:42.356626 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:07:42.351964 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 99349.4us
I20260709 13:07:42.357721 16352 raft_consensus.cc:2376] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 13. Re-sending same reply.
I20260709 13:07:42.361797 16350 raft_consensus.cc:2468] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 15.
W20260709 13:07:42.362010 16173 leader_election.cc:336] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 2.001s (SENT)
I20260709 13:07:42.362725 16173 leader_election.cc:304] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:42.343971 21163 raft_consensus.cc:515] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:42.369803 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:42.372228 16350 raft_consensus.cc:2393] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 in current term 9: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:07:42.401616 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:42.365788 21498 leader_election.cc:290] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:42.408665 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:42.424419 16282 raft_consensus.cc:2468] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 10.
W20260709 13:07:42.420516 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 62696.6us
I20260709 13:07:42.403393 16276 raft_consensus.cc:2410] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:07:42.430598 21163 leader_election.cc:290] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:42.431602 21444 raft_consensus.cc:493] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.432248 21401 raft_consensus.cc:493] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.432140 21444 raft_consensus.cc:515] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:42.432725 21401 raft_consensus.cc:515] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:42.433139 21494 raft_consensus.cc:493] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:42.433748 21494 raft_consensus.cc:515] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:42.434758 21401 leader_election.cc:290] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:42.436066 21494 leader_election.cc:290] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:42.436142 21493 raft_consensus.cc:493] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.437116 21493 raft_consensus.cc:515] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:07:42.437788 16320 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:42.438822 16203 raft_consensus.cc:1240] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 17. Current term is 18. Ops: []
I20260709 13:07:42.439769 21493 leader_election.cc:290] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:42.434409 21444 leader_election.cc:290] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:42.442035 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:42.442730 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:42.443665 16349 raft_consensus.cc:2393] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 in current term 14: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:07:42.443982 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:42.444753 16353 raft_consensus.cc:2368] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 14. Current term is 15.
I20260709 13:07:42.443742 16105 catalog_manager.cc:5697] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: config changed from index 5 to 7, term changed from 9 to 12, leader changed from 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) to <none>, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New cstate: current_term: 12 committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:07:42.445732 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:42.445603 16105 catalog_manager.cc:5697] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 9 to 13, leader changed from 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) to e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65). New cstate: current_term: 13 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } }
I20260709 13:07:42.446377 16348 raft_consensus.cc:2376] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 13. Re-sending same reply.
I20260709 13:07:42.446923 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:42.448067 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:07:42.449204 16173 leader_election.cc:336] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 2.048s (SENT)
I20260709 13:07:42.449110 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:42.455152 16349 raft_consensus.cc:2468] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 13.
I20260709 13:07:42.450845 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f022e2e63ae4461d834e476ff2666991" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:42.455892 16282 raft_consensus.cc:2468] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 9.
I20260709 13:07:42.437901 21510 raft_consensus.cc:515] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:42.458889 21510 leader_election.cc:290] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 15 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:42.459746 16205 raft_consensus.cc:1275] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:07:42.461067 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:42.461723 16202 raft_consensus.cc:2468] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 16.
I20260709 13:07:42.461966 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:42.462610 16203 raft_consensus.cc:2468] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 16.
I20260709 13:07:42.462790 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bc3c8ff9b84838a2664335d7e1582b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:42.463656 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:07:42.464578 16173 leader_election.cc:336] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 2.059s (SENT)
W20260709 13:07:42.420459 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 271509us
I20260709 13:07:42.465843 16201 raft_consensus.cc:2468] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 16.
I20260709 13:07:42.469540 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:42.471901 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f022e2e63ae4461d834e476ff2666991" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:42.472259 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:42.472653 16199 raft_consensus.cc:2468] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 9.
I20260709 13:07:42.473909 16205 raft_consensus.cc:2393] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 18: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:07:42.477245 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:42.478292 16944 raft_consensus.cc:2468] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 16.
I20260709 13:07:42.474238 16320 leader_election.cc:304] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:42.386319 21451 leader_election.cc:290] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:42.465925 16105 catalog_manager.cc:5697] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 11 to 14, leader changed from 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) to 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66). New cstate: current_term: 14 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } }
W20260709 13:07:42.486101 16173 leader_election.cc:336] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 2.072s (SENT)
I20260709 13:07:42.487514 16173 leader_election.cc:304] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:42.491320 16353 raft_consensus.cc:1240] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 16 LEADER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:42.491811 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f022e2e63ae4461d834e476ff2666991" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:42.492476 16941 raft_consensus.cc:2468] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 9.
I20260709 13:07:42.493239 16914 leader_election.cc:304] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:07:42.487226 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:42.495255 16200 raft_consensus.cc:2468] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 16.
I20260709 13:07:42.496018 16248 leader_election.cc:304] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:07:42.500138 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:42.502055 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:07:42.484624 21533 log.cc:927] Time spent T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:07:42.499101 16248 leader_election.cc:304] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:07:42.503315 16350 raft_consensus.cc:2393] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 in current term 9: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:07:42.501248 16246 leader_election.cc:304] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:42.504633 16914 leader_election.cc:304] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
W20260709 13:07:42.496281 21537 log.cc:927] Time spent T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:07:42.509938 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f022e2e63ae4461d834e476ff2666991" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:42.510118 21539 raft_consensus.cc:2804] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:42.508198 21477 raft_consensus.cc:2804] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:07:42.512018 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:42.486711 21448 consensus_queue.cc:1048] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:07:42.502336 21461 raft_consensus.cc:2749] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:42.512514 21538 raft_consensus.cc:2804] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:42.501997 16105 catalog_manager.cc:5697] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "1109f76a0b7b443a84c0327c8707bc63" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:07:42.490630 21503 raft_consensus.cc:2749] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:42.473063 21490 consensus_queue.cc:1048] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
W20260709 13:07:42.507387 21527 log.cc:927] Time spent T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.101s	user 0.004s	sys 0.000s
I20260709 13:07:42.514520 16199 raft_consensus.cc:2468] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 9.
I20260709 13:07:42.555464 21477 raft_consensus.cc:697] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 16 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:42.555701 21538 raft_consensus.cc:493] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:42.556250 21538 raft_consensus.cc:3060] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:42.556674 21477 consensus_queue.cc:237] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:42.535279 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:07:42.537658 21535 log.cc:927] Time spent T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 13:07:42.559902 21458 raft_consensus.cc:2749] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:42.535781 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:42.507880 21308 raft_consensus.cc:2804] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:42.561384 21308 raft_consensus.cc:493] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:42.561769 21308 raft_consensus.cc:3060] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:42.563232 16348 raft_consensus.cc:2468] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 11.
I20260709 13:07:42.556452 16105 catalog_manager.cc:5697] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } }
I20260709 13:07:42.505105 21494 raft_consensus.cc:2804] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:42.521718 16277 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45218 (request call id 2390) took 1018 ms. Trace:
W20260709 13:07:42.534937 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 50669.5us
W20260709 13:07:42.553879 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 47089.4us
I20260709 13:07:42.519174 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:42.536389 21539 raft_consensus.cc:493] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:42.581403 16912 leader_election.cc:304] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
W20260709 13:07:42.508996 21530 log.cc:927] Time spent T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63: Append to log took a long time: real 0.094s	user 0.000s	sys 0.004s
I20260709 13:07:42.543113 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:42.592705 16351 raft_consensus.cc:2468] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 12.
I20260709 13:07:42.576169 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:42.545910 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:42.535801 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:42.542810 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c15d8e9be8414c84912ab77b66bfb1" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:42.533499 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:42.595106 16353 raft_consensus.cc:2393] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 13: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
W20260709 13:07:42.589151 16173 leader_election.cc:336] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 2.088s (SENT)
I20260709 13:07:42.577471 16277 rpcz_store.cc:276] 0709 13:07:41.503596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:41.503755 (+   159us) service_pool.cc:224] Handling call
0709 13:07:41.528409 (+ 24654us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:41.596846 (+ 68437us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:41.596879 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:41.624319 (+ 27440us) log.cc:844] Serialized 26 byte log entry
0709 13:07:42.051385 (+427066us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:42.051430 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:42.051548 (+   118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:42.293479 (+241931us) spinlock_profiling.cc:243] Waited 13.2 ms on lock 0x7b4400022b4c. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361c224db1 00007f361c2c2c85 00007f361c2c36a2 00007f361f0351db 00007f361f030aaf 00007f361f02486e 00007f361f023bb6 00007f361f0237d8 00007f361f02d221 00007f361f02d1d9 00007f361f02d169
0709 13:07:42.518229 (+224750us) raft_consensus.cc:1685] finished
0709 13:07:42.518251 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:42.521642 (+  3391us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10695,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":2266,"spinlock_wait_cycles":30282496,"thread_start_us":317531,"threads_started":1,"wal-append.queue_time_us":422768}
I20260709 13:07:42.596802 16350 raft_consensus.cc:2410] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:07:42.597941 16354 raft_consensus.cc:2468] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 15.
W20260709 13:07:42.591073 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 86524us
I20260709 13:07:42.536214 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:07:42.599103 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:42.587132 21539 raft_consensus.cc:3060] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:42.601135 16355 raft_consensus.cc:2410] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for term 13 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
W20260709 13:07:42.603806 16248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:42.607224 16173 leader_election.cc:304] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
W20260709 13:07:42.610178 16914 leader_election.cc:336] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 1.776s (SENT)
I20260709 13:07:42.610744 16914 leader_election.cc:304] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:42.615358 16351 raft_consensus.cc:1275] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:07:42.580476 21494 raft_consensus.cc:493] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:42.619231 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:42.620934 21461 raft_consensus.cc:2749] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:42.621271 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:42.630688 21534 raft_consensus.cc:2749] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:07:42.632092 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 52839.6us
W20260709 13:07:42.632844 16173 leader_election.cc:336] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 2.097s (SENT)
I20260709 13:07:42.633256 16173 leader_election.cc:304] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:42.633821 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:42.631832 16105 catalog_manager.cc:5697] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 9 to 13, leader changed from <none> to 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66), now has a pending config: VOTER e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65), VOTER 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66), VOTER 363bb2f744eb486f9ad726f08214c98e (127.14.180.67), VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68). New cstate: current_term: 13 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
W20260709 13:07:42.634470 16173 leader_election.cc:336] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 2.114s (SENT)
I20260709 13:07:42.634811 21461 raft_consensus.cc:2749] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:42.635931 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:42.634526 16352 raft_consensus.cc:2468] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 13.
I20260709 13:07:42.637259 21502 raft_consensus.cc:515] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:42.599901 21167 raft_consensus.cc:2804] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:42.594197 21163 raft_consensus.cc:2804] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:07:42.640530 16914 leader_election.cc:336] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 1.829s (SENT)
I20260709 13:07:42.640415 16173 leader_election.cc:304] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:42.641006 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:42.638917 21494 raft_consensus.cc:3060] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:42.642596 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:42.649852 16348 raft_consensus.cc:2468] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 14.
I20260709 13:07:42.650399 16350 raft_consensus.cc:2368] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 16. Current term is 17.
I20260709 13:07:42.644922 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:42.646020 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:42.646692 16105 catalog_manager.cc:5697] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 10 to 12, leader changed from e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) to 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66). New cstate: current_term: 12 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:42.649207 16914 leader_election.cc:304] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:42.653306 16352 raft_consensus.cc:3060] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:42.655085 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:42.657411 16355 raft_consensus.cc:2393] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 13: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
I20260709 13:07:42.659010 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:42.659799 16353 raft_consensus.cc:2468] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 11.
I20260709 13:07:42.649044 21167 raft_consensus.cc:493] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:42.648730 21163 raft_consensus.cc:493] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:42.671859 16352 raft_consensus.cc:2468] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 12.
W20260709 13:07:42.673259 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 171999us
I20260709 13:07:42.688165 16105 catalog_manager.cc:5697] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } }
W20260709 13:07:42.694169 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 59743.2us
I20260709 13:07:42.663373 21461 raft_consensus.cc:2749] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:42.682083 21167 raft_consensus.cc:3060] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:42.683239 21163 raft_consensus.cc:3060] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:07:42.702792 16173 leader_election.cc:336] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 2.141s (SENT)
I20260709 13:07:42.685367 21541 raft_consensus.cc:2749] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:42.709020 16105 catalog_manager.cc:5697] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 14 to 15, leader changed from e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) to 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66). New cstate: current_term: 15 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:42.721030 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:42.721756 16350 raft_consensus.cc:3060] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:07:42.725342 16321 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:42.728331 16248 leader_election.cc:336] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 1.665s (SENT)
W20260709 13:07:42.747489 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 52303.8us
I20260709 13:07:42.749117 21461 consensus_queue.cc:1059] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:42.750401 21461 consensus_queue.cc:1048] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:07:42.751263 21461 consensus_queue.cc:1243] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer 1109f76a0b7b443a84c0327c8707bc63 log is divergent from this leader: its last log entry 11.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:07:42.752841 21461 raft_consensus.cc:3055] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:42.753319 21461 raft_consensus.cc:740] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:07:42.760900 21308 raft_consensus.cc:515] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:42.702530 21505 raft_consensus.cc:493] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.762305 21505 raft_consensus.cc:515] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:42.763659 16173 leader_election.cc:400] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 pre-election: Vote denied by peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823) with higher term. Message: Invalid argument: T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for earlier term 12. Current term is 13.
I20260709 13:07:42.764057 16173 leader_election.cc:403] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:42.764837 21505 leader_election.cc:290] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:42.766387 21249 raft_consensus.cc:2749] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823) with higher term. Message: Invalid argument: T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for earlier term 12. Current term is 13.
I20260709 13:07:42.767807 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:42.768515 16277 raft_consensus.cc:3060] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:42.779588 21167 raft_consensus.cc:515] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:42.781670 16248 leader_election.cc:304] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:42.800758 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:42.801576 16199 raft_consensus.cc:2468] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 14.
I20260709 13:07:42.802965 16105 catalog_manager.cc:5697] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "1109f76a0b7b443a84c0327c8707bc63" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:07:42.816728 16912 leader_election.cc:304] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:42.814983 16105 catalog_manager.cc:5697] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 9 to 10, leader changed from 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) to 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66). New cstate: current_term: 10 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:42.823796 21508 raft_consensus.cc:2804] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:42.824311 21508 raft_consensus.cc:493] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:42.824705 21508 raft_consensus.cc:3060] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:42.831861 21167 leader_election.cc:290] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 10 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:42.833302 21308 leader_election.cc:290] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:42.834403 21508 raft_consensus.cc:515] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:42.800232 21444 raft_consensus.cc:2749] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:42.837461 21508 leader_election.cc:290] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 15 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:42.837716 21494 raft_consensus.cc:515] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:42.840224 21494 leader_election.cc:290] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 17 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:42.838016 16105 catalog_manager.cc:5697] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 7 to 8, leader changed from 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) to 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66). New cstate: current_term: 8 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:42.849938 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f022e2e63ae4461d834e476ff2666991" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:42.851087 16205 raft_consensus.cc:3060] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:42.855198 16350 raft_consensus.cc:2468] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 16.
I20260709 13:07:42.856331 16105 catalog_manager.cc:5697] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 12 to 15, leader changed from e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) to 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66). New cstate: current_term: 15 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } }
W20260709 13:07:42.863646 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 100163us
W20260709 13:07:42.857635 16320 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:42.864755 16320 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:42.857726 16277 raft_consensus.cc:2468] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 15.
I20260709 13:07:42.859215 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f022e2e63ae4461d834e476ff2666991" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:42.866236 16278 raft_consensus.cc:2393] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 in current term 10: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
W20260709 13:07:42.867156 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 138876us
I20260709 13:07:42.869910 16105 catalog_manager.cc:5697] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 7 to 10. New cstate: current_term: 10 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:42.834448 21502 leader_election.cc:290] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:42.878448 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:42.874083 16105 catalog_manager.cc:5697] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "1109f76a0b7b443a84c0327c8707bc63" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:07:42.754397 21461 consensus_queue.cc:260] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:42.887398 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f022e2e63ae4461d834e476ff2666991" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:07:42.888255 16944 raft_consensus.cc:2393] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 10: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
I20260709 13:07:42.883807 16105 catalog_manager.cc:5697] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } }
I20260709 13:07:42.891148 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:07:42.891325 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:42.894418 16944 raft_consensus.cc:3060] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:42.899278 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:42.899925 16199 raft_consensus.cc:3060] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:42.895120 16351 raft_consensus.cc:2468] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 12.
I20260709 13:07:42.865677 16173 leader_election.cc:304] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:42.907007 16205 raft_consensus.cc:2468] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 10.
I20260709 13:07:42.909765 16349 raft_consensus.cc:1240] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 18. Current term is 19. Ops: []
I20260709 13:07:42.910209 16912 leader_election.cc:304] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:42.911108 16173 leader_election.cc:304] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:42.921417 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:07:42.922504 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:42.923233 16105 catalog_manager.cc:5697] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 4 to 8, leader changed from 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) to 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66). New cstate: current_term: 8 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:42.932675 16944 raft_consensus.cc:2468] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 10.
I20260709 13:07:42.890142 21538 raft_consensus.cc:515] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:07:42.943397 16913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:42.943961 16914 leader_election.cc:304] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:42.944526 16248 leader_election.cc:304] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:07:42.946269 21503 raft_consensus.cc:2804] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:42.946815 21261 raft_consensus.cc:2804] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:42.948544 21167 raft_consensus.cc:2804] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:42.948623 21261 raft_consensus.cc:697] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 15 LEADER]: Becoming Leader. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:07:42.949493 21167 raft_consensus.cc:697] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 LEADER]: Becoming Leader. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:07:42.939589 16105 catalog_manager.cc:5697] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 13 to 18, leader changed from 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) to 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66). New cstate: current_term: 18 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:42.971892 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:42.972791 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:42.972875 16205 raft_consensus.cc:3060] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:07:42.974022 16353 raft_consensus.cc:2393] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 13: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
I20260709 13:07:42.979667 16199 raft_consensus.cc:2468] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 15.
I20260709 13:07:42.978300 16105 catalog_manager.cc:5697] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 6 to 9, leader changed from 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) to e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65). New cstate: current_term: 9 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:07:42.950095 21261 consensus_queue.cc:237] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:42.946841 21503 raft_consensus.cc:493] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:42.991079 16912 leader_election.cc:304] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:42.993968 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f022e2e63ae4461d834e476ff2666991" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:42.994647 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:42.995409 16206 raft_consensus.cc:3060] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:42.953456 21163 raft_consensus.cc:515] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:43.002132 16943 raft_consensus.cc:2393] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 17: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
I20260709 13:07:42.950529 21167 consensus_queue.cc:237] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:42.971367 21544 raft_consensus.cc:2804] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:43.009033 21544 raft_consensus.cc:697] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:07:43.010044 21544 consensus_queue.cc:237] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:43.013556 21539 raft_consensus.cc:515] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:43.014746 21541 raft_consensus.cc:2804] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:43.015390 21541 raft_consensus.cc:697] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [term 15 LEADER]: Becoming Leader. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:07:43.016433 21541 consensus_queue.cc:237] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:42.994035 21448 raft_consensus.cc:1064] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3: attempting to promote NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 to VOTER
I20260709 13:07:42.990136 21552 raft_consensus.cc:2804] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:43.023954 21552 raft_consensus.cc:493] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:43.024415 21552 raft_consensus.cc:3060] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:42.991775 21503 raft_consensus.cc:3060] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:43.010411 21494 raft_consensus.cc:493] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:43.032799 21494 raft_consensus.cc:515] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:43.035898 21494 leader_election.cc:290] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:42.994956 16208 raft_consensus.cc:2393] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 10: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
I20260709 13:07:43.040367 16200 raft_consensus.cc:1275] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:07:43.039371 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:43.041326 16105 catalog_manager.cc:5697] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 6 to 10, leader changed from 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) to 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66). New cstate: current_term: 10 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:43.044471 16353 raft_consensus.cc:2468] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 19.
W20260709 13:07:43.048146 16248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:43.048818 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 137797us
I20260709 13:07:43.050014 16173 leader_election.cc:304] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:43.064441 21556 raft_consensus.cc:2804] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:43.049991 16105 catalog_manager.cc:5697] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: config changed from index -1 to 6, term changed from 7 to 10, leader changed from e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) to 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66), NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New cstate: current_term: 10 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } health_report { overall_health: HEALTHY } } }
W20260709 13:07:43.069871 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:43.066752 16248 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 1.985s (SENT) [suppressed 69 similar messages]
I20260709 13:07:43.076733 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:43.077441 16349 raft_consensus.cc:2376] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 12. Re-sending same reply.
I20260709 13:07:43.077843 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:43.079416 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:43.081374 16246 leader_election.cc:304] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:43.084190 21494 raft_consensus.cc:2749] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:43.085206 21461 raft_consensus.cc:3060] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:43.063639 21485 consensus_queue.cc:1048] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.022s
I20260709 13:07:43.088025 21539 leader_election.cc:290] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 17 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:43.092329 16205 raft_consensus.cc:2468] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 10.
I20260709 13:07:43.074901 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c15d8e9be8414c84912ab77b66bfb1" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:43.113291 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:43.114215 16353 raft_consensus.cc:2410] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for term 12 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:07:43.025658 21448 consensus_queue.cc:237] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 8, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:43.098515 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:43.118959 16200 raft_consensus.cc:3060] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:43.098699 16105 catalog_manager.cc:5697] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 7 to 9, leader changed from 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) to 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66). New cstate: current_term: 9 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:43.119498 16349 raft_consensus.cc:1275] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:07:43.092489 21163 leader_election.cc:290] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 17 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:43.107630 16206 raft_consensus.cc:2468] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 17.
I20260709 13:07:43.095490 21452 raft_consensus.cc:493] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
W20260709 13:07:43.121815 16914 leader_election.cc:336] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 3.313s (SENT)
I20260709 13:07:43.114523 16278 raft_consensus.cc:2393] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 in current term 17: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:07:43.124711 16246 leader_election.cc:304] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:07:43.130813 16105 catalog_manager.cc:5697] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 11 to 14, leader changed from 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) to 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66). New cstate: current_term: 14 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:43.106562 21498 raft_consensus.cc:493] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:43.136854 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:43.138811 16280 raft_consensus.cc:3060] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:43.143205 16914 leader_election.cc:304] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:43.130278 21452 raft_consensus.cc:515] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:43.162168 21452 leader_election.cc:290] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:43.145989 21498 raft_consensus.cc:515] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:43.164248 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bc3c8ff9b84838a2664335d7e1582b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:43.165248 21498 leader_election.cc:290] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:43.166049 16350 raft_consensus.cc:1275] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:07:43.166240 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:43.167034 16349 raft_consensus.cc:2368] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 16. Current term is 17.
I20260709 13:07:43.167141 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:43.168005 16350 raft_consensus.cc:2393] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 13: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
I20260709 13:07:43.166968 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:43.169046 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:43.166306 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:43.169978 16356 raft_consensus.cc:2393] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 16: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:07:43.171008 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:43.171736 16351 raft_consensus.cc:2468] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 18.
I20260709 13:07:43.168030 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
W20260709 13:07:43.173769 16914 leader_election.cc:336] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 1.558s (SENT)
I20260709 13:07:43.174365 16914 leader_election.cc:304] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:43.166960 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:43.178992 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:43.181712 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:43.182911 16354 raft_consensus.cc:2468] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 14.
I20260709 13:07:43.186825 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:07:43.187896 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 135109us
I20260709 13:07:43.189344 16173 leader_election.cc:304] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:43.134044 21556 raft_consensus.cc:697] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 15 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:07:43.141196 21487 raft_consensus.cc:2804] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:07:43.201321 16248 leader_election.cc:336] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 2.177s (SENT)
I20260709 13:07:43.215770 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:43.203613 16200 raft_consensus.cc:2468] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 17.
I20260709 13:07:43.214846 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:43.217056 21452 raft_consensus.cc:2749] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:43.216390 16248 leader_election.cc:304] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:43.218649 16246 leader_election.cc:304] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:43.222388 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:43.223369 16941 raft_consensus.cc:2368] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for earlier term 9. Current term is 10.
I20260709 13:07:43.225243 16944 raft_consensus.cc:1240] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 15 LEADER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 14. Current term is 15. Ops: [12.11-14.12]
I20260709 13:07:43.226435 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:43.150233 21163 raft_consensus.cc:2749] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:07:43.227280 16282 raft_consensus.cc:2468] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 10.
I20260709 13:07:43.233897 16914 leader_election.cc:304] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:07:43.236449 16280 raft_consensus.cc:2468] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 11.
I20260709 13:07:43.230304 21561 raft_consensus.cc:2804] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:07:43.199724 21563 raft_consensus.cc:493] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:43.238984 16914 leader_election.cc:304] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:07:43.264643 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:43.265374 16282 raft_consensus.cc:3060] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:43.267175 16283 raft_consensus.cc:1275] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
W20260709 13:07:43.267834 21553 log.cc:927] Time spent T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.162s	user 0.000s	sys 0.000s
I20260709 13:07:43.262257 21261 raft_consensus.cc:2804] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:43.269722 21261 raft_consensus.cc:493] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:43.270120 21261 raft_consensus.cc:3060] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:43.270766 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:43.271437 16354 raft_consensus.cc:2376] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 16. Re-sending same reply.
I20260709 13:07:43.272403 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:43.274807 16205 raft_consensus.cc:2468] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 10.
I20260709 13:07:43.276587 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:43.277170 16357 raft_consensus.cc:2376] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 12. Re-sending same reply.
I20260709 13:07:43.215454 21538 leader_election.cc:290] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 11 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:43.278074 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:43.278232 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:43.283435 16349 raft_consensus.cc:2410] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for term 13 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:07:43.275867 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
W20260709 13:07:43.278652 16321 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:43.276351 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:43.274989 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:43.283517 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
W20260709 13:07:43.394331 16173 leader_election.cc:336] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 1.519s (SENT)
W20260709 13:07:43.339643 16914 leader_election.cc:336] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 2.168s (SENT)
I20260709 13:07:43.397679 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:07:43.397943 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 58348.5us
I20260709 13:07:43.341447 16276 raft_consensus.cc:1275] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
W20260709 13:07:43.400272 16913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:43.360345 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:43.275867 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:43.397374 16351 raft_consensus.cc:2468] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 7.
W20260709 13:07:43.401739 16914 leader_election.cc:336] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 2.172s (SENT)
I20260709 13:07:43.402271 16914 leader_election.cc:304] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
W20260709 13:07:43.508090 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 113803us
W20260709 13:07:43.508834 16173 leader_election.cc:336] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 1.833s (SENT)
I20260709 13:07:43.509261 16173 leader_election.cc:304] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:43.509624 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:43.510696 16280 raft_consensus.cc:2393] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 17: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
W20260709 13:07:43.514698 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 112993us
W20260709 13:07:43.515489 16320 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:43.264683 21484 raft_consensus.cc:2749] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:43.265486 21493 raft_consensus.cc:2804] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:07:43.389783 21559 log.cc:927] Time spent T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
W20260709 13:07:43.516008 16320 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:43.284690 21541 raft_consensus.cc:2804] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:43.527055 16282 raft_consensus.cc:2468] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 18.
I20260709 13:07:43.527988 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
W20260709 13:07:43.537324 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 336022us
W20260709 13:07:43.583586 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:43.239370 21487 raft_consensus.cc:697] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:07:43.593868 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:43.514564 21477 raft_consensus.cc:493] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:43.597476 16279 raft_consensus.cc:1275] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:07:43.276609 21563 raft_consensus.cc:515] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:43.644847 21249 raft_consensus.cc:2749] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:07:43.509161 21505 raft_consensus.cc:2749] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:43.643554 21477 raft_consensus.cc:515] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:07:43.647241 16248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:43.590245 21493 raft_consensus.cc:697] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:07:43.628024 21561 raft_consensus.cc:697] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 17 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:07:43.512566 21556 consensus_queue.cc:237] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:43.695317 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:43.704964 16283 raft_consensus.cc:2393] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 17: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:07:43.722977 21563 leader_election.cc:290] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:43.739423 21493 consensus_queue.cc:237] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:43.768136 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:43.773077 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:43.781651 16941 raft_consensus.cc:2410] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:07:43.783208 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:43.783424 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:43.789258 16204 raft_consensus.cc:1275] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:07:43.771524 21541 raft_consensus.cc:697] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 LEADER]: Becoming Leader. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
W20260709 13:07:43.798961 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 290128us
W20260709 13:07:43.804281 16248 leader_election.cc:336] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 1.506s (SENT)
I20260709 13:07:43.805039 16248 leader_election.cc:304] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:07:43.795352 21503 consensus_meta.cc:287] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f: Time spent flushing consensus metadata: real 0.763s	user 0.012s	sys 0.001s
I20260709 13:07:43.757229 21487 consensus_queue.cc:237] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:43.872246 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:43.802081 21494 raft_consensus.cc:493] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
W20260709 13:07:43.832023 16173 leader_election.cc:336] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 2.165s (SENT)
W20260709 13:07:43.874150 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 69935.2us
W20260709 13:07:43.830288 16322 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:43.877559 16248 leader_election.cc:336] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 1.552s (SENT)
I20260709 13:07:43.878489 16248 leader_election.cc:304] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:43.884719 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
W20260709 13:07:43.890842 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 96810.1us
I20260709 13:07:43.834743 21503 raft_consensus.cc:515] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:43.912483 16914 leader_election.cc:304] T 540bfc4ad793452faea5b865343aacf7 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:07:43.916671 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 115849us
W20260709 13:07:43.917778 16173 leader_election.cc:336] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 2.189s (SENT)
I20260709 13:07:43.918318 16173 leader_election.cc:304] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:43.793366 21561 consensus_queue.cc:237] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:07:43.927076 16321 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:43.927204 16914 leader_election.cc:304] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:07:43.919368 21568 log.cc:927] Time spent T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.331s	user 0.001s	sys 0.000s
I20260709 13:07:43.902387 21484 raft_consensus.cc:2749] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:43.932542 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:43.879347 21494 raft_consensus.cc:515] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:07:43.934330 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 56831.6us
I20260709 13:07:43.904167 21163 consensus_queue.cc:1048] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 13:07:43.941254 16282 raft_consensus.cc:1240] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 LEADER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 16. Current term is 17. Ops: []
I20260709 13:07:43.948410 21494 leader_election.cc:290] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:07:43.951767 16247 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:43.959697 21569 log.cc:927] Time spent T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.364s	user 0.000s	sys 0.001s
I20260709 13:07:43.928797 21586 raft_consensus.cc:3060] T 540bfc4ad793452faea5b865343aacf7 P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:43.933657 21583 raft_consensus.cc:3060] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:43.902920 21541 consensus_queue.cc:237] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:07:43.984866 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 47514.4us
I20260709 13:07:43.942415 21477 leader_election.cc:290] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:07:43.993425 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 68795.4us
W20260709 13:07:43.993800 16173 connection.cc:256] RPC call timeout handler was delayed by -1.0984948680001025s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.28740000000000004s for a response
W20260709 13:07:43.994521 16173 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:43.994630 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 57460.6us
W20260709 13:07:43.997484 16320 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:43.974841 21487 raft_consensus.cc:2749] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:44.003257 16279 raft_consensus.cc:1275] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:07:44.005496 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:44.006915 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:44.007957 16941 raft_consensus.cc:2468] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 8.
I20260709 13:07:44.010043 16283 raft_consensus.cc:2410] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
W20260709 13:07:44.011368 16320 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:44.012010 16173 leader_election.cc:336] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 1.716s (SENT)
I20260709 13:07:44.011850 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:44.013142 16279 raft_consensus.cc:2468] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 15.
W20260709 13:07:44.013335 16173 leader_election.cc:336] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 1.716s (SENT)
I20260709 13:07:44.000309 21484 raft_consensus.cc:493] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.018077 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:07:44.021340 16173 leader_election.cc:336] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 1.722s (SENT)
I20260709 13:07:44.023638 16173 leader_election.cc:304] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:44.028568 16248 leader_election.cc:304] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:44.030097 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:44.040011 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:44.020162 21596 raft_consensus.cc:493] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.016516 21539 consensus_queue.cc:1048] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:07:44.017421 21544 consensus_queue.cc:1048] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:07:44.058898 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:07:44.044890 21261 consensus_meta.cc:287] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63: Time spent flushing consensus metadata: real 0.774s	user 0.014s	sys 0.000s
I20260709 13:07:44.062232 21493 raft_consensus.cc:2749] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:07:44.051025 21565 raft_consensus.cc:2749] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:44.062286 21578 consensus_queue.cc:1048] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.004s
I20260709 13:07:44.069212 21584 consensus_queue.cc:1048] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:44.069742 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:44.071875 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:44.073076 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:44.073681 16274 raft_consensus.cc:2468] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 16.
I20260709 13:07:44.021672 21484 raft_consensus.cc:515] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:44.058324 21596 raft_consensus.cc:515] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:44.074538 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:44.104130 16274 raft_consensus.cc:3060] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:44.078971 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:44.071877 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:44.111012 16280 raft_consensus.cc:3060] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:07:44.079825 16322 connection.cc:256] RPC call timeout handler was delayed by -2.1366523890000053s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15710000000000002s for a response
W20260709 13:07:44.113749 16322 connection.cc:256] RPC call timeout handler was delayed by -2.0736523890000171s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16410000000000002s for a response
W20260709 13:07:44.114144 16322 connection.cc:256] RPC call timeout handler was delayed by -2.0169523890000391s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1704s for a response
W20260709 13:07:44.114455 16322 connection.cc:256] RPC call timeout handler was delayed by -1.9971523890000071s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1726s for a response
W20260709 13:07:44.114997 16322 connection.cc:256] RPC call timeout handler was delayed by -1.8702523890000293s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1867s for a response
W20260709 13:07:44.115351 16322 connection.cc:256] RPC call timeout handler was delayed by -1.8702523890000293s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1867s for a response
W20260709 13:07:44.115710 16322 connection.cc:256] RPC call timeout handler was delayed by -1.8297523889999638s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1912s for a response
W20260709 13:07:44.116086 16322 connection.cc:256] RPC call timeout handler was delayed by -1.7937523890000193s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1952s for a response
W20260709 13:07:44.116454 16322 connection.cc:256] RPC call timeout handler was delayed by -1.7550523890000704s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1995s for a response
W20260709 13:07:44.116811 16322 connection.cc:256] RPC call timeout handler was delayed by -1.7550523890000704s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1995s for a response
W20260709 13:07:44.117177 16322 connection.cc:256] RPC call timeout handler was delayed by -1.6740523890000532s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20850000000000002s for a response
W20260709 13:07:44.117530 16322 connection.cc:256] RPC call timeout handler was delayed by -1.6470523890000095s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21150000000000002s for a response
W20260709 13:07:44.117884 16322 connection.cc:256] RPC call timeout handler was delayed by -1.3734523890000219s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2419s for a response
W20260709 13:07:44.156029 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 97752.6us
I20260709 13:07:44.068624 16283 raft_consensus.cc:2393] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 16: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
W20260709 13:07:44.168558 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:44.168866 16322 leader_election.cc:304] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:44.171203 16199 raft_consensus.cc:3055] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:44.171823 16199 raft_consensus.cc:740] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:07:44.172912 16199 consensus_queue.cc:260] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:44.174804 16199 raft_consensus.cc:3060] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:07:44.080453 21567 log.cc:927] Time spent T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63: Append to log took a long time: real 0.455s	user 0.003s	sys 0.000s
I20260709 13:07:44.179262 16279 raft_consensus.cc:2393] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 17: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:07:44.179783 16280 raft_consensus.cc:2468] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 17.
I20260709 13:07:44.088582 21261 raft_consensus.cc:515] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:44.184015 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:44.187891 16205 raft_consensus.cc:1275] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
W20260709 13:07:44.185168 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 144079us
I20260709 13:07:44.189630 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:44.190513 16276 raft_consensus.cc:2393] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 16: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:07:44.189555 16199 raft_consensus.cc:1275] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 12. (term mismatch)
I20260709 13:07:44.191233 16199 pending_rounds.cc:85] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f: Aborting all ops after (but not including) 11
W20260709 13:07:44.175632 21562 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.003s	sys 0.006s
W20260709 13:07:44.180553 21552 consensus_meta.cc:287] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f: Time spent flushing consensus metadata: real 1.156s	user 0.013s	sys 0.008s
I20260709 13:07:44.196749 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:44.191570 16199 pending_rounds.cc:107] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f: Aborting uncommitted NO_OP operation due to leader change: 14.12
I20260709 13:07:44.199652 16199 raft_consensus.cc:2889] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:44.198307 16205 raft_consensus.cc:3060] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:44.202406 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 44374.1us
I20260709 13:07:44.202992 16199 raft_consensus.cc:1275] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:07:44.194124 16349 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aee913c41fb9437587affa768953f637"
dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
mode: GRACEFUL
new_leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
 from {username='slave'} at 127.0.0.1:56792
I20260709 13:07:44.211542 16349 raft_consensus.cc:606] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Received request to transfer leadership to TS 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:07:44.212085 16349 raft_consensus.cc:614] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:07:44.214332 21570 log.cc:927] Time spent T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63: Append to log took a long time: real 0.592s	user 0.003s	sys 0.000s
I20260709 13:07:44.218183 21461 raft_consensus.cc:2749] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:07:44.189271 21565 consensus_queue.cc:1048] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:07:44.194414 21382 raft_consensus.cc:2749] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:07:44.194610 21562 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.605s	user 0.003s	sys 0.007s
I20260709 13:07:44.223387 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:44.225862 16275 raft_consensus.cc:2410] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:07:44.229923 16274 raft_consensus.cc:2468] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 16.
I20260709 13:07:44.232710 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:07:44.235903 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 67115.1us
I20260709 13:07:44.239972 16208 raft_consensus.cc:1275] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:07:44.240898 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:44.252447 16205 raft_consensus.cc:2468] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 11.
I20260709 13:07:44.258985 16322 leader_election.cc:304] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:07:44.262506 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 56818.6us
I20260709 13:07:44.270089 16282 raft_consensus.cc:1275] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:07:44.199028 21556 consensus_queue.cc:1048] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.059s
I20260709 13:07:44.272835 16173 leader_election.cc:304] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:44.272600 16248 leader_election.cc:304] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:07:44.277041 16275 raft_consensus.cc:1240] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:44.277251 16282 raft_consensus.cc:1275] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
W20260709 13:07:44.261361 21573 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.617s	user 0.018s	sys 0.011s
I20260709 13:07:44.232017 21534 consensus_queue.cc:1048] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.041s
I20260709 13:07:44.279902 21382 raft_consensus.cc:2749] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:07:44.282896 21573 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.638s	user 0.019s	sys 0.011s
I20260709 13:07:44.334355 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:44.241914 21508 consensus_queue.cc:1048] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 13:07:44.334712 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 18 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:44.288707 16281 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45210 (request call id 2473) took 1014 ms. Trace:
W20260709 13:07:44.309427 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 44853.7us
I20260709 13:07:44.282094 21461 raft_consensus.cc:2749] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:44.292589 16912 leader_election.cc:304] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:44.266090 21578 consensus_queue.cc:1048] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
W20260709 13:07:44.362978 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 70497.4us
I20260709 13:07:44.282325 21600 raft_consensus.cc:493] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.363866 21600 raft_consensus.cc:515] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:44.366251 21600 leader_election.cc:290] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:44.288388 21544 raft_consensus.cc:2764] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:07:44.202180 21552 raft_consensus.cc:515] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:44.278389 21448 consensus_queue.cc:1048] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 13:07:44.372643 21580 raft_consensus.cc:2804] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:44.291827 21565 raft_consensus.cc:493] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.358143 21452 raft_consensus.cc:493] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:44.384626 21565 raft_consensus.cc:515] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:44.384853 21452 raft_consensus.cc:515] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:44.386749 16200 raft_consensus.cc:2468] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 13.
I20260709 13:07:44.387217 21565 leader_election.cc:290] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:07:44.350397 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 91526.2us
I20260709 13:07:44.353936 16281 rpcz_store.cc:276] 0709 13:07:43.274628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:43.276045 (+  1417us) service_pool.cc:224] Handling call
0709 13:07:44.265957 (+989912us) spinlock_profiling.cc:243] Waited 3.17 ms on lock 0x7b58001a8298. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361c224db1 00007f361c364b71 00007f361c364a22 00007f362527dc09 00007f36243d7ee0 00007f36244a10ab 00007f36244a1131 00007f3624462fc0 00007f362444d929 00007f362444d3d2 00007f361d9c4bd4
0709 13:07:44.266182 (+   225us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:44.283522 (+ 17340us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:44.283548 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:44.288310 (+  4762us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:44.288358 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:44.288429 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:44.288596 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7282432}
I20260709 13:07:44.290700 16248 leader_election.cc:304] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:44.388089 21452 leader_election.cc:290] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:07:44.389019 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 99750.2us
I20260709 13:07:44.389430 16322 leader_election.cc:304] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:44.390308 16248 leader_election.cc:304] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:44.367950 16173 leader_election.cc:304] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:44.369869 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:44.309067 21538 consensus_queue.cc:1048] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 13:07:44.299436 21594 consensus_queue.cc:1059] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 18.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.055s
I20260709 13:07:44.355502 21508 consensus_queue.cc:1243] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Peer e10b16d536674c0bb350a31d7ce5ff7f log is divergent from this leader: its last log entry 12.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:07:44.378794 21484 leader_election.cc:290] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:44.402405 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:44.396670 21576 raft_consensus.cc:2749] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:44.406082 16203 raft_consensus.cc:1240] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:44.399961 21596 leader_election.cc:290] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:44.399362 21458 raft_consensus.cc:2804] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:07:44.396076 16322 leader_election.cc:304] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:07:44.399253 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:44.367992 21586 raft_consensus.cc:2749] T 540bfc4ad793452faea5b865343aacf7 P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:07:44.407289 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 51930.2us
I20260709 13:07:44.415284 16173 leader_election.cc:304] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:44.395596 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:44.415789 16322 leader_election.cc:304] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:44.412012 16248 leader_election.cc:304] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:44.416415 16281 raft_consensus.cc:3060] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:44.397174 21448 raft_consensus.cc:2749] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:44.407953 21574 raft_consensus.cc:2749] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:44.422269 16199 raft_consensus.cc:1275] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:07:44.425439 16248 leader_election.cc:304] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:44.426007 16322 leader_election.cc:304] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:44.402063 21580 raft_consensus.cc:697] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [term 11 LEADER]: Becoming Leader. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:07:44.429955 16322 leader_election.cc:304] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:44.424374 21484 raft_consensus.cc:3060] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:44.438475 16281 raft_consensus.cc:2468] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 11.
I20260709 13:07:44.414712 21458 raft_consensus.cc:493] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:44.426890 21556 raft_consensus.cc:2749] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:07:44.458635 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 54123us
I20260709 13:07:44.480248 16173 leader_election.cc:304] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
W20260709 13:07:44.447728 21607 log.cc:927] Time spent T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 13:07:44.448693 21575 raft_consensus.cc:2749] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:44.438918 21477 raft_consensus.cc:2749] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:44.450639 21485 raft_consensus.cc:2749] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:44.482699 21503 leader_election.cc:290] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 14 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:07:44.495359 16321 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:44.485268 21522 consensus_queue.cc:1048] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:07:44.457579 21458 raft_consensus.cc:3060] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:44.486896 21461 raft_consensus.cc:2804] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:07:44.502951 21461 raft_consensus.cc:697] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 18 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:07:44.504015 21461 consensus_queue.cc:237] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:44.491441 21552 leader_election.cc:290] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 13 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:44.485637 21580 consensus_queue.cc:237] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:07:44.525373 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 95466.3us
I20260709 13:07:44.443522 21594 raft_consensus.cc:2749] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:44.493168 16173 leader_election.cc:400] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 pre-election: Vote denied by peer 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875) with higher term. Message: Invalid argument: T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for earlier term 9. Current term is 10.
I20260709 13:07:44.527427 16173 leader_election.cc:403] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:44.481043 21382 raft_consensus.cc:493] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:44.498771 21613 log.cc:927] Time spent T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 13:07:44.493872 21452 consensus_queue.cc:1048] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 13:07:44.484583 21573 consensus_queue.cc:1048] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.015s
W20260709 13:07:44.499593 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 74228.8us
I20260709 13:07:44.497783 21586 raft_consensus.cc:493] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:44.508785 21477 raft_consensus.cc:2749] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:44.514995 21261 leader_election.cc:290] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 11 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:44.484752 21565 consensus_queue.cc:1048] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.023s
I20260709 13:07:44.530599 16173 leader_election.cc:304] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:44.530886 16322 leader_election.cc:304] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:44.537942 21586 raft_consensus.cc:515] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:44.539659 16248 leader_election.cc:304] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:44.549750 16248 leader_election.cc:304] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:44.534490 21503 raft_consensus.cc:2749] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875) with higher term. Message: Invalid argument: T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for earlier term 9. Current term is 10.
W20260709 13:07:44.554961 16320 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:44.565137 21487 raft_consensus.cc:2749] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:44.565986 21586 leader_election.cc:290] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:44.551688 21490 raft_consensus.cc:2749] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:07:44.570154 21552 raft_consensus.cc:493] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:44.570950 21552 raft_consensus.cc:515] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:44.578516 16205 pending_rounds.cc:85] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f: Aborting all ops after (but not including) 10
I20260709 13:07:44.579099 16205 pending_rounds.cc:107] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:07:44.579447 16205 raft_consensus.cc:2889] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:44.576771 16246 leader_election.cc:304] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:44.583320 16248 leader_election.cc:304] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:44.540920 21308 consensus_queue.cc:1048] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 13:07:44.536232 21382 raft_consensus.cc:515] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:44.550638 21556 raft_consensus.cc:2804] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:44.588779 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:44.611490 16280 raft_consensus.cc:3060] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:44.607148 21590 consensus_queue.cc:1048] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:07:44.606869 21598 raft_consensus.cc:2749] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:44.562955 21561 raft_consensus.cc:493] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.588011 16248 leader_election.cc:304] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:44.635926 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:07:44.637446 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 49581.7us
W20260709 13:07:44.607147 21571 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.838s	user 0.010s	sys 0.008s
W20260709 13:07:44.621510 21583 consensus_meta.cc:287] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63: Time spent flushing consensus metadata: real 0.618s	user 0.010s	sys 0.002s
W20260709 13:07:44.604182 21609 log.cc:927] Time spent T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.175s	user 0.005s	sys 0.000s
I20260709 13:07:44.635274 21598 raft_consensus.cc:493] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:44.581976 21576 raft_consensus.cc:2804] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:44.613572 21594 raft_consensus.cc:2804] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:44.638612 16248 leader_election.cc:304] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:44.596326 21544 raft_consensus.cc:3055] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:07:44.667546 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:44.667532 21583 raft_consensus.cc:2749] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:44.622495 21556 raft_consensus.cc:493] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:44.645735 21571 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.943s	user 0.015s	sys 0.008s
I20260709 13:07:44.678691 16278 raft_consensus.cc:3060] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:07:44.685671 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 159135us
I20260709 13:07:44.686585 16322 leader_election.cc:304] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:44.679689 16276 raft_consensus.cc:1275] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
W20260709 13:07:44.682590 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 44113.3us
I20260709 13:07:44.639151 21590 raft_consensus.cc:2764] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 13:07:44.685061 16283 raft_consensus.cc:1275] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
W20260709 13:07:44.692225 21566 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.020s	user 0.027s	sys 0.029s
W20260709 13:07:44.692641 21566 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.072s	user 0.027s	sys 0.030s
I20260709 13:07:44.695314 16277 raft_consensus.cc:1240] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 13:07:44.677484 21594 raft_consensus.cc:493] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:44.669924 21576 raft_consensus.cc:493] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:44.696758 16943 raft_consensus.cc:2468] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 9.
I20260709 13:07:44.639757 21561 raft_consensus.cc:515] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:44.678470 21484 raft_consensus.cc:2749] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:44.678365 21544 raft_consensus.cc:740] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:07:44.706444 21544 consensus_queue.cc:260] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:44.707315 21561 leader_election.cc:290] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:44.708160 21544 raft_consensus.cc:3060] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:44.710711 16283 raft_consensus.cc:1240] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 15. Current term is 16. Ops: [12.8-15.10]
I20260709 13:07:44.703545 21382 leader_election.cc:290] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:44.704160 21552 leader_election.cc:290] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:44.704276 21576 raft_consensus.cc:3060] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:44.698915 21575 raft_consensus.cc:2749] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:44.712850 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:44.718942 16941 raft_consensus.cc:2468] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 9.
I20260709 13:07:44.674942 21598 raft_consensus.cc:515] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:44.681625 21556 raft_consensus.cc:3060] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:44.689392 21487 raft_consensus.cc:2749] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:44.717862 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c15d8e9be8414c84912ab77b66bfb1" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:44.723910 16208 raft_consensus.cc:2468] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 12.
I20260709 13:07:44.725648 16320 leader_election.cc:304] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:44.700945 21594 raft_consensus.cc:3060] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:44.701022 21458 raft_consensus.cc:515] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } }
I20260709 13:07:44.723739 16173 leader_election.cc:304] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:44.722669 21620 consensus_queue.cc:1059] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.112s
I20260709 13:07:44.739120 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:44.740010 16277 raft_consensus.cc:2468] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 4.
W20260709 13:07:44.740365 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:44.737847 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:44.739195 21552 raft_consensus.cc:2804] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:44.741629 21552 raft_consensus.cc:493] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:44.742046 21552 raft_consensus.cc:3060] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:44.742879 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:44.689716 16248 leader_election.cc:304] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:07:44.749646 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 63218.7us
I20260709 13:07:44.753873 16278 raft_consensus.cc:2468] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 13.
I20260709 13:07:44.756862 16280 raft_consensus.cc:2468] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 14.
W20260709 13:07:44.759680 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 70141.4us
I20260709 13:07:44.760998 16277 raft_consensus.cc:1240] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 19. Current term is 20. Ops: []
I20260709 13:07:44.746894 21575 raft_consensus.cc:2804] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:44.784962 16204 raft_consensus.cc:1275] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:07:44.788319 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:44.759464 21621 raft_consensus.cc:3055] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:44.805141 16173 leader_election.cc:304] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:07:44.802583 16943 raft_consensus.cc:1275] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:07:44.762490 21590 raft_consensus.cc:2749] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:07:44.807473 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:44.808404 16322 leader_election.cc:304] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:07:44.809784 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 129076us
I20260709 13:07:44.815945 16944 raft_consensus.cc:1275] T 4b962ceebb5c48c1914459ae0c0eff1b P 1109f76a0b7b443a84c0327c8707bc63 [term 12 LEARNER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:07:44.787406 21575 raft_consensus.cc:493] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:44.820326 16914 leader_election.cc:336] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 2.013s (SENT)
I20260709 13:07:44.819020 16173 leader_election.cc:304] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:44.822130 21477 raft_consensus.cc:2749] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:44.824398 16248 leader_election.cc:304] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:44.824892 16173 leader_election.cc:304] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:44.827414 16943 raft_consensus.cc:1275] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 17 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:07:44.805408 21621 raft_consensus.cc:740] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:44.799537 21561 consensus_queue.cc:1048] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 13:07:44.838912 16322 leader_election.cc:304] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:44.820474 21562 raft_consensus.cc:2804] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:07:44.804160 21382 consensus_queue.cc:1048] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:07:44.824463 21575 raft_consensus.cc:3060] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:07:44.847178 16173 leader_election.cc:336] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 1.633s (SENT)
I20260709 13:07:44.800989 21620 consensus_queue.cc:1048] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 13:07:44.827996 21578 raft_consensus.cc:2804] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:44.809044 21565 consensus_queue.cc:1048] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 13:07:44.865255 21477 raft_consensus.cc:2749] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:44.833477 21600 raft_consensus.cc:493] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.819988 21484 consensus_queue.cc:1048] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 13:07:44.832779 21503 raft_consensus.cc:2804] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:44.872318 16173 leader_election.cc:304] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:44.810451 21566 consensus_queue.cc:1059] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 13:07:44.832369 21498 raft_consensus.cc:493] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:44.834085 21598 leader_election.cc:290] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:44.809341 21574 consensus_queue.cc:1059] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
W20260709 13:07:44.896895 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 58465.8us
I20260709 13:07:44.866909 21562 raft_consensus.cc:493] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Starting leader election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:44.869983 21590 raft_consensus.cc:2749] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:44.885201 21578 raft_consensus.cc:697] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 13 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
W20260709 13:07:44.919091 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 85727.8us
I20260709 13:07:44.832700 21573 consensus_queue.cc:1059] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.056s
I20260709 13:07:44.902863 21562 raft_consensus.cc:3060] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:44.888423 21600 raft_consensus.cc:515] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:44.938182 16277 raft_consensus.cc:1275] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:07:44.926748 21584 raft_consensus.cc:3055] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:07:44.926477 21624 raft_consensus.cc:2749] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:44.899501 21498 raft_consensus.cc:515] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:44.923300 21556 raft_consensus.cc:515] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:07:44.975414 21629 log.cc:927] Time spent T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.107s	user 0.000s	sys 0.003s
I20260709 13:07:44.976751 21556 leader_election.cc:290] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 election: Requested vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:44.943647 21584 raft_consensus.cc:740] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:07:44.979404 21584 consensus_queue.cc:260] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:44.981163 21584 raft_consensus.cc:3060] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:44.951711 21600 leader_election.cc:290] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:44.955190 21562 raft_consensus.cc:515] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:07:44.956845 21626 log.cc:927] Time spent T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.194s	user 0.000s	sys 0.001s
I20260709 13:07:44.935567 21461 raft_consensus.cc:3055] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:07:44.984227 21461 raft_consensus.cc:740] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 19 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:07:44.985087 21562 leader_election.cc:290] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:44.985560 21458 leader_election.cc:290] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 20 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:44.985224 21461 consensus_queue.cc:260] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } }
I20260709 13:07:44.940858 21590 consensus_queue.cc:1048] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 13:07:44.990957 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:44.962363 21578 consensus_queue.cc:237] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:07:44.993721 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 56802.1us
I20260709 13:07:44.963239 21594 raft_consensus.cc:515] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:44.965247 16322 leader_election.cc:304] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:44.965945 21576 raft_consensus.cc:515] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:07:44.967296 16321 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:45.011883 21458 consensus_queue.cc:1048] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 13:07:45.018733 16274 raft_consensus.cc:1275] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:07:45.021273 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:44.954063 21552 raft_consensus.cc:515] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:45.027267 16281 raft_consensus.cc:2393] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 14: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
W20260709 13:07:45.030807 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 96857.8us
I20260709 13:07:45.031744 16322 leader_election.cc:304] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:07:45.033106 16322 leader_election.cc:304] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:07:45.033658 21382 raft_consensus.cc:2749] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:45.028113 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:45.050923 21620 raft_consensus.cc:2749] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:45.033672 21576 leader_election.cc:290] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:45.022337 21461 raft_consensus.cc:3060] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:45.020294 21477 raft_consensus.cc:2749] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:45.059724 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:45.036486 21566 raft_consensus.cc:3055] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:07:45.068145 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 59711.9us
I20260709 13:07:45.016152 21494 consensus_queue.cc:1048] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 13:07:45.069814 16248 leader_election.cc:304] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:45.036500 21575 raft_consensus.cc:515] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:45.083748 21552 leader_election.cc:290] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 election: Requested vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:45.066124 21503 raft_consensus.cc:697] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:07:45.093132 16322 leader_election.cc:400] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 pre-election: Vote denied by peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823) with higher term. Message: Invalid argument: T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for earlier term 11. Current term is 12.
I20260709 13:07:45.094224 16322 leader_election.cc:403] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:45.062619 21508 consensus_queue.cc:1048] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.018s
I20260709 13:07:45.069169 21566 raft_consensus.cc:740] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:07:45.079250 21640 raft_consensus.cc:2749] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:07:45.071630 21534 consensus_queue.cc:1048] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 13:07:45.121166 21594 leader_election.cc:290] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:45.122264 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:45.123129 21575 leader_election.cc:290] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:45.123976 21566 consensus_queue.cc:260] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:45.125428 21566 raft_consensus.cc:3060] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:45.113432 21477 raft_consensus.cc:2749] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823) with higher term. Message: Invalid argument: T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for earlier term 11. Current term is 12.
I20260709 13:07:45.129221 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c15d8e9be8414c84912ab77b66bfb1" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:45.129916 16202 raft_consensus.cc:3060] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:45.123165 16200 raft_consensus.cc:3060] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:45.147091 21477 raft_consensus.cc:493] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:45.147856 21477 raft_consensus.cc:515] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:45.161177 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:45.170893 21503 consensus_queue.cc:237] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:45.172286 21498 leader_election.cc:290] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:45.173830 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:07:45.175649 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 93383.5us
I20260709 13:07:45.176924 16322 leader_election.cc:304] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:45.178097 21575 raft_consensus.cc:2749] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:45.180630 16200 raft_consensus.cc:2468] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 14.
W20260709 13:07:45.194701 16248 leader_election.cc:336] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 1.985s (SENT)
I20260709 13:07:45.215972 16203 raft_consensus.cc:2468] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 20.
W20260709 13:07:45.219738 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 372582us
I20260709 13:07:45.225282 16202 raft_consensus.cc:2468] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 13.
I20260709 13:07:45.226948 16322 leader_election.cc:304] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:45.229979 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:07:45.230711 16941 raft_consensus.cc:3060] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Advancing to term 10
W20260709 13:07:45.237504 16914 leader_election.cc:336] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 2.167s (SENT)
I20260709 13:07:45.238227 16914 leader_election.cc:304] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:45.238816 16941 raft_consensus.cc:2468] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 10.
I20260709 13:07:45.241336 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:07:45.240669 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:45.242270 16280 raft_consensus.cc:1275] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:07:45.245250 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:07:45.246012 16941 raft_consensus.cc:3060] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:45.219738 21575 raft_consensus.cc:493] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:45.224838 21477 leader_election.cc:290] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:45.250984 21485 raft_consensus.cc:2749] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:45.228658 21619 consensus_queue.cc:1059] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 13:07:45.279510 16322 leader_election.cc:304] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:45.281409 16322 leader_election.cc:304] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:07:45.276191 16941 raft_consensus.cc:2468] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 10.
I20260709 13:07:45.256244 21508 raft_consensus.cc:2749] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:07:45.294945 21652 log.cc:927] Time spent T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:07:45.262046 21583 raft_consensus.cc:493] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
W20260709 13:07:45.324833 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:45.330633 21382 raft_consensus.cc:2749] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:45.332283 21576 raft_consensus.cc:2749] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:07:45.332338 21620 raft_consensus.cc:3055] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:45.333477 21620 raft_consensus.cc:740] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:45.269014 21575 raft_consensus.cc:515] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:07:45.335246 21620 consensus_queue.cc:260] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:45.336871 21575 leader_election.cc:290] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:45.337800 21620 raft_consensus.cc:3060] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:07:45.339213 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 94575.8us
I20260709 13:07:45.348131 16322 leader_election.cc:304] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:07:45.356592 21458 raft_consensus.cc:2955] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 LEADER]: Committing config change with OpId 12.10: config changed from index 6 to 10, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:07:45.374720 21485 raft_consensus.cc:2749] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:07:45.376303 21631 log.cc:927] Time spent T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.449s	user 0.005s	sys 0.005s
I20260709 13:07:45.339089 21583 raft_consensus.cc:515] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:45.385319 21583 leader_election.cc:290] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:45.403108 16944 raft_consensus.cc:2955] T 4b962ceebb5c48c1914459ae0c0eff1b P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index 6 to 10, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:07:45.412206 21621 consensus_queue.cc:260] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:45.413919 21621 raft_consensus.cc:3060] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:07:45.420866 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 72829.8us
I20260709 13:07:45.423702 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:45.424726 16199 raft_consensus.cc:2468] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 14.
I20260709 13:07:45.429589 16202 raft_consensus.cc:1240] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 4. Current term is 5. Ops: []
I20260709 13:07:45.434257 16246 leader_election.cc:304] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:45.435667 16200 raft_consensus.cc:1275] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:07:45.431239 16205 raft_consensus.cc:2955] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index 6 to 10, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:07:45.434795 16322 leader_election.cc:304] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:45.443814 16322 leader_election.cc:304] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:07:45.452165 21477 raft_consensus.cc:2749] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:45.439680 16320 leader_election.cc:304] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:45.438337 21642 raft_consensus.cc:493] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:45.454118 21642 raft_consensus.cc:515] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:45.454845 21485 raft_consensus.cc:2804] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:45.455405 21485 raft_consensus.cc:697] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [term 13 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:45.440526 16246 leader_election.cc:304] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:45.456367 21642 leader_election.cc:290] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:45.472860 21477 raft_consensus.cc:2749] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:45.473373 21580 consensus_queue.cc:1059] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:07:45.476758 16173 leader_election.cc:336] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 1.872s (SENT)
I20260709 13:07:45.477283 16173 leader_election.cc:304] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:45.470474 21308 raft_consensus.cc:2804] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:07:45.478660 21586 raft_consensus.cc:3055] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:07:45.479082 21586 raft_consensus.cc:740] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:07:45.480108 21586 consensus_queue.cc:260] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:45.481671 21586 raft_consensus.cc:3060] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:07:45.478087 21461 consensus_queue.cc:1048] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.006s
I20260709 13:07:45.485282 21308 raft_consensus.cc:697] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:07:45.486285 21308 consensus_queue.cc:237] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } }
I20260709 13:07:45.474335 21452 consensus_queue.cc:1048] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 13:07:45.489048 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:07:45.493494 16173 leader_election.cc:336] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 1.900s (SENT)
W20260709 13:07:45.494462 16173 leader_election.cc:336] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 2.004s (SENT)
I20260709 13:07:45.494508 16320 leader_election.cc:304] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
W20260709 13:07:45.495452 16173 leader_election.cc:336] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 2.010s (SENT)
I20260709 13:07:45.495867 16173 leader_election.cc:304] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:45.496616 21584 raft_consensus.cc:2749] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:45.496914 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:45.457352 21640 raft_consensus.cc:2804] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:45.497558 16276 raft_consensus.cc:2468] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 19.
I20260709 13:07:45.497362 21584 raft_consensus.cc:2749] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:45.460527 21619 consensus_queue.cc:1048] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
W20260709 13:07:45.499074 16173 leader_election.cc:336] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 2.061s (SENT)
I20260709 13:07:45.499567 16173 leader_election.cc:304] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:45.500344 21584 raft_consensus.cc:3060] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:07:45.502285 16173 leader_election.cc:336] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 2.068s (SENT)
I20260709 13:07:45.456413 21485 consensus_queue.cc:237] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:45.504863 21576 raft_consensus.cc:2804] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:45.497726 21640 raft_consensus.cc:697] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:07:45.436556 21575 consensus_queue.cc:1048] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
W20260709 13:07:45.512112 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:45.552335 16174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:45.557231 16173 leader_election.cc:304] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:45.559736 21576 raft_consensus.cc:493] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:45.593798 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 91527.1us
W20260709 13:07:45.594261 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 150531us
I20260709 13:07:45.595094 16322 leader_election.cc:304] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:07:45.601080 16322 leader_election.cc:304] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:07:45.589074 21461 raft_consensus.cc:2749] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:45.595819 21576 raft_consensus.cc:3060] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:45.596196 16173 leader_election.cc:304] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:45.616169 16173 leader_election.cc:304] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:07:45.604367 21660 raft_consensus.cc:2749] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:45.614220 21382 raft_consensus.cc:2749] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:45.627873 16173 leader_election.cc:304] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:45.617228 21566 raft_consensus.cc:2804] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:45.673712 16281 raft_consensus.cc:1275] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:07:45.628258 21461 raft_consensus.cc:2749] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:07:45.766943 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:45.626971 21640 consensus_queue.cc:237] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:45.772622 21578 raft_consensus.cc:2804] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:45.773789 21584 raft_consensus.cc:2749] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:45.774422 21566 raft_consensus.cc:697] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [term 10 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
W20260709 13:07:45.793231 21659 log.cc:927] Time spent T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.198s	user 0.002s	sys 0.002s
W20260709 13:07:45.826869 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 150669us
W20260709 13:07:45.827369 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 226347us
I20260709 13:07:45.849915 16322 leader_election.cc:304] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:45.853510 16322 leader_election.cc:304] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:45.856051 16173 leader_election.cc:304] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:45.856643 16276 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7"
dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:45374
I20260709 13:07:45.857672 16276 raft_consensus.cc:606] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Received request to transfer leadership
I20260709 13:07:45.862365 16276 raft_consensus.cc:614] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:45.858768 16322 leader_election.cc:304] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:45.866797 16322 leader_election.cc:304] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:45.872906 21621 raft_consensus.cc:2804] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:07:45.856873 21477 raft_consensus.cc:2749] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:45.876432 16322 leader_election.cc:304] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:45.877466 21621 raft_consensus.cc:697] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 16 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:45.870014 21382 raft_consensus.cc:2804] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:07:45.870217 21552 raft_consensus.cc:2804] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:07:45.876289 21620 raft_consensus.cc:2749] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:45.880308 21503 consensus_queue.cc:1048] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:45.891214 16322 leader_election.cc:304] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:07:45.902444 16248 leader_election.cc:336] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 2.999s (SENT)
I20260709 13:07:45.903661 16248 leader_election.cc:304] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:45.914288 16322 leader_election.cc:304] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:07:45.917744 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 46693us
I20260709 13:07:45.922145 16276 raft_consensus.cc:1275] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:07:45.928709 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:45.929437 16351 raft_consensus.cc:2468] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 12.
I20260709 13:07:45.930662 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:45.930773 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:45.932070 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:45.932747 16355 raft_consensus.cc:2468] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 8.
I20260709 13:07:45.933676 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:45.934913 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:45.936256 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:45.934334 16355 raft_consensus.cc:2468] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 13.
I20260709 13:07:45.936939 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:45.937896 16348 raft_consensus.cc:2468] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 13.
I20260709 13:07:45.938084 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:45.938796 16355 raft_consensus.cc:2468] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 9.
I20260709 13:07:45.939685 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:45.936937 16351 raft_consensus.cc:2468] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 10.
I20260709 13:07:45.946431 16352 raft_consensus.cc:2468] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 18.
I20260709 13:07:45.946527 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:45.948678 16352 raft_consensus.cc:1240] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 13:07:45.901887 21552 raft_consensus.cc:493] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:45.955500 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:45.957222 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:45.957469 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:45.957993 16356 raft_consensus.cc:2468] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 14.
I20260709 13:07:45.958424 16353 raft_consensus.cc:2468] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 13.
I20260709 13:07:45.959203 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:45.960151 16350 raft_consensus.cc:2410] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:07:45.921180 21575 raft_consensus.cc:2749] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:45.918525 21619 raft_consensus.cc:2749] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:45.923640 21490 raft_consensus.cc:493] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:45.925793 21308 raft_consensus.cc:2749] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:45.966735 21621 consensus_queue.cc:237] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:45.928148 21566 consensus_queue.cc:237] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:45.924316 21660 consensus_queue.cc:1059] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 13:07:45.961748 21552 raft_consensus.cc:3060] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:45.977142 16353 raft_consensus.cc:1275] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:07:45.977502 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:46.017673 16281 raft_consensus.cc:1275] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:07:46.034068 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:46.019102 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:46.023362 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:46.021528 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:46.024551 16280 raft_consensus.cc:1240] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 12. Current term is 13. Ops: [12.6-12.6]
I20260709 13:07:46.021878 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c15d8e9be8414c84912ab77b66bfb1" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:46.040046 16275 raft_consensus.cc:2468] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 12.
I20260709 13:07:46.044277 16248 leader_election.cc:304] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:45.952301 21485 raft_consensus.cc:2749] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:46.047669 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
W20260709 13:07:46.048228 16174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:46.084052 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:45.892689 21576 raft_consensus.cc:515] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:07:46.075116 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c15d8e9be8414c84912ab77b66bfb1" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:46.087756 16283 raft_consensus.cc:3060] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:46.045531 21651 raft_consensus.cc:493] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
W20260709 13:07:46.048135 21661 log.cc:927] Time spent T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
W20260709 13:07:46.109313 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 61699.7us
I20260709 13:07:46.029963 21578 raft_consensus.cc:697] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
W20260709 13:07:46.135165 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 90952.5us
I20260709 13:07:46.141479 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:46.142493 16350 raft_consensus.cc:3060] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:46.162360 21494 raft_consensus.cc:2749] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:07:46.164379 16105 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38840 (request call id 206) took 9831 ms. Trace:
I20260709 13:07:46.168337 21576 leader_election.cc:290] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:46.171804 21667 raft_consensus.cc:493] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:46.172434 21667 raft_consensus.cc:515] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:46.180521 16348 raft_consensus.cc:2376] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 17. Re-sending same reply.
I20260709 13:07:46.108551 21382 raft_consensus.cc:697] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 17 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:46.197273 16283 raft_consensus.cc:2468] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 13.
I20260709 13:07:46.164922 16105 rpcz_store.cc:276] 0709 13:07:36.333313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:36.333516 (+   203us) service_pool.cc:224] Handling call
0709 13:07:46.164269 (+9830753us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:43.628545 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:43.696978 (+ 68433us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:43.697017 (+    39us) write_op.cc:435] Acquired schema lock
0709 13:07:43.697034 (+    17us) tablet.cc:662] Decoding operations
0709 13:07:43.698791 (+  1757us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:43.698848 (+    57us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:43.698878 (+    30us) tablet.cc:685] Acquiring locks for 23 operations
0709 13:07:43.700800 (+  1922us) tablet.cc:701] Row locks acquired
0709 13:07:43.700821 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:07:43.700974 (+   153us) write_op.cc:270] Start()
0709 13:07:43.701106 (+   132us) write_op.cc:276] Timestamp: P: 1783602463700929 usec, L: 0
0709 13:07:43.701132 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 13:07:43.701926 (+   794us) log.cc:844] Serialized 9430 byte log entry
0709 13:07:44.521286 (+819360us) spinlock_profiling.cc:243] Waited 1.7 ms on lock 0x7b4400022b4c. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361c224db1 00007f361c2c2c85 00007f361c2c36a2 00007f361f0351db 00007f361f030aaf 00007f361c37f0ac 00007f36251d9ab9 00007f361c39b69b 00007f361c39993f 00007f361c39bc02 00007f361f02320b
0709 13:07:44.870143 (+348857us) op_driver.cc:464] REPLICATION: finished
0709 13:07:45.081064 (+210921us) write_op.cc:301] APPLY: starting
0709 13:07:45.082488 (+  1424us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:45.362007 (+279519us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:45.362036 (+    29us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:45.401727 (+ 39691us) spinlock_profiling.cc:243] Waited 1.69 ms on lock 0x7b5400137754. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48632a 00007f361f40bf14 00007f361f40bec3 00007f361f40be38 00007f361f40bdf3 00007f361f40b0dc 00007f361f434e16 00007f361f41ccbb 00007f361f40739d 00007f361f40ad75
0709 13:07:45.547650 (+145923us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:45.548132 (+   482us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=46,key_file_lookups=46,delta_file_lookups=46,mrs_lookups=0
0709 13:07:45.548198 (+    66us) write_op.cc:312] APPLY: finished
0709 13:07:45.549150 (+   952us) log.cc:844] Serialized 204 byte log entry
0709 13:07:45.558947 (+  9797us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:45.586349 (+ 27402us) write_op.cc:454] Released schema lock
0709 13:07:45.590273 (+  3924us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:45.609043 (+ 18770us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:45.609084 (+    41us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":5522,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":177372,"apply.run_cpu_time_us":34853,"apply.run_wall_time_us":535718,"cfile_cache_hit":94,"cfile_cache_hit_bytes":100267,"num_ops":23,"prepare.queue_time_us":414321,"prepare.run_cpu_time_us":31245,"prepare.run_wall_time_us":1103844,"raft.queue_time_us":75204,"raft.run_cpu_time_us":16313,"raft.run_wall_time_us":577794,"replication_time_us":1131530,"spinlock_wait_cycles":7831040,"thread_start_us":1241371,"threads_started":4,"wal-append.queue_time_us":972797}]]}
I20260709 13:07:46.047801 21490 raft_consensus.cc:515] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:46.212059 16350 raft_consensus.cc:2468] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 10.
I20260709 13:07:46.216980 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:07:46.231984 16322 service_pool.cc:136] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:41830 dropped due to backpressure: service queue is full with 50 items
I20260709 13:07:46.253691 16281 raft_consensus.cc:2410] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:07:46.178406 21651 raft_consensus.cc:515] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:46.270440 21490 leader_election.cc:290] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:46.244262 21676 raft_consensus.cc:493] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:46.278952 21676 raft_consensus.cc:515] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:46.259660 21667 leader_election.cc:290] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:07:46.301362 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 267754us
I20260709 13:07:46.305805 16200 raft_consensus.cc:1275] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 20 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
W20260709 13:07:46.264557 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 138322us
I20260709 13:07:46.308713 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:46.232653 16322 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:41830 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33486 (request call id 775)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33486 (request call id 774)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41832 (request call id 2359)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41832 (request call id 2361)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33486 (request call id 777)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41830 (request call id 2556)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41832 (request call id 2362)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41832 (request call id 2363)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41832 (request call id 2358)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33486 (request call id 758)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41832 (request call id 2357)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41830 (request call id 2545)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33486 (request call id 778)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41830 (request call id 2558)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33486 (request call id 761)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41832 (request call id 2356)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33486 (request call id 763)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33486 (request call id 779)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41830 (request call id 2543)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33486 (request call id 760)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33486 (request call id 780)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33486 (request call id 769)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33486 (request call id 759)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41830 (request call id 2544)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41832 (request call id 2364)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41832 (request call id 2365)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33486 (request call id 764)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33486 (request call id 765)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33486 (request call id 766)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33486 (request call id 767)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33486 (request call id 768)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33486 (request call id 770)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33486 (request call id 771)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33486 (request call id 772)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33486 (request call id 773)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33486 (request call id 776)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41830 (request call id 2540)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41830 (request call id 2541)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41830 (request call id 2542)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41830 (request call id 2546)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41830 (request call id 2547)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41830 (request call id 2548)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41830 (request call id 2549)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41830 (request call id 2550)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41830 (request call id 2551)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41830 (request call id 2552)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41830 (request call id 2553)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41830 (request call id 2554)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41830 (request call id 2555)
I20260709 13:07:46.314632 16206 raft_consensus.cc:1240] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:46.318291 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:46.319242 16200 raft_consensus.cc:2468] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 14.
I20260709 13:07:46.320768 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:46.321408 16199 raft_consensus.cc:3060] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:46.326886 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
W20260709 13:07:46.331399 21671 log.cc:927] Time spent T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.154s	user 0.000s	sys 0.001s
W20260709 13:07:46.332827 21666 log.cc:927] Time spent T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:07:46.262869 21578 consensus_queue.cc:237] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:46.339013 16354 raft_consensus.cc:3060] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:46.339766 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:46.347425 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:46.348389 16348 raft_consensus.cc:2468] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 14.
I20260709 13:07:46.348562 21619 consensus_queue.cc:1059] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:46.349431 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:46.350399 21576 raft_consensus.cc:3055] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:46.350883 21576 raft_consensus.cc:740] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:46.351874 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:46.351830 21576 consensus_queue.cc:260] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:46.353403 21576 raft_consensus.cc:3060] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:46.353843 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:46.348389 21665 raft_consensus.cc:493] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:46.355593 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:46.355387 21665 raft_consensus.cc:515] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:46.356534 16353 raft_consensus.cc:2468] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 10.
I20260709 13:07:46.299548 21382 consensus_queue.cc:237] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:46.357824 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:46.341884 21651 leader_election.cc:290] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:46.371515 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:46.363827 16348 raft_consensus.cc:2468] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 10.
I20260709 13:07:46.371150 16322 leader_election.cc:304] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:46.371564 16350 raft_consensus.cc:2468] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 15.
I20260709 13:07:46.375409 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:46.377393 16348 raft_consensus.cc:2376] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 18. Re-sending same reply.
I20260709 13:07:46.370967 16353 raft_consensus.cc:2393] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 19: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:07:46.379026 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:46.379854 16353 raft_consensus.cc:2376] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 13. Re-sending same reply.
I20260709 13:07:46.384213 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:46.387003 16199 raft_consensus.cc:2468] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 15.
I20260709 13:07:46.389155 16320 leader_election.cc:304] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:46.318902 21539 consensus_queue.cc:1048] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.063s
I20260709 13:07:46.391716 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 18 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:46.392197 21687 raft_consensus.cc:2764] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:07:46.392728 21584 consensus_queue.cc:1059] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:46.396024 21584 raft_consensus.cc:3055] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:46.396478 21584 raft_consensus.cc:740] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
W20260709 13:07:46.396831 21669 log.cc:927] Time spent T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:07:46.397486 21584 consensus_queue.cc:260] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:46.398990 21676 leader_election.cc:290] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:46.399211 21584 raft_consensus.cc:3060] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:46.403260 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:46.409816 16356 raft_consensus.cc:2410] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for term 18 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:07:46.412288 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:46.413285 16348 raft_consensus.cc:2376] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 10. Re-sending same reply.
I20260709 13:07:46.414644 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:46.384922 16173 leader_election.cc:304] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:46.420966 16203 raft_consensus.cc:1275] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:07:46.425153 16354 raft_consensus.cc:2468] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 10.
I20260709 13:07:46.429603 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:46.438508 16322 leader_election.cc:304] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:46.444530 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:46.445271 16354 raft_consensus.cc:2376] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 13. Re-sending same reply.
I20260709 13:07:46.446337 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:46.447280 16354 raft_consensus.cc:3060] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:07:46.447595 16353 raft_consensus.cc:2468] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 13.
I20260709 13:07:46.460492 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:07:46.461459 16174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:46.462311 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 77461.7us
I20260709 13:07:46.466624 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:46.464262 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:46.467578 16173 leader_election.cc:304] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:46.465725 16281 raft_consensus.cc:1275] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:07:46.467901 16279 raft_consensus.cc:3060] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:46.470947 21566 raft_consensus.cc:2749] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:46.471763 21566 consensus_queue.cc:1048] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:46.470364 16173 leader_election.cc:304] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:07:46.431459 21660 consensus_queue.cc:1243] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer 0aea40d6e4374085a2e38a70a71f63e3 log is divergent from this leader: its last log entry 17.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:07:46.476512 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:46.476979 16322 leader_election.cc:304] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:07:46.477418 16348 raft_consensus.cc:3060] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:46.475086 16356 raft_consensus.cc:2468] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 13.
I20260709 13:07:46.479055 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:46.479928 16356 raft_consensus.cc:2393] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 13: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:07:46.480829 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:46.482007 16279 raft_consensus.cc:2410] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:07:46.481827 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:46.429284 21477 raft_consensus.cc:493] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:46.433074 21620 raft_consensus.cc:2804] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:46.433888 21651 raft_consensus.cc:2749] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:46.492611 16354 raft_consensus.cc:2468] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 11.
I20260709 13:07:46.463317 21665 leader_election.cc:290] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:46.521629 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:46.444967 21676 consensus_queue.cc:1048] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 13:07:46.533375 16354 raft_consensus.cc:3060] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:46.497516 21477 raft_consensus.cc:515] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:46.548743 16356 raft_consensus.cc:2410] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:07:46.549927 21477 leader_election.cc:290] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:46.456789 21667 consensus_queue.cc:1048] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.045s
I20260709 13:07:46.550484 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:46.551808 21575 raft_consensus.cc:3055] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:07:46.551918 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:46.552331 21575 raft_consensus.cc:740] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:46.553215 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:46.554234 16356 raft_consensus.cc:2410] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:07:46.554979 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:46.491891 21503 raft_consensus.cc:2764] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:07:46.478914 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:46.536854 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:46.485087 21660 raft_consensus.cc:2749] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:46.539029 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:46.521346 21620 raft_consensus.cc:697] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 15 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:46.541031 21675 raft_consensus.cc:493] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:46.553267 21575 consensus_queue.cc:260] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:46.543267 21552 raft_consensus.cc:515] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:46.545100 21687 raft_consensus.cc:2749] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:46.570794 16354 raft_consensus.cc:2468] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 15.
I20260709 13:07:46.572193 16356 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef"
dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
mode: GRACEFUL
new_leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
 from {username='slave'} at 127.0.0.1:56792
I20260709 13:07:46.591490 16356 raft_consensus.cc:606] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Received request to transfer leadership to TS 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:07:46.592123 16356 raft_consensus.cc:614] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:46.596537 16350 raft_consensus.cc:1275] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:07:46.601075 16356 raft_consensus.cc:1275] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:07:46.571910 21493 raft_consensus.cc:493] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:46.611097 16280 raft_consensus.cc:1240] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 LEADER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 13. Current term is 14. Ops: [13.9-13.9]
W20260709 13:07:46.626332 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 345134us
W20260709 13:07:46.634342 16321 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:46.600723 21616 raft_consensus.cc:493] T 540bfc4ad793452faea5b865343aacf7 P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:46.576730 16106 catalog_manager.cc:5697] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } }
I20260709 13:07:46.578590 21675 raft_consensus.cc:515] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:46.518764 21672 consensus_queue.cc:1048] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:07:46.601075 16354 raft_consensus.cc:1275] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:07:46.573983 16348 raft_consensus.cc:2468] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 14.
W20260709 13:07:46.673583 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:46.644204 16914 leader_election.cc:304] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:07:46.682158 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 66825.6us
W20260709 13:07:46.684163 16248 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.004s	sys 0.036s
W20260709 13:07:46.690588 16248 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.553s	user 0.004s	sys 0.036s
W20260709 13:07:46.691151 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 553715us
I20260709 13:07:46.695041 21680 raft_consensus.cc:2749] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:46.698674 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
W20260709 13:07:46.700767 16154 auto_rebalancer.cc:893] Removing replace marker failed: Replica 0aea40d6e4374085a2e38a70a71f63e3 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 15 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } } pending_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
W20260709 13:07:46.701242 16154 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
W20260709 13:07:46.701526 16154 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 13:07:46.703265 21620 consensus_queue.cc:237] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:07:46.681468 21586 raft_consensus.cc:493] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:46.726873 21690 raft_consensus.cc:493] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:46.717412 21688 log.cc:927] Time spent T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 13:07:46.636009 21493 raft_consensus.cc:515] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:46.733363 21552 leader_election.cc:290] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 19 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:46.738435 16354 raft_consensus.cc:1275] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:07:46.733937 16207 raft_consensus.cc:1240] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 16. Current term is 17. Ops: []
I20260709 13:07:46.718006 16106 catalog_manager.cc:5697] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f reported cstate change: term changed from 12 to 13, leader changed from 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) to e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65). New cstate: current_term: 13 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:46.750352 16357 raft_consensus.cc:1240] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 17 LEADER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 16. Current term is 17. Ops: []
I20260709 13:07:46.755501 16106 catalog_manager.cc:5697] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } }
W20260709 13:07:46.757982 21621 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.017s	sys 0.023s
W20260709 13:07:46.758755 21621 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.588s	user 0.018s	sys 0.023s
I20260709 13:07:46.766682 21485 consensus_queue.cc:1059] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:07:46.768016 16349 raft_consensus.cc:1240] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 16 LEADER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:46.684226 21616 raft_consensus.cc:515] T 540bfc4ad793452faea5b865343aacf7 P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:46.738883 21586 raft_consensus.cc:515] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:46.800016 16943 raft_consensus.cc:2468] T 540bfc4ad793452faea5b865343aacf7 P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 14.
I20260709 13:07:46.746194 21690 raft_consensus.cc:515] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
W20260709 13:07:46.805982 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 329052us
I20260709 13:07:46.860293 16322 leader_election.cc:304] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:46.802915 21660 raft_consensus.cc:493] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:46.872044 16322 leader_election.cc:304] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:46.804809 21667 raft_consensus.cc:493] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
W20260709 13:07:46.870225 21689 log.cc:927] Time spent T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:07:46.883597 21676 raft_consensus.cc:2749] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:07:46.884079 21690 leader_election.cc:290] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:46.878966 21493 leader_election.cc:290] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:46.885773 16207 pending_rounds.cc:85] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f: Aborting all ops after (but not including) 9
I20260709 13:07:46.898518 16207 pending_rounds.cc:107] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f: Aborting uncommitted NO_OP operation due to leader change: 15.10
I20260709 13:07:46.898670 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:46.885870 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:46.894428 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:46.898875 16207 raft_consensus.cc:2889] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:07:46.910669 21691 log.cc:927] Time spent T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
W20260709 13:07:46.912317 21695 log.cc:927] Time spent T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 13:07:46.916107 21586 leader_election.cc:290] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:46.935585 21675 leader_election.cc:290] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:07:46.941609 21698 log.cc:927] Time spent T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:07:46.886246 16348 raft_consensus.cc:1275] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:07:46.875824 16106 catalog_manager.cc:5697] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f reported cstate change: term changed from 6 to 8, leader changed from 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) to e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65). New cstate: current_term: 8 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:07:46.957780 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:46.875768 21660 raft_consensus.cc:515] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:46.961123 16941 raft_consensus.cc:1275] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 13:07:46.961426 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 317333us
I20260709 13:07:46.965930 16914 leader_election.cc:304] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:07:46.956866 16106 catalog_manager.cc:5697] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f reported cstate change: term changed from 12 to 11, leader changed from <none> to 363bb2f744eb486f9ad726f08214c98e (127.14.180.67). New cstate: current_term: 11 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
W20260709 13:07:46.963411 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 223961us
I20260709 13:07:46.976914 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:46.997969 16248 leader_election.cc:304] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:46.998958 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:46.983106 16278 raft_consensus.cc:1275] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:07:46.951833 21382 consensus_queue.cc:1048] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:07:46.888442 21667 raft_consensus.cc:515] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:46.984189 16274 raft_consensus.cc:1275] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:07:47.002195 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:47.003207 16914 leader_election.cc:304] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:07:46.994794 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:47.005220 16349 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41832 (request call id 2331) took 1078 ms. Trace:
W20260709 13:07:47.008891 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 79033.8us
I20260709 13:07:47.012253 16322 leader_election.cc:304] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:47.009230 16349 rpcz_store.cc:276] 0709 13:07:45.926598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:45.926824 (+   226us) service_pool.cc:224] Handling call
0709 13:07:45.941054 (+ 14230us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:46.768517 (+827463us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:47.004966 (+236449us) spinlock_profiling.cc:243] Waited 827 ms on lock 0x7b54003a43d4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f489e01 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6
0709 13:07:47.005156 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1901338368}
I20260709 13:07:47.015442 16248 leader_election.cc:304] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:47.021391 16322 leader_election.cc:304] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:07:47.023927 16914 leader_election.cc:304] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:47.026582 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:47.028118 16350 raft_consensus.cc:2393] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 19: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:07:47.031361 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:47.032136 16349 raft_consensus.cc:2376] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 10. Re-sending same reply.
I20260709 13:07:47.033178 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:47.034032 16282 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45210 (request call id 2505) took 1007 ms. Trace:
I20260709 13:07:47.032048 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:07:47.037075 16174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:47.034418 16282 rpcz_store.cc:276] 0709 13:07:46.026381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:46.037525 (+ 11144us) service_pool.cc:224] Handling call
0709 13:07:46.037860 (+   335us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:46.104316 (+ 66456us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:46.104369 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:46.105057 (+   688us) log.cc:844] Serialized 26 byte log entry
0709 13:07:46.349228 (+244171us) spinlock_profiling.cc:243] Waited 12.5 ms on lock 0x7b18002eae00. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f3625264de1 00007f36252715b1 00007f361c37ee07 00007f36251d9ab9 00007f361c39b69b 00007f361c39993f 00007f361c39bc02 00007f361f02320b 00007f361f028d23 00007f361f0290d1 00007f361f444a0f
0709 13:07:46.630893 (+281665us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:46.685094 (+ 54201us) log.cc:844] Serialized 14 byte log entry
0709 13:07:46.685377 (+   283us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:46.685502 (+   125us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:46.940908 (+255406us) spinlock_profiling.cc:243] Waited 58.4 ms on lock 0x7b4400022b4c. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361c224db1 00007f361c2c2c85 00007f361c2c36a2 00007f361f0351db 00007f361f030aaf 00007f361f02486e 00007f361f023bb6 00007f361f0237d8 00007f361f02d221 00007f361f02d1d9 00007f361f02d169
0709 13:07:47.033831 (+ 92923us) raft_consensus.cc:1685] finished
0709 13:07:47.033852 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:47.033977 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":79083,"prepare.queue_time_us":57662,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":12306,"raft.queue_time_us":69649,"raft.run_cpu_time_us":240,"raft.run_wall_time_us":19243,"spinlock_wait_cycles":216531968,"thread_start_us":281415,"threads_started":1,"wal-append.queue_time_us":640361}
I20260709 13:07:47.040285 16357 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41832 (request call id 2335) took 1111 ms. Trace:
I20260709 13:07:47.040542 16278 raft_consensus.cc:2468] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 19.
I20260709 13:07:47.049746 16280 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45210 (request call id 2506) took 1023 ms. Trace:
I20260709 13:07:47.041139 16357 rpcz_store.cc:276] 0709 13:07:45.928442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:45.928549 (+   107us) service_pool.cc:224] Handling call
0709 13:07:45.928854 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:46.750894 (+822040us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:47.039966 (+289072us) spinlock_profiling.cc:243] Waited 821 ms on lock 0x7b540032b754. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f489e01 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6
0709 13:07:47.040192 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1888817536}
I20260709 13:07:47.056299 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bc3c8ff9b84838a2664335d7e1582b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:07:47.059185 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 46412.4us
W20260709 13:07:47.060564 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 45178.8us
I20260709 13:07:47.007113 21261 raft_consensus.cc:2804] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:47.063685 16248 leader_election.cc:304] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:47.008102 21683 raft_consensus.cc:2804] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:47.050180 16280 rpcz_store.cc:276] 0709 13:07:46.026759 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:46.039196 (+ 12437us) service_pool.cc:224] Handling call
0709 13:07:46.039489 (+   293us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:46.611754 (+572265us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:47.039314 (+427560us) spinlock_profiling.cc:243] Waited 571 ms on lock 0x7b54001a8bd4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f489e01 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6
0709 13:07:47.049673 (+ 10359us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1313850752}
I20260709 13:07:47.074519 16357 raft_consensus.cc:1275] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:07:47.013368 21477 raft_consensus.cc:2749] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:47.083688 16349 raft_consensus.cc:3060] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:47.075917 15057 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:07:47.091809 16248 leader_election.cc:304] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:07:47.097541 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 48976.7us
I20260709 13:07:47.099124 16322 leader_election.cc:304] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:47.096968 16357 raft_consensus.cc:1275] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:07:47.037173 21713 raft_consensus.cc:2804] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:47.064474 21675 raft_consensus.cc:493] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.114015 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:47.086066 16106 catalog_manager.cc:5697] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f reported cstate change: term changed from 11 to 14. New cstate: current_term: 14 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:47.078263 21690 raft_consensus.cc:2749] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:47.117005 16278 raft_consensus.cc:2468] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 16.
I20260709 13:07:47.078729 21261 raft_consensus.cc:493] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:47.083487 21493 raft_consensus.cc:2749] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:47.084434 21485 raft_consensus.cc:2749] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:47.082824 21534 raft_consensus.cc:493] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.079819 21683 raft_consensus.cc:493] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:47.089883 21712 raft_consensus.cc:2749] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:07:47.137959 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 61008.7us
I20260709 13:07:47.133550 21458 raft_consensus.cc:493] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:47.155431 21458 raft_consensus.cc:515] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:07:47.157032 21703 log.cc:927] Time spent T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.205s	user 0.000s	sys 0.001s
I20260709 13:07:47.158228 16356 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33486 (request call id 765) took 1149 ms. Trace:
I20260709 13:07:47.103693 21508 consensus_queue.cc:1048] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.056s
I20260709 13:07:47.140141 21665 raft_consensus.cc:493] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.158778 16356 rpcz_store.cc:276] 0709 13:07:46.008971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:46.605013 (+596042us) service_pool.cc:224] Handling call
0709 13:07:46.605510 (+   497us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:46.610614 (+  5104us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:46.610752 (+   138us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:46.611659 (+   907us) log.cc:844] Serialized 26 byte log entry
0709 13:07:46.963140 (+351481us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:47.004177 (+ 41037us) log.cc:844] Serialized 14 byte log entry
0709 13:07:47.004437 (+   260us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:47.004512 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:47.157626 (+153114us) spinlock_profiling.cc:243] Waited 27.5 ms on lock 0x7b1800403180. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f3625264de1 00007f36252715b1 00007f361c39c522 00007f361c39e7c1 00007f361c39e779 00007f361c39e709 00007f361c39e6d1 00007f361c39d9cd 000000000038f354 000000000038f199 00007f361c37f83a
0709 13:07:47.157863 (+   237us) raft_consensus.cc:1685] finished
0709 13:07:47.157981 (+   118us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:47.158151 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26612,"prepare.queue_time_us":54080,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":55,"raft.queue_time_us":3150,"raft.run_cpu_time_us":386,"raft.run_wall_time_us":15924,"spinlock_wait_cycles":63284608,"thread_start_us":229935,"threads_started":1,"wal-append.queue_time_us":325759}
I20260709 13:07:47.160784 21665 raft_consensus.cc:515] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:47.162020 16356 raft_consensus.cc:1275] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:07:47.163304 16351 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41832 (request call id 2343) took 1231 ms. Trace:
I20260709 13:07:47.163856 16351 rpcz_store.cc:276] 0709 13:07:45.931928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:45.946858 (+ 14930us) service_pool.cc:224] Handling call
0709 13:07:45.951352 (+  4494us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:46.120568 (+169216us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:46.120633 (+    65us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:46.142981 (+ 22348us) log.cc:844] Serialized 26 byte log entry
0709 13:07:46.461700 (+318719us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:46.768091 (+306391us) spinlock_profiling.cc:243] Waited 3.02 ms on lock 0x7b4400022b4c. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361c224db1 00007f361c2c2c85 00007f361c2c36a2 00007f361f0351db 00007f361f030aaf 00007f361f02486e 00007f361f023bb6 00007f361f0237d8 00007f361f02d221 00007f361f02d1d9 00007f361f02d169
0709 13:07:46.796151 (+ 28060us) log.cc:844] Serialized 14 byte log entry
0709 13:07:46.796515 (+   364us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:47.162937 (+366422us) spinlock_profiling.cc:243] Waited 140 ms on lock 0x7b540026af54. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f489e01 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6
0709 13:07:47.162996 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:47.163049 (+    53us) raft_consensus.cc:1685] finished
0709 13:07:47.163068 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:47.163233 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":77928,"prepare.queue_time_us":82401,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":91950,"raft.run_cpu_time_us":384,"raft.run_wall_time_us":21914,"spinlock_wait_cycles":330567040,"thread_start_us":475232,"threads_started":2,"wal-append.queue_time_us":530197}
I20260709 13:07:47.113641 21672 consensus_queue.cc:1048] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 13:07:47.168035 21552 consensus_queue.cc:1048] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:07:47.206312 21642 raft_consensus.cc:493] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:47.207041 21642 raft_consensus.cc:515] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:47.209661 21642 leader_election.cc:290] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:47.115454 21696 raft_consensus.cc:493] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.212869 16349 raft_consensus.cc:1275] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 20 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
W20260709 13:07:47.213924 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 148151us
I20260709 13:07:47.135115 21639 raft_consensus.cc:2749] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:47.126637 21477 raft_consensus.cc:2749] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:47.134212 21261 raft_consensus.cc:3060] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:47.141867 21683 raft_consensus.cc:3060] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:47.116514 21713 raft_consensus.cc:493] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:47.230147 16106 catalog_manager.cc:5697] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f reported cstate change: term changed from 8 to 11, leader changed from e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) to 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68). New cstate: current_term: 11 leader_uuid: "1109f76a0b7b443a84c0327c8707bc63" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:07:47.235894 16352 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33486 (request call id 766) took 1226 ms. Trace:
I20260709 13:07:47.140715 21616 leader_election.cc:290] T 540bfc4ad793452faea5b865343aacf7 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:47.242494 16352 rpcz_store.cc:276] 0709 13:07:46.009307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:46.612703 (+603396us) service_pool.cc:224] Handling call
0709 13:07:46.613191 (+   488us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:46.615065 (+  1874us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:46.615108 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:46.647161 (+ 32053us) log.cc:844] Serialized 26 byte log entry
0709 13:07:47.005221 (+358060us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:47.083834 (+ 78613us) log.cc:844] Serialized 14 byte log entry
0709 13:07:47.084104 (+   270us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:47.084242 (+   138us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:47.197988 (+113746us) spinlock_profiling.cc:243] Waited 5.91 ms on lock 0x7b180038d280. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f3625264de1 00007f36252715b1 00007f361c39c3f3 00007f361c39e7c1 00007f361c39e779 00007f361c39e709 00007f361c39e6d1 00007f361c39d9cd 000000000038f354 000000000038f199 00007f361c37f83a
0709 13:07:47.218141 (+ 20153us) raft_consensus.cc:1685] finished
0709 13:07:47.235540 (+ 17399us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:47.235799 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13738,"prepare.queue_time_us":95917,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":10196,"raft.run_wall_time_us":5448,"spinlock_wait_cycles":35016320,"thread_start_us":313431,"threads_started":1,"wal-append.queue_time_us":423337}
I20260709 13:07:47.129459 21675 raft_consensus.cc:515] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:47.261231 16354 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41830 (request call id 2541) took 1088 ms. Trace:
I20260709 13:07:47.262517 21675 leader_election.cc:290] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:47.253014 16947 raft_consensus.cc:1275] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:07:47.264665 21665 leader_election.cc:290] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:47.228950 21696 raft_consensus.cc:515] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:47.266534 21680 consensus_queue.cc:1048] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:47.268723 21696 leader_election.cc:290] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:47.271490 21675 consensus_queue.cc:1048] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:47.261878 16354 rpcz_store.cc:276] 0709 13:07:46.172638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:46.739683 (+567045us) service_pool.cc:224] Handling call
0709 13:07:46.740005 (+   322us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:46.746711 (+  6706us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:46.746764 (+    53us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:46.748133 (+  1369us) log.cc:844] Serialized 52 byte log entry
0709 13:07:46.992916 (+244783us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:47.014412 (+ 21496us) log.cc:844] Serialized 14 byte log entry
0709 13:07:47.014807 (+   395us) log.cc:844] Serialized 14 byte log entry
0709 13:07:47.014957 (+   150us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:47.015028 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:47.167976 (+152948us) spinlock_profiling.cc:243] Waited 13.8 ms on lock 0x7b180004d200. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f3625264de1 00007f36252715b1 00007f361c36a2a6 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f36243b2aa1 00007f36243a9b37 00007f36243a99ca 00007f36244a126f
0709 13:07:47.169444 (+  1468us) spinlock_profiling.cc:243] Waited 16.9 ms on lock 0x7b4800032358. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f36243b2aa1 00007f36243a9b37 00007f36243a99ca 00007f36244a126f 00007f36244a0f37 00007f36244b555c 00007f36244b5508 00007f36244b5488 00007f36244b5443 00007f36244b46ec 00007f36233dea96
0709 13:07:47.260862 (+ 91418us) raft_consensus.cc:1685] finished
0709 13:07:47.260898 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:47.261138 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11534,"prepare.queue_time_us":215923,"prepare.run_cpu_time_us":99,"prepare.run_wall_time_us":105,"raft.queue_time_us":4131,"raft.run_cpu_time_us":3968,"raft.run_wall_time_us":176618,"spinlock_wait_cycles":70786688,"thread_start_us":170330,"threads_started":1,"wal-append.queue_time_us":459697}
I20260709 13:07:47.251649 16106 catalog_manager.cc:5697] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "1109f76a0b7b443a84c0327c8707bc63" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:07:47.259832 15057 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:47.245644 21713 raft_consensus.cc:3060] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:47.239673 21575 raft_consensus.cc:3060] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:47.170473 21552 consensus_queue.cc:1048] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.109s
I20260709 13:07:47.152467 21534 raft_consensus.cc:515] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:47.287693 21458 leader_election.cc:290] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:07:47.307691 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 208656us
I20260709 13:07:47.310535 16322 leader_election.cc:304] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:07:47.323417 16321 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:47.337828 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:47.447084 16173 leader_election.cc:304] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
W20260709 13:07:47.451480 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 186314us
I20260709 13:07:47.464047 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:47.464803 16282 raft_consensus.cc:2468] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 13.
I20260709 13:07:47.469290 21723 raft_consensus.cc:493] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.470141 21723 raft_consensus.cc:515] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } }
I20260709 13:07:47.471800 21534 leader_election.cc:290] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:47.473273 21723 leader_election.cc:290] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:47.473328 21676 raft_consensus.cc:493] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.474170 21676 raft_consensus.cc:515] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:47.476336 21676 leader_election.cc:290] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:47.477304 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:47.319237 21667 leader_election.cc:290] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:47.485209 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:47.452023 21578 raft_consensus.cc:2749] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:47.488238 16354 raft_consensus.cc:1275] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:07:47.488058 21578 consensus_queue.cc:1048] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:47.451817 21727 raft_consensus.cc:493] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.491405 21727 raft_consensus.cc:515] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:47.494601 21566 consensus_queue.cc:1048] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:07:47.456132 21458 raft_consensus.cc:493] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:47.497417 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:47.497387 21458 raft_consensus.cc:515] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:47.498239 16352 raft_consensus.cc:2376] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 10. Re-sending same reply.
I20260709 13:07:47.499878 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:47.500511 16352 raft_consensus.cc:2376] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 13. Re-sending same reply.
I20260709 13:07:47.502203 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:47.503048 16352 raft_consensus.cc:2376] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 14. Re-sending same reply.
I20260709 13:07:47.326357 21687 raft_consensus.cc:2749] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:47.443383 21620 raft_consensus.cc:493] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.510661 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:47.514794 16106 catalog_manager.cc:5697] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f reported cstate change: term changed from 10 to 13, leader changed from e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) to 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68). New cstate: current_term: 13 leader_uuid: "1109f76a0b7b443a84c0327c8707bc63" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:07:47.515758 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:47.518246 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:47.517391 16352 raft_consensus.cc:2376] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 10. Re-sending same reply.
I20260709 13:07:47.322013 21576 consensus_queue.cc:1048] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.185s
I20260709 13:07:47.499897 21458 leader_election.cc:290] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:47.325393 21728 consensus_queue.cc:1048] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.199s
I20260709 13:07:47.494472 21727 leader_election.cc:290] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:07:47.534403 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 397050us
I20260709 13:07:47.540726 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:47.546633 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:47.552109 16204 raft_consensus.cc:2468] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 5.
I20260709 13:07:47.552282 16200 raft_consensus.cc:2393] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 in current term 15: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:07:47.556787 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:47.558571 16282 raft_consensus.cc:2410] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for term 14 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:07:47.565713 16322 leader_election.cc:304] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:07:47.530978 21534 raft_consensus.cc:493] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:47.579991 16248 leader_election.cc:304] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:47.531256 21552 raft_consensus.cc:493] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:47.587181 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:47.588358 16947 raft_consensus.cc:2410] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for term 14 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:07:47.517987 21620 raft_consensus.cc:515] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:07:47.637488 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 177611us
I20260709 13:07:47.599655 16322 leader_election.cc:304] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:07:47.584473 21490 raft_consensus.cc:2749] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:07:47.648533 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 48999.8us
I20260709 13:07:47.644673 16947 raft_consensus.cc:3060] T 540bfc4ad793452faea5b865343aacf7 P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:47.651572 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bc3c8ff9b84838a2664335d7e1582b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:47.655350 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:47.656049 16352 raft_consensus.cc:2468] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 13.
I20260709 13:07:47.657648 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:47.660409 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:47.661128 16349 raft_consensus.cc:2376] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 15. Re-sending same reply.
I20260709 13:07:47.660957 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:47.662398 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:47.663105 16349 raft_consensus.cc:2468] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 13.
W20260709 13:07:47.665781 21701 log.cc:927] Time spent T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.604s	user 0.001s	sys 0.001s
W20260709 13:07:47.666209 21722 log.cc:927] Time spent T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 13:07:47.692729 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:47.600327 21493 raft_consensus.cc:2764] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:07:47.695432 16277 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45210 (request call id 2498) took 1675 ms. Trace:
I20260709 13:07:47.699878 16277 rpcz_store.cc:276] 0709 13:07:46.020394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:46.044109 (+ 23715us) service_pool.cc:224] Handling call
0709 13:07:46.044601 (+   492us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:46.107430 (+ 62829us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:46.107484 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:46.108120 (+   636us) log.cc:844] Serialized 26 byte log entry
0709 13:07:46.383646 (+275526us) spinlock_profiling.cc:243] Waited 16.1 ms on lock 0x7b180038c260. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f3625264de1 00007f36252715b1 00007f361c37ee07 00007f36251d9ab9 00007f361c39b69b 00007f361c39993f 00007f361c39bc02 00007f361f02320b 00007f361f028d23 00007f361f0290d1 00007f361f444a0f
0709 13:07:46.712644 (+328998us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:46.749670 (+ 37026us) log.cc:844] Serialized 14 byte log entry
0709 13:07:46.749889 (+   219us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:46.749978 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:46.938147 (+188169us) spinlock_profiling.cc:243] Waited 5.9 ms on lock 0x7b180038c260. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f3625264de1 00007f36252715b1 00007f361c39c522 00007f361c39e7c1 00007f361c39e779 00007f361c39e709 00007f361c39e6d1 00007f361c39d9cd 000000000038f354 000000000038f199 00007f361c37f83a
0709 13:07:47.665152 (+727005us) spinlock_profiling.cc:243] Waited 50.4 ms on lock 0x7b4400022b4c. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361c224db1 00007f361c2c2c85 00007f361c2c36a2 00007f361f0351db 00007f361f030aaf 00007f361f02486e 00007f361f023bb6 00007f361f0237d8 00007f361f02d221 00007f361f02d1d9 00007f361f02d169
0709 13:07:47.695095 (+ 29943us) raft_consensus.cc:1685] finished
0709 13:07:47.695122 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:47.695332 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":62318,"prepare.queue_time_us":40952,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":48,"raft.queue_time_us":65974,"raft.run_cpu_time_us":356,"raft.run_wall_time_us":41508,"spinlock_wait_cycles":166416896,"thread_start_us":328784,"threads_started":1,"wal-append.queue_time_us":873432}
I20260709 13:07:47.697621 16348 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41830 (request call id 2540) took 1525 ms. Trace:
I20260709 13:07:47.703110 16914 leader_election.cc:304] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:07:47.702685 16348 rpcz_store.cc:276] 0709 13:07:46.172346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:46.694474 (+522128us) service_pool.cc:224] Handling call
0709 13:07:46.714822 (+ 20348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:46.944663 (+229841us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:47.697390 (+752727us) spinlock_profiling.cc:243] Waited 171 ms on lock 0x7b540028bed4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f489e01 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6
0709 13:07:47.697561 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":393335040}
I20260709 13:07:47.705852 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:47.708564 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:47.709280 16944 raft_consensus.cc:2468] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 5.
I20260709 13:07:47.644867 21667 raft_consensus.cc:2804] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:47.712203 16914 leader_election.cc:304] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:47.712141 16173 leader_election.cc:304] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:47.594820 21552 raft_consensus.cc:515] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:47.590938 21534 raft_consensus.cc:515] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:47.645344 21690 raft_consensus.cc:493] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:47.690289 21687 raft_consensus.cc:2749] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:47.644675 21727 consensus_queue.cc:1048] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.076s
I20260709 13:07:47.696300 21696 raft_consensus.cc:493] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
W20260709 13:07:47.734608 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 49061.5us
W20260709 13:07:47.710350 21710 log.cc:927] Time spent T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.648s	user 0.005s	sys 0.001s
W20260709 13:07:47.719877 21700 log.cc:927] Time spent T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.835s	user 0.008s	sys 0.000s
I20260709 13:07:47.725483 16947 raft_consensus.cc:1275] T 540bfc4ad793452faea5b865343aacf7 P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260709 13:07:47.722751 21667 raft_consensus.cc:493] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:47.744653 16947 pending_rounds.cc:85] T 540bfc4ad793452faea5b865343aacf7 P 1109f76a0b7b443a84c0327c8707bc63: Aborting all ops after (but not including) 8
I20260709 13:07:47.745177 16947 pending_rounds.cc:107] T 540bfc4ad793452faea5b865343aacf7 P 1109f76a0b7b443a84c0327c8707bc63: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 13.9
I20260709 13:07:47.736073 21584 raft_consensus.cc:2804] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:47.745574 16947 raft_consensus.cc:2917] T 540bfc4ad793452faea5b865343aacf7 P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Aborting config change with OpId 13.9: Aborted: Op aborted by new leader
I20260709 13:07:47.759372 16947 raft_consensus.cc:2889] T 540bfc4ad793452faea5b865343aacf7 P 1109f76a0b7b443a84c0327c8707bc63 [term 15 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:47.704857 21578 consensus_queue.cc:1048] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 13:07:47.755424 21667 raft_consensus.cc:3060] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:47.762244 21584 raft_consensus.cc:493] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:47.774493 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 62362.7us
I20260709 13:07:47.758647 21724 raft_consensus.cc:2804] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:47.754336 21616 raft_consensus.cc:2749] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:07:47.769065 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 82846.2us
I20260709 13:07:47.738886 21690 raft_consensus.cc:515] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:07:47.801687 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 61725.2us
I20260709 13:07:47.743836 21696 raft_consensus.cc:515] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:47.772706 21584 raft_consensus.cc:3060] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:07:47.769243 21734 raft_consensus.cc:493] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.825839 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:47.827266 16200 raft_consensus.cc:1275] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 11. (term mismatch)
I20260709 13:07:47.827678 16200 pending_rounds.cc:85] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f: Aborting all ops after (but not including) 10
I20260709 13:07:47.827893 16200 pending_rounds.cc:107] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f: Aborting uncommitted NO_OP operation due to leader change: 16.11
I20260709 13:07:47.828137 16200 raft_consensus.cc:2889] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:47.819095 21539 consensus_queue.cc:1048] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:07:47.824118 16199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60154 (request call id 2981) took 1271 ms. Trace:
I20260709 13:07:47.785331 21544 raft_consensus.cc:493] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:47.794271 21724 raft_consensus.cc:493] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:47.835772 21261 consensus_meta.cc:287] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63: Time spent flushing consensus metadata: real 0.581s	user 0.009s	sys 0.002s
I20260709 13:07:47.838788 16199 rpcz_store.cc:276] 0709 13:07:46.552303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:46.553186 (+   883us) service_pool.cc:224] Handling call
0709 13:07:46.553599 (+   413us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:46.554007 (+   408us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:46.554045 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:46.556646 (+  2601us) log.cc:844] Serialized 26 byte log entry
0709 13:07:46.841066 (+284420us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:46.841129 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:46.841234 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:47.670438 (+829204us) spinlock_profiling.cc:243] Waited 50.6 ms on lock 0x7b4400022b4c. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361c224db1 00007f361c2c2c85 00007f361c2c36a2 00007f361f0351db 00007f361f030aaf 00007f361f02486e 00007f361f023bb6 00007f361f0237d8 00007f361f02d221 00007f361f02d1d9 00007f361f02d169
0709 13:07:47.808689 (+138251us) raft_consensus.cc:1685] finished
0709 13:07:47.808710 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:47.824006 (+ 15296us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1237,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":84,"spinlock_wait_cycles":116434688,"thread_start_us":261025,"threads_started":1,"wal-append.queue_time_us":413876}
I20260709 13:07:47.850092 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:47.851076 16204 raft_consensus.cc:2468] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 13.
I20260709 13:07:47.848057 16248 leader_election.cc:304] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:07:47.853715 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:07:47.840308 21713 consensus_meta.cc:287] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63: Time spent flushing consensus metadata: real 0.542s	user 0.007s	sys 0.004s
I20260709 13:07:47.860921 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:47.862056 16279 raft_consensus.cc:2468] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 19.
W20260709 13:07:47.863277 16248 leader_election.cc:336] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 2.196s (SENT)
I20260709 13:07:47.863700 16322 leader_election.cc:304] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:07:47.786016 21729 consensus_queue.cc:1048] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.065s
W20260709 13:07:47.846279 21575 consensus_meta.cc:287] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 0.556s	user 0.004s	sys 0.008s
I20260709 13:07:47.887471 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:47.843434 21676 raft_consensus.cc:493] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:47.849366 21724 raft_consensus.cc:3060] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:47.918128 16275 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45218 (request call id 2431) took 1586 ms. Trace:
I20260709 13:07:47.919201 16912 leader_election.cc:304] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:47.852592 21674 raft_consensus.cc:493] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:47.926074 21534 leader_election.cc:290] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:47.845264 21734 raft_consensus.cc:515] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:47.929157 21690 leader_election.cc:290] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:47.859509 21261 raft_consensus.cc:515] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:47.930538 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:47.895001 16353 raft_consensus.cc:2410] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for term 17 because replica has last-logged OpId of term: 16 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 13:07:47.860562 21620 leader_election.cc:290] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:47.936630 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:47.893622 21687 raft_consensus.cc:2804] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:07:47.878316 21745 raft_consensus.cc:2804] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:47.931942 16275 rpcz_store.cc:276] 0709 13:07:46.331460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:46.331624 (+   164us) service_pool.cc:224] Handling call
0709 13:07:46.332053 (+   429us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:46.332442 (+   389us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:07:46.362671 (+ 30229us) log.cc:844] Serialized 14 byte log entry
0709 13:07:46.778786 (+416115us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:46.785670 (+  6884us) log.cc:844] Serialized 26 byte log entry
0709 13:07:46.785824 (+   154us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:46.785857 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:46.785930 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:47.674213 (+888283us) spinlock_profiling.cc:243] Waited 58.8 ms on lock 0x7b4400022b4c. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361c224db1 00007f361c2c2c85 00007f361c2c36a2 00007f361f0351db 00007f361f030aaf 00007f361f02486e 00007f361f023bb6 00007f361f0237d8 00007f361f02d221 00007f361f02d1d9 00007f361f02d169
0709 13:07:47.893411 (+219198us) raft_consensus.cc:1685] finished
0709 13:07:47.917571 (+ 24160us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:47.918057 (+   486us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29772,"prepare.queue_time_us":30531,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":433,"raft.run_cpu_time_us":245,"raft.run_wall_time_us":2475,"spinlock_wait_cycles":135225088,"thread_start_us":415647,"threads_started":1,"wal-append.queue_time_us":507058}
I20260709 13:07:47.850476 21544 raft_consensus.cc:515] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:47.942919 16204 raft_consensus.cc:2468] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 19.
I20260709 13:07:47.947774 16912 leader_election.cc:304] T 540bfc4ad793452faea5b865343aacf7 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:47.937443 21676 raft_consensus.cc:515] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:47.949903 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:47.878006 21746 consensus_queue.cc:1048] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.062s
I20260709 13:07:47.878489 21713 raft_consensus.cc:515] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:47.938865 21737 raft_consensus.cc:493] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:47.946272 21687 raft_consensus.cc:493] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:47.942883 21727 raft_consensus.cc:493] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:47.952795 21745 raft_consensus.cc:493] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:47.955549 21578 raft_consensus.cc:493] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:47.949361 21660 leader_election.cc:290] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:07:47.985056 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 50481.1us
I20260709 13:07:47.946362 21723 consensus_queue.cc:1048] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 13:07:47.965085 21744 raft_consensus.cc:2804] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:07:48.008091 16320 leader_election.cc:304] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:48.090520 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:48.110343 16947 raft_consensus.cc:2468] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 17.
I20260709 13:07:48.114490 16173 leader_election.cc:304] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:47.985031 21687 raft_consensus.cc:3060] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:47.943216 21674 raft_consensus.cc:515] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:07:48.148624 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 140636us
I20260709 13:07:48.089202 21578 raft_consensus.cc:515] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } }
I20260709 13:07:47.997745 21745 raft_consensus.cc:3060] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:48.000765 21552 leader_election.cc:290] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:07:48.173596 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 59238.5us
I20260709 13:07:48.110530 21640 raft_consensus.cc:493] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:48.088896 21744 raft_consensus.cc:493] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:48.108438 21665 raft_consensus.cc:493] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:48.168740 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 213429us
I20260709 13:07:47.995911 21727 raft_consensus.cc:515] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:48.154800 21705 raft_consensus.cc:2749] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:48.223400 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:07:48.172289 21741 log.cc:927] Time spent T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.367s	user 0.000s	sys 0.001s
I20260709 13:07:48.225788 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:07:48.214787 21742 log.cc:927] Time spent T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.275s	user 0.002s	sys 0.000s
I20260709 13:07:47.996964 21737 raft_consensus.cc:515] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:48.213452 21552 raft_consensus.cc:493] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:48.214206 21744 raft_consensus.cc:3060] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:07:48.244252 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 93800.3us
I20260709 13:07:48.216859 21696 leader_election.cc:290] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:48.259159 16320 leader_election.cc:304] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:07:48.246340 21720 log.cc:927] Time spent T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 13:07:48.229423 21575 raft_consensus.cc:493] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:48.241499 21675 raft_consensus.cc:493] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:48.224995 21665 raft_consensus.cc:515] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:48.225126 21640 raft_consensus.cc:515] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:48.286656 21734 leader_election.cc:290] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:48.282866 21675 raft_consensus.cc:515] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:48.287106 21676 leader_election.cc:290] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:48.288046 21676 raft_consensus.cc:2749] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:07:48.289129 21675 leader_election.cc:290] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:48.266150 21728 raft_consensus.cc:493] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:48.290468 21740 raft_consensus.cc:493] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:48.290730 21544 leader_election.cc:290] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:48.290966 21673 raft_consensus.cc:493] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:48.291118 21740 raft_consensus.cc:515] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:48.291584 21673 raft_consensus.cc:515] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:48.281421 21261 leader_election.cc:290] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 11 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:48.279069 21752 raft_consensus.cc:2749] T 540bfc4ad793452faea5b865343aacf7 P 1109f76a0b7b443a84c0327c8707bc63 [term 15 LEARNER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:07:48.296073 21732 log.cc:927] Time spent T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.160s	user 0.000s	sys 0.001s
I20260709 13:07:48.296689 21740 leader_election.cc:290] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:48.297971 16280 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45218 (request call id 2439) took 1214 ms. Trace:
W20260709 13:07:48.298123 21702 log.cc:927] Time spent T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 1.381s	user 0.016s	sys 0.011s
I20260709 13:07:48.298236 21767 raft_consensus.cc:2804] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:48.298527 16280 rpcz_store.cc:276] 0709 13:07:47.083178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:47.084465 (+  1287us) service_pool.cc:224] Handling call
0709 13:07:47.084921 (+   456us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:47.145613 (+ 60692us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:47.145667 (+    54us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:47.148138 (+  2471us) log.cc:844] Serialized 52 byte log entry
0709 13:07:47.534270 (+386132us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:47.582375 (+ 48105us) log.cc:844] Serialized 14 byte log entry
0709 13:07:47.582634 (+   259us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:47.582713 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:47.815037 (+232324us) spinlock_profiling.cc:243] Waited 3.26 ms on lock 0x7b180032fa40. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f3625264de1 00007f36252715b1 00007f361c36a2a6 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f3625264de1 00007f36252715b1 00007f361c39c3f3 00007f361c39e7c1
0709 13:07:47.815679 (+   642us) spinlock_profiling.cc:243] Waited 3.17 ms on lock 0x7b180032fa40. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f3625264de1 00007f36252715b1 00007f361c39c3f3 00007f361c39e7c1 00007f361c39e779 00007f361c39e709 00007f361c39e6d1 00007f361c39d9cd 000000000038f354 000000000038f199 00007f361c37f83a
0709 13:07:48.297718 (+482039us) raft_consensus.cc:1685] finished
0709 13:07:48.297747 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:48.297902 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18503,"prepare.queue_time_us":51028,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":58,"raft.queue_time_us":38132,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":12898,"spinlock_wait_cycles":26727936,"thread_start_us":287477,"threads_started":1,"wal-append.queue_time_us":370246}
W20260709 13:07:48.300932 21750 log.cc:927] Time spent T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:07:48.312225 21665 leader_election.cc:290] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:48.253450 21552 raft_consensus.cc:515] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:48.289870 21728 raft_consensus.cc:515] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:07:48.376514 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 147635us
W20260709 13:07:48.380270 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 161360us
I20260709 13:07:48.385349 16947 raft_consensus.cc:1240] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 13. Current term is 14. Ops: []
W20260709 13:07:48.330068 21667 consensus_meta.cc:287] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 0.544s	user 0.011s	sys 0.000s
I20260709 13:07:48.298941 21767 raft_consensus.cc:493] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:48.400327 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:48.294457 21673 leader_election.cc:290] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:48.330268 21765 raft_consensus.cc:493] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:48.276810 21575 raft_consensus.cc:515] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:48.403568 21616 raft_consensus.cc:493] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:48.406330 21667 raft_consensus.cc:515] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:48.414403 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:48.296712 21727 leader_election.cc:290] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:48.416292 21667 leader_election.cc:290] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:48.332017 21552 leader_election.cc:290] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:48.319450 21713 leader_election.cc:290] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 14 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:48.423347 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:48.320099 21578 leader_election.cc:290] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:48.326478 21737 leader_election.cc:290] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:48.329109 21640 leader_election.cc:290] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:48.445124 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:48.398793 21674 leader_election.cc:290] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:48.404271 21767 raft_consensus.cc:3060] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:07:48.457257 21683 consensus_meta.cc:287] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3: Time spent flushing consensus metadata: real 1.204s	user 0.009s	sys 0.005s
W20260709 13:07:48.471238 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 196775us
I20260709 13:07:48.480401 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:48.318497 21724 raft_consensus.cc:515] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:07:48.464985 21584 consensus_meta.cc:287] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f: Time spent flushing consensus metadata: real 0.632s	user 0.012s	sys 0.000s
W20260709 13:07:48.484031 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 253744us
I20260709 13:07:48.484711 21640 raft_consensus.cc:493] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:48.486817 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:48.487600 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:48.432209 21616 raft_consensus.cc:515] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:48.490268 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:48.489655 16208 raft_consensus.cc:3060] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:48.494505 16173 leader_election.cc:304] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:48.498080 16944 raft_consensus.cc:2393] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 14: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
I20260709 13:07:48.430678 21765 raft_consensus.cc:515] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:48.505532 16946 raft_consensus.cc:1240] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:48.513381 21616 leader_election.cc:290] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:48.488569 21584 raft_consensus.cc:515] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:48.490448 21753 raft_consensus.cc:493] T 4b962ceebb5c48c1914459ae0c0eff1b P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:48.517009 21584 leader_election.cc:290] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:48.516515 21753 raft_consensus.cc:515] T 4b962ceebb5c48c1914459ae0c0eff1b P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:48.519632 21765 leader_election.cc:290] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:48.520004 21724 leader_election.cc:290] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 14 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:48.473119 21683 raft_consensus.cc:515] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:48.523095 21683 leader_election.cc:290] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:48.524761 16200 raft_consensus.cc:2368] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 5. Current term is 6.
I20260709 13:07:48.525960 16173 leader_election.cc:304] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:48.527709 21775 raft_consensus.cc:493] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:48.528504 21775 raft_consensus.cc:515] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:48.532495 16248 leader_election.cc:304] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:48.532507 16946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:48.496296 21576 raft_consensus.cc:493] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.535965 16946 raft_consensus.cc:2468] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 10.
I20260709 13:07:48.499894 21308 raft_consensus.cc:493] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:48.493687 21640 raft_consensus.cc:515] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:07:48.549649 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 59762.2us
I20260709 13:07:48.553665 21779 raft_consensus.cc:493] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:48.535290 21737 raft_consensus.cc:2804] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:07:48.541901 21765 raft_consensus.cc:2804] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:48.554704 21674 raft_consensus.cc:493] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:48.575536 21562 raft_consensus.cc:493] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:48.576377 21562 raft_consensus.cc:515] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:48.576004 21674 raft_consensus.cc:515] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:48.585054 21784 raft_consensus.cc:493] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:48.586105 21784 raft_consensus.cc:515] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:48.589447 21774 raft_consensus.cc:493] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:48.590427 21774 raft_consensus.cc:515] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:48.593896 21774 leader_election.cc:290] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:48.596410 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:48.597487 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:48.598150 16283 raft_consensus.cc:3060] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:48.598126 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:48.600649 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:48.543215 21687 raft_consensus.cc:515] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:48.557286 21494 raft_consensus.cc:493] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:48.543041 21576 raft_consensus.cc:515] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:48.606686 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:48.607683 16283 raft_consensus.cc:2468] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 14.
I20260709 13:07:48.606963 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:48.618255 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:48.609355 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:48.619656 16357 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41832 (request call id 2370) took 1603 ms. Trace:
I20260709 13:07:48.620095 16348 raft_consensus.cc:3060] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:48.609464 16282 raft_consensus.cc:1275] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260709 13:07:48.621570 16282 pending_rounds.cc:85] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3: Aborting all ops after (but not including) 8
I20260709 13:07:48.621943 16282 pending_rounds.cc:107] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 13.9
I20260709 13:07:48.611683 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:48.613533 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:48.603700 21687 leader_election.cc:290] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 20 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:48.561131 21458 raft_consensus.cc:2749] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:48.610318 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
W20260709 13:07:48.628711 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 94824.7us
I20260709 13:07:48.629741 16246 leader_election.cc:304] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:48.629769 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:48.623207 16354 raft_consensus.cc:3060] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:48.620440 16357 rpcz_store.cc:276] 0709 13:07:47.015911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:47.120282 (+104371us) service_pool.cc:224] Handling call
0709 13:07:47.120783 (+   501us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:07:47.121293 (+   510us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:47.121341 (+    48us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:07:47.122240 (+   899us) log.cc:844] Serialized 78 byte log entry
0709 13:07:47.504199 (+381959us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:07:47.517209 (+ 13010us) log.cc:844] Serialized 14 byte log entry
0709 13:07:47.526298 (+  9089us) log.cc:844] Serialized 14 byte log entry
0709 13:07:47.530862 (+  4564us) log.cc:844] Serialized 14 byte log entry
0709 13:07:47.531339 (+   477us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:47.531424 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:47.682329 (+150905us) spinlock_profiling.cc:243] Waited 13 ms on lock 0x7b18000d10e0. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f3625264de1 00007f36252715b1 00007f361c39c3f3 00007f361c39e7c1 00007f361c39e779 00007f361c39e709 00007f361c39e6d1 00007f361c39d9cd 000000000038f354 000000000038f199 00007f361c37f83a
0709 13:07:48.303070 (+620741us) spinlock_profiling.cc:243] Waited 8.89 ms on lock 0x7b18000d10e0. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f3625264de1 00007f36252715b1 00007f361c39c522 00007f361c39e7c1 00007f361c39e779 00007f361c39e709 00007f361c39e6d1 00007f361c39d9cd 000000000038f354 000000000038f199 00007f361c37f83a
0709 13:07:48.417120 (+114050us) spinlock_profiling.cc:243] Waited 3.66 ms on lock 0x7b18000d10e0. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f3625264de1 00007f36252715b1 00007f361c39c3f3 00007f361c39e7c1 00007f361c39e779 00007f361c39e709 00007f361c39e6d1 00007f361c39d9cd 000000000038f354 000000000038f199 00007f361c37f83a
0709 13:07:48.619330 (+202210us) raft_consensus.cc:1685] finished
0709 13:07:48.619351 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:48.619558 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":205115,"prepare.queue_time_us":1798660,"prepare.run_cpu_time_us":167,"prepare.run_wall_time_us":1606,"raft.queue_time_us":37957,"raft.run_cpu_time_us":606,"raft.run_wall_time_us":31173,"spinlock_wait_cycles":58824448,"thread_start_us":281709,"threads_started":1,"wal-append.queue_time_us":439935}
I20260709 13:07:48.563917 21765 raft_consensus.cc:493] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:48.635152 21765 raft_consensus.cc:3060] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:48.636852 21704 raft_consensus.cc:493] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:48.637516 21704 raft_consensus.cc:515] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:48.639113 21562 leader_election.cc:290] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:48.639952 21704 leader_election.cc:290] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:48.640336 21576 leader_election.cc:290] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:48.564711 21779 raft_consensus.cc:515] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:48.627180 21494 raft_consensus.cc:515] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:48.643340 21779 leader_election.cc:290] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:48.644050 16204 raft_consensus.cc:2468] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 13.
I20260709 13:07:48.563913 21728 leader_election.cc:290] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:48.632470 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:48.621822 21552 raft_consensus.cc:493] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:48.598296 16948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:48.614907 21672 raft_consensus.cc:493] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:48.551584 21696 consensus_queue.cc:1059] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.053s
I20260709 13:07:48.645465 16282 raft_consensus.cc:2917] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Aborting config change with OpId 13.9: Aborted: Op aborted by new leader
I20260709 13:07:48.648319 16322 leader_election.cc:304] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:48.649842 16348 raft_consensus.cc:2468] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 11.
I20260709 13:07:48.631855 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:48.654284 16282 raft_consensus.cc:2889] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:48.572137 21737 raft_consensus.cc:697] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 19 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:07:48.656558 16348 raft_consensus.cc:1275] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 9. (term mismatch)
I20260709 13:07:48.656919 16348 pending_rounds.cc:85] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e: Aborting all ops after (but not including) 8
I20260709 13:07:48.657235 16348 pending_rounds.cc:107] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260709 13:07:48.581156 21575 leader_election.cc:290] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:48.657555 16348 raft_consensus.cc:2889] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:48.659634 16208 raft_consensus.cc:2468] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 14.
W20260709 13:07:48.661203 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 91672.5us
I20260709 13:07:48.552415 21308 raft_consensus.cc:515] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:48.668015 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:48.669137 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:48.669917 16354 raft_consensus.cc:2468] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 14.
I20260709 13:07:48.679306 16357 raft_consensus.cc:1240] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:48.619529 21660 raft_consensus.cc:493] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:48.770972 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
W20260709 13:07:48.691960 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 62297.5us
I20260709 13:07:48.644999 21578 raft_consensus.cc:493] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:48.773674 16320 leader_election.cc:304] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:48.779541 21676 raft_consensus.cc:2804] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:48.652997 21552 raft_consensus.cc:515] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:07:48.776197 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 127990us
I20260709 13:07:48.780144 21676 raft_consensus.cc:697] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 14 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:48.781311 21676 consensus_queue.cc:237] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:48.785707 16322 leader_election.cc:304] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:48.788590 21768 raft_consensus.cc:2749] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:48.677100 21308 leader_election.cc:290] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:48.791901 16322 leader_election.cc:304] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:48.772378 21539 raft_consensus.cc:2749] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:48.794760 21728 raft_consensus.cc:2749] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:48.799470 21660 raft_consensus.cc:515] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:48.679018 21544 raft_consensus.cc:493] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:48.828526 21578 raft_consensus.cc:515] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:48.782271 21552 leader_election.cc:290] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:07:48.860064 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 81226.7us
I20260709 13:07:48.834470 21773 raft_consensus.cc:493] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:48.835887 21494 leader_election.cc:290] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:48.845968 16202 raft_consensus.cc:2468] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 10.
I20260709 13:07:48.673611 21382 raft_consensus.cc:493] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:48.845000 21544 raft_consensus.cc:515] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:48.859251 21578 leader_election.cc:290] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:07:48.862043 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 70278us
I20260709 13:07:48.673388 21458 raft_consensus.cc:493] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:48.874822 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:48.862670 16352 raft_consensus.cc:2955] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index 6 to 10, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:07:48.907639 16207 raft_consensus.cc:2468] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 8.
I20260709 13:07:48.776600 21575 raft_consensus.cc:493] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:48.900982 21544 leader_election.cc:290] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:07:48.903824 21736 log.cc:927] Time spent T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 1.054s	user 0.005s	sys 0.009s
I20260709 13:07:48.905210 21765 raft_consensus.cc:515] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:48.909582 16943 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35106 (request call id 897) took 1768 ms. Trace:
I20260709 13:07:48.661679 21672 raft_consensus.cc:515] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:07:48.907091 21744 consensus_meta.cc:287] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63: Time spent flushing consensus metadata: real 0.644s	user 0.006s	sys 0.006s
I20260709 13:07:48.927347 16943 rpcz_store.cc:276] 0709 13:07:47.124158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:47.124295 (+   137us) service_pool.cc:224] Handling call
0709 13:07:47.124623 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:47.215747 (+ 91124us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:47.215799 (+    52us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:47.215866 (+    67us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:47.215919 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:48.891944 (+1676025us) spinlock_profiling.cc:243] Waited 90.8 ms on lock 0x7b54005a2654. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f489e01 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6
0709 13:07:48.892159 (+   215us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:48.892422 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":208837888}
I20260709 13:07:48.884388 21687 raft_consensus.cc:2749] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:48.853576 21660 leader_election.cc:290] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:48.890395 21775 leader_election.cc:290] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:48.927215 21737 consensus_queue.cc:237] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:48.964536 16206 raft_consensus.cc:2468] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 14.
I20260709 13:07:48.964583 16355 raft_consensus.cc:1275] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:07:48.965965 16205 raft_consensus.cc:1240] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 16. Current term is 17. Ops: []
W20260709 13:07:48.960035 21745 consensus_meta.cc:287] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3: Time spent flushing consensus metadata: real 0.748s	user 0.006s	sys 0.006s
W20260709 13:07:48.961102 16353 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41830 (request call id 2562) took 2590 ms (client timeout 2196 ms). Trace:
W20260709 13:07:48.975497 16353 rpcz_store.cc:269] 0709 13:07:46.370844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:46.478522 (+107678us) service_pool.cc:224] Handling call
0709 13:07:48.960531 (+2482009us) spinlock_profiling.cc:243] Waited 1.34 s on lock 0x7b540026a054. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:07:48.960965 (+   434us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3074338176}
I20260709 13:07:48.895617 21773 raft_consensus.cc:515] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:48.981909 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:48.984472 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:48.987246 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:48.988159 16283 raft_consensus.cc:3060] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:48.989650 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:48.996814 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:07:48.971920 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 415048us
I20260709 13:07:49.009824 16283 raft_consensus.cc:2468] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 20.
I20260709 13:07:49.054950 21544 raft_consensus.cc:493] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:49.055166 21490 raft_consensus.cc:493] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:49.055775 21544 raft_consensus.cc:515] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:49.055868 21490 raft_consensus.cc:515] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:49.056421 16248 leader_election.cc:304] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:49.057308 21494 raft_consensus.cc:2749] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:49.058000 21544 leader_election.cc:290] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:49.059334 21786 raft_consensus.cc:493] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:49.060322 21490 leader_election.cc:290] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:49.117002 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:49.117796 16274 raft_consensus.cc:2468] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 12.
I20260709 13:07:49.118897 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:49.060141 21786 raft_consensus.cc:515] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:49.061120 21772 raft_consensus.cc:493] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:49.062222 21778 raft_consensus.cc:493] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:49.148710 21772 raft_consensus.cc:515] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:48.927855 21458 raft_consensus.cc:515] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:48.909323 21382 raft_consensus.cc:515] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:49.118974 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:49.118841 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:49.125464 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:49.152472 16203 raft_consensus.cc:2468] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 15.
I20260709 13:07:49.152695 21382 leader_election.cc:290] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:49.125828 21674 leader_election.cc:290] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:49.136708 21676 raft_consensus.cc:493] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.141119 21566 raft_consensus.cc:493] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:49.148821 21778 raft_consensus.cc:515] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:49.149009 16355 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41830 (request call id 2542) took 2976 ms. Trace:
I20260709 13:07:48.930626 21575 raft_consensus.cc:515] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:49.164127 21778 leader_election.cc:290] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:49.153857 21676 raft_consensus.cc:515] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:49.165537 21575 leader_election.cc:290] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:49.166780 21676 leader_election.cc:290] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:49.156013 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:49.162509 21566 raft_consensus.cc:515] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:49.163424 21458 leader_election.cc:290] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:48.952651 21744 raft_consensus.cc:515] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:07:49.174438 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 49408.5us
I20260709 13:07:49.160732 16355 rpcz_store.cc:276] 0709 13:07:46.172906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:46.808492 (+635586us) service_pool.cc:224] Handling call
0709 13:07:48.962611 (+2154119us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:48.966345 (+  3734us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:49.147644 (+181299us) spinlock_profiling.cc:243] Waited 1.56 ms on lock 0x7b540026a054. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f489e01 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6
0709 13:07:49.148624 (+   980us) spinlock_profiling.cc:243] Waited 2.15 s on lock 0x7b540026a050. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f4888ad 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:07:49.148877 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4956659712}
I20260709 13:07:49.185858 16248 leader_election.cc:304] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:49.188807 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:49.188877 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:49.190244 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:49.191156 16203 raft_consensus.cc:2468] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 12.
I20260709 13:07:49.191432 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:49.191437 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:49.192816 16322 leader_election.cc:304] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:07:49.168668 21736 log.cc:927] Time spent T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.164s	user 0.000s	sys 0.001s
I20260709 13:07:49.050706 21775 consensus_queue.cc:1048] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.128s
W20260709 13:07:49.183452 21790 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.617s	user 0.087s	sys 0.199s
I20260709 13:07:49.195188 16322 leader_election.cc:304] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:49.210682 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:49.006748 21745 raft_consensus.cc:515] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:49.201547 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:49.218597 16282 raft_consensus.cc:2468] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 4.
I20260709 13:07:49.215036 16942 raft_consensus.cc:2368] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 5. Current term is 6.
I20260709 13:07:49.215653 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:49.202571 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:49.221990 16283 raft_consensus.cc:2468] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 15.
I20260709 13:07:49.208657 21729 raft_consensus.cc:493] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:49.205256 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:49.208036 21696 raft_consensus.cc:493] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:49.223109 21729 raft_consensus.cc:515] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:49.224074 21696 raft_consensus.cc:515] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:07:49.215406 21790 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.649s	user 0.087s	sys 0.200s
I20260709 13:07:49.226224 21729 leader_election.cc:290] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:49.227030 21696 leader_election.cc:290] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:49.194774 21681 raft_consensus.cc:493] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:49.228055 21681 raft_consensus.cc:515] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:49.231169 16940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:49.232069 21494 consensus_queue.cc:1059] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:07:49.232220 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f022e2e63ae4461d834e476ff2666991" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:49.233248 21494 raft_consensus.cc:3055] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:49.233644 21494 raft_consensus.cc:740] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:07:49.234473 21784 leader_election.cc:290] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:49.234917 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:49.235983 21640 leader_election.cc:290] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:07:49.236657 21803 log.cc:927] Time spent T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.186s	user 0.000s	sys 0.000s
I20260709 13:07:49.237499 16945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:07:49.238276 16945 raft_consensus.cc:2393] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 6: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
I20260709 13:07:49.196511 21637 raft_consensus.cc:2749] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:49.200040 21687 raft_consensus.cc:2749] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:49.199254 21772 leader_election.cc:290] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:49.194267 21458 raft_consensus.cc:493] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:49.273918 16350 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41830 (request call id 2549) took 3099 ms. Trace:
I20260709 13:07:49.277390 16281 raft_consensus.cc:2393] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 in current term 14: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:07:49.279284 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:49.200615 21746 raft_consensus.cc:493] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:49.201005 21802 raft_consensus.cc:493] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:49.283025 16350 rpcz_store.cc:276] 0709 13:07:46.174667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:47.056589 (+881922us) service_pool.cc:224] Handling call
0709 13:07:47.057275 (+   686us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:47.219808 (+162533us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:47.219844 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:47.257631 (+ 37787us) log.cc:844] Serialized 26 byte log entry
0709 13:07:47.531654 (+274023us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:47.551494 (+ 19840us) log.cc:844] Serialized 14 byte log entry
0709 13:07:47.590884 (+ 39390us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:47.590984 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:47.818372 (+227388us) spinlock_profiling.cc:243] Waited 39.8 ms on lock 0x7b1800392500. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f3625264de1 00007f36252715b1 00007f361c39c3f3 00007f361c39e7c1 00007f361c39e779 00007f361c39e709 00007f361c39e6d1 00007f361c39d9cd 000000000038f354 000000000038f199 00007f361c37f83a
0709 13:07:48.902714 (+1084342us) spinlock_profiling.cc:243] Waited 6.18 ms on lock 0x7b4400022b4c. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361c224db1 00007f361c2c2c85 00007f361c2c36a2 00007f361f0351db 00007f361f030aaf 00007f361f02486e 00007f361f023bb6 00007f361f0237d8 00007f361f02d221 00007f361f02d1d9 00007f361f02d169
0709 13:07:49.273557 (+370843us) raft_consensus.cc:1685] finished
0709 13:07:49.273599 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:49.273829 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":190183,"prepare.queue_time_us":19966,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":3715,"raft.queue_time_us":162972,"raft.run_cpu_time_us":327,"raft.run_wall_time_us":57246,"spinlock_wait_cycles":105657856,"thread_start_us":331324,"threads_started":2,"wal-append.queue_time_us":298595}
I20260709 13:07:49.230134 21681 leader_election.cc:290] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:49.244462 21704 raft_consensus.cc:493] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:49.234515 21494 consensus_queue.cc:260] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:49.277462 21640 consensus_queue.cc:1048] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:07:49.301334 21539 raft_consensus.cc:493] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:49.326006 16248 leader_election.cc:400] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875) with higher term. Message: Invalid argument: T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 5. Current term is 6.
I20260709 13:07:49.326283 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:49.326450 16248 leader_election.cc:403] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:07:49.327838 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 132746us
I20260709 13:07:49.303387 21676 raft_consensus.cc:2749] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:49.336293 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:49.338057 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:49.341676 16353 raft_consensus.cc:2468] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 13.
I20260709 13:07:49.342428 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:49.343075 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:49.343637 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:49.338790 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:49.345824 16355 raft_consensus.cc:2468] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 9.
I20260709 13:07:49.340353 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:49.347059 16354 raft_consensus.cc:2468] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 8.
I20260709 13:07:49.348661 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:49.350299 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:49.351351 16353 raft_consensus.cc:2468] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 15.
I20260709 13:07:49.297617 21458 raft_consensus.cc:515] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:49.303841 21704 raft_consensus.cc:515] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:49.356262 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:49.357491 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:49.367676 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:49.335377 21544 raft_consensus.cc:3060] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:07:49.370240 16914 leader_election.cc:304] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:07:49.299974 21746 raft_consensus.cc:515] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:49.335172 21621 raft_consensus.cc:493] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:49.344748 21494 raft_consensus.cc:3060] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:49.328847 21539 raft_consensus.cc:515] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:49.377527 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:49.379240 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:49.396157 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:49.398352 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:49.399771 16353 raft_consensus.cc:2468] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 12.
I20260709 13:07:49.421489 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:49.424475 21812 raft_consensus.cc:493] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:49.425300 21812 raft_consensus.cc:515] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:49.400795 21566 leader_election.cc:290] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:49.431203 16914 leader_election.cc:304] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:07:49.431764 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:07:49.409956 21799 log.cc:927] Time spent T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.207s	user 0.001s	sys 0.000s
I20260709 13:07:49.380585 21621 raft_consensus.cc:515] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:49.448436 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:49.423738 21744 leader_election.cc:290] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 6 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:49.429430 21772 raft_consensus.cc:2804] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:49.446487 21815 raft_consensus.cc:493] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:49.451941 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:49.289167 21802 raft_consensus.cc:515] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:07:49.325867 21637 consensus_queue.cc:1175] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "363bb2f744eb486f9ad726f08214c98e" responder_term: 11 status { last_received { term: 10 index: 11 } last_committed_idx: 11 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 10. Current term is 11. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:07:49.461320 21802 leader_election.cc:290] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:49.469453 21773 leader_election.cc:290] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:07:49.491007 21798 log.cc:927] Time spent T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.205s	user 0.001s	sys 0.000s
W20260709 13:07:49.443117 21767 consensus_meta.cc:287] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f: Time spent flushing consensus metadata: real 0.979s	user 0.019s	sys 0.004s
I20260709 13:07:49.456460 16279 raft_consensus.cc:1240] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:49.457799 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:49.458700 21815 raft_consensus.cc:515] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:49.459678 21704 leader_election.cc:290] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:49.460310 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:49.505221 16353 raft_consensus.cc:2393] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 13: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:07:49.442840 21745 leader_election.cc:290] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 election: Requested vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:07:49.455154 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 224094us
I20260709 13:07:49.505935 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:49.499382 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:49.500308 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:49.500913 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:49.512938 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:49.513880 16201 raft_consensus.cc:2393] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 in current term 6: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:07:49.514603 21753 leader_election.cc:290] T 4b962ceebb5c48c1914459ae0c0eff1b P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:07:49.515250 21809 log.cc:927] Time spent T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:07:49.515715 21458 leader_election.cc:290] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:49.520886 21616 raft_consensus.cc:493] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:49.521637 16945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:49.521515 21616 raft_consensus.cc:515] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:49.506249 21539 leader_election.cc:290] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:49.457866 21813 raft_consensus.cc:2804] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:49.525588 21813 raft_consensus.cc:697] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 14 LEADER]: Becoming Leader. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:07:49.526755 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:49.527078 21621 leader_election.cc:290] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:07:49.508652 21807 log.cc:927] Time spent T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.154s	user 0.000s	sys 0.001s
I20260709 13:07:49.528004 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:49.508852 21767 raft_consensus.cc:515] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:49.528942 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:49.502777 21746 leader_election.cc:290] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:49.531114 16276 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45210 (request call id 2526) took 1694 ms. Trace:
I20260709 13:07:49.531608 16276 rpcz_store.cc:276] 0709 13:07:47.836925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:47.837167 (+   242us) service_pool.cc:224] Handling call
0709 13:07:47.837466 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:47.847171 (+  9705us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:47.847203 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:47.847245 (+    42us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:47.847276 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:49.530865 (+1683589us) spinlock_profiling.cc:243] Waited 9.52 ms on lock 0x7b540004e554. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f489e01 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6
0709 13:07:49.530914 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:49.531056 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":21889792}
I20260709 13:07:49.533771 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:49.534252 21683 raft_consensus.cc:3055] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:49.534512 16275 raft_consensus.cc:2468] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 12.
I20260709 13:07:49.534818 21683 raft_consensus.cc:740] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:07:49.535765 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:49.535899 21683 consensus_queue.cc:260] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:49.513813 21815 leader_election.cc:290] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:49.539276 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:49.539837 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:49.540521 16280 raft_consensus.cc:2468] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 17.
I20260709 13:07:49.541051 16274 raft_consensus.cc:1275] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:07:49.542405 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:49.578016 16279 raft_consensus.cc:2410] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:07:49.544153 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:49.579305 16348 raft_consensus.cc:2393] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 14: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
I20260709 13:07:49.527506 16354 raft_consensus.cc:2468] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 17.
I20260709 13:07:49.546674 21812 leader_election.cc:290] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:49.547885 21672 leader_election.cc:290] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:49.548573 21616 leader_election.cc:290] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:49.551349 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:49.581511 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:49.582654 16944 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40078 (request call id 687) took 1183 ms. Trace:
I20260709 13:07:49.582850 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:49.548588 16351 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33486 (request call id 784) took 1888 ms. Trace:
I20260709 13:07:49.583515 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:49.526652 21813 consensus_queue.cc:237] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:49.558962 21767 leader_election.cc:290] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 18 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:49.507918 21772 raft_consensus.cc:697] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 11 LEADER]: Becoming Leader. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:07:49.583119 16944 rpcz_store.cc:276] 0709 13:07:48.399747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.399916 (+   169us) service_pool.cc:224] Handling call
0709 13:07:49.582419 (+1182503us) spinlock_profiling.cc:243] Waited 91.4 ms on lock 0x7b54006455d4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:07:49.582541 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":210147712}
I20260709 13:07:49.595485 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:49.596840 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:49.596956 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:49.568133 21544 raft_consensus.cc:2749] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875) with higher term. Message: Invalid argument: T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 5. Current term is 6.
I20260709 13:07:49.582916 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:49.584789 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:49.586704 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:49.552175 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:49.583683 16351 rpcz_store.cc:276] 0709 13:07:47.660611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:47.662683 (+  2072us) service_pool.cc:224] Handling call
0709 13:07:47.663085 (+   402us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:47.663425 (+   340us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:47.663454 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:47.663916 (+   462us) log.cc:844] Serialized 26 byte log entry
0709 13:07:47.770480 (+106564us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:47.784330 (+ 13850us) log.cc:844] Serialized 14 byte log entry
0709 13:07:47.789428 (+  5098us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:47.789507 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:48.295105 (+505598us) spinlock_profiling.cc:243] Waited 3.46 ms on lock 0x7b1800257fe0. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f3625264de1 00007f36252715b1 00007f361c39c522 00007f361c39e7c1 00007f361c39e779 00007f361c39e709 00007f361c39e6d1 00007f361c39d9cd 000000000038f354 000000000038f199 00007f361c37f83a
0709 13:07:49.543466 (+1248361us) spinlock_profiling.cc:243] Waited 6.64 ms on lock 0x7b24001fa2e8. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361c224db1 00007f361c2229c4 00007f361c220acb 00007f361c3dbdc9 00007f361c3dba55 00007f361c3dafb0 00007f361f051488 00007f361f051be8 00007f361f029398 00007f361f02476a 00007f361f023bb6
0709 13:07:49.548363 (+  4897us) raft_consensus.cc:1685] finished
0709 13:07:49.548387 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:49.548523 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41112,"prepare.queue_time_us":119,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":8312,"raft.run_cpu_time_us":335,"raft.run_wall_time_us":39907,"spinlock_wait_cycles":23211136,"thread_start_us":106182,"threads_started":1,"wal-append.queue_time_us":195674}
I20260709 13:07:49.593909 16946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:49.575979 16283 raft_consensus.cc:2468] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 11.
I20260709 13:07:49.598528 16914 leader_election.cc:304] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:49.600618 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:49.602246 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:07:49.603260 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:49.605103 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:49.610062 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:49.611066 16281 raft_consensus.cc:2468] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 13.
I20260709 13:07:49.609470 16322 leader_election.cc:304] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:49.611840 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:49.598394 21672 raft_consensus.cc:493] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:49.613962 16173 leader_election.cc:304] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:49.613974 16322 leader_election.cc:304] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:07:49.619226 21728 raft_consensus.cc:2804] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:49.619719 21728 raft_consensus.cc:493] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:49.619426 21672 raft_consensus.cc:515] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:49.620460 21584 raft_consensus.cc:2804] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:49.620894 21584 raft_consensus.cc:493] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:49.621274 21584 raft_consensus.cc:3060] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:49.621821 21738 log.cc:927] Time spent T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 1.864s	user 0.005s	sys 0.032s
I20260709 13:07:49.621985 21672 leader_election.cc:290] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:49.609402 21578 raft_consensus.cc:493] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:49.623261 21578 raft_consensus.cc:515] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:49.625785 16278 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45210 (request call id 2518) took 2171 ms. Trace:
I20260709 13:07:49.626215 16278 rpcz_store.cc:276] 0709 13:07:47.454380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:47.454644 (+   264us) service_pool.cc:224] Handling call
0709 13:07:47.455152 (+   508us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:47.456149 (+   997us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:47.456186 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:47.457187 (+  1001us) log.cc:844] Serialized 26 byte log entry
0709 13:07:47.689189 (+232002us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:47.689304 (+   115us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:47.689382 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:49.621357 (+1931975us) spinlock_profiling.cc:243] Waited 23.5 ms on lock 0x7b24002a6de8. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361c224db1 00007f361c2229c4 00007f361c220acb 00007f361c3dbdc9 00007f361c3dba55 00007f361c3db09d 00007f361f00d10e 00007f361f02488c 00007f361f023bb6 00007f361f0237d8 00007f361f02d221
0709 13:07:49.625422 (+  4065us) raft_consensus.cc:1685] finished
0709 13:07:49.625447 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:49.625691 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2055,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":111,"spinlock_wait_cycles":54143232,"thread_start_us":231364,"threads_started":1,"wal-append.queue_time_us":273998}
I20260709 13:07:49.605818 21767 raft_consensus.cc:493] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:49.627907 16914 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.180.66:45823 timed out after 1.927s (SENT) [suppressed 20 similar messages]
I20260709 13:07:49.628028 21767 raft_consensus.cc:515] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:07:49.615789 21566 raft_consensus.cc:493] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:49.631954 21566 raft_consensus.cc:515] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:49.633765 15057 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:49.617758 21815 raft_consensus.cc:2804] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:07:49.615450 21773 raft_consensus.cc:493] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:49.620147 21728 raft_consensus.cc:3060] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:49.609939 21795 raft_consensus.cc:2749] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:49.634522 21566 leader_election.cc:290] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:49.635492 21815 raft_consensus.cc:697] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 20 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:49.651190 21815 consensus_queue.cc:237] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:49.648921 21786 leader_election.cc:290] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:49.637434 21773 raft_consensus.cc:515] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:49.654785 16946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:07:49.657042 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:49.658757 16946 raft_consensus.cc:1240] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:49.659900 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:49.647228 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:49.639420 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:49.668053 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:49.668799 21584 raft_consensus.cc:515] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:49.664439 16322 leader_election.cc:304] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:07:49.670082 21600 consensus_queue.cc:1048] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:49.670867 21600 consensus_queue.cc:1243] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer 363bb2f744eb486f9ad726f08214c98e log is divergent from this leader: its last log entry 16.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:07:49.671229 16248 leader_election.cc:304] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:07:49.671870 21584 leader_election.cc:290] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 11 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:49.672349 21765 leader_election.cc:290] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 17 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:49.672627 21637 raft_consensus.cc:2804] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:49.673254 21637 raft_consensus.cc:493] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:49.647661 21767 leader_election.cc:290] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:49.673727 21637 raft_consensus.cc:3060] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:49.674029 21683 raft_consensus.cc:3060] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:49.674335 21619 raft_consensus.cc:2804] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:49.674768 21619 raft_consensus.cc:493] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:49.675179 21619 raft_consensus.cc:3060] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:49.675834 21812 consensus_queue.cc:1048] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:49.643193 21772 consensus_queue.cc:237] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:49.686218 16173 leader_election.cc:304] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:49.687817 21773 leader_election.cc:290] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:49.660209 21578 leader_election.cc:290] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:49.692996 21778 raft_consensus.cc:2804] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:49.693537 21778 raft_consensus.cc:493] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:49.693928 21778 raft_consensus.cc:3060] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:49.695134 16320 leader_election.cc:304] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:07:49.696734 16320 leader_election.cc:304] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:07:49.697887 16320 leader_election.cc:304] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:07:49.703321 21729 raft_consensus.cc:2804] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:49.703820 21729 raft_consensus.cc:493] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:49.704190 21729 raft_consensus.cc:3060] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:49.706764 21723 consensus_queue.cc:1059] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:07:49.708033 21723 raft_consensus.cc:2804] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:49.708470 21723 raft_consensus.cc:493] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:49.708920 21776 raft_consensus.cc:2804] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:49.709579 21776 raft_consensus.cc:493] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:49.710652 21667 raft_consensus.cc:3055] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:07:49.710898 21477 raft_consensus.cc:493] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:49.711144 21667 raft_consensus.cc:740] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:49.711648 21477 raft_consensus.cc:515] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:49.708412 21637 raft_consensus.cc:515] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:49.712347 21667 consensus_queue.cc:260] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:49.713917 21667 raft_consensus.cc:3060] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:49.710071 21776 raft_consensus.cc:3060] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:49.714497 21477 leader_election.cc:290] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:49.719537 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:49.714378 21637 leader_election.cc:290] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 election: Requested vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:49.715368 16320 leader_election.cc:304] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:07:49.716486 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:49.717656 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:49.718219 16945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:49.710938 16248 leader_election.cc:304] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:49.733120 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:49.730324 16173 leader_election.cc:304] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:49.734771 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:49.709007 21723 raft_consensus.cc:3060] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:49.740551 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:49.741452 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:49.744290 16202 raft_consensus.cc:1275] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260709 13:07:49.747437 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 72054.4us
I20260709 13:07:49.748399 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:49.749272 16205 raft_consensus.cc:2468] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 13.
I20260709 13:07:49.749476 16322 leader_election.cc:304] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:07:49.750586 16173 leader_election.cc:304] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:49.752131 16173 leader_election.cc:304] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:49.754135 16248 leader_election.cc:304] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:49.756475 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:49.758203 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:49.762069 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:49.764456 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:49.768381 16205 raft_consensus.cc:1275] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:07:49.771765 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:49.775458 16173 leader_election.cc:304] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:49.774351 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:49.786752 21759 raft_consensus.cc:2804] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:49.787323 21759 raft_consensus.cc:493] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:49.787369 21600 raft_consensus.cc:2749] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:49.787855 21759 raft_consensus.cc:3060] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:49.771555 21477 raft_consensus.cc:2804] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:49.788695 21477 raft_consensus.cc:493] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:49.789115 21477 raft_consensus.cc:3060] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:49.789021 21619 raft_consensus.cc:515] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:49.792295 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:49.792076 21728 raft_consensus.cc:515] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:07:49.792797 21739 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.496s	user 0.007s	sys 0.037s
W20260709 13:07:49.793197 21739 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.567s	user 0.008s	sys 0.037s
I20260709 13:07:49.792232 21619 leader_election.cc:290] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 18 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:49.794067 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:49.769431 21767 raft_consensus.cc:2804] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:49.795941 21767 raft_consensus.cc:493] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:49.796401 21767 raft_consensus.cc:3060] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:49.796725 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:49.798770 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:49.802611 21765 raft_consensus.cc:2749] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:49.802781 16357 raft_consensus.cc:1240] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:49.803635 16945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:07:49.807502 16322 leader_election.cc:304] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:07:49.808614 16248 leader_election.cc:304] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:49.805212 16320 leader_election.cc:304] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:49.766009 21637 raft_consensus.cc:2749] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:49.816789 16322 leader_election.cc:304] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:07:49.759785 21578 raft_consensus.cc:2804] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:49.854714 16320 leader_election.cc:304] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:49.802240 21778 raft_consensus.cc:515] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:49.850356 21705 raft_consensus.cc:1064] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e: attempting to promote NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 to VOTER
I20260709 13:07:49.862381 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:49.859844 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:49.859946 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:49.850428 21494 raft_consensus.cc:2749] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:07:49.851657 21774 raft_consensus.cc:2749] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:49.852974 21621 raft_consensus.cc:2749] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:49.832933 21812 raft_consensus.cc:493] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:49.833267 21773 raft_consensus.cc:2804] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:49.840517 21728 leader_election.cc:290] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:49.862383 21620 raft_consensus.cc:2749] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:49.864050 21619 raft_consensus.cc:2749] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:49.963871 16206 raft_consensus.cc:2393] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 14: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
W20260709 13:07:49.964105 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 158759us
I20260709 13:07:50.049314 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:49.991619 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:50.051844 16203 raft_consensus.cc:1240] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 17. Current term is 18. Ops: []
I20260709 13:07:49.993606 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:50.057572 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:49.993784 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:49.995309 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
W20260709 13:07:49.999541 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 371470us
I20260709 13:07:49.860795 21578 raft_consensus.cc:493] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:50.063186 21578 raft_consensus.cc:3060] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:49.863878 21705 raft_consensus.cc:1068] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e: Unable to promote non-voter 1109f76a0b7b443a84c0327c8707bc63: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:07:49.892347 21773 raft_consensus.cc:493] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:50.067065 21773 raft_consensus.cc:3060] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:50.067211 16355 raft_consensus.cc:1217] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Deduplicated request from leader. Original: 10.6->[12.7-17.10]   Dedup: 12.7->[13.8-17.10]
I20260709 13:07:50.068076 16355 pending_rounds.cc:85] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e: Aborting all ops after (but not including) 7
I20260709 13:07:50.068457 16355 pending_rounds.cc:107] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e: Aborting uncommitted NO_OP operation due to leader change: 16.8
I20260709 13:07:50.068761 16355 raft_consensus.cc:2889] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:49.929550 21778 leader_election.cc:290] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 14 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:49.891737 21812 raft_consensus.cc:515] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:49.991806 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:50.026146 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:50.073573 16352 raft_consensus.cc:2393] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 13: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:07:50.029842 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:50.025065 21815 consensus_queue.cc:1048] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 13:07:50.091174 16173 leader_election.cc:304] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:50.092540 21812 leader_election.cc:290] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:50.092686 21672 raft_consensus.cc:2804] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:50.093529 21672 raft_consensus.cc:493] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:50.094079 21672 raft_consensus.cc:3060] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:50.094599 16173 leader_election.cc:304] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:50.095973 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:50.099418 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:50.099906 16204 raft_consensus.cc:1240] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:50.101159 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:50.105706 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f022e2e63ae4461d834e476ff2666991" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:50.111259 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:50.112936 16203 raft_consensus.cc:2368] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 13. Current term is 14.
I20260709 13:07:50.113727 21812 raft_consensus.cc:493] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:50.114737 21812 raft_consensus.cc:515] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:50.119064 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:50.120898 21812 leader_election.cc:290] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:50.131078 16914 leader_election.cc:304] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:07:50.132882 21813 raft_consensus.cc:670] T 540bfc4ad793452faea5b865343aacf7 P 1109f76a0b7b443a84c0327c8707bc63: failed to trigger leader election: Illegal state: only voting members can start elections: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:07:50.067066 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:50.135854 21778 raft_consensus.cc:2749] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:07:50.140885 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 46557.4us
I20260709 13:07:50.144315 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:50.149466 16945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:07:50.151751 16357 raft_consensus.cc:1240] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 17. Current term is 18. Ops: []
W20260709 13:07:50.154124 16247 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:50.154922 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 132393us
I20260709 13:07:50.158806 21772 raft_consensus.cc:2749] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:50.174386 16248 leader_election.cc:304] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:50.176514 21683 raft_consensus.cc:2749] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:50.177609 21665 raft_consensus.cc:493] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:50.179090 21665 raft_consensus.cc:515] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:50.235127 21665 leader_election.cc:290] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:50.235378 16320 leader_election.cc:304] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:50.235920 21665 consensus_queue.cc:1048] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:50.262818 16320 leader_election.cc:304] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:50.263280 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:50.264349 16203 raft_consensus.cc:2393] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 17: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:07:50.238101 21477 raft_consensus.cc:515] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:50.267647 21578 raft_consensus.cc:515] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:50.269039 21477 leader_election.cc:290] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:50.270742 16282 raft_consensus.cc:2468] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 6.
I20260709 13:07:50.284157 16945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f022e2e63ae4461d834e476ff2666991" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
W20260709 13:07:50.284602 16274 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.502s	user 0.003s	sys 0.015s
I20260709 13:07:50.287307 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:50.289412 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:07:50.293394 21619 raft_consensus.cc:2749] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:07:50.295483 21667 consensus_meta.cc:287] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 0.540s	user 0.009s	sys 0.015s
I20260709 13:07:50.296574 16351 raft_consensus.cc:2468] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 17.
W20260709 13:07:50.321965 21723 consensus_meta.cc:287] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 0.563s	user 0.011s	sys 0.006s
I20260709 13:07:50.277736 16914 leader_election.cc:304] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:07:50.310298 21776 consensus_meta.cc:287] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 0.592s	user 0.011s	sys 0.009s
W20260709 13:07:50.337522 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 84371.5us
I20260709 13:07:50.346709 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:50.351853 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:50.353832 16320 leader_election.cc:304] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:50.322521 21723 raft_consensus.cc:515] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:50.375699 21578 leader_election.cc:290] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:07:50.397291 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 186884us
I20260709 13:07:50.356632 21776 raft_consensus.cc:515] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:50.399441 16248 leader_election.cc:304] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
W20260709 13:07:50.388931 21729 consensus_meta.cc:287] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 0.545s	user 0.009s	sys 0.013s
I20260709 13:07:50.414888 21539 raft_consensus.cc:2749] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:07:50.423110 21705 raft_consensus.cc:2749] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:50.424096 21726 raft_consensus.cc:2749] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:50.405973 21665 raft_consensus.cc:3060] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:50.415338 21672 raft_consensus.cc:515] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:07:50.439044 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 144512us
I20260709 13:07:50.422250 21729 raft_consensus.cc:515] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:50.455099 16351 raft_consensus.cc:1240] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:50.450141 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:50.462061 16349 raft_consensus.cc:1240] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:50.492473 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:50.513878 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:50.522943 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:50.539388 16200 raft_consensus.cc:1240] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 9. Current term is 10. Ops: []
W20260709 13:07:50.531709 21759 consensus_meta.cc:287] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 0.644s	user 0.021s	sys 0.002s
I20260709 13:07:50.528916 21723 leader_election.cc:290] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:50.577294 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:50.592531 16946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:50.595278 21494 raft_consensus.cc:493] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.595947 21494 raft_consensus.cc:515] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:50.564298 21776 leader_election.cc:290] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:50.630278 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:07:50.631963 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 223217us
I20260709 13:07:50.644090 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bc3c8ff9b84838a2664335d7e1582b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:50.684707 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:50.686741 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:50.689913 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:50.636798 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:50.584985 21759 raft_consensus.cc:515] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:50.707149 21672 leader_election.cc:290] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 18 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:50.715593 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:50.723174 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:07:50.733356 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 471391us
I20260709 13:07:50.729085 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:50.735908 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:50.736152 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:50.739395 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:50.740231 16208 raft_consensus.cc:3055] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:07:50.749758 16348 raft_consensus.cc:1240] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:07:50.751186 16914 leader_election.cc:304] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:50.746661 16208 raft_consensus.cc:740] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 19 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:07:50.753324 21729 leader_election.cc:290] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:50.753782 16248 leader_election.cc:304] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
W20260709 13:07:50.768585 21832 log.cc:927] Time spent T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.292s	user 0.000s	sys 0.002s
W20260709 13:07:50.750520 21833 log.cc:927] Time spent T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.302s	user 0.002s	sys 0.000s
I20260709 13:07:50.774919 16208 consensus_queue.cc:260] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:50.775394 16322 leader_election.cc:304] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:07:50.766986 21773 consensus_meta.cc:287] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f: Time spent flushing consensus metadata: real 0.696s	user 0.012s	sys 0.007s
I20260709 13:07:50.776782 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:50.788911 16208 raft_consensus.cc:3060] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:50.789618 16322 leader_election.cc:304] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:50.795761 21788 raft_consensus.cc:2749] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:07:50.790357 21834 log.cc:927] Time spent T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.169s	user 0.000s	sys 0.001s
I20260709 13:07:50.796705 16356 raft_consensus.cc:1240] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 20 LEADER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 19. Current term is 20. Ops: []
I20260709 13:07:50.790197 21705 raft_consensus.cc:2749] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:50.792377 21729 raft_consensus.cc:2749] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:50.821807 16349 raft_consensus.cc:2468] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 17.
I20260709 13:07:50.799489 21726 raft_consensus.cc:493] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
W20260709 13:07:50.803716 21767 consensus_meta.cc:287] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f: Time spent flushing consensus metadata: real 0.932s	user 0.021s	sys 0.005s
I20260709 13:07:50.826464 21544 raft_consensus.cc:493] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:50.837474 16208 raft_consensus.cc:1275] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 20 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 10. (term mismatch)
I20260709 13:07:50.788017 21773 raft_consensus.cc:515] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:07:50.833884 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 110348us
I20260709 13:07:50.838044 16208 pending_rounds.cc:85] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f: Aborting all ops after (but not including) 9
I20260709 13:07:50.841682 16208 pending_rounds.cc:107] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f: Aborting uncommitted NO_OP operation due to leader change: 19.10
I20260709 13:07:50.842175 16208 raft_consensus.cc:2889] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:50.847164 16322 leader_election.cc:304] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:50.815258 21723 raft_consensus.cc:493] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:50.845783 21544 raft_consensus.cc:515] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:50.836701 21767 raft_consensus.cc:515] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:50.843497 21667 raft_consensus.cc:493] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:50.857990 21729 raft_consensus.cc:2749] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:50.859354 21667 raft_consensus.cc:515] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:50.857523 16205 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60154 (request call id 3033) took 1035 ms. Trace:
I20260709 13:07:50.862123 21667 leader_election.cc:290] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:50.872640 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:50.860962 16205 rpcz_store.cc:276] 0709 13:07:49.795978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.796766 (+   788us) service_pool.cc:224] Handling call
0709 13:07:49.797092 (+   326us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:49.963296 (+166204us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:49.963439 (+   143us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:49.964852 (+  1413us) log.cc:844] Serialized 26 byte log entry
0709 13:07:50.212764 (+247912us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:50.212826 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:50.238504 (+ 25678us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:50.830116 (+591612us) raft_consensus.cc:1685] finished
0709 13:07:50.830140 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:50.831704 (+  1564us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":165116,"raft.queue_time_us":208083,"raft.run_cpu_time_us":410,"raft.run_wall_time_us":24233,"thread_start_us":247233,"threads_started":1,"wal-append.queue_time_us":480582}
I20260709 13:07:50.864326 21544 leader_election.cc:290] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:50.864598 21494 leader_election.cc:290] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:50.866691 21723 raft_consensus.cc:515] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:50.867936 21683 raft_consensus.cc:2804] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:50.896770 21683 raft_consensus.cc:493] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:50.897290 21683 raft_consensus.cc:3060] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:50.857484 16202 raft_consensus.cc:1240] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:50.870771 21477 consensus_queue.cc:1048] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:50.886826 16914 leader_election.cc:304] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:07:50.905136 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 60956.2us
I20260709 13:07:50.906088 21723 leader_election.cc:290] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:50.891705 16199 raft_consensus.cc:2393] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 9: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
W20260709 13:07:50.907866 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 69771us
I20260709 13:07:50.909293 16322 leader_election.cc:304] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:50.892755 21767 leader_election.cc:290] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:50.852391 21726 raft_consensus.cc:515] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:50.911689 21477 raft_consensus.cc:2749] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:07:50.913887 21726 leader_election.cc:290] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:50.858031 21759 leader_election.cc:290] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:50.868095 21773 leader_election.cc:290] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 16 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:50.917672 21578 consensus_queue.cc:1059] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:07:50.913625 21771 raft_consensus.cc:2749] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:50.918772 21578 raft_consensus.cc:3055] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:07:50.919189 21578 raft_consensus.cc:740] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:07:50.920450 16914 leader_election.cc:304] T 4b962ceebb5c48c1914459ae0c0eff1b P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:50.922487 16173 leader_election.cc:304] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:50.923049 21586 raft_consensus.cc:2749] T 4b962ceebb5c48c1914459ae0c0eff1b P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:50.923672 21737 raft_consensus.cc:2749] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:50.925603 16173 leader_election.cc:304] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:50.926745 21737 raft_consensus.cc:2749] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:50.929482 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:50.935740 16322 leader_election.cc:304] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:07:50.937821 21812 raft_consensus.cc:2749] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:07:50.920249 21578 consensus_queue.cc:260] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:50.943482 21578 raft_consensus.cc:3060] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:07:50.959972 21665 consensus_meta.cc:287] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 0.523s	user 0.012s	sys 0.000s
I20260709 13:07:50.960698 21665 raft_consensus.cc:2749] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:50.942305 16322 leader_election.cc:304] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:50.972218 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:50.990031 21544 raft_consensus.cc:493] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:50.990694 21544 raft_consensus.cc:515] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:50.993146 21544 leader_election.cc:290] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:50.989121 16322 leader_election.cc:304] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:51.003422 21667 raft_consensus.cc:2749] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:07:51.007133 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 81690.8us
W20260709 13:07:51.016652 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 225552us
I20260709 13:07:50.984355 21723 raft_consensus.cc:2749] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:51.039988 16353 raft_consensus.cc:2468] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 14.
I20260709 13:07:51.042798 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:51.049063 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:51.051954 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:51.055428 16173 leader_election.cc:304] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
W20260709 13:07:51.057160 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 74373.9us
W20260709 13:07:51.057569 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:51.058035 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:51.061065 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 157252us
I20260709 13:07:51.060853 21683 raft_consensus.cc:515] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:51.067396 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:51.073874 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:51.074353 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:51.074661 16277 raft_consensus.cc:2468] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 11.
I20260709 13:07:51.075839 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:51.076376 16275 raft_consensus.cc:1275] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 18 index: 9. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260709 13:07:51.076501 16280 raft_consensus.cc:2468] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 11.
I20260709 13:07:51.081305 21847 raft_consensus.cc:493] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:51.082002 21847 raft_consensus.cc:515] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:51.086287 21683 leader_election.cc:290] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 17 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:51.088714 21683 consensus_queue.cc:1059] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:51.089416 21539 consensus_queue.cc:1059] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:51.091339 21544 raft_consensus.cc:3055] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:51.091816 21544 raft_consensus.cc:740] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:07:51.092813 21544 consensus_queue.cc:260] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:07:51.073912 16106 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38830 (request call id 230) took 17522 ms (client timeout 15000 ms). Trace:
I20260709 13:07:51.102335 16353 raft_consensus.cc:1240] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:51.102633 21619 raft_consensus.cc:493] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.103313 21619 raft_consensus.cc:515] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:51.089933 21683 raft_consensus.cc:3055] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:51.105616 21619 leader_election.cc:290] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:51.105993 21683 raft_consensus.cc:740] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
W20260709 13:07:51.099421 16106 rpcz_store.cc:269] 0709 13:07:33.551220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:33.554326 (+  3106us) service_pool.cc:224] Handling call
0709 13:07:51.073674 (+17519348us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:47.836150 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:47.836811 (+   661us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:47.836852 (+    41us) write_op.cc:435] Acquired schema lock
0709 13:07:47.836872 (+    20us) tablet.cc:662] Decoding operations
0709 13:07:48.142660 (+305788us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:48.157101 (+ 14441us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:48.163624 (+  6523us) tablet.cc:685] Acquiring locks for 9 operations
0709 13:07:48.303280 (+139656us) tablet.cc:701] Row locks acquired
0709 13:07:48.303306 (+    26us) write_op.cc:260] PREPARE: finished
0709 13:07:48.303491 (+   185us) write_op.cc:270] Start()
0709 13:07:48.303661 (+   170us) write_op.cc:276] Timestamp: P: 1783602468303428 usec, L: 0
0709 13:07:48.303681 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:07:48.304418 (+   737us) log.cc:844] Serialized 3670 byte log entry
0709 13:07:48.566262 (+261844us) op_driver.cc:464] REPLICATION: finished
0709 13:07:49.309081 (+742819us) write_op.cc:301] APPLY: starting
0709 13:07:49.321925 (+ 12844us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:49.544223 (+222298us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:49.544369 (+   146us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:49.707864 (+163495us) spinlock_profiling.cc:243] Waited 6.21 ms on lock 0x7b180004c2a0. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f3625264de1 00007f36252715b1 00007f361c39c522 00007f361c39e7c1 00007f361c39e779 00007f361c39e709 00007f361c39e6d1 00007f361c39d9cd 000000000038f354 000000000038f199 00007f361c37f83a
0709 13:07:50.042266 (+334402us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:50.086893 (+ 44627us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=18,key_file_lookups=18,delta_file_lookups=18,mrs_lookups=0
0709 13:07:50.087012 (+   119us) write_op.cc:312] APPLY: finished
0709 13:07:50.087771 (+   759us) log.cc:844] Serialized 89 byte log entry
0709 13:07:50.491767 (+403996us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:50.508172 (+ 16405us) write_op.cc:454] Released schema lock
0709 13:07:50.508245 (+    73us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:50.665843 (+157598us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:50.665872 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":50,"spinlock_wait_cycles":3456,"child_traces":[["op",{"apply.queue_time_us":723046,"apply.run_cpu_time_us":49036,"apply.run_wall_time_us":1328186,"cfile_cache_hit":38,"cfile_cache_hit_bytes":41747,"num_ops":9,"prepare.queue_time_us":127533,"prepare.run_cpu_time_us":19187,"prepare.run_wall_time_us":669465,"raft.queue_time_us":42012,"raft.run_cpu_time_us":287849,"raft.run_wall_time_us":661121,"replication_time_us":262462,"spinlock_wait_cycles":14278528,"thread_start_us":1217000,"threads_started":5,"wal-append.queue_time_us":644992,"wal-append.run_cpu_time_us":26395,"wal-append.run_wall_time_us":1064198}]]}
I20260709 13:07:51.109365 21683 consensus_queue.cc:260] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:51.110033 21812 raft_consensus.cc:493] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:51.112790 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:51.123804 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:51.124927 16351 raft_consensus.cc:1240] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:51.126772 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:51.129573 16354 raft_consensus.cc:1275] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 13:07:51.129906 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:51.163089 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:51.149163 21578 raft_consensus.cc:2749] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:07:51.170146 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 81827us
I20260709 13:07:51.173830 16246 leader_election.cc:304] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:07:51.176842 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 131907us
I20260709 13:07:51.165624 21683 raft_consensus.cc:3060] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:51.171072 21847 leader_election.cc:290] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:07:51.219801 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 54210us
I20260709 13:07:51.219542 16104 catalog_manager.cc:5697] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "1109f76a0b7b443a84c0327c8707bc63" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:51.221058 16246 leader_election.cc:304] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:51.222872 16104 catalog_manager.cc:5697] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: term changed from 11 to 13, leader changed from 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) to 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66). New cstate: current_term: 13 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:07:51.226931 21494 raft_consensus.cc:2749] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:51.227748 21494 raft_consensus.cc:2749] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:07:51.228173 16104 catalog_manager.cc:5697] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "1109f76a0b7b443a84c0327c8707bc63" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:51.167405 21812 raft_consensus.cc:515] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:07:51.232132 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 43716.9us
W20260709 13:07:51.287122 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 66215.6us
I20260709 13:07:51.241930 21477 raft_consensus.cc:1064] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e: attempting to promote NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 to VOTER
I20260709 13:07:51.245775 21544 raft_consensus.cc:3060] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:51.264379 16322 leader_election.cc:304] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:51.272189 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:51.250032 21854 raft_consensus.cc:493] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
W20260709 13:07:51.309705 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 45434.3us
I20260709 13:07:51.310420 16322 leader_election.cc:304] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:51.292510 21726 raft_consensus.cc:493] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
W20260709 13:07:51.324422 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:51.318243 16275 raft_consensus.cc:2468] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 11.
I20260709 13:07:51.327690 16246 leader_election.cc:304] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:51.317199 21759 raft_consensus.cc:2749] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:07:51.339433 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 148855us
I20260709 13:07:51.340377 16322 leader_election.cc:304] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:51.347657 21846 consensus_queue.cc:1059] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:07:51.348733 21846 raft_consensus.cc:3055] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:51.349130 21846 raft_consensus.cc:740] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:07:51.349870 21726 raft_consensus.cc:515] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:07:51.350636 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 62777.5us
I20260709 13:07:51.351763 21849 raft_consensus.cc:493] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:51.352348 21849 raft_consensus.cc:515] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:51.352756 21726 leader_election.cc:290] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:51.354440 21539 raft_consensus.cc:2749] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:51.316165 21854 raft_consensus.cc:515] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:51.344717 21759 raft_consensus.cc:2749] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:07:51.380062 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:51.382086 16322 leader_election.cc:304] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:51.384259 21812 leader_election.cc:290] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:51.389179 21705 raft_consensus.cc:493] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:51.389856 21705 raft_consensus.cc:515] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:51.391577 21729 raft_consensus.cc:2804] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:51.400694 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:07:51.402770 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 96635.6us
I20260709 13:07:51.354518 21849 leader_election.cc:290] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:51.360128 21854 leader_election.cc:290] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:07:51.423954 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 122926us
I20260709 13:07:51.426240 16246 leader_election.cc:304] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63
W20260709 13:07:51.433949 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 119811us
I20260709 13:07:51.357677 21772 consensus_queue.cc:1059] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.068s
I20260709 13:07:51.413527 21729 raft_consensus.cc:493] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:51.350116 21846 consensus_queue.cc:260] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:51.423362 21812 raft_consensus.cc:2749] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:07:51.449790 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 104956us
I20260709 13:07:51.444721 21683 raft_consensus.cc:2804] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:51.455484 21683 raft_consensus.cc:493] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:51.455914 21683 raft_consensus.cc:3060] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:51.483134 16173 leader_election.cc:304] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:51.450762 21729 raft_consensus.cc:3060] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:07:51.488117 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:51.491984 21726 raft_consensus.cc:3055] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:51.492532 21726 raft_consensus.cc:740] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
W20260709 13:07:51.503346 21857 log.cc:927] Time spent T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:07:51.493638 21726 consensus_queue.cc:260] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:07:51.511262 21859 log.cc:927] Time spent T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 13:07:51.513612 21726 raft_consensus.cc:3060] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:51.514201 21846 raft_consensus.cc:3060] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:51.518011 21772 consensus_queue.cc:1048] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:07:51.519945 21863 raft_consensus.cc:493] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:51.520630 21863 raft_consensus.cc:515] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:51.485173 21854 consensus_queue.cc:1059] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 13:07:51.521991 21854 raft_consensus.cc:3055] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:51.522388 21854 raft_consensus.cc:740] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:07:51.522857 21705 leader_election.cc:290] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:51.523486 16173 leader_election.cc:304] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:51.524394 21578 raft_consensus.cc:2749] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:07:51.524444 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 109803us
I20260709 13:07:51.525528 16246 leader_election.cc:304] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:51.526736 16946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:51.526652 21477 consensus_queue.cc:237] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 8, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:51.526458 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:51.529623 16173 leader_election.cc:304] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:51.513515 21737 raft_consensus.cc:2749] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:51.530467 21578 raft_consensus.cc:2749] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:51.532900 16173 leader_election.cc:304] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:51.534031 21578 raft_consensus.cc:2749] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:07:51.536321 16248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:51.537222 21866 raft_consensus.cc:2749] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:51.523368 21854 consensus_queue.cc:260] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:51.538980 21863 leader_election.cc:290] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:51.539791 21854 raft_consensus.cc:3060] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:51.534282 16173 leader_election.cc:304] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:51.543653 16914 leader_election.cc:304] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:07:51.539870 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:51.559067 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 177051us
I20260709 13:07:51.552878 21771 raft_consensus.cc:2749] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:51.560098 16322 leader_election.cc:304] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:07:51.567636 16322 leader_election.cc:304] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:51.563277 21812 raft_consensus.cc:493] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:51.588116 21812 raft_consensus.cc:515] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:51.571888 21665 raft_consensus.cc:2804] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:51.591506 21665 raft_consensus.cc:493] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Starting leader election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:51.592188 21665 raft_consensus.cc:3060] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:51.592778 21729 raft_consensus.cc:515] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:51.595058 21729 leader_election.cc:290] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 12 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:51.562028 21578 raft_consensus.cc:2749] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:51.601320 16246 leader_election.cc:304] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:07:51.603878 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 69686us
I20260709 13:07:51.607443 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:51.608235 16202 raft_consensus.cc:2468] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 9.
I20260709 13:07:51.610772 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:51.617993 21759 consensus_queue.cc:1048] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:51.616529 21539 raft_consensus.cc:2749] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:51.620558 16173 leader_election.cc:304] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:51.614830 21870 raft_consensus.cc:2749] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:07:51.623584 21578 raft_consensus.cc:2749] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:51.623911 16173 leader_election.cc:304] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:51.600977 21544 consensus_queue.cc:1059] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.024s
I20260709 13:07:51.625504 21544 raft_consensus.cc:3055] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:07:51.625903 21544 raft_consensus.cc:740] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:07:51.626978 21544 consensus_queue.cc:260] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:51.630796 21578 raft_consensus.cc:2749] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:51.632018 21544 raft_consensus.cc:3060] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:51.634215 16246 leader_election.cc:304] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:51.637789 21866 raft_consensus.cc:2749] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:51.638151 16320 leader_election.cc:304] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:51.616966 21812 leader_election.cc:290] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:51.605808 21683 raft_consensus.cc:515] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:51.641227 21705 raft_consensus.cc:2804] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:51.641655 21683 leader_election.cc:290] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:51.645251 16202 raft_consensus.cc:1275] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:07:51.648200 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:07:51.625937 16173 leader_election.cc:304] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:51.650413 21477 consensus_queue.cc:1048] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:51.651660 21578 raft_consensus.cc:2749] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:51.653566 21737 consensus_queue.cc:1059] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:51.662139 16246 leader_election.cc:304] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:51.641889 21705 raft_consensus.cc:493] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:51.663899 21705 raft_consensus.cc:3060] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:51.664131 21494 raft_consensus.cc:2749] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:51.662892 21539 consensus_queue.cc:1059] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:51.666513 21539 raft_consensus.cc:3055] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:51.666988 21539 raft_consensus.cc:740] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:07:51.693342 16246 leader_election.cc:400] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 pre-election: Vote denied by peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073) with higher term. Message: Invalid argument: T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 13. Current term is 14.
I20260709 13:07:51.694137 16246 leader_election.cc:403] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:07:51.696098 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 78584.7us
I20260709 13:07:51.697798 21854 raft_consensus.cc:493] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:51.698410 21854 raft_consensus.cc:515] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:51.698861 21578 raft_consensus.cc:3055] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:07:51.699272 21578 raft_consensus.cc:740] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:07:51.700721 21854 leader_election.cc:290] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:51.700143 21578 consensus_queue.cc:260] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:51.702054 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:51.704814 21578 raft_consensus.cc:3060] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:51.709313 21494 raft_consensus.cc:493] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:51.710016 21494 raft_consensus.cc:515] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:51.712380 21494 leader_election.cc:290] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:51.713828 21854 raft_consensus.cc:3060] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:07:51.681746 21539 consensus_queue.cc:260] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:51.715529 16173 leader_election.cc:304] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:51.696048 21665 raft_consensus.cc:515] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:51.717695 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:51.717633 21539 raft_consensus.cc:3060] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:51.723315 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 54970.5us
I20260709 13:07:51.726261 16246 leader_election.cc:304] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:51.727151 21665 leader_election.cc:290] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 12 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:51.727380 21494 raft_consensus.cc:2749] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:51.729426 16246 leader_election.cc:304] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:51.740092 16322 leader_election.cc:304] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:07:51.743760 21854 raft_consensus.cc:2749] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073) with higher term. Message: Invalid argument: T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 13. Current term is 14.
W20260709 13:07:51.749217 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 51629.4us
I20260709 13:07:51.748847 21494 raft_consensus.cc:2749] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:51.748270 21665 raft_consensus.cc:2804] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:51.755074 21665 raft_consensus.cc:493] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:51.758159 21665 raft_consensus.cc:3060] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:51.755698 16173 leader_election.cc:304] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:51.767105 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:51.767845 16275 raft_consensus.cc:2468] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 7.
W20260709 13:07:51.778898 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 49628.5us
I20260709 13:07:51.780258 21705 raft_consensus.cc:515] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:51.781589 21494 consensus_queue.cc:1059] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:51.783427 21494 raft_consensus.cc:3055] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:51.783910 21494 raft_consensus.cc:740] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:07:51.784788 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:51.785662 16202 raft_consensus.cc:3060] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:51.786482 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:51.787508 21771 raft_consensus.cc:493] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:51.788079 21726 raft_consensus.cc:493] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:51.788805 21771 raft_consensus.cc:515] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:51.789139 21726 raft_consensus.cc:515] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:51.788126 16275 raft_consensus.cc:2468] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 14.
I20260709 13:07:51.792768 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:51.794628 21875 raft_consensus.cc:2804] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:07:51.795186 21875 raft_consensus.cc:697] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 17 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:07:51.795361 21771 leader_election.cc:290] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:51.796160 21875 consensus_queue.cc:237] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:51.798144 21874 raft_consensus.cc:493] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:51.798341 21726 leader_election.cc:290] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:51.798769 21874 raft_consensus.cc:515] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:51.799136 21494 consensus_queue.cc:260] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:51.800583 21729 raft_consensus.cc:493] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:51.801316 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:51.801183 21729 raft_consensus.cc:515] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:51.768774 21578 raft_consensus.cc:2749] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:51.803395 21729 leader_election.cc:290] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:51.804134 16173 leader_election.cc:304] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:51.794649 16943 raft_consensus.cc:2393] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 14: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
I20260709 13:07:51.804956 16202 raft_consensus.cc:2468] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 10.
I20260709 13:07:51.805378 21737 raft_consensus.cc:2804] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:51.805922 21737 raft_consensus.cc:697] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:07:51.806166 16320 leader_election.cc:304] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:51.800474 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:51.800487 21494 raft_consensus.cc:3060] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:51.808127 21812 raft_consensus.cc:2804] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:51.808728 21812 raft_consensus.cc:697] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 10 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:51.810114 21759 raft_consensus.cc:493] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:51.810845 21759 raft_consensus.cc:515] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } }
I20260709 13:07:51.812364 21729 raft_consensus.cc:493] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:51.813329 21729 raft_consensus.cc:515] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:51.813848 21477 raft_consensus.cc:493] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:51.814489 21477 raft_consensus.cc:515] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:51.816035 21729 leader_election.cc:290] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:51.816663 21477 leader_election.cc:290] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:51.813127 21759 leader_election.cc:290] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:51.816979 21767 consensus_queue.cc:1059] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:51.818519 21767 raft_consensus.cc:3055] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:51.818981 21767 raft_consensus.cc:740] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:07:51.819407 21737 consensus_queue.cc:237] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:51.819924 21767 consensus_queue.cc:260] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:51.821112 21767 raft_consensus.cc:3060] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:51.809720 21812 consensus_queue.cc:237] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:51.826740 21759 raft_consensus.cc:493] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:51.827111 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:51.827494 21759 raft_consensus.cc:515] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:51.829464 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:51.830067 21759 leader_election.cc:290] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:51.830335 16202 raft_consensus.cc:2393] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 16: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:07:51.831513 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:51.833678 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:51.832669 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
W20260709 13:07:51.833875 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 79820.4us
I20260709 13:07:51.834614 16202 raft_consensus.cc:2393] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 10: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:07:51.834671 16275 raft_consensus.cc:3060] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:51.838168 16277 raft_consensus.cc:1275] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:07:51.839027 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:07:51.838055 16943 raft_consensus.cc:1275] T 540bfc4ad793452faea5b865343aacf7 P 1109f76a0b7b443a84c0327c8707bc63 [term 15 LEARNER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:07:51.840447 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:51.841082 16283 raft_consensus.cc:3060] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:51.841823 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:51.842352 16356 raft_consensus.cc:1275] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 13:07:51.834894 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 53537.2us
I20260709 13:07:51.841922 21759 raft_consensus.cc:493] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:51.832181 16199 raft_consensus.cc:2468] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 20.
I20260709 13:07:51.903731 16283 raft_consensus.cc:2468] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 12.
W20260709 13:07:51.903968 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 69563.9us
I20260709 13:07:51.848278 21759 raft_consensus.cc:515] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:51.909210 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:51.914261 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:51.914701 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:51.917899 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:51.920202 16355 raft_consensus.cc:1240] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:51.804539 21705 leader_election.cc:290] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 10 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:51.927940 16348 raft_consensus.cc:2393] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 17: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:07:51.910158 21847 consensus_queue.cc:1059] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
W20260709 13:07:51.930742 16913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:51.927561 21665 raft_consensus.cc:515] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:51.932000 16278 raft_consensus.cc:1240] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:51.933441 21665 leader_election.cc:290] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 12 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:51.935519 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:51.936949 16349 raft_consensus.cc:2468] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 10.
I20260709 13:07:51.935995 16356 raft_consensus.cc:1240] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 11. Current term is 12. Ops: [11.12-11.12]
I20260709 13:07:51.940403 21874 leader_election.cc:290] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:51.947762 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:51.948750 16283 raft_consensus.cc:2393] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 in current term 14: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:07:51.923365 21477 raft_consensus.cc:493] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:51.950510 21477 raft_consensus.cc:515] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:51.951323 16274 raft_consensus.cc:1275] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 13:07:51.951821 16283 raft_consensus.cc:1240] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:51.952735 21477 leader_election.cc:290] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:51.956308 16276 raft_consensus.cc:1240] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:51.969535 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:51.970678 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:51.971650 16355 raft_consensus.cc:2393] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 12: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:07:51.968926 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:51.973659 16352 raft_consensus.cc:2393] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 14: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:07:51.973405 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:51.979017 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:51.979462 16281 raft_consensus.cc:1275] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:07:51.980350 16278 raft_consensus.cc:2376] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 6. Re-sending same reply.
W20260709 13:07:51.992841 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 168666us
I20260709 13:07:51.996182 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:51.998126 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:51.995088 16320 leader_election.cc:304] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:51.999298 16275 raft_consensus.cc:2468] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 12.
I20260709 13:07:52.000125 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:52.000788 16351 raft_consensus.cc:2393] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 18: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:07:52.001633 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:52.002350 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:52.002652 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:52.003360 16208 raft_consensus.cc:2468] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 14.
I20260709 13:07:52.002399 21477 raft_consensus.cc:2804] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:07:52.004002 21477 raft_consensus.cc:493] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 20 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
W20260709 13:07:52.004148 16249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:52.004432 21477 raft_consensus.cc:3060] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:52.007637 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:52.002480 16200 raft_consensus.cc:2368] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 5. Current term is 6.
I20260709 13:07:52.012555 16320 leader_election.cc:304] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:52.021976 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bc3c8ff9b84838a2664335d7e1582b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:52.031915 16275 raft_consensus.cc:1240] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:52.033799 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:52.034157 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:52.035519 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:52.036738 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:52.037418 16282 raft_consensus.cc:2468] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 11.
I20260709 13:07:52.037612 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f022e2e63ae4461d834e476ff2666991" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:52.038784 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:52.039837 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:52.035430 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:52.035678 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:52.038360 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:52.033836 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:52.042625 16282 raft_consensus.cc:2468] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 18.
W20260709 13:07:52.042025 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:52.033622 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:52.032974 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:52.047725 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:52.048386 16276 raft_consensus.cc:2468] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 9.
I20260709 13:07:52.051446 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:52.054051 21759 leader_election.cc:290] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:52.054869 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:52.041515 21705 raft_consensus.cc:2804] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:52.055771 16276 raft_consensus.cc:2393] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 6: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
W20260709 13:07:52.041467 16914 leader_election.cc:336] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Timed out: RequestConsensusVote RPC to 127.14.180.66:45823 timed out after 1.927s (SENT)
I20260709 13:07:52.057164 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:52.058241 16208 raft_consensus.cc:2468] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 18.
I20260709 13:07:52.060735 16278 raft_consensus.cc:2468] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 10.
I20260709 13:07:52.064307 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:52.064695 16351 raft_consensus.cc:1240] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 10 LEADER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 9. Current term is 10. Ops: []
W20260709 13:07:52.066502 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:52.068331 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:52.071257 16206 raft_consensus.cc:1240] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 17. Current term is 18. Ops: []
I20260709 13:07:52.073182 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:52.074066 21869 consensus_queue.cc:1059] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.028s
I20260709 13:07:52.079445 16201 raft_consensus.cc:1240] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 15. Current term is 16. Ops: []
W20260709 13:07:52.081177 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:52.089352 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:52.095217 16280 raft_consensus.cc:2468] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 11.
I20260709 13:07:52.097656 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:52.098733 16208 raft_consensus.cc:2468] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 12.
I20260709 13:07:52.056066 21705 raft_consensus.cc:493] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:52.101873 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:52.106253 16351 raft_consensus.cc:2468] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 16.
I20260709 13:07:52.088614 21866 raft_consensus.cc:3055] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:07:52.110159 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:52.109555 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:52.113086 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:52.114565 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:52.116285 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:52.096922 21771 consensus_queue.cc:1048] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.007s
I20260709 13:07:52.122787 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:52.123952 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:52.119868 16246 leader_election.cc:400] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 5 pre-election: Vote denied by peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073) with higher term. Message: Invalid argument: T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 5. Current term is 6.
I20260709 13:07:52.125090 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:52.121912 16275 raft_consensus.cc:2393] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 10: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:07:52.110371 21705 raft_consensus.cc:3060] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:52.125206 16248 leader_election.cc:304] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:52.099023 21867 consensus_queue.cc:1059] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 13:07:52.152969 16203 raft_consensus.cc:2468] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 14.
I20260709 13:07:52.153741 21867 raft_consensus.cc:3055] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:52.111976 21866 raft_consensus.cc:740] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:07:52.154170 16283 raft_consensus.cc:1240] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 19. Current term is 20. Ops: []
I20260709 13:07:52.154950 21866 consensus_queue.cc:260] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:52.155855 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:52.156562 16280 raft_consensus.cc:3060] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:52.156886 21477 raft_consensus.cc:515] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } }
I20260709 13:07:52.156090 21866 raft_consensus.cc:3060] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:52.164077 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:52.167057 16274 raft_consensus.cc:2468] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 14.
I20260709 13:07:52.142812 21854 raft_consensus.cc:2749] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:07:52.147485 21883 log.cc:927] Time spent T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
I20260709 13:07:52.152680 16173 leader_election.cc:304] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:07:52.133332 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:07:52.184103 16248 leader_election.cc:304] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:52.137837 16282 raft_consensus.cc:2468] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 9.
I20260709 13:07:52.164243 16320 leader_election.cc:304] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
W20260709 13:07:52.190974 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 83007.1us
I20260709 13:07:52.192202 16246 leader_election.cc:304] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:52.192473 16322 leader_election.cc:304] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:52.176744 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:52.194440 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:52.193472 16246 leader_election.cc:304] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:52.197841 16248 leader_election.cc:304] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:52.197629 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:52.213503 21578 raft_consensus.cc:2749] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:07:52.213738 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 61188.7us
I20260709 13:07:52.199844 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:52.206768 21667 consensus_queue.cc:1048] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:52.215633 16173 leader_election.cc:304] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:52.216542 21667 raft_consensus.cc:2749] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:52.216575 21578 raft_consensus.cc:2749] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:52.217942 16352 raft_consensus.cc:2393] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 9: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
W20260709 13:07:52.209697 16104 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55244 (request call id 132) took 13519 ms (client timeout 15000 ms). Trace:
I20260709 13:07:52.154196 21867 raft_consensus.cc:740] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:07:52.211516 21477 leader_election.cc:290] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 21 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:52.212855 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:52.231043 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:52.231455 16203 raft_consensus.cc:3060] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:52.215401 16105 catalog_manager.cc:5697] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 11 to 13, leader changed from 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) to 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68). New cstate: current_term: 13 leader_uuid: "1109f76a0b7b443a84c0327c8707bc63" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:07:52.236348 16105 catalog_manager.cc:5697] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 15 to 17, leader changed from 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) to e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65). New cstate: current_term: 17 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } }
I20260709 13:07:52.237933 21854 raft_consensus.cc:2749] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:07:52.239800 21854 raft_consensus.cc:2749] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:52.241465 16105 catalog_manager.cc:5697] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 14 to 15, leader changed from e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) to 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68). New cstate: current_term: 15 leader_uuid: "1109f76a0b7b443a84c0327c8707bc63" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:07:52.243547 16105 catalog_manager.cc:5697] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 11 to 14, leader changed from 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) to 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66). New cstate: current_term: 14 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } }
W20260709 13:07:52.227522 16104 rpcz_store.cc:269] 0709 13:07:38.690127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:38.719871 (+ 29744us) service_pool.cc:224] Handling call
0709 13:07:52.209602 (+13489731us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:51.610995 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:51.611723 (+   728us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:51.611774 (+    51us) write_op.cc:435] Acquired schema lock
0709 13:07:51.611793 (+    19us) tablet.cc:662] Decoding operations
0709 13:07:51.612401 (+   608us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:51.612492 (+    91us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:51.612520 (+    28us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:07:51.612982 (+   462us) tablet.cc:701] Row locks acquired
0709 13:07:51.613039 (+    57us) write_op.cc:260] PREPARE: finished
0709 13:07:51.613206 (+   167us) write_op.cc:270] Start()
0709 13:07:51.613378 (+   172us) write_op.cc:276] Timestamp: P: 1783602471613135 usec, L: 0
0709 13:07:51.613401 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:07:51.642794 (+ 29393us) log.cc:844] Serialized 1302 byte log entry
0709 13:07:52.054887 (+412093us) op_driver.cc:464] REPLICATION: finished
0709 13:07:52.138833 (+ 83946us) write_op.cc:301] APPLY: starting
0709 13:07:52.138946 (+   113us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:52.141621 (+  2675us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:52.141772 (+   151us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:52.144441 (+  2669us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:52.144650 (+   209us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=6,mrs_lookups=0
0709 13:07:52.144712 (+    62us) write_op.cc:312] APPLY: finished
0709 13:07:52.144970 (+   258us) log.cc:844] Serialized 41 byte log entry
0709 13:07:52.145227 (+   257us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:52.145338 (+   111us) write_op.cc:454] Released schema lock
0709 13:07:52.145388 (+    50us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:52.221425 (+ 76037us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:52.222532 (+  1107us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":78049,"reported_tablets":27,"child_traces":[["op",{"apply.queue_time_us":83611,"apply.run_cpu_time_us":6669,"apply.run_wall_time_us":33141,"cfile_cache_hit":14,"cfile_cache_hit_bytes":16667,"num_ops":3,"prepare.queue_time_us":206766,"prepare.run_cpu_time_us":41712,"prepare.run_wall_time_us":127431,"raft.queue_time_us":200314,"raft.run_cpu_time_us":31786,"raft.run_wall_time_us":231880,"replication_time_us":428314,"spinlock_wait_cycles":22113152,"thread_start_us":469130,"threads_started":4,"wal-append.queue_time_us":141511}]]}
W20260709 13:07:52.247058 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 146452us
I20260709 13:07:52.191249 21874 raft_consensus.cc:493] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:52.223127 21847 raft_consensus.cc:2749] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:07:52.222908 21776 raft_consensus.cc:2804] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:52.246130 16105 catalog_manager.cc:5697] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } }
I20260709 13:07:52.266305 16203 raft_consensus.cc:2468] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 21.
I20260709 13:07:52.248449 16280 raft_consensus.cc:2468] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 12.
I20260709 13:07:52.230789 21544 raft_consensus.cc:2749] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:07:52.250538 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 149149us
I20260709 13:07:52.259923 16173 leader_election.cc:304] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:52.271624 16320 leader_election.cc:304] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:52.263227 21867 consensus_queue.cc:260] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:52.268659 16105 catalog_manager.cc:5697] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } }
I20260709 13:07:52.292850 16105 catalog_manager.cc:5697] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } }
I20260709 13:07:52.294740 21874 raft_consensus.cc:515] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:52.297333 21874 leader_election.cc:290] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:52.301504 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:52.302659 16201 raft_consensus.cc:2393] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 18: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:07:52.308785 16105 catalog_manager.cc:5697] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 8 to 13, leader changed from 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) to 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66). New cstate: current_term: 13 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:52.310534 16105 catalog_manager.cc:5697] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 9 to 13, leader changed from e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) to 363bb2f744eb486f9ad726f08214c98e (127.14.180.67). New cstate: current_term: 13 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } }
I20260709 13:07:52.268039 21776 raft_consensus.cc:493] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:52.320727 21776 raft_consensus.cc:3060] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:52.247061 21767 consensus_queue.cc:1059] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.061s
I20260709 13:07:52.325976 16105 catalog_manager.cc:5697] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } }
W20260709 13:07:52.324956 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 55526.1us
W20260709 13:07:52.333632 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 141231us
W20260709 13:07:52.333539 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 73715.1us
I20260709 13:07:52.307301 21477 raft_consensus.cc:2804] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:07:52.332758 21578 raft_consensus.cc:2749] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:07:52.342803 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 148921us
I20260709 13:07:52.343791 16105 catalog_manager.cc:5697] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 15 to 18, leader changed from 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) to e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65). New cstate: current_term: 18 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } }
I20260709 13:07:52.344437 16246 leader_election.cc:304] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:52.348541 16322 leader_election.cc:304] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:52.354200 21891 raft_consensus.cc:493] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.354789 21888 consensus_queue.cc:1048] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:07:52.355130 21891 raft_consensus.cc:515] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:52.358354 21726 raft_consensus.cc:3055] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:07:52.358939 21726 raft_consensus.cc:740] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:07:52.340994 21867 raft_consensus.cc:3060] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:52.359642 21477 raft_consensus.cc:697] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 21 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:52.363440 16173 leader_election.cc:304] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:07:52.364308 21477 consensus_queue.cc:237] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } }
I20260709 13:07:52.365276 16173 leader_election.cc:304] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:52.366442 21737 raft_consensus.cc:2749] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:52.368801 21881 raft_consensus.cc:3055] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:52.369424 21881 raft_consensus.cc:740] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:07:52.358127 21891 leader_election.cc:290] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:52.370301 21881 consensus_queue.cc:260] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:52.379505 21881 raft_consensus.cc:3060] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:07:52.383287 16914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:52.331679 21705 raft_consensus.cc:515] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:52.382927 21847 raft_consensus.cc:2804] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:52.391021 21847 raft_consensus.cc:493] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:52.391510 21847 raft_consensus.cc:3060] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:52.396865 16914 leader_election.cc:304] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:07:52.384395 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 186671us
I20260709 13:07:52.395253 16246 leader_election.cc:304] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:52.398603 16248 leader_election.cc:304] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:52.348801 16105 catalog_manager.cc:5697] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 13 to 17, leader changed from 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) to 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66). New cstate: current_term: 17 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:52.383673 21759 raft_consensus.cc:2804] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:52.384855 21875 raft_consensus.cc:2749] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:52.361635 21726 consensus_queue.cc:260] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:52.403023 16914 leader_election.cc:304] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:07:52.399132 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 85380.3us
I20260709 13:07:52.403126 16105 catalog_manager.cc:5697] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "1109f76a0b7b443a84c0327c8707bc63" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
W20260709 13:07:52.407440 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 59035.5us
I20260709 13:07:52.408331 16322 leader_election.cc:304] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:07:52.408330 16105 catalog_manager.cc:5697] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "1109f76a0b7b443a84c0327c8707bc63" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:07:52.410136 16105 catalog_manager.cc:5697] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } }
W20260709 13:07:52.413800 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 48658us
I20260709 13:07:52.402655 21494 raft_consensus.cc:2749] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:07:52.425414 21812 raft_consensus.cc:493] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.426106 21812 raft_consensus.cc:515] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:52.410910 21854 raft_consensus.cc:2749] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:52.416445 21890 raft_consensus.cc:2804] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:52.427479 21890 raft_consensus.cc:493] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:52.427946 21890 raft_consensus.cc:3060] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:52.416604 21788 raft_consensus.cc:2749] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:52.402890 21888 consensus_queue.cc:1048] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 13:07:52.431248 21726 raft_consensus.cc:3060] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:52.417356 16105 catalog_manager.cc:5697] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 3 to 7, leader changed from 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) to e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65). New cstate: current_term: 7 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } }
I20260709 13:07:52.400763 21889 raft_consensus.cc:2749] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:52.434064 16105 catalog_manager.cc:5697] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 15 to 16, leader changed from e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) to 363bb2f744eb486f9ad726f08214c98e (127.14.180.67). New cstate: current_term: 16 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } }
I20260709 13:07:52.396246 21891 consensus_queue.cc:1059] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.017s
I20260709 13:07:52.419778 16173 leader_election.cc:304] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:52.435742 21891 raft_consensus.cc:3055] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:07:52.436174 21891 raft_consensus.cc:740] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:07:52.404265 21759 raft_consensus.cc:493] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:52.437116 21759 raft_consensus.cc:3060] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:52.437420 16173 leader_election.cc:304] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:52.438340 21737 raft_consensus.cc:2749] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:52.439318 21737 raft_consensus.cc:2749] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:52.447058 21891 consensus_queue.cc:260] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:52.448721 21891 raft_consensus.cc:3060] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:52.449606 21776 raft_consensus.cc:515] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:52.440639 16173 leader_election.cc:304] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:52.435776 16105 catalog_manager.cc:5697] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 10 to 17, leader changed from e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) to 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66). New cstate: current_term: 17 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:52.461063 16105 catalog_manager.cc:5697] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 6 to 12. New cstate: current_term: 12 leader_uuid: "1109f76a0b7b443a84c0327c8707bc63" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:07:52.462325 16322 leader_election.cc:304] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63
W20260709 13:07:52.461728 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 57293.9us
I20260709 13:07:52.466879 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:52.467607 16203 raft_consensus.cc:3060] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:07:52.462961 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 45435us
I20260709 13:07:52.463397 16105 catalog_manager.cc:5697] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 9 to 11, leader changed from e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) to 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68). New cstate: current_term: 11 leader_uuid: "1109f76a0b7b443a84c0327c8707bc63" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:07:52.473498 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:52.465422 16246 leader_election.cc:304] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:52.474972 16105 catalog_manager.cc:5697] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:52.467000 21875 raft_consensus.cc:2749] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:07:52.475131 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 68146us
I20260709 13:07:52.479542 21667 raft_consensus.cc:2804] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:52.493335 16173 leader_election.cc:304] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:52.506943 16173 leader_election.cc:304] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:52.489794 16203 raft_consensus.cc:2468] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 15.
I20260709 13:07:52.491801 21854 raft_consensus.cc:2804] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:07:52.514349 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 93182.5us
I20260709 13:07:52.463428 21729 consensus_queue.cc:1048] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 13:07:52.493909 21737 raft_consensus.cc:493] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.516918 16914 leader_election.cc:304] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:52.516155 16320 leader_election.cc:304] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:52.514070 16105 catalog_manager.cc:5697] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 10 to 15, leader changed from 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) to 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68). New cstate: current_term: 15 leader_uuid: "1109f76a0b7b443a84c0327c8707bc63" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:07:52.511883 21578 raft_consensus.cc:2749] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:07:52.525885 15057 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:52.530730 21889 raft_consensus.cc:2804] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:52.530982 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:52.531262 21889 raft_consensus.cc:493] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:52.531677 16280 raft_consensus.cc:2376] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 6. Re-sending same reply.
I20260709 13:07:52.531719 21889 raft_consensus.cc:3060] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:52.530267 16105 catalog_manager.cc:5697] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "1109f76a0b7b443a84c0327c8707bc63" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:07:52.513854 21667 raft_consensus.cc:697] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 12 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:52.514225 21767 raft_consensus.cc:2749] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:07:52.536155 16276 raft_consensus.cc:1240] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 11. Current term is 12. Ops: [11.12-11.12]
W20260709 13:07:52.535424 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 73192.8us
I20260709 13:07:52.532739 16248 leader_election.cc:304] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:07:52.517536 21854 raft_consensus.cc:493] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:52.537948 16322 leader_election.cc:304] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:52.533641 16105 catalog_manager.cc:5697] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: config changed from index 6 to 10, term changed from 10 to 12, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New cstate: current_term: 12 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:52.568509 16208 raft_consensus.cc:1240] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:52.569073 16105 catalog_manager.cc:5697] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 8 to 12, leader changed from 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) to e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65). New cstate: current_term: 12 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } }
I20260709 13:07:52.571976 16201 raft_consensus.cc:1240] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 21 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 20. Current term is 21. Ops: []
I20260709 13:07:52.573055 16173 leader_election.cc:304] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:52.537817 21477 raft_consensus.cc:2804] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:52.584154 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:52.572047 16105 catalog_manager.cc:5697] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 13 to 15, leader changed from 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) to 363bb2f744eb486f9ad726f08214c98e (127.14.180.67), no longer has a pending config: VOTER e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65), VOTER 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66), VOTER 363bb2f744eb486f9ad726f08214c98e (127.14.180.67), VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68). New cstate: current_term: 15 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:07:52.544531 21854 raft_consensus.cc:3060] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:52.584975 16949 raft_consensus.cc:2468] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 13.
I20260709 13:07:52.546708 21494 raft_consensus.cc:2804] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:52.593780 16173 leader_election.cc:304] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:07:52.594839 16914 leader_election.cc:304] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:52.523872 21737 raft_consensus.cc:515] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:52.597525 16105 catalog_manager.cc:5697] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 9 to 11, leader changed from 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) to e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65). New cstate: current_term: 11 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } }
I20260709 13:07:52.538151 21895 consensus_queue.cc:1059] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:07:52.600678 21539 raft_consensus.cc:493] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:52.610002 21895 consensus_queue.cc:1243] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer 363bb2f744eb486f9ad726f08214c98e log is divergent from this leader: its last log entry 10.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:07:52.610073 21539 raft_consensus.cc:515] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:07:52.612696 21539 leader_election.cc:290] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:52.536751 21726 consensus_queue.cc:1059] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.051s
W20260709 13:07:52.606736 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:52.606405 16105 catalog_manager.cc:5697] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:52.599352 21494 raft_consensus.cc:493] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:52.620241 21891 consensus_queue.cc:1059] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:07:52.544715 21759 raft_consensus.cc:515] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:52.597067 21767 raft_consensus.cc:2804] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:07:52.641147 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 49255us
I20260709 13:07:52.638414 16105 catalog_manager.cc:5697] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 8 to 13. New cstate: current_term: 13 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } }
I20260709 13:07:52.622455 21494 raft_consensus.cc:3060] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:52.623555 21875 raft_consensus.cc:2804] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:52.660655 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:52.639147 21776 leader_election.cc:290] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:07:52.670018 16174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:52.670810 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 76071.8us
I20260709 13:07:52.655634 21771 raft_consensus.cc:2804] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:07:52.654022 21767 raft_consensus.cc:697] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 10 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:07:52.680315 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:52.663122 21896 raft_consensus.cc:3055] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:52.664399 21900 raft_consensus.cc:2804] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:52.658407 21847 raft_consensus.cc:515] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:07:52.691757 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 98060.4us
I20260709 13:07:52.667028 21875 raft_consensus.cc:697] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:07:52.700346 21875 consensus_queue.cc:237] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:52.701287 16173 leader_election.cc:304] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:52.638058 21667 consensus_queue.cc:237] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:52.682489 21894 raft_consensus.cc:3055] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:52.683710 21896 raft_consensus.cc:740] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:07:52.709484 16275 raft_consensus.cc:1275] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:07:52.685693 21771 raft_consensus.cc:697] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [term 6 LEADER]: Becoming Leader. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:07:52.712587 21771 consensus_queue.cc:237] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:52.677080 21868 consensus_queue.cc:1059] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.028s
W20260709 13:07:52.728930 21899 log.cc:927] Time spent T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 13:07:52.730506 21901 raft_consensus.cc:3055] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:52.731050 21901 raft_consensus.cc:740] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:07:52.732136 21759 leader_election.cc:290] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:52.732028 21901 consensus_queue.cc:260] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:52.705950 21894 raft_consensus.cc:740] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:07:52.735212 21737 leader_election.cc:290] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:52.736171 21894 consensus_queue.cc:260] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:52.737902 21894 raft_consensus.cc:3060] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:52.738420 21705 leader_election.cc:290] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:52.738744 21767 consensus_queue.cc:237] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:52.740276 21812 leader_election.cc:290] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:52.716079 21900 raft_consensus.cc:697] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 12 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:52.745236 21900 consensus_queue.cc:237] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:52.747958 21854 raft_consensus.cc:515] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:52.749818 21544 raft_consensus.cc:493] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.750499 21544 raft_consensus.cc:515] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:52.753237 21896 consensus_queue.cc:260] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:52.754932 21896 raft_consensus.cc:3060] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:52.760190 21890 raft_consensus.cc:515] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:52.768667 21889 raft_consensus.cc:515] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:52.769550 21866 consensus_queue.cc:1059] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:07:52.770043 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:52.770855 16949 raft_consensus.cc:1240] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:52.772085 21906 raft_consensus.cc:493] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:52.772562 21539 raft_consensus.cc:3055] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:07:52.773000 21539 raft_consensus.cc:740] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:07:52.772716 21906 raft_consensus.cc:515] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:52.773919 21539 consensus_queue.cc:260] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } }
I20260709 13:07:52.775274 21539 raft_consensus.cc:3060] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:07:52.779765 16248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:52.810734 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 272800us
I20260709 13:07:52.812038 16322 leader_election.cc:304] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:52.829972 16322 leader_election.cc:304] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:07:52.836477 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 152279us
I20260709 13:07:52.839964 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:52.847308 16201 raft_consensus.cc:1240] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:52.857728 16248 leader_election.cc:304] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:07:52.770910 21890 leader_election.cc:290] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:52.873330 21906 leader_election.cc:290] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:52.874253 21906 raft_consensus.cc:493] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.876535 21890 raft_consensus.cc:3060] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:52.807487 21494 raft_consensus.cc:515] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:52.842304 21891 raft_consensus.cc:493] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:52.884663 21494 leader_election.cc:290] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 17 election: Requested vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:52.884473 21891 raft_consensus.cc:515] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:52.886049 21494 raft_consensus.cc:2804] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:52.846834 21705 raft_consensus.cc:3060] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:52.874959 21906 raft_consensus.cc:515] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:52.903765 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:52.886525 21494 raft_consensus.cc:493] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:52.888779 21847 leader_election.cc:290] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 18 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:52.939272 21494 raft_consensus.cc:3060] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:52.955931 16208 raft_consensus.cc:2468] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 18.
I20260709 13:07:52.944595 21905 raft_consensus.cc:2804] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:52.945180 21902 raft_consensus.cc:493] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:52.946983 21539 raft_consensus.cc:493] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.947083 21908 raft_consensus.cc:493] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:52.947767 21866 raft_consensus.cc:493] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.925506 21895 raft_consensus.cc:493] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.927234 21889 leader_election.cc:290] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 11 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:52.925508 21900 raft_consensus.cc:493] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:52.896989 21767 consensus_queue.cc:1059] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 13:07:52.981205 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:52.971429 21539 raft_consensus.cc:515] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:52.990763 21539 leader_election.cc:290] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:52.973524 21866 raft_consensus.cc:515] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:52.991640 21906 leader_election.cc:290] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:52.978756 21477 raft_consensus.cc:697] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 15 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:53.002049 16208 raft_consensus.cc:1275] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 21 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:07:52.973387 21891 leader_election.cc:290] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:52.975943 21905 raft_consensus.cc:697] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:07:53.006754 21477 consensus_queue.cc:237] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:07:53.010043 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 180126us
I20260709 13:07:53.024777 16322 leader_election.cc:304] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:07:53.027275 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c15d8e9be8414c84912ab77b66bfb1" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:07:53.025473 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 177128us
I20260709 13:07:53.014135 16246 leader_election.cc:304] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:52.978922 21895 raft_consensus.cc:515] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:53.031708 21905 consensus_queue.cc:237] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:53.034385 21895 leader_election.cc:290] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:53.034915 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:52.979274 21900 raft_consensus.cc:515] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:53.035673 16206 raft_consensus.cc:2468] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 16.
I20260709 13:07:53.037498 21900 leader_election.cc:290] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:53.039348 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:53.042387 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:53.043355 16207 raft_consensus.cc:2468] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 6.
W20260709 13:07:53.045572 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 187934us
I20260709 13:07:53.048245 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:53.048979 16280 raft_consensus.cc:2468] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 16.
W20260709 13:07:53.019670 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 160394us
I20260709 13:07:53.040325 16204 raft_consensus.cc:2468] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 10.
I20260709 13:07:53.049207 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
W20260709 13:07:53.063278 16246 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:53.053418 16173 leader_election.cc:304] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:53.059886 16276 raft_consensus.cc:1275] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:07:52.975368 21902 raft_consensus.cc:515] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:53.082540 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:53.045308 21891 raft_consensus.cc:2804] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:07:53.097482 16322 leader_election.cc:304] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:53.100279 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:53.052881 21900 raft_consensus.cc:493] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.978502 21908 raft_consensus.cc:515] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:53.044849 21903 raft_consensus.cc:2749] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:53.053766 21869 raft_consensus.cc:493] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:53.115686 16322 leader_election.cc:304] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:07:53.083129 21539 raft_consensus.cc:493] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.088227 21881 raft_consensus.cc:2804] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:07:53.133085 21912 log.cc:927] Time spent T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:07:53.121102 21665 raft_consensus.cc:2749] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:53.134923 21901 raft_consensus.cc:3060] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:53.135730 21866 leader_election.cc:290] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:53.094689 21544 leader_election.cc:290] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:53.134512 21776 raft_consensus.cc:493] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:53.145691 21913 log.cc:927] Time spent T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.172s	user 0.000s	sys 0.001s
I20260709 13:07:53.146101 21920 raft_consensus.cc:493] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.138840 21539 raft_consensus.cc:515] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:53.076268 21578 consensus_queue.cc:1048] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 13:07:53.112097 21729 raft_consensus.cc:493] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.138213 21887 raft_consensus.cc:493] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:53.121413 21891 raft_consensus.cc:697] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:07:53.139554 21874 raft_consensus.cc:2804] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:53.140570 21881 raft_consensus.cc:493] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:53.180925 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:53.186843 21887 raft_consensus.cc:515] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:53.189625 21887 leader_election.cc:290] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:53.153338 21776 raft_consensus.cc:515] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:53.193280 21776 leader_election.cc:290] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:53.196018 21539 leader_election.cc:290] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:53.197674 21874 raft_consensus.cc:697] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 12 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:53.197455 21494 raft_consensus.cc:515] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:53.198761 21874 consensus_queue.cc:237] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:53.151497 21890 raft_consensus.cc:2749] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:53.219697 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:53.220762 16283 raft_consensus.cc:2468] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 18.
I20260709 13:07:53.222358 16914 leader_election.cc:304] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:07:53.121325 21900 raft_consensus.cc:515] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:53.230335 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:53.231227 16207 raft_consensus.cc:2468] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 10.
W20260709 13:07:53.231443 21923 log.cc:927] Time spent T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
I20260709 13:07:53.183149 21729 raft_consensus.cc:515] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:53.234935 21918 raft_consensus.cc:493] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.235564 21918 raft_consensus.cc:515] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:53.236006 21705 raft_consensus.cc:2749] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:53.238023 21918 leader_election.cc:290] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:53.240304 21891 consensus_queue.cc:237] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:53.234424 21729 leader_election.cc:290] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:53.243008 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:53.243800 16282 raft_consensus.cc:2468] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 14.
W20260709 13:07:53.248458 16249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:53.252462 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:53.252609 16280 raft_consensus.cc:1275] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:07:53.202606 21881 raft_consensus.cc:3060] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:53.259838 21908 leader_election.cc:290] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:53.183276 21920 raft_consensus.cc:515] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:53.262918 21920 leader_election.cc:290] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:53.253264 16207 raft_consensus.cc:2468] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 13.
I20260709 13:07:53.140779 21869 raft_consensus.cc:515] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:53.267043 16914 leader_election.cc:304] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:07:53.258342 21882 raft_consensus.cc:3055] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:53.254082 21896 raft_consensus.cc:2804] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:53.278738 21896 raft_consensus.cc:493] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:53.279217 21896 raft_consensus.cc:3060] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:53.272981 21889 raft_consensus.cc:2804] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:53.279783 21889 raft_consensus.cc:493] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:53.280126 21889 raft_consensus.cc:3060] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:53.282835 21927 consensus_queue.cc:1048] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:53.284502 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:53.285104 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:53.285853 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:53.286455 16206 raft_consensus.cc:2468] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 13.
I20260709 13:07:53.275218 21902 leader_election.cc:290] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:53.288617 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:53.289299 16207 raft_consensus.cc:2468] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 14.
I20260709 13:07:53.285354 16199 raft_consensus.cc:2393] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 in current term 18: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:07:53.291422 16246 leader_election.cc:304] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:53.292421 16246 leader_election.cc:304] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:53.293203 21539 raft_consensus.cc:2804] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:53.293382 16246 leader_election.cc:304] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:53.293639 21539 raft_consensus.cc:493] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:53.294034 21539 raft_consensus.cc:3060] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:53.273387 21900 leader_election.cc:290] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:53.296164 16246 leader_election.cc:304] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:53.304148 21544 raft_consensus.cc:2804] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:53.304596 21544 raft_consensus.cc:493] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:53.302574 21895 raft_consensus.cc:2804] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:53.305024 21544 raft_consensus.cc:3060] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:53.306454 21895 raft_consensus.cc:493] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:53.307025 21895 raft_consensus.cc:3060] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:53.315819 21889 raft_consensus.cc:515] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:53.290407 21869 leader_election.cc:290] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:53.324378 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:53.327853 21919 consensus_queue.cc:1048] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:53.303066 21902 raft_consensus.cc:2804] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:53.329993 21494 leader_election.cc:290] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 election: Requested vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:53.330664 21539 raft_consensus.cc:515] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:53.271028 21908 raft_consensus.cc:493] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:53.341622 16943 raft_consensus.cc:1240] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:53.320461 16246 leader_election.cc:304] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:53.335495 16205 raft_consensus.cc:2468] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 18.
I20260709 13:07:53.339335 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:53.340212 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:53.343237 16207 raft_consensus.cc:2468] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 14.
I20260709 13:07:53.303256 21882 raft_consensus.cc:740] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:07:53.347198 16206 raft_consensus.cc:1275] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:07:53.347966 21539 leader_election.cc:290] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:53.344359 21866 raft_consensus.cc:493] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:53.349061 21866 raft_consensus.cc:515] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:53.340097 21902 raft_consensus.cc:493] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:53.351418 21866 leader_election.cc:290] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:53.351751 21902 raft_consensus.cc:3060] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:53.354144 21882 consensus_queue.cc:260] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:53.345443 21908 raft_consensus.cc:515] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:53.355552 21882 raft_consensus.cc:3060] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:53.357134 21908 leader_election.cc:290] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:53.357792 21908 raft_consensus.cc:493] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:53.345944 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:53.361274 21854 leader_election.cc:290] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:53.364955 21544 raft_consensus.cc:515] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:53.383729 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:53.384466 16199 raft_consensus.cc:3060] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:07:53.386982 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:53.385842 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:53.391055 16276 raft_consensus.cc:3060] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:53.398717 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:53.400341 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:53.401422 16282 raft_consensus.cc:2393] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 in current term 11: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:07:53.403604 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:53.377914 21494 raft_consensus.cc:2804] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:53.358349 21908 raft_consensus.cc:515] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:53.397832 21888 consensus_queue.cc:1048] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 13:07:53.413300 21874 consensus_queue.cc:1048] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:07:53.416700 16320 leader_election.cc:304] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:53.417682 16320 leader_election.cc:304] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:53.420624 16320 leader_election.cc:304] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:53.420065 21890 raft_consensus.cc:2804] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:53.426030 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:07:53.426394 21890 raft_consensus.cc:493] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:53.426864 21890 raft_consensus.cc:3060] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:53.425709 21759 raft_consensus.cc:2804] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:53.428196 21759 raft_consensus.cc:493] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:53.428574 21759 raft_consensus.cc:3060] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:53.424404 16274 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f"
dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
mode: GRACEFUL
new_leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
 from {username='slave'} at 127.0.0.1:39058
I20260709 13:07:53.429579 16274 raft_consensus.cc:606] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 LEADER]: Received request to transfer leadership to TS e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:53.432001 16944 raft_consensus.cc:3060] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:53.432426 21895 raft_consensus.cc:515] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:53.435423 16943 raft_consensus.cc:3060] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:53.435990 16320 leader_election.cc:304] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:53.448151 21544 leader_election.cc:290] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 15 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:53.407482 21889 leader_election.cc:290] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 15 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:53.454006 16199 raft_consensus.cc:2468] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 12.
I20260709 13:07:53.454437 21902 raft_consensus.cc:515] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:53.405944 21494 raft_consensus.cc:493] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:53.460355 16914 leader_election.cc:304] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:53.460939 16282 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8"
dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
mode: GRACEFUL
new_leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
 from {username='slave'} at 127.0.0.1:39058
I20260709 13:07:53.462582 21922 raft_consensus.cc:2804] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:07:53.466874 16944 raft_consensus.cc:1275] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:07:53.471364 16943 raft_consensus.cc:2468] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 14.
I20260709 13:07:53.480062 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
W20260709 13:07:53.480979 16174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:53.422531 21891 raft_consensus.cc:493] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.483243 16282 raft_consensus.cc:606] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 21 FOLLOWER]: Received request to transfer leadership to TS e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:53.536877 16282 raft_consensus.cc:614] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:53.484057 16276 raft_consensus.cc:2468] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 15.
I20260709 13:07:53.510032 16199 raft_consensus.cc:3060] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:07:53.538676 21896 raft_consensus.cc:515] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:53.543877 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:53.440966 21874 raft_consensus.cc:493] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.547055 16283 raft_consensus.cc:1240] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:07:53.463179 21920 raft_consensus.cc:2804] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:53.551312 16279 raft_consensus.cc:1240] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 16. Current term is 17. Ops: []
I20260709 13:07:53.546597 16248 leader_election.cc:304] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:07:53.562980 16199 raft_consensus.cc:2468] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 15.
I20260709 13:07:53.439229 21881 raft_consensus.cc:515] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:53.498333 21922 raft_consensus.cc:493] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:53.498996 21494 raft_consensus.cc:3060] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:07:53.615913 21932 log.cc:927] Time spent T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
I20260709 13:07:53.616191 21908 leader_election.cc:290] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:53.616783 21922 raft_consensus.cc:3060] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:07:53.617080 21934 log.cc:927] Time spent T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
I20260709 13:07:53.553083 21759 raft_consensus.cc:515] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:53.642279 16200 raft_consensus.cc:2393] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 17: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:07:53.487051 16246 leader_election.cc:304] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:53.623528 21881 leader_election.cc:290] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 17 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:07:53.625861 21924 log.cc:927] Time spent T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.306s	user 0.005s	sys 0.000s
I20260709 13:07:53.609797 16205 raft_consensus.cc:2468] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 14.
I20260709 13:07:53.553507 21667 raft_consensus.cc:493] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.619794 21902 leader_election.cc:290] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:53.766913 21667 raft_consensus.cc:515] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:53.608706 21539 raft_consensus.cc:2804] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:53.768148 21539 raft_consensus.cc:697] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:07:53.769130 21539 consensus_queue.cc:237] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:53.769630 21667 leader_election.cc:290] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:53.647324 16282 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db"
dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
mode: GRACEFUL
new_leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
 from {username='slave'} at 127.0.0.1:39058
I20260709 13:07:53.770586 16945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:53.770872 16282 raft_consensus.cc:606] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Received request to transfer leadership to TS e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:53.771023 21544 raft_consensus.cc:993] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3: : Instructing follower e10b16d536674c0bb350a31d7ce5ff7f to start an election
I20260709 13:07:53.771311 16282 raft_consensus.cc:614] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:53.771476 16945 raft_consensus.cc:2393] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 14: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:07:53.772476 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:53.773247 16282 raft_consensus.cc:2368] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for earlier term 14. Current term is 15.
I20260709 13:07:53.773741 21895 leader_election.cc:290] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 17 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:53.765749 21866 raft_consensus.cc:2804] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:53.775950 21866 raft_consensus.cc:697] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:07:53.610738 21903 raft_consensus.cc:493] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:53.612497 21898 raft_consensus.cc:2749] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:53.553709 21477 raft_consensus.cc:493] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:53.543439 21891 raft_consensus.cc:515] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:53.651279 21916 raft_consensus.cc:493] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:53.657953 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:07:53.661167 21925 raft_consensus.cc:493] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:53.541225 21919 consensus_queue.cc:1048] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.103s
I20260709 13:07:53.567698 21874 raft_consensus.cc:515] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:53.674175 21759 leader_election.cc:290] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:07:53.693886 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 85335.6us
I20260709 13:07:53.705646 21909 raft_consensus.cc:493] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:53.705739 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:53.702224 21890 raft_consensus.cc:515] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:53.712133 16248 leader_election.cc:304] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:53.719563 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
W20260709 13:07:53.799808 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 87785.6us
I20260709 13:07:53.721936 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:53.724627 16280 raft_consensus.cc:1275] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:07:53.729758 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:53.731439 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:53.712596 21922 raft_consensus.cc:515] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:53.731599 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:07:53.737643 16946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:53.802084 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:53.750238 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:53.802428 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:53.753527 21943 raft_consensus.cc:493] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.736234 21705 raft_consensus.cc:493] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:53.702452 21494 raft_consensus.cc:515] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:53.730762 21776 raft_consensus.cc:493] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:53.756074 21896 leader_election.cc:290] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 18 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:53.810254 21940 raft_consensus.cc:493] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:53.810752 21909 raft_consensus.cc:515] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:53.811046 21940 raft_consensus.cc:515] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:53.811736 21922 leader_election.cc:290] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 19 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:07:53.757022 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 49969.2us
W20260709 13:07:53.763523 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 276567us
I20260709 13:07:53.764142 16914 leader_election.cc:304] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:53.560461 21920 raft_consensus.cc:493] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:53.784101 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:53.813584 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 49588.5us
I20260709 13:07:53.789697 21477 raft_consensus.cc:515] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:53.794843 16282 raft_consensus.cc:1275] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 21 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
W20260709 13:07:53.818953 16249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:53.801046 16204 raft_consensus.cc:2393] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 in current term 18: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:07:53.751109 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:53.801174 16275 raft_consensus.cc:2468] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 18.
I20260709 13:07:53.803910 16949 raft_consensus.cc:2368] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for earlier term 14. Current term is 15.
I20260709 13:07:53.808442 16278 raft_consensus.cc:1275] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:07:53.813995 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:53.816556 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:53.804502 21908 raft_consensus.cc:2749] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:53.821671 16199 raft_consensus.cc:2393] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 15: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:07:53.817674 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bc3c8ff9b84838a2664335d7e1582b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:53.771745 21544 raft_consensus.cc:1081] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 LEADER]: Signalling peer e10b16d536674c0bb350a31d7ce5ff7f to start an election
I20260709 13:07:53.816591 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:53.825471 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:53.828186 16914 leader_election.cc:304] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:07:53.828722 16275 raft_consensus.cc:1275] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:07:53.829068 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:53.830227 16277 raft_consensus.cc:2393] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 15: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:07:53.830653 16278 raft_consensus.cc:2393] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 17: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:07:53.831818 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:53.832264 16203 raft_consensus.cc:3060] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:53.829715 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:53.812790 21705 raft_consensus.cc:515] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:53.836472 21705 leader_election.cc:290] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:53.831723 21902 raft_consensus.cc:493] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.838886 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:53.839036 21902 raft_consensus.cc:515] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:53.830940 21895 raft_consensus.cc:493] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.841939 16206 raft_consensus.cc:1275] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:07:53.842115 21895 raft_consensus.cc:515] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:53.826510 21776 raft_consensus.cc:515] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:53.823328 21896 raft_consensus.cc:2749] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:53.844362 21891 leader_election.cc:290] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:53.796965 21916 raft_consensus.cc:515] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:53.845960 21776 leader_election.cc:290] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:53.847922 21890 leader_election.cc:290] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 12 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:53.805294 21925 raft_consensus.cc:515] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:53.793210 21903 raft_consensus.cc:515] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:53.861618 16282 raft_consensus.cc:1275] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:07:53.865615 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:53.841451 21902 leader_election.cc:290] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:53.859129 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:53.870334 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:53.805051 21729 raft_consensus.cc:493] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:53.873704 16278 raft_consensus.cc:2468] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 14.
I20260709 13:07:53.869709 16203 raft_consensus.cc:2468] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 19.
I20260709 13:07:53.876751 16204 raft_consensus.cc:1240] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 19 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 18. Current term is 19. Ops: []
I20260709 13:07:53.876900 16275 raft_consensus.cc:2393] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 15: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:07:53.877871 21729 raft_consensus.cc:515] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:53.865779 16246 leader_election.cc:304] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:53.880160 16246 leader_election.cc:304] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:53.881181 21854 raft_consensus.cc:2804] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:53.881691 21854 raft_consensus.cc:697] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:07:53.823065 21943 raft_consensus.cc:515] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:53.882578 21854 consensus_queue.cc:237] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:53.853839 21940 leader_election.cc:290] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:53.848572 21895 leader_election.cc:290] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:53.884404 16281 raft_consensus.cc:2468] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 15.
I20260709 13:07:53.884601 21943 leader_election.cc:290] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:07:53.885510 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 64767.3us
I20260709 13:07:53.886446 16277 raft_consensus.cc:1275] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:07:53.886977 21940 raft_consensus.cc:493] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:53.887604 21940 raft_consensus.cc:515] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:53.888121 16246 leader_election.cc:304] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:53.818643 21920 raft_consensus.cc:3060] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:53.860944 21909 leader_election.cc:290] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:53.895318 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:53.862032 21866 consensus_queue.cc:237] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:53.831442 21922 raft_consensus.cc:493] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:53.891366 16173 leader_election.cc:304] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:53.891171 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:53.895252 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:53.857111 21926 raft_consensus.cc:2804] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:53.898723 16357 raft_consensus.cc:1240] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 21 LEADER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 20. Current term is 21. Ops: []
I20260709 13:07:53.899153 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:53.902648 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:53.909258 16320 leader_election.cc:304] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:53.899515 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:53.858328 21874 leader_election.cc:290] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:53.911525 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:53.953394 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:53.856755 21494 leader_election.cc:290] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:53.886888 21925 leader_election.cc:290] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:53.860080 21477 leader_election.cc:290] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:53.957062 16349 raft_consensus.cc:2368] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 18. Current term is 19.
I20260709 13:07:53.954254 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c15d8e9be8414c84912ab77b66bfb1" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:07:53.960522 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 69243us
I20260709 13:07:53.961104 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:53.963939 16202 raft_consensus.cc:2393] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 12: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:07:53.965538 16350 raft_consensus.cc:1240] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:53.966306 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
W20260709 13:07:53.965215 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 59735.4us
I20260709 13:07:53.905160 16348 raft_consensus.cc:2468] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 13.
W20260709 13:07:53.971011 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 61858us
I20260709 13:07:53.969450 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:53.975927 16208 raft_consensus.cc:2368] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for earlier term 16. Current term is 17.
I20260709 13:07:53.968102 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:53.982599 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:53.983430 16353 raft_consensus.cc:2393] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 15: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:07:53.983278 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:53.983747 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:53.984409 16944 raft_consensus.cc:2468] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 16.
I20260709 13:07:53.989445 16282 raft_consensus.cc:2468] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 18.
I20260709 13:07:53.990725 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:53.998790 16351 raft_consensus.cc:2468] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 15.
I20260709 13:07:53.991045 16274 raft_consensus.cc:1275] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:07:53.915102 21847 raft_consensus.cc:2749] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:07:53.992165 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 16 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:53.992441 16356 raft_consensus.cc:2393] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 12: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:07:54.005342 16207 raft_consensus.cc:2410] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:07:53.911450 21901 raft_consensus.cc:493] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:53.997102 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:53.906711 21891 raft_consensus.cc:2804] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:54.001187 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:54.001837 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:07:54.004920 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 53091us
I20260709 13:07:54.008205 16349 raft_consensus.cc:2468] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 15.
I20260709 13:07:54.009193 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:53.918206 21940 leader_election.cc:290] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:54.006429 16283 raft_consensus.cc:2468] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 12.
I20260709 13:07:54.010175 16277 raft_consensus.cc:1275] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:07:54.009215 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:53.970197 21881 raft_consensus.cc:2749] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:07:54.011117 16276 raft_consensus.cc:2393] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 16: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:07:54.009868 16200 raft_consensus.cc:2468] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 11.
I20260709 13:07:54.077255 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:53.991947 21874 raft_consensus.cc:2804] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:07:53.951319 21893 consensus_queue.cc:1059] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.056s
I20260709 13:07:54.085920 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:53.956544 21906 consensus_queue.cc:1048] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.051s
I20260709 13:07:53.950827 21922 raft_consensus.cc:515] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:54.012521 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:54.004633 21539 raft_consensus.cc:493] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.000962 21494 raft_consensus.cc:493] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.089756 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bc3c8ff9b84838a2664335d7e1582b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:07:54.088055 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 82505us
I20260709 13:07:54.092401 16356 raft_consensus.cc:2393] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 12: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:07:54.094542 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:54.095499 16354 raft_consensus.cc:2393] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 15: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:07:54.097769 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:54.098390 16348 raft_consensus.cc:3060] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:07:54.076330 21726 raft_consensus.cc:493] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.990859 21865 consensus_queue.cc:1059] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.101s
I20260709 13:07:54.099748 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:07:54.096217 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 97935.5us
I20260709 13:07:54.108314 16354 raft_consensus.cc:2468] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 9.
I20260709 13:07:54.090515 21891 raft_consensus.cc:697] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:07:54.007006 21767 consensus_queue.cc:1048] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.098s
I20260709 13:07:54.078058 21901 raft_consensus.cc:515] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:54.116276 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:54.116987 16354 raft_consensus.cc:2468] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 16.
I20260709 13:07:54.100231 21874 raft_consensus.cc:697] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 19 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:54.109504 21888 raft_consensus.cc:493] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.121421 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:54.093986 21494 raft_consensus.cc:515] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:54.097242 21539 raft_consensus.cc:515] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:54.130434 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:54.110584 21726 raft_consensus.cc:515] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:54.140230 21726 leader_election.cc:290] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:54.142596 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:54.151921 21922 leader_election.cc:290] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:54.128610 21888 raft_consensus.cc:515] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:54.161592 21539 leader_election.cc:290] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:54.162710 21888 leader_election.cc:290] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:54.168401 16200 raft_consensus.cc:1275] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:07:54.169117 16914 leader_election.cc:304] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:54.123818 21544 consensus_queue.cc:1059] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.018s
I20260709 13:07:54.122965 21737 consensus_queue.cc:1048] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:07:54.174482 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:54.186072 16354 raft_consensus.cc:3060] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:54.198401 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:54.199576 16282 raft_consensus.cc:2468] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 12.
I20260709 13:07:54.171770 21926 raft_consensus.cc:697] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 15 LEADER]: Becoming Leader. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:07:54.214634 21926 consensus_queue.cc:237] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:54.227113 16914 leader_election.cc:304] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
W20260709 13:07:54.229274 16174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:54.232560 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:54.232985 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:54.233227 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:54.233814 16208 raft_consensus.cc:3060] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:07:54.240715 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:54.233639 16200 raft_consensus.cc:2468] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 12.
I20260709 13:07:54.242179 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:54.243939 16207 raft_consensus.cc:2468] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 16.
I20260709 13:07:54.245980 16279 raft_consensus.cc:2468] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 12.
I20260709 13:07:54.231153 21767 raft_consensus.cc:493] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.175072 21539 raft_consensus.cc:493] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.175638 21894 raft_consensus.cc:493] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.251490 16914 leader_election.cc:304] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:07:54.228550 21902 raft_consensus.cc:493] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.261065 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:54.262436 16246 leader_election.cc:304] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:54.280750 16246 leader_election.cc:304] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:54.263833 16207 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f"
dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
 from {username='slave'} at 127.0.0.1:60138
I20260709 13:07:54.287267 16207 raft_consensus.cc:493] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:54.287741 16207 raft_consensus.cc:3060] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:54.287271 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:54.171808 21891 consensus_queue.cc:237] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:54.266701 21888 raft_consensus.cc:2804] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:54.290858 21725 raft_consensus.cc:2804] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:54.294157 21544 raft_consensus.cc:2804] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:54.321789 21544 raft_consensus.cc:493] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:54.299182 21919 raft_consensus.cc:493] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.322129 21905 raft_consensus.cc:493] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.257771 21539 raft_consensus.cc:515] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:54.338233 16354 raft_consensus.cc:2468] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 16.
I20260709 13:07:54.291476 21847 raft_consensus.cc:2804] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:54.320916 16357 raft_consensus.cc:1240] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 12 LEADER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:54.321419 21725 raft_consensus.cc:493] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:54.322661 21919 raft_consensus.cc:515] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:54.323429 21907 raft_consensus.cc:2804] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:07:54.326092 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:54.263427 21894 raft_consensus.cc:515] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } }
I20260709 13:07:54.311532 16356 raft_consensus.cc:1240] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:54.348026 16351 raft_consensus.cc:2393] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 9: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:07:54.349123 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:54.247493 21767 raft_consensus.cc:515] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:54.352917 21767 leader_election.cc:290] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:54.310647 16353 raft_consensus.cc:1275] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:07:54.356433 16353 raft_consensus.cc:1275] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:07:54.322177 21544 raft_consensus.cc:3060] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:54.316490 16207 raft_consensus.cc:515] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:54.254617 21874 consensus_queue.cc:237] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:54.247457 21953 consensus_queue.cc:1048] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.166s
W20260709 13:07:54.349400 16249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:54.360787 16356 raft_consensus.cc:1275] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:07:54.333981 16322 leader_election.cc:304] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:07:54.372756 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 82277.4us
I20260709 13:07:54.336172 16208 raft_consensus.cc:2468] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 16.
I20260709 13:07:54.319878 21888 raft_consensus.cc:493] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:54.342904 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:54.361490 16353 raft_consensus.cc:1275] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:07:54.287662 21902 raft_consensus.cc:515] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:54.341034 21847 raft_consensus.cc:493] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:54.345543 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:54.370210 16207 leader_election.cc:290] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 17 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:54.346978 21725 raft_consensus.cc:3060] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:54.375996 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:07:54.377521 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 43622.8us
I20260709 13:07:54.384382 16322 leader_election.cc:400] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 election: Vote denied by peer 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875) with higher term. Message: Invalid argument: T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for earlier term 14. Current term is 15.
I20260709 13:07:54.384878 16322 leader_election.cc:403] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:07:54.389964 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:54.384101 16246 leader_election.cc:304] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:54.339864 21905 raft_consensus.cc:515] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:54.371480 21901 leader_election.cc:290] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:54.380618 21888 raft_consensus.cc:3060] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:54.379884 21705 raft_consensus.cc:2749] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:54.381544 21847 raft_consensus.cc:3060] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:54.377274 21907 raft_consensus.cc:697] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 18 LEADER]: Becoming Leader. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:07:54.396826 21776 raft_consensus.cc:3060] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:07:54.420626 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 44042.1us
I20260709 13:07:54.420831 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:54.423446 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:54.424364 16279 raft_consensus.cc:2468] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 9.
I20260709 13:07:54.433035 16946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:54.433300 21916 leader_election.cc:290] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:54.434867 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:54.442703 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:54.423364 21901 raft_consensus.cc:2804] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:07:54.423313 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 310677us
W20260709 13:07:54.455015 21920 consensus_meta.cc:287] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 0.536s	user 0.008s	sys 0.003s
I20260709 13:07:54.455591 21920 raft_consensus.cc:515] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:54.456967 16349 raft_consensus.cc:2368] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 14. Current term is 15.
I20260709 13:07:54.459724 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 16 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:54.459821 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:54.460114 16348 raft_consensus.cc:2468] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 17.
I20260709 13:07:54.461155 16946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:54.461297 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:54.462771 16276 raft_consensus.cc:2368] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for earlier term 16. Current term is 17.
I20260709 13:07:54.464205 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:54.466002 16283 raft_consensus.cc:1275] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:07:54.467058 16946 raft_consensus.cc:2393] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 11: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
I20260709 13:07:54.471753 16946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:54.473361 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: true dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:54.474049 16281 raft_consensus.cc:3055] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:07:54.474385 16281 raft_consensus.cc:740] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:07:54.484973 16248 leader_election.cc:304] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:54.477615 16173 leader_election.cc:304] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:54.488070 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:54.435902 21909 raft_consensus.cc:2955] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 15 LEADER]: Committing config change with OpId 15.10: config changed from index 6 to 10, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:07:54.492990 21539 leader_election.cc:290] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:54.493738 21539 raft_consensus.cc:2749] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:07:54.500173 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:54.500964 16207 raft_consensus.cc:2468] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 10.
I20260709 13:07:54.484004 21901 raft_consensus.cc:697] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:07:54.502573 21901 consensus_queue.cc:237] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:54.505100 21895 raft_consensus.cc:3055] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:07:54.505610 21895 raft_consensus.cc:740] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
W20260709 13:07:54.507216 21965 log.cc:927] Time spent T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:07:54.514765 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:54.516114 16246 leader_election.cc:304] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:54.513535 16173 leader_election.cc:304] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:54.526432 16207 raft_consensus.cc:1275] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260709 13:07:54.590850 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 59715.9us
W20260709 13:07:54.592024 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 56741.2us
W20260709 13:07:54.633520 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 120045us
W20260709 13:07:54.686900 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 257804us
W20260709 13:07:54.692142 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 56791.7us
I20260709 13:07:54.698993 16355 raft_consensus.cc:1240] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 19 LEADER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 18. Current term is 19. Ops: []
I20260709 13:07:54.700040 16353 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4"
dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
mode: GRACEFUL
new_leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
 from {username='slave'} at 127.0.0.1:56792
I20260709 13:07:54.700667 16353 raft_consensus.cc:606] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Received request to transfer leadership to TS e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:54.700958 16353 raft_consensus.cc:614] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:54.590256 21854 raft_consensus.cc:2804] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:54.526139 21881 raft_consensus.cc:2804] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:54.691565 21767 raft_consensus.cc:2804] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:54.736901 16173 leader_election.cc:304] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:54.741585 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:54.697415 21866 raft_consensus.cc:493] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.706844 21854 raft_consensus.cc:493] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:54.638187 21962 consensus_queue.cc:1048] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.097s
I20260709 13:07:54.749176 16281 consensus_queue.cc:260] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:54.708374 21881 raft_consensus.cc:493] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Starting leader election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:54.735133 21767 raft_consensus.cc:493] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:54.769021 16281 raft_consensus.cc:3060] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:07:54.765551 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 280709us
I20260709 13:07:54.728845 21882 consensus_queue.cc:1059] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:07:54.764127 21854 raft_consensus.cc:3060] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:54.735144 21943 consensus_queue.cc:1048] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 13:07:54.741300 21578 consensus_queue.cc:1048] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
W20260709 13:07:54.818684 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 44275.5us
I20260709 13:07:54.692265 21895 consensus_queue.cc:260] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:54.840030 21961 consensus_queue.cc:1048] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.097s
I20260709 13:07:54.849339 16281 raft_consensus.cc:2468] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 17.
I20260709 13:07:54.758962 21866 raft_consensus.cc:515] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:54.692083 21907 consensus_queue.cc:237] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:54.920186 16248 leader_election.cc:400] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 18 election: Vote denied by peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107) with higher term. Message: Invalid argument: T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 18. Current term is 19.
I20260709 13:07:54.785790 21729 leader_election.cc:290] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:54.835307 21920 leader_election.cc:290] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:54.772464 21767 raft_consensus.cc:3060] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:54.773120 21881 raft_consensus.cc:3060] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:54.915059 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:54.932407 16248 leader_election.cc:304] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:54.870235 21905 leader_election.cc:290] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:54.920092 21895 raft_consensus.cc:3060] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:54.953331 16248 leader_election.cc:304] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:54.951789 16281 raft_consensus.cc:2468] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 18.
I20260709 13:07:54.954787 21969 raft_consensus.cc:493] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
W20260709 13:07:54.969551 21935 log.cc:927] Time spent T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
W20260709 13:07:55.015185 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 91657.6us
I20260709 13:07:54.963263 21905 raft_consensus.cc:493] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:54.951049 21882 raft_consensus.cc:493] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:54.976263 21956 raft_consensus.cc:2749] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:07:55.036053 16275 raft_consensus.cc:1240] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:07:55.023823 16248 leader_election.cc:304] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:54.986617 21975 raft_consensus.cc:2749] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:07:55.045382 21977 log.cc:927] Time spent T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
W20260709 13:07:55.027904 21967 log.cc:927] Time spent T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63: Append to log took a long time: real 0.169s	user 0.001s	sys 0.000s
I20260709 13:07:55.060122 16275 raft_consensus.cc:1240] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 16. Current term is 17. Ops: []
W20260709 13:07:55.078379 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 55974.9us
I20260709 13:07:55.082186 16248 leader_election.cc:304] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:55.088423 21665 raft_consensus.cc:493] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:55.089092 21665 raft_consensus.cc:515] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:55.092092 21665 leader_election.cc:290] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:55.096235 21986 raft_consensus.cc:2749] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:07:55.099184 21909 consensus_meta.cc:287] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 0.605s	user 0.019s	sys 0.000s
I20260709 13:07:55.101416 16248 leader_election.cc:304] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:55.102763 16248 leader_election.cc:304] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:55.031029 21974 consensus_queue.cc:1059] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.056s
W20260709 13:07:55.106868 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 418971us
I20260709 13:07:55.031199 21905 raft_consensus.cc:515] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:55.115985 21866 leader_election.cc:290] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:55.117947 21903 leader_election.cc:290] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:07:55.119153 21980 log.cc:927] Time spent T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
W20260709 13:07:55.128832 21847 consensus_meta.cc:287] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3: Time spent flushing consensus metadata: real 0.699s	user 0.007s	sys 0.004s
I20260709 13:07:55.170475 21847 raft_consensus.cc:515] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:55.085592 21895 raft_consensus.cc:493] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:55.173775 21895 raft_consensus.cc:515] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:55.131321 21984 raft_consensus.cc:2749] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:55.177255 21847 leader_election.cc:290] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:55.183636 21895 leader_election.cc:290] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:07:55.193638 21972 log.cc:927] Time spent T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.272s	user 0.004s	sys 0.000s
W20260709 13:07:55.131868 21725 consensus_meta.cc:287] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63: Time spent flushing consensus metadata: real 0.734s	user 0.011s	sys 0.000s
I20260709 13:07:55.196799 21725 raft_consensus.cc:515] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:55.114740 21975 raft_consensus.cc:2749] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:55.133196 21974 raft_consensus.cc:3055] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:55.200242 21974 raft_consensus.cc:740] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:07:55.201222 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:55.202081 16202 raft_consensus.cc:3060] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:55.204766 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:55.205192 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:07:55.134302 21544 consensus_meta.cc:287] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3: Time spent flushing consensus metadata: real 0.763s	user 0.008s	sys 0.004s
I20260709 13:07:55.219592 21544 raft_consensus.cc:515] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:55.221165 21953 raft_consensus.cc:3055] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:55.221629 21953 raft_consensus.cc:740] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:07:55.221979 21544 leader_election.cc:290] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 17 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:55.137192 21494 leader_election.cc:290] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:55.140501 21898 raft_consensus.cc:3055] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:07:55.105443 21986 raft_consensus.cc:2749] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:55.078462 21981 raft_consensus.cc:493] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
W20260709 13:07:55.232952 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 118646us
I20260709 13:07:55.039146 21882 raft_consensus.cc:515] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:07:55.140550 21776 consensus_meta.cc:287] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 0.695s	user 0.007s	sys 0.004s
I20260709 13:07:55.024317 21969 raft_consensus.cc:515] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:55.151103 21905 leader_election.cc:290] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:55.224691 16320 leader_election.cc:400] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 16 pre-election: Vote denied by peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073) with higher term. Message: Invalid argument: T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for earlier term 16. Current term is 17.
I20260709 13:07:55.277087 16320 leader_election.cc:403] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:55.267568 16322 leader_election.cc:400] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 election: Vote denied by peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823) with higher term. Message: Invalid argument: T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for earlier term 14. Current term is 15.
I20260709 13:07:55.239751 16202 raft_consensus.cc:2468] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 15.
I20260709 13:07:55.240209 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:55.279588 16275 raft_consensus.cc:3060] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:55.279711 21882 leader_election.cc:290] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:55.275665 21776 raft_consensus.cc:2749] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875) with higher term. Message: Invalid argument: T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for earlier term 14. Current term is 15.
I20260709 13:07:55.225781 21903 raft_consensus.cc:493] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:55.281215 21903 raft_consensus.cc:515] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:55.282861 21494 raft_consensus.cc:493] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:55.283439 21903 leader_election.cc:290] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:55.283470 21494 raft_consensus.cc:515] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:07:55.284309 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 59744us
I20260709 13:07:55.285187 21969 leader_election.cc:290] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:55.285763 21494 leader_election.cc:290] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:55.286422 21874 raft_consensus.cc:2749] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073) with higher term. Message: Invalid argument: T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for earlier term 16. Current term is 17.
W20260709 13:07:55.267246 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 50899.2us
I20260709 13:07:55.290125 16278 raft_consensus.cc:1275] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:07:55.285787 16320 leader_election.cc:304] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:55.238353 21788 raft_consensus.cc:3055] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:07:55.223869 21665 raft_consensus.cc:493] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:55.285795 21962 raft_consensus.cc:2749] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:55.228952 21894 leader_election.cc:290] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:55.250756 21919 leader_election.cc:290] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:55.270267 21898 raft_consensus.cc:740] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:07:55.306522 16322 leader_election.cc:304] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:55.201179 21974 consensus_queue.cc:260] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:55.300372 21890 raft_consensus.cc:2804] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:55.307696 21665 raft_consensus.cc:515] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:55.312686 21890 raft_consensus.cc:493] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:55.316126 21974 raft_consensus.cc:3060] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:55.318635 16322 leader_election.cc:304] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:07:55.299639 21788 raft_consensus.cc:740] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:07:55.325784 16322 leader_election.cc:304] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:55.222486 21953 consensus_queue.cc:260] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:55.326045 21890 raft_consensus.cc:3060] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:55.313014 21771 raft_consensus.cc:493] T 540bfc4ad793452faea5b865343aacf7 P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:55.335551 16322 leader_election.cc:304] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:55.339768 21788 consensus_queue.cc:260] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:55.340289 21922 raft_consensus.cc:2749] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:55.340627 21665 leader_election.cc:290] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:55.340981 21788 raft_consensus.cc:3060] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:55.342407 16322 leader_election.cc:304] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:55.343683 21903 raft_consensus.cc:2749] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:07:55.335314 21771 raft_consensus.cc:515] T 540bfc4ad793452faea5b865343aacf7 P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:55.338624 21725 leader_election.cc:290] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 13 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:55.338748 21776 raft_consensus.cc:2749] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:55.326400 21729 raft_consensus.cc:2749] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:07:55.335745 21888 consensus_meta.cc:287] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63: Time spent flushing consensus metadata: real 0.911s	user 0.012s	sys 0.000s
I20260709 13:07:55.288811 21981 raft_consensus.cc:515] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:55.347751 16322 leader_election.cc:304] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:55.348058 16275 raft_consensus.cc:2468] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 13.
I20260709 13:07:55.359378 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:55.371454 16274 raft_consensus.cc:2468] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 15.
I20260709 13:07:55.364467 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:07:55.369268 21854 consensus_meta.cc:287] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3: Time spent flushing consensus metadata: real 0.518s	user 0.013s	sys 0.000s
I20260709 13:07:55.369768 21888 raft_consensus.cc:515] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:55.376739 16280 raft_consensus.cc:2468] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 16.
I20260709 13:07:55.344571 21874 raft_consensus.cc:3060] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:55.378238 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:55.383123 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:55.385211 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:55.385692 16355 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41830 (request call id 2665) took 1160 ms. Trace:
I20260709 13:07:55.385932 16283 raft_consensus.cc:2468] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 10.
W20260709 13:07:55.388192 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 76779.5us
W20260709 13:07:55.388988 16349 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41830 (request call id 2657) took 1373 ms (client timeout 1607 ms). Trace:
I20260709 13:07:55.389552 16202 raft_consensus.cc:1275] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:07:55.386220 16355 rpcz_store.cc:276] 0709 13:07:54.214537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:54.231803 (+ 17266us) service_pool.cc:224] Handling call
0709 13:07:54.255587 (+ 23784us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:54.699500 (+443913us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:55.374904 (+675404us) spinlock_profiling.cc:243] Waited 443 ms on lock 0x7b5400194954. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f489e01 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6
0709 13:07:55.375149 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1019265920}
I20260709 13:07:55.392403 16205 raft_consensus.cc:1240] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
W20260709 13:07:55.389463 16349 rpcz_store.cc:269] 0709 13:07:54.008447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:54.008923 (+   476us) service_pool.cc:224] Handling call
0709 13:07:55.373215 (+1364292us) spinlock_profiling.cc:243] Waited 370 ms on lock 0x7b5400291dd4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:07:55.381384 (+  8169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":851422592}
I20260709 13:07:55.396072 16322 leader_election.cc:304] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:55.398787 16205 raft_consensus.cc:1275] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:07:55.402299 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:55.402731 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:55.384675 21987 consensus_queue.cc:1048] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.090s
I20260709 13:07:55.384624 21776 consensus_queue.cc:1048] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:07:55.407148 21903 raft_consensus.cc:2749] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:07:55.411026 21922 consensus_queue.cc:1048] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:55.417825 16944 raft_consensus.cc:2393] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 13: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
I20260709 13:07:55.418527 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:55.419179 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:55.419423 16205 raft_consensus.cc:3060] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:55.370417 21902 leader_election.cc:290] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:55.423753 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:55.421253 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:07:55.422339 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 319629us
I20260709 13:07:55.425499 16322 leader_election.cc:304] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:55.425506 16248 leader_election.cc:304] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:55.416973 16173 leader_election.cc:304] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:55.355842 21767 raft_consensus.cc:515] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:55.359181 21909 consensus_queue.cc:1048] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.068s
I20260709 13:07:55.451896 16914 leader_election.cc:304] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:07:55.387146 21667 raft_consensus.cc:2804] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:55.386785 21968 raft_consensus.cc:493] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:55.451488 16248 leader_election.cc:304] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:55.441231 16173 leader_election.cc:304] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:07:55.417894 21956 raft_consensus.cc:493] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.387390 21854 raft_consensus.cc:515] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:55.389298 21729 consensus_queue.cc:1048] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.058s
I20260709 13:07:55.445318 21974 raft_consensus.cc:493] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.427635 21776 consensus_queue.cc:1048] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 13:07:55.488422 16208 raft_consensus.cc:2393] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 13: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:07:55.447687 21894 raft_consensus.cc:2749] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:55.447893 21919 raft_consensus.cc:2804] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:07:55.490365 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 60691.2us
W20260709 13:07:55.489728 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 58962.6us
I20260709 13:07:55.418525 21869 consensus_queue.cc:1059] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
W20260709 13:07:55.464286 21881 consensus_meta.cc:287] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f: Time spent flushing consensus metadata: real 0.502s	user 0.010s	sys 0.000s
I20260709 13:07:55.505642 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:55.447538 21903 raft_consensus.cc:2804] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:55.417207 21890 raft_consensus.cc:515] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:07:55.493757 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 52668us
I20260709 13:07:55.494716 21982 consensus_queue.cc:1048] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 13:07:55.518149 21888 leader_election.cc:290] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 13 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:55.499132 16277 raft_consensus.cc:2393] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 11: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:07:55.459847 21985 raft_consensus.cc:493] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:55.520227 21985 raft_consensus.cc:515] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:55.513151 21903 raft_consensus.cc:493] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:55.521441 21903 raft_consensus.cc:3060] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:55.522948 16279 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45218 (request call id 2512) took 1068 ms. Trace:
I20260709 13:07:55.523429 16279 rpcz_store.cc:276] 0709 13:07:54.454359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:54.456926 (+  2567us) service_pool.cc:224] Handling call
0709 13:07:54.457228 (+   302us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:54.477336 (+ 20108us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:54.477367 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:54.477851 (+   484us) log.cc:844] Serialized 26 byte log entry
0709 13:07:55.287156 (+809305us) spinlock_profiling.cc:243] Waited 986 us on lock 0x7b480015c258. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f36243b2aa1 00007f36243a9b37 00007f36243a99ca 00007f36244a126f 00007f36244a0f37 00007f36244b555c 00007f36244b5508 00007f36244b5488 00007f36244b5443 00007f36244b46ec 00007f36233dea96
0709 13:07:55.393802 (+106646us) spinlock_profiling.cc:243] Waited 16.4 ms on lock 0x7b18004a40a0. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f3625264de1 00007f36252715b1 00007f361c37ee07 00007f36251d9ab9 00007f361c39b69b 00007f361c39993f 00007f361c39bc02 00007f361f02320b 00007f361f028d23 00007f361f0290d1 00007f361f444a0f
0709 13:07:55.455434 (+ 61632us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:07:55.455477 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:55.455546 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:55.522648 (+ 67102us) raft_consensus.cc:1685] finished
0709 13:07:55.522672 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:55.522846 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19728,"raft.queue_time_us":30552,"raft.run_cpu_time_us":29086,"raft.run_wall_time_us":796722,"spinlock_wait_cycles":39986688,"thread_start_us":61440,"threads_started":1,"wal-append.queue_time_us":1023304}
I20260709 13:07:55.525802 21953 raft_consensus.cc:3060] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:55.454084 21986 consensus_queue.cc:1048] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 13:07:55.514914 21881 raft_consensus.cc:515] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:55.530200 16202 raft_consensus.cc:2468] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 16.
I20260709 13:07:55.499795 21974 raft_consensus.cc:515] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:55.532042 21854 leader_election.cc:290] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:55.532596 21974 leader_election.cc:290] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:55.535046 21890 leader_election.cc:290] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:55.489221 21956 raft_consensus.cc:515] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:55.539109 21767 leader_election.cc:290] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 13 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:55.539816 16281 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45218 (request call id 2519) took 1072 ms. Trace:
I20260709 13:07:55.461606 21667 raft_consensus.cc:493] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:55.465193 21889 raft_consensus.cc:2804] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:55.454247 21902 consensus_queue.cc:1059] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 13:07:55.543740 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:55.544611 16203 raft_consensus.cc:3060] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:55.509066 16205 raft_consensus.cc:2468] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 17.
I20260709 13:07:55.540215 16281 rpcz_store.cc:276] 0709 13:07:54.467547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:54.967844 (+500297us) service_pool.cc:224] Handling call
0709 13:07:54.968206 (+   362us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:55.026241 (+ 58035us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:55.026300 (+    59us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:55.056534 (+ 30234us) log.cc:844] Serialized 26 byte log entry
0709 13:07:55.257883 (+201349us) spinlock_profiling.cc:243] Waited 1.92 ms on lock 0x7b1800364840. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f3625264de1 00007f36252715b1 00007f361c37ee07 00007f36251d9ab9 00007f361c39b69b 00007f361c39993f 00007f361c39bc02 00007f361f02320b 00007f361f028d23 00007f361f0290d1 00007f361f444a0f
0709 13:07:55.357429 (+ 99546us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:55.357474 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:55.357539 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:55.539494 (+181955us) raft_consensus.cc:1685] finished
0709 13:07:55.539514 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:55.539751 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":913,"raft.queue_time_us":107943,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":25916,"spinlock_wait_cycles":4410112,"thread_start_us":155775,"threads_started":2,"wal-append.queue_time_us":451166}
I20260709 13:07:55.546486 16246 leader_election.cc:304] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:55.548332 21902 raft_consensus.cc:3055] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:55.548744 21902 raft_consensus.cc:740] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:07:55.549541 21902 consensus_queue.cc:260] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:55.549577 21898 consensus_queue.cc:260] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:55.537750 21771 leader_election.cc:290] T 540bfc4ad793452faea5b865343aacf7 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:55.554479 21898 raft_consensus.cc:3060] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:55.505371 16946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:55.491350 21943 raft_consensus.cc:2804] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:07:55.555742 21943 raft_consensus.cc:493] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:55.555815 16946 raft_consensus.cc:2468] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 16.
I20260709 13:07:55.556250 21943 raft_consensus.cc:3060] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:55.557641 21985 leader_election.cc:290] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:55.491580 21916 raft_consensus.cc:2804] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:55.558789 21916 raft_consensus.cc:493] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:55.559250 21916 raft_consensus.cc:3060] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:55.559446 16945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:55.469674 21968 raft_consensus.cc:515] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:55.561403 16946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:55.540670 21956 leader_election.cc:290] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:55.562184 16946 raft_consensus.cc:2468] T 540bfc4ad793452faea5b865343aacf7 P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 15.
I20260709 13:07:55.510243 21981 leader_election.cc:290] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:55.513640 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:55.550679 21889 raft_consensus.cc:697] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 13 LEADER]: Becoming Leader. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:07:55.566038 21889 consensus_queue.cc:237] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:55.568003 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:55.568727 16283 raft_consensus.cc:2468] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 15.
I20260709 13:07:55.570072 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:55.571972 21903 raft_consensus.cc:515] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:55.573334 21881 leader_election.cc:290] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 16 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:55.575603 16944 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40078 (request call id 734) took 1186 ms. Trace:
I20260709 13:07:55.576109 16944 rpcz_store.cc:276] 0709 13:07:54.389196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:54.389718 (+   522us) service_pool.cc:224] Handling call
0709 13:07:55.575325 (+1185607us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b54005c0dd4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:07:55.575484 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2361614080}
I20260709 13:07:55.552297 21902 raft_consensus.cc:3060] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:55.546940 21667 raft_consensus.cc:3060] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:55.562827 21539 raft_consensus.cc:2804] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:07:55.509274 21955 consensus_queue.cc:1048] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.047s
W20260709 13:07:55.588218 16915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:55.588500 21903 leader_election.cc:290] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 10 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:55.513013 21919 raft_consensus.cc:697] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 17 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:07:55.590271 21919 consensus_queue.cc:237] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:55.562729 21968 leader_election.cc:290] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:07:55.579735 16246 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:55.579726 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:55.601395 16281 raft_consensus.cc:3060] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:55.581468 16949 raft_consensus.cc:1275] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:07:55.599112 21539 raft_consensus.cc:697] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:07:55.573904 21943 raft_consensus.cc:515] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:55.610708 16205 raft_consensus.cc:1275] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:07:55.613044 21943 leader_election.cc:290] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 19 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:55.611255 21956 raft_consensus.cc:493] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:55.610869 21539 consensus_queue.cc:237] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:55.614960 21956 raft_consensus.cc:515] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:55.617266 21956 leader_election.cc:290] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:55.617064 21916 raft_consensus.cc:515] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:55.619722 21916 leader_election.cc:290] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:55.620108 16246 leader_election.cc:304] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:55.620412 21916 consensus_queue.cc:1048] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:55.621248 21962 raft_consensus.cc:2804] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:55.626314 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:55.600601 16320 leader_election.cc:304] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:55.621754 21962 raft_consensus.cc:493] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:55.636251 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:55.637920 16281 raft_consensus.cc:2468] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 13.
I20260709 13:07:55.638681 16203 raft_consensus.cc:2468] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 11.
I20260709 13:07:55.505081 16322 leader_election.cc:304] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:55.642792 16914 leader_election.cc:304] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:07:55.666790 16201 raft_consensus.cc:1240] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:55.603076 21881 raft_consensus.cc:493] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
W20260709 13:07:55.675522 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 170512us
I20260709 13:07:55.675623 16246 leader_election.cc:304] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:55.653661 16200 raft_consensus.cc:1240] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 19 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 18. Current term is 19. Ops: []
I20260709 13:07:55.676608 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:55.676494 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:55.683314 16322 leader_election.cc:400] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 16 pre-election: Vote denied by peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823) with higher term. Message: Invalid argument: T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for earlier term 16. Current term is 17.
I20260709 13:07:55.639014 21893 raft_consensus.cc:493] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:55.683486 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 167134us
I20260709 13:07:55.653792 21981 raft_consensus.cc:493] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.638871 21962 raft_consensus.cc:3060] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:55.685384 16322 leader_election.cc:304] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:55.505784 21874 raft_consensus.cc:2749] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:55.690727 16203 raft_consensus.cc:1240] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:07:55.659440 21995 raft_consensus.cc:2804] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:07:55.675866 16248 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 1.607s (SENT) [suppressed 11 similar messages]
I20260709 13:07:55.699632 16173 leader_election.cc:304] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:55.701005 16173 leader_election.cc:304] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:55.698325 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:55.703639 16322 leader_election.cc:304] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:55.677220 21922 raft_consensus.cc:2749] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:07:55.750674 16247 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:55.685344 21955 raft_consensus.cc:2804] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:07:55.755263 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 58808.5us
I20260709 13:07:55.766884 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
W20260709 13:07:55.767765 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 66874.2us
I20260709 13:07:55.769057 16173 leader_election.cc:304] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:55.693367 21992 raft_consensus.cc:2804] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:55.692643 21956 raft_consensus.cc:493] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:55.755194 21882 raft_consensus.cc:2804] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:07:55.792455 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 88897.1us
I20260709 13:07:55.764544 21920 raft_consensus.cc:2749] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:55.692909 21909 consensus_queue.cc:1048] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.090s
I20260709 13:07:55.757915 21925 raft_consensus.cc:493] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:55.771281 21905 raft_consensus.cc:2804] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:55.693921 21893 raft_consensus.cc:515] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:55.780359 21955 raft_consensus.cc:697] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [term 13 LEADER]: Becoming Leader. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:07:55.801074 21905 raft_consensus.cc:493] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:55.815214 21905 raft_consensus.cc:3060] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:55.794708 21956 raft_consensus.cc:515] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:55.822664 21956 leader_election.cc:290] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:55.772078 21995 raft_consensus.cc:697] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 15 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:55.692162 21881 raft_consensus.cc:515] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:55.769176 21726 consensus_queue.cc:1059] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.032s
I20260709 13:07:55.701836 21981 raft_consensus.cc:515] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:07:55.844296 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 50768.9us
I20260709 13:07:55.786324 21882 raft_consensus.cc:493] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:55.860986 16322 leader_election.cc:304] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:55.852862 21920 consensus_queue.cc:1059] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:55.887660 21920 raft_consensus.cc:2749] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:55.888406 21920 raft_consensus.cc:3055] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:55.888775 21920 raft_consensus.cc:740] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:55.889576 21920 consensus_queue.cc:260] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:55.855460 21987 consensus_queue.cc:1059] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:55.891062 21987 raft_consensus.cc:3055] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:55.891469 21987 raft_consensus.cc:740] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:55.892462 21987 consensus_queue.cc:260] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:55.893852 21987 raft_consensus.cc:3060] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:55.895100 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:55.903208 16355 raft_consensus.cc:2468] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 15.
I20260709 13:07:55.784821 21968 raft_consensus.cc:2804] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:55.846815 21767 raft_consensus.cc:493] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:55.912441 21767 raft_consensus.cc:515] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:55.799605 21903 raft_consensus.cc:2749] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:55.850868 21995 consensus_queue.cc:237] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:55.916019 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:55.916692 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:55.866147 21882 raft_consensus.cc:3060] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:55.794979 21992 raft_consensus.cc:697] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:07:55.911713 16354 raft_consensus.cc:1275] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:07:55.924194 21992 consensus_queue.cc:237] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:55.915319 21667 raft_consensus.cc:515] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:55.881573 16202 raft_consensus.cc:2955] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index 6 to 10, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:07:55.932291 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:55.935034 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:55.940555 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:55.941210 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:55.941356 16350 raft_consensus.cc:2468] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 10.
I20260709 13:07:55.941476 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:07:55.942626 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 266768us
I20260709 13:07:55.945971 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:55.946631 16200 raft_consensus.cc:2468] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 11.
I20260709 13:07:55.946789 16348 raft_consensus.cc:2468] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 10.
I20260709 13:07:55.948599 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:55.956583 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:55.950166 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:55.937929 16357 raft_consensus.cc:2468] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 12.
I20260709 13:07:55.947801 16320 leader_election.cc:304] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:55.971799 16350 raft_consensus.cc:1275] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:07:55.972462 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:55.973071 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:55.973127 16357 raft_consensus.cc:3060] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:07:55.974689 16915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:55.976148 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:55.944732 16248 leader_election.cc:304] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:55.979848 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:55.840440 21925 raft_consensus.cc:515] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:55.984119 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:55.988643 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:55.988643 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:55.993021 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:55.908412 21957 raft_consensus.cc:493] T 4b962ceebb5c48c1914459ae0c0eff1b P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
W20260709 13:07:55.999951 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 229717us
I20260709 13:07:55.928390 21881 leader_election.cc:290] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:56.000600 16350 raft_consensus.cc:2393] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 10: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:07:55.908766 21968 raft_consensus.cc:493] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:55.981930 16949 raft_consensus.cc:2955] T 540bfc4ad793452faea5b865343aacf7 P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index 6 to 10, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:07:55.982314 21896 raft_consensus.cc:493] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:55.977209 21539 raft_consensus.cc:493] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.091440 16356 raft_consensus.cc:2410] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:07:56.093415 16354 raft_consensus.cc:1275] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
W20260709 13:07:56.093891 16320 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:56.157227 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:07:56.097352 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 152723us
I20260709 13:07:55.991338 21998 raft_consensus.cc:2804] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:55.977382 21544 raft_consensus.cc:493] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:56.108264 16281 raft_consensus.cc:1275] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 11. (term mismatch)
I20260709 13:07:56.162002 16281 pending_rounds.cc:85] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3: Aborting all ops after (but not including) 10
I20260709 13:07:56.161818 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:56.162271 16281 pending_rounds.cc:107] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3: Aborting uncommitted NO_OP operation due to leader change: 18.11
I20260709 13:07:56.162576 16281 raft_consensus.cc:2889] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:56.108906 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:56.087532 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:07:56.151108 16246 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:55.999265 21920 raft_consensus.cc:3060] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:07:56.154091 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 225378us
I20260709 13:07:56.159721 16248 leader_election.cc:304] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:56.161100 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:56.164004 16355 raft_consensus.cc:2468] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 15.
W20260709 13:07:56.176292 16320 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:56.180830 21968 raft_consensus.cc:3060] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:56.180962 16277 raft_consensus.cc:2410] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:07:56.188844 16351 raft_consensus.cc:1240] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 15 LEADER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:56.191337 16281 raft_consensus.cc:1240] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:07:56.118791 21578 raft_consensus.cc:493] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.191063 16280 raft_consensus.cc:2955] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index 6 to 10, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:07:56.201612 16283 raft_consensus.cc:1240] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:07:56.108031 21767 leader_election.cc:290] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:56.150473 21974 raft_consensus.cc:493] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.121045 21986 raft_consensus.cc:2749] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:56.216961 16354 raft_consensus.cc:1275] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:07:56.177613 21494 raft_consensus.cc:493] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.184650 21894 raft_consensus.cc:493] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.998049 21955 consensus_queue.cc:237] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:07:56.217895 22003 log.cc:927] Time spent T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:07:56.206045 21998 raft_consensus.cc:697] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 11 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:56.165330 21896 raft_consensus.cc:515] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:56.152726 21957 raft_consensus.cc:515] T 4b962ceebb5c48c1914459ae0c0eff1b P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:56.176987 21539 raft_consensus.cc:515] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:56.184494 21544 raft_consensus.cc:515] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:56.218453 21578 raft_consensus.cc:515] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:07:56.312341 16247 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:56.229118 21974 raft_consensus.cc:515] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:56.315203 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:56.318426 16281 raft_consensus.cc:2393] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 10: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:07:56.229580 21962 raft_consensus.cc:515] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:07:56.323678 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 227291us
I20260709 13:07:56.259435 21894 raft_consensus.cc:515] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:56.249574 21494 raft_consensus.cc:515] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:56.339648 21539 leader_election.cc:290] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:56.340365 21539 raft_consensus.cc:2749] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:56.343930 21896 leader_election.cc:290] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:56.344517 21957 leader_election.cc:290] T 4b962ceebb5c48c1914459ae0c0eff1b P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:56.345930 21998 consensus_queue.cc:237] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:56.347605 21894 leader_election.cc:290] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:56.352298 16348 raft_consensus.cc:2410] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:07:56.358747 21962 leader_election.cc:290] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 17 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:56.359923 21925 leader_election.cc:290] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:56.361771 21578 leader_election.cc:290] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:56.365140 21981 leader_election.cc:290] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:07:56.365979 22015 log.cc:927] Time spent T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 13:07:56.366928 21893 leader_election.cc:290] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:07:56.342322 22004 log.cc:927] Time spent T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63: Append to log took a long time: real 0.462s	user 0.003s	sys 0.000s
I20260709 13:07:56.384737 16357 raft_consensus.cc:2468] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 17.
I20260709 13:07:56.388218 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:56.389865 21544 leader_election.cc:290] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:56.390728 21494 leader_election.cc:290] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:56.391760 21917 raft_consensus.cc:3055] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:07:56.392283 21917 raft_consensus.cc:740] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:07:56.393344 21917 consensus_queue.cc:260] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:56.396183 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
W20260709 13:07:56.399847 21953 consensus_meta.cc:287] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f: Time spent flushing consensus metadata: real 0.873s	user 0.010s	sys 0.002s
I20260709 13:07:56.400976 21974 leader_election.cc:290] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:56.405012 16206 raft_consensus.cc:2393] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 18: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:07:56.354360 21667 leader_election.cc:290] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 18 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:07:56.412647 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 253260us
W20260709 13:07:56.433475 16279 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.016s	sys 0.006s
W20260709 13:07:56.436934 16279 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.016s	sys 0.006s
I20260709 13:07:56.471853 16353 raft_consensus.cc:2468] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 15.
I20260709 13:07:56.428136 21917 raft_consensus.cc:3060] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:07:56.468008 21905 consensus_meta.cc:287] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f: Time spent flushing consensus metadata: real 0.652s	user 0.011s	sys 0.000s
I20260709 13:07:56.492395 16283 raft_consensus.cc:1240] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 LEADER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:07:56.493929 16946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
W20260709 13:07:56.491001 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 289941us
I20260709 13:07:56.504900 16946 raft_consensus.cc:2468] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 16.
I20260709 13:07:56.507606 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:56.508325 16946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:07:56.511395 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:56.515012 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:56.515076 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:56.516228 16203 raft_consensus.cc:2468] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 11.
I20260709 13:07:56.517163 16945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:07:56.517975 16945 raft_consensus.cc:3060] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:56.518954 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:56.520402 16942 raft_consensus.cc:2410] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 13:07:56.523537 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:56.525166 16942 raft_consensus.cc:2468] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 17.
I20260709 13:07:56.416155 21974 consensus_queue.cc:1048] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.068s
I20260709 13:07:56.415185 21882 raft_consensus.cc:515] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:56.532851 21998 raft_consensus.cc:493] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.535679 16945 raft_consensus.cc:2468] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 17.
I20260709 13:07:56.459261 21960 consensus_queue.cc:1048] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.094s
I20260709 13:07:56.543660 16912 leader_election.cc:304] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:56.552219 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: true dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:56.553210 16357 raft_consensus.cc:3060] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:07:56.555248 16201 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.684s	user 0.014s	sys 0.005s
I20260709 13:07:56.555522 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:56.556931 16353 raft_consensus.cc:2410] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
W20260709 13:07:56.557488 16201 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.692s	user 0.014s	sys 0.005s
I20260709 13:07:56.558501 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:56.562064 16207 raft_consensus.cc:1240] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:56.564743 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:07:56.543947 22006 log.cc:927] Time spent T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 13:07:56.566812 16248 leader_election.cc:304] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:07:56.567328 16915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:56.569744 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:56.560555 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:56.570188 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:56.583554 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:56.584151 16357 raft_consensus.cc:2468] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 17.
I20260709 13:07:56.584438 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:56.585031 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:56.585052 16349 raft_consensus.cc:2468] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 15.
I20260709 13:07:56.586128 16203 raft_consensus.cc:2468] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 18.
I20260709 13:07:56.586853 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:56.587009 16205 raft_consensus.cc:2468] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 19.
I20260709 13:07:56.587476 16349 raft_consensus.cc:2468] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 18.
I20260709 13:07:56.593153 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:56.594566 16205 raft_consensus.cc:3060] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:56.599586 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:07:56.598361 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 62512us
I20260709 13:07:56.600589 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:56.601069 16206 raft_consensus.cc:1275] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:07:56.600720 16353 raft_consensus.cc:2393] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 13: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:07:56.601339 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:56.601727 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:56.531419 21905 raft_consensus.cc:515] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:56.604244 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:56.565771 22033 raft_consensus.cc:2804] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:56.601712 16173 leader_election.cc:304] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:56.564299 21902 raft_consensus.cc:493] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.622994 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:56.624257 16205 raft_consensus.cc:2468] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 17.
I20260709 13:07:56.549255 21998 raft_consensus.cc:515] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:56.627120 16943 raft_consensus.cc:1240] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 13 LEADER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:56.630475 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:56.633876 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:56.649821 21998 leader_election.cc:290] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:56.629129 16200 raft_consensus.cc:1240] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 16. Current term is 17. Ops: []
I20260709 13:07:56.652135 21882 leader_election.cc:290] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 16 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:56.630117 21902 raft_consensus.cc:515] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:56.623931 22033 raft_consensus.cc:493] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:56.628587 22001 raft_consensus.cc:2764] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Leader election decision vote started in defunct term 16: won
I20260709 13:07:56.666047 22033 raft_consensus.cc:3060] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:07:56.667284 22045 log.cc:927] Time spent T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.138s	user 0.002s	sys 0.002s
I20260709 13:07:56.669139 21902 leader_election.cc:290] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:07:56.670218 22035 log.cc:927] Time spent T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.163s	user 0.002s	sys 0.001s
I20260709 13:07:56.661947 16322 leader_election.cc:304] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:07:56.673789 22042 log.cc:927] Time spent T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
I20260709 13:07:56.674464 21987 raft_consensus.cc:2749] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:56.675586 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:56.690722 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
W20260709 13:07:56.680343 22025 log.cc:927] Time spent T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.186s	user 0.001s	sys 0.001s
I20260709 13:07:56.695111 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
W20260709 13:07:56.677681 22047 log.cc:927] Time spent T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.177s	user 0.000s	sys 0.003s
I20260709 13:07:56.701972 16945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:56.676430 16322 leader_election.cc:304] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:56.705917 16322 leader_election.cc:304] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:07:56.700811 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:07:56.679497 21905 leader_election.cc:290] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 17 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:56.715282 21909 raft_consensus.cc:2749] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:56.725152 16278 raft_consensus.cc:1240] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 12. Current term is 13. Ops: [12.12-12.12]
I20260709 13:07:56.677274 21968 raft_consensus.cc:515] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:56.711153 21998 raft_consensus.cc:2749] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:07:56.732270 16320 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:56.740370 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:56.742799 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
W20260709 13:07:56.787889 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 61685.9us
I20260709 13:07:56.789846 21968 leader_election.cc:290] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 11 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:07:56.801385 16320 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:56.801520 21957 consensus_queue.cc:1048] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:07:56.803818 22020 raft_consensus.cc:493] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:56.804641 22020 raft_consensus.cc:515] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:56.808012 22020 leader_election.cc:290] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:07:56.811082 16915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:56.805497 16914 leader_election.cc:304] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:07:56.805522 16204 raft_consensus.cc:1240] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:56.818825 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:56.819281 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:56.819631 16949 raft_consensus.cc:2468] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 7.
I20260709 13:07:56.820104 16283 raft_consensus.cc:2410] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for term 15 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:07:56.815734 16914 leader_election.cc:304] T 540bfc4ad793452faea5b865343aacf7 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:56.822110 16173 leader_election.cc:304] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:56.821528 22046 raft_consensus.cc:2804] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:07:56.823060 22034 log.cc:927] Time spent T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.326s	user 0.002s	sys 0.007s
I20260709 13:07:56.823367 22046 raft_consensus.cc:493] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:56.828359 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:56.826159 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:56.829025 16357 raft_consensus.cc:2468] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 14.
I20260709 13:07:56.827037 16173 leader_election.cc:304] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:56.827181 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:56.826499 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:56.829737 16914 leader_election.cc:304] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:56.833240 16357 raft_consensus.cc:1275] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:07:56.835253 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:56.835448 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:56.754123 21905 raft_consensus.cc:493] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.836624 16357 raft_consensus.cc:2468] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 18.
I20260709 13:07:56.838313 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:56.838959 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:56.845507 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:56.845768 16352 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece"
dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
mode: GRACEFUL
new_leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
 from {username='slave'} at 127.0.0.1:56792
I20260709 13:07:56.851094 16352 raft_consensus.cc:606] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 14 LEADER]: Received request to transfer leadership to TS e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:56.841274 16173 leader_election.cc:304] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:56.852322 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:56.853622 21771 raft_consensus.cc:2804] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:56.854128 21771 raft_consensus.cc:493] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:56.854633 21771 raft_consensus.cc:3060] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:56.857967 16173 leader_election.cc:304] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:56.869541 16354 raft_consensus.cc:1275] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:07:56.872210 16278 raft_consensus.cc:2468] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 18.
I20260709 13:07:56.837231 22046 raft_consensus.cc:3060] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:56.876741 16247 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:56.837855 21968 raft_consensus.cc:2749] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:56.874856 21882 raft_consensus.cc:2804] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:07:56.843330 21961 raft_consensus.cc:2749] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:56.886801 22031 raft_consensus.cc:493] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.898017 22026 raft_consensus.cc:493] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:56.844597 22027 raft_consensus.cc:2749] T 540bfc4ad793452faea5b865343aacf7 P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:56.890550 16204 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60154 (request call id 3162) took 1051 ms. Trace:
I20260709 13:07:56.868184 21953 raft_consensus.cc:2804] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:56.886948 16202 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60154 (request call id 3157) took 1204 ms. Trace:
I20260709 13:07:56.857491 22001 raft_consensus.cc:493] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:56.882476 22036 log.cc:927] Time spent T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.387s	user 0.002s	sys 0.007s
I20260709 13:07:56.901225 16204 rpcz_store.cc:276] 0709 13:07:55.839313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:55.840229 (+   916us) service_pool.cc:224] Handling call
0709 13:07:55.866334 (+ 26105us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:56.815695 (+949361us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:56.890330 (+ 74635us) spinlock_profiling.cc:243] Waited 939 ms on lock 0x7b5400238054. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f489e01 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6
0709 13:07:56.890493 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2159454080}
I20260709 13:07:56.907712 16202 rpcz_store.cc:276] 0709 13:07:55.682612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:55.682796 (+   184us) service_pool.cc:224] Handling call
0709 13:07:55.684158 (+  1362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:55.881399 (+197241us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:07:56.168296 (+286897us) log.cc:844] Serialized 14 byte log entry
0709 13:07:56.526899 (+358603us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:56.527070 (+   171us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:56.527120 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:56.886599 (+359479us) spinlock_profiling.cc:243] Waited 197 ms on lock 0x7b54003d1b54. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f489e01 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6
0709 13:07:56.886677 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:56.886862 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9445,"raft.queue_time_us":92,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":5015,"spinlock_wait_cycles":452900736,"thread_start_us":337361,"threads_started":1,"wal-append.queue_time_us":456200}
I20260709 13:07:56.889691 21882 raft_consensus.cc:493] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:56.858917 21905 raft_consensus.cc:515] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:56.906160 22026 raft_consensus.cc:515] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:56.910745 21544 raft_consensus.cc:493] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:56.899034 21992 raft_consensus.cc:493] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:56.885493 21771 raft_consensus.cc:515] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:56.898224 22031 raft_consensus.cc:515] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:56.916688 21969 raft_consensus.cc:493] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.934013 22026 leader_election.cc:290] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:56.951093 16946 raft_consensus.cc:2410] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for term 19 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 13:07:56.907487 21953 raft_consensus.cc:493] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:56.926676 21882 raft_consensus.cc:3060] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:56.957643 16207 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60154 (request call id 3165) took 1097 ms. Trace:
I20260709 13:07:56.931540 21986 raft_consensus.cc:2804] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:07:56.936539 21771 leader_election.cc:290] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 13 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:56.934013 21905 leader_election.cc:290] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:56.937119 21974 raft_consensus.cc:493] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.936995 22024 raft_consensus.cc:493] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:56.961308 16207 rpcz_store.cc:276] 0709 13:07:55.860085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:55.860486 (+   401us) service_pool.cc:224] Handling call
0709 13:07:55.877174 (+ 16688us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:56.562691 (+685517us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:56.957229 (+394538us) spinlock_profiling.cc:243] Waited 685 ms on lock 0x7b54003d1654. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f489e01 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6
0709 13:07:56.957546 (+   317us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1574474496}
I20260709 13:07:56.934360 21544 raft_consensus.cc:515] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:56.957283 21953 raft_consensus.cc:3060] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:56.967754 21974 raft_consensus.cc:515] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:56.940140 21705 consensus_queue.cc:1059] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:07:56.965732 16322 leader_election.cc:304] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:56.917223 22001 raft_consensus.cc:515] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:07:56.973815 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 173953us
I20260709 13:07:56.936580 21969 raft_consensus.cc:515] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:56.963156 21995 consensus_queue.cc:1048] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.017s
W20260709 13:07:56.988401 16246 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:56.990269 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:56.990653 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:07:56.980839 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 414093us
I20260709 13:07:56.991201 16280 raft_consensus.cc:2468] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 18.
I20260709 13:07:56.934748 21992 raft_consensus.cc:515] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:56.969846 21986 raft_consensus.cc:697] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:07:57.006754 21776 raft_consensus.cc:2749] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:56.992164 16248 leader_election.cc:304] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:57.008507 16248 leader_election.cc:304] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:57.009852 16248 leader_election.cc:304] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:57.010937 22028 raft_consensus.cc:2749] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:07:57.011180 22051 log.cc:927] Time spent T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.167s	user 0.001s	sys 0.000s
I20260709 13:07:57.011682 22028 raft_consensus.cc:2804] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:57.012059 22028 raft_consensus.cc:493] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:57.012293 22026 raft_consensus.cc:2749] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:07:57.012503 22028 raft_consensus.cc:3060] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:56.992628 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:56.992946 16322 leader_election.cc:304] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:56.993841 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:57.016397 16278 raft_consensus.cc:2368] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for earlier term 16. Current term is 17.
I20260709 13:07:57.019024 16248 leader_election.cc:304] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:57.022878 16248 leader_election.cc:304] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:57.045212 16248 leader_election.cc:304] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:56.963901 22033 raft_consensus.cc:515] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:56.995911 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:56.996776 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:57.052938 16283 raft_consensus.cc:3060] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:57.053216 16277 raft_consensus.cc:2393] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 13: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
W20260709 13:07:57.004693 22040 log.cc:927] Time spent T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63: Append to log took a long time: real 0.478s	user 0.004s	sys 0.005s
I20260709 13:07:57.034891 16322 leader_election.cc:304] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:57.004923 21544 leader_election.cc:290] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:57.021785 21916 raft_consensus.cc:2749] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:57.055362 21974 leader_election.cc:290] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:56.973368 22024 raft_consensus.cc:515] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:57.020295 21874 raft_consensus.cc:493] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:57.040809 21705 raft_consensus.cc:2749] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:57.066479 16943 raft_consensus.cc:2368] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for earlier term 11. Current term is 12.
W20260709 13:07:57.066965 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 129803us
I20260709 13:07:57.066810 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:57.065680 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:57.064792 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:57.068406 16278 raft_consensus.cc:2468] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 13.
I20260709 13:07:57.056046 22026 raft_consensus.cc:2749] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:57.072031 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:57.055905 21776 raft_consensus.cc:2749] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:57.072784 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:57.073487 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:57.078866 16275 raft_consensus.cc:2468] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 19.
W20260709 13:07:57.107640 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 46296us
I20260709 13:07:57.108803 16248 leader_election.cc:304] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:57.109778 16283 raft_consensus.cc:2468] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 19.
I20260709 13:07:57.113564 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:57.115428 16207 raft_consensus.cc:1275] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:07:57.117393 16204 raft_consensus.cc:1275] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:07:57.120563 16199 raft_consensus.cc:1275] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 19 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:07:57.114377 16200 raft_consensus.cc:2468] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 17.
I20260709 13:07:57.052793 21909 consensus_queue.cc:1059] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 13:07:57.006482 21986 consensus_queue.cc:237] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:57.124972 16248 leader_election.cc:304] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:57.064749 22055 raft_consensus.cc:2749] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:57.138402 16248 leader_election.cc:304] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:07:57.157255 21890 raft_consensus.cc:993] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e: : Instructing follower e10b16d536674c0bb350a31d7ce5ff7f to start an election
I20260709 13:07:57.122418 21962 consensus_queue.cc:1048] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 13:07:57.126798 21544 raft_consensus.cc:2749] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:07:57.134761 22054 raft_consensus.cc:493] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:57.180552 22055 raft_consensus.cc:493] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:57.174901 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:57.181133 22055 raft_consensus.cc:515] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:57.183585 22055 leader_election.cc:290] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:57.170254 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:57.180887 22054 raft_consensus.cc:515] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:57.188207 22054 leader_election.cc:290] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:57.198904 21890 raft_consensus.cc:1081] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 14 LEADER]: Signalling peer e10b16d536674c0bb350a31d7ce5ff7f to start an election
I20260709 13:07:57.199256 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:57.200565 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:57.067655 21874 raft_consensus.cc:515] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:57.205019 21874 leader_election.cc:290] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:57.198941 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:57.220912 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:57.220814 21882 raft_consensus.cc:515] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:57.221895 16942 raft_consensus.cc:2410] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for term 19 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 13:07:57.127010 22056 consensus_queue.cc:1059] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.104s
I20260709 13:07:57.223284 22056 raft_consensus.cc:3055] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:57.223671 22056 raft_consensus.cc:740] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:57.224339 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:57.224488 22056 consensus_queue.cc:260] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:57.225207 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:57.225795 16199 raft_consensus.cc:3060] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:57.225905 22056 raft_consensus.cc:3060] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:57.166978 21902 consensus_queue.cc:1048] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 13:07:57.167330 22043 raft_consensus.cc:2804] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:57.131151 21916 consensus_queue.cc:1048] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 13:07:57.179209 21969 leader_election.cc:290] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:07:57.242802 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 143925us
I20260709 13:07:57.179589 22024 leader_election.cc:290] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:57.180104 22057 raft_consensus.cc:493] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:57.201576 16280 raft_consensus.cc:2393] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 7: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:07:57.245590 16248 leader_election.cc:304] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:07:57.146747 22026 raft_consensus.cc:2749] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:57.180877 21544 raft_consensus.cc:493] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:57.244243 16322 leader_election.cc:304] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:57.256613 16248 leader_election.cc:304] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:07:57.257928 16945 raft_consensus.cc:1240] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [term 13 LEADER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:57.200656 22001 leader_election.cc:290] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:57.270103 16322 leader_election.cc:304] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:57.175941 22033 leader_election.cc:290] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 12 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:57.271531 16199 raft_consensus.cc:2468] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 12.
I20260709 13:07:57.273360 16278 raft_consensus.cc:1240] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:57.242802 22043 raft_consensus.cc:493] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:57.276551 16912 leader_election.cc:304] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:57.276684 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:57.278847 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:57.273138 22057 raft_consensus.cc:515] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:57.280406 22043 raft_consensus.cc:3060] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:57.266434 22024 raft_consensus.cc:2804] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:57.235754 22028 raft_consensus.cc:515] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:57.272744 21995 raft_consensus.cc:2749] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:57.275123 21667 raft_consensus.cc:2804] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:07:57.277434 22026 raft_consensus.cc:2804] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:07:57.295130 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
W20260709 13:07:57.292204 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 93873.5us
I20260709 13:07:57.295572 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:57.296085 16246 leader_election.cc:304] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:57.296957 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:57.298535 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:57.311875 16274 raft_consensus.cc:1240] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:57.306741 16348 raft_consensus.cc:1275] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:07:57.300510 16246 leader_election.cc:304] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:57.271126 21544 raft_consensus.cc:515] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:57.286958 22027 raft_consensus.cc:2804] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:57.319631 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: true dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:57.320000 16322 leader_election.cc:304] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:57.321950 16322 leader_election.cc:304] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:07:57.322948 21969 raft_consensus.cc:2804] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:07:57.323588 21969 raft_consensus.cc:493] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:57.324065 21969 raft_consensus.cc:3060] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:57.326877 21874 raft_consensus.cc:2749] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:57.287712 22024 raft_consensus.cc:493] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:57.333817 16322 leader_election.cc:304] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:57.320261 16356 raft_consensus.cc:2376] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 17. Re-sending same reply.
I20260709 13:07:57.299803 21882 leader_election.cc:290] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 19 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:57.327122 22064 consensus_queue.cc:1048] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:57.314272 22055 raft_consensus.cc:2804] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:07:57.343542 22024 raft_consensus.cc:3060] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:57.314682 22026 raft_consensus.cc:697] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:07:57.318821 21667 raft_consensus.cc:697] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 18 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:57.342993 21874 raft_consensus.cc:2749] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:57.358415 16914 leader_election.cc:304] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:07:57.344866 22027 raft_consensus.cc:697] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [term 12 LEADER]: Becoming Leader. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:07:57.372856 16914 leader_election.cc:304] T 4b962ceebb5c48c1914459ae0c0eff1b P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:57.355551 22055 raft_consensus.cc:493] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:57.380841 16914 leader_election.cc:304] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:57.380653 16280 raft_consensus.cc:1275] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 8. (term mismatch)
I20260709 13:07:57.392052 16280 pending_rounds.cc:85] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3: Aborting all ops after (but not including) 7
I20260709 13:07:57.392383 16280 pending_rounds.cc:107] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 13:07:57.392797 16280 raft_consensus.cc:2889] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:57.358892 21995 raft_consensus.cc:2749] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:57.404068 15057 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:07:57.369894 22057 leader_election.cc:290] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:57.412354 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:57.413162 16277 raft_consensus.cc:2468] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 7.
W20260709 13:07:57.415154 16915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:57.416491 22027 consensus_queue.cc:237] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:57.419226 21916 consensus_queue.cc:1048] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:57.379160 21953 raft_consensus.cc:515] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:57.422896 21667 consensus_queue.cc:237] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:07:57.423878 22046 consensus_meta.cc:287] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63: Time spent flushing consensus metadata: real 0.525s	user 0.011s	sys 0.000s
I20260709 13:07:57.424512 22046 raft_consensus.cc:515] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:57.426700 22057 raft_consensus.cc:493] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:57.427294 22057 raft_consensus.cc:515] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:57.427799 21544 leader_election.cc:290] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:57.428977 21992 leader_election.cc:290] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:57.429438 22057 leader_election.cc:290] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:57.429862 22026 consensus_queue.cc:237] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:57.432441 22028 leader_election.cc:290] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:57.403451 21971 raft_consensus.cc:2749] T 4b962ceebb5c48c1914459ae0c0eff1b P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:57.411984 21889 raft_consensus.cc:2749] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:57.438905 16949 raft_consensus.cc:1240] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:57.391299 21955 raft_consensus.cc:2804] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:57.402801 22055 raft_consensus.cc:3060] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:57.422376 21953 leader_election.cc:290] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 16 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:57.464830 22058 raft_consensus.cc:3055] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:57.465502 22058 raft_consensus.cc:740] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:57.471704 22031 leader_election.cc:290] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:57.476053 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:57.476411 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:57.477255 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:57.478411 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:57.478556 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:57.482012 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:57.482407 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:57.484234 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:57.484237 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:07:57.500168 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 182082us
I20260709 13:07:57.449393 21955 raft_consensus.cc:493] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:57.505633 16353 raft_consensus.cc:2468] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 13.
I20260709 13:07:57.508235 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:57.509770 16246 leader_election.cc:304] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:57.512465 16350 raft_consensus.cc:2468] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 13.
I20260709 13:07:57.505995 16355 raft_consensus.cc:2468] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 17.
W20260709 13:07:57.514405 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 155064us
I20260709 13:07:57.520257 16349 raft_consensus.cc:1275] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 8. (term mismatch)
I20260709 13:07:57.520697 16349 pending_rounds.cc:85] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e: Aborting all ops after (but not including) 7
I20260709 13:07:57.521001 16349 pending_rounds.cc:107] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 13:07:57.521248 16349 raft_consensus.cc:2889] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:57.531136 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:57.511637 21955 raft_consensus.cc:3060] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:57.533682 16914 leader_election.cc:304] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:57.538010 16322 leader_election.cc:304] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
W20260709 13:07:57.543045 22029 log.cc:927] Time spent T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 1.018s	user 0.007s	sys 0.015s
I20260709 13:07:57.550153 16246 leader_election.cc:304] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:57.510102 21960 raft_consensus.cc:493] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:57.515419 21986 raft_consensus.cc:493] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:57.517448 21953 raft_consensus.cc:493] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:57.553187 16914 leader_election.cc:304] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:57.547470 21896 raft_consensus.cc:2749] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:07:57.569507 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:57.528663 22046 leader_election.cc:290] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 11 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:57.629238 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:57.584772 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:57.630208 16203 raft_consensus.cc:2393] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 19: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:07:57.573185 16199 raft_consensus.cc:1240] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:57.574292 16208 raft_consensus.cc:1275] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 13:07:57.629102 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 76461.2us
W20260709 13:07:57.628018 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 74910.4us
I20260709 13:07:57.573566 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:57.572438 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:57.550936 21667 consensus_queue.cc:1048] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 13:07:57.639285 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:57.640477 16248 leader_election.cc:304] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:57.483096 22058 consensus_queue.cc:260] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:57.574700 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:57.663408 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:57.660614 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:57.666002 16275 raft_consensus.cc:1240] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 18. Current term is 19. Ops: []
I20260709 13:07:57.666769 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:57.668177 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:57.550640 22071 raft_consensus.cc:2749] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:57.674736 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:57.671604 16248 leader_election.cc:304] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:57.668804 16206 raft_consensus.cc:2468] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 12.
I20260709 13:07:57.676254 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:57.676823 16248 leader_election.cc:304] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:07:57.573194 22060 raft_consensus.cc:2804] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:57.685211 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:57.625706 22026 raft_consensus.cc:2749] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:57.686995 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f022e2e63ae4461d834e476ff2666991" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:57.629592 21971 raft_consensus.cc:2749] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:57.699487 16348 raft_consensus.cc:1275] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:07:57.673831 21882 raft_consensus.cc:493] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:57.571691 21960 raft_consensus.cc:515] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:57.700848 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:57.697988 16248 leader_election.cc:304] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:07:57.575311 21902 raft_consensus.cc:493] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:57.710484 16946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:57.626814 21986 raft_consensus.cc:515] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:57.710788 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f022e2e63ae4461d834e476ff2666991" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:57.714517 16246 leader_election.cc:304] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:57.678634 21962 raft_consensus.cc:2749] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:07:57.714756 16248 leader_election.cc:304] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:57.694747 22026 raft_consensus.cc:2804] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:57.693675 22060 raft_consensus.cc:493] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:57.703333 22058 raft_consensus.cc:3060] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:07:57.733043 16322 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:57.658421 21953 raft_consensus.cc:515] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:57.742359 16280 raft_consensus.cc:1275] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:07:57.680840 22068 consensus_queue.cc:1048] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.086s
I20260709 13:07:57.722153 22071 raft_consensus.cc:2804] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:57.746536 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:57.726150 21902 raft_consensus.cc:515] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:57.730026 22026 raft_consensus.cc:493] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:57.748695 21986 leader_election.cc:290] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:57.750191 22031 raft_consensus.cc:493] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:57.750877 21544 raft_consensus.cc:2749] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:57.733693 22060 raft_consensus.cc:3060] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:57.757936 21960 leader_election.cc:290] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:57.741142 21962 raft_consensus.cc:2749] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:07:57.757368 22072 log.cc:927] Time spent T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 13:07:57.762727 15057 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:57.741385 21969 raft_consensus.cc:515] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:57.717064 21882 raft_consensus.cc:515] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:57.809180 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:57.772364 16199 raft_consensus.cc:2468] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 8.
I20260709 13:07:57.810240 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:57.697876 22075 raft_consensus.cc:2749] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:57.762434 21920 raft_consensus.cc:3055] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:57.766489 16320 leader_election.cc:304] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:07:57.784330 21995 consensus_queue.cc:1048] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:57.820408 21969 leader_election.cc:290] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 20 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:57.785380 22056 consensus_queue.cc:1048] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:57.785992 22067 consensus_queue.cc:1048] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:07:57.786197 21953 leader_election.cc:290] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:57.787918 21998 raft_consensus.cc:493] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:57.788679 22061 consensus_queue.cc:1059] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:07:57.782020 21874 consensus_queue.cc:1059] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.008s
I20260709 13:07:57.793407 22026 raft_consensus.cc:3060] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:57.796075 22031 raft_consensus.cc:515] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:57.780159 22071 raft_consensus.cc:493] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:57.799697 21902 leader_election.cc:290] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:57.801673 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:57.807806 16946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:57.743180 22043 raft_consensus.cc:515] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:07:57.816051 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 101371us
I20260709 13:07:57.819461 16357 raft_consensus.cc:1240] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:07:57.815013 16173 leader_election.cc:304] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:57.821457 16279 raft_consensus.cc:1240] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 19. Current term is 20. Ops: [19.11-19.11]
I20260709 13:07:57.822311 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
W20260709 13:07:57.822845 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 56436.3us
I20260709 13:07:57.827867 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:57.828538 16205 raft_consensus.cc:2468] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 15.
W20260709 13:07:57.835239 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 117766us
I20260709 13:07:57.835446 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:57.814613 21920 raft_consensus.cc:740] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:57.865453 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:57.833695 21995 raft_consensus.cc:2804] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:57.870693 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:57.851529 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:57.859476 16201 raft_consensus.cc:1240] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:07:57.872128 16199 raft_consensus.cc:2468] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 8.
I20260709 13:07:57.897922 16914 leader_election.cc:304] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:57.850816 16208 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece"
dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
 from {username='slave'} at 127.0.0.1:60154
I20260709 13:07:57.828006 21962 raft_consensus.cc:493] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:57.868117 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:07:57.861646 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 147198us
I20260709 13:07:57.841357 22071 raft_consensus.cc:3060] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:57.863245 21953 raft_consensus.cc:2804] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:07:57.911571 16208 raft_consensus.cc:493] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:57.912504 22033 raft_consensus.cc:2749] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:57.870977 21995 raft_consensus.cc:493] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:57.836256 21998 raft_consensus.cc:515] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:57.919456 16208 raft_consensus.cc:3060] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:07:57.920413 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 200453us
I20260709 13:07:57.839594 21955 raft_consensus.cc:515] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:57.932866 22031 leader_election.cc:290] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:57.871366 22075 consensus_queue.cc:1048] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 13:07:57.937008 16246 leader_election.cc:304] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:57.957862 16246 leader_election.cc:304] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:57.923079 21953 raft_consensus.cc:493] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Starting leader election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:57.925252 21995 raft_consensus.cc:3060] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:57.964648 16246 leader_election.cc:304] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:57.970913 16946 raft_consensus.cc:1240] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:57.971104 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:57.973237 16208 raft_consensus.cc:515] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:57.974310 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
W20260709 13:07:57.959877 22024 consensus_meta.cc:287] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3: Time spent flushing consensus metadata: real 0.590s	user 0.012s	sys 0.001s
I20260709 13:07:57.977550 16246 leader_election.cc:304] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:57.919035 21962 raft_consensus.cc:515] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:57.974296 21953 raft_consensus.cc:3060] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:07:58.137414 16208 leader_election.cc:290] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 15 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:57.975843 21992 raft_consensus.cc:2749] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:57.978899 22057 raft_consensus.cc:2749] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:58.151463 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:58.118060 21983 raft_consensus.cc:493] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:57.967444 22092 raft_consensus.cc:2749] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:58.126859 22077 raft_consensus.cc:493] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:57.966133 22085 consensus_queue.cc:1059] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.209s
I20260709 13:07:58.322091 22102 raft_consensus.cc:2749] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:57.944365 21920 consensus_queue.cc:260] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:07:58.322937 22058 consensus_meta.cc:287] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 0.582s	user 0.011s	sys 0.000s
I20260709 13:07:58.124413 21969 consensus_queue.cc:1048] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 13:07:58.229315 22095 raft_consensus.cc:493] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:58.326975 22095 raft_consensus.cc:515] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:58.229584 16948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:58.328006 22071 raft_consensus.cc:515] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:58.231149 22056 raft_consensus.cc:493] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:58.233693 21955 leader_election.cc:290] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 15 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:07:58.235294 22096 log.cc:927] Time spent T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:07:58.329530 22095 leader_election.cc:290] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:58.329576 22056 raft_consensus.cc:515] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:58.333243 22056 leader_election.cc:290] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:58.236264 22043 leader_election.cc:290] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 election: Requested vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:58.333503 22071 leader_election.cc:290] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 18 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:58.335549 16949 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40078 (request call id 747) took 1169 ms. Trace:
I20260709 13:07:58.181550 21882 leader_election.cc:290] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:07:58.244824 22055 consensus_meta.cc:287] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3: Time spent flushing consensus metadata: real 0.789s	user 0.007s	sys 0.003s
I20260709 13:07:58.235374 21998 leader_election.cc:290] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:58.264730 16248 leader_election.cc:304] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
W20260709 13:07:58.251834 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 99307.7us
I20260709 13:07:58.278450 16945 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35122 (request call id 767) took 1552 ms. Trace:
I20260709 13:07:58.307372 16199 raft_consensus.cc:2468] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 11.
W20260709 13:07:58.313364 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 335862us
I20260709 13:07:58.316634 21983 raft_consensus.cc:515] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:58.317665 22077 raft_consensus.cc:515] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:58.324028 22085 raft_consensus.cc:3055] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:07:58.331108 16352 raft_consensus.cc:2410] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:07:58.339911 16945 rpcz_store.cc:276] 0709 13:07:56.711050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:56.724941 (+ 13891us) service_pool.cc:224] Handling call
0709 13:07:56.753874 (+ 28933us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:57.267741 (+513867us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:58.263072 (+995331us) spinlock_profiling.cc:243] Waited 504 ms on lock 0x7b54005c0dd4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f489e01 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6
0709 13:07:58.263332 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1158710016}
I20260709 13:07:58.343034 16246 leader_election.cc:304] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
W20260709 13:07:58.344105 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 79475.9us
I20260709 13:07:58.336016 16949 rpcz_store.cc:276] 0709 13:07:57.165871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:57.166051 (+   180us) service_pool.cc:224] Handling call
0709 13:07:57.166430 (+   379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:57.439568 (+273138us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:58.335301 (+895733us) spinlock_profiling.cc:243] Waited 272 ms on lock 0x7b540006b3d4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f489e01 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6
0709 13:07:58.335477 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":625953536}
I20260709 13:07:58.347501 16246 leader_election.cc:304] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:58.326327 22058 raft_consensus.cc:493] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:58.252645 21578 raft_consensus.cc:493] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:58.359330 21578 raft_consensus.cc:515] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:58.343127 22024 raft_consensus.cc:515] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:07:58.375778 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 399583us
I20260709 13:07:58.374676 16246 leader_election.cc:304] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:58.348237 22085 raft_consensus.cc:740] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:07:58.349287 21974 raft_consensus.cc:2749] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:58.378960 16173 leader_election.cc:400] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 16 election: Vote denied by peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823) with higher term. Message: Invalid argument: T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for earlier term 16. Current term is 17.
I20260709 13:07:58.380733 16173 leader_election.cc:304] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:58.380836 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:58.381811 16279 raft_consensus.cc:2468] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 13.
I20260709 13:07:58.352710 22057 raft_consensus.cc:2804] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:58.384234 16173 leader_election.cc:304] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:58.387113 16320 leader_election.cc:304] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:58.389106 16173 leader_election.cc:304] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:58.369863 21995 raft_consensus.cc:515] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:58.392427 22056 consensus_queue.cc:1059] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 13:07:58.388093 21882 raft_consensus.cc:2749] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:07:58.413295 22099 raft_consensus.cc:2804] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:58.394023 22085 consensus_queue.cc:260] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:58.413738 22099 raft_consensus.cc:493] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:58.413758 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:58.414064 21983 leader_election.cc:290] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:58.395004 22098 raft_consensus.cc:2804] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:58.396234 22077 leader_election.cc:290] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:07:58.397469 22026 consensus_meta.cc:287] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3: Time spent flushing consensus metadata: real 0.556s	user 0.007s	sys 0.004s
I20260709 13:07:58.345721 22055 raft_consensus.cc:515] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:58.376840 21992 raft_consensus.cc:2749] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:07:58.403199 16322 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:58.404242 16199 raft_consensus.cc:1275] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:07:58.458117 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:58.400379 21667 raft_consensus.cc:493] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:58.406334 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:58.408757 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:58.465076 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:58.465971 16199 raft_consensus.cc:2468] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 17.
I20260709 13:07:58.419576 22001 raft_consensus.cc:2749] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:07:58.385071 22071 raft_consensus.cc:2804] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:58.410811 16203 raft_consensus.cc:1275] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:07:58.472645 16203 raft_consensus.cc:1240] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:58.418160 21962 leader_election.cc:290] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:58.412094 22043 raft_consensus.cc:493] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:58.412812 22075 raft_consensus.cc:493] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:58.416658 16279 raft_consensus.cc:1275] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:07:58.419123 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:58.420722 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:58.422672 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:58.414350 22085 raft_consensus.cc:3060] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:58.425357 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:58.389575 22057 raft_consensus.cc:493] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:58.374182 22058 raft_consensus.cc:515] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:58.430866 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:58.431210 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:58.432658 22026 raft_consensus.cc:515] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:58.482903 16274 raft_consensus.cc:2393] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 19: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:07:58.483264 16205 raft_consensus.cc:1240] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 16. Current term is 17. Ops: []
I20260709 13:07:58.433048 22068 raft_consensus.cc:493] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:58.437507 22055 leader_election.cc:290] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 19 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:58.438876 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:58.439782 22056 raft_consensus.cc:3055] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:58.440739 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:58.417385 22098 raft_consensus.cc:493] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:58.455232 16349 raft_consensus.cc:1275] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 13:07:58.495119 16349 pending_rounds.cc:85] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e: Aborting all ops after (but not including) 10
I20260709 13:07:58.495404 16349 pending_rounds.cc:107] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:07:58.495693 16349 raft_consensus.cc:2889] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:58.414235 22099 raft_consensus.cc:3060] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:58.404872 16200 raft_consensus.cc:1240] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:58.463562 16354 raft_consensus.cc:2393] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 18: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:07:58.409215 16173 leader_election.cc:304] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
W20260709 13:07:58.497730 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 88602.6us
I20260709 13:07:58.465276 16202 raft_consensus.cc:2468] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 13.
W20260709 13:07:58.469725 22060 consensus_meta.cc:287] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 0.668s	user 0.012s	sys 0.002s
I20260709 13:07:58.486580 22057 raft_consensus.cc:3060] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:58.471207 22071 raft_consensus.cc:493] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:58.509332 22071 raft_consensus.cc:3060] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:58.493633 22056 raft_consensus.cc:740] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:58.511365 22056 consensus_queue.cc:260] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:58.512642 22056 raft_consensus.cc:3060] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:58.494658 21992 consensus_queue.cc:1059] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 13:07:58.498510 16173 leader_election.cc:304] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:58.515700 16173 leader_election.cc:304] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:58.516610 21882 raft_consensus.cc:2804] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:07:58.517058 21882 raft_consensus.cc:493] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 19 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:58.517462 21882 raft_consensus.cc:3060] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:58.518869 22101 raft_consensus.cc:2749] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:58.521552 21909 raft_consensus.cc:3055] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:07:58.522042 21909 raft_consensus.cc:740] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:58.527841 16173 leader_election.cc:304] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:07:58.528771 22101 raft_consensus.cc:2804] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:07:58.529313 22101 raft_consensus.cc:697] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 19 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:07:58.530272 22101 consensus_queue.cc:237] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:58.498325 22108 consensus_queue.cc:1059] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.033s
I20260709 13:07:58.498492 22098 raft_consensus.cc:3060] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:58.469172 21667 raft_consensus.cc:515] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:58.535915 21667 leader_election.cc:290] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:58.537135 21578 leader_election.cc:290] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:58.502338 22001 raft_consensus.cc:2749] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:58.539611 16946 raft_consensus.cc:1275] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 17 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:07:58.540181 21995 leader_election.cc:290] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 18 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:58.541132 16945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:07:58.500257 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:58.493391 22068 raft_consensus.cc:515] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:58.505231 22058 leader_election.cc:290] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:58.489800 21998 consensus_queue.cc:1059] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.018s
I20260709 13:07:58.542809 16281 raft_consensus.cc:2468] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 19.
I20260709 13:07:58.557454 16320 leader_election.cc:304] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:58.568962 16173 leader_election.cc:304] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:07:58.487983 22043 raft_consensus.cc:515] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:58.578223 16105 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38840 (request call id 207) took 7603 ms. Trace:
I20260709 13:07:58.496819 21962 consensus_queue.cc:1059] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.074s
I20260709 13:07:58.488168 22075 raft_consensus.cc:515] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:58.587023 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:58.589247 16202 raft_consensus.cc:3060] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:07:58.590718 16943 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35122 (request call id 766) took 1890 ms (client timeout 2176 ms). Trace:
I20260709 13:07:58.586424 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:58.586916 16914 leader_election.cc:304] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:07:58.576881 22103 raft_consensus.cc:2804] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:58.580765 21868 raft_consensus.cc:493] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:58.595947 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 138992us
I20260709 13:07:58.596222 16942 raft_consensus.cc:1240] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [term 12 LEADER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 11. Current term is 12. Ops: []
W20260709 13:07:58.591163 16943 rpcz_store.cc:269] 0709 13:07:56.700201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:56.700426 (+   225us) service_pool.cc:224] Handling call
0709 13:07:58.590454 (+1890028us) spinlock_profiling.cc:243] Waited 353 ms on lock 0x7b54005b3bd4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:07:58.590646 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":810776832}
I20260709 13:07:58.602870 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:58.562417 21995 consensus_queue.cc:1059] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:07:58.543320 22060 raft_consensus.cc:515] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:58.587563 21578 raft_consensus.cc:2749] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:58.608480 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:58.580224 16105 rpcz_store.cc:276] 0709 13:07:50.994648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:50.997011 (+  2363us) service_pool.cc:224] Handling call
0709 13:07:58.574238 (+7577227us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:53.117495 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:53.147257 (+ 29762us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:53.147296 (+    39us) write_op.cc:435] Acquired schema lock
0709 13:07:53.147337 (+    41us) tablet.cc:662] Decoding operations
0709 13:07:53.272360 (+125023us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:53.272424 (+    64us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:53.272449 (+    25us) tablet.cc:685] Acquiring locks for 29 operations
0709 13:07:53.297409 (+ 24960us) tablet.cc:701] Row locks acquired
0709 13:07:53.297426 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:07:53.297615 (+   189us) write_op.cc:270] Start()
0709 13:07:53.297754 (+   139us) write_op.cc:276] Timestamp: P: 1783602473297541 usec, L: 0
0709 13:07:53.297779 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:07:53.304319 (+  6540us) log.cc:844] Serialized 11527 byte log entry
0709 13:07:53.791544 (+487225us) op_driver.cc:464] REPLICATION: finished
0709 13:07:54.131869 (+340325us) write_op.cc:301] APPLY: starting
0709 13:07:54.138114 (+  6245us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:54.324683 (+186569us) spinlock_profiling.cc:243] Waited 20.4 ms on lock 0x7b5400137754. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48632a 00007f361f40bf14 00007f361f40bec3 00007f361f40be38 00007f361f40bdf3 00007f361f40b0dc 00007f361f434e16 00007f361f41ccbb 00007f361f40739d 00007f361f40ad75
0709 13:07:54.505136 (+180453us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:54.505179 (+    43us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:55.333224 (+828045us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:55.333589 (+   365us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=58,key_file_lookups=58,delta_file_lookups=58,mrs_lookups=0
0709 13:07:55.333639 (+    50us) write_op.cc:312] APPLY: finished
0709 13:07:55.334153 (+   514us) log.cc:844] Serialized 252 byte log entry
0709 13:07:55.455220 (+121067us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:55.491516 (+ 36296us) write_op.cc:454] Released schema lock
0709 13:07:55.500871 (+  9355us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:55.520301 (+ 19430us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:55.520332 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":77437,"reported_tablets":43,"child_traces":[["op",{"apply.queue_time_us":322469,"apply.run_cpu_time_us":69307,"apply.run_wall_time_us":1389497,"cfile_cache_hit":118,"cfile_cache_hit_bytes":125347,"num_ops":29,"prepare.queue_time_us":112106,"prepare.run_cpu_time_us":34252,"prepare.run_wall_time_us":303317,"raft.queue_time_us":72069,"raft.run_cpu_time_us":70067,"raft.run_wall_time_us":587509,"replication_time_us":468016,"spinlock_wait_cycles":46940416,"thread_start_us":487032,"threads_started":5,"wal-append.queue_time_us":415427,"wal-append.run_cpu_time_us":25083,"wal-append.run_wall_time_us":2155803}]]}
I20260709 13:07:58.603157 22101 raft_consensus.cc:493] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:58.610827 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:58.644858 16353 raft_consensus.cc:3060] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:58.612695 16283 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45210 (request call id 2669) took 1219 ms. Trace:
I20260709 13:07:58.602761 22103 raft_consensus.cc:493] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:58.570395 22055 consensus_queue.cc:1048] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.029s
I20260709 13:07:58.577453 22077 consensus_queue.cc:1059] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:07:58.616358 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:07:58.604051 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:58.616676 22110 consensus_queue.cc:1048] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.011s
I20260709 13:07:58.618657 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:58.606897 21868 raft_consensus.cc:515] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:58.655689 21882 raft_consensus.cc:515] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:58.620831 16281 consensus_queue.cc:237] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:58.618738 21955 raft_consensus.cc:2804] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:07:58.588910 22033 raft_consensus.cc:493] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.695878 21955 raft_consensus.cc:493] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:58.696462 21955 raft_consensus.cc:3060] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:58.570394 22038 consensus_queue.cc:1059] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:07:58.697340 22038 raft_consensus.cc:3055] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:58.697744 22038 raft_consensus.cc:740] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:07:58.698629 22038 consensus_queue.cc:260] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:58.699929 22038 raft_consensus.cc:3060] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:58.702382 22028 raft_consensus.cc:3055] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:58.702946 22028 raft_consensus.cc:740] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:07:58.704243 21578 raft_consensus.cc:3055] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:58.704141 22028 consensus_queue.cc:260] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:58.658201 21868 leader_election.cc:290] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:58.704764 21578 raft_consensus.cc:740] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:07:58.658711 16943 raft_consensus.cc:3060] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:07:58.620958 16321 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:58.705925 16942 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35122 (request call id 768) took 1329 ms. Trace:
I20260709 13:07:58.645825 16283 rpcz_store.cc:276] 0709 13:07:57.393320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:57.393454 (+   134us) service_pool.cc:224] Handling call
0709 13:07:57.393752 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:57.393952 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:07:58.536019 (+1142067us) spinlock_profiling.cc:243] Waited 15.4 ms on lock 0x7b18000af7e0. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f3625264de1 00007f36252715b1 00007f361f0314bc 00007f361c37f48b 00007f36251d9ab9 00007f361c39b69b 00007f361c39993f 00007f361c399455 00007f3622e813c7 00007f361f4939a7 00007f361f4a30bf
0709 13:07:58.536164 (+   145us) log.cc:844] Serialized 14 byte log entry
0709 13:07:58.611943 (+ 75779us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:58.612068 (+   125us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:07:58.612152 (+    84us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:58.612302 (+   150us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:58.612564 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":18961,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":65,"raft.queue_time_us":176,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":85,"spinlock_wait_cycles":35434880,"thread_start_us":120802,"threads_started":2}
I20260709 13:07:58.661067 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:58.649873 16202 raft_consensus.cc:2468] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 18.
I20260709 13:07:58.668959 22099 raft_consensus.cc:515] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:58.670805 22068 leader_election.cc:290] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:58.672971 22026 leader_election.cc:290] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:58.674710 21874 raft_consensus.cc:3055] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:07:58.666162 16276 raft_consensus.cc:2468] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 16.
I20260709 13:07:58.682348 16350 raft_consensus.cc:2368] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 8. Current term is 9.
I20260709 13:07:58.639506 22024 leader_election.cc:290] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 18 election: Requested vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:58.612789 21992 raft_consensus.cc:493] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:58.694525 21909 consensus_queue.cc:260] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:58.649807 22101 raft_consensus.cc:515] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:58.696089 22033 raft_consensus.cc:515] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:07:58.704650 22114 log.cc:927] Time spent T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:07:58.661646 21953 raft_consensus.cc:515] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:58.707993 16274 raft_consensus.cc:2393] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 in current term 18: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
W20260709 13:07:58.663915 16248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:58.708855 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:58.709954 16320 leader_election.cc:304] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
W20260709 13:07:58.753875 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 44011.2us
I20260709 13:07:58.707198 16942 rpcz_store.cc:276] 0709 13:07:57.376982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:57.377231 (+   249us) service_pool.cc:224] Handling call
0709 13:07:58.595993 (+1218762us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:58.601275 (+  5282us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:58.705659 (+104384us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b54005b3bd0. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f4888ad 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:07:58.705856 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2728861952}
I20260709 13:07:58.704506 21920 raft_consensus.cc:3060] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:58.712462 16206 raft_consensus.cc:1240] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 19 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 18. Current term is 19. Ops: []
I20260709 13:07:58.651667 22103 raft_consensus.cc:3060] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:58.717303 16353 raft_consensus.cc:2468] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 18.
I20260709 13:07:58.712180 22085 raft_consensus.cc:493] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:58.720597 16348 raft_consensus.cc:1240] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:07:58.763367 16943 raft_consensus.cc:2468] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 18.
I20260709 13:07:58.765655 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
W20260709 13:07:58.722537 22088 log.cc:927] Time spent T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63: Append to log took a long time: real 0.592s	user 0.004s	sys 0.000s
I20260709 13:07:58.772671 22057 raft_consensus.cc:515] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:58.705924 21578 consensus_queue.cc:260] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:07:58.730768 16350 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41830 (request call id 2702) took 1162 ms (client timeout 1508 ms). Trace:
I20260709 13:07:58.721836 22099 leader_election.cc:290] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 12 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:07:58.746719 16247 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:58.747751 16356 raft_consensus.cc:1240] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 17. Current term is 18. Ops: []
I20260709 13:07:58.768697 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:58.729375 21992 raft_consensus.cc:515] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:58.768885 22085 raft_consensus.cc:515] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:07:58.729809 22113 log.cc:927] Time spent T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 13:07:58.770043 21882 leader_election.cc:290] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 20 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:58.753666 22024 raft_consensus.cc:493] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:58.761793 22055 raft_consensus.cc:493] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:58.727934 22071 raft_consensus.cc:515] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:58.728438 21874 raft_consensus.cc:740] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:58.848977 16278 raft_consensus.cc:2468] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 8.
I20260709 13:07:58.613262 22089 consensus_queue.cc:1048] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.100s
I20260709 13:07:58.815909 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:58.830251 21916 raft_consensus.cc:3055] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:58.849706 16946 raft_consensus.cc:1275] T 4b962ceebb5c48c1914459ae0c0eff1b P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:07:58.733289 21909 raft_consensus.cc:3060] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:58.819134 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:58.754491 21953 leader_election.cc:290] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:58.853590 16357 raft_consensus.cc:3060] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:58.820612 15057 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:58.742041 22101 leader_election.cc:290] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:07:58.808501 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 239631us
I20260709 13:07:58.825392 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:58.855878 16351 raft_consensus.cc:3060] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:07:58.829932 21992 leader_election.cc:290] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:58.832306 22085 leader_election.cc:290] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:58.724375 22098 raft_consensus.cc:515] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:58.728950 22075 leader_election.cc:290] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:58.747740 22028 raft_consensus.cc:3060] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:58.845436 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:58.819293 22038 raft_consensus.cc:493] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.766439 22033 leader_election.cc:290] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:58.820814 22108 consensus_queue.cc:1059] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 13:07:58.855332 21916 raft_consensus.cc:740] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:07:58.825836 21998 raft_consensus.cc:2804] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:07:58.872862 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 44970.1us
I20260709 13:07:58.857374 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:58.848874 22071 leader_election.cc:290] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:07:58.841336 16350 rpcz_store.cc:269] 0709 13:07:57.568168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:57.568312 (+   144us) service_pool.cc:224] Handling call
0709 13:07:58.730495 (+1162183us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b5400268c54. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:07:58.730707 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2404823808}
I20260709 13:07:58.886097 16357 raft_consensus.cc:2468] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 14.
I20260709 13:07:58.883582 16173 leader_election.cc:304] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:58.895992 16173 leader_election.cc:304] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:58.837752 22099 consensus_queue.cc:1059] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 13:07:58.834344 22024 raft_consensus.cc:515] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:58.846630 21578 raft_consensus.cc:3060] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:58.904014 16173 leader_election.cc:304] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:58.854923 22055 raft_consensus.cc:515] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:58.908293 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
W20260709 13:07:58.912358 16914 leader_election.cc:336] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 2.045s (SENT)
I20260709 13:07:58.842841 22103 raft_consensus.cc:515] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:58.859094 22026 consensus_queue.cc:1048] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 13:07:58.892458 22043 leader_election.cc:290] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:58.898134 21953 raft_consensus.cc:2749] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:07:58.897819 22075 raft_consensus.cc:493] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:58.903589 22077 raft_consensus.cc:2749] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:58.884634 22038 raft_consensus.cc:515] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:58.914988 22109 raft_consensus.cc:3055] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:07:58.921731 22071 raft_consensus.cc:493] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.918454 21998 raft_consensus.cc:697] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 18 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
W20260709 13:07:58.976634 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 74769.4us
I20260709 13:07:58.916679 21882 consensus_queue.cc:1048] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.055s
I20260709 13:07:58.972685 21953 raft_consensus.cc:2749] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:07:58.994182 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:58.995260 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:58.998116 16274 raft_consensus.cc:2368] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for earlier term 17. Current term is 18.
I20260709 13:07:58.998217 16283 raft_consensus.cc:2468] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 17.
W20260709 13:07:58.995573 16247 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:58.904264 21874 consensus_queue.cc:260] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:07:59.004012 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:59.004624 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:58.972808 22109 raft_consensus.cc:740] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:58.942493 22075 raft_consensus.cc:515] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:58.989892 22089 raft_consensus.cc:493] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.012261 16274 raft_consensus.cc:1240] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 18. Current term is 19. Ops: []
I20260709 13:07:59.014814 16248 leader_election.cc:304] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:58.976161 22071 raft_consensus.cc:515] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:59.016588 16248 leader_election.cc:304] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:07:58.973632 21916 consensus_queue.cc:260] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:07:59.026183 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 122293us
I20260709 13:07:59.010120 21874 raft_consensus.cc:3060] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:59.027910 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:59.028309 16173 leader_election.cc:304] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:59.029075 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:59.031034 16283 raft_consensus.cc:2468] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 14.
I20260709 13:07:59.031313 16274 raft_consensus.cc:2468] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 18.
I20260709 13:07:59.009498 22094 raft_consensus.cc:493] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:59.019923 22043 raft_consensus.cc:2749] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:07:59.016640 22108 raft_consensus.cc:493] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:59.058903 22108 raft_consensus.cc:515] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:59.061899 22108 leader_election.cc:290] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:59.065431 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:59.066134 16355 raft_consensus.cc:2468] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 11.
I20260709 13:07:59.067206 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:59.068125 22075 leader_election.cc:290] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:59.069129 16282 raft_consensus.cc:1240] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:59.069667 21916 raft_consensus.cc:3060] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:59.029835 22068 raft_consensus.cc:2804] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:07:59.075469 22068 raft_consensus.cc:697] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:07:59.076431 22068 consensus_queue.cc:237] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:07:59.082696 22120 log.cc:927] Time spent T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.138s	user 0.000s	sys 0.001s
I20260709 13:07:59.085543 22038 leader_election.cc:290] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:07:59.086777 22126 log.cc:927] Time spent T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
W20260709 13:07:59.089475 22121 log.cc:927] Time spent T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 13:07:59.095269 22031 raft_consensus.cc:3055] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:59.090306 16207 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60138 (request call id 2951) took 1422 ms. Trace:
I20260709 13:07:59.095842 22031 raft_consensus.cc:740] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:59.096963 22031 consensus_queue.cc:260] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:59.096133 16207 rpcz_store.cc:276] 0709 13:07:57.668149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:57.669032 (+   883us) service_pool.cc:224] Handling call
0709 13:07:57.669385 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:57.669580 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:07:57.860539 (+190959us) log.cc:844] Serialized 14 byte log entry
0709 13:07:59.089152 (+1228613us) spinlock_profiling.cc:243] Waited 133 ms on lock 0x7b18004b8380. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f3625264de1 00007f36252715b1 00007f361f0314bc 00007f361c37f48b 00007f36251d9ab9 00007f361c39b69b 00007f361c39993f 00007f361c399455 00007f361f481060 00007f361f493716 00007f361f4a4287
0709 13:07:59.089609 (+   457us) log.cc:844] Serialized 14 byte log entry
0709 13:07:59.089855 (+   246us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:59.089913 (+    58us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:59.089977 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:59.090067 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:59.090230 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":196252,"prepare.run_cpu_time_us":88,"prepare.run_wall_time_us":90,"raft.queue_time_us":42530,"raft.run_cpu_time_us":251,"raft.run_wall_time_us":12087,"spinlock_wait_cycles":306884864,"thread_start_us":276743,"threads_started":3,"wal-append.queue_time_us":263420}
I20260709 13:07:59.040720 16173 leader_election.cc:304] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:59.038448 21953 raft_consensus.cc:2749] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 13:07:59.034891 21902 consensus_queue.cc:1175] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "363bb2f744eb486f9ad726f08214c98e" responder_term: 10 status { last_received { term: 10 index: 8 } last_committed_idx: 8 last_received_current_leader { term: 10 index: 8 } }
I20260709 13:07:59.041342 22061 raft_consensus.cc:493] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:59.122829 22061 raft_consensus.cc:515] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:59.125063 22061 leader_election.cc:290] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:59.053642 16351 raft_consensus.cc:2468] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 18.
I20260709 13:07:59.028651 22057 leader_election.cc:290] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:59.125422 16945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:59.127446 16946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:07:59.054674 21955 raft_consensus.cc:515] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:59.130414 21955 leader_election.cc:290] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 20 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:07:59.104496 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 63815.3us
I20260709 13:07:59.039563 16248 leader_election.cc:304] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
W20260709 13:07:59.132565 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 93079.9us
I20260709 13:07:59.133406 16248 leader_election.cc:400] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107) with higher term. Message: Invalid argument: T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 8. Current term is 9.
I20260709 13:07:59.133333 16173 leader_election.cc:304] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:59.134316 21953 raft_consensus.cc:2749] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:59.134745 22057 raft_consensus.cc:2804] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:59.135361 22057 raft_consensus.cc:697] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:07:59.136276 22057 consensus_queue.cc:237] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:59.137375 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:59.037916 21998 consensus_queue.cc:237] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:59.140280 16943 raft_consensus.cc:1240] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:59.141717 16207 raft_consensus.cc:1275] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:07:59.039413 22094 raft_consensus.cc:515] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:59.143867 22094 leader_election.cc:290] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:59.145509 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:59.146472 16199 raft_consensus.cc:2393] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 19: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:07:59.148168 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:59.148876 16207 raft_consensus.cc:2468] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 17.
I20260709 13:07:59.149727 22055 leader_election.cc:290] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:59.150786 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:59.151110 22024 leader_election.cc:290] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:59.151583 16204 raft_consensus.cc:2393] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 11: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:07:59.153326 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:59.154052 16204 raft_consensus.cc:3060] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:59.154963 16354 raft_consensus.cc:2468] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 17.
I20260709 13:07:59.108788 22109 consensus_queue.cc:260] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:59.157472 22060 leader_election.cc:290] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:59.157655 22109 raft_consensus.cc:3060] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:59.158941 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:59.160082 16207 raft_consensus.cc:2393] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 17: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:07:59.162117 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:59.163934 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:59.111004 21960 raft_consensus.cc:2749] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:59.112103 22027 consensus_queue.cc:1048] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:07:59.113788 16914 leader_election.cc:304] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:59.116964 22071 leader_election.cc:290] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:59.166904 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:59.168550 16202 raft_consensus.cc:1240] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:59.119179 22103 leader_election.cc:290] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:59.119623 22098 leader_election.cc:290] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 13 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:07:59.007853 22100 consensus_queue.cc:1175] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "0aea40d6e4374085a2e38a70a71f63e3" responder_term: 15 status { last_received { term: 15 index: 12 } last_committed_idx: 12 last_received_current_leader { term: 15 index: 12 } }
W20260709 13:07:59.181614 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 67940.8us
I20260709 13:07:59.184787 21896 raft_consensus.cc:2749] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:07:59.184973 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:07:59.109998 16321 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:59.165221 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:59.187009 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:59.187714 16203 raft_consensus.cc:2468] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 11.
I20260709 13:07:59.166338 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:59.017041 22089 raft_consensus.cc:515] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:59.169525 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:59.169533 16246 leader_election.cc:304] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:59.170883 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:59.171597 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:59.190407 16246 leader_election.cc:304] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:59.197264 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:59.174190 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:59.200820 16945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:07:59.167047 22027 consensus_queue.cc:1243] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Peer 363bb2f744eb486f9ad726f08214c98e log is divergent from this leader: its last log entry 12.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:07:59.165302 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:59.190327 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:59.211956 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:59.198755 16246 leader_election.cc:304] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:07:59.201193 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 176739us
I20260709 13:07:59.205765 16173 leader_election.cc:304] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:59.215704 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:59.207008 16275 raft_consensus.cc:3060] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:59.181274 22031 raft_consensus.cc:3060] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:59.207808 16202 raft_consensus.cc:1240] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 20 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 19. Current term is 20. Ops: []
I20260709 13:07:59.180702 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:59.217610 16208 raft_consensus.cc:3060] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:59.173970 16204 raft_consensus.cc:2468] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 14.
I20260709 13:07:59.216481 16207 raft_consensus.cc:2393] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 16: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:07:59.219614 21995 raft_consensus.cc:493] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.221541 16173 leader_election.cc:304] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:59.222007 16248 leader_election.cc:304] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:07:59.223045 16349 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33486 (request call id 871) took 1655 ms. Trace:
I20260709 13:07:59.223429 16349 rpcz_store.cc:276] 0709 13:07:57.567413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:57.625018 (+ 57605us) service_pool.cc:224] Handling call
0709 13:07:58.454851 (+829833us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:58.496236 (+ 41385us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:59.222867 (+726631us) spinlock_profiling.cc:243] Waited 829 ms on lock 0x7b540032ad50. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f4888ad 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:07:59.222990 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1907273088}
I20260709 13:07:59.224628 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:59.225396 16356 raft_consensus.cc:1275] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 13:07:59.225929 16356 pending_rounds.cc:85] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e: Aborting all ops after (but not including) 9
I20260709 13:07:59.226243 16356 pending_rounds.cc:107] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 13:07:59.226529 16356 raft_consensus.cc:2889] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:59.228516 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:59.229724 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:59.227833 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:59.236842 16352 raft_consensus.cc:2393] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 in current term 18: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:07:59.197788 22024 raft_consensus.cc:2749] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:07:59.239890 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:59.240171 16356 raft_consensus.cc:1275] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:07:59.236240 16320 leader_election.cc:304] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:59.242861 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:59.243854 16355 raft_consensus.cc:2368] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 8. Current term is 9.
I20260709 13:07:59.245816 21920 raft_consensus.cc:2804] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:59.246268 21920 raft_consensus.cc:493] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:59.246417 21962 raft_consensus.cc:2804] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:07:59.246778 21920 raft_consensus.cc:3060] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:59.202423 22055 raft_consensus.cc:2804] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:59.255286 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:59.255997 16348 raft_consensus.cc:2468] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 10.
I20260709 13:07:59.252779 16201 raft_consensus.cc:2468] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 8.
I20260709 13:07:59.252979 16208 raft_consensus.cc:2468] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 14.
I20260709 13:07:59.252636 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:59.269713 16275 raft_consensus.cc:2468] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 15.
I20260709 13:07:59.220160 21995 raft_consensus.cc:515] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:59.292899 21995 leader_election.cc:290] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:59.272478 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:59.293753 16348 raft_consensus.cc:2468] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 14.
I20260709 13:07:59.274082 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:59.260393 16320 leader_election.cc:304] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:07:59.261140 16356 raft_consensus.cc:2468] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 16.
I20260709 13:07:59.276665 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:59.296106 16282 raft_consensus.cc:3060] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:59.296797 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:59.277455 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:59.277609 16945 raft_consensus.cc:2468] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 7.
I20260709 13:07:59.278153 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:07:59.279189 16278 raft_consensus.cc:1240] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 19. Current term is 20. Ops: [19.11-19.11]
I20260709 13:07:59.224758 22043 raft_consensus.cc:2749] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:59.238260 21960 raft_consensus.cc:2804] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:07:59.274145 16248 leader_election.cc:304] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:07:59.287988 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:59.399928 21960 raft_consensus.cc:697] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 16 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:07:59.288383 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:59.400925 16208 raft_consensus.cc:2468] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 10.
I20260709 13:07:59.199589 22071 consensus_queue.cc:1048] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.057s
I20260709 13:07:59.401052 21960 consensus_queue.cc:237] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:59.406654 22089 leader_election.cc:290] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:07:59.407493 22075 raft_consensus.cc:2804] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:59.408021 22075 raft_consensus.cc:493] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:59.408432 22075 raft_consensus.cc:3060] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:59.221537 22026 consensus_queue.cc:1048] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.062s
W20260709 13:07:59.414721 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 154438us
W20260709 13:07:59.415800 16320 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:59.416810 22067 raft_consensus.cc:2804] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:59.417398 22067 raft_consensus.cc:697] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 14 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
W20260709 13:07:59.424993 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:59.426721 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 68915us
I20260709 13:07:59.426888 22133 raft_consensus.cc:493] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.427626 16322 leader_election.cc:400] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 17 pre-election: Vote denied by peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823) with higher term. Message: Invalid argument: T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for earlier term 17. Current term is 18.
I20260709 13:07:59.427430 22133 raft_consensus.cc:515] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:59.428092 16322 leader_election.cc:403] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:59.282403 22038 consensus_queue.cc:1059] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.113s
I20260709 13:07:59.317952 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:59.396763 16274 raft_consensus.cc:2393] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 11: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:07:59.348435 16348 raft_consensus.cc:1240] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 13:07:59.333482 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:59.312307 16282 raft_consensus.cc:2468] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 14.
W20260709 13:07:59.406805 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 132739us
I20260709 13:07:59.443718 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:07:59.435382 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 155247us
I20260709 13:07:59.358539 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:07:59.447433 16357 raft_consensus.cc:2368] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for earlier term 13. Current term is 14.
I20260709 13:07:59.296188 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
W20260709 13:07:59.435482 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 150370us
I20260709 13:07:59.429430 16322 leader_election.cc:304] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:59.445894 16248 leader_election.cc:304] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:07:59.273170 22098 raft_consensus.cc:2804] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:59.457566 16248 leader_election.cc:304] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:59.449270 21995 raft_consensus.cc:2749] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823) with higher term. Message: Invalid argument: T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for earlier term 17. Current term is 18.
I20260709 13:07:59.465487 16248 leader_election.cc:400] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 election: Vote denied by peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107) with higher term. Message: Invalid argument: T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 8. Current term is 9.
I20260709 13:07:59.465852 16248 leader_election.cc:403] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:07:59.262349 21874 consensus_queue.cc:1059] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.195s
I20260709 13:07:59.472085 22081 consensus_queue.cc:1048] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:59.474128 22133 leader_election.cc:290] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:59.327042 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:59.326395 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:07:59.475169 16914 leader_election.cc:304] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:07:59.304512 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:07:59.486595 16322 leader_election.cc:304] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:07:59.464351 22105 log.cc:927] Time spent T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.159s	user 0.001s	sys 0.000s
I20260709 13:07:59.488220 16283 raft_consensus.cc:3060] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:59.254894 22055 raft_consensus.cc:493] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:59.464847 21974 raft_consensus.cc:2804] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:59.497880 16322 leader_election.cc:304] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:59.501300 16912 leader_election.cc:304] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:07:59.456286 21902 consensus_queue.cc:1059] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:07:59.482236 21909 raft_consensus.cc:2804] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:59.272639 22108 raft_consensus.cc:493] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:59.477665 22001 raft_consensus.cc:493] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.459946 22071 consensus_queue.cc:1059] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 13:07:59.418339 22067 consensus_queue.cc:237] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:59.508415 22055 raft_consensus.cc:3060] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:59.504779 21995 raft_consensus.cc:2804] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:07:59.509863 22028 consensus_meta.cc:287] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3: Time spent flushing consensus metadata: real 0.631s	user 0.011s	sys 0.001s
I20260709 13:07:59.561964 16322 leader_election.cc:304] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:59.509732 21974 raft_consensus.cc:493] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:07:59.524219 21896 raft_consensus.cc:2749] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:59.556236 16283 raft_consensus.cc:2468] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 9.
I20260709 13:07:59.485323 21898 consensus_queue.cc:1048] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.061s
I20260709 13:07:59.547315 21957 raft_consensus.cc:2804] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:59.499722 21771 consensus_queue.cc:1048] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.063s
I20260709 13:07:59.526726 21909 raft_consensus.cc:493] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:59.559088 22060 raft_consensus.cc:2804] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:07:59.561689 21667 raft_consensus.cc:3055] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:07:59.582640 21974 raft_consensus.cc:3060] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:59.583716 22133 raft_consensus.cc:2749] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:59.571183 21995 raft_consensus.cc:493] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:59.585891 22026 raft_consensus.cc:2749] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:59.585139 16103 catalog_manager.cc:5697] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:59.589342 21957 raft_consensus.cc:493] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:07:59.591838 21902 raft_consensus.cc:3055] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 LEADER]: Stepping down as leader of term 17
W20260709 13:07:59.601866 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 100661us
I20260709 13:07:59.568902 22001 raft_consensus.cc:515] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:59.589918 22071 raft_consensus.cc:2749] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107) with higher term. Message: Invalid argument: T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 8. Current term is 9.
I20260709 13:07:59.560528 22108 raft_consensus.cc:515] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:59.606619 16276 raft_consensus.cc:1240] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 LEADER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 13:07:59.593030 21667 raft_consensus.cc:740] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:59.592748 21909 raft_consensus.cc:3060] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:59.593400 22060 raft_consensus.cc:493] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:59.590934 22134 consensus_queue.cc:1059] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:07:59.628183 22134 raft_consensus.cc:3055] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:07:59.628597 22134 raft_consensus.cc:740] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:07:59.629492 22134 consensus_queue.cc:260] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:59.637539 21578 raft_consensus.cc:3055] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:59.638072 21578 raft_consensus.cc:740] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:07:59.638998 21578 consensus_queue.cc:260] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:59.604935 21995 raft_consensus.cc:3060] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:59.609244 21902 raft_consensus.cc:740] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:07:59.609390 21957 raft_consensus.cc:3060] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:59.645248 22134 raft_consensus.cc:3060] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:59.624989 22060 raft_consensus.cc:3060] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:59.645782 22075 raft_consensus.cc:515] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:59.651635 21667 consensus_queue.cc:260] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:07:59.653993 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 392473us
I20260709 13:07:59.603803 21962 raft_consensus.cc:697] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:07:59.684033 16246 leader_election.cc:304] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:07:59.688679 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 223102us
I20260709 13:07:59.693598 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:07:59.696957 16207 raft_consensus.cc:2468] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 7.
I20260709 13:07:59.716634 16912 leader_election.cc:304] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
W20260709 13:07:59.723762 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 142033us
I20260709 13:07:59.726627 16322 leader_election.cc:304] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:59.729405 16355 pending_rounds.cc:85] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e: Aborting all ops after (but not including) 11
I20260709 13:07:59.729894 16355 pending_rounds.cc:107] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e: Aborting uncommitted NO_OP operation due to leader change: 12.12
I20260709 13:07:59.730257 16355 raft_consensus.cc:2889] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:59.698622 22027 raft_consensus.cc:493] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:59.747936 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 63984.7us
I20260709 13:07:59.708935 21667 raft_consensus.cc:3060] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:59.761556 16246 leader_election.cc:304] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:59.707888 22071 raft_consensus.cc:493] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:07:59.765403 16945 raft_consensus.cc:1240] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 20 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 19. Current term is 20. Ops: []
I20260709 13:07:59.747542 22056 raft_consensus.cc:2804] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:07:59.773815 22142 log.cc:927] Time spent T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
W20260709 13:07:59.780272 22138 log.cc:927] Time spent T 4b962ceebb5c48c1914459ae0c0eff1b P 1109f76a0b7b443a84c0327c8707bc63: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:07:59.786798 22001 leader_election.cc:290] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:59.759656 22054 raft_consensus.cc:2804] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:59.762677 22139 raft_consensus.cc:2749] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:07:59.791282 22055 raft_consensus.cc:515] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:59.744249 21902 consensus_queue.cc:260] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:59.795135 21962 consensus_queue.cc:237] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:59.827979 16945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:59.763938 16173 leader_election.cc:304] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
W20260709 13:07:59.802111 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 49517.1us
W20260709 13:07:59.833678 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 71854.2us
I20260709 13:07:59.788105 22108 leader_election.cc:290] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:07:59.793928 21974 raft_consensus.cc:515] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:07:59.818740 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 118389us
I20260709 13:07:59.823935 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:07:59.833853 22001 raft_consensus.cc:2804] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:07:59.817996 22031 consensus_meta.cc:287] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 0.584s	user 0.007s	sys 0.004s
W20260709 13:07:59.817842 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 56405.8us
I20260709 13:07:59.842784 16246 leader_election.cc:304] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:59.840076 16945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:59.839319 16248 leader_election.cc:304] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:07:59.763414 22027 raft_consensus.cc:515] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:07:59.810842 22054 raft_consensus.cc:493] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:59.823247 21920 consensus_meta.cc:287] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 0.576s	user 0.009s	sys 0.004s
I20260709 13:07:59.888007 21974 leader_election.cc:290] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 17 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:07:59.812584 22056 raft_consensus.cc:697] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 9 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
W20260709 13:07:59.848588 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 114921us
I20260709 13:07:59.797479 22071 raft_consensus.cc:515] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:59.830197 21981 raft_consensus.cc:493] T 540bfc4ad793452faea5b865343aacf7 P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
W20260709 13:07:59.892726 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 50036.9us
I20260709 13:07:59.927860 16246 leader_election.cc:304] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:07:59.945423 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 54731.5us
W20260709 13:07:59.943395 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 104147us
I20260709 13:07:59.947652 16248 leader_election.cc:304] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:59.840044 22026 raft_consensus.cc:2749] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:07:59.965142 16248 leader_election.cc:304] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:59.890151 22081 raft_consensus.cc:493] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.893386 21902 raft_consensus.cc:3060] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:59.893690 22054 raft_consensus.cc:3060] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:59.986205 16248 leader_election.cc:304] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:07:59.891867 21920 raft_consensus.cc:515] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:07:59.892371 22001 raft_consensus.cc:697] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:07:59.999135 16946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:07:59.966471 22043 raft_consensus.cc:2749] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:59.944186 22024 raft_consensus.cc:2749] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:07:59.943910 22139 raft_consensus.cc:3055] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:00.004172 16945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
W20260709 13:08:00.014956 16249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:59.966210 21992 raft_consensus.cc:2804] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:07:59.992637 21916 consensus_meta.cc:287] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3: Time spent flushing consensus metadata: real 0.913s	user 0.008s	sys 0.004s
I20260709 13:07:59.890357 22152 consensus_queue.cc:1048] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.157s
W20260709 13:08:00.029776 22155 log.cc:927] Time spent T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 13:08:00.030354 22165 raft_consensus.cc:493] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:08:00.035091 21986 raft_consensus.cc:2749] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:00.036191 22028 raft_consensus.cc:493] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:07:59.987123 21974 raft_consensus.cc:2804] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:00.040035 16173 leader_election.cc:400] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 13 election: Vote denied by peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107) with higher term. Message: Invalid argument: T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for earlier term 13. Current term is 14.
I20260709 13:07:59.996061 22146 raft_consensus.cc:2804] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:00.044112 21992 raft_consensus.cc:493] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:00.041395 22139 raft_consensus.cc:740] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:07:59.988586 16354 raft_consensus.cc:2468] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 15.
I20260709 13:08:00.069842 16173 leader_election.cc:403] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:08:00.072373 16201 raft_consensus.cc:1240] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 17. Current term is 18. Ops: [17.12-17.12]
I20260709 13:07:59.967072 21981 raft_consensus.cc:515] T 540bfc4ad793452faea5b865343aacf7 P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:00.071090 22146 raft_consensus.cc:493] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:00.070880 21974 raft_consensus.cc:493] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:08:00.000674 22081 raft_consensus.cc:515] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:00.075750 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:08:00.088230 16204 raft_consensus.cc:2393] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 11: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:08:00.076011 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:08:00.089187 16205 raft_consensus.cc:2393] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 17: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:08:00.080920 16173 leader_election.cc:304] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:08:00.049727 22159 raft_consensus.cc:493] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:08:00.077821 21992 raft_consensus.cc:3060] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:00.108315 16278 raft_consensus.cc:1240] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:00.079996 21974 raft_consensus.cc:3060] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:00.079455 21960 raft_consensus.cc:2749] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107) with higher term. Message: Invalid argument: T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for earlier term 13. Current term is 14.
I20260709 13:08:00.078356 22146 raft_consensus.cc:3060] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:00.126113 21986 raft_consensus.cc:2955] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 LEADER]: Committing config change with OpId 12.11: config changed from index 10 to 11, VOTER e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:08:00.131695 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:00.131956 22058 raft_consensus.cc:493] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:08:00.132472 16275 raft_consensus.cc:2468] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 7.
I20260709 13:08:00.133716 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:00.135792 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:08:00.138854 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:00.139791 16278 raft_consensus.cc:3060] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:08:00.137172 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 63210.2us
I20260709 13:08:00.132401 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:00.148288 16281 raft_consensus.cc:2393] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 20: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:08:00.143759 16275 raft_consensus.cc:2393] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 7: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:08:00.152485 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:00.078320 22139 consensus_queue.cc:260] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:00.155895 22139 raft_consensus.cc:3060] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:00.156558 21960 raft_consensus.cc:2749] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:00.060367 22165 raft_consensus.cc:515] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:00.096264 22057 raft_consensus.cc:493] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:08:00.160503 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:00.073449 22167 consensus_queue.cc:1059] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.082s
I20260709 13:08:00.121592 22149 raft_consensus.cc:493] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.080183 22028 raft_consensus.cc:515] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:08:00.188019 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 107169us
I20260709 13:08:00.191680 22169 consensus_queue.cc:1059] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:00.192615 22169 consensus_queue.cc:1243] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer 1109f76a0b7b443a84c0327c8707bc63 log is divergent from this leader: its last log entry 18.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:08:00.199996 16173 leader_election.cc:304] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:08:00.095535 22056 consensus_queue.cc:237] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:00.107993 22159 raft_consensus.cc:515] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:00.213490 16322 leader_election.cc:304] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:00.168569 22055 leader_election.cc:290] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 18 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:00.194360 22169 raft_consensus.cc:3055] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:08:00.132611 22058 raft_consensus.cc:515] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:00.219319 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:08:00.218530 16322 leader_election.cc:304] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:00.115869 22001 consensus_queue.cc:237] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:00.236989 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:00.240998 16278 raft_consensus.cc:2468] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 20.
I20260709 13:08:00.239578 16281 raft_consensus.cc:1275] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:08:00.240998 16205 raft_consensus.cc:2468] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 11.
I20260709 13:08:00.211689 22027 leader_election.cc:290] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:00.254112 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:00.173198 22057 raft_consensus.cc:515] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:00.256903 16351 raft_consensus.cc:3060] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:08:00.259789 22162 log.cc:927] Time spent T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
W20260709 13:08:00.260596 22158 log.cc:927] Time spent T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.179s	user 0.000s	sys 0.001s
I20260709 13:08:00.235996 22031 raft_consensus.cc:2749] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:00.252811 22055 raft_consensus.cc:493] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
W20260709 13:08:00.262511 21995 consensus_meta.cc:287] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 0.579s	user 0.000s	sys 0.010s
I20260709 13:08:00.219560 22071 leader_election.cc:290] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:00.217116 22169 raft_consensus.cc:740] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 19 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:08:00.254700 22067 raft_consensus.cc:2749] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:00.286996 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:00.288708 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:00.286458 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:00.185717 22149 raft_consensus.cc:515] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:00.309327 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:00.310210 16350 raft_consensus.cc:1240] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:08:00.314530 16350 raft_consensus.cc:1275] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:08:00.302371 16351 raft_consensus.cc:1275] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:08:00.318872 16945 raft_consensus.cc:2955] T 4b962ceebb5c48c1914459ae0c0eff1b P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Committing config change with OpId 12.11: config changed from index 10 to 11, VOTER e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:08:00.323369 16353 raft_consensus.cc:2468] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 17.
I20260709 13:08:00.311905 21920 leader_election.cc:290] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:00.309226 22098 raft_consensus.cc:493] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:00.352995 22174 raft_consensus.cc:2749] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:08:00.354856 22171 log.cc:927] Time spent T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:08:00.357393 22075 leader_election.cc:290] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:00.371889 22159 leader_election.cc:290] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:08:00.372373 21909 consensus_meta.cc:287] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 0.719s	user 0.011s	sys 0.000s
I20260709 13:08:00.372891 21909 raft_consensus.cc:515] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:00.374821 22165 leader_election.cc:290] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:00.376125 21981 leader_election.cc:290] T 540bfc4ad793452faea5b865343aacf7 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:08:00.376880 21957 consensus_meta.cc:287] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63: Time spent flushing consensus metadata: real 0.690s	user 0.011s	sys 0.000s
I20260709 13:08:00.377260 21992 raft_consensus.cc:515] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:08:00.378073 22145 log.cc:927] Time spent T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.630s	user 0.005s	sys 0.007s
I20260709 13:08:00.377424 21957 raft_consensus.cc:515] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:00.350805 22098 raft_consensus.cc:3060] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:00.379905 21992 leader_election.cc:290] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:00.302860 22055 raft_consensus.cc:515] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:00.361970 22054 raft_consensus.cc:515] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:00.384945 22055 leader_election.cc:290] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:00.303308 21995 raft_consensus.cc:515] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:00.387902 22058 leader_election.cc:290] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:00.388360 22054 leader_election.cc:290] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 8 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:00.388432 21995 leader_election.cc:290] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:00.343901 22081 leader_election.cc:290] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:00.389920 22028 leader_election.cc:290] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:08:00.391119 22164 log.cc:927] Time spent T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.279s	user 0.003s	sys 0.000s
I20260709 13:08:00.392545 22149 leader_election.cc:290] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:08:00.393432 22161 log.cc:927] Time spent T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.312s	user 0.000s	sys 0.001s
W20260709 13:08:00.410804 22154 log.cc:927] Time spent T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63: Append to log took a long time: real 0.501s	user 0.003s	sys 0.000s
I20260709 13:08:00.399577 22169 consensus_queue.cc:260] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:00.420789 22146 raft_consensus.cc:515] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:00.461508 16201 raft_consensus.cc:3055] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:00.462757 16201 raft_consensus.cc:740] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:08:00.465019 16201 consensus_queue.cc:260] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:00.483843 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:00.485056 16281 raft_consensus.cc:1240] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:00.488134 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:00.489621 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:08:00.490902 16248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:00.493093 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f022e2e63ae4461d834e476ff2666991" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:00.494395 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:08:00.502683 16276 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45218 (request call id 2557) took 1320 ms. Trace:
I20260709 13:08:00.505220 16357 raft_consensus.cc:1240] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 14. Current term is 15. Ops: []
W20260709 13:08:00.506028 16246 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:00.517172 16354 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41832 (request call id 2490) took 1226 ms. Trace:
I20260709 13:08:00.540506 16354 rpcz_store.cc:276] 0709 13:07:59.290354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:59.295940 (+  5586us) service_pool.cc:224] Handling call
0709 13:08:00.516519 (+1220579us) spinlock_profiling.cc:243] Waited 442 ms on lock 0x7b540026aa54. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:08:00.516791 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1016283392}
I20260709 13:08:00.540158 16276 rpcz_store.cc:276] 0709 13:07:59.166251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:59.172974 (+  6723us) service_pool.cc:224] Handling call
0709 13:07:59.194511 (+ 21537us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:59.619304 (+424793us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:00.485606 (+866302us) spinlock_profiling.cc:243] Waited 412 ms on lock 0x7b5400127354. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f489e01 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6
0709 13:08:00.486186 (+   580us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":947011456}
I20260709 13:08:00.519595 16199 raft_consensus.cc:1275] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:08:00.559654 16278 raft_consensus.cc:2393] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 16: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:08:00.574821 16203 raft_consensus.cc:3060] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:08:00.583349 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 290136us
I20260709 13:08:00.587987 22165 raft_consensus.cc:493] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:00.588901 22165 raft_consensus.cc:515] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:00.592034 22176 raft_consensus.cc:493] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.593197 22176 raft_consensus.cc:515] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:00.594460 22098 raft_consensus.cc:515] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:00.601233 16203 raft_consensus.cc:2468] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 11.
I20260709 13:08:00.603366 22098 leader_election.cc:290] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:08:00.600353 21902 consensus_meta.cc:287] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3: Time spent flushing consensus metadata: real 0.603s	user 0.012s	sys 0.005s
I20260709 13:08:00.598804 16348 raft_consensus.cc:2468] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 11.
W20260709 13:08:00.609227 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 67436.9us
I20260709 13:08:00.583737 22055 raft_consensus.cc:493] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.611100 22055 raft_consensus.cc:515] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:00.612475 15057 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:00.614531 22068 consensus_queue.cc:1048] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:00.614984 22147 raft_consensus.cc:493] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:00.616461 16942 raft_consensus.cc:1240] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 18 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:00.618928 22146 leader_election.cc:290] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:00.587392 21957 leader_election.cc:290] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 18 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:00.622910 22043 raft_consensus.cc:493] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.623817 22043 raft_consensus.cc:515] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:00.625519 21986 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:45374 (request call id 2) took 2011 ms. Trace:
I20260709 13:08:00.627132 22055 leader_election.cc:290] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:00.616020 22147 raft_consensus.cc:515] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:00.631731 22085 raft_consensus.cc:493] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.632747 16277 raft_consensus.cc:2410] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
W20260709 13:08:00.631920 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 431918us
I20260709 13:08:00.638863 16201 raft_consensus.cc:3060] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:00.645375 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:00.648655 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:08:00.649670 22057 leader_election.cc:290] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:00.654834 22075 raft_consensus.cc:493] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:08:00.647063 22146 raft_consensus.cc:493] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:00.655697 22075 raft_consensus.cc:515] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:00.656206 22146 raft_consensus.cc:515] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:00.649801 21909 leader_election.cc:290] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 18 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:00.659430 22085 raft_consensus.cc:515] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:00.660287 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:08:00.662709 22085 leader_election.cc:290] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:00.663390 22165 leader_election.cc:290] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:00.662729 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:08:00.666282 16200 raft_consensus.cc:2393] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 16: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:08:00.585857 16322 leader_election.cc:304] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:08:00.626132 21986 rpcz_store.cc:276] 0709 13:07:58.614431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.615124 (+   693us) service_pool.cc:224] Handling call
0709 13:07:58.695068 (+ 79944us) log.cc:844] Serialized 501 byte log entry
0709 13:08:00.625233 (+1930165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5391,"raft.queue_time_us":5685,"raft.run_cpu_time_us":1817,"raft.run_wall_time_us":1817,"thread_start_us":145920,"threads_started":1,"wal-append.queue_time_us":246059,"wal-append.run_cpu_time_us":2739,"wal-append.run_wall_time_us":1144615}
W20260709 13:08:00.668100 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 82760.4us
I20260709 13:08:00.648751 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:00.670991 22189 raft_consensus.cc:2749] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:00.671360 16173 leader_election.cc:304] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:08:00.673830 22147 leader_election.cc:290] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:00.673919 21909 consensus_queue.cc:1059] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:00.676916 21920 raft_consensus.cc:3055] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:00.677675 21920 raft_consensus.cc:740] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
W20260709 13:08:00.678823 22185 log.cc:927] Time spent T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.258s	user 0.005s	sys 0.000s
I20260709 13:08:00.680157 21920 consensus_queue.cc:260] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:00.686957 22043 leader_election.cc:290] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:00.682337 16246 leader_election.cc:304] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:00.664103 22176 leader_election.cc:290] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:00.695034 16200 raft_consensus.cc:1275] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:08:00.696641 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:00.664350 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:08:00.697180 22060 consensus_meta.cc:287] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 1.010s	user 0.013s	sys 0.005s
I20260709 13:08:00.697626 16206 raft_consensus.cc:2468] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 11.
I20260709 13:08:00.697710 16203 raft_consensus.cc:1275] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:08:00.698938 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
W20260709 13:08:00.699751 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 64398.1us
I20260709 13:08:00.704694 22075 leader_election.cc:290] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:00.714951 22093 raft_consensus.cc:2749] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:00.717140 22169 raft_consensus.cc:3060] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:08:00.718024 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 46892.4us
I20260709 13:08:00.719666 16201 raft_consensus.cc:1275] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 11. (term mismatch)
I20260709 13:08:00.720570 16201 pending_rounds.cc:85] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f: Aborting all ops after (but not including) 10
I20260709 13:08:00.719193 22085 raft_consensus.cc:493] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.722831 22188 raft_consensus.cc:493] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:08:00.721771 22043 raft_consensus.cc:2804] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:00.724454 22043 raft_consensus.cc:697] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:08:00.726298 22175 raft_consensus.cc:493] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:08:00.728802 22175 raft_consensus.cc:515] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:00.728865 16173 leader_election.cc:304] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:08:00.727938 16201 pending_rounds.cc:107] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f: Aborting uncommitted NO_OP operation due to leader change: 17.11
W20260709 13:08:00.721370 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 86296.5us
W20260709 13:08:00.725684 22186 log.cc:927] Time spent T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.304s	user 0.003s	sys 0.000s
I20260709 13:08:00.724370 22188 raft_consensus.cc:515] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:00.732862 16201 raft_consensus.cc:2889] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:00.744035 22175 leader_election.cc:290] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:08:00.745926 21882 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 18 current term: 18 is higher.
I20260709 13:08:00.748121 16173 leader_election.cc:304] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:00.749809 22098 raft_consensus.cc:2749] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:00.750761 22098 raft_consensus.cc:2804] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:00.751401 22098 raft_consensus.cc:697] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 15 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
W20260709 13:08:00.752143 22177 log.cc:927] Time spent T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.363s	user 0.002s	sys 0.001s
I20260709 13:08:00.752622 22098 consensus_queue.cc:237] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:00.764041 16322 leader_election.cc:304] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
W20260709 13:08:00.770368 16174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:00.697718 22060 raft_consensus.cc:515] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:00.775907 16092 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4b962ceebb5c48c1914459ae0c0eff1b with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:00.771871 22175 raft_consensus.cc:493] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:08:00.780683 22175 raft_consensus.cc:515] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:00.782660 21953 raft_consensus.cc:493] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:00.780575 22178 log.cc:927] Time spent T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.381s	user 0.000s	sys 0.003s
I20260709 13:08:00.783550 21953 raft_consensus.cc:515] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:08:00.787246 22182 log.cc:927] Time spent T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.374s	user 0.001s	sys 0.002s
I20260709 13:08:00.779491 22085 raft_consensus.cc:515] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:00.729163 22043 consensus_queue.cc:237] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:00.793028 21920 raft_consensus.cc:3060] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:00.795521 21578 raft_consensus.cc:3060] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:00.790109 22075 raft_consensus.cc:493] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:00.790367 22085 leader_election.cc:290] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:00.815126 16173 leader_election.cc:304] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:08:00.790336 22176 raft_consensus.cc:493] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:08:00.806933 22189 raft_consensus.cc:493] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:08:00.819139 21953 leader_election.cc:290] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:00.828286 21909 raft_consensus.cc:493] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.828352 21986 raft_consensus.cc:493] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
W20260709 13:08:00.844254 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 83563.8us
I20260709 13:08:00.846380 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:00.848412 22147 raft_consensus.cc:493] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:08:00.848805 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:00.849290 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:00.854532 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:00.865481 16246 leader_election.cc:304] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:00.863164 21667 raft_consensus.cc:3060] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:00.877799 16278 raft_consensus.cc:2468] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 15.
I20260709 13:08:00.883576 16276 raft_consensus.cc:3060] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:00.880899 16277 raft_consensus.cc:2468] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 11.
I20260709 13:08:00.893568 22147 raft_consensus.cc:515] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:00.908026 22060 leader_election.cc:290] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 19 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:00.907629 21909 raft_consensus.cc:515] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:00.909485 16945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:00.910284 22176 raft_consensus.cc:515] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:00.911733 22175 leader_election.cc:290] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:00.914532 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:08:00.919157 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 145454us
I20260709 13:08:00.893729 22189 raft_consensus.cc:515] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:00.925063 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:00.887085 21953 raft_consensus.cc:2749] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:08:00.895783 22085 raft_consensus.cc:2804] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:00.927291 16322 leader_election.cc:304] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:08:00.902540 21882 raft_consensus.cc:493] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.945829 22175 raft_consensus.cc:493] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:08:00.946091 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f022e2e63ae4461d834e476ff2666991" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:00.952116 22183 raft_consensus.cc:2749] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:00.918651 22188 leader_election.cc:290] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:00.935660 22085 raft_consensus.cc:493] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:00.901638 22075 raft_consensus.cc:515] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:08:00.967659 21974 consensus_meta.cc:287] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3: Time spent flushing consensus metadata: real 0.800s	user 0.014s	sys 0.008s
I20260709 13:08:00.976738 16276 raft_consensus.cc:2468] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 8.
I20260709 13:08:00.934751 21986 raft_consensus.cc:515] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:00.966435 22085 raft_consensus.cc:3060] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:00.954352 22175 raft_consensus.cc:515] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:00.990947 16945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:00.998700 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c15d8e9be8414c84912ab77b66bfb1" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:01.001909 16320 leader_election.cc:304] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:01.004769 22188 raft_consensus.cc:2804] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:01.005612 22188 raft_consensus.cc:697] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 11 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:08:01.007226 22188 consensus_queue.cc:237] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:01.007990 21992 consensus_queue.cc:1048] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.040s
W20260709 13:08:01.017011 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:01.019570 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:00.983151 22146 leader_election.cc:290] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:01.026069 16942 raft_consensus.cc:2468] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 11.
I20260709 13:08:01.034245 16946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:01.035449 16946 raft_consensus.cc:2468] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 15.
I20260709 13:08:00.987948 21974 raft_consensus.cc:515] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:08:01.047940 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 133140us
W20260709 13:08:01.055861 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 108908us
W20260709 13:08:01.060999 16248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:01.062654 16946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:01.064643 22146 raft_consensus.cc:493] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:01.020154 21882 raft_consensus.cc:515] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:01.071020 16279 raft_consensus.cc:1240] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:01.071635 21882 leader_election.cc:290] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:01.050334 22183 raft_consensus.cc:493] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:01.047150 22189 leader_election.cc:290] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:01.078943 16945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:01.110461 16945 raft_consensus.cc:2468] T 540bfc4ad793452faea5b865343aacf7 P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 15.
I20260709 13:08:01.125726 22128 raft_consensus.cc:493] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:01.127624 22128 raft_consensus.cc:515] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:01.109273 22147 leader_election.cc:290] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:01.130733 22175 leader_election.cc:290] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:01.111366 22183 raft_consensus.cc:515] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:01.131071 21726 consensus_queue.cc:1059] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.018s
I20260709 13:08:01.132565 21726 raft_consensus.cc:3055] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:01.133040 21726 raft_consensus.cc:740] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:08:01.133746 22183 leader_election.cc:290] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:01.135716 21974 leader_election.cc:290] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 15 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:01.136433 22075 leader_election.cc:290] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:08:01.137161 16174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:01.138430 16205 raft_consensus.cc:2468] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 13.
I20260709 13:08:01.110286 22146 raft_consensus.cc:515] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:01.108835 21909 leader_election.cc:290] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:01.143746 22146 leader_election.cc:290] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:01.130183 22128 leader_election.cc:290] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:08:01.160684 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 157154us
W20260709 13:08:01.161943 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 43865.2us
I20260709 13:08:01.158164 22075 raft_consensus.cc:493] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:01.126752 21986 leader_election.cc:290] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:01.165310 16248 leader_election.cc:304] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:01.194166 22176 leader_election.cc:290] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:01.195015 16248 leader_election.cc:304] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:08:01.196049 22028 raft_consensus.cc:2749] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:01.197471 16248 leader_election.cc:304] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:08:01.198525 22139 raft_consensus.cc:2804] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:01.199551 22139 raft_consensus.cc:493] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:01.200053 22139 raft_consensus.cc:3060] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:01.150738 22146 consensus_queue.cc:1059] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.021s
I20260709 13:08:01.212721 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:01.134213 21726 consensus_queue.cc:260] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:01.218019 21726 raft_consensus.cc:3060] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:01.219141 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:01.225899 22026 raft_consensus.cc:2804] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:01.228597 22026 raft_consensus.cc:493] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:01.229858 16279 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45218 (request call id 2559) took 1102 ms. Trace:
W20260709 13:08:01.228935 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:01.230253 16279 rpcz_store.cc:276] 0709 13:08:00.127548 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.134808 (+  7260us) service_pool.cc:224] Handling call
0709 13:08:00.135204 (+   396us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:01.071610 (+936406us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:01.229541 (+157931us) spinlock_profiling.cc:243] Waited 930 ms on lock 0x7b54001f68d4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f489e01 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6
0709 13:08:01.229770 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2139327872}
I20260709 13:08:01.191359 22075 raft_consensus.cc:515] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:01.229080 22026 raft_consensus.cc:3060] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:01.235924 21962 raft_consensus.cc:3055] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:01.236384 21962 raft_consensus.cc:740] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:08:01.237594 21962 consensus_queue.cc:260] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:01.239198 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bc3c8ff9b84838a2664335d7e1582b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:01.240398 21909 consensus_queue.cc:1048] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:01.241098 22183 consensus_queue.cc:1048] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:01.236198 22139 raft_consensus.cc:515] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:01.245673 22139 leader_election.cc:290] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 election: Requested vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:01.255829 22075 leader_election.cc:290] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:08:01.238705 22196 log.cc:927] Time spent T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
W20260709 13:08:01.258139 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 177159us
I20260709 13:08:01.260259 16173 leader_election.cc:304] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:08:01.261267 22176 raft_consensus.cc:2749] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:08:01.263000 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 97041.2us
I20260709 13:08:01.265862 22176 consensus_queue.cc:1048] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:01.245473 21667 raft_consensus.cc:2749] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:01.274039 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
W20260709 13:08:01.279119 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 55559.7us
I20260709 13:08:01.266808 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:01.287895 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:01.287990 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:01.291031 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:08:01.299540 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:01.303488 16204 raft_consensus.cc:1275] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:08:01.308280 16912 leader_election.cc:304] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:01.312474 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:01.273916 22146 raft_consensus.cc:493] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:01.335433 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:01.336050 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:01.336486 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:01.337054 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:08:01.338914 16278 raft_consensus.cc:2393] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 15: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:08:01.341524 16945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:01.324021 16914 leader_election.cc:304] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:01.339262 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:01.337553 22075 raft_consensus.cc:493] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:01.351297 16205 raft_consensus.cc:2410] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for term 21 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 13:08:01.355530 16200 raft_consensus.cc:2468] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 15.
I20260709 13:08:01.344554 21962 raft_consensus.cc:3060] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:01.335594 22147 raft_consensus.cc:493] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:01.341257 21909 raft_consensus.cc:493] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:01.355266 22075 raft_consensus.cc:515] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:01.371703 22204 raft_consensus.cc:2804] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:08:01.353483 21957 raft_consensus.cc:2804] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:01.350670 21920 raft_consensus.cc:493] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:08:01.387360 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:08:01.389117 16913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:01.392373 16946 raft_consensus.cc:1275] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 18 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:08:01.327699 22146 raft_consensus.cc:515] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:01.408478 16282 raft_consensus.cc:1275] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 12. (term mismatch)
I20260709 13:08:01.408979 16282 pending_rounds.cc:85] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3: Aborting all ops after (but not including) 11
I20260709 13:08:01.412788 16282 pending_rounds.cc:107] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3: Aborting uncommitted NO_OP operation due to leader change: 17.12
I20260709 13:08:01.413089 16282 raft_consensus.cc:2889] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:01.400421 21957 raft_consensus.cc:493] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:01.415910 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:01.388754 22147 raft_consensus.cc:515] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } }
I20260709 13:08:01.429435 16320 leader_election.cc:304] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:01.409634 22204 raft_consensus.cc:697] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 20 LEADER]: Becoming Leader. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:08:01.426399 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:08:01.508488 16943 raft_consensus.cc:3060] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:01.414520 22054 raft_consensus.cc:493] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
W20260709 13:08:01.441116 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 148711us
I20260709 13:08:01.417621 21957 raft_consensus.cc:3060] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:01.450968 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:01.455008 16945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
W20260709 13:08:01.509577 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 80233.6us
I20260709 13:08:01.455143 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:01.458493 16946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:01.509989 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:08:01.464640 22201 log.cc:927] Time spent T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63: Append to log took a long time: real 0.055s	user 0.003s	sys 0.000s
I20260709 13:08:01.465173 21920 raft_consensus.cc:515] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:01.467931 22056 consensus_queue.cc:1048] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.072s
W20260709 13:08:01.469385 22198 log.cc:927] Time spent T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 13:08:01.472975 21985 raft_consensus.cc:493] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:01.474941 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:01.475433 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:01.476270 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:01.475004 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:01.477202 22075 leader_election.cc:290] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:01.481623 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:08:01.487398 22145 log.cc:927] Time spent T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
I20260709 13:08:01.560195 16274 raft_consensus.cc:2468] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 12.
I20260709 13:08:01.406991 21909 raft_consensus.cc:515] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:01.434046 16248 leader_election.cc:304] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:01.456586 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
W20260709 13:08:01.509020 22200 log.cc:927] Time spent T 00000000000000000000000000000000 P 4dc6f08597514f4d85fd451b999b403e: Append to log took a long time: real 0.127s	user 0.000s	sys 0.003s
I20260709 13:08:01.517218 22054 raft_consensus.cc:515] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:01.521915 22026 raft_consensus.cc:515] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:01.617933 16282 raft_consensus.cc:2368] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for earlier term 15. Current term is 16.
I20260709 13:08:01.620160 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:01.621394 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:01.621811 22075 raft_consensus.cc:2749] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:08:01.622009 16282 raft_consensus.cc:2468] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 19.
I20260709 13:08:01.539934 22146 leader_election.cc:290] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:01.540747 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:01.625478 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:01.541334 16281 raft_consensus.cc:2368] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for earlier term 11. Current term is 12.
I20260709 13:08:01.545185 16943 raft_consensus.cc:2468] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 12.
I20260709 13:08:01.550963 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:01.627943 16276 raft_consensus.cc:2468] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 16.
I20260709 13:08:01.478039 22085 raft_consensus.cc:515] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:01.630404 22085 leader_election.cc:290] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:01.552418 16283 raft_consensus.cc:2468] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 15.
I20260709 13:08:01.631721 16279 raft_consensus.cc:2368] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for earlier term 11. Current term is 12.
I20260709 13:08:01.632318 22085 raft_consensus.cc:493] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:08:01.576722 16203 raft_consensus.cc:1275] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:08:01.633160 21920 leader_election.cc:290] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:01.542868 22188 raft_consensus.cc:2804] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:01.583227 16948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:01.633769 22188 raft_consensus.cc:493] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:01.634104 16948 raft_consensus.cc:2368] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for earlier term 11. Current term is 12.
I20260709 13:08:01.634193 22188 raft_consensus.cc:3060] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:01.632912 22085 raft_consensus.cc:515] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:01.584444 21909 leader_election.cc:290] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:01.636853 22085 leader_election.cc:290] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:01.586861 16280 raft_consensus.cc:2393] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 9: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:08:01.640192 22054 leader_election.cc:290] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:01.640439 22026 leader_election.cc:290] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 election: Requested vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:01.587560 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:01.641316 16274 raft_consensus.cc:2468] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 11.
I20260709 13:08:01.642644 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:01.643374 16278 raft_consensus.cc:2468] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 17.
I20260709 13:08:01.644287 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:01.646119 22026 raft_consensus.cc:493] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:08:01.646826 22026 raft_consensus.cc:515] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:01.647400 16280 raft_consensus.cc:1240] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 19. Current term is 20. Ops: []
I20260709 13:08:01.648216 22147 leader_election.cc:290] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:01.649711 22026 leader_election.cc:290] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:01.599269 16945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:01.600590 22204 consensus_queue.cc:237] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:01.607551 22199 raft_consensus.cc:493] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:01.615324 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 193331us
I20260709 13:08:01.587695 16173 leader_election.cc:304] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:08:01.586774 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:08:01.651125 16174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:01.660879 16945 raft_consensus.cc:2393] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 15: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
I20260709 13:08:01.653152 16278 raft_consensus.cc:2468] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 16.
W20260709 13:08:01.657379 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:01.664299 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:01.664111 16275 raft_consensus.cc:2468] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 16.
I20260709 13:08:01.670161 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:08:01.670665 16283 raft_consensus.cc:1240] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:01.670810 16204 raft_consensus.cc:3060] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:01.671586 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:01.672953 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:08:01.669425 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 142064us
I20260709 13:08:01.679826 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:01.656383 22175 raft_consensus.cc:493] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:08:01.667388 22056 raft_consensus.cc:493] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:01.664595 22176 raft_consensus.cc:2749] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:01.658793 22189 raft_consensus.cc:493] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:08:01.668883 21667 raft_consensus.cc:493] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:01.581039 21985 raft_consensus.cc:515] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:01.682500 22026 raft_consensus.cc:493] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:08:01.706734 22180 raft_consensus.cc:493] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:01.682219 22085 raft_consensus.cc:493] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:08:01.688541 22199 raft_consensus.cc:515] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:01.728657 22199 leader_election.cc:290] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:01.691386 22175 raft_consensus.cc:515] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:01.731030 22175 leader_election.cc:290] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:08:01.734097 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 146525us
I20260709 13:08:01.736589 21985 leader_election.cc:290] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:01.736769 22128 consensus_queue.cc:1048] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:01.737381 21882 consensus_queue.cc:1059] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:01.737370 22180 raft_consensus.cc:515] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:01.700598 22056 raft_consensus.cc:515] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:01.739796 22180 leader_election.cc:290] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:01.740749 22085 raft_consensus.cc:515] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:01.741333 22056 leader_election.cc:290] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:01.754633 16204 raft_consensus.cc:2468] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 12.
I20260709 13:08:01.766791 16246 leader_election.cc:304] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
W20260709 13:08:01.771274 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 213210us
I20260709 13:08:01.783186 16248 leader_election.cc:304] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:01.769197 16173 leader_election.cc:304] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:01.789687 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:01.791147 16173 leader_election.cc:304] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:01.791694 16914 leader_election.cc:304] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:08:01.793848 16173 leader_election.cc:304] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:01.795629 16173 leader_election.cc:304] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:01.799127 16204 raft_consensus.cc:2468] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 20.
I20260709 13:08:01.787024 22146 raft_consensus.cc:2804] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:01.721872 22026 raft_consensus.cc:515] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:01.803805 16914 leader_election.cc:304] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:01.804761 22060 raft_consensus.cc:493] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:08:01.805469 22060 raft_consensus.cc:515] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:01.807904 22060 leader_election.cc:290] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:01.810003 21992 raft_consensus.cc:2749] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:01.814661 21578 raft_consensus.cc:2804] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:01.815207 21578 raft_consensus.cc:493] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:01.815624 21578 raft_consensus.cc:3060] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:01.818972 22199 consensus_queue.cc:1048] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:08:01.819353 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 94545.1us
I20260709 13:08:01.820709 16248 leader_election.cc:304] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:01.821456 21992 consensus_queue.cc:1048] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:01.800139 22180 raft_consensus.cc:2804] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:01.822989 22180 raft_consensus.cc:493] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:01.823396 22180 raft_consensus.cc:3060] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:01.823962 21992 raft_consensus.cc:2804] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:01.826653 21992 raft_consensus.cc:697] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:08:01.822220 16248 leader_election.cc:304] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:01.765890 21667 raft_consensus.cc:515] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:01.833974 16914 leader_election.cc:304] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:01.834702 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:01.838779 22184 raft_consensus.cc:493] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:08:01.839514 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:01.827495 21983 raft_consensus.cc:2764] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:08:01.832309 16173 leader_election.cc:304] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:01.793342 22222 raft_consensus.cc:2804] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:01.851550 16173 leader_election.cc:304] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:01.782783 22189 raft_consensus.cc:515] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:01.858599 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:01.788133 21957 raft_consensus.cc:515] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:01.830747 22219 raft_consensus.cc:493] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:01.862700 22184 raft_consensus.cc:515] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:01.867717 22026 leader_election.cc:290] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:01.868532 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:01.870529 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:01.871608 21992 consensus_queue.cc:237] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:01.862987 22183 raft_consensus.cc:493] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:08:01.852186 22176 consensus_queue.cc:1059] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 13:08:01.878453 22189 leader_election.cc:290] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:01.854866 22222 raft_consensus.cc:493] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:08:01.879596 16352 raft_consensus.cc:1240] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:01.880314 21985 raft_consensus.cc:2804] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:08:01.884305 16946 raft_consensus.cc:2368] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for earlier term 13. Current term is 14.
I20260709 13:08:01.848860 22218 raft_consensus.cc:2749] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:08:01.833880 22146 raft_consensus.cc:697] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:08:01.895949 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:01.887689 21882 raft_consensus.cc:2804] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:01.887420 21986 raft_consensus.cc:2804] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:01.888226 22085 leader_election.cc:290] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:01.893545 22056 raft_consensus.cc:493] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:01.910300 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 88260.4us
I20260709 13:08:01.911441 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:01.895888 22223 raft_consensus.cc:2804] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:01.896490 22222 raft_consensus.cc:3060] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:01.914824 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:01.904367 21882 raft_consensus.cc:493] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:01.907963 21985 raft_consensus.cc:697] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 LEADER]: Becoming Leader. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:08:01.914599 22188 raft_consensus.cc:515] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:01.923962 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:01.930462 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:01.909516 22183 raft_consensus.cc:515] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:01.904647 22219 raft_consensus.cc:515] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:01.917490 21578 raft_consensus.cc:515] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:01.937260 22180 raft_consensus.cc:515] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:01.942849 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:02.000121 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:02.000535 16943 raft_consensus.cc:2468] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 16.
I20260709 13:08:02.000981 16356 raft_consensus.cc:2468] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 10.
I20260709 13:08:02.001878 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:01.946398 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:02.002321 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:02.003058 16349 raft_consensus.cc:2468] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 18.
I20260709 13:08:02.003852 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:02.004101 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:01.975502 21882 raft_consensus.cc:3060] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:02.004639 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:02.005478 16352 raft_consensus.cc:3060] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:02.007320 21985 consensus_queue.cc:237] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:01.915176 22223 raft_consensus.cc:493] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:01.947983 22199 raft_consensus.cc:493] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:01.949620 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:08:01.951383 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:01.960244 21957 leader_election.cc:290] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 14 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:08:01.978861 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 63276.2us
I20260709 13:08:01.981597 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:01.982244 22043 raft_consensus.cc:493] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:08:01.983006 16248 leader_election.cc:304] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:01.984237 22188 leader_election.cc:290] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 17 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:01.985963 16275 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8"
dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
mode: GRACEFUL
new_leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
 from {username='slave'} at 127.0.0.1:39058
I20260709 13:08:02.020902 16275 raft_consensus.cc:606] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 21 FOLLOWER]: Received request to transfer leadership to TS e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:02.021503 16275 raft_consensus.cc:614] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:01.986806 16355 raft_consensus.cc:2468] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 12.
I20260709 13:08:01.997236 22219 leader_election.cc:290] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:01.934363 21667 leader_election.cc:290] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:01.977922 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:02.004660 16353 raft_consensus.cc:2468] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 14.
I20260709 13:08:02.025527 16348 raft_consensus.cc:2468] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 10.
W20260709 13:08:02.025791 16913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:02.017382 22199 raft_consensus.cc:515] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:01.916919 21986 raft_consensus.cc:697] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:08:02.025646 16352 raft_consensus.cc:2468] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 11.
I20260709 13:08:02.012398 16942 raft_consensus.cc:3060] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:02.031863 22184 leader_election.cc:290] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:02.031565 21986 consensus_queue.cc:237] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:02.033155 21578 leader_election.cc:290] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 18 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:02.028019 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:02.000191 22180 leader_election.cc:290] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:02.035080 16350 raft_consensus.cc:2468] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 14.
I20260709 13:08:02.018607 22146 consensus_queue.cc:237] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:02.026810 22043 raft_consensus.cc:515] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:02.038209 22043 leader_election.cc:290] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:01.913805 22056 raft_consensus.cc:515] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:02.029304 16354 raft_consensus.cc:1275] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:08:02.040485 16248 leader_election.cc:304] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:08:02.044479 22199 leader_election.cc:290] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:02.012369 22223 raft_consensus.cc:3060] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:02.046972 22147 consensus_queue.cc:1048] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:08:02.010759 22075 raft_consensus.cc:493] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.049575 22075 raft_consensus.cc:515] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:02.027070 21992 raft_consensus.cc:2749] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:02.050438 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:02.050438 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c15d8e9be8414c84912ab77b66bfb1" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:02.047461 22085 raft_consensus.cc:2804] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:02.056428 16942 raft_consensus.cc:2468] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 16.
I20260709 13:08:02.065647 16356 raft_consensus.cc:2468] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 16.
I20260709 13:08:02.068302 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:02.069244 16354 raft_consensus.cc:2468] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 16.
I20260709 13:08:02.068270 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:02.040573 22056 leader_election.cc:290] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:02.071349 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:02.071645 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:02.071410 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:02.072248 16350 raft_consensus.cc:2468] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 10.
I20260709 13:08:02.073463 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:02.075663 16355 raft_consensus.cc:2468] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 13.
I20260709 13:08:02.062846 22075 leader_election.cc:290] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:02.083689 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:08:02.084014 16204 raft_consensus.cc:1240] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:08:02.084408 16200 raft_consensus.cc:3060] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:08:02.085016 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:02.086856 22128 raft_consensus.cc:3055] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:02.087352 22128 raft_consensus.cc:740] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:08:02.091197 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:02.092192 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:02.093380 16948 raft_consensus.cc:1240] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 12. Current term is 14. Ops: []
I20260709 13:08:02.092283 22183 leader_election.cc:290] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:02.080619 21992 raft_consensus.cc:493] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:08:02.095192 21992 raft_consensus.cc:515] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:02.096076 16200 raft_consensus.cc:2468] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 17.
I20260709 13:08:02.097622 21992 leader_election.cc:290] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:02.098730 16946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:02.098856 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:02.074328 22085 raft_consensus.cc:697] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:08:02.088347 22128 consensus_queue.cc:260] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:02.104091 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:02.104761 16350 raft_consensus.cc:3060] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:08:02.106966 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:02.107003 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:02.107720 16351 raft_consensus.cc:2468] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 16.
I20260709 13:08:02.108163 16352 raft_consensus.cc:1275] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:08:02.108758 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:02.109146 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:02.109539 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:02.110409 16355 raft_consensus.cc:2410] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for term 21 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 13:08:02.110325 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:02.107146 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:02.112584 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bc3c8ff9b84838a2664335d7e1582b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:02.092159 16353 raft_consensus.cc:2393] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 15: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:08:02.025223 22222 raft_consensus.cc:515] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:02.118774 16356 raft_consensus.cc:1275] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:08:02.119613 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:02.120250 16354 raft_consensus.cc:2468] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 15.
I20260709 13:08:02.119520 16320 leader_election.cc:304] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:02.125102 22183 raft_consensus.cc:2804] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:08:02.125595 22183 raft_consensus.cc:493] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:02.125950 22183 raft_consensus.cc:3060] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:02.129101 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:02.109172 22085 consensus_queue.cc:237] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:02.135546 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:02.137017 16350 raft_consensus.cc:2468] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 12.
I20260709 13:08:02.145375 16201 raft_consensus.cc:2393] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 18: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:08:02.146704 16357 raft_consensus.cc:3060] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:08:02.149439 16207 raft_consensus.cc:2410] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:08:02.124569 21882 raft_consensus.cc:515] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:02.208323 16202 raft_consensus.cc:2393] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 20: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:08:02.208838 21882 leader_election.cc:290] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 20 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:02.179436 16945 raft_consensus.cc:1240] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 LEADER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 7. Current term is 8. Ops: []
I20260709 13:08:02.161648 22128 raft_consensus.cc:3060] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:02.190891 16248 leader_election.cc:304] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:08:02.211221 22085 raft_consensus.cc:2804] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:02.211462 16248 leader_election.cc:304] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:02.212884 16248 leader_election.cc:304] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:02.213344 22139 raft_consensus.cc:2749] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:02.213939 16248 leader_election.cc:304] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:02.192644 22222 leader_election.cc:290] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:08:02.193455 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:02.185742 16914 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 1.579s (SENT) [suppressed 6 similar messages]
I20260709 13:08:02.214380 22139 raft_consensus.cc:2749] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:02.195753 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:02.195978 16348 raft_consensus.cc:2955] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Committing config change with OpId 12.11: config changed from index 10 to 11, VOTER e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:08:02.197567 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:02.197567 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:02.198355 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:02.198629 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:02.198946 22220 raft_consensus.cc:493] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.199544 16283 raft_consensus.cc:1240] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 LEADER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:02.219228 16278 raft_consensus.cc:2410] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:08:02.200829 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:02.201246 22223 raft_consensus.cc:515] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:02.202605 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:02.203383 16946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:02.204252 22183 raft_consensus.cc:515] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:02.209275 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:02.211635 22085 raft_consensus.cc:493] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:02.225056 16350 raft_consensus.cc:2393] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 19: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:08:02.200524 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:02.226073 16280 raft_consensus.cc:2468] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 16.
I20260709 13:08:02.194985 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:02.194245 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:08:02.227276 16205 raft_consensus.cc:3060] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:02.218987 16275 raft_consensus.cc:2468] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 20.
I20260709 13:08:02.233517 16357 raft_consensus.cc:2468] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 16.
I20260709 13:08:02.235466 16248 leader_election.cc:304] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:08:02.233518 22220 raft_consensus.cc:515] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:02.249028 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:02.251686 22220 leader_election.cc:290] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:02.254626 22183 leader_election.cc:290] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 21 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:08:02.255425 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 403985us
I20260709 13:08:02.261448 16320 leader_election.cc:304] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:02.273111 16204 raft_consensus.cc:2393] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 17: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:08:02.280650 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:02.233703 22175 raft_consensus.cc:493] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:08:02.256249 22085 raft_consensus.cc:3060] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:02.292541 16276 raft_consensus.cc:1275] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:08:02.256524 22043 raft_consensus.cc:2749] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:02.281379 16279 raft_consensus.cc:2468] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 14.
I20260709 13:08:02.261411 21992 raft_consensus.cc:2804] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:08:02.301563 16173 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:02.302500 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:02.303160 16278 raft_consensus.cc:2468] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 16.
I20260709 13:08:02.305698 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:02.305958 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:02.306881 16274 raft_consensus.cc:3060] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:08:02.309501 16173 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:02.314261 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:02.315456 21992 raft_consensus.cc:697] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:08:02.316535 21992 consensus_queue.cc:237] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:02.320673 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:02.322151 16280 raft_consensus.cc:2468] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 19.
I20260709 13:08:02.331048 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:02.285955 22188 raft_consensus.cc:2804] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:02.269853 22222 consensus_queue.cc:1059] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:08:02.330132 16173 leader_election.cc:304] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:08:02.334295 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:02.339157 16279 raft_consensus.cc:2393] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 18: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:08:02.349887 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:02.340607 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:02.362203 16283 raft_consensus.cc:3060] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:02.376390 16276 raft_consensus.cc:2468] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 12.
I20260709 13:08:02.365952 22180 raft_consensus.cc:2749] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:02.395639 22223 leader_election.cc:290] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 17 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:02.401726 22075 raft_consensus.cc:493] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.403034 22075 raft_consensus.cc:515] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:02.321720 22175 raft_consensus.cc:515] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:02.417922 16351 raft_consensus.cc:2468] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 13.
I20260709 13:08:02.419415 22175 leader_election.cc:290] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:02.360926 21578 consensus_queue.cc:1048] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.082s
I20260709 13:08:02.450032 21882 raft_consensus.cc:493] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.450924 21882 raft_consensus.cc:515] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:08:02.465008 16913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:02.467262 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:02.469476 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:02.476610 16945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
W20260709 13:08:02.482385 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 197392us
W20260709 13:08:02.482990 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 196223us
I20260709 13:08:02.483081 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:02.483713 22176 raft_consensus.cc:3055] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:08:02.484082 16322 leader_election.cc:304] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:02.485564 16322 leader_election.cc:304] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:02.484220 22176 raft_consensus.cc:740] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:08:02.488122 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:08:02.489099 16199 raft_consensus.cc:3060] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:02.532845 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:02.406260 22075 leader_election.cc:290] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:02.485999 21920 consensus_queue.cc:1059] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:08:02.514691 22056 raft_consensus.cc:2749] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:02.500787 21882 leader_election.cc:290] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:02.544090 16274 raft_consensus.cc:2468] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 17.
W20260709 13:08:02.536034 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 350331us
I20260709 13:08:02.545934 16205 raft_consensus.cc:2468] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 14.
I20260709 13:08:02.538703 22175 raft_consensus.cc:493] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:02.554191 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 316369us
I20260709 13:08:02.538517 21909 raft_consensus.cc:2749] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:02.582496 16283 raft_consensus.cc:2468] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 20.
I20260709 13:08:02.594347 16945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:02.600231 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:02.604123 16204 raft_consensus.cc:1275] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 20 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:08:02.576762 22188 raft_consensus.cc:697] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 17 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:08:02.584342 22199 raft_consensus.cc:493] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:02.615170 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:02.594843 22056 raft_consensus.cc:3055] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:02.621640 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:02.617344 16173 leader_election.cc:304] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:02.640905 16204 raft_consensus.cc:2410] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for term 21 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 13:08:02.641342 22128 raft_consensus.cc:2804] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:02.643148 22128 raft_consensus.cc:697] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [term 12 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:08:02.643321 22176 consensus_queue.cc:260] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:02.644398 22128 consensus_queue.cc:237] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:02.621335 22199 raft_consensus.cc:515] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:02.601961 22043 raft_consensus.cc:493] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:08:02.647022 22043 raft_consensus.cc:515] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:02.647512 22188 consensus_queue.cc:237] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:02.621909 22056 raft_consensus.cc:740] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:08:02.651082 22056 consensus_queue.cc:260] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:02.579627 22175 raft_consensus.cc:515] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:02.652666 22056 raft_consensus.cc:3060] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:02.654484 22175 leader_election.cc:290] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:02.648054 22199 leader_election.cc:290] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:02.650178 22043 leader_election.cc:290] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:02.672005 16205 raft_consensus.cc:1240] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 17. Current term is 18. Ops: []
W20260709 13:08:02.655946 21578 consensus_queue.cc:1175] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "1109f76a0b7b443a84c0327c8707bc63" responder_term: 8 status { last_received { term: 8 index: 9 } last_committed_idx: 8 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 7. Current term is 8. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:08:02.645011 22176 raft_consensus.cc:3060] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:08:02.687515 16199 raft_consensus.cc:2468] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 21.
I20260709 13:08:02.692010 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:02.692502 22233 raft_consensus.cc:493] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:08:02.693259 16207 raft_consensus.cc:2393] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 12: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:08:02.692067 16320 leader_election.cc:304] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:02.695263 22085 raft_consensus.cc:515] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:02.695307 22199 raft_consensus.cc:2804] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:08:02.696660 22199 raft_consensus.cc:697] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 21 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:08:02.697707 22085 leader_election.cc:290] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 17 election: Requested vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:02.697638 22199 consensus_queue.cc:237] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:02.698984 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:08:02.705667 16174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:02.699795 16201 raft_consensus.cc:2468] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 17.
I20260709 13:08:02.701987 16173 leader_election.cc:304] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:02.709457 16320 leader_election.cc:304] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:02.718138 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:02.719398 16275 raft_consensus.cc:3060] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:08:02.728969 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 119901us
I20260709 13:08:02.732904 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:02.733664 16276 raft_consensus.cc:2468] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 20.
I20260709 13:08:02.745601 22249 raft_consensus.cc:2804] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:08:02.746523 22249 raft_consensus.cc:697] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 20 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:08:02.747730 22249 consensus_queue.cc:237] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:02.748859 22146 raft_consensus.cc:493] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.749531 22146 raft_consensus.cc:515] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:02.752453 22146 leader_election.cc:290] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:02.754740 22253 raft_consensus.cc:2804] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:02.755584 22253 raft_consensus.cc:493] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:02.756049 22253 raft_consensus.cc:3060] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:08:02.748221 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:02.765841 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:02.773554 16201 raft_consensus.cc:1275] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:08:02.776233 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:02.780254 16173 leader_election.cc:304] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:08:02.788064 16248 leader_election.cc:304] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:08:02.790658 16104 catalog_manager.cc:5697] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: term changed from 13 to 15, leader changed from e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) to 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68). New cstate: current_term: 15 leader_uuid: "1109f76a0b7b443a84c0327c8707bc63" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:02.693254 22233 raft_consensus.cc:515] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:08:02.794911 16173 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:02.794463 16104 catalog_manager.cc:5697] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: term changed from 11 to 12, leader changed from 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) to e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65). New cstate: current_term: 12 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:08:02.795104 22232 raft_consensus.cc:2804] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:08:02.814615 22232 raft_consensus.cc:493] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:02.815003 22232 raft_consensus.cc:3060] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:02.824702 22233 leader_election.cc:290] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:02.825925 16948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
W20260709 13:08:02.833905 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 47877.2us
I20260709 13:08:02.836939 16275 raft_consensus.cc:2468] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 17.
I20260709 13:08:02.810702 22223 raft_consensus.cc:493] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:08:02.828167 22146 raft_consensus.cc:2749] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:02.851203 16248 leader_election.cc:304] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:08:02.851509 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 258995us
I20260709 13:08:02.855372 16912 leader_election.cc:304] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:02.849253 22176 raft_consensus.cc:493] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
W20260709 13:08:02.843304 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 357805us
I20260709 13:08:02.877912 16322 leader_election.cc:304] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:02.883955 16248 leader_election.cc:304] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:02.897948 16948 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4"
dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
mode: GRACEFUL
new_leader_uuid: "363bb2f744eb486f9ad726f08214c98e"
 from {username='slave'} at 127.0.0.1:58316
I20260709 13:08:02.883520 22215 raft_consensus.cc:2804] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:02.845551 22232 raft_consensus.cc:515] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:02.898715 16948 raft_consensus.cc:606] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63 [term 13 LEADER]: Received request to transfer leadership to TS 363bb2f744eb486f9ad726f08214c98e
I20260709 13:08:02.900270 16322 leader_election.cc:400] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 pre-election: Vote denied by peer 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875) with higher term. Message: Invalid argument: T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for earlier term 11. Current term is 12.
I20260709 13:08:02.851305 21962 consensus_queue.cc:1048] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 13:08:02.906389 16322 leader_election.cc:403] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:02.852041 22223 raft_consensus.cc:515] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:02.897042 22056 raft_consensus.cc:2749] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:02.882798 22184 consensus_queue.cc:1048] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.023s
I20260709 13:08:02.927155 16322 leader_election.cc:400] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Vote denied by peer 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875) with higher term. Message: Invalid argument: T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for earlier term 13. Current term is 14.
I20260709 13:08:02.927583 16322 leader_election.cc:403] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:02.905736 21986 raft_consensus.cc:2804] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:02.930305 16322 leader_election.cc:304] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:02.899570 22176 raft_consensus.cc:515] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:02.930822 21986 raft_consensus.cc:493] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:08:02.935353 21986 raft_consensus.cc:3060] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:02.935889 22259 raft_consensus.cc:2749] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:02.936663 22256 raft_consensus.cc:3060] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:08:02.937541 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:02.939041 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:02.939267 16356 raft_consensus.cc:1240] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:02.941716 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:02.942610 16350 raft_consensus.cc:2468] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 15.
I20260709 13:08:02.941948 16348 raft_consensus.cc:1217] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Deduplicated request from leader. Original: 16.10->[17.11-17.11]   Dedup: 17.11->[]
I20260709 13:08:02.943820 16348 raft_consensus.cc:1240] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 13:08:02.943709 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:02.944458 16354 raft_consensus.cc:2468] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 11.
I20260709 13:08:02.945636 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:02.947027 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:02.947649 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:02.948020 16349 raft_consensus.cc:2410] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for term 20 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
W20260709 13:08:02.933120 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 70212.5us
I20260709 13:08:02.942148 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:02.950290 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
W20260709 13:08:02.953928 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 70065.4us
I20260709 13:08:02.955113 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:02.959583 16351 raft_consensus.cc:2393] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 12: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:08:02.959643 21962 raft_consensus.cc:493] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:02.960327 21962 raft_consensus.cc:515] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:02.960673 16248 leader_election.cc:304] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:02.960754 22253 raft_consensus.cc:515] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:02.962095 16354 raft_consensus.cc:2368] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for earlier term 18. Current term is 19.
I20260709 13:08:02.917948 22184 consensus_queue.cc:1243] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Peer e10b16d536674c0bb350a31d7ce5ff7f log is divergent from this leader: its last log entry 19.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:08:02.963269 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:02.963826 22223 leader_election.cc:290] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:02.965523 16357 raft_consensus.cc:1275] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:08:02.918284 22189 raft_consensus.cc:2749] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875) with higher term. Message: Invalid argument: T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for earlier term 11. Current term is 12.
I20260709 13:08:02.917745 22085 raft_consensus.cc:2749] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:02.950839 16352 raft_consensus.cc:2468] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 17.
I20260709 13:08:02.963900 16351 raft_consensus.cc:3060] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:02.964709 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:02.967236 16248 leader_election.cc:304] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:08:02.969658 16202 raft_consensus.cc:1240] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 21 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 20. Current term is 21. Ops: [18.12-20.13]
W20260709 13:08:02.974766 16913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:02.974607 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:02.978592 16356 raft_consensus.cc:2468] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 16.
I20260709 13:08:02.980404 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:02.981123 16349 raft_consensus.cc:3060] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:02.967677 21962 leader_election.cc:290] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:03.027551 22265 consensus_queue.cc:1059] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.102s
I20260709 13:08:02.990401 16353 raft_consensus.cc:2393] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 12: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:08:03.186975 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:03.201462 16356 raft_consensus.cc:3060] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:03.188835 16352 raft_consensus.cc:1240] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 18. Current term is 19. Ops: []
I20260709 13:08:03.207751 16351 raft_consensus.cc:2410] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for term 20 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
W20260709 13:08:03.182869 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 202740us
I20260709 13:08:03.217620 16202 raft_consensus.cc:1275] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 9. (term mismatch)
I20260709 13:08:03.218149 16202 pending_rounds.cc:85] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f: Aborting all ops after (but not including) 8
I20260709 13:08:03.218434 16202 pending_rounds.cc:107] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f: Aborting uncommitted NO_OP operation due to leader change: 7.9
I20260709 13:08:03.218763 16202 raft_consensus.cc:2889] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:03.221187 16322 leader_election.cc:304] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:03.222922 22256 raft_consensus.cc:2749] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875) with higher term. Message: Invalid argument: T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for earlier term 13. Current term is 14.
I20260709 13:08:03.223968 22043 raft_consensus.cc:2804] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:03.224429 22043 raft_consensus.cc:493] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:08:03.224833 22043 raft_consensus.cc:3060] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:03.226365 16355 raft_consensus.cc:1240] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 12. Current term is 14. Ops: []
I20260709 13:08:03.193501 22085 raft_consensus.cc:2749] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:03.188540 21726 consensus_queue.cc:1059] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.040s
I20260709 13:08:03.228610 22265 raft_consensus.cc:3055] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:03.228983 22265 raft_consensus.cc:740] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:08:03.229743 22265 consensus_queue.cc:260] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:03.230981 22265 raft_consensus.cc:3060] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:03.231020 22259 raft_consensus.cc:2749] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:03.233156 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:03.188834 22215 raft_consensus.cc:697] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 14 LEADER]: Becoming Leader. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:08:03.222913 21986 raft_consensus.cc:515] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:03.243458 21986 leader_election.cc:290] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 17 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:03.229772 16322 leader_election.cc:304] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:03.245757 22189 raft_consensus.cc:2749] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:08:03.246484 16322 leader_election.cc:304] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:03.246824 21726 consensus_queue.cc:1243] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Peer e10b16d536674c0bb350a31d7ce5ff7f log is divergent from this leader: its last log entry 19.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:08:03.247409 21726 raft_consensus.cc:3055] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:08:03.247660 22189 raft_consensus.cc:2749] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:08:03.247932 21726 raft_consensus.cc:740] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:08:03.247494 22188 consensus_queue.cc:1048] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:03.248945 16322 leader_election.cc:400] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 pre-election: Vote denied by peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823) with higher term. Message: Invalid argument: T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for earlier term 15. Current term is 16.
I20260709 13:08:03.249323 16322 leader_election.cc:403] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:03.248996 21726 consensus_queue.cc:260] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:03.251201 21726 raft_consensus.cc:3060] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:03.255643 16349 raft_consensus.cc:2468] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 12.
I20260709 13:08:03.256502 16356 raft_consensus.cc:2468] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 17.
I20260709 13:08:03.257417 16322 leader_election.cc:304] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:08:03.259021 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:03.267838 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:08:03.268579 16208 raft_consensus.cc:3060] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:08:03.259008 16914 leader_election.cc:304] T 540bfc4ad793452faea5b865343aacf7 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:03.272514 22232 leader_election.cc:290] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 21 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:03.273140 22043 raft_consensus.cc:515] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:08:03.275612 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:03.259308 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 293849us
W20260709 13:08:03.289433 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 336212us
I20260709 13:08:03.289719 16322 leader_election.cc:400] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 pre-election: Vote denied by peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823) with higher term. Message: Invalid argument: T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for earlier term 11. Current term is 12.
I20260709 13:08:03.291232 16322 leader_election.cc:304] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:03.302796 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:03.303228 16322 leader_election.cc:400] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 election: Vote denied by peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823) with higher term. Message: Invalid argument: T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for earlier term 11. Current term is 12.
I20260709 13:08:03.257131 22188 raft_consensus.cc:2749] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823) with higher term. Message: Invalid argument: T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for earlier term 15. Current term is 16.
I20260709 13:08:03.304443 16104 catalog_manager.cc:5697] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "1109f76a0b7b443a84c0327c8707bc63" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:03.275943 22253 leader_election.cc:290] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 19 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:03.301175 22220 raft_consensus.cc:2749] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:08:03.368651 16246 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:03.308826 22189 raft_consensus.cc:2804] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:03.275045 22229 consensus_queue.cc:1048] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 13:08:03.401567 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:03.402339 16282 raft_consensus.cc:3060] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:03.402365 16274 raft_consensus.cc:1240] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:03.407874 16208 raft_consensus.cc:2468] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 19.
W20260709 13:08:03.397176 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 138252us
W20260709 13:08:03.365430 16103 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38842 (request call id 220) took 22818 ms (client timeout 15000 ms). Trace:
W20260709 13:08:03.424286 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 121774us
I20260709 13:08:03.254462 22215 consensus_queue.cc:237] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:03.410182 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:08:03.430198 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:03.434458 16948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:08:03.435158 16205 raft_consensus.cc:1275] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 21 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:08:03.379751 21957 raft_consensus.cc:2749] T 540bfc4ad793452faea5b865343aacf7 P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:03.429975 22233 raft_consensus.cc:493] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:03.441377 16322 leader_election.cc:304] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:08:03.442726 16283 raft_consensus.cc:1275] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:08:03.444583 16104 catalog_manager.cc:5697] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: term changed from 13 to 14, leader changed from 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) to e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65). New cstate: current_term: 14 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
W20260709 13:08:03.428867 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 59092.7us
I20260709 13:08:03.447829 16201 raft_consensus.cc:1240] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:03.455559 16282 raft_consensus.cc:2468] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 21.
W20260709 13:08:03.456029 16173 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:03.457332 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 490152us
I20260709 13:08:03.458384 16248 leader_election.cc:304] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:03.395844 22189 raft_consensus.cc:493] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:08:03.329347 22057 consensus_queue.cc:1048] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.105s
I20260709 13:08:03.452397 16320 leader_election.cc:304] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:03.463716 16173 leader_election.cc:304] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:03.482364 16248 leader_election.cc:304] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:03.484436 21578 raft_consensus.cc:2804] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:03.484563 16248 leader_election.cc:304] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:03.485244 21578 raft_consensus.cc:697] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 17 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:08:03.468699 22043 leader_election.cc:290] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 election: Requested vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:03.486208 22043 consensus_queue.cc:1048] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:03.486342 21578 consensus_queue.cc:237] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:03.488178 22043 raft_consensus.cc:2749] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:08:03.488946 22043 raft_consensus.cc:2749] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:03.463848 22189 raft_consensus.cc:3060] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:03.479146 16104 catalog_manager.cc:5697] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: term changed from 7 to 10, leader changed from 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) to e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65). New cstate: current_term: 10 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:08:03.451329 22180 raft_consensus.cc:493] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:03.494720 22146 raft_consensus.cc:2749] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:03.482686 21667 raft_consensus.cc:2804] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:03.510399 22188 raft_consensus.cc:2804] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:03.509768 22249 consensus_queue.cc:1059] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 13:08:03.524686 21667 raft_consensus.cc:493] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Starting leader election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:08:03.512701 22199 consensus_queue.cc:1048] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 13:08:03.535635 22188 raft_consensus.cc:697] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 19 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
W20260709 13:08:03.424441 16103 rpcz_store.cc:269] 0709 13:07:40.548356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:40.550335 (+  1979us) service_pool.cc:224] Handling call
0709 13:08:03.365035 (+22814700us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:00.836668 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:00.915722 (+ 79054us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:00.915800 (+    78us) write_op.cc:435] Acquired schema lock
0709 13:08:00.915845 (+    45us) tablet.cc:662] Decoding operations
0709 13:08:00.916367 (+   522us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:00.916498 (+   131us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:00.916541 (+    43us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:08:00.917008 (+   467us) tablet.cc:701] Row locks acquired
0709 13:08:00.917088 (+    80us) write_op.cc:260] PREPARE: finished
0709 13:08:00.917331 (+   243us) write_op.cc:270] Start()
0709 13:08:00.917506 (+   175us) write_op.cc:276] Timestamp: P: 1783602480917217 usec, L: 0
0709 13:08:00.917547 (+    41us) op_driver.cc:348] REPLICATION: starting
0709 13:08:00.918503 (+   956us) log.cc:844] Serialized 541 byte log entry
0709 13:08:01.827163 (+908660us) op_driver.cc:464] REPLICATION: finished
0709 13:08:01.925621 (+ 98458us) write_op.cc:301] APPLY: starting
0709 13:08:01.925737 (+   116us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:01.927614 (+  1877us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:01.927742 (+   128us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:01.928459 (+   717us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:01.928737 (+   278us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:08:01.928805 (+    68us) write_op.cc:312] APPLY: finished
0709 13:08:01.929078 (+   273us) log.cc:844] Serialized 25 byte log entry
0709 13:08:01.929273 (+   195us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:01.929363 (+    90us) write_op.cc:454] Released schema lock
0709 13:08:01.929424 (+    61us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:01.976993 (+ 47569us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:01.989116 (+ 12123us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":17221,"reported_tablets":51,"spinlock_wait_cycles":2432,"child_traces":[["op",{"apply.queue_time_us":82462,"apply.run_cpu_time_us":4226,"apply.run_wall_time_us":4231,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8307,"num_ops":1,"prepare.queue_time_us":245229,"prepare.run_cpu_time_us":43284,"prepare.run_wall_time_us":391801,"raft.queue_time_us":209857,"raft.run_cpu_time_us":24403,"raft.run_wall_time_us":64242,"replication_time_us":909442,"thread_start_us":593857,"threads_started":4,"wal-append.queue_time_us":385972,"wal-append.run_cpu_time_us":31625,"wal-append.run_wall_time_us":1610488}]]}
I20260709 13:08:03.524365 22180 raft_consensus.cc:515] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:03.576367 16104 catalog_manager.cc:5697] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: term changed from 10 to 14, leader changed from 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) to 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68). New cstate: current_term: 14 leader_uuid: "1109f76a0b7b443a84c0327c8707bc63" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:03.465085 22233 raft_consensus.cc:515] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:03.567855 21667 raft_consensus.cc:3060] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:03.590788 16283 raft_consensus.cc:1275] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
W20260709 13:08:03.606213 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 164889us
W20260709 13:08:03.627841 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 143338us
I20260709 13:08:03.631107 16248 leader_election.cc:304] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:08:03.586017 22267 log.cc:927] Time spent T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
W20260709 13:08:03.585523 22270 log.cc:927] Time spent T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:08:03.582966 22275 raft_consensus.cc:493] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:03.622285 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 198028us
I20260709 13:08:03.593214 22146 consensus_queue.cc:1059] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:08:03.607496 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:03.687299 16275 raft_consensus.cc:2468] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 18.
W20260709 13:08:03.624459 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 148174us
I20260709 13:08:03.641191 16248 leader_election.cc:304] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:03.682858 16914 leader_election.cc:304] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:03.631094 16322 leader_election.cc:304] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:03.691598 16914 leader_election.cc:304] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:08:03.599056 22188 consensus_queue.cc:237] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:08:03.708185 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 77182.1us
W20260709 13:08:03.708859 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 68246us
I20260709 13:08:03.713201 16322 leader_election.cc:304] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:08:03.714141 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 208171us
I20260709 13:08:03.664953 22269 raft_consensus.cc:2749] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:03.721863 16248 leader_election.cc:304] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:03.704690 22257 raft_consensus.cc:2804] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:03.681838 21992 consensus_queue.cc:1048] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.035s
I20260709 13:08:03.735754 16248 leader_election.cc:304] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:08:03.736125 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 44611.8us
I20260709 13:08:03.723340 22253 raft_consensus.cc:2749] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:03.727375 22057 raft_consensus.cc:2749] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:03.723582 22199 raft_consensus.cc:493] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
W20260709 13:08:03.744338 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:03.731601 22257 raft_consensus.cc:493] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:08:03.762727 16274 raft_consensus.cc:1275] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:08:03.748210 16945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:08:03.747921 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:03.749769 16282 raft_consensus.cc:1240] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:03.749411 16275 raft_consensus.cc:1240] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 21 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 20. Current term is 21. Ops: []
I20260709 13:08:03.716629 22275 raft_consensus.cc:515] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:03.739466 21957 raft_consensus.cc:2804] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:03.743502 22266 raft_consensus.cc:2804] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:03.777141 16946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:03.780357 16946 raft_consensus.cc:2468] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 18.
W20260709 13:08:03.784837 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 59673.3us
I20260709 13:08:03.786377 16173 leader_election.cc:304] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:03.787664 16276 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94"
dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
mode: GRACEFUL
new_leader_uuid: "363bb2f744eb486f9ad726f08214c98e"
 from {username='slave'} at 127.0.0.1:39058
I20260709 13:08:03.787772 16248 leader_election.cc:304] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:03.788426 16276 raft_consensus.cc:606] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Received request to transfer leadership to TS 363bb2f744eb486f9ad726f08214c98e
I20260709 13:08:03.788736 22146 raft_consensus.cc:2749] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:03.788807 16276 raft_consensus.cc:614] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:03.759500 22207 raft_consensus.cc:493] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:03.791100 21578 consensus_queue.cc:1048] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:08:03.826455 16248 leader_election.cc:304] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:03.746330 22282 raft_consensus.cc:2749] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:03.767833 22257 raft_consensus.cc:3060] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:03.829963 16248 leader_election.cc:304] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:03.766957 22180 leader_election.cc:290] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:03.746182 22189 raft_consensus.cc:515] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:03.781886 22043 raft_consensus.cc:493] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:03.782823 22279 raft_consensus.cc:2749] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:03.844055 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:08:03.848214 16946 raft_consensus.cc:1275] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [term 16 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:08:03.782128 22266 raft_consensus.cc:493] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:08:03.834595 22258 consensus_queue.cc:1059] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.022s
W20260709 13:08:03.856837 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 70558.2us
I20260709 13:08:03.856941 16947 raft_consensus.cc:1275] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:08:03.779601 21957 raft_consensus.cc:493] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:08:03.828521 22249 raft_consensus.cc:2804] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:08:03.765964 22199 raft_consensus.cc:515] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:08:03.868736 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 155677us
I20260709 13:08:03.871836 16173 leader_election.cc:304] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:03.831972 22057 raft_consensus.cc:2749] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:03.873224 21578 consensus_queue.cc:1048] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:03.889604 21578 raft_consensus.cc:2804] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:03.890045 21578 raft_consensus.cc:493] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:08:03.890398 21578 raft_consensus.cc:3060] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:03.890578 16322 leader_election.cc:304] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:03.822448 22284 raft_consensus.cc:493] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:03.855755 22176 leader_election.cc:290] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:03.868629 22266 raft_consensus.cc:3060] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:03.831562 22207 raft_consensus.cc:515] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:03.871243 21992 raft_consensus.cc:2804] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:03.831786 21985 consensus_queue.cc:1048] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 13:08:03.875002 21957 raft_consensus.cc:3060] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:03.897449 22218 raft_consensus.cc:993] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63: : Instructing follower 363bb2f744eb486f9ad726f08214c98e to start an election
I20260709 13:08:03.897687 22253 raft_consensus.cc:2749] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:03.899286 16322 leader_election.cc:304] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:08:03.871960 22281 raft_consensus.cc:493] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:08:03.903112 21992 raft_consensus.cc:493] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:03.865373 22043 raft_consensus.cc:515] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:03.887748 22249 raft_consensus.cc:697] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 21 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:08:03.934453 16945 raft_consensus.cc:3060] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:03.934602 16322 leader_election.cc:304] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:03.936349 16322 leader_election.cc:304] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:08:03.941135 21578 raft_consensus.cc:515] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:08:03.922513 21726 consensus_meta.cc:287] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63: Time spent flushing consensus metadata: real 0.671s	user 0.009s	sys 0.003s
I20260709 13:08:03.971990 22207 leader_election.cc:290] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:03.933800 22279 raft_consensus.cc:493] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:08:03.974057 22279 raft_consensus.cc:515] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:03.974932 22229 raft_consensus.cc:1081] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63 [term 13 LEADER]: Signalling peer 363bb2f744eb486f9ad726f08214c98e to start an election
W20260709 13:08:03.976960 22283 log.cc:927] Time spent T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.194s	user 0.001s	sys 0.000s
I20260709 13:08:03.977916 22275 leader_election.cc:290] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:03.978758 22291 raft_consensus.cc:493] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:08:03.979406 22291 raft_consensus.cc:515] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:03.981802 22291 leader_election.cc:290] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:03.983672 22288 raft_consensus.cc:493] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:03.985458 21578 leader_election.cc:290] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 18 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:03.997350 16948 raft_consensus.cc:2410] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for term 21 because replica has last-logged OpId of term: 20 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
I20260709 13:08:03.942930 21992 raft_consensus.cc:3060] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:03.925197 22290 raft_consensus.cc:493] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
W20260709 13:08:04.009508 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 179638us
I20260709 13:08:03.964418 22256 raft_consensus.cc:2804] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:03.976817 22279 leader_election.cc:290] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:03.982437 22291 raft_consensus.cc:2764] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 13:08:03.984508 22288 raft_consensus.cc:515] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:08:04.025732 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 89512.4us
I20260709 13:08:03.902405 22284 raft_consensus.cc:515] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:04.029023 16322 leader_election.cc:304] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:04.014269 22056 raft_consensus.cc:2749] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:04.039742 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:04.040408 16322 leader_election.cc:304] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:04.013309 22256 raft_consensus.cc:493] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting leader election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:08:04.014001 22275 raft_consensus.cc:493] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:04.043159 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:08:04.044370 16945 raft_consensus.cc:2468] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 17.
I20260709 13:08:04.046696 16322 leader_election.cc:304] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:03.963996 22281 raft_consensus.cc:515] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:08:04.050058 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 219284us
I20260709 13:08:04.063011 22253 raft_consensus.cc:2749] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:04.043988 22256 raft_consensus.cc:3060] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:08:04.061817 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 190092us
W20260709 13:08:04.081748 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 68960.8us
I20260709 13:08:04.085913 16283 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aee913c41fb9437587affa768953f637"
dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
mode: GRACEFUL
new_leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
 from {username='slave'} at 127.0.0.1:39058
I20260709 13:08:04.086834 16283 raft_consensus.cc:606] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 LEADER]: Received request to transfer leadership to TS e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:04.060277 22060 raft_consensus.cc:3060] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:04.014871 22290 raft_consensus.cc:515] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:08:04.114092 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 51237.2us
W20260709 13:08:04.123162 22285 log.cc:927] Time spent T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.255s	user 0.001s	sys 0.001s
I20260709 13:08:04.089084 22189 leader_election.cc:290] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 17 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:04.045665 22275 raft_consensus.cc:515] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:04.133337 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:04.136710 22284 leader_election.cc:290] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:04.137192 22294 raft_consensus.cc:2764] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 13:08:04.141633 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:08:04.142102 22281 leader_election.cc:290] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:04.143517 22199 leader_election.cc:290] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:04.144021 22290 leader_election.cc:290] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:04.144533 22295 consensus_queue.cc:1048] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:04.146232 22043 leader_election.cc:290] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:04.147912 22288 leader_election.cc:290] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:04.152060 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:04.152408 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:04.158255 16941 raft_consensus.cc:2393] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 18: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
I20260709 13:08:04.158696 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:08:04.167176 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 74699.1us
I20260709 13:08:04.169139 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:04.062927 22249 consensus_queue.cc:237] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:04.174101 22259 raft_consensus.cc:493] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:04.174742 22259 raft_consensus.cc:515] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:04.175562 21957 raft_consensus.cc:515] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:04.177220 22259 leader_election.cc:290] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:04.178359 16942 raft_consensus.cc:1240] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 19 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 18. Current term is 19. Ops: []
I20260709 13:08:04.178802 22288 raft_consensus.cc:493] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:04.179482 22288 raft_consensus.cc:515] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:04.180155 16283 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a"
dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
mode: GRACEFUL
new_leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
 from {username='slave'} at 127.0.0.1:39058
I20260709 13:08:04.180778 16283 raft_consensus.cc:606] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Received request to transfer leadership to TS e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:04.181121 16283 raft_consensus.cc:614] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:04.183403 21957 leader_election.cc:290] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 19 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:04.184106 22128 raft_consensus.cc:3055] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:04.184581 22128 raft_consensus.cc:740] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:08:04.185636 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:04.122423 22257 raft_consensus.cc:515] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:04.186934 16944 raft_consensus.cc:1240] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:04.188414 22257 leader_election.cc:290] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 11 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:08:04.191537 21667 consensus_meta.cc:287] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 0.579s	user 0.011s	sys 0.000s
I20260709 13:08:04.192044 21667 raft_consensus.cc:515] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:04.156531 22265 consensus_queue.cc:1048] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 13:08:04.201150 22233 leader_election.cc:290] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:04.202129 21962 raft_consensus.cc:3055] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:04.202591 21962 raft_consensus.cc:740] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:08:04.202865 22275 leader_election.cc:290] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:04.203539 21962 consensus_queue.cc:260] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:04.204555 21962 raft_consensus.cc:3060] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:04.211898 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:04.213377 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:04.214035 16354 raft_consensus.cc:2468] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 16.
I20260709 13:08:04.214952 16354 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4"
dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
 from {username='slave'} at 127.0.0.1:33486
I20260709 13:08:04.194380 21667 leader_election.cc:290] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 17 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:04.231923 22060 raft_consensus.cc:2749] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:04.246634 22288 leader_election.cc:290] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:08:04.247275 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 74198.8us
I20260709 13:08:04.214403 16350 raft_consensus.cc:1240] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 16. Current term is 17. Ops: []
W20260709 13:08:04.282507 16173 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:04.282649 16356 raft_consensus.cc:2468] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 14.
I20260709 13:08:04.266860 16354 raft_consensus.cc:493] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
W20260709 13:08:04.267910 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 44164.7us
I20260709 13:08:04.286504 16354 raft_consensus.cc:3060] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:04.285868 16357 raft_consensus.cc:1275] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:08:04.290874 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:04.291631 16355 raft_consensus.cc:3060] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:04.178030 22266 raft_consensus.cc:515] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:04.295593 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:08:04.299724 22297 raft_consensus.cc:493] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:08:04.300539 22297 raft_consensus.cc:515] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:04.302850 16283 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7"
dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
mode: GRACEFUL
new_leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
 from {username='slave'} at 127.0.0.1:39058
I20260709 13:08:04.303615 16283 raft_consensus.cc:606] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 LEADER]: Received request to transfer leadership to TS e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:04.303848 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:04.304270 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:04.292054 16248 leader_election.cc:304] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:08:04.304723 16350 raft_consensus.cc:2376] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 14. Re-sending same reply.
I20260709 13:08:04.275331 22054 raft_consensus.cc:3055] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:04.309636 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:04.309157 16276 raft_consensus.cc:1275] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:08:04.305711 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:04.336196 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:04.336480 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:04.335031 16274 raft_consensus.cc:2468] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 13.
I20260709 13:08:04.347474 16282 raft_consensus.cc:1275] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:08:04.347666 16275 raft_consensus.cc:3060] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:04.348707 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:04.349459 16277 raft_consensus.cc:2468] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 18.
I20260709 13:08:04.346755 16354 raft_consensus.cc:515] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:04.352429 15057 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:08:04.354648 22259 raft_consensus.cc:493] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:04.354938 16354 leader_election.cc:290] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:04.355383 22259 raft_consensus.cc:515] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:04.283983 21986 raft_consensus.cc:493] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:08:04.331820 22295 raft_consensus.cc:2804] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:04.357366 22295 raft_consensus.cc:697] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:08:04.338323 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:04.341190 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:04.337437 22284 consensus_queue.cc:1059] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:04.359439 16205 raft_consensus.cc:1275] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:08:04.278780 22146 raft_consensus.cc:493] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:08:04.367954 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:04.374976 16274 raft_consensus.cc:3060] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:04.360569 15057 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:04.373570 16945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
W20260709 13:08:04.376098 16246 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:04.376821 16914 leader_election.cc:304] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:08:04.386955 16275 raft_consensus.cc:2468] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 21.
I20260709 13:08:04.389643 16278 raft_consensus.cc:1275] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 21 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:08:04.295210 21726 raft_consensus.cc:493] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:04.392911 16948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:04.395165 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:04.294756 21667 raft_consensus.cc:493] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:08:04.401046 16357 raft_consensus.cc:1240] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:04.403604 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:04.404449 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:04.404850 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:04.405582 16357 raft_consensus.cc:2376] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 12. Re-sending same reply.
I20260709 13:08:04.405769 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:04.406601 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:04.407200 16357 raft_consensus.cc:2376] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 16. Re-sending same reply.
I20260709 13:08:04.411834 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:04.412072 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:04.412849 16352 raft_consensus.cc:2410] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:08:04.415205 16354 raft_consensus.cc:1275] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 9. (term mismatch)
I20260709 13:08:04.415566 16354 pending_rounds.cc:85] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e: Aborting all ops after (but not including) 8
I20260709 13:08:04.415774 16354 pending_rounds.cc:107] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e: Aborting uncommitted NO_OP operation due to leader change: 11.9
I20260709 13:08:04.415987 16354 raft_consensus.cc:2889] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:04.417465 16281 raft_consensus.cc:2393] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 14: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:08:04.417147 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:04.332227 22054 raft_consensus.cc:740] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:08:04.390300 22184 raft_consensus.cc:2764] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 13:08:04.420373 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:04.410002 21726 raft_consensus.cc:515] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:04.424639 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:04.425926 21726 leader_election.cc:290] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:04.422821 16207 raft_consensus.cc:1240] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:08:04.425848 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:04.427241 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:04.422361 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:04.428373 16353 raft_consensus.cc:3060] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:04.428267 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:04.433095 16274 raft_consensus.cc:2468] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 19.
I20260709 13:08:04.433300 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:04.435592 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:04.436298 16279 raft_consensus.cc:2393] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 17: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:08:04.394573 22223 raft_consensus.cc:493] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:04.429198 22216 consensus_queue.cc:1059] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.018s
I20260709 13:08:04.440008 22292 consensus_queue.cc:1048] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 13:08:04.408800 22275 raft_consensus.cc:493] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:04.447710 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:04.356663 21986 raft_consensus.cc:515] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:04.437888 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:04.512355 16207 raft_consensus.cc:2393] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 19: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:08:04.512454 16277 raft_consensus.cc:1240] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:04.372430 21992 raft_consensus.cc:515] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:04.460523 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:04.388921 22146 raft_consensus.cc:515] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:08:04.521679 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 78717.5us
I20260709 13:08:04.536090 16248 leader_election.cc:304] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:04.558194 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:04.419451 21667 raft_consensus.cc:515] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:04.560264 16274 raft_consensus.cc:2368] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for earlier term 18. Current term is 19.
I20260709 13:08:04.557490 16248 leader_election.cc:304] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:08:04.561295 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:04.562561 16278 raft_consensus.cc:3060] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:04.563717 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:04.563858 16356 raft_consensus.cc:2468] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 15.
I20260709 13:08:04.564492 16276 raft_consensus.cc:2468] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 15.
I20260709 13:08:04.565936 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:04.561894 16322 leader_election.cc:304] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:04.569214 16276 raft_consensus.cc:2468] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 17.
I20260709 13:08:04.523612 22060 raft_consensus.cc:493] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:08:04.573992 16276 raft_consensus.cc:1275] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:08:04.570808 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:04.448264 22288 consensus_queue.cc:1059] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.113s
I20260709 13:08:04.408047 22295 consensus_queue.cc:237] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:04.587612 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:04.588393 16356 raft_consensus.cc:1813] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Handling vote request from an unknown peer e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:04.589093 16356 raft_consensus.cc:2410] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:08:04.563362 22269 raft_consensus.cc:2749] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:08:04.592707 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:04.551627 22223 raft_consensus.cc:515] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:04.579835 22057 raft_consensus.cc:2749] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:08:04.605908 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 67374.5us
I20260709 13:08:04.524997 22275 raft_consensus.cc:515] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:08:04.594374 22256 consensus_meta.cc:287] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 0.505s	user 0.010s	sys 0.009s
W20260709 13:08:04.625257 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 63470.6us
W20260709 13:08:04.629837 16248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:04.609866 16276 raft_consensus.cc:1240] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:04.607357 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:04.625154 16356 raft_consensus.cc:2468] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 15.
I20260709 13:08:04.631062 16277 raft_consensus.cc:2468] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 15.
I20260709 13:08:04.638181 16322 leader_election.cc:304] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:08:04.599246 22297 leader_election.cc:290] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:04.581275 22060 raft_consensus.cc:515] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:04.641734 16204 raft_consensus.cc:2410] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:08:04.639746 16173 leader_election.cc:304] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:08:04.591130 22265 consensus_queue.cc:1059] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.038s
I20260709 13:08:04.643015 21992 leader_election.cc:290] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 19 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:04.643466 22146 leader_election.cc:290] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:04.645023 21986 leader_election.cc:290] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:04.645433 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:08:04.659727 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:04.660250 16942 raft_consensus.cc:3060] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:04.660497 16279 raft_consensus.cc:1275] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:08:04.660893 22060 leader_election.cc:290] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:04.646190 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:04.663139 21667 leader_election.cc:290] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:04.647861 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:04.667598 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:04.668450 16357 raft_consensus.cc:2393] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 12: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:08:04.669224 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:04.648121 16945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:04.652452 22223 leader_election.cc:290] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:04.652616 22259 leader_election.cc:290] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:04.656230 16355 raft_consensus.cc:2468] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 19.
I20260709 13:08:04.672345 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:04.673698 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:04.642035 22220 consensus_queue.cc:1048] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:08:04.643029 22277 consensus_queue.cc:1048] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.162s
I20260709 13:08:04.670287 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:04.678452 16353 raft_consensus.cc:2468] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 17.
I20260709 13:08:04.679356 16173 leader_election.cc:304] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:08:04.661520 22060 consensus_queue.cc:1048] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:08:04.679409 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:04.629426 22266 leader_election.cc:290] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:04.640689 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:04.679903 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:04.638902 22189 raft_consensus.cc:2749] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:04.687605 16278 raft_consensus.cc:2468] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 14.
I20260709 13:08:04.687621 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:04.691890 16351 raft_consensus.cc:2468] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 12.
I20260709 13:08:04.683439 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:04.684281 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:04.694417 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:04.682698 16942 raft_consensus.cc:2468] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 19.
I20260709 13:08:04.631441 22284 consensus_queue.cc:1048] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 13:08:04.678457 22298 raft_consensus.cc:2804] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:04.698715 16248 leader_election.cc:304] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:08:04.637748 22256 raft_consensus.cc:515] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:04.641783 22288 consensus_queue.cc:1059] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.047s
I20260709 13:08:04.705374 16280 raft_consensus.cc:2410] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:08:04.682899 22322 raft_consensus.cc:2749] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:04.705927 16357 raft_consensus.cc:1240] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:04.699550 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:04.706611 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:04.702922 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:04.707233 16355 raft_consensus.cc:2393] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 19: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:08:04.704602 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:04.687052 22223 raft_consensus.cc:2804] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:04.710851 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:04.711189 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:04.714891 16353 raft_consensus.cc:1275] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:08:04.701440 22298 raft_consensus.cc:493] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:08:04.719373 16349 raft_consensus.cc:1240] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:04.736675 16351 raft_consensus.cc:1240] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 18. Current term is 19. Ops: [18.14-18.14]
I20260709 13:08:04.737444 16277 raft_consensus.cc:1240] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:04.710274 22085 raft_consensus.cc:2804] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:04.743856 16350 raft_consensus.cc:1275] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:08:04.745322 16350 raft_consensus.cc:1240] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:04.757226 16348 raft_consensus.cc:1275] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:08:04.730384 22298 raft_consensus.cc:3060] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:04.759904 16353 raft_consensus.cc:1275] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:08:04.761142 16351 raft_consensus.cc:1275] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 20 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 11. (term mismatch)
W20260709 13:08:04.761348 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 102958us
I20260709 13:08:04.761780 16351 pending_rounds.cc:85] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e: Aborting all ops after (but not including) 10
I20260709 13:08:04.762162 16322 leader_election.cc:304] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:04.763023 16351 pending_rounds.cc:107] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e: Aborting uncommitted NO_OP operation due to leader change: 18.11
I20260709 13:08:04.764251 16351 raft_consensus.cc:2889] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:04.758013 22085 raft_consensus.cc:697] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:08:04.772243 22085 consensus_queue.cc:237] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:04.773139 22275 leader_election.cc:290] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:04.773577 22303 raft_consensus.cc:3055] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:04.773968 22303 raft_consensus.cc:740] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:08:04.774941 22303 consensus_queue.cc:260] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:04.775676 22057 raft_consensus.cc:993] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3: : Instructing follower e10b16d536674c0bb350a31d7ce5ff7f to start an election
I20260709 13:08:04.776227 22057 raft_consensus.cc:1081] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 LEADER]: Signalling peer e10b16d536674c0bb350a31d7ce5ff7f to start an election
I20260709 13:08:04.776275 22303 raft_consensus.cc:3060] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:04.777133 22256 leader_election.cc:290] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:04.785945 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:08:04.787209 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:08:04.787771 16200 raft_consensus.cc:3060] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:04.787827 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:04.791824 16246 leader_election.cc:304] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:04.799170 16322 leader_election.cc:304] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:04.801530 22189 consensus_queue.cc:1048] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:04.804265 21992 raft_consensus.cc:2749] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:04.805539 21992 raft_consensus.cc:993] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3: : Instructing follower e10b16d536674c0bb350a31d7ce5ff7f to start an election
I20260709 13:08:04.806031 21992 raft_consensus.cc:1081] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 LEADER]: Signalling peer e10b16d536674c0bb350a31d7ce5ff7f to start an election
I20260709 13:08:04.793618 22324 raft_consensus.cc:2749] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:04.809113 22332 raft_consensus.cc:493] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:08:04.815555 22332 raft_consensus.cc:515] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:04.822849 16246 leader_election.cc:304] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:04.809283 16200 raft_consensus.cc:2468] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 19.
I20260709 13:08:04.824404 22294 consensus_queue.cc:1048] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:04.824787 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:04.825887 22322 raft_consensus.cc:3055] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:08:04.829923 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:04.830857 16281 raft_consensus.cc:2468] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 14.
I20260709 13:08:04.838217 22054 consensus_queue.cc:260] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:04.839093 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:08:04.839392 22054 raft_consensus.cc:3060] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:04.840960 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:08:04.841596 16942 raft_consensus.cc:3055] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:04.841940 16942 raft_consensus.cc:740] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:08:04.842873 16942 consensus_queue.cc:260] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:04.844270 16942 raft_consensus.cc:3060] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:04.846285 16248 leader_election.cc:304] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:04.847819 22325 raft_consensus.cc:2749] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:08:04.849818 22128 consensus_queue.cc:260] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:04.826354 22322 raft_consensus.cc:740] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:08:04.851816 22322 consensus_queue.cc:260] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:04.852556 22282 raft_consensus.cc:2749] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:04.853272 22322 raft_consensus.cc:3060] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:04.854455 16248 leader_election.cc:304] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:04.855791 22282 raft_consensus.cc:2749] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:04.859360 16945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:04.861528 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:04.861605 16914 leader_election.cc:304] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:04.863528 22315 raft_consensus.cc:2749] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:04.865185 16945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:04.866050 16945 raft_consensus.cc:2393] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 11: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
I20260709 13:08:04.818487 22332 leader_election.cc:290] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:04.881003 16248 leader_election.cc:304] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:08:04.883157 16199 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aee913c41fb9437587affa768953f637"
dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
 from {username='slave'} at 127.0.0.1:60138
I20260709 13:08:04.883852 16199 raft_consensus.cc:493] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:04.883404 16914 leader_election.cc:304] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:04.884207 16248 leader_election.cc:304] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:04.884693 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:08:04.885236 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 62459.5us
I20260709 13:08:04.884263 16199 raft_consensus.cc:3060] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:04.890328 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:04.891081 16275 raft_consensus.cc:3060] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:04.894719 21957 raft_consensus.cc:2749] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:08:04.880081 22298 raft_consensus.cc:515] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:04.895691 16202 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7"
dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
 from {username='slave'} at 127.0.0.1:60138
I20260709 13:08:04.896306 16202 raft_consensus.cc:493] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:04.896690 16202 raft_consensus.cc:3060] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:04.897256 16914 leader_election.cc:304] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:08:04.899045 16945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:08:04.893828 16246 leader_election.cc:304] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:04.904695 16248 leader_election.cc:304] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:08:04.905134 16942 raft_consensus.cc:2468] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 14.
I20260709 13:08:04.907366 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:04.910194 16248 leader_election.cc:304] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:08:04.924124 22282 raft_consensus.cc:493] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
W20260709 13:08:04.929013 16246 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:04.933578 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:04.934993 16354 raft_consensus.cc:3060] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:04.896589 21986 raft_consensus.cc:2749] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:04.892772 22295 raft_consensus.cc:493] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:04.936493 16320 leader_election.cc:304] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:04.948868 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:08:04.898010 21962 raft_consensus.cc:2749] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:04.935946 16199 raft_consensus.cc:515] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:04.952991 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:04.953953 16356 raft_consensus.cc:2468] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 12.
I20260709 13:08:04.955180 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:04.956110 16353 raft_consensus.cc:2468] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 12.
I20260709 13:08:04.957262 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:04.958355 16351 raft_consensus.cc:2393] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 14: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:08:04.962702 16206 raft_consensus.cc:1275] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 19 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:08:04.966140 16320 leader_election.cc:304] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:04.962136 16207 raft_consensus.cc:3060] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:04.924823 22269 raft_consensus.cc:2749] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:04.984858 16275 raft_consensus.cc:2468] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 15.
I20260709 13:08:04.909279 22325 raft_consensus.cc:493] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:08:04.943230 22146 raft_consensus.cc:2749] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:04.983762 16199 leader_election.cc:290] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 16 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:04.924978 22075 raft_consensus.cc:2749] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:04.944808 22298 leader_election.cc:290] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:04.987178 16349 raft_consensus.cc:1240] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:04.988801 16278 raft_consensus.cc:1240] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:05.000063 16354 raft_consensus.cc:2468] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 16.
I20260709 13:08:05.002672 16280 raft_consensus.cc:1240] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:04.981050 22199 raft_consensus.cc:2749] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:04.977648 22060 raft_consensus.cc:2749] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:05.010804 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:04.943922 22054 consensus_queue.cc:1059] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.047s
I20260709 13:08:04.937068 22282 raft_consensus.cc:515] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:05.024324 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:05.017450 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:05.019965 22299 raft_consensus.cc:493] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:05.022642 22271 raft_consensus.cc:2804] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:04.968379 22295 raft_consensus.cc:515] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:05.004153 22269 raft_consensus.cc:493] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:08:05.007290 22223 raft_consensus.cc:697] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:08:05.044484 22054 raft_consensus.cc:3055] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:05.063587 22054 raft_consensus.cc:740] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:08:05.064807 22054 consensus_queue.cc:260] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:05.096997 16207 raft_consensus.cc:2468] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 14.
I20260709 13:08:05.066442 22054 raft_consensus.cc:3060] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:05.004587 22325 raft_consensus.cc:515] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:05.110494 22223 consensus_queue.cc:237] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:08:05.116616 22341 log.cc:927] Time spent T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:08:05.117856 16947 raft_consensus.cc:2468] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 17.
I20260709 13:08:05.120927 22295 leader_election.cc:290] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:05.088790 22180 raft_consensus.cc:3055] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:05.125442 22180 raft_consensus.cc:740] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:08:05.126524 22180 consensus_queue.cc:260] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:05.127686 22180 raft_consensus.cc:3060] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:05.054814 22299 raft_consensus.cc:515] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:08:05.134609 16915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:05.062839 22271 raft_consensus.cc:697] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 19 LEADER]: Becoming Leader. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:08:05.150353 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:05.151378 22271 consensus_queue.cc:237] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:05.139102 22299 leader_election.cc:290] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:05.166636 22325 leader_election.cc:290] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:05.062654 22259 consensus_queue.cc:1048] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.079s
I20260709 13:08:05.070737 22269 raft_consensus.cc:515] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:05.171476 22269 leader_election.cc:290] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:05.173763 22282 leader_election.cc:290] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:05.176273 22296 raft_consensus.cc:3055] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:05.176849 22296 raft_consensus.cc:740] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:08:05.178539 21974 raft_consensus.cc:3055] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:08:05.179216 21974 raft_consensus.cc:740] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:08:05.180459 21974 consensus_queue.cc:260] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:08:05.210599 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:05.225613 22319 log.cc:927] Time spent T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.526s	user 0.000s	sys 0.001s
I20260709 13:08:05.233765 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:05.234740 16352 raft_consensus.cc:2368] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 16. Current term is 17.
W20260709 13:08:05.242893 22305 log.cc:927] Time spent T 00000000000000000000000000000000 P 4dc6f08597514f4d85fd451b999b403e: Append to log took a long time: real 0.817s	user 0.004s	sys 0.001s
I20260709 13:08:05.246939 21974 raft_consensus.cc:3060] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:05.280754 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:08:05.283006 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 372885us
I20260709 13:08:05.281563 16204 raft_consensus.cc:2468] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 18.
I20260709 13:08:05.283396 16202 raft_consensus.cc:515] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:05.294410 16248 leader_election.cc:304] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:05.295794 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:05.302983 16280 raft_consensus.cc:2468] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 21.
I20260709 13:08:05.305226 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:08:05.294108 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 235795us
I20260709 13:08:05.311738 16320 leader_election.cc:304] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:05.316099 16914 leader_election.cc:304] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:05.319859 16202 leader_election.cc:290] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:05.318125 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:05.328089 16204 raft_consensus.cc:1275] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:08:05.336478 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:05.311465 22075 raft_consensus.cc:3060] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:05.338835 22184 raft_consensus.cc:2804] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:08:05.341908 22184 raft_consensus.cc:493] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:05.342299 22184 raft_consensus.cc:3060] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:08:05.344307 16173 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.646s	user 0.009s	sys 0.013s
W20260709 13:08:05.344707 16173 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.647s	user 0.009s	sys 0.013s
W20260709 13:08:05.345013 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 647240us
I20260709 13:08:05.351267 22184 raft_consensus.cc:515] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:05.354655 22184 leader_election.cc:290] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 22 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:05.321255 22220 raft_consensus.cc:2804] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:05.339679 22298 consensus_queue.cc:1048] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:08:05.315999 22057 raft_consensus.cc:2749] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:05.362143 22296 consensus_queue.cc:260] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:05.373615 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:08:05.383299 22296 raft_consensus.cc:3060] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:05.379379 22220 raft_consensus.cc:697] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 14 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:08:05.388438 22220 consensus_queue.cc:237] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:08:05.389925 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:05.390425 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:05.407460 16322 leader_election.cc:304] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:08:05.408898 16322 leader_election.cc:304] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:08:05.414358 21992 consensus_queue.cc:1048] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:05.418387 16204 raft_consensus.cc:1240] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:05.418604 22146 raft_consensus.cc:493] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:08:05.419268 22146 raft_consensus.cc:515] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:05.420295 16203 raft_consensus.cc:1275] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 19 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:08:05.410244 16322 leader_election.cc:304] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:05.421880 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:05.422500 16278 raft_consensus.cc:3060] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:05.427770 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:05.429270 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:05.441255 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:08:05.445151 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:05.450302 16207 raft_consensus.cc:1240] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:05.452304 16322 leader_election.cc:304] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:05.462430 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: true dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:05.463145 16274 raft_consensus.cc:3055] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:05.463454 16274 raft_consensus.cc:740] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:08:05.465919 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:05.466665 16283 raft_consensus.cc:3055] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:05.466962 16283 raft_consensus.cc:740] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:08:05.484176 16322 leader_election.cc:304] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:05.464164 16274 consensus_queue.cc:260] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:05.487980 16274 raft_consensus.cc:3060] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:05.499514 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:05.501572 16278 raft_consensus.cc:2468] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 22.
I20260709 13:08:05.496253 16173 leader_election.cc:304] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:05.502792 16283 consensus_queue.cc:260] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:05.507179 16282 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45210 (request call id 2749) took 1141 ms. Trace:
I20260709 13:08:05.506871 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:05.506403 16283 raft_consensus.cc:3060] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:05.505785 16173 leader_election.cc:304] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:05.512496 16322 leader_election.cc:304] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:05.495833 22085 raft_consensus.cc:493] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:05.504030 22298 raft_consensus.cc:2749] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:05.519263 16914 leader_election.cc:304] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:08:05.506644 21667 raft_consensus.cc:2749] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:05.512656 22322 raft_consensus.cc:2804] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:05.542456 16274 raft_consensus.cc:2468] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 12.
I20260709 13:08:05.513633 22324 raft_consensus.cc:493] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:05.515704 22291 raft_consensus.cc:2749] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:05.505640 22352 raft_consensus.cc:3060] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:05.522989 22328 raft_consensus.cc:493] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:05.505970 22180 consensus_queue.cc:1059] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 13:08:05.562415 22315 raft_consensus.cc:2804] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:08:05.515410 22334 consensus_queue.cc:1048] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.059s
I20260709 13:08:05.571969 22322 raft_consensus.cc:493] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:05.528689 22331 consensus_queue.cc:1059] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.050s
W20260709 13:08:05.596441 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 81483us
W20260709 13:08:05.608486 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 298914us
I20260709 13:08:05.574373 22298 raft_consensus.cc:3060] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:05.536342 22085 raft_consensus.cc:515] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:05.614341 16173 leader_election.cc:400] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 18 election: Vote denied by peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823) with higher term. Message: Invalid argument: T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for earlier term 18. Current term is 19.
W20260709 13:08:05.619542 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 107134us
I20260709 13:08:05.586081 21667 raft_consensus.cc:493] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:08:05.621521 16173 leader_election.cc:403] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 13:08:05.626403 16322 leader_election.cc:304] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:05.612131 22322 raft_consensus.cc:3060] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:05.579136 22324 raft_consensus.cc:515] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:05.630077 16322 leader_election.cc:304] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:08:05.617630 22284 raft_consensus.cc:2804] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:08:05.635164 22354 log.cc:927] Time spent T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:08:05.612248 22315 raft_consensus.cc:697] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 22 LEADER]: Becoming Leader. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:08:05.585041 22328 raft_consensus.cc:515] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:05.631309 22290 raft_consensus.cc:2749] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:05.649513 22328 leader_election.cc:290] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:05.650305 22324 leader_election.cc:290] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:05.638722 22325 raft_consensus.cc:2804] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:05.652297 22128 raft_consensus.cc:3060] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:05.652470 22325 raft_consensus.cc:697] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 15 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
W20260709 13:08:05.642845 22353 log.cc:927] Time spent T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:08:05.643350 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:05.644148 22060 raft_consensus.cc:2749] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 14 LEADER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:05.628140 22275 consensus_queue.cc:1048] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.019s
I20260709 13:08:05.647035 22146 leader_election.cc:290] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:05.651767 22075 raft_consensus.cc:2749] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:05.642387 22085 leader_election.cc:290] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:05.663810 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:05.665558 16274 raft_consensus.cc:1275] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:08:05.667148 16945 raft_consensus.cc:1275] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 19 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:08:05.677141 16283 raft_consensus.cc:2468] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 16.
W20260709 13:08:05.769932 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 105514us
I20260709 13:08:05.772476 16945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:08:05.629352 21667 raft_consensus.cc:515] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:05.777331 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:05.659274 22296 raft_consensus.cc:2749] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823) with higher term. Message: Invalid argument: T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for earlier term 18. Current term is 19.
I20260709 13:08:05.781400 16941 raft_consensus.cc:2393] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 17: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:08:05.783955 16248 leader_election.cc:304] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:05.788926 16248 leader_election.cc:304] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:08:05.789455 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:05.793473 16248 leader_election.cc:400] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 election: Vote denied by peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107) with higher term. Message: Invalid argument: T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 16. Current term is 17.
I20260709 13:08:05.794030 16248 leader_election.cc:403] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:08:05.804010 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:05.668057 22269 consensus_queue.cc:1048] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.123s
W20260709 13:08:05.820441 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 193793us
I20260709 13:08:05.822000 16173 leader_election.cc:304] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:05.825491 16173 leader_election.cc:304] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:05.801939 21974 raft_consensus.cc:2804] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:05.800940 22265 raft_consensus.cc:2804] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:05.803608 22256 raft_consensus.cc:493] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:08:05.820078 22282 raft_consensus.cc:2749] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107) with higher term. Message: Invalid argument: T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 16. Current term is 17.
I20260709 13:08:05.782928 22273 consensus_queue.cc:1048] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.045s
I20260709 13:08:05.845218 16173 leader_election.cc:304] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:08:05.828227 22296 raft_consensus.cc:2804] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:08:05.861743 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:05.834830 21974 raft_consensus.cc:493] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:08:05.835177 22324 raft_consensus.cc:493] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:05.864217 16247 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:05.838863 22233 raft_consensus.cc:2804] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:08:05.866317 16247 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:05.869603 16277 raft_consensus.cc:1275] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 13:08:05.864099 22296 raft_consensus.cc:697] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:08:05.848990 22188 raft_consensus.cc:493] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:05.780007 22315 consensus_queue.cc:237] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:05.782693 22325 consensus_queue.cc:237] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:05.870985 22328 raft_consensus.cc:493] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:08:05.887347 22328 raft_consensus.cc:515] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:05.889675 22328 leader_election.cc:290] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:08:05.890729 16249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:05.879381 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
W20260709 13:08:05.895228 22362 log.cc:927] Time spent T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.239s	user 0.001s	sys 0.000s
I20260709 13:08:05.896070 21667 leader_election.cc:290] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:05.856760 22265 raft_consensus.cc:697] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:08:05.897466 22265 consensus_queue.cc:237] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:05.867288 21974 raft_consensus.cc:3060] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:05.850078 22256 raft_consensus.cc:515] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:05.920082 16173 leader_election.cc:304] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:08:05.871239 22180 raft_consensus.cc:2749] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:05.922986 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:05.876614 22233 raft_consensus.cc:697] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 16 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:08:05.930994 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:05.933610 16173 leader_election.cc:304] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:08:05.874888 22324 raft_consensus.cc:515] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:05.939683 16173 leader_election.cc:304] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
W20260709 13:08:05.942469 22367 log.cc:927] Time spent T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:08:05.947026 16173 leader_election.cc:304] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:08:05.902990 22188 raft_consensus.cc:515] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:05.958021 16173 leader_election.cc:304] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:08:05.959846 16173 leader_election.cc:304] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:08:05.935918 22180 raft_consensus.cc:2749] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:05.948372 22365 raft_consensus.cc:2749] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:05.969866 22365 raft_consensus.cc:2749] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:05.970683 22365 raft_consensus.cc:2749] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:08:05.956640 22334 raft_consensus.cc:2804] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:05.971642 22334 raft_consensus.cc:493] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:08:05.972201 22334 raft_consensus.cc:3060] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:05.961313 22331 raft_consensus.cc:2749] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:05.978574 22324 leader_election.cc:290] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:05.982391 22256 leader_election.cc:290] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:05.983908 15057 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:05.975064 22296 consensus_queue.cc:237] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:06.017823 22298 raft_consensus.cc:2749] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:06.024772 22322 raft_consensus.cc:515] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:05.507666 16282 rpcz_store.cc:276] 0709 13:08:04.366024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:04.366187 (+   163us) service_pool.cc:224] Handling call
0709 13:08:04.392955 (+ 26768us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:04.401804 (+  8849us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:04.401834 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:04.402299 (+   465us) log.cc:844] Serialized 26 byte log entry
0709 13:08:05.231375 (+829076us) spinlock_profiling.cc:243] Waited 3.42 ms on lock 0x7b180035dd60. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f3625264de1 00007f36252715b1 00007f361c37ee07 00007f36251d9ab9 00007f361c39b69b 00007f361c39993f 00007f361c39bc02 00007f361f02320b 00007f361f028d23 00007f361f0290d1 00007f361f444a0f
0709 13:08:05.334775 (+103400us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:08:05.381003 (+ 46228us) log.cc:844] Serialized 14 byte log entry
0709 13:08:05.484477 (+103474us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:05.484598 (+   121us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:05.484663 (+    65us) raft_consensus.cc:1685] finished
0709 13:08:05.506960 (+ 22297us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:05.507114 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":111404,"prepare.queue_time_us":70164,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":51,"raft.queue_time_us":88080,"raft.run_cpu_time_us":303,"raft.run_wall_time_us":16685,"spinlock_wait_cycles":7873920,"thread_start_us":103211,"threads_started":1,"wal-append.queue_time_us":937738}
W20260709 13:08:06.028852 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 69127.5us
I20260709 13:08:06.022122 22352 raft_consensus.cc:2749] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:08:06.042759 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:06.010313 22180 raft_consensus.cc:493] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:06.012761 22365 raft_consensus.cc:493] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
W20260709 13:08:06.056562 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 44575.4us
I20260709 13:08:06.045701 22256 raft_consensus.cc:493] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:08:06.064024 22322 leader_election.cc:290] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 16 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:06.009209 22233 consensus_queue.cc:237] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:06.084652 22256 raft_consensus.cc:515] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:06.087419 22256 leader_election.cc:290] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:06.070621 22330 consensus_queue.cc:1048] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:06.043495 22331 consensus_queue.cc:1048] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.017s
W20260709 13:08:06.089963 22349 log.cc:927] Time spent T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.719s	user 0.000s	sys 0.010s
I20260709 13:08:06.054580 22298 raft_consensus.cc:493] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:08:06.090776 22298 raft_consensus.cc:515] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:06.092579 16275 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42740 (request call id 1160) took 1184 ms. Trace:
I20260709 13:08:06.093129 22298 leader_election.cc:290] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:06.092998 16275 rpcz_store.cc:276] 0709 13:08:04.907837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:04.989791 (+ 81954us) service_pool.cc:224] Handling call
0709 13:08:04.990511 (+   720us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:05.401136 (+410625us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:05.401187 (+    51us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:05.401252 (+    65us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:05.401298 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:06.092356 (+691058us) spinlock_profiling.cc:243] Waited 410 ms on lock 0x7b54001a81d4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f489e01 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6
0709 13:08:06.092406 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:06.092515 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":943699840}
I20260709 13:08:06.096889 22284 raft_consensus.cc:493] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:06.097421 22284 raft_consensus.cc:3060] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:06.051908 22180 raft_consensus.cc:515] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:06.109959 16945 raft_consensus.cc:1275] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 17 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:08:06.059872 22379 consensus_queue.cc:1048] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.052s
I20260709 13:08:06.060366 22365 raft_consensus.cc:515] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:06.122028 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:06.132154 16201 raft_consensus.cc:2468] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 18.
I20260709 13:08:06.123260 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:06.124341 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:06.125560 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:08:06.115456 22378 log.cc:927] Time spent T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.058s	user 0.001s	sys 0.001s
I20260709 13:08:06.129951 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:06.125973 22334 raft_consensus.cc:515] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:06.133414 16206 raft_consensus.cc:2468] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 19.
I20260709 13:08:06.136174 16199 raft_consensus.cc:2468] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 8.
I20260709 13:08:06.143198 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:06.143700 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:06.124202 22180 leader_election.cc:290] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:06.119771 22075 consensus_queue.cc:1048] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.031s
I20260709 13:08:06.166393 22365 leader_election.cc:290] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:06.120096 22188 leader_election.cc:290] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:08:06.171944 22128 consensus_meta.cc:287] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f: Time spent flushing consensus metadata: real 0.519s	user 0.012s	sys 0.000s
I20260709 13:08:06.172901 22334 leader_election.cc:290] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 13 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:06.174446 22296 raft_consensus.cc:493] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:06.175197 22296 raft_consensus.cc:515] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:06.155285 16200 raft_consensus.cc:1275] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:08:06.182989 16205 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39674 (request call id 1448) took 1272 ms. Trace:
I20260709 13:08:06.183595 16205 rpcz_store.cc:276] 0709 13:08:04.910127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:04.910472 (+   345us) service_pool.cc:224] Handling call
0709 13:08:06.181854 (+1271382us) spinlock_profiling.cc:243] Waited 1.9 ms on lock 0x7b5800002a98. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361c224db1 00007f361c364b71 00007f361c364a22 00007f362527dc09 00007f36243d7ee0 00007f36244a10ab 00007f36244a1131 00007f3624462fc0 00007f362444d929 00007f362444d3d2 00007f361d9c4bd4
0709 13:08:06.182154 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:06.182433 (+   279us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:06.182473 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:06.182534 (+    61us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:06.182609 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:06.182691 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:06.182864 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4368256}
I20260709 13:08:06.207826 16320 leader_election.cc:304] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:06.208511 16943 raft_consensus.cc:1240] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 22 LEADER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 21. Current term is 22. Ops: []
I20260709 13:08:06.185599 22359 raft_consensus.cc:493] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:06.210794 16320 leader_election.cc:304] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:06.216141 16320 leader_election.cc:304] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:06.147095 21974 raft_consensus.cc:515] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:06.222735 22359 raft_consensus.cc:515] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:06.223551 22220 raft_consensus.cc:2804] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:06.234711 22374 raft_consensus.cc:2804] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:06.215430 22259 raft_consensus.cc:2804] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:06.253651 22374 raft_consensus.cc:493] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:08:06.241999 22363 raft_consensus.cc:493] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:08:06.261086 22363 raft_consensus.cc:515] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:06.261806 22284 raft_consensus.cc:515] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:08:06.262394 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:06.263499 16203 raft_consensus.cc:1240] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:06.265573 22363 leader_election.cc:290] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:06.266167 22359 leader_election.cc:290] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:06.296162 22328 raft_consensus.cc:493] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:06.296392 16247 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:06.254810 22259 raft_consensus.cc:493] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:06.302311 22259 raft_consensus.cc:3060] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:06.298085 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:06.303773 21974 leader_election.cc:290] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:06.245203 22220 raft_consensus.cc:493] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:06.304590 22220 raft_consensus.cc:3060] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:06.260133 22374 raft_consensus.cc:3060] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:06.215230 22294 raft_consensus.cc:493] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:08:06.227946 22060 consensus_queue.cc:1048] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.068s
I20260709 13:08:06.312803 22259 raft_consensus.cc:515] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:06.330235 22284 leader_election.cc:290] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 18 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:06.339344 22315 raft_consensus.cc:493] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:06.340376 22249 raft_consensus.cc:3055] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:06.340073 22315 raft_consensus.cc:515] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:06.340780 22249 raft_consensus.cc:740] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:08:06.341703 22249 consensus_queue.cc:260] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:06.342495 22315 leader_election.cc:290] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:06.342700 22249 raft_consensus.cc:3060] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:08:06.372864 22338 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.746s	user 0.010s	sys 0.019s
I20260709 13:08:06.316756 22328 raft_consensus.cc:515] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:06.319813 22294 raft_consensus.cc:515] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:06.395840 16914 leader_election.cc:304] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3
W20260709 13:08:06.391587 22338 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.774s	user 0.011s	sys 0.019s
W20260709 13:08:06.397874 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 84382.2us
I20260709 13:08:06.395327 22374 raft_consensus.cc:515] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:06.396657 22315 raft_consensus.cc:493] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:06.409621 16173 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:06.398818 22054 consensus_queue.cc:1048] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.012s
I20260709 13:08:06.427395 22259 leader_election.cc:290] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 19 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:06.436302 22328 leader_election.cc:290] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:06.438061 22294 leader_election.cc:290] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:06.412797 22398 raft_consensus.cc:2804] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:06.440024 22398 raft_consensus.cc:493] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:08:06.440063 22374 leader_election.cc:290] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:06.440500 22398 raft_consensus.cc:3060] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:06.442754 22359 raft_consensus.cc:493] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:06.443384 21986 raft_consensus.cc:493] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:08:06.443673 22359 raft_consensus.cc:515] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:06.443948 21986 raft_consensus.cc:515] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:06.446053 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:08:06.449349 22265 raft_consensus.cc:493] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:06.450019 22265 raft_consensus.cc:515] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:06.453346 22265 leader_election.cc:290] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:06.453652 22296 leader_election.cc:290] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:06.446223 21986 leader_election.cc:290] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:06.404435 22233 consensus_queue.cc:1059] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.020s
I20260709 13:08:06.457492 22233 consensus_queue.cc:1243] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer 1109f76a0b7b443a84c0327c8707bc63 log is divergent from this leader: its last log entry 22.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:08:06.458040 22233 raft_consensus.cc:3055] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:08:06.458366 22233 raft_consensus.cc:740] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 21 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:08:06.459278 22233 consensus_queue.cc:260] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:06.460632 22233 raft_consensus.cc:3060] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:06.442924 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:06.442924 21992 raft_consensus.cc:493] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:06.473858 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:06.474865 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:08:06.479763 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:06.480477 16202 raft_consensus.cc:2468] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 18.
I20260709 13:08:06.485873 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:08:06.489804 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:08:06.490453 16249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:06.490710 16355 raft_consensus.cc:2393] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 17: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:08:06.487298 16278 raft_consensus.cc:1240] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 22 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 21. Current term is 22. Ops: []
I20260709 13:08:06.489583 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:06.498063 16357 raft_consensus.cc:2468] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 14.
I20260709 13:08:06.500828 16206 raft_consensus.cc:3060] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:06.508903 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:06.510372 16357 raft_consensus.cc:1275] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:08:06.496987 16320 leader_election.cc:304] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:06.509626 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:06.543829 16355 raft_consensus.cc:3060] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:06.550455 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:06.551224 16356 raft_consensus.cc:2468] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 20.
I20260709 13:08:06.542801 21992 raft_consensus.cc:515] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:06.552237 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:06.553638 16246 leader_election.cc:304] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:06.553925 21962 raft_consensus.cc:493] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:06.554090 21992 leader_election.cc:290] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:06.554494 21962 raft_consensus.cc:515] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:06.578234 21962 leader_election.cc:290] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:06.557559 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:06.579039 16277 raft_consensus.cc:2468] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 17.
I20260709 13:08:06.580189 16277 raft_consensus.cc:1240] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:06.581398 16277 raft_consensus.cc:1275] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:08:06.553365 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:06.583093 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:06.584679 22220 raft_consensus.cc:515] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:06.587996 16280 raft_consensus.cc:1240] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 LEADER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:06.596266 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:06.597198 16283 raft_consensus.cc:2468] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 19.
I20260709 13:08:06.598516 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:06.600198 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:06.601699 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:06.602463 16274 raft_consensus.cc:3060] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:06.621330 16355 raft_consensus.cc:2468] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 13.
I20260709 13:08:06.627722 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:06.629117 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bc3c8ff9b84838a2664335d7e1582b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:06.561049 22398 raft_consensus.cc:515] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:06.565537 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
W20260709 13:08:06.635860 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 82312.1us
W20260709 13:08:06.568271 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 72750.6us
W20260709 13:08:06.568549 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:06.570395 22253 raft_consensus.cc:2804] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:06.572292 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:06.574636 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:06.446286 22359 leader_election.cc:290] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:06.640827 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:06.655076 16348 raft_consensus.cc:3060] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:06.646294 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: true dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:06.642423 16246 leader_election.cc:304] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:06.655970 16357 raft_consensus.cc:3060] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:06.654938 16349 raft_consensus.cc:2468] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 12.
I20260709 13:08:06.650489 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:06.656783 16246 leader_election.cc:304] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:06.410885 22315 raft_consensus.cc:515] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:06.675395 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:06.540971 22259 raft_consensus.cc:493] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:08:06.678071 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:06.679299 16349 raft_consensus.cc:2368] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for earlier term 12. Current term is 13.
I20260709 13:08:06.681212 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:06.682365 16351 raft_consensus.cc:2376] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 17. Re-sending same reply.
I20260709 13:08:06.588081 21962 raft_consensus.cc:493] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:06.667866 22399 log.cc:927] Time spent T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.172s	user 0.001s	sys 0.000s
I20260709 13:08:06.690312 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:06.651628 21992 raft_consensus.cc:2749] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:06.639266 22282 raft_consensus.cc:493] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:06.659463 22253 raft_consensus.cc:493] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:06.696099 16355 raft_consensus.cc:3060] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:06.464666 22382 consensus_queue.cc:1059] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 13.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.211s
I20260709 13:08:06.667135 22265 raft_consensus.cc:2804] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:06.702224 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:06.703920 16351 raft_consensus.cc:1240] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:08:06.670356 22057 raft_consensus.cc:2749] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:08:06.707114 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:06.729283 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:08:06.729910 16202 raft_consensus.cc:3060] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:06.707139 22253 raft_consensus.cc:3060] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:08:06.741760 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:06.715409 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:06.716460 16322 leader_election.cc:304] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3
W20260709 13:08:06.710165 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 299661us
I20260709 13:08:06.745707 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:06.746089 16355 raft_consensus.cc:2468] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 16.
W20260709 13:08:06.709525 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 298021us
I20260709 13:08:06.724996 16348 raft_consensus.cc:2468] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 16.
I20260709 13:08:06.747097 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:06.749969 16355 raft_consensus.cc:1240] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 17. Current term is 19. Ops: []
I20260709 13:08:06.750797 22220 leader_election.cc:290] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 20 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:06.751171 16355 raft_consensus.cc:1240] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:06.752784 22315 leader_election.cc:290] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:06.710443 22282 raft_consensus.cc:515] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:06.698127 22359 consensus_queue.cc:1048] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.047s
I20260709 13:08:06.760864 22054 raft_consensus.cc:3055] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:06.761337 22054 raft_consensus.cc:740] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:08:06.762123 22057 raft_consensus.cc:493] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:08:06.762733 22057 raft_consensus.cc:515] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:08:06.765448 16104 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55244 (request call id 133) took 12604 ms (client timeout 15000 ms). Trace:
I20260709 13:08:06.762171 22054 consensus_queue.cc:260] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:06.768570 22054 raft_consensus.cc:3060] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:06.725847 22265 raft_consensus.cc:493] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:06.770120 22265 raft_consensus.cc:3060] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:06.771888 22398 leader_election.cc:290] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 13 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:08:06.765908 16104 rpcz_store.cc:269] 0709 13:07:54.161212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:54.161573 (+   361us) service_pool.cc:224] Handling call
0709 13:08:06.765358 (+12603785us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:04.034947 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:04.035531 (+   584us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:04.035568 (+    37us) write_op.cc:435] Acquired schema lock
0709 13:08:04.035587 (+    19us) tablet.cc:662] Decoding operations
0709 13:08:04.036422 (+   835us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:04.036498 (+    76us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:04.036538 (+    40us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:08:04.037078 (+   540us) tablet.cc:701] Row locks acquired
0709 13:08:04.037097 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:08:04.037253 (+   156us) write_op.cc:270] Start()
0709 13:08:04.037384 (+   131us) write_op.cc:276] Timestamp: P: 1783602484037199 usec, L: 0
0709 13:08:04.037408 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:08:04.038094 (+   686us) log.cc:844] Serialized 2452 byte log entry
0709 13:08:04.425681 (+387587us) spinlock_profiling.cc:243] Waited 8.77 ms on lock 0x7b180008f6e0. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f3625264de1 00007f36252715b1 00007f361c39c3f3 00007f361c39e7c1 00007f361c39e779 00007f361c39e709 00007f361c39e6d1 00007f361c39d9cd 000000000038f354 000000000038f199 00007f361c37f83a
0709 13:08:05.184019 (+758338us) spinlock_profiling.cc:243] Waited 5.29 ms on lock 0x7b4400022b4c. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361c224db1 00007f361c2c2c85 00007f361c2c36a2 00007f361f0351db 00007f361f030aaf 00007f361f02486e 00007f361f023bb6 00007f361f0237d8 00007f361f02d221 00007f361f02d1d9 00007f361f02d169
0709 13:08:05.634309 (+450290us) op_driver.cc:464] REPLICATION: finished
0709 13:08:05.880129 (+245820us) write_op.cc:301] APPLY: starting
0709 13:08:05.880234 (+   105us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:05.980765 (+100531us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:05.980793 (+    28us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:06.169071 (+188278us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:06.169327 (+   256us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=12,key_file_lookups=12,delta_file_lookups=12,mrs_lookups=0
0709 13:08:06.169377 (+    50us) write_op.cc:312] APPLY: finished
0709 13:08:06.169665 (+   288us) log.cc:844] Serialized 65 byte log entry
0709 13:08:06.169976 (+   311us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:06.170101 (+   125us) write_op.cc:454] Released schema lock
0709 13:08:06.170151 (+    50us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:06.170649 (+   498us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:06.170693 (+    44us) write_op.cc:454] Released schema lock
Metrics: {"dns_us":8316,"mutex_wait_us":602382,"reported_tablets":26,"spinlock_wait_cycles":1353472,"child_traces":[["op",{"apply.queue_time_us":241811,"apply.run_cpu_time_us":13659,"apply.run_wall_time_us":290481,"cfile_cache_hit":26,"cfile_cache_hit_bytes":29207,"num_ops":6,"prepare.queue_time_us":283424,"prepare.run_cpu_time_us":37247,"prepare.run_wall_time_us":87415,"raft.queue_time_us":258055,"raft.run_cpu_time_us":75369,"raft.run_wall_time_us":213242,"replication_time_us":1592228,"spinlock_wait_cycles":32409088,"thread_start_us":715800,"threads_started":4,"wal-append.queue_time_us":101465}]]}
W20260709 13:08:06.773245 16913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:06.776647 16202 raft_consensus.cc:2468] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 20.
I20260709 13:08:06.777447 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:06.724996 16274 raft_consensus.cc:2468] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 18.
I20260709 13:08:06.738687 16206 raft_consensus.cc:2468] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 19.
I20260709 13:08:06.746611 16349 raft_consensus.cc:2393] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 20: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
W20260709 13:08:06.803766 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 87441.2us
I20260709 13:08:06.804131 16348 raft_consensus.cc:2468] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 17.
I20260709 13:08:06.693085 22259 raft_consensus.cc:515] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:08:06.813230 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:06.792454 22057 leader_election.cc:290] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:06.701556 21962 raft_consensus.cc:515] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:06.803705 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:06.808384 16348 raft_consensus.cc:1240] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 12. Current term is 13. Ops: [11.8-12.9]
W20260709 13:08:06.805248 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 58224.3us
I20260709 13:08:06.812245 16320 leader_election.cc:304] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:06.833917 16322 leader_election.cc:304] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:06.844902 22215 raft_consensus.cc:493] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:06.845523 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:06.845708 22215 raft_consensus.cc:515] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:06.848080 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:06.848356 16173 leader_election.cc:304] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:08:06.849511 22361 raft_consensus.cc:2749] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:06.849675 16283 raft_consensus.cc:1275] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:08:06.850903 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:06.851851 16173 leader_election.cc:304] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:08:06.852604 22374 raft_consensus.cc:2804] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:08:06.853118 22374 raft_consensus.cc:697] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 20 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:08:06.853523 16173 leader_election.cc:304] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:08:06.854017 22374 consensus_queue.cc:237] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:06.854902 22361 raft_consensus.cc:2749] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:06.855616 22361 raft_consensus.cc:2749] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:08:06.856837 16173 leader_election.cc:304] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:08:06.857999 22361 raft_consensus.cc:2749] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:06.859329 16173 leader_election.cc:400] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 election: Vote denied by peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107) with higher term. Message: Invalid argument: T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for earlier term 12. Current term is 13.
I20260709 13:08:06.859259 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:06.858341 22281 raft_consensus.cc:2749] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:06.840149 16320 leader_election.cc:304] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:06.863148 22279 raft_consensus.cc:2804] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:06.863747 22279 raft_consensus.cc:697] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 19 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:08:06.866004 16173 leader_election.cc:304] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:06.867333 22393 raft_consensus.cc:2804] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:06.867858 22393 raft_consensus.cc:697] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 16 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:08:06.868741 16173 leader_election.cc:304] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:06.866068 22279 consensus_queue.cc:237] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:06.849776 22215 leader_election.cc:290] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:06.804268 22249 raft_consensus.cc:493] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:08:06.875478 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:06.876617 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:06.904532 16277 raft_consensus.cc:3060] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:08:06.877645 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:06.878329 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:06.879428 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:06.879694 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:06.880172 16943 raft_consensus.cc:1240] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:06.884058 22384 raft_consensus.cc:493] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:08:06.880645 16278 raft_consensus.cc:3060] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:06.892803 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:06.897774 16945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:06.880909 22303 raft_consensus.cc:493] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:06.917842 16948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:08:06.900552 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:06.884189 22296 raft_consensus.cc:2804] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:06.905694 16349 raft_consensus.cc:1275] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:08:06.903791 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:06.908003 16280 raft_consensus.cc:2393] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 12: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:08:06.908965 16351 raft_consensus.cc:1275] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:08:06.909461 16357 raft_consensus.cc:2468] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 12.
I20260709 13:08:06.929389 16348 raft_consensus.cc:1275] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:08:06.909380 16282 raft_consensus.cc:1275] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:08:06.813023 22220 raft_consensus.cc:2804] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:06.868693 22393 consensus_queue.cc:237] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:06.934983 21986 raft_consensus.cc:493] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:08:06.935472 16944 raft_consensus.cc:1275] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:08:06.935563 21986 raft_consensus.cc:515] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:06.937834 21986 leader_election.cc:290] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:06.938722 22220 raft_consensus.cc:697] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 17 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:08:06.939899 22220 consensus_queue.cc:237] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:06.925665 22296 raft_consensus.cc:493] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:06.943172 22296 raft_consensus.cc:3060] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:06.949115 22259 leader_election.cc:290] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:06.903499 22359 raft_consensus.cc:493] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:08:06.951215 22359 raft_consensus.cc:515] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:06.953543 22359 leader_election.cc:290] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:06.953975 22282 leader_election.cc:290] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:06.954656 22294 consensus_queue.cc:1059] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:06.956084 22294 raft_consensus.cc:3055] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:06.956442 22294 raft_consensus.cc:740] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:08:06.957334 22294 consensus_queue.cc:260] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:06.959920 21962 leader_election.cc:290] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:06.960963 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:06.933743 22303 raft_consensus.cc:515] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:06.964586 22294 raft_consensus.cc:3060] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:06.965412 22303 leader_election.cc:290] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:06.915273 22249 raft_consensus.cc:515] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:06.968326 22249 leader_election.cc:290] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:08:06.971153 22233 consensus_meta.cc:287] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f: Time spent flushing consensus metadata: real 0.510s	user 0.013s	sys 0.000s
I20260709 13:08:06.919540 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:06.972011 16274 raft_consensus.cc:3060] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:06.972385 16205 raft_consensus.cc:1275] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 22 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:08:06.976428 16277 raft_consensus.cc:2468] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 19.
I20260709 13:08:06.933923 16357 raft_consensus.cc:1275] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:08:06.978718 16248 leader_election.cc:304] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
W20260709 13:08:06.984470 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 56678.2us
I20260709 13:08:06.985140 16278 raft_consensus.cc:2468] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 16.
I20260709 13:08:06.987574 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f022e2e63ae4461d834e476ff2666991" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:06.993472 16248 leader_election.cc:304] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:07.015401 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:06.983549 21962 raft_consensus.cc:493] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:08:06.984449 16102 catalog_manager.cc:5697] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 12 to 17, leader changed from 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) to e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65). New cstate: current_term: 17 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } }
I20260709 13:08:07.012013 22282 raft_consensus.cc:3060] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:06.927106 22384 raft_consensus.cc:515] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:07.025796 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:07.017259 22359 raft_consensus.cc:2804] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:07.029834 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:07.027343 16102 catalog_manager.cc:5697] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:07.033041 16248 leader_election.cc:304] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:08:07.039832 22303 consensus_queue.cc:1048] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.006s
I20260709 13:08:07.046146 22303 consensus_queue.cc:1243] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Peer e10b16d536674c0bb350a31d7ce5ff7f log is divergent from this leader: its last log entry 21.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:08:07.050915 16205 pending_rounds.cc:85] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f: Aborting all ops after (but not including) 11
I20260709 13:08:07.051587 16205 pending_rounds.cc:107] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f: Aborting uncommitted NO_OP operation due to leader change: 19.12
I20260709 13:08:07.052103 16205 raft_consensus.cc:2889] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:07.052635 16205 pending_rounds.cc:107] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f: Aborting uncommitted NO_OP operation due to leader change: 21.13
I20260709 13:08:07.053017 16205 raft_consensus.cc:2889] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:07.056485 16274 raft_consensus.cc:2468] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 20.
I20260709 13:08:07.035111 16102 catalog_manager.cc:5697] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 16 to 18, leader changed from 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) to 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66). New cstate: current_term: 18 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:07.018501 22057 consensus_queue.cc:1048] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.022s
I20260709 13:08:07.030507 22359 raft_consensus.cc:493] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:08:07.067260 21992 raft_consensus.cc:2804] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:08:07.104884 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:07.098739 22359 raft_consensus.cc:3060] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:07.109843 22338 raft_consensus.cc:493] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.110407 21992 raft_consensus.cc:493] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:08:07.134362 22398 raft_consensus.cc:493] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:07.078943 16354 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.019s	sys 0.020s
I20260709 13:08:07.025736 21962 raft_consensus.cc:515] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:07.074379 16102 catalog_manager.cc:5697] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } }
I20260709 13:08:07.113351 22253 raft_consensus.cc:515] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:07.151131 16102 catalog_manager.cc:5697] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: config changed from index 10 to 11, VOTER e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) evicted. New cstate: current_term: 12 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:07.128481 21992 raft_consensus.cc:3060] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:08:07.151552 16354 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.019s	sys 0.020s
I20260709 13:08:07.144657 22398 raft_consensus.cc:515] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:07.191133 22398 leader_election.cc:290] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:07.192389 16356 raft_consensus.cc:2368] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for earlier term 18. Current term is 19.
I20260709 13:08:07.193518 22253 leader_election.cc:290] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 19 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:07.200170 21962 leader_election.cc:290] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:07.217511 16102 catalog_manager.cc:5697] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: config changed from index 6 to 10, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New cstate: current_term: 15 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:08:07.200891 21962 raft_consensus.cc:493] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:08:07.227093 21962 raft_consensus.cc:515] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:07.229467 21962 leader_election.cc:290] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:07.234898 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:08:07.235574 16202 raft_consensus.cc:3060] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:07.244562 16102 catalog_manager.cc:5697] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:07.246904 16102 catalog_manager.cc:5697] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 8 to 11. New cstate: current_term: 11 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:07.249006 16202 raft_consensus.cc:2468] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 19.
I20260709 13:08:07.248639 16102 catalog_manager.cc:5697] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 18 to 20, leader changed from 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) to 363bb2f744eb486f9ad726f08214c98e (127.14.180.67). New cstate: current_term: 20 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } }
I20260709 13:08:07.254086 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:07.250933 16320 leader_election.cc:304] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:07.135725 22338 raft_consensus.cc:515] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:07.261843 22290 raft_consensus.cc:2804] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:07.262586 22290 raft_consensus.cc:697] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 19 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:08:07.263571 22290 consensus_queue.cc:237] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:08:07.275594 16913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:07.279143 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:07.270030 22328 raft_consensus.cc:476] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 14 LEADER]: Not starting pre-election -- already a leader
I20260709 13:08:07.250973 16102 catalog_manager.cc:5697] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:07.284413 22396 raft_consensus.cc:493] T 540bfc4ad793452faea5b865343aacf7 P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:07.289795 16206 raft_consensus.cc:2468] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 11.
I20260709 13:08:07.291404 22396 raft_consensus.cc:515] T 540bfc4ad793452faea5b865343aacf7 P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:08:07.294751 22265 consensus_meta.cc:287] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3: Time spent flushing consensus metadata: real 0.524s	user 0.011s	sys 0.000s
I20260709 13:08:07.295413 22265 raft_consensus.cc:515] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:07.297401 16912 leader_election.cc:304] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:07.297636 16283 raft_consensus.cc:2393] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 19: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:08:07.298900 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:08:07.302963 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 258015us
I20260709 13:08:07.298302 22054 raft_consensus.cc:2804] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:07.305657 22396 leader_election.cc:290] T 540bfc4ad793452faea5b865343aacf7 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:08:07.309479 16246 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.610s	user 0.025s	sys 0.034s
I20260709 13:08:07.297763 22265 leader_election.cc:290] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 19 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:08:07.301575 22266 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.537s	user 0.028s	sys 0.013s
I20260709 13:08:07.286967 22296 raft_consensus.cc:515] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:07.304427 16102 catalog_manager.cc:5697] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 20 to 21, leader changed from 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) to 363bb2f744eb486f9ad726f08214c98e (127.14.180.67). New cstate: current_term: 21 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } }
W20260709 13:08:07.308781 16092 thread.cc:641] client-negotiator [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.011s	sys 0.038s
W20260709 13:08:07.314260 16246 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.615s	user 0.025s	sys 0.034s
I20260709 13:08:07.308857 22054 raft_consensus.cc:493] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:07.311080 16248 leader_election.cc:304] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
W20260709 13:08:07.322239 22266 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.557s	user 0.029s	sys 0.013s
I20260709 13:08:07.327741 16102 catalog_manager.cc:5697] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:07.310138 22384 leader_election.cc:290] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:08:07.323432 16092 thread.cc:608] client-negotiator [worker] (thread pool) Time spent starting thread: real 0.575s	user 0.012s	sys 0.038s
I20260709 13:08:07.331048 16248 leader_election.cc:304] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:08:07.324909 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 625775us
I20260709 13:08:07.333915 16246 leader_election.cc:304] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:07.340148 21962 raft_consensus.cc:2749] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:07.332327 16102 catalog_manager.cc:5697] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 10 to 11, leader changed from 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) to e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65). New cstate: current_term: 11 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:08:07.338650 16948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:07.330035 22054 raft_consensus.cc:3060] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:07.350668 16276 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.007s	sys 0.037s
I20260709 13:08:07.353582 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:07.354136 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bc3c8ff9b84838a2664335d7e1582b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:07.349622 16102 catalog_manager.cc:5697] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "1109f76a0b7b443a84c0327c8707bc63" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:08:07.355778 16102 catalog_manager.cc:5697] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 10 to 13, leader changed from 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) to 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68). New cstate: current_term: 13 leader_uuid: "1109f76a0b7b443a84c0327c8707bc63" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:08:07.356698 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:08:07.352243 16276 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.505s	user 0.007s	sys 0.037s
I20260709 13:08:07.358187 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:07.336156 22265 raft_consensus.cc:2804] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:07.360102 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:07.370149 16201 raft_consensus.cc:1275] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:08:07.370924 16206 raft_consensus.cc:2393] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 18: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:08:07.347091 22057 raft_consensus.cc:2804] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:07.369133 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:07.348440 22253 raft_consensus.cc:493] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:08:07.346225 22359 raft_consensus.cc:515] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:08:07.367678 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 379201us
I20260709 13:08:07.375375 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:07.367688 16102 catalog_manager.cc:5697] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } }
W20260709 13:08:07.372396 22374 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.010s	sys 0.045s
I20260709 13:08:07.375119 22282 raft_consensus.cc:2749] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:07.372399 22057 raft_consensus.cc:493] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:08:07.394493 16322 leader_election.cc:304] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:08:07.384737 16102 catalog_manager.cc:5697] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:07.385633 22294 raft_consensus.cc:493] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.395869 22057 raft_consensus.cc:3060] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:07.382293 22265 raft_consensus.cc:697] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:08:07.403062 16102 catalog_manager.cc:5697] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:07.421265 22265 consensus_queue.cc:237] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:07.425977 16322 leader_election.cc:304] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:08:07.387995 22374 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.531s	user 0.010s	sys 0.046s
I20260709 13:08:07.380257 22253 raft_consensus.cc:515] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:07.426311 22338 leader_election.cc:290] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:07.431447 22338 raft_consensus.cc:493] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:08:07.432063 22338 raft_consensus.cc:515] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:07.432792 22075 raft_consensus.cc:493] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:07.433472 22075 raft_consensus.cc:515] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:07.388963 21986 consensus_queue.cc:1059] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 13:08:07.406459 22259 raft_consensus.cc:2749] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:07.418787 22294 raft_consensus.cc:515] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:07.435220 21986 raft_consensus.cc:3055] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:07.463104 21986 raft_consensus.cc:740] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:08:07.464015 21986 consensus_queue.cc:260] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:07.465384 21986 raft_consensus.cc:3060] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:07.465569 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:07.437060 22393 consensus_queue.cc:1059] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 13:08:07.467468 22393 raft_consensus.cc:3055] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:07.467877 22393 raft_consensus.cc:740] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:08:07.468699 22393 consensus_queue.cc:260] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:07.469962 22393 raft_consensus.cc:3060] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:07.418109 21974 raft_consensus.cc:493] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.471750 16173 leader_election.cc:304] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 363bb2f744eb486f9ad726f08214c98e
I20260709 13:08:07.473119 16173 leader_election.cc:304] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:08:07.471596 21974 raft_consensus.cc:515] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:07.475253 21974 leader_election.cc:290] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:07.434474 22338 leader_election.cc:290] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:07.471025 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:07.476006 22359 leader_election.cc:290] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 15 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:07.477243 22233 raft_consensus.cc:2749] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:07.438230 16322 leader_election.cc:304] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:07.478678 16173 leader_election.cc:304] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:08:07.438450 22220 consensus_queue.cc:1048] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 13:08:07.438851 22249 consensus_queue.cc:1048] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 13:08:07.479709 22416 raft_consensus.cc:2749] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:07.480680 22233 raft_consensus.cc:2749] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:07.440347 22075 leader_election.cc:290] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:08:07.481807 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 43656us
I20260709 13:08:07.483186 16322 leader_election.cc:304] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:07.484692 16322 leader_election.cc:304] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:07.485983 16322 leader_election.cc:304] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:07.458824 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:07.447775 22294 leader_election.cc:290] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:07.456173 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:07.489696 22416 raft_consensus.cc:2749] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:07.486954 22281 raft_consensus.cc:2749] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:07.460386 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f022e2e63ae4461d834e476ff2666991" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:07.491607 22416 consensus_queue.cc:1048] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.002s
I20260709 13:08:07.437148 22259 raft_consensus.cc:2749] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:07.487074 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:08:07.495424 16200 raft_consensus.cc:2393] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 19: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:08:07.487586 22220 raft_consensus.cc:2749] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:07.450249 22253 leader_election.cc:290] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:07.455417 22296 leader_election.cc:290] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 18 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:07.458596 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:07.497367 16173 leader_election.cc:304] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 363bb2f744eb486f9ad726f08214c98e
I20260709 13:08:07.499150 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:07.500095 16355 raft_consensus.cc:2410] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for term 18 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260709 13:08:07.503415 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:07.511613 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:07.514194 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:07.515025 16276 raft_consensus.cc:2468] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 15.
I20260709 13:08:07.494812 21992 raft_consensus.cc:515] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:07.523720 16356 raft_consensus.cc:1240] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 8. Current term is 9. Ops: []
I20260709 13:08:07.523859 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:07.525102 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:07.525298 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:07.515086 16354 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41830 (request call id 2821) took 1023 ms. Trace:
I20260709 13:08:07.526015 16348 raft_consensus.cc:2468] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 14.
I20260709 13:08:07.527311 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:07.528784 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:07.529831 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:07.530419 16348 raft_consensus.cc:2468] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 11.
W20260709 13:08:07.535846 16247 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:07.542313 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:07.543304 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:07.544268 16276 raft_consensus.cc:1275] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 22 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:08:07.549310 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:07.550010 16283 raft_consensus.cc:2468] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 14.
I20260709 13:08:07.551047 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:07.551455 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:07.551920 16350 raft_consensus.cc:2393] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 16: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:08:07.551502 16948 raft_consensus.cc:1275] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:08:07.513513 22338 raft_consensus.cc:2804] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:07.558878 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:07.556538 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:07.563405 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:07.567032 16279 raft_consensus.cc:2393] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 19: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:08:07.568935 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:07.586803 16283 raft_consensus.cc:2468] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 13.
I20260709 13:08:07.589591 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:07.590361 16278 raft_consensus.cc:2468] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 14.
I20260709 13:08:07.555158 22075 raft_consensus.cc:493] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:07.603122 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:07.526166 16354 rpcz_store.cc:276] 0709 13:08:06.491736 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:06.491980 (+   244us) service_pool.cc:224] Handling call
0709 13:08:06.492349 (+   369us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:06.542602 (+ 50253us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:06.542635 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:06.558005 (+ 15370us) log.cc:844] Serialized 26 byte log entry
0709 13:08:07.187214 (+629209us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:08:07.513498 (+326284us) log.cc:844] Serialized 14 byte log entry
0709 13:08:07.514774 (+  1276us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:07.514864 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:07.514901 (+    37us) raft_consensus.cc:1685] finished
0709 13:08:07.514912 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:07.515029 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27838,"prepare.queue_time_us":50006,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":999,"raft.run_cpu_time_us":345,"raft.run_wall_time_us":82381,"thread_start_us":907377,"threads_started":2,"wal-append.queue_time_us":588956}
I20260709 13:08:07.608898 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:07.609871 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:07.609952 16278 raft_consensus.cc:2468] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 17.
I20260709 13:08:07.609081 16948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:07.612421 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:07.626183 16275 raft_consensus.cc:1275] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:08:07.632503 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:07.636382 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:07.653168 16279 raft_consensus.cc:1275] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:08:07.663419 21992 leader_election.cc:290] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 21 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:07.665647 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:07.668480 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:07.669354 15057 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:07.667445 22253 raft_consensus.cc:493] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.671360 22253 raft_consensus.cc:515] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:07.673532 22253 leader_election.cc:290] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:07.627321 22075 raft_consensus.cc:515] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:07.676224 22075 leader_election.cc:290] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:07.669359 16283 raft_consensus.cc:3060] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:07.667658 22054 raft_consensus.cc:515] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:07.683211 16205 raft_consensus.cc:1275] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 19 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:08:07.684530 16944 raft_consensus.cc:2393] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 12: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
W20260709 13:08:07.685747 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 298515us
I20260709 13:08:07.686146 22290 consensus_queue.cc:1048] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:07.687108 22054 leader_election.cc:290] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 12 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:07.669899 22057 raft_consensus.cc:515] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:07.692668 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:07.693444 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:08:07.693389 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:07.704563 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:07.705494 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: true dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:07.714521 16357 raft_consensus.cc:2376] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 12. Re-sending same reply.
I20260709 13:08:07.705813 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:07.715821 16356 raft_consensus.cc:3060] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:07.706874 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:07.707856 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:07.709370 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:07.705852 16322 leader_election.cc:304] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:08:07.717942 16354 raft_consensus.cc:2468] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 11.
I20260709 13:08:07.725383 16322 leader_election.cc:304] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:07.727564 22220 raft_consensus.cc:2749] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:07.729707 16322 leader_election.cc:304] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:08:07.733433 16322 leader_election.cc:304] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:08:07.734193 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 189096us
I20260709 13:08:07.735076 22259 raft_consensus.cc:2749] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:07.737074 16277 raft_consensus.cc:1240] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 12. Current term is 13. Ops: [12.9-12.9]
W20260709 13:08:07.738252 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 220702us
W20260709 13:08:07.738885 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 216193us
I20260709 13:08:07.738925 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
W20260709 13:08:07.742661 16173 leader_election.cc:336] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 2.268s (SENT)
I20260709 13:08:07.746693 16356 raft_consensus.cc:2468] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 18.
I20260709 13:08:07.749503 16283 raft_consensus.cc:2468] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 18.
I20260709 13:08:07.768718 16246 leader_election.cc:304] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:07.728175 22265 raft_consensus.cc:493] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:07.732678 22416 raft_consensus.cc:2749] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:07.732898 22384 raft_consensus.cc:2764] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 13:08:07.736260 22290 raft_consensus.cc:2749] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:08:07.782590 16246 leader_election.cc:304] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:07.790627 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:08:07.791399 16199 raft_consensus.cc:3060] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:07.799105 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:07.789252 22359 raft_consensus.cc:2749] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:07.770658 22393 consensus_queue.cc:1048] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 13:08:07.794471 22075 raft_consensus.cc:2749] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:07.794499 22338 raft_consensus.cc:697] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 18 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:08:07.778690 22265 raft_consensus.cc:515] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:07.802414 16246 leader_election.cc:304] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:07.817931 16248 leader_election.cc:304] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:08:07.801369 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 67736.9us
I20260709 13:08:07.793052 21986 consensus_queue.cc:1048] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
W20260709 13:08:07.832221 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 77035.7us
I20260709 13:08:07.834290 16322 leader_election.cc:304] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:07.855412 16199 raft_consensus.cc:2468] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 12.
I20260709 13:08:07.842131 16248 leader_election.cc:304] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:07.858107 16246 leader_election.cc:304] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:07.860844 16912 leader_election.cc:304] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
W20260709 13:08:07.869685 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 90834.4us
I20260709 13:08:07.870219 16246 leader_election.cc:304] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:07.872852 16322 leader_election.cc:304] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:07.874974 16246 leader_election.cc:304] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:07.802618 22233 consensus_queue.cc:1048] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.066s
I20260709 13:08:07.856025 22290 consensus_queue.cc:1048] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.023s
I20260709 13:08:07.873886 21962 raft_consensus.cc:2749] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:07.857973 22359 raft_consensus.cc:2749] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:07.876698 16246 leader_election.cc:304] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:07.892897 16944 raft_consensus.cc:1275] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 17 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:08:07.894385 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:07.858817 21992 raft_consensus.cc:2749] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:07.897929 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:07.905869 16349 raft_consensus.cc:3060] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:07.907838 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:07.908595 16354 raft_consensus.cc:2468] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 16.
I20260709 13:08:07.810702 22315 consensus_queue.cc:1048] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.065s
I20260709 13:08:07.900525 16356 raft_consensus.cc:1275] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:08:07.902465 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:07.911425 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:08:07.903101 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:07.903119 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:07.831140 22249 consensus_queue.cc:1048] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.065s
I20260709 13:08:07.880554 21974 raft_consensus.cc:2749] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:07.868577 22259 raft_consensus.cc:2749] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:07.916484 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:07.879168 22075 raft_consensus.cc:2749] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:07.919044 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c15d8e9be8414c84912ab77b66bfb1" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:07.915339 16280 raft_consensus.cc:1240] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 21 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 20. Current term is 21. Ops: []
I20260709 13:08:07.920714 16281 raft_consensus.cc:1275] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 13. (term mismatch)
I20260709 13:08:07.930428 16248 leader_election.cc:304] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:07.930755 16281 pending_rounds.cc:85] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3: Aborting all ops after (but not including) 12
I20260709 13:08:07.904631 22359 raft_consensus.cc:2749] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:07.904036 22189 raft_consensus.cc:2749] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:07.920912 16322 leader_election.cc:304] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:08:07.880146 22057 leader_election.cc:290] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:07.878912 22265 leader_election.cc:290] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:07.931345 16281 pending_rounds.cc:107] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3: Aborting uncommitted NO_OP operation due to leader change: 17.13
I20260709 13:08:07.879202 22266 raft_consensus.cc:2749] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:07.881819 22296 consensus_queue.cc:1048] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 13:08:07.875195 22433 consensus_queue.cc:1048] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.066s
I20260709 13:08:07.879237 22253 consensus_queue.cc:1048] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.049s
I20260709 13:08:07.932629 16349 raft_consensus.cc:2468] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 12.
I20260709 13:08:07.934019 16280 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439"
dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
mode: GRACEFUL
new_leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
 from {username='slave'} at 127.0.0.1:39058
I20260709 13:08:07.939728 16281 raft_consensus.cc:2889] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:07.955708 16280 raft_consensus.cc:606] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 22 FOLLOWER]: Received request to transfer leadership to TS e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:07.956375 16280 raft_consensus.cc:614] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 22 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:07.946615 16248 leader_election.cc:304] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:07.958964 16248 leader_election.cc:304] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:08:07.962069 22265 raft_consensus.cc:2749] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:08:07.962779 21974 raft_consensus.cc:2749] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:08:07.963400 22428 log.cc:927] Time spent T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
I20260709 13:08:07.949072 22432 consensus_queue.cc:1059] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:08:07.965569 22432 raft_consensus.cc:3055] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:07.959892 22445 raft_consensus.cc:2804] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:07.966034 22432 raft_consensus.cc:740] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:08:07.966902 22445 raft_consensus.cc:697] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 12 LEADER]: Becoming Leader. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:08:07.967519 22432 consensus_queue.cc:260] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:07.967914 22445 consensus_queue.cc:237] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:07.969192 16944 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867"
dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
mode: GRACEFUL
new_leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
 from {username='slave'} at 127.0.0.1:58316
I20260709 13:08:07.969870 16944 raft_consensus.cc:606] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 LEADER]: Received request to transfer leadership to TS e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:07.935375 22338 consensus_queue.cc:237] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:07.941717 22298 raft_consensus.cc:2749] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:07.956009 22359 raft_consensus.cc:2749] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:08:07.999420 22435 log.cc:927] Time spent T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
W20260709 13:08:08.001217 22431 log.cc:927] Time spent T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:08:08.001487 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:08:08.008448 22440 log.cc:927] Time spent T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
W20260709 13:08:08.010692 22430 log.cc:927] Time spent T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.216s	user 0.000s	sys 0.001s
W20260709 13:08:08.012944 22443 log.cc:927] Time spent T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.136s	user 0.000s	sys 0.001s
W20260709 13:08:08.048833 22427 log.cc:927] Time spent T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.175s	user 0.000s	sys 0.003s
I20260709 13:08:08.049914 16283 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6"
dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
mode: GRACEFUL
new_leader_uuid: "363bb2f744eb486f9ad726f08214c98e"
 from {username='slave'} at 127.0.0.1:39058
I20260709 13:08:08.050590 16283 raft_consensus.cc:606] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Received request to transfer leadership to TS 363bb2f744eb486f9ad726f08214c98e
I20260709 13:08:08.050952 16283 raft_consensus.cc:614] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:08.041023 22422 raft_consensus.cc:493] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:08:08.052150 22422 raft_consensus.cc:515] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:08:08.059650 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 188826us
I20260709 13:08:08.070880 22429 raft_consensus.cc:493] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:08:08.070341 16173 leader_election.cc:304] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63
W20260709 13:08:08.078812 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 166662us
I20260709 13:08:08.094133 16200 raft_consensus.cc:1240] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:08.094712 16204 raft_consensus.cc:1275] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260709 13:08:08.104328 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 162255us
W20260709 13:08:08.116218 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 45976us
I20260709 13:08:08.117174 16173 leader_election.cc:304] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:08:08.110600 16914 leader_election.cc:304] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 363bb2f744eb486f9ad726f08214c98e
I20260709 13:08:08.087327 22432 raft_consensus.cc:3060] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:08.094687 22279 raft_consensus.cc:493] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:08:08.128502 16279 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aee913c41fb9437587affa768953f637"
dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
mode: GRACEFUL
new_leader_uuid: "363bb2f744eb486f9ad726f08214c98e"
 from {username='slave'} at 127.0.0.1:39058
I20260709 13:08:08.130112 16279 raft_consensus.cc:606] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Received request to transfer leadership to TS 363bb2f744eb486f9ad726f08214c98e
I20260709 13:08:08.129994 16173 leader_election.cc:304] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:08:08.130617 16279 raft_consensus.cc:614] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:08.103016 22406 raft_consensus.cc:493] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:08:08.071475 22429 raft_consensus.cc:515] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:08.126137 22384 raft_consensus.cc:2764] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:08:08.168776 22266 consensus_queue.cc:1059] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 13:08:08.191457 22266 raft_consensus.cc:3055] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:08.191959 22266 raft_consensus.cc:740] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:08:08.193041 22266 consensus_queue.cc:260] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:08:08.199710 22438 log.cc:927] Time spent T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.229s	user 0.002s	sys 0.000s
W20260709 13:08:08.200124 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 70196.4us
I20260709 13:08:08.201714 16173 leader_election.cc:304] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
W20260709 13:08:08.173403 22444 log.cc:927] Time spent T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.204s	user 0.001s	sys 0.002s
I20260709 13:08:08.128507 22265 consensus_queue.cc:1048] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 13:08:08.219561 22303 raft_consensus.cc:493] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:08.220252 22303 raft_consensus.cc:515] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:08.176204 22396 raft_consensus.cc:993] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63: : Instructing follower e10b16d536674c0bb350a31d7ce5ff7f to start an election
I20260709 13:08:08.221518 22396 raft_consensus.cc:1081] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 LEADER]: Signalling peer e10b16d536674c0bb350a31d7ce5ff7f to start an election
I20260709 13:08:08.176642 22382 consensus_queue.cc:1048] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:08.113973 22352 consensus_queue.cc:1048] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.051s
W20260709 13:08:08.179767 22448 log.cc:927] Time spent T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.218s	user 0.002s	sys 0.000s
I20260709 13:08:08.181162 16279 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba"
dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
mode: GRACEFUL
new_leader_uuid: "363bb2f744eb486f9ad726f08214c98e"
 from {username='slave'} at 127.0.0.1:39058
I20260709 13:08:08.133339 22279 raft_consensus.cc:515] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:08.188750 22429 leader_election.cc:290] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:08.169308 22433 raft_consensus.cc:2749] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:08.216945 22233 raft_consensus.cc:2749] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:08.248487 22303 leader_election.cc:290] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:08.250291 16279 raft_consensus.cc:606] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 LEADER]: Received request to transfer leadership to TS 363bb2f744eb486f9ad726f08214c98e
W20260709 13:08:08.253180 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 51613.3us
I20260709 13:08:08.258651 22279 leader_election.cc:290] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:08.280750 16202 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867"
dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
 from {username='slave'} at 127.0.0.1:39674
I20260709 13:08:08.281821 16202 raft_consensus.cc:493] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:08.282384 16202 raft_consensus.cc:3060] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:08:08.286171 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 156987us
I20260709 13:08:08.269250 16173 leader_election.cc:304] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:08.254827 22296 raft_consensus.cc:2749] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:08.296370 22265 raft_consensus.cc:493] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:08.297267 16279 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7"
dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
mode: GRACEFUL
new_leader_uuid: "363bb2f744eb486f9ad726f08214c98e"
 from {username='slave'} at 127.0.0.1:39058
I20260709 13:08:08.287892 16914 leader_election.cc:304] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:08:08.307439 16279 raft_consensus.cc:606] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Received request to transfer leadership to TS 363bb2f744eb486f9ad726f08214c98e
I20260709 13:08:08.307817 16279 raft_consensus.cc:614] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:08.308404 16914 leader_election.cc:304] T 540bfc4ad793452faea5b865343aacf7 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:08.306845 22265 raft_consensus.cc:515] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } }
I20260709 13:08:08.309286 22432 raft_consensus.cc:2804] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:08.309770 22266 raft_consensus.cc:3060] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:08.310406 22303 raft_consensus.cc:2749] T 540bfc4ad793452faea5b865343aacf7 P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:08.309772 22432 raft_consensus.cc:493] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:08.312173 16914 leader_election.cc:304] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:08:08.317274 16914 leader_election.cc:304] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:08:08.318639 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:08:08.319401 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 192145us
I20260709 13:08:08.321156 16355 raft_consensus.cc:1275] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:08:08.323493 16248 leader_election.cc:304] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:08.327692 15057 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:08:08.330070 15057 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:08.332710 16248 leader_election.cc:304] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:08.324044 22432 raft_consensus.cc:3060] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:08.325843 22398 raft_consensus.cc:2804] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:08.251552 22406 raft_consensus.cc:515] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:08.350595 22290 raft_consensus.cc:493] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:08.352291 22290 raft_consensus.cc:515] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:08.353456 22422 leader_election.cc:290] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:08.355757 16248 leader_election.cc:304] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:08.356956 16248 leader_election.cc:304] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:08.361076 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:08.363881 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:08.364674 16277 raft_consensus.cc:2393] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 13: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
I20260709 13:08:08.365278 16202 raft_consensus.cc:515] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:08.354454 22290 leader_election.cc:290] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:08.357787 16914 leader_election.cc:304] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:08.350267 21962 consensus_queue.cc:1048] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.069s
I20260709 13:08:08.334403 21986 raft_consensus.cc:2804] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:08.415093 21992 raft_consensus.cc:2749] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:08.422704 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:08.323293 22433 raft_consensus.cc:2804] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:08.326074 22303 raft_consensus.cc:2804] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:08:08.420894 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 59078us
I20260709 13:08:08.440321 16248 leader_election.cc:304] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:08.415383 22075 raft_consensus.cc:2749] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:08:08.427850 21986 raft_consensus.cc:493] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:08.447500 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 91965.1us
I20260709 13:08:08.424780 22359 raft_consensus.cc:2749] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:08.424363 22398 raft_consensus.cc:697] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 13 LEADER]: Becoming Leader. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
W20260709 13:08:08.450836 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 93139.5us
I20260709 13:08:08.460240 16202 leader_election.cc:290] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:08.414366 22393 consensus_queue.cc:1059] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 13:08:08.443007 22303 raft_consensus.cc:493] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:08.442009 22457 raft_consensus.cc:2804] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:08.450045 21986 raft_consensus.cc:3060] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:08.445731 22433 raft_consensus.cc:697] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 18 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:08:08.448128 22454 raft_consensus.cc:2749] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:08.427877 22455 consensus_queue.cc:1059] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.054s
W20260709 13:08:08.506765 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 58559.7us
I20260709 13:08:08.464437 22265 leader_election.cc:290] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:08.500409 22447 raft_consensus.cc:493] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:08.506204 22279 raft_consensus.cc:493] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:08:08.477792 22303 raft_consensus.cc:3060] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:08.464342 22249 consensus_queue.cc:1048] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 13:08:08.533228 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: true dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:08:08.535172 16944 raft_consensus.cc:3055] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:08:08.535617 16944 raft_consensus.cc:740] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:08:08.549109 16944 consensus_queue.cc:260] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:08.552830 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:08.554297 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:08.552983 16944 raft_consensus.cc:3060] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:08.556744 16202 raft_consensus.cc:2393] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 13: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
W20260709 13:08:08.583431 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 260664us
I20260709 13:08:08.585856 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:08.586915 16274 raft_consensus.cc:1240] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:08.591192 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: true dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:08.591943 16274 raft_consensus.cc:3060] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:08.593743 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:08.594506 16280 raft_consensus.cc:2468] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 13.
I20260709 13:08:08.552024 22456 raft_consensus.cc:3055] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:08:08.577605 22315 raft_consensus.cc:2749] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:08.577414 22259 raft_consensus.cc:493] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:08.718479 16274 raft_consensus.cc:2468] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 9.
I20260709 13:08:08.546118 22279 raft_consensus.cc:515] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:08:08.720463 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RunLeaderElection -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 79033.3us
I20260709 13:08:08.633977 22393 consensus_queue.cc:1243] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer 0aea40d6e4374085a2e38a70a71f63e3 log is divergent from this leader: its last log entry 11.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:08:08.546306 22447 raft_consensus.cc:515] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:08:08.741439 22443 log.cc:927] Time spent T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
W20260709 13:08:08.776129 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 131884us
I20260709 13:08:08.596174 22406 leader_election.cc:290] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:08.596951 22398 consensus_queue.cc:237] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:08.747517 22456 raft_consensus.cc:740] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 20 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
W20260709 13:08:08.783862 22444 log.cc:927] Time spent T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.080s	user 0.003s	sys 0.000s
W20260709 13:08:08.847488 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 239976us
I20260709 13:08:08.876999 22456 consensus_queue.cc:260] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:08.878741 22456 raft_consensus.cc:3060] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:08.879817 22296 raft_consensus.cc:3055] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:08.880306 22296 raft_consensus.cc:740] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:08:08.785445 22485 consensus_queue.cc:1059] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.096s
I20260709 13:08:08.881206 22296 consensus_queue.cc:260] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:08:08.641424 22425 log.cc:927] Time spent T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
W20260709 13:08:08.876916 22482 log.cc:927] Time spent T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:08:08.887553 16322 leader_election.cc:304] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:08:08.773478 22475 raft_consensus.cc:493] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
W20260709 13:08:08.891323 16247 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:08.909968 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:08.912016 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:08.912498 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c15d8e9be8414c84912ab77b66bfb1" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:08.914696 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:08.915560 16355 raft_consensus.cc:2393] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 14: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:08:08.916723 16248 leader_election.cc:304] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:08.918947 21992 raft_consensus.cc:2749] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:08.919421 22470 raft_consensus.cc:3055] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:08.919982 22470 raft_consensus.cc:740] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
W20260709 13:08:08.920379 22474 log.cc:927] Time spent T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 13:08:08.920536 21992 raft_consensus.cc:993] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3: : Instructing follower 363bb2f744eb486f9ad726f08214c98e to start an election
I20260709 13:08:08.927140 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:08.875049 22393 raft_consensus.cc:493] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:08.948019 16353 raft_consensus.cc:1275] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:08:08.901763 22296 raft_consensus.cc:3060] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:08.816571 22259 raft_consensus.cc:515] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:08:08.995232 22472 log.cc:927] Time spent T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63: Append to log took a long time: real 0.136s	user 0.000s	sys 0.000s
W20260709 13:08:08.996701 22467 log.cc:927] Time spent T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.267s	user 0.001s	sys 0.000s
I20260709 13:08:08.639999 22433 consensus_queue.cc:237] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:08.949273 21962 raft_consensus.cc:1081] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 LEADER]: Signalling peer 363bb2f744eb486f9ad726f08214c98e to start an election
W20260709 13:08:09.000236 22466 log.cc:927] Time spent T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
I20260709 13:08:08.884727 22328 raft_consensus.cc:493] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:08.952225 22281 raft_consensus.cc:2749] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:08.906857 22475 raft_consensus.cc:515] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:08:09.054592 22432 consensus_meta.cc:287] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63: Time spent flushing consensus metadata: real 0.688s	user 0.002s	sys 0.017s
I20260709 13:08:09.055114 22432 raft_consensus.cc:515] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:09.057418 22432 leader_election.cc:290] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 15 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:09.015130 22470 consensus_queue.cc:260] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:09.059172 22470 raft_consensus.cc:3060] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:08:09.063732 22487 log.cc:927] Time spent T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:08:09.073537 22447 leader_election.cc:290] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:08:09.030887 22429 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.008s	sys 0.032s
W20260709 13:08:09.075400 22429 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.562s	user 0.008s	sys 0.032s
W20260709 13:08:09.078119 22266 consensus_meta.cc:287] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3: Time spent flushing consensus metadata: real 0.768s	user 0.006s	sys 0.005s
I20260709 13:08:09.079164 22279 leader_election.cc:290] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:08:09.083087 16349 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.656s	user 0.009s	sys 0.017s
W20260709 13:08:09.083366 16944 consensus_meta.cc:287] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63: Time spent flushing consensus metadata: real 0.524s	user 0.010s	sys 0.000s
I20260709 13:08:08.955252 22393 raft_consensus.cc:515] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:09.084048 16277 raft_consensus.cc:2468] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 13.
I20260709 13:08:09.084162 16944 raft_consensus.cc:2468] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 9.
W20260709 13:08:09.090153 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 171780us
W20260709 13:08:09.097555 16349 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.656s	user 0.009s	sys 0.017s
W20260709 13:08:09.175402 16174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:09.021677 22477 consensus_queue.cc:1048] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.061s
W20260709 13:08:09.218078 16914 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.684s	user 0.030s	sys 0.102s
W20260709 13:08:09.218521 16914 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.685s	user 0.030s	sys 0.102s
W20260709 13:08:09.218827 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 756102us
W20260709 13:08:09.220465 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 127792us
I20260709 13:08:09.045233 22328 raft_consensus.cc:515] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:09.099897 21962 raft_consensus.cc:493] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
W20260709 13:08:09.227622 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 482075us
W20260709 13:08:09.229782 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:09.302838 16173 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:09.303328 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 76938.2us
W20260709 13:08:09.251091 16092 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 73757c6fea8949e090aa4e55902a41d4 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER failed with leader 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 1109f76a0b7b443a84c0327c8707bc63 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 14 committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:08:09.223515 22481 raft_consensus.cc:493] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:08:09.325820 16207 raft_consensus.cc:1275] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 13:08:09.330386 16092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 104453us
I20260709 13:08:09.332342 22328 leader_election.cc:290] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:09.334426 22491 raft_consensus.cc:493] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
W20260709 13:08:09.334605 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 82614.1us
I20260709 13:08:09.335175 22491 raft_consensus.cc:515] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:09.335700 22259 leader_election.cc:290] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:09.336040 16322 leader_election.cc:304] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:09.337285 22491 leader_election.cc:290] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:09.339314 22220 raft_consensus.cc:2749] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:09.342779 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:09.343637 16353 raft_consensus.cc:2468] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 14.
I20260709 13:08:09.345019 16348 raft_consensus.cc:1275] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:08:09.346799 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:09.347362 16348 raft_consensus.cc:3060] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:09.317592 22490 raft_consensus.cc:493] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:09.356042 22490 raft_consensus.cc:515] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:09.303999 22455 raft_consensus.cc:493] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:09.359140 22455 raft_consensus.cc:515] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:08:09.362387 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 52175.8us
I20260709 13:08:09.362232 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:09.338279 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:09.364203 16944 raft_consensus.cc:2393] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 9: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:08:09.364545 16248 leader_election.cc:304] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:09.322954 16173 leader_election.cc:304] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:09.376101 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:09.376632 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:09.378134 16279 raft_consensus.cc:1275] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:08:09.378865 16248 leader_election.cc:304] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:09.358330 22490 leader_election.cc:290] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:09.382340 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:08:09.376156 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 53343.3us
I20260709 13:08:09.306201 22384 raft_consensus.cc:493] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:09.361186 22455 leader_election.cc:290] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:09.395315 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
W20260709 13:08:09.396623 22461 log.cc:927] Time spent T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63: Append to log took a long time: real 0.889s	user 0.003s	sys 0.010s
I20260709 13:08:09.398409 22475 leader_election.cc:290] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:09.400630 22422 raft_consensus.cc:2749] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:09.408075 22282 consensus_queue.cc:1048] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 13:08:09.408154 16941 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35122 (request call id 816) took 1048 ms. Trace:
W20260709 13:08:09.395352 22460 log.cc:927] Time spent T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.109s	user 0.000s	sys 0.004s
W20260709 13:08:09.391134 22303 consensus_meta.cc:287] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63: Time spent flushing consensus metadata: real 0.813s	user 0.014s	sys 0.000s
I20260709 13:08:09.383924 22296 raft_consensus.cc:2804] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:09.412384 16349 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41832 (request call id 2582) took 1091 ms. Trace:
I20260709 13:08:09.414883 16277 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45210 (request call id 2821) took 1018 ms. Trace:
I20260709 13:08:09.435266 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:09.450997 16275 raft_consensus.cc:3060] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:08:09.436864 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 133900us
I20260709 13:08:09.371269 16348 raft_consensus.cc:2468] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 15.
W20260709 13:08:09.412957 22478 log.cc:927] Time spent T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.513s	user 0.000s	sys 0.016s
I20260709 13:08:09.449791 16277 rpcz_store.cc:276] 0709 13:08:08.396124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.422372 (+ 26248us) service_pool.cc:224] Handling call
0709 13:08:09.414676 (+992304us) spinlock_profiling.cc:243] Waited 655 ms on lock 0x7b54000028d4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:08:09.414812 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1506665216}
I20260709 13:08:09.454809 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:09.452950 16914 leader_election.cc:304] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:08:09.448161 16349 rpcz_store.cc:276] 0709 13:08:08.320827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.321398 (+   571us) service_pool.cc:224] Handling call
0709 13:08:08.321682 (+   284us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:08.426518 (+104836us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:08.426564 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:08.427094 (+   530us) log.cc:844] Serialized 26 byte log entry
0709 13:08:09.098409 (+671315us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:09.098474 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:09.098599 (+   125us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:09.412139 (+313540us) raft_consensus.cc:1685] finished
0709 13:08:09.412159 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:09.412283 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":104429,"raft.queue_time_us":121744,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":18742,"thread_start_us":670863,"threads_started":1,"wal-append.queue_time_us":983293}
I20260709 13:08:09.425678 16941 rpcz_store.cc:276] 0709 13:08:08.359682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.360656 (+   974us) service_pool.cc:224] Handling call
0709 13:08:08.360942 (+   286us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:08.448861 (+ 87919us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:08.448883 (+    22us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:08.465917 (+ 17034us) log.cc:844] Serialized 26 byte log entry
0709 13:08:08.560161 (+ 94244us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:08.560222 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:09.407682 (+847460us) spinlock_profiling.cc:243] Waited 59.3 ms on lock 0x7b54007eca54. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f489e01 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6
0709 13:08:09.407750 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:09.407803 (+    53us) raft_consensus.cc:1685] finished
0709 13:08:09.407816 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:09.408075 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":97760,"raft.queue_time_us":30885,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":15286,"spinlock_wait_cycles":136502016,"thread_start_us":57077,"threads_started":1,"wal-append.queue_time_us":113735}
I20260709 13:08:09.458686 16276 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45210 (request call id 2820) took 1094 ms. Trace:
I20260709 13:08:09.466419 16276 rpcz_store.cc:276] 0709 13:08:08.363764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.364827 (+  1063us) service_pool.cc:224] Handling call
0709 13:08:08.365197 (+   370us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:08.420400 (+ 55203us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:08.420439 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:09.226882 (+806443us) spinlock_profiling.cc:243] Waited 3.11 ms on lock 0x7b2c0000ffe8. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361dd82a11 00007f361dd92372 00007f361f4c4a01 00007f361f48943a 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2
0709 13:08:09.227277 (+   395us) log.cc:844] Serialized 26 byte log entry
0709 13:08:09.392181 (+164904us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:08:09.392381 (+   200us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:09.398574 (+  6193us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:09.438726 (+ 40152us) raft_consensus.cc:1685] finished
0709 13:08:09.438759 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:09.458586 (+ 19827us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":54712,"raft.queue_time_us":59024,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":13896,"spinlock_wait_cycles":7151872,"thread_start_us":163698,"threads_started":1,"wal-append.queue_time_us":195772}
I20260709 13:08:09.418251 22393 leader_election.cc:290] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:09.412088 22486 raft_consensus.cc:2749] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:08:09.470904 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:09.409766 22490 raft_consensus.cc:493] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
W20260709 13:08:09.458832 21986 consensus_meta.cc:287] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3: Time spent flushing consensus metadata: real 0.928s	user 0.008s	sys 0.009s
I20260709 13:08:09.371793 22481 raft_consensus.cc:515] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:09.467118 22485 raft_consensus.cc:493] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:09.483717 16278 raft_consensus.cc:2468] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 14.
I20260709 13:08:09.470584 22406 raft_consensus.cc:493] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:09.401144 21962 raft_consensus.cc:515] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:09.473695 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:09.495633 16281 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45210 (request call id 2817) took 1136 ms. Trace:
I20260709 13:08:09.454072 22303 raft_consensus.cc:515] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:09.485433 16173 leader_election.cc:304] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:08:09.509909 16275 raft_consensus.cc:2468] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 15.
I20260709 13:08:09.408628 22384 raft_consensus.cc:515] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:09.472896 22054 raft_consensus.cc:2804] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:09.519524 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:09.522429 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:09.522789 16353 raft_consensus.cc:1275] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:08:09.528009 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:09.530040 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:09.531378 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:09.518098 16281 rpcz_store.cc:276] 0709 13:08:08.358765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.359791 (+  1026us) service_pool.cc:224] Handling call
0709 13:08:08.360078 (+   287us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:08.360303 (+   225us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:08.360331 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:08.415737 (+ 55406us) log.cc:844] Serialized 26 byte log entry
0709 13:08:08.747545 (+331808us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:08:08.747580 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:08.747652 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:09.495420 (+747768us) raft_consensus.cc:1685] finished
0709 13:08:09.495441 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:09.495571 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":327650,"threads_started":1,"wal-append.queue_time_us":984661}
I20260709 13:08:09.492695 22296 raft_consensus.cc:697] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:08:09.538300 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:09.557451 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:09.496551 22481 leader_election.cc:290] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:09.561818 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:09.564079 16944 raft_consensus.cc:1240] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 18 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 17. Current term is 18. Ops: [17.15-17.15]
I20260709 13:08:09.563105 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:09.565610 16941 raft_consensus.cc:2468] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 9.
I20260709 13:08:09.523788 22054 raft_consensus.cc:493] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:09.571725 16173 leader_election.cc:304] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:09.530362 22475 raft_consensus.cc:2749] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:09.601883 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:09.493602 22490 raft_consensus.cc:515] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:09.494871 21986 raft_consensus.cc:515] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:09.606498 22470 raft_consensus.cc:493] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:08:09.619771 16283 raft_consensus.cc:1240] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 13:08:09.619561 22470 raft_consensus.cc:515] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:09.621039 21986 leader_election.cc:290] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 17 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:09.526582 22406 raft_consensus.cc:515] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:09.608392 22498 raft_consensus.cc:493] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:08:09.622903 22498 raft_consensus.cc:515] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:09.608876 22480 raft_consensus.cc:493] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:08:09.611202 22296 consensus_queue.cc:237] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:09.625087 22480 raft_consensus.cc:515] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:09.569072 22433 raft_consensus.cc:493] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:08:09.627492 22433 raft_consensus.cc:515] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:09.628819 22490 leader_election.cc:290] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:09.629065 22498 leader_election.cc:290] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:09.622215 22470 leader_election.cc:290] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:09.629714 22433 leader_election.cc:290] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:09.602989 22393 raft_consensus.cc:493] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:08:09.615160 22488 raft_consensus.cc:2804] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:08:09.512589 22485 raft_consensus.cc:515] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:09.671567 22253 raft_consensus.cc:493] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:08:09.672334 22485 leader_election.cc:290] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:09.672302 22253 raft_consensus.cc:515] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:09.660172 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:09.571079 22429 raft_consensus.cc:493] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:09.669018 16173 leader_election.cc:304] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
W20260709 13:08:09.652580 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 326517us
I20260709 13:08:09.664983 16945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f022e2e63ae4461d834e476ff2666991" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:09.693987 16248 leader_election.cc:304] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:09.604892 22054 raft_consensus.cc:3060] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:09.685696 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:09.686796 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:09.700901 16199 raft_consensus.cc:2468] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 15.
W20260709 13:08:09.697718 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 227822us
W20260709 13:08:09.663168 22492 log.cc:927] Time spent T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.196s	user 0.000s	sys 0.001s
I20260709 13:08:09.704691 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:09.703426 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:09.706040 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:09.706712 16356 raft_consensus.cc:2468] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 14.
I20260709 13:08:09.708925 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:09.711035 16945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:09.662472 22488 raft_consensus.cc:493] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Starting leader election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:08:09.711778 16945 raft_consensus.cc:2468] T 4b962ceebb5c48c1914459ae0c0eff1b P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 12.
I20260709 13:08:09.674759 22253 leader_election.cc:290] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:09.699211 22486 raft_consensus.cc:493] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:09.701671 22470 raft_consensus.cc:2749] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:09.653172 22393 raft_consensus.cc:515] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:09.674719 22433 consensus_queue.cc:1048] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 13:08:09.706471 22359 raft_consensus.cc:2749] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:08:09.722929 16914 leader_election.cc:304] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:08:09.705595 22279 raft_consensus.cc:493] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
W20260709 13:08:09.751500 16174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:09.717641 22488 raft_consensus.cc:3060] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:08:09.707804 22281 consensus_queue.cc:1048] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.031s
I20260709 13:08:09.725173 22480 leader_election.cc:290] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:09.702945 22429 raft_consensus.cc:515] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:09.768383 16173 leader_election.cc:304] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 363bb2f744eb486f9ad726f08214c98e
W20260709 13:08:09.770448 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 59894.5us
I20260709 13:08:09.774065 16283 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45218 (request call id 2651) took 1451 ms. Trace:
I20260709 13:08:09.776396 16283 rpcz_store.cc:276] 0709 13:08:08.322347 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.322464 (+   117us) service_pool.cc:224] Handling call
0709 13:08:08.332610 (+ 10146us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:09.620308 (+1287698us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:09.773695 (+153387us) spinlock_profiling.cc:243] Waited 1.29 s on lock 0x7b5400125054. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f489e01 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6
0709 13:08:09.773981 (+   286us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2959668096}
I20260709 13:08:09.716840 22382 consensus_queue.cc:1048] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 13:08:09.775704 16173 leader_election.cc:304] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:08:09.781265 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:09.781358 22406 leader_election.cc:290] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:09.782788 22456 raft_consensus.cc:493] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:08:09.783090 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:09.785152 16274 raft_consensus.cc:1275] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:08:09.778069 16322 leader_election.cc:304] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:08:09.775275 22491 raft_consensus.cc:2804] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:09.735889 22486 raft_consensus.cc:515] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:09.791667 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f022e2e63ae4461d834e476ff2666991" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:09.793358 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:09.794381 16355 raft_consensus.cc:2393] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 9: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:08:09.800599 16274 raft_consensus.cc:2468] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 13.
I20260709 13:08:09.794828 16350 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41832 (request call id 2583) took 1473 ms. Trace:
I20260709 13:08:09.802232 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:08:09.795601 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:09.803159 16281 raft_consensus.cc:2468] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 9.
I20260709 13:08:09.770635 22470 raft_consensus.cc:493] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:08:09.770403 22384 leader_election.cc:290] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:08:09.798305 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 89538us
I20260709 13:08:09.744021 22279 raft_consensus.cc:515] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:09.801457 16350 rpcz_store.cc:276] 0709 13:08:08.321111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.322028 (+   917us) service_pool.cc:224] Handling call
0709 13:08:08.335202 (+ 13174us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:08.501553 (+166351us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:08.501588 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:08.505973 (+  4385us) log.cc:844] Serialized 26 byte log entry
0709 13:08:08.817748 (+311775us) spinlock_profiling.cc:243] Waited 4.25 ms on lock 0x7b18002bff60. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f3625264de1 00007f36252715b1 00007f361c37ee07 00007f36251d9ab9 00007f361c39b69b 00007f361c39993f 00007f361c39bc02 00007f361f02320b 00007f361f028d23 00007f361f0290d1 00007f361f444a0f
0709 13:08:08.904672 (+ 86924us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:08.904752 (+    80us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:08.904931 (+   179us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:09.775614 (+870683us) raft_consensus.cc:1685] finished
0709 13:08:09.775634 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:09.794730 (+ 19096us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":82847,"raft.queue_time_us":80458,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":103,"spinlock_wait_cycles":9782144,"thread_start_us":86571,"threads_started":1,"wal-append.queue_time_us":873736}
I20260709 13:08:09.823971 21962 leader_election.cc:290] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:09.801620 22303 leader_election.cc:290] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 18 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:09.849265 22498 raft_consensus.cc:493] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
W20260709 13:08:09.846683 22510 log.cc:927] Time spent T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 13:08:09.849826 22498 raft_consensus.cc:515] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:09.848016 22393 leader_election.cc:290] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:09.773027 22374 consensus_queue.cc:1059] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.040s
W20260709 13:08:09.852093 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 78515.7us
I20260709 13:08:09.853868 16173 leader_election.cc:304] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:08:09.798341 22480 raft_consensus.cc:2804] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:09.800016 22434 raft_consensus.cc:493] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:08:09.799841 22481 raft_consensus.cc:2804] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:09.848013 16320 leader_election.cc:304] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:09.797621 22503 raft_consensus.cc:2804] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:08:09.855677 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 132875us
I20260709 13:08:09.799299 22491 raft_consensus.cc:493] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
W20260709 13:08:09.853855 22466 log.cc:927] Time spent T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 13:08:09.864398 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:09.866888 16320 leader_election.cc:304] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:09.867360 16283 raft_consensus.cc:3060] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:09.870618 16173 leader_election.cc:304] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
W20260709 13:08:09.859871 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 97777.2us
I20260709 13:08:09.798897 22456 raft_consensus.cc:515] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:09.859027 22475 raft_consensus.cc:2749] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:09.878151 16283 raft_consensus.cc:2468] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 18.
I20260709 13:08:09.874933 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:09.875804 22374 raft_consensus.cc:2749] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:09.858376 22290 raft_consensus.cc:493] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:08:09.857781 22480 raft_consensus.cc:493] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:08:09.858484 22481 raft_consensus.cc:493] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Starting leader election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:08:09.878939 16173 leader_election.cc:304] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:09.867540 22491 raft_consensus.cc:3060] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:08:09.874478 22513 log.cc:927] Time spent T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
W20260709 13:08:09.880381 22512 log.cc:927] Time spent T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:08:09.846954 22504 consensus_queue.cc:1048] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.081s
I20260709 13:08:09.854564 22470 raft_consensus.cc:515] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:09.886626 16173 leader_election.cc:304] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:09.893849 16320 leader_election.cc:304] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:09.896055 22493 raft_consensus.cc:493] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:08:09.898067 22517 raft_consensus.cc:493] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:08:09.871758 22393 consensus_queue.cc:1059] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.023s
I20260709 13:08:09.894232 22457 raft_consensus.cc:493] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:09.906819 22485 raft_consensus.cc:3055] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:09.907016 22457 raft_consensus.cc:3060] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:09.907271 22485 raft_consensus.cc:740] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:08:09.908190 22485 consensus_queue.cc:260] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:09.909437 22485 raft_consensus.cc:3060] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:09.898793 22279 leader_election.cc:290] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:09.904052 22475 raft_consensus.cc:2804] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:09.911304 22475 raft_consensus.cc:493] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:09.911852 22475 raft_consensus.cc:3060] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:09.912177 22279 raft_consensus.cc:2749] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:09.861131 22434 raft_consensus.cc:515] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:09.915268 22434 leader_election.cc:290] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:09.888235 22481 raft_consensus.cc:3060] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:09.883745 22433 raft_consensus.cc:2749] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:09.900933 16173 leader_election.cc:304] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:08:09.916930 22433 raft_consensus.cc:2749] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:09.882841 22477 raft_consensus.cc:493] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:08:09.924350 22477 raft_consensus.cc:515] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:09.887919 22290 raft_consensus.cc:515] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:09.885429 22480 raft_consensus.cc:3060] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:09.905848 22486 leader_election.cc:290] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:09.916589 22054 raft_consensus.cc:515] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:09.903337 22523 raft_consensus.cc:2749] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:09.891227 22384 raft_consensus.cc:2804] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:08:09.934620 16173 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:09.942041 22290 leader_election.cc:290] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:09.942840 22429 leader_election.cc:290] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:09.946663 22384 raft_consensus.cc:493] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:09.947223 22384 raft_consensus.cc:3060] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:09.888743 22522 consensus_queue.cc:1048] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.073s
I20260709 13:08:09.951368 22503 raft_consensus.cc:697] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [term 15 LEADER]: Becoming Leader. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:08:09.960009 22456 leader_election.cc:290] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:09.993643 22516 raft_consensus.cc:3055] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:09.994225 22516 raft_consensus.cc:740] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:08:09.995139 22516 consensus_queue.cc:260] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:10.000102 16351 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba"
dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
 from {username='slave'} at 127.0.0.1:41830
I20260709 13:08:10.000793 16351 raft_consensus.cc:493] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:10.001236 16351 raft_consensus.cc:3060] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:10.003119 22457 raft_consensus.cc:515] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:10.005786 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:10.021404 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:10.035338 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:10.036646 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:10.037281 16354 raft_consensus.cc:2468] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 12.
I20260709 13:08:09.934468 22517 raft_consensus.cc:515] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:10.025493 22470 leader_election.cc:290] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:10.025825 22457 leader_election.cc:290] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 16 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:10.028252 22481 raft_consensus.cc:515] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:09.976478 22498 leader_election.cc:290] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:09.932582 22493 raft_consensus.cc:515] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:09.978796 22523 raft_consensus.cc:493] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:08:10.045776 22523 raft_consensus.cc:515] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:10.047362 22493 leader_election.cc:290] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:10.067814 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:10.068578 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:10.069286 16280 raft_consensus.cc:2468] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 18.
I20260709 13:08:10.061772 16322 leader_election.cc:304] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:10.069953 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:10.072381 22503 consensus_queue.cc:237] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:10.075021 22523 leader_election.cc:290] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:10.075944 22481 leader_election.cc:290] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 15 election: Requested vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:10.058938 22522 raft_consensus.cc:493] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:10.078362 22522 raft_consensus.cc:515] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:10.078886 22265 raft_consensus.cc:493] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:10.079526 22265 raft_consensus.cc:515] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:10.080880 22522 leader_election.cc:290] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:10.059713 22470 raft_consensus.cc:493] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:10.081876 22265 leader_election.cc:290] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:08:10.082245 22473 log.cc:927] Time spent T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 1.163s	user 0.009s	sys 0.000s
I20260709 13:08:10.081915 22470 raft_consensus.cc:515] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:10.083716 16352 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41832 (request call id 2584) took 1762 ms. Trace:
W20260709 13:08:10.084684 22468 log.cc:927] Time spent T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 1.355s	user 0.000s	sys 0.008s
I20260709 13:08:10.085809 22470 leader_election.cc:290] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:10.077406 22488 raft_consensus.cc:515] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:10.088107 22488 leader_election.cc:290] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 election: Requested vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:10.053736 22477 leader_election.cc:290] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:10.088966 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bc3c8ff9b84838a2664335d7e1582b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:10.042503 22517 leader_election.cc:290] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:10.090919 22259 raft_consensus.cc:2804] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:10.091456 22259 raft_consensus.cc:493] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:08:10.091931 22259 raft_consensus.cc:3060] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:10.094985 22422 raft_consensus.cc:493] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:08:10.095683 22422 raft_consensus.cc:515] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:10.084144 16352 rpcz_store.cc:276] 0709 13:08:08.321409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.321522 (+   113us) service_pool.cc:224] Handling call
0709 13:08:08.321776 (+   254us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:08.426475 (+104699us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:08.426506 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:08.443721 (+ 17215us) log.cc:844] Serialized 26 byte log entry
0709 13:08:08.582618 (+138897us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:08.582663 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:08.582741 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:10.081649 (+1498908us) spinlock_profiling.cc:243] Waited 29.9 ms on lock 0x7b4400022b4c. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361c224db1 00007f361c2c2c85 00007f361c2c36a2 00007f361f0351db 00007f361f030aaf 00007f361f02486e 00007f361f023bb6 00007f361f0237d8 00007f361f02d221 00007f361f02d1d9 00007f361f02d169
0709 13:08:10.083386 (+  1737us) raft_consensus.cc:1685] finished
0709 13:08:10.083411 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:10.083654 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":160967,"raft.queue_time_us":104526,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":14220,"spinlock_wait_cycles":68764032,"thread_start_us":86492,"threads_started":1,"wal-append.queue_time_us":421229}
I20260709 13:08:10.101848 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:10.103332 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:10.103616 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:10.104403 16276 raft_consensus.cc:2393] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 15: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:08:10.121210 16355 raft_consensus.cc:1275] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:08:10.125041 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bc3c8ff9b84838a2664335d7e1582b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:10.127097 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:10.130096 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:10.092790 22491 raft_consensus.cc:515] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:10.147786 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:10.056586 22433 raft_consensus.cc:493] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.149104 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:08:10.150688 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:10.151618 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:10.152555 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:10.154457 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:10.155990 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:10.161811 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:10.158404 16351 raft_consensus.cc:515] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:10.184469 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:10.185424 16354 raft_consensus.cc:1240] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:10.153180 16355 raft_consensus.cc:2468] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 12.
I20260709 13:08:10.188102 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:10.189806 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:08:10.191762 22476 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 1.311s	user 0.031s	sys 0.041s
W20260709 13:08:10.192377 22476 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 1.333s	user 0.032s	sys 0.041s
I20260709 13:08:10.198899 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:08:10.205551 16351 leader_election.cc:290] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:10.078408 22454 raft_consensus.cc:493] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.222790 16173 leader_election.cc:304] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:08:10.082463 22265 raft_consensus.cc:493] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:10.236807 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:10.237556 16355 raft_consensus.cc:3060] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:10.159477 22422 leader_election.cc:290] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:10.244834 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:10.245688 16944 raft_consensus.cc:2468] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 9.
I20260709 13:08:10.248733 16173 leader_election.cc:304] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
W20260709 13:08:10.251456 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 350421us
W20260709 13:08:10.264608 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 391884us
I20260709 13:08:10.267421 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:08:10.268957 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 401862us
I20260709 13:08:10.234253 22456 raft_consensus.cc:2749] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:10.268026 16320 leader_election.cc:304] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:10.271471 16207 raft_consensus.cc:1240] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:10.201793 22433 raft_consensus.cc:515] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:10.292060 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:10.280987 16355 raft_consensus.cc:2468] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 15.
I20260709 13:08:10.277211 16914 leader_election.cc:304] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:08:10.285859 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:10.292050 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:10.286988 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:10.293915 16200 raft_consensus.cc:2468] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 21.
I20260709 13:08:10.287719 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:10.288378 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:08:10.295378 16322 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.180.68:36875 timed out after 1.912s (SENT) [suppressed 23 similar messages]
I20260709 13:08:10.289340 16206 raft_consensus.cc:1240] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:10.257701 22338 raft_consensus.cc:2804] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:08:10.292083 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:10.297305 16944 raft_consensus.cc:2468] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 17.
I20260709 13:08:10.297693 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:10.295401 16203 raft_consensus.cc:2468] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 17.
I20260709 13:08:10.300367 16173 leader_election.cc:304] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:08:10.301648 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:10.302196 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:10.302953 16941 raft_consensus.cc:2368] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 14. Current term is 15.
I20260709 13:08:10.303064 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:10.302461 16351 raft_consensus.cc:2393] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 9: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:08:10.304126 16944 raft_consensus.cc:2468] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 9.
I20260709 13:08:10.305245 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:10.306165 16278 raft_consensus.cc:3055] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:10.306602 16278 raft_consensus.cc:740] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:08:10.307745 16173 leader_election.cc:304] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:08:10.307790 16278 consensus_queue.cc:260] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:10.314054 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:10.314774 16278 raft_consensus.cc:3060] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:08:10.294816 22398 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.272s	user 0.006s	sys 0.034s
I20260709 13:08:10.236515 22265 raft_consensus.cc:515] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:08:10.324527 16174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:10.327636 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:10.297570 22477 raft_consensus.cc:493] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.301321 22490 raft_consensus.cc:2804] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:10.335067 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:10.233966 22454 raft_consensus.cc:515] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:08:10.321561 22398 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.307s	user 0.007s	sys 0.035s
I20260709 13:08:10.303208 22396 raft_consensus.cc:2804] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:10.344233 16173 leader_election.cc:304] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:08:10.347465 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:08:10.321115 22485 raft_consensus.cc:2804] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:10.352823 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:10.344774 22477 raft_consensus.cc:515] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:10.355994 22477 leader_election.cc:290] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:10.356397 16320 leader_election.cc:304] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:10.357641 22499 raft_consensus.cc:2804] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:08:10.357946 16320 leader_election.cc:304] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:10.358654 22451 consensus_queue.cc:1059] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:10.342461 22490 raft_consensus.cc:493] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:08:10.359603 22490 raft_consensus.cc:3060] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:10.359772 22451 raft_consensus.cc:3055] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:10.360149 22451 raft_consensus.cc:740] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:08:10.363373 22328 raft_consensus.cc:2804] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:10.363827 22328 raft_consensus.cc:493] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:08:10.364217 22328 raft_consensus.cc:3060] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:10.368854 22451 consensus_queue.cc:260] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:10.370270 22451 raft_consensus.cc:3060] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:10.372666 22393 raft_consensus.cc:493] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.373258 22393 raft_consensus.cc:515] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:10.374622 22470 raft_consensus.cc:2749] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:10.351452 16277 raft_consensus.cc:2468] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 19.
I20260709 13:08:10.378261 22485 raft_consensus.cc:493] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:08:10.379581 16357 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41830 (request call id 2860) took 1467 ms. Trace:
I20260709 13:08:10.321218 22494 raft_consensus.cc:493] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:08:10.383051 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:10.388662 16278 raft_consensus.cc:2468] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 15.
I20260709 13:08:10.318701 22522 consensus_queue.cc:1048] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 13:08:10.379969 16357 rpcz_store.cc:276] 0709 13:08:08.911705 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.938428 (+ 26723us) service_pool.cc:224] Handling call
0709 13:08:08.938929 (+   501us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:09.330979 (+392050us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:09.331012 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:09.331579 (+   567us) log.cc:844] Serialized 52 byte log entry
0709 13:08:09.510810 (+179231us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:08:09.510931 (+   121us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:10.378147 (+867216us) spinlock_profiling.cc:243] Waited 392 ms on lock 0x7b540026aa54. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f489e01 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6
0709 13:08:10.378209 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:10.378257 (+    48us) raft_consensus.cc:1685] finished
0709 13:08:10.378274 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:10.379508 (+  1234us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2169,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":105,"spinlock_wait_cycles":900675456,"thread_start_us":178813,"threads_started":1,"wal-append.queue_time_us":207376}
I20260709 13:08:10.327442 22338 raft_consensus.cc:697] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:08:10.296391 22475 raft_consensus.cc:515] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:10.397946 16173 leader_election.cc:304] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:08:10.431593 22522 raft_consensus.cc:2749] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:10.434696 22384 raft_consensus.cc:515] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:10.435961 22265 leader_election.cc:290] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:10.437119 22384 leader_election.cc:290] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 14 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:10.428670 22494 raft_consensus.cc:515] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:10.438840 22454 leader_election.cc:290] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:08:10.405279 22464 log.cc:927] Time spent T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63: Append to log took a long time: real 1.542s	user 0.005s	sys 0.021s
I20260709 13:08:10.440442 22494 leader_election.cc:290] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:10.441632 22488 raft_consensus.cc:493] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:08:10.378831 22485 raft_consensus.cc:3060] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:10.442327 22488 raft_consensus.cc:515] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:10.442975 22433 leader_election.cc:290] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:10.412300 16275 raft_consensus.cc:2393] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 21: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:08:10.439036 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:10.358250 22499 raft_consensus.cc:493] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 20 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
W20260709 13:08:10.410230 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 114868us
W20260709 13:08:10.412545 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 69720.7us
I20260709 13:08:10.342602 22054 leader_election.cc:290] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 15 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:10.343065 22456 raft_consensus.cc:2749] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:08:10.448027 16092 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 73757c6fea8949e090aa4e55902a41d4 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER failed with leader 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 1109f76a0b7b443a84c0327c8707bc63 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 14 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:08:10.452967 16322 leader_election.cc:304] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:10.458146 16948 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35122 (request call id 815) took 2554 ms. Trace:
I20260709 13:08:10.462853 16203 raft_consensus.cc:3060] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:10.441715 22491 leader_election.cc:290] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 15 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:10.467710 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:10.468560 16322 leader_election.cc:304] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:08:10.448710 22532 log.cc:927] Time spent T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:08:10.459002 22396 raft_consensus.cc:697] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 18 LEADER]: Becoming Leader. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:08:10.465142 22525 raft_consensus.cc:493] T 540bfc4ad793452faea5b865343aacf7 P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
W20260709 13:08:10.465596 16321 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:10.452338 22499 raft_consensus.cc:3060] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:10.456236 22488 leader_election.cc:290] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:10.475121 16322 leader_election.cc:304] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:10.451541 22454 raft_consensus.cc:493] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:10.458704 16948 rpcz_store.cc:276] 0709 13:08:07.897196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:07.897366 (+   170us) service_pool.cc:224] Handling call
0709 13:08:07.897654 (+   288us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:08.087541 (+189887us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:08.087587 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:08.103219 (+ 15632us) log.cc:844] Serialized 26 byte log entry
0709 13:08:08.436731 (+333512us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:08:08.436810 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:08.436930 (+   120us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:10.224790 (+1787860us) spinlock_profiling.cc:243] Waited 4.82 ms on lock 0x7b4400022b4c. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361c224db1 00007f361c2c2c85 00007f361c2c36a2 00007f361f0351db 00007f361f030aaf 00007f361f02486e 00007f361f023bb6 00007f361f0237d8 00007f361f02d221 00007f361f02d1d9 00007f361f02d169
0709 13:08:10.445729 (+220939us) raft_consensus.cc:1685] finished
0709 13:08:10.445749 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:10.451551 (+  5802us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31757,"raft.queue_time_us":65466,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":93,"spinlock_wait_cycles":11078016,"thread_start_us":436330,"threads_started":2,"wal-append.queue_time_us":595301}
I20260709 13:08:10.479875 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:10.478958 22518 raft_consensus.cc:2804] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:10.491420 22298 raft_consensus.cc:2749] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:10.491469 22518 raft_consensus.cc:493] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:08:10.492198 22518 raft_consensus.cc:3060] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:10.494303 16322 leader_election.cc:304] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:08:10.476886 22451 raft_consensus.cc:2749] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:10.497666 22451 raft_consensus.cc:2804] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:10.498232 22451 raft_consensus.cc:697] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 15 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:08:10.482826 22396 consensus_queue.cc:237] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:10.499269 22451 consensus_queue.cc:237] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:08:10.495587 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 45690.7us
I20260709 13:08:10.495844 22054 consensus_queue.cc:1059] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:10.502347 22054 raft_consensus.cc:3055] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:10.502772 22054 raft_consensus.cc:740] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:08:10.507144 16948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:10.488222 16248 leader_election.cc:304] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:10.508659 15057 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:10.509222 16248 leader_election.cc:304] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:08:10.510219 22075 raft_consensus.cc:2749] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:08:10.511049 22075 raft_consensus.cc:2804] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:10.511473 22075 raft_consensus.cc:493] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:08:10.515547 16248 leader_election.cc:304] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:10.516167 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
W20260709 13:08:10.518491 16322 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:10.542086 16248 leader_election.cc:304] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:10.550794 16203 raft_consensus.cc:2468] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 15.
I20260709 13:08:10.556957 16282 raft_consensus.cc:1275] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:08:10.557732 16282 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45218 (request call id 2656) took 1177 ms. Trace:
I20260709 13:08:10.557605 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:10.558229 16282 rpcz_store.cc:276] 0709 13:08:09.380488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:09.382030 (+  1542us) service_pool.cc:224] Handling call
0709 13:08:10.556380 (+1174350us) spinlock_profiling.cc:243] Waited 6.64 ms on lock 0x7b58001a8298. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361c224db1 00007f361c364e9c 00007f361c364a5b 00007f362527dc09 00007f36243d7ee0 00007f36244a10ab 00007f36244a1131 00007f3624462fc0 00007f362444d929 00007f362444d3d2 00007f361d9c4bd4
0709 13:08:10.556575 (+   195us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:10.557463 (+   888us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:10.557672 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15265280}
I20260709 13:08:10.561208 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:10.562171 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:10.562474 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:10.562995 16357 raft_consensus.cc:2468] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 12.
I20260709 13:08:10.563824 16322 leader_election.cc:304] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:08:10.511878 22075 raft_consensus.cc:3060] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:10.511863 22518 raft_consensus.cc:515] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:10.569352 21992 raft_consensus.cc:2749] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:10.576309 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:10.549372 22265 raft_consensus.cc:2749] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:08:10.595367 16322 leader_election.cc:304] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:10.570797 22253 raft_consensus.cc:493] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.600482 22253 raft_consensus.cc:515] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:10.486763 22338 consensus_queue.cc:237] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:10.491494 22454 raft_consensus.cc:515] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:10.602800 16322 leader_election.cc:304] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:08:10.597538 22477 raft_consensus.cc:2804] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:10.589896 22393 leader_election.cc:290] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:10.609372 16322 leader_election.cc:304] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:08:10.608032 22477 raft_consensus.cc:493] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:08:10.633973 16350 raft_consensus.cc:2468] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 15.
W20260709 13:08:10.612057 22259 consensus_meta.cc:287] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 0.520s	user 0.011s	sys 0.000s
I20260709 13:08:10.613243 22485 raft_consensus.cc:515] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:10.615991 22518 leader_election.cc:290] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 19 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:10.602059 22497 raft_consensus.cc:2749] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:10.617636 22075 raft_consensus.cc:515] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:10.487224 22525 raft_consensus.cc:515] T 540bfc4ad793452faea5b865343aacf7 P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:10.620177 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:10.625455 22454 leader_election.cc:290] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:10.636013 16279 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42740 (request call id 1187) took 1254 ms. Trace:
I20260709 13:08:10.634845 22477 raft_consensus.cc:3060] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:10.641175 16355 raft_consensus.cc:3060] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:10.634176 22517 raft_consensus.cc:2804] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:08:10.638254 22480 consensus_meta.cc:287] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 0.687s	user 0.013s	sys 0.000s
I20260709 13:08:10.679541 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:10.672276 16279 rpcz_store.cc:276] 0709 13:08:09.381350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:09.385039 (+  3689us) service_pool.cc:224] Handling call
0709 13:08:09.385532 (+   493us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:08:09.386456 (+   924us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:09.386523 (+    67us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:08:10.031762 (+645239us) spinlock_profiling.cc:243] Waited 3.49 ms on lock 0x7b2c0000ffe8. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361dd82a11 00007f361dd92372 00007f361f4c4a01 00007f361f48943a 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2
0709 13:08:10.032695 (+   933us) log.cc:844] Serialized 78 byte log entry
0709 13:08:10.267750 (+235055us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:08:10.298781 (+ 31031us) log.cc:844] Serialized 14 byte log entry
0709 13:08:10.625668 (+326887us) spinlock_profiling.cc:243] Waited 6.97 ms on lock 0x7b180043dc20. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f3625264de1 00007f36252715b1 00007f361c316c0a 00007f3625a56219 00007f361c39ea40 00007f361c3994e4 00007f361c399455 00007f3622e813c7 00007f361f4939a7 00007f361f4a30bf 00007f361f4a3038
0709 13:08:10.625925 (+   257us) log.cc:844] Serialized 14 byte log entry
0709 13:08:10.635387 (+  9462us) log.cc:844] Serialized 14 byte log entry
0709 13:08:10.635638 (+   251us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:10.635716 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:10.635773 (+    57us) raft_consensus.cc:1685] finished
0709 13:08:10.635786 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:10.635931 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":334683,"prepare.queue_time_us":380559,"prepare.run_cpu_time_us":125,"prepare.run_wall_time_us":5811,"raft.queue_time_us":17467,"raft.run_cpu_time_us":479,"raft.run_wall_time_us":42814,"spinlock_wait_cycles":109473792,"thread_start_us":234635,"threads_started":1,"wal-append.queue_time_us":312297}
I20260709 13:08:10.701987 22525 leader_election.cc:290] T 540bfc4ad793452faea5b865343aacf7 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:10.704386 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:10.709511 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:10.710767 22523 raft_consensus.cc:2749] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:10.712199 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:10.714262 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:10.714886 16350 raft_consensus.cc:3060] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:10.677881 22517 raft_consensus.cc:493] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:10.747159 16174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:10.644454 22259 raft_consensus.cc:515] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:10.749732 16350 raft_consensus.cc:2468] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 15.
W20260709 13:08:10.750885 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 178165us
W20260709 13:08:10.727586 22532 log.cc:927] Time spent T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:08:10.763127 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:10.763453 16248 leader_election.cc:400] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875) with higher term. Message: Invalid argument: T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 14. Current term is 15.
I20260709 13:08:10.764225 16248 leader_election.cc:403] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:10.767656 16248 leader_election.cc:304] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:08:10.743146 22475 leader_election.cc:290] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:10.768648 16351 raft_consensus.cc:3060] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:10.769484 16248 leader_election.cc:304] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:10.752568 22517 raft_consensus.cc:3060] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:10.722369 22480 raft_consensus.cc:515] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:10.750217 22454 raft_consensus.cc:493] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:10.765021 22359 raft_consensus.cc:3060] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:08:10.678920 22054 consensus_queue.cc:260] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:10.748685 22328 raft_consensus.cc:515] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:10.783700 22454 raft_consensus.cc:515] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:08:10.800014 22547 log.cc:927] Time spent T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:08:10.797233 22054 raft_consensus.cc:3060] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:10.793344 22422 raft_consensus.cc:2749] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:10.807641 22328 leader_election.cc:290] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 18 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:10.809790 22075 leader_election.cc:290] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 election: Requested vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:10.806638 22454 leader_election.cc:290] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:10.792908 22549 raft_consensus.cc:2749] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:10.831068 22490 raft_consensus.cc:515] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:10.833267 22359 raft_consensus.cc:2749] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875) with higher term. Message: Invalid argument: T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 14. Current term is 15.
I20260709 13:08:10.833406 22490 leader_election.cc:290] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:10.810863 22485 leader_election.cc:290] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 13 election: Requested vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:10.827754 22480 leader_election.cc:290] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:10.839524 22477 raft_consensus.cc:515] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:10.847808 22499 raft_consensus.cc:515] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:10.849254 22517 raft_consensus.cc:515] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:08:10.913203 16321 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:10.914603 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:10.913272 16348 raft_consensus.cc:2468] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 21.
I20260709 13:08:10.923236 16353 raft_consensus.cc:1240] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:10.948704 16350 raft_consensus.cc:1240] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:10.957227 22374 raft_consensus.cc:493] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:08:10.978946 22490 raft_consensus.cc:493] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:08:10.980026 22490 raft_consensus.cc:515] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:10.988307 22480 raft_consensus.cc:493] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:08:10.989619 22480 raft_consensus.cc:515] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:10.970640 22374 raft_consensus.cc:515] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:10.993592 22517 leader_election.cc:290] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 10 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:10.996198 22374 leader_election.cc:290] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:10.999184 22359 raft_consensus.cc:493] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:08:11.000609 22359 raft_consensus.cc:515] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:11.009167 22359 leader_election.cc:290] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:11.031422 22499 leader_election.cc:290] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 21 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:08:10.984073 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 214505us
I20260709 13:08:11.031551 16349 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41832 (request call id 2587) took 1511 ms. Trace:
I20260709 13:08:11.035454 16349 rpcz_store.cc:276] 0709 13:08:09.520287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:09.520416 (+   129us) service_pool.cc:224] Handling call
0709 13:08:09.520718 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:09.626798 (+106080us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:09.626844 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:09.626887 (+    43us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:09.626920 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:11.030892 (+1403972us) spinlock_profiling.cc:243] Waited 106 ms on lock 0x7b5400019fd4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f489e01 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6
0709 13:08:11.030991 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:11.031314 (+   323us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":243434752}
I20260709 13:08:11.046864 16945 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35122 (request call id 822) took 1169 ms. Trace:
I20260709 13:08:11.047454 16945 rpcz_store.cc:276] 0709 13:08:09.877558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:09.877722 (+   164us) service_pool.cc:224] Handling call
0709 13:08:09.878133 (+   411us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:10.195941 (+317808us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:08:10.310675 (+114734us) log.cc:844] Serialized 14 byte log entry
0709 13:08:10.448855 (+138180us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:10.448940 (+    85us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:10.448987 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:11.046159 (+597172us) spinlock_profiling.cc:243] Waited 317 ms on lock 0x7b54007eca54. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f489e01 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6
0709 13:08:11.046240 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:11.046584 (+   344us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":53202,"prepare.queue_time_us":130045,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":50,"raft.queue_time_us":63529,"spinlock_wait_cycles":735080064,"thread_start_us":164798,"threads_started":2,"wal-append.queue_time_us":166556}
I20260709 13:08:11.050889 22454 raft_consensus.cc:493] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:11.051342 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:11.052511 22454 raft_consensus.cc:515] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:11.065438 22477 leader_election.cc:290] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 18 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:11.089489 22480 leader_election.cc:290] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:11.092242 16349 raft_consensus.cc:1275] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:08:11.084527 22490 leader_election.cc:290] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:11.110096 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:08:11.102155 22518 raft_consensus.cc:493] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:08:11.113791 22518 raft_consensus.cc:515] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:11.116436 16945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:11.103811 16322 leader_election.cc:304] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:08:11.120666 16201 raft_consensus.cc:1240] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 9. Current term is 10. Ops: []
W20260709 13:08:11.122722 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 96234.6us
I20260709 13:08:11.124523 22477 raft_consensus.cc:2749] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:11.102025 16351 raft_consensus.cc:2468] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 14.
I20260709 13:08:11.119249 22518 leader_election.cc:290] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:11.131285 22454 leader_election.cc:290] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:11.133526 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:08:11.137377 16945 raft_consensus.cc:1275] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:08:11.141988 22422 raft_consensus.cc:493] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:11.143388 22422 raft_consensus.cc:515] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:11.147351 22422 leader_election.cc:290] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:11.148018 22359 raft_consensus.cc:493] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.149224 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:11.148975 22359 raft_consensus.cc:515] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:11.151101 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:11.155171 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:08:11.155776 22359 leader_election.cc:290] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:11.158183 22542 raft_consensus.cc:493] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.158381 22338 raft_consensus.cc:493] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:08:11.159086 22542 raft_consensus.cc:515] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:11.160090 22338 raft_consensus.cc:515] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:11.147090 22075 raft_consensus.cc:493] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:11.162140 22542 leader_election.cc:290] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:11.163100 22075 raft_consensus.cc:515] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:11.165186 16173 leader_election.cc:304] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:08:11.167117 22429 consensus_queue.cc:1059] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:11.167694 22542 raft_consensus.cc:2804] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:11.169176 22542 raft_consensus.cc:697] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:08:11.169633 22338 leader_election.cc:290] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:11.171365 16353 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41830 (request call id 2863) took 1172 ms. Trace:
I20260709 13:08:11.170996 22542 consensus_queue.cc:237] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:11.172031 16353 rpcz_store.cc:276] 0709 13:08:09.999223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:10.002820 (+  3597us) service_pool.cc:224] Handling call
0709 13:08:10.003425 (+   605us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:10.924122 (+920697us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:11.170980 (+246858us) spinlock_profiling.cc:243] Waited 788 ms on lock 0x7b540028bed4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f489e01 00007f361f48883e 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6
0709 13:08:11.171291 (+   311us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1811279616}
I20260709 13:08:11.173652 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:11.175298 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:11.192550 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:11.193486 16350 raft_consensus.cc:2468] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 12.
W20260709 13:08:11.190975 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 44984.3us
I20260709 13:08:11.193084 22454 raft_consensus.cc:493] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:08:11.209569 22453 raft_consensus.cc:493] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.210695 22453 raft_consensus.cc:515] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:11.212060 16279 raft_consensus.cc:1240] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 17. Current term is 18. Ops: [17.15-17.15]
I20260709 13:08:11.211859 22454 raft_consensus.cc:515] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:11.215302 22453 leader_election.cc:290] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:11.215842 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:11.213654 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:11.216807 16282 raft_consensus.cc:3060] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:11.222223 16945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:11.222867 16355 raft_consensus.cc:3060] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:11.226858 16914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:11.227025 22556 raft_consensus.cc:493] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:08:11.228003 22556 raft_consensus.cc:515] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:08:11.229789 16947 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35122 (request call id 817) took 2862 ms (client timeout 1912 ms). Trace:
W20260709 13:08:11.230376 16947 rpcz_store.cc:269] 0709 13:08:08.360598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.360725 (+   127us) service_pool.cc:224] Handling call
0709 13:08:11.222256 (+2861531us) spinlock_profiling.cc:243] Waited 2.83 s on lock 0x7b540006b3d4. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:08:11.222497 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6512931200}
I20260709 13:08:11.229905 22075 leader_election.cc:290] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:11.226179 16356 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41830 (request call id 2867) took 1225 ms. Trace:
I20260709 13:08:11.246107 22516 raft_consensus.cc:3060] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:11.251148 16914 leader_election.cc:304] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:08:11.253937 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:11.254117 16355 raft_consensus.cc:2468] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 13.
I20260709 13:08:11.254626 16914 leader_election.cc:304] T 540bfc4ad793452faea5b865343aacf7 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:11.254983 22556 leader_election.cc:290] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:11.255981 22525 raft_consensus.cc:2804] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:11.256769 22525 raft_consensus.cc:697] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 15 LEADER]: Becoming Leader. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:08:11.258931 22446 raft_consensus.cc:2749] T 540bfc4ad793452faea5b865343aacf7 P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:11.259259 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:11.258204 22525 consensus_queue.cc:237] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:11.260828 22338 raft_consensus.cc:493] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:11.261583 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
W20260709 13:08:11.257985 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 94089.5us
I20260709 13:08:11.263736 22265 raft_consensus.cc:493] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:08:11.264536 22265 raft_consensus.cc:515] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:11.265504 22359 raft_consensus.cc:493] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.267324 22265 leader_election.cc:290] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:11.261616 22338 raft_consensus.cc:515] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:11.269603 22338 leader_election.cc:290] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:11.266214 22359 raft_consensus.cc:515] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:11.272742 22359 leader_election.cc:290] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:11.214499 22454 leader_election.cc:290] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:11.276588 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:11.281999 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:11.282637 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:08:11.284898 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:08:11.279749 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:08:11.295454 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:11.241590 16356 rpcz_store.cc:276] 0709 13:08:10.000412 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:10.044738 (+ 44326us) service_pool.cc:224] Handling call
0709 13:08:10.045178 (+   440us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:08:10.045655 (+   477us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:10.045685 (+    30us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:08:10.046429 (+   744us) log.cc:844] Serialized 78 byte log entry
0709 13:08:10.474373 (+427944us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:10.489137 (+ 14764us) log.cc:844] Serialized 14 byte log entry
0709 13:08:11.150661 (+661524us) spinlock_profiling.cc:243] Waited 12.4 ms on lock 0x7b18004b1000. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f3625264de1 00007f36252715b1 00007f361c316c0a 00007f3625a56219 00007f361c39ea40 00007f361c3994e4 00007f361c399455 00007f3622e813c7 00007f361f4939a7 00007f361f4a30bf 00007f361f4a3038
0709 13:08:11.224069 (+ 73408us) log.cc:844] Serialized 14 byte log entry
0709 13:08:11.224710 (+   641us) log.cc:844] Serialized 14 byte log entry
0709 13:08:11.225235 (+   525us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:11.225616 (+   381us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:11.225681 (+    65us) raft_consensus.cc:1685] finished
0709 13:08:11.225694 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:11.225977 (+   283us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":673938,"prepare.queue_time_us":686512,"prepare.run_cpu_time_us":150,"prepare.run_wall_time_us":151,"raft.queue_time_us":9788,"raft.run_cpu_time_us":495,"raft.run_wall_time_us":43973,"spinlock_wait_cycles":28420992,"thread_start_us":426253,"threads_started":1,"wal-append.queue_time_us":621755}
I20260709 13:08:11.300295 16278 raft_consensus.cc:2393] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 15: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:08:11.303534 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:11.305382 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:11.313931 16202 raft_consensus.cc:3060] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:11.315414 16948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:11.316787 16945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:08:11.317525 16945 raft_consensus.cc:3060] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:11.317901 16199 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60154 (request call id 3433) took 1034 ms. Trace:
I20260709 13:08:11.319237 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:11.312927 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f022e2e63ae4461d834e476ff2666991" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:11.331125 16948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:11.338323 16948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:08:11.339826 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:11.343575 22486 raft_consensus.cc:493] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:08:11.344399 22486 raft_consensus.cc:515] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:11.347566 22259 leader_election.cc:290] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:11.318259 16199 rpcz_store.cc:276] 0709 13:08:10.283443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:10.285607 (+  2164us) service_pool.cc:224] Handling call
0709 13:08:11.317560 (+1031953us) spinlock_profiling.cc:243] Waited 684 ms on lock 0x7b54003d2a54. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:08:11.317713 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1574089472}
I20260709 13:08:11.349439 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:08:11.350234 22054 consensus_queue.cc:1048] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:11.344410 16280 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45210 (request call id 2851) took 1058 ms. Trace:
I20260709 13:08:11.364980 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:11.365397 16277 raft_consensus.cc:1275] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:08:11.312077 22359 raft_consensus.cc:493] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:08:11.367805 22359 raft_consensus.cc:515] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:11.368585 16942 raft_consensus.cc:1240] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 16 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:11.372648 16283 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45218 (request call id 2672) took 1245 ms. Trace:
I20260709 13:08:11.367719 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:11.370208 22359 leader_election.cc:290] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:11.359423 16280 rpcz_store.cc:276] 0709 13:08:10.286087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:10.309683 (+ 23596us) service_pool.cc:224] Handling call
0709 13:08:10.487306 (+177623us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:10.487544 (+   238us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:08:10.627560 (+140016us) log.cc:844] Serialized 14 byte log entry
0709 13:08:10.896847 (+269287us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:10.897020 (+   173us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:08:10.897228 (+   208us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:10.897431 (+   203us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:11.344048 (+446617us) spinlock_profiling.cc:243] Waited 177 ms on lock 0x7b5400126450. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f4888ad 00007f362444d419 00007f361d9c4bd4 00007f361d9c4b62 00007f361d9c4a91 00007f361d9c4a0c 00007f361d9c3cc2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:08:11.344199 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":139692,"prepare.queue_time_us":140417,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":66752,"raft.run_cpu_time_us":372,"raft.run_wall_time_us":5683,"spinlock_wait_cycles":407631232,"thread_start_us":268332,"threads_started":1,"wal-append.queue_time_us":175843}
I20260709 13:08:11.387815 16282 raft_consensus.cc:2468] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 19.
I20260709 13:08:11.385370 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:11.385941 16204 raft_consensus.cc:2468] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 15.
I20260709 13:08:11.393934 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:11.404795 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:11.405655 16173 leader_election.cc:304] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:11.422035 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:11.425459 16201 raft_consensus.cc:2468] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 21.
I20260709 13:08:11.422482 16199 raft_consensus.cc:2468] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 17.
I20260709 13:08:11.426864 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:11.427747 16279 raft_consensus.cc:2393] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 17: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:08:11.377089 16283 rpcz_store.cc:276] 0709 13:08:10.127020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:10.128426 (+  1406us) service_pool.cc:224] Handling call
0709 13:08:10.128859 (+   433us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:10.129357 (+   498us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:08:10.197415 (+ 68058us) log.cc:844] Serialized 14 byte log entry
0709 13:08:11.143502 (+946087us) spinlock_profiling.cc:243] Waited 6.43 ms on lock 0x7b1800440f20. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f3625264de1 00007f36252715b1 00007f361c37ee07 00007f36251d9ab9 00007f361c39b69b 00007f361c39993f 00007f361c39bc02 00007f361f02320b 00007f361f028d23 00007f361f02923a 00007f361f493a2a
0709 13:08:11.359060 (+215558us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:11.366970 (+  7910us) log.cc:844] Serialized 26 byte log entry
0709 13:08:11.367145 (+   175us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:11.367175 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:11.367283 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:11.372200 (+  4917us) raft_consensus.cc:1685] finished
0709 13:08:11.372300 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:11.372448 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25074,"prepare.queue_time_us":72966,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":62,"raft.queue_time_us":23482,"raft.run_cpu_time_us":261,"raft.run_wall_time_us":31863,"spinlock_wait_cycles":14786944,"thread_start_us":147489,"threads_started":1,"wal-append.queue_time_us":1137246}
I20260709 13:08:11.429854 16945 raft_consensus.cc:2468] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 10.
I20260709 13:08:11.431398 16276 raft_consensus.cc:2393] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 13: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:08:11.433071 16274 raft_consensus.cc:2393] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 21: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:08:11.439482 16202 raft_consensus.cc:2468] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 18.
I20260709 13:08:11.421880 22486 leader_election.cc:290] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:11.455366 16199 raft_consensus.cc:1275] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:08:11.454989 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:11.455345 22352 consensus_queue.cc:1059] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.019s
I20260709 13:08:11.461324 22352 raft_consensus.cc:3055] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:11.461959 22352 raft_consensus.cc:740] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:08:11.471843 22352 consensus_queue.cc:260] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:11.474867 22352 raft_consensus.cc:3060] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:11.475325 16349 raft_consensus.cc:1275] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 15. (term mismatch)
I20260709 13:08:11.477059 22253 leader_election.cc:290] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:11.458865 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:11.482043 16349 pending_rounds.cc:85] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e: Aborting all ops after (but not including) 14
I20260709 13:08:11.456144 22542 raft_consensus.cc:493] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
W20260709 13:08:11.496668 16174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:11.492139 16349 pending_rounds.cc:107] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e: Aborting uncommitted NO_OP operation due to leader change: 17.15
I20260709 13:08:11.497833 16349 raft_consensus.cc:2889] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:11.526160 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:11.529964 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:11.544795 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:11.548038 22565 raft_consensus.cc:493] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:08:11.548835 22565 raft_consensus.cc:515] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:11.549304 22298 raft_consensus.cc:493] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:08:11.551146 22485 raft_consensus.cc:2804] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:11.551668 22485 raft_consensus.cc:493] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Starting leader election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:08:11.552093 22485 raft_consensus.cc:3060] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:11.550369 22298 raft_consensus.cc:515] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:08:11.558881 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 173439us
I20260709 13:08:11.537652 22359 consensus_queue.cc:1059] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 13:08:11.565788 22359 raft_consensus.cc:3055] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:11.566243 22359 raft_consensus.cc:740] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:08:11.567409 22359 consensus_queue.cc:260] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:11.569211 22359 raft_consensus.cc:3060] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:11.558796 22298 leader_election.cc:290] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:11.570713 16206 raft_consensus.cc:1240] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:11.572572 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:11.573716 16200 raft_consensus.cc:2468] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 13.
I20260709 13:08:11.559839 16248 leader_election.cc:304] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:08:11.575753 16199 raft_consensus.cc:2468] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 13.
I20260709 13:08:11.583097 16275 raft_consensus.cc:1240] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 13:08:11.585218 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:11.587283 16282 raft_consensus.cc:1275] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 13:08:11.588758 22569 log.cc:927] Time spent T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
W20260709 13:08:11.593676 16322 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:11.598716 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:08:11.599712 16357 raft_consensus.cc:1240] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:11.600072 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:11.600538 16201 raft_consensus.cc:2368] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for earlier term 13. Current term is 14.
I20260709 13:08:11.601106 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:08:11.602375 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 60816.9us
I20260709 13:08:11.604810 22486 raft_consensus.cc:2749] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:11.604089 16248 leader_election.cc:304] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:08:11.598829 22281 raft_consensus.cc:493] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.598858 22477 raft_consensus.cc:493] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.615645 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:11.620179 16173 leader_election.cc:304] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:11.541039 22542 raft_consensus.cc:515] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:11.624784 16281 raft_consensus.cc:1275] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:08:11.628954 16201 raft_consensus.cc:1240] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:11.631042 22486 raft_consensus.cc:493] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:08:11.616894 22562 raft_consensus.cc:2804] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:08:11.632180 22562 raft_consensus.cc:493] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:11.632030 22486 raft_consensus.cc:515] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:11.632660 22562 raft_consensus.cc:3060] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:11.635510 16283 raft_consensus.cc:2468] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 9.
I20260709 13:08:11.647397 16202 raft_consensus.cc:2468] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 11.
I20260709 13:08:11.650383 16201 raft_consensus.cc:1240] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:11.610998 22281 raft_consensus.cc:515] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:11.652838 21962 raft_consensus.cc:493] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:11.653249 16355 raft_consensus.cc:1240] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:11.656068 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:11.656445 22281 leader_election.cc:290] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:11.649446 22057 raft_consensus.cc:493] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.657424 22057 raft_consensus.cc:515] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:11.658459 22480 raft_consensus.cc:3055] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:11.658942 22480 raft_consensus.cc:740] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:08:11.659915 16276 raft_consensus.cc:2468] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 15.
I20260709 13:08:11.660110 22480 consensus_queue.cc:260] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:11.660852 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:11.661288 22480 raft_consensus.cc:3060] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:11.661535 16205 raft_consensus.cc:2468] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 21.
I20260709 13:08:11.635241 22486 leader_election.cc:290] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:11.660072 22057 leader_election.cc:290] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:11.664539 22338 raft_consensus.cc:493] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:08:11.664901 22057 raft_consensus.cc:493] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.665256 22454 raft_consensus.cc:493] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:08:11.665757 22338 raft_consensus.cc:515] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:11.666024 22454 raft_consensus.cc:515] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:11.665673 22057 raft_consensus.cc:515] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:11.667830 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:11.668114 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:11.668378 22454 leader_election.cc:290] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:11.668823 16355 raft_consensus.cc:2410] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:08:11.669948 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:11.671494 22057 leader_election.cc:290] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:11.653319 22298 raft_consensus.cc:493] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:08:11.671625 16356 raft_consensus.cc:1240] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:11.674906 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:11.623808 22477 raft_consensus.cc:515] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:11.673455 22298 raft_consensus.cc:515] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:11.675451 16320 leader_election.cc:304] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:11.672155 21962 raft_consensus.cc:515] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } }
W20260709 13:08:11.688421 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 112096us
I20260709 13:08:11.689157 22429 raft_consensus.cc:2749] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:11.683698 22477 leader_election.cc:290] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:11.691481 21962 leader_election.cc:290] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:11.676738 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:11.697327 22462 raft_consensus.cc:493] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:11.699303 16320 leader_election.cc:304] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:11.702366 16274 raft_consensus.cc:2468] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 13.
I20260709 13:08:11.704385 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:11.705821 22462 raft_consensus.cc:515] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:11.702817 22565 leader_election.cc:290] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:11.705857 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:11.709342 16320 leader_election.cc:304] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:11.711304 22574 raft_consensus.cc:2804] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:11.711607 22477 raft_consensus.cc:2804] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:11.711984 22574 raft_consensus.cc:697] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:08:11.712103 22477 raft_consensus.cc:493] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:08:11.712460 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:11.712589 22477 raft_consensus.cc:3060] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:08:11.710377 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 55928.3us
I20260709 13:08:11.713765 16320 leader_election.cc:304] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:11.715119 16278 raft_consensus.cc:3060] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:11.716773 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:11.711771 22352 raft_consensus.cc:2804] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:11.708736 22298 leader_election.cc:290] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:11.723140 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:11.724063 16274 raft_consensus.cc:3060] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:11.725747 22057 raft_consensus.cc:493] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:08:11.730026 16320 leader_election.cc:304] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:11.731804 16173 leader_election.cc:304] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:11.732813 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:11.713152 22574 consensus_queue.cc:237] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:11.735985 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:11.725277 22338 leader_election.cc:290] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:11.735723 22451 raft_consensus.cc:2804] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:08:11.740098 22057 raft_consensus.cc:515] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:11.740811 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:11.740830 22451 raft_consensus.cc:697] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 21 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:08:11.749007 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:11.750357 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:11.751331 16355 raft_consensus.cc:2468] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 18.
I20260709 13:08:11.732897 22352 raft_consensus.cc:697] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 15 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:08:11.654975 15057 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:11.741351 22298 raft_consensus.cc:2804] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:11.765870 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:11.766039 22352 consensus_queue.cc:237] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:11.766947 16281 raft_consensus.cc:2468] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 13.
I20260709 13:08:11.771044 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:11.740254 22484 consensus_queue.cc:1048] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 13:08:11.747066 22462 leader_election.cc:290] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:11.746140 22338 raft_consensus.cc:2804] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:11.763863 16320 leader_election.cc:304] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:11.777854 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:11.778638 16320 leader_election.cc:304] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:11.774071 22542 leader_election.cc:290] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:11.796267 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:11.777293 22338 raft_consensus.cc:493] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:11.799259 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:11.781757 22484 raft_consensus.cc:2804] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:11.781711 22298 raft_consensus.cc:697] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 18 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:08:11.802198 16351 raft_consensus.cc:2468] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 16.
W20260709 13:08:11.804221 22572 log.cc:927] Time spent T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 13:08:11.808600 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:11.814308 16945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:11.794209 22259 raft_consensus.cc:2804] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:11.816447 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f022e2e63ae4461d834e476ff2666991" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:11.803822 22338 raft_consensus.cc:3060] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:11.819473 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:11.806594 22565 raft_consensus.cc:493] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:08:11.824535 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:11.802928 22484 raft_consensus.cc:493] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:08:11.819850 16320 leader_election.cc:400] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 election: Vote denied by peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073) with higher term. Message: Invalid argument: T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for earlier term 13. Current term is 14.
I20260709 13:08:11.820775 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:11.825560 22057 leader_election.cc:290] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:11.816802 22259 raft_consensus.cc:493] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:08:11.828164 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:11.828486 22259 raft_consensus.cc:3060] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:11.829346 16945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:11.826267 16173 leader_election.cc:304] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:11.826823 16320 leader_election.cc:403] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:08:11.823794 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:11.830242 16914 leader_election.cc:304] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:08:11.836542 16282 raft_consensus.cc:1275] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:08:11.840654 16173 leader_election.cc:304] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:11.840886 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:11.838994 16320 leader_election.cc:304] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:08:11.838718 22281 raft_consensus.cc:2749] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073) with higher term. Message: Invalid argument: T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for earlier term 13. Current term is 14.
I20260709 13:08:11.830809 22484 raft_consensus.cc:3060] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:11.833339 22454 consensus_queue.cc:1059] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:11.856650 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:11.843992 16322 leader_election.cc:304] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:08:11.852502 16320 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:11.861011 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:11.797304 22451 consensus_queue.cc:237] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:11.847618 22462 raft_consensus.cc:2749] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:11.876773 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:11.856021 22516 raft_consensus.cc:2804] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:11.834384 22565 raft_consensus.cc:515] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:11.883344 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:11.866708 22493 raft_consensus.cc:2804] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:11.871486 22542 raft_consensus.cc:2804] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:11.868083 22485 raft_consensus.cc:515] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:11.900398 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:11.901684 16274 raft_consensus.cc:2468] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 14.
I20260709 13:08:11.886651 22516 raft_consensus.cc:493] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Starting leader election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
W20260709 13:08:11.902127 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 85706.9us
I20260709 13:08:11.907196 16204 raft_consensus.cc:1240] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 12. Current term is 13. Ops: []
W20260709 13:08:11.908123 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 102804us
I20260709 13:08:11.895627 22493 raft_consensus.cc:697] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 14 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:08:11.903318 22328 raft_consensus.cc:2749] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:11.922694 16173 leader_election.cc:304] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:08:11.906116 22516 raft_consensus.cc:3060] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:11.927500 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 43772.9us
I20260709 13:08:11.927784 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:11.932569 16354 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41832 (request call id 2615) took 1369 ms. Trace:
I20260709 13:08:11.933166 16354 rpcz_store.cc:276] 0709 13:08:10.557830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:10.558237 (+   407us) service_pool.cc:224] Handling call
0709 13:08:10.565770 (+  7533us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:10.598812 (+ 33042us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:08:11.352742 (+753930us) log.cc:844] Serialized 14 byte log entry
0709 13:08:11.542141 (+189399us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:11.625797 (+ 83656us) log.cc:844] Serialized 26 byte log entry
0709 13:08:11.637357 (+ 11560us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:11.637407 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:11.642655 (+  5248us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:11.926707 (+284052us) raft_consensus.cc:1685] finished
0709 13:08:11.926727 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:11.926858 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":580597,"prepare.queue_time_us":555815,"prepare.run_cpu_time_us":87,"prepare.run_wall_time_us":90,"raft.queue_time_us":33482,"raft.run_cpu_time_us":330,"raft.run_wall_time_us":9286,"spinlock_wait_cycles":1452800,"thread_start_us":251738,"threads_started":2,"wal-append.queue_time_us":209403}
I20260709 13:08:11.907706 22542 raft_consensus.cc:697] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [term 13 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:08:11.931419 16246 leader_election.cc:304] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:11.915211 22511 consensus_queue.cc:1059] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.050s
I20260709 13:08:11.882898 22298 consensus_queue.cc:237] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:11.942147 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:11.910197 16104 catalog_manager.cc:5697] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: term changed from 12 to 14, leader changed from e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) to 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68). New cstate: current_term: 14 leader_uuid: "1109f76a0b7b443a84c0327c8707bc63" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:11.947075 22057 raft_consensus.cc:2749] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:11.944473 16205 raft_consensus.cc:2468] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 15.
I20260709 13:08:11.950908 22570 raft_consensus.cc:2749] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:11.951866 22481 consensus_queue.cc:1048] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 13:08:11.952143 16914 leader_election.cc:304] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:08:11.953501 22485 leader_election.cc:290] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 13 election: Requested vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:08:11.953913 16092 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 73757c6fea8949e090aa4e55902a41d4 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER failed with leader 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 1109f76a0b7b443a84c0327c8707bc63 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 14 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
W20260709 13:08:11.954777 16092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 45762.8us
I20260709 13:08:11.959578 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:11.968920 22493 consensus_queue.cc:237] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:11.971588 22494 consensus_queue.cc:1059] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.006s
I20260709 13:08:11.979885 16276 raft_consensus.cc:1813] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Handling vote request from an unknown peer e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:11.979990 16942 raft_consensus.cc:1240] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:11.980819 16276 raft_consensus.cc:2410] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:08:11.983361 22303 raft_consensus.cc:3055] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:11.983839 22303 raft_consensus.cc:740] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:08:11.984741 22303 consensus_queue.cc:260] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:11.986212 22303 raft_consensus.cc:3060] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:11.988387 22486 raft_consensus.cc:3055] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:11.989068 22486 raft_consensus.cc:740] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:08:11.992229 22565 leader_election.cc:290] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:08:11.998910 22575 log.cc:927] Time spent T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
I20260709 13:08:11.999147 16246 leader_election.cc:304] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:12.003960 22454 raft_consensus.cc:2749] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:12.005023 16246 leader_election.cc:304] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:12.006421 22406 raft_consensus.cc:2749] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:11.990296 22486 consensus_queue.cc:260] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:08:12.007339 22579 log.cc:927] Time spent T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:08:12.008358 22486 raft_consensus.cc:3060] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:12.013976 16246 leader_election.cc:304] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:12.015934 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:12.021286 22520 raft_consensus.cc:2749] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:08:12.021075 22542 consensus_queue.cc:237] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:12.022377 22494 raft_consensus.cc:3055] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:12.022883 22494 raft_consensus.cc:740] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:08:12.023962 22494 consensus_queue.cc:260] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:12.025437 22494 raft_consensus.cc:3060] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:12.025430 22259 raft_consensus.cc:515] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:12.032536 16246 leader_election.cc:304] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:12.035862 22454 raft_consensus.cc:2749] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:12.036675 22511 raft_consensus.cc:493] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:08:12.037297 22511 raft_consensus.cc:515] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:12.039482 22511 leader_election.cc:290] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:12.040572 16246 leader_election.cc:304] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:12.045749 16246 leader_election.cc:304] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:12.048452 16246 leader_election.cc:304] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:12.044931 22454 raft_consensus.cc:2749] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:12.053216 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:12.060159 16246 leader_election.cc:304] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:12.062600 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:08:12.067273 16104 catalog_manager.cc:5697] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: term changed from 8 to 12, leader changed from e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) to 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68). New cstate: current_term: 12 leader_uuid: "1109f76a0b7b443a84c0327c8707bc63" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:12.069362 16104 catalog_manager.cc:5697] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "1109f76a0b7b443a84c0327c8707bc63" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:12.072592 16945 raft_consensus.cc:1275] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:08:12.076332 22281 raft_consensus.cc:493] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:08:12.079183 22454 raft_consensus.cc:2804] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:12.079656 22454 raft_consensus.cc:493] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:12.079490 22484 raft_consensus.cc:515] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:12.053900 22422 raft_consensus.cc:2749] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:08:12.074640 16104 catalog_manager.cc:5697] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: term changed from 15 to 19, leader changed from 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) to 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66). New cstate: current_term: 19 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:08:12.080338 22454 raft_consensus.cc:3060] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:12.078570 22259 leader_election.cc:290] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:08:12.090862 16912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:12.107897 22338 raft_consensus.cc:515] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:12.109282 16206 raft_consensus.cc:2393] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 14: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:08:12.049902 22406 raft_consensus.cc:2749] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:12.053871 22057 raft_consensus.cc:2749] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:12.095183 16322 leader_election.cc:304] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:12.099272 22562 raft_consensus.cc:515] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:08:12.100492 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 153536us
I20260709 13:08:12.107205 22484 leader_election.cc:290] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:12.079171 22281 raft_consensus.cc:515] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:12.081954 16104 catalog_manager.cc:5697] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: term changed from 17 to 22, leader changed from 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) to 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68). New cstate: current_term: 22 leader_uuid: "1109f76a0b7b443a84c0327c8707bc63" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:12.116997 16278 raft_consensus.cc:2468] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 15.
I20260709 13:08:12.127398 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:08:12.129093 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:08:12.135447 16104 catalog_manager.cc:5697] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: term changed from 12 to 16, leader changed from 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) to 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66). New cstate: current_term: 16 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
W20260709 13:08:12.140115 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 79990.3us
I20260709 13:08:12.143600 16173 leader_election.cc:304] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 363bb2f744eb486f9ad726f08214c98e
I20260709 13:08:12.144767 16201 raft_consensus.cc:2368] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for earlier term 13. Current term is 14.
I20260709 13:08:12.110643 22338 leader_election.cc:290] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 14 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:12.147802 16246 leader_election.cc:304] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:12.148752 16104 catalog_manager.cc:5697] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: term changed from 13 to 17. New cstate: current_term: 17 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:08:12.125626 22253 raft_consensus.cc:2749] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:12.155260 22493 raft_consensus.cc:2804] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:12.168417 22493 raft_consensus.cc:493] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 19 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:12.168895 22493 raft_consensus.cc:3060] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:12.170709 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:08:12.173696 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 78638.8us
I20260709 13:08:12.155616 16914 leader_election.cc:304] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:08:12.155304 22432 consensus_queue.cc:1059] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 13:08:12.177088 22462 raft_consensus.cc:2749] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:12.157580 22562 leader_election.cc:290] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 22 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:12.185012 16322 leader_election.cc:304] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:08:12.158005 22484 raft_consensus.cc:493] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:08:12.161037 22281 leader_election.cc:290] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:12.132213 21962 raft_consensus.cc:493] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:12.164552 22477 raft_consensus.cc:515] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:12.166638 22511 raft_consensus.cc:493] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:12.155709 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 89281.9us
I20260709 13:08:12.187062 16104 catalog_manager.cc:5697] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: term changed from 18 to 19, leader changed from 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) to 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68). New cstate: current_term: 19 leader_uuid: "1109f76a0b7b443a84c0327c8707bc63" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:12.192441 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:12.195928 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:12.179268 22057 raft_consensus.cc:2749] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:12.201053 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:08:12.208693 16207 raft_consensus.cc:3060] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:08:12.203227 16247 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:12.203786 16320 leader_election.cc:400] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 election: Vote denied by peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073) with higher term. Message: Invalid argument: T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for earlier term 13. Current term is 14.
I20260709 13:08:12.210055 16320 leader_election.cc:403] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:08:12.204566 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:12.206321 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:12.177959 22462 consensus_queue.cc:1048] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.016s
I20260709 13:08:12.221556 16276 raft_consensus.cc:2468] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 17.
I20260709 13:08:12.197402 22429 raft_consensus.cc:2749] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:12.229836 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:08:12.225989 22484 raft_consensus.cc:515] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:12.245594 22484 leader_election.cc:290] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:12.245599 16206 raft_consensus.cc:2468] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 17.
I20260709 13:08:12.189066 21962 raft_consensus.cc:515] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:12.220768 22253 raft_consensus.cc:3060] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:12.257202 16102 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38840 (request call id 208) took 9878 ms. Trace:
I20260709 13:08:12.223786 22565 consensus_queue.cc:1048] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 13:08:12.197947 22511 raft_consensus.cc:515] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:12.250989 16320 leader_election.cc:304] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:12.308504 16947 raft_consensus.cc:2468] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 13.
I20260709 13:08:12.266865 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:08:12.307507 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 55061.1us
I20260709 13:08:12.322809 16207 raft_consensus.cc:2468] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 22.
I20260709 13:08:12.276095 16173 leader_election.cc:304] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
W20260709 13:08:12.330063 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 74792.5us
W20260709 13:08:12.330780 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 79906.1us
I20260709 13:08:12.335640 16246 leader_election.cc:304] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
W20260709 13:08:12.337548 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 156632us
I20260709 13:08:12.338217 22429 raft_consensus.cc:2804] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:12.269227 22520 raft_consensus.cc:3055] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:12.339820 22520 raft_consensus.cc:740] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:08:12.340157 22259 raft_consensus.cc:493] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:12.340790 22520 consensus_queue.cc:260] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:12.342123 22253 raft_consensus.cc:2749] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073) with higher term. Message: Invalid argument: T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for earlier term 13. Current term is 14.
W20260709 13:08:12.355140 16912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:12.342904 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:12.278703 21962 leader_election.cc:290] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:12.346851 16322 leader_election.cc:304] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:08:12.262812 22477 leader_election.cc:290] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 17 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:12.342391 22520 raft_consensus.cc:3060] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:12.269629 22493 raft_consensus.cc:515] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:12.266842 22454 raft_consensus.cc:515] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:08:12.409277 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 133247us
I20260709 13:08:12.374683 22562 raft_consensus.cc:2804] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:08:12.381589 22294 raft_consensus.cc:2749] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:08:12.384044 22511 leader_election.cc:290] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:12.370827 22542 raft_consensus.cc:2749] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:08:12.422080 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:08:12.422679 22583 raft_consensus.cc:493] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:12.422873 16207 raft_consensus.cc:3060] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:12.423393 22583 raft_consensus.cc:515] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:12.425983 22583 leader_election.cc:290] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:12.426690 22562 raft_consensus.cc:697] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 22 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:08:12.427865 22562 consensus_queue.cc:237] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:12.392270 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:12.343057 22429 raft_consensus.cc:697] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 17 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:08:12.409807 22253 consensus_queue.cc:1048] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 13:08:12.431949 22493 leader_election.cc:290] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 20 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:12.431653 22429 consensus_queue.cc:237] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:12.398103 16191 tablet_service.cc:1558] Processing DeleteTablet for tablet 4b962ceebb5c48c1914459ae0c0eff1b with delete_type TABLET_DATA_TOMBSTONED (TS e10b16d536674c0bb350a31d7ce5ff7f not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:44830
I20260709 13:08:12.340806 22259 raft_consensus.cc:515] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:12.415971 22454 leader_election.cc:290] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:12.289686 22516 raft_consensus.cc:515] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:12.419720 16914 leader_election.cc:304] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:12.435266 16207 raft_consensus.cc:2468] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 16.
I20260709 13:08:12.340221 22422 raft_consensus.cc:493] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:12.445169 22422 raft_consensus.cc:515] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:12.441169 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c15d8e9be8414c84912ab77b66bfb1" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:12.442658 22259 leader_election.cc:290] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:12.442976 22315 raft_consensus.cc:2804] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:08:12.450323 22315 raft_consensus.cc:493] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:08:12.450824 22315 raft_consensus.cc:3060] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:12.451442 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:12.443768 16322 leader_election.cc:304] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:12.454866 22587 consensus_queue.cc:1048] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:08:12.456463 22294 raft_consensus.cc:2804] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:12.457095 22294 raft_consensus.cc:697] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 19 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:08:12.458041 22294 consensus_queue.cc:237] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:12.440129 16246 leader_election.cc:304] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:12.460422 16914 leader_election.cc:304] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:12.257675 16102 rpcz_store.cc:276] 0709 13:08:02.379176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:02.383807 (+  4631us) service_pool.cc:224] Handling call
0709 13:08:12.256990 (+9873183us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:07.941246 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:08.015261 (+ 74015us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:08.015315 (+    54us) write_op.cc:435] Acquired schema lock
0709 13:08:08.015334 (+    19us) tablet.cc:662] Decoding operations
0709 13:08:08.016994 (+  1660us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:08.017064 (+    70us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:08.017100 (+    36us) tablet.cc:685] Acquiring locks for 18 operations
0709 13:08:08.053377 (+ 36277us) tablet.cc:701] Row locks acquired
0709 13:08:08.053412 (+    35us) write_op.cc:260] PREPARE: finished
0709 13:08:08.073032 (+ 19620us) write_op.cc:270] Start()
0709 13:08:08.077697 (+  4665us) write_op.cc:276] Timestamp: P: 1783602488069108 usec, L: 0
0709 13:08:08.085048 (+  7351us) op_driver.cc:348] REPLICATION: starting
0709 13:08:08.171221 (+ 86173us) log.cc:844] Serialized 7163 byte log entry
0709 13:08:08.777843 (+606622us) op_driver.cc:464] REPLICATION: finished
0709 13:08:09.931771 (+1153928us) spinlock_profiling.cc:243] Waited 1.79 ms on lock 0x7b4400022b4c. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361c224db1 00007f361c2c2c85 00007f361c2c36a2 00007f361f0351db 00007f361f030aaf 00007f361c37f0ac 00007f36251d9ab9 00007f361c39b69b 00007f361c39993f 00007f361c39bc02 00007f3622ebfef0
0709 13:08:10.335102 (+403331us) write_op.cc:301] APPLY: starting
0709 13:08:10.342798 (+  7696us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:10.504726 (+161928us) spinlock_profiling.cc:243] Waited 57.5 ms on lock 0x7b5400137754. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48632a 00007f361f40bf14 00007f361f40bec3 00007f361f40be38 00007f361f40bdf3 00007f361f40b0dc 00007f361f434e16 00007f361f41ccbb 00007f361f40739d 00007f361f40ad75
0709 13:08:10.628869 (+124143us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:10.628913 (+    44us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:10.843837 (+214924us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:10.844140 (+   303us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=36,key_file_lookups=36,delta_file_lookups=36,mrs_lookups=0
0709 13:08:10.844191 (+    51us) write_op.cc:312] APPLY: finished
0709 13:08:10.844585 (+   394us) log.cc:844] Serialized 164 byte log entry
0709 13:08:10.846598 (+  2013us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:10.846841 (+   243us) write_op.cc:454] Released schema lock
0709 13:08:10.846929 (+    88us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:10.847283 (+   354us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:10.847311 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":67784,"reported_tablets":31,"spinlock_wait_cycles":21120,"child_traces":[["op",{"apply.queue_time_us":1519354,"apply.run_cpu_time_us":32880,"apply.run_wall_time_us":518980,"cfile_cache_hit":74,"cfile_cache_hit_bytes":79367,"num_ops":18,"prepare.queue_time_us":353349,"prepare.run_cpu_time_us":14231,"prepare.run_wall_time_us":361350,"raft.queue_time_us":215486,"raft.run_cpu_time_us":77443,"raft.run_wall_time_us":1867665,"replication_time_us":644128,"spinlock_wait_cycles":136286208,"thread_start_us":1862363,"threads_started":5,"wal-append.queue_time_us":245303,"wal-append.run_cpu_time_us":11246,"wal-append.run_wall_time_us":2202614}]]}
I20260709 13:08:12.445829 22516 leader_election.cc:290] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 12 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:12.462977 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:12.465091 16942 raft_consensus.cc:2393] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 13: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:08:12.467540 22591 consensus_queue.cc:1048] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:08:12.480005 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:08:12.465384 22494 raft_consensus.cc:2749] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:12.486672 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:12.468227 22454 raft_consensus.cc:2804] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:12.495663 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:12.496749 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:12.499897 22422 leader_election.cc:290] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:12.501403 16248 leader_election.cc:304] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:12.519436 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:12.528563 16945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
W20260709 13:08:12.530110 16914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:12.503700 16173 leader_election.cc:304] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:12.547071 22493 raft_consensus.cc:2804] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:12.547590 22493 raft_consensus.cc:493] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:12.547940 22493 raft_consensus.cc:3060] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:12.548738 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:12.549352 16277 raft_consensus.cc:3060] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:12.550796 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:12.551748 16248 leader_election.cc:304] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:12.552959 16248 leader_election.cc:304] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:08:12.554342 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:12.554944 22057 consensus_queue.cc:1059] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:08:12.555966 22057 raft_consensus.cc:2749] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:12.556603 22057 raft_consensus.cc:2749] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:12.556680 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:12.557878 22422 raft_consensus.cc:3055] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:12.558254 22422 raft_consensus.cc:740] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
W20260709 13:08:12.561467 16912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:12.563331 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:08:12.569792 16948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:12.573637 16277 raft_consensus.cc:2468] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 14.
I20260709 13:08:12.575399 22484 raft_consensus.cc:493] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:08:12.576498 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:12.543771 22454 raft_consensus.cc:697] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:08:12.589877 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:12.595122 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:12.595623 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:12.588970 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:12.578994 22486 raft_consensus.cc:2749] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:12.616951 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:12.618074 16322 leader_election.cc:304] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:12.618669 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:12.620147 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:12.620769 16280 raft_consensus.cc:3060] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:12.623219 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:12.626642 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:12.621027 16173 leader_election.cc:304] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:12.628278 16283 raft_consensus.cc:2393] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 17: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:08:12.629921 16351 raft_consensus.cc:1240] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:12.630400 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:12.631809 16355 raft_consensus.cc:1275] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:08:12.633488 16352 raft_consensus.cc:1240] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 19 LEADER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 18. Current term is 19. Ops: []
I20260709 13:08:12.634472 16207 raft_consensus.cc:1240] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 22 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 21. Current term is 22. Ops: []
I20260709 13:08:12.634696 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:12.634912 16322 leader_election.cc:304] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:12.576107 22484 raft_consensus.cc:515] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:12.640117 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:12.638842 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:12.643518 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:12.643877 16351 raft_consensus.cc:1275] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:08:12.644344 16279 raft_consensus.cc:2368] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for earlier term 13. Current term is 14.
I20260709 13:08:12.598644 22494 consensus_queue.cc:1048] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.040s
I20260709 13:08:12.652307 16207 raft_consensus.cc:1240] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 20 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 19. Current term is 20. Ops: []
I20260709 13:08:12.649364 16279 raft_consensus.cc:1240] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 18. Current term is 19. Ops: [17.9-18.10]
I20260709 13:08:12.662058 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:12.638732 22429 raft_consensus.cc:2804] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:12.647992 22542 raft_consensus.cc:2804] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:08:12.667357 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 113423us
I20260709 13:08:12.668399 16322 leader_election.cc:304] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:12.687220 16248 leader_election.cc:304] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:12.648396 22597 tablet_replica.cc:333] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f: stopping tablet replica
I20260709 13:08:12.690649 16248 leader_election.cc:304] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:12.624176 22338 consensus_queue.cc:1059] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 13:08:12.659490 22480 raft_consensus.cc:3060] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:12.631155 22566 consensus_queue.cc:1048] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.034s
W20260709 13:08:12.703420 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 64811us
I20260709 13:08:12.623936 22422 consensus_queue.cc:260] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:12.708949 16248 leader_election.cc:304] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:08:12.694890 22580 raft_consensus.cc:2749] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:12.695676 22583 raft_consensus.cc:2749] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:12.695689 22429 raft_consensus.cc:697] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 10 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:08:12.665508 22259 consensus_queue.cc:1059] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.045s
I20260709 13:08:12.736706 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:12.659668 22516 consensus_queue.cc:1059] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.060s
I20260709 13:08:12.740224 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:12.742447 16276 raft_consensus.cc:2468] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 15.
I20260709 13:08:12.741809 22588 raft_consensus.cc:493] T 4b962ceebb5c48c1914459ae0c0eff1b P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:08:12.748138 22588 raft_consensus.cc:515] T 4b962ceebb5c48c1914459ae0c0eff1b P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:12.751392 22597 raft_consensus.cc:2243] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:12.757349 16352 raft_consensus.cc:1240] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:12.759327 16351 raft_consensus.cc:1275] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:08:12.693475 22454 consensus_queue.cc:237] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:12.764098 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:12.766216 16942 raft_consensus.cc:1275] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:08:12.742336 22583 raft_consensus.cc:2804] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:12.769937 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:12.770872 16277 raft_consensus.cc:2468] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 13.
I20260709 13:08:12.740917 16948 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7295dce0baa440b8a197da845581ee81"
dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
mode: GRACEFUL
new_leader_uuid: "363bb2f744eb486f9ad726f08214c98e"
 from {username='slave'} at 127.0.0.1:58316
I20260709 13:08:12.772787 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:12.773031 16948 raft_consensus.cc:606] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [term 12 LEADER]: Received request to transfer leadership to TS 363bb2f744eb486f9ad726f08214c98e
I20260709 13:08:12.773460 16351 raft_consensus.cc:2468] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 15.
I20260709 13:08:12.778184 16277 raft_consensus.cc:1275] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:08:12.778245 16357 raft_consensus.cc:2468] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 14.
I20260709 13:08:12.784554 16277 raft_consensus.cc:1275] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:08:12.783074 22605 raft_consensus.cc:493] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:12.785595 22493 raft_consensus.cc:515] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:12.787032 22605 raft_consensus.cc:515] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:12.789141 22605 leader_election.cc:290] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:08:12.789499 22600 log.cc:927] Time spent T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 13:08:12.769765 22477 raft_consensus.cc:3055] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:08:12.791239 22477 raft_consensus.cc:740] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:08:12.790848 22429 consensus_queue.cc:237] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:12.770385 22565 raft_consensus.cc:3055] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:12.793387 22565 raft_consensus.cc:740] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:08:12.794283 22565 consensus_queue.cc:260] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:12.795794 22484 leader_election.cc:290] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:12.796118 22565 raft_consensus.cc:3060] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:08:12.796707 22602 log.cc:927] Time spent T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.180s	user 0.000s	sys 0.002s
I20260709 13:08:12.797194 22253 raft_consensus.cc:3055] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:08:12.797715 22253 raft_consensus.cc:740] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:08:12.798875 22253 consensus_queue.cc:260] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:12.789101 22493 leader_election.cc:290] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 18 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:12.816525 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:12.816581 22597 raft_consensus.cc:2272] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:12.771696 22583 raft_consensus.cc:493] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:08:12.820374 22583 raft_consensus.cc:3060] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:12.792328 22477 consensus_queue.cc:260] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:12.821362 22477 raft_consensus.cc:3060] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:12.821158 22315 raft_consensus.cc:515] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:08:12.789095 22601 log.cc:927] Time spent T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:08:12.824523 22484 raft_consensus.cc:493] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:12.825076 22484 raft_consensus.cc:515] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:08:12.826021 22604 log.cc:927] Time spent T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.086s	user 0.001s	sys 0.001s
I20260709 13:08:12.831548 16280 raft_consensus.cc:2468] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 20.
I20260709 13:08:12.836274 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:12.830474 22480 raft_consensus.cc:2749] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:12.867214 16200 raft_consensus.cc:2468] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 10.
I20260709 13:08:12.858366 22542 raft_consensus.cc:697] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [term 13 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
W20260709 13:08:12.872816 16154 auto_rebalancer.cc:629] Failed to schedule move for tablet 40719878febd41f9b57c9a6992d4431b: Illegal state: Replica e10b16d536674c0bb350a31d7ce5ff7f is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 21 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } }
I20260709 13:08:12.832479 22484 leader_election.cc:290] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:12.884588 16320 leader_election.cc:304] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:12.872771 22542 consensus_queue.cc:237] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:12.929509 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:12.932209 16283 raft_consensus.cc:1240] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 LEADER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:12.913936 22281 raft_consensus.cc:2804] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:08:12.936863 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 203261us
I20260709 13:08:12.941314 16173 leader_election.cc:304] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:12.915632 22315 leader_election.cc:290] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 10 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:12.950901 22454 raft_consensus.cc:493] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:12.951649 22454 raft_consensus.cc:515] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:12.961354 16947 raft_consensus.cc:1240] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 9. Current term is 10. Ops: []
I20260709 13:08:12.954312 22454 leader_election.cc:290] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:12.943838 22281 raft_consensus.cc:493] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:12.970850 16354 raft_consensus.cc:1240] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:12.971839 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:12.972939 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:12.955246 22485 raft_consensus.cc:2804] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:12.949483 22486 raft_consensus.cc:2749] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:12.976023 16275 raft_consensus.cc:3060] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:12.995932 16173 leader_election.cc:304] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:12.998327 22612 consensus_queue.cc:1048] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:12.975138 22281 raft_consensus.cc:3060] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:12.999717 22610 consensus_queue.cc:1059] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:08:13.000476 22615 log.cc:927] Time spent T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63: Append to log took a long time: real 0.134s	user 0.000s	sys 0.001s
I20260709 13:08:12.951320 22609 consensus_queue.cc:1059] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.032s
W20260709 13:08:13.002699 16249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:13.004837 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:13.020685 16354 raft_consensus.cc:2410] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for term 22 because replica has last-logged OpId of term: 21 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 11.
I20260709 13:08:13.007025 16281 raft_consensus.cc:1240] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 22 LEADER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 21. Current term is 22. Ops: []
I20260709 13:08:13.005220 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c15d8e9be8414c84912ab77b66bfb1" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:13.004812 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
W20260709 13:08:13.027292 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 318425us
I20260709 13:08:13.004072 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:13.029484 16248 leader_election.cc:304] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:12.971691 22597 ts_tablet_manager.cc:1916] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:13.000739 22610 raft_consensus.cc:3055] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:08:12.971796 22605 raft_consensus.cc:493] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:13.032615 16173 leader_election.cc:304] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:08:13.028887 16352 raft_consensus.cc:2468] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 15.
I20260709 13:08:13.034345 16248 leader_election.cc:304] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:08:13.034763 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:13.003722 22253 raft_consensus.cc:3060] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:13.036706 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:13.014492 22422 raft_consensus.cc:3060] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:13.036338 22562 raft_consensus.cc:2804] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:13.007496 22616 raft_consensus.cc:493] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:13.043923 16248 leader_election.cc:304] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:13.044124 16173 leader_election.cc:304] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:08:13.007678 22485 raft_consensus.cc:697] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:08:12.998374 22611 raft_consensus.cc:2804] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:08:13.052322 16279 raft_consensus.cc:1240] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 19. Current term is 20. Ops: []
I20260709 13:08:13.057178 16173 leader_election.cc:304] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:08:13.057456 16274 raft_consensus.cc:1275] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:08:12.987404 22606 consensus_queue.cc:1048] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.056s
I20260709 13:08:13.065379 16173 leader_election.cc:304] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:08:13.069737 16208 raft_consensus.cc:1240] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:13.038269 22610 raft_consensus.cc:740] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:08:13.004432 22583 raft_consensus.cc:515] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:13.007956 22614 consensus_queue.cc:1048] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.058s
W20260709 13:08:13.106774 16321 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:13.074404 22612 raft_consensus.cc:2749] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:13.063551 22616 raft_consensus.cc:515] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:13.063769 22617 raft_consensus.cc:2749] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:13.095393 22281 raft_consensus.cc:515] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:13.085834 16248 leader_election.cc:304] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:13.108136 16914 leader_election.cc:304] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:13.138948 16914 leader_election.cc:304] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:13.055156 22562 raft_consensus.cc:493] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:08:13.054404 22621 raft_consensus.cc:2749] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:13.146498 16277 raft_consensus.cc:2468] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 9.
I20260709 13:08:13.103768 22454 raft_consensus.cc:2749] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:08:13.046840 22605 raft_consensus.cc:515] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:13.112399 22611 raft_consensus.cc:697] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 20 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:08:13.110597 22481 raft_consensus.cc:2749] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:13.144493 22562 raft_consensus.cc:3060] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:13.151878 22303 raft_consensus.cc:2804] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:13.114995 22462 consensus_queue.cc:1048] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.051s
I20260709 13:08:13.151070 22520 raft_consensus.cc:2749] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:13.193884 16275 raft_consensus.cc:2468] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 18.
I20260709 13:08:13.174397 22617 consensus_queue.cc:1048] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
W20260709 13:08:13.202574 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 89136.2us
I20260709 13:08:13.158855 22609 raft_consensus.cc:493] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:13.204309 16173 leader_election.cc:304] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:08:13.193564 22406 raft_consensus.cc:493] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.206620 22608 raft_consensus.cc:2749] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:08:13.158154 22432 consensus_queue.cc:1059] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 13:08:13.179957 22621 raft_consensus.cc:2749] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:08:13.220913 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 135157us
I20260709 13:08:13.195536 22303 raft_consensus.cc:493] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
W20260709 13:08:13.225409 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 80691.2us
W20260709 13:08:13.209892 22622 log.cc:927] Time spent T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:08:13.253364 16173 leader_election.cc:304] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:08:13.240924 22626 raft_consensus.cc:493] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:08:13.241499 22359 consensus_queue.cc:1059] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:13.226778 22588 leader_election.cc:290] T 4b962ceebb5c48c1914459ae0c0eff1b P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:13.221251 22606 raft_consensus.cc:2749] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:13.218348 22494 raft_consensus.cc:493] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.239969 16322 leader_election.cc:304] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:13.224992 22259 raft_consensus.cc:493] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.267910 16322 leader_election.cc:304] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
W20260709 13:08:13.271654 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 122788us
I20260709 13:08:13.272362 16322 leader_election.cc:304] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:08:13.248351 22303 raft_consensus.cc:3060] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:13.260535 22481 consensus_queue.cc:1059] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 13:08:13.277778 22259 raft_consensus.cc:515] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:13.278359 22635 raft_consensus.cc:2749] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:13.210286 22485 consensus_queue.cc:237] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:13.218089 22609 raft_consensus.cc:515] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:13.267469 22566 raft_consensus.cc:2749] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:13.276612 16914 leader_election.cc:304] T 4b962ceebb5c48c1914459ae0c0eff1b P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:08:13.285367 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:13.277513 16322 leader_election.cc:304] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:13.288139 22481 consensus_queue.cc:1243] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer 363bb2f744eb486f9ad726f08214c98e log is divergent from this leader: its last log entry 19.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:08:13.290797 22580 raft_consensus.cc:493] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:08:13.292868 22359 raft_consensus.cc:493] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:13.271006 22477 raft_consensus.cc:2749] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:13.222868 22406 raft_consensus.cc:515] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:13.210124 22610 consensus_queue.cc:260] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:13.281368 22516 raft_consensus.cc:2749] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:13.309926 16322 leader_election.cc:400] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 election: Vote denied by peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823) with higher term. Message: Invalid argument: T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for earlier term 13. Current term is 14.
I20260709 13:08:13.311420 16941 raft_consensus.cc:2393] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 16: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
I20260709 13:08:13.322250 16200 raft_consensus.cc:1275] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 22 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:08:13.260713 22633 consensus_queue.cc:1048] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.057s
I20260709 13:08:13.326128 16322 leader_election.cc:304] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:13.271950 22494 raft_consensus.cc:515] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:13.264293 22626 raft_consensus.cc:515] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:13.312000 22486 raft_consensus.cc:493] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:13.334604 22631 raft_consensus.cc:2749] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:13.325162 22359 raft_consensus.cc:515] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:13.335222 22583 leader_election.cc:290] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 19 election: Requested vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:13.335997 22605 leader_election.cc:290] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:13.336621 22281 leader_election.cc:290] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:08:13.340757 22627 log.cc:927] Time spent T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
W20260709 13:08:13.343535 22603 log.cc:927] Time spent T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.728s	user 0.004s	sys 0.000s
I20260709 13:08:13.329919 16322 leader_election.cc:304] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:08:13.349187 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:08:13.315932 22328 raft_consensus.cc:2749] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:13.359169 16201 raft_consensus.cc:1240] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:13.359824 16208 raft_consensus.cc:1275] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:08:13.376807 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:13.387436 16202 raft_consensus.cc:2393] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 10: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:08:13.379242 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:13.388537 16199 raft_consensus.cc:2468] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 18.
I20260709 13:08:13.386029 16941 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8b615ac918a749989f2968826926adf3"
dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
mode: GRACEFUL
new_leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
 from {username='slave'} at 127.0.0.1:58316
I20260709 13:08:13.389699 16941 raft_consensus.cc:606] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 13 LEADER]: Received request to transfer leadership to TS e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:08:13.392942 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 63154.6us
W20260709 13:08:13.380093 22565 consensus_meta.cc:287] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f: Time spent flushing consensus metadata: real 0.583s	user 0.010s	sys 0.003s
I20260709 13:08:13.362339 22610 raft_consensus.cc:3060] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:13.401435 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:13.275218 22611 consensus_queue.cc:237] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:13.409279 16322 leader_election.cc:304] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:08:13.412464 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 98906.2us
I20260709 13:08:13.386770 22633 raft_consensus.cc:493] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:13.313984 22580 raft_consensus.cc:515] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:13.364140 22486 raft_consensus.cc:515] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:08:13.416814 16092 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 73757c6fea8949e090aa4e55902a41d4 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER failed with leader 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 1109f76a0b7b443a84c0327c8707bc63 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 14 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:08:13.399850 22616 leader_election.cc:290] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:13.419768 22625 consensus_queue.cc:1059] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:13.420301 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:08:13.423331 16154 auto_rebalancer.cc:629] Failed to schedule move for tablet 176e2f21e86a4e54a8d9a21aef8a272f: Illegal state: Replica 0aea40d6e4374085a2e38a70a71f63e3 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 17 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } }
I20260709 13:08:13.434623 22638 raft_consensus.cc:2804] T 4b962ceebb5c48c1914459ae0c0eff1b P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:13.435125 22638 raft_consensus.cc:493] T 4b962ceebb5c48c1914459ae0c0eff1b P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:08:13.435508 22638 raft_consensus.cc:3060] T 4b962ceebb5c48c1914459ae0c0eff1b P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:13.439785 22359 leader_election.cc:290] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:13.399003 22583 consensus_queue.cc:1048] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 13:08:13.415422 22281 raft_consensus.cc:493] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:08:13.415654 22631 raft_consensus.cc:2804] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:13.449407 22625 consensus_queue.cc:1243] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer 0aea40d6e4374085a2e38a70a71f63e3 log is divergent from this leader: its last log entry 16.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:08:13.446697 22640 raft_consensus.cc:2749] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:13.431370 22634 raft_consensus.cc:3055] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:08:13.479002 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 104068us
W20260709 13:08:13.479831 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 58096.8us
I20260709 13:08:13.451854 22631 raft_consensus.cc:493] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:13.425765 22635 consensus_queue.cc:1048] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.053s
I20260709 13:08:13.490895 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:13.458145 22516 raft_consensus.cc:3055] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:13.454247 22494 leader_election.cc:290] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:13.491798 16352 raft_consensus.cc:1275] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:08:13.458459 22625 raft_consensus.cc:493] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.490213 16200 raft_consensus.cc:1275] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
W20260709 13:08:13.494520 16154 auto_rebalancer.cc:629] Failed to schedule move for tablet cad5db410b3444caafa5090b94f02dba: Illegal state: Replica 0aea40d6e4374085a2e38a70a71f63e3 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 15 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } }
I20260709 13:08:13.424973 22633 raft_consensus.cc:515] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:13.507349 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:13.478761 22634 raft_consensus.cc:740] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:08:13.514693 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:13.456489 22562 raft_consensus.cc:515] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:13.454691 22281 raft_consensus.cc:515] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:13.513121 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:13.491652 22493 raft_consensus.cc:3055] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:08:13.518350 16357 raft_consensus.cc:1275] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:08:13.593931 16945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:08:13.495373 22609 leader_election.cc:290] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:13.500659 22516 raft_consensus.cc:740] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:08:13.495837 22631 raft_consensus.cc:3060] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:13.595508 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:13.609825 16248 leader_election.cc:304] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:13.614651 16246 leader_election.cc:304] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:13.617599 16248 leader_election.cc:304] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:13.518348 22493 raft_consensus.cc:740] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:08:13.632323 16276 raft_consensus.cc:1275] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:08:13.629631 16357 raft_consensus.cc:1240] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 11. Current term is 12. Ops: []
W20260709 13:08:13.621605 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 106958us
I20260709 13:08:13.631048 16277 raft_consensus.cc:1240] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:13.638458 16942 raft_consensus.cc:1275] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:08:13.503041 22303 raft_consensus.cc:515] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:13.647169 16348 raft_consensus.cc:2393] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 in current term 13: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:08:13.656889 16355 raft_consensus.cc:1275] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 22 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 12. (term mismatch)
I20260709 13:08:13.616117 22338 raft_consensus.cc:493] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:13.632532 22359 raft_consensus.cc:2804] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:13.657395 16355 pending_rounds.cc:85] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e: Aborting all ops after (but not including) 11
I20260709 13:08:13.634738 22605 raft_consensus.cc:2749] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:08:13.678886 22644 log.cc:927] Time spent T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.184s	user 0.000s	sys 0.001s
I20260709 13:08:13.679188 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:13.639364 22583 raft_consensus.cc:2804] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:13.680809 16355 pending_rounds.cc:107] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e: Aborting uncommitted NO_OP operation due to leader change: 21.12
I20260709 13:08:13.689610 16355 raft_consensus.cc:2889] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:13.678514 22645 raft_consensus.cc:993] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63: : Instructing follower e10b16d536674c0bb350a31d7ce5ff7f to start an election
I20260709 13:08:13.681293 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:13.682037 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:13.682691 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:13.685319 22493 consensus_queue.cc:260] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:13.694581 22634 consensus_queue.cc:260] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:13.681550 22338 raft_consensus.cc:515] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:13.704502 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:13.704905 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:13.705446 16278 raft_consensus.cc:3060] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:08:13.705737 22338 leader_election.cc:290] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:13.680730 22359 raft_consensus.cc:493] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:13.706460 22359 raft_consensus.cc:3060] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:13.510388 22625 raft_consensus.cc:515] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:08:13.695051 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 76401.4us
I20260709 13:08:13.693579 16354 raft_consensus.cc:2468] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 16.
I20260709 13:08:13.644768 22626 leader_election.cc:290] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:13.699568 22281 leader_election.cc:290] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:13.700340 22486 leader_election.cc:290] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:13.682111 22516 consensus_queue.cc:260] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:13.686607 16348 consensus_queue.cc:237] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 9, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:08:13.717895 16278 raft_consensus.cc:2468] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 11.
I20260709 13:08:13.705928 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:13.692093 22583 raft_consensus.cc:493] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:08:13.708031 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:13.706511 16322 leader_election.cc:304] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:13.711179 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:13.707983 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:13.676003 22580 leader_election.cc:290] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:13.734802 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:13.738971 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:13.734942 22625 leader_election.cc:290] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:13.709017 22633 leader_election.cc:290] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:13.785063 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:13.789985 16357 raft_consensus.cc:2368] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 10. Current term is 11.
I20260709 13:08:13.790326 16355 raft_consensus.cc:1240] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 13. Current term is 14. Ops: []
W20260709 13:08:13.808967 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 102533us
I20260709 13:08:13.792526 16280 raft_consensus.cc:2468] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 15.
W20260709 13:08:13.804620 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 88541.6us
I20260709 13:08:13.762786 22583 raft_consensus.cc:3060] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:13.819053 22650 raft_consensus.cc:493] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.824090 22650 raft_consensus.cc:515] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:08:13.822692 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:13.837134 16248 leader_election.cc:304] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:13.830538 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:13.836105 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:08:13.838945 16942 raft_consensus.cc:2410] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for term 15 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 13:08:13.805495 22640 raft_consensus.cc:493] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.849857 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:13.819952 22516 raft_consensus.cc:3060] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:13.826514 22650 leader_election.cc:290] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:13.870816 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:13.871820 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:08:13.827061 22406 leader_election.cc:290] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:13.847352 22281 consensus_queue.cc:1048] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 13:08:13.905946 22635 consensus_queue.cc:1059] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.005s
W20260709 13:08:13.918219 16249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:13.931730 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 94668.7us
I20260709 13:08:13.906970 22650 raft_consensus.cc:2749] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:13.909889 22406 raft_consensus.cc:493] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.937418 16248 leader_election.cc:304] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:13.855140 22640 raft_consensus.cc:515] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:13.945704 16945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:13.952587 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:13.904505 22656 consensus_queue.cc:1048] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 7, Time since last communication: 0.031s
W20260709 13:08:13.959060 22655 log.cc:927] Time spent T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.122s	user 0.000s	sys 0.001s
I20260709 13:08:13.958042 16248 leader_election.cc:304] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:08:13.934381 22659 raft_consensus.cc:493] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
W20260709 13:08:13.959933 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 50995.9us
I20260709 13:08:13.953218 22477 raft_consensus.cc:493] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.944167 22621 raft_consensus.cc:2749] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:13.947333 22660 raft_consensus.cc:493] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.956414 22639 raft_consensus.cc:2749] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:13.940425 22486 consensus_queue.cc:1048] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.023s
W20260709 13:08:13.965018 22664 log.cc:927] Time spent T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.144s	user 0.001s	sys 0.000s
I20260709 13:08:13.944295 22406 raft_consensus.cc:515] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:13.972630 16248 leader_election.cc:304] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:08:13.963330 16322 leader_election.cc:304] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:08:13.979565 22671 raft_consensus.cc:2804] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:08:13.982743 16323 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:13.973340 22610 consensus_meta.cc:287] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f: Time spent flushing consensus metadata: real 0.562s	user 0.017s	sys 0.000s
I20260709 13:08:13.969142 22477 raft_consensus.cc:515] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:14.008016 16248 leader_election.cc:400] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107) with higher term. Message: Invalid argument: T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 10. Current term is 11.
I20260709 13:08:14.010377 16248 leader_election.cc:403] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:13.967244 22659 raft_consensus.cc:515] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:08:13.979100 22638 consensus_meta.cc:287] T 4b962ceebb5c48c1914459ae0c0eff1b P 1109f76a0b7b443a84c0327c8707bc63: Time spent flushing consensus metadata: real 0.540s	user 0.014s	sys 0.016s
I20260709 13:08:13.990959 22597 ts_tablet_manager.cc:1929] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 12.10
I20260709 13:08:13.995142 22640 leader_election.cc:290] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:14.008008 16322 leader_election.cc:304] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:08:14.006774 22422 raft_consensus.cc:2749] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:14.011627 16248 leader_election.cc:304] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:08:14.028653 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:14.029412 16357 raft_consensus.cc:2468] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 18.
W20260709 13:08:14.029889 16322 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:14.015296 22406 leader_election.cc:290] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:14.018595 22641 raft_consensus.cc:493] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:14.032434 16246 leader_election.cc:304] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:14.019595 22649 raft_consensus.cc:493] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:14.030402 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:14.033687 16353 raft_consensus.cc:2410] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for term 15 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 13:08:14.031891 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:14.010639 22656 raft_consensus.cc:2804] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:14.007023 22671 raft_consensus.cc:493] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:14.038226 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:14.038884 16278 raft_consensus.cc:2468] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 13.
I20260709 13:08:14.039119 16356 raft_consensus.cc:1275] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 11. (term mismatch)
I20260709 13:08:14.039664 16356 pending_rounds.cc:85] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e: Aborting all ops after (but not including) 10
I20260709 13:08:14.039880 16356 pending_rounds.cc:107] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e: Aborting uncommitted NO_OP operation due to leader change: 15.11
I20260709 13:08:14.040099 16356 raft_consensus.cc:2889] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:14.040165 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:14.040521 16207 raft_consensus.cc:2468] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 10.
I20260709 13:08:14.042155 16948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:14.036278 22406 raft_consensus.cc:2749] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:08:14.042824 16948 raft_consensus.cc:2468] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 17.
I20260709 13:08:14.044004 16280 raft_consensus.cc:1275] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
W20260709 13:08:14.049145 22668 log.cc:927] Time spent T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
I20260709 13:08:14.049804 22672 raft_consensus.cc:2749] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:08:14.050331 22359 raft_consensus.cc:515] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:14.051981 16283 raft_consensus.cc:1240] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 13:08:14.024475 22626 raft_consensus.cc:2749] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107) with higher term. Message: Invalid argument: T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 10. Current term is 11.
I20260709 13:08:14.031646 22597 log.cc:1199] T 4b962ceebb5c48c1914459ae0c0eff1b P e10b16d536674c0bb350a31d7ce5ff7f: Deleting WAL directory at /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602283040513-15057-0/minicluster-data/ts-0-root/wals/4b962ceebb5c48c1914459ae0c0eff1b
I20260709 13:08:14.053049 16248 leader_election.cc:304] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:08:14.024788 22583 raft_consensus.cc:515] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:14.036196 22484 raft_consensus.cc:2804] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:13.972148 22660 raft_consensus.cc:515] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:14.066242 22484 raft_consensus.cc:493] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:14.071049 22484 raft_consensus.cc:3060] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:14.071125 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:14.072925 22597 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44830 (request call id 0) took 1675 ms. Trace:
I20260709 13:08:14.073364 22597 rpcz_store.cc:276] 0709 13:08:12.397510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:12.397783 (+   273us) service_pool.cc:224] Handling call
0709 13:08:12.594487 (+196704us) ts_tablet_manager.cc:1151] Deleting tablet 4b962ceebb5c48c1914459ae0c0eff1b
0709 13:08:12.609185 (+ 14698us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:08:13.446045 (+836860us) tablet_metadata.cc:665] Metadata flushed
0709 13:08:13.990785 (+544740us) tablet_metadata.cc:665] Metadata flushed
0709 13:08:14.072822 (+ 82037us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":62673,"tablet-delete.queue_time_us":159532,"thread_start_us":98281,"threads_started":1}
I20260709 13:08:14.032985 22638 raft_consensus.cc:515] T 4b962ceebb5c48c1914459ae0c0eff1b P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:14.076346 22660 leader_election.cc:290] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:14.076628 22638 leader_election.cc:290] T 4b962ceebb5c48c1914459ae0c0eff1b P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 13 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:14.045998 22671 raft_consensus.cc:3060] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:14.077164 22542 raft_consensus.cc:493] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:14.041177 22641 raft_consensus.cc:515] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:14.077971 22542 raft_consensus.cc:515] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:14.081274 22641 leader_election.cc:290] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:14.066124 22422 raft_consensus.cc:2804] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:14.083010 22422 raft_consensus.cc:493] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:14.083458 22422 raft_consensus.cc:3060] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:14.081346 22486 consensus_queue.cc:1048] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 13:08:14.083935 22542 leader_election.cc:290] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:14.084331 22359 leader_election.cc:290] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 19 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:14.077342 22631 raft_consensus.cc:515] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:14.085250 16090 catalog_manager.cc:5028] TS e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): tablet 4b962ceebb5c48c1914459ae0c0eff1b (table test-workload [id=f364cfe226234c5b99453e3013c8717e]) successfully deleted
I20260709 13:08:14.087037 22631 leader_election.cc:290] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 16 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:14.088281 16944 raft_consensus.cc:2468] T 4b962ceebb5c48c1914459ae0c0eff1b P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 13.
W20260709 13:08:14.088783 22619 log.cc:927] Time spent T 00000000000000000000000000000000 P 4dc6f08597514f4d85fd451b999b403e: Append to log took a long time: real 0.063s	user 0.002s	sys 0.000s
I20260709 13:08:14.036983 22649 raft_consensus.cc:515] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:14.063692 22656 raft_consensus.cc:697] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 11 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:08:14.097323 22659 leader_election.cc:290] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:14.097098 22656 consensus_queue.cc:237] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:14.099236 22650 raft_consensus.cc:493] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:08:14.100023 22650 raft_consensus.cc:515] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:08:14.102345 16249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:14.065135 22665 log.cc:927] Time spent T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 13:08:14.105404 22650 leader_election.cc:290] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:14.106849 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:14.107770 16205 raft_consensus.cc:2410] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:08:14.113525 22422 raft_consensus.cc:515] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:14.097703 22649 leader_election.cc:290] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:14.117631 22671 raft_consensus.cc:515] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:14.129643 16322 leader_election.cc:304] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:08:14.137883 22520 raft_consensus.cc:3055] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:14.138648 22520 raft_consensus.cc:740] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:08:14.140015 22520 consensus_queue.cc:260] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:14.145022 16914 leader_election.cc:304] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:14.150707 22659 raft_consensus.cc:993] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63: : Instructing follower 363bb2f744eb486f9ad726f08214c98e to start an election
I20260709 13:08:14.167644 22659 raft_consensus.cc:1081] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [term 12 LEADER]: Signalling peer 363bb2f744eb486f9ad726f08214c98e to start an election
I20260709 13:08:14.145629 22303 leader_election.cc:290] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 16 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:14.158164 22477 leader_election.cc:290] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:14.170991 22677 raft_consensus.cc:493] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:14.171873 22294 raft_consensus.cc:493] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:08:14.172191 22673 raft_consensus.cc:493] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:08:14.172458 22294 raft_consensus.cc:515] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:14.173064 22673 raft_consensus.cc:515] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:14.177069 22673 leader_election.cc:290] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:14.178591 22580 raft_consensus.cc:3055] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:14.179057 22580 raft_consensus.cc:740] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:08:14.179293 22516 consensus_queue.cc:1059] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:14.180229 22516 consensus_queue.cc:1048] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:14.181450 22294 leader_election.cc:290] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:14.159847 22259 leader_election.cc:290] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:14.184557 22643 raft_consensus.cc:493] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:08:14.185145 22643 raft_consensus.cc:515] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:14.187875 22643 leader_election.cc:290] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:14.171494 22677 raft_consensus.cc:515] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:14.174289 22625 raft_consensus.cc:493] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:08:14.191057 22625 raft_consensus.cc:515] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:14.193215 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:08:14.193966 16200 raft_consensus.cc:3060] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:14.196072 22580 consensus_queue.cc:260] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:14.197536 22580 raft_consensus.cc:3060] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:14.199164 22638 raft_consensus.cc:2749] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:14.203074 22677 leader_election.cc:290] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:14.204627 22520 raft_consensus.cc:3060] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:14.206952 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:14.207437 16206 raft_consensus.cc:1275] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 13:08:14.205435 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:14.193274 22625 leader_election.cc:290] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:14.207993 16206 pending_rounds.cc:85] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f: Aborting all ops after (but not including) 8
I20260709 13:08:14.208418 16206 pending_rounds.cc:107] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:08:14.208731 16206 raft_consensus.cc:2889] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:14.210289 16205 raft_consensus.cc:1275] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 20 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:08:14.217765 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:14.220328 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:08:14.218822 16202 raft_consensus.cc:2468] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 12.
I20260709 13:08:14.222322 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:14.224823 16283 raft_consensus.cc:1240] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 17. Current term is 18. Ops: [16.11-17.12]
I20260709 13:08:14.224546 16200 raft_consensus.cc:2468] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 11.
I20260709 13:08:14.230513 16248 leader_election.cc:304] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
W20260709 13:08:14.243803 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 173869us
I20260709 13:08:14.215317 22674 raft_consensus.cc:2749] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:14.244884 16246 leader_election.cc:304] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:14.249145 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f022e2e63ae4461d834e476ff2666991" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:14.246064 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:14.246940 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:14.250408 16246 leader_election.cc:304] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:14.250617 16353 raft_consensus.cc:2393] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 in current term 18: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:08:14.250440 16356 raft_consensus.cc:2468] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 13.
I20260709 13:08:14.252444 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:14.218982 22626 raft_consensus.cc:493] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:14.256914 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:14.257275 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:14.262117 16322 leader_election.cc:304] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:14.262321 16320 leader_election.cc:304] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:14.263819 16246 leader_election.cc:304] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:14.265138 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:14.265640 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:14.263797 16322 leader_election.cc:304] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:08:14.265072 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:14.268496 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
W20260709 13:08:14.269239 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:14.270953 16947 raft_consensus.cc:2393] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 16: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
I20260709 13:08:14.270794 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:14.271679 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:14.272660 16353 raft_consensus.cc:2393] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 16: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:08:14.242846 22643 raft_consensus.cc:2749] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:14.274271 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:08:14.274675 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:14.273552 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:14.266865 16914 leader_election.cc:304] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:08:14.277554 16200 raft_consensus.cc:3060] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:14.276816 16351 raft_consensus.cc:2393] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 in current term 13: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:08:14.280330 22679 raft_consensus.cc:493] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:08:14.280903 22679 raft_consensus.cc:515] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:14.282683 22679 leader_election.cc:290] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:14.277693 16942 raft_consensus.cc:2468] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 14.
I20260709 13:08:14.283406 22649 raft_consensus.cc:2804] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:14.283820 22649 raft_consensus.cc:493] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:14.283910 16948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:14.284134 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:08:14.284248 22649 raft_consensus.cc:3060] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:14.285044 22493 raft_consensus.cc:3060] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:14.287971 22674 raft_consensus.cc:2749] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:14.288758 22674 raft_consensus.cc:2804] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:14.289155 22674 raft_consensus.cc:493] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:14.289480 22674 raft_consensus.cc:3060] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:14.270407 22626 raft_consensus.cc:515] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:14.287892 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:14.292706 16200 raft_consensus.cc:2468] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 19.
I20260709 13:08:14.262092 22671 leader_election.cc:290] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 election: Requested vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:14.265018 22253 raft_consensus.cc:493] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:14.254506 22583 leader_election.cc:290] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:14.266623 22328 raft_consensus.cc:2749] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:14.265309 22406 raft_consensus.cc:2749] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:14.275338 21962 consensus_queue.cc:1048] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 13:08:14.258999 16356 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7295dce0baa440b8a197da845581ee81"
dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
 from {username='slave'} at 127.0.0.1:33486
I20260709 13:08:14.261085 22676 raft_consensus.cc:2749] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:14.313292 16356 raft_consensus.cc:493] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:14.294922 22057 raft_consensus.cc:493] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:14.297644 22253 raft_consensus.cc:515] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:14.311818 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f022e2e63ae4461d834e476ff2666991" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:14.313752 16356 raft_consensus.cc:3060] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:14.318984 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 63235us
W20260709 13:08:14.319720 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 55995.6us
I20260709 13:08:14.320832 22588 raft_consensus.cc:493] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:14.273505 22646 raft_consensus.cc:2749] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:08:14.324103 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:14.331723 16275 raft_consensus.cc:2468] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 20.
W20260709 13:08:14.332597 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:14.340828 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:14.350350 16206 raft_consensus.cc:1240] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 19 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 13:08:14.352272 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:08:14.331162 16322 consensus_peers.cc:597] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e -> Peer 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875): Couldn't send request to peer 1109f76a0b7b443a84c0327c8707bc63. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5c2f49b7f95a4153b2d180218e6af1db. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:14.361115 16203 raft_consensus.cc:1275] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 19 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:08:14.360895 22406 raft_consensus.cc:493] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:14.366451 22406 raft_consensus.cc:515] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:14.367054 22685 consensus_queue.cc:1048] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.012s
I20260709 13:08:14.368777 22406 leader_election.cc:290] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:14.327018 22057 raft_consensus.cc:515] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:14.349426 22588 raft_consensus.cc:515] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:14.371541 22057 leader_election.cc:290] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:14.374330 22588 leader_election.cc:290] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:14.377592 22674 raft_consensus.cc:515] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:14.378119 22422 leader_election.cc:290] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 19 election: Requested vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:14.377592 22649 raft_consensus.cc:515] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:14.360649 16322 leader_election.cc:304] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:08:14.365027 16320 leader_election.cc:304] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:14.383737 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:08:14.399870 16174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:14.428053 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:08:14.440689 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 56064.3us
I20260709 13:08:14.441220 16914 leader_election.cc:304] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:14.428205 22328 raft_consensus.cc:2804] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:14.428519 22656 raft_consensus.cc:2804] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:14.444449 22328 raft_consensus.cc:493] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:08:14.444927 22328 raft_consensus.cc:3060] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:14.447414 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:14.448284 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:14.449512 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:14.451408 16914 leader_election.cc:304] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:14.456774 16282 raft_consensus.cc:2393] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 14: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:08:14.455168 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:14.453155 22315 raft_consensus.cc:2749] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:14.359115 22484 raft_consensus.cc:515] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:14.453255 22656 raft_consensus.cc:493] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting leader election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:08:14.466096 16274 raft_consensus.cc:1240] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 18. Current term is 19. Ops: []
I20260709 13:08:14.466353 22656 raft_consensus.cc:3060] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:14.466822 16354 raft_consensus.cc:2368] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 16. Current term is 17.
I20260709 13:08:14.468866 22484 leader_election.cc:290] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 17 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:14.459604 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:14.461596 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:14.470337 16352 raft_consensus.cc:2468] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 13.
I20260709 13:08:14.465164 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:14.461947 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:14.471689 16280 raft_consensus.cc:2368] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 for earlier term 18. Current term is 19.
I20260709 13:08:14.357676 22687 consensus_queue.cc:1048] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.124s
I20260709 13:08:14.470297 16275 raft_consensus.cc:2468] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 14.
I20260709 13:08:14.474992 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:14.473287 16173 leader_election.cc:304] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:14.453775 22673 raft_consensus.cc:493] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:08:14.456149 22614 raft_consensus.cc:493] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:14.481844 16914 leader_election.cc:304] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:14.475726 16275 raft_consensus.cc:2468] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 16.
I20260709 13:08:14.484984 16351 raft_consensus.cc:1240] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:08:14.484623 22673 raft_consensus.cc:515] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:14.485903 22649 leader_election.cc:290] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 15 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:14.487160 22673 leader_election.cc:290] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:14.489073 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:08:14.489810 16944 raft_consensus.cc:3060] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:14.491600 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:14.492506 16275 raft_consensus.cc:3060] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:14.497179 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:14.502168 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:14.504033 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:14.505900 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:14.464231 22303 raft_consensus.cc:2749] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:08:14.513495 16249 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:14.513131 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:14.514832 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:14.517872 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:14.525216 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:14.528085 16277 raft_consensus.cc:2468] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 13.
I20260709 13:08:14.456107 22294 consensus_queue.cc:1059] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 13:08:14.489286 22493 raft_consensus.cc:2804] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:14.535530 16941 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:58316 (request call id 3) took 1159 ms. Trace:
I20260709 13:08:14.541188 16352 raft_consensus.cc:1275] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:08:14.543956 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:14.508819 22588 raft_consensus.cc:2804] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:14.541201 16941 rpcz_store.cc:276] 0709 13:08:13.363102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:13.363278 (+   176us) service_pool.cc:224] Handling call
0709 13:08:14.522690 (+1159412us) spinlock_profiling.cc:243] Waited 4.42 ms on lock 0x7b4c003537c0. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361d755a20 00007f361d766a29 00007f361d72c644 00007f361d753f2d 00007f361d753b93 00007f361f483c92 00007f361f48384a 00007f362445160a 00007f361d9d77d4 00007f361d9d7762 00007f361d9d7691
0709 13:08:14.522843 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10170240}
I20260709 13:08:14.544945 16276 raft_consensus.cc:2468] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 17.
I20260709 13:08:14.524001 22511 raft_consensus.cc:1081] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 13 LEADER]: Signalling peer e10b16d536674c0bb350a31d7ce5ff7f to start an election
I20260709 13:08:14.557998 16355 raft_consensus.cc:1217] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 19 LEADER]: Deduplicated request from leader. Original: 17.9->[18.10-18.10]   Dedup: 18.10->[]
I20260709 13:08:14.559077 16355 raft_consensus.cc:1240] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 19 LEADER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260709 13:08:14.560041 22477 raft_consensus.cc:3055] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:08:14.560606 22477 raft_consensus.cc:740] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:08:14.561499 22477 consensus_queue.cc:260] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:14.546753 22616 raft_consensus.cc:493] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:08:14.563030 22616 raft_consensus.cc:515] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:14.565337 22616 leader_election.cc:290] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:14.567166 16354 raft_consensus.cc:1275] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:08:14.569741 16275 raft_consensus.cc:2468] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 17.
I20260709 13:08:14.570820 22493 raft_consensus.cc:697] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 18 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:08:14.575418 16914 leader_election.cc:400] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 18 pre-election: Vote denied by peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823) with higher term. Message: Invalid argument: T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 for earlier term 18. Current term is 19.
I20260709 13:08:14.605377 16914 leader_election.cc:403] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:14.605499 16279 raft_consensus.cc:1217] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Deduplicated request from leader. Original: 15.8->[17.9-18.10]   Dedup: 18.10->[]
I20260709 13:08:14.606036 16279 raft_consensus.cc:1240] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 18. Current term is 19. Ops: [17.9-18.10]
I20260709 13:08:14.591717 16945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:08:14.607123 16945 raft_consensus.cc:3060] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:08:14.592007 16282 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423"
dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
mode: GRACEFUL
new_leader_uuid: "363bb2f744eb486f9ad726f08214c98e"
 from {username='slave'} at 127.0.0.1:39058
I20260709 13:08:14.608428 16282 raft_consensus.cc:606] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Received request to transfer leadership to TS 363bb2f744eb486f9ad726f08214c98e
I20260709 13:08:14.593291 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:14.593717 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:14.594919 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:14.611584 16275 raft_consensus.cc:1240] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 16. Current term is 17. Ops: []
W20260709 13:08:14.597651 16207 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39674 (request call id 1565) took 1275 ms (client timeout 1675 ms). Trace:
I20260709 13:08:14.601069 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:14.613174 16248 leader_election.cc:400] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 election: Vote denied by peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107) with higher term. Message: Invalid argument: T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 16. Current term is 17.
I20260709 13:08:14.594964 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:14.613515 16248 leader_election.cc:403] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:08:14.614471 16282 raft_consensus.cc:614] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:14.508251 22614 raft_consensus.cc:515] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:14.573258 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:14.621187 16278 raft_consensus.cc:3060] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:14.555239 22588 raft_consensus.cc:493] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:14.608631 16356 raft_consensus.cc:515] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:14.618435 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:08:14.626070 16279 raft_consensus.cc:1275] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:08:14.626536 16947 raft_consensus.cc:3060] T 4b962ceebb5c48c1914459ae0c0eff1b P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:14.619040 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:08:14.612399 16207 rpcz_store.cc:269] 0709 13:08:13.322887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:13.323207 (+   320us) service_pool.cc:224] Handling call
0709 13:08:14.597437 (+1274230us) spinlock_profiling.cc:243] Waited 625 ms on lock 0x7b54001c7d54. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f48d2fa 00007f362444eb17 00007f361d9c96d4 00007f361d9c9662 00007f361d9c9591 00007f361d9c950c 00007f361d9c87c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:08:14.597561 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1438365440}
I20260709 13:08:14.630541 16348 raft_consensus.cc:1240] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:14.628221 16280 raft_consensus.cc:2410] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for term 15 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 13:08:14.618844 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:14.640038 16275 raft_consensus.cc:3060] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:14.573693 22634 raft_consensus.cc:3060] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:14.638970 16246 leader_election.cc:304] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:14.571871 22661 raft_consensus.cc:493] T 540bfc4ad793452faea5b865343aacf7 P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
W20260709 13:08:14.654800 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 128743us
I20260709 13:08:14.691421 16948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
W20260709 13:08:14.685983 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 51679.4us
I20260709 13:08:14.572991 22253 leader_election.cc:290] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:14.586864 22674 leader_election.cc:290] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:14.602155 22626 leader_election.cc:290] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:08:14.692102 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 53309.6us
I20260709 13:08:14.620424 22477 raft_consensus.cc:3060] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:14.622635 22676 raft_consensus.cc:2749] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107) with higher term. Message: Invalid argument: T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 16. Current term is 17.
I20260709 13:08:14.576457 22659 consensus_queue.cc:1059] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.124s
I20260709 13:08:14.712177 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:14.712917 16356 leader_election.cc:290] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:14.632090 22588 raft_consensus.cc:3060] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:14.713196 16246 leader_election.cc:304] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 363bb2f744eb486f9ad726f08214c98e
I20260709 13:08:14.725590 16246 leader_election.cc:304] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:14.714167 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:14.726534 16277 raft_consensus.cc:2468] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 14.
I20260709 13:08:14.712245 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:14.715404 16322 leader_election.cc:304] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:14.628144 16355 raft_consensus.cc:1275] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 20 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:08:14.719431 16944 raft_consensus.cc:2468] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 17.
I20260709 13:08:14.736480 16246 leader_election.cc:304] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:14.707968 22605 raft_consensus.cc:2749] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:08:14.740399 16246 leader_election.cc:304] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:14.741617 16322 leader_election.cc:304] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:08:14.574934 22493 consensus_queue.cc:237] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:14.744619 16322 leader_election.cc:304] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:14.749331 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:14.755016 16275 raft_consensus.cc:2468] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 14.
I20260709 13:08:14.758330 16945 raft_consensus.cc:2468] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 19.
I20260709 13:08:14.759234 16947 raft_consensus.cc:2468] T 4b962ceebb5c48c1914459ae0c0eff1b P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 14.
I20260709 13:08:14.724550 22562 leader_election.cc:290] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 17 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:14.700066 22328 raft_consensus.cc:515] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:14.737857 22626 raft_consensus.cc:2804] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:14.768348 16278 raft_consensus.cc:2468] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 15.
I20260709 13:08:14.717845 22673 consensus_queue.cc:1048] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 13:08:14.742827 22631 raft_consensus.cc:2749] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:08:14.711930 22661 raft_consensus.cc:515] T 540bfc4ad793452faea5b865343aacf7 P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:14.745891 22486 raft_consensus.cc:2749] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:14.745776 22646 raft_consensus.cc:2749] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:14.761188 22649 raft_consensus.cc:2749] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823) with higher term. Message: Invalid argument: T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 for earlier term 18. Current term is 19.
I20260709 13:08:14.748502 22630 raft_consensus.cc:2804] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:08:14.746083 22684 raft_consensus.cc:2749] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:08:14.782155 16276 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a"
dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
mode: GRACEFUL
new_leader_uuid: "363bb2f744eb486f9ad726f08214c98e"
 from {username='slave'} at 127.0.0.1:39058
I20260709 13:08:14.750794 22606 raft_consensus.cc:493] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:14.785892 16353 raft_consensus.cc:1240] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 12. Current term is 13. Ops: []
W20260709 13:08:14.804164 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 112088us
I20260709 13:08:14.781152 22626 raft_consensus.cc:697] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:08:14.805250 22612 raft_consensus.cc:493] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:14.789085 22625 raft_consensus.cc:493] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:14.808943 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 178994us
I20260709 13:08:14.787494 22630 raft_consensus.cc:493] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:14.819458 16914 leader_election.cc:304] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 363bb2f744eb486f9ad726f08214c98e
W20260709 13:08:14.810662 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 179024us
I20260709 13:08:14.789449 22640 raft_consensus.cc:2749] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:14.820896 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:14.823424 16914 leader_election.cc:304] T 4b962ceebb5c48c1914459ae0c0eff1b P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 363bb2f744eb486f9ad726f08214c98e
I20260709 13:08:14.825100 16912 leader_election.cc:304] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:08:14.793248 22606 raft_consensus.cc:515] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:14.816754 22486 raft_consensus.cc:493] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:08:14.863083 16248 leader_election.cc:304] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:14.796299 22484 consensus_queue.cc:1048] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 13:08:14.864843 22646 raft_consensus.cc:2749] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:14.866526 16201 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8b615ac918a749989f2968826926adf3"
dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
 from {username='slave'} at 127.0.0.1:39674
I20260709 13:08:14.867165 16201 raft_consensus.cc:493] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:14.867591 16201 raft_consensus.cc:3060] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:14.824026 22630 raft_consensus.cc:3060] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:14.831889 22315 raft_consensus.cc:2764] T 4b962ceebb5c48c1914459ae0c0eff1b P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Leader election decision vote started in defunct term 13: won
I20260709 13:08:14.831467 22511 raft_consensus.cc:2764] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 13:08:14.860301 16914 leader_election.cc:304] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:08:14.860738 22656 raft_consensus.cc:515] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:08:14.862087 22690 log.cc:927] Time spent T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 13:08:14.862022 22699 raft_consensus.cc:2804] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:08:14.862831 22486 raft_consensus.cc:515] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:14.856968 22702 consensus_queue.cc:1048] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:14.872761 16248 leader_election.cc:304] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
W20260709 13:08:14.918974 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:14.950783 16174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:14.823225 22612 raft_consensus.cc:515] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:08:14.994692 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 122054us
I20260709 13:08:14.996562 16351 raft_consensus.cc:3060] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:08:14.995729 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 208689us
I20260709 13:08:14.850584 22617 consensus_queue.cc:1048] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 13:08:14.998193 16322 leader_election.cc:304] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:14.831691 22625 raft_consensus.cc:515] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:14.996367 22511 raft_consensus.cc:2804] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:14.997256 22614 leader_election.cc:290] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:15.001561 22605 raft_consensus.cc:2804] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:08:15.029866 22698 log.cc:927] Time spent T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.204s	user 0.000s	sys 0.001s
I20260709 13:08:14.999847 22699 raft_consensus.cc:697] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 LEADER]: Becoming Leader. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:08:15.032162 22640 raft_consensus.cc:2749] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:08:15.057983 22612 leader_election.cc:290] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:15.026198 16201 raft_consensus.cc:515] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:15.071444 16351 raft_consensus.cc:2468] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 15.
I20260709 13:08:14.996101 22626 consensus_queue.cc:237] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:08:15.095397 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 251355us
I20260709 13:08:15.054986 22605 raft_consensus.cc:697] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:08:15.053802 22511 raft_consensus.cc:697] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 15 LEADER]: Becoming Leader. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
W20260709 13:08:15.074487 22694 log.cc:927] Time spent T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.198s	user 0.001s	sys 0.000s
I20260709 13:08:15.063990 22328 leader_election.cc:290] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:15.117662 16322 leader_election.cc:304] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:15.130770 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:08:15.132063 16201 leader_election.cc:290] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 14 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:15.153882 16322 leader_election.cc:304] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:08:15.157992 16322 leader_election.cc:304] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:15.135941 22480 raft_consensus.cc:493] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:08:15.159373 22486 leader_election.cc:290] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:08:15.151010 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 329164us
I20260709 13:08:15.159152 22480 raft_consensus.cc:515] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:15.141446 22639 raft_consensus.cc:493] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:08:15.167286 16173 leader_election.cc:304] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:08:15.162351 22328 raft_consensus.cc:2804] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:15.273429 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:15.162060 22652 raft_consensus.cc:2804] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:15.291730 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:15.163226 22661 leader_election.cc:290] T 540bfc4ad793452faea5b865343aacf7 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:08:15.297511 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 130354us
I20260709 13:08:15.300676 16173 leader_election.cc:304] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:08:15.296253 22328 raft_consensus.cc:697] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 17 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:08:15.301990 22328 consensus_queue.cc:237] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:15.165438 22493 consensus_queue.cc:1059] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.122s
I20260709 13:08:15.306912 22710 raft_consensus.cc:2749] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:15.155640 22699 consensus_queue.cc:237] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:08:15.311299 22708 log.cc:927] Time spent T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.208s	user 0.000s	sys 0.000s
I20260709 13:08:15.272277 22656 leader_election.cc:290] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:15.323094 22625 leader_election.cc:290] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:15.324038 22705 raft_consensus.cc:493] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
W20260709 13:08:15.324990 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 55706.8us
I20260709 13:08:15.324726 22705 raft_consensus.cc:515] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:15.327328 22705 leader_election.cc:290] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:15.275553 22511 consensus_queue.cc:237] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:15.252730 22259 raft_consensus.cc:2749] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:15.332978 22480 leader_election.cc:290] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:15.323344 22493 raft_consensus.cc:2749] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:15.312668 22709 raft_consensus.cc:2955] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 20 LEADER]: Committing config change with OpId 20.11: config changed from index -1 to 11, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:08:15.337004 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:15.251952 22605 consensus_queue.cc:237] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:15.271490 22713 raft_consensus.cc:493] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:15.340665 22713 raft_consensus.cc:515] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:15.349895 22710 raft_consensus.cc:3055] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:15.350390 22710 raft_consensus.cc:740] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:08:15.351763 22710 consensus_queue.cc:260] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:15.353088 22710 raft_consensus.cc:3060] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:15.347666 22612 consensus_queue.cc:1048] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.006s
I20260709 13:08:15.275699 22639 raft_consensus.cc:515] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:08:15.355098 22477 consensus_meta.cc:287] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 0.634s	user 0.011s	sys 0.000s
I20260709 13:08:15.356052 22639 leader_election.cc:290] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:15.356690 22617 consensus_queue.cc:1048] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:15.290688 22652 raft_consensus.cc:493] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:08:15.357963 22652 raft_consensus.cc:3060] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:08:15.295369 22701 log.cc:927] Time spent T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.244s	user 0.000s	sys 0.001s
I20260709 13:08:15.363289 22713 leader_election.cc:290] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:08:15.357988 22588 consensus_meta.cc:287] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63: Time spent flushing consensus metadata: real 0.618s	user 0.004s	sys 0.006s
I20260709 13:08:15.364584 22588 raft_consensus.cc:515] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:15.373817 16945 raft_consensus.cc:1240] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 16 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 15. Current term is 16. Ops: []
W20260709 13:08:15.342724 22634 consensus_meta.cc:287] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3: Time spent flushing consensus metadata: real 0.608s	user 0.006s	sys 0.006s
W20260709 13:08:15.384511 16173 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:15.388206 16276 raft_consensus.cc:606] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Received request to transfer leadership to TS 363bb2f744eb486f9ad726f08214c98e
I20260709 13:08:15.388283 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:08:15.388741 16276 raft_consensus.cc:614] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:15.391769 16948 raft_consensus.cc:1240] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:15.397241 22630 raft_consensus.cc:515] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:15.403101 22588 leader_election.cc:290] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 14 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:15.391170 22646 raft_consensus.cc:493] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:15.408710 22646 raft_consensus.cc:515] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:15.413952 22630 leader_election.cc:290] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 21 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:08:15.424649 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 263910us
I20260709 13:08:15.482146 16173 leader_election.cc:304] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
W20260709 13:08:15.490108 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 55338.8us
W20260709 13:08:15.498776 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 340840us
I20260709 13:08:15.507865 16322 leader_election.cc:304] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:08:15.511794 16199 raft_consensus.cc:1275] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:08:15.518209 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:15.520354 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:15.514619 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:15.523578 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:08:15.524232 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:15.513593 16203 raft_consensus.cc:2955] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 20 FOLLOWER]: Committing config change with OpId 20.11: config changed from index -1 to 11, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:08:15.531801 16173 leader_election.cc:304] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:08:15.491535 22710 consensus_queue.cc:1059] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 13:08:15.507558 22695 raft_consensus.cc:493] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:08:15.542805 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:15.521579 22636 raft_consensus.cc:2749] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:15.546402 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:15.546871 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:15.549213 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:15.549870 16355 raft_consensus.cc:2468] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 14.
I20260709 13:08:15.527513 22685 raft_consensus.cc:2804] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:15.542853 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:15.554489 16353 raft_consensus.cc:3060] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:15.552739 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:15.557741 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:15.559849 16201 raft_consensus.cc:2393] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 10: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
I20260709 13:08:15.561236 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bc3c8ff9b84838a2664335d7e1582b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:15.562532 16279 raft_consensus.cc:1275] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:08:15.567005 16278 raft_consensus.cc:1240] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:15.569296 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:15.570274 16281 raft_consensus.cc:2468] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 15.
I20260709 13:08:15.559892 22672 raft_consensus.cc:493] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:15.538697 22712 raft_consensus.cc:2749] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:15.552119 22583 raft_consensus.cc:493] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:15.580643 16206 raft_consensus.cc:1240] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:15.581034 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: true dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:15.581676 16277 raft_consensus.cc:3060] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:15.534147 22711 consensus_queue.cc:1048] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:08:15.598982 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:08:15.613194 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:15.616323 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:15.617897 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:15.619637 16280 raft_consensus.cc:1275] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:08:15.620934 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:15.621467 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:15.543705 22695 raft_consensus.cc:515] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:15.622160 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:15.621491 16280 raft_consensus.cc:3060] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:15.625620 16275 raft_consensus.cc:2368] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for earlier term 14. Current term is 15.
I20260709 13:08:15.628357 16948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:08:15.632489 16948 raft_consensus.cc:3055] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:15.554095 22630 consensus_queue.cc:1048] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:08:15.629530 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:15.635550 16281 raft_consensus.cc:3060] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:15.631179 16947 raft_consensus.cc:2393] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 16: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
I20260709 13:08:15.633970 16945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:15.632889 16948 raft_consensus.cc:740] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:08:15.636466 16945 raft_consensus.cc:2468] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 12.
I20260709 13:08:15.637131 16948 consensus_queue.cc:260] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:15.637696 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:15.627477 22685 raft_consensus.cc:697] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 14 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:08:15.639068 22685 consensus_queue.cc:237] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:15.575064 22672 raft_consensus.cc:515] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:15.642637 22672 leader_election.cc:290] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:15.621798 22617 consensus_queue.cc:1048] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.022s
I20260709 13:08:15.638134 16948 raft_consensus.cc:3060] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:15.645887 16246 leader_election.cc:304] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:15.657405 16248 leader_election.cc:304] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:15.622545 22711 consensus_queue.cc:1243] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer 0aea40d6e4374085a2e38a70a71f63e3 log is divergent from this leader: its last log entry 11.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:08:15.674968 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:15.665338 16173 leader_election.cc:304] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:15.612322 22583 raft_consensus.cc:515] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:15.688488 16277 raft_consensus.cc:2468] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 14.
I20260709 13:08:15.690301 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:15.663239 22486 raft_consensus.cc:3060] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:08:15.678761 22605 raft_consensus.cc:2749] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:15.697566 16282 raft_consensus.cc:1240] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:15.674094 22713 raft_consensus.cc:493] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:15.705675 16274 raft_consensus.cc:2468] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 10.
I20260709 13:08:15.707047 22656 raft_consensus.cc:493] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:15.707638 22656 raft_consensus.cc:515] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:08:15.707566 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 50243us
I20260709 13:08:15.709861 22656 leader_election.cc:290] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:15.708997 16248 leader_election.cc:304] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:15.693421 22693 raft_consensus.cc:2804] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:15.676048 22712 consensus_queue.cc:1048] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.035s
I20260709 13:08:15.712523 16280 raft_consensus.cc:2468] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 21.
I20260709 13:08:15.695369 22562 consensus_queue.cc:1059] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:08:15.721395 22709 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:38982 (request call id 1) took 2046 ms. Trace:
W20260709 13:08:15.720958 22726 log.cc:927] Time spent T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.146s	user 0.001s	sys 0.000s
W20260709 13:08:15.720914 22729 log.cc:927] Time spent T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 13:08:15.715962 22693 raft_consensus.cc:493] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:15.726861 22634 raft_consensus.cc:2804] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:15.741488 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:15.741753 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:08:15.752884 22725 log.cc:927] Time spent T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.170s	user 0.001s	sys 0.000s
W20260709 13:08:15.753759 22727 log.cc:927] Time spent T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63: Append to log took a long time: real 0.200s	user 0.001s	sys 0.000s
I20260709 13:08:15.740684 22612 raft_consensus.cc:493] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:08:15.755337 22676 raft_consensus.cc:3055] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:15.762125 16322 leader_election.cc:304] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:15.712304 22713 raft_consensus.cc:515] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:15.767760 16351 raft_consensus.cc:1275] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 12. (term mismatch)
I20260709 13:08:15.769049 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:08:15.772157 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 48524.5us
I20260709 13:08:15.776791 16357 raft_consensus.cc:1240] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 21 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 20. Current term is 21. Ops: [20.14-20.14]
I20260709 13:08:15.777830 16351 pending_rounds.cc:85] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e: Aborting all ops after (but not including) 11
I20260709 13:08:15.778257 16351 pending_rounds.cc:107] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e: Aborting uncommitted NO_OP operation due to leader change: 17.12
I20260709 13:08:15.778623 16351 raft_consensus.cc:2889] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:15.777041 16278 raft_consensus.cc:2468] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 14.
I20260709 13:08:15.764578 22693 raft_consensus.cc:3060] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:15.761314 22724 raft_consensus.cc:493] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:08:15.764168 22634 raft_consensus.cc:493] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:08:15.776964 22676 raft_consensus.cc:740] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:08:15.787271 22741 raft_consensus.cc:493] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:15.797719 22674 raft_consensus.cc:2749] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:15.781524 22612 raft_consensus.cc:515] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:15.797375 22634 raft_consensus.cc:3060] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:08:15.813773 22731 log.cc:927] Time spent T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.179s	user 0.001s	sys 0.001s
I20260709 13:08:15.822849 16248 leader_election.cc:304] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:15.834506 16353 raft_consensus.cc:2468] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 19.
I20260709 13:08:15.835934 16322 leader_election.cc:400] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 election: Vote denied by peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823) with higher term. Message: Invalid argument: T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for earlier term 14. Current term is 15.
I20260709 13:08:15.836459 16322 leader_election.cc:403] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:08:15.815748 16281 raft_consensus.cc:2468] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 13.
W20260709 13:08:15.842283 16914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:15.801920 22724 raft_consensus.cc:515] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:15.810508 22294 consensus_queue.cc:1048] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:08:15.863291 16322 leader_election.cc:304] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:15.834565 22695 leader_election.cc:290] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:15.877707 16945 raft_consensus.cc:1275] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 19 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:08:15.879145 16322 leader_election.cc:304] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
W20260709 13:08:15.885191 22734 log.cc:927] Time spent T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:08:15.745168 22709 rpcz_store.cc:276] 0709 13:08:13.679879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:13.680018 (+   139us) service_pool.cc:224] Handling call
0709 13:08:13.853240 (+173222us) log.cc:844] Serialized 506 byte log entry
0709 13:08:15.711028 (+1857788us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1481,"raft.queue_time_us":1028,"raft.run_cpu_time_us":2475,"raft.run_wall_time_us":110772,"thread_start_us":50268,"threads_started":1,"wal-append.queue_time_us":164596,"wal-append.run_cpu_time_us":2132,"wal-append.run_wall_time_us":1020360}
I20260709 13:08:15.898181 16948 raft_consensus.cc:2468] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 13.
I20260709 13:08:15.880003 22746 raft_consensus.cc:2749] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:15.876916 22583 leader_election.cc:290] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:15.827445 22741 raft_consensus.cc:515] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:15.878345 22723 raft_consensus.cc:2749] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823) with higher term. Message: Invalid argument: T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for earlier term 14. Current term is 15.
I20260709 13:08:15.912730 22493 raft_consensus.cc:3055] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 16 LEADER]: Stepping down as leader of term 16
W20260709 13:08:15.915915 22740 log.cc:927] Time spent T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
W20260709 13:08:15.916965 22742 log.cc:927] Time spent T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
W20260709 13:08:15.923342 22743 log.cc:927] Time spent T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 13:08:15.926127 22741 leader_election.cc:290] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:15.927402 22713 leader_election.cc:290] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:15.919240 22493 raft_consensus.cc:740] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:08:15.936601 22493 consensus_queue.cc:260] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:15.900919 22656 raft_consensus.cc:2804] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 21 FOLLOWER]: Leader election won for term 21
W20260709 13:08:15.930420 22736 log.cc:927] Time spent T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.195s	user 0.002s	sys 0.000s
I20260709 13:08:15.898275 22621 raft_consensus.cc:2749] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:08:15.932235 22733 log.cc:927] Time spent T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.201s	user 0.002s	sys 0.000s
I20260709 13:08:15.875041 22676 consensus_queue.cc:260] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:08:15.992100 22652 consensus_meta.cc:287] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 0.634s	user 0.013s	sys 0.001s
I20260709 13:08:15.952266 22493 raft_consensus.cc:3060] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:15.930315 22612 leader_election.cc:290] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:08:16.054073 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 171948us
I20260709 13:08:16.056334 16322 leader_election.cc:304] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:08:16.026435 22656 raft_consensus.cc:697] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 21 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
W20260709 13:08:16.064275 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 206275us
I20260709 13:08:16.035265 22713 raft_consensus.cc:493] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:08:16.073900 16322 leader_election.cc:304] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:08:16.056056 22638 raft_consensus.cc:3055] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:08:16.080511 16914 leader_election.cc:304] T 540bfc4ad793452faea5b865343aacf7 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:16.046214 22652 raft_consensus.cc:515] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:16.087498 22511 raft_consensus.cc:493] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:08:16.095777 22511 raft_consensus.cc:515] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:16.087853 22659 raft_consensus.cc:2749] T 540bfc4ad793452faea5b865343aacf7 P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:16.098351 22688 consensus_queue.cc:1048] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:08:16.092585 22748 raft_consensus.cc:2804] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:16.092510 22583 raft_consensus.cc:493] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:08:16.071269 22626 raft_consensus.cc:493] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:16.079881 22638 raft_consensus.cc:740] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:08:16.076689 22709 raft_consensus.cc:493] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:08:16.076809 22741 raft_consensus.cc:493] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:08:16.076143 22751 raft_consensus.cc:493] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.104250 22674 raft_consensus.cc:2804] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:16.122766 16945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:16.125662 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:16.135309 16282 raft_consensus.cc:2468] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 19.
I20260709 13:08:16.124008 16275 raft_consensus.cc:1275] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
W20260709 13:08:16.123315 16092 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 73757c6fea8949e090aa4e55902a41d4 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER failed with leader 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 1109f76a0b7b443a84c0327c8707bc63 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 14 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:08:16.117117 16173 leader_election.cc:304] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:08:16.104120 22748 raft_consensus.cc:493] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:16.073127 22713 raft_consensus.cc:515] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:16.144994 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:16.146675 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bc3c8ff9b84838a2664335d7e1582b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:16.147042 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:16.112388 22754 raft_consensus.cc:493] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.111264 22652 leader_election.cc:290] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 18 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:08:16.124862 22735 log.cc:927] Time spent T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.392s	user 0.001s	sys 0.000s
I20260709 13:08:16.151541 16355 raft_consensus.cc:1275] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:08:16.152841 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:16.117233 22724 leader_election.cc:290] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:16.104501 22621 raft_consensus.cc:493] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.125981 22753 raft_consensus.cc:493] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:08:16.144156 22723 raft_consensus.cc:493] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.163120 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:16.119302 22646 leader_election.cc:290] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:16.109576 22583 raft_consensus.cc:515] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:16.160887 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:16.102885 22656 consensus_queue.cc:237] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:16.147912 22636 raft_consensus.cc:2749] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:16.154086 22480 raft_consensus.cc:493] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:08:16.159379 22702 consensus_queue.cc:1059] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.013s
I20260709 13:08:16.148131 22674 raft_consensus.cc:697] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 13 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:08:16.186139 22674 consensus_queue.cc:237] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:16.138134 22520 consensus_queue.cc:1059] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 13:08:16.150641 22695 consensus_queue.cc:1048] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 13:08:16.191450 22755 raft_consensus.cc:3055] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:16.191911 22755 raft_consensus.cc:740] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:08:16.192821 22755 consensus_queue.cc:260] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:16.194095 22583 leader_election.cc:290] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:16.194175 22755 raft_consensus.cc:3060] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:16.115679 22638 consensus_queue.cc:260] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:16.196321 22638 raft_consensus.cc:3060] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:16.148763 22748 raft_consensus.cc:3060] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:16.110881 22626 raft_consensus.cc:515] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:16.220556 22626 leader_election.cc:290] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:16.116070 22709 raft_consensus.cc:515] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:16.223757 22606 leader_election.cc:290] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:16.162336 22754 raft_consensus.cc:515] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:16.198844 22480 raft_consensus.cc:515] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:16.226457 22754 leader_election.cc:290] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:16.117636 22741 raft_consensus.cc:515] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:16.227341 22480 leader_election.cc:290] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:16.173575 22621 raft_consensus.cc:515] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:16.229743 22676 raft_consensus.cc:3060] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:16.231763 22713 leader_election.cc:290] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:16.175524 22753 raft_consensus.cc:515] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:16.233174 22511 leader_election.cc:290] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:16.233770 22511 raft_consensus.cc:493] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
W20260709 13:08:16.198815 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 123146us
I20260709 13:08:16.234915 22753 leader_election.cc:290] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:16.177769 22723 raft_consensus.cc:515] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:16.229063 22741 leader_election.cc:290] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:16.237844 22723 leader_election.cc:290] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:16.238766 16352 raft_consensus.cc:2410] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for term 19 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 13:08:16.238963 16945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:16.102540 22486 raft_consensus.cc:2749] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:08:16.135109 22751 raft_consensus.cc:515] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:16.178795 22646 raft_consensus.cc:493] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.181622 16281 raft_consensus.cc:2955] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Committing config change with OpId 20.11: config changed from index -1 to 11, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:08:16.211828 22702 raft_consensus.cc:3055] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:08:16.223882 16276 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:39058 (request call id 43) took 1442 ms. Trace:
I20260709 13:08:16.264230 16945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:16.234769 16274 raft_consensus.cc:3060] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:16.114521 22634 raft_consensus.cc:515] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:16.266093 22621 leader_election.cc:290] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:16.249991 22741 raft_consensus.cc:493] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.267300 22709 leader_election.cc:290] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:16.267508 22760 consensus_queue.cc:1048] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:08:16.267364 22741 raft_consensus.cc:515] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:16.270064 22741 leader_election.cc:290] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:16.234303 22511 raft_consensus.cc:515] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:16.270738 22751 leader_election.cc:290] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:16.272397 22511 leader_election.cc:290] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:16.264302 22646 raft_consensus.cc:515] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:16.274911 22634 leader_election.cc:290] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 15 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:16.275450 22646 leader_election.cc:290] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:16.264364 22702 raft_consensus.cc:740] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 20 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:08:16.264564 16276 rpcz_store.cc:276] 0709 13:08:14.781876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:14.782026 (+   150us) service_pool.cc:224] Handling call
0709 13:08:16.223604 (+1441578us) spinlock_profiling.cc:243] Waited 600 ms on lock 0x7b540031db54. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f483853 00007f362445160a 00007f361d9d77d4 00007f361d9d7762 00007f361d9d7691 00007f361d9d760c 00007f361d9d68c2 00007f361d7c448c 00007f361d7c38c6 00007f361d7c326f
0709 13:08:16.223762 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1379644288}
I20260709 13:08:16.280215 15057 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:08:16.281525 22702 consensus_queue.cc:260] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:16.282903 22702 raft_consensus.cc:3060] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:16.278391 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:16.287499 16945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
W20260709 13:08:16.288591 22737 log.cc:927] Time spent T 00000000000000000000000000000000 P 4dc6f08597514f4d85fd451b999b403e: Append to log took a long time: real 0.556s	user 0.004s	sys 0.000s
I20260709 13:08:16.293403 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:16.294152 16947 raft_consensus.cc:2468] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 17.
I20260709 13:08:16.300686 22281 raft_consensus.cc:493] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.301342 22281 raft_consensus.cc:515] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:16.290812 22693 raft_consensus.cc:515] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:16.303690 22281 leader_election.cc:290] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:16.303951 22751 raft_consensus.cc:493] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:08:16.304543 22751 raft_consensus.cc:515] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:16.305181 22693 leader_election.cc:290] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 16 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:16.306737 22751 leader_election.cc:290] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:16.307762 16248 leader_election.cc:304] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:08:16.311473 22605 raft_consensus.cc:2804] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:16.312019 22605 raft_consensus.cc:493] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:16.312402 22605 raft_consensus.cc:3060] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:16.317958 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:16.321430 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:16.322345 16354 raft_consensus.cc:2393] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 12: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:08:16.323760 16354 raft_consensus.cc:1240] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:16.302045 16274 raft_consensus.cc:2468] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 18.
I20260709 13:08:16.340586 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:16.340752 16248 leader_election.cc:304] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:08:16.343289 16914 leader_election.cc:304] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:16.347774 22648 raft_consensus.cc:493] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:16.348451 22648 raft_consensus.cc:515] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:16.353520 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bc3c8ff9b84838a2664335d7e1582b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:16.355947 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:16.360901 22760 raft_consensus.cc:2749] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:16.362066 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:16.362946 16281 raft_consensus.cc:2393] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 19: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:08:16.371987 22697 raft_consensus.cc:493] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.372644 22697 raft_consensus.cc:515] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:16.373608 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:16.374310 16282 raft_consensus.cc:2468] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 15.
I20260709 13:08:16.375555 22711 raft_consensus.cc:493] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:08:16.376142 22711 raft_consensus.cc:515] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:08:16.379990 16915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:16.384058 16913 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:16.387331 16948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: true dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:08:16.388878 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:16.389603 16280 raft_consensus.cc:2468] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 18.
I20260709 13:08:16.390575 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:16.391016 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:16.391173 16946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:16.392021 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:16.392464 16204 raft_consensus.cc:1275] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 19 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:08:16.394071 22648 leader_election.cc:290] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:16.394778 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:16.397068 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:16.397814 16206 raft_consensus.cc:2468] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 13.
I20260709 13:08:16.399166 16945 raft_consensus.cc:2468] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 19.
I20260709 13:08:16.391294 16200 raft_consensus.cc:2468] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 11.
I20260709 13:08:16.326843 22748 raft_consensus.cc:515] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:16.405501 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:08:16.406332 16173 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:16.406442 16280 raft_consensus.cc:2410] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:08:16.399974 16320 leader_election.cc:304] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:16.407097 16173 leader_election.cc:304] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:16.401357 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bc3c8ff9b84838a2664335d7e1582b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:16.409107 16948 raft_consensus.cc:2468] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 14.
I20260709 13:08:16.410058 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:16.411085 16355 raft_consensus.cc:1275] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 11. (term mismatch)
I20260709 13:08:16.411491 16355 pending_rounds.cc:85] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e: Aborting all ops after (but not including) 10
I20260709 13:08:16.411707 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:16.411854 16355 pending_rounds.cc:107] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e: Aborting uncommitted NO_OP operation due to leader change: 18.11
I20260709 13:08:16.412377 16355 raft_consensus.cc:2889] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:16.410912 16949 raft_consensus.cc:2468] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 12.
I20260709 13:08:16.414260 16173 leader_election.cc:304] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:16.414202 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:16.414625 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:16.416997 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:16.417729 16353 raft_consensus.cc:2468] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 15.
I20260709 13:08:16.412441 16206 raft_consensus.cc:2468] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 11.
I20260709 13:08:16.418776 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:16.420414 16355 raft_consensus.cc:2393] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 18: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:08:16.420531 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:16.415400 16207 raft_consensus.cc:2468] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 17.
I20260709 13:08:16.422397 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:16.427150 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:16.427434 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:16.428133 16200 raft_consensus.cc:2468] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 19.
I20260709 13:08:16.429345 16355 raft_consensus.cc:2468] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 16.
I20260709 13:08:16.435541 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:16.436094 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:16.442155 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:16.443578 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:16.404299 22688 raft_consensus.cc:493] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.447435 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:08:16.449386 16280 raft_consensus.cc:1240] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 21 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 20. Current term is 21. Ops: [20.14-20.14]
I20260709 13:08:16.449743 16201 raft_consensus.cc:1275] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:08:16.404136 22699 raft_consensus.cc:2749] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:16.453456 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:16.454495 16352 raft_consensus.cc:2368] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for earlier term 14. Current term is 15.
I20260709 13:08:16.446673 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:16.451113 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:16.455276 16203 raft_consensus.cc:2468] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 13.
I20260709 13:08:16.445608 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:08:16.451465 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:16.403918 22695 raft_consensus.cc:493] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:08:16.458101 16280 raft_consensus.cc:2468] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 14.
I20260709 13:08:16.458642 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:16.462837 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
W20260709 13:08:16.464375 16914 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:16.417956 22429 raft_consensus.cc:2749] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:16.467571 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:16.468407 16275 raft_consensus.cc:1275] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:08:16.426154 22636 raft_consensus.cc:2804] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:16.467638 16948 raft_consensus.cc:1275] T 4b962ceebb5c48c1914459ae0c0eff1b P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:08:16.431809 22477 raft_consensus.cc:493] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.483029 22477 raft_consensus.cc:515] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:16.485986 22477 leader_election.cc:290] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:16.445163 22753 raft_consensus.cc:493] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.378423 22711 leader_election.cc:290] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:16.441848 22693 raft_consensus.cc:2804] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:16.491560 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:16.444989 22760 raft_consensus.cc:493] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:08:16.492991 16202 raft_consensus.cc:1240] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:16.432190 22638 raft_consensus.cc:493] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:16.498006 16278 raft_consensus.cc:2468] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 10.
I20260709 13:08:16.477994 16281 pending_rounds.cc:85] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3: Aborting all ops after (but not including) 8
I20260709 13:08:16.503453 16281 pending_rounds.cc:107] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3: Aborting uncommitted NO_OP operation due to leader change: 11.9
I20260709 13:08:16.503803 16281 raft_consensus.cc:2889] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:16.497586 22693 raft_consensus.cc:493] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:16.447540 22612 raft_consensus.cc:493] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:16.472858 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:16.495177 22697 leader_election.cc:290] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:16.509585 22638 raft_consensus.cc:515] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:16.527575 16246 leader_election.cc:304] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:16.531484 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:16.532585 16279 raft_consensus.cc:2468] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 11.
I20260709 13:08:16.502687 22583 raft_consensus.cc:493] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:08:16.466921 22755 consensus_queue.cc:1048] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.052s
I20260709 13:08:16.523945 16248 leader_election.cc:304] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:08:16.458600 22606 consensus_queue.cc:1059] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.052s
I20260709 13:08:16.527449 16173 leader_election.cc:304] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:16.490092 22702 consensus_queue.cc:1059] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.031s
I20260709 13:08:16.543708 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:16.459231 22688 raft_consensus.cc:515] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:16.539305 22583 raft_consensus.cc:515] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:16.508935 22693 raft_consensus.cc:3060] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:16.540409 22562 raft_consensus.cc:2749] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:16.540163 22759 consensus_queue.cc:1048] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:16.541350 16246 leader_election.cc:304] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:16.542485 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:16.478879 22695 raft_consensus.cc:515] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:16.539822 22771 ts_tablet_manager.cc:933] T 5c2f49b7f95a4153b2d180218e6af1db P 1109f76a0b7b443a84c0327c8707bc63: Initiating tablet copy from peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:16.551148 16246 leader_election.cc:304] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:08:16.550354 16277 raft_consensus.cc:1240] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:16.553138 16246 leader_election.cc:304] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:16.559181 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:16.504036 22753 raft_consensus.cc:515] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:16.546051 22634 raft_consensus.cc:2804] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:16.521148 22612 raft_consensus.cc:515] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:16.507335 22760 raft_consensus.cc:515] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:16.575546 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:16.556255 22676 raft_consensus.cc:2804] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:16.576367 16355 raft_consensus.cc:2468] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 18.
I20260709 13:08:16.562768 22741 raft_consensus.cc:2804] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:16.566887 22634 raft_consensus.cc:493] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:16.580260 15057 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:16.557909 16246 leader_election.cc:304] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:16.587566 22747 raft_consensus.cc:2804] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:16.588240 22747 raft_consensus.cc:493] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:16.564921 22486 raft_consensus.cc:2749] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:16.588781 22747 raft_consensus.cc:3060] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:16.591480 16246 leader_election.cc:304] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:16.593896 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:16.593983 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:16.584740 22711 raft_consensus.cc:2804] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:16.584554 22676 raft_consensus.cc:493] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:16.583688 22741 raft_consensus.cc:493] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:08:16.590245 22634 raft_consensus.cc:3060] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:16.609983 22676 raft_consensus.cc:3060] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:16.612828 22612 leader_election.cc:290] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:16.614312 22583 leader_election.cc:290] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:16.615470 22638 leader_election.cc:290] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:16.585275 22605 raft_consensus.cc:515] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:16.617839 22605 leader_election.cc:290] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 18 election: Requested vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:16.619185 22606 raft_consensus.cc:493] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:16.619762 22606 raft_consensus.cc:515] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:16.620363 22760 leader_election.cc:290] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:16.620882 22741 raft_consensus.cc:3060] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:16.620988 22634 raft_consensus.cc:515] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:16.621999 22606 leader_election.cc:290] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:16.598196 16246 leader_election.cc:304] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:16.584245 22636 raft_consensus.cc:697] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:08:16.626892 22636 consensus_queue.cc:237] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:16.602861 16202 raft_consensus.cc:2410] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
W20260709 13:08:16.633057 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 105672us
I20260709 13:08:16.633291 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:16.639489 16948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:16.657346 16281 raft_consensus.cc:1240] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:16.626935 22634 leader_election.cc:290] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 20 election: Requested vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:16.665501 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:16.666313 16208 raft_consensus.cc:2468] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 19.
I20260709 13:08:16.605311 22751 raft_consensus.cc:2804] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:16.672729 22751 raft_consensus.cc:493] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:16.673141 22751 raft_consensus.cc:3060] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:16.673241 22695 leader_election.cc:290] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:16.667541 22638 raft_consensus.cc:493] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.670166 22748 leader_election.cc:290] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:16.674108 22638 raft_consensus.cc:515] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:16.667798 22583 raft_consensus.cc:2804] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:16.675452 22583 raft_consensus.cc:493] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:16.675853 22583 raft_consensus.cc:3060] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:16.608847 22711 raft_consensus.cc:493] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Starting leader election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:08:16.676784 22711 raft_consensus.cc:3060] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:16.679044 22493 raft_consensus.cc:3055] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:16.679519 22493 raft_consensus.cc:740] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:08:16.680406 22493 consensus_queue.cc:260] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:16.681452 22493 raft_consensus.cc:3060] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:16.682898 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:16.683888 22753 leader_election.cc:290] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:16.685223 22688 leader_election.cc:290] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:16.671713 16945 raft_consensus.cc:1240] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 13:08:16.670194 22777 consensus_queue.cc:1059] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.002s
W20260709 13:08:16.687660 22770 log.cc:927] Time spent T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.062s	user 0.002s	sys 0.000s
I20260709 13:08:16.688287 22777 raft_consensus.cc:3055] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:16.688686 22777 raft_consensus.cc:740] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:08:16.672205 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:16.689481 22777 consensus_queue.cc:260] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:16.690367 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:16.694269 16945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:16.694394 22639 consensus_queue.cc:1059] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:16.695513 22656 raft_consensus.cc:3055] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:16.695886 22656 raft_consensus.cc:740] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:08:16.696094 22777 raft_consensus.cc:3060] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:16.696743 22656 consensus_queue.cc:260] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:16.697964 22656 raft_consensus.cc:3060] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:16.698217 16348 raft_consensus.cc:2468] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 14.
I20260709 13:08:16.698655 16320 leader_election.cc:304] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:16.704141 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:08:16.703685 16945 raft_consensus.cc:1240] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 16 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:16.705493 16208 raft_consensus.cc:3060] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:08:16.712116 16281 raft_consensus.cc:1240] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 18. Current term is 20. Ops: []
I20260709 13:08:16.715202 16282 raft_consensus.cc:1275] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:08:16.710319 22741 raft_consensus.cc:515] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:16.706405 22580 raft_consensus.cc:2804] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:16.707624 22638 leader_election.cc:290] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:16.722657 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:16.723682 16355 raft_consensus.cc:1275] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:08:16.717985 22693 raft_consensus.cc:515] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:16.731003 16201 raft_consensus.cc:1240] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:16.731649 16173 leader_election.cc:304] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
W20260709 13:08:16.731986 22775 log.cc:927] Time spent T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.136s	user 0.001s	sys 0.000s
I20260709 13:08:16.734436 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:16.735899 16173 leader_election.cc:304] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:08:16.738389 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:16.739697 16914 leader_election.cc:304] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:16.741153 16173 leader_election.cc:304] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:08:16.743830 16278 raft_consensus.cc:1240] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:16.741184 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:16.708534 22676 raft_consensus.cc:515] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:16.753197 22676 leader_election.cc:290] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 15 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:16.711293 22747 raft_consensus.cc:515] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:16.741605 22774 consensus_queue.cc:1048] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.005s
I20260709 13:08:16.757998 16945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:16.722241 22580 raft_consensus.cc:493] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:16.762671 22693 leader_election.cc:290] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 11 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:16.744834 22606 raft_consensus.cc:2804] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:08:16.783929 22606 raft_consensus.cc:493] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Starting leader election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:08:16.766781 16948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:16.784814 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:16.749840 22695 raft_consensus.cc:2804] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:16.782218 22648 consensus_queue.cc:1048] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 13:08:16.788849 16104 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55244 (request call id 134) took 8952 ms. Trace:
I20260709 13:08:16.789080 16322 leader_election.cc:304] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:08:16.782739 22580 raft_consensus.cc:3060] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:16.790337 22709 raft_consensus.cc:2804] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:16.790853 22709 raft_consensus.cc:493] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Starting leader election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:08:16.790727 22429 consensus_queue.cc:1048] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:08:16.791332 16948 raft_consensus.cc:2468] T 4b962ceebb5c48c1914459ae0c0eff1b P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 14.
I20260709 13:08:16.791373 22709 raft_consensus.cc:3060] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:16.784842 22741 leader_election.cc:290] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:16.793191 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:16.769464 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:08:16.768421 22747 leader_election.cc:290] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:16.794616 16947 raft_consensus.cc:3060] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:16.783021 22677 consensus_queue.cc:1059] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 13:08:16.760614 22772 consensus_queue.cc:1059] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.051s
I20260709 13:08:16.741343 16281 raft_consensus.cc:1275] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:08:16.770809 16945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:08:16.770671 22638 raft_consensus.cc:2749] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:16.799252 16945 raft_consensus.cc:3060] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:16.749778 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:16.765939 22712 raft_consensus.cc:3055] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:16.801687 22712 raft_consensus.cc:740] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:08:16.772444 16208 raft_consensus.cc:2468] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 15.
I20260709 13:08:16.745704 16201 raft_consensus.cc:2468] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 16.
I20260709 13:08:16.777313 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:16.778086 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bc3c8ff9b84838a2664335d7e1582b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:16.783763 22711 raft_consensus.cc:515] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:16.798650 22677 raft_consensus.cc:3055] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:16.805871 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:16.803655 16248 leader_election.cc:304] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:08:16.812999 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:08:16.822486 16948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:08:16.823042 16246 leader_election.cc:304] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:16.814196 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:08:16.789312 16104 rpcz_store.cc:276] 0709 13:08:07.836085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:07.857654 (+ 21569us) service_pool.cc:224] Handling call
0709 13:08:16.788780 (+8931126us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:12.621991 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:12.644888 (+ 22897us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:12.644941 (+    53us) write_op.cc:435] Acquired schema lock
0709 13:08:12.644958 (+    17us) tablet.cc:662] Decoding operations
0709 13:08:12.645885 (+   927us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:12.645985 (+   100us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:12.646020 (+    35us) tablet.cc:685] Acquiring locks for 8 operations
0709 13:08:12.695736 (+ 49716us) tablet.cc:701] Row locks acquired
0709 13:08:12.720367 (+ 24631us) write_op.cc:260] PREPARE: finished
0709 13:08:12.741701 (+ 21334us) write_op.cc:270] Start()
0709 13:08:12.767179 (+ 25478us) write_op.cc:276] Timestamp: P: 1783602492736989 usec, L: 0
0709 13:08:12.779202 (+ 12023us) op_driver.cc:348] REPLICATION: starting
0709 13:08:12.799327 (+ 20125us) log.cc:844] Serialized 3218 byte log entry
0709 13:08:13.997089 (+1197762us) spinlock_profiling.cc:243] Waited 11 ms on lock 0x7b1800088540. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f3625264de1 00007f36252715b1 00007f361c39c3f3 00007f361c39e7c1 00007f361c39e779 00007f361c39e709 00007f361c39e6d1 00007f361c39d9cd 000000000038f354 000000000038f199 00007f361c37f83a
0709 13:08:14.365778 (+368689us) op_driver.cc:464] REPLICATION: finished
0709 13:08:14.754802 (+389024us) spinlock_profiling.cc:243] Waited 14.3 ms on lock 0x7b4400022b4c. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361c224db1 00007f361c2c2c85 00007f361c2c36a2 00007f361f0351db 00007f361f030aaf 00007f361c37f0ac 00007f36251d9ab9 00007f361c39b69b 00007f361c39993f 00007f361c39bc02 00007f3622ebfef0
0709 13:08:15.044713 (+289911us) write_op.cc:301] APPLY: starting
0709 13:08:15.053718 (+  9005us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:15.361769 (+308051us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:15.361810 (+    41us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:15.497754 (+135944us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:15.529575 (+ 31821us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=16,key_file_lookups=16,delta_file_lookups=16,mrs_lookups=0
0709 13:08:15.535278 (+  5703us) write_op.cc:312] APPLY: finished
0709 13:08:15.574859 (+ 39581us) log.cc:844] Serialized 81 byte log entry
0709 13:08:15.713332 (+138473us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:15.726174 (+ 12842us) write_op.cc:454] Released schema lock
0709 13:08:15.748724 (+ 22550us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:15.797925 (+ 49201us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:15.801595 (+  3670us) write_op.cc:454] Released schema lock
0709 13:08:16.288045 (+486450us) spinlock_profiling.cc:243] Waited 2.45 ms on lock 0x7b4400022b4c. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361c224db1 00007f361c2c2c85 00007f361c2c36a2 00007f361f0351db 00007f361f030aaf 00007f361f02486e 00007f361f023bb6 00007f361f0237d8 00007f361f02d221 00007f361f02d1d9 00007f361f02d169
Metrics: {"mutex_wait_us":114159,"reported_tablets":15,"child_traces":[["op",{"apply.queue_time_us":629185,"apply.run_cpu_time_us":62418,"apply.run_wall_time_us":753133,"cfile_cache_hit":34,"cfile_cache_hit_bytes":37567,"num_ops":8,"prepare.queue_time_us":268299,"prepare.run_cpu_time_us":65281,"prepare.run_wall_time_us":359660,"raft.queue_time_us":234210,"raft.run_cpu_time_us":65881,"raft.run_wall_time_us":524683,"replication_time_us":1581687,"spinlock_wait_cycles":63776128,"thread_start_us":1059609,"threads_started":5,"wal-append.queue_time_us":300580,"wal-append.run_cpu_time_us":54698,"wal-append.run_wall_time_us":1254134}]]}
I20260709 13:08:16.786458 22695 raft_consensus.cc:493] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Starting leader election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:08:16.825551 16914 leader_election.cc:304] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:16.829488 22709 raft_consensus.cc:515] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:16.784750 22606 raft_consensus.cc:3060] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:16.802798 22773 raft_consensus.cc:2764] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:08:16.798321 22583 raft_consensus.cc:515] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:16.821928 22741 raft_consensus.cc:2804] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:16.895372 22741 raft_consensus.cc:493] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:16.895973 22741 raft_consensus.cc:3060] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:16.837790 16945 raft_consensus.cc:2468] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 18.
I20260709 13:08:16.815425 16322 leader_election.cc:304] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:08:16.776118 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:08:16.844062 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:16.861274 16947 raft_consensus.cc:2468] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 20.
I20260709 13:08:16.865103 16914 leader_election.cc:304] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:08:16.870332 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 47432us
I20260709 13:08:16.816329 22677 raft_consensus.cc:740] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:08:16.900367 16248 leader_election.cc:304] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:08:16.901394 16246 leader_election.cc:304] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:16.868113 16320 leader_election.cc:304] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
W20260709 13:08:16.906322 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 90967us
I20260709 13:08:16.906484 22658 raft_consensus.cc:2749] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:16.908313 16248 leader_election.cc:304] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:08:16.909531 22756 raft_consensus.cc:2804] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:16.909973 22756 raft_consensus.cc:493] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Starting leader election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:08:16.910333 22756 raft_consensus.cc:3060] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:16.872336 22695 raft_consensus.cc:3060] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:16.913364 22580 raft_consensus.cc:515] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:16.914639 22626 raft_consensus.cc:2804] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:16.907616 16322 leader_election.cc:304] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:16.916332 22429 raft_consensus.cc:2804] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:16.916832 22429 raft_consensus.cc:493] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:08:16.917243 22429 raft_consensus.cc:3060] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:16.918248 16322 leader_election.cc:304] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:16.919219 22652 raft_consensus.cc:2749] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:16.920092 22711 leader_election.cc:290] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 election: Requested vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:16.923417 16322 leader_election.cc:304] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:16.924194 22583 leader_election.cc:290] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 20 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:16.924280 22652 raft_consensus.cc:2804] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:16.924922 22676 raft_consensus.cc:2804] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:16.925097 22652 raft_consensus.cc:697] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 18 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:08:16.925429 22676 raft_consensus.cc:493] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:16.925936 22676 raft_consensus.cc:3060] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:16.926790 22753 raft_consensus.cc:2804] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:08:16.877394 22303 raft_consensus.cc:2749] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:16.927326 22753 raft_consensus.cc:697] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:08:16.928382 22753 consensus_queue.cc:237] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:16.929527 22751 raft_consensus.cc:515] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:16.932018 22699 consensus_queue.cc:1048] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:16.933665 22712 consensus_queue.cc:260] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:16.934266 22626 raft_consensus.cc:697] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:08:16.934718 22606 raft_consensus.cc:515] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:16.935293 22712 raft_consensus.cc:3060] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:16.935904 16207 raft_consensus.cc:1240] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 10. Current term is 11. Ops: []
I20260709 13:08:16.935496 22626 consensus_queue.cc:237] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:08:16.940018 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 72047.1us
I20260709 13:08:16.940781 16945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:08:16.941610 22748 raft_consensus.cc:2804] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:16.942166 22748 raft_consensus.cc:697] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 15 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:08:16.943379 22748 consensus_queue.cc:237] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:16.945031 22709 leader_election.cc:290] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 20 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:16.901015 22486 raft_consensus.cc:2749] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:16.948843 16208 raft_consensus.cc:2393] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 15: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:08:16.950635 16173 leader_election.cc:304] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:08:16.926149 22652 consensus_queue.cc:237] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:16.967303 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:08:16.957156 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:08:16.971549 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:16.972457 16279 raft_consensus.cc:3060] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:16.990823 16106 catalog_manager.cc:5697] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } }
I20260709 13:08:17.003862 22677 consensus_queue.cc:260] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:17.005952 22677 raft_consensus.cc:3060] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:17.006837 22658 consensus_queue.cc:1059] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:17.008690 22751 leader_election.cc:290] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 18 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:17.008755 22580 leader_election.cc:290] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 20 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:17.014668 16277 raft_consensus.cc:1240] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:17.017973 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
W20260709 13:08:17.018862 16321 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:17.016867 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:08:16.971987 22693 raft_consensus.cc:2749] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:08:17.036231 16246 leader_election.cc:304] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:17.037441 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:08:17.038144 16208 raft_consensus.cc:3060] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:16.970860 22606 leader_election.cc:290] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 11 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:17.050925 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:17.063329 16275 raft_consensus.cc:2393] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 15: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:08:17.052580 16276 raft_consensus.cc:1275] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:08:17.070188 16947 raft_consensus.cc:2468] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 12.
I20260709 13:08:17.002131 22741 raft_consensus.cc:515] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:17.083636 16276 raft_consensus.cc:1275] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 21 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:08:17.075951 16914 leader_election.cc:304] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:17.087782 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:17.040261 22612 raft_consensus.cc:493] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:08:17.079813 16173 leader_election.cc:400] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 14 pre-election: Vote denied by peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107) with higher term. Message: Invalid argument: T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for earlier term 14. Current term is 15.
I20260709 13:08:17.104810 16173 leader_election.cc:304] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:17.074620 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:17.079010 16248 leader_election.cc:304] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63
W20260709 13:08:17.081472 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 45735.4us
I20260709 13:08:17.018623 22648 consensus_queue.cc:1059] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 13:08:17.109440 16248 leader_election.cc:304] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:08:17.085574 22776 log.cc:927] Time spent T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 13:08:17.032056 22695 raft_consensus.cc:515] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:17.111747 16274 raft_consensus.cc:1240] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 14. Current term is 15. Ops: []
W20260709 13:08:17.099225 22780 log.cc:927] Time spent T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:08:17.081012 16283 raft_consensus.cc:1240] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:17.093698 22486 raft_consensus.cc:2749] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:17.044049 22493 consensus_queue.cc:1059] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.067s
I20260709 13:08:17.131402 16248 leader_election.cc:304] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:17.093294 22771 tablet_copy_client.cc:323] T 5c2f49b7f95a4153b2d180218e6af1db P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Beginning tablet copy session from remote peer at address 127.14.180.67:46107
I20260709 13:08:17.116520 22699 raft_consensus.cc:2804] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:17.150007 16279 raft_consensus.cc:2468] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 11.
I20260709 13:08:17.155237 16281 raft_consensus.cc:1240] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 10. Current term is 11. Ops: [10.11-10.11]
I20260709 13:08:17.156783 16173 leader_election.cc:304] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:08:17.113371 22612 raft_consensus.cc:515] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:08:17.185678 22768 log.cc:927] Time spent T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 13:08:17.193604 22636 raft_consensus.cc:2804] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:17.128082 22760 raft_consensus.cc:2804] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:17.194422 22636 raft_consensus.cc:697] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:08:17.194949 22760 raft_consensus.cc:493] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:08:17.195643 22760 raft_consensus.cc:3060] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:17.195689 22636 consensus_queue.cc:237] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:17.126156 22693 raft_consensus.cc:2804] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:17.198397 22693 raft_consensus.cc:697] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:08:17.199780 22693 consensus_queue.cc:237] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:17.208144 16279 raft_consensus.cc:1275] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:08:17.127743 22754 raft_consensus.cc:2749] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:17.093024 22747 consensus_queue.cc:1048] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.048s
I20260709 13:08:17.218758 16201 raft_consensus.cc:1240] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 11. Current term is 12. Ops: []
I20260709 13:08:17.220119 22695 leader_election.cc:290] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:17.244081 22429 raft_consensus.cc:515] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:17.245172 22761 raft_consensus.cc:493] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:08:17.245962 22761 raft_consensus.cc:515] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:17.251016 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:17.253870 22580 raft_consensus.cc:493] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:08:17.255144 22761 leader_election.cc:290] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:17.144214 16248 leader_election.cc:304] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:17.103281 22709 raft_consensus.cc:493] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:08:17.256090 22709 raft_consensus.cc:515] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:17.162046 22741 leader_election.cc:290] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 15 election: Requested vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:17.260869 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:17.137667 16208 raft_consensus.cc:2468] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 18.
I20260709 13:08:17.254736 22580 raft_consensus.cc:515] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:08:17.270691 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 67902.4us
I20260709 13:08:17.273653 16947 raft_consensus.cc:1240] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 18 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 17. Current term is 18. Ops: []
W20260709 13:08:17.275825 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 131731us
I20260709 13:08:17.274968 16246 leader_election.cc:304] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:17.278582 16248 leader_election.cc:304] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:17.284838 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:08:17.293090 16948 raft_consensus.cc:1275] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:08:17.148752 22751 raft_consensus.cc:2749] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:17.174382 22699 raft_consensus.cc:493] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:08:17.308686 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:08:17.280609 22754 raft_consensus.cc:2749] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:17.293001 22741 raft_consensus.cc:2804] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:17.322808 16948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:08:17.302683 22747 raft_consensus.cc:2749] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:17.324138 16948 raft_consensus.cc:3060] T 4b962ceebb5c48c1914459ae0c0eff1b P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:17.343138 16280 raft_consensus.cc:1240] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 LEADER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 17. Current term is 18. Ops: [17.14-17.14]
I20260709 13:08:17.310987 22699 raft_consensus.cc:3060] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:17.280423 22676 raft_consensus.cc:515] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:17.319648 22709 leader_election.cc:290] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:17.367624 22429 leader_election.cc:290] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 19 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:17.308403 22756 raft_consensus.cc:515] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:08:17.382167 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:17.383492 22756 leader_election.cc:290] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 16 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:17.384783 22612 leader_election.cc:290] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:17.394011 22580 leader_election.cc:290] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:08:17.398671 22511 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.030s	sys 0.015s
W20260709 13:08:17.399242 22511 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.030s	sys 0.015s
I20260709 13:08:17.356884 22741 raft_consensus.cc:697] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:08:17.400517 22741 consensus_queue.cc:237] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:17.403949 22676 leader_election.cc:290] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 17 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:17.419142 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:17.420483 16208 raft_consensus.cc:2468] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 14.
I20260709 13:08:17.421036 16948 raft_consensus.cc:2468] T 4b962ceebb5c48c1914459ae0c0eff1b P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 15.
I20260709 13:08:17.342662 22753 raft_consensus.cc:493] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
W20260709 13:08:17.426359 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 329305us
I20260709 13:08:17.483700 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:17.483958 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:17.484829 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bc3c8ff9b84838a2664335d7e1582b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:17.485088 16322 leader_election.cc:304] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:17.486449 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:17.488551 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:17.492180 16357 raft_consensus.cc:2393] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 12: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:08:17.500286 16322 leader_election.cc:304] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:17.479758 22747 raft_consensus.cc:493] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:17.447182 22753 raft_consensus.cc:515] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:17.522572 22281 raft_consensus.cc:3060] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:17.523836 16322 leader_election.cc:304] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
W20260709 13:08:17.512462 22677 consensus_meta.cc:287] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 0.506s	user 0.014s	sys 0.000s
I20260709 13:08:17.508953 22756 raft_consensus.cc:2804] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:17.499836 22638 consensus_queue.cc:1059] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 13:08:17.531133 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:08:17.556407 16207 raft_consensus.cc:3060] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:17.537905 16202 raft_consensus.cc:1275] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 21 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 14. (term mismatch)
I20260709 13:08:17.539379 16322 leader_election.cc:304] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:17.559091 16202 pending_rounds.cc:85] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f: Aborting all ops after (but not including) 13
I20260709 13:08:17.559404 16202 pending_rounds.cc:107] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f: Aborting uncommitted NO_OP operation due to leader change: 20.14
I20260709 13:08:17.559695 16202 raft_consensus.cc:2889] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:17.564239 16322 leader_election.cc:304] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:17.536782 22688 raft_consensus.cc:493] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.512017 22747 raft_consensus.cc:515] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:17.546497 22635 raft_consensus.cc:3060] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:08:17.576577 16321 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:17.575824 16201 raft_consensus.cc:1240] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 LEADER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 10. Current term is 11. Ops: []
W20260709 13:08:17.588832 22748 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.640s	user 0.003s	sys 0.038s
I20260709 13:08:17.592523 22677 consensus_queue.cc:1048] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
W20260709 13:08:17.594199 22748 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.645s	user 0.004s	sys 0.039s
I20260709 13:08:17.569725 22744 raft_consensus.cc:2749] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:17.585250 22429 raft_consensus.cc:2749] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:17.616925 22699 raft_consensus.cc:515] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:17.585860 22688 raft_consensus.cc:515] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:17.594761 22630 consensus_queue.cc:1059] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.019s
I20260709 13:08:17.577229 16356 raft_consensus.cc:2468] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 11.
I20260709 13:08:17.567355 22760 raft_consensus.cc:515] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:17.628752 16947 raft_consensus.cc:1275] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:08:17.540521 22756 raft_consensus.cc:493] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:17.633661 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:17.639271 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:08:17.638257 16207 raft_consensus.cc:2468] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 17.
I20260709 13:08:17.643872 16942 raft_consensus.cc:1240] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:17.642892 16274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:17.644585 16274 raft_consensus.cc:2468] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 13.
I20260709 13:08:17.646286 16282 raft_consensus.cc:2393] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 12: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:08:17.607888 22798 consensus_queue.cc:1048] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 13:08:17.643827 22756 raft_consensus.cc:3060] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:17.663863 15057 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:17.677729 22760 leader_election.cc:290] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 election: Requested vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:17.679492 22511 raft_consensus.cc:3055] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:08:17.679919 22511 raft_consensus.cc:740] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:08:17.680893 22511 consensus_queue.cc:260] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:17.682024 22511 raft_consensus.cc:3060] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:17.682963 22753 leader_election.cc:290] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:17.684161 22747 leader_election.cc:290] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:17.688094 22658 raft_consensus.cc:3055] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:17.688632 22658 raft_consensus.cc:740] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:08:17.689702 22658 consensus_queue.cc:260] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:08:17.705132 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 115549us
I20260709 13:08:17.648905 22802 consensus_queue.cc:1048] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.051s
I20260709 13:08:17.707857 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:17.713658 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:17.714093 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:17.708796 16320 leader_election.cc:304] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:17.714380 16350 raft_consensus.cc:2468] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 16.
I20260709 13:08:17.715080 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:17.713965 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:17.715945 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
W20260709 13:08:17.714326 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 287199us
I20260709 13:08:17.719594 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:17.720431 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:17.721257 16353 raft_consensus.cc:3060] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Advancing to term 18
W20260709 13:08:17.711877 22792 log.cc:927] Time spent T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.191s	user 0.001s	sys 0.001s
I20260709 13:08:17.710083 16248 leader_election.cc:304] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:08:17.724292 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:17.711082 22760 raft_consensus.cc:493] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.728643 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:17.732177 16947 raft_consensus.cc:1275] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 18 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:08:17.734983 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:08:17.735193 16352 raft_consensus.cc:1240] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 20 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 19. Current term is 20. Ops: [19.11-19.11]
W20260709 13:08:17.736402 16912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:17.742309 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:17.743378 16356 raft_consensus.cc:3060] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:17.722678 22281 raft_consensus.cc:2749] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:17.756793 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
W20260709 13:08:17.757525 16915 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:17.729007 22754 raft_consensus.cc:2804] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:17.727908 16914 leader_election.cc:304] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:17.740759 22658 raft_consensus.cc:3060] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:17.713220 22773 consensus_queue.cc:1048] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.025s
I20260709 13:08:17.763602 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:17.723445 22677 consensus_queue.cc:1048] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.035s
I20260709 13:08:17.765481 16353 raft_consensus.cc:2468] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 18.
I20260709 13:08:17.727833 22648 consensus_queue.cc:1048] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 13:08:17.769196 16356 raft_consensus.cc:2468] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 17.
W20260709 13:08:17.771413 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 43585.4us
I20260709 13:08:17.772473 16356 raft_consensus.cc:3055] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:17.774078 16356 raft_consensus.cc:740] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:08:17.775084 16914 leader_election.cc:304] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:17.776873 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:17.734804 22760 raft_consensus.cc:515] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:08:17.779778 22803 log.cc:927] Time spent T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 13:08:17.781836 22796 raft_consensus.cc:2749] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:08:17.783926 22807 log.cc:927] Time spent T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 13:08:17.776460 22591 raft_consensus.cc:2749] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:17.776561 16356 consensus_queue.cc:260] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:17.791204 22688 leader_election.cc:290] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:17.797957 16283 raft_consensus.cc:1240] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 19. Current term is 20. Ops: []
I20260709 13:08:17.800482 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:17.801633 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:08:17.807515 16279 raft_consensus.cc:1240] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:17.794406 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:17.808497 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:17.812871 16276 raft_consensus.cc:2393] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 15: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:08:17.814453 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:17.820255 16942 raft_consensus.cc:2393] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 14: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
I20260709 13:08:17.820081 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:17.821592 16947 raft_consensus.cc:1240] T 4b962ceebb5c48c1914459ae0c0eff1b P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:08:17.770474 22754 raft_consensus.cc:697] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:08:17.822264 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:17.823383 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:17.825644 16947 raft_consensus.cc:2468] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 14.
I20260709 13:08:17.825838 16248 leader_election.cc:304] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:17.791962 22639 raft_consensus.cc:2804] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:17.835225 22754 consensus_queue.cc:237] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:17.838398 22811 raft_consensus.cc:2749] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:17.829406 22625 raft_consensus.cc:493] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:08:17.847152 22625 raft_consensus.cc:515] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:17.849454 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:17.849778 16356 raft_consensus.cc:3060] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:17.813452 22699 leader_election.cc:290] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 15 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:17.852550 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:17.852844 22760 leader_election.cc:290] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:17.792032 22753 consensus_queue.cc:1048] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.052s
I20260709 13:08:17.853531 22813 raft_consensus.cc:493] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.854063 22813 raft_consensus.cc:515] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:17.856283 22813 leader_election.cc:290] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:08:17.858089 22806 log.cc:927] Time spent T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
I20260709 13:08:17.849658 22625 leader_election.cc:290] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:17.861713 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:08:17.862900 22281 raft_consensus.cc:493] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.863499 22281 raft_consensus.cc:515] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:17.864728 22813 raft_consensus.cc:493] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:08:17.865314 22813 raft_consensus.cc:515] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:17.865696 22281 leader_election.cc:290] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:17.866044 16173 leader_election.cc:304] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:08:17.874436 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:17.869704 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:17.877979 16202 raft_consensus.cc:2468] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 12.
I20260709 13:08:17.871932 16208 raft_consensus.cc:1275] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:08:17.873993 16277 raft_consensus.cc:1240] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:17.868948 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:17.877458 16248 leader_election.cc:304] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:17.886296 16276 raft_consensus.cc:1275] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:08:17.886158 16356 raft_consensus.cc:1275] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 14. (term mismatch)
I20260709 13:08:17.898484 16356 pending_rounds.cc:85] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e: Aborting all ops after (but not including) 13
I20260709 13:08:17.898895 16356 pending_rounds.cc:107] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e: Aborting uncommitted NO_OP operation due to leader change: 17.14
I20260709 13:08:17.899253 16356 raft_consensus.cc:2889] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:17.894304 16320 leader_election.cc:304] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
W20260709 13:08:17.907331 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:17.908138 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:17.905230 16173 leader_election.cc:304] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:08:17.912196 16942 raft_consensus.cc:1275] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 13:08:17.915484 16248 leader_election.cc:304] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:17.916330 16246 leader_election.cc:304] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:17.883584 22303 consensus_queue.cc:1059] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 15.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.031s
I20260709 13:08:17.919960 16173 leader_election.cc:304] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:08:17.922464 16248 leader_election.cc:304] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:17.922737 16942 raft_consensus.cc:1275] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 13:08:17.928334 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 44899.8us
I20260709 13:08:17.929868 16322 leader_election.cc:304] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:08:17.931238 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:08:17.927873 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 51742.3us
I20260709 13:08:17.909981 22693 raft_consensus.cc:2749] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:17.929023 16173 leader_election.cc:304] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:08:17.937017 22493 raft_consensus.cc:493] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:08:17.921072 22760 raft_consensus.cc:493] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.920909 22759 raft_consensus.cc:2749] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:17.921118 22773 raft_consensus.cc:2749] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:17.920672 22813 leader_election.cc:290] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:17.928138 22747 raft_consensus.cc:2749] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:17.931818 22709 raft_consensus.cc:2804] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:17.923511 22583 raft_consensus.cc:2804] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:17.931547 22606 raft_consensus.cc:2749] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:17.931193 22741 raft_consensus.cc:2749] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:08:17.954061 22635 raft_consensus.cc:2749] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:17.945494 22804 raft_consensus.cc:2804] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:08:17.948499 22798 raft_consensus.cc:2749] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:08:17.967312 22709 raft_consensus.cc:493] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:17.937543 22281 consensus_queue.cc:1048] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.048s
I20260709 13:08:17.961151 22811 consensus_queue.cc:1059] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 13:08:17.919725 22748 consensus_queue.cc:1048] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.030s
I20260709 13:08:17.941917 22630 consensus_queue.cc:1048] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.046s
I20260709 13:08:17.963573 22760 raft_consensus.cc:515] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:17.995080 22583 raft_consensus.cc:697] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:08:17.951316 22656 consensus_queue.cc:1059] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.044s
W20260709 13:08:18.007999 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 73960.5us
I20260709 13:08:18.010604 16357 raft_consensus.cc:3060] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:18.024719 16248 leader_election.cc:304] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:08:18.027745 22760 leader_election.cc:290] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:18.028757 22583 consensus_queue.cc:237] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:18.032902 16357 raft_consensus.cc:2468] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 20.
I20260709 13:08:18.033257 22747 raft_consensus.cc:2749] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:08:18.037931 16248 leader_election.cc:304] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:18.040583 22477 raft_consensus.cc:493] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:08:18.044777 22477 raft_consensus.cc:515] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:18.043941 22656 raft_consensus.cc:3055] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:18.045997 22656 raft_consensus.cc:740] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
W20260709 13:08:18.048494 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 67126.8us
I20260709 13:08:18.049443 16322 leader_election.cc:304] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:18.050300 22798 raft_consensus.cc:2749] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:08:18.049679 22656 consensus_queue.cc:260] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:18.051698 22656 raft_consensus.cc:3060] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:18.053346 16322 leader_election.cc:304] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:18.054337 22798 raft_consensus.cc:2749] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:08:18.048696 22477 leader_election.cc:290] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:18.057664 22828 raft_consensus.cc:2749] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:18.059788 16322 leader_election.cc:304] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:18.060570 22477 consensus_queue.cc:1059] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:18.061534 22625 raft_consensus.cc:3060] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:18.062322 22798 raft_consensus.cc:3055] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:08:18.062907 22798 raft_consensus.cc:740] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:08:18.064057 22798 consensus_queue.cc:260] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:18.065577 22798 raft_consensus.cc:3060] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:18.066089 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:18.067235 22648 raft_consensus.cc:3055] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:18.070431 16947 raft_consensus.cc:1275] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 20 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:08:18.069613 16322 leader_election.cc:304] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:17.959952 22493 raft_consensus.cc:515] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:17.962450 22744 consensus_queue.cc:1059] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.057s
W20260709 13:08:18.162263 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 61748.5us
I20260709 13:08:18.008755 22709 raft_consensus.cc:3060] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:18.162230 16948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
W20260709 13:08:18.176642 22580 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 18 current term: 18 is higher.
I20260709 13:08:18.020015 22804 raft_consensus.cc:697] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [term 11 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
W20260709 13:08:18.182298 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 112752us
I20260709 13:08:18.067705 22648 raft_consensus.cc:740] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:08:18.185371 16208 raft_consensus.cc:2468] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 16.
I20260709 13:08:18.011165 22756 raft_consensus.cc:515] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:08:18.188899 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 247598us
I20260709 13:08:18.192425 16173 leader_election.cc:304] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:18.193665 16173 leader_election.cc:304] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:08:18.206194 22702 raft_consensus.cc:3055] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:18.224041 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:18.224738 16352 raft_consensus.cc:1240] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:18.191522 22825 raft_consensus.cc:2749] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:08:18.230160 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:18.230948 16283 raft_consensus.cc:2468] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 13.
I20260709 13:08:18.231094 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:18.233829 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:18.197181 22773 raft_consensus.cc:2804] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:18.202622 22606 raft_consensus.cc:2749] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:18.210284 22748 raft_consensus.cc:3055] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:18.248492 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:18.248965 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:18.252671 16357 raft_consensus.cc:1240] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 18. Current term is 19. Ops: []
I20260709 13:08:18.255834 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:18.220666 22702 raft_consensus.cc:740] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:08:18.267465 22777 consensus_queue.cc:1059] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.004s
I20260709 13:08:18.227001 22281 consensus_queue.cc:1048] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.038s
I20260709 13:08:18.275355 22636 raft_consensus.cc:3055] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:18.275848 22636 raft_consensus.cc:740] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:08:18.276805 22636 consensus_queue.cc:260] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:18.274387 22294 raft_consensus.cc:493] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.278667 22294 raft_consensus.cc:515] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:08:18.279455 22791 log.cc:927] Time spent T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.765s	user 0.002s	sys 0.003s
I20260709 13:08:18.241592 22773 raft_consensus.cc:493] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:08:18.286440 22773 raft_consensus.cc:3060] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:18.288283 22827 consensus_queue.cc:1059] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.023s
W20260709 13:08:18.289644 22658 consensus_meta.cc:287] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63: Time spent flushing consensus metadata: real 0.526s	user 0.011s	sys 0.000s
I20260709 13:08:18.251472 22748 raft_consensus.cc:740] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:08:18.291649 22756 leader_election.cc:290] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:18.291770 22748 consensus_queue.cc:260] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:18.293471 22748 raft_consensus.cc:3060] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:18.246042 22648 consensus_queue.cc:260] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:18.295871 22648 raft_consensus.cc:3060] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:18.296952 22804 consensus_queue.cc:237] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:08:18.302742 16322 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:18.307165 22493 leader_election.cc:290] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:18.317407 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:08:18.265805 22814 raft_consensus.cc:493] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:08:18.319504 22814 raft_consensus.cc:515] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:18.325722 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:18.326485 16204 raft_consensus.cc:2468] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 16.
W20260709 13:08:18.339335 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 124793us
I20260709 13:08:18.345654 22797 raft_consensus.cc:493] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:08:18.346539 22493 raft_consensus.cc:493] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:08:18.346349 22797 raft_consensus.cc:515] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:18.347086 22493 raft_consensus.cc:515] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:18.348695 22797 leader_election.cc:290] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:18.256002 22833 raft_consensus.cc:493] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:08:18.351289 22833 raft_consensus.cc:515] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:18.353644 22833 leader_election.cc:290] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:18.375181 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:18.379045 22639 raft_consensus.cc:493] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:08:18.379676 22639 raft_consensus.cc:3060] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:18.392585 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 52011us
I20260709 13:08:18.394739 22711 consensus_queue.cc:1048] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:18.393955 22839 consensus_queue.cc:1048] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:18.395613 22709 raft_consensus.cc:515] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:08:18.407260 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:18.431814 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 64694.2us
W20260709 13:08:18.432010 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 68060.8us
W20260709 13:08:18.436863 16912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:18.432528 16320 leader_election.cc:304] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:18.445303 16280 raft_consensus.cc:1240] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:18.446830 16356 raft_consensus.cc:2368] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for earlier term 13. Current term is 14.
I20260709 13:08:18.446599 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:18.470974 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:18.472121 22646 raft_consensus.cc:493] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:18.478346 22751 raft_consensus.cc:493] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:18.478907 22841 raft_consensus.cc:493] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.499214 22841 raft_consensus.cc:515] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:18.505722 16352 raft_consensus.cc:1275] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:08:18.507588 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:18.509048 22493 leader_election.cc:290] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:18.509920 16322 leader_election.cc:304] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:08:18.511658 22709 leader_election.cc:290] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:18.515686 22825 raft_consensus.cc:2749] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:08:18.524253 22812 log.cc:927] Time spent T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.733s	user 0.001s	sys 0.009s
I20260709 13:08:18.528579 16248 leader_election.cc:304] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:18.531549 22562 raft_consensus.cc:2804] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:18.531836 22625 raft_consensus.cc:2749] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:18.532066 22562 raft_consensus.cc:493] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:08:18.474196 22824 raft_consensus.cc:493] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.532516 22562 raft_consensus.cc:3060] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:18.532792 22824 raft_consensus.cc:515] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:18.533161 22636 raft_consensus.cc:3060] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:18.491199 22751 raft_consensus.cc:515] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:18.536219 22824 leader_election.cc:290] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:18.536675 22814 leader_election.cc:290] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:18.537053 22751 leader_election.cc:290] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:18.537494 22759 consensus_queue.cc:1048] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:08:18.498320 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:18.488149 22646 raft_consensus.cc:515] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:18.542748 22646 leader_election.cc:290] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:18.449934 22656 raft_consensus.cc:2804] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:18.549290 22656 raft_consensus.cc:493] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:18.549757 22656 raft_consensus.cc:3060] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:18.547364 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:18.558064 16206 raft_consensus.cc:2410] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 for term 15 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:08:18.564635 16320 leader_election.cc:304] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:18.568671 22294 leader_election.cc:290] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:18.570421 22702 consensus_queue.cc:260] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:18.426534 22639 raft_consensus.cc:515] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:18.571704 22702 raft_consensus.cc:3060] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:18.574054 22639 leader_election.cc:290] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:18.578038 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:18.597062 16942 raft_consensus.cc:2468] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 14.
I20260709 13:08:18.597330 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:08:18.599033 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:18.599893 16942 raft_consensus.cc:2468] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 16.
I20260709 13:08:18.603333 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:18.607105 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:18.611459 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:18.612593 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:08:18.502308 22841 leader_election.cc:290] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:18.566946 22844 raft_consensus.cc:2804] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:18.641683 16248 leader_election.cc:304] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:18.636021 16173 leader_election.cc:304] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:18.640280 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:18.648837 16283 raft_consensus.cc:1275] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
W20260709 13:08:18.655827 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 57579.4us
I20260709 13:08:18.655264 16173 leader_election.cc:304] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:08:18.664165 16203 raft_consensus.cc:2468] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 14.
I20260709 13:08:18.647316 22747 raft_consensus.cc:493] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:18.643431 22844 raft_consensus.cc:493] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:08:18.700587 16352 raft_consensus.cc:1240] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:18.700855 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:18.676447 16320 leader_election.cc:304] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:18.702077 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:18.694224 16941 raft_consensus.cc:1275] T 4b962ceebb5c48c1914459ae0c0eff1b P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:08:18.696681 16203 raft_consensus.cc:1275] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:08:18.667488 22697 raft_consensus.cc:2804] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:18.650522 22741 raft_consensus.cc:493] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:08:18.700146 16355 raft_consensus.cc:1240] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 20 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 19. Current term is 20. Ops: []
I20260709 13:08:18.678093 22712 raft_consensus.cc:2749] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:18.720896 16367 tablet_copy_service.cc:140] P 363bb2f744eb486f9ad726f08214c98e: Received BeginTabletCopySession request for tablet 5c2f49b7f95a4153b2d180218e6af1db from peer 1109f76a0b7b443a84c0327c8707bc63 ({username='slave'} at 127.0.0.1:33486)
I20260709 13:08:18.721788 16367 tablet_copy_service.cc:161] P 363bb2f744eb486f9ad726f08214c98e: Beginning new tablet copy session on tablet 5c2f49b7f95a4153b2d180218e6af1db from peer 1109f76a0b7b443a84c0327c8707bc63 at {username='slave'} at 127.0.0.1:33486: session id = 1109f76a0b7b443a84c0327c8707bc63-5c2f49b7f95a4153b2d180218e6af1db
I20260709 13:08:18.687678 22486 raft_consensus.cc:2749] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:08:18.706413 22837 log.cc:927] Time spent T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:08:18.713519 22429 raft_consensus.cc:2804] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:18.726910 22606 consensus_queue.cc:1048] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 13:08:18.703651 22828 consensus_queue.cc:1048] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.048s
I20260709 13:08:18.703843 22844 raft_consensus.cc:3060] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:18.703961 22697 raft_consensus.cc:493] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:18.784782 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:18.788080 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:08:18.694003 22747 raft_consensus.cc:515] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:08:18.802740 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:18.828279 16912 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:18.791893 22697 raft_consensus.cc:3060] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:18.772971 22773 raft_consensus.cc:515] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:18.794409 22429 raft_consensus.cc:697] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 14 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:08:18.845026 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:18.719789 22741 raft_consensus.cc:515] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:08:18.840593 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 147781us
I20260709 13:08:18.847085 16948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
W20260709 13:08:18.844766 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 130326us
I20260709 13:08:18.794087 22676 raft_consensus.cc:3055] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:08:18.775262 22759 consensus_queue.cc:1048] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.064s
I20260709 13:08:18.799808 22711 consensus_queue.cc:1059] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.049s
I20260709 13:08:18.852813 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:18.856261 16277 raft_consensus.cc:3060] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:18.854787 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:18.779521 22562 raft_consensus.cc:515] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:18.862027 16207 raft_consensus.cc:3060] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:18.873908 16207 raft_consensus.cc:2468] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 14.
I20260709 13:08:18.877341 16276 raft_consensus.cc:1240] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:18.877579 16248 leader_election.cc:304] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:08:18.854295 22676 raft_consensus.cc:740] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:08:18.862954 22754 raft_consensus.cc:493] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.880510 22754 raft_consensus.cc:515] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:18.880831 22828 raft_consensus.cc:2749] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:18.882580 22754 leader_election.cc:290] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:18.882966 16277 raft_consensus.cc:2468] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 14.
I20260709 13:08:18.882514 22828 consensus_queue.cc:1048] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:18.896896 16173 leader_election.cc:400] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 13 pre-election: Vote denied by peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107) with higher term. Message: Invalid argument: T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for earlier term 13. Current term is 14.
I20260709 13:08:18.866508 22626 consensus_queue.cc:1048] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 13:08:18.899958 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:18.901769 16277 raft_consensus.cc:2468] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 15.
I20260709 13:08:18.878392 22656 raft_consensus.cc:515] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:18.918596 16355 raft_consensus.cc:1240] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:18.923347 22747 leader_election.cc:290] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:18.924731 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:18.926251 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:18.925818 16277 raft_consensus.cc:3060] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:08:18.923864 16367 tablet_copy_source_session.cc:215] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:18.927376 16349 raft_consensus.cc:2468] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 16.
W20260709 13:08:18.937773 22849 log.cc:927] Time spent T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:08:18.965843 22773 leader_election.cc:290] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 13 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:18.910430 22676 consensus_queue.cc:260] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:18.971012 22741 leader_election.cc:290] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:18.973731 22676 raft_consensus.cc:3060] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:18.975631 22656 leader_election.cc:290] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 17 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:18.905753 22429 consensus_queue.cc:237] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:18.977118 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:18.977936 16281 raft_consensus.cc:2368] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for earlier term 13. Current term is 14.
I20260709 13:08:18.918679 22493 consensus_queue.cc:1059] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.018s
I20260709 13:08:18.983245 16277 raft_consensus.cc:1275] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:08:18.956753 22693 raft_consensus.cc:3055] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:08:18.997035 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 116681us
W20260709 13:08:19.001389 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:18.997836 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 68981.4us
I20260709 13:08:19.004916 16322 leader_election.cc:304] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:19.006281 16322 leader_election.cc:304] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:18.992498 22693 raft_consensus.cc:740] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:08:19.014379 16322 leader_election.cc:304] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
W20260709 13:08:19.015144 22854 log.cc:927] Time spent T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 13:08:19.015333 22677 raft_consensus.cc:2749] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:19.010860 22630 raft_consensus.cc:2749] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:19.009950 22493 raft_consensus.cc:493] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:08:19.017253 22697 raft_consensus.cc:515] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:19.017452 22493 raft_consensus.cc:515] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:19.019418 22493 leader_election.cc:290] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:19.021312 22800 raft_consensus.cc:2749] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:19.019436 22697 leader_election.cc:290] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 17 election: Requested vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:19.026153 16945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:08:19.026813 16945 raft_consensus.cc:3060] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:19.028155 16322 leader_election.cc:304] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:08:19.029066 22656 raft_consensus.cc:2804] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:19.029685 22656 raft_consensus.cc:697] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 14 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:08:19.030716 22656 consensus_queue.cc:237] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:19.037276 16945 raft_consensus.cc:2468] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 17.
I20260709 13:08:19.039378 16355 raft_consensus.cc:1275] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 12. (term mismatch)
I20260709 13:08:19.039840 16355 pending_rounds.cc:85] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e: Aborting all ops after (but not including) 11
I20260709 13:08:19.040099 16355 pending_rounds.cc:107] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e: Aborting uncommitted NO_OP operation due to leader change: 14.12
I20260709 13:08:19.040359 16355 raft_consensus.cc:2889] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:19.040551 16173 leader_election.cc:304] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:19.041198 16356 raft_consensus.cc:1275] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 20 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:08:19.050472 16355 raft_consensus.cc:1240] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 20 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 19. Current term is 20. Ops: [19.11-19.11]
I20260709 13:08:19.052246 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:19.052197 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:19.001448 22562 leader_election.cc:290] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 15 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:19.067901 16173 leader_election.cc:304] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:08:19.055718 22697 raft_consensus.cc:493] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:19.058811 22606 raft_consensus.cc:2804] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:19.075239 16322 leader_election.cc:304] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:19.081594 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:19.072400 22773 raft_consensus.cc:2749] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:19.088388 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:19.088833 16355 raft_consensus.cc:1275] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:08:19.089038 16352 raft_consensus.cc:3060] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:19.089207 16945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:08:19.091758 16945 raft_consensus.cc:2393] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 14: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
I20260709 13:08:19.092561 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:19.080590 22656 raft_consensus.cc:2749] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:19.081490 22606 raft_consensus.cc:697] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [term 17 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:08:19.095111 16322 leader_election.cc:304] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:08:19.074020 22697 raft_consensus.cc:515] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:19.096181 16356 raft_consensus.cc:1240] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:08:19.074580 22844 raft_consensus.cc:515] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:19.106180 22844 leader_election.cc:290] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 17 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:19.097524 16322 leader_election.cc:304] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:19.111960 22844 raft_consensus.cc:2749] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:19.115641 22702 raft_consensus.cc:3055] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:08:19.116204 22702 raft_consensus.cc:740] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:08:19.116227 22697 leader_election.cc:290] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:19.117272 22702 consensus_queue.cc:260] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:19.097419 22773 consensus_queue.cc:1048] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:08:19.126279 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:19.126930 16278 raft_consensus.cc:3060] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:08:19.098333 22630 raft_consensus.cc:2749] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:19.132494 22606 consensus_queue.cc:237] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:19.131297 16173 leader_election.cc:400] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 13 election: Vote denied by peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823) with higher term. Message: Invalid argument: T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for earlier term 13. Current term is 14.
I20260709 13:08:19.138044 16173 leader_election.cc:403] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:08:19.138741 22773 raft_consensus.cc:2749] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823) with higher term. Message: Invalid argument: T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for earlier term 13. Current term is 14.
I20260709 13:08:19.140007 22777 consensus_queue.cc:1048] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:08:19.140911 22839 consensus_queue.cc:1059] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:19.141168 16914 leader_election.cc:304] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:19.142016 22773 raft_consensus.cc:3055] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:19.142442 22773 raft_consensus.cc:740] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:08:19.143625 22773 consensus_queue.cc:260] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:19.144755 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:19.148947 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:19.150054 16277 raft_consensus.cc:2393] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 12: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:08:19.151364 16173 leader_election.cc:304] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:08:19.144443 22693 consensus_queue.cc:260] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:19.167292 22693 raft_consensus.cc:3060] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:19.168533 22699 raft_consensus.cc:2749] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:19.171437 16914 leader_election.cc:304] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:08:19.161899 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:19.172276 16278 raft_consensus.cc:2468] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 17.
I20260709 13:08:19.172498 16349 raft_consensus.cc:2468] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 12.
I20260709 13:08:19.173161 22790 raft_consensus.cc:493] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:19.174105 22850 log.cc:927] Time spent T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.442s	user 0.000s	sys 0.002s
I20260709 13:08:19.175081 22697 raft_consensus.cc:2749] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:19.177809 16352 raft_consensus.cc:2468] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 17.
I20260709 13:08:19.173751 22790 raft_consensus.cc:515] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:19.184844 22790 leader_election.cc:290] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:19.195240 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:19.198706 16914 leader_election.cc:304] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:08:19.167292 22851 log.cc:927] Time spent T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.322s	user 0.000s	sys 0.003s
I20260709 13:08:19.218434 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:08:19.219199 16207 raft_consensus.cc:3060] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:19.219296 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:08:19.235697 22294 raft_consensus.cc:493] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.236330 22294 raft_consensus.cc:515] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:19.237012 22699 raft_consensus.cc:2749] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:19.237457 22839 raft_consensus.cc:493] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.238041 22839 raft_consensus.cc:515] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:19.240267 22839 leader_election.cc:290] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:19.199810 22790 raft_consensus.cc:2749] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:19.252396 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:19.170922 22648 consensus_queue.cc:1059] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.052s
I20260709 13:08:19.258574 16207 raft_consensus.cc:2468] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 17.
W20260709 13:08:19.268910 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 70360.4us
I20260709 13:08:19.271454 22771 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c2f49b7f95a4153b2d180218e6af1db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:19.279284 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:19.280025 16277 raft_consensus.cc:2468] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 12.
I20260709 13:08:19.263073 22294 leader_election.cc:290] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:19.296168 16322 leader_election.cc:304] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:08:19.305465 16322 leader_election.cc:304] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:19.270339 22827 raft_consensus.cc:493] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:19.293165 22824 raft_consensus.cc:493] T 4b962ceebb5c48c1914459ae0c0eff1b P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.316433 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 19 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:19.302357 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:19.318264 16944 raft_consensus.cc:2468] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 12.
W20260709 13:08:19.300961 16248 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:19.302826 22281 raft_consensus.cc:493] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:08:19.324280 16248 leader_election.cc:304] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:19.322660 22827 raft_consensus.cc:515] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:19.328366 16948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 19 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
W20260709 13:08:19.321933 22825 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.601s	user 0.004s	sys 0.016s
I20260709 13:08:19.311534 22709 raft_consensus.cc:2749] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:08:19.311110 22639 raft_consensus.cc:2804] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:19.347595 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f022e2e63ae4461d834e476ff2666991" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:19.342705 22281 raft_consensus.cc:515] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:19.332190 22824 raft_consensus.cc:515] T 4b962ceebb5c48c1914459ae0c0eff1b P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:19.359089 16948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:08:19.412850 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:19.364861 16248 leader_election.cc:304] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:19.342286 22646 raft_consensus.cc:2749] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:08:19.414079 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 49389.8us
I20260709 13:08:19.355310 22753 consensus_queue.cc:1048] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.025s
I20260709 13:08:19.375373 22860 consensus_queue.cc:1048] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.010s
I20260709 13:08:19.389199 22809 raft_consensus.cc:493] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.397619 22870 raft_consensus.cc:3055] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:08:19.414690 16348 raft_consensus.cc:1240] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:19.414759 16357 raft_consensus.cc:1275] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:08:19.415097 16248 leader_election.cc:304] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:08:19.404891 22825 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.684s	user 0.004s	sys 0.017s
I20260709 13:08:19.437572 22809 raft_consensus.cc:515] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:19.444624 22281 leader_election.cc:290] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:19.445878 16248 leader_election.cc:304] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:08:19.450578 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:19.432309 22870 raft_consensus.cc:740] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:08:19.467443 22853 consensus_queue.cc:1048] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:19.467833 22870 consensus_queue.cc:260] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:19.469220 22759 consensus_queue.cc:1059] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:19.470772 22626 raft_consensus.cc:3055] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:19.471251 22626 raft_consensus.cc:740] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:08:19.472388 22626 consensus_queue.cc:260] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:19.473869 22626 raft_consensus.cc:3060] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:19.468647 22748 raft_consensus.cc:493] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.475270 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:19.475208 22748 raft_consensus.cc:515] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:19.474648 22672 raft_consensus.cc:2804] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:19.478263 22672 raft_consensus.cc:493] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:19.479007 22672 raft_consensus.cc:3060] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:19.446830 22741 raft_consensus.cc:2749] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:08:19.483639 22868 log.cc:927] Time spent T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:08:19.416996 22747 raft_consensus.cc:2749] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:08:19.436305 22824 leader_election.cc:290] T 4b962ceebb5c48c1914459ae0c0eff1b P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:19.469872 22870 raft_consensus.cc:3060] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:08:19.504338 22872 log.cc:927] Time spent T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.153s	user 0.001s	sys 0.001s
I20260709 13:08:19.423244 22639 raft_consensus.cc:697] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 17 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:08:19.506338 22639 consensus_queue.cc:237] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:08:19.524370 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:19.512293 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 232322us
I20260709 13:08:19.532559 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:19.533397 16202 raft_consensus.cc:2368] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 16. Current term is 17.
I20260709 13:08:19.536636 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:19.537564 16205 raft_consensus.cc:2468] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 12.
I20260709 13:08:19.542816 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f022e2e63ae4461d834e476ff2666991" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:19.541189 22562 raft_consensus.cc:493] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.548215 22562 raft_consensus.cc:515] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:19.551111 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:08:19.539832 22809 leader_election.cc:290] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:19.559655 22562 leader_election.cc:290] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:19.563102 16914 leader_election.cc:304] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:08:19.569427 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:19.575314 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:19.576090 16283 raft_consensus.cc:2393] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 20: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
W20260709 13:08:19.581898 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 125593us
I20260709 13:08:19.581878 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:19.584762 16276 raft_consensus.cc:2468] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 16.
I20260709 13:08:19.580147 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:19.586903 16914 leader_election.cc:304] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:08:19.583865 22824 raft_consensus.cc:2804] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:19.601987 22881 raft_consensus.cc:493] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:08:19.602777 22881 raft_consensus.cc:515] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:19.605237 22881 leader_election.cc:290] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:19.613015 22827 leader_election.cc:290] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:19.624253 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:19.625000 16203 raft_consensus.cc:2468] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 15.
I20260709 13:08:19.587957 22636 raft_consensus.cc:493] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:08:19.596479 22809 raft_consensus.cc:2804] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:08:19.649873 22885 log.cc:927] Time spent T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 13:08:19.655933 22866 log.cc:927] Time spent T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:08:19.648473 16173 leader_election.cc:304] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:08:19.624141 22824 raft_consensus.cc:493] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:19.595701 22672 raft_consensus.cc:515] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:19.670900 22672 leader_election.cc:290] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:19.671257 22824 raft_consensus.cc:3060] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:19.673439 22773 raft_consensus.cc:3060] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:19.675009 22875 raft_consensus.cc:2804] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:19.679792 16246 leader_election.cc:400] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 pre-election: Vote denied by peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073) with higher term. Message: Invalid argument: T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 16. Current term is 17.
I20260709 13:08:19.705687 16246 leader_election.cc:403] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:19.683758 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:19.684394 22677 raft_consensus.cc:493] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.706406 16201 raft_consensus.cc:2468] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 12.
I20260709 13:08:19.708364 16246 leader_election.cc:304] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:19.687920 22748 leader_election.cc:290] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:19.690860 22833 raft_consensus.cc:493] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:19.701283 22871 log.cc:927] Time spent T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.329s	user 0.000s	sys 0.003s
I20260709 13:08:19.703686 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:08:19.719563 16207 raft_consensus.cc:3060] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:19.708158 22677 raft_consensus.cc:515] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:19.721715 22677 leader_election.cc:290] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:19.704016 16322 leader_election.cc:304] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:08:19.648608 22809 raft_consensus.cc:493] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:19.724014 22809 raft_consensus.cc:3060] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:19.686092 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:08:19.707216 22875 raft_consensus.cc:493] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:19.710762 22562 raft_consensus.cc:2749] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073) with higher term. Message: Invalid argument: T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 16. Current term is 17.
I20260709 13:08:19.711269 22853 raft_consensus.cc:2749] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:19.712102 22833 raft_consensus.cc:515] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:19.645889 22636 raft_consensus.cc:515] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:19.718436 16246 leader_election.cc:304] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:19.730736 16207 raft_consensus.cc:2468] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 13.
I20260709 13:08:19.752640 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:19.753373 16349 raft_consensus.cc:2468] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 15.
I20260709 13:08:19.754199 16246 leader_election.cc:304] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:19.759092 16948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:19.767011 22883 raft_consensus.cc:2804] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:19.767560 22883 raft_consensus.cc:493] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:19.767927 22883 raft_consensus.cc:3060] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:19.773572 16201 raft_consensus.cc:1275] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:08:19.775727 22636 leader_election.cc:290] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:19.741552 22875 raft_consensus.cc:3060] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:19.737547 22748 raft_consensus.cc:2749] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:19.738018 22800 raft_consensus.cc:493] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:08:19.777762 22562 raft_consensus.cc:2804] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:19.778344 22562 raft_consensus.cc:697] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:08:19.777942 22800 raft_consensus.cc:515] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:19.779268 22562 consensus_queue.cc:237] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:19.786926 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:19.787642 16207 raft_consensus.cc:2468] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 19.
I20260709 13:08:19.789373 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:19.791258 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:19.793983 16173 leader_election.cc:304] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:08:19.799727 16941 raft_consensus.cc:1275] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:08:19.801931 16173 leader_election.cc:304] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:08:19.808569 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:19.770416 22771 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:35122 (request call id 861) took 3385 ms. Trace:
I20260709 13:08:19.813864 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:19.815750 16351 raft_consensus.cc:2468] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 20.
I20260709 13:08:19.809262 16356 raft_consensus.cc:2468] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 16.
I20260709 13:08:19.818641 16203 raft_consensus.cc:1275] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:08:19.826205 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:19.841172 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:19.846760 16356 raft_consensus.cc:1275] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:08:19.854523 22833 leader_election.cc:290] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:19.859484 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:19.862406 16357 raft_consensus.cc:1240] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 18. Current term is 19. Ops: []
I20260709 13:08:19.807183 22881 raft_consensus.cc:2749] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:08:19.815321 22802 raft_consensus.cc:2749] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:19.818782 22741 raft_consensus.cc:493] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
W20260709 13:08:19.885025 22886 log.cc:927] Time spent T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:08:19.875988 22606 raft_consensus.cc:493] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.901986 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:19.907733 16320 leader_election.cc:304] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:19.907128 16322 leader_election.cc:304] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:08:19.916102 16948 raft_consensus.cc:1275] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 17 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:08:19.903330 22798 raft_consensus.cc:493] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.904672 22800 leader_election.cc:290] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:19.915036 22853 raft_consensus.cc:493] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.922592 22652 raft_consensus.cc:2804] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:08:19.899596 22741 raft_consensus.cc:515] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
W20260709 13:08:20.001816 16171 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:19.911774 22748 consensus_queue.cc:1048] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.077s
I20260709 13:08:19.934471 22813 raft_consensus.cc:2749] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:19.937495 22697 consensus_queue.cc:1048] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.074s
I20260709 13:08:19.997326 22652 raft_consensus.cc:493] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:19.939814 22677 consensus_queue.cc:1048] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.072s
W20260709 13:08:20.014308 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 107265us
I20260709 13:08:19.997787 22853 raft_consensus.cc:515] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:20.041549 22853 leader_election.cc:290] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:20.043844 22741 leader_election.cc:290] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:20.053625 22702 raft_consensus.cc:3060] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:20.060706 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:20.061434 16277 raft_consensus.cc:2468] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 20.
I20260709 13:08:20.070982 16205 raft_consensus.cc:2468] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 15.
I20260709 13:08:19.914026 22606 raft_consensus.cc:515] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:20.078358 16279 raft_consensus.cc:1275] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:08:19.944037 22798 raft_consensus.cc:515] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:20.024757 22652 raft_consensus.cc:3060] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:20.010954 22824 raft_consensus.cc:515] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:20.079383 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:20.092046 16280 raft_consensus.cc:2410] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for term 21 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 13:08:20.097680 22875 raft_consensus.cc:515] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:20.100006 22875 leader_election.cc:290] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:20.080677 22646 raft_consensus.cc:493] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.102912 16944 raft_consensus.cc:2393] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 13: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
I20260709 13:08:20.102897 22646 raft_consensus.cc:515] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:20.103847 22883 raft_consensus.cc:515] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:20.112773 22672 raft_consensus.cc:493] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.114645 22672 raft_consensus.cc:515] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:20.117637 22672 leader_election.cc:290] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:08:20.117787 22880 log.cc:927] Time spent T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.605s	user 0.006s	sys 0.000s
I20260709 13:08:20.128013 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:20.128940 16276 raft_consensus.cc:2393] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 12: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
W20260709 13:08:20.140393 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 117478us
I20260709 13:08:19.815466 22771 rpcz_store.cc:276] 0709 13:08:16.384935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:16.392508 (+  7573us) service_pool.cc:224] Handling call
0709 13:08:16.556010 (+163502us) ts_tablet_manager.cc:934] T 5c2f49b7f95a4153b2d180218e6af1db P 1109f76a0b7b443a84c0327c8707bc63: Initiating tablet copy from peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
0709 13:08:16.768232 (+212222us) spinlock_profiling.cc:243] Waited 7.62 ms on lock 0x7b4400022b4c. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361c224db1 00007f361c2c2c85 00007f361c2c36a2 00007f361f0351db 00007f361f030aaf 00007f361c37f0ac 00007f36251d9ab9 00007f361c39b69b 00007f361c398caa 00007f361c398bd2 00007f36243fd131
0709 13:08:19.270048 (+2501816us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:08:19.673507 (+403459us) tablet_metadata.cc:665] Metadata flushed
0709 13:08:19.673656 (+   149us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:08:19.769504 (+ 95848us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:08:19.769827 (+   323us) tablet_replica.cc:206] Creating consensus instance
0709 13:08:19.770157 (+   330us) ts_tablet_manager.cc:989] Replica registered.
0709 13:08:19.770322 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":48615,"spinlock_wait_cycles":17535872,"tablet-copy.queue_time_us":146757,"thread_start_us":450831,"threads_started":2}
I20260709 13:08:20.147413 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:20.132617 22824 leader_election.cc:290] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 13 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:20.175705 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:20.179884 16173 leader_election.cc:304] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:08:20.189234 22798 leader_election.cc:290] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:20.190925 22606 leader_election.cc:290] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:20.192622 22693 raft_consensus.cc:2804] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:20.193044 22693 raft_consensus.cc:493] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 19 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:20.193418 22693 raft_consensus.cc:3060] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:20.199103 22652 raft_consensus.cc:515] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:20.199707 16280 raft_consensus.cc:1275] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:08:20.201244 22636 consensus_queue.cc:1048] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:20.201592 22652 leader_election.cc:290] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 21 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:20.149014 22813 consensus_queue.cc:1048] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.014s
I20260709 13:08:20.204993 16173 leader_election.cc:304] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:08:20.208323 16914 leader_election.cc:304] T 4b962ceebb5c48c1914459ae0c0eff1b P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:08:20.212011 22883 leader_election.cc:290] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:20.212108 22636 raft_consensus.cc:2749] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:20.212584 22884 raft_consensus.cc:2749] T 4b962ceebb5c48c1914459ae0c0eff1b P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:20.219350 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:20.220126 16947 raft_consensus.cc:2468] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 20.
I20260709 13:08:20.221186 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:20.221884 16941 raft_consensus.cc:2468] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 15.
I20260709 13:08:20.223949 22646 leader_election.cc:290] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:20.225006 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:20.227056 16173 leader_election.cc:304] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:20.227862 22827 raft_consensus.cc:2804] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:20.228243 22827 raft_consensus.cc:493] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:20.228567 22827 raft_consensus.cc:3060] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:20.233163 22493 raft_consensus.cc:493] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:08:20.233675 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:08:20.233753 22493 raft_consensus.cc:515] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:20.234532 16201 raft_consensus.cc:2393] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 in current term 13: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:08:20.234723 16246 leader_election.cc:304] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:08:20.235558 22878 consensus_queue.cc:1048] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:08:20.235836 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:20.237354 22753 raft_consensus.cc:2804] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:20.237414 16322 leader_election.cc:304] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:20.238181 22753 raft_consensus.cc:697] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:08:20.238400 22878 raft_consensus.cc:2749] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:20.264029 22753 consensus_queue.cc:237] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:20.239431 22493 leader_election.cc:290] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:20.245718 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:20.267517 16355 raft_consensus.cc:2393] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 21: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:08:20.252543 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:20.268360 16280 raft_consensus.cc:2468] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 20.
I20260709 13:08:20.269624 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:08:20.253556 22809 consensus_meta.cc:287] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63: Time spent flushing consensus metadata: real 0.529s	user 0.008s	sys 0.004s
I20260709 13:08:20.271622 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:20.271940 22809 raft_consensus.cc:515] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:20.262321 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:20.272914 16348 raft_consensus.cc:2468] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 20.
I20260709 13:08:20.272336 16356 raft_consensus.cc:3060] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:20.274072 22809 leader_election.cc:290] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 17 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:20.253568 16105 catalog_manager.cc:5697] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e reported cstate change: term changed from 13 to 18, leader changed from e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) to 363bb2f744eb486f9ad726f08214c98e (127.14.180.67). New cstate: current_term: 18 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:20.274168 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:20.275105 16206 raft_consensus.cc:2468] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 19.
I20260709 13:08:20.278404 22693 raft_consensus.cc:515] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:20.279613 16208 raft_consensus.cc:2468] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 20.
I20260709 13:08:20.281520 16356 raft_consensus.cc:2468] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 16.
I20260709 13:08:20.282714 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:20.282984 16173 leader_election.cc:304] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:20.283830 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:20.284161 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:20.286335 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:20.285943 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:20.287722 16280 raft_consensus.cc:2393] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 20: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:08:20.287732 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:20.288442 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:08:20.288614 16202 raft_consensus.cc:2468] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 12.
I20260709 13:08:20.289047 16208 raft_consensus.cc:3060] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:08:20.289788 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 222850us
I20260709 13:08:20.291646 22693 leader_election.cc:290] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 20 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:20.302245 16948 raft_consensus.cc:1275] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:08:20.286055 16348 raft_consensus.cc:2468] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 12.
I20260709 13:08:20.305079 16205 raft_consensus.cc:1275] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:08:20.307456 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:20.308000 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:08:20.308326 16205 raft_consensus.cc:2468] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 19.
I20260709 13:08:20.308634 16202 raft_consensus.cc:3060] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:20.299983 15057 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:20.323987 16208 raft_consensus.cc:2468] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 16.
I20260709 13:08:20.327356 22626 consensus_queue.cc:1048] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 13:08:20.333491 22827 raft_consensus.cc:515] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:20.335150 16105 catalog_manager.cc:5697] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e reported cstate change: term changed from 13 to 15, leader changed from e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) to 363bb2f744eb486f9ad726f08214c98e (127.14.180.67). New cstate: current_term: 15 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:20.335975 22827 leader_election.cc:290] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 16 election: Requested vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:08:20.336223 16106 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38830 (request call id 231) took 28701 ms (client timeout 15000 ms). Trace:
I20260709 13:08:20.313849 22875 raft_consensus.cc:2804] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:20.337908 16191 tablet_service.cc:1558] Processing DeleteTablet for tablet 4b962ceebb5c48c1914459ae0c0eff1b with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 10 (current committed config index is 11)) from {username='slave'} at 127.0.0.1:44830
I20260709 13:08:20.338074 22875 raft_consensus.cc:493] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 19 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:08:20.346316 16202 raft_consensus.cc:2468] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 21.
I20260709 13:08:20.358814 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:08:20.359764 16944 raft_consensus.cc:3060] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:20.328128 22771 tablet_copy_client.cc:806] T 5c2f49b7f95a4153b2d180218e6af1db P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:20.338519 22875 raft_consensus.cc:3060] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:20.379762 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:20.387625 16352 raft_consensus.cc:2393] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f in current term 20: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:08:20.388378 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:20.389197 16348 raft_consensus.cc:2368] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for earlier term 20. Current term is 21.
I20260709 13:08:20.391247 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:20.393383 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:20.394217 16246 leader_election.cc:304] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:20.395169 22672 raft_consensus.cc:2804] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:08:20.395989 22672 raft_consensus.cc:493] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:20.396111 16200 raft_consensus.cc:1275] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:08:20.396549 22672 raft_consensus.cc:3060] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:20.403582 16246 leader_election.cc:304] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:20.404676 22486 raft_consensus.cc:2804] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:08:20.405121 22486 raft_consensus.cc:493] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:20.405532 22486 raft_consensus.cc:3060] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:20.407476 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:20.420481 16944 raft_consensus.cc:2468] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 16.
W20260709 13:08:20.336625 16106 rpcz_store.cc:269] 0709 13:07:51.634463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:51.634671 (+   208us) service_pool.cc:224] Handling call
0709 13:07:51.723963 (+ 89292us) spinlock_profiling.cc:243] Waited 64.5 ms on lock 0x7b5400137754. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f3090 00007f361f491f3a 00007f36252481cc 00007f362534637e 00007f36238072a4 00007f3623807232 00007f3623807161 00007f36238070dc 00007f3623806392 00007f361d7c448c 00007f361d7c38c6
0709 13:08:20.336127 (+28612164us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:17.610692 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:17.611302 (+   610us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:17.611343 (+    41us) write_op.cc:435] Acquired schema lock
0709 13:08:17.612613 (+  1270us) tablet.cc:662] Decoding operations
0709 13:08:17.647455 (+ 34842us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:17.647536 (+    81us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:17.659138 (+ 11602us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:08:17.672750 (+ 13612us) tablet.cc:701] Row locks acquired
0709 13:08:17.673599 (+   849us) write_op.cc:260] PREPARE: finished
0709 13:08:17.674737 (+  1138us) write_op.cc:270] Start()
0709 13:08:17.674870 (+   133us) write_op.cc:276] Timestamp: P: 1783602497674684 usec, L: 0
0709 13:08:17.676396 (+  1526us) op_driver.cc:348] REPLICATION: starting
0709 13:08:17.764212 (+ 87816us) log.cc:844] Serialized 541 byte log entry
0709 13:08:17.853208 (+ 88996us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b4400022b4c. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361c224db1 00007f361c2c2c85 00007f361c2c36a2 00007f361f0351db 00007f361f030aaf 00007f361c37f0ac 00007f36251d9ab9 00007f361c39b69b 00007f361c39993f 00007f361c39bc02 00007f361f02320b
0709 13:08:17.926941 (+ 73733us) op_driver.cc:464] REPLICATION: finished
0709 13:08:18.254341 (+327400us) write_op.cc:301] APPLY: starting
0709 13:08:18.265589 (+ 11248us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:18.294061 (+ 28472us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:18.294098 (+    37us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:18.295063 (+   965us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:18.295311 (+   248us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:08:18.295390 (+    79us) write_op.cc:312] APPLY: finished
0709 13:08:18.295666 (+   276us) log.cc:844] Serialized 25 byte log entry
0709 13:08:18.295927 (+   261us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:18.296037 (+   110us) write_op.cc:454] Released schema lock
0709 13:08:18.296097 (+    60us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:18.632874 (+336777us) spinlock_profiling.cc:243] Waited 33.6 ms on lock 0x7b5400137754. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f2571 00007f361f484e28 00007f3622ebf581 00007f3622ebed58 00007f3622ec39f1 00007f3622ec39a9 00007f3622ec3939 00007f3622ec3901 00007f3622ec2b2d 000000000038f354 000000000038f199
0709 13:08:18.668519 (+ 35645us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:18.674225 (+  5706us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":6074,"reported_tablets":50,"spinlock_wait_cycles":148429184,"child_traces":[["op",{"apply.queue_time_us":288072,"apply.run_cpu_time_us":4410,"apply.run_wall_time_us":48616,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8307,"num_ops":1,"prepare.queue_time_us":540808,"prepare.run_cpu_time_us":21108,"prepare.run_wall_time_us":1034863,"raft.queue_time_us":9042,"raft.run_cpu_time_us":15918,"raft.run_wall_time_us":299529,"replication_time_us":225589,"spinlock_wait_cycles":100657280,"thread_start_us":741414,"threads_started":4,"wal-append.queue_time_us":121840,"wal-append.run_cpu_time_us":9103,"wal-append.run_wall_time_us":1412183}]]}
I20260709 13:08:20.421476 16246 leader_election.cc:304] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:20.421998 16173 leader_election.cc:304] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:20.423949 22771 tablet_copy_client.cc:670] T 5c2f49b7f95a4153b2d180218e6af1db P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:20.421849 16105 catalog_manager.cc:5697] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e reported cstate change: term changed from 9 to 10, leader changed from 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) to e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65). New cstate: current_term: 10 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } }
W20260709 13:08:20.430230 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 56225us
I20260709 13:08:20.444741 16173 leader_election.cc:304] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:08:20.451300 16105 catalog_manager.cc:5697] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e reported cstate change: term changed from 17 to 18, leader changed from 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) to 363bb2f744eb486f9ad726f08214c98e (127.14.180.67). New cstate: current_term: 18 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:20.433774 16246 leader_election.cc:304] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
W20260709 13:08:20.453642 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 243969us
I20260709 13:08:20.462404 16322 leader_election.cc:304] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:08:20.462745 16173 leader_election.cc:400] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 20 election: Vote denied by peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107) with higher term. Message: Invalid argument: T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for earlier term 20. Current term is 21.
I20260709 13:08:20.463107 16173 leader_election.cc:403] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
I20260709 13:08:20.436545 16320 leader_election.cc:304] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:20.429976 22639 raft_consensus.cc:493] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:08:20.434824 22636 raft_consensus.cc:2804] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:20.431911 22429 consensus_queue.cc:1048] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.023s
I20260709 13:08:20.466686 16322 leader_election.cc:304] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:20.453670 22751 raft_consensus.cc:2804] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:20.448607 22693 raft_consensus.cc:2749] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:08:20.469673 22677 raft_consensus.cc:2804] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:20.481257 22636 raft_consensus.cc:697] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [term 16 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:08:20.481820 22773 raft_consensus.cc:2749] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107) with higher term. Message: Invalid argument: T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for earlier term 20. Current term is 21.
I20260709 13:08:20.471120 22639 raft_consensus.cc:515] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:20.521986 22639 leader_election.cc:290] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:20.492048 22562 raft_consensus.cc:2804] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:20.523137 22562 raft_consensus.cc:697] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:08:20.524089 22562 consensus_queue.cc:237] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:20.473265 22751 raft_consensus.cc:493] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:20.526643 22751 raft_consensus.cc:3060] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:20.533223 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:20.534164 16282 raft_consensus.cc:3060] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:20.544412 22672 raft_consensus.cc:515] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:20.547549 16248 leader_election.cc:304] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:20.484724 22677 raft_consensus.cc:493] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:20.551009 22677 raft_consensus.cc:3060] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:20.481724 16914 leader_election.cc:304] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:20.483363 16947 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1356ff4c060346359eb10723422e972a"
dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
mode: GRACEFUL
new_leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
 from {username='slave'} at 127.0.0.1:58316
I20260709 13:08:20.483599 16320 leader_election.cc:304] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:20.563066 16947 raft_consensus.cc:606] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Received request to transfer leadership to TS e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:08:20.563287 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 79776.4us
I20260709 13:08:20.563603 16947 raft_consensus.cc:614] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:20.565193 22884 raft_consensus.cc:2749] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:20.485356 16090 catalog_manager.cc:5028] TS e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): tablet 4b962ceebb5c48c1914459ae0c0eff1b (table test-workload [id=f364cfe226234c5b99453e3013c8717e]) successfully deleted
I20260709 13:08:20.566655 22904 raft_consensus.cc:2804] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:08:20.487754 22646 consensus_queue.cc:1048] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:08:20.566887 16090 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 81551us
I20260709 13:08:20.567359 22904 raft_consensus.cc:697] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 21 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:08:20.467154 22652 raft_consensus.cc:2804] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:08:20.570490 22652 raft_consensus.cc:493] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:20.570959 22652 raft_consensus.cc:3060] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:20.569754 22904 consensus_queue.cc:237] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:20.572803 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:08:20.580417 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:20.580979 16947 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "26565509c81343bc818483042146461a"
dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
mode: GRACEFUL
new_leader_uuid: "363bb2f744eb486f9ad726f08214c98e"
 from {username='slave'} at 127.0.0.1:58316
I20260709 13:08:20.581585 16947 raft_consensus.cc:606] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 20 FOLLOWER]: Received request to transfer leadership to TS 363bb2f744eb486f9ad726f08214c98e
I20260709 13:08:20.495690 22636 consensus_queue.cc:237] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:20.508711 22693 raft_consensus.cc:493] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.582216 16947 raft_consensus.cc:614] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:20.585924 22693 raft_consensus.cc:515] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:20.588248 22693 leader_election.cc:290] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:20.479624 22813 raft_consensus.cc:2749] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:20.589630 16948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:20.590304 16948 raft_consensus.cc:2468] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 12.
I20260709 13:08:20.591926 16948 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf"
dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
mode: GRACEFUL
new_leader_uuid: "363bb2f744eb486f9ad726f08214c98e"
 from {username='slave'} at 127.0.0.1:58316
I20260709 13:08:20.592519 16948 raft_consensus.cc:606] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 20 FOLLOWER]: Received request to transfer leadership to TS 363bb2f744eb486f9ad726f08214c98e
I20260709 13:08:20.592886 16948 raft_consensus.cc:614] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:20.594432 16173 leader_election.cc:304] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:20.595366 22881 raft_consensus.cc:2804] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:20.595777 22881 raft_consensus.cc:493] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:20.596098 22881 raft_consensus.cc:3060] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:20.566241 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 84582.8us
I20260709 13:08:20.566843 22759 raft_consensus.cc:2749] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:20.607430 22875 raft_consensus.cc:515] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:20.609015 16206 raft_consensus.cc:3060] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:08:20.609956 16092 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 73757c6fea8949e090aa4e55902a41d4 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER failed with leader 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 1109f76a0b7b443a84c0327c8707bc63 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 14 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
W20260709 13:08:20.611203 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 117002us
I20260709 13:08:20.631139 16282 raft_consensus.cc:2468] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 17.
I20260709 13:08:20.635305 16283 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b"
dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
mode: GRACEFUL
new_leader_uuid: "363bb2f744eb486f9ad726f08214c98e"
 from {username='slave'} at 127.0.0.1:39058
I20260709 13:08:20.639106 16283 raft_consensus.cc:606] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 LEADER]: Received request to transfer leadership to TS 363bb2f744eb486f9ad726f08214c98e
I20260709 13:08:20.638898 16914 leader_election.cc:304] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:08:20.650723 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:20.658325 16947 raft_consensus.cc:2368] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for earlier term 15. Current term is 16.
I20260709 13:08:20.610934 22486 raft_consensus.cc:515] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:20.628937 22903 consensus_queue.cc:1048] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 13:08:20.674039 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:20.675890 16351 raft_consensus.cc:2468] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 13.
I20260709 13:08:20.681499 16206 raft_consensus.cc:2468] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 21.
I20260709 13:08:20.682888 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47342899f1ed4c788d60ea4c5b52969a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:20.683511 16356 raft_consensus.cc:3060] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:20.684072 22672 leader_election.cc:290] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 21 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:20.684442 22747 raft_consensus.cc:493] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:08:20.655218 22809 raft_consensus.cc:2804] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:20.712551 16246 leader_election.cc:304] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:20.714936 16280 raft_consensus.cc:2393] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 21: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:08:20.690886 22747 raft_consensus.cc:515] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:20.696300 16356 raft_consensus.cc:2468] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 17.
I20260709 13:08:20.729844 16322 leader_election.cc:400] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 pre-election: Vote denied by peer 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875) with higher term. Message: Invalid argument: T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for earlier term 15. Current term is 16.
I20260709 13:08:20.730436 16322 leader_election.cc:403] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:20.719130 22672 raft_consensus.cc:2804] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:08:20.733425 22672 raft_consensus.cc:697] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 21 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:08:20.742781 22486 leader_election.cc:290] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 21 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:20.744230 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:08:20.745397 16200 raft_consensus.cc:2393] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 21: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:08:20.741961 22672 consensus_queue.cc:237] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:08:20.719982 22915 log.cc:927] Time spent T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:08:20.721872 22809 raft_consensus.cc:697] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 17 LEADER]: Becoming Leader. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:08:20.746243 22652 raft_consensus.cc:515] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:08:20.792208 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 65802.5us
I20260709 13:08:20.787458 22656 raft_consensus.cc:3060] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:08:20.804594 22652 leader_election.cc:290] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 21 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:20.812740 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:20.813486 16283 raft_consensus.cc:3060] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Advancing to term 21
I20260709 13:08:20.816977 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:08:20.817696 16947 raft_consensus.cc:3060] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:20.843369 16947 raft_consensus.cc:2468] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 21.
I20260709 13:08:20.859970 16280 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aee913c41fb9437587affa768953f637"
dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
mode: GRACEFUL
new_leader_uuid: "363bb2f744eb486f9ad726f08214c98e"
 from {username='slave'} at 127.0.0.1:39058
I20260709 13:08:20.860637 16280 raft_consensus.cc:606] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Received request to transfer leadership to TS 363bb2f744eb486f9ad726f08214c98e
I20260709 13:08:20.861209 16280 raft_consensus.cc:614] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:08:20.861954 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 79438.3us
W20260709 13:08:20.863423 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 109126us
I20260709 13:08:20.887799 15057 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:08:20.896039 15057 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:20.920984 16948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:20.921839 16948 raft_consensus.cc:2368] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 20. Current term is 21.
I20260709 13:08:20.923868 16248 leader_election.cc:400] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 20 pre-election: Vote denied by peer 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875) with higher term. Message: Invalid argument: T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 20. Current term is 21.
I20260709 13:08:20.924325 16248 leader_election.cc:403] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 20 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:20.859594 22881 raft_consensus.cc:515] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:08:20.932323 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 114837us
I20260709 13:08:20.922964 22771 tablet_copy_client.cc:538] T 5c2f49b7f95a4153b2d180218e6af1db P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:20.898198 22747 leader_election.cc:290] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:20.860688 22809 consensus_queue.cc:237] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:20.953882 22741 raft_consensus.cc:493] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:21.033699 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 68776.5us
W20260709 13:08:21.059067 22924 log.cc:927] Time spent T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.151s	user 0.000s	sys 0.001s
I20260709 13:08:21.095902 16283 raft_consensus.cc:2468] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 21.
I20260709 13:08:21.055310 22741 raft_consensus.cc:515] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:21.102337 22626 raft_consensus.cc:2749] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: Vote denied by peer 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875) with higher term. Message: Invalid argument: T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 20. Current term is 21.
W20260709 13:08:21.124959 22931 log.cc:927] Time spent T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.171s	user 0.000s	sys 0.001s
W20260709 13:08:21.176790 22751 consensus_meta.cc:287] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3: Time spent flushing consensus metadata: real 0.650s	user 0.005s	sys 0.006s
I20260709 13:08:21.119058 22884 raft_consensus.cc:493] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:08:21.177450 22751 raft_consensus.cc:515] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:21.178407 22884 raft_consensus.cc:515] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:21.181102 22884 leader_election.cc:290] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:21.111668 22929 raft_consensus.cc:493] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:08:21.182372 22751 leader_election.cc:290] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:21.182536 22929 raft_consensus.cc:515] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:08:21.215313 22926 log.cc:927] Time spent T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.260s	user 0.002s	sys 0.000s
I20260709 13:08:21.170070 22860 raft_consensus.cc:493] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:08:21.220824 22860 raft_consensus.cc:515] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:21.174839 22741 leader_election.cc:290] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:08:21.194273 22677 consensus_meta.cc:287] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e: Time spent flushing consensus metadata: real 0.643s	user 0.011s	sys 0.001s
W20260709 13:08:21.202121 22921 log.cc:927] Time spent T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.270s	user 0.001s	sys 0.000s
W20260709 13:08:21.201577 22928 log.cc:927] Time spent T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.246s	user 0.001s	sys 0.000s
I20260709 13:08:21.249517 22656 raft_consensus.cc:2749] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875) with higher term. Message: Invalid argument: T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for earlier term 15. Current term is 16.
I20260709 13:08:21.257092 22929 leader_election.cc:290] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:21.256629 22677 raft_consensus.cc:515] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:21.287199 22860 leader_election.cc:290] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:21.356968 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
W20260709 13:08:21.360133 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 483034us
I20260709 13:08:21.280360 22677 leader_election.cc:290] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 20 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:21.377427 16208 raft_consensus.cc:3060] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:21.392107 16201 raft_consensus.cc:1275] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:08:21.392433 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:08:21.396139 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:21.424224 16206 raft_consensus.cc:3060] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:21.424562 16202 raft_consensus.cc:2468] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 16.
I20260709 13:08:21.428241 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:21.428972 16204 raft_consensus.cc:1275] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:08:21.430346 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:21.445266 22875 leader_election.cc:290] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 20 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:21.452770 22881 leader_election.cc:290] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 14 election: Requested vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:21.454247 22771 tablet_bootstrap.cc:492] T 5c2f49b7f95a4153b2d180218e6af1db P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap starting.
I20260709 13:08:21.474826 16208 raft_consensus.cc:2468] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 20.
I20260709 13:08:21.496999 16200 raft_consensus.cc:1275] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 21 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:08:21.512181 16320 leader_election.cc:304] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:21.516242 22639 raft_consensus.cc:2804] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:08:21.517040 22639 raft_consensus.cc:697] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 20 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:08:21.520542 22833 consensus_queue.cc:1048] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:21.524535 16948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:08:21.525664 16948 raft_consensus.cc:3060] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:08:21.532397 22639 consensus_queue.cc:237] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:21.535602 16944 raft_consensus.cc:3060] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:21.539438 16206 raft_consensus.cc:2468] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 13.
I20260709 13:08:21.542110 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:21.543188 16356 raft_consensus.cc:3060] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:21.547185 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:21.547322 22954 raft_consensus.cc:493] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.547703 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:21.548694 16352 raft_consensus.cc:2368] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 20. Current term is 21.
I20260709 13:08:21.548329 22954 raft_consensus.cc:515] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:21.550583 16350 raft_consensus.cc:1275] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:08:21.551869 22954 leader_election.cc:290] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:21.556306 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:21.557101 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:21.559684 16357 raft_consensus.cc:2468] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 17.
I20260709 13:08:21.562844 22814 raft_consensus.cc:493] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:08:21.568070 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:21.571638 16204 raft_consensus.cc:2393] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 in current term 15: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:08:21.571534 22753 consensus_queue.cc:1048] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:21.582527 16246 leader_election.cc:304] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:21.563687 22814 raft_consensus.cc:515] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:21.589223 22814 leader_election.cc:290] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:21.593139 16202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:21.594066 16202 raft_consensus.cc:2468] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 16.
I20260709 13:08:21.593390 16912 leader_election.cc:304] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:21.595911 22947 raft_consensus.cc:2804] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:21.596041 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:21.596503 22947 raft_consensus.cc:493] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:21.596972 16350 raft_consensus.cc:3060] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:21.596987 22947 raft_consensus.cc:3060] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:21.598807 22759 consensus_queue.cc:1048] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:08:21.604414 16246 leader_election.cc:304] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:21.616894 22626 raft_consensus.cc:2804] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:21.617538 22626 raft_consensus.cc:697] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:08:21.618708 16320 leader_election.cc:304] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:21.618790 22626 consensus_queue.cc:237] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:21.624917 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:21.631494 22798 raft_consensus.cc:2804] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:21.632230 22798 raft_consensus.cc:493] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:21.632666 22798 raft_consensus.cc:3060] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:21.637856 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:21.638857 16282 raft_consensus.cc:3060] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:08:21.643659 16947 raft_consensus.cc:1275] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 16 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:08:21.652153 22702 consensus_queue.cc:1048] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:08:21.670265 16282 raft_consensus.cc:2468] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 20.
I20260709 13:08:21.671463 16948 raft_consensus.cc:2468] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 14.
I20260709 13:08:21.674332 16356 raft_consensus.cc:2468] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 21.
I20260709 13:08:21.686435 16944 raft_consensus.cc:1275] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:08:21.685405 16278 raft_consensus.cc:1275] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 21 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:08:21.698082 22927 raft_consensus.cc:2749] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:21.700021 22747 raft_consensus.cc:493] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:21.700773 22747 raft_consensus.cc:515] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:21.703599 16173 leader_election.cc:304] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:21.705010 22702 raft_consensus.cc:2804] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:21.705678 22702 raft_consensus.cc:697] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:08:21.706938 22702 consensus_queue.cc:237] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:21.722515 22747 leader_election.cc:290] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:21.727842 16248 leader_election.cc:304] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:21.728089 22747 raft_consensus.cc:993] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3: : Instructing follower 363bb2f744eb486f9ad726f08214c98e to start an election
I20260709 13:08:21.728981 22942 raft_consensus.cc:2749] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:08:21.729755 16248 leader_election.cc:400] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 20 pre-election: Vote denied by peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107) with higher term. Message: Invalid argument: T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 20. Current term is 21.
I20260709 13:08:21.729990 22759 raft_consensus.cc:1081] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 LEADER]: Signalling peer 363bb2f744eb486f9ad726f08214c98e to start an election
I20260709 13:08:21.730191 16102 catalog_manager.cc:5697] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "1109f76a0b7b443a84c0327c8707bc63" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:21.739068 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:21.739144 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:21.741568 16350 raft_consensus.cc:2468] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 13.
I20260709 13:08:21.744009 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:21.709295 22798 raft_consensus.cc:515] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:21.744499 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:21.759647 22747 raft_consensus.cc:493] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:08:21.793298 22677 raft_consensus.cc:493] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:08:21.794176 22677 raft_consensus.cc:515] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:21.767465 22759 consensus_queue.cc:1048] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.015s
I20260709 13:08:21.798285 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:21.793124 22429 raft_consensus.cc:493] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:08:21.811813 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:21.778029 16102 catalog_manager.cc:5697] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: term changed from 13 to 14, leader changed from 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) to e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65). New cstate: current_term: 14 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:08:21.816004 16354 raft_consensus.cc:2368] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for earlier term 17. Current term is 18.
I20260709 13:08:21.818876 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:21.835919 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:21.836876 16356 raft_consensus.cc:2368] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for earlier term 20. Current term is 21.
W20260709 13:08:21.839329 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 51175.4us
I20260709 13:08:21.801859 22947 raft_consensus.cc:515] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:21.845429 16355 raft_consensus.cc:1275] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:08:21.848907 22677 leader_election.cc:290] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:21.850762 22798 leader_election.cc:290] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 18 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:21.872388 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:08:21.873270 16206 raft_consensus.cc:3060] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:08:21.887559 16352 raft_consensus.cc:3060] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:21.843683 22429 raft_consensus.cc:515] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:08:21.861132 22964 log.cc:927] Time spent T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.085s	user 0.003s	sys 0.000s
I20260709 13:08:21.826889 22747 raft_consensus.cc:515] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:21.917855 16278 raft_consensus.cc:2393] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 18: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:08:21.923869 16276 raft_consensus.cc:1275] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:08:21.919943 16248 leader_election.cc:304] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:21.943473 22626 raft_consensus.cc:2749] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:21.951411 16204 raft_consensus.cc:1275] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 21 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:08:21.955018 15057 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:21.960337 16355 consensus_queue.cc:237] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:08:21.967680 22959 log.cc:927] Time spent T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
W20260709 13:08:21.974212 16105 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38842 (request call id 221) took 20440 ms (client timeout 15000 ms). Trace:
I20260709 13:08:21.947544 16102 catalog_manager.cc:5697] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: term changed from 10 to 15, leader changed from 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) to 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68). New cstate: current_term: 15 leader_uuid: "1109f76a0b7b443a84c0327c8707bc63" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:08:21.980108 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 65810.8us
I20260709 13:08:21.986105 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:22.000872 22927 consensus_queue.cc:1048] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:08:22.001621 16322 leader_election.cc:304] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:08:22.003875 22932 raft_consensus.cc:2804] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:08:22.004472 22932 raft_consensus.cc:697] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 21 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:08:22.004704 22902 consensus_queue.cc:1048] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:22.007571 22429 leader_election.cc:290] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:22.007913 16348 raft_consensus.cc:1275] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:08:22.005847 22932 consensus_queue.cc:237] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:22.052721 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:22.075003 16352 raft_consensus.cc:2468] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 14.
I20260709 13:08:22.087532 22947 leader_election.cc:290] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 18 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:22.063597 22759 consensus_queue.cc:1048] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.031s
W20260709 13:08:22.106367 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 48656.8us
I20260709 13:08:22.131771 22747 leader_election.cc:290] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:22.118167 16102 catalog_manager.cc:5697] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:08:22.146765 22798 raft_consensus.cc:493] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:21.974845 16105 rpcz_store.cc:269] 0709 13:08:01.533595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:01.534029 (+   434us) service_pool.cc:224] Handling call
0709 13:08:21.973948 (+20439919us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:20.756286 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:20.756884 (+   598us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:20.756920 (+    36us) write_op.cc:435] Acquired schema lock
0709 13:08:20.756940 (+    20us) tablet.cc:662] Decoding operations
0709 13:08:20.757530 (+   590us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:20.757617 (+    87us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:20.757658 (+    41us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:08:20.766948 (+  9290us) tablet.cc:701] Row locks acquired
0709 13:08:20.766976 (+    28us) write_op.cc:260] PREPARE: finished
0709 13:08:20.767177 (+   201us) write_op.cc:270] Start()
0709 13:08:20.769663 (+  2486us) write_op.cc:276] Timestamp: P: 1783602500767120 usec, L: 0
0709 13:08:20.769698 (+    35us) op_driver.cc:348] REPLICATION: starting
0709 13:08:20.794152 (+ 24454us) log.cc:844] Serialized 1706 byte log entry
0709 13:08:21.299628 (+505476us) op_driver.cc:464] REPLICATION: finished
0709 13:08:21.301313 (+  1685us) write_op.cc:301] APPLY: starting
0709 13:08:21.301421 (+   108us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:21.458804 (+157383us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:21.459022 (+   218us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:21.463606 (+  4584us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:21.464048 (+   442us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=8,mrs_lookups=0
0709 13:08:21.464142 (+    94us) write_op.cc:312] APPLY: finished
0709 13:08:21.464762 (+   620us) log.cc:844] Serialized 49 byte log entry
0709 13:08:21.567836 (+103074us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:21.572222 (+  4386us) write_op.cc:454] Released schema lock
0709 13:08:21.572281 (+    59us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:21.577512 (+  5231us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:21.577550 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":596723,"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":1346,"apply.run_cpu_time_us":13489,"apply.run_wall_time_us":276133,"cfile_cache_hit":18,"cfile_cache_hit_bytes":20847,"num_ops":4,"prepare.queue_time_us":213835,"prepare.run_cpu_time_us":23263,"prepare.run_wall_time_us":566219,"raft.queue_time_us":7925,"raft.run_cpu_time_us":1624,"raft.run_wall_time_us":1697,"replication_time_us":529671,"thread_start_us":587751,"threads_started":4,"wal-append.queue_time_us":491948}]]}
I20260709 13:08:22.147418 22798 raft_consensus.cc:515] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:22.152704 16206 raft_consensus.cc:2468] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 18.
I20260709 13:08:22.150352 22798 leader_election.cc:290] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:22.169871 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:22.179946 16320 leader_election.cc:304] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:22.164634 22753 raft_consensus.cc:493] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:22.191172 22798 raft_consensus.cc:493] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:08:22.191314 22923 raft_consensus.cc:2804] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:22.193011 22923 raft_consensus.cc:697] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 18 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:08:22.192049 22798 raft_consensus.cc:515] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:22.197418 16102 catalog_manager.cc:5697] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: term changed from 13 to 14, leader changed from 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) to 363bb2f744eb486f9ad726f08214c98e (127.14.180.67). New cstate: current_term: 14 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
W20260709 13:08:22.208729 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 138597us
I20260709 13:08:22.194057 22923 consensus_queue.cc:237] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:22.218190 16102 catalog_manager.cc:5697] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: term changed from 8 to 11, leader changed from 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) to e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65). New cstate: current_term: 11 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:08:22.228909 22824 raft_consensus.cc:493] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:22.229708 22824 raft_consensus.cc:515] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:08:22.238894 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 172920us
I20260709 13:08:22.207757 22753 raft_consensus.cc:515] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:22.253644 16102 catalog_manager.cc:5697] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: term changed from 16 to 20, leader changed from 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) to 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66). New cstate: current_term: 20 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:08:22.264917 16203 raft_consensus.cc:1275] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:08:22.257442 22798 leader_election.cc:290] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:22.259824 22753 leader_election.cc:290] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:22.259699 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:22.264276 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:22.267601 22798 consensus_queue.cc:1048] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:08:22.268318 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 49672us
I20260709 13:08:22.270386 22756 consensus_queue.cc:1048] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:22.271068 16102 catalog_manager.cc:5697] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: term changed from 14 to 18, leader changed from 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) to 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66). New cstate: current_term: 18 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:08:22.275051 22798 raft_consensus.cc:493] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:08:22.240171 22824 leader_election.cc:290] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:22.273663 16322 leader_election.cc:304] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:08:22.278836 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:22.279925 16199 raft_consensus.cc:1275] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:08:22.279985 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:22.286178 16947 raft_consensus.cc:1275] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:08:22.287871 16102 catalog_manager.cc:5697] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: term changed from 12 to 13, leader changed from 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) to e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65). New cstate: current_term: 13 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:08:22.304239 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:08:22.309801 16205 raft_consensus.cc:2393] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 18: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:08:22.305158 22756 raft_consensus.cc:2749] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:22.323346 22940 raft_consensus.cc:493] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:22.324167 22940 raft_consensus.cc:515] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:22.275775 22798 raft_consensus.cc:515] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:22.309747 16102 catalog_manager.cc:5697] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: term changed from 8 to 10, leader changed from 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) to 363bb2f744eb486f9ad726f08214c98e (127.14.180.67). New cstate: current_term: 10 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:08:22.340140 16352 raft_consensus.cc:1275] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 21 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:08:22.313169 22802 consensus_queue.cc:1048] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.029s
I20260709 13:08:22.309403 22747 raft_consensus.cc:493] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:22.349826 22972 consensus_queue.cc:1048] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:08:22.356266 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:22.357599 16348 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b"
dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
 from {username='slave'} at 127.0.0.1:41830
I20260709 13:08:22.358424 16348 raft_consensus.cc:493] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:22.358887 16348 raft_consensus.cc:3060] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:22.361007 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:22.364216 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:22.368530 22747 raft_consensus.cc:515] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:22.376116 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:22.337530 22947 raft_consensus.cc:493] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:22.387668 22947 raft_consensus.cc:515] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:22.389534 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:22.399323 22747 leader_election.cc:290] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:22.399853 16348 raft_consensus.cc:515] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:22.412156 16348 leader_election.cc:290] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 17 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:22.343653 16102 catalog_manager.cc:5697] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: term changed from 12 to 13, leader changed from 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) to 363bb2f744eb486f9ad726f08214c98e (127.14.180.67). New cstate: current_term: 13 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
W20260709 13:08:22.367753 22771 log.cc:927] Time spent T 5c2f49b7f95a4153b2d180218e6af1db P 1109f76a0b7b443a84c0327c8707bc63: Append to log took a long time: real 0.061s	user 0.003s	sys 0.000s
I20260709 13:08:22.412840 22940 leader_election.cc:290] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:22.447872 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:22.437662 16102 catalog_manager.cc:5697] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: term changed from 11 to 12, leader changed from 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) to e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65). New cstate: current_term: 12 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
W20260709 13:08:22.484633 16248 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.14.180.67:46107 timed out after 1.784s (SENT)
I20260709 13:08:22.508965 22874 raft_consensus.cc:493] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:22.509831 22874 raft_consensus.cc:515] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:08:22.558620 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 74040.1us
I20260709 13:08:22.558387 22798 leader_election.cc:290] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:22.577971 22947 leader_election.cc:290] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:22.562959 22874 leader_election.cc:290] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:22.584125 16173 leader_election.cc:400] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 17 pre-election: Vote denied by peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107) with higher term. Message: Invalid argument: T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for earlier term 17. Current term is 18.
I20260709 13:08:22.593803 16173 leader_election.cc:403] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:22.585354 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:22.585445 16948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:22.593216 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:22.608276 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:22.609292 16277 raft_consensus.cc:2393] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 18: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
W20260709 13:08:22.608347 22985 log.cc:927] Time spent T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.069s	user 0.002s	sys 0.000s
I20260709 13:08:22.627962 22940 consensus_queue.cc:1048] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:08:22.632994 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
W20260709 13:08:22.613677 22771 log.cc:927] Time spent T 5c2f49b7f95a4153b2d180218e6af1db P 1109f76a0b7b443a84c0327c8707bc63: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:08:22.646481 16276 raft_consensus.cc:1275] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:08:22.654302 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:22.661841 16944 raft_consensus.cc:1275] T 540bfc4ad793452faea5b865343aacf7 P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:08:22.644687 22881 raft_consensus.cc:2749] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107) with higher term. Message: Invalid argument: T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for earlier term 17. Current term is 18.
I20260709 13:08:22.664764 16948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: true dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:08:22.665442 16948 raft_consensus.cc:3060] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:22.668681 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:08:22.669800 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 85865.1us
I20260709 13:08:22.670826 16173 leader_election.cc:400] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 20 election: Vote denied by peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107) with higher term. Message: Invalid argument: T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for earlier term 20. Current term is 21.
I20260709 13:08:22.671188 16173 leader_election.cc:403] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
I20260709 13:08:22.672946 22875 raft_consensus.cc:2749] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107) with higher term. Message: Invalid argument: T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate e10b16d536674c0bb350a31d7ce5ff7f for earlier term 20. Current term is 21.
I20260709 13:08:22.681794 16200 raft_consensus.cc:2955] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index 10 to 11, VOTER 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
W20260709 13:08:22.712929 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 64002.1us
I20260709 13:08:22.726804 16948 raft_consensus.cc:2468] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 17.
W20260709 13:08:22.727913 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 67292.8us
I20260709 13:08:22.729193 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:22.677624 22813 raft_consensus.cc:2955] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 15 LEADER]: Committing config change with OpId 15.11: config changed from index 10 to 11, VOTER 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
W20260709 13:08:22.758585 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 45315.5us
I20260709 13:08:22.713826 22881 consensus_queue.cc:1048] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.031s
W20260709 13:08:22.798302 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 134124us
I20260709 13:08:22.755798 22942 raft_consensus.cc:493] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:22.800447 22986 log.cc:927] Time spent T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
W20260709 13:08:22.815734 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 74402.4us
W20260709 13:08:22.826244 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 63793.9us
I20260709 13:08:22.836354 16199 raft_consensus.cc:1275] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 20 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:08:22.868288 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbc1db111e7466090abdb97a79d0d9b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: true dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:22.869043 16279 raft_consensus.cc:3055] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:22.869415 16279 raft_consensus.cc:740] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:08:22.823276 22942 raft_consensus.cc:515] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:08:22.877676 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 50690.8us
W20260709 13:08:22.878908 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 46572.3us
W20260709 13:08:22.880383 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 123627us
I20260709 13:08:22.880203 16279 consensus_queue.cc:260] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:22.858099 22971 raft_consensus.cc:493] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:22.888012 22936 consensus_queue.cc:1048] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.023s
W20260709 13:08:22.912492 22996 log.cc:927] Time spent T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:08:22.914500 16279 raft_consensus.cc:3060] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:22.928156 22942 leader_election.cc:290] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:22.880038 22672 consensus_queue.cc:1048] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.102s
I20260709 13:08:22.930878 22927 raft_consensus.cc:493] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:22.931529 22927 raft_consensus.cc:515] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:08:22.955157 16246 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:22.956661 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:22.957397 16277 raft_consensus.cc:2468] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 21.
W20260709 13:08:22.961606 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 75364.3us
W20260709 13:08:22.964283 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 290996us
W20260709 13:08:22.954036 22771 log.cc:927] Time spent T 5c2f49b7f95a4153b2d180218e6af1db P 1109f76a0b7b443a84c0327c8707bc63: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:08:22.934024 22927 leader_election.cc:290] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:22.965427 16914 leader_election.cc:304] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:08:22.981657 16279 raft_consensus.cc:2468] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 17.
W20260709 13:08:22.982384 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 103888us
I20260709 13:08:22.985652 16248 leader_election.cc:304] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:22.990765 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:22.990684 16248 leader_election.cc:304] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:22.983999 22927 raft_consensus.cc:2804] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:08:22.996201 22972 raft_consensus.cc:2749] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:08:22.972108 22971 raft_consensus.cc:515] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:23.000327 16248 leader_election.cc:304] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:23.001765 16248 leader_election.cc:304] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:23.002064 22759 raft_consensus.cc:2749] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:23.005503 22626 raft_consensus.cc:2749] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:08:23.007694 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:22.994081 22927 raft_consensus.cc:493] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:23.019037 22927 raft_consensus.cc:3060] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:23.021867 16282 raft_consensus.cc:1275] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 21 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:08:23.028301 22971 leader_election.cc:290] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:23.030624 22813 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:51696 (request call id 3) took 1137 ms. Trace:
I20260709 13:08:23.031656 22813 rpcz_store.cc:276] 0709 13:08:21.893177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:21.893359 (+   182us) service_pool.cc:224] Handling call
0709 13:08:21.965023 (+ 71664us) log.cc:844] Serialized 501 byte log entry
0709 13:08:22.256194 (+291171us) spinlock_profiling.cc:243] Waited 1.47 ms on lock 0x7b18001e0ee0. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f3625264de1 00007f36252715b1 00007f361c39c3f3 00007f361c39e7c1 00007f361c39e779 00007f361c39e709 00007f361c39e6d1 00007f361c39d9cd 000000000038f354 000000000038f199 00007f361c37f83a
0709 13:08:22.335391 (+ 79197us) spinlock_profiling.cc:243] Waited 10.8 ms on lock 0x7b18001e0ee0. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f3625264de1 00007f36252715b1 00007f361c39c522 00007f361c39e7c1 00007f361c39e779 00007f361c39e709 00007f361c39e6d1 00007f361c39d9cd 000000000038f354 000000000038f199 00007f361c37f83a
0709 13:08:23.030507 (+695116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5264,"raft.queue_time_us":9443,"raft.run_cpu_time_us":1944,"raft.run_wall_time_us":40665,"spinlock_wait_cycles":28205568,"thread_start_us":206025,"threads_started":1,"wal-append.queue_time_us":250681}
I20260709 13:08:23.037333 23002 raft_consensus.cc:2749] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:08:23.041483 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 48171.6us
W20260709 13:08:23.070773 22771 log.cc:927] Time spent T 5c2f49b7f95a4153b2d180218e6af1db P 1109f76a0b7b443a84c0327c8707bc63: Append to log took a long time: real 0.052s	user 0.003s	sys 0.001s
I20260709 13:08:23.080155 16092 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 540bfc4ad793452faea5b865343aacf7 with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:23.087159 22875 raft_consensus.cc:493] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:23.106282 22875 raft_consensus.cc:515] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:23.108603 22875 leader_election.cc:290] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:23.137146 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:23.137355 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:23.137904 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:23.140000 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:23.148684 16352 raft_consensus.cc:1275] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:08:23.152560 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:23.168738 23000 consensus_queue.cc:1048] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:08:23.171128 16322 leader_election.cc:304] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:23.172192 23000 raft_consensus.cc:2749] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:23.173732 16322 leader_election.cc:304] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:23.174654 22677 raft_consensus.cc:2749] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:23.182047 16322 leader_election.cc:304] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:08:23.183265 16322 leader_election.cc:304] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:23.209403 16201 raft_consensus.cc:1275] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
W20260709 13:08:23.208940 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 90167.6us
I20260709 13:08:23.213351 16322 leader_election.cc:304] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:23.218873 23008 raft_consensus.cc:493] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:23.219535 23008 raft_consensus.cc:515] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:08:23.221355 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 85033.7us
I20260709 13:08:23.222930 16322 leader_election.cc:304] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:23.187413 23000 raft_consensus.cc:2804] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:23.217425 22940 raft_consensus.cc:493] T 540bfc4ad793452faea5b865343aacf7 P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:23.226693 22940 raft_consensus.cc:515] T 540bfc4ad793452faea5b865343aacf7 P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:23.229801 22940 leader_election.cc:290] T 540bfc4ad793452faea5b865343aacf7 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:23.231747 22429 raft_consensus.cc:2749] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:23.238528 22927 raft_consensus.cc:515] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:23.240374 16947 raft_consensus.cc:2393] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 22: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
I20260709 13:08:23.241041 22927 leader_election.cc:290] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 22 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:23.197693 22813 raft_consensus.cc:2749] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:08:23.259385 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:23.257405 22932 raft_consensus.cc:2749] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:23.270723 22883 raft_consensus.cc:493] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:23.271463 22883 raft_consensus.cc:515] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:23.273772 22883 leader_election.cc:290] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:23.277779 22923 consensus_queue.cc:1048] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:23.278055 23007 consensus_queue.cc:1048] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 13:08:23.280287 23008 leader_election.cc:290] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:23.280827 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:23.283011 22759 raft_consensus.cc:493] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:23.283699 22759 raft_consensus.cc:515] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:23.286787 22942 raft_consensus.cc:493] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:23.287518 22942 raft_consensus.cc:515] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:23.290977 22753 raft_consensus.cc:493] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:23.291647 22753 raft_consensus.cc:515] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:23.292336 22942 leader_election.cc:290] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:23.292927 22972 raft_consensus.cc:493] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:23.293547 22972 raft_consensus.cc:515] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:23.303530 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:23.304239 16281 raft_consensus.cc:2468] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 15.
I20260709 13:08:23.304741 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:23.300210 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:23.305364 16280 raft_consensus.cc:3060] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:23.305621 16276 raft_consensus.cc:2468] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 18.
I20260709 13:08:23.306449 22672 raft_consensus.cc:493] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:23.307085 22672 raft_consensus.cc:515] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:23.263962 23000 raft_consensus.cc:697] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 17 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:08:23.309885 22672 leader_election.cc:290] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:23.293910 22753 leader_election.cc:290] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:23.314304 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:23.317628 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:23.319712 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:23.318393 16947 raft_consensus.cc:2468] T 540bfc4ad793452faea5b865343aacf7 P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 15.
I20260709 13:08:23.323082 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:23.325064 16280 raft_consensus.cc:2468] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 22.
I20260709 13:08:23.328405 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:23.329170 16355 raft_consensus.cc:1275] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:08:23.330067 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:23.323726 16354 raft_consensus.cc:2376] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 21 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 21. Re-sending same reply.
I20260709 13:08:23.310393 23000 consensus_queue.cc:237] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:23.311885 22883 raft_consensus.cc:493] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:23.333491 22883 raft_consensus.cc:515] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:23.314872 22759 leader_election.cc:290] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:23.335829 22883 leader_election.cc:290] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:23.316396 22942 raft_consensus.cc:493] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:23.337447 22942 raft_consensus.cc:515] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:08:23.339850 22942 leader_election.cc:290] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:23.344175 23012 raft_consensus.cc:493] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:08:23.344919 23012 raft_consensus.cc:515] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:23.345335 22756 raft_consensus.cc:493] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:08:23.345970 22756 raft_consensus.cc:515] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:23.324872 22753 raft_consensus.cc:493] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:23.347128 22753 raft_consensus.cc:515] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:23.347587 23012 leader_election.cc:290] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:23.344167 22972 leader_election.cc:290] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:23.348361 22756 leader_election.cc:290] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:23.349407 22753 leader_election.cc:290] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:23.354483 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:23.357395 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:23.361119 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:23.368692 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:23.372473 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:23.369451 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:23.380267 16173 leader_election.cc:304] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:23.381325 22987 raft_consensus.cc:2804] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:23.381752 22987 raft_consensus.cc:493] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:23.382141 22987 raft_consensus.cc:3060] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:23.382710 16914 leader_election.cc:304] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:23.384442 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:23.386168 23008 raft_consensus.cc:2749] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:23.392266 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:23.398037 16914 leader_election.cc:304] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:08:23.401255 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:23.403399 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:23.408484 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:23.406297 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c15d8e9be8414c84912ab77b66bfb1" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:23.415004 23008 raft_consensus.cc:2804] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:08:23.415701 23008 raft_consensus.cc:697] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 22 LEADER]: Becoming Leader. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:08:23.416652 23008 consensus_queue.cc:237] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:23.417758 22771 tablet_bootstrap.cc:492] T 5c2f49b7f95a4153b2d180218e6af1db P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=1 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:23.418886 22771 tablet_bootstrap.cc:492] T 5c2f49b7f95a4153b2d180218e6af1db P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap complete.
I20260709 13:08:23.419687 22771 ts_tablet_manager.cc:1403] T 5c2f49b7f95a4153b2d180218e6af1db P 1109f76a0b7b443a84c0327c8707bc63: Time spent bootstrapping tablet: real 1.967s	user 0.088s	sys 0.052s
I20260709 13:08:23.423106 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:23.426126 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:23.428084 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:23.432688 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:23.433369 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:23.435345 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c15d8e9be8414c84912ab77b66bfb1" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:23.435422 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:23.438958 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:23.439786 22987 raft_consensus.cc:515] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:23.449554 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:23.460175 22813 raft_consensus.cc:493] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.461138 22813 raft_consensus.cc:515] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:23.466765 22813 leader_election.cc:290] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:23.485535 16173 leader_election.cc:304] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:08:23.486826 16914 leader_election.cc:304] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:23.488654 22875 raft_consensus.cc:2749] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:23.489957 22809 raft_consensus.cc:2749] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:23.403457 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:23.491544 22875 consensus_queue.cc:1048] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:23.521302 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:23.529415 16914 leader_election.cc:304] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:23.531184 22809 raft_consensus.cc:2749] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:23.535984 16282 raft_consensus.cc:1275] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:08:23.541851 16102 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55244 (request call id 135) took 4426 ms. Trace:
I20260709 13:08:23.543619 22942 raft_consensus.cc:493] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.586385 22942 raft_consensus.cc:515] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:23.588888 22942 leader_election.cc:290] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:08:23.548856 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 49536.1us
I20260709 13:08:23.550902 16944 raft_consensus.cc:1240] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 22 LEADER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 21. Current term is 22. Ops: []
I20260709 13:08:23.553836 22756 raft_consensus.cc:493] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:08:23.604570 22756 raft_consensus.cc:515] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:23.608283 22756 leader_election.cc:290] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:23.558285 22987 leader_election.cc:290] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 19 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:23.486949 22771 raft_consensus.cc:359] T 5c2f49b7f95a4153b2d180218e6af1db P 1109f76a0b7b443a84c0327c8707bc63 [term 20 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:08:23.618383 22771 raft_consensus.cc:740] T 5c2f49b7f95a4153b2d180218e6af1db P 1109f76a0b7b443a84c0327c8707bc63 [term 20 LEARNER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Initialized, Role: LEARNER
I20260709 13:08:23.619495 22771 consensus_queue.cc:260] T 5c2f49b7f95a4153b2d180218e6af1db P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:08:23.576259 16248 leader_election.cc:304] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:08:23.627357 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 51204.7us
I20260709 13:08:23.585537 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:23.571492 16947 raft_consensus.cc:2955] T 540bfc4ad793452faea5b865343aacf7 P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index 10 to 11, VOTER 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:08:23.629451 16248 leader_election.cc:304] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:08:23.630589 22947 raft_consensus.cc:2749] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:23.633378 22947 consensus_queue.cc:1048] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:23.634779 22972 raft_consensus.cc:2749] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:08:23.570573 16104 catalog_manager.cc:5697] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 17 to 19, leader changed from e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) to 363bb2f744eb486f9ad726f08214c98e (127.14.180.67). New cstate: current_term: 19 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } }
I20260709 13:08:23.672392 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:23.674259 16248 leader_election.cc:304] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:23.681555 22947 raft_consensus.cc:2749] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:23.705654 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:23.711658 22771 ts_tablet_manager.cc:1434] T 5c2f49b7f95a4153b2d180218e6af1db P 1109f76a0b7b443a84c0327c8707bc63: Time spent starting tablet: real 0.292s	user 0.010s	sys 0.000s
I20260709 13:08:23.679243 16104 catalog_manager.cc:5697] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 17 to 21, leader changed from e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) to 363bb2f744eb486f9ad726f08214c98e (127.14.180.67). New cstate: current_term: 21 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } }
I20260709 13:08:23.721509 16104 catalog_manager.cc:5697] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 14 to 18, leader changed from e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) to 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66). New cstate: current_term: 18 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:23.703760 16248 leader_election.cc:304] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:23.725111 16104 catalog_manager.cc:5697] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 10 to 14, leader changed from 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) to e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65). New cstate: current_term: 14 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } }
I20260709 13:08:23.732098 16104 catalog_manager.cc:5697] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 14 to 16, leader changed from 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) to 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66). New cstate: current_term: 16 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:23.742697 23019 raft_consensus.cc:2749] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:08:23.744765 16248 leader_election.cc:304] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:23.745595 23019 raft_consensus.cc:2749] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:23.746191 16104 catalog_manager.cc:5697] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 11 to 12, leader changed from 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) to e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65). New cstate: current_term: 12 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } }
I20260709 13:08:23.752913 16104 catalog_manager.cc:5697] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 12 to 15. New cstate: current_term: 15 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:23.763696 16104 catalog_manager.cc:5697] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 14 to 16, leader changed from e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) to 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66). New cstate: current_term: 16 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:23.778461 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:23.665565 16102 rpcz_store.cc:276] 0709 13:08:19.115114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:19.118488 (+  3374us) service_pool.cc:224] Handling call
0709 13:08:23.541760 (+4423272us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:22.761863 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:22.762490 (+   627us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:22.762540 (+    50us) write_op.cc:435] Acquired schema lock
0709 13:08:22.762586 (+    46us) tablet.cc:662] Decoding operations
0709 13:08:22.763842 (+  1256us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:22.763960 (+   118us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:22.763997 (+    37us) tablet.cc:685] Acquiring locks for 12 operations
0709 13:08:22.858794 (+ 94797us) tablet.cc:701] Row locks acquired
0709 13:08:22.868437 (+  9643us) write_op.cc:260] PREPARE: finished
0709 13:08:22.882039 (+ 13602us) write_op.cc:270] Start()
0709 13:08:22.922635 (+ 40596us) write_op.cc:276] Timestamp: P: 1783602502878640 usec, L: 0
0709 13:08:22.922663 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 13:08:22.923314 (+   651us) log.cc:844] Serialized 4813 byte log entry
0709 13:08:23.245134 (+321820us) op_driver.cc:464] REPLICATION: finished
0709 13:08:23.283391 (+ 38257us) write_op.cc:301] APPLY: starting
0709 13:08:23.283478 (+    87us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:23.364301 (+ 80823us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:23.364423 (+   122us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:23.413863 (+ 49440us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:23.414098 (+   235us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=24,key_file_lookups=24,delta_file_lookups=24,mrs_lookups=0
0709 13:08:23.414140 (+    42us) write_op.cc:312] APPLY: finished
0709 13:08:23.414460 (+   320us) log.cc:844] Serialized 113 byte log entry
0709 13:08:23.499352 (+ 84892us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:23.499500 (+   148us) write_op.cc:454] Released schema lock
0709 13:08:23.499558 (+    58us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:23.499992 (+   434us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:23.500024 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":208938,"reported_tablets":17,"spinlock_wait_cycles":28032,"child_traces":[["op",{"apply.queue_time_us":38003,"apply.run_cpu_time_us":19114,"apply.run_wall_time_us":216559,"cfile_cache_hit":50,"cfile_cache_hit_bytes":54287,"num_ops":12,"prepare.queue_time_us":150731,"prepare.run_cpu_time_us":17600,"prepare.run_wall_time_us":226959,"raft.queue_time_us":146134,"raft.run_cpu_time_us":5781,"raft.run_wall_time_us":23340,"replication_time_us":322302,"thread_start_us":314135,"threads_started":4,"wal-append.queue_time_us":100985}]]}
I20260709 13:08:23.770780 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:23.775817 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:23.779588 16104 catalog_manager.cc:5697] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 15 to 19. New cstate: current_term: 19 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } }
I20260709 13:08:23.781728 16104 catalog_manager.cc:5697] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "1109f76a0b7b443a84c0327c8707bc63" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:08:23.748131 16248 leader_election.cc:304] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:23.795289 23019 raft_consensus.cc:2749] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:23.794839 16104 catalog_manager.cc:5697] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 18 to 22, leader changed from 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) to 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66). New cstate: current_term: 22 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } }
W20260709 13:08:23.796387 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 48358.7us
I20260709 13:08:23.801944 16248 leader_election.cc:304] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:23.797851 16104 catalog_manager.cc:5697] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 18 to 20, leader changed from e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) to 363bb2f744eb486f9ad726f08214c98e (127.14.180.67). New cstate: current_term: 20 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } }
I20260709 13:08:23.814627 16367 tablet_copy_service.cc:342] P 363bb2f744eb486f9ad726f08214c98e: Request end of tablet copy session 1109f76a0b7b443a84c0327c8707bc63-5c2f49b7f95a4153b2d180218e6af1db received from {username='slave'} at 127.0.0.1:33486
I20260709 13:08:23.815281 16367 tablet_copy_service.cc:434] P 363bb2f744eb486f9ad726f08214c98e: ending tablet copy session 1109f76a0b7b443a84c0327c8707bc63-5c2f49b7f95a4153b2d180218e6af1db on tablet 5c2f49b7f95a4153b2d180218e6af1db with peer 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:08:23.816365 23019 raft_consensus.cc:2749] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:23.803607 16104 catalog_manager.cc:5697] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 15 to 18, leader changed from 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) to e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65). New cstate: current_term: 18 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } }
I20260709 13:08:23.819078 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:23.819185 16248 leader_election.cc:304] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:23.826038 23019 raft_consensus.cc:2749] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:23.829071 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:23.834234 16104 catalog_manager.cc:5697] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: config changed from index -1 to 11, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New cstate: current_term: 20 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:08:23.839694 16104 catalog_manager.cc:5697] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } }
I20260709 13:08:23.840885 16248 leader_election.cc:304] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:23.849742 16104 catalog_manager.cc:5697] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 14 to 15, leader changed from 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) to 363bb2f744eb486f9ad726f08214c98e (127.14.180.67). New cstate: current_term: 15 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } }
I20260709 13:08:23.851384 16104 catalog_manager.cc:5697] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:23.834506 23000 consensus_queue.cc:1048] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.005s
I20260709 13:08:23.854759 22753 raft_consensus.cc:2749] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:08:23.903206 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 48986.9us
W20260709 13:08:23.911077 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 52220.1us
W20260709 13:08:23.925318 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 82323.3us
I20260709 13:08:23.949656 16279 raft_consensus.cc:1275] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 22 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:08:23.961881 22809 consensus_queue.cc:1048] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:08:23.969995 23033 consensus_queue.cc:1048] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:23.979558 16322 leader_election.cc:304] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:23.989940 16322 leader_election.cc:304] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:23.991611 23034 raft_consensus.cc:2749] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:23.994251 23034 raft_consensus.cc:2749] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:24.011970 16248 leader_election.cc:304] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:24.013376 23019 raft_consensus.cc:2749] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:24.014468 16248 leader_election.cc:304] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:24.016911 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:24.018911 16248 leader_election.cc:304] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:24.021252 16248 leader_election.cc:304] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:24.024984 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:24.023913 22753 raft_consensus.cc:2749] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:24.020416 23019 raft_consensus.cc:2749] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:24.026486 16948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "862e96f5785248c58d0355cac229fc05" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:24.030412 16914 leader_election.cc:304] T 540bfc4ad793452faea5b865343aacf7 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:24.034842 16280 raft_consensus.cc:1275] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:08:24.035691 16948 raft_consensus.cc:1275] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [term 17 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:08:24.037191 23008 raft_consensus.cc:2749] T 540bfc4ad793452faea5b865343aacf7 P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:24.038905 23034 raft_consensus.cc:493] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:08:24.039492 23034 raft_consensus.cc:515] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:24.034507 23019 raft_consensus.cc:2749] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:24.041712 23034 leader_election.cc:290] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:24.043813 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:24.070945 16173 leader_election.cc:304] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:08:24.115056 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:24.120177 16280 raft_consensus.cc:1240] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 22 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 21. Current term is 22. Ops: [21.16-21.16]
I20260709 13:08:24.128016 16204 raft_consensus.cc:1240] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 19 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 18. Current term is 19. Ops: []
W20260709 13:08:24.129492 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 58696.8us
I20260709 13:08:24.140307 22875 raft_consensus.cc:2749] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:08:24.138377 23034 consensus_queue.cc:1059] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.027s
I20260709 13:08:24.164901 23034 consensus_queue.cc:1243] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer 1109f76a0b7b443a84c0327c8707bc63 log is divergent from this leader: its last log entry 22.16 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 15
I20260709 13:08:24.165489 23034 raft_consensus.cc:3055] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:08:24.165863 23034 raft_consensus.cc:740] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:08:24.168918 22936 consensus_queue.cc:1059] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:08:24.170341 22936 raft_consensus.cc:3055] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:08:24.170770 22936 raft_consensus.cc:740] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:08:24.171762 22936 consensus_queue.cc:260] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:24.188525 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:24.192457 16248 leader_election.cc:304] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:24.215083 16948 raft_consensus.cc:1217] T 5c2f49b7f95a4153b2d180218e6af1db P 1109f76a0b7b443a84c0327c8707bc63 [term 20 LEARNER]: Deduplicated request from leader. Original: 20.10->[20.11-20.11]   Dedup: 20.11->[]
I20260709 13:08:24.173255 22936 raft_consensus.cc:3060] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:24.218822 23036 raft_consensus.cc:2749] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:24.210734 23012 consensus_queue.cc:1048] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.049s
I20260709 13:08:24.244397 23034 consensus_queue.cc:260] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:24.246102 23034 raft_consensus.cc:3060] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:08:24.257076 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 100059us
I20260709 13:08:24.257892 16322 leader_election.cc:304] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:24.275878 15057 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:08:24.280084 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 60195.1us
I20260709 13:08:24.292745 16322 leader_election.cc:304] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:08:24.291322 23000 raft_consensus.cc:2749] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:24.298062 23000 raft_consensus.cc:2749] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:24.307901 23000 consensus_queue.cc:1048] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:08:24.305714 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 44356.7us
W20260709 13:08:24.326776 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 45801.1us
I20260709 13:08:24.400388 16349 raft_consensus.cc:1275] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 22 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 22 index: 16. (term mismatch)
I20260709 13:08:24.400971 16349 pending_rounds.cc:85] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e: Aborting all ops after (but not including) 15
I20260709 13:08:24.401278 16349 pending_rounds.cc:107] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e: Aborting uncommitted NO_OP operation due to leader change: 21.16
I20260709 13:08:24.402935 16349 raft_consensus.cc:2889] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:08:24.419034 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 59708.9us
I20260709 13:08:24.419361 16322 leader_election.cc:304] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:24.429384 23034 raft_consensus.cc:2749] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:24.448714 23008 consensus_queue.cc:1048] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 13:08:24.594391 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 65244.3us
I20260709 13:08:24.686204 16102 catalog_manager.cc:5697] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: term changed from 14 to 17, leader changed from 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) to e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65). New cstate: current_term: 17 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:08:24.692340 16102 catalog_manager.cc:5697] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: term changed from 14 to 15, leader changed from e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) to 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66). New cstate: current_term: 15 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:08:24.693715 16102 catalog_manager.cc:5697] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "1109f76a0b7b443a84c0327c8707bc63" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:24.695006 16102 catalog_manager.cc:5697] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: term changed from 19 to 22. New cstate: current_term: 22 leader_uuid: "1109f76a0b7b443a84c0327c8707bc63" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:24.696497 16102 catalog_manager.cc:5697] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: term changed from 10 to 14, leader changed from e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) to 363bb2f744eb486f9ad726f08214c98e (127.14.180.67). New cstate: current_term: 14 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:08:24.698377 16102 catalog_manager.cc:5697] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: term changed from 11 to 13, leader changed from 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) to 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66). New cstate: current_term: 13 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:08:24.716077 16102 catalog_manager.cc:5697] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:08:24.717844 16102 catalog_manager.cc:5697] T 540bfc4ad793452faea5b865343aacf7 P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: config changed from index 10 to 11, VOTER 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) evicted. New cstate: current_term: 15 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:08:24.728443 16102 catalog_manager.cc:5697] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:08:24.746129 16104 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38840 (request call id 209) took 6367 ms. Trace:
I20260709 13:08:24.753845 16355 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d"
dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
mode: GRACEFUL
new_leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
 from {username='slave'} at 127.0.0.1:56792
I20260709 13:08:24.754664 16355 raft_consensus.cc:606] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 19 LEADER]: Received request to transfer leadership to TS 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:08:24.756829 22756 raft_consensus.cc:1064] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e: attempting to promote NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 to VOTER
I20260709 13:08:24.760232 22756 consensus_queue.cc:237] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 9, Current term: 20, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:24.746565 16104 rpcz_store.cc:276] 0709 13:08:18.378711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:18.378926 (+   215us) service_pool.cc:224] Handling call
0709 13:08:24.746065 (+6367139us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:23.988256 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:23.989041 (+   785us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:23.989076 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:08:23.989121 (+    45us) tablet.cc:662] Decoding operations
0709 13:08:24.094470 (+105349us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:24.094585 (+   115us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:24.094612 (+    27us) tablet.cc:685] Acquiring locks for 17 operations
0709 13:08:24.095903 (+  1291us) tablet.cc:701] Row locks acquired
0709 13:08:24.095925 (+    22us) write_op.cc:260] PREPARE: finished
0709 13:08:24.096072 (+   147us) write_op.cc:270] Start()
0709 13:08:24.096201 (+   129us) write_op.cc:276] Timestamp: P: 1783602504096027 usec, L: 0
0709 13:08:24.096224 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:08:24.096960 (+   736us) log.cc:844] Serialized 6798 byte log entry
0709 13:08:24.308974 (+212014us) op_driver.cc:464] REPLICATION: finished
0709 13:08:24.423516 (+114542us) spinlock_profiling.cc:243] Waited 2.14 ms on lock 0x7b54001375a8. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f36258459e1 00007f362584464c 00007f3622ec0845 00007f3622ec4d61 00007f3622ec4d19 00007f3622ec4ca9 00007f3622ec4c71 00007f3622ec3e9d 000000000038f354 000000000038f199 00007f361c39c475
0709 13:08:24.423616 (+   100us) write_op.cc:301] APPLY: starting
0709 13:08:24.423724 (+   108us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:24.549718 (+125994us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:24.549739 (+    21us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:24.581366 (+ 31627us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:24.581646 (+   280us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=34,key_file_lookups=34,delta_file_lookups=34,mrs_lookups=0
0709 13:08:24.581692 (+    46us) write_op.cc:312] APPLY: finished
0709 13:08:24.582064 (+   372us) log.cc:844] Serialized 156 byte log entry
0709 13:08:24.594418 (+ 12354us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:24.604917 (+ 10499us) write_op.cc:454] Released schema lock
0709 13:08:24.611970 (+  7053us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:24.629459 (+ 17489us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:24.629508 (+    49us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":326729,"reported_tablets":36,"child_traces":[["op",{"apply.queue_time_us":85789,"apply.run_cpu_time_us":31804,"apply.run_wall_time_us":234345,"cfile_cache_hit":70,"cfile_cache_hit_bytes":75187,"num_ops":17,"prepare.queue_time_us":51780,"prepare.run_cpu_time_us":5913,"prepare.run_wall_time_us":109033,"replication_time_us":212567,"spinlock_wait_cycles":4920704,"thread_start_us":71385,"threads_started":2}]]}
I20260709 13:08:24.767144 22936 raft_consensus.cc:993] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e: : Instructing follower 0aea40d6e4374085a2e38a70a71f63e3 to start an election
I20260709 13:08:24.767729 22936 raft_consensus.cc:1081] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 19 LEADER]: Signalling peer 0aea40d6e4374085a2e38a70a71f63e3 to start an election
I20260709 13:08:24.791134 16283 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d"
dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
 from {username='slave'} at 127.0.0.1:45210
I20260709 13:08:24.791826 16283 raft_consensus.cc:493] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:24.792376 16283 raft_consensus.cc:3060] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:24.800292 16278 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aee913c41fb9437587affa768953f637"
dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
mode: GRACEFUL
new_leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
 from {username='slave'} at 127.0.0.1:39058
I20260709 13:08:24.801003 16278 raft_consensus.cc:606] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Received request to transfer leadership to TS e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:24.801913 16278 raft_consensus.cc:614] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:24.810400 16283 raft_consensus.cc:515] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:24.821382 16283 leader_election.cc:290] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 20 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:24.820567 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: true dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:08:24.823311 16203 raft_consensus.cc:3060] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:24.824652 16356 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece"
dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
mode: GRACEFUL
new_leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
 from {username='slave'} at 127.0.0.1:56792
I20260709 13:08:24.825294 16356 raft_consensus.cc:606] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Received request to transfer leadership to TS 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:08:24.825625 16356 raft_consensus.cc:614] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:24.828167 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: true dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:24.828841 16354 raft_consensus.cc:3055] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:08:24.829097 16354 raft_consensus.cc:740] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:08:24.830451 16354 consensus_queue.cc:260] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:24.832568 16354 raft_consensus.cc:3060] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:24.831089 15057 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:08:24.835408 15057 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:24.850600 16354 raft_consensus.cc:2468] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 20.
I20260709 13:08:24.851351 16203 raft_consensus.cc:2468] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 20.
I20260709 13:08:24.853425 16246 leader_election.cc:304] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:24.856063 22942 raft_consensus.cc:2804] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:08:24.856600 22942 raft_consensus.cc:697] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:08:24.857518 22942 consensus_queue.cc:237] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:24.882474 16270 tablet_service.cc:1558] Processing DeleteTablet for tablet 540bfc4ad793452faea5b865343aacf7 with delete_type TABLET_DATA_TOMBSTONED (TS 0aea40d6e4374085a2e38a70a71f63e3 not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:45374
I20260709 13:08:24.882958 16944 raft_consensus.cc:1275] T 5c2f49b7f95a4153b2d180218e6af1db P 1109f76a0b7b443a84c0327c8707bc63 [term 20 LEARNER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:08:24.886451 23056 consensus_queue.cc:1048] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:24.891084 16278 raft_consensus.cc:1275] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:08:24.897287 23056 consensus_queue.cc:1048] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:24.902699 16203 raft_consensus.cc:1275] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 20 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:08:24.906792 22756 consensus_queue.cc:1048] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:24.938483 16102 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55244 (request call id 136) took 1057 ms. Trace:
I20260709 13:08:24.938988 16102 rpcz_store.cc:276] 0709 13:08:23.838175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:23.838384 (+   209us) service_pool.cc:224] Handling call
0709 13:08:24.895154 (+1056770us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:24.760689 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:24.770392 (+  9703us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:24.770431 (+    39us) write_op.cc:435] Acquired schema lock
0709 13:08:24.770450 (+    19us) tablet.cc:662] Decoding operations
0709 13:08:24.771620 (+  1170us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:24.771715 (+    95us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:24.771750 (+    35us) tablet.cc:685] Acquiring locks for 9 operations
0709 13:08:24.772569 (+   819us) tablet.cc:701] Row locks acquired
0709 13:08:24.772585 (+    16us) write_op.cc:260] PREPARE: finished
0709 13:08:24.772745 (+   160us) write_op.cc:270] Start()
0709 13:08:24.772869 (+   124us) write_op.cc:276] Timestamp: P: 1783602504772693 usec, L: 0
0709 13:08:24.772889 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:08:24.773783 (+   894us) log.cc:844] Serialized 3601 byte log entry
0709 13:08:24.776313 (+  2530us) op_driver.cc:464] REPLICATION: finished
0709 13:08:24.776830 (+   517us) write_op.cc:301] APPLY: starting
0709 13:08:24.776918 (+    88us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:24.781975 (+  5057us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:24.782074 (+    99us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:24.813324 (+ 31250us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:24.813526 (+   202us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=18,key_file_lookups=18,delta_file_lookups=18,mrs_lookups=0
0709 13:08:24.813568 (+    42us) write_op.cc:312] APPLY: finished
0709 13:08:24.813857 (+   289us) log.cc:844] Serialized 89 byte log entry
0709 13:08:24.829610 (+ 15753us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:24.832577 (+  2967us) write_op.cc:454] Released schema lock
0709 13:08:24.860173 (+ 27596us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:24.860566 (+   393us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:24.860598 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":21362,"reported_tablets":15,"spinlock_wait_cycles":5760,"child_traces":[["op",{"apply.queue_time_us":279,"apply.run_cpu_time_us":12381,"apply.run_wall_time_us":83687,"cfile_cache_hit":36,"cfile_cache_hit_bytes":37620,"num_ops":9,"prepare.queue_time_us":18152,"prepare.run_cpu_time_us":4475,"prepare.run_wall_time_us":13404,"replication_time_us":3264,"thread_start_us":36910,"threads_started":1}]]}
I20260709 13:08:24.963673 23070 tablet_replica.cc:333] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3: stopping tablet replica
I20260709 13:08:24.965164 23070 raft_consensus.cc:2243] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:24.971154 16103 catalog_manager.cc:5697] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f reported cstate change: term changed from 14 to 17, leader changed from 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) to e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65). New cstate: current_term: 17 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:24.966421 23070 raft_consensus.cc:2272] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:24.997049 23070 ts_tablet_manager.cc:1916] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:25.017584 16103 catalog_manager.cc:5697] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f reported cstate change: term changed from 11 to 14, leader changed from e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) to 363bb2f744eb486f9ad726f08214c98e (127.14.180.67). New cstate: current_term: 14 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } }
I20260709 13:08:25.019768 16103 catalog_manager.cc:5697] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f reported cstate change: term changed from 16 to 19. New cstate: current_term: 19 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } }
I20260709 13:08:25.025202 16103 catalog_manager.cc:5697] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } }
I20260709 13:08:25.026872 16103 catalog_manager.cc:5697] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f reported cstate change: term changed from 7 to 9, leader changed from e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) to 363bb2f744eb486f9ad726f08214c98e (127.14.180.67). New cstate: current_term: 9 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } }
I20260709 13:08:25.067363 22813 raft_consensus.cc:2955] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 20 LEADER]: Committing config change with OpId 20.12: config changed from index 11 to 12, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:08:25.082532 16944 raft_consensus.cc:2955] T 5c2f49b7f95a4153b2d180218e6af1db P 1109f76a0b7b443a84c0327c8707bc63 [term 20 FOLLOWER]: Committing config change with OpId 20.12: config changed from index 11 to 12, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:08:25.099248 16102 catalog_manager.cc:5697] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: term changed from 16 to 17, leader changed from 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) to 363bb2f744eb486f9ad726f08214c98e (127.14.180.67). New cstate: current_term: 17 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:08:25.126178 16283 raft_consensus.cc:2955] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Committing config change with OpId 20.12: config changed from index 11 to 12, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:08:25.129740 23070 ts_tablet_manager.cc:1929] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 15.10
I20260709 13:08:25.154707 23070 log.cc:1199] T 540bfc4ad793452faea5b865343aacf7 P 0aea40d6e4374085a2e38a70a71f63e3: Deleting WAL directory at /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602283040513-15057-0/minicluster-data/ts-1-root/wals/540bfc4ad793452faea5b865343aacf7
I20260709 13:08:25.146013 16104 catalog_manager.cc:5697] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } }
I20260709 13:08:25.160590 16104 catalog_manager.cc:5697] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 16 to 18, leader changed from 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) to 363bb2f744eb486f9ad726f08214c98e (127.14.180.67). New cstate: current_term: 18 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } }
I20260709 13:08:25.163074 16104 catalog_manager.cc:5697] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 9 to 13, leader changed from 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) to 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66). New cstate: current_term: 13 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:25.164801 16104 catalog_manager.cc:5697] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } }
I20260709 13:08:25.166086 16104 catalog_manager.cc:5697] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:25.168336 16092 catalog_manager.cc:5028] TS 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): tablet 540bfc4ad793452faea5b865343aacf7 (table test-workload [id=f364cfe226234c5b99453e3013c8717e]) successfully deleted
I20260709 13:08:25.167564 16104 catalog_manager.cc:5697] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 15 to 20, leader changed from 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) to 363bb2f744eb486f9ad726f08214c98e (127.14.180.67). New cstate: current_term: 20 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } }
I20260709 13:08:25.175961 16191 tablet_service.cc:1558] Processing DeleteTablet for tablet 4b962ceebb5c48c1914459ae0c0eff1b with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 10 (current committed config index is 11)) from {username='slave'} at 127.0.0.1:44830
I20260709 13:08:25.184144 16104 catalog_manager.cc:5697] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 13 to 15, leader changed from 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) to 363bb2f744eb486f9ad726f08214c98e (127.14.180.67). New cstate: current_term: 15 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } }
I20260709 13:08:25.191147 16104 catalog_manager.cc:5697] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } }
I20260709 13:08:25.193854 16104 catalog_manager.cc:5697] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 10 to 16, leader changed from e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) to 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66). New cstate: current_term: 16 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:25.197664 16104 catalog_manager.cc:5697] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 17 to 18, leader changed from e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) to 363bb2f744eb486f9ad726f08214c98e (127.14.180.67). New cstate: current_term: 18 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } }
W20260709 13:08:25.200557 16103 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38830 (request call id 232) took 13224 ms (client timeout 15000 ms). Trace:
I20260709 13:08:25.204604 16104 catalog_manager.cc:5697] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 14 to 17, leader changed from 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) to 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66). New cstate: current_term: 17 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } }
W20260709 13:08:25.203944 16103 rpcz_store.cc:269] 0709 13:08:11.975962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:11.976381 (+   419us) service_pool.cc:224] Handling call
0709 13:08:25.200463 (+13224082us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:25.036624 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:25.037464 (+   840us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:25.037510 (+    46us) write_op.cc:435] Acquired schema lock
0709 13:08:25.037534 (+    24us) tablet.cc:662] Decoding operations
0709 13:08:25.038364 (+   830us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:25.038433 (+    69us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:25.038509 (+    76us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:08:25.039326 (+   817us) tablet.cc:701] Row locks acquired
0709 13:08:25.039352 (+    26us) write_op.cc:260] PREPARE: finished
0709 13:08:25.039555 (+   203us) write_op.cc:270] Start()
0709 13:08:25.039706 (+   151us) write_op.cc:276] Timestamp: P: 1783602505039490 usec, L: 0
0709 13:08:25.039736 (+    30us) op_driver.cc:348] REPLICATION: starting
0709 13:08:25.040541 (+   805us) log.cc:844] Serialized 2094 byte log entry
0709 13:08:25.061788 (+ 21247us) op_driver.cc:464] REPLICATION: finished
0709 13:08:25.066930 (+  5142us) write_op.cc:301] APPLY: starting
0709 13:08:25.067021 (+    91us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:25.071990 (+  4969us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:25.072095 (+   105us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:25.075454 (+  3359us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:25.075637 (+   183us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=10,key_file_lookups=10,delta_file_lookups=10,mrs_lookups=0
0709 13:08:25.075682 (+    45us) write_op.cc:312] APPLY: finished
0709 13:08:25.075919 (+   237us) log.cc:844] Serialized 57 byte log entry
0709 13:08:25.076102 (+   183us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:25.076209 (+   107us) write_op.cc:454] Released schema lock
0709 13:08:25.076256 (+    47us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:25.116509 (+ 40253us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:25.116549 (+    40us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":17540,"reported_tablets":50,"child_traces":[["op",{"apply.queue_time_us":156,"apply.run_cpu_time_us":8095,"apply.run_wall_time_us":49535,"cfile_cache_hit":20,"cfile_cache_hit_bytes":20900,"num_ops":5,"prepare.queue_time_us":191,"prepare.run_cpu_time_us":4399,"prepare.run_wall_time_us":13896,"replication_time_us":11838}]]}
I20260709 13:08:25.209551 16200 raft_consensus.cc:2955] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 20 FOLLOWER]: Committing config change with OpId 20.12: config changed from index 11 to 12, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:08:25.219167 16090 catalog_manager.cc:5028] TS e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): tablet 4b962ceebb5c48c1914459ae0c0eff1b (table test-workload [id=f364cfe226234c5b99453e3013c8717e]) successfully deleted
I20260709 13:08:25.221113 16104 catalog_manager.cc:5697] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 10 to 11, leader changed from 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) to e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65). New cstate: current_term: 11 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } }
I20260709 13:08:25.225188 16104 catalog_manager.cc:5697] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 12 to 14, leader changed from 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) to 363bb2f744eb486f9ad726f08214c98e (127.14.180.67). New cstate: current_term: 14 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } }
I20260709 13:08:25.319080 16354 raft_consensus.cc:1275] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 20 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:08:25.321758 22753 consensus_queue.cc:1048] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:25.372145 16200 raft_consensus.cc:1275] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 20 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:08:25.384721 22753 consensus_queue.cc:1048] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:25.405712 16102 catalog_manager.cc:5697] T 5c2f49b7f95a4153b2d180218e6af1db P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: config changed from index 11 to 12, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New cstate: current_term: 20 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:08:25.420528 16104 catalog_manager.cc:5697] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 19 to 20, leader changed from 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) to 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66). New cstate: current_term: 20 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:25.537307 16106 catalog_manager.cc:5244] ChangeConfig:REMOVE_PEER RPC for tablet 540bfc4ad793452faea5b865343aacf7 with cas_config_opid_index 10: aborting the task: latest config opid_index 11; task opid_index 10
I20260709 13:08:25.577836 16106 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38842 (request call id 222) took 5099 ms. Trace:
I20260709 13:08:25.578238 16106 rpcz_store.cc:276] 0709 13:08:20.478776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:20.480591 (+  1815us) service_pool.cc:224] Handling call
0709 13:08:20.609186 (+128595us) spinlock_profiling.cc:243] Waited 28.6 ms on lock 0x7b54002b0110. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361c224db1 00007f361c364b71 00007f361c3650b2 00007f36252dea89 00007f3625276da6 00007f3625248088 00007f362534637e 00007f36238072a4 00007f3623807232 00007f3623807161 00007f36238070dc
0709 13:08:20.624940 (+ 15754us) spinlock_profiling.cc:243] Waited 4 ms on lock 0x7b5400137754. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361f3f3090 00007f361f491f3a 00007f36252481cc 00007f362534637e 00007f36238072a4 00007f3623807232 00007f3623807161 00007f36238070dc 00007f3623806392 00007f361d7c448c 00007f361d7c38c6
0709 13:08:20.668551 (+ 43611us) spinlock_profiling.cc:243] Waited 25.3 ms on lock 0x7b54002b0110. stack: 00007f361c36a343 00007f361c36a240 00007f361bcf91d4 00007f3625a37304 00007f3625a37299 00007f361c224db1 00007f361c365640 00007f362523cb76 00007f3625346c3e 00007f36238072a4 00007f3623807232 00007f3623807161 00007f36238070dc 00007f3623806392 00007f361d7c448c 00007f361d7c38c6
0709 13:08:25.577743 (+4909192us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20537,"reported_tablets":51,"spinlock_wait_cycles":133043200}
I20260709 13:08:25.689421 22942 raft_consensus.cc:493] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:25.690039 22942 raft_consensus.cc:515] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:25.696034 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:25.696885 16203 raft_consensus.cc:2393] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 19: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:08:25.697861 22756 raft_consensus.cc:493] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.698455 22756 raft_consensus.cc:515] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:25.699765 22942 leader_election.cc:290] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:25.701006 22756 leader_election.cc:290] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:25.701663 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:25.701551 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:25.702306 16200 raft_consensus.cc:2468] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 19.
I20260709 13:08:25.702318 16356 raft_consensus.cc:2468] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 19.
I20260709 13:08:25.704465 16320 leader_election.cc:304] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:25.705616 16248 leader_election.cc:304] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:25.706064 22756 raft_consensus.cc:2804] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:25.706686 22756 raft_consensus.cc:493] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:25.707147 22756 raft_consensus.cc:3060] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:25.702648 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:25.710155 16283 raft_consensus.cc:2468] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 18.
I20260709 13:08:25.712716 22942 raft_consensus.cc:2804] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:25.713279 22942 raft_consensus.cc:493] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:25.713776 22942 raft_consensus.cc:3060] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:25.753345 22942 raft_consensus.cc:515] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:25.766660 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:08:25.767650 16203 raft_consensus.cc:2393] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 19: Already voted for candidate e10b16d536674c0bb350a31d7ce5ff7f in this term.
I20260709 13:08:25.770334 22942 leader_election.cc:290] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 19 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:25.775437 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:25.778431 22756 raft_consensus.cc:515] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:25.779717 16355 raft_consensus.cc:2368] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 19. Current term is 20.
I20260709 13:08:25.780779 22756 leader_election.cc:290] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 20 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:25.787063 16248 leader_election.cc:400] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 19 election: Vote denied by peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107) with higher term. Message: Invalid argument: T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 19. Current term is 20.
I20260709 13:08:25.787503 16248 leader_election.cc:403] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 13:08:25.789258 22753 raft_consensus.cc:3060] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:25.791337 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:25.798796 22753 raft_consensus.cc:2749] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107) with higher term. Message: Invalid argument: T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 19. Current term is 20.
I20260709 13:08:25.815598 16203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:08:25.816362 16203 raft_consensus.cc:3060] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:25.826623 16283 raft_consensus.cc:2468] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 20.
I20260709 13:08:25.828739 16322 leader_election.cc:304] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:08:25.830330 23000 raft_consensus.cc:2804] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:08:25.828418 16203 raft_consensus.cc:2468] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 20.
I20260709 13:08:25.834942 23000 raft_consensus.cc:697] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 20 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:08:25.841208 23000 consensus_queue.cc:237] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:25.868817 15057 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:25.951329 16355 consensus_queue.cc:237] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 9, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:25.968006 16944 raft_consensus.cc:1275] T 5c2f49b7f95a4153b2d180218e6af1db P 1109f76a0b7b443a84c0327c8707bc63 [term 20 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:08:25.968325 16203 raft_consensus.cc:1275] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 20 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:08:25.971190 23033 consensus_queue.cc:1048] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:08:25.973515 23033 consensus_queue.cc:1048] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:25.968320 16103 catalog_manager.cc:5697] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:25.981662 23033 raft_consensus.cc:2955] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 20 LEADER]: Committing config change with OpId 20.13: config changed from index 12 to 13, VOTER 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:08:25.985702 16206 raft_consensus.cc:2955] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 20 FOLLOWER]: Committing config change with OpId 20.13: config changed from index 12 to 13, VOTER 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:08:25.991928 16947 raft_consensus.cc:2955] T 5c2f49b7f95a4153b2d180218e6af1db P 1109f76a0b7b443a84c0327c8707bc63 [term 20 FOLLOWER]: Committing config change with OpId 20.13: config changed from index 12 to 13, VOTER 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:08:26.036773 16092 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5c2f49b7f95a4153b2d180218e6af1db with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:26.043511 16104 catalog_manager.cc:5697] T 5c2f49b7f95a4153b2d180218e6af1db P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: config changed from index 12 to 13, VOTER 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) evicted. New cstate: current_term: 20 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:08:26.226087 16270 tablet_service.cc:1558] Processing DeleteTablet for tablet 5c2f49b7f95a4153b2d180218e6af1db with delete_type TABLET_DATA_TOMBSTONED (TS 0aea40d6e4374085a2e38a70a71f63e3 not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:45374
I20260709 13:08:26.235700 23089 tablet_replica.cc:333] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3: stopping tablet replica
I20260709 13:08:26.281817 16283 raft_consensus.cc:1275] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:08:26.293059 22813 consensus_queue.cc:1048] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:26.298683 16204 raft_consensus.cc:1275] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 20 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:08:26.303666 23000 consensus_queue.cc:1048] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:08:26.326749 23089 raft_consensus.cc:2243] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:26.327646 23089 raft_consensus.cc:2272] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:26.337358 23089 ts_tablet_manager.cc:1916] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:26.452288 23089 ts_tablet_manager.cc:1929] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 20.12
I20260709 13:08:26.453117 23089 log.cc:1199] T 5c2f49b7f95a4153b2d180218e6af1db P 0aea40d6e4374085a2e38a70a71f63e3: Deleting WAL directory at /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602283040513-15057-0/minicluster-data/ts-1-root/wals/5c2f49b7f95a4153b2d180218e6af1db
I20260709 13:08:26.460749 16092 catalog_manager.cc:5028] TS 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): tablet 5c2f49b7f95a4153b2d180218e6af1db (table test-workload [id=f364cfe226234c5b99453e3013c8717e]) successfully deleted
W20260709 13:08:26.560938 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 67893.2us
W20260709 13:08:27.274349 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 55239.9us
I20260709 13:08:27.359972 15057 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:27.404119 16283 consensus_queue.cc:237] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:08:27.431740 16354 raft_consensus.cc:1275] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:08:27.434852 23098 consensus_queue.cc:1048] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:08:27.444438 16248 consensus_peers.cc:597] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 -> Peer 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875): Couldn't send request to peer 1109f76a0b7b443a84c0327c8707bc63. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: eafb6ab8cb0c42309ea6508e0ad9b9ef. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:27.447619 16203 raft_consensus.cc:1275] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:08:27.449426 23036 consensus_queue.cc:1048] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:27.466727 23096 raft_consensus.cc:2955] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 LEADER]: Committing config change with OpId 16.11: config changed from index -1 to 11, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:08:27.479516 16354 raft_consensus.cc:2955] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index -1 to 11, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:08:27.494294 16283 consensus_queue.cc:237] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:08:27.520304 16103 catalog_manager.cc:5697] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: config changed from index -1 to 11, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New cstate: current_term: 16 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:27.556926 16200 raft_consensus.cc:2955] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Committing config change with OpId 16.11: config changed from index -1 to 11, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:08:27.593277 16354 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "16a307cee8ef431184c620fec029af19"
dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
mode: GRACEFUL
new_leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
 from {username='slave'} at 127.0.0.1:56792
I20260709 13:08:27.594079 16354 raft_consensus.cc:606] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 18 LEADER]: Received request to transfer leadership to TS e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:08:27.603339 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 64543us
I20260709 13:08:27.624223 16354 raft_consensus.cc:1275] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 22 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:08:27.630951 16355 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7295dce0baa440b8a197da845581ee81"
dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
mode: GRACEFUL
new_leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
 from {username='slave'} at 127.0.0.1:56792
I20260709 13:08:27.631619 16355 raft_consensus.cc:606] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 13 LEADER]: Received request to transfer leadership to TS 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:08:27.637562 16200 raft_consensus.cc:1275] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 22 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:08:27.641441 23098 consensus_queue.cc:1048] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:08:27.652220 16248 consensus_peers.cc:597] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 -> Peer 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875): Couldn't send request to peer 1109f76a0b7b443a84c0327c8707bc63. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8cabbc283ea543459d45ebdb8b6add94. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:27.654038 16283 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8b615ac918a749989f2968826926adf3"
dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
mode: GRACEFUL
new_leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
 from {username='slave'} at 127.0.0.1:39058
I20260709 13:08:27.654773 16283 raft_consensus.cc:606] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 LEADER]: Received request to transfer leadership to TS e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:27.664197 23104 consensus_queue.cc:1048] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:08:27.666405 16355 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aee913c41fb9437587affa768953f637"
dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
mode: GRACEFUL
new_leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
 from {username='slave'} at 127.0.0.1:56792
I20260709 13:08:27.667088 16355 raft_consensus.cc:606] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 20 LEADER]: Received request to transfer leadership to TS e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:27.673336 16279 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef"
dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
mode: GRACEFUL
new_leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
 from {username='slave'} at 127.0.0.1:39058
I20260709 13:08:27.673971 16279 raft_consensus.cc:606] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 LEADER]: Received request to transfer leadership to TS e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:27.678081 15057 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:08:27.680162 15057 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:27.714605 23098 raft_consensus.cc:2955] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 22 LEADER]: Committing config change with OpId 22.13: config changed from index -1 to 13, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:08:27.724006 16203 raft_consensus.cc:2955] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 22 FOLLOWER]: Committing config change with OpId 22.13: config changed from index -1 to 13, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:08:27.732460 16354 raft_consensus.cc:2955] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 22 FOLLOWER]: Committing config change with OpId 22.13: config changed from index -1 to 13, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:08:27.751775 23000 raft_consensus.cc:993] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e: : Instructing follower 0aea40d6e4374085a2e38a70a71f63e3 to start an election
I20260709 13:08:27.752452 23000 raft_consensus.cc:1081] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 13 LEADER]: Signalling peer 0aea40d6e4374085a2e38a70a71f63e3 to start an election
I20260709 13:08:27.754458 16279 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7295dce0baa440b8a197da845581ee81"
dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
 from {username='slave'} at 127.0.0.1:45210
I20260709 13:08:27.755087 16279 raft_consensus.cc:493] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:27.755429 16279 raft_consensus.cc:3060] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:27.757405 16104 catalog_manager.cc:5697] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e reported cstate change: config changed from index -1 to 13, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New cstate: current_term: 22 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:08:27.784168 16279 raft_consensus.cc:515] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:27.794173 16279 leader_election.cc:290] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 election: Requested vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:27.796268 16355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: true dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:27.796490 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: true dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:08:27.797045 16355 raft_consensus.cc:3055] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:27.797060 16947 raft_consensus.cc:3060] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:27.797667 16355 raft_consensus.cc:740] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:08:27.798604 16355 consensus_queue.cc:260] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:27.800053 16355 raft_consensus.cc:3060] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:27.805965 16947 raft_consensus.cc:2468] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 14.
I20260709 13:08:27.807397 16248 leader_election.cc:304] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:08:27.809019 16355 raft_consensus.cc:2468] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 14.
I20260709 13:08:27.809978 23098 raft_consensus.cc:2804] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:27.817880 23098 raft_consensus.cc:697] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:08:27.819027 23098 consensus_queue.cc:237] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:27.785182 16354 consensus_queue.cc:237] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:08:27.861464 16106 catalog_manager.cc:5697] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 13 to 14, leader changed from 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) to 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66). New cstate: current_term: 14 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:27.883867 16200 raft_consensus.cc:1275] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:08:27.885592 16279 raft_consensus.cc:1275] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:08:27.887039 22756 consensus_queue.cc:1048] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:27.888140 23105 consensus_queue.cc:1048] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:08:27.890517 16322 consensus_peers.cc:597] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e -> Peer 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875): Couldn't send request to peer 1109f76a0b7b443a84c0327c8707bc63. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cad5db410b3444caafa5090b94f02dba. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:27.902923 23105 raft_consensus.cc:993] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e: : Instructing follower e10b16d536674c0bb350a31d7ce5ff7f to start an election
I20260709 13:08:27.903234 23115 ts_tablet_manager.cc:933] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 1109f76a0b7b443a84c0327c8707bc63: Initiating tablet copy from peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:27.903550 23033 raft_consensus.cc:1081] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 20 LEADER]: Signalling peer e10b16d536674c0bb350a31d7ce5ff7f to start an election
I20260709 13:08:27.930779 16203 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aee913c41fb9437587affa768953f637"
dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
 from {username='slave'} at 127.0.0.1:60154
I20260709 13:08:27.931495 16203 raft_consensus.cc:493] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 20 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:27.931915 16203 raft_consensus.cc:3060] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:27.937873 22813 raft_consensus.cc:2955] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 17 LEADER]: Committing config change with OpId 17.12: config changed from index -1 to 12, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:08:27.941313 16204 raft_consensus.cc:2955] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index -1 to 12, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:08:27.948354 16278 raft_consensus.cc:2955] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index -1 to 12, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:08:27.956288 23096 raft_consensus.cc:993] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3: : Instructing follower e10b16d536674c0bb350a31d7ce5ff7f to start an election
I20260709 13:08:27.956888 23096 raft_consensus.cc:1081] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 LEADER]: Signalling peer e10b16d536674c0bb350a31d7ce5ff7f to start an election
I20260709 13:08:27.958616 16200 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef"
dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
 from {username='slave'} at 127.0.0.1:60138
I20260709 13:08:27.959359 16200 raft_consensus.cc:493] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:27.959777 16200 raft_consensus.cc:3060] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:27.980527 23115 tablet_copy_client.cc:323] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Beginning tablet copy session from remote peer at address 127.14.180.66:45823
I20260709 13:08:27.982005 16200 raft_consensus.cc:515] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:08:27.983335 16293 tablet_copy_service.cc:140] P 0aea40d6e4374085a2e38a70a71f63e3: Received BeginTabletCopySession request for tablet eafb6ab8cb0c42309ea6508e0ad9b9ef from peer 1109f76a0b7b443a84c0327c8707bc63 ({username='slave'} at 127.0.0.1:42740)
I20260709 13:08:27.983979 16293 tablet_copy_service.cc:161] P 0aea40d6e4374085a2e38a70a71f63e3: Beginning new tablet copy session on tablet eafb6ab8cb0c42309ea6508e0ad9b9ef from peer 1109f76a0b7b443a84c0327c8707bc63 at {username='slave'} at 127.0.0.1:42740: session id = 1109f76a0b7b443a84c0327c8707bc63-eafb6ab8cb0c42309ea6508e0ad9b9ef
I20260709 13:08:27.986649 16200 leader_election.cc:290] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 17 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:27.987349 16104 catalog_manager.cc:5697] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e reported cstate change: config changed from index -1 to 12, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New cstate: current_term: 17 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:27.989167 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: true dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:27.989789 16283 raft_consensus.cc:3055] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:27.990106 16283 raft_consensus.cc:740] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:08:27.993337 16200 consensus_queue.cc:237] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:08:28.006337 16283 consensus_queue.cc:260] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:08:28.008339 16283 raft_consensus.cc:3060] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:28.000041 16203 raft_consensus.cc:515] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 21 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:28.027433 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: true dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:28.028439 16354 raft_consensus.cc:3060] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:28.030382 16203 leader_election.cc:290] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 21 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:28.032353 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: true dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:28.033037 16278 raft_consensus.cc:3060] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:28.054317 23098 raft_consensus.cc:993] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3: : Instructing follower e10b16d536674c0bb350a31d7ce5ff7f to start an election
I20260709 13:08:28.055151 23104 raft_consensus.cc:1081] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 LEADER]: Signalling peer e10b16d536674c0bb350a31d7ce5ff7f to start an election
I20260709 13:08:28.057265 16204 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8b615ac918a749989f2968826926adf3"
dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
 from {username='slave'} at 127.0.0.1:60138
I20260709 13:08:28.057992 16204 raft_consensus.cc:493] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:28.059139 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: true dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:28.059859 16349 raft_consensus.cc:3055] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:08:28.058440 16204 raft_consensus.cc:3060] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:28.060213 16349 raft_consensus.cc:740] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:08:28.061086 16349 consensus_queue.cc:260] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:28.066864 16354 raft_consensus.cc:2468] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 17.
I20260709 13:08:28.065322 16283 raft_consensus.cc:2468] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 17.
I20260709 13:08:28.069610 16349 raft_consensus.cc:3060] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:28.073858 16278 raft_consensus.cc:2468] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 21.
I20260709 13:08:28.074040 16204 raft_consensus.cc:515] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:28.071038 16173 leader_election.cc:304] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:28.080623 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: true dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:28.081272 16281 raft_consensus.cc:3055] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:28.081614 16281 raft_consensus.cc:740] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:08:28.083250 23110 raft_consensus.cc:2804] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:28.082333 16281 consensus_queue.cc:260] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:28.080726 16173 leader_election.cc:304] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:28.084599 16281 raft_consensus.cc:3060] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:28.084648 16204 leader_election.cc:290] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 16 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:28.093371 23095 raft_consensus.cc:2804] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:08:28.095389 23095 raft_consensus.cc:697] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 21 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:08:28.096504 16293 tablet_copy_source_session.cc:215] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:28.096380 23095 consensus_queue.cc:237] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:28.100790 23115 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eafb6ab8cb0c42309ea6508e0ad9b9ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:28.091125 23110 raft_consensus.cc:697] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [term 17 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:08:28.109228 16349 raft_consensus.cc:2468] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 21.
I20260709 13:08:28.110978 23110 consensus_queue.cc:237] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:08:28.115882 23000 raft_consensus.cc:993] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e: : Instructing follower e10b16d536674c0bb350a31d7ce5ff7f to start an election
I20260709 13:08:28.116631 23000 raft_consensus.cc:1081] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 18 LEADER]: Signalling peer e10b16d536674c0bb350a31d7ce5ff7f to start an election
I20260709 13:08:28.118494 16204 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "16a307cee8ef431184c620fec029af19"
dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
 from {username='slave'} at 127.0.0.1:60154
I20260709 13:08:28.119102 16204 raft_consensus.cc:493] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:28.119467 16204 raft_consensus.cc:3060] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:28.133695 16281 raft_consensus.cc:2468] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 16.
I20260709 13:08:28.141445 16204 raft_consensus.cc:515] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:28.147564 16204 leader_election.cc:290] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 19 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:08:28.188930 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 108247us
I20260709 13:08:28.191932 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: true dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:08:28.192564 16944 raft_consensus.cc:3060] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:28.194916 16278 raft_consensus.cc:1275] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:08:28.195459 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: true dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:28.196221 16281 raft_consensus.cc:3060] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:28.200461 16349 raft_consensus.cc:1275] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:08:28.204806 16281 raft_consensus.cc:2468] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 19.
I20260709 13:08:28.210129 16944 raft_consensus.cc:2468] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 16.
I20260709 13:08:28.211730 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: true dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:28.221837 16349 raft_consensus.cc:3055] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:08:28.222110 16349 raft_consensus.cc:740] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:08:28.222826 16349 consensus_queue.cc:260] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:28.223912 16349 raft_consensus.cc:3060] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:28.213485 23126 ts_tablet_manager.cc:933] T 8cabbc283ea543459d45ebdb8b6add94 P 1109f76a0b7b443a84c0327c8707bc63: Initiating tablet copy from peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:28.225800 16173 leader_election.cc:304] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:28.239985 16349 raft_consensus.cc:2468] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 19.
I20260709 13:08:28.227035 23097 consensus_queue.cc:1048] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.014s
I20260709 13:08:28.253638 23122 raft_consensus.cc:2804] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:28.254274 23122 raft_consensus.cc:697] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 16 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:08:28.255262 23122 consensus_queue.cc:237] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:28.264083 16173 leader_election.cc:304] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:28.274812 23125 raft_consensus.cc:2804] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:28.275588 23125 raft_consensus.cc:697] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 19 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:08:28.277323 23125 consensus_queue.cc:237] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:28.261546 23095 consensus_queue.cc:1048] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.008s
I20260709 13:08:28.310864 16104 catalog_manager.cc:5697] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f reported cstate change: term changed from 16 to 17, leader changed from 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) to e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65). New cstate: current_term: 17 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:28.330329 16247 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:28.330837 16944 raft_consensus.cc:1275] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:08:28.347816 23130 consensus_queue.cc:1048] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:08:28.377594 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 45335.7us
I20260709 13:08:28.336172 23126 tablet_copy_client.cc:323] T 8cabbc283ea543459d45ebdb8b6add94 P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Beginning tablet copy session from remote peer at address 127.14.180.66:45823
W20260709 13:08:28.379141 16173 consensus_peers.cc:597] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f -> Peer 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875): Couldn't send request to peer 1109f76a0b7b443a84c0327c8707bc63. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 13bc3c8ff9b84838a2664335d7e1582b. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:28.382900 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 116457us
W20260709 13:08:28.450268 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 54048.1us
W20260709 13:08:28.455891 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 56948.6us
I20260709 13:08:28.467013 16293 tablet_copy_service.cc:140] P 0aea40d6e4374085a2e38a70a71f63e3: Received BeginTabletCopySession request for tablet 8cabbc283ea543459d45ebdb8b6add94 from peer 1109f76a0b7b443a84c0327c8707bc63 ({username='slave'} at 127.0.0.1:42740)
I20260709 13:08:28.467748 16293 tablet_copy_service.cc:161] P 0aea40d6e4374085a2e38a70a71f63e3: Beginning new tablet copy session on tablet 8cabbc283ea543459d45ebdb8b6add94 from peer 1109f76a0b7b443a84c0327c8707bc63 at {username='slave'} at 127.0.0.1:42740: session id = 1109f76a0b7b443a84c0327c8707bc63-8cabbc283ea543459d45ebdb8b6add94
I20260709 13:08:28.469429 16104 catalog_manager.cc:5697] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f reported cstate change: term changed from 20 to 21, leader changed from 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) to e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65). New cstate: current_term: 21 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:28.463796 23115 tablet_copy_client.cc:806] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:28.472254 23115 tablet_copy_client.cc:670] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:28.471657 16104 catalog_manager.cc:5697] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f reported cstate change: term changed from 15 to 16, leader changed from 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) to e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65). New cstate: current_term: 16 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:28.477789 16104 catalog_manager.cc:5697] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f reported cstate change: term changed from 18 to 19, leader changed from 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) to e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65). New cstate: current_term: 19 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:28.493594 16293 tablet_copy_source_session.cc:215] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 13:08:28.510218 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 121683us
I20260709 13:08:28.513375 23115 tablet_copy_client.cc:538] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:28.523445 16349 raft_consensus.cc:1275] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:08:28.569806 23115 tablet_bootstrap.cc:492] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap starting.
I20260709 13:08:28.579742 23140 consensus_queue.cc:1048] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:08:28.599663 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 96364.3us
I20260709 13:08:28.609624 23141 raft_consensus.cc:2955] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [term 11 LEADER]: Committing config change with OpId 11.9: config changed from index -1 to 9, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:08:28.612900 23126 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cabbc283ea543459d45ebdb8b6add94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:28.617213 16355 raft_consensus.cc:2955] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index -1 to 9, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:08:28.625605 23147 ts_tablet_manager.cc:933] T cad5db410b3444caafa5090b94f02dba P 1109f76a0b7b443a84c0327c8707bc63: Initiating tablet copy from peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:28.628072 16283 raft_consensus.cc:1275] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:08:28.635047 16354 raft_consensus.cc:1275] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 21 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:08:28.638635 23133 consensus_queue.cc:1048] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:08:28.639905 23146 ts_tablet_manager.cc:933] T 13bc3c8ff9b84838a2664335d7e1582b P 1109f76a0b7b443a84c0327c8707bc63: Initiating tablet copy from peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073)
I20260709 13:08:28.642724 16354 raft_consensus.cc:1275] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:08:28.683104 15057 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:28.661772 23132 consensus_queue.cc:1048] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.032s
I20260709 13:08:28.697744 16104 catalog_manager.cc:5697] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e reported cstate change: config changed from index -1 to 9, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New cstate: current_term: 11 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:08:28.703963 16278 raft_consensus.cc:1275] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 21 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:08:28.714342 23095 consensus_queue.cc:1048] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.005s
I20260709 13:08:28.746529 16356 raft_consensus.cc:1275] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:08:28.748299 16278 raft_consensus.cc:2955] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index -1 to 9, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:08:28.712319 23139 consensus_queue.cc:1048] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 13:08:28.752264 23123 consensus_queue.cc:1048] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.041s
I20260709 13:08:28.791615 23147 tablet_copy_client.cc:323] T cad5db410b3444caafa5090b94f02dba P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Beginning tablet copy session from remote peer at address 127.14.180.67:46107
I20260709 13:08:28.789623 23146 tablet_copy_client.cc:323] T 13bc3c8ff9b84838a2664335d7e1582b P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Beginning tablet copy session from remote peer at address 127.14.180.65:46073
W20260709 13:08:28.845397 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 47215.6us
I20260709 13:08:28.896081 16217 tablet_copy_service.cc:140] P e10b16d536674c0bb350a31d7ce5ff7f: Received BeginTabletCopySession request for tablet 13bc3c8ff9b84838a2664335d7e1582b from peer 1109f76a0b7b443a84c0327c8707bc63 ({username='slave'} at 127.0.0.1:39674)
I20260709 13:08:28.896847 16217 tablet_copy_service.cc:161] P e10b16d536674c0bb350a31d7ce5ff7f: Beginning new tablet copy session on tablet 13bc3c8ff9b84838a2664335d7e1582b from peer 1109f76a0b7b443a84c0327c8707bc63 at {username='slave'} at 127.0.0.1:39674: session id = 1109f76a0b7b443a84c0327c8707bc63-13bc3c8ff9b84838a2664335d7e1582b
W20260709 13:08:28.922111 16173 consensus_peers.cc:597] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f -> Peer 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875): Couldn't send request to peer 1109f76a0b7b443a84c0327c8707bc63. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:28.898283 16367 tablet_copy_service.cc:140] P 363bb2f744eb486f9ad726f08214c98e: Received BeginTabletCopySession request for tablet cad5db410b3444caafa5090b94f02dba from peer 1109f76a0b7b443a84c0327c8707bc63 ({username='slave'} at 127.0.0.1:33486)
I20260709 13:08:28.943735 16367 tablet_copy_service.cc:161] P 363bb2f744eb486f9ad726f08214c98e: Beginning new tablet copy session on tablet cad5db410b3444caafa5090b94f02dba from peer 1109f76a0b7b443a84c0327c8707bc63 at {username='slave'} at 127.0.0.1:33486: session id = 1109f76a0b7b443a84c0327c8707bc63-cad5db410b3444caafa5090b94f02dba
W20260709 13:08:28.946772 16092 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 73757c6fea8949e090aa4e55902a41d4 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER failed with leader 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107) due to error UNKNOWN_ERROR; will retry: Invalid argument: Cannot remove peer 363bb2f744eb486f9ad726f08214c98e from the config because it is the leader. Force another leader to be elected to remove this peer. Consensus state: current_term: 14 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:08:28.963884 16281 raft_consensus.cc:1275] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:08:28.985505 23139 consensus_queue.cc:1048] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.046s
W20260709 13:08:29.060935 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 95144.9us
I20260709 13:08:29.135987 16947 raft_consensus.cc:1275] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 16 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:08:29.156821 16367 tablet_copy_source_session.cc:215] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 13:08:29.168748 23163 log.cc:927] Time spent T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:08:29.178285 23147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cad5db410b3444caafa5090b94f02dba. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:08:29.204205 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 48465.6us
I20260709 13:08:29.209450 16217 tablet_copy_source_session.cc:215] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:29.218573 23162 consensus_queue.cc:1048] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:08:29.232163 23146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13bc3c8ff9b84838a2664335d7e1582b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:29.244765 16279 raft_consensus.cc:1275] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
W20260709 13:08:29.337033 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 102215us
W20260709 13:08:29.423605 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 66009.6us
I20260709 13:08:29.413167 23126 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:40078 (request call id 1040) took 1241 ms. Trace:
W20260709 13:08:29.438481 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 51226.4us
W20260709 13:08:29.468909 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 123740us
I20260709 13:08:29.470196 23180 consensus_queue.cc:1048] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:08:29.432238 23126 rpcz_store.cc:276] 0709 13:08:28.160442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:28.160599 (+   157us) service_pool.cc:224] Handling call
0709 13:08:28.227032 (+ 66433us) ts_tablet_manager.cc:934] T 8cabbc283ea543459d45ebdb8b6add94 P 1109f76a0b7b443a84c0327c8707bc63: Initiating tablet copy from peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
0709 13:08:28.607380 (+380348us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:08:29.216488 (+609108us) tablet_metadata.cc:665] Metadata flushed
0709 13:08:29.216627 (+   139us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:08:29.304107 (+ 87480us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:08:29.344407 (+ 40300us) tablet_replica.cc:206] Creating consensus instance
0709 13:08:29.379258 (+ 34851us) ts_tablet_manager.cc:989] Replica registered.
0709 13:08:29.386659 (+  7401us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":23809,"tablet-copy.queue_time_us":52277,"thread_start_us":113762,"threads_started":2}
I20260709 13:08:29.519726 23126 tablet_copy_client.cc:806] T 8cabbc283ea543459d45ebdb8b6add94 P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:29.520401 23126 tablet_copy_client.cc:670] T 8cabbc283ea543459d45ebdb8b6add94 P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:29.538507 23147 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:35122 (request call id 988) took 1035 ms. Trace:
W20260709 13:08:29.547806 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 57491.8us
I20260709 13:08:29.566403 23147 rpcz_store.cc:276] 0709 13:08:28.502917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:28.503065 (+   148us) service_pool.cc:224] Handling call
0709 13:08:28.626148 (+123083us) ts_tablet_manager.cc:934] T cad5db410b3444caafa5090b94f02dba P 1109f76a0b7b443a84c0327c8707bc63: Initiating tablet copy from peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
0709 13:08:29.176509 (+550361us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:08:29.314240 (+137731us) tablet_metadata.cc:665] Metadata flushed
0709 13:08:29.314381 (+   141us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:08:29.537755 (+223374us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:08:29.538069 (+   314us) tablet_replica.cc:206] Creating consensus instance
0709 13:08:29.538384 (+   315us) ts_tablet_manager.cc:989] Replica registered.
0709 13:08:29.538441 (+    57us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":64888,"tablet-copy.queue_time_us":121915,"thread_start_us":155313,"threads_started":2}
I20260709 13:08:29.607172 23147 tablet_copy_client.cc:806] T cad5db410b3444caafa5090b94f02dba P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:29.607928 23147 tablet_copy_client.cc:670] T cad5db410b3444caafa5090b94f02dba P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Starting download of 1 WAL segments...
W20260709 13:08:29.577904 23181 log.cc:927] Time spent T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:08:29.581272 23126 tablet_copy_client.cc:538] T 8cabbc283ea543459d45ebdb8b6add94 P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:29.587850 23115 tablet_bootstrap.cc:492] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=0 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:29.593791 23146 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:35106 (request call id 1168) took 1066 ms. Trace:
I20260709 13:08:29.651947 23115 tablet_bootstrap.cc:492] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap complete.
I20260709 13:08:29.652900 23115 ts_tablet_manager.cc:1403] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 1109f76a0b7b443a84c0327c8707bc63: Time spent bootstrapping tablet: real 1.090s	user 0.061s	sys 0.018s
I20260709 13:08:29.638149 23146 rpcz_store.cc:276] 0709 13:08:28.527755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:28.527921 (+   166us) service_pool.cc:224] Handling call
0709 13:08:28.640314 (+112393us) ts_tablet_manager.cc:934] T 13bc3c8ff9b84838a2664335d7e1582b P 1109f76a0b7b443a84c0327c8707bc63: Initiating tablet copy from peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073)
0709 13:08:29.230673 (+590359us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:08:29.525381 (+294708us) tablet_metadata.cc:665] Metadata flushed
0709 13:08:29.525542 (+   161us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:08:29.592794 (+ 67252us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:08:29.593122 (+   328us) tablet_replica.cc:206] Creating consensus instance
0709 13:08:29.593669 (+   547us) ts_tablet_manager.cc:989] Replica registered.
0709 13:08:29.593728 (+    59us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":10295,"tablet-copy.queue_time_us":111304,"thread_start_us":101982,"threads_started":2}
I20260709 13:08:29.675810 23146 tablet_copy_client.cc:806] T 13bc3c8ff9b84838a2664335d7e1582b P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:29.676648 23146 tablet_copy_client.cc:670] T 13bc3c8ff9b84838a2664335d7e1582b P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:29.693023 23115 raft_consensus.cc:359] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 1109f76a0b7b443a84c0327c8707bc63 [term 17 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:08:29.693948 23115 raft_consensus.cc:740] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 1109f76a0b7b443a84c0327c8707bc63 [term 17 LEARNER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Initialized, Role: LEARNER
I20260709 13:08:29.694907 23115 consensus_queue.cc:260] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:08:29.697676 23115 ts_tablet_manager.cc:1434] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 1109f76a0b7b443a84c0327c8707bc63: Time spent starting tablet: real 0.044s	user 0.002s	sys 0.002s
I20260709 13:08:29.709372 16293 tablet_copy_service.cc:342] P 0aea40d6e4374085a2e38a70a71f63e3: Request end of tablet copy session 1109f76a0b7b443a84c0327c8707bc63-eafb6ab8cb0c42309ea6508e0ad9b9ef received from {username='slave'} at 127.0.0.1:42740
I20260709 13:08:29.709960 16293 tablet_copy_service.cc:434] P 0aea40d6e4374085a2e38a70a71f63e3: ending tablet copy session 1109f76a0b7b443a84c0327c8707bc63-eafb6ab8cb0c42309ea6508e0ad9b9ef on tablet eafb6ab8cb0c42309ea6508e0ad9b9ef with peer 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:08:29.740963 23146 tablet_copy_client.cc:538] T 13bc3c8ff9b84838a2664335d7e1582b P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:29.786492 15057 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:08:29.760883 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 101754us
I20260709 13:08:29.843370 23147 tablet_copy_client.cc:538] T cad5db410b3444caafa5090b94f02dba P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:29.921815 16356 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f"
dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
mode: GRACEFUL
new_leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
 from {username='slave'} at 127.0.0.1:56792
I20260709 13:08:29.922536 16356 raft_consensus.cc:606] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 18 LEADER]: Received request to transfer leadership to TS 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:08:29.939328 16276 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f"
dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
mode: GRACEFUL
new_leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
 from {username='slave'} at 127.0.0.1:39058
I20260709 13:08:29.940881 16276 raft_consensus.cc:606] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 LEADER]: Received request to transfer leadership to TS e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:30.003751 16349 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f"
dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
mode: GRACEFUL
new_leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
 from {username='slave'} at 127.0.0.1:56792
I20260709 13:08:30.004938 16349 raft_consensus.cc:606] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 19 LEADER]: Received request to transfer leadership to TS 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:08:30.000952 23146 tablet_bootstrap.cc:492] T 13bc3c8ff9b84838a2664335d7e1582b P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap starting.
I20260709 13:08:30.036762 23147 tablet_bootstrap.cc:492] T cad5db410b3444caafa5090b94f02dba P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap starting.
I20260709 13:08:30.038177 23126 tablet_bootstrap.cc:492] T 8cabbc283ea543459d45ebdb8b6add94 P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap starting.
I20260709 13:08:30.061362 22813 raft_consensus.cc:993] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e: : Instructing follower 0aea40d6e4374085a2e38a70a71f63e3 to start an election
I20260709 13:08:30.062117 22813 raft_consensus.cc:1081] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 18 LEADER]: Signalling peer 0aea40d6e4374085a2e38a70a71f63e3 to start an election
I20260709 13:08:30.073009 16276 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f"
dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
 from {username='slave'} at 127.0.0.1:45210
I20260709 13:08:30.073618 16276 raft_consensus.cc:493] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:30.073952 16276 raft_consensus.cc:3060] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:30.074656 16349 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c"
dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
mode: GRACEFUL
new_leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
 from {username='slave'} at 127.0.0.1:56792
I20260709 13:08:30.075350 16349 raft_consensus.cc:606] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 21 LEADER]: Received request to transfer leadership to TS e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:30.087805 16276 raft_consensus.cc:515] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:30.088312 16354 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba"
dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
mode: GRACEFUL
new_leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
 from {username='slave'} at 127.0.0.1:56792
I20260709 13:08:30.089118 16354 raft_consensus.cc:606] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 17 LEADER]: Received request to transfer leadership to TS e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:30.092687 15057 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:08:30.094395 15057 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:30.103734 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: true dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:08:30.098380 16276 leader_election.cc:290] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 19 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:30.104549 16200 raft_consensus.cc:3060] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:30.112583 16200 raft_consensus.cc:2468] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 19.
W20260709 13:08:30.122025 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 45578.2us
I20260709 13:08:30.137753 16246 leader_election.cc:304] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:30.138775 23127 raft_consensus.cc:2804] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:30.139590 23127 raft_consensus.cc:697] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:08:30.140659 23127 consensus_queue.cc:237] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:30.150624 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: true dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:30.151335 16356 raft_consensus.cc:3055] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:08:30.151679 16356 raft_consensus.cc:740] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:08:30.152462 16356 consensus_queue.cc:260] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:30.153641 16356 raft_consensus.cc:3060] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:30.154023 16204 raft_consensus.cc:1240] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 19 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 18. Current term is 19. Ops: []
I20260709 13:08:30.165792 16356 raft_consensus.cc:2468] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 19.
I20260709 13:08:30.244746 16102 catalog_manager.cc:5697] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 18 to 19, leader changed from 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) to 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66). New cstate: current_term: 19 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:30.288182 23169 raft_consensus.cc:993] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e: : Instructing follower 0aea40d6e4374085a2e38a70a71f63e3 to start an election
I20260709 13:08:30.297008 22756 raft_consensus.cc:1081] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 19 LEADER]: Signalling peer 0aea40d6e4374085a2e38a70a71f63e3 to start an election
I20260709 13:08:30.303414 16279 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f"
dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
 from {username='slave'} at 127.0.0.1:45210
I20260709 13:08:30.304071 16279 raft_consensus.cc:493] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:30.304477 16279 raft_consensus.cc:3060] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:30.308935 22813 raft_consensus.cc:993] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e: : Instructing follower e10b16d536674c0bb350a31d7ce5ff7f to start an election
I20260709 13:08:30.311022 23000 raft_consensus.cc:1081] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 17 LEADER]: Signalling peer e10b16d536674c0bb350a31d7ce5ff7f to start an election
I20260709 13:08:30.315568 16204 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba"
dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
 from {username='slave'} at 127.0.0.1:60154
I20260709 13:08:30.316421 16204 raft_consensus.cc:493] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:30.317020 16204 raft_consensus.cc:3060] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:30.330430 16279 raft_consensus.cc:515] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:30.332683 16204 raft_consensus.cc:515] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:08:30.336941 23169 raft_consensus.cc:993] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e: : Instructing follower e10b16d536674c0bb350a31d7ce5ff7f to start an election
I20260709 13:08:30.359306 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: true dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:08:30.360255 16200 raft_consensus.cc:3060] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:30.361761 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: true dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:30.362425 16281 raft_consensus.cc:3060] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:30.363519 16204 leader_election.cc:290] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 18 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:30.364955 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: true dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:30.365583 16354 raft_consensus.cc:3055] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:30.365886 16354 raft_consensus.cc:740] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:08:30.366777 16354 consensus_queue.cc:260] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:08:30.368144 16354 raft_consensus.cc:3060] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:30.354094 23184 raft_consensus.cc:1081] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 21 LEADER]: Signalling peer e10b16d536674c0bb350a31d7ce5ff7f to start an election
I20260709 13:08:30.378073 16200 raft_consensus.cc:2468] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 20.
I20260709 13:08:30.380187 16281 raft_consensus.cc:2468] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 18.
I20260709 13:08:30.379941 16246 leader_election.cc:304] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:30.382736 16173 leader_election.cc:304] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:30.389607 16354 raft_consensus.cc:2468] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 18.
I20260709 13:08:30.391578 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: true dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:30.392241 16349 raft_consensus.cc:3055] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:08:30.392530 16349 raft_consensus.cc:740] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:08:30.382489 23140 raft_consensus.cc:2804] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:08:30.395906 16200 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c"
dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
 from {username='slave'} at 127.0.0.1:60154
I20260709 13:08:30.397341 16200 raft_consensus.cc:493] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 21 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:30.396997 16349 consensus_queue.cc:260] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:30.397845 16200 raft_consensus.cc:3060] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:30.385882 23121 raft_consensus.cc:2804] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:30.405889 16279 leader_election.cc:290] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 20 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:30.409595 16349 raft_consensus.cc:3060] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:30.411965 16200 raft_consensus.cc:515] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 22 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:30.426903 16200 leader_election.cc:290] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 22 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:30.429857 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: true dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:30.430305 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: true dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:30.430786 16349 raft_consensus.cc:2468] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 20.
I20260709 13:08:30.430958 16279 raft_consensus.cc:3060] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:30.408089 23140 raft_consensus.cc:697] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:08:30.431025 16356 raft_consensus.cc:3055] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:08:30.412330 23121 raft_consensus.cc:697] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 18 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:08:30.436609 16356 raft_consensus.cc:740] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:08:30.452378 16279 raft_consensus.cc:2468] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 22.
I20260709 13:08:30.442461 23166 raft_consensus.cc:1064] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f: attempting to promote NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 to VOTER
I20260709 13:08:30.454459 16173 leader_election.cc:304] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:30.478895 23121 consensus_queue.cc:237] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:08:30.486733 23140 consensus_queue.cc:237] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:30.469117 23162 raft_consensus.cc:2804] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:08:30.512804 23174 raft_consensus.cc:993] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3: : Instructing follower e10b16d536674c0bb350a31d7ce5ff7f to start an election
I20260709 13:08:30.513512 23106 raft_consensus.cc:1081] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 LEADER]: Signalling peer e10b16d536674c0bb350a31d7ce5ff7f to start an election
I20260709 13:08:30.515751 16356 consensus_queue.cc:260] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:30.517222 16356 raft_consensus.cc:3060] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:30.521987 16203 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f"
dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
 from {username='slave'} at 127.0.0.1:60138
I20260709 13:08:30.522672 16203 raft_consensus.cc:493] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:30.523079 16203 raft_consensus.cc:3060] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:30.539489 23162 raft_consensus.cc:697] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 22 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:08:30.493005 23166 consensus_queue.cc:237] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 11, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:30.547952 23162 consensus_queue.cc:237] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:30.567123 16203 raft_consensus.cc:515] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:08:30.579111 23146 log.cc:927] Time spent T 13bc3c8ff9b84838a2664335d7e1582b P 1109f76a0b7b443a84c0327c8707bc63: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
W20260709 13:08:30.569268 23147 log.cc:927] Time spent T cad5db410b3444caafa5090b94f02dba P 1109f76a0b7b443a84c0327c8707bc63: Append to log took a long time: real 0.077s	user 0.002s	sys 0.000s
I20260709 13:08:30.591182 16356 raft_consensus.cc:2468] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 22.
W20260709 13:08:30.592571 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 138245us
I20260709 13:08:30.613196 16203 leader_election.cc:290] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 19 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:30.634658 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: true dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:30.635403 16276 raft_consensus.cc:3055] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:08:30.635759 16276 raft_consensus.cc:740] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:08:30.650888 16276 consensus_queue.cc:260] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:30.652444 16276 raft_consensus.cc:3060] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:30.660895 16276 raft_consensus.cc:2468] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 19.
I20260709 13:08:30.679525 16947 raft_consensus.cc:1275] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 1109f76a0b7b443a84c0327c8707bc63 [term 17 LEARNER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:08:30.694376 16203 raft_consensus.cc:1275] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 19 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:08:30.694595 16281 raft_consensus.cc:1275] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:08:30.698453 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: true dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:30.699100 16356 raft_consensus.cc:3060] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:30.699251 16354 raft_consensus.cc:1275] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:08:30.709465 23142 consensus_queue.cc:1048] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.003s
I20260709 13:08:30.718977 16356 raft_consensus.cc:2468] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 19.
I20260709 13:08:30.707046 23133 consensus_queue.cc:1048] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.015s
I20260709 13:08:30.769783 23126 tablet_bootstrap.cc:492] T 8cabbc283ea543459d45ebdb8b6add94 P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap replayed 1/1 log segments. Stats: ops{read=15 overwritten=2 applied=13 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:08:30.776048 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 68905.8us
I20260709 13:08:30.784963 16355 raft_consensus.cc:1275] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:08:30.801044 23146 tablet_bootstrap.cc:492] T 13bc3c8ff9b84838a2664335d7e1582b P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=0 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:30.802517 23146 tablet_bootstrap.cc:492] T 13bc3c8ff9b84838a2664335d7e1582b P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap complete.
I20260709 13:08:30.802992 23126 tablet_bootstrap.cc:492] T 8cabbc283ea543459d45ebdb8b6add94 P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap complete.
I20260709 13:08:30.803648 23146 ts_tablet_manager.cc:1403] T 13bc3c8ff9b84838a2664335d7e1582b P 1109f76a0b7b443a84c0327c8707bc63: Time spent bootstrapping tablet: real 0.866s	user 0.053s	sys 0.030s
I20260709 13:08:30.803862 23126 ts_tablet_manager.cc:1403] T 8cabbc283ea543459d45ebdb8b6add94 P 1109f76a0b7b443a84c0327c8707bc63: Time spent bootstrapping tablet: real 0.766s	user 0.061s	sys 0.009s
I20260709 13:08:30.791677 16106 catalog_manager.cc:5697] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f reported cstate change: term changed from 17 to 18, leader changed from 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) to e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65). New cstate: current_term: 18 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:30.816638 16106 catalog_manager.cc:5697] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f reported cstate change: term changed from 21 to 22, leader changed from 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) to e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65). New cstate: current_term: 22 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:30.831758 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 126176us
I20260709 13:08:30.823581 23126 raft_consensus.cc:359] T 8cabbc283ea543459d45ebdb8b6add94 P 1109f76a0b7b443a84c0327c8707bc63 [term 22 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:08:30.833619 23133 consensus_queue.cc:1048] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.005s
I20260709 13:08:30.835624 16173 leader_election.cc:304] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:30.844344 23133 raft_consensus.cc:2804] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:30.844975 23133 raft_consensus.cc:697] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 19 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:08:30.824043 23127 consensus_queue.cc:1048] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.010s
I20260709 13:08:30.856071 23126 raft_consensus.cc:740] T 8cabbc283ea543459d45ebdb8b6add94 P 1109f76a0b7b443a84c0327c8707bc63 [term 22 LEARNER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Initialized, Role: LEARNER
I20260709 13:08:30.861392 23126 consensus_queue.cc:260] T 8cabbc283ea543459d45ebdb8b6add94 P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
W20260709 13:08:30.862418 23203 log.cc:927] Time spent T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f: Append to log took a long time: real 0.065s	user 0.003s	sys 0.004s
I20260709 13:08:30.865058 23126 ts_tablet_manager.cc:1434] T 8cabbc283ea543459d45ebdb8b6add94 P 1109f76a0b7b443a84c0327c8707bc63: Time spent starting tablet: real 0.061s	user 0.009s	sys 0.000s
I20260709 13:08:30.848846 23146 raft_consensus.cc:359] T 13bc3c8ff9b84838a2664335d7e1582b P 1109f76a0b7b443a84c0327c8707bc63 [term 11 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:08:30.884364 23146 raft_consensus.cc:740] T 13bc3c8ff9b84838a2664335d7e1582b P 1109f76a0b7b443a84c0327c8707bc63 [term 11 LEARNER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Initialized, Role: LEARNER
I20260709 13:08:30.846014 23133 consensus_queue.cc:237] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:30.869447 23147 tablet_bootstrap.cc:492] T cad5db410b3444caafa5090b94f02dba P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=0 applied=12 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:30.885667 16293 tablet_copy_service.cc:342] P 0aea40d6e4374085a2e38a70a71f63e3: Request end of tablet copy session 1109f76a0b7b443a84c0327c8707bc63-8cabbc283ea543459d45ebdb8b6add94 received from {username='slave'} at 127.0.0.1:42740
I20260709 13:08:30.886209 16293 tablet_copy_service.cc:434] P 0aea40d6e4374085a2e38a70a71f63e3: ending tablet copy session 1109f76a0b7b443a84c0327c8707bc63-8cabbc283ea543459d45ebdb8b6add94 on tablet 8cabbc283ea543459d45ebdb8b6add94 with peer 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:08:30.886286 23147 tablet_bootstrap.cc:492] T cad5db410b3444caafa5090b94f02dba P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap complete.
I20260709 13:08:30.887120 23147 ts_tablet_manager.cc:1403] T cad5db410b3444caafa5090b94f02dba P 1109f76a0b7b443a84c0327c8707bc63: Time spent bootstrapping tablet: real 0.851s	user 0.061s	sys 0.016s
I20260709 13:08:30.884073 23192 consensus_queue.cc:1048] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:08:30.885238 23146 consensus_queue.cc:260] T 13bc3c8ff9b84838a2664335d7e1582b P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:08:30.912204 23146 ts_tablet_manager.cc:1434] T 13bc3c8ff9b84838a2664335d7e1582b P 1109f76a0b7b443a84c0327c8707bc63: Time spent starting tablet: real 0.108s	user 0.007s	sys 0.001s
I20260709 13:08:30.917438 16217 tablet_copy_service.cc:342] P e10b16d536674c0bb350a31d7ce5ff7f: Request end of tablet copy session 1109f76a0b7b443a84c0327c8707bc63-13bc3c8ff9b84838a2664335d7e1582b received from {username='slave'} at 127.0.0.1:39674
I20260709 13:08:30.918057 16217 tablet_copy_service.cc:434] P e10b16d536674c0bb350a31d7ce5ff7f: ending tablet copy session 1109f76a0b7b443a84c0327c8707bc63-13bc3c8ff9b84838a2664335d7e1582b on tablet 13bc3c8ff9b84838a2664335d7e1582b with peer 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:08:30.919958 23147 raft_consensus.cc:359] T cad5db410b3444caafa5090b94f02dba P 1109f76a0b7b443a84c0327c8707bc63 [term 17 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:08:30.932158 23147 raft_consensus.cc:740] T cad5db410b3444caafa5090b94f02dba P 1109f76a0b7b443a84c0327c8707bc63 [term 17 LEARNER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Initialized, Role: LEARNER
I20260709 13:08:30.938189 23147 consensus_queue.cc:260] T cad5db410b3444caafa5090b94f02dba P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:08:30.945477 16941 raft_consensus.cc:1217] T 13bc3c8ff9b84838a2664335d7e1582b P 1109f76a0b7b443a84c0327c8707bc63 [term 11 LEARNER]: Deduplicated request from leader. Original: 11.8->[11.9-11.9]   Dedup: 11.9->[]
I20260709 13:08:30.954487 23147 ts_tablet_manager.cc:1434] T cad5db410b3444caafa5090b94f02dba P 1109f76a0b7b443a84c0327c8707bc63: Time spent starting tablet: real 0.067s	user 0.007s	sys 0.000s
I20260709 13:08:30.980508 16941 raft_consensus.cc:3060] T cad5db410b3444caafa5090b94f02dba P 1109f76a0b7b443a84c0327c8707bc63 [term 17 LEARNER]: Advancing to term 18
I20260709 13:08:30.970305 16103 catalog_manager.cc:5697] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f reported cstate change: term changed from 18 to 19, leader changed from 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) to e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65). New cstate: current_term: 19 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:30.983471 16104 catalog_manager.cc:5697] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 19 to 20, leader changed from 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) to 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66). New cstate: current_term: 20 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:30.997107 16279 raft_consensus.cc:1275] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 22 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:08:31.000133 23192 consensus_queue.cc:1048] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:08:31.011829 16941 raft_consensus.cc:1275] T cad5db410b3444caafa5090b94f02dba P 1109f76a0b7b443a84c0327c8707bc63 [term 18 LEARNER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:08:31.019210 16356 raft_consensus.cc:1275] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:08:31.021307 16354 raft_consensus.cc:1275] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 20 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:08:31.022878 16367 tablet_copy_service.cc:342] P 363bb2f744eb486f9ad726f08214c98e: Request end of tablet copy session 1109f76a0b7b443a84c0327c8707bc63-cad5db410b3444caafa5090b94f02dba received from {username='slave'} at 127.0.0.1:33486
I20260709 13:08:31.042802 16367 tablet_copy_service.cc:434] P 363bb2f744eb486f9ad726f08214c98e: ending tablet copy session 1109f76a0b7b443a84c0327c8707bc63-cad5db410b3444caafa5090b94f02dba on tablet cad5db410b3444caafa5090b94f02dba with peer 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:08:31.047323 23201 consensus_queue.cc:1048] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:08:31.046051 23141 raft_consensus.cc:2955] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [term 17 LEADER]: Committing config change with OpId 17.13: config changed from index 11 to 13, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:08:31.095654 15057 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:08:31.109629 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 62064.1us
W20260709 13:08:31.114885 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 71109.5us
I20260709 13:08:31.117971 23098 consensus_queue.cc:1048] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:08:31.130313 16203 raft_consensus.cc:1275] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 20 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:08:31.129231 16348 raft_consensus.cc:2955] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index 11 to 13, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:08:31.143759 23127 consensus_queue.cc:1048] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:08:31.155040 23166 consensus_queue.cc:1048] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.029s
I20260709 13:08:31.228473 16279 raft_consensus.cc:2955] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index 11 to 13, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:08:31.241998 16941 raft_consensus.cc:1217] T 8cabbc283ea543459d45ebdb8b6add94 P 1109f76a0b7b443a84c0327c8707bc63 [term 22 LEARNER]: Deduplicated request from leader. Original: 22.12->[22.13-22.13]   Dedup: 22.13->[]
I20260709 13:08:31.247139 23193 raft_consensus.cc:1064] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f: attempting to promote NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 to VOTER
I20260709 13:08:31.247298 16281 raft_consensus.cc:1275] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
W20260709 13:08:31.248000 23193 raft_consensus.cc:1068] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f: Unable to promote non-voter 1109f76a0b7b443a84c0327c8707bc63: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:08:31.251926 16941 raft_consensus.cc:2955] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 1109f76a0b7b443a84c0327c8707bc63 [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index 11 to 13, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:08:31.268203 23192 consensus_queue.cc:1048] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:08:31.326713 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 182327us
I20260709 13:08:31.412586 16348 raft_consensus.cc:1275] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 22 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:08:31.443676 16104 catalog_manager.cc:5697] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: config changed from index 11 to 13, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New cstate: current_term: 17 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
W20260709 13:08:31.451910 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 120892us
W20260709 13:08:31.467819 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 123605us
W20260709 13:08:31.698895 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 216924us
W20260709 13:08:31.702980 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 54208.6us
W20260709 13:08:31.685688 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 208080us
W20260709 13:08:31.750720 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 50189.6us
W20260709 13:08:31.752533 23190 log.cc:927] Time spent T 00000000000000000000000000000000 P 4dc6f08597514f4d85fd451b999b403e: Append to log took a long time: real 0.051s	user 0.000s	sys 0.005s
I20260709 13:08:31.808094 16200 consensus_queue.cc:237] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:08:31.834769 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 91566.2us
I20260709 13:08:31.835599 23121 consensus_queue.cc:1048] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:08:31.878329 16276 raft_consensus.cc:1275] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:08:32.012275 16948 raft_consensus.cc:1275] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 1109f76a0b7b443a84c0327c8707bc63 [term 17 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
W20260709 13:08:32.014402 16172 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:32.039516 16278 raft_consensus.cc:1275] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:08:32.075052 23239 raft_consensus.cc:1064] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3: attempting to promote NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 to VOTER
I20260709 13:08:32.110916 23141 raft_consensus.cc:1064] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f: attempting to promote NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 to VOTER
I20260709 13:08:32.107213 23121 consensus_queue.cc:1048] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.020s
I20260709 13:08:32.130903 23110 raft_consensus.cc:1064] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f: attempting to promote NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 to VOTER
I20260709 13:08:32.131556 23141 consensus_queue.cc:237] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 12, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:32.152961 23110 consensus_queue.cc:237] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 7, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:32.153146 23239 consensus_queue.cc:237] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 11, Current term: 22, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:32.191598 23201 consensus_queue.cc:1048] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:32.213176 16204 raft_consensus.cc:1275] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 22 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:08:32.217332 16941 raft_consensus.cc:1275] T 8cabbc283ea543459d45ebdb8b6add94 P 1109f76a0b7b443a84c0327c8707bc63 [term 22 LEARNER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:08:32.217867 16349 raft_consensus.cc:1275] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 22 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:08:32.221211 23096 consensus_queue.cc:1048] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:08:32.233625 23142 consensus_queue.cc:1048] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:08:32.237962 23096 consensus_queue.cc:1048] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:08:32.238765 23141 consensus_queue.cc:1048] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:08:32.282049 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 60813.8us
I20260709 13:08:32.286652 16944 raft_consensus.cc:1275] T 13bc3c8ff9b84838a2664335d7e1582b P 1109f76a0b7b443a84c0327c8707bc63 [term 11 LEARNER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 13:08:32.331620 16174 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:32.335973 23189 raft_consensus.cc:493] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:32.336908 23189 raft_consensus.cc:515] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:32.345609 16349 raft_consensus.cc:1275] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:08:32.346160 16348 raft_consensus.cc:1275] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:08:32.346650 16948 raft_consensus.cc:1275] T cad5db410b3444caafa5090b94f02dba P 1109f76a0b7b443a84c0327c8707bc63 [term 18 LEARNER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:08:32.347671 16355 raft_consensus.cc:1275] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:08:32.359122 15057 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:32.377866 23189 leader_election.cc:290] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:32.380086 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
W20260709 13:08:32.429554 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 73023us
I20260709 13:08:32.492996 23223 consensus_queue.cc:1048] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 13:08:32.495256 23223 consensus_queue.cc:1048] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:08:32.510651 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 50649.6us
I20260709 13:08:32.517125 16281 raft_consensus.cc:1275] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:08:32.534729 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:32.517060 23240 consensus_queue.cc:1048] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.076s
I20260709 13:08:32.546280 16322 leader_election.cc:304] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:32.547398 23220 raft_consensus.cc:2749] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:08:32.579876 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 69928.3us
I20260709 13:08:32.593928 23096 raft_consensus.cc:2955] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 22 LEADER]: Committing config change with OpId 22.14: config changed from index 13 to 14, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:08:32.603129 23240 raft_consensus.cc:2955] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [term 17 LEADER]: Committing config change with OpId 17.14: config changed from index 13 to 14, VOTER 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:08:32.604827 23141 consensus_queue.cc:1048] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:08:32.596359 16941 raft_consensus.cc:2955] T 8cabbc283ea543459d45ebdb8b6add94 P 1109f76a0b7b443a84c0327c8707bc63 [term 22 FOLLOWER]: Committing config change with OpId 22.14: config changed from index 13 to 14, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:08:32.598521 23256 consensus_queue.cc:1048] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:32.622408 16352 raft_consensus.cc:2955] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 22 FOLLOWER]: Committing config change with OpId 22.14: config changed from index 13 to 14, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:08:32.627002 16944 raft_consensus.cc:2955] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 1109f76a0b7b443a84c0327c8707bc63 [term 17 FOLLOWER]: Committing config change with OpId 17.14: config changed from index 13 to 14, VOTER 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:08:32.652042 23192 consensus_queue.cc:1048] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:08:32.659729 16279 raft_consensus.cc:1275] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:08:32.703166 23141 raft_consensus.cc:2955] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 18 LEADER]: Committing config change with OpId 18.14: config changed from index 12 to 14, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:08:32.742512 16355 raft_consensus.cc:2955] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Committing config change with OpId 18.14: config changed from index 12 to 14, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:08:32.759281 23121 consensus_queue.cc:1048] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.083s
W20260709 13:08:32.854703 23255 log.cc:927] Time spent T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:08:32.887199 16105 catalog_manager.cc:5697] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: config changed from index 13 to 14, VOTER 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) evicted. New cstate: current_term: 17 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:08:32.933933 16281 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f"
dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
mode: GRACEFUL
new_leader_uuid: "363bb2f744eb486f9ad726f08214c98e"
 from {username='slave'} at 127.0.0.1:39058
I20260709 13:08:32.934783 16281 raft_consensus.cc:606] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 LEADER]: Received request to transfer leadership to TS 363bb2f744eb486f9ad726f08214c98e
W20260709 13:08:33.010761 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 250193us
I20260709 13:08:33.033962 16104 catalog_manager.cc:5697] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e reported cstate change: config changed from index 13 to 14, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New cstate: current_term: 22 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:08:33.031993 23240 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:44830 (request call id 3) took 1245 ms. Trace:
I20260709 13:08:33.042968 23240 rpcz_store.cc:276] 0709 13:08:31.770210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:31.775628 (+  5418us) service_pool.cc:224] Handling call
0709 13:08:31.846861 (+ 71233us) log.cc:844] Serialized 501 byte log entry
0709 13:08:33.015963 (+1169102us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":323,"raft.run_cpu_time_us":1280,"raft.run_wall_time_us":1281,"spinlock_wait_cycles":123648}
I20260709 13:08:33.048861 16090 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet eafb6ab8cb0c42309ea6508e0ad9b9ef with cas_config_opid_index 13: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:08:33.082453 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 61012.5us
I20260709 13:08:33.095832 16201 raft_consensus.cc:2955] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 22 FOLLOWER]: Committing config change with OpId 22.14: config changed from index 13 to 14, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:08:33.172863 16945 raft_consensus.cc:2955] T cad5db410b3444caafa5090b94f02dba P 1109f76a0b7b443a84c0327c8707bc63 [term 18 FOLLOWER]: Committing config change with OpId 18.14: config changed from index 12 to 14, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:08:33.178126 23219 raft_consensus.cc:993] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3: : Instructing follower 363bb2f744eb486f9ad726f08214c98e to start an election
I20260709 13:08:33.178752 23219 raft_consensus.cc:1081] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 LEADER]: Signalling peer 363bb2f744eb486f9ad726f08214c98e to start an election
I20260709 13:08:33.185806 16281 raft_consensus.cc:2955] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Committing config change with OpId 18.14: config changed from index 12 to 14, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:08:33.200574 16351 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f"
dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
 from {username='slave'} at 127.0.0.1:41830
I20260709 13:08:33.201295 16351 raft_consensus.cc:493] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:33.201646 16351 raft_consensus.cc:3060] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:33.234400 16351 raft_consensus.cc:515] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:33.237154 23223 raft_consensus.cc:2955] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [term 11 LEADER]: Committing config change with OpId 11.10: config changed from index 9 to 10, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:08:33.264096 16281 raft_consensus.cc:2955] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Committing config change with OpId 17.14: config changed from index 13 to 14, VOTER 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:08:33.448638 16351 leader_election.cc:290] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 20 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:08:33.469998 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 182230us
I20260709 13:08:33.510607 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: true dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:33.511723 16279 raft_consensus.cc:3055] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:08:33.512053 16279 raft_consensus.cc:740] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:08:33.512946 16279 consensus_queue.cc:260] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:33.514369 16279 raft_consensus.cc:3060] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:08:33.522785 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 50369us
I20260709 13:08:33.537091 16201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: true dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:08:33.538017 16201 raft_consensus.cc:3060] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:33.538092 16200 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953"
dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
mode: GRACEFUL
new_leader_uuid: "363bb2f744eb486f9ad726f08214c98e"
 from {username='slave'} at 127.0.0.1:35456
I20260709 13:08:33.538800 16200 raft_consensus.cc:606] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 LEADER]: Received request to transfer leadership to TS 363bb2f744eb486f9ad726f08214c98e
I20260709 13:08:33.557578 16355 raft_consensus.cc:2955] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 9 to 10, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:08:33.586261 23218 raft_consensus.cc:493] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:08:33.586982 23218 raft_consensus.cc:515] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:33.589823 23218 leader_election.cc:290] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:33.591166 16280 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7295dce0baa440b8a197da845581ee81"
dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
mode: GRACEFUL
new_leader_uuid: "1109f76a0b7b443a84c0327c8707bc63"
 from {username='slave'} at 127.0.0.1:39058
I20260709 13:08:33.591856 16280 raft_consensus.cc:606] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 LEADER]: Received request to transfer leadership to TS 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:08:33.611891 16279 raft_consensus.cc:2468] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 20.
I20260709 13:08:33.594156 16277 raft_consensus.cc:2955] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 9 to 10, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:08:33.633018 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:33.614024 16201 raft_consensus.cc:2468] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 20.
W20260709 13:08:33.636948 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 78294.3us
W20260709 13:08:33.685858 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 127802us
I20260709 13:08:33.698176 16320 leader_election.cc:304] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:33.701401 23266 raft_consensus.cc:2804] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:08:33.701998 23266 raft_consensus.cc:697] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 20 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:08:33.702886 23266 consensus_queue.cc:237] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:08:33.707700 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 130555us
I20260709 13:08:33.718778 23223 raft_consensus.cc:993] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f: : Instructing follower 363bb2f744eb486f9ad726f08214c98e to start an election
I20260709 13:08:33.719404 23223 raft_consensus.cc:1081] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 LEADER]: Signalling peer 363bb2f744eb486f9ad726f08214c98e to start an election
I20260709 13:08:33.719515 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:33.722179 16945 raft_consensus.cc:2955] T 13bc3c8ff9b84838a2664335d7e1582b P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 9 to 10, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:08:33.728600 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:33.746671 16338 tablet_service.cc:1558] Processing DeleteTablet for tablet eafb6ab8cb0c42309ea6508e0ad9b9ef with delete_type TABLET_DATA_TOMBSTONED (TS 363bb2f744eb486f9ad726f08214c98e not found in new config with opid_index 14) from {username='slave'} at 127.0.0.1:51696
I20260709 13:08:33.767781 16355 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4"
dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
mode: GRACEFUL
new_leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
 from {username='slave'} at 127.0.0.1:56792
I20260709 13:08:33.768780 16355 raft_consensus.cc:606] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 14 LEADER]: Received request to transfer leadership to TS 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:08:33.772948 16322 leader_election.cc:304] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:33.774827 22813 raft_consensus.cc:2749] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:33.791873 16351 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953"
dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
 from {username='slave'} at 127.0.0.1:41832
I20260709 13:08:33.792636 16351 raft_consensus.cc:493] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:33.793042 16351 raft_consensus.cc:3060] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:33.811331 16277 consensus_queue.cc:237] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:33.821734 16944 raft_consensus.cc:1275] T 8cabbc283ea543459d45ebdb8b6add94 P 1109f76a0b7b443a84c0327c8707bc63 [term 22 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:08:33.825064 23258 consensus_queue.cc:1048] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:08:33.833851 16204 raft_consensus.cc:1275] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 22 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:08:33.837425 23202 consensus_queue.cc:1048] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:08:33.837126 16948 raft_consensus.cc:2955] T 8cabbc283ea543459d45ebdb8b6add94 P 1109f76a0b7b443a84c0327c8707bc63 [term 22 FOLLOWER]: Committing config change with OpId 22.15: config changed from index 14 to 15, VOTER 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:08:33.840804 16103 catalog_manager.cc:5697] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: config changed from index 12 to 14, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New cstate: current_term: 18 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:08:33.835556 23142 raft_consensus.cc:2955] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 22 LEADER]: Committing config change with OpId 22.15: config changed from index 14 to 15, VOTER 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:08:33.844637 16200 raft_consensus.cc:2955] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 22 FOLLOWER]: Committing config change with OpId 22.15: config changed from index 14 to 15, VOTER 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:08:33.856458 16103 catalog_manager.cc:5697] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: config changed from index 9 to 10, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New cstate: current_term: 11 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:08:33.900275 16092 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8cabbc283ea543459d45ebdb8b6add94 with cas_config_opid_index 14: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:33.926931 16351 raft_consensus.cc:515] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:33.928344 16355 raft_consensus.cc:1240] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:33.939335 16351 leader_election.cc:290] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:33.942183 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:08:33.942971 16200 raft_consensus.cc:3055] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:33.943305 16200 raft_consensus.cc:740] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:08:33.948339 16204 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8b615ac918a749989f2968826926adf3"
dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
mode: GRACEFUL
new_leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
 from {username='slave'} at 127.0.0.1:35456
I20260709 13:08:33.949133 16204 raft_consensus.cc:606] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 16 LEADER]: Received request to transfer leadership to TS 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:08:33.949733 16200 consensus_queue.cc:260] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:33.951190 16200 raft_consensus.cc:3060] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:33.965925 16200 raft_consensus.cc:2468] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 15.
I20260709 13:08:33.976645 23294 tablet_replica.cc:333] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e: stopping tablet replica
I20260709 13:08:33.969852 15057 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:08:33.974159 16320 leader_election.cc:304] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:33.983892 15057 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:33.979300 23294 raft_consensus.cc:2243] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:34.009917 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:34.010656 16282 raft_consensus.cc:3060] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:33.999061 23218 raft_consensus.cc:2804] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:08:34.022903 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 78649.4us
I20260709 13:08:34.025473 23294 raft_consensus.cc:2272] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:34.028574 23294 ts_tablet_manager.cc:1916] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:34.035892 23218 raft_consensus.cc:697] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 15 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:08:34.047914 23218 consensus_queue.cc:237] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:34.050105 16104 catalog_manager.cc:5697] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e reported cstate change: term changed from 19 to 20, leader changed from 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) to 363bb2f744eb486f9ad726f08214c98e (127.14.180.67). New cstate: current_term: 20 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:34.068512 16282 raft_consensus.cc:2468] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 15.
I20260709 13:08:34.097307 23258 raft_consensus.cc:993] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3: : Instructing follower 1109f76a0b7b443a84c0327c8707bc63 to start an election
I20260709 13:08:34.097865 23258 raft_consensus.cc:1081] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 LEADER]: Signalling peer 1109f76a0b7b443a84c0327c8707bc63 to start an election
I20260709 13:08:34.107338 16948 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7295dce0baa440b8a197da845581ee81"
dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
 from {username='slave'} at 127.0.0.1:40078
I20260709 13:08:34.107931 16948 raft_consensus.cc:493] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:34.108300 16948 raft_consensus.cc:3060] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:34.118059 16103 catalog_manager.cc:5697] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: config changed from index 14 to 15, VOTER 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) evicted. New cstate: current_term: 22 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:34.133848 16948 raft_consensus.cc:515] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:34.138273 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: true dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:34.139070 16282 raft_consensus.cc:3055] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:34.139459 16282 raft_consensus.cc:740] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:08:34.140334 16282 consensus_queue.cc:260] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:34.141594 16282 raft_consensus.cc:3060] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:34.148981 16282 raft_consensus.cc:2468] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 15.
I20260709 13:08:34.175009 16105 catalog_manager.cc:5697] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e reported cstate change: term changed from 14 to 15, leader changed from e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) to 363bb2f744eb486f9ad726f08214c98e (127.14.180.67). New cstate: current_term: 15 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:34.176005 16914 leader_election.cc:304] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:08:34.178754 23285 raft_consensus.cc:2804] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:34.179323 23285 raft_consensus.cc:697] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [term 15 LEADER]: Becoming Leader. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:08:34.180194 23285 consensus_queue.cc:237] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:34.181740 16204 consensus_queue.cc:237] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:34.189677 16279 raft_consensus.cc:1275] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:08:34.193876 16945 raft_consensus.cc:1275] T 13bc3c8ff9b84838a2664335d7e1582b P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:08:34.194031 16338 tablet_service.cc:1558] Processing DeleteTablet for tablet 8cabbc283ea543459d45ebdb8b6add94 with delete_type TABLET_DATA_TOMBSTONED (TS 363bb2f744eb486f9ad726f08214c98e not found in new config with opid_index 15) from {username='slave'} at 127.0.0.1:51696
I20260709 13:08:34.195513 23223 consensus_queue.cc:1048] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:34.198619 16204 raft_consensus.cc:1275] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 20 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:08:34.198757 23141 consensus_queue.cc:1048] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:34.201457 23220 consensus_queue.cc:1048] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:08:34.151945 16948 leader_election.cc:290] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 15 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:34.167078 23294 ts_tablet_manager.cc:1929] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 17.13
I20260709 13:08:34.167404 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: true dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:34.204273 16348 raft_consensus.cc:3060] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:34.203833 23294 log.cc:1199] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 363bb2f744eb486f9ad726f08214c98e: Deleting WAL directory at /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602283040513-15057-0/minicluster-data/ts-2-root/wals/eafb6ab8cb0c42309ea6508e0ad9b9ef
I20260709 13:08:34.210426 23294 tablet_replica.cc:333] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e: stopping tablet replica
I20260709 13:08:34.210811 16092 catalog_manager.cc:5028] TS 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): tablet eafb6ab8cb0c42309ea6508e0ad9b9ef (table test-workload [id=f364cfe226234c5b99453e3013c8717e]) successfully deleted
I20260709 13:08:34.212868 23294 raft_consensus.cc:2243] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:34.215471 23294 raft_consensus.cc:2272] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:34.171600 16200 consensus_queue.cc:237] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:34.219558 23267 raft_consensus.cc:2955] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [term 11 LEADER]: Committing config change with OpId 11.11: config changed from index 10 to 11, VOTER 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:08:34.236217 16948 raft_consensus.cc:2955] T 13bc3c8ff9b84838a2664335d7e1582b P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Committing config change with OpId 11.11: config changed from index 10 to 11, VOTER 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:08:34.221864 16348 raft_consensus.cc:2468] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 15.
I20260709 13:08:34.223115 16279 raft_consensus.cc:2955] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Committing config change with OpId 11.11: config changed from index 10 to 11, VOTER 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:08:34.254879 16090 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 13bc3c8ff9b84838a2664335d7e1582b with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:34.269642 16281 raft_consensus.cc:1275] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:08:34.279457 23282 raft_consensus.cc:993] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f: : Instructing follower 0aea40d6e4374085a2e38a70a71f63e3 to start an election
I20260709 13:08:34.280592 23282 raft_consensus.cc:1081] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 16 LEADER]: Signalling peer 0aea40d6e4374085a2e38a70a71f63e3 to start an election
I20260709 13:08:34.283095 23294 ts_tablet_manager.cc:1916] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:34.284242 16103 catalog_manager.cc:5697] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: term changed from 14 to 15, leader changed from 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) to 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68). New cstate: current_term: 15 leader_uuid: "1109f76a0b7b443a84c0327c8707bc63" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:34.286031 16105 catalog_manager.cc:5697] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f reported cstate change: config changed from index 10 to 11, VOTER 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) evicted. New cstate: current_term: 11 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:34.295554 16280 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8b615ac918a749989f2968826926adf3"
dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
 from {username='slave'} at 127.0.0.1:45218
I20260709 13:08:34.296320 16280 raft_consensus.cc:493] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:34.296696 16280 raft_consensus.cc:3060] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:34.308656 16944 raft_consensus.cc:1275] T cad5db410b3444caafa5090b94f02dba P 1109f76a0b7b443a84c0327c8707bc63 [term 18 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:08:34.317118 23287 raft_consensus.cc:993] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e: : Instructing follower 0aea40d6e4374085a2e38a70a71f63e3 to start an election
I20260709 13:08:34.317777 23287 raft_consensus.cc:1081] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 14 LEADER]: Signalling peer 0aea40d6e4374085a2e38a70a71f63e3 to start an election
I20260709 13:08:34.352614 16338 tablet_service.cc:1558] Processing DeleteTablet for tablet 13bc3c8ff9b84838a2664335d7e1582b with delete_type TABLET_DATA_TOMBSTONED (TS 363bb2f744eb486f9ad726f08214c98e not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:51696
I20260709 13:08:34.352895 16280 raft_consensus.cc:515] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:34.360483 23141 consensus_queue.cc:1048] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:08:34.363426 23287 consensus_queue.cc:1048] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:08:34.368090 16351 raft_consensus.cc:1275] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:08:34.371595 16282 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4"
dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
 from {username='slave'} at 127.0.0.1:45210
I20260709 13:08:34.372218 16282 raft_consensus.cc:493] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:34.372547 16282 raft_consensus.cc:3060] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:34.390136 16280 leader_election.cc:290] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 17 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:34.392829 16200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: true dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:08:34.393533 16200 raft_consensus.cc:3055] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:34.393854 16200 raft_consensus.cc:740] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:08:34.394862 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: true dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:08:34.394766 16200 consensus_queue.cc:260] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:34.395591 16944 raft_consensus.cc:3060] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:34.396112 16200 raft_consensus.cc:3060] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:34.420581 16282 raft_consensus.cc:515] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:34.429656 16200 raft_consensus.cc:2468] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 17.
I20260709 13:08:34.431387 16246 leader_election.cc:304] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:34.434266 23202 raft_consensus.cc:2804] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:34.435091 23202 raft_consensus.cc:697] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:08:34.436057 23202 consensus_queue.cc:237] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:34.446324 16944 raft_consensus.cc:2468] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 17.
I20260709 13:08:34.450718 16204 raft_consensus.cc:1275] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:08:34.453640 23287 consensus_queue.cc:1048] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:34.572992 16206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:08:34.573625 16206 raft_consensus.cc:3060] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:34.577353 16282 leader_election.cc:290] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 15 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:34.578423 16945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:08:34.579092 16945 raft_consensus.cc:3060] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:34.618304 23240 consensus_queue.cc:1048] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:08:34.623574 23223 raft_consensus.cc:2955] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 18 LEADER]: Committing config change with OpId 18.15: config changed from index 14 to 15, VOTER 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:08:34.625762 16282 raft_consensus.cc:1275] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:08:34.624032 16103 catalog_manager.cc:5697] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 16 to 17, leader changed from e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) to 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66). New cstate: current_term: 17 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:34.627127 16206 raft_consensus.cc:2468] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 15.
I20260709 13:08:34.636118 23217 consensus_queue.cc:1048] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:34.652051 16277 raft_consensus.cc:1240] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:34.660950 16945 raft_consensus.cc:2468] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 15.
I20260709 13:08:34.679674 16248 leader_election.cc:304] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:34.699141 16945 raft_consensus.cc:2955] T cad5db410b3444caafa5090b94f02dba P 1109f76a0b7b443a84c0327c8707bc63 [term 18 FOLLOWER]: Committing config change with OpId 18.15: config changed from index 14 to 15, VOTER 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:08:34.713892 23142 raft_consensus.cc:2804] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:08:34.734858 23304 log.cc:927] Time spent T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:08:34.748948 23142 raft_consensus.cc:697] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:08:34.791451 23142 consensus_queue.cc:237] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:08:34.792786 23306 log.cc:927] Time spent T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
I20260709 13:08:34.777585 16090 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet cad5db410b3444caafa5090b94f02dba with cas_config_opid_index 14: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:08:34.833374 16090 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 55826.4us
W20260709 13:08:34.919188 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 54220.6us
W20260709 13:08:34.925736 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 195272us
I20260709 13:08:34.941959 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:34.952131 16351 raft_consensus.cc:3055] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:34.952636 16351 raft_consensus.cc:740] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
W20260709 13:08:34.940770 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 189676us
I20260709 13:08:34.964426 16348 raft_consensus.cc:1275] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:08:34.943143 23294 ts_tablet_manager.cc:1929] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 22.14
I20260709 13:08:34.969697 16351 consensus_queue.cc:260] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:35.004993 23294 log.cc:1199] T 8cabbc283ea543459d45ebdb8b6add94 P 363bb2f744eb486f9ad726f08214c98e: Deleting WAL directory at /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602283040513-15057-0/minicluster-data/ts-2-root/wals/8cabbc283ea543459d45ebdb8b6add94
I20260709 13:08:35.046197 15057 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:08:35.046448 16322 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:35.138337 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 74254.3us
I20260709 13:08:35.150818 16351 raft_consensus.cc:3060] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:35.154002 16103 catalog_manager.cc:5697] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f reported cstate change: config changed from index 14 to 15, VOTER 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) evicted. New cstate: current_term: 18 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:35.170477 23294 tablet_replica.cc:333] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e: stopping tablet replica
I20260709 13:08:35.171772 23294 raft_consensus.cc:2243] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:35.173605 16092 catalog_manager.cc:5028] TS 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): tablet 8cabbc283ea543459d45ebdb8b6add94 (table test-workload [id=f364cfe226234c5b99453e3013c8717e]) successfully deleted
I20260709 13:08:35.172725 23294 raft_consensus.cc:2272] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:35.200188 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 147662us
I20260709 13:08:35.208782 16945 raft_consensus.cc:1275] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 17 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:08:35.236645 23294 ts_tablet_manager.cc:1916] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:35.258723 16201 raft_consensus.cc:1240] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Rejecting Update request from peer 363bb2f744eb486f9ad726f08214c98e for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:35.259372 16351 raft_consensus.cc:2468] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 15.
I20260709 13:08:35.255903 23142 consensus_queue.cc:1048] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.005s
I20260709 13:08:35.270779 23322 raft_consensus.cc:493] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:08:35.271415 23322 raft_consensus.cc:515] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:35.277690 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:35.274679 23322 leader_election.cc:290] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:08:35.289597 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 58117.6us
I20260709 13:08:35.306659 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:08:35.360890 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 46821.3us
I20260709 13:08:35.363513 16349 raft_consensus.cc:1275] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:08:35.410709 16248 leader_election.cc:304] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:08:35.411780 23257 raft_consensus.cc:2749] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:35.412525 23257 consensus_queue.cc:1048] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:35.417034 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" is_pre_election: true
I20260709 13:08:35.417513 16201 raft_consensus.cc:1275] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
W20260709 13:08:35.428087 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 455752us
I20260709 13:08:35.465065 16201 raft_consensus.cc:1275] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:08:35.487401 23296 consensus_queue.cc:1048] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:08:35.515619 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 48345.9us
I20260709 13:08:35.518911 16283 raft_consensus.cc:1275] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
W20260709 13:08:35.528834 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 44301.4us
I20260709 13:08:35.537756 23294 ts_tablet_manager.cc:1929] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 11.10
I20260709 13:08:35.538288 23294 log.cc:1199] T 13bc3c8ff9b84838a2664335d7e1582b P 363bb2f744eb486f9ad726f08214c98e: Deleting WAL directory at /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602283040513-15057-0/minicluster-data/ts-2-root/wals/13bc3c8ff9b84838a2664335d7e1582b
I20260709 13:08:35.539556 23294 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:51696 (request call id 8) took 1187 ms. Trace:
I20260709 13:08:35.539974 23294 rpcz_store.cc:276] 0709 13:08:34.351887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:34.352365 (+   478us) service_pool.cc:224] Handling call
0709 13:08:35.170139 (+817774us) ts_tablet_manager.cc:1151] Deleting tablet 13bc3c8ff9b84838a2664335d7e1582b
0709 13:08:35.170194 (+    55us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:08:35.489111 (+318917us) tablet_metadata.cc:665] Metadata flushed
0709 13:08:35.537619 (+ 48508us) tablet_metadata.cc:665] Metadata flushed
0709 13:08:35.539451 (+  1832us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":816829}
I20260709 13:08:35.542565 16092 catalog_manager.cc:5028] TS 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): tablet 13bc3c8ff9b84838a2664335d7e1582b (table test-workload [id=f364cfe226234c5b99453e3013c8717e]) successfully deleted
I20260709 13:08:35.547879 23220 consensus_queue.cc:1048] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:35.569818 23257 consensus_queue.cc:1048] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:08:35.573139 16349 raft_consensus.cc:2955] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Committing config change with OpId 18.15: config changed from index 14 to 15, VOTER 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:08:35.598677 23257 consensus_queue.cc:1048] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:35.584318 16105 catalog_manager.cc:5697] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 14 to 15, leader changed from 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) to 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66). New cstate: current_term: 15 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:35.634450 16941 raft_consensus.cc:1275] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:08:35.660533 23351 consensus_queue.cc:1048] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:35.755658 16270 tablet_service.cc:1558] Processing DeleteTablet for tablet cad5db410b3444caafa5090b94f02dba with delete_type TABLET_DATA_TOMBSTONED (TS 0aea40d6e4374085a2e38a70a71f63e3 not found in new config with opid_index 15) from {username='slave'} at 127.0.0.1:45374
I20260709 13:08:35.865994 23363 tablet_replica.cc:333] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3: stopping tablet replica
I20260709 13:08:35.867300 23363 raft_consensus.cc:2243] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:35.868822 23363 raft_consensus.cc:2272] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:35.871942 23363 ts_tablet_manager.cc:1916] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:35.925571 23363 ts_tablet_manager.cc:1929] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 18.14
I20260709 13:08:35.926123 23363 log.cc:1199] T cad5db410b3444caafa5090b94f02dba P 0aea40d6e4374085a2e38a70a71f63e3: Deleting WAL directory at /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602283040513-15057-0/minicluster-data/ts-1-root/wals/cad5db410b3444caafa5090b94f02dba
I20260709 13:08:35.928376 16092 catalog_manager.cc:5028] TS 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): tablet cad5db410b3444caafa5090b94f02dba (table test-workload [id=f364cfe226234c5b99453e3013c8717e]) successfully deleted
W20260709 13:08:36.523609 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 68757.1us
I20260709 13:08:36.572595 15057 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:36.728050 16349 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f"
dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
mode: GRACEFUL
new_leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
 from {username='slave'} at 127.0.0.1:56792
I20260709 13:08:36.728714 16349 raft_consensus.cc:606] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 20 LEADER]: Received request to transfer leadership to TS 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:08:36.749280 16350 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "186b9e9483624c769871a8894ee07efa"
dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
mode: GRACEFUL
new_leader_uuid: "1109f76a0b7b443a84c0327c8707bc63"
 from {username='slave'} at 127.0.0.1:56792
I20260709 13:08:36.749927 16350 raft_consensus.cc:606] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 14 LEADER]: Received request to transfer leadership to TS 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:08:36.755596 16280 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d"
dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
mode: GRACEFUL
new_leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
 from {username='slave'} at 127.0.0.1:39058
I20260709 13:08:36.756281 16280 raft_consensus.cc:606] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 LEADER]: Received request to transfer leadership to TS e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:36.761704 16280 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157"
dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
mode: GRACEFUL
new_leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
 from {username='slave'} at 127.0.0.1:39058
I20260709 13:08:36.762257 16280 raft_consensus.cc:606] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 LEADER]: Received request to transfer leadership to TS e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:36.767668 15057 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:08:36.769695 15057 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:08:36.972483 16154 auto_rebalancer.cc:629] Failed to schedule move for tablet c824093f8d374c1b9f3c8a6e8e711157: Remote error: Service unavailable: leader transfer in progress
I20260709 13:08:36.978256 16280 consensus_queue.cc:237] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:08:36.984365 23365 raft_consensus.cc:993] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e: : Instructing follower 1109f76a0b7b443a84c0327c8707bc63 to start an election
I20260709 13:08:36.987960 23365 raft_consensus.cc:1081] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 14 LEADER]: Signalling peer 1109f76a0b7b443a84c0327c8707bc63 to start an election
I20260709 13:08:36.990108 16941 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "186b9e9483624c769871a8894ee07efa"
dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
 from {username='slave'} at 127.0.0.1:35122
I20260709 13:08:36.990862 16941 raft_consensus.cc:493] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:36.991279 16941 raft_consensus.cc:3060] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:37.019182 16941 raft_consensus.cc:515] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:37.021922 16941 leader_election.cc:290] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 15 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:37.022789 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: true dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:08:37.023470 16199 raft_consensus.cc:3060] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:37.031011 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: true dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:37.031731 16349 raft_consensus.cc:3055] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:37.032047 16349 raft_consensus.cc:740] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:08:37.032759 16349 consensus_queue.cc:260] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:37.035915 16349 raft_consensus.cc:3060] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:37.054992 16199 raft_consensus.cc:2468] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 15.
I20260709 13:08:37.076740 16912 leader_election.cc:304] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:37.077822 23296 raft_consensus.cc:2804] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:37.078727 23296 raft_consensus.cc:697] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 15 LEADER]: Becoming Leader. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:08:37.079998 23296 consensus_queue.cc:237] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:08:37.086385 16248 consensus_peers.cc:597] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 -> Peer 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875): Couldn't send request to peer 1109f76a0b7b443a84c0327c8707bc63. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: abbbc04ca95a4119a7e3fb64073fe61f. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:37.091856 16199 raft_consensus.cc:1275] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 20 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:08:37.093132 23367 raft_consensus.cc:993] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3: : Instructing follower e10b16d536674c0bb350a31d7ce5ff7f to start an election
I20260709 13:08:37.098412 23367 raft_consensus.cc:1081] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 LEADER]: Signalling peer e10b16d536674c0bb350a31d7ce5ff7f to start an election
I20260709 13:08:37.101774 23367 consensus_queue.cc:1048] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:08:37.105031 16200 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d"
dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
 from {username='slave'} at 127.0.0.1:60138
I20260709 13:08:37.105769 16200 raft_consensus.cc:493] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 20 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:37.106122 16200 raft_consensus.cc:3060] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:37.096203 16349 raft_consensus.cc:2468] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 15.
I20260709 13:08:37.120400 16200 raft_consensus.cc:515] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 21 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:37.128988 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: true dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:37.129639 16280 raft_consensus.cc:3055] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:08:37.129961 16280 raft_consensus.cc:740] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:08:37.130291 16200 leader_election.cc:290] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 21 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:37.130939 16280 consensus_queue.cc:260] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:37.133517 16280 raft_consensus.cc:3060] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:37.136364 23367 raft_consensus.cc:993] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3: : Instructing follower e10b16d536674c0bb350a31d7ce5ff7f to start an election
I20260709 13:08:37.137044 23323 raft_consensus.cc:1081] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 LEADER]: Signalling peer e10b16d536674c0bb350a31d7ce5ff7f to start an election
I20260709 13:08:37.140317 16349 raft_consensus.cc:1275] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 20 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:08:37.159217 16280 raft_consensus.cc:2468] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 21.
I20260709 13:08:37.161396 16105 catalog_manager.cc:5697] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: term changed from 14 to 15, leader changed from 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) to 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68). New cstate: current_term: 15 leader_uuid: "1109f76a0b7b443a84c0327c8707bc63" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:37.163951 16201 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157"
dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
 from {username='slave'} at 127.0.0.1:60138
I20260709 13:08:37.173285 16201 raft_consensus.cc:493] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:37.173707 16201 raft_consensus.cc:3060] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:37.169927 23323 raft_consensus.cc:2955] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 LEADER]: Committing config change with OpId 20.14: config changed from index -1 to 14, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:08:37.171921 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: true dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:37.174834 16350 raft_consensus.cc:3060] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:37.175529 23317 raft_consensus.cc:993] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e: : Instructing follower 0aea40d6e4374085a2e38a70a71f63e3 to start an election
I20260709 13:08:37.176110 23317 raft_consensus.cc:1081] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 20 LEADER]: Signalling peer 0aea40d6e4374085a2e38a70a71f63e3 to start an election
I20260709 13:08:37.180773 23278 consensus_queue.cc:1048] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:08:37.185048 16173 leader_election.cc:304] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:37.185943 23223 raft_consensus.cc:2804] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:08:37.186492 23223 raft_consensus.cc:697] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 21 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:08:37.187402 23223 consensus_queue.cc:237] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:37.188385 16350 raft_consensus.cc:2468] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 21.
I20260709 13:08:37.192662 16199 raft_consensus.cc:2955] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 20 FOLLOWER]: Committing config change with OpId 20.14: config changed from index -1 to 14, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:08:37.196978 16201 raft_consensus.cc:515] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:37.202721 16201 leader_election.cc:290] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 14 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:37.204133 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:37.205003 16277 raft_consensus.cc:3055] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:37.205406 16277 raft_consensus.cc:740] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:08:37.206419 16277 consensus_queue.cc:260] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:37.208920 16277 raft_consensus.cc:3060] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:37.230002 16281 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f"
dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
 from {username='slave'} at 127.0.0.1:45210
I20260709 13:08:37.230960 16281 raft_consensus.cc:493] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:37.231372 16281 raft_consensus.cc:3060] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:37.239544 16277 raft_consensus.cc:2468] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 14.
I20260709 13:08:37.248790 16173 leader_election.cc:304] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:37.278764 23267 raft_consensus.cc:2804] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:37.279323 23267 raft_consensus.cc:697] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:08:37.280488 23267 consensus_queue.cc:237] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:08:37.290499 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 46942.3us
W20260709 13:08:37.306505 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 73508us
W20260709 13:08:37.345666 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 111656us
W20260709 13:08:37.346099 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 55485.8us
I20260709 13:08:37.337882 16281 raft_consensus.cc:515] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 21 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:37.348747 16353 raft_consensus.cc:2955] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 20 FOLLOWER]: Committing config change with OpId 20.14: config changed from index -1 to 14, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:08:37.356992 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:37.357860 16350 raft_consensus.cc:3060] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:37.366312 16281 leader_election.cc:290] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 21 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:37.395083 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: true dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:37.395865 16349 raft_consensus.cc:3055] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:08:37.396193 16349 raft_consensus.cc:740] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:08:37.396950 16349 consensus_queue.cc:260] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:37.398417 16350 raft_consensus.cc:2468] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 14.
I20260709 13:08:37.398422 16349 raft_consensus.cc:3060] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:37.402354 16104 catalog_manager.cc:5697] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: config changed from index -1 to 14, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New cstate: current_term: 20 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:37.420169 16199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: true dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:08:37.420992 16199 raft_consensus.cc:3060] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:37.417807 16350 consensus_queue.cc:237] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:08:37.425984 16102 catalog_manager.cc:5697] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f reported cstate change: term changed from 20 to 21, leader changed from 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) to e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65). New cstate: current_term: 21 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:37.441797 16199 raft_consensus.cc:2468] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 21.
I20260709 13:08:37.447943 16349 raft_consensus.cc:2468] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 21.
W20260709 13:08:37.499135 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 51307.8us
I20260709 13:08:37.499993 16246 leader_election.cc:304] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:37.502954 23323 raft_consensus.cc:2804] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:08:37.503531 23323 raft_consensus.cc:697] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 21 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:08:37.506108 23323 consensus_queue.cc:237] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:08:37.515218 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 54135us
W20260709 13:08:37.515820 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 54464.4us
W20260709 13:08:37.530635 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 127423us
I20260709 13:08:37.579074 16199 raft_consensus.cc:1275] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 21 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
W20260709 13:08:37.601869 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 80050.7us
I20260709 13:08:37.605990 16200 raft_consensus.cc:1275] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:08:37.606940 23365 consensus_queue.cc:1048] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:08:37.624886 23392 consensus_queue.cc:1048] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.002s
I20260709 13:08:37.661432 16277 raft_consensus.cc:1275] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 21 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:08:37.665365 16353 raft_consensus.cc:1275] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
W20260709 13:08:37.671027 16322 consensus_peers.cc:597] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e -> Peer 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875): Couldn't send request to peer 1109f76a0b7b443a84c0327c8707bc63. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 19e573db44d24720b3a4805dc20210e8. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:37.682078 23391 consensus_queue.cc:1048] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.007s
I20260709 13:08:37.684535 23366 consensus_queue.cc:1048] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.008s
I20260709 13:08:37.678635 16103 catalog_manager.cc:5697] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 20 to 21, leader changed from 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) to 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66). New cstate: current_term: 21 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:37.730994 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 61028.5us
I20260709 13:08:37.747416 23396 ts_tablet_manager.cc:933] T abbbc04ca95a4119a7e3fb64073fe61f P 1109f76a0b7b443a84c0327c8707bc63: Initiating tablet copy from peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:08:37.764595 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 88076.2us
I20260709 13:08:37.771759 16277 raft_consensus.cc:1275] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 21 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:08:37.772905 15057 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:37.777483 16103 catalog_manager.cc:5697] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f reported cstate change: term changed from 13 to 14, leader changed from 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) to e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65). New cstate: current_term: 14 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:37.804842 23373 consensus_queue.cc:1048] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.008s
I20260709 13:08:37.809512 23390 raft_consensus.cc:2955] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 21 LEADER]: Committing config change with OpId 21.15: config changed from index -1 to 15, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:08:37.816812 16281 raft_consensus.cc:2955] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 21 FOLLOWER]: Committing config change with OpId 21.15: config changed from index -1 to 15, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:08:37.834321 16277 raft_consensus.cc:1275] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:08:37.839334 23394 consensus_queue.cc:1048] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:37.842945 16351 raft_consensus.cc:1275] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 21 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:08:37.845857 16353 raft_consensus.cc:1275] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:08:37.846976 23394 consensus_queue.cc:1048] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.008s
I20260709 13:08:37.869333 23394 consensus_queue.cc:1048] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:37.899814 23396 tablet_copy_client.cc:323] T abbbc04ca95a4119a7e3fb64073fe61f P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Beginning tablet copy session from remote peer at address 127.14.180.66:45823
I20260709 13:08:37.902252 16293 tablet_copy_service.cc:140] P 0aea40d6e4374085a2e38a70a71f63e3: Received BeginTabletCopySession request for tablet abbbc04ca95a4119a7e3fb64073fe61f from peer 1109f76a0b7b443a84c0327c8707bc63 ({username='slave'} at 127.0.0.1:42740)
I20260709 13:08:37.903093 16293 tablet_copy_service.cc:161] P 0aea40d6e4374085a2e38a70a71f63e3: Beginning new tablet copy session on tablet abbbc04ca95a4119a7e3fb64073fe61f from peer 1109f76a0b7b443a84c0327c8707bc63 at {username='slave'} at 127.0.0.1:42740: session id = 1109f76a0b7b443a84c0327c8707bc63-abbbc04ca95a4119a7e3fb64073fe61f
W20260709 13:08:37.944298 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 44860.3us
I20260709 13:08:37.954169 16293 tablet_copy_source_session.cc:215] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:37.969059 16200 raft_consensus.cc:1275] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 21 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 13:08:37.976516 16281 consensus_queue.cc:237] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:08:37.978758 23400 consensus_queue.cc:1048] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.010s
I20260709 13:08:38.025542 16102 catalog_manager.cc:5697] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: config changed from index -1 to 15, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New cstate: current_term: 21 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
W20260709 13:08:38.103556 23398 log.cc:927] Time spent T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 13:08:38.107400 16200 raft_consensus.cc:2955] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 21 FOLLOWER]: Committing config change with OpId 21.15: config changed from index -1 to 15, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:08:38.183188 23396 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abbbc04ca95a4119a7e3fb64073fe61f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:08:38.263278 23408 log.cc:927] Time spent T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
W20260709 13:08:38.245761 23407 log.cc:927] Time spent T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.211s	user 0.001s	sys 0.000s
W20260709 13:08:38.304292 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 321562us
W20260709 13:08:38.304745 23410 log.cc:927] Time spent T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.198s	user 0.001s	sys 0.000s
I20260709 13:08:38.333892 23430 ts_tablet_manager.cc:933] T 19e573db44d24720b3a4805dc20210e8 P 1109f76a0b7b443a84c0327c8707bc63: Initiating tablet copy from peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:08:38.374439 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 182593us
W20260709 13:08:38.393923 16248 consensus_peers.cc:597] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 -> Peer 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875): Couldn't send request to peer 1109f76a0b7b443a84c0327c8707bc63. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ab124ef29c71409d9c14a75a054095e1. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:38.456925 23430 tablet_copy_client.cc:323] T 19e573db44d24720b3a4805dc20210e8 P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Beginning tablet copy session from remote peer at address 127.14.180.67:46107
I20260709 13:08:38.489354 16350 raft_consensus.cc:1275] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
W20260709 13:08:38.532245 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 66364.7us
W20260709 13:08:38.577944 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 44669us
W20260709 13:08:38.736661 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 157769us
W20260709 13:08:38.857144 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 109463us
I20260709 13:08:38.862839 16367 tablet_copy_service.cc:140] P 363bb2f744eb486f9ad726f08214c98e: Received BeginTabletCopySession request for tablet 19e573db44d24720b3a4805dc20210e8 from peer 1109f76a0b7b443a84c0327c8707bc63 ({username='slave'} at 127.0.0.1:33486)
I20260709 13:08:38.867285 16350 raft_consensus.cc:1275] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 21 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 13:08:38.867431 16367 tablet_copy_service.cc:161] P 363bb2f744eb486f9ad726f08214c98e: Beginning new tablet copy session on tablet 19e573db44d24720b3a4805dc20210e8 from peer 1109f76a0b7b443a84c0327c8707bc63 at {username='slave'} at 127.0.0.1:33486: session id = 1109f76a0b7b443a84c0327c8707bc63-19e573db44d24720b3a4805dc20210e8
I20260709 13:08:38.882889 23367 consensus_queue.cc:1048] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:08:38.867398 23425 consensus_queue.cc:1048] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.016s
I20260709 13:08:38.947965 15057 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:38.982710 23396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:40078 (request call id 1194) took 1342 ms. Trace:
I20260709 13:08:38.983242 23396 rpcz_store.cc:276] 0709 13:08:37.659491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:37.659920 (+   429us) service_pool.cc:224] Handling call
0709 13:08:37.748083 (+ 88163us) ts_tablet_manager.cc:934] T abbbc04ca95a4119a7e3fb64073fe61f P 1109f76a0b7b443a84c0327c8707bc63: Initiating tablet copy from peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
0709 13:08:38.013834 (+265751us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:08:38.738139 (+724305us) tablet_metadata.cc:665] Metadata flushed
0709 13:08:38.742772 (+  4633us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:08:38.943235 (+200463us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:08:38.958987 (+ 15752us) tablet_replica.cc:206] Creating consensus instance
0709 13:08:38.982487 (+ 23500us) ts_tablet_manager.cc:989] Replica registered.
0709 13:08:38.982597 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":29424,"tablet-copy.queue_time_us":86808,"thread_start_us":162642,"threads_started":2}
I20260709 13:08:38.984900 23396 tablet_copy_client.cc:806] T abbbc04ca95a4119a7e3fb64073fe61f P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:38.985605 23396 tablet_copy_client.cc:670] T abbbc04ca95a4119a7e3fb64073fe61f P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:39.057338 16367 tablet_copy_source_session.cc:215] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:39.056972 23417 raft_consensus.cc:2955] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 LEADER]: Committing config change with OpId 18.11: config changed from index -1 to 11, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:08:39.095106 16282 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8b615ac918a749989f2968826926adf3"
dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
mode: GRACEFUL
new_leader_uuid: "1109f76a0b7b443a84c0327c8707bc63"
 from {username='slave'} at 127.0.0.1:39058
I20260709 13:08:39.095839 16282 raft_consensus.cc:606] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 LEADER]: Received request to transfer leadership to TS 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:08:39.100534 23430 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19e573db44d24720b3a4805dc20210e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:39.122586 23396 tablet_copy_client.cc:538] T abbbc04ca95a4119a7e3fb64073fe61f P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:39.125792 23437 raft_consensus.cc:493] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:08:39.126415 23437 raft_consensus.cc:515] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:39.128643 23437 leader_election.cc:290] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:39.158365 23462 ts_tablet_manager.cc:933] T ab124ef29c71409d9c14a75a054095e1 P 1109f76a0b7b443a84c0327c8707bc63: Initiating tablet copy from peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:08:39.168478 16174 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.014s	sys 0.052s
W20260709 13:08:39.168889 16174 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.553s	user 0.014s	sys 0.052s
W20260709 13:08:39.174680 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 83149.8us
I20260709 13:08:39.174618 16353 raft_consensus.cc:2955] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Committing config change with OpId 18.11: config changed from index -1 to 11, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:08:39.196877 16205 raft_consensus.cc:1275] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:08:39.208268 23462 tablet_copy_client.cc:323] T ab124ef29c71409d9c14a75a054095e1 P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Beginning tablet copy session from remote peer at address 127.14.180.66:45823
I20260709 13:08:39.210722 16293 tablet_copy_service.cc:140] P 0aea40d6e4374085a2e38a70a71f63e3: Received BeginTabletCopySession request for tablet ab124ef29c71409d9c14a75a054095e1 from peer 1109f76a0b7b443a84c0327c8707bc63 ({username='slave'} at 127.0.0.1:42740)
I20260709 13:08:39.211308 16293 tablet_copy_service.cc:161] P 0aea40d6e4374085a2e38a70a71f63e3: Beginning new tablet copy session on tablet ab124ef29c71409d9c14a75a054095e1 from peer 1109f76a0b7b443a84c0327c8707bc63 at {username='slave'} at 127.0.0.1:42740: session id = 1109f76a0b7b443a84c0327c8707bc63-ab124ef29c71409d9c14a75a054095e1
I20260709 13:08:39.247848 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:39.249127 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:08:39.356711 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 93142.2us
I20260709 13:08:39.367353 23375 consensus_queue.cc:1048] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 13:08:39.413185 23401 raft_consensus.cc:993] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3: : Instructing follower 1109f76a0b7b443a84c0327c8707bc63 to start an election
I20260709 13:08:39.413528 23396 tablet_bootstrap.cc:492] T abbbc04ca95a4119a7e3fb64073fe61f P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap starting.
I20260709 13:08:39.413735 23401 raft_consensus.cc:1081] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 LEADER]: Signalling peer 1109f76a0b7b443a84c0327c8707bc63 to start an election
I20260709 13:08:39.421074 16944 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8b615ac918a749989f2968826926adf3"
dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
 from {username='slave'} at 127.0.0.1:40078
I20260709 13:08:39.421926 16944 raft_consensus.cc:493] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:39.422402 16944 raft_consensus.cc:3060] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:39.432052 16173 leader_election.cc:304] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:08:39.442451 16944 raft_consensus.cc:515] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:39.457343 16205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: true dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:08:39.460971 16205 raft_consensus.cc:3060] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:39.469975 16944 leader_election.cc:290] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 18 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:39.470188 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: true dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:39.470989 16282 raft_consensus.cc:3055] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:39.471411 16282 raft_consensus.cc:740] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:08:39.472487 16282 consensus_queue.cc:260] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:39.473650 16282 raft_consensus.cc:3060] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:39.499505 16105 catalog_manager.cc:5697] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e reported cstate change: config changed from index -1 to 11, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New cstate: current_term: 18 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:08:39.484948 23394 raft_consensus.cc:2749] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:39.535210 16282 raft_consensus.cc:2468] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 18.
I20260709 13:08:39.539004 16208 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aee913c41fb9437587affa768953f637"
dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
mode: GRACEFUL
new_leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
 from {username='slave'} at 127.0.0.1:35456
I20260709 13:08:39.539243 23417 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:42736 (request call id 12) took 1616 ms. Trace:
I20260709 13:08:39.539724 16208 raft_consensus.cc:606] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 21 LEADER]: Received request to transfer leadership to TS 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:08:39.539767 23417 rpcz_store.cc:276] 0709 13:08:37.922822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:37.922960 (+   138us) service_pool.cc:224] Handling call
0709 13:08:37.980270 (+ 57310us) log.cc:844] Serialized 506 byte log entry
0709 13:08:39.539124 (+1558854us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":227,"mutex_wait_us":320,"raft.queue_time_us":102050,"raft.run_cpu_time_us":2247,"raft.run_wall_time_us":67083,"thread_start_us":368538,"threads_started":3,"wal-append.queue_time_us":184836,"wal-append.run_cpu_time_us":1835,"wal-append.run_wall_time_us":1005035}
I20260709 13:08:39.539031 16914 leader_election.cc:304] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:08:39.557451 23420 raft_consensus.cc:2804] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:39.558287 23420 raft_consensus.cc:697] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 18 LEADER]: Becoming Leader. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:08:39.559508 23420 consensus_queue.cc:237] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:39.572405 16205 raft_consensus.cc:2468] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 18.
I20260709 13:08:39.589505 23396 tablet_bootstrap.cc:700] T abbbc04ca95a4119a7e3fb64073fe61f P 1109f76a0b7b443a84c0327c8707bc63: Time spent opening tablet: real 0.101s	user 0.003s	sys 0.000s
W20260709 13:08:39.627249 23471 log.cc:927] Time spent T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:08:39.683956 16199 raft_consensus.cc:2955] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Committing config change with OpId 18.11: config changed from index -1 to 11, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
W20260709 13:08:39.700585 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 47351.1us
I20260709 13:08:39.857735 16204 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360"
dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
mode: GRACEFUL
new_leader_uuid: "363bb2f744eb486f9ad726f08214c98e"
 from {username='slave'} at 127.0.0.1:35456
I20260709 13:08:39.858397 16204 raft_consensus.cc:606] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 LEADER]: Received request to transfer leadership to TS 363bb2f744eb486f9ad726f08214c98e
I20260709 13:08:39.881692 15057 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:08:39.956257 23430 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:35122 (request call id 1092) took 1649 ms. Trace:
I20260709 13:08:39.956938 23430 rpcz_store.cc:276] 0709 13:08:38.306822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:38.313133 (+  6311us) service_pool.cc:224] Handling call
0709 13:08:38.358093 (+ 44960us) ts_tablet_manager.cc:934] T 19e573db44d24720b3a4805dc20210e8 P 1109f76a0b7b443a84c0327c8707bc63: Initiating tablet copy from peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
0709 13:08:39.095453 (+737360us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:08:39.392105 (+296652us) tablet_metadata.cc:665] Metadata flushed
0709 13:08:39.392233 (+   128us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:08:39.891714 (+499481us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:08:39.915343 (+ 23629us) tablet_replica.cc:206] Creating consensus instance
0709 13:08:39.956064 (+ 40721us) ts_tablet_manager.cc:989] Replica registered.
0709 13:08:39.956163 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":19406,"tablet-copy.queue_time_us":20111,"thread_start_us":57045,"threads_started":2}
W20260709 13:08:39.975081 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 121149us
W20260709 13:08:39.999637 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 101352us
I20260709 13:08:39.978055 23430 tablet_copy_client.cc:806] T 19e573db44d24720b3a4805dc20210e8 P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:40.018122 23430 tablet_copy_client.cc:670] T 19e573db44d24720b3a4805dc20210e8 P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Starting download of 1 WAL segments...
W20260709 13:08:40.043694 23475 log.cc:927] Time spent T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:08:40.046054 16293 tablet_copy_source_session.cc:215] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:40.068953 15057 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:08:40.096110 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 81010.9us
W20260709 13:08:40.103446 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 102705us
I20260709 13:08:40.121603 23429 raft_consensus.cc:993] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f: : Instructing follower 363bb2f744eb486f9ad726f08214c98e to start an election
I20260709 13:08:40.122704 23444 raft_consensus.cc:1081] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 LEADER]: Signalling peer 363bb2f744eb486f9ad726f08214c98e to start an election
I20260709 13:08:40.153728 16205 raft_consensus.cc:1275] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 13:08:40.157096 23420 consensus_queue.cc:1048] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 13:08:40.170723 23456 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.640s	user 0.019s	sys 0.005s
W20260709 13:08:40.189047 23456 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.663s	user 0.020s	sys 0.005s
I20260709 13:08:40.241288 23462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab124ef29c71409d9c14a75a054095e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:40.271219 16350 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360"
dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
 from {username='slave'} at 127.0.0.1:41832
I20260709 13:08:40.271895 16350 raft_consensus.cc:493] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:40.272274 16350 raft_consensus.cc:3060] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:40.279168 23430 tablet_copy_client.cc:538] T 19e573db44d24720b3a4805dc20210e8 P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:40.327665 16277 raft_consensus.cc:1275] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 13:08:40.339465 23430 tablet_bootstrap.cc:492] T 19e573db44d24720b3a4805dc20210e8 P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap starting.
I20260709 13:08:40.341188 16350 raft_consensus.cc:515] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:40.363897 16350 leader_election.cc:290] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:40.372629 23440 raft_consensus.cc:993] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f: : Instructing follower 0aea40d6e4374085a2e38a70a71f63e3 to start an election
I20260709 13:08:40.372421 23420 consensus_queue.cc:1048] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:08:40.373276 23440 raft_consensus.cc:1081] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 21 LEADER]: Signalling peer 0aea40d6e4374085a2e38a70a71f63e3 to start an election
I20260709 13:08:40.383349 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: true dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:08:40.392840 16204 raft_consensus.cc:3055] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:40.393522 16204 raft_consensus.cc:740] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:08:40.407012 16204 consensus_queue.cc:260] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:40.416623 16204 raft_consensus.cc:3060] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:40.420408 16102 catalog_manager.cc:5697] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: term changed from 17 to 18, leader changed from 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) to 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68). New cstate: current_term: 18 leader_uuid: "1109f76a0b7b443a84c0327c8707bc63" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:08:40.426995 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 45509.9us
I20260709 13:08:40.434638 16281 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aee913c41fb9437587affa768953f637"
dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
 from {username='slave'} at 127.0.0.1:45218
I20260709 13:08:40.435326 16281 raft_consensus.cc:493] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 21 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:40.435717 16281 raft_consensus.cc:3060] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:40.453439 16281 raft_consensus.cc:515] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 22 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:40.459385 16278 raft_consensus.cc:1240] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 22 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 21. Current term is 22. Ops: []
I20260709 13:08:40.461567 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: true dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:08:40.462400 16944 raft_consensus.cc:3060] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:40.475950 16352 raft_consensus.cc:1240] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:40.476236 16204 raft_consensus.cc:2468] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 15.
I20260709 13:08:40.479746 16281 leader_election.cc:290] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 22 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:40.480336 16944 raft_consensus.cc:2468] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 15.
I20260709 13:08:40.482620 16320 leader_election.cc:304] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:40.486255 16105 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38842 (request call id 262) took 1006 ms. Trace:
I20260709 13:08:40.496762 16207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: true dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:08:40.502738 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: true dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:40.503448 16354 raft_consensus.cc:3060] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:40.512343 23441 raft_consensus.cc:2804] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:40.512589 16207 raft_consensus.cc:3055] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:08:40.513067 23441 raft_consensus.cc:697] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 15 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:08:40.513113 16207 raft_consensus.cc:740] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 21 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:08:40.515239 16207 consensus_queue.cc:260] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:40.516506 16207 raft_consensus.cc:3060] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:40.514331 23441 consensus_queue.cc:237] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:40.527940 16207 raft_consensus.cc:2468] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 22.
W20260709 13:08:40.529150 23440 consensus_queue.cc:1175] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "0aea40d6e4374085a2e38a70a71f63e3" responder_term: 22 status { last_received { term: 21 index: 14 } last_committed_idx: 14 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer e10b16d536674c0bb350a31d7ce5ff7f for earlier term 21. Current term is 22. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:08:40.529398 16354 raft_consensus.cc:2468] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 22.
I20260709 13:08:40.545478 23462 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:40078 (request call id 1213) took 1701 ms. Trace:
I20260709 13:08:40.551393 23462 rpcz_store.cc:276] 0709 13:08:38.843790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:38.844081 (+   291us) service_pool.cc:224] Handling call
0709 13:08:39.158829 (+314748us) ts_tablet_manager.cc:934] T ab124ef29c71409d9c14a75a054095e1 P 1109f76a0b7b443a84c0327c8707bc63: Initiating tablet copy from peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
0709 13:08:40.240006 (+1081177us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:08:40.324434 (+ 84428us) tablet_metadata.cc:665] Metadata flushed
0709 13:08:40.324549 (+   115us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:08:40.544640 (+220091us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:08:40.544976 (+   336us) tablet_replica.cc:206] Creating consensus instance
0709 13:08:40.545334 (+   358us) ts_tablet_manager.cc:989] Replica registered.
0709 13:08:40.545408 (+    74us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":316,"tablet-copy.queue_time_us":313501,"thread_start_us":276939,"threads_started":2}
I20260709 13:08:40.539557 16246 leader_election.cc:304] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:40.486745 16105 rpcz_store.cc:276] 0709 13:08:39.480123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:39.480293 (+   170us) service_pool.cc:224] Handling call
0709 13:08:40.486182 (+1005889us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:39.834705 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:39.842883 (+  8178us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:39.842917 (+    34us) write_op.cc:435] Acquired schema lock
0709 13:08:39.842935 (+    18us) tablet.cc:662] Decoding operations
0709 13:08:39.843294 (+   359us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:39.843368 (+    74us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:39.843402 (+    34us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:08:39.843588 (+   186us) tablet.cc:701] Row locks acquired
0709 13:08:39.843610 (+    22us) write_op.cc:260] PREPARE: finished
0709 13:08:39.843746 (+   136us) write_op.cc:270] Start()
0709 13:08:39.843860 (+   114us) write_op.cc:276] Timestamp: P: 1783602519843698 usec, L: 0
0709 13:08:39.843887 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 13:08:39.844558 (+   671us) log.cc:844] Serialized 599 byte log entry
0709 13:08:40.207069 (+362511us) op_driver.cc:464] REPLICATION: finished
0709 13:08:40.469611 (+262542us) write_op.cc:301] APPLY: starting
0709 13:08:40.469705 (+    94us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:40.470944 (+  1239us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:40.471052 (+   108us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:40.471858 (+   806us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:40.472037 (+   179us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:08:40.472092 (+    55us) write_op.cc:312] APPLY: finished
0709 13:08:40.472313 (+   221us) log.cc:844] Serialized 25 byte log entry
0709 13:08:40.472491 (+   178us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:40.472573 (+    82us) write_op.cc:454] Released schema lock
0709 13:08:40.472617 (+    44us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":262275,"apply.run_cpu_time_us":3421,"apply.run_wall_time_us":14866,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8307,"num_ops":1,"prepare.queue_time_us":284984,"prepare.run_cpu_time_us":7432,"prepare.run_wall_time_us":68224,"raft.queue_time_us":257978,"raft.run_cpu_time_us":80964,"raft.run_wall_time_us":188403,"replication_time_us":363006,"thread_start_us":620860,"threads_started":4,"wal-append.queue_time_us":116550}]]}
I20260709 13:08:40.578147 23462 tablet_copy_client.cc:806] T ab124ef29c71409d9c14a75a054095e1 P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:40.586601 23462 tablet_copy_client.cc:670] T ab124ef29c71409d9c14a75a054095e1 P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:40.585458 23323 raft_consensus.cc:2804] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:08:40.613430 23323 raft_consensus.cc:697] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 22 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:08:40.619024 23323 consensus_queue.cc:237] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:40.647302 23462 tablet_copy_client.cc:538] T ab124ef29c71409d9c14a75a054095e1 P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:40.686048 16105 catalog_manager.cc:5697] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e reported cstate change: term changed from 14 to 15, leader changed from e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) to 363bb2f744eb486f9ad726f08214c98e (127.14.180.67). New cstate: current_term: 15 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:40.810416 23462 tablet_bootstrap.cc:492] T ab124ef29c71409d9c14a75a054095e1 P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap starting.
W20260709 13:08:40.827428 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 59988.5us
I20260709 13:08:40.842231 23396 tablet_bootstrap.cc:492] T abbbc04ca95a4119a7e3fb64073fe61f P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:40.852288 23396 tablet_bootstrap.cc:492] T abbbc04ca95a4119a7e3fb64073fe61f P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap complete.
I20260709 13:08:40.854511 23396 ts_tablet_manager.cc:1403] T abbbc04ca95a4119a7e3fb64073fe61f P 1109f76a0b7b443a84c0327c8707bc63: Time spent bootstrapping tablet: real 1.444s	user 0.072s	sys 0.009s
I20260709 13:08:40.860307 23396 raft_consensus.cc:359] T abbbc04ca95a4119a7e3fb64073fe61f P 1109f76a0b7b443a84c0327c8707bc63 [term 20 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:08:40.868884 23396 raft_consensus.cc:740] T abbbc04ca95a4119a7e3fb64073fe61f P 1109f76a0b7b443a84c0327c8707bc63 [term 20 LEARNER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Initialized, Role: LEARNER
I20260709 13:08:40.869765 23396 consensus_queue.cc:260] T abbbc04ca95a4119a7e3fb64073fe61f P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:08:40.872931 23396 ts_tablet_manager.cc:1434] T abbbc04ca95a4119a7e3fb64073fe61f P 1109f76a0b7b443a84c0327c8707bc63: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.005s
I20260709 13:08:40.858448 16105 catalog_manager.cc:5697] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 21 to 22, leader changed from e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) to 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66). New cstate: current_term: 22 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:40.876423 16293 tablet_copy_service.cc:342] P 0aea40d6e4374085a2e38a70a71f63e3: Request end of tablet copy session 1109f76a0b7b443a84c0327c8707bc63-abbbc04ca95a4119a7e3fb64073fe61f received from {username='slave'} at 127.0.0.1:42740
I20260709 13:08:40.876987 16293 tablet_copy_service.cc:434] P 0aea40d6e4374085a2e38a70a71f63e3: ending tablet copy session 1109f76a0b7b443a84c0327c8707bc63-abbbc04ca95a4119a7e3fb64073fe61f on tablet abbbc04ca95a4119a7e3fb64073fe61f with peer 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:08:40.937299 23462 tablet_bootstrap.cc:700] T ab124ef29c71409d9c14a75a054095e1 P 1109f76a0b7b443a84c0327c8707bc63: Time spent opening tablet: real 0.103s	user 0.003s	sys 0.001s
I20260709 13:08:40.946307 16204 raft_consensus.cc:1275] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:08:40.949734 23492 consensus_queue.cc:1048] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:08:41.050130 16944 raft_consensus.cc:1275] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:08:41.069062 23492 consensus_queue.cc:1048] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:08:41.073284 23462 tablet_bootstrap.cc:492] T ab124ef29c71409d9c14a75a054095e1 P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=0 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:41.087479 23462 tablet_bootstrap.cc:492] T ab124ef29c71409d9c14a75a054095e1 P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap complete.
I20260709 13:08:41.088496 23462 ts_tablet_manager.cc:1403] T ab124ef29c71409d9c14a75a054095e1 P 1109f76a0b7b443a84c0327c8707bc63: Time spent bootstrapping tablet: real 0.278s	user 0.029s	sys 0.022s
I20260709 13:08:41.100097 23462 raft_consensus.cc:359] T ab124ef29c71409d9c14a75a054095e1 P 1109f76a0b7b443a84c0327c8707bc63 [term 18 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:08:41.101150 23462 raft_consensus.cc:740] T ab124ef29c71409d9c14a75a054095e1 P 1109f76a0b7b443a84c0327c8707bc63 [term 18 LEARNER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Initialized, Role: LEARNER
I20260709 13:08:41.102109 23462 consensus_queue.cc:260] T ab124ef29c71409d9c14a75a054095e1 P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:08:41.104337 23462 ts_tablet_manager.cc:1434] T ab124ef29c71409d9c14a75a054095e1 P 1109f76a0b7b443a84c0327c8707bc63: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:08:41.106331 16293 tablet_copy_service.cc:342] P 0aea40d6e4374085a2e38a70a71f63e3: Request end of tablet copy session 1109f76a0b7b443a84c0327c8707bc63-ab124ef29c71409d9c14a75a054095e1 received from {username='slave'} at 127.0.0.1:42740
I20260709 13:08:41.106796 16293 tablet_copy_service.cc:434] P 0aea40d6e4374085a2e38a70a71f63e3: ending tablet copy session 1109f76a0b7b443a84c0327c8707bc63-ab124ef29c71409d9c14a75a054095e1 on tablet ab124ef29c71409d9c14a75a054095e1 with peer 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:08:41.108815 15057 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:41.138389 23430 tablet_bootstrap.cc:492] T 19e573db44d24720b3a4805dc20210e8 P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap replayed 1/1 log segments. Stats: ops{read=16 overwritten=1 applied=15 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:41.139621 23430 tablet_bootstrap.cc:492] T 19e573db44d24720b3a4805dc20210e8 P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap complete.
I20260709 13:08:41.140570 23430 ts_tablet_manager.cc:1403] T 19e573db44d24720b3a4805dc20210e8 P 1109f76a0b7b443a84c0327c8707bc63: Time spent bootstrapping tablet: real 0.801s	user 0.067s	sys 0.010s
I20260709 13:08:41.144588 23430 raft_consensus.cc:359] T 19e573db44d24720b3a4805dc20210e8 P 1109f76a0b7b443a84c0327c8707bc63 [term 21 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:08:41.145732 23430 raft_consensus.cc:740] T 19e573db44d24720b3a4805dc20210e8 P 1109f76a0b7b443a84c0327c8707bc63 [term 21 LEARNER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Initialized, Role: LEARNER
I20260709 13:08:41.146533 23430 consensus_queue.cc:260] T 19e573db44d24720b3a4805dc20210e8 P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:08:41.149135 23430 ts_tablet_manager.cc:1434] T 19e573db44d24720b3a4805dc20210e8 P 1109f76a0b7b443a84c0327c8707bc63: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:08:41.151510 16367 tablet_copy_service.cc:342] P 363bb2f744eb486f9ad726f08214c98e: Request end of tablet copy session 1109f76a0b7b443a84c0327c8707bc63-19e573db44d24720b3a4805dc20210e8 received from {username='slave'} at 127.0.0.1:33486
I20260709 13:08:41.152026 16367 tablet_copy_service.cc:434] P 363bb2f744eb486f9ad726f08214c98e: ending tablet copy session 1109f76a0b7b443a84c0327c8707bc63-19e573db44d24720b3a4805dc20210e8 on tablet 19e573db44d24720b3a4805dc20210e8 with peer 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:08:41.242357 16354 raft_consensus.cc:1275] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 22 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:08:41.269165 23486 consensus_queue.cc:1048] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:08:41.316813 16948 raft_consensus.cc:1217] T ab124ef29c71409d9c14a75a054095e1 P 1109f76a0b7b443a84c0327c8707bc63 [term 18 LEARNER]: Deduplicated request from leader. Original: 18.10->[18.11-18.11]   Dedup: 18.11->[]
I20260709 13:08:41.334154 16201 raft_consensus.cc:1275] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 22 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:08:41.376493 23438 consensus_queue.cc:1048] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:08:41.395797 16944 raft_consensus.cc:1217] T abbbc04ca95a4119a7e3fb64073fe61f P 1109f76a0b7b443a84c0327c8707bc63 [term 20 LEARNER]: Deduplicated request from leader. Original: 20.13->[20.14-20.14]   Dedup: 20.14->[]
W20260709 13:08:41.437966 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 96557.2us
W20260709 13:08:41.562428 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 45511us
W20260709 13:08:41.576122 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 49303.8us
I20260709 13:08:41.596060 16944 raft_consensus.cc:1217] T 19e573db44d24720b3a4805dc20210e8 P 1109f76a0b7b443a84c0327c8707bc63 [term 21 LEARNER]: Deduplicated request from leader. Original: 21.14->[21.15-21.15]   Dedup: 21.15->[]
I20260709 13:08:41.755393 23438 raft_consensus.cc:1064] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3: attempting to promote NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 to VOTER
I20260709 13:08:41.758059 23438 consensus_queue.cc:237] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 9, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:41.822993 16351 raft_consensus.cc:1275] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:08:41.827533 16944 raft_consensus.cc:1275] T ab124ef29c71409d9c14a75a054095e1 P 1109f76a0b7b443a84c0327c8707bc63 [term 18 LEARNER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:08:41.851159 23323 consensus_queue.cc:1048] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:41.856642 23421 consensus_queue.cc:1048] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:41.855091 16201 raft_consensus.cc:1275] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:08:41.875413 23401 consensus_queue.cc:1048] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:41.921088 23323 raft_consensus.cc:1064] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3: attempting to promote NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 to VOTER
I20260709 13:08:41.984174 23323 consensus_queue.cc:237] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 12, Current term: 20, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:41.984542 23526 raft_consensus.cc:2955] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 LEADER]: Committing config change with OpId 18.12: config changed from index 11 to 12, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:08:42.001153 16348 raft_consensus.cc:2955] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Committing config change with OpId 18.12: config changed from index 11 to 12, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:08:42.017585 23515 raft_consensus.cc:1064] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e: attempting to promote NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 to VOTER
I20260709 13:08:42.029000 16207 raft_consensus.cc:2955] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Committing config change with OpId 18.12: config changed from index 11 to 12, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:08:42.024382 23515 consensus_queue.cc:237] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 13, Current term: 21, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:42.100567 16941 raft_consensus.cc:1275] T abbbc04ca95a4119a7e3fb64073fe61f P 1109f76a0b7b443a84c0327c8707bc63 [term 20 LEARNER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:08:42.119094 16348 raft_consensus.cc:1275] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 20 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:08:42.133991 23387 consensus_queue.cc:1048] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:08:42.142515 23387 consensus_queue.cc:1048] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:08:42.145344 16103 catalog_manager.cc:5697] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e reported cstate change: config changed from index 11 to 12, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New cstate: current_term: 18 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:08:42.167330 16207 raft_consensus.cc:1275] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 20 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:08:42.171300 16948 raft_consensus.cc:1275] T 19e573db44d24720b3a4805dc20210e8 P 1109f76a0b7b443a84c0327c8707bc63 [term 21 LEARNER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:08:42.173815 23323 consensus_queue.cc:1048] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 13:08:42.191417 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 110064us
I20260709 13:08:42.231597 23515 consensus_queue.cc:1048] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.033s
I20260709 13:08:42.325872 16948 raft_consensus.cc:2955] T ab124ef29c71409d9c14a75a054095e1 P 1109f76a0b7b443a84c0327c8707bc63 [term 18 FOLLOWER]: Committing config change with OpId 18.12: config changed from index 11 to 12, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:08:42.344913 16205 raft_consensus.cc:1275] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 21 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:08:42.375435 23542 consensus_queue.cc:1048] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.009s
W20260709 13:08:42.389277 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 67037.9us
I20260709 13:08:42.392233 16283 raft_consensus.cc:1275] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 21 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:08:42.391808 23526 raft_consensus.cc:2955] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 LEADER]: Committing config change with OpId 20.15: config changed from index 14 to 15, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:08:42.399511 16207 raft_consensus.cc:2955] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 20 FOLLOWER]: Committing config change with OpId 20.15: config changed from index 14 to 15, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:08:42.466755 15057 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:42.489358 16102 catalog_manager.cc:5697] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f reported cstate change: config changed from index 14 to 15, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New cstate: current_term: 20 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:08:42.506985 16351 raft_consensus.cc:2955] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 20 FOLLOWER]: Committing config change with OpId 20.15: config changed from index 14 to 15, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:08:42.510286 16283 consensus_queue.cc:237] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:42.510831 16948 raft_consensus.cc:2955] T abbbc04ca95a4119a7e3fb64073fe61f P 1109f76a0b7b443a84c0327c8707bc63 [term 20 FOLLOWER]: Committing config change with OpId 20.15: config changed from index 14 to 15, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:08:42.523061 16945 raft_consensus.cc:1275] T ab124ef29c71409d9c14a75a054095e1 P 1109f76a0b7b443a84c0327c8707bc63 [term 18 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:08:42.525785 23387 consensus_queue.cc:1048] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.010s
I20260709 13:08:42.542689 16205 raft_consensus.cc:1275] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:08:42.545020 23387 consensus_queue.cc:1048] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:42.552604 23438 raft_consensus.cc:2955] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 LEADER]: Committing config change with OpId 18.13: config changed from index 12 to 13, VOTER 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:08:42.554215 16945 raft_consensus.cc:2955] T ab124ef29c71409d9c14a75a054095e1 P 1109f76a0b7b443a84c0327c8707bc63 [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index 12 to 13, VOTER 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:08:42.556524 16205 raft_consensus.cc:2955] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index 12 to 13, VOTER 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:08:42.586644 23542 raft_consensus.cc:2955] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 21 LEADER]: Committing config change with OpId 21.16: config changed from index 15 to 16, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:08:42.601876 16205 raft_consensus.cc:2955] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 21 FOLLOWER]: Committing config change with OpId 21.16: config changed from index 15 to 16, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:08:42.604442 16283 consensus_queue.cc:237] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:42.610828 16102 catalog_manager.cc:5697] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f reported cstate change: config changed from index 12 to 13, VOTER 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) evicted. New cstate: current_term: 18 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:08:42.616988 23541 consensus_queue.cc:1048] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 13:08:42.618742 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 49211.3us
I20260709 13:08:42.634294 16945 raft_consensus.cc:1275] T abbbc04ca95a4119a7e3fb64073fe61f P 1109f76a0b7b443a84c0327c8707bc63 [term 20 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:08:42.656589 16947 raft_consensus.cc:2955] T 19e573db44d24720b3a4805dc20210e8 P 1109f76a0b7b443a84c0327c8707bc63 [term 21 FOLLOWER]: Committing config change with OpId 21.16: config changed from index 15 to 16, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:08:42.661054 16338 tablet_service.cc:1558] Processing DeleteTablet for tablet ab124ef29c71409d9c14a75a054095e1 with delete_type TABLET_DATA_TOMBSTONED (TS 363bb2f744eb486f9ad726f08214c98e not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:51696
I20260709 13:08:42.691679 16348 raft_consensus.cc:1275] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 20 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:08:42.709075 16092 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ab124ef29c71409d9c14a75a054095e1 with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:42.714759 23526 consensus_queue.cc:1048] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:08:42.716068 23323 consensus_queue.cc:1048] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:08:42.740199 16102 catalog_manager.cc:5697] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e reported cstate change: config changed from index 15 to 16, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New cstate: current_term: 21 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:42.743909 23551 tablet_replica.cc:333] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e: stopping tablet replica
I20260709 13:08:42.750937 23551 raft_consensus.cc:2243] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:42.752243 23551 raft_consensus.cc:2272] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:42.754704 23526 raft_consensus.cc:2955] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 LEADER]: Committing config change with OpId 20.16: config changed from index 15 to 16, VOTER e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:08:42.759430 16948 raft_consensus.cc:2955] T abbbc04ca95a4119a7e3fb64073fe61f P 1109f76a0b7b443a84c0327c8707bc63 [term 20 FOLLOWER]: Committing config change with OpId 20.16: config changed from index 15 to 16, VOTER e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:08:42.780773 16350 raft_consensus.cc:2955] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 20 FOLLOWER]: Committing config change with OpId 20.16: config changed from index 15 to 16, VOTER e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:08:42.782830 16354 consensus_queue.cc:237] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:42.793392 23551 ts_tablet_manager.cc:1916] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:42.804800 16948 raft_consensus.cc:1275] T 19e573db44d24720b3a4805dc20210e8 P 1109f76a0b7b443a84c0327c8707bc63 [term 21 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 13:08:42.810921 16205 raft_consensus.cc:1275] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 21 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 13:08:42.813752 23542 consensus_queue.cc:1048] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:08:42.813586 16105 catalog_manager.cc:5697] T abbbc04ca95a4119a7e3fb64073fe61f P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: config changed from index 15 to 16, VOTER e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) evicted. New cstate: current_term: 20 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:08:42.815853 23540 consensus_queue.cc:1048] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:08:42.835167 16092 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet abbbc04ca95a4119a7e3fb64073fe61f with cas_config_opid_index 15: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:42.831700 16277 raft_consensus.cc:2955] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 21 FOLLOWER]: Committing config change with OpId 21.16: config changed from index 15 to 16, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:08:42.859115 23492 raft_consensus.cc:2955] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 21 LEADER]: Committing config change with OpId 21.17: config changed from index 16 to 17, VOTER 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) evicted. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:08:42.866393 16948 raft_consensus.cc:2955] T 19e573db44d24720b3a4805dc20210e8 P 1109f76a0b7b443a84c0327c8707bc63 [term 21 FOLLOWER]: Committing config change with OpId 21.17: config changed from index 16 to 17, VOTER 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) evicted. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:08:42.883394 16201 raft_consensus.cc:2955] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 21 FOLLOWER]: Committing config change with OpId 21.17: config changed from index 16 to 17, VOTER 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) evicted. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:08:42.906620 16191 tablet_service.cc:1558] Processing DeleteTablet for tablet abbbc04ca95a4119a7e3fb64073fe61f with delete_type TABLET_DATA_TOMBSTONED (TS e10b16d536674c0bb350a31d7ce5ff7f not found in new config with opid_index 16) from {username='slave'} at 127.0.0.1:44830
I20260709 13:08:42.908715 16092 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 19e573db44d24720b3a4805dc20210e8 with cas_config_opid_index 16: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:42.941205 16105 catalog_manager.cc:5697] T 19e573db44d24720b3a4805dc20210e8 P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: config changed from index 16 to 17, VOTER 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) evicted. New cstate: current_term: 21 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:08:42.971691 23551 ts_tablet_manager.cc:1929] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 18.12
I20260709 13:08:42.972384 23551 log.cc:1199] T ab124ef29c71409d9c14a75a054095e1 P 363bb2f744eb486f9ad726f08214c98e: Deleting WAL directory at /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602283040513-15057-0/minicluster-data/ts-2-root/wals/ab124ef29c71409d9c14a75a054095e1
I20260709 13:08:42.974866 16092 catalog_manager.cc:5028] TS 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): tablet ab124ef29c71409d9c14a75a054095e1 (table test-workload [id=f364cfe226234c5b99453e3013c8717e]) successfully deleted
I20260709 13:08:42.985639 16270 tablet_service.cc:1558] Processing DeleteTablet for tablet 19e573db44d24720b3a4805dc20210e8 with delete_type TABLET_DATA_TOMBSTONED (TS 0aea40d6e4374085a2e38a70a71f63e3 not found in new config with opid_index 17) from {username='slave'} at 127.0.0.1:45374
I20260709 13:08:42.996120 23554 tablet_replica.cc:333] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3: stopping tablet replica
I20260709 13:08:42.999532 23553 tablet_replica.cc:333] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f: stopping tablet replica
I20260709 13:08:43.005390 16350 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d"
dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
mode: GRACEFUL
new_leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
 from {username='slave'} at 127.0.0.1:56792
I20260709 13:08:43.007539 16350 raft_consensus.cc:606] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 21 LEADER]: Received request to transfer leadership to TS 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:08:43.013355 23554 raft_consensus.cc:2243] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:43.014361 23554 raft_consensus.cc:2272] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:43.022745 23554 ts_tablet_manager.cc:1916] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:43.033749 16277 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aee913c41fb9437587affa768953f637"
dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
mode: GRACEFUL
new_leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
 from {username='slave'} at 127.0.0.1:39058
I20260709 13:08:43.034474 16277 raft_consensus.cc:606] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 22 LEADER]: Received request to transfer leadership to TS e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:43.036106 15057 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:08:43.038048 15057 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:43.045495 23554 ts_tablet_manager.cc:1929] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 21.16
I20260709 13:08:43.046205 23554 log.cc:1199] T 19e573db44d24720b3a4805dc20210e8 P 0aea40d6e4374085a2e38a70a71f63e3: Deleting WAL directory at /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602283040513-15057-0/minicluster-data/ts-1-root/wals/19e573db44d24720b3a4805dc20210e8
I20260709 13:08:43.054149 16092 catalog_manager.cc:5028] TS 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): tablet 19e573db44d24720b3a4805dc20210e8 (table test-workload [id=f364cfe226234c5b99453e3013c8717e]) successfully deleted
I20260709 13:08:43.086660 23553 raft_consensus.cc:2243] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:43.087843 23553 raft_consensus.cc:2272] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:43.094887 23553 ts_tablet_manager.cc:1916] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:43.155941 23553 ts_tablet_manager.cc:1929] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 20.15
I20260709 13:08:43.158818 23553 log.cc:1199] T abbbc04ca95a4119a7e3fb64073fe61f P e10b16d536674c0bb350a31d7ce5ff7f: Deleting WAL directory at /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602283040513-15057-0/minicluster-data/ts-0-root/wals/abbbc04ca95a4119a7e3fb64073fe61f
I20260709 13:08:43.161173 16090 catalog_manager.cc:5028] TS e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): tablet abbbc04ca95a4119a7e3fb64073fe61f (table test-workload [id=f364cfe226234c5b99453e3013c8717e]) successfully deleted
I20260709 13:08:43.352159 23541 raft_consensus.cc:993] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e: : Instructing follower 0aea40d6e4374085a2e38a70a71f63e3 to start an election
I20260709 13:08:43.353238 23541 raft_consensus.cc:1081] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 21 LEADER]: Signalling peer 0aea40d6e4374085a2e38a70a71f63e3 to start an election
I20260709 13:08:43.362458 16277 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d"
dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
 from {username='slave'} at 127.0.0.1:45210
I20260709 13:08:43.365077 16277 raft_consensus.cc:493] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 21 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:43.365599 16277 raft_consensus.cc:3060] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:43.409626 16277 raft_consensus.cc:515] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 22 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:43.414602 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: true dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:08:43.415599 16204 raft_consensus.cc:3060] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:43.449277 23526 raft_consensus.cc:993] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3: : Instructing follower e10b16d536674c0bb350a31d7ce5ff7f to start an election
I20260709 13:08:43.450085 23387 raft_consensus.cc:1081] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 22 LEADER]: Signalling peer e10b16d536674c0bb350a31d7ce5ff7f to start an election
I20260709 13:08:43.461154 16204 raft_consensus.cc:2468] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 22.
I20260709 13:08:43.465039 16277 leader_election.cc:290] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 22 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:43.467636 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: true dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:43.468359 16348 raft_consensus.cc:3055] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:08:43.468730 16348 raft_consensus.cc:740] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:08:43.469718 16348 consensus_queue.cc:260] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:43.470945 16205 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aee913c41fb9437587affa768953f637"
dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
 from {username='slave'} at 127.0.0.1:60138
I20260709 13:08:43.471710 16205 raft_consensus.cc:493] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 22 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:43.472062 16205 raft_consensus.cc:3060] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:08:43.473256 16348 raft_consensus.cc:3060] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:43.489543 16205 raft_consensus.cc:515] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 23 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:43.498684 16205 leader_election.cc:290] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 23 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:43.499928 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: true dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:43.499568 16348 raft_consensus.cc:2468] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 22.
I20260709 13:08:43.500566 16353 raft_consensus.cc:3060] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:08:43.503309 16248 leader_election.cc:304] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:08:43.504878 23526 raft_consensus.cc:2804] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:08:43.506697 23526 raft_consensus.cc:697] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 22 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:08:43.509855 23526 consensus_queue.cc:237] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:43.557364 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: true dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:43.558144 16281 raft_consensus.cc:3055] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:08:43.558497 16281 raft_consensus.cc:740] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:08:43.559458 16281 consensus_queue.cc:260] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:43.561043 16281 raft_consensus.cc:3060] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:08:43.568642 16353 raft_consensus.cc:2468] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 23.
I20260709 13:08:43.594205 16281 raft_consensus.cc:2468] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e10b16d536674c0bb350a31d7ce5ff7f in term 23.
I20260709 13:08:43.595925 16173 leader_election.cc:304] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:43.625146 23539 raft_consensus.cc:2804] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:08:43.626581 23539 raft_consensus.cc:697] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 23 LEADER]: Becoming Leader. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:08:43.627718 23539 consensus_queue.cc:237] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:43.707708 16102 catalog_manager.cc:5697] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 21 to 22, leader changed from 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) to 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66). New cstate: current_term: 22 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:43.709422 16105 catalog_manager.cc:5697] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f reported cstate change: term changed from 22 to 23, leader changed from 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) to e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65). New cstate: current_term: 23 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:43.922789 16205 raft_consensus.cc:1275] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 22 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:08:43.924518 23526 consensus_queue.cc:1048] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:44.047367 16281 raft_consensus.cc:1275] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 23 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:08:44.050140 23557 consensus_queue.cc:1048] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:08:44.053296 16350 raft_consensus.cc:1275] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 22 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:08:44.054886 15057 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:44.088842 23438 consensus_queue.cc:1048] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:08:44.122393 16350 raft_consensus.cc:1275] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 23 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:08:44.135517 23557 consensus_queue.cc:1048] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 13:08:44.456907 23573 log.cc:927] Time spent T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
W20260709 13:08:44.482826 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 129552us
W20260709 13:08:44.694468 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 67845.4us
W20260709 13:08:44.710896 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 62646.6us
I20260709 13:08:44.727358 16349 consensus_queue.cc:237] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
W20260709 13:08:44.748337 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 47888.8us
W20260709 13:08:44.791172 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 86968.5us
W20260709 13:08:44.791265 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 107403us
W20260709 13:08:44.794824 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 83154.7us
I20260709 13:08:44.832159 16208 raft_consensus.cc:1275] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:08:44.834470 23584 consensus_queue.cc:1048] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:44.911764 16277 raft_consensus.cc:1275] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:08:44.917030 23585 raft_consensus.cc:2955] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [term 13 LEADER]: Committing config change with OpId 13.10: config changed from index -1 to 10, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:08:44.928138 16208 raft_consensus.cc:2955] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index -1 to 10, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:08:44.957204 16102 catalog_manager.cc:5697] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e reported cstate change: config changed from index -1 to 10, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New cstate: current_term: 13 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:44.961819 16277 consensus_queue.cc:237] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:08:44.974792 16199 raft_consensus.cc:1275] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 22 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
W20260709 13:08:44.975653 16248 consensus_peers.cc:597] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 -> Peer 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875): Couldn't send request to peer 1109f76a0b7b443a84c0327c8707bc63. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a054979193cb43dcba8c8eb72cd7f05d. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:44.977072 23605 consensus_queue.cc:1048] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:08:44.992039 23609 raft_consensus.cc:2955] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 22 LEADER]: Committing config change with OpId 22.14: config changed from index -1 to 14, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:08:45.004907 16199 raft_consensus.cc:2955] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 22 FOLLOWER]: Committing config change with OpId 22.14: config changed from index -1 to 14, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:08:45.018030 16208 consensus_queue.cc:237] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:08:45.026444 16104 catalog_manager.cc:5697] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: config changed from index -1 to 14, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New cstate: current_term: 22 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:45.054937 16322 consensus_peers.cc:597] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e -> Peer 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875): Couldn't send request to peer 1109f76a0b7b443a84c0327c8707bc63. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5054b6ad2e4141cab2232a3fecd7c858. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:45.063692 16173 consensus_peers.cc:597] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f -> Peer 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875): Couldn't send request to peer 1109f76a0b7b443a84c0327c8707bc63. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 16a307cee8ef431184c620fec029af19. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:45.075850 16349 raft_consensus.cc:1275] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:08:45.082335 16280 raft_consensus.cc:1275] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:08:45.082474 23607 consensus_queue.cc:1048] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:45.084118 23610 consensus_queue.cc:1048] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:08:45.087538 16349 raft_consensus.cc:1275] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 22 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:08:45.106297 23610 consensus_queue.cc:1048] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:08:45.109797 23609 consensus_queue.cc:1048] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:08:45.125274 23579 raft_consensus.cc:2955] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 19 LEADER]: Committing config change with OpId 19.14: config changed from index -1 to 14, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:08:45.127373 16280 raft_consensus.cc:2955] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Committing config change with OpId 19.14: config changed from index -1 to 14, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:08:45.152206 16353 raft_consensus.cc:2955] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 22 FOLLOWER]: Committing config change with OpId 22.14: config changed from index -1 to 14, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:08:45.253448 16282 raft_consensus.cc:2955] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index -1 to 10, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:08:45.322108 16348 raft_consensus.cc:2955] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Committing config change with OpId 19.14: config changed from index -1 to 14, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
W20260709 13:08:45.407089 23618 log.cc:927] Time spent T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:08:45.418579 16349 consensus_queue.cc:237] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
W20260709 13:08:45.426002 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 49199.6us
I20260709 13:08:45.433897 15057 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:45.432106 23622 ts_tablet_manager.cc:933] T 5054b6ad2e4141cab2232a3fecd7c858 P 1109f76a0b7b443a84c0327c8707bc63: Initiating tablet copy from peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:08:45.436563 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 81125us
I20260709 13:08:45.447532 16282 consensus_queue.cc:237] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:45.521517 16105 catalog_manager.cc:5697] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: config changed from index -1 to 14, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New cstate: current_term: 19 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:08:45.536829 23622 tablet_copy_client.cc:323] T 5054b6ad2e4141cab2232a3fecd7c858 P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Beginning tablet copy session from remote peer at address 127.14.180.67:46107
I20260709 13:08:45.567304 16199 raft_consensus.cc:1275] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:08:45.577886 23605 consensus_queue.cc:1048] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 13:08:45.580966 16367 tablet_copy_service.cc:140] P 363bb2f744eb486f9ad726f08214c98e: Received BeginTabletCopySession request for tablet 5054b6ad2e4141cab2232a3fecd7c858 from peer 1109f76a0b7b443a84c0327c8707bc63 ({username='slave'} at 127.0.0.1:33486)
I20260709 13:08:45.581615 16367 tablet_copy_service.cc:161] P 363bb2f744eb486f9ad726f08214c98e: Beginning new tablet copy session on tablet 5054b6ad2e4141cab2232a3fecd7c858 from peer 1109f76a0b7b443a84c0327c8707bc63 at {username='slave'} at 127.0.0.1:33486: session id = 1109f76a0b7b443a84c0327c8707bc63-5054b6ad2e4141cab2232a3fecd7c858
I20260709 13:08:45.594588 16199 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "13bc3c8ff9b84838a2664335d7e1582b"
dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
mode: GRACEFUL
new_leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
 from {username='slave'} at 127.0.0.1:35456
I20260709 13:08:45.595297 16199 raft_consensus.cc:606] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [term 11 LEADER]: Received request to transfer leadership to TS 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:08:45.595301 23633 ts_tablet_manager.cc:933] T 16a307cee8ef431184c620fec029af19 P 1109f76a0b7b443a84c0327c8707bc63: Initiating tablet copy from peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073)
I20260709 13:08:45.632138 16199 raft_consensus.cc:1275] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 20 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:08:45.634259 16283 raft_consensus.cc:1275] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
W20260709 13:08:45.635190 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 129718us
I20260709 13:08:45.642191 16283 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece"
dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
mode: GRACEFUL
new_leader_uuid: "363bb2f744eb486f9ad726f08214c98e"
 from {username='slave'} at 127.0.0.1:39058
I20260709 13:08:45.643666 23576 consensus_queue.cc:1048] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.003s
I20260709 13:08:45.645341 23540 consensus_queue.cc:1048] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:08:45.642846 16283 raft_consensus.cc:606] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 LEADER]: Received request to transfer leadership to TS 363bb2f744eb486f9ad726f08214c98e
W20260709 13:08:45.651836 16322 consensus_peers.cc:597] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e -> Peer 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875): Couldn't send request to peer 1109f76a0b7b443a84c0327c8707bc63. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a1a76ba8ceae4d0780583a09087cec0a. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:45.654734 16367 tablet_copy_source_session.cc:215] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:45.659677 15057 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:08:45.663090 15057 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:45.670810 23637 raft_consensus.cc:993] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3: : Instructing follower 363bb2f744eb486f9ad726f08214c98e to start an election
I20260709 13:08:45.671408 23637 raft_consensus.cc:1081] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 LEADER]: Signalling peer 363bb2f744eb486f9ad726f08214c98e to start an election
I20260709 13:08:45.675207 23622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5054b6ad2e4141cab2232a3fecd7c858. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:08:45.702186 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 88294.1us
I20260709 13:08:45.715220 16201 raft_consensus.cc:2955] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 7 to 12, VOTER 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:08:45.718168 16354 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece"
dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
 from {username='slave'} at 127.0.0.1:41830
I20260709 13:08:45.718796 16354 raft_consensus.cc:493] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:45.719142 16354 raft_consensus.cc:3060] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:45.721191 16945 raft_consensus.cc:1275] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:08:45.714375 23626 raft_consensus.cc:2955] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 LEADER]: Committing config change with OpId 15.12: config changed from index 7 to 12, VOTER 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:08:45.731065 23633 tablet_copy_client.cc:323] T 16a307cee8ef431184c620fec029af19 P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Beginning tablet copy session from remote peer at address 127.14.180.65:46073
I20260709 13:08:45.768982 23627 consensus_queue.cc:1048] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:45.787312 16217 tablet_copy_service.cc:140] P e10b16d536674c0bb350a31d7ce5ff7f: Received BeginTabletCopySession request for tablet 16a307cee8ef431184c620fec029af19 from peer 1109f76a0b7b443a84c0327c8707bc63 ({username='slave'} at 127.0.0.1:39674)
I20260709 13:08:45.788055 16217 tablet_copy_service.cc:161] P e10b16d536674c0bb350a31d7ce5ff7f: Beginning new tablet copy session on tablet 16a307cee8ef431184c620fec029af19 from peer 1109f76a0b7b443a84c0327c8707bc63 at {username='slave'} at 127.0.0.1:39674: session id = 1109f76a0b7b443a84c0327c8707bc63-16a307cee8ef431184c620fec029af19
W20260709 13:08:45.827924 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 58972.2us
I20260709 13:08:45.837867 23645 ts_tablet_manager.cc:933] T a054979193cb43dcba8c8eb72cd7f05d P 1109f76a0b7b443a84c0327c8707bc63: Initiating tablet copy from peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:08:45.841527 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 96767us
I20260709 13:08:45.846094 16354 raft_consensus.cc:515] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:45.848138 16354 leader_election.cc:290] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 17 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:45.855250 16204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: true dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:08:45.856217 16204 raft_consensus.cc:3060] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:45.873122 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: true dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:45.873842 16277 raft_consensus.cc:3055] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:45.874158 16277 raft_consensus.cc:740] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:08:45.888540 16217 tablet_copy_source_session.cc:215] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:45.909735 23580 raft_consensus.cc:993] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f: : Instructing follower 0aea40d6e4374085a2e38a70a71f63e3 to start an election
I20260709 13:08:45.910611 23599 raft_consensus.cc:1081] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [term 11 LEADER]: Signalling peer 0aea40d6e4374085a2e38a70a71f63e3 to start an election
I20260709 13:08:45.919981 16102 catalog_manager.cc:5697] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f reported cstate change: config changed from index 7 to 12, VOTER 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) evicted. New cstate: current_term: 15 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:08:45.927553 23576 raft_consensus.cc:2955] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 20 LEADER]: Committing config change with OpId 20.14: config changed from index -1 to 14, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:08:45.929687 23645 tablet_copy_client.cc:323] T a054979193cb43dcba8c8eb72cd7f05d P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Beginning tablet copy session from remote peer at address 127.14.180.66:45823
I20260709 13:08:45.931524 16283 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "13bc3c8ff9b84838a2664335d7e1582b"
dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
 from {username='slave'} at 127.0.0.1:45218
I20260709 13:08:45.932154 16283 raft_consensus.cc:493] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:45.932511 16283 raft_consensus.cc:3060] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:45.902454 16277 consensus_queue.cc:260] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:45.934841 16208 raft_consensus.cc:2955] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 20 FOLLOWER]: Committing config change with OpId 20.14: config changed from index -1 to 14, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:08:45.945286 16204 raft_consensus.cc:2468] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 17.
I20260709 13:08:45.948191 16293 tablet_copy_service.cc:140] P 0aea40d6e4374085a2e38a70a71f63e3: Received BeginTabletCopySession request for tablet a054979193cb43dcba8c8eb72cd7f05d from peer 1109f76a0b7b443a84c0327c8707bc63 ({username='slave'} at 127.0.0.1:42740)
I20260709 13:08:45.948844 16293 tablet_copy_service.cc:161] P 0aea40d6e4374085a2e38a70a71f63e3: Beginning new tablet copy session on tablet a054979193cb43dcba8c8eb72cd7f05d from peer 1109f76a0b7b443a84c0327c8707bc63 at {username='slave'} at 127.0.0.1:42740: session id = 1109f76a0b7b443a84c0327c8707bc63-a054979193cb43dcba8c8eb72cd7f05d
I20260709 13:08:45.951969 23633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16a307cee8ef431184c620fec029af19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:45.953063 16277 raft_consensus.cc:3060] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:45.965082 16092 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 73757c6fea8949e090aa4e55902a41d4 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER succeeded (attempt 12)
I20260709 13:08:45.966508 16280 raft_consensus.cc:2955] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Committing config change with OpId 20.14: config changed from index -1 to 14, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:08:45.968299 16277 raft_consensus.cc:2468] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 17.
I20260709 13:08:45.980057 16320 leader_election.cc:304] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:45.981763 23646 raft_consensus.cc:2804] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:45.982513 23646 raft_consensus.cc:697] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 17 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:08:45.983783 23646 consensus_queue.cc:237] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:45.986284 16293 tablet_copy_source_session.cc:215] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:46.010576 16338 tablet_service.cc:1558] Processing DeleteTablet for tablet 73757c6fea8949e090aa4e55902a41d4 with delete_type TABLET_DATA_TOMBSTONED (TS 363bb2f744eb486f9ad726f08214c98e not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:51696
I20260709 13:08:46.003211 16945 raft_consensus.cc:2955] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 7 to 12, VOTER 363bb2f744eb486f9ad726f08214c98e (127.14.180.67) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:08:46.011598 16283 raft_consensus.cc:515] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:46.029927 16283 leader_election.cc:290] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:46.041651 16948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bc3c8ff9b84838a2664335d7e1582b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: true dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:08:46.042450 16948 raft_consensus.cc:3060] T 13bc3c8ff9b84838a2664335d7e1582b P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:46.048158 23645 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a054979193cb43dcba8c8eb72cd7f05d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:46.050040 23622 tablet_copy_client.cc:806] T 5054b6ad2e4141cab2232a3fecd7c858 P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:46.050812 23622 tablet_copy_client.cc:670] T 5054b6ad2e4141cab2232a3fecd7c858 P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:46.109412 16102 catalog_manager.cc:5697] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f reported cstate change: config changed from index -1 to 14, NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) added. New cstate: current_term: 20 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } }
I20260709 13:08:46.126204 16208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bc3c8ff9b84838a2664335d7e1582b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: true dest_uuid: "e10b16d536674c0bb350a31d7ce5ff7f"
I20260709 13:08:46.127084 16208 raft_consensus.cc:3055] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:08:46.127441 16208 raft_consensus.cc:740] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e10b16d536674c0bb350a31d7ce5ff7f, State: Running, Role: LEADER
I20260709 13:08:46.129689 16208 consensus_queue.cc:260] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:46.131102 16208 raft_consensus.cc:3060] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:46.132788 23622 tablet_copy_client.cc:538] T 5054b6ad2e4141cab2232a3fecd7c858 P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:46.167829 16948 raft_consensus.cc:2468] T 13bc3c8ff9b84838a2664335d7e1582b P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 12.
I20260709 13:08:46.186002 23650 tablet_replica.cc:333] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e: stopping tablet replica
I20260709 13:08:46.187389 16208 raft_consensus.cc:2468] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 12.
I20260709 13:08:46.189224 16246 leader_election.cc:304] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f; no voters: 
I20260709 13:08:46.204442 16104 catalog_manager.cc:5697] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e reported cstate change: term changed from 16 to 17, leader changed from 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) to 363bb2f744eb486f9ad726f08214c98e (127.14.180.67). New cstate: current_term: 17 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } }
W20260709 13:08:46.221087 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 97438.5us
I20260709 13:08:46.223754 23387 raft_consensus.cc:2804] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:46.308043 23387 raft_consensus.cc:697] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:08:46.309063 23387 consensus_queue.cc:237] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:46.339391 23650 raft_consensus.cc:2243] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:46.340284 23650 raft_consensus.cc:2272] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:46.357558 23633 tablet_copy_client.cc:806] T 16a307cee8ef431184c620fec029af19 P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:46.358243 23633 tablet_copy_client.cc:670] T 16a307cee8ef431184c620fec029af19 P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:46.359414 23650 ts_tablet_manager.cc:1916] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:46.369359 23622 tablet_bootstrap.cc:492] T 5054b6ad2e4141cab2232a3fecd7c858 P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap starting.
I20260709 13:08:46.378298 23645 tablet_copy_client.cc:806] T a054979193cb43dcba8c8eb72cd7f05d P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Starting download of 0 data blocks...
W20260709 13:08:46.403091 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 118317us
I20260709 13:08:46.407938 23645 tablet_copy_client.cc:670] T a054979193cb43dcba8c8eb72cd7f05d P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:46.440953 16199 raft_consensus.cc:1275] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:08:46.444532 23658 ts_tablet_manager.cc:933] T a1a76ba8ceae4d0780583a09087cec0a P 1109f76a0b7b443a84c0327c8707bc63: Initiating tablet copy from peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:46.450410 23576 consensus_queue.cc:1048] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 13:08:46.473278 23645 tablet_copy_client.cc:538] T a054979193cb43dcba8c8eb72cd7f05d P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:46.479528 23633 tablet_copy_client.cc:538] T 16a307cee8ef431184c620fec029af19 P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:46.507957 23633 tablet_bootstrap.cc:492] T 16a307cee8ef431184c620fec029af19 P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap starting.
I20260709 13:08:46.512259 23658 tablet_copy_client.cc:323] T a1a76ba8ceae4d0780583a09087cec0a P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Beginning tablet copy session from remote peer at address 127.14.180.67:46107
I20260709 13:08:46.530862 16367 tablet_copy_service.cc:140] P 363bb2f744eb486f9ad726f08214c98e: Received BeginTabletCopySession request for tablet a1a76ba8ceae4d0780583a09087cec0a from peer 1109f76a0b7b443a84c0327c8707bc63 ({username='slave'} at 127.0.0.1:33486)
I20260709 13:08:46.531641 16367 tablet_copy_service.cc:161] P 363bb2f744eb486f9ad726f08214c98e: Beginning new tablet copy session on tablet a1a76ba8ceae4d0780583a09087cec0a from peer 1109f76a0b7b443a84c0327c8707bc63 at {username='slave'} at 127.0.0.1:33486: session id = 1109f76a0b7b443a84c0327c8707bc63-a1a76ba8ceae4d0780583a09087cec0a
I20260709 13:08:46.528111 16102 catalog_manager.cc:5697] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 11 to 12, leader changed from e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) to 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66). New cstate: current_term: 12 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:46.542717 16367 tablet_copy_source_session.cc:215] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:46.546247 23645 tablet_bootstrap.cc:492] T a054979193cb43dcba8c8eb72cd7f05d P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap starting.
I20260709 13:08:46.553182 23650 ts_tablet_manager.cc:1929] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 15.11
I20260709 13:08:46.570286 16280 raft_consensus.cc:1275] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:08:46.579301 23658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1a76ba8ceae4d0780583a09087cec0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:46.570196 23650 log.cc:1199] T 73757c6fea8949e090aa4e55902a41d4 P 363bb2f744eb486f9ad726f08214c98e: Deleting WAL directory at /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602283040513-15057-0/minicluster-data/ts-2-root/wals/73757c6fea8949e090aa4e55902a41d4
I20260709 13:08:46.584743 16092 catalog_manager.cc:5028] TS 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): tablet 73757c6fea8949e090aa4e55902a41d4 (table test-workload [id=f364cfe226234c5b99453e3013c8717e]) successfully deleted
I20260709 13:08:46.629860 23576 consensus_queue.cc:1048] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.006s
I20260709 13:08:46.670751 15057 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:08:46.769268 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 44009.3us
I20260709 13:08:46.806594 16941 raft_consensus.cc:1275] T 13bc3c8ff9b84838a2664335d7e1582b P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:08:46.810490 23609 consensus_queue.cc:1048] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:46.977761 16204 raft_consensus.cc:1275] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:08:46.980341 23658 tablet_copy_client.cc:806] T a1a76ba8ceae4d0780583a09087cec0a P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:46.981026 23658 tablet_copy_client.cc:670] T a1a76ba8ceae4d0780583a09087cec0a P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Starting download of 1 WAL segments...
/apache/dev/git/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:278: Failure
Failed
Bad status: Illegal state: leader_transfer_task size should be 0, but 2
I20260709 13:08:46.981777 23628 consensus_queue.cc:1048] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.017s
/apache/dev/git/kudu/src/kudu/util/test_util.cc:402: Failure
Failed
Timed out waiting for assertion to pass.
I20260709 13:08:47.005079 15057 tablet_server.cc:179] TabletServer@127.14.180.65:0 shutting down...
W20260709 13:08:47.006403 16320 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:47.038967 23658 tablet_copy_client.cc:538] T a1a76ba8ceae4d0780583a09087cec0a P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 13:08:47.085695 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 71847.3us
W20260709 13:08:47.090313 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 83952.2us
W20260709 13:08:47.098481 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 77862.9us
I20260709 13:08:47.234102 23658 tablet_bootstrap.cc:492] T a1a76ba8ceae4d0780583a09087cec0a P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap starting.
W20260709 13:08:47.223618 16912 consensus_peers.cc:597] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:47.270625 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 47163.1us
W20260709 13:08:47.245738 16246 consensus_peers.cc:597] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:47.256263 23622 tablet_bootstrap.cc:492] T 5054b6ad2e4141cab2232a3fecd7c858 P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:08:47.272655 16246 consensus_peers.cc:597] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:47.271320 16912 consensus_peers.cc:597] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:47.280714 16912 consensus_peers.cc:597] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:47.283208 16912 consensus_peers.cc:597] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:47.375223 23622 tablet_bootstrap.cc:492] T 5054b6ad2e4141cab2232a3fecd7c858 P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap complete.
I20260709 13:08:47.376183 23622 ts_tablet_manager.cc:1403] T 5054b6ad2e4141cab2232a3fecd7c858 P 1109f76a0b7b443a84c0327c8707bc63: Time spent bootstrapping tablet: real 1.007s	user 0.054s	sys 0.006s
W20260709 13:08:47.389416 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 83791.4us
W20260709 13:08:47.377583 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 101500us
W20260709 13:08:47.405510 16320 consensus_peers.cc:597] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:47.403671 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 90504.7us
W20260709 13:08:47.406056 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 125869us
W20260709 13:08:47.409214 16320 consensus_peers.cc:597] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:47.409876 16320 consensus_peers.cc:597] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:47.410430 16320 consensus_peers.cc:597] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:47.413955 16320 consensus_peers.cc:597] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:47.400875 16912 consensus_peers.cc:597] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:47.464246 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 43525.5us
W20260709 13:08:47.481716 16320 consensus_peers.cc:597] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:47.492297 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 77510.1us
W20260709 13:08:47.465113 23645 log.cc:927] Time spent T a054979193cb43dcba8c8eb72cd7f05d P 1109f76a0b7b443a84c0327c8707bc63: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260709 13:08:47.499912 16320 consensus_peers.cc:597] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:47.534523 16320 consensus_peers.cc:597] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:47.570297 16320 consensus_peers.cc:597] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:47.571277 16320 consensus_peers.cc:597] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:47.579910 16320 consensus_peers.cc:597] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:47.581517 16320 consensus_peers.cc:597] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:47.619341 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 133792us
W20260709 13:08:47.637394 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 227840us
W20260709 13:08:47.649562 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 164746us
W20260709 13:08:47.650013 16320 consensus_peers.cc:597] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:47.897064 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 235515us
W20260709 13:08:47.935463 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 272092us
I20260709 13:08:47.926379 23622 raft_consensus.cc:359] T 5054b6ad2e4141cab2232a3fecd7c858 P 1109f76a0b7b443a84c0327c8707bc63 [term 13 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:08:47.980494 23654 raft_consensus.cc:493] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:48.024510 23623 raft_consensus.cc:493] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:08:48.028465 23692 raft_consensus.cc:493] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:08:48.013089 23622 raft_consensus.cc:740] T 5054b6ad2e4141cab2232a3fecd7c858 P 1109f76a0b7b443a84c0327c8707bc63 [term 13 LEARNER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Initialized, Role: LEARNER
I20260709 13:08:48.047369 23622 consensus_queue.cc:260] T 5054b6ad2e4141cab2232a3fecd7c858 P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:08:48.024639 23678 raft_consensus.cc:493] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:08:48.050320 23678 raft_consensus.cc:515] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:48.052824 23678 leader_election.cc:290] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:48.055365 23645 tablet_bootstrap.cc:492] T a054979193cb43dcba8c8eb72cd7f05d P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:48.056560 23645 tablet_bootstrap.cc:492] T a054979193cb43dcba8c8eb72cd7f05d P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap complete.
I20260709 13:08:48.057441 23645 ts_tablet_manager.cc:1403] T a054979193cb43dcba8c8eb72cd7f05d P 1109f76a0b7b443a84c0327c8707bc63: Time spent bootstrapping tablet: real 1.511s	user 0.051s	sys 0.025s
I20260709 13:08:48.030588 23692 raft_consensus.cc:515] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:48.060663 23692 leader_election.cc:290] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:48.065167 23622 ts_tablet_manager.cc:1434] T 5054b6ad2e4141cab2232a3fecd7c858 P 1109f76a0b7b443a84c0327c8707bc63: Time spent starting tablet: real 0.689s	user 0.012s	sys 0.001s
I20260709 13:08:48.025545 23623 raft_consensus.cc:515] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:48.068145 23623 leader_election.cc:290] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:08:48.069105 23622 ts_tablet_manager.cc:1467] T 5054b6ad2e4141cab2232a3fecd7c858 P 1109f76a0b7b443a84c0327c8707bc63: Tablet startup took 692ms
I20260709 13:08:48.033541 23654 raft_consensus.cc:515] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:08:48.069679 23622 ts_tablet_manager.cc:1469] T 5054b6ad2e4141cab2232a3fecd7c858 P 1109f76a0b7b443a84c0327c8707bc63: Trace:
0709 13:08:45.238937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:45.239113 (+   176us) service_pool.cc:224] Handling call
0709 13:08:45.464251 (+225138us) ts_tablet_manager.cc:934] T 5054b6ad2e4141cab2232a3fecd7c858 P 1109f76a0b7b443a84c0327c8707bc63: Initiating tablet copy from peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
0709 13:08:45.667433 (+203182us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:08:45.907329 (+239896us) tablet_metadata.cc:665] Metadata flushed
0709 13:08:45.907455 (+   126us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:08:46.022329 (+114874us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:08:46.034907 (+ 12578us) tablet_replica.cc:206] Creating consensus instance
0709 13:08:46.049435 (+ 14528us) ts_tablet_manager.cc:989] Replica registered.
0709 13:08:46.049511 (+    76us) inbound_call.cc:177] Queueing success response
0709 13:08:46.368933 (+319422us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:08:47.376563 (+1007630us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:08:47.592401 (+215838us) tablet_replica.cc:261] Starting instrumentation
0709 13:08:47.593271 (+   870us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":6528,"mutex_wait_us":28316,"raft.queue_time_us":13334,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":151,"tablet-copy.queue_time_us":174296,"tablet-download-pool.queue_time_us":9511,"tablet-download-pool.run_cpu_time_us":1482,"tablet-download-pool.run_wall_time_us":71896,"thread_start_us":157543,"threads_started":2}
W20260709 13:08:48.089604 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 148613us
I20260709 13:08:48.089000 23654 leader_election.cc:290] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:48.116514 23697 raft_consensus.cc:493] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:48.117187 23697 raft_consensus.cc:515] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:48.120220 23697 leader_election.cc:290] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:48.166589 23684 raft_consensus.cc:493] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:48.167266 23684 raft_consensus.cc:515] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:48.171744 23654 raft_consensus.cc:493] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:08:48.172446 23654 raft_consensus.cc:515] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:48.179296 23684 leader_election.cc:290] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:48.182790 23690 raft_consensus.cc:493] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:48.183439 23690 raft_consensus.cc:515] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:48.185600 23690 leader_election.cc:290] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:48.188877 23610 raft_consensus.cc:493] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:08:48.189555 23610 raft_consensus.cc:515] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:48.191846 23610 leader_election.cc:290] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:48.192512 23610 raft_consensus.cc:493] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:08:48.193405 23610 raft_consensus.cc:515] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:48.195705 23610 leader_election.cc:290] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:08:48.206754 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 103884us
I20260709 13:08:48.197973 23645 raft_consensus.cc:359] T a054979193cb43dcba8c8eb72cd7f05d P 1109f76a0b7b443a84c0327c8707bc63 [term 22 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
W20260709 13:08:48.216032 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 209321us
W20260709 13:08:48.217820 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 109209us
W20260709 13:08:48.220355 16246 consensus_peers.cc:597] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:48.231915 16945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:48.229710 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:48.236851 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:48.245307 16367 tablet_copy_service.cc:342] P 363bb2f744eb486f9ad726f08214c98e: Request end of tablet copy session 1109f76a0b7b443a84c0327c8707bc63-5054b6ad2e4141cab2232a3fecd7c858 received from {username='slave'} at 127.0.0.1:33486
I20260709 13:08:48.245900 16367 tablet_copy_service.cc:434] P 363bb2f744eb486f9ad726f08214c98e: ending tablet copy session 1109f76a0b7b443a84c0327c8707bc63-5054b6ad2e4141cab2232a3fecd7c858 on tablet 5054b6ad2e4141cab2232a3fecd7c858 with peer 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:08:48.225514 23645 raft_consensus.cc:740] T a054979193cb43dcba8c8eb72cd7f05d P 1109f76a0b7b443a84c0327c8707bc63 [term 22 LEARNER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Initialized, Role: LEARNER
I20260709 13:08:48.260564 16945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:48.262473 16948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:48.292490 23623 raft_consensus.cc:493] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:48.293190 23623 raft_consensus.cc:515] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:48.295554 23623 leader_election.cc:290] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:48.281101 15057 tablet_copy_service.cc:362] P e10b16d536674c0bb350a31d7ce5ff7f: Destroying tablet copy session 1109f76a0b7b443a84c0327c8707bc63-16a307cee8ef431184c620fec029af19 due to service shutdown
I20260709 13:08:48.308269 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f72b5892c874917882ef9ee926ce439" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:48.309405 15057 tablet_copy_service.cc:434] P e10b16d536674c0bb350a31d7ce5ff7f: ending tablet copy session 1109f76a0b7b443a84c0327c8707bc63-16a307cee8ef431184c620fec029af19 on tablet 16a307cee8ef431184c620fec029af19 with peer 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:08:48.309737 23678 raft_consensus.cc:493] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:48.310341 23678 raft_consensus.cc:515] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:48.310726 23580 raft_consensus.cc:493] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:48.311465 23580 raft_consensus.cc:515] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:08:48.312613 23678 leader_election.cc:290] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:48.313449 23572 raft_consensus.cc:493] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:48.313910 23580 leader_election.cc:290] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:48.314036 23572 raft_consensus.cc:515] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:48.265889 23654 leader_election.cc:290] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:08:48.309049 16912 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 75799us
I20260709 13:08:48.319825 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b615ac918a749989f2968826926adf3" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:48.316562 23572 leader_election.cc:290] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:48.335421 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:48.322413 23684 raft_consensus.cc:493] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
W20260709 13:08:48.340636 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 61309.2us
I20260709 13:08:48.342147 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:48.343679 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:48.344072 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:48.328719 23678 raft_consensus.cc:493] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:48.362054 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:48.366066 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40719878febd41f9b57c9a6992d4431b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:48.365741 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:48.369889 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b241405f79a345849ba216394fcb999a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:48.370813 23678 raft_consensus.cc:515] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:48.377924 23678 leader_election.cc:290] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:48.378657 23672 raft_consensus.cc:493] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:48.379248 23672 raft_consensus.cc:515] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:48.380631 23572 raft_consensus.cc:493] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:08:48.381281 23572 raft_consensus.cc:515] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:48.360436 23599 raft_consensus.cc:493] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:08:48.383069 23599 raft_consensus.cc:515] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:48.384456 23572 leader_election.cc:290] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:48.368126 23579 raft_consensus.cc:493] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:08:48.386142 23579 raft_consensus.cc:515] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:48.388374 23579 leader_election.cc:290] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:48.389344 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:48.364598 23623 raft_consensus.cc:493] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:48.391103 23623 raft_consensus.cc:515] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:48.393379 23623 leader_election.cc:290] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:48.310815 23645 consensus_queue.cc:260] T a054979193cb43dcba8c8eb72cd7f05d P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:08:48.402631 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:48.340494 23684 raft_consensus.cc:515] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:08:48.417779 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 107330us
I20260709 13:08:48.421492 23678 raft_consensus.cc:493] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:48.430047 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7ce522fbeb44228a8c05d5ceeadc347" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:48.433295 16945 raft_consensus.cc:1217] T 5054b6ad2e4141cab2232a3fecd7c858 P 1109f76a0b7b443a84c0327c8707bc63 [term 13 LEARNER]: Deduplicated request from leader. Original: 13.9->[13.10-13.10]   Dedup: 13.10->[]
I20260709 13:08:48.422032 23580 raft_consensus.cc:493] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:08:48.434757 23579 raft_consensus.cc:493] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:08:48.452525 23672 leader_election.cc:290] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:08:48.456166 16320 consensus_peers.cc:597] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:48.434588 23654 raft_consensus.cc:493] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
W20260709 13:08:48.462018 16246 consensus_peers.cc:597] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:48.465353 16246 consensus_peers.cc:597] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:48.466231 16246 consensus_peers.cc:597] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:48.464412 23690 raft_consensus.cc:493] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:08:48.474767 23599 leader_election.cc:290] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:48.479424 16945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
W20260709 13:08:48.476800 16320 consensus_peers.cc:597] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:48.482435 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
W20260709 13:08:48.471591 16246 consensus_peers.cc:597] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:48.462699 23579 raft_consensus.cc:515] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:08:48.486163 16912 consensus_peers.cc:597] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:48.487341 16246 consensus_peers.cc:597] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:48.464890 23580 raft_consensus.cc:515] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:48.466193 23678 raft_consensus.cc:515] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:48.481775 23697 raft_consensus.cc:493] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:08:48.496873 23697 raft_consensus.cc:515] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:48.475737 23654 raft_consensus.cc:515] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:08:48.500008 16246 consensus_peers.cc:597] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:48.490517 23672 raft_consensus.cc:493] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
W20260709 13:08:48.503659 16912 consensus_peers.cc:597] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:48.507406 16945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
W20260709 13:08:48.504639 16246 consensus_peers.cc:597] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:48.507258 23692 raft_consensus.cc:493] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:08:48.487587 23690 raft_consensus.cc:515] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
W20260709 13:08:48.514182 16246 consensus_peers.cc:597] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:48.539229 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:48.539153 16945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:48.540817 16948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:48.543910 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bc3c8ff9b84838a2664335d7e1582b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:48.546752 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:48.548650 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:48.551993 23684 leader_election.cc:290] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:48.545615 23692 raft_consensus.cc:515] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:48.557215 23692 leader_election.cc:290] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:48.561206 23697 leader_election.cc:290] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:48.564874 23684 raft_consensus.cc:493] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:48.524499 23672 raft_consensus.cc:515] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:48.569387 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eeda5ee833164deb9ec027b22371793c" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:48.570116 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:48.571208 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e573db44d24720b3a4805dc20210e8" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:48.568396 23672 leader_election.cc:290] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:48.573982 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:48.574631 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:48.575944 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:48.576588 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:48.576826 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd0c3c592b464aafaf1d0b94d1e6e360" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:48.576033 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccde1e8182914560a3c1df0312e6a2b2" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:48.579593 23579 leader_election.cc:290] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:48.584363 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:48.565573 23684 raft_consensus.cc:515] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:48.594240 23645 ts_tablet_manager.cc:1434] T a054979193cb43dcba8c8eb72cd7f05d P 1109f76a0b7b443a84c0327c8707bc63: Time spent starting tablet: real 0.536s	user 0.010s	sys 0.003s
W20260709 13:08:48.594729 23645 ts_tablet_manager.cc:1467] T a054979193cb43dcba8c8eb72cd7f05d P 1109f76a0b7b443a84c0327c8707bc63: Tablet startup took 536ms
I20260709 13:08:48.611294 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98afc5914978455ba8cc5329152a3f1d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:48.611580 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bc3c8ff9b84838a2664335d7e1582b" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:48.616478 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:48.627231 16173 leader_election.cc:304] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:08:48.646061 23580 leader_election.cc:290] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:48.651568 23654 leader_election.cc:290] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:48.653369 23684 leader_election.cc:290] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:48.626199 23686 raft_consensus.cc:493] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:48.659071 23599 raft_consensus.cc:2749] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:48.674717 23686 raft_consensus.cc:515] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:08:48.677042 23686 leader_election.cc:290] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:48.680863 23690 leader_election.cc:290] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:48.695895 16173 leader_election.cc:304] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:08:48.701239 16173 leader_election.cc:304] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:08:48.703737 16173 leader_election.cc:304] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:08:48.701116 23599 raft_consensus.cc:2749] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:48.705237 23579 raft_consensus.cc:2749] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:48.707486 23684 raft_consensus.cc:2749] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:08:48.711730 23678 leader_election.cc:290] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:08:48.595038 23645 ts_tablet_manager.cc:1469] T a054979193cb43dcba8c8eb72cd7f05d P 1109f76a0b7b443a84c0327c8707bc63: Trace:
0709 13:08:45.739254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:45.739409 (+   155us) service_pool.cc:224] Handling call
0709 13:08:45.838324 (+ 98915us) ts_tablet_manager.cc:934] T a054979193cb43dcba8c8eb72cd7f05d P 1109f76a0b7b443a84c0327c8707bc63: Initiating tablet copy from peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
0709 13:08:46.033788 (+195464us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:08:46.245417 (+211629us) tablet_metadata.cc:665] Metadata flushed
0709 13:08:46.245609 (+   192us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:08:46.377375 (+131766us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:08:46.377684 (+   309us) tablet_replica.cc:206] Creating consensus instance
0709 13:08:46.377997 (+   313us) ts_tablet_manager.cc:989] Replica registered.
0709 13:08:46.378060 (+    63us) inbound_call.cc:177] Queueing success response
0709 13:08:46.545891 (+167831us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:08:48.057821 (+1511930us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:08:48.058458 (+   637us) tablet_replica.cc:261] Starting instrumentation
0709 13:08:48.196173 (+137715us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":378,"raft.queue_time_us":325,"raft.run_cpu_time_us":232,"raft.run_wall_time_us":12453,"tablet-copy.queue_time_us":95937,"tablet-download-pool.queue_time_us":3163,"tablet-download-pool.run_cpu_time_us":1175,"tablet-download-pool.run_wall_time_us":19420,"thread_start_us":180216,"threads_started":2}
I20260709 13:08:48.789019 16293 tablet_copy_service.cc:342] P 0aea40d6e4374085a2e38a70a71f63e3: Request end of tablet copy session 1109f76a0b7b443a84c0327c8707bc63-a054979193cb43dcba8c8eb72cd7f05d received from {username='slave'} at 127.0.0.1:42740
I20260709 13:08:48.790699 16293 tablet_copy_service.cc:434] P 0aea40d6e4374085a2e38a70a71f63e3: ending tablet copy session 1109f76a0b7b443a84c0327c8707bc63-a054979193cb43dcba8c8eb72cd7f05d on tablet a054979193cb43dcba8c8eb72cd7f05d with peer 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:08:48.813359 16173 leader_election.cc:304] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:08:48.802248 23633 tablet_bootstrap.cc:492] T 16a307cee8ef431184c620fec029af19 P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:48.823402 16173 leader_election.cc:304] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:08:48.827189 16173 leader_election.cc:304] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:08:48.828178 23579 raft_consensus.cc:2749] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:48.831789 16173 leader_election.cc:304] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:08:48.822685 23690 raft_consensus.cc:2749] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:08:48.836324 23684 raft_consensus.cc:2749] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:48.832490 23579 raft_consensus.cc:2749] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:48.847584 23633 tablet_bootstrap.cc:492] T 16a307cee8ef431184c620fec029af19 P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap complete.
I20260709 13:08:48.848404 23633 ts_tablet_manager.cc:1403] T 16a307cee8ef431184c620fec029af19 P 1109f76a0b7b443a84c0327c8707bc63: Time spent bootstrapping tablet: real 2.341s	user 0.074s	sys 0.023s
I20260709 13:08:48.837602 16173 leader_election.cc:304] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:08:48.859704 23633 raft_consensus.cc:359] T 16a307cee8ef431184c620fec029af19 P 1109f76a0b7b443a84c0327c8707bc63 [term 19 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
W20260709 13:08:48.865501 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 161226us
W20260709 13:08:48.884582 16173 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 47090.3us
I20260709 13:08:48.886227 23697 raft_consensus.cc:2749] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:48.867173 23633 raft_consensus.cc:740] T 16a307cee8ef431184c620fec029af19 P 1109f76a0b7b443a84c0327c8707bc63 [term 19 LEARNER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Initialized, Role: LEARNER
I20260709 13:08:48.904052 16173 leader_election.cc:304] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:08:48.909358 16173 leader_election.cc:304] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:08:48.919723 23690 raft_consensus.cc:2749] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:48.913619 23579 raft_consensus.cc:2749] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:48.927982 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c15d8e9be8414c84912ab77b66bfb1" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:48.935611 16947 raft_consensus.cc:1217] T a054979193cb43dcba8c8eb72cd7f05d P 1109f76a0b7b443a84c0327c8707bc63 [term 22 LEARNER]: Deduplicated request from leader. Original: 22.13->[22.14-22.14]   Dedup: 22.14->[]
I20260709 13:08:48.942214 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9c15d8e9be8414c84912ab77b66bfb1" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:48.953104 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:48.962170 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:48.968768 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:48.971570 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:48.972977 16945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:48.973083 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:48.974216 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cabbc283ea543459d45ebdb8b6add94" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:48.976046 16945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f022e2e63ae4461d834e476ff2666991" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:48.957899 23633 consensus_queue.cc:260] T 16a307cee8ef431184c620fec029af19 P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:08:48.982892 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5247d6e15e644eaa8f250cc1aa2d4b75" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:48.984318 16945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:48.985762 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:48.987260 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5063fcda38c2468a8dad5d01023b700a" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:48.989204 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f022e2e63ae4461d834e476ff2666991" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:48.991174 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:49.002110 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:49.003582 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:49.010584 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:49.012135 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5054b6ad2e4141cab2232a3fecd7c858" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:49.015105 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:49.015890 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7d554054f014c74992a2a66ff6873cd" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:49.018646 23690 raft_consensus.cc:493] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:49.022786 23690 raft_consensus.cc:515] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:49.022929 23572 raft_consensus.cc:493] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:08:49.028409 23572 raft_consensus.cc:515] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:49.044013 23644 raft_consensus.cc:1064] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e: attempting to promote NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 to VOTER
I20260709 13:08:49.026459 23690 leader_election.cc:290] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:49.030529 23572 leader_election.cc:290] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:49.054455 15057 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:08:49.059497 15057 tablet_replica.cc:333] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f: stopping tablet replica
I20260709 13:08:49.068454 15057 raft_consensus.cc:2243] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:08:49.071723 15057 raft_consensus.cc:2272] T 18b8d2f02b16479aaf7ec42190a4197f P e10b16d536674c0bb350a31d7ce5ff7f [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:49.072404 23644 consensus_queue.cc:237] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 8, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:49.074936 15057 tablet_replica.cc:333] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f: stopping tablet replica
I20260709 13:08:49.075726 23633 ts_tablet_manager.cc:1434] T 16a307cee8ef431184c620fec029af19 P 1109f76a0b7b443a84c0327c8707bc63: Time spent starting tablet: real 0.227s	user 0.011s	sys 0.001s
I20260709 13:08:49.075966 15057 raft_consensus.cc:2243] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:49.078296 15057 raft_consensus.cc:2272] T c24b4a916c7f491da5d7f9b92db71ece P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:49.076282 16173 leader_election.cc:304] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:08:49.082387 23654 raft_consensus.cc:2749] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:49.083972 16173 leader_election.cc:304] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:08:49.084860 23654 raft_consensus.cc:2749] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:08:49.086308 16173 leader_election.cc:304] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:08:49.087175 23654 raft_consensus.cc:2749] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:08:49.095098 16173 leader_election.cc:304] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:08:49.096061 23654 raft_consensus.cc:2749] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:49.096624 16173 leader_election.cc:304] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:08:49.097536 23654 raft_consensus.cc:2749] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:49.098035 16173 leader_election.cc:304] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:08:49.098901 23654 raft_consensus.cc:2749] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:49.099442 16173 leader_election.cc:304] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:08:49.100301 23654 raft_consensus.cc:2749] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:49.100850 16173 leader_election.cc:304] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:08:49.101743 23654 raft_consensus.cc:2749] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:49.102236 16173 leader_election.cc:304] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:08:49.103148 23654 raft_consensus.cc:2749] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:08:49.114744 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 49938.9us
I20260709 13:08:49.129310 16945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:49.136109 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:49.143476 15057 tablet_replica.cc:333] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f: stopping tablet replica
I20260709 13:08:49.143790 16945 raft_consensus.cc:1217] T 16a307cee8ef431184c620fec029af19 P 1109f76a0b7b443a84c0327c8707bc63 [term 19 LEARNER]: Deduplicated request from leader. Original: 19.13->[19.14-19.14]   Dedup: 19.14->[]
I20260709 13:08:49.144824 15057 raft_consensus.cc:2243] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:49.145664 15057 raft_consensus.cc:2272] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:49.148695 15057 tablet_replica.cc:333] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f: stopping tablet replica
I20260709 13:08:49.149569 15057 raft_consensus.cc:2243] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:08:49.162402 16945 raft_consensus.cc:1275] T 5054b6ad2e4141cab2232a3fecd7c858 P 1109f76a0b7b443a84c0327c8707bc63 [term 13 LEARNER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:08:49.162588 16282 raft_consensus.cc:1275] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 13:08:49.164247 16320 consensus_peers.cc:597] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:49.171147 16173 leader_election.cc:304] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:08:49.172221 23572 raft_consensus.cc:2749] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:49.179243 16173 leader_election.cc:304] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:08:49.180114 23672 raft_consensus.cc:2749] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:49.181516 16173 leader_election.cc:304] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:08:49.182322 23572 raft_consensus.cc:2749] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:49.183851 16173 leader_election.cc:304] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
W20260709 13:08:49.184684 16173 raft_consensus.cc:2686] T 5247d6e15e644eaa8f250cc1aa2d4b75 P e10b16d536674c0bb350a31d7ce5ff7f: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:08:49.185539 16173 leader_election.cc:304] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:08:49.186277 23672 raft_consensus.cc:2749] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:08:49.188843 16173 leader_election.cc:304] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:08:49.189648 23672 raft_consensus.cc:2749] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:08:49.191635 16173 leader_election.cc:304] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:08:49.192422 23672 raft_consensus.cc:2749] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:49.193825 16173 leader_election.cc:304] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:08:49.194633 23672 raft_consensus.cc:2749] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:49.195950 16173 leader_election.cc:304] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:08:49.196702 23672 raft_consensus.cc:2749] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:08:49.197903 16173 leader_election.cc:304] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:08:49.198695 23672 raft_consensus.cc:2749] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:49.204880 16173 leader_election.cc:304] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:08:49.205188 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:49.205819 23672 raft_consensus.cc:2749] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:08:49.208930 23658 log.cc:927] Time spent T a1a76ba8ceae4d0780583a09087cec0a P 1109f76a0b7b443a84c0327c8707bc63: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:08:49.216899 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:49.221470 23644 consensus_queue.cc:1048] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.009s
I20260709 13:08:49.233258 16173 leader_election.cc:304] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:08:49.242846 23672 raft_consensus.cc:2749] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:49.244902 16173 leader_election.cc:304] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e10b16d536674c0bb350a31d7ce5ff7f; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:08:49.245746 23672 raft_consensus.cc:2749] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:49.254760 15057 raft_consensus.cc:2272] T 42944699e5b24681aa3b54ef1010699d P e10b16d536674c0bb350a31d7ce5ff7f [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:49.257804 15057 tablet_replica.cc:333] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f: stopping tablet replica
I20260709 13:08:49.258523 23658 tablet_bootstrap.cc:492] T a1a76ba8ceae4d0780583a09087cec0a P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:49.260030 23644 consensus_queue.cc:1048] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:49.282919 15057 raft_consensus.cc:2243] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:49.283747 15057 raft_consensus.cc:2272] T 8cabbc283ea543459d45ebdb8b6add94 P e10b16d536674c0bb350a31d7ce5ff7f [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:49.306962 15057 tablet_replica.cc:333] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f: stopping tablet replica
I20260709 13:08:49.303911 23658 tablet_bootstrap.cc:492] T a1a76ba8ceae4d0780583a09087cec0a P 1109f76a0b7b443a84c0327c8707bc63: Bootstrap complete.
I20260709 13:08:49.315099 15057 raft_consensus.cc:2243] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:49.319200 15057 raft_consensus.cc:2272] T 143d3d1339b44b6dbdf204507b6af74b P e10b16d536674c0bb350a31d7ce5ff7f [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:49.327111 23658 ts_tablet_manager.cc:1403] T a1a76ba8ceae4d0780583a09087cec0a P 1109f76a0b7b443a84c0327c8707bc63: Time spent bootstrapping tablet: real 2.093s	user 0.058s	sys 0.056s
I20260709 13:08:49.333879 15057 tablet_replica.cc:333] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f: stopping tablet replica
I20260709 13:08:49.340593 15057 raft_consensus.cc:2243] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:49.344907 15057 raft_consensus.cc:2272] T 5054b6ad2e4141cab2232a3fecd7c858 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:49.351830 15057 tablet_replica.cc:333] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f: stopping tablet replica
I20260709 13:08:49.352872 15057 raft_consensus.cc:2243] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:49.355720 15057 raft_consensus.cc:2272] T 19e573db44d24720b3a4805dc20210e8 P e10b16d536674c0bb350a31d7ce5ff7f [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:49.357688 23658 raft_consensus.cc:359] T a1a76ba8ceae4d0780583a09087cec0a P 1109f76a0b7b443a84c0327c8707bc63 [term 20 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:08:49.368888 23658 raft_consensus.cc:740] T a1a76ba8ceae4d0780583a09087cec0a P 1109f76a0b7b443a84c0327c8707bc63 [term 20 LEARNER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Initialized, Role: LEARNER
I20260709 13:08:49.372092 23658 consensus_queue.cc:260] T a1a76ba8ceae4d0780583a09087cec0a P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } }
I20260709 13:08:49.359709 15057 tablet_replica.cc:333] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f: stopping tablet replica
I20260709 13:08:49.374150 15057 raft_consensus.cc:2243] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:49.375451 15057 raft_consensus.cc:2272] T 176e2f21e86a4e54a8d9a21aef8a272f P e10b16d536674c0bb350a31d7ce5ff7f [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:49.418718 23658 ts_tablet_manager.cc:1434] T a1a76ba8ceae4d0780583a09087cec0a P 1109f76a0b7b443a84c0327c8707bc63: Time spent starting tablet: real 0.077s	user 0.006s	sys 0.003s
I20260709 13:08:49.452926 15057 tablet_replica.cc:333] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f: stopping tablet replica
I20260709 13:08:49.454707 15057 raft_consensus.cc:2243] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:08:49.456708 15057 raft_consensus.cc:2272] T 916cdb289e9442b69dd8ed0c99eb8198 P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:49.476133 15057 tablet_replica.cc:333] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f: stopping tablet replica
I20260709 13:08:49.458020 23644 raft_consensus.cc:2955] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [term 13 LEADER]: Committing config change with OpId 13.11: config changed from index 10 to 11, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
W20260709 13:08:49.458858 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 49152.9us
I20260709 13:08:49.480643 15057 raft_consensus.cc:2243] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:49.481381 15057 raft_consensus.cc:2272] T 98afc5914978455ba8cc5329152a3f1d P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:49.484413 15057 tablet_replica.cc:333] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f: stopping tablet replica
I20260709 13:08:49.485328 15057 raft_consensus.cc:2243] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:49.486109 15057 raft_consensus.cc:2272] T b241405f79a345849ba216394fcb999a P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:49.489003 15057 tablet_replica.cc:333] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f: stopping tablet replica
I20260709 13:08:49.489871 15057 raft_consensus.cc:2243] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:49.490751 15057 raft_consensus.cc:2272] T ab124ef29c71409d9c14a75a054095e1 P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:49.493651 15057 tablet_replica.cc:333] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f: stopping tablet replica
I20260709 13:08:49.494652 15057 raft_consensus.cc:2243] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:08:49.495779 15057 raft_consensus.cc:2272] T eafb6ab8cb0c42309ea6508e0ad9b9ef P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:49.498852 15057 tablet_replica.cc:333] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f: stopping tablet replica
I20260709 13:08:49.499752 15057 raft_consensus.cc:2243] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:49.500375 15057 raft_consensus.cc:2272] T eeda5ee833164deb9ec027b22371793c P e10b16d536674c0bb350a31d7ce5ff7f [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:49.503466 15057 tablet_replica.cc:333] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f: stopping tablet replica
I20260709 13:08:49.504493 15057 raft_consensus.cc:2243] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:49.505249 15057 raft_consensus.cc:2272] T f022e2e63ae4461d834e476ff2666991 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:49.512894 23682 raft_consensus.cc:1064] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3: attempting to promote NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 to VOTER
I20260709 13:08:49.519397 15057 tablet_replica.cc:333] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f: stopping tablet replica
I20260709 13:08:49.520409 15057 raft_consensus.cc:2243] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:49.521136 15057 raft_consensus.cc:2272] T c7d554054f014c74992a2a66ff6873cd P e10b16d536674c0bb350a31d7ce5ff7f [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:49.528710 16282 raft_consensus.cc:2955] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:08:49.530589 23579 raft_consensus.cc:1064] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f: attempting to promote NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 to VOTER
I20260709 13:08:49.535458 23579 consensus_queue.cc:237] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 12, Current term: 19, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:49.540472 23682 consensus_queue.cc:237] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 12, Current term: 22, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:49.574627 16945 raft_consensus.cc:1275] T a054979193cb43dcba8c8eb72cd7f05d P 1109f76a0b7b443a84c0327c8707bc63 [term 22 LEARNER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:08:49.581964 23707 consensus_queue.cc:1048] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 13:08:49.586051 16246 consensus_peers.cc:597] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:49.595538 16367 tablet_copy_service.cc:342] P 363bb2f744eb486f9ad726f08214c98e: Request end of tablet copy session 1109f76a0b7b443a84c0327c8707bc63-a1a76ba8ceae4d0780583a09087cec0a received from {username='slave'} at 127.0.0.1:33486
I20260709 13:08:49.596029 16367 tablet_copy_service.cc:434] P 363bb2f744eb486f9ad726f08214c98e: ending tablet copy session 1109f76a0b7b443a84c0327c8707bc63-a1a76ba8ceae4d0780583a09087cec0a on tablet a1a76ba8ceae4d0780583a09087cec0a with peer 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:08:49.616432 16948 raft_consensus.cc:1217] T a1a76ba8ceae4d0780583a09087cec0a P 1109f76a0b7b443a84c0327c8707bc63 [term 20 LEARNER]: Deduplicated request from leader. Original: 20.13->[20.14-20.14]   Dedup: 20.14->[]
I20260709 13:08:49.625029 16948 raft_consensus.cc:2955] T 5054b6ad2e4141cab2232a3fecd7c858 P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:08:49.632751 15057 tablet_replica.cc:333] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f: stopping tablet replica
I20260709 13:08:49.603457 16103 catalog_manager.cc:5697] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e reported cstate change: config changed from index 10 to 11, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New cstate: current_term: 13 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:49.643590 15057 raft_consensus.cc:2243] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [term 13 LEADER]: Raft consensus shutting down.
W20260709 13:08:49.670758 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 54367.4us
I20260709 13:08:49.727006 15057 raft_consensus.cc:2272] T 1356ff4c060346359eb10723422e972a P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:49.747196 16348 raft_consensus.cc:1275] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 22 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:08:49.762893 15057 tablet_replica.cc:333] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f: stopping tablet replica
I20260709 13:08:49.763969 15057 raft_consensus.cc:2243] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:08:49.764904 15057 raft_consensus.cc:2272] T aee913c41fb9437587affa768953f637 P e10b16d536674c0bb350a31d7ce5ff7f [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:49.771613 16353 raft_consensus.cc:1275] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:08:49.785924 15057 tablet_replica.cc:333] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f: stopping tablet replica
I20260709 13:08:49.787262 15057 raft_consensus.cc:2243] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:49.788662 15057 raft_consensus.cc:2272] T 13bc3c8ff9b84838a2664335d7e1582b P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:49.788942 16948 raft_consensus.cc:1275] T 16a307cee8ef431184c620fec029af19 P 1109f76a0b7b443a84c0327c8707bc63 [term 19 LEARNER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:08:49.792035 15057 tablet_replica.cc:333] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f: stopping tablet replica
I20260709 13:08:49.793829 15057 raft_consensus.cc:2243] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:49.817689 15057 raft_consensus.cc:2272] T fd0c3c592b464aafaf1d0b94d1e6e360 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:49.833431 15057 tablet_replica.cc:333] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f: stopping tablet replica
I20260709 13:08:49.835403 15057 raft_consensus.cc:2243] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 20 FOLLOWER]: Raft consensus shutting down.
W20260709 13:08:49.837291 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 135551us
I20260709 13:08:49.811268 23726 consensus_queue.cc:1048] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.024s
I20260709 13:08:49.846939 16283 raft_consensus.cc:1275] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Refusing update from remote peer e10b16d536674c0bb350a31d7ce5ff7f: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:08:49.862536 23733 consensus_queue.cc:1048] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:08:49.855264 23579 consensus_queue.cc:1048] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.017s
I20260709 13:08:49.889429 15057 raft_consensus.cc:2272] T 5c2f49b7f95a4153b2d180218e6af1db P e10b16d536674c0bb350a31d7ce5ff7f [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:49.916080 15057 tablet_replica.cc:333] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f: stopping tablet replica
I20260709 13:08:49.916956 15057 raft_consensus.cc:2243] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:49.917742 15057 raft_consensus.cc:2272] T a054979193cb43dcba8c8eb72cd7f05d P e10b16d536674c0bb350a31d7ce5ff7f [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:49.921435 23579 consensus_queue.cc:1048] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:08:49.923903 23687 raft_consensus.cc:1064] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e: attempting to promote NON_VOTER 1109f76a0b7b443a84c0327c8707bc63 to VOTER
I20260709 13:08:49.928377 15057 tablet_replica.cc:333] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f: stopping tablet replica
I20260709 13:08:49.927232 23687 consensus_queue.cc:237] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 12, Current term: 20, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:49.934940 15057 raft_consensus.cc:2243] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:08:49.936230 15057 raft_consensus.cc:2272] T b2275272882d4313a1ce1a8632a5819c P e10b16d536674c0bb350a31d7ce5ff7f [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:49.943336 15057 tablet_replica.cc:333] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f: stopping tablet replica
I20260709 13:08:49.950701 15057 raft_consensus.cc:2243] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:49.981628 15057 raft_consensus.cc:2272] T bc427ac4cc014a9c99e5731814bff30a P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:49.985534 15057 tablet_replica.cc:333] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f: stopping tablet replica
I20260709 13:08:50.001379 16945 raft_consensus.cc:1275] T a1a76ba8ceae4d0780583a09087cec0a P 1109f76a0b7b443a84c0327c8707bc63 [term 20 LEARNER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:08:50.001405 15057 raft_consensus.cc:2243] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:08:50.001230 23672 raft_consensus.cc:2955] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 19 LEADER]: Committing config change with OpId 19.15: config changed from index 14 to 15, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:08:50.003031 15057 raft_consensus.cc:2272] T c824093f8d374c1b9f3c8a6e8e711157 P e10b16d536674c0bb350a31d7ce5ff7f [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:50.006050 23702 consensus_queue.cc:1048] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:08:49.994397 23682 raft_consensus.cc:2955] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 22 LEADER]: Committing config change with OpId 22.15: config changed from index 14 to 15, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
W20260709 13:08:49.995698 16320 consensus_peers.cc:597] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:50.007886 16348 raft_consensus.cc:2955] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 22 FOLLOWER]: Committing config change with OpId 22.15: config changed from index 14 to 15, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
W20260709 13:08:50.015702 16320 consensus_peers.cc:597] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:50.019563 16282 raft_consensus.cc:1275] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:08:50.020026 16353 raft_consensus.cc:2955] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Committing config change with OpId 19.15: config changed from index 14 to 15, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:08:50.030649 15057 tablet_replica.cc:333] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f: stopping tablet replica
I20260709 13:08:50.031697 15057 raft_consensus.cc:2243] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:50.032449 15057 raft_consensus.cc:2272] T 40719878febd41f9b57c9a6992d4431b P e10b16d536674c0bb350a31d7ce5ff7f [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:50.045778 23702 consensus_queue.cc:1048] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.002s
I20260709 13:08:50.048102 16941 raft_consensus.cc:2955] T 16a307cee8ef431184c620fec029af19 P 1109f76a0b7b443a84c0327c8707bc63 [term 19 FOLLOWER]: Committing config change with OpId 19.15: config changed from index 14 to 15, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:08:50.050781 23733 raft_consensus.cc:493] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:08:50.051496 23733 raft_consensus.cc:515] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:08:50.053866 23741 log.cc:927] Time spent T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:08:50.056224 23733 leader_election.cc:290] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:50.061280 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:50.076297 15057 tablet_replica.cc:333] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f: stopping tablet replica
I20260709 13:08:50.078204 15057 raft_consensus.cc:2243] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:08:50.082538 15057 raft_consensus.cc:2272] T 16a307cee8ef431184c620fec029af19 P e10b16d536674c0bb350a31d7ce5ff7f [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:50.083878 16912 consensus_peers.cc:597] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:50.090323 16246 leader_election.cc:336] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:50.104954 16248 leader_election.cc:304] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:50.105844 23704 raft_consensus.cc:2749] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:08:50.107107 16941 raft_consensus.cc:2955] T a054979193cb43dcba8c8eb72cd7f05d P 1109f76a0b7b443a84c0327c8707bc63 [term 22 FOLLOWER]: Committing config change with OpId 22.15: config changed from index 14 to 15, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
W20260709 13:08:50.122030 16320 consensus_peers.cc:597] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:50.118396 15057 tablet_replica.cc:333] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f: stopping tablet replica
I20260709 13:08:50.124047 15057 raft_consensus.cc:2243] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:50.124886 15057 raft_consensus.cc:2272] T 0340758c689242c3979a434fa59589f7 P e10b16d536674c0bb350a31d7ce5ff7f [term 10 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:50.132036 16320 consensus_peers.cc:597] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:50.133414 16320 consensus_peers.cc:597] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:50.135918 15057 tablet_replica.cc:333] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f: stopping tablet replica
I20260709 13:08:50.137183 15057 raft_consensus.cc:2243] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:08:50.138471 15057 raft_consensus.cc:2272] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:50.141875 15057 tablet_replica.cc:333] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f: stopping tablet replica
I20260709 13:08:50.142772 15057 raft_consensus.cc:2243] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:50.143477 15057 raft_consensus.cc:2272] T 5063fcda38c2468a8dad5d01023b700a P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:50.147712 23704 raft_consensus.cc:493] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:08:50.148679 23704 raft_consensus.cc:515] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:50.159125 23704 leader_election.cc:290] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:50.162235 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:50.168948 16348 consensus_queue.cc:237] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:50.173655 16104 catalog_manager.cc:5697] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: config changed from index 14 to 15, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New cstate: current_term: 22 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:50.183841 15057 tablet_replica.cc:333] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f: stopping tablet replica
I20260709 13:08:50.184775 15057 raft_consensus.cc:2243] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:50.185389 15057 raft_consensus.cc:2272] T ccde1e8182914560a3c1df0312e6a2b2 P e10b16d536674c0bb350a31d7ce5ff7f [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:50.190742 16945 raft_consensus.cc:1275] T 5054b6ad2e4141cab2232a3fecd7c858 P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:08:50.195909 23702 consensus_queue.cc:1048] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:50.200657 16283 raft_consensus.cc:1275] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:08:50.202801 23687 consensus_queue.cc:1048] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:50.203352 16102 catalog_manager.cc:5697] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e reported cstate change: config changed from index 14 to 15, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New cstate: current_term: 19 leader_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
W20260709 13:08:50.212159 16320 consensus_peers.cc:597] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:50.215339 23687 raft_consensus.cc:2955] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 20 LEADER]: Committing config change with OpId 20.15: config changed from index 14 to 15, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:08:50.215795 23607 raft_consensus.cc:2955] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [term 13 LEADER]: Committing config change with OpId 13.12: config changed from index 11 to 12, VOTER e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:08:50.218498 16282 raft_consensus.cc:2955] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Committing config change with OpId 20.15: config changed from index 14 to 15, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:08:50.217770 16947 raft_consensus.cc:2955] T 5054b6ad2e4141cab2232a3fecd7c858 P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Committing config change with OpId 13.12: config changed from index 11 to 12, VOTER e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:08:50.238724 15057 tablet_replica.cc:333] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f: stopping tablet replica
I20260709 13:08:50.241518 15057 raft_consensus.cc:2243] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:50.242574 15057 raft_consensus.cc:2272] T 73757c6fea8949e090aa4e55902a41d4 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:50.246459 16246 leader_election.cc:336] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:50.247051 16246 leader_election.cc:304] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:50.247716 23682 raft_consensus.cc:2749] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:50.251487 16278 raft_consensus.cc:2955] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Committing config change with OpId 13.12: config changed from index 11 to 12, VOTER e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:08:50.248108 16283 consensus_queue.cc:237] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:50.267694 16941 raft_consensus.cc:2955] T a1a76ba8ceae4d0780583a09087cec0a P 1109f76a0b7b443a84c0327c8707bc63 [term 20 FOLLOWER]: Committing config change with OpId 20.15: config changed from index 14 to 15, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:08:50.267288 15057 tablet_replica.cc:333] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f: stopping tablet replica
W20260709 13:08:50.282948 16320 consensus_peers.cc:597] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:50.284207 15057 raft_consensus.cc:2243] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:50.286659 15057 raft_consensus.cc:2272] T a7ce522fbeb44228a8c05d5ceeadc347 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:50.273747 16102 catalog_manager.cc:5697] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e reported cstate change: config changed from index 14 to 15, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New cstate: current_term: 20 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:08:50.293198 16246 consensus_peers.cc:597] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:50.303460 16320 consensus_peers.cc:597] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:50.304020 16246 consensus_peers.cc:597] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:50.313895 16945 raft_consensus.cc:1275] T a054979193cb43dcba8c8eb72cd7f05d P 1109f76a0b7b443a84c0327c8707bc63 [term 22 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:08:50.317986 23682 consensus_queue.cc:1048] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:08:50.328048 23704 raft_consensus.cc:2955] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 22 LEADER]: Committing config change with OpId 22.16: config changed from index 15 to 16, VOTER e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
W20260709 13:08:50.333175 16320 consensus_peers.cc:597] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:50.335280 16351 raft_consensus.cc:1275] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 22 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:08:50.337409 15057 tablet_replica.cc:333] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f: stopping tablet replica
I20260709 13:08:50.338353 15057 raft_consensus.cc:2243] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:50.339074 15057 raft_consensus.cc:2272] T 186b9e9483624c769871a8894ee07efa P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:50.333382 16102 catalog_manager.cc:5697] T 5054b6ad2e4141cab2232a3fecd7c858 P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: config changed from index 11 to 12, VOTER e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) evicted. New cstate: current_term: 13 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:08:50.340559 23733 consensus_queue.cc:1048] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:08:50.352267 16351 raft_consensus.cc:2955] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 22 FOLLOWER]: Committing config change with OpId 22.16: config changed from index 15 to 16, VOTER e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:08:50.354157 16092 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5054b6ad2e4141cab2232a3fecd7c858 with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:50.359338 16947 raft_consensus.cc:2955] T a054979193cb43dcba8c8eb72cd7f05d P 1109f76a0b7b443a84c0327c8707bc63 [term 22 FOLLOWER]: Committing config change with OpId 22.16: config changed from index 15 to 16, VOTER e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:08:50.391497 16092 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a054979193cb43dcba8c8eb72cd7f05d with cas_config_opid_index 15: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:50.401705 15057 tablet_replica.cc:333] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f: stopping tablet replica
I20260709 13:08:50.402688 15057 raft_consensus.cc:2243] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:08:50.403837 15057 raft_consensus.cc:2272] T 888479daeaaa4744a161f6b45bb257f6 P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:50.419270 15057 tablet_replica.cc:333] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f: stopping tablet replica
I20260709 13:08:50.420140 15057 raft_consensus.cc:2243] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:50.420833 15057 raft_consensus.cc:2272] T a1a76ba8ceae4d0780583a09087cec0a P e10b16d536674c0bb350a31d7ce5ff7f [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:50.440884 15057 tablet_replica.cc:333] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f: stopping tablet replica
I20260709 13:08:50.441670 15057 raft_consensus.cc:2243] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 22 FOLLOWER]: Raft consensus shutting down.
W20260709 13:08:50.450879 16912 consensus_peers.cc:597] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:50.442402 15057 raft_consensus.cc:2272] T 4f72b5892c874917882ef9ee926ce439 P e10b16d536674c0bb350a31d7ce5ff7f [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:50.456570 16246 consensus_peers.cc:597] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:50.475979 16090 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 73820.3us
I20260709 13:08:50.477182 23734 raft_consensus.cc:493] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
W20260709 13:08:50.477741 16320 consensus_peers.cc:597] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:50.477938 23734 raft_consensus.cc:515] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:50.480888 23734 leader_election.cc:290] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:50.448022 16104 catalog_manager.cc:5697] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: config changed from index 15 to 16, VOTER e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) evicted. New cstate: current_term: 22 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:50.485147 15057 tablet_replica.cc:333] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f: stopping tablet replica
I20260709 13:08:50.486306 15057 raft_consensus.cc:2243] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:08:50.487534 15057 raft_consensus.cc:2272] T 38b024fb12204d9b9e35d72638671c24 P e10b16d536674c0bb350a31d7ce5ff7f [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:50.472606 16912 consensus_peers.cc:597] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:50.491003 16246 leader_election.cc:336] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:08:50.491818 16090 catalog_manager.cc:4755] TS e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 5054b6ad2e4141cab2232a3fecd7c858: Remote error: Service unavailable: service kudu.tserver.TabletServerAdminService not registered on TabletServer
I20260709 13:08:50.497124 15057 tablet_replica.cc:333] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f: stopping tablet replica
I20260709 13:08:50.498081 15057 raft_consensus.cc:2243] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:50.509965 16945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:50.514834 15057 raft_consensus.cc:2272] T 8b615ac918a749989f2968826926adf3 P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:50.527752 16248 leader_election.cc:304] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:50.529282 23734 raft_consensus.cc:2749] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:08:50.530833 16912 consensus_peers.cc:597] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:50.532681 15057 tablet_replica.cc:333] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f: stopping tablet replica
I20260709 13:08:50.533553 15057 raft_consensus.cc:2243] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:50.534322 15057 raft_consensus.cc:2272] T 52982fc727d3451e9c722e63eb4d79ef P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:50.542263 16912 consensus_peers.cc:597] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:50.566653 15057 tablet_replica.cc:333] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f: stopping tablet replica
W20260709 13:08:50.568086 16912 consensus_peers.cc:597] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:50.568184 15057 raft_consensus.cc:2243] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:08:50.569880 15057 raft_consensus.cc:2272] T ae7bbe4140004c26b8f5f8b6b79c9b83 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:50.575932 15057 tablet_replica.cc:333] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f: stopping tablet replica
I20260709 13:08:50.576853 15057 raft_consensus.cc:2243] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:08:50.583732 15057 raft_consensus.cc:2272] T 7877d879c7564adfac82b8387dbbc867 P e10b16d536674c0bb350a31d7ce5ff7f [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:50.586416 16246 consensus_peers.cc:597] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:50.587116 15057 tablet_replica.cc:333] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f: stopping tablet replica
I20260709 13:08:50.587776 15057 raft_consensus.cc:2243] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:50.588622 15057 raft_consensus.cc:2272] T 552b1776c27a48c194068de522fa45b6 P e10b16d536674c0bb350a31d7ce5ff7f [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:50.601508 15057 tablet_replica.cc:333] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f: stopping tablet replica
I20260709 13:08:50.602358 15057 raft_consensus.cc:2243] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:50.603102 15057 raft_consensus.cc:2272] T d9c15d8e9be8414c84912ab77b66bfb1 P e10b16d536674c0bb350a31d7ce5ff7f [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:50.613555 15057 tablet_replica.cc:333] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f: stopping tablet replica
I20260709 13:08:50.623109 15057 raft_consensus.cc:2243] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:08:50.624290 15057 raft_consensus.cc:2272] T cad5db410b3444caafa5090b94f02dba P e10b16d536674c0bb350a31d7ce5ff7f [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:50.630318 16246 consensus_peers.cc:597] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:50.636361 15057 tablet_replica.cc:333] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f: stopping tablet replica
I20260709 13:08:50.637306 15057 raft_consensus.cc:2243] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:50.637992 15057 raft_consensus.cc:2272] T 6759dbf6a6924fcc870cb52b4a5d7953 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:50.644048 16320 consensus_peers.cc:597] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:50.654255 15057 tablet_replica.cc:333] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f: stopping tablet replica
I20260709 13:08:50.655313 15057 raft_consensus.cc:2243] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:50.656194 15057 raft_consensus.cc:2272] T 540bfc4ad793452faea5b865343aacf7 P e10b16d536674c0bb350a31d7ce5ff7f [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:50.697470 16320 consensus_peers.cc:597] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:50.716656 23702 raft_consensus.cc:493] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:08:50.717342 23702 raft_consensus.cc:515] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:50.719816 23739 raft_consensus.cc:493] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 1109f76a0b7b443a84c0327c8707bc63 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:08:50.720433 23739 raft_consensus.cc:515] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 1109f76a0b7b443a84c0327c8707bc63 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:50.721065 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:50.721690 16282 raft_consensus.cc:2468] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 21.
I20260709 13:08:50.722632 23739 leader_election.cc:290] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:50.725304 16322 leader_election.cc:304] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:08:50.726444 23607 raft_consensus.cc:2804] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:08:50.726898 23607 raft_consensus.cc:493] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 21 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
W20260709 13:08:50.727046 16320 leader_election.cc:336] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:50.727358 23607 raft_consensus.cc:3060] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:50.727800 23702 leader_election.cc:290] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:08:50.732688 16912 leader_election.cc:336] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:08:50.734826 16320 consensus_peers.cc:597] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:50.734788 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:50.739244 16282 raft_consensus.cc:2468] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 17.
I20260709 13:08:50.740973 16914 leader_election.cc:304] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:50.742272 23739 raft_consensus.cc:2804] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 1109f76a0b7b443a84c0327c8707bc63 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:50.742733 23739 raft_consensus.cc:493] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 1109f76a0b7b443a84c0327c8707bc63 [term 17 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:08:50.743113 23739 raft_consensus.cc:3060] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 1109f76a0b7b443a84c0327c8707bc63 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:50.750159 23607 raft_consensus.cc:515] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:50.752458 23739 raft_consensus.cc:515] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 1109f76a0b7b443a84c0327c8707bc63 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:50.753871 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42944699e5b24681aa3b54ef1010699d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:50.754521 16282 raft_consensus.cc:3060] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:08:50.755853 16320 leader_election.cc:336] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:50.763316 16282 raft_consensus.cc:2468] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 22.
W20260709 13:08:50.768175 16912 leader_election.cc:336] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:50.770442 23698 raft_consensus.cc:493] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:08:50.774869 16322 leader_election.cc:304] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:50.777032 23731 raft_consensus.cc:2804] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:08:50.777632 23731 raft_consensus.cc:697] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 22 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:08:50.777721 23739 leader_election.cc:290] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 18 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:50.771322 23607 leader_election.cc:290] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 22 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:50.774835 23698 raft_consensus.cc:515] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:50.779954 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eafb6ab8cb0c42309ea6508e0ad9b9ef" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:50.780619 16278 raft_consensus.cc:3060] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:50.781802 23698 leader_election.cc:290] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:50.783885 23682 raft_consensus.cc:493] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:08:50.784466 23682 raft_consensus.cc:515] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:50.788918 16278 raft_consensus.cc:2468] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 18.
I20260709 13:08:50.789961 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:50.790436 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
W20260709 13:08:50.791678 16246 leader_election.cc:336] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:50.792459 23731 consensus_queue.cc:237] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:50.792467 16914 leader_election.cc:304] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:50.795928 23739 raft_consensus.cc:2804] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 1109f76a0b7b443a84c0327c8707bc63 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:50.794504 16248 leader_election.cc:304] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:50.796473 23739 raft_consensus.cc:697] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 1109f76a0b7b443a84c0327c8707bc63 [term 18 LEADER]: Becoming Leader. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:08:50.797190 23734 raft_consensus.cc:2749] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:08:50.797518 23739 consensus_queue.cc:237] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:50.796429 23682 leader_election.cc:290] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:08:50.773429 16320 consensus_peers.cc:597] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:50.811805 16320 leader_election.cc:336] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:50.812282 16320 leader_election.cc:304] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:50.816028 23607 raft_consensus.cc:493] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:08:50.816844 23607 raft_consensus.cc:515] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:50.816568 16104 catalog_manager.cc:5697] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: term changed from 17 to 18, leader changed from e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) to 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68). New cstate: current_term: 18 leader_uuid: "1109f76a0b7b443a84c0327c8707bc63" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:50.819410 23607 leader_election.cc:290] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:50.820824 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:50.821573 16282 raft_consensus.cc:2468] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 19.
I20260709 13:08:50.822790 16322 leader_election.cc:304] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:08:50.823619 23607 raft_consensus.cc:2804] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:50.824026 23607 raft_consensus.cc:493] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:08:50.824396 23607 raft_consensus.cc:3060] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:50.836239 23607 raft_consensus.cc:515] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:50.836664 23698 raft_consensus.cc:2749] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:08:50.844401 16246 consensus_peers.cc:597] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:50.847385 23739 raft_consensus.cc:493] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:08:50.848071 23739 raft_consensus.cc:515] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:50.849344 23607 leader_election.cc:290] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 20 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:50.853363 23739 leader_election.cc:290] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:50.862321 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:08:50.863054 16320 leader_election.cc:336] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:50.863682 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
W20260709 13:08:50.864215 16320 leader_election.cc:336] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:50.864362 16278 raft_consensus.cc:3060] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:08:50.866222 16912 leader_election.cc:336] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:50.874984 16914 leader_election.cc:304] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:50.876597 16278 raft_consensus.cc:2468] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 20.
I20260709 13:08:50.877852 23706 raft_consensus.cc:2749] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:50.886097 16322 leader_election.cc:304] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:50.897969 23702 raft_consensus.cc:2804] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:08:50.898612 23702 raft_consensus.cc:697] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 20 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:08:50.899641 23702 consensus_queue.cc:237] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:50.926118 16104 catalog_manager.cc:5697] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e reported cstate change: term changed from 21 to 22, leader changed from e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) to 363bb2f744eb486f9ad726f08214c98e (127.14.180.67). New cstate: current_term: 22 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:50.932283 23706 raft_consensus.cc:493] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:08:50.932890 23706 raft_consensus.cc:515] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:50.935073 23706 leader_election.cc:290] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:08:50.977277 16246 consensus_peers.cc:597] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:50.982213 16912 leader_election.cc:336] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:50.984992 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:50.995136 16349 raft_consensus.cc:2468] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 17.
I20260709 13:08:51.001118 16104 catalog_manager.cc:5697] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e reported cstate change: term changed from 19 to 20, leader changed from e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) to 363bb2f744eb486f9ad726f08214c98e (127.14.180.67). New cstate: current_term: 20 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:51.007956 16914 leader_election.cc:304] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:51.009301 23706 raft_consensus.cc:2804] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:51.009773 23706 raft_consensus.cc:493] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 17 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:08:51.010164 23706 raft_consensus.cc:3060] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:51.030687 23706 raft_consensus.cc:515] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:51.042347 23706 leader_election.cc:290] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 18 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:51.046181 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:51.047273 16352 raft_consensus.cc:3060] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:51.064913 16352 raft_consensus.cc:2468] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 18.
I20260709 13:08:51.072111 16914 leader_election.cc:304] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:08:51.074332 23696 raft_consensus.cc:2804] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:51.074970 23696 raft_consensus.cc:697] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 18 LEADER]: Becoming Leader. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:08:51.075855 23696 consensus_queue.cc:237] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:08:51.091439 16912 leader_election.cc:336] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111)
W20260709 13:08:51.092269 16912 consensus_peers.cc:597] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:51.103896 23731 raft_consensus.cc:493] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:08:51.104781 23731 raft_consensus.cc:515] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:51.108355 23731 leader_election.cc:290] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:51.110500 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:51.111927 16947 raft_consensus.cc:2468] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 13.
I20260709 13:08:51.113505 16322 leader_election.cc:304] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:08:51.114616 23728 raft_consensus.cc:2804] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:51.115063 23728 raft_consensus.cc:493] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:08:51.115458 23728 raft_consensus.cc:3060] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:51.136926 16246 consensus_peers.cc:597] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:51.143517 16320 leader_election.cc:336] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111)
I20260709 13:08:51.163683 16104 catalog_manager.cc:5697] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: term changed from 17 to 18, leader changed from e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) to 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68). New cstate: current_term: 18 leader_uuid: "1109f76a0b7b443a84c0327c8707bc63" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:51.153394 23728 raft_consensus.cc:515] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:51.205890 23728 leader_election.cc:290] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:51.209713 16945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1356ff4c060346359eb10723422e972a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:08:51.210444 16945 raft_consensus.cc:3060] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:08:51.217132 16320 leader_election.cc:336] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111)
W20260709 13:08:51.220376 16246 consensus_peers.cc:597] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:51.221901 16945 raft_consensus.cc:2468] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 14.
I20260709 13:08:51.224212 16322 leader_election.cc:304] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:51.225208 23728 raft_consensus.cc:2804] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:51.226712 23728 raft_consensus.cc:697] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 14 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:08:51.227878 23728 consensus_queue.cc:237] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:51.264914 16278 raft_consensus.cc:1275] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:08:51.270998 23702 raft_consensus.cc:493] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 23 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:08:51.271704 23702 raft_consensus.cc:515] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:51.274724 23607 raft_consensus.cc:493] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:08:51.275424 23607 raft_consensus.cc:515] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:51.278065 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:51.278841 16278 raft_consensus.cc:2468] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 23.
I20260709 13:08:51.279428 23607 leader_election.cc:290] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:51.274243 23702 leader_election.cc:290] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:08:51.281884 16320 leader_election.cc:336] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111)
I20260709 13:08:51.284778 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:08:51.286952 16320 leader_election.cc:336] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111)
I20260709 13:08:51.287298 23696 consensus_queue.cc:1048] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:08:51.286229 16322 leader_election.cc:304] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:51.290892 23702 raft_consensus.cc:2804] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:08:51.291366 23702 raft_consensus.cc:493] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 23 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:08:51.292018 23702 raft_consensus.cc:3060] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:08:51.292387 16322 leader_election.cc:304] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:51.298382 23698 raft_consensus.cc:2749] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:51.298672 23607 raft_consensus.cc:493] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
W20260709 13:08:51.299819 16246 consensus_peers.cc:597] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:51.299440 23607 raft_consensus.cc:515] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:51.317502 16104 catalog_manager.cc:5697] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e reported cstate change: term changed from 13 to 14, leader changed from e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) to 363bb2f744eb486f9ad726f08214c98e (127.14.180.67). New cstate: current_term: 14 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:51.321688 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:51.322678 23607 leader_election.cc:290] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:51.330402 23702 raft_consensus.cc:515] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:51.344506 16282 raft_consensus.cc:1275] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:08:51.350939 23733 raft_consensus.cc:493] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:08:51.352784 23733 raft_consensus.cc:515] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:51.351663 23702 leader_election.cc:290] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 24 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:51.357327 23734 raft_consensus.cc:493] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:08:51.357970 23734 raft_consensus.cc:515] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:08:51.360198 16912 consensus_peers.cc:597] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 1109f76a0b7b443a84c0327c8707bc63 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:51.360258 23734 leader_election.cc:290] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:51.360278 23733 leader_election.cc:290] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:51.366113 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:51.366461 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:51.367172 16352 raft_consensus.cc:2468] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 14.
I20260709 13:08:51.369022 16248 leader_election.cc:304] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:08:51.369877 23733 raft_consensus.cc:2804] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:51.370308 23733 raft_consensus.cc:493] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:08:51.370774 23733 raft_consensus.cc:3060] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:08:51.382519 16320 leader_election.cc:336] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111)
I20260709 13:08:51.383112 16320 leader_election.cc:304] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:08:51.383589 16246 leader_election.cc:336] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111)
I20260709 13:08:51.383910 23731 raft_consensus.cc:2749] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:08:51.384225 16320 consensus_peers.cc:597] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:51.384333 16246 leader_election.cc:336] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111)
I20260709 13:08:51.384824 16246 leader_election.cc:304] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:51.385532 23704 raft_consensus.cc:2749] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:08:51.392349 16320 leader_election.cc:336] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111)
I20260709 13:08:51.439324 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:51.440001 16278 raft_consensus.cc:3060] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:08:51.442994 16320 consensus_peers.cc:597] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:51.450428 23734 raft_consensus.cc:493] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:08:51.451892 23734 raft_consensus.cc:515] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:51.454351 16278 raft_consensus.cc:2468] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 24.
I20260709 13:08:51.461354 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:51.462035 16283 raft_consensus.cc:1275] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 22 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:08:51.462617 23702 raft_consensus.cc:493] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:08:51.465303 23702 raft_consensus.cc:515] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:51.467782 23702 leader_election.cc:290] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:51.469063 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:51.471513 16248 leader_election.cc:304] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:08:51.472560 23704 raft_consensus.cc:2749] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:51.475610 23734 leader_election.cc:290] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:08:51.477632 16320 leader_election.cc:336] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111)
I20260709 13:08:51.448850 23733 raft_consensus.cc:515] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:51.486712 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:51.487720 16352 raft_consensus.cc:3060] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:51.495841 23607 consensus_queue.cc:1048] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:08:51.496524 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:51.500125 16278 raft_consensus.cc:2468] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 22.
W20260709 13:08:51.503839 16246 leader_election.cc:336] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111)
W20260709 13:08:51.507531 16246 leader_election.cc:336] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111)
I20260709 13:08:51.525226 23607 raft_consensus.cc:493] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:08:51.526044 23607 raft_consensus.cc:515] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:51.527683 16352 raft_consensus.cc:2468] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 15.
I20260709 13:08:51.523787 23702 consensus_queue.cc:1048] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.006s
I20260709 13:08:51.530062 23607 leader_election.cc:290] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:51.530850 16322 leader_election.cc:304] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:51.544468 23733 leader_election.cc:290] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 15 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:51.548513 23752 raft_consensus.cc:493] T 16a307cee8ef431184c620fec029af19 P 1109f76a0b7b443a84c0327c8707bc63 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
W20260709 13:08:51.550822 23633 tablet_copy_client.cc:1131] T 16a307cee8ef431184c620fec029af19 P 1109f76a0b7b443a84c0327c8707bc63: tablet copy: Unable to close tablet copy session: Network error: failure ending tablet copy session: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111)
I20260709 13:08:51.550716 23752 raft_consensus.cc:515] T 16a307cee8ef431184c620fec029af19 P 1109f76a0b7b443a84c0327c8707bc63 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:51.545924 23607 raft_consensus.cc:2804] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:08:51.565248 23696 raft_consensus.cc:493] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:08:51.566066 23696 raft_consensus.cc:515] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:51.608125 23752 leader_election.cc:290] T 16a307cee8ef431184c620fec029af19 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:51.598336 23696 leader_election.cc:290] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:51.614365 23607 raft_consensus.cc:697] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 24 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:08:51.619064 23607 consensus_queue.cc:237] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:08:52.042604 15057 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 16229)
I20260709 13:08:52.322575 23773 raft_consensus.cc:493] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:08:52.323455 23773 raft_consensus.cc:515] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:52.326195 23773 leader_election.cc:290] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:52.338945 23772 raft_consensus.cc:493] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:08:52.339705 23772 raft_consensus.cc:515] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:08:52.348169 16912 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111) [suppressed 280 similar messages]
I20260709 13:08:52.355392 23772 leader_election.cc:290] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:08:52.359195 16322 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.781s	user 0.002s	sys 0.009s
W20260709 13:08:52.360246 16322 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.782s	user 0.003s	sys 0.009s
W20260709 13:08:52.360864 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 805552us
I20260709 13:08:52.361567 16322 leader_election.cc:304] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:52.362387 23702 raft_consensus.cc:2804] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:08:52.362872 23702 raft_consensus.cc:493] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 22 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
W20260709 13:08:52.363932 16320 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.786s	user 0.019s	sys 0.014s
W20260709 13:08:52.364887 16320 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.787s	user 0.019s	sys 0.014s
I20260709 13:08:52.371068 23702 raft_consensus.cc:3060] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:08:52.380765 23702 raft_consensus.cc:515] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:52.383183 23702 leader_election.cc:290] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 23 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:08:52.390151 16912 leader_election.cc:336] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111)
W20260709 13:08:52.395510 16912 leader_election.cc:336] T 16a307cee8ef431184c620fec029af19 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111)
W20260709 13:08:52.396051 16912 consensus_peers.cc:597] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:52.396653 16912 leader_election.cc:336] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111)
I20260709 13:08:52.406992 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:52.407652 16947 raft_consensus.cc:2468] T 16a307cee8ef431184c620fec029af19 P 1109f76a0b7b443a84c0327c8707bc63 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 19.
W20260709 13:08:52.451435 16090 thread.cc:641] client-negotiator [worker] (thread pool) Time spent creating pthread: real 0.735s	user 0.002s	sys 0.010s
W20260709 13:08:52.452637 16090 thread.cc:608] client-negotiator [worker] (thread pool) Time spent starting thread: real 0.737s	user 0.002s	sys 0.010s
I20260709 13:08:52.490259 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:52.492527 16277 raft_consensus.cc:2468] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 11.
I20260709 13:08:52.491088 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:52.495445 16283 raft_consensus.cc:2468] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 19.
I20260709 13:08:52.503037 23772 raft_consensus.cc:493] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:08:52.504217 23772 raft_consensus.cc:515] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:52.506927 23776 raft_consensus.cc:493] T cad5db410b3444caafa5090b94f02dba P 1109f76a0b7b443a84c0327c8707bc63 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:08:52.507949 23776 raft_consensus.cc:515] T cad5db410b3444caafa5090b94f02dba P 1109f76a0b7b443a84c0327c8707bc63 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:52.512210 23772 leader_election.cc:290] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:52.516914 23776 leader_election.cc:290] T cad5db410b3444caafa5090b94f02dba P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:08:52.537434 16090 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 82693.8us
I20260709 13:08:52.542604 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:52.543689 16277 raft_consensus.cc:2468] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 11.
W20260709 13:08:52.546442 16090 catalog_manager.cc:4755] TS e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet a054979193cb43dcba8c8eb72cd7f05d: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111)
W20260709 13:08:52.552057 16278 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.029s	user 0.010s	sys 0.017s
W20260709 13:08:52.552605 16278 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.030s	user 0.010s	sys 0.017s
I20260709 13:08:52.554154 16278 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45210 (request call id 3832) took 1037 ms. Trace:
I20260709 13:08:52.554780 16278 rpcz_store.cc:276] 0709 13:08:51.516509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:51.521120 (+  4611us) service_pool.cc:224] Handling call
0709 13:08:51.521458 (+   338us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:51.521811 (+   353us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:51.521847 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:51.522368 (+   521us) log.cc:844] Serialized 26 byte log entry
0709 13:08:52.553391 (+1031023us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:08:52.553510 (+   119us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:52.553675 (+   165us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:52.553759 (+    84us) raft_consensus.cc:1685] finished
0709 13:08:52.553775 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:52.554027 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1759,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":111,"thread_start_us":1030138,"threads_started":1,"wal-append.queue_time_us":90142}
W20260709 13:08:52.559661 16912 leader_election.cc:336] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111)
I20260709 13:08:52.564926 23776 raft_consensus.cc:493] T 4b962ceebb5c48c1914459ae0c0eff1b P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
W20260709 13:08:52.565956 16912 leader_election.cc:336] T cad5db410b3444caafa5090b94f02dba P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111)
I20260709 13:08:52.566045 23776 raft_consensus.cc:515] T 4b962ceebb5c48c1914459ae0c0eff1b P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:52.571017 16914 leader_election.cc:304] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:52.581801 23775 raft_consensus.cc:493] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:08:52.583215 23775 raft_consensus.cc:515] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:52.591552 23771 raft_consensus.cc:2804] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:52.592293 23771 raft_consensus.cc:493] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:08:52.592868 23771 raft_consensus.cc:3060] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:52.602535 23773 raft_consensus.cc:493] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:52.603652 23773 raft_consensus.cc:515] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:52.604832 23776 leader_election.cc:290] T 4b962ceebb5c48c1914459ae0c0eff1b P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:52.607406 16105 catalog_manager.cc:5697] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e reported cstate change: term changed from 23 to 24, leader changed from e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) to 363bb2f744eb486f9ad726f08214c98e (127.14.180.67). New cstate: current_term: 24 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:52.612123 23773 leader_election.cc:290] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:52.613493 23775 leader_election.cc:290] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:52.614332 23775 raft_consensus.cc:493] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:08:52.615250 23772 raft_consensus.cc:493] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:08:52.615648 23775 raft_consensus.cc:515] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:52.616290 23772 raft_consensus.cc:515] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:52.624265 23776 raft_consensus.cc:493] T 540bfc4ad793452faea5b865343aacf7 P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:52.626304 23776 raft_consensus.cc:515] T 540bfc4ad793452faea5b865343aacf7 P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:52.629168 23776 leader_election.cc:290] T 540bfc4ad793452faea5b865343aacf7 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:52.630780 23772 leader_election.cc:290] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:08:52.638077 16323 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.060s	user 0.000s	sys 0.016s
W20260709 13:08:52.638758 16323 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.061s	user 0.001s	sys 0.016s
W20260709 13:08:52.634399 16246 leader_election.cc:336] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111)
I20260709 13:08:52.666690 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:52.668964 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
W20260709 13:08:52.673825 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 62747.6us
I20260709 13:08:52.682322 23787 raft_consensus.cc:493] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:08:52.683470 23787 raft_consensus.cc:515] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:52.684574 16352 raft_consensus.cc:1275] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:08:52.685473 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:52.686533 16348 raft_consensus.cc:2468] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 19.
I20260709 13:08:52.688840 23779 raft_consensus.cc:493] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:08:52.689440 23788 raft_consensus.cc:493] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:08:52.689886 23779 raft_consensus.cc:515] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:52.686599 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:52.690598 23788 raft_consensus.cc:515] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:52.691303 16353 raft_consensus.cc:2468] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 16.
I20260709 13:08:52.694697 23778 raft_consensus.cc:493] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:08:52.695834 23778 raft_consensus.cc:515] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:08:52.697536 16912 leader_election.cc:336] T 540bfc4ad793452faea5b865343aacf7 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111)
I20260709 13:08:52.659417 23702 raft_consensus.cc:493] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:08:52.710127 23787 leader_election.cc:290] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:52.676131 23775 leader_election.cc:290] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:52.714212 23794 raft_consensus.cc:493] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:08:52.715054 23794 raft_consensus.cc:515] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:52.715938 23778 leader_election.cc:290] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:52.717711 23794 leader_election.cc:290] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:52.718910 23779 leader_election.cc:290] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:52.721714 23779 raft_consensus.cc:493] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:08:52.722250 23788 leader_election.cc:290] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:52.723040 23788 raft_consensus.cc:493] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:08:52.722520 23779 raft_consensus.cc:515] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:52.723479 23792 raft_consensus.cc:493] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:08:52.723749 23788 raft_consensus.cc:515] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:52.724279 23792 raft_consensus.cc:515] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:52.725401 23779 leader_election.cc:290] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:52.726159 23788 leader_election.cc:290] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:52.729470 23772 raft_consensus.cc:493] T abbbc04ca95a4119a7e3fb64073fe61f P 1109f76a0b7b443a84c0327c8707bc63 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:08:52.730381 23772 raft_consensus.cc:515] T abbbc04ca95a4119a7e3fb64073fe61f P 1109f76a0b7b443a84c0327c8707bc63 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:52.733064 23772 leader_election.cc:290] T abbbc04ca95a4119a7e3fb64073fe61f P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:52.733819 23702 raft_consensus.cc:515] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:52.734907 23792 leader_election.cc:290] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:52.735635 23792 raft_consensus.cc:493] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:52.736361 23792 raft_consensus.cc:515] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:52.742290 23792 leader_election.cc:290] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:52.753314 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:52.754277 16352 raft_consensus.cc:2468] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 18.
I20260709 13:08:52.738452 23702 leader_election.cc:290] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:52.746541 23764 raft_consensus.cc:493] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
W20260709 13:08:52.763804 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 122099us
I20260709 13:08:52.767161 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39dd6382a0304387a1341bcc36471cbf" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:52.759310 23771 raft_consensus.cc:515] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:52.768714 16914 leader_election.cc:304] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:52.769793 16941 raft_consensus.cc:2393] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 12: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
I20260709 13:08:52.769951 23774 raft_consensus.cc:2804] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:08:52.770511 23774 raft_consensus.cc:493] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:08:52.770897 23774 raft_consensus.cc:3060] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:08:52.771727 16246 leader_election.cc:336] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111)
W20260709 13:08:52.772277 16246 leader_election.cc:336] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111)
I20260709 13:08:52.781843 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c24b4a916c7f491da5d7f9b92db71ece" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:52.784057 16941 raft_consensus.cc:1275] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 13:08:52.786700 16912 leader_election.cc:336] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111)
I20260709 13:08:52.794796 23795 raft_consensus.cc:493] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:08:52.795832 23795 raft_consensus.cc:515] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:52.796484 23779 raft_consensus.cc:493] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:52.797214 23779 raft_consensus.cc:515] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:52.799759 23779 leader_election.cc:290] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:52.801759 23770 raft_consensus.cc:493] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
W20260709 13:08:52.786754 16320 leader_election.cc:336] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111)
I20260709 13:08:52.802670 23770 raft_consensus.cc:515] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:52.789515 23792 raft_consensus.cc:493] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:52.806111 23770 leader_election.cc:290] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:52.809605 16248 leader_election.cc:304] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:52.811411 23771 leader_election.cc:290] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 12 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:52.810956 23792 raft_consensus.cc:515] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:52.811738 23791 raft_consensus.cc:3060] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:52.812124 23764 raft_consensus.cc:515] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:52.816540 23764 leader_election.cc:290] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:52.818919 23792 leader_election.cc:290] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:52.820266 23795 leader_election.cc:290] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:52.820355 23774 raft_consensus.cc:515] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:52.832907 23774 leader_election.cc:290] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 12 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:52.827518 23791 raft_consensus.cc:2749] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:52.836036 16282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:52.837201 16282 raft_consensus.cc:2468] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 19.
I20260709 13:08:52.839641 23772 raft_consensus.cc:493] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:08:52.840459 23772 raft_consensus.cc:515] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:52.841461 16947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:52.842208 16947 raft_consensus.cc:2468] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 18.
I20260709 13:08:52.843784 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:52.845022 16946 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:52.845615 16945 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:52.843704 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:52.846674 16949 raft_consensus.cc:2468] T abbbc04ca95a4119a7e3fb64073fe61f P 1109f76a0b7b443a84c0327c8707bc63 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 20.
I20260709 13:08:52.850237 23772 leader_election.cc:290] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:52.852893 23795 consensus_queue.cc:1048] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:08:52.844784 16941 raft_consensus.cc:2468] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 16.
I20260709 13:08:52.855243 23774 raft_consensus.cc:493] T 5c2f49b7f95a4153b2d180218e6af1db P 1109f76a0b7b443a84c0327c8707bc63 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:52.855590 16322 leader_election.cc:304] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:08:52.855932 23774 raft_consensus.cc:515] T 5c2f49b7f95a4153b2d180218e6af1db P 1109f76a0b7b443a84c0327c8707bc63 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:52.856446 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:52.856591 23795 raft_consensus.cc:2804] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:52.857115 23795 raft_consensus.cc:493] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:08:52.857506 23795 raft_consensus.cc:3060] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:52.858426 23774 leader_election.cc:290] T 5c2f49b7f95a4153b2d180218e6af1db P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:52.860081 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:52.860790 16944 raft_consensus.cc:2468] T 4b962ceebb5c48c1914459ae0c0eff1b P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 15.
I20260709 13:08:52.862942 16322 leader_election.cc:304] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:08:52.863827 23764 raft_consensus.cc:2804] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:08:52.864266 23764 raft_consensus.cc:493] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 20 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:08:52.864696 23764 raft_consensus.cc:3060] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:52.868578 23784 raft_consensus.cc:493] T 13bc3c8ff9b84838a2664335d7e1582b P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:08:52.869300 23784 raft_consensus.cc:515] T 13bc3c8ff9b84838a2664335d7e1582b P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:52.871811 23784 leader_election.cc:290] T 13bc3c8ff9b84838a2664335d7e1582b P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:08:52.872416 16246 leader_election.cc:336] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111)
W20260709 13:08:52.873088 16246 leader_election.cc:336] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111)
I20260709 13:08:52.880189 23772 consensus_queue.cc:1048] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:08:52.882886 16914 leader_election.cc:304] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:52.883811 16322 leader_election.cc:304] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:08:52.884573 23772 raft_consensus.cc:2804] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:52.884722 23702 raft_consensus.cc:2804] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:52.885226 23702 raft_consensus.cc:493] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:08:52.885900 23702 raft_consensus.cc:3060] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:52.838075 23797 raft_consensus.cc:493] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:52.888410 23797 raft_consensus.cc:515] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:52.885224 23772 raft_consensus.cc:493] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 16 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:08:52.898749 23772 raft_consensus.cc:3060] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:52.901728 16248 leader_election.cc:304] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:52.889178 16914 leader_election.cc:304] T 16a307cee8ef431184c620fec029af19 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:52.903709 23797 leader_election.cc:290] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:08:52.905193 16912 leader_election.cc:336] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111)
I20260709 13:08:52.905719 23795 raft_consensus.cc:515] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:52.910876 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2275272882d4313a1ce1a8632a5819c" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:52.911896 16280 raft_consensus.cc:3060] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:08:52.913216 23774 raft_consensus.cc:2804] T 16a307cee8ef431184c620fec029af19 P 1109f76a0b7b443a84c0327c8707bc63 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:52.913734 23774 raft_consensus.cc:493] T 16a307cee8ef431184c620fec029af19 P 1109f76a0b7b443a84c0327c8707bc63 [term 19 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:08:52.914142 23774 raft_consensus.cc:3060] T 16a307cee8ef431184c620fec029af19 P 1109f76a0b7b443a84c0327c8707bc63 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:52.916299 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:52.918200 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:52.911027 16322 leader_election.cc:304] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:08:52.920583 23779 raft_consensus.cc:2804] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:52.921039 23779 raft_consensus.cc:493] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:08:52.921408 23779 raft_consensus.cc:3060] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:52.925706 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:52.928728 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "916cdb289e9442b69dd8ed0c99eb8198" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:52.929697 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7295dce0baa440b8a197da845581ee81" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:52.932910 23791 raft_consensus.cc:2804] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:52.933990 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7877d879c7564adfac82b8387dbbc867" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:52.933512 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:52.935137 23791 raft_consensus.cc:697] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:08:52.936765 23791 consensus_queue.cc:237] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:52.939208 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:52.943486 23771 raft_consensus.cc:493] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:08:52.944459 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:52.944262 23771 raft_consensus.cc:515] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:08:52.946332 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 44812.1us
I20260709 13:08:52.946678 23771 leader_election.cc:290] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:52.947361 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9e1324823f04d8da5a4b3ddbd061c0e" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:52.948561 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:52.933051 23779 raft_consensus.cc:515] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:52.949651 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "176e2f21e86a4e54a8d9a21aef8a272f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:52.950222 23702 raft_consensus.cc:515] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:08:52.952885 16246 leader_election.cc:336] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111)
I20260709 13:08:52.953545 23702 leader_election.cc:290] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 17 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:52.955753 16914 leader_election.cc:304] T cad5db410b3444caafa5090b94f02dba P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:52.956729 23771 raft_consensus.cc:2804] T cad5db410b3444caafa5090b94f02dba P 1109f76a0b7b443a84c0327c8707bc63 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:52.957150 23771 raft_consensus.cc:493] T cad5db410b3444caafa5090b94f02dba P 1109f76a0b7b443a84c0327c8707bc63 [term 18 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:08:52.957533 23771 raft_consensus.cc:3060] T cad5db410b3444caafa5090b94f02dba P 1109f76a0b7b443a84c0327c8707bc63 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:52.961091 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:08:52.953569 16246 leader_election.cc:336] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111)
I20260709 13:08:52.962604 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:52.963387 16277 raft_consensus.cc:2468] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 18.
I20260709 13:08:52.955897 16280 raft_consensus.cc:2468] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 23.
I20260709 13:08:52.965904 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:52.966358 16278 raft_consensus.cc:2468] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 12.
I20260709 13:08:52.966671 16350 raft_consensus.cc:2468] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 18.
I20260709 13:08:52.967615 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:52.968389 16356 raft_consensus.cc:2468] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 12.
I20260709 13:08:52.955842 23779 leader_election.cc:290] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 16 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:52.969377 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:08:52.949713 16912 leader_election.cc:336] T 5c2f49b7f95a4153b2d180218e6af1db P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111)
I20260709 13:08:52.963732 16248 leader_election.cc:304] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:08:52.971909 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:52.922439 23764 raft_consensus.cc:515] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 21 FOLLOWER]: Starting leader election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:52.974740 23764 leader_election.cc:290] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 21 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:52.979617 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13bc3c8ff9b84838a2664335d7e1582b" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:52.981326 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc427ac4cc014a9c99e5731814bff30a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:52.980813 23792 raft_consensus.cc:2749] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:08:52.983847 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:52.986974 23795 leader_election.cc:290] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 19 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:52.987660 16354 raft_consensus.cc:1240] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 18. Current term is 19. Ops: []
I20260709 13:08:52.987885 16248 leader_election.cc:304] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:52.988397 23774 raft_consensus.cc:515] T 16a307cee8ef431184c620fec029af19 P 1109f76a0b7b443a84c0327c8707bc63 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:52.992383 23772 raft_consensus.cc:515] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:52.993844 23792 raft_consensus.cc:2749] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:52.999197 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae7bbe4140004c26b8f5f8b6b79c9b83" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:52.987648 23771 raft_consensus.cc:515] T cad5db410b3444caafa5090b94f02dba P 1109f76a0b7b443a84c0327c8707bc63 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:53.000240 23779 raft_consensus.cc:493] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:08:53.000949 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540bfc4ad793452faea5b865343aacf7" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:53.002470 16281 raft_consensus.cc:3060] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:08:53.005133 23779 raft_consensus.cc:515] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:53.000186 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:53.005805 23776 raft_consensus.cc:493] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:08:53.006428 23776 raft_consensus.cc:515] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:53.007464 23779 leader_election.cc:290] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:53.005513 23785 raft_consensus.cc:493] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:08:53.008246 23785 raft_consensus.cc:515] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:53.010000 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73757c6fea8949e090aa4e55902a41d4" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:53.008594 23776 leader_election.cc:290] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:53.011744 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:53.012602 16349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:53.013581 16349 raft_consensus.cc:2393] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 in current term 19: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:08:53.013919 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1a76ba8ceae4d0780583a09087cec0a" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
W20260709 13:08:53.014055 16912 leader_election.cc:336] T 13bc3c8ff9b84838a2664335d7e1582b P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111)
I20260709 13:08:53.014911 23785 leader_election.cc:290] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:53.015224 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:08:53.015621 16320 leader_election.cc:336] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111)
I20260709 13:08:53.016898 23771 leader_election.cc:290] T cad5db410b3444caafa5090b94f02dba P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 19 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:53.017520 16277 raft_consensus.cc:1275] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 24 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:08:53.017804 23774 leader_election.cc:290] T 16a307cee8ef431184c620fec029af19 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 20 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:08:53.018187 16320 leader_election.cc:336] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111)
W20260709 13:08:53.020169 16912 leader_election.cc:336] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111)
I20260709 13:08:53.022874 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c2f49b7f95a4153b2d180218e6af1db" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:53.024367 16348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:53.025851 16352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:53.025931 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:08:53.026738 16352 raft_consensus.cc:3060] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:53.026993 16941 raft_consensus.cc:2393] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 17: Already voted for candidate 1109f76a0b7b443a84c0327c8707bc63 in this term.
W20260709 13:08:53.028841 16320 leader_election.cc:336] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111)
I20260709 13:08:53.029395 16320 leader_election.cc:304] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:53.030416 23796 raft_consensus.cc:493] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:08:53.031033 23772 leader_election.cc:290] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 17 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:53.031093 23796 raft_consensus.cc:515] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:53.032357 16351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cad5db410b3444caafa5090b94f02dba" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:53.033159 16351 raft_consensus.cc:3060] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:53.036573 16914 leader_election.cc:304] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:53.034811 23796 leader_election.cc:290] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:53.041178 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:08:53.042163 23779 raft_consensus.cc:2749] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:08:53.043656 15057 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 16229)
I20260709 13:08:53.044512 16944 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:08:53.045414 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "552b1776c27a48c194068de522fa45b6" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:53.041409 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:53.046149 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0340758c689242c3979a434fa59589f7" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:08:53.036513 16320 consensus_peers.cc:597] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:53.050679 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:08:53.052606 16351 raft_consensus.cc:2468] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 19.
I20260709 13:08:53.056294 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:53.049940 16248 leader_election.cc:304] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:08:53.050892 16320 consensus_peers.cc:597] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:53.066180 16320 leader_election.cc:336] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111)
W20260709 13:08:53.067287 16320 leader_election.cc:336] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111)
W20260709 13:08:53.067929 16320 leader_election.cc:336] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111)
I20260709 13:08:53.070185 16322 leader_election.cc:304] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:53.071265 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:53.072687 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "16a307cee8ef431184c620fec029af19" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:53.073344 16280 raft_consensus.cc:3060] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:53.079037 16248 leader_election.cc:304] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:08:53.080776 16912 leader_election.cc:336] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111)
I20260709 13:08:53.081254 16912 leader_election.cc:304] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:53.083019 16248 leader_election.cc:304] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:53.085027 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:53.107268 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143d3d1339b44b6dbdf204507b6af74b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:53.064467 23771 raft_consensus.cc:2804] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:53.115638 16322 leader_election.cc:304] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:53.084836 23791 raft_consensus.cc:2804] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:08:53.133751 16246 leader_election.cc:336] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111)
I20260709 13:08:53.127887 23791 raft_consensus.cc:493] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:08:53.135315 23791 raft_consensus.cc:3060] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:53.110678 23775 raft_consensus.cc:2749] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:53.086773 23796 raft_consensus.cc:2804] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:53.140233 23796 raft_consensus.cc:493] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:08:53.140802 23796 raft_consensus.cc:3060] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:08:53.143043 16320 leader_election.cc:336] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111)
I20260709 13:08:53.143723 16320 leader_election.cc:304] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:53.144819 23764 raft_consensus.cc:2749] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:08:53.149214 16248 leader_election.cc:304] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:08:53.153740 16912 leader_election.cc:336] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111)
W20260709 13:08:53.154443 16912 leader_election.cc:336] T 16a307cee8ef431184c620fec029af19 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111)
W20260709 13:08:53.155018 16912 leader_election.cc:336] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111)
W20260709 13:08:53.155434 16912 leader_election.cc:336] T cad5db410b3444caafa5090b94f02dba P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111)
W20260709 13:08:53.173774 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 109215us
I20260709 13:08:53.153798 23784 raft_consensus.cc:2749] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:53.174957 16914 leader_election.cc:304] T 13bc3c8ff9b84838a2664335d7e1582b P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:53.182341 23792 raft_consensus.cc:2749] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:08:53.187801 16320 leader_election.cc:336] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111)
I20260709 13:08:53.193759 16280 raft_consensus.cc:2468] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 20.
W20260709 13:08:53.198743 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 49700.7us
I20260709 13:08:53.162137 23771 raft_consensus.cc:697] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [term 12 LEADER]: Becoming Leader. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:08:53.201515 16352 raft_consensus.cc:2468] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 20.
I20260709 13:08:53.210975 16248 leader_election.cc:304] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:53.214354 16914 leader_election.cc:304] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:53.216414 16281 raft_consensus.cc:2468] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 12.
I20260709 13:08:53.205545 23794 raft_consensus.cc:2764] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 13:08:53.219099 16914 leader_election.cc:304] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:53.214061 23779 raft_consensus.cc:2749] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:53.226294 23805 raft_consensus.cc:2749] T 13bc3c8ff9b84838a2664335d7e1582b P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:53.220309 23772 raft_consensus.cc:2749] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:53.216351 23776 raft_consensus.cc:493] T ab124ef29c71409d9c14a75a054095e1 P 1109f76a0b7b443a84c0327c8707bc63 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:08:53.244359 23776 raft_consensus.cc:515] T ab124ef29c71409d9c14a75a054095e1 P 1109f76a0b7b443a84c0327c8707bc63 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:53.247514 23770 raft_consensus.cc:2749] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:53.247228 23771 consensus_queue.cc:237] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:53.256843 23776 leader_election.cc:290] T ab124ef29c71409d9c14a75a054095e1 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:53.258090 23784 raft_consensus.cc:2804] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:08:53.258853 23784 raft_consensus.cc:697] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [term 12 LEADER]: Becoming Leader. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:08:53.259809 16914 leader_election.cc:304] T 4b962ceebb5c48c1914459ae0c0eff1b P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:08:53.259982 23784 consensus_queue.cc:237] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:53.260988 23772 raft_consensus.cc:2749] T 4b962ceebb5c48c1914459ae0c0eff1b P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:53.261718 16914 leader_election.cc:304] T 540bfc4ad793452faea5b865343aacf7 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:53.262745 23805 raft_consensus.cc:2749] T 540bfc4ad793452faea5b865343aacf7 P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:53.263185 16914 leader_election.cc:304] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:08:53.264014 23791 raft_consensus.cc:515] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:53.264554 16914 leader_election.cc:304] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:08:53.264977 23776 raft_consensus.cc:3060] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:53.265404 23805 raft_consensus.cc:2749] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:53.265902 16914 leader_election.cc:304] T abbbc04ca95a4119a7e3fb64073fe61f P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:08:53.273860 16914 leader_election.cc:304] T 5c2f49b7f95a4153b2d180218e6af1db P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:53.278860 23797 raft_consensus.cc:2749] T abbbc04ca95a4119a7e3fb64073fe61f P 1109f76a0b7b443a84c0327c8707bc63 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:53.280253 23772 raft_consensus.cc:2749] T 5c2f49b7f95a4153b2d180218e6af1db P 1109f76a0b7b443a84c0327c8707bc63 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:08:53.291460 16912 leader_election.cc:336] T ab124ef29c71409d9c14a75a054095e1 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111)
I20260709 13:08:53.291770 23791 leader_election.cc:290] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:53.339200 16104 catalog_manager.cc:5697] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 14 to 15, leader changed from e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) to 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66). New cstate: current_term: 15 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:53.346745 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 130469us
W20260709 13:08:53.348454 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 137569us
I20260709 13:08:53.357067 23796 raft_consensus.cc:515] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:53.366906 16322 leader_election.cc:304] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:08:53.368770 23795 raft_consensus.cc:2749] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:53.371186 16322 leader_election.cc:304] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:08:53.379760 16322 leader_election.cc:304] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:53.376457 16277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab124ef29c71409d9c14a75a054095e1" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:53.379020 23810 raft_consensus.cc:2749] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:53.390784 23812 consensus_queue.cc:1059] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.017s
I20260709 13:08:53.394558 23796 leader_election.cc:290] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 19 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:08:53.396473 16912 consensus_peers.cc:597] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:08:53.405347 16322 leader_election.cc:304] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:08:53.407814 16322 leader_election.cc:304] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:53.408797 23813 raft_consensus.cc:2804] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:53.409307 23813 raft_consensus.cc:493] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Starting leader election (detected failure of leader e10b16d536674c0bb350a31d7ce5ff7f)
I20260709 13:08:53.409739 23813 raft_consensus.cc:3060] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:08:53.397070 16912 consensus_peers.cc:597] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:08:53.410809 23810 raft_consensus.cc:2749] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:08:53.402727 23791 raft_consensus.cc:493] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:53.416110 16970 debug-util.cc:398] Leaking SignalData structure 0x7b080035ca80 after lost signal to thread 15060
I20260709 13:08:53.416000 23791 raft_consensus.cc:515] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:08:53.417588 16970 debug-util.cc:398] Leaking SignalData structure 0x7b08002f9100 after lost signal to thread 16140
W20260709 13:08:53.419343 16970 debug-util.cc:398] Leaking SignalData structure 0x7b08003aa180 after lost signal to thread 16307
W20260709 13:08:53.420930 16970 debug-util.cc:398] Leaking SignalData structure 0x7b080020d300 after lost signal to thread 16381
I20260709 13:08:53.423574 23812 raft_consensus.cc:3055] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:08:53.424146 23812 raft_consensus.cc:740] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:08:53.425266 23812 consensus_queue.cc:260] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:53.427101 23731 raft_consensus.cc:2749] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:08:53.429710 23791 leader_election.cc:290] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:53.439073 23812 raft_consensus.cc:3060] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:08:53.446816 16970 debug-util.cc:398] Leaking SignalData structure 0x7b080027db80 after lost signal to thread 16973
I20260709 13:08:53.449443 16322 leader_election.cc:304] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:08:53.463016 16320 consensus_peers.cc:597] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:53.464026 23731 raft_consensus.cc:2804] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:08:53.464634 23731 raft_consensus.cc:697] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 23 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:08:53.466254 23810 consensus_queue.cc:1048] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:08:53.472834 23776 raft_consensus.cc:2749] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:53.465790 23731 consensus_queue.cc:237] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:53.477355 16943 raft_consensus.cc:1240] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 19 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 18. Current term is 19. Ops: []
I20260709 13:08:53.479395 16914 leader_election.cc:304] T ab124ef29c71409d9c14a75a054095e1 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:53.498701 23771 raft_consensus.cc:2749] T ab124ef29c71409d9c14a75a054095e1 P 1109f76a0b7b443a84c0327c8707bc63 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:53.501183 16322 leader_election.cc:304] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:08:53.502702 16322 leader_election.cc:304] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
W20260709 13:08:53.506038 16246 leader_election.cc:336] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111)
W20260709 13:08:53.513204 16320 consensus_peers.cc:597] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:08:53.505409 23779 raft_consensus.cc:2749] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:08:53.519337 16104 catalog_manager.cc:5697] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: term changed from 11 to 12, leader changed from e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) to 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68). New cstate: current_term: 12 leader_uuid: "1109f76a0b7b443a84c0327c8707bc63" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:53.521891 16104 catalog_manager.cc:5697] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: term changed from 11 to 12, leader changed from e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) to 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68). New cstate: current_term: 12 leader_uuid: "1109f76a0b7b443a84c0327c8707bc63" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:08:53.535538 16246 consensus_peers.cc:597] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:53.538635 16246 leader_election.cc:336] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111)
I20260709 13:08:53.540170 16322 leader_election.cc:304] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:08:53.542202 16322 leader_election.cc:304] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:53.544137 23810 raft_consensus.cc:2749] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:08:53.544139 23779 raft_consensus.cc:2749] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 13:08:53.545974 16320 consensus_peers.cc:597] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:08:53.547514 23788 raft_consensus.cc:2749] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:08:53.539719 16246 consensus_peers.cc:597] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:53.555668 16246 leader_election.cc:336] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111)
I20260709 13:08:53.558195 16914 leader_election.cc:304] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:08:53.560446 23771 raft_consensus.cc:2749] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:53.495270 23813 raft_consensus.cc:515] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:53.580473 16914 leader_election.cc:304] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:08:53.581667 16320 leader_election.cc:336] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111)
I20260709 13:08:53.583163 16914 leader_election.cc:304] T cad5db410b3444caafa5090b94f02dba P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:53.583709 23776 raft_consensus.cc:2749] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:08:53.584331 23771 raft_consensus.cc:2804] T cad5db410b3444caafa5090b94f02dba P 1109f76a0b7b443a84c0327c8707bc63 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:53.585870 16914 leader_election.cc:304] T 16a307cee8ef431184c620fec029af19 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:53.587409 23784 raft_consensus.cc:2804] T 16a307cee8ef431184c620fec029af19 P 1109f76a0b7b443a84c0327c8707bc63 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:08:53.588068 23784 raft_consensus.cc:697] T 16a307cee8ef431184c620fec029af19 P 1109f76a0b7b443a84c0327c8707bc63 [term 20 LEADER]: Becoming Leader. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:08:53.587347 23771 raft_consensus.cc:697] T cad5db410b3444caafa5090b94f02dba P 1109f76a0b7b443a84c0327c8707bc63 [term 19 LEADER]: Becoming Leader. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:08:53.589183 23784 consensus_queue.cc:237] T 16a307cee8ef431184c620fec029af19 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:53.589977 23771 consensus_queue.cc:237] T cad5db410b3444caafa5090b94f02dba P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:53.625659 23813 leader_election.cc:290] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 19 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:08:53.656512 16912 consensus_peers.cc:597] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:08:53.662873 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18b8d2f02b16479aaf7ec42190a4197f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:53.664430 16281 raft_consensus.cc:1275] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 12 index: 13. (index mismatch)
W20260709 13:08:53.669584 16912 consensus_peers.cc:597] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:08:53.683087 16351 raft_consensus.cc:1240] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:53.683907 16348 raft_consensus.cc:1240] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 21 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 20. Current term is 21. Ops: []
I20260709 13:08:53.684742 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aee913c41fb9437587affa768953f637" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:53.693253 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:53.694144 16355 raft_consensus.cc:1275] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:08:53.692240 23785 consensus_queue.cc:1048] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.004s
I20260709 13:08:53.697801 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd2e2dfe8dc4456ab39d1a4d6f6416b7" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:53.698513 16354 raft_consensus.cc:3060] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:53.694264 16350 raft_consensus.cc:2393] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 19: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:08:53.715741 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:53.716647 16357 raft_consensus.cc:2393] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 in current term 17: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
W20260709 13:08:53.724520 16912 consensus_peers.cc:597] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:53.728399 16320 consensus_peers.cc:597] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:53.731714 16090 catalog_manager.cc:4755] TS e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 5054b6ad2e4141cab2232a3fecd7c858: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111)
I20260709 13:08:53.740491 16354 raft_consensus.cc:2468] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 13.
I20260709 13:08:53.750375 16104 catalog_manager.cc:5697] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e reported cstate change: term changed from 22 to 23, leader changed from e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) to 363bb2f744eb486f9ad726f08214c98e (127.14.180.67). New cstate: current_term: 23 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } }
W20260709 13:08:53.789881 16912 consensus_peers.cc:597] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:08:53.799242 16103 catalog_manager.cc:5697] T cad5db410b3444caafa5090b94f02dba P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: term changed from 18 to 19, leader changed from e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) to 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68). New cstate: current_term: 19 leader_uuid: "1109f76a0b7b443a84c0327c8707bc63" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:08:53.805243 16246 consensus_peers.cc:597] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:53.817003 16320 consensus_peers.cc:597] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:53.817950 16320 consensus_peers.cc:597] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:53.818656 16320 consensus_peers.cc:597] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:53.820613 23828 log.cc:927] Time spent T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 13:08:53.828923 16248 leader_election.cc:304] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:53.832787 16914 leader_election.cc:304] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:53.817392 16103 catalog_manager.cc:5697] T 16a307cee8ef431184c620fec029af19 P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: term changed from 19 to 20, leader changed from e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) to 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68). New cstate: current_term: 20 leader_uuid: "1109f76a0b7b443a84c0327c8707bc63" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:53.835641 16283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:53.837837 16283 raft_consensus.cc:2393] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e in current term 19: Already voted for candidate 0aea40d6e4374085a2e38a70a71f63e3 in this term.
I20260709 13:08:53.842404 23815 consensus_queue.cc:1059] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:08:53.840869 23817 raft_consensus.cc:2749] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:53.838006 23785 raft_consensus.cc:2749] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:08:53.843321 23773 consensus_queue.cc:1059] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 20.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:08:53.857633 23792 raft_consensus.cc:3055] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 LEADER]: Stepping down as leader of term 20
W20260709 13:08:53.859095 16912 consensus_peers.cc:597] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:53.859429 23792 raft_consensus.cc:740] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:08:53.872452 23792 consensus_queue.cc:260] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:53.888902 23791 raft_consensus.cc:3055] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:53.898432 16322 leader_election.cc:304] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:53.887465 23815 consensus_queue.cc:1048] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 13:08:53.924309 16248 leader_election.cc:304] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:53.911319 23794 raft_consensus.cc:2749] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:08:53.905906 23791 raft_consensus.cc:740] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:08:53.966375 23791 consensus_queue.cc:260] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:53.967847 23791 raft_consensus.cc:3060] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:53.933245 16248 leader_election.cc:304] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:53.937600 23792 raft_consensus.cc:3060] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:08:53.940397 16912 consensus_peers.cc:597] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:08:53.943646 23812 raft_consensus.cc:2749] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:08:53.974671 16248 leader_election.cc:304] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:53.962595 16276 raft_consensus.cc:1275] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 13:08:53.973259 16320 consensus_peers.cc:597] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:53.978334 16320 consensus_peers.cc:597] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:53.980971 16246 consensus_peers.cc:597] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:08:53.982966 23773 raft_consensus.cc:2749] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:08:53.983742 23771 consensus_queue.cc:1048] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:08:53.984618 16246 consensus_peers.cc:597] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:08:53.985056 23813 raft_consensus.cc:493] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:53.985481 16246 consensus_peers.cc:597] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:08:53.985800 23813 raft_consensus.cc:515] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:53.990924 23815 raft_consensus.cc:2804] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:53.991536 23815 raft_consensus.cc:697] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:08:53.992504 23815 consensus_queue.cc:237] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:08:54.002275 16320 consensus_peers.cc:597] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:54.024276 23813 leader_election.cc:290] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:08:54.027420 16320 leader_election.cc:336] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111)
W20260709 13:08:54.040417 16320 consensus_peers.cc:597] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:54.044119 15057 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 16229)
W20260709 13:08:54.058257 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 129988us
W20260709 13:08:54.086997 16320 consensus_peers.cc:597] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:54.121402 16912 consensus_peers.cc:597] T cad5db410b3444caafa5090b94f02dba P 1109f76a0b7b443a84c0327c8707bc63 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:54.120774 16103 catalog_manager.cc:5697] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 12 to 13, leader changed from e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) to 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66). New cstate: current_term: 13 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:54.134323 16279 raft_consensus.cc:1275] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 23 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:08:54.154208 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c824093f8d374c1b9f3c8a6e8e711157" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:54.167886 16354 raft_consensus.cc:1240] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Rejecting Update request from peer 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 15. Current term is 16. Ops: []
W20260709 13:08:54.171242 16912 consensus_peers.cc:597] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:54.176213 16912 consensus_peers.cc:597] T 16a307cee8ef431184c620fec029af19 P 1109f76a0b7b443a84c0327c8707bc63 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:54.216051 16276 raft_consensus.cc:1275] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:08:54.217931 23785 consensus_queue.cc:1048] T 16a307cee8ef431184c620fec029af19 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:08:54.219421 16349 raft_consensus.cc:1275] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:08:54.222038 16276 raft_consensus.cc:2955] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Committing config change with OpId 19.15: config changed from index 14 to 15, 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } } }
I20260709 13:08:54.282874 23785 consensus_queue.cc:1048] T cad5db410b3444caafa5090b94f02dba P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 13:08:54.323519 16246 consensus_peers.cc:597] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:08:54.377851 16322 leader_election.cc:304] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:54.378782 23813 consensus_queue.cc:1048] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:08:54.379895 23834 raft_consensus.cc:2749] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:54.410226 16349 raft_consensus.cc:1275] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 20 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
W20260709 13:08:54.458835 16320 consensus_peers.cc:597] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:08:54.461557 23806 consensus_queue.cc:1048] T 16a307cee8ef431184c620fec029af19 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 13:08:54.570137 16246 consensus_peers.cc:597] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:54.637210 16350 raft_consensus.cc:1275] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:08:54.638799 23791 consensus_queue.cc:1048] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:54.689132 23779 raft_consensus.cc:493] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:54.689783 23779 raft_consensus.cc:515] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:54.692515 23779 leader_election.cc:290] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:54.696516 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:54.697268 16943 raft_consensus.cc:2468] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 17.
W20260709 13:08:54.697654 16246 consensus_peers.cc:597] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:54.697538 16320 leader_election.cc:336] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111)
I20260709 13:08:54.700022 16322 leader_election.cc:304] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:54.701129 23764 raft_consensus.cc:2804] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:54.701685 23764 raft_consensus.cc:493] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:54.702138 23764 raft_consensus.cc:3060] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:08:54.709848 16320 consensus_peers.cc:597] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:54.723258 23764 raft_consensus.cc:515] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:54.725682 23764 leader_election.cc:290] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 18 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:54.726779 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38b024fb12204d9b9e35d72638671c24" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:08:54.727401 16943 raft_consensus.cc:3060] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:08:54.730636 16320 leader_election.cc:336] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111)
I20260709 13:08:54.734658 16943 raft_consensus.cc:2468] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 18.
I20260709 13:08:54.735957 16322 leader_election.cc:304] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:54.738047 23764 raft_consensus.cc:2804] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:54.741932 23764 raft_consensus.cc:697] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 18 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:08:54.746795 23764 consensus_queue.cc:237] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:08:54.762785 16912 consensus_peers.cc:597] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:54.770324 16912 consensus_peers.cc:597] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 1109f76a0b7b443a84c0327c8707bc63 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:54.793735 16102 catalog_manager.cc:5697] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e reported cstate change: term changed from 16 to 18, leader changed from e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) to 363bb2f744eb486f9ad726f08214c98e (127.14.180.67). New cstate: current_term: 18 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:54.805969 16246 consensus_peers.cc:597] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:54.809953 16320 consensus_peers.cc:597] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:08:54.825722 23773 raft_consensus.cc:493] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:54.826390 23773 raft_consensus.cc:515] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:54.830132 23773 leader_election.cc:290] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:54.830349 16942 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:54.831278 16942 raft_consensus.cc:2468] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 19.
I20260709 13:08:54.833158 16248 leader_election.cc:304] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:08:54.834681 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:54.835387 16350 raft_consensus.cc:2468] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 19.
I20260709 13:08:54.837823 23773 raft_consensus.cc:2804] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:54.838485 23773 raft_consensus.cc:493] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:54.838922 23773 raft_consensus.cc:3060] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:08:54.868016 16320 consensus_peers.cc:597] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:08:54.888307 23773 raft_consensus.cc:515] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:54.892045 23773 leader_election.cc:290] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 20 election: Requested vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:54.897212 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:54.898912 16350 raft_consensus.cc:3060] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:08:54.900365 16246 consensus_peers.cc:597] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:54.900961 16246 consensus_peers.cc:597] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:08:54.900985 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:08:54.901702 16943 raft_consensus.cc:3060] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:54.916925 16943 raft_consensus.cc:2468] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 20.
W20260709 13:08:54.924836 16320 consensus_peers.cc:597] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:54.926227 16350 raft_consensus.cc:2468] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 20.
I20260709 13:08:54.927642 16248 leader_election.cc:304] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:08:54.928680 23773 raft_consensus.cc:2804] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:08:54.929970 23773 raft_consensus.cc:697] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:08:54.930989 23773 consensus_queue.cc:237] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:54.962054 23771 raft_consensus.cc:493] T 4b962ceebb5c48c1914459ae0c0eff1b P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:08:54.962886 23771 raft_consensus.cc:515] T 4b962ceebb5c48c1914459ae0c0eff1b P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:54.967577 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:54.968300 16279 raft_consensus.cc:2468] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 16.
I20260709 13:08:54.968842 23771 leader_election.cc:290] T 4b962ceebb5c48c1914459ae0c0eff1b P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:54.968215 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:54.969611 16350 raft_consensus.cc:2393] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 in current term 16: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:08:54.969658 16914 leader_election.cc:304] T 4b962ceebb5c48c1914459ae0c0eff1b P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:08:54.970587 23806 raft_consensus.cc:493] T abbbc04ca95a4119a7e3fb64073fe61f P 1109f76a0b7b443a84c0327c8707bc63 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:08:54.971325 23806 raft_consensus.cc:515] T abbbc04ca95a4119a7e3fb64073fe61f P 1109f76a0b7b443a84c0327c8707bc63 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:54.973711 23806 leader_election.cc:290] T abbbc04ca95a4119a7e3fb64073fe61f P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:54.974351 23806 raft_consensus.cc:2804] T 4b962ceebb5c48c1914459ae0c0eff1b P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:54.978250 23806 raft_consensus.cc:493] T 4b962ceebb5c48c1914459ae0c0eff1b P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:08:54.978713 23806 raft_consensus.cc:3060] T 4b962ceebb5c48c1914459ae0c0eff1b P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:54.981240 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:54.982105 16350 raft_consensus.cc:2393] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 in current term 21: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:08:54.983304 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:54.983974 16279 raft_consensus.cc:2468] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 21.
I20260709 13:08:54.991276 16914 leader_election.cc:304] T abbbc04ca95a4119a7e3fb64073fe61f P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:08:54.992689 23785 raft_consensus.cc:2804] T abbbc04ca95a4119a7e3fb64073fe61f P 1109f76a0b7b443a84c0327c8707bc63 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:08:54.993119 23785 raft_consensus.cc:493] T abbbc04ca95a4119a7e3fb64073fe61f P 1109f76a0b7b443a84c0327c8707bc63 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:08:54.993494 23785 raft_consensus.cc:3060] T abbbc04ca95a4119a7e3fb64073fe61f P 1109f76a0b7b443a84c0327c8707bc63 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:55.010355 16102 catalog_manager.cc:5697] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:55.007304 23785 raft_consensus.cc:515] T abbbc04ca95a4119a7e3fb64073fe61f P 1109f76a0b7b443a84c0327c8707bc63 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:55.017658 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:55.029676 16279 raft_consensus.cc:2468] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 21.
I20260709 13:08:55.031844 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:55.032732 16350 raft_consensus.cc:2393] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 in current term 21: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:08:55.033488 23785 leader_election.cc:290] T abbbc04ca95a4119a7e3fb64073fe61f P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 21 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:55.037480 16914 leader_election.cc:304] T abbbc04ca95a4119a7e3fb64073fe61f P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 363bb2f744eb486f9ad726f08214c98e
I20260709 13:08:55.040405 23771 raft_consensus.cc:2804] T abbbc04ca95a4119a7e3fb64073fe61f P 1109f76a0b7b443a84c0327c8707bc63 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:08:55.041157 23771 raft_consensus.cc:697] T abbbc04ca95a4119a7e3fb64073fe61f P 1109f76a0b7b443a84c0327c8707bc63 [term 21 LEADER]: Becoming Leader. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:08:55.042104 23771 consensus_queue.cc:237] T abbbc04ca95a4119a7e3fb64073fe61f P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:08:55.044672 15057 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 16229)
I20260709 13:08:55.047979 23806 raft_consensus.cc:515] T 4b962ceebb5c48c1914459ae0c0eff1b P 1109f76a0b7b443a84c0327c8707bc63 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:55.064232 23806 leader_election.cc:290] T 4b962ceebb5c48c1914459ae0c0eff1b P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 16 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:55.067334 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:55.071192 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:55.072203 16350 raft_consensus.cc:2393] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 1109f76a0b7b443a84c0327c8707bc63 in current term 16: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:08:55.077756 16281 raft_consensus.cc:2468] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 16.
I20260709 13:08:55.080646 16914 leader_election.cc:304] T 4b962ceebb5c48c1914459ae0c0eff1b P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:08:55.083703 23806 raft_consensus.cc:2804] T 4b962ceebb5c48c1914459ae0c0eff1b P 1109f76a0b7b443a84c0327c8707bc63 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:55.085799 23806 raft_consensus.cc:697] T 4b962ceebb5c48c1914459ae0c0eff1b P 1109f76a0b7b443a84c0327c8707bc63 [term 16 LEADER]: Becoming Leader. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:08:55.086910 23806 consensus_queue.cc:237] T 4b962ceebb5c48c1914459ae0c0eff1b P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:55.118719 16102 catalog_manager.cc:5697] T abbbc04ca95a4119a7e3fb64073fe61f P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: term changed from 20 to 21, leader changed from 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) to 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68). New cstate: current_term: 21 leader_uuid: "1109f76a0b7b443a84c0327c8707bc63" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:55.139319 16943 raft_consensus.cc:1275] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 18 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:08:55.145040 23764 consensus_queue.cc:1048] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:08:55.156113 16102 catalog_manager.cc:5697] T 4b962ceebb5c48c1914459ae0c0eff1b P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: term changed from 15 to 16, leader changed from 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) to 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68). New cstate: current_term: 16 leader_uuid: "1109f76a0b7b443a84c0327c8707bc63" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:08:55.183215 16320 consensus_peers.cc:597] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:55.322980 16320 consensus_peers.cc:597] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:55.331669 16941 raft_consensus.cc:1275] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 20 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:08:55.333688 23796 consensus_queue.cc:1048] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:08:55.395339 23810 raft_consensus.cc:493] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:55.396091 23810 raft_consensus.cc:515] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:55.398967 23810 leader_election.cc:290] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:55.423239 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:55.424458 16281 raft_consensus.cc:2468] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 16.
I20260709 13:08:55.443480 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:55.461961 16322 leader_election.cc:304] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:08:55.472734 23855 raft_consensus.cc:2804] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:55.473171 23855 raft_consensus.cc:493] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:55.473652 23855 raft_consensus.cc:3060] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:08:55.517148 16320 consensus_peers.cc:597] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:55.518025 16281 raft_consensus.cc:1275] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:08:55.519861 23785 consensus_queue.cc:1048] T 4b962ceebb5c48c1914459ae0c0eff1b P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:08:55.521991 23855 raft_consensus.cc:515] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:55.524338 23855 leader_election.cc:290] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 17 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:08:55.537528 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 65037.1us
I20260709 13:08:55.544873 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:08:55.545923 16280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:55.552345 16356 raft_consensus.cc:1275] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 20 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:08:55.575989 16322 leader_election.cc:304] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:08:55.598875 23810 raft_consensus.cc:2749] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:08:55.607019 23855 raft_consensus.cc:493] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:55.607632 23855 raft_consensus.cc:515] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:55.610520 23855 leader_election.cc:290] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:08:55.616228 16320 leader_election.cc:336] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111)
I20260709 13:08:55.620687 23796 consensus_queue.cc:1048] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:08:55.622813 16354 raft_consensus.cc:1240] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:55.627873 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:55.628029 23785 consensus_queue.cc:1059] T 4b962ceebb5c48c1914459ae0c0eff1b P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:08:55.628585 16279 raft_consensus.cc:2468] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 19.
I20260709 13:08:55.630824 23785 raft_consensus.cc:3055] T 4b962ceebb5c48c1914459ae0c0eff1b P 1109f76a0b7b443a84c0327c8707bc63 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:55.631225 23785 raft_consensus.cc:740] T 4b962ceebb5c48c1914459ae0c0eff1b P 1109f76a0b7b443a84c0327c8707bc63 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:08:55.632085 23785 consensus_queue.cc:260] T 4b962ceebb5c48c1914459ae0c0eff1b P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:55.633339 23785 raft_consensus.cc:3060] T 4b962ceebb5c48c1914459ae0c0eff1b P 1109f76a0b7b443a84c0327c8707bc63 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:55.651425 16322 leader_election.cc:304] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:55.654421 23860 raft_consensus.cc:2804] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:55.654604 16276 raft_consensus.cc:1275] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 21 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 13:08:55.654973 23860 raft_consensus.cc:493] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:55.655341 23860 raft_consensus.cc:3060] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:55.664026 23860 raft_consensus.cc:515] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:08:55.675758 16320 leader_election.cc:336] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111)
I20260709 13:08:55.679234 23772 consensus_queue.cc:1048] T abbbc04ca95a4119a7e3fb64073fe61f P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:08:55.680426 23860 leader_election.cc:290] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 20 election: Requested vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:08:55.710103 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "888479daeaaa4744a161f6b45bb257f6" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:55.711654 16281 raft_consensus.cc:3060] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:08:55.742586 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 64598.6us
I20260709 13:08:55.767920 16350 raft_consensus.cc:1275] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 21 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
W20260709 13:08:55.779575 16320 consensus_peers.cc:597] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:08:55.771967 16281 raft_consensus.cc:2468] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 20.
I20260709 13:08:55.787856 16322 leader_election.cc:304] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:08:55.787971 23794 raft_consensus.cc:493] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:55.788686 23794 raft_consensus.cc:515] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:55.789889 23860 raft_consensus.cc:2804] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:08:55.790488 23860 raft_consensus.cc:697] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 20 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:08:55.791484 23860 consensus_queue.cc:237] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:08:55.795663 23794 leader_election.cc:290] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:55.798205 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:55.800491 16281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
I20260709 13:08:55.802750 16281 raft_consensus.cc:2468] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 21.
I20260709 13:08:55.805382 16322 leader_election.cc:304] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:08:55.811079 23794 raft_consensus.cc:2804] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:08:55.813711 23794 raft_consensus.cc:493] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:55.814121 23794 raft_consensus.cc:3060] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:55.857774 23862 consensus_queue.cc:1048] T abbbc04ca95a4119a7e3fb64073fe61f P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:08:55.861145 16102 catalog_manager.cc:5697] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e reported cstate change: term changed from 18 to 20, leader changed from e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65) to 363bb2f744eb486f9ad726f08214c98e (127.14.180.67). New cstate: current_term: 20 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } }
W20260709 13:08:55.890894 16320 consensus_peers.cc:597] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:08:55.909618 23794 raft_consensus.cc:515] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 22 FOLLOWER]: Starting leader election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:55.946302 16350 raft_consensus.cc:1240] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 22 FOLLOWER]: Rejecting Update request from peer 1109f76a0b7b443a84c0327c8707bc63 for earlier term 21. Current term is 22. Ops: [21.17-21.17]
I20260709 13:08:55.952320 23806 consensus_queue.cc:1059] T abbbc04ca95a4119a7e3fb64073fe61f P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: INVALID_TERM, Last received: 20.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:08:55.953493 23785 raft_consensus.cc:3055] T abbbc04ca95a4119a7e3fb64073fe61f P 1109f76a0b7b443a84c0327c8707bc63 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:08:55.953938 23785 raft_consensus.cc:740] T abbbc04ca95a4119a7e3fb64073fe61f P 1109f76a0b7b443a84c0327c8707bc63 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:08:55.954953 23785 consensus_queue.cc:260] T abbbc04ca95a4119a7e3fb64073fe61f P 1109f76a0b7b443a84c0327c8707bc63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.17, Last appended by leader: 17, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:55.956396 23785 raft_consensus.cc:3060] T abbbc04ca95a4119a7e3fb64073fe61f P 1109f76a0b7b443a84c0327c8707bc63 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:55.979787 23794 leader_election.cc:290] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 22 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:55.980712 16941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:08:55.982288 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
W20260709 13:08:55.989811 16912 consensus_peers.cc:597] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:56.018500 16912 consensus_peers.cc:597] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:56.023521 16246 consensus_peers.cc:597] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:56.035174 16941 raft_consensus.cc:2410] T abbbc04ca95a4119a7e3fb64073fe61f P 1109f76a0b7b443a84c0327c8707bc63 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 363bb2f744eb486f9ad726f08214c98e for term 22 because replica has last-logged OpId of term: 21 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 16.
I20260709 13:08:56.038857 16322 leader_election.cc:304] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:08:56.043876 23860 raft_consensus.cc:2749] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
W20260709 13:08:56.045261 15057 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 16229)
W20260709 13:08:56.051720 16912 consensus_peers.cc:597] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:56.082947 16090 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 100779us
W20260709 13:08:56.093780 16090 catalog_manager.cc:4755] TS e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet a054979193cb43dcba8c8eb72cd7f05d: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111)
W20260709 13:08:56.093855 16246 consensus_peers.cc:597] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:56.100127 16246 consensus_peers.cc:597] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:56.171206 16912 consensus_peers.cc:597] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:56.192185 16246 consensus_peers.cc:597] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:56.198789 16912 consensus_peers.cc:597] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:56.272440 16320 consensus_peers.cc:597] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:56.280762 16320 consensus_peers.cc:597] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:56.296593 16320 consensus_peers.cc:597] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:56.318120 16912 consensus_peers.cc:597] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:56.325120 16320 consensus_peers.cc:597] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:56.329543 16320 consensus_peers.cc:597] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:08:56.367131 16280 raft_consensus.cc:1275] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:08:56.380125 23794 consensus_queue.cc:1048] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:08:56.469841 16912 consensus_peers.cc:597] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:56.512189 16912 consensus_peers.cc:597] T 16a307cee8ef431184c620fec029af19 P 1109f76a0b7b443a84c0327c8707bc63 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:56.539490 16320 consensus_peers.cc:597] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:56.560602 16246 consensus_peers.cc:597] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:56.571853 16320 consensus_peers.cc:597] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:56.627753 16912 consensus_peers.cc:597] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:56.662503 16912 consensus_peers.cc:597] T cad5db410b3444caafa5090b94f02dba P 1109f76a0b7b443a84c0327c8707bc63 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:56.671871 16320 consensus_peers.cc:597] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:56.687865 16320 consensus_peers.cc:597] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:56.697551 16320 consensus_peers.cc:597] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:56.702252 16320 consensus_peers.cc:597] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:56.704453 16912 consensus_peers.cc:597] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:56.743359 16246 consensus_peers.cc:597] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:56.940886 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:45823, user_credentials={real_user=slave}} blocked reactor thread for 43737.1us
W20260709 13:08:56.987457 16320 consensus_peers.cc:597] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:08:57.024905 23785 raft_consensus.cc:493] T 4b962ceebb5c48c1914459ae0c0eff1b P 1109f76a0b7b443a84c0327c8707bc63 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:57.025548 23785 raft_consensus.cc:515] T 4b962ceebb5c48c1914459ae0c0eff1b P 1109f76a0b7b443a84c0327c8707bc63 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:57.028296 23785 leader_election.cc:290] T 4b962ceebb5c48c1914459ae0c0eff1b P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:57.031961 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3" is_pre_election: true
W20260709 13:08:57.045791 15057 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 16229)
I20260709 13:08:57.050426 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:57.051231 16350 raft_consensus.cc:2468] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 17.
I20260709 13:08:57.052878 16914 leader_election.cc:304] T 4b962ceebb5c48c1914459ae0c0eff1b P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:08:57.055119 23806 raft_consensus.cc:2804] T 4b962ceebb5c48c1914459ae0c0eff1b P 1109f76a0b7b443a84c0327c8707bc63 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:57.055652 23806 raft_consensus.cc:493] T 4b962ceebb5c48c1914459ae0c0eff1b P 1109f76a0b7b443a84c0327c8707bc63 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:57.056074 23806 raft_consensus.cc:3060] T 4b962ceebb5c48c1914459ae0c0eff1b P 1109f76a0b7b443a84c0327c8707bc63 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:57.091239 23806 raft_consensus.cc:515] T 4b962ceebb5c48c1914459ae0c0eff1b P 1109f76a0b7b443a84c0327c8707bc63 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:57.093777 23806 leader_election.cc:290] T 4b962ceebb5c48c1914459ae0c0eff1b P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 18 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:08:57.098820 16350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:57.099514 16350 raft_consensus.cc:3060] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:57.105587 23874 raft_consensus.cc:493] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:08:57.106331 23874 raft_consensus.cc:515] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:57.109966 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:57.114297 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0aea40d6e4374085a2e38a70a71f63e3"
I20260709 13:08:57.114485 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b962ceebb5c48c1914459ae0c0eff1b" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:57.116246 16276 raft_consensus.cc:3060] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:08:57.117640 16943 raft_consensus.cc:2368] T 4b962ceebb5c48c1914459ae0c0eff1b P 1109f76a0b7b443a84c0327c8707bc63 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 17. Current term is 18.
I20260709 13:08:57.120066 16248 leader_election.cc:400] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 17 pre-election: Vote denied by peer 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875) with higher term. Message: Invalid argument: T 4b962ceebb5c48c1914459ae0c0eff1b P 1109f76a0b7b443a84c0327c8707bc63 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 17. Current term is 18.
I20260709 13:08:57.120415 16248 leader_election.cc:403] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:57.117441 23874 leader_election.cc:290] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:08:57.143332 16276 raft_consensus.cc:2468] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 18.
I20260709 13:08:57.144744 23832 raft_consensus.cc:2749] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875) with higher term. Message: Invalid argument: T 4b962ceebb5c48c1914459ae0c0eff1b P 1109f76a0b7b443a84c0327c8707bc63 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 for earlier term 17. Current term is 18.
I20260709 13:08:57.153740 16350 raft_consensus.cc:2468] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 18.
I20260709 13:08:57.158850 16914 leader_election.cc:304] T 4b962ceebb5c48c1914459ae0c0eff1b P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: 
I20260709 13:08:57.159803 23785 raft_consensus.cc:2804] T 4b962ceebb5c48c1914459ae0c0eff1b P 1109f76a0b7b443a84c0327c8707bc63 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:57.161468 23785 raft_consensus.cc:697] T 4b962ceebb5c48c1914459ae0c0eff1b P 1109f76a0b7b443a84c0327c8707bc63 [term 18 LEADER]: Becoming Leader. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:08:57.162627 23785 consensus_queue.cc:237] T 4b962ceebb5c48c1914459ae0c0eff1b P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:08:57.142282 16246 consensus_peers.cc:597] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:57.196784 16246 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 54565us
W20260709 13:08:57.202972 16246 consensus_peers.cc:597] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:08:57.211134 16103 catalog_manager.cc:5697] T 4b962ceebb5c48c1914459ae0c0eff1b P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "1109f76a0b7b443a84c0327c8707bc63" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:08:57.212670 16912 consensus_peers.cc:597] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 1109f76a0b7b443a84c0327c8707bc63 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:57.287971 16246 consensus_peers.cc:597] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:57.288702 16246 consensus_peers.cc:597] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:57.389181 16320 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111) [suppressed 457 similar messages]
I20260709 13:08:57.580891 23883 raft_consensus.cc:493] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:08:57.581619 23883 raft_consensus.cc:515] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:08:57.584137 23883 leader_election.cc:290] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:08:57.668475 16320 consensus_peers.cc:597] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:57.671342 16246 consensus_peers.cc:597] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:57.672187 16246 consensus_peers.cc:597] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:08:57.685191 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:08:57.686058 16949 raft_consensus.cc:2468] T abbbc04ca95a4119a7e3fb64073fe61f P 1109f76a0b7b443a84c0327c8707bc63 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 22.
I20260709 13:08:57.700953 16248 leader_election.cc:304] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
W20260709 13:08:57.705628 16912 consensus_peers.cc:597] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:08:57.710661 23884 raft_consensus.cc:2804] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:08:57.711232 23884 raft_consensus.cc:493] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:08:57.711776 23884 raft_consensus.cc:3060] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:57.729970 23884 raft_consensus.cc:515] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:08:57.754477 16320 consensus_peers.cc:597] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:08:57.759976 23884 leader_election.cc:290] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 22 election: Requested vote from peers 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:08:57.761224 16320 consensus_peers.cc:597] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:57.765064 16320 consensus_peers.cc:597] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:08:57.764216 16283 raft_consensus.cc:1275] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:08:57.767737 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:08:57.775328 23771 consensus_queue.cc:1048] T 4b962ceebb5c48c1914459ae0c0eff1b P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:08:57.782472 16949 raft_consensus.cc:2468] T abbbc04ca95a4119a7e3fb64073fe61f P 1109f76a0b7b443a84c0327c8707bc63 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0aea40d6e4374085a2e38a70a71f63e3 in term 22.
I20260709 13:08:57.788193 16248 leader_election.cc:304] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63; no voters: 
I20260709 13:08:57.792405 23884 raft_consensus.cc:2804] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:08:57.792985 23884 raft_consensus.cc:697] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 22 LEADER]: Becoming Leader. State: Replica: 0aea40d6e4374085a2e38a70a71f63e3, State: Running, Role: LEADER
I20260709 13:08:57.793852 23884 consensus_queue.cc:237] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.17, Last appended by leader: 17, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:08:57.806746 16320 consensus_peers.cc:597] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:57.813273 16356 raft_consensus.cc:1275] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:08:57.822815 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:08:57.823685 16354 raft_consensus.cc:2393] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 22: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:08:57.824498 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "0aea40d6e4374085a2e38a70a71f63e3" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:08:57.825317 16353 raft_consensus.cc:2393] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 0aea40d6e4374085a2e38a70a71f63e3 in current term 22: Already voted for candidate 363bb2f744eb486f9ad726f08214c98e in this term.
I20260709 13:08:57.847831 23877 consensus_queue.cc:1048] T 4b962ceebb5c48c1914459ae0c0eff1b P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:57.880355 16103 catalog_manager.cc:5697] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 reported cstate change: term changed from 21 to 22, leader changed from 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68) to 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66). New cstate: current_term: 22 leader_uuid: "0aea40d6e4374085a2e38a70a71f63e3" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:58.033911 16246 consensus_peers.cc:597] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:58.046378 15057 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 16229)
W20260709 13:08:58.117215 16320 consensus_peers.cc:597] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:08:58.358883 16949 raft_consensus.cc:1275] T abbbc04ca95a4119a7e3fb64073fe61f P 1109f76a0b7b443a84c0327c8707bc63 [term 22 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 21 index: 17. Preceding OpId from leader: term: 22 index: 18. (index mismatch)
I20260709 13:08:58.380677 23796 consensus_queue.cc:1048] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
W20260709 13:08:58.417717 16912 consensus_peers.cc:597] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:58.421330 16322 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:36875, user_credentials={real_user=slave}} blocked reactor thread for 46123.4us
W20260709 13:08:58.433629 16137 debug-util.cc:398] Leaking SignalData structure 0x7b0800311380 after lost signal to thread 15060
W20260709 13:08:58.435032 16137 debug-util.cc:398] Leaking SignalData structure 0x7b0800302480 after lost signal to thread 16140
W20260709 13:08:58.436901 16137 debug-util.cc:398] Leaking SignalData structure 0x7b080037a7a0 after lost signal to thread 16307
W20260709 13:08:58.438465 16137 debug-util.cc:398] Leaking SignalData structure 0x7b0800364600 after lost signal to thread 16381
W20260709 13:08:58.439934 16137 debug-util.cc:398] Leaking SignalData structure 0x7b0800267400 after lost signal to thread 16973
W20260709 13:08:58.455540 16320 consensus_peers.cc:597] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:58.486788 16246 consensus_peers.cc:597] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:58.500142 16912 consensus_peers.cc:597] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:58.503141 16912 consensus_peers.cc:597] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:08:58.537767 16353 raft_consensus.cc:1275] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 22 FOLLOWER]: Refusing update from remote peer 0aea40d6e4374085a2e38a70a71f63e3: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 22 index: 18. (index mismatch)
W20260709 13:08:58.562983 16320 consensus_peers.cc:597] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:08:58.569092 23796 consensus_queue.cc:1048] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.001s
W20260709 13:08:58.660061 16912 consensus_peers.cc:597] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:58.667829 16246 consensus_peers.cc:597] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:58.702275 16320 consensus_peers.cc:597] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:58.745409 16320 consensus_peers.cc:597] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:58.750001 16320 consensus_peers.cc:597] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:58.793527 16246 consensus_peers.cc:597] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:58.843004 16912 consensus_peers.cc:597] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:58.882107 16912 consensus_peers.cc:597] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:58.910339 16912 consensus_peers.cc:597] T 16a307cee8ef431184c620fec029af19 P 1109f76a0b7b443a84c0327c8707bc63 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:58.933692 16912 consensus_peers.cc:597] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:58.977136 16320 consensus_peers.cc:597] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:59.047623 15057 thread.cc:527] Waited for 8000ms trying to join with diag-logger (tid 16229)
W20260709 13:08:59.054392 16320 consensus_peers.cc:597] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:59.061921 16320 consensus_peers.cc:597] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:59.075763 16320 consensus_peers.cc:597] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:59.093400 16320 consensus_peers.cc:597] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:59.118580 16320 consensus_peers.cc:597] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:59.168030 16912 consensus_peers.cc:597] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:59.218050 16320 consensus_peers.cc:597] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:59.225883 16246 consensus_peers.cc:597] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:59.244315 16912 consensus_peers.cc:597] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:59.291164 16912 consensus_peers.cc:597] T cad5db410b3444caafa5090b94f02dba P 1109f76a0b7b443a84c0327c8707bc63 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:59.372045 16320 consensus_peers.cc:597] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:59.434227 16320 consensus_peers.cc:597] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:59.497545 16246 consensus_peers.cc:597] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:59.521705 16246 consensus_peers.cc:597] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:59.569887 16246 consensus_peers.cc:597] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:59.700796 16320 consensus_peers.cc:597] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:59.877283 16246 consensus_peers.cc:597] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:59.945339 16912 consensus_peers.cc:597] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 1109f76a0b7b443a84c0327c8707bc63 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:59.959227 16246 consensus_peers.cc:597] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:59.999789 16320 consensus_peers.cc:597] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:00.048125 15057 thread.cc:527] Waited for 9000ms trying to join with diag-logger (tid 16229)
W20260709 13:09:00.083572 16320 consensus_peers.cc:597] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:00.254609 16090 catalog_manager.cc:4755] TS e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 5054b6ad2e4141cab2232a3fecd7c858: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111)
W20260709 13:09:00.317306 16246 consensus_peers.cc:597] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:00.379372 16320 consensus_peers.cc:597] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:00.427876 16246 consensus_peers.cc:597] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:00.457908 16912 consensus_peers.cc:597] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:00.497504 16320 consensus_peers.cc:597] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:00.552798 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 55342.1us
W20260709 13:09:00.641351 16320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46073, user_credentials={real_user=slave}} blocked reactor thread for 78458.9us
W20260709 13:09:00.716907 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 66135.1us
W20260709 13:09:00.781250 16320 consensus_peers.cc:597] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:00.793905 16246 consensus_peers.cc:597] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:00.871369 16320 consensus_peers.cc:597] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:00.892256 16248 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 66803.2us
W20260709 13:09:00.915150 16320 consensus_peers.cc:597] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:00.965924 16320 consensus_peers.cc:597] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:09:01.014309 15057 tablet_server.cc:196] TabletServer@127.14.180.65:0 shutdown complete.
W20260709 13:09:01.040380 16912 consensus_peers.cc:597] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:01.055511 16246 consensus_peers.cc:597] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:01.178174 16912 consensus_peers.cc:597] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:09:01.233120 15057 tablet_server.cc:179] TabletServer@127.14.180.66:0 shutting down...
W20260709 13:09:01.265728 16914 consensus_peers.cc:597] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 -> Peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Couldn't send request to peer 0aea40d6e4374085a2e38a70a71f63e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:01.266441 16912 consensus_peers.cc:597] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:01.286656 16914 consensus_peers.cc:597] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 -> Peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Couldn't send request to peer 0aea40d6e4374085a2e38a70a71f63e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:01.312047 16914 consensus_peers.cc:597] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 1109f76a0b7b443a84c0327c8707bc63 -> Peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Couldn't send request to peer 0aea40d6e4374085a2e38a70a71f63e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:01.322616 16322 consensus_peers.cc:597] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e -> Peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Couldn't send request to peer 0aea40d6e4374085a2e38a70a71f63e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:01.332747 16320 consensus_peers.cc:597] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:01.334291 16320 consensus_peers.cc:597] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:01.325429 16322 consensus_peers.cc:597] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e -> Peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Couldn't send request to peer 0aea40d6e4374085a2e38a70a71f63e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:01.345605 16914 consensus_peers.cc:597] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 -> Peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Couldn't send request to peer 0aea40d6e4374085a2e38a70a71f63e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:01.346707 16322 consensus_peers.cc:597] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e -> Peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Couldn't send request to peer 0aea40d6e4374085a2e38a70a71f63e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:01.356933 16322 consensus_peers.cc:597] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e -> Peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Couldn't send request to peer 0aea40d6e4374085a2e38a70a71f63e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:01.359949 16912 consensus_peers.cc:597] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:01.361766 16914 consensus_peers.cc:597] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 -> Peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Couldn't send request to peer 0aea40d6e4374085a2e38a70a71f63e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:01.368219 16320 consensus_peers.cc:597] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:01.367080 16322 consensus_peers.cc:597] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e -> Peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Couldn't send request to peer 0aea40d6e4374085a2e38a70a71f63e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:01.372910 16320 consensus_peers.cc:597] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:01.377815 16246 consensus_peers.cc:597] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:01.382042 16914 consensus_peers.cc:597] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 -> Peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Couldn't send request to peer 0aea40d6e4374085a2e38a70a71f63e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:01.422894 16246 consensus_peers.cc:597] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:01.438695 16912 consensus_peers.cc:597] T 16a307cee8ef431184c620fec029af19 P 1109f76a0b7b443a84c0327c8707bc63 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:01.443972 16914 consensus_peers.cc:597] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 -> Peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Couldn't send request to peer 0aea40d6e4374085a2e38a70a71f63e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:01.452075 16914 consensus_peers.cc:597] T 4b962ceebb5c48c1914459ae0c0eff1b P 1109f76a0b7b443a84c0327c8707bc63 -> Peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Couldn't send request to peer 0aea40d6e4374085a2e38a70a71f63e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:01.448364 16322 consensus_peers.cc:597] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e -> Peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Couldn't send request to peer 0aea40d6e4374085a2e38a70a71f63e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:01.472005 16912 consensus_peers.cc:597] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:01.486124 16322 consensus_peers.cc:597] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e -> Peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Couldn't send request to peer 0aea40d6e4374085a2e38a70a71f63e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:01.499540 16912 consensus_peers.cc:597] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:01.501245 16322 consensus_peers.cc:597] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e -> Peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Couldn't send request to peer 0aea40d6e4374085a2e38a70a71f63e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:01.502005 16322 consensus_peers.cc:597] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e -> Peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Couldn't send request to peer 0aea40d6e4374085a2e38a70a71f63e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:01.520967 15057 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:09:01.522765 16914 consensus_peers.cc:597] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 -> Peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Couldn't send request to peer 0aea40d6e4374085a2e38a70a71f63e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:01.524324 15057 tablet_replica.cc:333] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3: stopping tablet replica
W20260709 13:09:01.533932 16914 consensus_peers.cc:597] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 -> Peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Couldn't send request to peer 0aea40d6e4374085a2e38a70a71f63e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:01.535804 15057 raft_consensus.cc:2243] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:09:01.537362 15057 raft_consensus.cc:2272] T abbbc04ca95a4119a7e3fb64073fe61f P 0aea40d6e4374085a2e38a70a71f63e3 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.540385 15057 tablet_replica.cc:333] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3: stopping tablet replica
I20260709 13:09:01.541384 15057 raft_consensus.cc:2243] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:01.542035 15057 raft_consensus.cc:2272] T 18b8d2f02b16479aaf7ec42190a4197f P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.544801 15057 tablet_replica.cc:333] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3: stopping tablet replica
I20260709 13:09:01.545702 15057 raft_consensus.cc:2243] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Raft consensus shutting down.
W20260709 13:09:01.549125 16320 consensus_peers.cc:597] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:09:01.559432 15057 raft_consensus.cc:2272] T c24b4a916c7f491da5d7f9b92db71ece P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:01.560091 16912 consensus_peers.cc:597] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:09:01.563625 15057 tablet_replica.cc:333] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3: stopping tablet replica
I20260709 13:09:01.569375 15057 raft_consensus.cc:2243] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:09:01.570797 15057 raft_consensus.cc:2272] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:01.574913 16914 consensus_peers.cc:597] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 -> Peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Couldn't send request to peer 0aea40d6e4374085a2e38a70a71f63e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:01.576361 15057 tablet_replica.cc:333] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3: stopping tablet replica
W20260709 13:09:01.582255 16322 consensus_peers.cc:597] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e -> Peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Couldn't send request to peer 0aea40d6e4374085a2e38a70a71f63e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:01.588822 16322 consensus_peers.cc:597] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e -> Peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Couldn't send request to peer 0aea40d6e4374085a2e38a70a71f63e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:01.589613 16322 consensus_peers.cc:597] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e -> Peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Couldn't send request to peer 0aea40d6e4374085a2e38a70a71f63e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:01.592175 15057 raft_consensus.cc:2243] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:01.596571 15057 raft_consensus.cc:2272] T 42944699e5b24681aa3b54ef1010699d P 0aea40d6e4374085a2e38a70a71f63e3 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.599341 15057 tablet_replica.cc:333] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3: stopping tablet replica
I20260709 13:09:01.600136 15057 raft_consensus.cc:2243] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:01.600811 15057 raft_consensus.cc:2272] T b2275272882d4313a1ce1a8632a5819c P 0aea40d6e4374085a2e38a70a71f63e3 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.603730 15057 tablet_replica.cc:333] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3: stopping tablet replica
I20260709 13:09:01.608732 15057 raft_consensus.cc:2243] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:01.609543 15057 raft_consensus.cc:2272] T 47342899f1ed4c788d60ea4c5b52969a P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.619203 15057 tablet_replica.cc:333] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3: stopping tablet replica
I20260709 13:09:01.622382 15057 raft_consensus.cc:2243] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:01.624302 15057 raft_consensus.cc:2272] T 6759dbf6a6924fcc870cb52b4a5d7953 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:01.633522 16912 consensus_peers.cc:597] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:01.637401 16914 consensus_peers.cc:597] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 -> Peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Couldn't send request to peer 0aea40d6e4374085a2e38a70a71f63e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:01.639555 15057 tablet_replica.cc:333] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3: stopping tablet replica
I20260709 13:09:01.643987 15057 raft_consensus.cc:2243] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:01.656261 15057 raft_consensus.cc:2272] T 862e96f5785248c58d0355cac229fc05 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:01.649469 16320 consensus_peers.cc:597] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:09:01.664831 15057 tablet_replica.cc:333] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3: stopping tablet replica
W20260709 13:09:01.661000 16914 consensus_peers.cc:597] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 -> Peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Couldn't send request to peer 0aea40d6e4374085a2e38a70a71f63e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:01.665130 16320 consensus_peers.cc:597] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:01.648175 16322 consensus_peers.cc:597] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e -> Peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Couldn't send request to peer 0aea40d6e4374085a2e38a70a71f63e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:01.677062 15057 raft_consensus.cc:2243] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:09:01.684212 15057 raft_consensus.cc:2272] T 8cabbc283ea543459d45ebdb8b6add94 P 0aea40d6e4374085a2e38a70a71f63e3 [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:01.689201 16322 consensus_peers.cc:597] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e -> Peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Couldn't send request to peer 0aea40d6e4374085a2e38a70a71f63e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:01.690037 16322 consensus_peers.cc:597] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e -> Peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Couldn't send request to peer 0aea40d6e4374085a2e38a70a71f63e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:01.697331 16322 consensus_peers.cc:597] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e -> Peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Couldn't send request to peer 0aea40d6e4374085a2e38a70a71f63e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:01.698478 15057 tablet_replica.cc:333] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3: stopping tablet replica
I20260709 13:09:01.718926 15057 raft_consensus.cc:2243] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:01.731719 15057 raft_consensus.cc:2272] T b241405f79a345849ba216394fcb999a P 0aea40d6e4374085a2e38a70a71f63e3 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.755633 15057 tablet_replica.cc:333] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3: stopping tablet replica
I20260709 13:09:01.756867 15057 raft_consensus.cc:2243] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:09:01.758090 15057 raft_consensus.cc:2272] T 176e2f21e86a4e54a8d9a21aef8a272f P 0aea40d6e4374085a2e38a70a71f63e3 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:01.764351 16320 consensus_peers.cc:597] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:01.773290 16320 consensus_peers.cc:597] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:09:01.761585 15057 tablet_replica.cc:333] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3: stopping tablet replica
W20260709 13:09:01.779683 16320 consensus_peers.cc:597] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:09:01.781203 15057 raft_consensus.cc:2243] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:09:01.782831 15057 raft_consensus.cc:2272] T 98afc5914978455ba8cc5329152a3f1d P 0aea40d6e4374085a2e38a70a71f63e3 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.785979 15057 tablet_replica.cc:333] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3: stopping tablet replica
I20260709 13:09:01.795120 15057 raft_consensus.cc:2243] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:09:01.801208 15057 raft_consensus.cc:2272] T 143d3d1339b44b6dbdf204507b6af74b P 0aea40d6e4374085a2e38a70a71f63e3 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.805670 15057 tablet_replica.cc:333] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3: stopping tablet replica
I20260709 13:09:01.806658 15057 raft_consensus.cc:2243] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:01.811305 15057 raft_consensus.cc:2272] T 7295dce0baa440b8a197da845581ee81 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.814350 15057 tablet_replica.cc:333] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3: stopping tablet replica
I20260709 13:09:01.829294 15057 raft_consensus.cc:2243] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:01.830932 15057 raft_consensus.cc:2272] T 5054b6ad2e4141cab2232a3fecd7c858 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:01.844698 16320 consensus_peers.cc:597] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:09:01.847182 15057 tablet_replica.cc:333] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3: stopping tablet replica
I20260709 13:09:01.851315 15057 raft_consensus.cc:2243] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:01.852289 15057 raft_consensus.cc:2272] T f022e2e63ae4461d834e476ff2666991 P 0aea40d6e4374085a2e38a70a71f63e3 [term 10 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:01.863828 16912 consensus_peers.cc:597] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:09:01.882961 15057 tablet_replica.cc:333] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3: stopping tablet replica
I20260709 13:09:01.884035 15057 raft_consensus.cc:2243] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:01.884871 15057 raft_consensus.cc:2272] T c7d554054f014c74992a2a66ff6873cd P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.892762 15057 tablet_replica.cc:333] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3: stopping tablet replica
I20260709 13:09:01.893730 15057 raft_consensus.cc:2243] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:09:01.894804 15057 raft_consensus.cc:2272] T ab124ef29c71409d9c14a75a054095e1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.897962 15057 tablet_replica.cc:333] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3: stopping tablet replica
I20260709 13:09:01.898878 15057 raft_consensus.cc:2243] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:01.899912 15057 raft_consensus.cc:2272] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.902930 15057 tablet_replica.cc:333] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3: stopping tablet replica
I20260709 13:09:01.903877 15057 raft_consensus.cc:2243] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:09:01.905098 15057 raft_consensus.cc:2272] T bb3b9c4ba1f147fc8d9858234bfce423 P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.908082 15057 tablet_replica.cc:333] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3: stopping tablet replica
I20260709 13:09:01.908954 15057 raft_consensus.cc:2243] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:09:01.910262 15057 raft_consensus.cc:2272] T 13bc3c8ff9b84838a2664335d7e1582b P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:01.913710 16914 consensus_peers.cc:597] T 16a307cee8ef431184c620fec029af19 P 1109f76a0b7b443a84c0327c8707bc63 -> Peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Couldn't send request to peer 0aea40d6e4374085a2e38a70a71f63e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:01.917836 15057 tablet_replica.cc:333] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3: stopping tablet replica
I20260709 13:09:01.918840 15057 raft_consensus.cc:2243] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:01.919866 15057 raft_consensus.cc:2272] T eeda5ee833164deb9ec027b22371793c P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.922811 15057 tablet_replica.cc:333] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3: stopping tablet replica
I20260709 13:09:01.925876 15057 raft_consensus.cc:2243] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:01.926573 15057 raft_consensus.cc:2272] T aee913c41fb9437587affa768953f637 P 0aea40d6e4374085a2e38a70a71f63e3 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.929281 15057 tablet_replica.cc:333] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3: stopping tablet replica
I20260709 13:09:01.930217 15057 raft_consensus.cc:2243] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:01.930898 15057 raft_consensus.cc:2272] T a7ce522fbeb44228a8c05d5ceeadc347 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.933667 15057 tablet_replica.cc:333] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3: stopping tablet replica
I20260709 13:09:01.934574 15057 raft_consensus.cc:2243] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:01.935438 15057 raft_consensus.cc:2272] T 16a307cee8ef431184c620fec029af19 P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.938174 15057 tablet_replica.cc:333] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3: stopping tablet replica
I20260709 13:09:01.939160 15057 raft_consensus.cc:2243] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:01.939867 15057 raft_consensus.cc:2272] T 4b962ceebb5c48c1914459ae0c0eff1b P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.950450 15057 tablet_replica.cc:333] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3: stopping tablet replica
I20260709 13:09:01.951471 15057 raft_consensus.cc:2243] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:01.952170 15057 raft_consensus.cc:2272] T bc427ac4cc014a9c99e5731814bff30a P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.955093 15057 tablet_replica.cc:333] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3: stopping tablet replica
I20260709 13:09:01.955927 15057 raft_consensus.cc:2243] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:09:01.957119 15057 raft_consensus.cc:2272] T c824093f8d374c1b9f3c8a6e8e711157 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.960129 15057 tablet_replica.cc:333] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3: stopping tablet replica
I20260709 13:09:01.961015 15057 raft_consensus.cc:2243] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:01.961781 15057 raft_consensus.cc:2272] T 40719878febd41f9b57c9a6992d4431b P 0aea40d6e4374085a2e38a70a71f63e3 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.965718 15057 tablet_replica.cc:333] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3: stopping tablet replica
I20260709 13:09:01.966694 15057 raft_consensus.cc:2243] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:01.967643 15057 raft_consensus.cc:2272] T 39dd6382a0304387a1341bcc36471cbf P 0aea40d6e4374085a2e38a70a71f63e3 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.970814 15057 tablet_replica.cc:333] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3: stopping tablet replica
I20260709 13:09:01.971689 15057 raft_consensus.cc:2243] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:09:01.972770 15057 raft_consensus.cc:2272] T 454d01f56c2d4533a035fdbc026c10b3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:01.974754 16246 consensus_peers.cc:597] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:09:01.975690 15057 tablet_replica.cc:333] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3: stopping tablet replica
I20260709 13:09:01.976595 15057 raft_consensus.cc:2243] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:09:01.977758 15057 raft_consensus.cc:2272] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.980720 15057 tablet_replica.cc:333] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3: stopping tablet replica
I20260709 13:09:01.981588 15057 raft_consensus.cc:2243] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:09:01.982867 15057 raft_consensus.cc:2272] T 5063fcda38c2468a8dad5d01023b700a P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.985834 15057 tablet_replica.cc:333] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3: stopping tablet replica
I20260709 13:09:01.986933 15057 raft_consensus.cc:2243] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:09:01.988183 15057 raft_consensus.cc:2272] T 73757c6fea8949e090aa4e55902a41d4 P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.990988 15057 tablet_replica.cc:333] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3: stopping tablet replica
I20260709 13:09:01.991878 15057 raft_consensus.cc:2243] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:01.992548 15057 raft_consensus.cc:2272] T 8b615ac918a749989f2968826926adf3 P 0aea40d6e4374085a2e38a70a71f63e3 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:01.995615 15057 tablet_replica.cc:333] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3: stopping tablet replica
I20260709 13:09:01.996537 15057 raft_consensus.cc:2243] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:01.997301 15057 raft_consensus.cc:2272] T 7877d879c7564adfac82b8387dbbc867 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:02.024286 15057 tablet_replica.cc:333] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3: stopping tablet replica
I20260709 13:09:02.029937 15057 raft_consensus.cc:2243] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:02.030715 15057 raft_consensus.cc:2272] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 0aea40d6e4374085a2e38a70a71f63e3 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:02.033553 15057 tablet_replica.cc:333] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3: stopping tablet replica
I20260709 13:09:02.034435 15057 raft_consensus.cc:2243] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:02.035379 15057 raft_consensus.cc:2272] T a1a76ba8ceae4d0780583a09087cec0a P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:02.038595 15057 tablet_replica.cc:333] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3: stopping tablet replica
I20260709 13:09:02.039506 15057 raft_consensus.cc:2243] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:02.040210 15057 raft_consensus.cc:2272] T 888479daeaaa4744a161f6b45bb257f6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:02.042910 15057 tablet_replica.cc:333] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3: stopping tablet replica
I20260709 13:09:02.043777 15057 raft_consensus.cc:2243] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:02.044517 15057 raft_consensus.cc:2272] T b9e1324823f04d8da5a4b3ddbd061c0e P 0aea40d6e4374085a2e38a70a71f63e3 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:02.047859 15057 tablet_replica.cc:333] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3: stopping tablet replica
I20260709 13:09:02.048801 15057 raft_consensus.cc:2243] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:02.049623 15057 raft_consensus.cc:2272] T 4f72b5892c874917882ef9ee926ce439 P 0aea40d6e4374085a2e38a70a71f63e3 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:02.052788 15057 tablet_replica.cc:333] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3: stopping tablet replica
I20260709 13:09:02.053725 15057 raft_consensus.cc:2243] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:02.054489 15057 raft_consensus.cc:2272] T 9dbc1db111e7466090abdb97a79d0d9b P 0aea40d6e4374085a2e38a70a71f63e3 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:02.057883 15057 tablet_replica.cc:333] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3: stopping tablet replica
I20260709 13:09:02.058820 15057 raft_consensus.cc:2243] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:02.059765 15057 raft_consensus.cc:2272] T d9c15d8e9be8414c84912ab77b66bfb1 P 0aea40d6e4374085a2e38a70a71f63e3 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:02.062683 15057 tablet_replica.cc:333] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3: stopping tablet replica
I20260709 13:09:02.066236 15057 raft_consensus.cc:2243] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:09:02.069800 15057 raft_consensus.cc:2272] T 552b1776c27a48c194068de522fa45b6 P 0aea40d6e4374085a2e38a70a71f63e3 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:02.072973 15057 tablet_replica.cc:333] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3: stopping tablet replica
I20260709 13:09:02.073817 15057 raft_consensus.cc:2243] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:09:02.075302 15057 raft_consensus.cc:2272] T a054979193cb43dcba8c8eb72cd7f05d P 0aea40d6e4374085a2e38a70a71f63e3 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:02.084000 15057 tablet_replica.cc:333] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3: stopping tablet replica
I20260709 13:09:02.084776 15057 raft_consensus.cc:2243] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:09:02.085966 15057 raft_consensus.cc:2272] T 26565509c81343bc818483042146461a P 0aea40d6e4374085a2e38a70a71f63e3 [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:02.088212 16912 consensus_peers.cc:597] T cad5db410b3444caafa5090b94f02dba P 1109f76a0b7b443a84c0327c8707bc63 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:09:02.209723 16320 consensus_peers.cc:597] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:02.235294 16320 consensus_peers.cc:597] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:02.305656 16912 consensus_peers.cc:597] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 1109f76a0b7b443a84c0327c8707bc63 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:02.394322 16914 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.14.180.66:45823: connect: Connection refused (error 111) [suppressed 513 similar messages]
W20260709 13:09:02.401852 16320 consensus_peers.cc:597] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:09:02.695235 23932 raft_consensus.cc:493] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:09:02.717926 23932 raft_consensus.cc:515] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:09:02.721884 23932 leader_election.cc:290] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:09:02.731763 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
W20260709 13:09:02.748699 16322 leader_election.cc:336] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Network error: Client connection negotiation failed: client connection to 127.14.180.66:45823: connect: Connection refused (error 111)
I20260709 13:09:02.749429 16322 leader_election.cc:304] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:09:02.750506 23911 raft_consensus.cc:2749] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:09:02.771628 23928 raft_consensus.cc:493] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:09:02.772677 23928 raft_consensus.cc:515] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:09:02.779142 23935 raft_consensus.cc:493] T abbbc04ca95a4119a7e3fb64073fe61f P 1109f76a0b7b443a84c0327c8707bc63 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:09:02.780121 23935 raft_consensus.cc:515] T abbbc04ca95a4119a7e3fb64073fe61f P 1109f76a0b7b443a84c0327c8707bc63 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:09:02.781296 16322 leader_election.cc:336] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Network error: Client connection negotiation failed: client connection to 127.14.180.66:45823: connect: Connection refused (error 111)
I20260709 13:09:02.782138 23928 leader_election.cc:290] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:09:02.782867 23935 leader_election.cc:290] T abbbc04ca95a4119a7e3fb64073fe61f P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:09:02.809401 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:09:02.810256 16356 raft_consensus.cc:2468] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 22.
W20260709 13:09:02.811969 16914 leader_election.cc:336] T abbbc04ca95a4119a7e3fb64073fe61f P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Network error: Client connection negotiation failed: client connection to 127.14.180.66:45823: connect: Connection refused (error 111)
I20260709 13:09:02.818871 23928 raft_consensus.cc:493] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:09:02.823161 23928 raft_consensus.cc:515] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:09:02.825776 23928 leader_election.cc:290] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:09:02.821211 16320 leader_election.cc:336] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111)
I20260709 13:09:02.828064 16914 leader_election.cc:304] T abbbc04ca95a4119a7e3fb64073fe61f P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:09:02.831561 16320 leader_election.cc:304] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:09:02.837941 23935 raft_consensus.cc:2804] T abbbc04ca95a4119a7e3fb64073fe61f P 1109f76a0b7b443a84c0327c8707bc63 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:09:02.838518 23935 raft_consensus.cc:493] T abbbc04ca95a4119a7e3fb64073fe61f P 1109f76a0b7b443a84c0327c8707bc63 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:09:02.839015 23935 raft_consensus.cc:3060] T abbbc04ca95a4119a7e3fb64073fe61f P 1109f76a0b7b443a84c0327c8707bc63 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:09:02.841073 23928 raft_consensus.cc:2749] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:09:02.832171 16322 leader_election.cc:336] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Network error: Client connection negotiation failed: client connection to 127.14.180.66:45823: connect: Connection refused (error 111)
W20260709 13:09:02.852568 16320 leader_election.cc:336] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111)
I20260709 13:09:02.853675 16320 leader_election.cc:304] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:09:02.855365 23911 raft_consensus.cc:2749] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:09:02.856731 23917 raft_consensus.cc:493] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:09:02.857812 23917 raft_consensus.cc:515] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:09:02.860554 23917 leader_election.cc:290] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:09:02.878818 16322 leader_election.cc:336] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Network error: Client connection negotiation failed: client connection to 127.14.180.66:45823: connect: Connection refused (error 111)
I20260709 13:09:02.906988 23935 raft_consensus.cc:515] T abbbc04ca95a4119a7e3fb64073fe61f P 1109f76a0b7b443a84c0327c8707bc63 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:09:02.911950 23935 leader_election.cc:290] T abbbc04ca95a4119a7e3fb64073fe61f P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 23 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:09:02.925977 16320 leader_election.cc:336] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111)
I20260709 13:09:02.933977 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbbc04ca95a4119a7e3fb64073fe61f" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:09:02.934675 16356 raft_consensus.cc:3060] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:09:02.943878 16320 leader_election.cc:304] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:09:02.946734 16356 raft_consensus.cc:2468] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 23.
I20260709 13:09:02.947722 23911 raft_consensus.cc:2749] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:09:02.948506 16320 consensus_peers.cc:597] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:02.960552 16914 leader_election.cc:336] T abbbc04ca95a4119a7e3fb64073fe61f P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Network error: Client connection negotiation failed: client connection to 127.14.180.66:45823: connect: Connection refused (error 111)
I20260709 13:09:02.966740 16914 leader_election.cc:304] T abbbc04ca95a4119a7e3fb64073fe61f P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:09:02.973910 23935 raft_consensus.cc:2804] T abbbc04ca95a4119a7e3fb64073fe61f P 1109f76a0b7b443a84c0327c8707bc63 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:09:02.974535 23935 raft_consensus.cc:697] T abbbc04ca95a4119a7e3fb64073fe61f P 1109f76a0b7b443a84c0327c8707bc63 [term 23 LEADER]: Becoming Leader. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:09:02.976295 23935 consensus_queue.cc:237] T abbbc04ca95a4119a7e3fb64073fe61f P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 22.18, Last appended by leader: 18, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:09:03.029736 16104 catalog_manager.cc:5697] T abbbc04ca95a4119a7e3fb64073fe61f P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: term changed from 22 to 23, leader changed from 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) to 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68). New cstate: current_term: 23 leader_uuid: "1109f76a0b7b443a84c0327c8707bc63" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:09:03.051146 16320 consensus_peers.cc:597] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:09:03.054979 23934 raft_consensus.cc:493] T 13bc3c8ff9b84838a2664335d7e1582b P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
W20260709 13:09:03.053607 16320 consensus_peers.cc:597] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:09:03.057811 23935 raft_consensus.cc:493] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:09:03.055944 23934 raft_consensus.cc:515] T 13bc3c8ff9b84838a2664335d7e1582b P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:09:03.058715 23935 raft_consensus.cc:515] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:09:03.062753 23934 leader_election.cc:290] T 13bc3c8ff9b84838a2664335d7e1582b P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:09:03.065126 23935 leader_election.cc:290] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:09:03.069446 16914 leader_election.cc:336] T 13bc3c8ff9b84838a2664335d7e1582b P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Network error: Client connection negotiation failed: client connection to 127.14.180.66:45823: connect: Connection refused (error 111)
W20260709 13:09:03.069598 16320 consensus_peers.cc:597] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:03.070209 16914 leader_election.cc:336] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Network error: Client connection negotiation failed: client connection to 127.14.180.66:45823: connect: Connection refused (error 111)
W20260709 13:09:03.089047 16912 leader_election.cc:336] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111)
I20260709 13:09:03.089661 16912 leader_election.cc:304] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:09:03.091112 23934 raft_consensus.cc:2749] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:09:03.091318 16912 leader_election.cc:336] T 13bc3c8ff9b84838a2664335d7e1582b P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111)
I20260709 13:09:03.091822 16912 leader_election.cc:304] T 13bc3c8ff9b84838a2664335d7e1582b P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:09:03.092628 23934 raft_consensus.cc:2749] T 13bc3c8ff9b84838a2664335d7e1582b P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:03.117906 23917 raft_consensus.cc:493] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:09:03.119012 23917 raft_consensus.cc:515] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:09:03.120736 23911 raft_consensus.cc:493] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:09:03.121505 23911 raft_consensus.cc:515] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
I20260709 13:09:03.125977 23911 leader_election.cc:290] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:09:03.127951 23934 raft_consensus.cc:493] T 8cabbc283ea543459d45ebdb8b6add94 P 1109f76a0b7b443a84c0327c8707bc63 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:09:03.129091 23934 raft_consensus.cc:515] T 8cabbc283ea543459d45ebdb8b6add94 P 1109f76a0b7b443a84c0327c8707bc63 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:09:03.131894 23934 leader_election.cc:290] T 8cabbc283ea543459d45ebdb8b6add94 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:09:03.132828 23917 leader_election.cc:290] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:09:03.137048 16320 leader_election.cc:336] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111)
W20260709 13:09:03.140961 16322 leader_election.cc:336] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Network error: Client connection negotiation failed: client connection to 127.14.180.66:45823: connect: Connection refused (error 111)
W20260709 13:09:03.142740 16320 leader_election.cc:336] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111)
I20260709 13:09:03.142230 16322 leader_election.cc:304] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:09:03.144253 23917 raft_consensus.cc:2749] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:09:03.144217 16914 leader_election.cc:336] T 8cabbc283ea543459d45ebdb8b6add94 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Network error: Client connection negotiation failed: client connection to 127.14.180.66:45823: connect: Connection refused (error 111)
I20260709 13:09:03.145243 23934 raft_consensus.cc:493] T ab124ef29c71409d9c14a75a054095e1 P 1109f76a0b7b443a84c0327c8707bc63 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:09:03.145991 23934 raft_consensus.cc:515] T ab124ef29c71409d9c14a75a054095e1 P 1109f76a0b7b443a84c0327c8707bc63 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:09:03.147399 15057 tablet_server.cc:196] TabletServer@127.14.180.66:0 shutdown complete.
W20260709 13:09:03.148486 16322 leader_election.cc:336] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Network error: Client connection negotiation failed: client connection to 127.14.180.66:45823: connect: Connection refused (error 111)
I20260709 13:09:03.153957 16322 leader_election.cc:304] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:09:03.146991 16912 leader_election.cc:336] T 8cabbc283ea543459d45ebdb8b6add94 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111)
I20260709 13:09:03.157781 23917 raft_consensus.cc:2749] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:09:03.158572 16914 leader_election.cc:336] T ab124ef29c71409d9c14a75a054095e1 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Network error: Client connection negotiation failed: client connection to 127.14.180.66:45823: connect: Connection refused (error 111)
I20260709 13:09:03.159341 16912 leader_election.cc:304] T 8cabbc283ea543459d45ebdb8b6add94 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:09:03.160275 23935 raft_consensus.cc:2749] T 8cabbc283ea543459d45ebdb8b6add94 P 1109f76a0b7b443a84c0327c8707bc63 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:09:03.156599 23934 leader_election.cc:290] T ab124ef29c71409d9c14a75a054095e1 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:09:03.175521 23917 raft_consensus.cc:493] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:09:03.181190 23917 raft_consensus.cc:515] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:09:03.183280 16912 leader_election.cc:336] T ab124ef29c71409d9c14a75a054095e1 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111)
I20260709 13:09:03.183872 16912 leader_election.cc:304] T ab124ef29c71409d9c14a75a054095e1 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:09:03.184705 23935 raft_consensus.cc:2749] T ab124ef29c71409d9c14a75a054095e1 P 1109f76a0b7b443a84c0327c8707bc63 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:09:03.185499 23917 leader_election.cc:290] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:09:03.190194 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
W20260709 13:09:03.196699 16322 leader_election.cc:336] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Network error: Client connection negotiation failed: client connection to 127.14.180.66:45823: connect: Connection refused (error 111)
I20260709 13:09:03.200160 16322 leader_election.cc:304] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:09:03.206759 23917 raft_consensus.cc:2749] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:09:03.201256 16912 consensus_peers.cc:597] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:09:03.226266 23911 raft_consensus.cc:493] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:09:03.226811 23934 raft_consensus.cc:493] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:09:03.227070 23911 raft_consensus.cc:515] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:09:03.227567 23934 raft_consensus.cc:515] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:09:03.229400 23911 leader_election.cc:290] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:09:03.229864 23934 leader_election.cc:290] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:09:03.235327 23933 raft_consensus.cc:493] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:09:03.235996 23933 raft_consensus.cc:515] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:09:03.236505 16320 consensus_peers.cc:597] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:09:03.236510 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:09:03.237708 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:09:03.242681 16322 leader_election.cc:336] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Network error: Client connection negotiation failed: client connection to 127.14.180.66:45823: connect: Connection refused (error 111)
I20260709 13:09:03.243150 16322 leader_election.cc:304] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:09:03.243891 23917 raft_consensus.cc:2749] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:09:03.249697 23917 raft_consensus.cc:493] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:09:03.250064 23933 leader_election.cc:290] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:09:03.250440 23917 raft_consensus.cc:515] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:09:03.258143 16914 leader_election.cc:336] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Network error: Client connection negotiation failed: client connection to 127.14.180.66:45823: connect: Connection refused (error 111)
I20260709 13:09:03.261292 16914 leader_election.cc:304] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
W20260709 13:09:03.260715 16912 leader_election.cc:336] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111)
W20260709 13:09:03.262511 16322 leader_election.cc:336] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Network error: Client connection negotiation failed: client connection to 127.14.180.66:45823: connect: Connection refused (error 111)
I20260709 13:09:03.262579 23934 raft_consensus.cc:2749] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:03.266084 23933 raft_consensus.cc:493] T a054979193cb43dcba8c8eb72cd7f05d P 1109f76a0b7b443a84c0327c8707bc63 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
W20260709 13:09:03.267166 16914 leader_election.cc:336] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Network error: Client connection negotiation failed: client connection to 127.14.180.66:45823: connect: Connection refused (error 111)
I20260709 13:09:03.269806 16914 leader_election.cc:304] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:09:03.269649 23933 raft_consensus.cc:515] T a054979193cb43dcba8c8eb72cd7f05d P 1109f76a0b7b443a84c0327c8707bc63 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:09:03.271670 23935 raft_consensus.cc:2749] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:09:03.272379 23935 raft_consensus.cc:493] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:09:03.272940 23935 raft_consensus.cc:515] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:09:03.273304 23933 leader_election.cc:290] T a054979193cb43dcba8c8eb72cd7f05d P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:09:03.275151 23935 leader_election.cc:290] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:09:03.276216 23917 leader_election.cc:290] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:09:03.283676 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:09:03.284403 16943 raft_consensus.cc:2468] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 19.
W20260709 13:09:03.284106 16912 leader_election.cc:336] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111)
I20260709 13:09:03.285874 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:09:03.286592 16356 raft_consensus.cc:2468] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 22.
I20260709 13:09:03.295753 16322 leader_election.cc:304] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:09:03.297195 23911 raft_consensus.cc:2804] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:09:03.297619 23911 raft_consensus.cc:493] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:09:03.297994 23911 raft_consensus.cc:3060] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:09:03.312279 16914 leader_election.cc:304] T a054979193cb43dcba8c8eb72cd7f05d P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: 
W20260709 13:09:03.313850 16320 consensus_peers.cc:597] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:09:03.315968 23911 raft_consensus.cc:515] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:09:03.320124 23935 raft_consensus.cc:2804] T a054979193cb43dcba8c8eb72cd7f05d P 1109f76a0b7b443a84c0327c8707bc63 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:09:03.320623 23935 raft_consensus.cc:493] T a054979193cb43dcba8c8eb72cd7f05d P 1109f76a0b7b443a84c0327c8707bc63 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:09:03.321014 23935 raft_consensus.cc:3060] T a054979193cb43dcba8c8eb72cd7f05d P 1109f76a0b7b443a84c0327c8707bc63 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:09:03.329313 23935 raft_consensus.cc:515] T a054979193cb43dcba8c8eb72cd7f05d P 1109f76a0b7b443a84c0327c8707bc63 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:09:03.330500 23917 raft_consensus.cc:493] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:09:03.336652 23917 raft_consensus.cc:515] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:09:03.337924 23935 leader_election.cc:290] T a054979193cb43dcba8c8eb72cd7f05d P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 23 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:09:03.339093 23917 leader_election.cc:290] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:09:03.341499 16943 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb3b9c4ba1f147fc8d9858234bfce423" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63"
I20260709 13:09:03.342379 16943 raft_consensus.cc:3060] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:09:03.345894 16914 leader_election.cc:336] T a054979193cb43dcba8c8eb72cd7f05d P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Network error: Client connection negotiation failed: client connection to 127.14.180.66:45823: connect: Connection refused (error 111)
I20260709 13:09:03.346359 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:09:03.357079 23917 raft_consensus.cc:493] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
W20260709 13:09:03.357538 16914 leader_election.cc:336] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Network error: Client connection negotiation failed: client connection to 127.14.180.66:45823: connect: Connection refused (error 111)
I20260709 13:09:03.358033 16914 leader_election.cc:304] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:09:03.351269 23934 raft_consensus.cc:493] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:09:03.357761 23917 raft_consensus.cc:515] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:09:03.354784 16322 leader_election.cc:336] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Network error: Client connection negotiation failed: client connection to 127.14.180.66:45823: connect: Connection refused (error 111)
I20260709 13:09:03.358844 23934 raft_consensus.cc:515] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:09:03.359906 23935 raft_consensus.cc:2749] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:09:03.360199 23917 leader_election.cc:290] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:09:03.370606 23934 leader_election.cc:290] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:09:03.371728 16320 consensus_peers.cc:597] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:09:03.339563 23911 leader_election.cc:290] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 20 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
W20260709 13:09:03.372409 16322 leader_election.cc:336] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Network error: Client connection negotiation failed: client connection to 127.14.180.66:45823: connect: Connection refused (error 111)
I20260709 13:09:03.376609 16322 leader_election.cc:304] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 1109f76a0b7b443a84c0327c8707bc63
I20260709 13:09:03.385161 23928 raft_consensus.cc:2749] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:09:03.393456 16320 leader_election.cc:336] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111)
I20260709 13:09:03.395092 16943 raft_consensus.cc:2468] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 363bb2f744eb486f9ad726f08214c98e in term 20.
I20260709 13:09:03.403476 16356 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a054979193cb43dcba8c8eb72cd7f05d" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:09:03.404175 16356 raft_consensus.cc:3060] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:09:03.412922 16356 raft_consensus.cc:2468] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 23.
I20260709 13:09:03.417074 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
W20260709 13:09:03.417202 16322 leader_election.cc:336] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Network error: Client connection negotiation failed: client connection to 127.14.180.66:45823: connect: Connection refused (error 111)
I20260709 13:09:03.427806 16322 leader_election.cc:304] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:09:03.427191 16914 leader_election.cc:336] T a054979193cb43dcba8c8eb72cd7f05d P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Network error: Client connection negotiation failed: client connection to 127.14.180.66:45823: connect: Connection refused (error 111)
W20260709 13:09:03.438175 16914 leader_election.cc:336] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Network error: Client connection negotiation failed: client connection to 127.14.180.66:45823: connect: Connection refused (error 111)
I20260709 13:09:03.437549 23911 raft_consensus.cc:2749] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:03.417842 16357 raft_consensus.cc:2468] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 20.
I20260709 13:09:03.461740 16914 leader_election.cc:304] T a054979193cb43dcba8c8eb72cd7f05d P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:09:03.463011 23942 raft_consensus.cc:2804] T a054979193cb43dcba8c8eb72cd7f05d P 1109f76a0b7b443a84c0327c8707bc63 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:09:03.463691 23942 raft_consensus.cc:697] T a054979193cb43dcba8c8eb72cd7f05d P 1109f76a0b7b443a84c0327c8707bc63 [term 23 LEADER]: Becoming Leader. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:09:03.464831 23942 consensus_queue.cc:237] T a054979193cb43dcba8c8eb72cd7f05d P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:09:03.469822 16322 leader_election.cc:304] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:09:03.470920 23911 raft_consensus.cc:2804] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:09:03.471470 23911 raft_consensus.cc:697] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 20 LEADER]: Becoming Leader. State: Replica: 363bb2f744eb486f9ad726f08214c98e, State: Running, Role: LEADER
I20260709 13:09:03.471786 23934 raft_consensus.cc:493] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:09:03.472448 23911 consensus_queue.cc:237] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:09:03.472481 23934 raft_consensus.cc:515] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:09:03.475914 23934 leader_election.cc:290] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:09:03.492615 16914 leader_election.cc:336] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Network error: Client connection negotiation failed: client connection to 127.14.180.66:45823: connect: Connection refused (error 111)
I20260709 13:09:03.499150 16103 catalog_manager.cc:5697] T a054979193cb43dcba8c8eb72cd7f05d P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: term changed from 22 to 23, leader changed from 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) to 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68). New cstate: current_term: 23 leader_uuid: "1109f76a0b7b443a84c0327c8707bc63" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:03.494050 16104 catalog_manager.cc:5697] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e reported cstate change: term changed from 19 to 20, leader changed from 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) to 363bb2f744eb486f9ad726f08214c98e (127.14.180.67). New cstate: current_term: 20 leader_uuid: "363bb2f744eb486f9ad726f08214c98e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:03.504312 16912 consensus_peers.cc:597] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:09:03.509891 16914 leader_election.cc:304] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:09:03.510862 23942 raft_consensus.cc:2804] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:09:03.511243 23942 raft_consensus.cc:493] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:09:03.511658 23942 raft_consensus.cc:3060] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:03.518710 16357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e" is_pre_election: true
I20260709 13:09:03.520618 16357 raft_consensus.cc:2468] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 20.
I20260709 13:09:03.520432 23942 raft_consensus.cc:515] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:09:03.528874 16914 leader_election.cc:336] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Network error: Client connection negotiation failed: client connection to 127.14.180.66:45823: connect: Connection refused (error 111)
I20260709 13:09:03.534876 23942 leader_election.cc:290] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 21 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:09:03.548978 16914 consensus_peers.cc:597] T abbbc04ca95a4119a7e3fb64073fe61f P 1109f76a0b7b443a84c0327c8707bc63 -> Peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Couldn't send request to peer 0aea40d6e4374085a2e38a70a71f63e3. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.66:45823: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:03.587168 16914 leader_election.cc:304] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:09:03.588146 23942 raft_consensus.cc:2804] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:09:03.588574 23942 raft_consensus.cc:493] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:09:03.588954 23942 raft_consensus.cc:3060] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:03.596783 23942 raft_consensus.cc:515] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:09:03.603325 23942 leader_election.cc:290] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 21 election: Requested vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:09:03.610198 16914 leader_election.cc:336] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Network error: Client connection negotiation failed: client connection to 127.14.180.66:45823: connect: Connection refused (error 111)
I20260709 13:09:03.613304 16356 raft_consensus.cc:1275] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 23 FOLLOWER]: Refusing update from remote peer 1109f76a0b7b443a84c0327c8707bc63: Log matching property violated. Preceding OpId in replica: term: 22 index: 18. Preceding OpId from leader: term: 23 index: 19. (index mismatch)
I20260709 13:09:03.613572 16354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454d01f56c2d4533a035fdbc026c10b3" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:09:03.614209 16354 raft_consensus.cc:3060] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:03.619691 16353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26565509c81343bc818483042146461a" candidate_uuid: "1109f76a0b7b443a84c0327c8707bc63" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "363bb2f744eb486f9ad726f08214c98e"
I20260709 13:09:03.620481 16353 raft_consensus.cc:3060] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:09:03.620812 23934 consensus_queue.cc:1048] T abbbc04ca95a4119a7e3fb64073fe61f P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Connected to new peer: Peer: permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 13:09:03.629542 16353 raft_consensus.cc:2468] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 21.
I20260709 13:09:03.635700 16354 raft_consensus.cc:2468] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1109f76a0b7b443a84c0327c8707bc63 in term 21.
I20260709 13:09:03.649360 16914 leader_election.cc:304] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:09:03.650331 23942 raft_consensus.cc:2804] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:09:03.650988 23942 raft_consensus.cc:697] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 21 LEADER]: Becoming Leader. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:09:03.652199 23942 consensus_queue.cc:237] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:09:03.652588 16914 leader_election.cc:304] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63, 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3
I20260709 13:09:03.654004 23934 raft_consensus.cc:2804] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:09:03.654673 23934 raft_consensus.cc:697] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 21 LEADER]: Becoming Leader. State: Replica: 1109f76a0b7b443a84c0327c8707bc63, State: Running, Role: LEADER
I20260709 13:09:03.655902 23934 consensus_queue.cc:237] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:09:03.668017 16912 consensus_peers.cc:597] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:03.683950 16320 consensus_peers.cc:597] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:03.684985 16914 consensus_peers.cc:597] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 -> Peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Couldn't send request to peer 0aea40d6e4374085a2e38a70a71f63e3. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.66:45823: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:03.732671 16322 consensus_peers.cc:597] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e -> Peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Couldn't send request to peer 0aea40d6e4374085a2e38a70a71f63e3. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.66:45823: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:03.740237 16320 consensus_peers.cc:597] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:03.746677 16322 consensus_peers.cc:597] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e -> Peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Couldn't send request to peer 0aea40d6e4374085a2e38a70a71f63e3. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.66:45823: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:03.750042 16320 consensus_peers.cc:597] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:09:03.755378 16104 catalog_manager.cc:5697] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: term changed from 20 to 21, leader changed from 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) to 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68). New cstate: current_term: 21 leader_uuid: "1109f76a0b7b443a84c0327c8707bc63" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:09:03.756896 16322 consensus_peers.cc:597] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e -> Peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Couldn't send request to peer 0aea40d6e4374085a2e38a70a71f63e3. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.66:45823: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:03.788709 16322 consensus_peers.cc:597] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e -> Peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Couldn't send request to peer 0aea40d6e4374085a2e38a70a71f63e3. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.66:45823: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:03.796267 16914 consensus_peers.cc:597] T 4b962ceebb5c48c1914459ae0c0eff1b P 1109f76a0b7b443a84c0327c8707bc63 -> Peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Couldn't send request to peer 0aea40d6e4374085a2e38a70a71f63e3. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.66:45823: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:03.797278 16322 consensus_peers.cc:597] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e -> Peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Couldn't send request to peer 0aea40d6e4374085a2e38a70a71f63e3. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.66:45823: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:03.800695 15057 tablet_server.cc:179] TabletServer@127.14.180.67:0 shutting down...
I20260709 13:09:03.818892 16104 catalog_manager.cc:5697] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 reported cstate change: term changed from 20 to 21, leader changed from 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66) to 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68). New cstate: current_term: 21 leader_uuid: "1109f76a0b7b443a84c0327c8707bc63" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:09:03.824371 16914 consensus_peers.cc:597] T abbbc04ca95a4119a7e3fb64073fe61f P 1109f76a0b7b443a84c0327c8707bc63 -> Peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Couldn't send request to peer 363bb2f744eb486f9ad726f08214c98e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:03.825248 16914 consensus_peers.cc:597] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 -> Peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Couldn't send request to peer 363bb2f744eb486f9ad726f08214c98e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:03.828159 16914 consensus_peers.cc:597] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 -> Peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Couldn't send request to peer 0aea40d6e4374085a2e38a70a71f63e3. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.66:45823: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:03.839383 16912 consensus_peers.cc:597] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:03.858620 16912 consensus_peers.cc:597] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:03.875907 16914 consensus_peers.cc:597] T 16a307cee8ef431184c620fec029af19 P 1109f76a0b7b443a84c0327c8707bc63 -> Peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Couldn't send request to peer 363bb2f744eb486f9ad726f08214c98e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:03.876890 16914 consensus_peers.cc:597] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 -> Peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Couldn't send request to peer 0aea40d6e4374085a2e38a70a71f63e3. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.66:45823: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:03.878175 16322 consensus_peers.cc:597] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e -> Peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Couldn't send request to peer 0aea40d6e4374085a2e38a70a71f63e3. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.66:45823: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:03.886780 16914 consensus_peers.cc:597] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 1109f76a0b7b443a84c0327c8707bc63 -> Peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Couldn't send request to peer 0aea40d6e4374085a2e38a70a71f63e3. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.66:45823: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:03.901207 16322 consensus_peers.cc:597] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e -> Peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Couldn't send request to peer 0aea40d6e4374085a2e38a70a71f63e3. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.66:45823: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:03.920117 16914 consensus_peers.cc:597] T a054979193cb43dcba8c8eb72cd7f05d P 1109f76a0b7b443a84c0327c8707bc63 -> Peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Couldn't send request to peer 363bb2f744eb486f9ad726f08214c98e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:03.922472 16912 consensus_peers.cc:597] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:03.927412 16914 consensus_peers.cc:597] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 -> Peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Couldn't send request to peer 363bb2f744eb486f9ad726f08214c98e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:03.942682 16320 consensus_peers.cc:597] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:09:03.957607 16943 raft_consensus.cc:1275] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 20 FOLLOWER]: Refusing update from remote peer 363bb2f744eb486f9ad726f08214c98e: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
W20260709 13:09:03.972992 16914 consensus_peers.cc:597] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 -> Peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Couldn't send request to peer 0aea40d6e4374085a2e38a70a71f63e3. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.66:45823: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:03.974337 23911 consensus_queue.cc:1048] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.003s
W20260709 13:09:03.979445 16912 consensus_peers.cc:597] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:04.001614 16320 consensus_peers.cc:597] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:04.023166 16322 consensus_peers.cc:597] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e -> Peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Couldn't send request to peer 0aea40d6e4374085a2e38a70a71f63e3. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.66:45823: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:04.026680 15057 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:04.031746 15057 tablet_replica.cc:333] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e: stopping tablet replica
I20260709 13:09:04.032994 15057 raft_consensus.cc:2243] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:09:04.038910 15057 raft_consensus.cc:2272] T 18b8d2f02b16479aaf7ec42190a4197f P 363bb2f744eb486f9ad726f08214c98e [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:04.027105 16914 consensus_peers.cc:597] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 -> Peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Couldn't send request to peer 0aea40d6e4374085a2e38a70a71f63e3. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.66:45823: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:04.041522 16914 consensus_peers.cc:597] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 -> Peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Couldn't send request to peer 0aea40d6e4374085a2e38a70a71f63e3. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.66:45823: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:04.047256 15057 tablet_replica.cc:333] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e: stopping tablet replica
I20260709 13:09:04.052654 15057 raft_consensus.cc:2243] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:04.053469 15057 pending_rounds.cc:70] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e: Trying to abort 1 pending ops.
W20260709 13:09:04.057343 16914 consensus_peers.cc:597] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 -> Peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Couldn't send request to peer 0aea40d6e4374085a2e38a70a71f63e3. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.66:45823: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:04.057749 15057 pending_rounds.cc:77] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e: Aborting op as it isn't in flight: id { term: 23 index: 19 } timestamp: 7305636016051277824 op_type: NO_OP noop_request { }
I20260709 13:09:04.060144 15057 raft_consensus.cc:2889] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:09:04.060657 15057 raft_consensus.cc:2272] T abbbc04ca95a4119a7e3fb64073fe61f P 363bb2f744eb486f9ad726f08214c98e [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:04.034834 16320 consensus_peers.cc:597] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:09:04.072252 15057 tablet_replica.cc:333] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e: stopping tablet replica
I20260709 13:09:04.073299 15057 raft_consensus.cc:2243] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:04.074050 15057 raft_consensus.cc:2272] T 5247d6e15e644eaa8f250cc1aa2d4b75 P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:04.075488 16914 consensus_peers.cc:597] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 -> Peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Couldn't send request to peer 0aea40d6e4374085a2e38a70a71f63e3. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.66:45823: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:04.076053 16914 consensus_peers.cc:597] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 -> Peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Couldn't send request to peer 0aea40d6e4374085a2e38a70a71f63e3. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.66:45823: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:04.103976 16914 consensus_peers.cc:597] T 4b962ceebb5c48c1914459ae0c0eff1b P 1109f76a0b7b443a84c0327c8707bc63 -> Peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Couldn't send request to peer 363bb2f744eb486f9ad726f08214c98e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:04.108845 16914 consensus_peers.cc:597] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 -> Peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Couldn't send request to peer 363bb2f744eb486f9ad726f08214c98e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:04.110674 16322 consensus_peers.cc:597] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e -> Peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Couldn't send request to peer 0aea40d6e4374085a2e38a70a71f63e3. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.66:45823: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:04.124919 16322 consensus_peers.cc:597] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e -> Peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Couldn't send request to peer 0aea40d6e4374085a2e38a70a71f63e3. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.66:45823: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:04.106329 15057 tablet_replica.cc:333] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e: stopping tablet replica
W20260709 13:09:04.130448 16322 consensus_peers.cc:597] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e -> Peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Couldn't send request to peer 0aea40d6e4374085a2e38a70a71f63e3. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.66:45823: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:04.132417 16320 consensus_peers.cc:597] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:09:04.129508 15057 raft_consensus.cc:2243] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:09:04.150763 15057 raft_consensus.cc:2272] T c24b4a916c7f491da5d7f9b92db71ece P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:04.162722 16914 consensus_peers.cc:597] T a054979193cb43dcba8c8eb72cd7f05d P 1109f76a0b7b443a84c0327c8707bc63 -> Peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Couldn't send request to peer 0aea40d6e4374085a2e38a70a71f63e3. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.66:45823: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:04.167541 15057 tablet_replica.cc:333] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e: stopping tablet replica
I20260709 13:09:04.174909 15057 raft_consensus.cc:2243] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:09:04.182442 15057 raft_consensus.cc:2272] T 42944699e5b24681aa3b54ef1010699d P 363bb2f744eb486f9ad726f08214c98e [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:04.175457 16914 consensus_peers.cc:597] T 16a307cee8ef431184c620fec029af19 P 1109f76a0b7b443a84c0327c8707bc63 -> Peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Couldn't send request to peer 0aea40d6e4374085a2e38a70a71f63e3. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.66:45823: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:04.186939 16914 consensus_peers.cc:597] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 -> Peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Couldn't send request to peer 0aea40d6e4374085a2e38a70a71f63e3. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.66:45823: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:04.202087 16912 consensus_peers.cc:597] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:09:04.212728 16912 consensus_peers.cc:597] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:09:04.217015 15057 tablet_replica.cc:333] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e: stopping tablet replica
I20260709 13:09:04.222376 15057 raft_consensus.cc:2243] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:04.223444 15057 raft_consensus.cc:2272] T 143d3d1339b44b6dbdf204507b6af74b P 363bb2f744eb486f9ad726f08214c98e [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:04.220016 16914 consensus_peers.cc:597] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 -> Peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Couldn't send request to peer 363bb2f744eb486f9ad726f08214c98e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:04.221191 16322 consensus_peers.cc:597] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e -> Peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Couldn't send request to peer 0aea40d6e4374085a2e38a70a71f63e3. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.66:45823: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:04.224994 16322 consensus_peers.cc:597] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e -> Peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Couldn't send request to peer 0aea40d6e4374085a2e38a70a71f63e3. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.66:45823: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:04.228114 16322 consensus_peers.cc:597] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e -> Peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Couldn't send request to peer 0aea40d6e4374085a2e38a70a71f63e3. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.66:45823: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:04.247769 15057 tablet_replica.cc:333] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e: stopping tablet replica
I20260709 13:09:04.254405 15057 raft_consensus.cc:2243] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:04.259029 15057 raft_consensus.cc:2272] T 47342899f1ed4c788d60ea4c5b52969a P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:04.253095 16914 consensus_peers.cc:597] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 -> Peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Couldn't send request to peer 0aea40d6e4374085a2e38a70a71f63e3. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.66:45823: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:04.263087 16914 consensus_peers.cc:597] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 -> Peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Couldn't send request to peer 0aea40d6e4374085a2e38a70a71f63e3. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.66:45823: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:04.264721 16320 consensus_peers.cc:597] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:09:04.271944 15057 tablet_replica.cc:333] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e: stopping tablet replica
I20260709 13:09:04.273521 15057 raft_consensus.cc:2243] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Raft consensus shutting down.
W20260709 13:09:04.272414 16914 consensus_peers.cc:597] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 -> Peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Couldn't send request to peer 0aea40d6e4374085a2e38a70a71f63e3. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.66:45823: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:04.277171 15057 raft_consensus.cc:2272] T cad5db410b3444caafa5090b94f02dba P 363bb2f744eb486f9ad726f08214c98e [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:04.282393 16322 consensus_peers.cc:597] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e -> Peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Couldn't send request to peer 0aea40d6e4374085a2e38a70a71f63e3. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.66:45823: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:04.285490 16914 consensus_peers.cc:597] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 -> Peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Couldn't send request to peer 363bb2f744eb486f9ad726f08214c98e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:04.286801 16914 consensus_peers.cc:597] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 -> Peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Couldn't send request to peer 363bb2f744eb486f9ad726f08214c98e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:04.287566 16914 consensus_peers.cc:597] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 -> Peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Couldn't send request to peer 363bb2f744eb486f9ad726f08214c98e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:04.288215 16914 consensus_peers.cc:597] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 -> Peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Couldn't send request to peer 363bb2f744eb486f9ad726f08214c98e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:04.317448 16912 consensus_peers.cc:597] T 16a307cee8ef431184c620fec029af19 P 1109f76a0b7b443a84c0327c8707bc63 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:09:04.291214 15057 tablet_replica.cc:333] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e: stopping tablet replica
I20260709 13:09:04.321866 15057 raft_consensus.cc:2243] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 15 LEADER]: Raft consensus shutting down.
W20260709 13:09:04.322892 16322 consensus_peers.cc:597] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e -> Peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Couldn't send request to peer 0aea40d6e4374085a2e38a70a71f63e3. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.66:45823: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:04.329811 15057 raft_consensus.cc:2272] T 540bfc4ad793452faea5b865343aacf7 P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:04.350069 16320 consensus_peers.cc:597] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:04.351449 16914 consensus_peers.cc:597] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 -> Peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Couldn't send request to peer 363bb2f744eb486f9ad726f08214c98e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:04.354224 16914 consensus_peers.cc:597] T cad5db410b3444caafa5090b94f02dba P 1109f76a0b7b443a84c0327c8707bc63 -> Peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Couldn't send request to peer 363bb2f744eb486f9ad726f08214c98e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:04.354887 16914 consensus_peers.cc:597] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 -> Peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Couldn't send request to peer 363bb2f744eb486f9ad726f08214c98e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:04.369676 16320 consensus_peers.cc:597] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:09:04.357496 15057 tablet_replica.cc:333] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e: stopping tablet replica
I20260709 13:09:04.375685 15057 raft_consensus.cc:2243] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:09:04.377200 15057 raft_consensus.cc:2272] T 6759dbf6a6924fcc870cb52b4a5d7953 P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:04.407975 15057 tablet_replica.cc:333] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e: stopping tablet replica
I20260709 13:09:04.414603 15057 raft_consensus.cc:2243] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:04.417160 15057 raft_consensus.cc:2272] T 7295dce0baa440b8a197da845581ee81 P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:04.473956 16912 consensus_peers.cc:597] T cad5db410b3444caafa5090b94f02dba P 1109f76a0b7b443a84c0327c8707bc63 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:09:04.475719 15057 tablet_replica.cc:333] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e: stopping tablet replica
I20260709 13:09:04.483198 15057 raft_consensus.cc:2243] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [term 13 LEADER]: Raft consensus shutting down.
W20260709 13:09:04.509815 16914 consensus_peers.cc:597] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 -> Peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Couldn't send request to peer 363bb2f744eb486f9ad726f08214c98e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:04.553574 16912 consensus_peers.cc:597] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:09:04.556954 16914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46107, user_credentials={real_user=slave}} blocked reactor thread for 62448.7us
W20260709 13:09:04.580886 16320 consensus_peers.cc:597] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:09:04.595104 15057 raft_consensus.cc:2272] T 5054b6ad2e4141cab2232a3fecd7c858 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:04.598341 15057 tablet_replica.cc:333] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e: stopping tablet replica
I20260709 13:09:04.602095 15057 raft_consensus.cc:2243] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:04.616813 15057 raft_consensus.cc:2272] T 862e96f5785248c58d0355cac229fc05 P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:04.621155 15057 tablet_replica.cc:333] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e: stopping tablet replica
I20260709 13:09:04.634418 15057 raft_consensus.cc:2243] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:09:04.636445 15057 raft_consensus.cc:2272] T b241405f79a345849ba216394fcb999a P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:04.643999 16320 consensus_peers.cc:597] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:09:04.644635 15057 tablet_replica.cc:333] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e: stopping tablet replica
I20260709 13:09:04.646229 15057 raft_consensus.cc:2243] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:09:04.647941 15057 raft_consensus.cc:2272] T 19e573db44d24720b3a4805dc20210e8 P 363bb2f744eb486f9ad726f08214c98e [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:04.655992 15057 tablet_replica.cc:333] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e: stopping tablet replica
I20260709 13:09:04.659572 15057 raft_consensus.cc:2243] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:04.675650 15057 raft_consensus.cc:2272] T 176e2f21e86a4e54a8d9a21aef8a272f P 363bb2f744eb486f9ad726f08214c98e [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:04.678896 15057 tablet_replica.cc:333] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e: stopping tablet replica
I20260709 13:09:04.680485 15057 raft_consensus.cc:2243] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:04.681432 15057 raft_consensus.cc:2272] T 916cdb289e9442b69dd8ed0c99eb8198 P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:04.693328 15057 tablet_replica.cc:333] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e: stopping tablet replica
I20260709 13:09:04.694207 15057 raft_consensus.cc:2243] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:04.695201 15057 raft_consensus.cc:2272] T 98afc5914978455ba8cc5329152a3f1d P 363bb2f744eb486f9ad726f08214c98e [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:04.698915 15057 tablet_replica.cc:333] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e: stopping tablet replica
I20260709 13:09:04.699846 15057 raft_consensus.cc:2243] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:09:04.701274 15057 raft_consensus.cc:2272] T bb3b9c4ba1f147fc8d9858234bfce423 P 363bb2f744eb486f9ad726f08214c98e [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:04.706712 23934 raft_consensus.cc:493] T 8cabbc283ea543459d45ebdb8b6add94 P 1109f76a0b7b443a84c0327c8707bc63 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:09:04.707406 23934 raft_consensus.cc:515] T 8cabbc283ea543459d45ebdb8b6add94 P 1109f76a0b7b443a84c0327c8707bc63 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:09:04.708915 15057 tablet_replica.cc:333] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e: stopping tablet replica
I20260709 13:09:04.709875 15057 raft_consensus.cc:2243] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:09:04.711239 15057 raft_consensus.cc:2272] T c7d554054f014c74992a2a66ff6873cd P 363bb2f744eb486f9ad726f08214c98e [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:04.713811 23917 raft_consensus.cc:493] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:09:04.716818 23917 raft_consensus.cc:515] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } }
W20260709 13:09:04.719213 16914 leader_election.cc:336] T 8cabbc283ea543459d45ebdb8b6add94 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Network error: Client connection negotiation failed: client connection to 127.14.180.66:45823: connect: Connection refused (error 111)
I20260709 13:09:04.720351 23917 leader_election.cc:290] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:09:04.715066 23934 leader_election.cc:290] T 8cabbc283ea543459d45ebdb8b6add94 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:09:04.724663 15057 tablet_replica.cc:333] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e: stopping tablet replica
W20260709 13:09:04.725091 16912 leader_election.cc:336] T 8cabbc283ea543459d45ebdb8b6add94 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111)
I20260709 13:09:04.736130 15057 raft_consensus.cc:2243] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:09:04.736253 16912 leader_election.cc:304] T 8cabbc283ea543459d45ebdb8b6add94 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:09:04.737581 15057 raft_consensus.cc:2272] T eeda5ee833164deb9ec027b22371793c P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:04.727208 23934 raft_consensus.cc:493] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:09:04.738435 23934 raft_consensus.cc:515] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:09:04.741037 23934 leader_election.cc:290] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:09:04.741596 23934 raft_consensus.cc:2749] T 8cabbc283ea543459d45ebdb8b6add94 P 1109f76a0b7b443a84c0327c8707bc63 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:09:04.732403 16322 leader_election.cc:336] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Network error: Client connection negotiation failed: client connection to 127.14.180.66:45823: connect: Connection refused (error 111)
W20260709 13:09:04.743230 16320 leader_election.cc:336] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111)
I20260709 13:09:04.744192 16320 leader_election.cc:304] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:09:04.750725 23917 raft_consensus.cc:2749] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:09:04.751753 16914 leader_election.cc:336] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Network error: Client connection negotiation failed: client connection to 127.14.180.66:45823: connect: Connection refused (error 111)
I20260709 13:09:04.756603 15057 tablet_replica.cc:333] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e: stopping tablet replica
I20260709 13:09:04.759481 15057 raft_consensus.cc:2243] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:09:04.761051 15057 raft_consensus.cc:2272] T 1356ff4c060346359eb10723422e972a P 363bb2f744eb486f9ad726f08214c98e [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:04.772239 15057 tablet_replica.cc:333] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e: stopping tablet replica
W20260709 13:09:04.761934 16912 leader_election.cc:336] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111)
I20260709 13:09:04.779302 16912 leader_election.cc:304] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:09:04.780203 23942 raft_consensus.cc:2749] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:04.784829 15057 raft_consensus.cc:2243] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:09:04.791658 15057 raft_consensus.cc:2272] T aee913c41fb9437587affa768953f637 P 363bb2f744eb486f9ad726f08214c98e [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:04.794883 15057 tablet_replica.cc:333] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e: stopping tablet replica
I20260709 13:09:04.801860 15057 raft_consensus.cc:2243] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:04.803385 15057 raft_consensus.cc:2272] T 16a307cee8ef431184c620fec029af19 P 363bb2f744eb486f9ad726f08214c98e [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:04.806658 15057 tablet_replica.cc:333] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e: stopping tablet replica
I20260709 13:09:04.815325 15057 raft_consensus.cc:2243] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:04.815759 23917 raft_consensus.cc:493] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:09:04.816141 15057 raft_consensus.cc:2272] T 4b962ceebb5c48c1914459ae0c0eff1b P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:04.816360 23917 raft_consensus.cc:515] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:09:04.819350 15057 tablet_replica.cc:333] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e: stopping tablet replica
I20260709 13:09:04.819849 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52982fc727d3451e9c722e63eb4d79ef" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:09:04.820360 15057 raft_consensus.cc:2243] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:09:04.821895 15057 raft_consensus.cc:2272] T b2275272882d4313a1ce1a8632a5819c P 363bb2f744eb486f9ad726f08214c98e [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:04.835940 15057 tablet_replica.cc:333] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e: stopping tablet replica
I20260709 13:09:04.836973 15057 raft_consensus.cc:2243] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 15 LEADER]: Raft consensus shutting down.
W20260709 13:09:04.837664 16320 leader_election.cc:336] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111)
I20260709 13:09:04.838300 15057 raft_consensus.cc:2272] T bc427ac4cc014a9c99e5731814bff30a P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:04.838933 23928 raft_consensus.cc:493] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 1109f76a0b7b443a84c0327c8707bc63)
I20260709 13:09:04.839478 23928 raft_consensus.cc:515] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:09:04.841707 23928 leader_election.cc:290] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:09:04.842368 23917 leader_election.cc:290] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 1109f76a0b7b443a84c0327c8707bc63 (127.14.180.68:36875)
I20260709 13:09:04.838191 16320 leader_election.cc:304] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:09:04.843427 16949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "186b9e9483624c769871a8894ee07efa" candidate_uuid: "363bb2f744eb486f9ad726f08214c98e" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "1109f76a0b7b443a84c0327c8707bc63" is_pre_election: true
I20260709 13:09:04.845614 23917 raft_consensus.cc:2749] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:04.848827 15057 tablet_replica.cc:333] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e: stopping tablet replica
I20260709 13:09:04.849808 15057 raft_consensus.cc:2243] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:04.850513 15057 raft_consensus.cc:2272] T c824093f8d374c1b9f3c8a6e8e711157 P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:04.853968 15057 tablet_replica.cc:333] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e: stopping tablet replica
I20260709 13:09:04.854957 15057 raft_consensus.cc:2243] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:09:04.860666 15057 raft_consensus.cc:2272] T 40719878febd41f9b57c9a6992d4431b P 363bb2f744eb486f9ad726f08214c98e [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:04.863808 15057 tablet_replica.cc:333] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e: stopping tablet replica
I20260709 13:09:04.864753 15057 raft_consensus.cc:2243] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 22 FOLLOWER]: Raft consensus shutting down.
W20260709 13:09:04.865487 16320 leader_election.cc:336] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111)
I20260709 13:09:04.868754 16320 leader_election.cc:304] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 363bb2f744eb486f9ad726f08214c98e; no voters: 1109f76a0b7b443a84c0327c8707bc63, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:09:04.870159 23917 raft_consensus.cc:2749] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:09:04.870389 15057 raft_consensus.cc:2272] T 39dd6382a0304387a1341bcc36471cbf P 363bb2f744eb486f9ad726f08214c98e [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:04.875208 15057 tablet_replica.cc:333] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e: stopping tablet replica
W20260709 13:09:04.876960 16320 consensus_peers.cc:597] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:09:04.877758 15057 raft_consensus.cc:2243] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:04.882648 15057 raft_consensus.cc:2272] T 186b9e9483624c769871a8894ee07efa P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:04.886950 15057 tablet_replica.cc:333] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e: stopping tablet replica
I20260709 13:09:04.890400 15057 raft_consensus.cc:2243] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:09:04.893127 15057 raft_consensus.cc:2272] T 0340758c689242c3979a434fa59589f7 P 363bb2f744eb486f9ad726f08214c98e [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:04.901707 15057 tablet_replica.cc:333] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e: stopping tablet replica
I20260709 13:09:04.902655 15057 raft_consensus.cc:2243] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:04.907598 15057 raft_consensus.cc:2272] T 454d01f56c2d4533a035fdbc026c10b3 P 363bb2f744eb486f9ad726f08214c98e [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:04.910730 15057 tablet_replica.cc:333] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e: stopping tablet replica
I20260709 13:09:04.919680 15057 raft_consensus.cc:2243] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:04.920459 15057 raft_consensus.cc:2272] T fd2e2dfe8dc4456ab39d1a4d6f6416b7 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:04.924220 15057 tablet_replica.cc:333] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e: stopping tablet replica
I20260709 13:09:04.925158 15057 raft_consensus.cc:2243] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:04.925987 15057 raft_consensus.cc:2272] T ccde1e8182914560a3c1df0312e6a2b2 P 363bb2f744eb486f9ad726f08214c98e [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:04.934592 15057 tablet_replica.cc:333] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e: stopping tablet replica
I20260709 13:09:04.935581 15057 raft_consensus.cc:2243] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:04.936447 15057 raft_consensus.cc:2272] T b9e1324823f04d8da5a4b3ddbd061c0e P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:04.950577 15057 tablet_replica.cc:333] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e: stopping tablet replica
I20260709 13:09:04.951489 15057 raft_consensus.cc:2243] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:09:04.953167 15057 raft_consensus.cc:2272] T 888479daeaaa4744a161f6b45bb257f6 P 363bb2f744eb486f9ad726f08214c98e [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:04.956980 15057 tablet_replica.cc:333] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e: stopping tablet replica
I20260709 13:09:04.991900 15057 raft_consensus.cc:2243] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:09:05.005965 15057 raft_consensus.cc:2272] T a1a76ba8ceae4d0780583a09087cec0a P 363bb2f744eb486f9ad726f08214c98e [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:05.077278 15057 tablet_replica.cc:333] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e: stopping tablet replica
W20260709 13:09:05.077164 16912 consensus_peers.cc:597] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 1109f76a0b7b443a84c0327c8707bc63 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:09:05.082377 15057 raft_consensus.cc:2243] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:09:05.086014 15057 raft_consensus.cc:2272] T 38b024fb12204d9b9e35d72638671c24 P 363bb2f744eb486f9ad726f08214c98e [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:05.105058 15057 tablet_replica.cc:333] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e: stopping tablet replica
I20260709 13:09:05.105984 15057 raft_consensus.cc:2243] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:09:05.107406 15057 raft_consensus.cc:2272] T 9dbc1db111e7466090abdb97a79d0d9b P 363bb2f744eb486f9ad726f08214c98e [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:05.110703 15057 tablet_replica.cc:333] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e: stopping tablet replica
I20260709 13:09:05.120927 15057 raft_consensus.cc:2243] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:05.121882 15057 raft_consensus.cc:2272] T 52982fc727d3451e9c722e63eb4d79ef P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:05.126670 15057 tablet_replica.cc:333] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e: stopping tablet replica
I20260709 13:09:05.128173 15057 raft_consensus.cc:2243] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:09:05.129612 15057 raft_consensus.cc:2272] T d9c15d8e9be8414c84912ab77b66bfb1 P 363bb2f744eb486f9ad726f08214c98e [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:05.132596 15057 tablet_replica.cc:333] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e: stopping tablet replica
I20260709 13:09:05.155331 15057 raft_consensus.cc:2243] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:05.156858 15057 raft_consensus.cc:2272] T a054979193cb43dcba8c8eb72cd7f05d P 363bb2f744eb486f9ad726f08214c98e [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:05.192092 15057 tablet_replica.cc:333] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e: stopping tablet replica
I20260709 13:09:05.198628 15057 raft_consensus.cc:2243] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:05.199481 15057 raft_consensus.cc:2272] T 26565509c81343bc818483042146461a P 363bb2f744eb486f9ad726f08214c98e [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:05.204790 15057 tablet_replica.cc:333] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e: stopping tablet replica
I20260709 13:09:05.208217 15057 raft_consensus.cc:2243] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:09:05.215972 15057 raft_consensus.cc:2272] T fd0c3c592b464aafaf1d0b94d1e6e360 P 363bb2f744eb486f9ad726f08214c98e [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:05.218760 15057 tablet_replica.cc:333] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e: stopping tablet replica
I20260709 13:09:05.219449 15057 raft_consensus.cc:2243] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:09:05.220726 15057 raft_consensus.cc:2272] T 5c2f49b7f95a4153b2d180218e6af1db P 363bb2f744eb486f9ad726f08214c98e [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:05.292203 23957 raft_consensus.cc:493] T ab124ef29c71409d9c14a75a054095e1 P 1109f76a0b7b443a84c0327c8707bc63 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:09:05.292810 23957 raft_consensus.cc:515] T ab124ef29c71409d9c14a75a054095e1 P 1109f76a0b7b443a84c0327c8707bc63 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:09:05.295948 23957 leader_election.cc:290] T ab124ef29c71409d9c14a75a054095e1 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:09:05.301977 16912 leader_election.cc:336] T ab124ef29c71409d9c14a75a054095e1 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111)
I20260709 13:09:05.304337 23957 raft_consensus.cc:493] T 13bc3c8ff9b84838a2664335d7e1582b P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:09:05.304950 23957 raft_consensus.cc:515] T 13bc3c8ff9b84838a2664335d7e1582b P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
W20260709 13:09:05.306387 16914 leader_election.cc:336] T ab124ef29c71409d9c14a75a054095e1 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Network error: Client connection negotiation failed: client connection to 127.14.180.66:45823: connect: Connection refused (error 111)
I20260709 13:09:05.307029 16914 leader_election.cc:304] T ab124ef29c71409d9c14a75a054095e1 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:09:05.307333 23957 leader_election.cc:290] T 13bc3c8ff9b84838a2664335d7e1582b P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
I20260709 13:09:05.307883 23934 raft_consensus.cc:2749] T ab124ef29c71409d9c14a75a054095e1 P 1109f76a0b7b443a84c0327c8707bc63 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:09:05.315968 16912 leader_election.cc:336] T 13bc3c8ff9b84838a2664335d7e1582b P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111)
W20260709 13:09:05.322716 16914 leader_election.cc:336] T 13bc3c8ff9b84838a2664335d7e1582b P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Network error: Client connection negotiation failed: client connection to 127.14.180.66:45823: connect: Connection refused (error 111)
I20260709 13:09:05.323318 16914 leader_election.cc:304] T 13bc3c8ff9b84838a2664335d7e1582b P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:09:05.324273 23957 raft_consensus.cc:2749] T 13bc3c8ff9b84838a2664335d7e1582b P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:09:05.481704 23957 raft_consensus.cc:493] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:09:05.482323 23957 raft_consensus.cc:515] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:09:05.484689 23957 leader_election.cc:290] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:09:05.492813 16912 leader_election.cc:336] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111)
I20260709 13:09:05.508548 23934 raft_consensus.cc:493] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0aea40d6e4374085a2e38a70a71f63e3)
I20260709 13:09:05.509164 23934 raft_consensus.cc:515] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:09:05.511512 23934 leader_election.cc:290] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823)
W20260709 13:09:05.527403 16914 leader_election.cc:336] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Network error: Client connection negotiation failed: client connection to 127.14.180.66:45823: connect: Connection refused (error 111)
I20260709 13:09:05.528502 16914 leader_election.cc:304] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:09:05.527971 16912 leader_election.cc:336] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111)
I20260709 13:09:05.530028 23957 raft_consensus.cc:2749] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:09:05.545008 16914 leader_election.cc:336] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Network error: Client connection negotiation failed: client connection to 127.14.180.66:45823: connect: Connection refused (error 111)
I20260709 13:09:05.545637 16914 leader_election.cc:304] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:09:05.546530 23957 raft_consensus.cc:2749] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:09:05.588937 16912 consensus_peers.cc:597] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:09:05.654312 23957 raft_consensus.cc:493] T 540bfc4ad793452faea5b865343aacf7 P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:09:05.655057 23957 raft_consensus.cc:515] T 540bfc4ad793452faea5b865343aacf7 P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:09:05.658852 23957 leader_election.cc:290] T 540bfc4ad793452faea5b865343aacf7 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:09:05.665894 16912 leader_election.cc:336] T 540bfc4ad793452faea5b865343aacf7 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111)
W20260709 13:09:05.680188 16914 leader_election.cc:336] T 540bfc4ad793452faea5b865343aacf7 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Network error: Client connection negotiation failed: client connection to 127.14.180.67:46107: connect: Connection refused (error 111)
I20260709 13:09:05.680814 16914 leader_election.cc:304] T 540bfc4ad793452faea5b865343aacf7 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:09:05.683133 23957 raft_consensus.cc:2749] T 540bfc4ad793452faea5b865343aacf7 P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:09:05.852536 16912 consensus_peers.cc:597] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:09:05.943794 16914 consensus_peers.cc:597] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 -> Peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Couldn't send request to peer 363bb2f744eb486f9ad726f08214c98e. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.67:46107: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:05.954818 23957 raft_consensus.cc:493] T 5054b6ad2e4141cab2232a3fecd7c858 P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:09:05.955470 23957 raft_consensus.cc:515] T 5054b6ad2e4141cab2232a3fecd7c858 P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:09:05.957373 23957 leader_election.cc:290] T 5054b6ad2e4141cab2232a3fecd7c858 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:09:05.962984 16914 leader_election.cc:336] T 5054b6ad2e4141cab2232a3fecd7c858 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Network error: Client connection negotiation failed: client connection to 127.14.180.66:45823: connect: Connection refused (error 111)
W20260709 13:09:05.963704 16914 leader_election.cc:336] T 5054b6ad2e4141cab2232a3fecd7c858 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Network error: Client connection negotiation failed: client connection to 127.14.180.67:46107: connect: Connection refused (error 111)
I20260709 13:09:05.964036 16914 leader_election.cc:304] T 5054b6ad2e4141cab2232a3fecd7c858 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:09:05.964644 23957 raft_consensus.cc:2749] T 5054b6ad2e4141cab2232a3fecd7c858 P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:09:06.005403 16914 consensus_peers.cc:597] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 -> Peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Couldn't send request to peer 0aea40d6e4374085a2e38a70a71f63e3. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.66:45823: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:09:06.033439 23960 raft_consensus.cc:493] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:09:06.033927 23960 raft_consensus.cc:515] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:09:06.036419 23960 leader_election.cc:290] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:09:06.038235 16912 consensus_peers.cc:597] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:09:06.041375 16912 leader_election.cc:336] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111)
W20260709 13:09:06.042846 16914 leader_election.cc:336] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Network error: Client connection negotiation failed: client connection to 127.14.180.67:46107: connect: Connection refused (error 111)
I20260709 13:09:06.043248 16914 leader_election.cc:304] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:09:06.043871 23960 raft_consensus.cc:2749] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:09:06.125811 23957 raft_consensus.cc:493] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:09:06.125962 23960 raft_consensus.cc:493] T 19e573db44d24720b3a4805dc20210e8 P 1109f76a0b7b443a84c0327c8707bc63 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:09:06.126639 23960 raft_consensus.cc:515] T 19e573db44d24720b3a4805dc20210e8 P 1109f76a0b7b443a84c0327c8707bc63 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:09:06.126531 23957 raft_consensus.cc:515] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:09:06.129129 23960 leader_election.cc:290] T 19e573db44d24720b3a4805dc20210e8 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
I20260709 13:09:06.129415 23957 leader_election.cc:290] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:09:06.134464 16912 leader_election.cc:336] T 19e573db44d24720b3a4805dc20210e8 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111)
W20260709 13:09:06.138264 16914 leader_election.cc:336] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Network error: Client connection negotiation failed: client connection to 127.14.180.66:45823: connect: Connection refused (error 111)
W20260709 13:09:06.138993 16914 leader_election.cc:336] T 19e573db44d24720b3a4805dc20210e8 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Network error: Client connection negotiation failed: client connection to 127.14.180.67:46107: connect: Connection refused (error 111)
I20260709 13:09:06.139401 16914 leader_election.cc:304] T 19e573db44d24720b3a4805dc20210e8 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:09:06.140221 23957 raft_consensus.cc:2749] T 19e573db44d24720b3a4805dc20210e8 P 1109f76a0b7b443a84c0327c8707bc63 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:09:06.140383 16914 leader_election.cc:336] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Network error: Client connection negotiation failed: client connection to 127.14.180.67:46107: connect: Connection refused (error 111)
I20260709 13:09:06.140910 16914 leader_election.cc:304] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:09:06.141645 23957 raft_consensus.cc:2749] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:09:06.151283 23957 raft_consensus.cc:493] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:09:06.152068 23957 raft_consensus.cc:515] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:09:06.155077 23957 leader_election.cc:290] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:09:06.160706 16914 leader_election.cc:336] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Network error: Client connection negotiation failed: client connection to 127.14.180.67:46107: connect: Connection refused (error 111)
W20260709 13:09:06.164857 16912 leader_election.cc:336] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111)
I20260709 13:09:06.166019 16912 leader_election.cc:304] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:09:06.168377 23957 raft_consensus.cc:2749] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:09:06.183322 15057 tablet_server.cc:196] TabletServer@127.14.180.67:0 shutdown complete.
W20260709 13:09:06.193506 16914 consensus_peers.cc:597] T abbbc04ca95a4119a7e3fb64073fe61f P 1109f76a0b7b443a84c0327c8707bc63 -> Peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Couldn't send request to peer 0aea40d6e4374085a2e38a70a71f63e3. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.66:45823: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:06.258024 16914 consensus_peers.cc:597] T 4b962ceebb5c48c1914459ae0c0eff1b P 1109f76a0b7b443a84c0327c8707bc63 -> Peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Couldn't send request to peer 0aea40d6e4374085a2e38a70a71f63e3. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.66:45823: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:06.270833 16914 consensus_peers.cc:597] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 -> Peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Couldn't send request to peer 0aea40d6e4374085a2e38a70a71f63e3. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.66:45823: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:09:06.278751 23960 raft_consensus.cc:493] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:09:06.279439 23960 raft_consensus.cc:515] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:09:06.281986 23960 leader_election.cc:290] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:09:06.287272 16912 leader_election.cc:336] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111)
W20260709 13:09:06.287897 16914 leader_election.cc:336] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Network error: Client connection negotiation failed: client connection to 127.14.180.67:46107: connect: Connection refused (error 111)
I20260709 13:09:06.288439 16914 leader_election.cc:304] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 363bb2f744eb486f9ad726f08214c98e, e10b16d536674c0bb350a31d7ce5ff7f
I20260709 13:09:06.289297 23960 raft_consensus.cc:2749] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:09:06.299458 16914 consensus_peers.cc:597] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 1109f76a0b7b443a84c0327c8707bc63 -> Peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Couldn't send request to peer 0aea40d6e4374085a2e38a70a71f63e3. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.66:45823: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:06.318782 16914 consensus_peers.cc:597] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 -> Peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Couldn't send request to peer 0aea40d6e4374085a2e38a70a71f63e3. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.66:45823: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:06.319767 16914 consensus_peers.cc:597] T 16a307cee8ef431184c620fec029af19 P 1109f76a0b7b443a84c0327c8707bc63 -> Peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Couldn't send request to peer 363bb2f744eb486f9ad726f08214c98e. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.67:46107: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:06.325299 16914 consensus_peers.cc:597] T 16a307cee8ef431184c620fec029af19 P 1109f76a0b7b443a84c0327c8707bc63 -> Peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Couldn't send request to peer 0aea40d6e4374085a2e38a70a71f63e3. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.66:45823: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:09:06.330945 15057 tablet_server.cc:179] TabletServer@127.14.180.68:0 shutting down...
I20260709 13:09:06.378628 23957 raft_consensus.cc:493] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:09:06.379556 23957 raft_consensus.cc:515] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:09:06.385062 23957 leader_election.cc:290] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:09:06.386852 16914 consensus_peers.cc:597] T 4b962ceebb5c48c1914459ae0c0eff1b P 1109f76a0b7b443a84c0327c8707bc63 -> Peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Couldn't send request to peer 363bb2f744eb486f9ad726f08214c98e. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.67:46107: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:06.392670 16914 leader_election.cc:336] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Network error: Client connection negotiation failed: client connection to 127.14.180.67:46107: connect: Connection refused (error 111)
W20260709 13:09:06.394371 16914 leader_election.cc:336] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Network error: Client connection negotiation failed: client connection to 127.14.180.66:45823: connect: Connection refused (error 111)
I20260709 13:09:06.394863 16914 leader_election.cc:304] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, 363bb2f744eb486f9ad726f08214c98e
I20260709 13:09:06.395682 23960 raft_consensus.cc:2749] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:09:06.398118 16914 consensus_peers.cc:597] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 -> Peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Couldn't send request to peer 363bb2f744eb486f9ad726f08214c98e. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.67:46107: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:06.398859 15057 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:06.400297 15057 tablet_replica.cc:333] T 5054b6ad2e4141cab2232a3fecd7c858 P 1109f76a0b7b443a84c0327c8707bc63: stopping tablet replica
I20260709 13:09:06.402011 15057 raft_consensus.cc:2243] T 5054b6ad2e4141cab2232a3fecd7c858 P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:06.403147 15057 raft_consensus.cc:2272] T 5054b6ad2e4141cab2232a3fecd7c858 P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:06.406787 15057 tablet_replica.cc:333] T ab124ef29c71409d9c14a75a054095e1 P 1109f76a0b7b443a84c0327c8707bc63: stopping tablet replica
I20260709 13:09:06.407936 15057 raft_consensus.cc:2243] T ab124ef29c71409d9c14a75a054095e1 P 1109f76a0b7b443a84c0327c8707bc63 [term 18 FOLLOWER]: Raft consensus shutting down.
W20260709 13:09:06.409298 16914 consensus_peers.cc:597] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 -> Peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Couldn't send request to peer 363bb2f744eb486f9ad726f08214c98e. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.67:46107: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:06.409358 15057 raft_consensus.cc:2272] T ab124ef29c71409d9c14a75a054095e1 P 1109f76a0b7b443a84c0327c8707bc63 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:06.409869 16914 consensus_peers.cc:597] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 -> Peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Couldn't send request to peer 363bb2f744eb486f9ad726f08214c98e. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.67:46107: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:06.412410 15057 tablet_replica.cc:333] T 19e573db44d24720b3a4805dc20210e8 P 1109f76a0b7b443a84c0327c8707bc63: stopping tablet replica
I20260709 13:09:06.413259 15057 raft_consensus.cc:2243] T 19e573db44d24720b3a4805dc20210e8 P 1109f76a0b7b443a84c0327c8707bc63 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:06.414063 15057 raft_consensus.cc:2272] T 19e573db44d24720b3a4805dc20210e8 P 1109f76a0b7b443a84c0327c8707bc63 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:06.416676 15057 tablet_replica.cc:333] T abbbc04ca95a4119a7e3fb64073fe61f P 1109f76a0b7b443a84c0327c8707bc63: stopping tablet replica
I20260709 13:09:06.417347 15057 raft_consensus.cc:2243] T abbbc04ca95a4119a7e3fb64073fe61f P 1109f76a0b7b443a84c0327c8707bc63 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:09:06.418408 15057 raft_consensus.cc:2272] T abbbc04ca95a4119a7e3fb64073fe61f P 1109f76a0b7b443a84c0327c8707bc63 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:06.421087 15057 tablet_replica.cc:333] T 8cabbc283ea543459d45ebdb8b6add94 P 1109f76a0b7b443a84c0327c8707bc63: stopping tablet replica
I20260709 13:09:06.422061 15057 raft_consensus.cc:2243] T 8cabbc283ea543459d45ebdb8b6add94 P 1109f76a0b7b443a84c0327c8707bc63 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:06.423789 15057 raft_consensus.cc:2272] T 8cabbc283ea543459d45ebdb8b6add94 P 1109f76a0b7b443a84c0327c8707bc63 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:06.427420 15057 tablet_replica.cc:333] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 1109f76a0b7b443a84c0327c8707bc63: stopping tablet replica
I20260709 13:09:06.428344 15057 raft_consensus.cc:2243] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 1109f76a0b7b443a84c0327c8707bc63 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:09:06.429539 15057 raft_consensus.cc:2272] T eafb6ab8cb0c42309ea6508e0ad9b9ef P 1109f76a0b7b443a84c0327c8707bc63 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:06.430263 16914 consensus_peers.cc:597] T a054979193cb43dcba8c8eb72cd7f05d P 1109f76a0b7b443a84c0327c8707bc63 -> Peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Couldn't send request to peer 363bb2f744eb486f9ad726f08214c98e. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.67:46107: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:06.432770 16914 consensus_peers.cc:597] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 -> Peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Couldn't send request to peer 0aea40d6e4374085a2e38a70a71f63e3. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.66:45823: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:09:06.433205 15057 tablet_replica.cc:333] T a054979193cb43dcba8c8eb72cd7f05d P 1109f76a0b7b443a84c0327c8707bc63: stopping tablet replica
I20260709 13:09:06.434006 15057 raft_consensus.cc:2243] T a054979193cb43dcba8c8eb72cd7f05d P 1109f76a0b7b443a84c0327c8707bc63 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:09:06.435098 15057 pending_rounds.cc:70] T a054979193cb43dcba8c8eb72cd7f05d P 1109f76a0b7b443a84c0327c8707bc63: Trying to abort 1 pending ops.
I20260709 13:09:06.435328 15057 pending_rounds.cc:77] T a054979193cb43dcba8c8eb72cd7f05d P 1109f76a0b7b443a84c0327c8707bc63: Aborting op as it isn't in flight: id { term: 23 index: 17 } timestamp: 7305636018064916480 op_type: NO_OP noop_request { }
I20260709 13:09:06.435629 15057 raft_consensus.cc:2889] T a054979193cb43dcba8c8eb72cd7f05d P 1109f76a0b7b443a84c0327c8707bc63 [term 23 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:09:06.435917 15057 raft_consensus.cc:2272] T a054979193cb43dcba8c8eb72cd7f05d P 1109f76a0b7b443a84c0327c8707bc63 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:06.438380 15057 tablet_replica.cc:333] T 5c2f49b7f95a4153b2d180218e6af1db P 1109f76a0b7b443a84c0327c8707bc63: stopping tablet replica
I20260709 13:09:06.439146 15057 raft_consensus.cc:2243] T 5c2f49b7f95a4153b2d180218e6af1db P 1109f76a0b7b443a84c0327c8707bc63 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:06.440200 15057 raft_consensus.cc:2272] T 5c2f49b7f95a4153b2d180218e6af1db P 1109f76a0b7b443a84c0327c8707bc63 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:06.442462 23960 raft_consensus.cc:493] T a1a76ba8ceae4d0780583a09087cec0a P 1109f76a0b7b443a84c0327c8707bc63 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 363bb2f744eb486f9ad726f08214c98e)
I20260709 13:09:06.443372 15057 tablet_replica.cc:333] T 16a307cee8ef431184c620fec029af19 P 1109f76a0b7b443a84c0327c8707bc63: stopping tablet replica
I20260709 13:09:06.443027 23960 raft_consensus.cc:515] T a1a76ba8ceae4d0780583a09087cec0a P 1109f76a0b7b443a84c0327c8707bc63 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: false } }
I20260709 13:09:06.444100 15057 raft_consensus.cc:2243] T 16a307cee8ef431184c620fec029af19 P 1109f76a0b7b443a84c0327c8707bc63 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:09:06.445259 15057 raft_consensus.cc:2272] T 16a307cee8ef431184c620fec029af19 P 1109f76a0b7b443a84c0327c8707bc63 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:06.446046 23960 leader_election.cc:290] T a1a76ba8ceae4d0780583a09087cec0a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073), 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823), 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107)
W20260709 13:09:06.446987 16912 consensus_peers.cc:597] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:09:06.448737 15057 tablet_replica.cc:333] T 4b962ceebb5c48c1914459ae0c0eff1b P 1109f76a0b7b443a84c0327c8707bc63: stopping tablet replica
I20260709 13:09:06.449719 15057 raft_consensus.cc:2243] T 4b962ceebb5c48c1914459ae0c0eff1b P 1109f76a0b7b443a84c0327c8707bc63 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:09:06.450961 15057 raft_consensus.cc:2272] T 4b962ceebb5c48c1914459ae0c0eff1b P 1109f76a0b7b443a84c0327c8707bc63 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:06.454185 15057 tablet_replica.cc:333] T 540bfc4ad793452faea5b865343aacf7 P 1109f76a0b7b443a84c0327c8707bc63: stopping tablet replica
I20260709 13:09:06.455119 15057 raft_consensus.cc:2243] T 540bfc4ad793452faea5b865343aacf7 P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Raft consensus shutting down.
W20260709 13:09:06.455315 16912 leader_election.cc:336] T a1a76ba8ceae4d0780583a09087cec0a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111)
I20260709 13:09:06.455914 15057 raft_consensus.cc:2272] T 540bfc4ad793452faea5b865343aacf7 P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:06.457083 16914 leader_election.cc:336] T a1a76ba8ceae4d0780583a09087cec0a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Network error: Client connection negotiation failed: client connection to 127.14.180.66:45823: connect: Connection refused (error 111)
I20260709 13:09:06.457655 16914 leader_election.cc:304] T a1a76ba8ceae4d0780583a09087cec0a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 1109f76a0b7b443a84c0327c8707bc63; no voters: 0aea40d6e4374085a2e38a70a71f63e3, e10b16d536674c0bb350a31d7ce5ff7f
W20260709 13:09:06.458782 16912 consensus_peers.cc:597] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:09:06.459246 15057 tablet_replica.cc:333] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63: stopping tablet replica
I20260709 13:09:06.459672 23960 raft_consensus.cc:2749] T a1a76ba8ceae4d0780583a09087cec0a P 1109f76a0b7b443a84c0327c8707bc63 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:09:06.460253 15057 raft_consensus.cc:2243] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Raft consensus shutting down.
W20260709 13:09:06.460632 16914 leader_election.cc:336] T a1a76ba8ceae4d0780583a09087cec0a P 1109f76a0b7b443a84c0327c8707bc63 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 363bb2f744eb486f9ad726f08214c98e (127.14.180.67:46107): Network error: Client connection negotiation failed: client connection to 127.14.180.67:46107: connect: Connection refused (error 111)
I20260709 13:09:06.461174 15057 raft_consensus.cc:2272] T 73757c6fea8949e090aa4e55902a41d4 P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:06.462344 16912 consensus_peers.cc:597] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:09:06.464443 15057 tablet_replica.cc:333] T 6759dbf6a6924fcc870cb52b4a5d7953 P 1109f76a0b7b443a84c0327c8707bc63: stopping tablet replica
I20260709 13:09:06.465118 15057 raft_consensus.cc:2243] T 6759dbf6a6924fcc870cb52b4a5d7953 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 LEARNER]: Raft consensus shutting down.
W20260709 13:09:06.465446 16912 consensus_peers.cc:597] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 -> Peer e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): Couldn't send request to peer e10b16d536674c0bb350a31d7ce5ff7f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:09:06.465694 15057 pending_rounds.cc:70] T 6759dbf6a6924fcc870cb52b4a5d7953 P 1109f76a0b7b443a84c0327c8707bc63: Trying to abort 1 pending ops.
I20260709 13:09:06.465953 15057 pending_rounds.cc:77] T 6759dbf6a6924fcc870cb52b4a5d7953 P 1109f76a0b7b443a84c0327c8707bc63: Aborting op as it isn't in flight: id { term: 1 index: 2 } timestamp: 7305635225638387712 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "6759dbf6a6924fcc870cb52b4a5d7953" old_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } } new_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } attrs { replace: true } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } } }
I20260709 13:09:06.466761 15057 raft_consensus.cc:2917] T 6759dbf6a6924fcc870cb52b4a5d7953 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 LEARNER]: Aborting config change with OpId 1.2: Aborted: Op aborted
I20260709 13:09:06.467132 15057 raft_consensus.cc:2889] T 6759dbf6a6924fcc870cb52b4a5d7953 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 NON_PARTICIPANT]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 13:09:06.467407 15057 raft_consensus.cc:2272] T 6759dbf6a6924fcc870cb52b4a5d7953 P 1109f76a0b7b443a84c0327c8707bc63 [term 2 NON_PARTICIPANT]: Raft consensus is shut down!
I20260709 13:09:06.469918 15057 tablet_replica.cc:333] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63: stopping tablet replica
I20260709 13:09:06.470629 15057 raft_consensus.cc:2243] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:09:06.471668 15057 pending_rounds.cc:70] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63: Trying to abort 1 pending ops.
I20260709 13:09:06.471917 15057 pending_rounds.cc:77] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63: Aborting op as it isn't in flight: id { term: 21 index: 16 } timestamp: 7305636018829705216 op_type: NO_OP noop_request { }
I20260709 13:09:06.472324 15057 raft_consensus.cc:2889] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 21 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:09:06.472709 15057 raft_consensus.cc:2272] T 454d01f56c2d4533a035fdbc026c10b3 P 1109f76a0b7b443a84c0327c8707bc63 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:06.475577 15057 tablet_replica.cc:333] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63: stopping tablet replica
I20260709 13:09:06.476491 15057 raft_consensus.cc:2243] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:09:06.477924 15057 raft_consensus.cc:2272] T 7877d879c7564adfac82b8387dbbc867 P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:06.479005 16914 consensus_peers.cc:597] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 -> Peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Couldn't send request to peer 0aea40d6e4374085a2e38a70a71f63e3. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.66:45823: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:06.479568 16914 consensus_peers.cc:597] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 -> Peer 0aea40d6e4374085a2e38a70a71f63e3 (127.14.180.66:45823): Couldn't send request to peer 0aea40d6e4374085a2e38a70a71f63e3. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.66:45823: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:09:06.480895 15057 tablet_replica.cc:333] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63: stopping tablet replica
I20260709 13:09:06.481648 15057 raft_consensus.cc:2243] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:09:06.482769 15057 raft_consensus.cc:2272] T ae7bbe4140004c26b8f5f8b6b79c9b83 P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:06.484933 15057 tablet_replica.cc:333] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63: stopping tablet replica
I20260709 13:09:06.485579 15057 raft_consensus.cc:2243] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:09:06.486450 15057 raft_consensus.cc:2272] T 39dd6382a0304387a1341bcc36471cbf P 1109f76a0b7b443a84c0327c8707bc63 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:06.488771 15057 tablet_replica.cc:333] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63: stopping tablet replica
I20260709 13:09:06.489373 15057 raft_consensus.cc:2243] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:09:06.490176 15057 pending_rounds.cc:70] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63: Trying to abort 1 pending ops.
I20260709 13:09:06.490334 15057 pending_rounds.cc:77] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63: Aborting op as it isn't in flight: id { term: 21 index: 17 } timestamp: 7305636018838003712 op_type: NO_OP noop_request { }
I20260709 13:09:06.490724 15057 raft_consensus.cc:2889] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 21 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:09:06.491027 15057 raft_consensus.cc:2272] T 26565509c81343bc818483042146461a P 1109f76a0b7b443a84c0327c8707bc63 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:06.493011 15057 tablet_replica.cc:333] T c7d554054f014c74992a2a66ff6873cd P 1109f76a0b7b443a84c0327c8707bc63: stopping tablet replica
I20260709 13:09:06.493693 15057 raft_consensus.cc:2243] T c7d554054f014c74992a2a66ff6873cd P 1109f76a0b7b443a84c0327c8707bc63 [term 2 LEARNER]: Raft consensus shutting down.
I20260709 13:09:06.494122 15057 pending_rounds.cc:70] T c7d554054f014c74992a2a66ff6873cd P 1109f76a0b7b443a84c0327c8707bc63: Trying to abort 1 pending ops.
I20260709 13:09:06.494267 15057 pending_rounds.cc:77] T c7d554054f014c74992a2a66ff6873cd P 1109f76a0b7b443a84c0327c8707bc63: Aborting op as it isn't in flight: id { term: 1 index: 2 } timestamp: 7305635246221651968 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "c7d554054f014c74992a2a66ff6873cd" old_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } } new_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e10b16d536674c0bb350a31d7ce5ff7f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46073 } } peers { permanent_uuid: "0aea40d6e4374085a2e38a70a71f63e3" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 45823 } attrs { replace: true } } peers { permanent_uuid: "363bb2f744eb486f9ad726f08214c98e" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46107 } } peers { permanent_uuid: "1109f76a0b7b443a84c0327c8707bc63" member_type: NON_VOTER last_known_addr { host: "127.14.180.68" port: 36875 } attrs { promote: true } } } }
I20260709 13:09:06.495143 15057 raft_consensus.cc:2917] T c7d554054f014c74992a2a66ff6873cd P 1109f76a0b7b443a84c0327c8707bc63 [term 2 LEARNER]: Aborting config change with OpId 1.2: Aborted: Op aborted
I20260709 13:09:06.495528 15057 raft_consensus.cc:2889] T c7d554054f014c74992a2a66ff6873cd P 1109f76a0b7b443a84c0327c8707bc63 [term 2 NON_PARTICIPANT]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 13:09:06.495806 15057 raft_consensus.cc:2272] T c7d554054f014c74992a2a66ff6873cd P 1109f76a0b7b443a84c0327c8707bc63 [term 2 NON_PARTICIPANT]: Raft consensus is shut down!
I20260709 13:09:06.497864 15057 tablet_replica.cc:333] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63: stopping tablet replica
I20260709 13:09:06.498500 15057 raft_consensus.cc:2243] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:09:06.499456 15057 raft_consensus.cc:2272] T f022e2e63ae4461d834e476ff2666991 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:06.501753 15057 tablet_replica.cc:333] T a1a76ba8ceae4d0780583a09087cec0a P 1109f76a0b7b443a84c0327c8707bc63: stopping tablet replica
I20260709 13:09:06.502411 15057 raft_consensus.cc:2243] T a1a76ba8ceae4d0780583a09087cec0a P 1109f76a0b7b443a84c0327c8707bc63 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:06.503079 15057 raft_consensus.cc:2272] T a1a76ba8ceae4d0780583a09087cec0a P 1109f76a0b7b443a84c0327c8707bc63 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:06.505371 15057 tablet_replica.cc:333] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63: stopping tablet replica
I20260709 13:09:06.506079 15057 raft_consensus.cc:2243] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:09:06.507139 15057 raft_consensus.cc:2272] T b9e1324823f04d8da5a4b3ddbd061c0e P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:06.509375 15057 tablet_replica.cc:333] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63: stopping tablet replica
I20260709 13:09:06.510061 15057 raft_consensus.cc:2243] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:09:06.511077 15057 raft_consensus.cc:2272] T 4f72b5892c874917882ef9ee926ce439 P 1109f76a0b7b443a84c0327c8707bc63 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:06.513127 15057 tablet_replica.cc:333] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63: stopping tablet replica
I20260709 13:09:06.513728 15057 raft_consensus.cc:2243] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:09:06.514685 15057 raft_consensus.cc:2272] T 916cdb289e9442b69dd8ed0c99eb8198 P 1109f76a0b7b443a84c0327c8707bc63 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:06.516731 15057 tablet_replica.cc:333] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63: stopping tablet replica
I20260709 13:09:06.517354 15057 raft_consensus.cc:2243] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:09:06.518219 15057 raft_consensus.cc:2272] T ccde1e8182914560a3c1df0312e6a2b2 P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:06.520457 15057 tablet_replica.cc:333] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63: stopping tablet replica
I20260709 13:09:06.521188 15057 raft_consensus.cc:2243] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:09:06.522023 15057 raft_consensus.cc:2272] T 52982fc727d3451e9c722e63eb4d79ef P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:06.524303 15057 tablet_replica.cc:333] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63: stopping tablet replica
I20260709 13:09:06.524945 15057 raft_consensus.cc:2243] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:06.525490 15057 raft_consensus.cc:2272] T fd0c3c592b464aafaf1d0b94d1e6e360 P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:06.527719 15057 tablet_replica.cc:333] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63: stopping tablet replica
I20260709 13:09:06.528304 15057 raft_consensus.cc:2243] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:09:06.529143 15057 raft_consensus.cc:2272] T 7295dce0baa440b8a197da845581ee81 P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:06.531286 15057 tablet_replica.cc:333] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63: stopping tablet replica
I20260709 13:09:06.531862 15057 raft_consensus.cc:2243] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:06.532385 15057 raft_consensus.cc:2272] T 5063fcda38c2468a8dad5d01023b700a P 1109f76a0b7b443a84c0327c8707bc63 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:06.534657 15057 tablet_replica.cc:333] T cad5db410b3444caafa5090b94f02dba P 1109f76a0b7b443a84c0327c8707bc63: stopping tablet replica
I20260709 13:09:06.535306 15057 raft_consensus.cc:2243] T cad5db410b3444caafa5090b94f02dba P 1109f76a0b7b443a84c0327c8707bc63 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:09:06.536469 15057 raft_consensus.cc:2272] T cad5db410b3444caafa5090b94f02dba P 1109f76a0b7b443a84c0327c8707bc63 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:06.538810 15057 tablet_replica.cc:333] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63: stopping tablet replica
I20260709 13:09:06.539392 15057 raft_consensus.cc:2243] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:06.539896 15057 raft_consensus.cc:2272] T bb3b9c4ba1f147fc8d9858234bfce423 P 1109f76a0b7b443a84c0327c8707bc63 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:06.542318 15057 tablet_replica.cc:333] T 13bc3c8ff9b84838a2664335d7e1582b P 1109f76a0b7b443a84c0327c8707bc63: stopping tablet replica
I20260709 13:09:06.543018 15057 raft_consensus.cc:2243] T 13bc3c8ff9b84838a2664335d7e1582b P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:06.543758 15057 raft_consensus.cc:2272] T 13bc3c8ff9b84838a2664335d7e1582b P 1109f76a0b7b443a84c0327c8707bc63 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:06.546485 15057 tablet_replica.cc:333] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63: stopping tablet replica
I20260709 13:09:06.547130 15057 raft_consensus.cc:2243] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:06.547580 15057 raft_consensus.cc:2272] T 0340758c689242c3979a434fa59589f7 P 1109f76a0b7b443a84c0327c8707bc63 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:06.549417 15057 tablet_replica.cc:333] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63: stopping tablet replica
I20260709 13:09:06.549953 15057 raft_consensus.cc:2243] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:06.550460 15057 raft_consensus.cc:2272] T 552b1776c27a48c194068de522fa45b6 P 1109f76a0b7b443a84c0327c8707bc63 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:06.552577 15057 tablet_replica.cc:333] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63: stopping tablet replica
I20260709 13:09:06.553112 15057 raft_consensus.cc:2243] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:06.553685 15057 raft_consensus.cc:2272] T 9dbc1db111e7466090abdb97a79d0d9b P 1109f76a0b7b443a84c0327c8707bc63 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:06.555708 15057 tablet_replica.cc:333] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63: stopping tablet replica
I20260709 13:09:06.556298 15057 raft_consensus.cc:2243] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:06.556797 15057 raft_consensus.cc:2272] T 38b024fb12204d9b9e35d72638671c24 P 1109f76a0b7b443a84c0327c8707bc63 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:06.559005 15057 tablet_replica.cc:333] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63: stopping tablet replica
I20260709 13:09:06.559561 15057 raft_consensus.cc:2243] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:06.560068 15057 raft_consensus.cc:2272] T 1356ff4c060346359eb10723422e972a P 1109f76a0b7b443a84c0327c8707bc63 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:06.562067 15057 tablet_replica.cc:333] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63: stopping tablet replica
I20260709 13:09:06.562721 15057 raft_consensus.cc:2243] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:09:06.563613 15057 raft_consensus.cc:2272] T 47342899f1ed4c788d60ea4c5b52969a P 1109f76a0b7b443a84c0327c8707bc63 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:06.565908 15057 tablet_replica.cc:333] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63: stopping tablet replica
I20260709 13:09:06.566474 15057 raft_consensus.cc:2243] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:09:06.567466 15057 raft_consensus.cc:2272] T 862e96f5785248c58d0355cac229fc05 P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:06.569449 15057 tablet_replica.cc:333] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63: stopping tablet replica
I20260709 13:09:06.569949 15057 raft_consensus.cc:2243] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:09:06.570937 15057 raft_consensus.cc:2272] T 8b615ac918a749989f2968826926adf3 P 1109f76a0b7b443a84c0327c8707bc63 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:06.573314 15057 tablet_replica.cc:333] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63: stopping tablet replica
I20260709 13:09:06.573839 15057 raft_consensus.cc:2243] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:09:06.574764 15057 raft_consensus.cc:2272] T 186b9e9483624c769871a8894ee07efa P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:06.576931 15057 tablet_replica.cc:333] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63: stopping tablet replica
I20260709 13:09:06.577452 15057 raft_consensus.cc:2243] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:09:06.578262 15057 raft_consensus.cc:2272] T a7ce522fbeb44228a8c05d5ceeadc347 P 1109f76a0b7b443a84c0327c8707bc63 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:06.999850 15057 tablet_server.cc:196] TabletServer@127.14.180.68:0 shutdown complete.
I20260709 13:09:07.075941 15057 master.cc:562] Master@127.14.180.126:35965 shutting down...
W20260709 13:09:07.120048 16154 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 13:09:07.120386 16154 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:09:07.120671 16154 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:09:08.488116 16090 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111) [suppressed 568 similar messages]
W20260709 13:09:08.492700 16090 catalog_manager.cc:4755] TS e10b16d536674c0bb350a31d7ce5ff7f (127.14.180.65:46073): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 5054b6ad2e4141cab2232a3fecd7c858: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46073: connect: Connection refused (error 111)
I20260709 13:09:08.609325 15057 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 4dc6f08597514f4d85fd451b999b403e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:08.609994 15057 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 4dc6f08597514f4d85fd451b999b403e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:08.610357 15057 tablet_replica.cc:333] T 00000000000000000000000000000000 P 4dc6f08597514f4d85fd451b999b403e: stopping tablet replica
I20260709 13:09:08.753667 15057 master.cc:584] Master@127.14.180.126:35965 shutdown complete.
I20260709 13:09:08.793453 15057 test_util.cc:182] -----------------------------------------------
I20260709 13:09:08.793685 15057 test_util.cc:183] Had failures, leaving test files at /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602283040513-15057-0
[  FAILED  ] LeaderRebalancerTest.AddTserver (239062 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 13:09:08.796906 15057 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.14.180.126:35949
I20260709 13:09:08.798033 15057 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:08.804090 23965 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:08.804167 23964 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:08.805006 23967 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:08.807250 15057 server_base.cc:1061] running on GCE node
I20260709 13:09:08.810075 15057 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:08.810343 15057 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:08.810524 15057 hybrid_clock.cc:648] HybridClock initialized: now 1783602548810504 us; error 0 us; skew 500 ppm
I20260709 13:09:08.811179 15057 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:08.815361 15057 webserver.cc:533] Webserver started at http://127.14.180.126:42701/ using document root <none> and password file <none>
I20260709 13:09:08.815970 15057 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:08.816213 15057 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:08.816529 15057 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:08.817896 15057 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602283040513-15057-0/minicluster-data/master-0-root/instance:
uuid: "b4b43535cc894944999253af4c68e388"
format_stamp: "Formatted at 2026-07-09 13:09:08 on dist-test-slave-r9m8"
I20260709 13:09:08.823823 15057 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:09:08.828524 23972 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:08.830024 15057 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 13:09:08.830421 15057 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602283040513-15057-0/minicluster-data/master-0-root
uuid: "b4b43535cc894944999253af4c68e388"
format_stamp: "Formatted at 2026-07-09 13:09:08 on dist-test-slave-r9m8"
I20260709 13:09:08.830816 15057 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602283040513-15057-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602283040513-15057-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602283040513-15057-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:08.845314 15057 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:08.846724 15057 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:08.888652 15057 rpc_server.cc:307] RPC server started. Bound to: 127.14.180.126:35949
I20260709 13:09:08.888974 24023 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.180.126:35949 every 8 connection(s)
I20260709 13:09:08.893024 24024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.905230 24024 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b4b43535cc894944999253af4c68e388: Bootstrap starting.
I20260709 13:09:08.910977 24024 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b4b43535cc894944999253af4c68e388: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:08.916265 24024 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b4b43535cc894944999253af4c68e388: No bootstrap required, opened a new log
I20260709 13:09:08.918673 24024 raft_consensus.cc:359] T 00000000000000000000000000000000 P b4b43535cc894944999253af4c68e388 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4b43535cc894944999253af4c68e388" member_type: VOTER }
I20260709 13:09:08.919102 24024 raft_consensus.cc:385] T 00000000000000000000000000000000 P b4b43535cc894944999253af4c68e388 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:08.919544 24024 raft_consensus.cc:740] T 00000000000000000000000000000000 P b4b43535cc894944999253af4c68e388 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4b43535cc894944999253af4c68e388, State: Initialized, Role: FOLLOWER
I20260709 13:09:08.920230 24024 consensus_queue.cc:260] T 00000000000000000000000000000000 P b4b43535cc894944999253af4c68e388 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4b43535cc894944999253af4c68e388" member_type: VOTER }
I20260709 13:09:08.920737 24024 raft_consensus.cc:399] T 00000000000000000000000000000000 P b4b43535cc894944999253af4c68e388 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:09:08.920965 24024 raft_consensus.cc:493] T 00000000000000000000000000000000 P b4b43535cc894944999253af4c68e388 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:09:08.921252 24024 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b4b43535cc894944999253af4c68e388 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:08.926210 24024 raft_consensus.cc:515] T 00000000000000000000000000000000 P b4b43535cc894944999253af4c68e388 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4b43535cc894944999253af4c68e388" member_type: VOTER }
I20260709 13:09:08.926829 24024 leader_election.cc:304] T 00000000000000000000000000000000 P b4b43535cc894944999253af4c68e388 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b4b43535cc894944999253af4c68e388; no voters: 
I20260709 13:09:08.928030 24024 leader_election.cc:290] T 00000000000000000000000000000000 P b4b43535cc894944999253af4c68e388 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:09:08.928448 24027 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b4b43535cc894944999253af4c68e388 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:08.929863 24027 raft_consensus.cc:697] T 00000000000000000000000000000000 P b4b43535cc894944999253af4c68e388 [term 1 LEADER]: Becoming Leader. State: Replica: b4b43535cc894944999253af4c68e388, State: Running, Role: LEADER
I20260709 13:09:08.930632 24027 consensus_queue.cc:237] T 00000000000000000000000000000000 P b4b43535cc894944999253af4c68e388 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4b43535cc894944999253af4c68e388" member_type: VOTER }
I20260709 13:09:08.931143 24024 sys_catalog.cc:565] T 00000000000000000000000000000000 P b4b43535cc894944999253af4c68e388 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:09:08.936316 24029 sys_catalog.cc:455] T 00000000000000000000000000000000 P b4b43535cc894944999253af4c68e388 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b4b43535cc894944999253af4c68e388. Latest consensus state: current_term: 1 leader_uuid: "b4b43535cc894944999253af4c68e388" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4b43535cc894944999253af4c68e388" member_type: VOTER } }
I20260709 13:09:08.936316 24028 sys_catalog.cc:455] T 00000000000000000000000000000000 P b4b43535cc894944999253af4c68e388 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b4b43535cc894944999253af4c68e388" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b4b43535cc894944999253af4c68e388" member_type: VOTER } }
I20260709 13:09:08.937068 24029 sys_catalog.cc:458] T 00000000000000000000000000000000 P b4b43535cc894944999253af4c68e388 [sys.catalog]: This master's current role is: LEADER
I20260709 13:09:08.937381 24028 sys_catalog.cc:458] T 00000000000000000000000000000000 P b4b43535cc894944999253af4c68e388 [sys.catalog]: This master's current role is: LEADER
I20260709 13:09:08.939591 24033 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:09:08.948202 24033 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:09:08.949297 15057 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:09:08.958930 24033 catalog_manager.cc:1383] Generated new cluster ID: d36d62f99ad047afad7d555e08272a09
I20260709 13:09:08.959230 24033 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:09:08.980978 24033 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:09:08.982311 24033 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:09:08.997704 24033 catalog_manager.cc:6070] T 00000000000000000000000000000000 P b4b43535cc894944999253af4c68e388: Generated new TSK 0
I20260709 13:09:08.998364 24033 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:09:09.017024 15057 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:09.023808 24045 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:09.025206 24046 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:09.029173 15057 server_base.cc:1061] running on GCE node
W20260709 13:09:09.029592 24048 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:09.035491 15057 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:09.035737 15057 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:09.035954 15057 hybrid_clock.cc:648] HybridClock initialized: now 1783602549035937 us; error 0 us; skew 500 ppm
I20260709 13:09:09.036567 15057 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:09.039529 15057 webserver.cc:533] Webserver started at http://127.14.180.65:46761/ using document root <none> and password file <none>
I20260709 13:09:09.040104 15057 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:09.040311 15057 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:09.040630 15057 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:09.041900 15057 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602283040513-15057-0/minicluster-data/ts-0-root/instance:
uuid: "dea34817fcc148d78f090ef5fa72304f"
format_stamp: "Formatted at 2026-07-09 13:09:09 on dist-test-slave-r9m8"
I20260709 13:09:09.047108 15057 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:09:09.051252 24053 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:09.052264 15057 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.002s
I20260709 13:09:09.052632 15057 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602283040513-15057-0/minicluster-data/ts-0-root
uuid: "dea34817fcc148d78f090ef5fa72304f"
format_stamp: "Formatted at 2026-07-09 13:09:09 on dist-test-slave-r9m8"
I20260709 13:09:09.052991 15057 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602283040513-15057-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602283040513-15057-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602283040513-15057-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:09.068746 15057 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:09.070050 15057 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:09.071696 15057 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:09.074082 15057 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:09.074337 15057 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:09.074659 15057 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:09.074877 15057 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:09.121290 15057 rpc_server.cc:307] RPC server started. Bound to: 127.14.180.65:36343
I20260709 13:09:09.121425 24115 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.180.65:36343 every 8 connection(s)
I20260709 13:09:09.127146 15057 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:09.135768 24120 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:09.137295 24121 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:09.142360 15057 server_base.cc:1061] running on GCE node
W20260709 13:09:09.142391 24124 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:09.145871 15057 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:09.146257 15057 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:09.146530 15057 hybrid_clock.cc:648] HybridClock initialized: now 1783602549146506 us; error 0 us; skew 500 ppm
I20260709 13:09:09.147318 15057 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:09.148064 24116 heartbeater.cc:344] Connected to a master server at 127.14.180.126:35949
I20260709 13:09:09.148542 24116 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:09.149472 24116 heartbeater.cc:507] Master 127.14.180.126:35949 requested a full tablet report, sending...
I20260709 13:09:09.150341 15057 webserver.cc:533] Webserver started at http://127.14.180.66:42677/ using document root <none> and password file <none>
I20260709 13:09:09.151058 15057 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:09.151283 15057 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:09.151595 15057 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:09.152256 23989 ts_manager.cc:194] Registered new tserver with Master: dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343)
I20260709 13:09:09.152913 15057 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602283040513-15057-0/minicluster-data/ts-1-root/instance:
uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5"
format_stamp: "Formatted at 2026-07-09 13:09:09 on dist-test-slave-r9m8"
I20260709 13:09:09.154425 23989 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37656
I20260709 13:09:09.158540 15057 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:09:09.162689 24128 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:09.163720 15057 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:09:09.164096 15057 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602283040513-15057-0/minicluster-data/ts-1-root
uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5"
format_stamp: "Formatted at 2026-07-09 13:09:09 on dist-test-slave-r9m8"
I20260709 13:09:09.164415 15057 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602283040513-15057-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602283040513-15057-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602283040513-15057-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:09.179522 15057 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:09.180763 15057 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:09.182310 15057 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:09.184720 15057 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:09.184974 15057 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:09.185237 15057 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:09.185418 15057 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:09.233371 15057 rpc_server.cc:307] RPC server started. Bound to: 127.14.180.66:37431
I20260709 13:09:09.233474 24190 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.180.66:37431 every 8 connection(s)
I20260709 13:09:09.238615 15057 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:09.246511 24194 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:09.248600 24195 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:09.250955 24197 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:09.251432 15057 server_base.cc:1061] running on GCE node
I20260709 13:09:09.252382 15057 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:09.252641 15057 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:09.252843 15057 hybrid_clock.cc:648] HybridClock initialized: now 1783602549252826 us; error 0 us; skew 500 ppm
I20260709 13:09:09.253391 15057 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:09.253770 24191 heartbeater.cc:344] Connected to a master server at 127.14.180.126:35949
I20260709 13:09:09.254240 24191 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:09.255406 24191 heartbeater.cc:507] Master 127.14.180.126:35949 requested a full tablet report, sending...
I20260709 13:09:09.256539 15057 webserver.cc:533] Webserver started at http://127.14.180.67:44039/ using document root <none> and password file <none>
I20260709 13:09:09.257189 15057 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:09.257426 15057 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:09.257714 15057 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:09.257862 23989 ts_manager.cc:194] Registered new tserver with Master: c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431)
I20260709 13:09:09.259253 15057 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602283040513-15057-0/minicluster-data/ts-2-root/instance:
uuid: "f8d4657116f948038a0c73018238c3ba"
format_stamp: "Formatted at 2026-07-09 13:09:09 on dist-test-slave-r9m8"
I20260709 13:09:09.259328 23989 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37670
I20260709 13:09:09.264779 15057 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:09:09.268673 24202 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:09.269662 15057 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:09:09.269946 15057 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602283040513-15057-0/minicluster-data/ts-2-root
uuid: "f8d4657116f948038a0c73018238c3ba"
format_stamp: "Formatted at 2026-07-09 13:09:09 on dist-test-slave-r9m8"
I20260709 13:09:09.270202 15057 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602283040513-15057-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602283040513-15057-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602283040513-15057-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:09.286845 15057 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:09.288084 15057 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:09.289666 15057 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:09.292323 15057 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:09.292590 15057 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:09.292906 15057 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:09.293066 15057 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:09.337865 15057 rpc_server.cc:307] RPC server started. Bound to: 127.14.180.67:46171
I20260709 13:09:09.338002 24264 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.180.67:46171 every 8 connection(s)
I20260709 13:09:09.343084 15057 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:09.349979 24268 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:09.351708 24269 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:09.353667 24271 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:09.355007 15057 server_base.cc:1061] running on GCE node
I20260709 13:09:09.355916 24265 heartbeater.cc:344] Connected to a master server at 127.14.180.126:35949
I20260709 13:09:09.356230 15057 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:09:09.356374 24265 heartbeater.cc:461] Registering TS with master...
W20260709 13:09:09.356546 15057 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:09.356792 15057 hybrid_clock.cc:648] HybridClock initialized: now 1783602549356773 us; error 0 us; skew 500 ppm
I20260709 13:09:09.357370 24265 heartbeater.cc:507] Master 127.14.180.126:35949 requested a full tablet report, sending...
I20260709 13:09:09.357621 15057 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:09.359998 23989 ts_manager.cc:194] Registered new tserver with Master: f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171)
I20260709 13:09:09.360598 15057 webserver.cc:533] Webserver started at http://127.14.180.68:41159/ using document root <none> and password file <none>
I20260709 13:09:09.361138 15057 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:09.361346 15057 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:09.361614 15057 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:09.361608 23989 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37686
I20260709 13:09:09.363191 15057 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602283040513-15057-0/minicluster-data/ts-3-root/instance:
uuid: "b39c386162de49aca92dbebee7f06ace"
format_stamp: "Formatted at 2026-07-09 13:09:09 on dist-test-slave-r9m8"
I20260709 13:09:09.368016 15057 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:09:09.371672 24276 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:09.372556 15057 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:09:09.372897 15057 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602283040513-15057-0/minicluster-data/ts-3-root
uuid: "b39c386162de49aca92dbebee7f06ace"
format_stamp: "Formatted at 2026-07-09 13:09:09 on dist-test-slave-r9m8"
I20260709 13:09:09.373226 15057 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602283040513-15057-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602283040513-15057-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602283040513-15057-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:09.398077 15057 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:09.399729 15057 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:09.401721 15057 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:09.404829 15057 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:09.405174 15057 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:09.405532 15057 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:09.405772 15057 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:09.456130 15057 rpc_server.cc:307] RPC server started. Bound to: 127.14.180.68:38561
I20260709 13:09:09.456233 24338 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.180.68:38561 every 8 connection(s)
I20260709 13:09:09.471155 24339 heartbeater.cc:344] Connected to a master server at 127.14.180.126:35949
I20260709 13:09:09.471720 24339 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:09.472589 24339 heartbeater.cc:507] Master 127.14.180.126:35949 requested a full tablet report, sending...
I20260709 13:09:09.474870 23989 ts_manager.cc:194] Registered new tserver with Master: b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561)
I20260709 13:09:09.475332 15057 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.015363622s
I20260709 13:09:09.476744 23989 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37700
I20260709 13:09:09.509156 23989 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37704:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 13:09:09.753994 24156 tablet_service.cc:1511] Processing CreateTablet for tablet 5a8830d169ce4e46807d04168c3bb086 (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:09:09.755273 24081 tablet_service.cc:1511] Processing CreateTablet for tablet 5a8830d169ce4e46807d04168c3bb086 (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:09:09.757097 24081 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a8830d169ce4e46807d04168c3bb086. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.761054 24155 tablet_service.cc:1511] Processing CreateTablet for tablet de5786fbd53646a9bc152ac0a2a9aa53 (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:09:09.758046 24080 tablet_service.cc:1511] Processing CreateTablet for tablet de5786fbd53646a9bc152ac0a2a9aa53 (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:09:09.765277 24080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de5786fbd53646a9bc152ac0a2a9aa53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.765507 24079 tablet_service.cc:1511] Processing CreateTablet for tablet 42868db4862647c28215f3d7cb9adf02 (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:09:09.767169 24079 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42868db4862647c28215f3d7cb9adf02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.755893 24156 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a8830d169ce4e46807d04168c3bb086. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.768978 24230 tablet_service.cc:1511] Processing CreateTablet for tablet de5786fbd53646a9bc152ac0a2a9aa53 (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:09:09.769819 24154 tablet_service.cc:1511] Processing CreateTablet for tablet c5873f7465894eddab6fa84daecdcc84 (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:09:09.770506 24230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de5786fbd53646a9bc152ac0a2a9aa53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.771359 24154 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5873f7465894eddab6fa84daecdcc84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.787642 24075 tablet_service.cc:1511] Processing CreateTablet for tablet 502fe798081f4dc693eed179efa2a241 (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:09:09.789157 24075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 502fe798081f4dc693eed179efa2a241. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.771878 24229 tablet_service.cc:1511] Processing CreateTablet for tablet 42868db4862647c28215f3d7cb9adf02 (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:09:09.793027 24229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42868db4862647c28215f3d7cb9adf02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.794955 24155 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de5786fbd53646a9bc152ac0a2a9aa53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.801193 24149 tablet_service.cc:1511] Processing CreateTablet for tablet 1541f6b04d914d10823ad78c03d9a847 (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:09:09.802879 24149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1541f6b04d914d10823ad78c03d9a847. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.802573 24074 tablet_service.cc:1511] Processing CreateTablet for tablet 1541f6b04d914d10823ad78c03d9a847 (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:09:09.804045 24074 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1541f6b04d914d10823ad78c03d9a847. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.804836 24072 tablet_service.cc:1511] Processing CreateTablet for tablet 93e868a924d74bbc8bf29aa5a7fc67fd (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:09:09.806270 24072 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93e868a924d74bbc8bf29aa5a7fc67fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.781904 24076 tablet_service.cc:1511] Processing CreateTablet for tablet f735173e22b242178edcdf4821b6f92b (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:09:09.808140 24076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f735173e22b242178edcdf4821b6f92b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.783561 24151 tablet_service.cc:1511] Processing CreateTablet for tablet c7b586130d5842f293b0df4b02792ec6 (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:09:09.779500 24227 tablet_service.cc:1511] Processing CreateTablet for tablet 49393e5cc2614c90b69a3bb2348dacb9 (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:09:09.812229 24148 tablet_service.cc:1511] Processing CreateTablet for tablet aac6068ee4554cce8f2d534a106ef417 (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:09:09.774426 24078 tablet_service.cc:1511] Processing CreateTablet for tablet 49393e5cc2614c90b69a3bb2348dacb9 (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:09:09.812274 24151 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7b586130d5842f293b0df4b02792ec6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.813894 24078 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49393e5cc2614c90b69a3bb2348dacb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.817993 24148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aac6068ee4554cce8f2d534a106ef417. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.775647 24153 tablet_service.cc:1511] Processing CreateTablet for tablet 49393e5cc2614c90b69a3bb2348dacb9 (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:09:09.820184 24153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49393e5cc2614c90b69a3bb2348dacb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.777062 24077 tablet_service.cc:1511] Processing CreateTablet for tablet 45b65ebcb0114044a04e5689db4a466f (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:09:09.798318 24150 tablet_service.cc:1511] Processing CreateTablet for tablet 502fe798081f4dc693eed179efa2a241 (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:09:09.773099 24228 tablet_service.cc:1511] Processing CreateTablet for tablet c5873f7465894eddab6fa84daecdcc84 (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:09:09.825276 24150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 502fe798081f4dc693eed179efa2a241. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.801450 24073 tablet_service.cc:1511] Processing CreateTablet for tablet 46f373ffd46f4625bac910b5ccf4b767 (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:09:09.826854 24147 tablet_service.cc:1511] Processing CreateTablet for tablet 93e868a924d74bbc8bf29aa5a7fc67fd (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:09:09.780676 24152 tablet_service.cc:1511] Processing CreateTablet for tablet 45b65ebcb0114044a04e5689db4a466f (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:09:09.828667 24147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93e868a924d74bbc8bf29aa5a7fc67fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.830010 24226 tablet_service.cc:1511] Processing CreateTablet for tablet f735173e22b242178edcdf4821b6f92b (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:09:09.832823 24225 tablet_service.cc:1511] Processing CreateTablet for tablet c7b586130d5842f293b0df4b02792ec6 (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:09:09.837604 24222 tablet_service.cc:1511] Processing CreateTablet for tablet aac6068ee4554cce8f2d534a106ef417 (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:09:09.840363 24221 tablet_service.cc:1511] Processing CreateTablet for tablet 93e868a924d74bbc8bf29aa5a7fc67fd (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:09:09.825276 24077 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45b65ebcb0114044a04e5689db4a466f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.843334 24223 tablet_service.cc:1511] Processing CreateTablet for tablet 46f373ffd46f4625bac910b5ccf4b767 (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:09:09.835594 24224 tablet_service.cc:1511] Processing CreateTablet for tablet 502fe798081f4dc693eed179efa2a241 (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:09:09.846642 24073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46f373ffd46f4625bac910b5ccf4b767. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.841722 24152 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45b65ebcb0114044a04e5689db4a466f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.856699 24228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5873f7465894eddab6fa84daecdcc84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.858937 24225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7b586130d5842f293b0df4b02792ec6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.861135 24224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 502fe798081f4dc693eed179efa2a241. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.863055 24222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aac6068ee4554cce8f2d534a106ef417. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.866988 24221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93e868a924d74bbc8bf29aa5a7fc67fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.870995 24223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46f373ffd46f4625bac910b5ccf4b767. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.877667 24226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f735173e22b242178edcdf4821b6f92b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.878468 24227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49393e5cc2614c90b69a3bb2348dacb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.927834 24360 tablet_bootstrap.cc:492] T 502fe798081f4dc693eed179efa2a241 P c0f503bf8bb94af8a2a1139db4e1c0f5: Bootstrap starting.
I20260709 13:09:09.936910 24304 tablet_service.cc:1511] Processing CreateTablet for tablet 5a8830d169ce4e46807d04168c3bb086 (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:09:09.937733 24302 tablet_service.cc:1511] Processing CreateTablet for tablet c5873f7465894eddab6fa84daecdcc84 (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:09:09.939054 24303 tablet_service.cc:1511] Processing CreateTablet for tablet 42868db4862647c28215f3d7cb9adf02 (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:09:09.974229 24303 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42868db4862647c28215f3d7cb9adf02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.939926 24300 tablet_service.cc:1511] Processing CreateTablet for tablet f735173e22b242178edcdf4821b6f92b (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:09:09.941990 24299 tablet_service.cc:1511] Processing CreateTablet for tablet c7b586130d5842f293b0df4b02792ec6 (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
W20260709 13:09:09.944468 24037 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:09.943977 24081 tablet_service.cc:1511] Processing CreateTablet for tablet b1d1d7dd508b43489431371c4ece4fa4 (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:09:09.979540 24304 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a8830d169ce4e46807d04168c3bb086. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.980443 24081 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1d1d7dd508b43489431371c4ece4fa4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.978931 24359 tablet_bootstrap.cc:492] T 5a8830d169ce4e46807d04168c3bb086 P dea34817fcc148d78f090ef5fa72304f: Bootstrap starting.
I20260709 13:09:09.947664 24150 tablet_service.cc:1511] Processing CreateTablet for tablet 9acec0d1a6e74a4bb39a0d867598acc5 (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:09:09.947970 24296 tablet_service.cc:1511] Processing CreateTablet for tablet aac6068ee4554cce8f2d534a106ef417 (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:09:09.950171 24295 tablet_service.cc:1511] Processing CreateTablet for tablet 9acec0d1a6e74a4bb39a0d867598acc5 (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:09:09.946183 24297 tablet_service.cc:1511] Processing CreateTablet for tablet 46f373ffd46f4625bac910b5ccf4b767 (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:09:09.952864 24301 tablet_service.cc:1511] Processing CreateTablet for tablet 45b65ebcb0114044a04e5689db4a466f (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:09:09.958904 24075 tablet_service.cc:1511] Processing CreateTablet for tablet 47fcd2aa8e994186872c2e0f9995dd8a (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:09:09.991416 24299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7b586130d5842f293b0df4b02792ec6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.991441 24075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47fcd2aa8e994186872c2e0f9995dd8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.964584 24153 tablet_service.cc:1511] Processing CreateTablet for tablet 95774511405b4ed8aadbab3d362c068e (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:09:09.944064 24298 tablet_service.cc:1511] Processing CreateTablet for tablet 1541f6b04d914d10823ad78c03d9a847 (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:09:09.994591 24302 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5873f7465894eddab6fa84daecdcc84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.003707 24230 tablet_service.cc:1511] Processing CreateTablet for tablet 95774511405b4ed8aadbab3d362c068e (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:09:09.996753 24078 tablet_service.cc:1511] Processing CreateTablet for tablet 7da69453741f4b73a0092f56f29b1000 (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:09:10.011160 24150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9acec0d1a6e74a4bb39a0d867598acc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.012239 24078 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7da69453741f4b73a0092f56f29b1000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.011302 24230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95774511405b4ed8aadbab3d362c068e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.015478 24296 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aac6068ee4554cce8f2d534a106ef417. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.017810 24295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9acec0d1a6e74a4bb39a0d867598acc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.020108 24301 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45b65ebcb0114044a04e5689db4a466f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.990379 24227 tablet_service.cc:1511] Processing CreateTablet for tablet b1d1d7dd508b43489431371c4ece4fa4 (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:09:10.021541 24300 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f735173e22b242178edcdf4821b6f92b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.022257 24297 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46f373ffd46f4625bac910b5ccf4b767. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.022496 24227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1d1d7dd508b43489431371c4ece4fa4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.023713 24298 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1541f6b04d914d10823ad78c03d9a847. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.034026 24079 tablet_service.cc:1511] Processing CreateTablet for tablet 99078769583e49908dd6990f1d806453 (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:09:10.035614 24079 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99078769583e49908dd6990f1d806453. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.046593 24225 tablet_service.cc:1511] Processing CreateTablet for tablet 47fcd2aa8e994186872c2e0f9995dd8a (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:09:10.047410 24224 tablet_service.cc:1511] Processing CreateTablet for tablet 861d7d76be4d484a9eb3acf8abffae5f (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:09:10.048230 24225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47fcd2aa8e994186872c2e0f9995dd8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.055531 24076 tablet_service.cc:1511] Processing CreateTablet for tablet 861d7d76be4d484a9eb3acf8abffae5f (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:09:10.057049 24076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 861d7d76be4d484a9eb3acf8abffae5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.058964 24224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 861d7d76be4d484a9eb3acf8abffae5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.063949 24079 tablet_service.cc:1511] Processing CreateTablet for tablet d17a6bbfc9d8478988b08964765c3b86 (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:09:10.065552 24079 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d17a6bbfc9d8478988b08964765c3b86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.077349 24080 tablet_service.cc:1511] Processing CreateTablet for tablet 9acec0d1a6e74a4bb39a0d867598acc5 (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:09:10.079252 24080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9acec0d1a6e74a4bb39a0d867598acc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.080096 24148 tablet_service.cc:1511] Processing CreateTablet for tablet 861d7d76be4d484a9eb3acf8abffae5f (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:09:10.080274 24150 tablet_service.cc:1511] Processing CreateTablet for tablet d17a6bbfc9d8478988b08964765c3b86 (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:09:10.081696 24148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 861d7d76be4d484a9eb3acf8abffae5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.082346 24150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d17a6bbfc9d8478988b08964765c3b86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.085839 24221 tablet_service.cc:1511] Processing CreateTablet for tablet 99078769583e49908dd6990f1d806453 (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:09:10.087507 24221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99078769583e49908dd6990f1d806453. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.087663 24154 tablet_service.cc:1511] Processing CreateTablet for tablet 7da69453741f4b73a0092f56f29b1000 (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:09:10.091078 24151 tablet_service.cc:1511] Processing CreateTablet for tablet 1cefd1de9d9a4839b200c2472b3aeefc (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:09:10.100391 24147 tablet_service.cc:1511] Processing CreateTablet for tablet ee2c640a38d44afebd95dfec0e30b0d6 (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:09:10.104434 24153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95774511405b4ed8aadbab3d362c068e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.111821 24073 tablet_service.cc:1511] Processing CreateTablet for tablet f662efc86a73450cac065505b63cb883 (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:09:10.015492 24149 tablet_service.cc:1511] Processing CreateTablet for tablet 47fcd2aa8e994186872c2e0f9995dd8a (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:09:10.127012 24149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47fcd2aa8e994186872c2e0f9995dd8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.128293 24147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee2c640a38d44afebd95dfec0e30b0d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.111902 24222 tablet_service.cc:1511] Processing CreateTablet for tablet 9a126a61cad843b4a3b34fac0f85a1d2 (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:09:10.125391 24223 tablet_service.cc:1511] Processing CreateTablet for tablet f662efc86a73450cac065505b63cb883 (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:09:10.129302 24073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f662efc86a73450cac065505b63cb883. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.136065 24304 tablet_service.cc:1511] Processing CreateTablet for tablet 1cefd1de9d9a4839b200c2472b3aeefc (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:09:10.140422 24361 tablet_bootstrap.cc:492] T 502fe798081f4dc693eed179efa2a241 P f8d4657116f948038a0c73018238c3ba: Bootstrap starting.
I20260709 13:09:10.141064 24304 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cefd1de9d9a4839b200c2472b3aeefc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.143026 24154 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7da69453741f4b73a0092f56f29b1000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.144068 24228 tablet_service.cc:1511] Processing CreateTablet for tablet 1cefd1de9d9a4839b200c2472b3aeefc (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:09:10.126067 24152 tablet_service.cc:1511] Processing CreateTablet for tablet 9a126a61cad843b4a3b34fac0f85a1d2 (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:09:10.117718 24359 tablet_bootstrap.cc:654] T 5a8830d169ce4e46807d04168c3bb086 P dea34817fcc148d78f090ef5fa72304f: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:10.136503 24222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a126a61cad843b4a3b34fac0f85a1d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.148272 24362 tablet_bootstrap.cc:492] T 5a8830d169ce4e46807d04168c3bb086 P b39c386162de49aca92dbebee7f06ace: Bootstrap starting.
I20260709 13:09:10.150990 24075 tablet_service.cc:1511] Processing CreateTablet for tablet ee2c640a38d44afebd95dfec0e30b0d6 (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:09:10.173067 24075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee2c640a38d44afebd95dfec0e30b0d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.158039 24116 heartbeater.cc:499] Master 127.14.180.126:35949 was elected leader, sending a full tablet report...
I20260709 13:09:10.184533 24225 tablet_service.cc:1511] Processing CreateTablet for tablet ee2c640a38d44afebd95dfec0e30b0d6 (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:09:10.186174 24225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee2c640a38d44afebd95dfec0e30b0d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.162395 24360 tablet_bootstrap.cc:654] T 502fe798081f4dc693eed179efa2a241 P c0f503bf8bb94af8a2a1139db4e1c0f5: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:10.188230 24229 tablet_service.cc:1511] Processing CreateTablet for tablet c9b7bd5d439d455a9173478e086439e8 (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:09:10.192569 24361 tablet_bootstrap.cc:654] T 502fe798081f4dc693eed179efa2a241 P f8d4657116f948038a0c73018238c3ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:10.160358 24072 tablet_service.cc:1511] Processing CreateTablet for tablet e845188d32d2466a92eacdb66da16dba (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:09:10.199653 24072 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e845188d32d2466a92eacdb66da16dba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.164757 24078 tablet_service.cc:1511] Processing CreateTablet for tablet c9b7bd5d439d455a9173478e086439e8 (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:09:10.203182 24078 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9b7bd5d439d455a9173478e086439e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.165226 24152 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a126a61cad843b4a3b34fac0f85a1d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.157187 24156 tablet_service.cc:1511] Processing CreateTablet for tablet e845188d32d2466a92eacdb66da16dba (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:09:10.207268 24362 tablet_bootstrap.cc:654] T 5a8830d169ce4e46807d04168c3bb086 P b39c386162de49aca92dbebee7f06ace: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:10.207772 24156 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e845188d32d2466a92eacdb66da16dba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.208338 24230 tablet_service.cc:1511] Processing CreateTablet for tablet e335cd6afc4349cfaafa2970bccb40ff (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:09:10.211613 24151 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cefd1de9d9a4839b200c2472b3aeefc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.230783 24229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9b7bd5d439d455a9173478e086439e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.244908 24150 tablet_service.cc:1511] Processing CreateTablet for tablet e335cd6afc4349cfaafa2970bccb40ff (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:09:10.246730 24077 tablet_service.cc:1511] Processing CreateTablet for tablet e6f709868be149759ecdc073fe125bec (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:09:10.248137 24077 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6f709868be149759ecdc073fe125bec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.248538 24303 tablet_service.cc:1511] Processing CreateTablet for tablet b1d1d7dd508b43489431371c4ece4fa4 (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:09:10.249907 24303 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1d1d7dd508b43489431371c4ece4fa4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.251972 24300 tablet_service.cc:1511] Processing CreateTablet for tablet 95774511405b4ed8aadbab3d362c068e (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:09:10.251626 24226 tablet_service.cc:1511] Processing CreateTablet for tablet e6f709868be149759ecdc073fe125bec (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:09:10.253468 24300 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95774511405b4ed8aadbab3d362c068e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.253554 24226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6f709868be149759ecdc073fe125bec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.260708 24297 tablet_service.cc:1511] Processing CreateTablet for tablet 99078769583e49908dd6990f1d806453 (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:09:10.262146 24297 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99078769583e49908dd6990f1d806453. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.262362 24191 heartbeater.cc:499] Master 127.14.180.126:35949 was elected leader, sending a full tablet report...
I20260709 13:09:10.246356 24150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e335cd6afc4349cfaafa2970bccb40ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.252067 24299 tablet_service.cc:1511] Processing CreateTablet for tablet 7da69453741f4b73a0092f56f29b1000 (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:09:10.265554 24299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7da69453741f4b73a0092f56f29b1000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.271867 24301 tablet_service.cc:1511] Processing CreateTablet for tablet 9a126a61cad843b4a3b34fac0f85a1d2 (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:09:10.273535 24301 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a126a61cad843b4a3b34fac0f85a1d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.282764 24230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e335cd6afc4349cfaafa2970bccb40ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.301021 24360 tablet_bootstrap.cc:492] T 502fe798081f4dc693eed179efa2a241 P c0f503bf8bb94af8a2a1139db4e1c0f5: No bootstrap required, opened a new log
I20260709 13:09:10.301626 24360 ts_tablet_manager.cc:1403] T 502fe798081f4dc693eed179efa2a241 P c0f503bf8bb94af8a2a1139db4e1c0f5: Time spent bootstrapping tablet: real 0.374s	user 0.009s	sys 0.005s
I20260709 13:09:10.307008 24228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cefd1de9d9a4839b200c2472b3aeefc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.318526 24153 tablet_service.cc:1511] Processing CreateTablet for tablet e6f709868be149759ecdc073fe125bec (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:09:10.320976 24153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6f709868be149759ecdc073fe125bec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.321264 24359 tablet_bootstrap.cc:492] T 5a8830d169ce4e46807d04168c3bb086 P dea34817fcc148d78f090ef5fa72304f: No bootstrap required, opened a new log
I20260709 13:09:10.322146 24359 ts_tablet_manager.cc:1403] T 5a8830d169ce4e46807d04168c3bb086 P dea34817fcc148d78f090ef5fa72304f: Time spent bootstrapping tablet: real 0.347s	user 0.013s	sys 0.009s
I20260709 13:09:10.326946 24295 tablet_service.cc:1511] Processing CreateTablet for tablet f662efc86a73450cac065505b63cb883 (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:09:10.328471 24295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f662efc86a73450cac065505b63cb883. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.333810 24298 tablet_service.cc:1511] Processing CreateTablet for tablet e845188d32d2466a92eacdb66da16dba (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:09:10.372994 24298 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e845188d32d2466a92eacdb66da16dba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.373190 24224 tablet_service.cc:1511] Processing CreateTablet for tablet 5bc4e407c8b04739aa0290922bfdbed4 (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:09:10.374125 24361 tablet_bootstrap.cc:492] T 502fe798081f4dc693eed179efa2a241 P f8d4657116f948038a0c73018238c3ba: No bootstrap required, opened a new log
I20260709 13:09:10.335057 24304 tablet_service.cc:1511] Processing CreateTablet for tablet c9b7bd5d439d455a9173478e086439e8 (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:09:10.374863 24361 ts_tablet_manager.cc:1403] T 502fe798081f4dc693eed179efa2a241 P f8d4657116f948038a0c73018238c3ba: Time spent bootstrapping tablet: real 0.235s	user 0.022s	sys 0.070s
I20260709 13:09:10.375339 24304 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9b7bd5d439d455a9173478e086439e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.376609 24079 tablet_service.cc:1511] Processing CreateTablet for tablet 687efb9bbbd04b0eb768bfa6543380c3 (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:09:10.378170 24079 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 687efb9bbbd04b0eb768bfa6543380c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.344696 24360 raft_consensus.cc:359] T 502fe798081f4dc693eed179efa2a241 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:10.378751 24360 raft_consensus.cc:385] T 502fe798081f4dc693eed179efa2a241 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:10.379099 24360 raft_consensus.cc:740] T 502fe798081f4dc693eed179efa2a241 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0f503bf8bb94af8a2a1139db4e1c0f5, State: Initialized, Role: FOLLOWER
I20260709 13:09:10.379395 24361 raft_consensus.cc:359] T 502fe798081f4dc693eed179efa2a241 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:10.362167 24296 tablet_service.cc:1511] Processing CreateTablet for tablet d17a6bbfc9d8478988b08964765c3b86 (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:09:10.364470 24265 heartbeater.cc:499] Master 127.14.180.126:35949 was elected leader, sending a full tablet report...
I20260709 13:09:10.380460 24361 raft_consensus.cc:385] T 502fe798081f4dc693eed179efa2a241 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:10.381036 24361 raft_consensus.cc:740] T 502fe798081f4dc693eed179efa2a241 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8d4657116f948038a0c73018238c3ba, State: Initialized, Role: FOLLOWER
I20260709 13:09:10.382036 24361 consensus_queue.cc:260] T 502fe798081f4dc693eed179efa2a241 P f8d4657116f948038a0c73018238c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:10.383033 24296 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d17a6bbfc9d8478988b08964765c3b86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.384574 24149 tablet_service.cc:1511] Processing CreateTablet for tablet 687efb9bbbd04b0eb768bfa6543380c3 (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:09:10.385977 24149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 687efb9bbbd04b0eb768bfa6543380c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.367566 24362 tablet_bootstrap.cc:492] T 5a8830d169ce4e46807d04168c3bb086 P b39c386162de49aca92dbebee7f06ace: No bootstrap required, opened a new log
I20260709 13:09:10.387063 24362 ts_tablet_manager.cc:1403] T 5a8830d169ce4e46807d04168c3bb086 P b39c386162de49aca92dbebee7f06ace: Time spent bootstrapping tablet: real 0.239s	user 0.017s	sys 0.023s
I20260709 13:09:10.368216 24223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f662efc86a73450cac065505b63cb883. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.394941 24224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bc4e407c8b04739aa0290922bfdbed4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.394671 24359 raft_consensus.cc:359] T 5a8830d169ce4e46807d04168c3bb086 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:10.395874 24359 raft_consensus.cc:385] T 5a8830d169ce4e46807d04168c3bb086 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:10.396369 24359 raft_consensus.cc:740] T 5a8830d169ce4e46807d04168c3bb086 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dea34817fcc148d78f090ef5fa72304f, State: Initialized, Role: FOLLOWER
I20260709 13:09:10.397697 24359 consensus_queue.cc:260] T 5a8830d169ce4e46807d04168c3bb086 P dea34817fcc148d78f090ef5fa72304f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:10.402762 24302 tablet_service.cc:1511] Processing CreateTablet for tablet e335cd6afc4349cfaafa2970bccb40ff (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:09:10.403594 24361 ts_tablet_manager.cc:1434] T 502fe798081f4dc693eed179efa2a241 P f8d4657116f948038a0c73018238c3ba: Time spent starting tablet: real 0.028s	user 0.013s	sys 0.000s
I20260709 13:09:10.404238 24302 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e335cd6afc4349cfaafa2970bccb40ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.405057 24361 tablet_bootstrap.cc:492] T de5786fbd53646a9bc152ac0a2a9aa53 P f8d4657116f948038a0c73018238c3ba: Bootstrap starting.
I20260709 13:09:10.379923 24360 consensus_queue.cc:260] T 502fe798081f4dc693eed179efa2a241 P c0f503bf8bb94af8a2a1139db4e1c0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:10.464725 24361 tablet_bootstrap.cc:654] T de5786fbd53646a9bc152ac0a2a9aa53 P f8d4657116f948038a0c73018238c3ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:10.467572 24360 ts_tablet_manager.cc:1434] T 502fe798081f4dc693eed179efa2a241 P c0f503bf8bb94af8a2a1139db4e1c0f5: Time spent starting tablet: real 0.166s	user 0.014s	sys 0.000s
I20260709 13:09:10.469111 24360 tablet_bootstrap.cc:492] T 1541f6b04d914d10823ad78c03d9a847 P c0f503bf8bb94af8a2a1139db4e1c0f5: Bootstrap starting.
I20260709 13:09:10.480166 24339 heartbeater.cc:499] Master 127.14.180.126:35949 was elected leader, sending a full tablet report...
W20260709 13:09:10.489368 24192 tablet.cc:2406] T 502fe798081f4dc693eed179efa2a241 P c0f503bf8bb94af8a2a1139db4e1c0f5: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260709 13:09:10.503237 23976 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.14.180.66:37431, user_credentials={real_user=slave}} blocked reactor thread for 55670.6us
I20260709 13:09:10.509342 24080 tablet_service.cc:1511] Processing CreateTablet for tablet 5bc4e407c8b04739aa0290922bfdbed4 (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:09:10.511554 24080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bc4e407c8b04739aa0290922bfdbed4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.390208 24362 raft_consensus.cc:359] T 5a8830d169ce4e46807d04168c3bb086 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:10.522853 24362 raft_consensus.cc:385] T 5a8830d169ce4e46807d04168c3bb086 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:10.523279 24362 raft_consensus.cc:740] T 5a8830d169ce4e46807d04168c3bb086 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b39c386162de49aca92dbebee7f06ace, State: Initialized, Role: FOLLOWER
I20260709 13:09:10.524379 24362 consensus_queue.cc:260] T 5a8830d169ce4e46807d04168c3bb086 P b39c386162de49aca92dbebee7f06ace [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:10.525399 24360 tablet_bootstrap.cc:654] T 1541f6b04d914d10823ad78c03d9a847 P c0f503bf8bb94af8a2a1139db4e1c0f5: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:10.554464 24371 raft_consensus.cc:493] T 5a8830d169ce4e46807d04168c3bb086 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.555531 24371 raft_consensus.cc:515] T 5a8830d169ce4e46807d04168c3bb086 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:10.572418 24371 leader_election.cc:290] T 5a8830d169ce4e46807d04168c3bb086 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431), b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561)
I20260709 13:09:10.579916 24359 ts_tablet_manager.cc:1434] T 5a8830d169ce4e46807d04168c3bb086 P dea34817fcc148d78f090ef5fa72304f: Time spent starting tablet: real 0.229s	user 0.031s	sys 0.040s
I20260709 13:09:10.560415 24296 tablet_service.cc:1511] Processing CreateTablet for tablet 687efb9bbbd04b0eb768bfa6543380c3 (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:09:10.597281 24360 tablet_bootstrap.cc:492] T 1541f6b04d914d10823ad78c03d9a847 P c0f503bf8bb94af8a2a1139db4e1c0f5: No bootstrap required, opened a new log
I20260709 13:09:10.598110 24360 ts_tablet_manager.cc:1403] T 1541f6b04d914d10823ad78c03d9a847 P c0f503bf8bb94af8a2a1139db4e1c0f5: Time spent bootstrapping tablet: real 0.129s	user 0.020s	sys 0.014s
I20260709 13:09:10.603353 24296 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 687efb9bbbd04b0eb768bfa6543380c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.621882 24367 raft_consensus.cc:493] T 502fe798081f4dc693eed179efa2a241 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.602617 24360 raft_consensus.cc:359] T 1541f6b04d914d10823ad78c03d9a847 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:10.622488 24367 raft_consensus.cc:515] T 502fe798081f4dc693eed179efa2a241 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:10.623207 24360 raft_consensus.cc:385] T 1541f6b04d914d10823ad78c03d9a847 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:10.623909 24360 raft_consensus.cc:740] T 1541f6b04d914d10823ad78c03d9a847 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0f503bf8bb94af8a2a1139db4e1c0f5, State: Initialized, Role: FOLLOWER
I20260709 13:09:10.625298 24367 leader_election.cc:290] T 502fe798081f4dc693eed179efa2a241 P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343), c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431)
I20260709 13:09:10.649808 24361 tablet_bootstrap.cc:492] T de5786fbd53646a9bc152ac0a2a9aa53 P f8d4657116f948038a0c73018238c3ba: No bootstrap required, opened a new log
I20260709 13:09:10.650460 24361 ts_tablet_manager.cc:1403] T de5786fbd53646a9bc152ac0a2a9aa53 P f8d4657116f948038a0c73018238c3ba: Time spent bootstrapping tablet: real 0.246s	user 0.060s	sys 0.055s
W20260709 13:09:10.652580 23974 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.14.180.68:38561, user_credentials={real_user=slave}} blocked reactor thread for 43888.8us
I20260709 13:09:10.660822 24361 raft_consensus.cc:359] T de5786fbd53646a9bc152ac0a2a9aa53 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:10.660575 24149 tablet_service.cc:1511] Processing CreateTablet for tablet d2ddfc9daac54dc28d63b46ab1777bf3 (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:09:10.661639 24361 raft_consensus.cc:385] T de5786fbd53646a9bc152ac0a2a9aa53 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:10.662027 24361 raft_consensus.cc:740] T de5786fbd53646a9bc152ac0a2a9aa53 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8d4657116f948038a0c73018238c3ba, State: Initialized, Role: FOLLOWER
I20260709 13:09:10.662945 24149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2ddfc9daac54dc28d63b46ab1777bf3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.664486 24300 tablet_service.cc:1511] Processing CreateTablet for tablet 5bc4e407c8b04739aa0290922bfdbed4 (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:09:10.670442 24300 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bc4e407c8b04739aa0290922bfdbed4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.671970 24302 tablet_service.cc:1511] Processing CreateTablet for tablet d2ddfc9daac54dc28d63b46ab1777bf3 (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:09:10.673442 24302 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2ddfc9daac54dc28d63b46ab1777bf3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.675479 24077 tablet_service.cc:1511] Processing CreateTablet for tablet bff14fa713b6482f89ecf3e18f785f81 (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:09:10.676899 24077 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bff14fa713b6482f89ecf3e18f785f81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.662993 24361 consensus_queue.cc:260] T de5786fbd53646a9bc152ac0a2a9aa53 P f8d4657116f948038a0c73018238c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:10.684986 24359 tablet_bootstrap.cc:492] T de5786fbd53646a9bc152ac0a2a9aa53 P dea34817fcc148d78f090ef5fa72304f: Bootstrap starting.
I20260709 13:09:10.625447 24360 consensus_queue.cc:260] T 1541f6b04d914d10823ad78c03d9a847 P c0f503bf8bb94af8a2a1139db4e1c0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:10.706416 24360 ts_tablet_manager.cc:1434] T 1541f6b04d914d10823ad78c03d9a847 P c0f503bf8bb94af8a2a1139db4e1c0f5: Time spent starting tablet: real 0.108s	user 0.014s	sys 0.002s
I20260709 13:09:10.707852 24360 tablet_bootstrap.cc:492] T c5873f7465894eddab6fa84daecdcc84 P c0f503bf8bb94af8a2a1139db4e1c0f5: Bootstrap starting.
I20260709 13:09:10.709211 24369 raft_consensus.cc:493] T 1541f6b04d914d10823ad78c03d9a847 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.709803 24369 raft_consensus.cc:515] T 1541f6b04d914d10823ad78c03d9a847 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:10.718237 24166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8830d169ce4e46807d04168c3bb086" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" is_pre_election: true
W20260709 13:09:10.725152 24057 leader_election.cc:343] T 5a8830d169ce4e46807d04168c3bb086 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:10.725466 24369 leader_election.cc:290] T 1541f6b04d914d10823ad78c03d9a847 P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561), dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343)
I20260709 13:09:10.745268 24359 tablet_bootstrap.cc:654] T de5786fbd53646a9bc152ac0a2a9aa53 P dea34817fcc148d78f090ef5fa72304f: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:10.755636 24362 ts_tablet_manager.cc:1434] T 5a8830d169ce4e46807d04168c3bb086 P b39c386162de49aca92dbebee7f06ace: Time spent starting tablet: real 0.368s	user 0.021s	sys 0.032s
I20260709 13:09:10.756775 24362 tablet_bootstrap.cc:492] T 46f373ffd46f4625bac910b5ccf4b767 P b39c386162de49aca92dbebee7f06ace: Bootstrap starting.
I20260709 13:09:10.782318 24156 tablet_service.cc:1511] Processing CreateTablet for tablet bff14fa713b6482f89ecf3e18f785f81 (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:09:10.796164 24156 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bff14fa713b6482f89ecf3e18f785f81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.797642 24304 tablet_service.cc:1511] Processing CreateTablet for tablet 1dcdde5516f54b19b11611ca9213415d (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:09:10.795908 24314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8830d169ce4e46807d04168c3bb086" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace" is_pre_election: true
I20260709 13:09:10.800643 24314 raft_consensus.cc:2468] T 5a8830d169ce4e46807d04168c3bb086 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dea34817fcc148d78f090ef5fa72304f in term 0.
I20260709 13:09:10.802361 24055 leader_election.cc:304] T 5a8830d169ce4e46807d04168c3bb086 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b39c386162de49aca92dbebee7f06ace, dea34817fcc148d78f090ef5fa72304f; no voters: c0f503bf8bb94af8a2a1139db4e1c0f5
I20260709 13:09:10.803689 24371 raft_consensus.cc:2804] T 5a8830d169ce4e46807d04168c3bb086 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:10.804105 24371 raft_consensus.cc:493] T 5a8830d169ce4e46807d04168c3bb086 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:10.804495 24371 raft_consensus.cc:3060] T 5a8830d169ce4e46807d04168c3bb086 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:10.807466 24304 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1dcdde5516f54b19b11611ca9213415d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.813961 24079 tablet_service.cc:1511] Processing CreateTablet for tablet 1dcdde5516f54b19b11611ca9213415d (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:09:10.815546 24079 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1dcdde5516f54b19b11611ca9213415d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.820190 24153 tablet_service.cc:1511] Processing CreateTablet for tablet 1dcdde5516f54b19b11611ca9213415d (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:09:10.822044 24153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1dcdde5516f54b19b11611ca9213415d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.824254 24314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1541f6b04d914d10823ad78c03d9a847" candidate_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace" is_pre_election: true
W20260709 13:09:10.828035 24130 leader_election.cc:343] T 1541f6b04d914d10823ad78c03d9a847 P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:10.831251 24360 tablet_bootstrap.cc:654] T c5873f7465894eddab6fa84daecdcc84 P c0f503bf8bb94af8a2a1139db4e1c0f5: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:10.835026 24361 ts_tablet_manager.cc:1434] T de5786fbd53646a9bc152ac0a2a9aa53 P f8d4657116f948038a0c73018238c3ba: Time spent starting tablet: real 0.184s	user 0.004s	sys 0.005s
I20260709 13:09:10.836205 24361 tablet_bootstrap.cc:492] T 49393e5cc2614c90b69a3bb2348dacb9 P f8d4657116f948038a0c73018238c3ba: Bootstrap starting.
I20260709 13:09:10.837172 24359 tablet_bootstrap.cc:492] T de5786fbd53646a9bc152ac0a2a9aa53 P dea34817fcc148d78f090ef5fa72304f: No bootstrap required, opened a new log
I20260709 13:09:10.837863 24359 ts_tablet_manager.cc:1403] T de5786fbd53646a9bc152ac0a2a9aa53 P dea34817fcc148d78f090ef5fa72304f: Time spent bootstrapping tablet: real 0.221s	user 0.022s	sys 0.022s
I20260709 13:09:10.842587 24359 raft_consensus.cc:359] T de5786fbd53646a9bc152ac0a2a9aa53 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:10.844954 24359 raft_consensus.cc:385] T de5786fbd53646a9bc152ac0a2a9aa53 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:10.845328 24359 raft_consensus.cc:740] T de5786fbd53646a9bc152ac0a2a9aa53 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dea34817fcc148d78f090ef5fa72304f, State: Initialized, Role: FOLLOWER
I20260709 13:09:10.846951 24359 consensus_queue.cc:260] T de5786fbd53646a9bc152ac0a2a9aa53 P dea34817fcc148d78f090ef5fa72304f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:10.825490 24371 raft_consensus.cc:515] T 5a8830d169ce4e46807d04168c3bb086 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:10.849555 24091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1541f6b04d914d10823ad78c03d9a847" candidate_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dea34817fcc148d78f090ef5fa72304f" is_pre_election: true
I20260709 13:09:10.851310 24362 tablet_bootstrap.cc:654] T 46f373ffd46f4625bac910b5ccf4b767 P b39c386162de49aca92dbebee7f06ace: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:10.851711 24132 leader_election.cc:343] T 1541f6b04d914d10823ad78c03d9a847 P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:10.852248 24132 leader_election.cc:304] T 1541f6b04d914d10823ad78c03d9a847 P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0f503bf8bb94af8a2a1139db4e1c0f5; no voters: b39c386162de49aca92dbebee7f06ace, dea34817fcc148d78f090ef5fa72304f
I20260709 13:09:10.854141 24369 raft_consensus.cc:2749] T 1541f6b04d914d10823ad78c03d9a847 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:10.862931 24150 tablet_service.cc:1511] Processing CreateTablet for tablet 352353d793574662ac966f335ae8cfbe (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:09:10.863749 24079 tablet_service.cc:1511] Processing CreateTablet for tablet b53fa043603b41be836d4ccb5c248df8 (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:09:10.864549 24150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 352353d793574662ac966f335ae8cfbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.869925 24079 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b53fa043603b41be836d4ccb5c248df8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.874866 24369 raft_consensus.cc:493] T 502fe798081f4dc693eed179efa2a241 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.875504 24369 raft_consensus.cc:515] T 502fe798081f4dc693eed179efa2a241 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:10.878991 24359 ts_tablet_manager.cc:1434] T de5786fbd53646a9bc152ac0a2a9aa53 P dea34817fcc148d78f090ef5fa72304f: Time spent starting tablet: real 0.040s	user 0.009s	sys 0.000s
I20260709 13:09:10.881930 24369 leader_election.cc:290] T 502fe798081f4dc693eed179efa2a241 P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343), f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171)
I20260709 13:09:10.883025 24166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8830d169ce4e46807d04168c3bb086" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5"
I20260709 13:09:10.884222 24091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "502fe798081f4dc693eed179efa2a241" candidate_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dea34817fcc148d78f090ef5fa72304f" is_pre_election: true
W20260709 13:09:10.889400 24132 leader_election.cc:343] T 502fe798081f4dc693eed179efa2a241 P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:10.884646 24077 tablet_service.cc:1511] Processing CreateTablet for tablet ab4ea1ceb7a443be94ec74cd88c9bf47 (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
W20260709 13:09:10.889488 24057 leader_election.cc:343] T 5a8830d169ce4e46807d04168c3bb086 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:10.885808 24302 tablet_service.cc:1511] Processing CreateTablet for tablet 352353d793574662ac966f335ae8cfbe (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:09:10.890995 24077 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab4ea1ceb7a443be94ec74cd88c9bf47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.890993 24302 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 352353d793574662ac966f335ae8cfbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.871685 24361 tablet_bootstrap.cc:654] T 49393e5cc2614c90b69a3bb2348dacb9 P f8d4657116f948038a0c73018238c3ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:10.851384 24300 tablet_service.cc:1511] Processing CreateTablet for tablet b53fa043603b41be836d4ccb5c248df8 (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:09:10.902063 24314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8830d169ce4e46807d04168c3bb086" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace"
I20260709 13:09:10.904282 24314 raft_consensus.cc:3060] T 5a8830d169ce4e46807d04168c3bb086 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:10.904006 24153 tablet_service.cc:1511] Processing CreateTablet for tablet ab4ea1ceb7a443be94ec74cd88c9bf47 (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:09:10.905867 24153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab4ea1ceb7a443be94ec74cd88c9bf47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.911736 24360 tablet_bootstrap.cc:492] T c5873f7465894eddab6fa84daecdcc84 P c0f503bf8bb94af8a2a1139db4e1c0f5: No bootstrap required, opened a new log
I20260709 13:09:10.912367 24360 ts_tablet_manager.cc:1403] T c5873f7465894eddab6fa84daecdcc84 P c0f503bf8bb94af8a2a1139db4e1c0f5: Time spent bootstrapping tablet: real 0.205s	user 0.008s	sys 0.006s
I20260709 13:09:10.898233 24371 leader_election.cc:290] T 5a8830d169ce4e46807d04168c3bb086 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 election: Requested vote from peers c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431), b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561)
I20260709 13:09:10.915396 24360 raft_consensus.cc:359] T c5873f7465894eddab6fa84daecdcc84 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:10.916043 24360 raft_consensus.cc:385] T c5873f7465894eddab6fa84daecdcc84 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:10.916299 24360 raft_consensus.cc:740] T c5873f7465894eddab6fa84daecdcc84 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0f503bf8bb94af8a2a1139db4e1c0f5, State: Initialized, Role: FOLLOWER
I20260709 13:09:10.916481 24314 raft_consensus.cc:2468] T 5a8830d169ce4e46807d04168c3bb086 P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dea34817fcc148d78f090ef5fa72304f in term 1.
I20260709 13:09:10.919692 24300 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b53fa043603b41be836d4ccb5c248df8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.920138 24224 tablet_service.cc:1511] Processing CreateTablet for tablet d2ddfc9daac54dc28d63b46ab1777bf3 (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:09:10.921707 24224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2ddfc9daac54dc28d63b46ab1777bf3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.922775 24055 leader_election.cc:304] T 5a8830d169ce4e46807d04168c3bb086 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b39c386162de49aca92dbebee7f06ace, dea34817fcc148d78f090ef5fa72304f; no voters: c0f503bf8bb94af8a2a1139db4e1c0f5
I20260709 13:09:10.922538 24296 tablet_service.cc:1511] Processing CreateTablet for tablet 0dbd3426f3e14ef28e7b0b6c4c7de6a2 (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:09:10.924170 24296 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0dbd3426f3e14ef28e7b0b6c4c7de6a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.923882 24080 tablet_service.cc:1511] Processing CreateTablet for tablet 0dbd3426f3e14ef28e7b0b6c4c7de6a2 (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:09:10.925323 24080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0dbd3426f3e14ef28e7b0b6c4c7de6a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.930698 24371 raft_consensus.cc:2804] T 5a8830d169ce4e46807d04168c3bb086 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:10.931375 24371 raft_consensus.cc:697] T 5a8830d169ce4e46807d04168c3bb086 P dea34817fcc148d78f090ef5fa72304f [term 1 LEADER]: Becoming Leader. State: Replica: dea34817fcc148d78f090ef5fa72304f, State: Running, Role: LEADER
I20260709 13:09:10.934381 24230 tablet_service.cc:1511] Processing CreateTablet for tablet b53fa043603b41be836d4ccb5c248df8 (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:09:10.934931 24229 tablet_service.cc:1511] Processing CreateTablet for tablet ab4ea1ceb7a443be94ec74cd88c9bf47 (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:09:10.935137 24228 tablet_service.cc:1511] Processing CreateTablet for tablet 352353d793574662ac966f335ae8cfbe (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:09:10.936094 24230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b53fa043603b41be836d4ccb5c248df8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.932303 24223 tablet_service.cc:1511] Processing CreateTablet for tablet bff14fa713b6482f89ecf3e18f785f81 (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:09:10.937326 24228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 352353d793574662ac966f335ae8cfbe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.932281 24371 consensus_queue.cc:237] T 5a8830d169ce4e46807d04168c3bb086 P dea34817fcc148d78f090ef5fa72304f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:10.938786 24091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "502fe798081f4dc693eed179efa2a241" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dea34817fcc148d78f090ef5fa72304f" is_pre_election: true
I20260709 13:09:10.939359 24223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bff14fa713b6482f89ecf3e18f785f81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.940335 24166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "502fe798081f4dc693eed179efa2a241" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" is_pre_election: true
I20260709 13:09:10.941192 24166 raft_consensus.cc:2468] T 502fe798081f4dc693eed179efa2a241 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8d4657116f948038a0c73018238c3ba in term 0.
I20260709 13:09:10.942687 24359 tablet_bootstrap.cc:492] T 502fe798081f4dc693eed179efa2a241 P dea34817fcc148d78f090ef5fa72304f: Bootstrap starting.
I20260709 13:09:10.942932 24229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab4ea1ceb7a443be94ec74cd88c9bf47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.946174 24156 tablet_service.cc:1511] Processing CreateTablet for tablet 0dbd3426f3e14ef28e7b0b6c4c7de6a2 (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:09:10.950403 24156 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0dbd3426f3e14ef28e7b0b6c4c7de6a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.917055 24360 consensus_queue.cc:260] T c5873f7465894eddab6fa84daecdcc84 P c0f503bf8bb94af8a2a1139db4e1c0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:10.953024 24369 raft_consensus.cc:493] T c5873f7465894eddab6fa84daecdcc84 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.953559 24369 raft_consensus.cc:515] T c5873f7465894eddab6fa84daecdcc84 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
W20260709 13:09:10.956122 24206 leader_election.cc:343] T 502fe798081f4dc693eed179efa2a241 P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:10.958830 24206 leader_election.cc:304] T 502fe798081f4dc693eed179efa2a241 P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c0f503bf8bb94af8a2a1139db4e1c0f5, f8d4657116f948038a0c73018238c3ba; no voters: dea34817fcc148d78f090ef5fa72304f
I20260709 13:09:10.948257 24362 tablet_bootstrap.cc:492] T 46f373ffd46f4625bac910b5ccf4b767 P b39c386162de49aca92dbebee7f06ace: No bootstrap required, opened a new log
I20260709 13:09:10.966671 24367 raft_consensus.cc:2804] T 502fe798081f4dc693eed179efa2a241 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:10.971737 24367 raft_consensus.cc:493] T 502fe798081f4dc693eed179efa2a241 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:10.972126 24367 raft_consensus.cc:3060] T 502fe798081f4dc693eed179efa2a241 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:10.977452 24226 tablet_service.cc:1511] Processing CreateTablet for tablet e21ef2f479764142935dc2b1b7e87220 (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:09:10.979506 24226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e21ef2f479764142935dc2b1b7e87220. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.979862 24298 tablet_service.cc:1511] Processing CreateTablet for tablet e21ef2f479764142935dc2b1b7e87220 (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:09:10.981635 24298 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e21ef2f479764142935dc2b1b7e87220. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:09:10.981868 24037 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:10.984146 23987 catalog_manager.cc:5697] T 5a8830d169ce4e46807d04168c3bb086 P dea34817fcc148d78f090ef5fa72304f reported cstate change: term changed from 0 to 1, leader changed from <none> to dea34817fcc148d78f090ef5fa72304f (127.14.180.65). New cstate: current_term: 1 leader_uuid: "dea34817fcc148d78f090ef5fa72304f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:10.968079 24362 ts_tablet_manager.cc:1403] T 46f373ffd46f4625bac910b5ccf4b767 P b39c386162de49aca92dbebee7f06ace: Time spent bootstrapping tablet: real 0.212s	user 0.006s	sys 0.010s
I20260709 13:09:10.991660 24072 tablet_service.cc:1511] Processing CreateTablet for tablet e21ef2f479764142935dc2b1b7e87220 (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:09:11.001160 24239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5873f7465894eddab6fa84daecdcc84" candidate_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8d4657116f948038a0c73018238c3ba" is_pre_election: true
I20260709 13:09:11.002031 24072 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e21ef2f479764142935dc2b1b7e87220. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:09:11.003084 24131 leader_election.cc:343] T c5873f7465894eddab6fa84daecdcc84 P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:11.004804 24361 tablet_bootstrap.cc:492] T 49393e5cc2614c90b69a3bb2348dacb9 P f8d4657116f948038a0c73018238c3ba: No bootstrap required, opened a new log
I20260709 13:09:11.005431 24361 ts_tablet_manager.cc:1403] T 49393e5cc2614c90b69a3bb2348dacb9 P f8d4657116f948038a0c73018238c3ba: Time spent bootstrapping tablet: real 0.169s	user 0.010s	sys 0.006s
I20260709 13:09:10.992268 24149 tablet_service.cc:1511] Processing CreateTablet for tablet 518a35ead60847e98c0b76330b999d6f (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:09:10.995395 24222 tablet_service.cc:1511] Processing CreateTablet for tablet 518a35ead60847e98c0b76330b999d6f (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:09:11.007421 24149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 518a35ead60847e98c0b76330b999d6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.007485 24222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 518a35ead60847e98c0b76330b999d6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.008801 24361 raft_consensus.cc:359] T 49393e5cc2614c90b69a3bb2348dacb9 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:11.009618 24361 raft_consensus.cc:385] T 49393e5cc2614c90b69a3bb2348dacb9 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:11.009912 24361 raft_consensus.cc:740] T 49393e5cc2614c90b69a3bb2348dacb9 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8d4657116f948038a0c73018238c3ba, State: Initialized, Role: FOLLOWER
I20260709 13:09:11.014482 24361 consensus_queue.cc:260] T 49393e5cc2614c90b69a3bb2348dacb9 P f8d4657116f948038a0c73018238c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:10.997082 24359 tablet_bootstrap.cc:654] T 502fe798081f4dc693eed179efa2a241 P dea34817fcc148d78f090ef5fa72304f: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:10.998831 24367 raft_consensus.cc:515] T 502fe798081f4dc693eed179efa2a241 P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:11.000200 24240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "502fe798081f4dc693eed179efa2a241" candidate_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8d4657116f948038a0c73018238c3ba" is_pre_election: true
I20260709 13:09:11.000531 24304 tablet_service.cc:1511] Processing CreateTablet for tablet 518a35ead60847e98c0b76330b999d6f (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:09:11.019155 24314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5873f7465894eddab6fa84daecdcc84" candidate_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace" is_pre_election: true
W20260709 13:09:11.020872 24130 leader_election.cc:343] T c5873f7465894eddab6fa84daecdcc84 P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:11.019290 24362 raft_consensus.cc:359] T 46f373ffd46f4625bac910b5ccf4b767 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:11.021359 24130 leader_election.cc:304] T c5873f7465894eddab6fa84daecdcc84 P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0f503bf8bb94af8a2a1139db4e1c0f5; no voters: b39c386162de49aca92dbebee7f06ace, f8d4657116f948038a0c73018238c3ba
I20260709 13:09:11.021867 24362 raft_consensus.cc:385] T 46f373ffd46f4625bac910b5ccf4b767 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:11.022482 24369 leader_election.cc:290] T c5873f7465894eddab6fa84daecdcc84 P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171), b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561)
I20260709 13:09:11.026327 24078 tablet_service.cc:1511] Processing CreateTablet for tablet 03e06f957f794ca696ddc7207eeabff0 (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:09:11.028895 24078 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03e06f957f794ca696ddc7207eeabff0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.038882 24240 raft_consensus.cc:2393] T 502fe798081f4dc693eed179efa2a241 P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0f503bf8bb94af8a2a1139db4e1c0f5 in current term 1: Already voted for candidate f8d4657116f948038a0c73018238c3ba in this term.
I20260709 13:09:11.042863 24131 leader_election.cc:304] T 502fe798081f4dc693eed179efa2a241 P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0f503bf8bb94af8a2a1139db4e1c0f5; no voters: dea34817fcc148d78f090ef5fa72304f, f8d4657116f948038a0c73018238c3ba
I20260709 13:09:11.045336 24299 tablet_service.cc:1511] Processing CreateTablet for tablet e280ec3a0e394065aca766e4f8bef46d (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:09:11.052353 24091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "502fe798081f4dc693eed179efa2a241" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dea34817fcc148d78f090ef5fa72304f"
W20260709 13:09:11.054242 24206 leader_election.cc:343] T 502fe798081f4dc693eed179efa2a241 P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:11.055429 24166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "502fe798081f4dc693eed179efa2a241" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5"
I20260709 13:09:11.056072 24166 raft_consensus.cc:3060] T 502fe798081f4dc693eed179efa2a241 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:11.028769 24225 tablet_service.cc:1511] Processing CreateTablet for tablet 03e06f957f794ca696ddc7207eeabff0 (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:09:11.059468 24225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03e06f957f794ca696ddc7207eeabff0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.059959 24369 raft_consensus.cc:2749] T c5873f7465894eddab6fa84daecdcc84 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:11.061721 24150 tablet_service.cc:1511] Processing CreateTablet for tablet 03e06f957f794ca696ddc7207eeabff0 (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:09:11.063117 24150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03e06f957f794ca696ddc7207eeabff0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.054293 24304 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 518a35ead60847e98c0b76330b999d6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.068468 24166 raft_consensus.cc:2468] T 502fe798081f4dc693eed179efa2a241 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8d4657116f948038a0c73018238c3ba in term 1.
I20260709 13:09:11.069375 24369 raft_consensus.cc:2749] T 502fe798081f4dc693eed179efa2a241 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:11.072739 24299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e280ec3a0e394065aca766e4f8bef46d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.072961 24153 tablet_service.cc:1511] Processing CreateTablet for tablet e280ec3a0e394065aca766e4f8bef46d (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:09:11.074375 24153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e280ec3a0e394065aca766e4f8bef46d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.023934 24362 raft_consensus.cc:740] T 46f373ffd46f4625bac910b5ccf4b767 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b39c386162de49aca92dbebee7f06ace, State: Initialized, Role: FOLLOWER
I20260709 13:09:11.081241 24362 consensus_queue.cc:260] T 46f373ffd46f4625bac910b5ccf4b767 P b39c386162de49aca92dbebee7f06ace [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:11.084017 24362 ts_tablet_manager.cc:1434] T 46f373ffd46f4625bac910b5ccf4b767 P b39c386162de49aca92dbebee7f06ace: Time spent starting tablet: real 0.069s	user 0.002s	sys 0.004s
I20260709 13:09:11.048609 24367 leader_election.cc:290] T 502fe798081f4dc693eed179efa2a241 P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 election: Requested vote from peers dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343), c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431)
I20260709 13:09:11.085614 24367 raft_consensus.cc:493] T de5786fbd53646a9bc152ac0a2a9aa53 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.086084 24367 raft_consensus.cc:515] T de5786fbd53646a9bc152ac0a2a9aa53 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:11.088896 24367 leader_election.cc:290] T de5786fbd53646a9bc152ac0a2a9aa53 P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343), c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431)
I20260709 13:09:11.111369 24361 ts_tablet_manager.cc:1434] T 49393e5cc2614c90b69a3bb2348dacb9 P f8d4657116f948038a0c73018238c3ba: Time spent starting tablet: real 0.106s	user 0.014s	sys 0.002s
I20260709 13:09:11.111529 24206 leader_election.cc:304] T 502fe798081f4dc693eed179efa2a241 P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c0f503bf8bb94af8a2a1139db4e1c0f5, f8d4657116f948038a0c73018238c3ba; no voters: dea34817fcc148d78f090ef5fa72304f
I20260709 13:09:11.112679 24361 tablet_bootstrap.cc:492] T c7b586130d5842f293b0df4b02792ec6 P f8d4657116f948038a0c73018238c3ba: Bootstrap starting.
I20260709 13:09:11.114112 24091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5786fbd53646a9bc152ac0a2a9aa53" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dea34817fcc148d78f090ef5fa72304f" is_pre_election: true
I20260709 13:09:11.099195 24371 raft_consensus.cc:493] T de5786fbd53646a9bc152ac0a2a9aa53 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.117826 24362 tablet_bootstrap.cc:492] T 42868db4862647c28215f3d7cb9adf02 P b39c386162de49aca92dbebee7f06ace: Bootstrap starting.
I20260709 13:09:11.118721 24371 raft_consensus.cc:515] T de5786fbd53646a9bc152ac0a2a9aa53 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:11.126739 24296 tablet_service.cc:1511] Processing CreateTablet for tablet 7a76ed4e1b6a4c2698999f722da5cfd7 (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:09:11.128350 24296 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a76ed4e1b6a4c2698999f722da5cfd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.129346 24371 leader_election.cc:290] T de5786fbd53646a9bc152ac0a2a9aa53 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171), c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431)
I20260709 13:09:11.130143 24091 raft_consensus.cc:2468] T de5786fbd53646a9bc152ac0a2a9aa53 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8d4657116f948038a0c73018238c3ba in term 0.
I20260709 13:09:11.117333 24367 raft_consensus.cc:2804] T 502fe798081f4dc693eed179efa2a241 P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:11.133481 24230 tablet_service.cc:1511] Processing CreateTablet for tablet 7a76ed4e1b6a4c2698999f722da5cfd7 (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:09:11.135126 24230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a76ed4e1b6a4c2698999f722da5cfd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.137112 24206 leader_election.cc:304] T de5786fbd53646a9bc152ac0a2a9aa53 P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dea34817fcc148d78f090ef5fa72304f, f8d4657116f948038a0c73018238c3ba; no voters: 
I20260709 13:09:11.143077 24367 raft_consensus.cc:697] T 502fe798081f4dc693eed179efa2a241 P f8d4657116f948038a0c73018238c3ba [term 1 LEADER]: Becoming Leader. State: Replica: f8d4657116f948038a0c73018238c3ba, State: Running, Role: LEADER
I20260709 13:09:11.144232 24367 consensus_queue.cc:237] T 502fe798081f4dc693eed179efa2a241 P f8d4657116f948038a0c73018238c3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
W20260709 13:09:11.105067 24130 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:38561, user_credentials={real_user=slave}} blocked reactor thread for 84240.5us
I20260709 13:09:11.129492 24362 tablet_bootstrap.cc:654] T 42868db4862647c28215f3d7cb9adf02 P b39c386162de49aca92dbebee7f06ace: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:11.154642 24166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5786fbd53646a9bc152ac0a2a9aa53" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" is_pre_election: true
I20260709 13:09:11.158735 24396 raft_consensus.cc:2804] T de5786fbd53646a9bc152ac0a2a9aa53 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:11.161114 24396 raft_consensus.cc:493] T de5786fbd53646a9bc152ac0a2a9aa53 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:11.161569 24396 raft_consensus.cc:3060] T de5786fbd53646a9bc152ac0a2a9aa53 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:11.166388 24361 tablet_bootstrap.cc:654] T c7b586130d5842f293b0df4b02792ec6 P f8d4657116f948038a0c73018238c3ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:11.167913 24360 ts_tablet_manager.cc:1434] T c5873f7465894eddab6fa84daecdcc84 P c0f503bf8bb94af8a2a1139db4e1c0f5: Time spent starting tablet: real 0.255s	user 0.014s	sys 0.017s
I20260709 13:09:11.168820 24077 tablet_service.cc:1511] Processing CreateTablet for tablet e280ec3a0e394065aca766e4f8bef46d (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:09:11.171157 24077 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e280ec3a0e394065aca766e4f8bef46d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.172875 24165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5786fbd53646a9bc152ac0a2a9aa53" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" is_pre_election: true
W20260709 13:09:11.167819 24206 leader_election.cc:343] T de5786fbd53646a9bc152ac0a2a9aa53 P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:11.175297 24057 leader_election.cc:343] T de5786fbd53646a9bc152ac0a2a9aa53 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:11.189170 24072 tablet_service.cc:1511] Processing CreateTablet for tablet 7a76ed4e1b6a4c2698999f722da5cfd7 (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:09:11.190632 24072 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a76ed4e1b6a4c2698999f722da5cfd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.191789 24360 tablet_bootstrap.cc:492] T 49393e5cc2614c90b69a3bb2348dacb9 P c0f503bf8bb94af8a2a1139db4e1c0f5: Bootstrap starting.
I20260709 13:09:11.191954 24229 tablet_service.cc:1511] Processing CreateTablet for tablet ef112a95c7964753b1c7c5a17656161b (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:09:11.193413 24229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef112a95c7964753b1c7c5a17656161b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.197283 24149 tablet_service.cc:1511] Processing CreateTablet for tablet ef112a95c7964753b1c7c5a17656161b (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:09:11.198904 24149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef112a95c7964753b1c7c5a17656161b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.203229 24359 tablet_bootstrap.cc:492] T 502fe798081f4dc693eed179efa2a241 P dea34817fcc148d78f090ef5fa72304f: No bootstrap required, opened a new log
I20260709 13:09:11.203897 24359 ts_tablet_manager.cc:1403] T 502fe798081f4dc693eed179efa2a241 P dea34817fcc148d78f090ef5fa72304f: Time spent bootstrapping tablet: real 0.301s	user 0.019s	sys 0.012s
I20260709 13:09:11.204595 24240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5786fbd53646a9bc152ac0a2a9aa53" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8d4657116f948038a0c73018238c3ba" is_pre_election: true
I20260709 13:09:11.225555 24080 tablet_service.cc:1511] Processing CreateTablet for tablet 25e4818a4e2e4c9c9f7a8467aa9ef881 (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:09:11.227010 24150 tablet_service.cc:1511] Processing CreateTablet for tablet 25e4818a4e2e4c9c9f7a8467aa9ef881 (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:09:11.228538 24150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25e4818a4e2e4c9c9f7a8467aa9ef881. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.228291 24300 tablet_service.cc:1511] Processing CreateTablet for tablet ef112a95c7964753b1c7c5a17656161b (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:09:11.227051 24080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25e4818a4e2e4c9c9f7a8467aa9ef881. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.209975 24396 raft_consensus.cc:515] T de5786fbd53646a9bc152ac0a2a9aa53 P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:11.228652 24222 tablet_service.cc:1511] Processing CreateTablet for tablet 25e4818a4e2e4c9c9f7a8467aa9ef881 (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:09:11.234395 24222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25e4818a4e2e4c9c9f7a8467aa9ef881. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.239315 24300 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef112a95c7964753b1c7c5a17656161b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.253862 24360 tablet_bootstrap.cc:654] T 49393e5cc2614c90b69a3bb2348dacb9 P c0f503bf8bb94af8a2a1139db4e1c0f5: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:11.252344 24359 raft_consensus.cc:359] T 502fe798081f4dc693eed179efa2a241 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:11.255973 24359 raft_consensus.cc:385] T 502fe798081f4dc693eed179efa2a241 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:11.268144 24396 leader_election.cc:290] T de5786fbd53646a9bc152ac0a2a9aa53 P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 election: Requested vote from peers dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343), c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431)
I20260709 13:09:11.269093 24240 raft_consensus.cc:2393] T de5786fbd53646a9bc152ac0a2a9aa53 P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dea34817fcc148d78f090ef5fa72304f in current term 1: Already voted for candidate f8d4657116f948038a0c73018238c3ba in this term.
I20260709 13:09:11.258905 24359 raft_consensus.cc:740] T 502fe798081f4dc693eed179efa2a241 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dea34817fcc148d78f090ef5fa72304f, State: Initialized, Role: FOLLOWER
I20260709 13:09:11.281538 24056 leader_election.cc:304] T de5786fbd53646a9bc152ac0a2a9aa53 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dea34817fcc148d78f090ef5fa72304f; no voters: c0f503bf8bb94af8a2a1139db4e1c0f5, f8d4657116f948038a0c73018238c3ba
I20260709 13:09:11.296150 24165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5786fbd53646a9bc152ac0a2a9aa53" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5"
I20260709 13:09:11.300575 24304 tablet_service.cc:1511] Processing CreateTablet for tablet 2dbbcd71c86041ba949fac653102e076 (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
W20260709 13:09:11.300853 24206 leader_election.cc:343] T de5786fbd53646a9bc152ac0a2a9aa53 P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:11.302028 24304 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2dbbcd71c86041ba949fac653102e076. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.301174 24361 tablet_bootstrap.cc:492] T c7b586130d5842f293b0df4b02792ec6 P f8d4657116f948038a0c73018238c3ba: No bootstrap required, opened a new log
I20260709 13:09:11.302910 24371 raft_consensus.cc:3060] T de5786fbd53646a9bc152ac0a2a9aa53 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:11.305719 24078 tablet_service.cc:1511] Processing CreateTablet for tablet 2dbbcd71c86041ba949fac653102e076 (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:09:11.273917 23986 catalog_manager.cc:5697] T 502fe798081f4dc693eed179efa2a241 P f8d4657116f948038a0c73018238c3ba reported cstate change: term changed from 0 to 1, leader changed from <none> to f8d4657116f948038a0c73018238c3ba (127.14.180.67). New cstate: current_term: 1 leader_uuid: "f8d4657116f948038a0c73018238c3ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:11.308825 24362 tablet_bootstrap.cc:492] T 42868db4862647c28215f3d7cb9adf02 P b39c386162de49aca92dbebee7f06ace: No bootstrap required, opened a new log
I20260709 13:09:11.309633 24362 ts_tablet_manager.cc:1403] T 42868db4862647c28215f3d7cb9adf02 P b39c386162de49aca92dbebee7f06ace: Time spent bootstrapping tablet: real 0.203s	user 0.019s	sys 0.013s
I20260709 13:09:11.303084 24361 ts_tablet_manager.cc:1403] T c7b586130d5842f293b0df4b02792ec6 P f8d4657116f948038a0c73018238c3ba: Time spent bootstrapping tablet: real 0.191s	user 0.017s	sys 0.001s
I20260709 13:09:11.311704 24078 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2dbbcd71c86041ba949fac653102e076. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.311571 24091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5786fbd53646a9bc152ac0a2a9aa53" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dea34817fcc148d78f090ef5fa72304f"
I20260709 13:09:11.327986 24226 tablet_service.cc:1511] Processing CreateTablet for tablet aaf99a05bd8842ed9ea668a9da85dbcc (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:09:11.329579 24226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aaf99a05bd8842ed9ea668a9da85dbcc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.329262 24362 raft_consensus.cc:359] T 42868db4862647c28215f3d7cb9adf02 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:11.330229 24362 raft_consensus.cc:385] T 42868db4862647c28215f3d7cb9adf02 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:11.317727 24359 consensus_queue.cc:260] T 502fe798081f4dc693eed179efa2a241 P dea34817fcc148d78f090ef5fa72304f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:11.333925 24361 raft_consensus.cc:359] T c7b586130d5842f293b0df4b02792ec6 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:11.338950 24361 raft_consensus.cc:385] T c7b586130d5842f293b0df4b02792ec6 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:11.339545 24361 raft_consensus.cc:740] T c7b586130d5842f293b0df4b02792ec6 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8d4657116f948038a0c73018238c3ba, State: Initialized, Role: FOLLOWER
I20260709 13:09:11.335044 24299 tablet_service.cc:1511] Processing CreateTablet for tablet aaf99a05bd8842ed9ea668a9da85dbcc (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:09:11.337330 24371 raft_consensus.cc:2749] T de5786fbd53646a9bc152ac0a2a9aa53 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:11.340850 24153 tablet_service.cc:1511] Processing CreateTablet for tablet 2dbbcd71c86041ba949fac653102e076 (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:09:11.343849 24361 consensus_queue.cc:260] T c7b586130d5842f293b0df4b02792ec6 P f8d4657116f948038a0c73018238c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:11.344843 24153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2dbbcd71c86041ba949fac653102e076. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.332751 24362 raft_consensus.cc:740] T 42868db4862647c28215f3d7cb9adf02 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b39c386162de49aca92dbebee7f06ace, State: Initialized, Role: FOLLOWER
I20260709 13:09:11.361393 24156 tablet_service.cc:1511] Processing CreateTablet for tablet 6bdf4f0b87584bdab10ccc418ab54f02 (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:09:11.358060 24299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aaf99a05bd8842ed9ea668a9da85dbcc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.366021 24156 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bdf4f0b87584bdab10ccc418ab54f02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.370249 24359 ts_tablet_manager.cc:1434] T 502fe798081f4dc693eed179efa2a241 P dea34817fcc148d78f090ef5fa72304f: Time spent starting tablet: real 0.166s	user 0.008s	sys 0.004s
I20260709 13:09:11.371665 24359 tablet_bootstrap.cc:492] T 49393e5cc2614c90b69a3bb2348dacb9 P dea34817fcc148d78f090ef5fa72304f: Bootstrap starting.
I20260709 13:09:11.375732 24360 tablet_bootstrap.cc:492] T 49393e5cc2614c90b69a3bb2348dacb9 P c0f503bf8bb94af8a2a1139db4e1c0f5: No bootstrap required, opened a new log
I20260709 13:09:11.375597 24091 raft_consensus.cc:2468] T de5786fbd53646a9bc152ac0a2a9aa53 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8d4657116f948038a0c73018238c3ba in term 1.
I20260709 13:09:11.384061 24206 leader_election.cc:304] T de5786fbd53646a9bc152ac0a2a9aa53 P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dea34817fcc148d78f090ef5fa72304f, f8d4657116f948038a0c73018238c3ba; no voters: c0f503bf8bb94af8a2a1139db4e1c0f5
I20260709 13:09:11.384727 24072 tablet_service.cc:1511] Processing CreateTablet for tablet aaf99a05bd8842ed9ea668a9da85dbcc (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:09:11.384953 24230 tablet_service.cc:1511] Processing CreateTablet for tablet 6bdf4f0b87584bdab10ccc418ab54f02 (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:09:11.385773 24361 ts_tablet_manager.cc:1434] T c7b586130d5842f293b0df4b02792ec6 P f8d4657116f948038a0c73018238c3ba: Time spent starting tablet: real 0.073s	user 0.005s	sys 0.004s
I20260709 13:09:11.386277 24072 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aaf99a05bd8842ed9ea668a9da85dbcc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.386912 24361 tablet_bootstrap.cc:492] T 93e868a924d74bbc8bf29aa5a7fc67fd P f8d4657116f948038a0c73018238c3ba: Bootstrap starting.
I20260709 13:09:11.381871 24362 consensus_queue.cc:260] T 42868db4862647c28215f3d7cb9adf02 P b39c386162de49aca92dbebee7f06ace [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:11.386783 24396 raft_consensus.cc:2804] T de5786fbd53646a9bc152ac0a2a9aa53 P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:11.392088 24396 raft_consensus.cc:697] T de5786fbd53646a9bc152ac0a2a9aa53 P f8d4657116f948038a0c73018238c3ba [term 1 LEADER]: Becoming Leader. State: Replica: f8d4657116f948038a0c73018238c3ba, State: Running, Role: LEADER
I20260709 13:09:11.393000 24396 consensus_queue.cc:237] T de5786fbd53646a9bc152ac0a2a9aa53 P f8d4657116f948038a0c73018238c3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:11.393502 24229 tablet_service.cc:1511] Processing CreateTablet for tablet 65f010ca5ab74fa1b0f45b7d5dced706 (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:09:11.395546 24362 ts_tablet_manager.cc:1434] T 42868db4862647c28215f3d7cb9adf02 P b39c386162de49aca92dbebee7f06ace: Time spent starting tablet: real 0.086s	user 0.006s	sys 0.002s
I20260709 13:09:11.396175 24368 consensus_queue.cc:1048] T 5a8830d169ce4e46807d04168c3bb086 P dea34817fcc148d78f090ef5fa72304f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:11.396781 24362 tablet_bootstrap.cc:492] T f735173e22b242178edcdf4821b6f92b P b39c386162de49aca92dbebee7f06ace: Bootstrap starting.
I20260709 13:09:11.381557 24360 ts_tablet_manager.cc:1403] T 49393e5cc2614c90b69a3bb2348dacb9 P c0f503bf8bb94af8a2a1139db4e1c0f5: Time spent bootstrapping tablet: real 0.190s	user 0.028s	sys 0.013s
I20260709 13:09:11.400547 24077 tablet_service.cc:1511] Processing CreateTablet for tablet 65f010ca5ab74fa1b0f45b7d5dced706 (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:09:11.386287 24230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bdf4f0b87584bdab10ccc418ab54f02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.408452 24077 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65f010ca5ab74fa1b0f45b7d5dced706. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.416296 24150 tablet_service.cc:1511] Processing CreateTablet for tablet 65f010ca5ab74fa1b0f45b7d5dced706 (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:09:11.417014 24302 tablet_service.cc:1511] Processing CreateTablet for tablet b25c31c2fcad44f281a8a045e6cb0c19 (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:09:11.419234 24302 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b25c31c2fcad44f281a8a045e6cb0c19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.420389 24229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65f010ca5ab74fa1b0f45b7d5dced706. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.427374 24362 tablet_bootstrap.cc:654] T f735173e22b242178edcdf4821b6f92b P b39c386162de49aca92dbebee7f06ace: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:11.424625 24080 tablet_service.cc:1511] Processing CreateTablet for tablet b25c31c2fcad44f281a8a045e6cb0c19 (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:09:11.433634 24360 raft_consensus.cc:359] T 49393e5cc2614c90b69a3bb2348dacb9 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:11.437881 24361 tablet_bootstrap.cc:654] T 93e868a924d74bbc8bf29aa5a7fc67fd P f8d4657116f948038a0c73018238c3ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:11.422915 24150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65f010ca5ab74fa1b0f45b7d5dced706. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.441015 24360 raft_consensus.cc:385] T 49393e5cc2614c90b69a3bb2348dacb9 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:11.472965 24360 raft_consensus.cc:740] T 49393e5cc2614c90b69a3bb2348dacb9 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0f503bf8bb94af8a2a1139db4e1c0f5, State: Initialized, Role: FOLLOWER
I20260709 13:09:11.449234 24359 tablet_bootstrap.cc:654] T 49393e5cc2614c90b69a3bb2348dacb9 P dea34817fcc148d78f090ef5fa72304f: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:11.477978 24360 consensus_queue.cc:260] T 49393e5cc2614c90b69a3bb2348dacb9 P c0f503bf8bb94af8a2a1139db4e1c0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:11.480536 24360 ts_tablet_manager.cc:1434] T 49393e5cc2614c90b69a3bb2348dacb9 P c0f503bf8bb94af8a2a1139db4e1c0f5: Time spent starting tablet: real 0.078s	user 0.006s	sys 0.003s
I20260709 13:09:11.440189 24080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b25c31c2fcad44f281a8a045e6cb0c19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.457304 24149 tablet_service.cc:1511] Processing CreateTablet for tablet b25c31c2fcad44f281a8a045e6cb0c19 (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:09:11.481909 24360 tablet_bootstrap.cc:492] T 45b65ebcb0114044a04e5689db4a466f P c0f503bf8bb94af8a2a1139db4e1c0f5: Bootstrap starting.
I20260709 13:09:11.468206 24367 raft_consensus.cc:493] T 49393e5cc2614c90b69a3bb2348dacb9 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.441062 24296 tablet_service.cc:1511] Processing CreateTablet for tablet 6bdf4f0b87584bdab10ccc418ab54f02 (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:09:11.482865 24367 raft_consensus.cc:515] T 49393e5cc2614c90b69a3bb2348dacb9 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:11.483511 24296 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bdf4f0b87584bdab10ccc418ab54f02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.485054 24367 leader_election.cc:290] T 49393e5cc2614c90b69a3bb2348dacb9 P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343), c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431)
I20260709 13:09:11.485836 24377 raft_consensus.cc:493] T 46f373ffd46f4625bac910b5ccf4b767 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.486330 24377 raft_consensus.cc:515] T 46f373ffd46f4625bac910b5ccf4b767 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:11.487186 24149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b25c31c2fcad44f281a8a045e6cb0c19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.491225 24377 leader_election.cc:290] T 46f373ffd46f4625bac910b5ccf4b767 P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171), dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343)
W20260709 13:09:11.508476 24057 consensus_peers.cc:597] T 5a8830d169ce4e46807d04168c3bb086 P dea34817fcc148d78f090ef5fa72304f -> Peer c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431): Couldn't send request to peer c0f503bf8bb94af8a2a1139db4e1c0f5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:11.510833 24165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393e5cc2614c90b69a3bb2348dacb9" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" is_pre_election: true
I20260709 13:09:11.511699 24165 raft_consensus.cc:2468] T 49393e5cc2614c90b69a3bb2348dacb9 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8d4657116f948038a0c73018238c3ba in term 0.
I20260709 13:09:11.526321 24206 leader_election.cc:304] T 49393e5cc2614c90b69a3bb2348dacb9 P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0f503bf8bb94af8a2a1139db4e1c0f5, f8d4657116f948038a0c73018238c3ba; no voters: 
I20260709 13:09:11.527765 24367 raft_consensus.cc:2804] T 49393e5cc2614c90b69a3bb2348dacb9 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:11.528194 24367 raft_consensus.cc:493] T 49393e5cc2614c90b69a3bb2348dacb9 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:11.527977 24222 tablet_service.cc:1511] Processing CreateTablet for tablet 01f1144c4a1c482894ec993e5ce24bc4 (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:09:11.529433 24222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01f1144c4a1c482894ec993e5ce24bc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.528601 24367 raft_consensus.cc:3060] T 49393e5cc2614c90b69a3bb2348dacb9 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:11.522588 24396 raft_consensus.cc:493] T c7b586130d5842f293b0df4b02792ec6 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.542645 24091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393e5cc2614c90b69a3bb2348dacb9" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dea34817fcc148d78f090ef5fa72304f" is_pre_election: true
I20260709 13:09:11.539618 24396 raft_consensus.cc:515] T c7b586130d5842f293b0df4b02792ec6 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:11.549518 24360 tablet_bootstrap.cc:654] T 45b65ebcb0114044a04e5689db4a466f P c0f503bf8bb94af8a2a1139db4e1c0f5: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:11.552452 24165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7b586130d5842f293b0df4b02792ec6" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" is_pre_election: true
W20260709 13:09:11.554026 24206 leader_election.cc:343] T c7b586130d5842f293b0df4b02792ec6 P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:11.554648 24396 leader_election.cc:290] T c7b586130d5842f293b0df4b02792ec6 P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431), b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561)
I20260709 13:09:11.556481 24299 tablet_service.cc:1511] Processing CreateTablet for tablet 01f1144c4a1c482894ec993e5ce24bc4 (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:09:11.558365 24299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01f1144c4a1c482894ec993e5ce24bc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.558427 23986 catalog_manager.cc:5697] T de5786fbd53646a9bc152ac0a2a9aa53 P f8d4657116f948038a0c73018238c3ba reported cstate change: term changed from 0 to 1, leader changed from <none> to f8d4657116f948038a0c73018238c3ba (127.14.180.67). New cstate: current_term: 1 leader_uuid: "f8d4657116f948038a0c73018238c3ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:11.569779 24206 leader_election.cc:343] T 49393e5cc2614c90b69a3bb2348dacb9 P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:11.575686 24072 tablet_service.cc:1511] Processing CreateTablet for tablet 01f1144c4a1c482894ec993e5ce24bc4 (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:09:11.576858 24361 tablet_bootstrap.cc:492] T 93e868a924d74bbc8bf29aa5a7fc67fd P f8d4657116f948038a0c73018238c3ba: No bootstrap required, opened a new log
I20260709 13:09:11.577103 24072 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01f1144c4a1c482894ec993e5ce24bc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.577417 24361 ts_tablet_manager.cc:1403] T 93e868a924d74bbc8bf29aa5a7fc67fd P f8d4657116f948038a0c73018238c3ba: Time spent bootstrapping tablet: real 0.191s	user 0.012s	sys 0.007s
I20260709 13:09:11.581209 24361 raft_consensus.cc:359] T 93e868a924d74bbc8bf29aa5a7fc67fd P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:11.581971 24361 raft_consensus.cc:385] T 93e868a924d74bbc8bf29aa5a7fc67fd P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:11.582278 24361 raft_consensus.cc:740] T 93e868a924d74bbc8bf29aa5a7fc67fd P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8d4657116f948038a0c73018238c3ba, State: Initialized, Role: FOLLOWER
I20260709 13:09:11.588460 24362 tablet_bootstrap.cc:492] T f735173e22b242178edcdf4821b6f92b P b39c386162de49aca92dbebee7f06ace: No bootstrap required, opened a new log
I20260709 13:09:11.588086 24361 consensus_queue.cc:260] T 93e868a924d74bbc8bf29aa5a7fc67fd P f8d4657116f948038a0c73018238c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:11.589037 24362 ts_tablet_manager.cc:1403] T f735173e22b242178edcdf4821b6f92b P b39c386162de49aca92dbebee7f06ace: Time spent bootstrapping tablet: real 0.192s	user 0.012s	sys 0.022s
I20260709 13:09:11.592149 24361 ts_tablet_manager.cc:1434] T 93e868a924d74bbc8bf29aa5a7fc67fd P f8d4657116f948038a0c73018238c3ba: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.000s
I20260709 13:09:11.592310 24362 raft_consensus.cc:359] T f735173e22b242178edcdf4821b6f92b P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:11.593168 24362 raft_consensus.cc:385] T f735173e22b242178edcdf4821b6f92b P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:11.593415 24361 tablet_bootstrap.cc:492] T aac6068ee4554cce8f2d534a106ef417 P f8d4657116f948038a0c73018238c3ba: Bootstrap starting.
I20260709 13:09:11.593503 24362 raft_consensus.cc:740] T f735173e22b242178edcdf4821b6f92b P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b39c386162de49aca92dbebee7f06ace, State: Initialized, Role: FOLLOWER
I20260709 13:09:11.603703 24359 tablet_bootstrap.cc:492] T 49393e5cc2614c90b69a3bb2348dacb9 P dea34817fcc148d78f090ef5fa72304f: No bootstrap required, opened a new log
I20260709 13:09:11.604326 24359 ts_tablet_manager.cc:1403] T 49393e5cc2614c90b69a3bb2348dacb9 P dea34817fcc148d78f090ef5fa72304f: Time spent bootstrapping tablet: real 0.233s	user 0.024s	sys 0.015s
I20260709 13:09:11.605283 24150 tablet_service.cc:1511] Processing CreateTablet for tablet c5dc7f36da134739916e9685345be3ac (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:09:11.608045 24359 raft_consensus.cc:359] T 49393e5cc2614c90b69a3bb2348dacb9 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:11.609123 24359 raft_consensus.cc:385] T 49393e5cc2614c90b69a3bb2348dacb9 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:11.609768 24359 raft_consensus.cc:740] T 49393e5cc2614c90b69a3bb2348dacb9 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dea34817fcc148d78f090ef5fa72304f, State: Initialized, Role: FOLLOWER
I20260709 13:09:11.610868 24362 consensus_queue.cc:260] T f735173e22b242178edcdf4821b6f92b P b39c386162de49aca92dbebee7f06ace [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:11.612125 24230 tablet_service.cc:1511] Processing CreateTablet for tablet c5dc7f36da134739916e9685345be3ac (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:09:11.613560 24230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5dc7f36da134739916e9685345be3ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.620625 24302 tablet_service.cc:1511] Processing CreateTablet for tablet c5dc7f36da134739916e9685345be3ac (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:09:11.621337 24091 raft_consensus.cc:3060] T 502fe798081f4dc693eed179efa2a241 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:11.622395 24302 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5dc7f36da134739916e9685345be3ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.626346 24080 tablet_service.cc:1511] Processing CreateTablet for tablet 430894245c954e33b6586b4704c66b3c (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:09:11.628023 24080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 430894245c954e33b6586b4704c66b3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.629738 24362 ts_tablet_manager.cc:1434] T f735173e22b242178edcdf4821b6f92b P b39c386162de49aca92dbebee7f06ace: Time spent starting tablet: real 0.040s	user 0.006s	sys 0.002s
I20260709 13:09:11.631011 24362 tablet_bootstrap.cc:492] T c7b586130d5842f293b0df4b02792ec6 P b39c386162de49aca92dbebee7f06ace: Bootstrap starting.
I20260709 13:09:11.632119 24150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5dc7f36da134739916e9685345be3ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.637122 24240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f373ffd46f4625bac910b5ccf4b767" candidate_uuid: "b39c386162de49aca92dbebee7f06ace" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8d4657116f948038a0c73018238c3ba" is_pre_election: true
I20260709 13:09:11.639055 24396 consensus_queue.cc:1048] T 502fe798081f4dc693eed179efa2a241 P f8d4657116f948038a0c73018238c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:09:11.640300 24279 leader_election.cc:343] T 46f373ffd46f4625bac910b5ccf4b767 P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:11.644740 24360 tablet_bootstrap.cc:492] T 45b65ebcb0114044a04e5689db4a466f P c0f503bf8bb94af8a2a1139db4e1c0f5: No bootstrap required, opened a new log
I20260709 13:09:11.645603 24360 ts_tablet_manager.cc:1403] T 45b65ebcb0114044a04e5689db4a466f P c0f503bf8bb94af8a2a1139db4e1c0f5: Time spent bootstrapping tablet: real 0.164s	user 0.020s	sys 0.003s
I20260709 13:09:11.610752 24359 consensus_queue.cc:260] T 49393e5cc2614c90b69a3bb2348dacb9 P dea34817fcc148d78f090ef5fa72304f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:11.605345 24367 raft_consensus.cc:515] T 49393e5cc2614c90b69a3bb2348dacb9 P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:11.653095 24367 leader_election.cc:290] T 49393e5cc2614c90b69a3bb2348dacb9 P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 election: Requested vote from peers dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343), c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431)
I20260709 13:09:11.655488 24090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393e5cc2614c90b69a3bb2348dacb9" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dea34817fcc148d78f090ef5fa72304f"
I20260709 13:09:11.656265 24090 raft_consensus.cc:3060] T 49393e5cc2614c90b69a3bb2348dacb9 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:11.656996 24149 tablet_service.cc:1511] Processing CreateTablet for tablet 430894245c954e33b6586b4704c66b3c (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:09:11.658497 24149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 430894245c954e33b6586b4704c66b3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.658972 24166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393e5cc2614c90b69a3bb2348dacb9" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5"
I20260709 13:09:11.659651 24166 raft_consensus.cc:3060] T 49393e5cc2614c90b69a3bb2348dacb9 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:11.665932 24090 raft_consensus.cc:2468] T 49393e5cc2614c90b69a3bb2348dacb9 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8d4657116f948038a0c73018238c3ba in term 1.
I20260709 13:09:11.667599 24206 leader_election.cc:304] T 49393e5cc2614c90b69a3bb2348dacb9 P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dea34817fcc148d78f090ef5fa72304f, f8d4657116f948038a0c73018238c3ba; no voters: 
I20260709 13:09:11.668044 24166 raft_consensus.cc:2468] T 49393e5cc2614c90b69a3bb2348dacb9 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8d4657116f948038a0c73018238c3ba in term 1.
I20260709 13:09:11.668743 24367 raft_consensus.cc:2804] T 49393e5cc2614c90b69a3bb2348dacb9 P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:11.669263 24367 raft_consensus.cc:697] T 49393e5cc2614c90b69a3bb2348dacb9 P f8d4657116f948038a0c73018238c3ba [term 1 LEADER]: Becoming Leader. State: Replica: f8d4657116f948038a0c73018238c3ba, State: Running, Role: LEADER
I20260709 13:09:11.670194 24367 consensus_queue.cc:237] T 49393e5cc2614c90b69a3bb2348dacb9 P f8d4657116f948038a0c73018238c3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:11.674719 24229 tablet_service.cc:1511] Processing CreateTablet for tablet 430894245c954e33b6586b4704c66b3c (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:09:11.676185 24229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 430894245c954e33b6586b4704c66b3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.681325 24296 tablet_service.cc:1511] Processing CreateTablet for tablet 99b130381d71460388507938ba053f8f (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:09:11.659602 24359 ts_tablet_manager.cc:1434] T 49393e5cc2614c90b69a3bb2348dacb9 P dea34817fcc148d78f090ef5fa72304f: Time spent starting tablet: real 0.055s	user 0.010s	sys 0.000s
I20260709 13:09:11.683492 24359 tablet_bootstrap.cc:492] T 42868db4862647c28215f3d7cb9adf02 P dea34817fcc148d78f090ef5fa72304f: Bootstrap starting.
I20260709 13:09:11.686919 24296 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99b130381d71460388507938ba053f8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.691663 24362 tablet_bootstrap.cc:654] T c7b586130d5842f293b0df4b02792ec6 P b39c386162de49aca92dbebee7f06ace: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:11.693822 24078 tablet_service.cc:1511] Processing CreateTablet for tablet 99b130381d71460388507938ba053f8f (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:09:11.695341 24078 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99b130381d71460388507938ba053f8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.703310 24368 raft_consensus.cc:493] T 502fe798081f4dc693eed179efa2a241 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.703943 24368 raft_consensus.cc:515] T 502fe798081f4dc693eed179efa2a241 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:11.706878 24153 tablet_service.cc:1511] Processing CreateTablet for tablet 99b130381d71460388507938ba053f8f (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:09:11.708125 24368 leader_election.cc:290] T 502fe798081f4dc693eed179efa2a241 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431), f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171)
I20260709 13:09:11.709712 24240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "502fe798081f4dc693eed179efa2a241" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8d4657116f948038a0c73018238c3ba" is_pre_election: true
I20260709 13:09:11.709712 24165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "502fe798081f4dc693eed179efa2a241" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" is_pre_election: true
I20260709 13:09:11.711771 24226 tablet_service.cc:1511] Processing CreateTablet for tablet a0ff7e0491fb406d9e1f13941504372f (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:09:11.713158 24226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0ff7e0491fb406d9e1f13941504372f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.714474 24361 tablet_bootstrap.cc:654] T aac6068ee4554cce8f2d534a106ef417 P f8d4657116f948038a0c73018238c3ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:11.720371 24056 leader_election.cc:304] T 502fe798081f4dc693eed179efa2a241 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dea34817fcc148d78f090ef5fa72304f; no voters: c0f503bf8bb94af8a2a1139db4e1c0f5, f8d4657116f948038a0c73018238c3ba
I20260709 13:09:11.721503 24419 raft_consensus.cc:2749] T 502fe798081f4dc693eed179efa2a241 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:11.724099 24359 tablet_bootstrap.cc:654] T 42868db4862647c28215f3d7cb9adf02 P dea34817fcc148d78f090ef5fa72304f: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:11.730871 24362 tablet_bootstrap.cc:492] T c7b586130d5842f293b0df4b02792ec6 P b39c386162de49aca92dbebee7f06ace: No bootstrap required, opened a new log
I20260709 13:09:11.731537 24362 ts_tablet_manager.cc:1403] T c7b586130d5842f293b0df4b02792ec6 P b39c386162de49aca92dbebee7f06ace: Time spent bootstrapping tablet: real 0.101s	user 0.009s	sys 0.005s
I20260709 13:09:11.738932 24420 consensus_queue.cc:1048] T 502fe798081f4dc693eed179efa2a241 P f8d4657116f948038a0c73018238c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:11.739531 23985 catalog_manager.cc:5697] T 49393e5cc2614c90b69a3bb2348dacb9 P f8d4657116f948038a0c73018238c3ba reported cstate change: term changed from 0 to 1, leader changed from <none> to f8d4657116f948038a0c73018238c3ba (127.14.180.67). New cstate: current_term: 1 leader_uuid: "f8d4657116f948038a0c73018238c3ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:11.747151 24362 raft_consensus.cc:359] T c7b586130d5842f293b0df4b02792ec6 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:11.776369 24090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f373ffd46f4625bac910b5ccf4b767" candidate_uuid: "b39c386162de49aca92dbebee7f06ace" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dea34817fcc148d78f090ef5fa72304f" is_pre_election: true
I20260709 13:09:11.778755 24314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7b586130d5842f293b0df4b02792ec6" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace" is_pre_election: true
W20260709 13:09:11.780611 24280 leader_election.cc:343] T 46f373ffd46f4625bac910b5ccf4b767 P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:11.781174 24280 leader_election.cc:304] T 46f373ffd46f4625bac910b5ccf4b767 P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b39c386162de49aca92dbebee7f06ace; no voters: dea34817fcc148d78f090ef5fa72304f, f8d4657116f948038a0c73018238c3ba
I20260709 13:09:11.782878 24080 tablet_service.cc:1511] Processing CreateTablet for tablet a0ff7e0491fb406d9e1f13941504372f (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:09:11.784302 24080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0ff7e0491fb406d9e1f13941504372f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.784302 24377 raft_consensus.cc:2749] T 46f373ffd46f4625bac910b5ccf4b767 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:11.785616 24361 tablet_bootstrap.cc:492] T aac6068ee4554cce8f2d534a106ef417 P f8d4657116f948038a0c73018238c3ba: No bootstrap required, opened a new log
I20260709 13:09:11.786175 24361 ts_tablet_manager.cc:1403] T aac6068ee4554cce8f2d534a106ef417 P f8d4657116f948038a0c73018238c3ba: Time spent bootstrapping tablet: real 0.193s	user 0.009s	sys 0.005s
I20260709 13:09:11.758744 24362 raft_consensus.cc:385] T c7b586130d5842f293b0df4b02792ec6 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:11.786852 24362 raft_consensus.cc:740] T c7b586130d5842f293b0df4b02792ec6 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b39c386162de49aca92dbebee7f06ace, State: Initialized, Role: FOLLOWER
I20260709 13:09:11.787671 24362 consensus_queue.cc:260] T c7b586130d5842f293b0df4b02792ec6 P b39c386162de49aca92dbebee7f06ace [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:11.788699 24314 raft_consensus.cc:2468] T c7b586130d5842f293b0df4b02792ec6 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8d4657116f948038a0c73018238c3ba in term 0.
I20260709 13:09:11.788524 24156 tablet_service.cc:1511] Processing CreateTablet for tablet 71cb3d981445473ca321bbe44299879c (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:09:11.779686 24304 tablet_service.cc:1511] Processing CreateTablet for tablet a0ff7e0491fb406d9e1f13941504372f (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:09:11.790086 24362 ts_tablet_manager.cc:1434] T c7b586130d5842f293b0df4b02792ec6 P b39c386162de49aca92dbebee7f06ace: Time spent starting tablet: real 0.058s	user 0.007s	sys 0.000s
I20260709 13:09:11.802172 24296 tablet_service.cc:1511] Processing CreateTablet for tablet 71cb3d981445473ca321bbe44299879c (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:09:11.801249 24204 leader_election.cc:304] T c7b586130d5842f293b0df4b02792ec6 P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b39c386162de49aca92dbebee7f06ace, f8d4657116f948038a0c73018238c3ba; no voters: c0f503bf8bb94af8a2a1139db4e1c0f5
I20260709 13:09:11.803696 24420 raft_consensus.cc:2804] T c7b586130d5842f293b0df4b02792ec6 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:11.804095 24420 raft_consensus.cc:493] T c7b586130d5842f293b0df4b02792ec6 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:11.804303 24304 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0ff7e0491fb406d9e1f13941504372f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.804417 24420 raft_consensus.cc:3060] T c7b586130d5842f293b0df4b02792ec6 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:11.807425 24072 tablet_service.cc:1511] Processing CreateTablet for tablet 3bcebec1ac994b99a49430f4f892d615 (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:09:11.808888 24072 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bcebec1ac994b99a49430f4f892d615. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.805703 24153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99b130381d71460388507938ba053f8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.804834 24360 raft_consensus.cc:359] T 45b65ebcb0114044a04e5689db4a466f P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:11.815569 24360 raft_consensus.cc:385] T 45b65ebcb0114044a04e5689db4a466f P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:11.815972 24360 raft_consensus.cc:740] T 45b65ebcb0114044a04e5689db4a466f P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0f503bf8bb94af8a2a1139db4e1c0f5, State: Initialized, Role: FOLLOWER
I20260709 13:09:11.817004 24360 consensus_queue.cc:260] T 45b65ebcb0114044a04e5689db4a466f P c0f503bf8bb94af8a2a1139db4e1c0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:11.827248 24377 raft_consensus.cc:493] T 42868db4862647c28215f3d7cb9adf02 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.827800 24377 raft_consensus.cc:515] T 42868db4862647c28215f3d7cb9adf02 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:11.828475 24150 tablet_service.cc:1511] Processing CreateTablet for tablet 3bcebec1ac994b99a49430f4f892d615 (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:09:11.828802 24359 tablet_bootstrap.cc:492] T 42868db4862647c28215f3d7cb9adf02 P dea34817fcc148d78f090ef5fa72304f: No bootstrap required, opened a new log
I20260709 13:09:11.829420 24359 ts_tablet_manager.cc:1403] T 42868db4862647c28215f3d7cb9adf02 P dea34817fcc148d78f090ef5fa72304f: Time spent bootstrapping tablet: real 0.146s	user 0.023s	sys 0.029s
I20260709 13:09:11.829984 24377 leader_election.cc:290] T 42868db4862647c28215f3d7cb9adf02 P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171), dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343)
I20260709 13:09:11.830201 24230 tablet_service.cc:1511] Processing CreateTablet for tablet 71cb3d981445473ca321bbe44299879c (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:09:11.831701 24230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71cb3d981445473ca321bbe44299879c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.841585 24090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42868db4862647c28215f3d7cb9adf02" candidate_uuid: "b39c386162de49aca92dbebee7f06ace" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dea34817fcc148d78f090ef5fa72304f" is_pre_election: true
I20260709 13:09:11.841590 24156 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71cb3d981445473ca321bbe44299879c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.842748 24150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bcebec1ac994b99a49430f4f892d615. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.844200 24300 tablet_service.cc:1511] Processing CreateTablet for tablet 03bfe46bf2b74722b6e8eb3015e38f43 (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
W20260709 13:09:11.845790 24280 leader_election.cc:343] T 42868db4862647c28215f3d7cb9adf02 P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:11.848348 24296 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71cb3d981445473ca321bbe44299879c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.848125 24078 tablet_service.cc:1511] Processing CreateTablet for tablet 03bfe46bf2b74722b6e8eb3015e38f43 (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:09:11.849489 24078 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03bfe46bf2b74722b6e8eb3015e38f43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.851212 24300 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03bfe46bf2b74722b6e8eb3015e38f43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.852463 24151 tablet_service.cc:1511] Processing CreateTablet for tablet 03bfe46bf2b74722b6e8eb3015e38f43 (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:09:11.853878 24151 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03bfe46bf2b74722b6e8eb3015e38f43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.834208 24362 tablet_bootstrap.cc:492] T 45b65ebcb0114044a04e5689db4a466f P b39c386162de49aca92dbebee7f06ace: Bootstrap starting.
I20260709 13:09:11.855631 24229 tablet_service.cc:1511] Processing CreateTablet for tablet 3bcebec1ac994b99a49430f4f892d615 (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:09:11.868366 24360 ts_tablet_manager.cc:1434] T 45b65ebcb0114044a04e5689db4a466f P c0f503bf8bb94af8a2a1139db4e1c0f5: Time spent starting tablet: real 0.222s	user 0.009s	sys 0.003s
I20260709 13:09:11.869623 24360 tablet_bootstrap.cc:492] T aac6068ee4554cce8f2d534a106ef417 P c0f503bf8bb94af8a2a1139db4e1c0f5: Bootstrap starting.
I20260709 13:09:11.870710 24222 tablet_service.cc:1511] Processing CreateTablet for tablet 662a938528e545e6aa4592052da18101 (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:09:11.880016 24229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bcebec1ac994b99a49430f4f892d615. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.831794 24240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42868db4862647c28215f3d7cb9adf02" candidate_uuid: "b39c386162de49aca92dbebee7f06ace" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8d4657116f948038a0c73018238c3ba" is_pre_election: true
I20260709 13:09:11.881459 24222 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 662a938528e545e6aa4592052da18101. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:09:11.882830 24279 leader_election.cc:343] T 42868db4862647c28215f3d7cb9adf02 P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:11.883378 24279 leader_election.cc:304] T 42868db4862647c28215f3d7cb9adf02 P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b39c386162de49aca92dbebee7f06ace; no voters: dea34817fcc148d78f090ef5fa72304f, f8d4657116f948038a0c73018238c3ba
I20260709 13:09:11.884604 24377 raft_consensus.cc:2749] T 42868db4862647c28215f3d7cb9adf02 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:11.824141 24361 raft_consensus.cc:359] T aac6068ee4554cce8f2d534a106ef417 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:11.891095 24361 raft_consensus.cc:385] T aac6068ee4554cce8f2d534a106ef417 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:11.891563 24361 raft_consensus.cc:740] T aac6068ee4554cce8f2d534a106ef417 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8d4657116f948038a0c73018238c3ba, State: Initialized, Role: FOLLOWER
I20260709 13:09:11.892572 24361 consensus_queue.cc:260] T aac6068ee4554cce8f2d534a106ef417 P f8d4657116f948038a0c73018238c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:11.894975 24361 ts_tablet_manager.cc:1434] T aac6068ee4554cce8f2d534a106ef417 P f8d4657116f948038a0c73018238c3ba: Time spent starting tablet: real 0.108s	user 0.008s	sys 0.002s
I20260709 13:09:11.907482 24361 tablet_bootstrap.cc:492] T 46f373ffd46f4625bac910b5ccf4b767 P f8d4657116f948038a0c73018238c3ba: Bootstrap starting.
I20260709 13:09:11.909807 24296 tablet_service.cc:1511] Processing CreateTablet for tablet 662a938528e545e6aa4592052da18101 (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:09:11.920682 24296 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 662a938528e545e6aa4592052da18101. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.909596 24077 tablet_service.cc:1511] Processing CreateTablet for tablet 662a938528e545e6aa4592052da18101 (DEFAULT_TABLE table=test-workload [id=4a2613beb8a3478486d4aee029c868b6]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:09:11.923417 24077 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 662a938528e545e6aa4592052da18101. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:11.930723 24362 tablet_bootstrap.cc:654] T 45b65ebcb0114044a04e5689db4a466f P b39c386162de49aca92dbebee7f06ace: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:11.912142 24359 raft_consensus.cc:359] T 42868db4862647c28215f3d7cb9adf02 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:11.942647 24359 raft_consensus.cc:385] T 42868db4862647c28215f3d7cb9adf02 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:11.943050 24359 raft_consensus.cc:740] T 42868db4862647c28215f3d7cb9adf02 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dea34817fcc148d78f090ef5fa72304f, State: Initialized, Role: FOLLOWER
I20260709 13:09:11.943868 24359 consensus_queue.cc:260] T 42868db4862647c28215f3d7cb9adf02 P dea34817fcc148d78f090ef5fa72304f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:11.919169 24420 raft_consensus.cc:515] T c7b586130d5842f293b0df4b02792ec6 P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:11.948282 24359 ts_tablet_manager.cc:1434] T 42868db4862647c28215f3d7cb9adf02 P dea34817fcc148d78f090ef5fa72304f: Time spent starting tablet: real 0.119s	user 0.008s	sys 0.001s
I20260709 13:09:11.949115 24165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7b586130d5842f293b0df4b02792ec6" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5"
I20260709 13:09:11.949756 24367 consensus_queue.cc:1048] T de5786fbd53646a9bc152ac0a2a9aa53 P f8d4657116f948038a0c73018238c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:11.950343 24359 tablet_bootstrap.cc:492] T f735173e22b242178edcdf4821b6f92b P dea34817fcc148d78f090ef5fa72304f: Bootstrap starting.
I20260709 13:09:11.949429 24314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7b586130d5842f293b0df4b02792ec6" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace"
I20260709 13:09:11.951347 24314 raft_consensus.cc:3060] T c7b586130d5842f293b0df4b02792ec6 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:11.955497 24206 leader_election.cc:343] T c7b586130d5842f293b0df4b02792ec6 P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:11.958927 24359 tablet_bootstrap.cc:654] T f735173e22b242178edcdf4821b6f92b P dea34817fcc148d78f090ef5fa72304f: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:11.948697 24420 leader_election.cc:290] T c7b586130d5842f293b0df4b02792ec6 P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 election: Requested vote from peers c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431), b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561)
I20260709 13:09:11.968163 24359 tablet_bootstrap.cc:492] T f735173e22b242178edcdf4821b6f92b P dea34817fcc148d78f090ef5fa72304f: No bootstrap required, opened a new log
I20260709 13:09:11.968873 24359 ts_tablet_manager.cc:1403] T f735173e22b242178edcdf4821b6f92b P dea34817fcc148d78f090ef5fa72304f: Time spent bootstrapping tablet: real 0.019s	user 0.011s	sys 0.000s
I20260709 13:09:11.972388 24314 raft_consensus.cc:2468] T c7b586130d5842f293b0df4b02792ec6 P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8d4657116f948038a0c73018238c3ba in term 1.
I20260709 13:09:11.972200 24359 raft_consensus.cc:359] T f735173e22b242178edcdf4821b6f92b P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:11.973156 24359 raft_consensus.cc:385] T f735173e22b242178edcdf4821b6f92b P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:11.973500 24359 raft_consensus.cc:740] T f735173e22b242178edcdf4821b6f92b P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dea34817fcc148d78f090ef5fa72304f, State: Initialized, Role: FOLLOWER
I20260709 13:09:11.974218 24204 leader_election.cc:304] T c7b586130d5842f293b0df4b02792ec6 P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b39c386162de49aca92dbebee7f06ace, f8d4657116f948038a0c73018238c3ba; no voters: c0f503bf8bb94af8a2a1139db4e1c0f5
I20260709 13:09:11.974335 24359 consensus_queue.cc:260] T f735173e22b242178edcdf4821b6f92b P dea34817fcc148d78f090ef5fa72304f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:11.976922 24362 tablet_bootstrap.cc:492] T 45b65ebcb0114044a04e5689db4a466f P b39c386162de49aca92dbebee7f06ace: No bootstrap required, opened a new log
I20260709 13:09:11.977535 24362 ts_tablet_manager.cc:1403] T 45b65ebcb0114044a04e5689db4a466f P b39c386162de49aca92dbebee7f06ace: Time spent bootstrapping tablet: real 0.144s	user 0.010s	sys 0.001s
I20260709 13:09:11.978832 24360 tablet_bootstrap.cc:654] T aac6068ee4554cce8f2d534a106ef417 P c0f503bf8bb94af8a2a1139db4e1c0f5: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:11.979858 24206 consensus_peers.cc:597] T de5786fbd53646a9bc152ac0a2a9aa53 P f8d4657116f948038a0c73018238c3ba -> Peer c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431): Couldn't send request to peer c0f503bf8bb94af8a2a1139db4e1c0f5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:11.983465 24359 ts_tablet_manager.cc:1434] T f735173e22b242178edcdf4821b6f92b P dea34817fcc148d78f090ef5fa72304f: Time spent starting tablet: real 0.014s	user 0.010s	sys 0.000s
I20260709 13:09:11.977599 24367 raft_consensus.cc:2804] T c7b586130d5842f293b0df4b02792ec6 P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:11.984390 24367 raft_consensus.cc:697] T c7b586130d5842f293b0df4b02792ec6 P f8d4657116f948038a0c73018238c3ba [term 1 LEADER]: Becoming Leader. State: Replica: f8d4657116f948038a0c73018238c3ba, State: Running, Role: LEADER
I20260709 13:09:11.984686 24359 tablet_bootstrap.cc:492] T 99078769583e49908dd6990f1d806453 P dea34817fcc148d78f090ef5fa72304f: Bootstrap starting.
I20260709 13:09:11.984803 24362 raft_consensus.cc:359] T 45b65ebcb0114044a04e5689db4a466f P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:11.985740 24362 raft_consensus.cc:385] T 45b65ebcb0114044a04e5689db4a466f P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:11.985258 24367 consensus_queue.cc:237] T c7b586130d5842f293b0df4b02792ec6 P f8d4657116f948038a0c73018238c3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:11.986114 24362 raft_consensus.cc:740] T 45b65ebcb0114044a04e5689db4a466f P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b39c386162de49aca92dbebee7f06ace, State: Initialized, Role: FOLLOWER
I20260709 13:09:11.987370 24362 consensus_queue.cc:260] T 45b65ebcb0114044a04e5689db4a466f P b39c386162de49aca92dbebee7f06ace [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:11.926419 24361 tablet_bootstrap.cc:654] T 46f373ffd46f4625bac910b5ccf4b767 P f8d4657116f948038a0c73018238c3ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:11.993505 24371 raft_consensus.cc:493] T f735173e22b242178edcdf4821b6f92b P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.993934 24359 tablet_bootstrap.cc:654] T 99078769583e49908dd6990f1d806453 P dea34817fcc148d78f090ef5fa72304f: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:11.994127 24371 raft_consensus.cc:515] T f735173e22b242178edcdf4821b6f92b P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
W20260709 13:09:11.994984 24037 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:12.016798 24240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f735173e22b242178edcdf4821b6f92b" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8d4657116f948038a0c73018238c3ba" is_pre_election: true
I20260709 13:09:12.017725 24371 leader_election.cc:290] T f735173e22b242178edcdf4821b6f92b P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171), b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561)
I20260709 13:09:12.019769 24314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f735173e22b242178edcdf4821b6f92b" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace" is_pre_election: true
I20260709 13:09:12.021447 24314 raft_consensus.cc:2468] T f735173e22b242178edcdf4821b6f92b P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dea34817fcc148d78f090ef5fa72304f in term 0.
I20260709 13:09:12.023722 24055 leader_election.cc:304] T f735173e22b242178edcdf4821b6f92b P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b39c386162de49aca92dbebee7f06ace, dea34817fcc148d78f090ef5fa72304f; no voters: 
W20260709 13:09:12.025105 24056 leader_election.cc:343] T f735173e22b242178edcdf4821b6f92b P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:12.027750 24362 ts_tablet_manager.cc:1434] T 45b65ebcb0114044a04e5689db4a466f P b39c386162de49aca92dbebee7f06ace: Time spent starting tablet: real 0.050s	user 0.009s	sys 0.000s
I20260709 13:09:12.025262 24371 raft_consensus.cc:2804] T f735173e22b242178edcdf4821b6f92b P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:12.029196 24371 raft_consensus.cc:493] T f735173e22b242178edcdf4821b6f92b P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:12.030057 24371 raft_consensus.cc:3060] T f735173e22b242178edcdf4821b6f92b P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:12.037782 24367 raft_consensus.cc:493] T 93e868a924d74bbc8bf29aa5a7fc67fd P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.038630 24367 raft_consensus.cc:515] T 93e868a924d74bbc8bf29aa5a7fc67fd P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:12.041555 24367 leader_election.cc:290] T 93e868a924d74bbc8bf29aa5a7fc67fd P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343), c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431)
I20260709 13:09:12.044477 24165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e868a924d74bbc8bf29aa5a7fc67fd" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" is_pre_election: true
I20260709 13:09:12.038870 23987 catalog_manager.cc:5697] T c7b586130d5842f293b0df4b02792ec6 P f8d4657116f948038a0c73018238c3ba reported cstate change: term changed from 0 to 1, leader changed from <none> to f8d4657116f948038a0c73018238c3ba (127.14.180.67). New cstate: current_term: 1 leader_uuid: "f8d4657116f948038a0c73018238c3ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:12.047761 24206 leader_election.cc:343] T 93e868a924d74bbc8bf29aa5a7fc67fd P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:12.049005 24091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e868a924d74bbc8bf29aa5a7fc67fd" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dea34817fcc148d78f090ef5fa72304f" is_pre_election: true
I20260709 13:09:12.051723 24362 tablet_bootstrap.cc:492] T aac6068ee4554cce8f2d534a106ef417 P b39c386162de49aca92dbebee7f06ace: Bootstrap starting.
I20260709 13:09:12.057835 24360 tablet_bootstrap.cc:492] T aac6068ee4554cce8f2d534a106ef417 P c0f503bf8bb94af8a2a1139db4e1c0f5: No bootstrap required, opened a new log
I20260709 13:09:12.058454 24360 ts_tablet_manager.cc:1403] T aac6068ee4554cce8f2d534a106ef417 P c0f503bf8bb94af8a2a1139db4e1c0f5: Time spent bootstrapping tablet: real 0.189s	user 0.019s	sys 0.019s
I20260709 13:09:12.061890 24360 raft_consensus.cc:359] T aac6068ee4554cce8f2d534a106ef417 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:12.062779 24360 raft_consensus.cc:385] T aac6068ee4554cce8f2d534a106ef417 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:12.063135 24360 raft_consensus.cc:740] T aac6068ee4554cce8f2d534a106ef417 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0f503bf8bb94af8a2a1139db4e1c0f5, State: Initialized, Role: FOLLOWER
W20260709 13:09:12.064405 24206 leader_election.cc:343] T 93e868a924d74bbc8bf29aa5a7fc67fd P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:12.064975 24206 leader_election.cc:304] T 93e868a924d74bbc8bf29aa5a7fc67fd P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8d4657116f948038a0c73018238c3ba; no voters: c0f503bf8bb94af8a2a1139db4e1c0f5, dea34817fcc148d78f090ef5fa72304f
I20260709 13:09:12.064790 24360 consensus_queue.cc:260] T aac6068ee4554cce8f2d534a106ef417 P c0f503bf8bb94af8a2a1139db4e1c0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:12.066238 24367 raft_consensus.cc:2749] T 93e868a924d74bbc8bf29aa5a7fc67fd P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:12.067327 24359 tablet_bootstrap.cc:492] T 99078769583e49908dd6990f1d806453 P dea34817fcc148d78f090ef5fa72304f: No bootstrap required, opened a new log
I20260709 13:09:12.067711 24361 tablet_bootstrap.cc:492] T 46f373ffd46f4625bac910b5ccf4b767 P f8d4657116f948038a0c73018238c3ba: No bootstrap required, opened a new log
I20260709 13:09:12.068058 24359 ts_tablet_manager.cc:1403] T 99078769583e49908dd6990f1d806453 P dea34817fcc148d78f090ef5fa72304f: Time spent bootstrapping tablet: real 0.084s	user 0.042s	sys 0.031s
I20260709 13:09:12.068251 24361 ts_tablet_manager.cc:1403] T 46f373ffd46f4625bac910b5ccf4b767 P f8d4657116f948038a0c73018238c3ba: Time spent bootstrapping tablet: real 0.161s	user 0.027s	sys 0.012s
I20260709 13:09:12.068616 24362 tablet_bootstrap.cc:654] T aac6068ee4554cce8f2d534a106ef417 P b39c386162de49aca92dbebee7f06ace: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:12.071673 24359 raft_consensus.cc:359] T 99078769583e49908dd6990f1d806453 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:12.071993 24361 raft_consensus.cc:359] T 46f373ffd46f4625bac910b5ccf4b767 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:12.072655 24359 raft_consensus.cc:385] T 99078769583e49908dd6990f1d806453 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:12.072814 24361 raft_consensus.cc:385] T 46f373ffd46f4625bac910b5ccf4b767 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:12.073240 24359 raft_consensus.cc:740] T 99078769583e49908dd6990f1d806453 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dea34817fcc148d78f090ef5fa72304f, State: Initialized, Role: FOLLOWER
I20260709 13:09:12.073560 24371 raft_consensus.cc:515] T f735173e22b242178edcdf4821b6f92b P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:12.074949 24360 ts_tablet_manager.cc:1434] T aac6068ee4554cce8f2d534a106ef417 P c0f503bf8bb94af8a2a1139db4e1c0f5: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.002s
I20260709 13:09:12.074421 24359 consensus_queue.cc:260] T 99078769583e49908dd6990f1d806453 P dea34817fcc148d78f090ef5fa72304f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:12.076574 24360 tablet_bootstrap.cc:492] T 9acec0d1a6e74a4bb39a0d867598acc5 P c0f503bf8bb94af8a2a1139db4e1c0f5: Bootstrap starting.
I20260709 13:09:12.077947 24240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f735173e22b242178edcdf4821b6f92b" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8d4657116f948038a0c73018238c3ba"
W20260709 13:09:12.079571 24056 leader_election.cc:343] T f735173e22b242178edcdf4821b6f92b P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:12.073269 24361 raft_consensus.cc:740] T 46f373ffd46f4625bac910b5ccf4b767 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8d4657116f948038a0c73018238c3ba, State: Initialized, Role: FOLLOWER
I20260709 13:09:12.081240 24361 consensus_queue.cc:260] T 46f373ffd46f4625bac910b5ccf4b767 P f8d4657116f948038a0c73018238c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:12.081693 24359 ts_tablet_manager.cc:1434] T 99078769583e49908dd6990f1d806453 P dea34817fcc148d78f090ef5fa72304f: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:09:12.082067 24314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f735173e22b242178edcdf4821b6f92b" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace"
I20260709 13:09:12.082751 24314 raft_consensus.cc:3060] T f735173e22b242178edcdf4821b6f92b P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:12.083331 24359 tablet_bootstrap.cc:492] T 46f373ffd46f4625bac910b5ccf4b767 P dea34817fcc148d78f090ef5fa72304f: Bootstrap starting.
I20260709 13:09:12.086576 24361 ts_tablet_manager.cc:1434] T 46f373ffd46f4625bac910b5ccf4b767 P f8d4657116f948038a0c73018238c3ba: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.002s
I20260709 13:09:12.087906 24361 tablet_bootstrap.cc:492] T c5873f7465894eddab6fa84daecdcc84 P f8d4657116f948038a0c73018238c3ba: Bootstrap starting.
I20260709 13:09:12.090860 24359 tablet_bootstrap.cc:654] T 46f373ffd46f4625bac910b5ccf4b767 P dea34817fcc148d78f090ef5fa72304f: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:12.093405 24314 raft_consensus.cc:2468] T f735173e22b242178edcdf4821b6f92b P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dea34817fcc148d78f090ef5fa72304f in term 1.
I20260709 13:09:12.094800 24055 leader_election.cc:304] T f735173e22b242178edcdf4821b6f92b P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b39c386162de49aca92dbebee7f06ace, dea34817fcc148d78f090ef5fa72304f; no voters: f8d4657116f948038a0c73018238c3ba
I20260709 13:09:12.095932 24419 raft_consensus.cc:2804] T f735173e22b242178edcdf4821b6f92b P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:12.096459 24419 raft_consensus.cc:697] T f735173e22b242178edcdf4821b6f92b P dea34817fcc148d78f090ef5fa72304f [term 1 LEADER]: Becoming Leader. State: Replica: dea34817fcc148d78f090ef5fa72304f, State: Running, Role: LEADER
I20260709 13:09:12.097342 24419 consensus_queue.cc:237] T f735173e22b242178edcdf4821b6f92b P dea34817fcc148d78f090ef5fa72304f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:12.098003 24360 tablet_bootstrap.cc:654] T 9acec0d1a6e74a4bb39a0d867598acc5 P c0f503bf8bb94af8a2a1139db4e1c0f5: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:12.101092 24361 tablet_bootstrap.cc:654] T c5873f7465894eddab6fa84daecdcc84 P f8d4657116f948038a0c73018238c3ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:12.107499 24371 leader_election.cc:290] T f735173e22b242178edcdf4821b6f92b P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 election: Requested vote from peers f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171), b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561)
I20260709 13:09:12.113804 24361 tablet_bootstrap.cc:492] T c5873f7465894eddab6fa84daecdcc84 P f8d4657116f948038a0c73018238c3ba: No bootstrap required, opened a new log
I20260709 13:09:12.114347 24361 ts_tablet_manager.cc:1403] T c5873f7465894eddab6fa84daecdcc84 P f8d4657116f948038a0c73018238c3ba: Time spent bootstrapping tablet: real 0.027s	user 0.013s	sys 0.000s
I20260709 13:09:12.118387 24360 tablet_bootstrap.cc:492] T 9acec0d1a6e74a4bb39a0d867598acc5 P c0f503bf8bb94af8a2a1139db4e1c0f5: No bootstrap required, opened a new log
I20260709 13:09:12.118760 24362 tablet_bootstrap.cc:492] T aac6068ee4554cce8f2d534a106ef417 P b39c386162de49aca92dbebee7f06ace: No bootstrap required, opened a new log
I20260709 13:09:12.118309 24361 raft_consensus.cc:359] T c5873f7465894eddab6fa84daecdcc84 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:12.119220 24360 ts_tablet_manager.cc:1403] T 9acec0d1a6e74a4bb39a0d867598acc5 P c0f503bf8bb94af8a2a1139db4e1c0f5: Time spent bootstrapping tablet: real 0.043s	user 0.013s	sys 0.004s
I20260709 13:09:12.119339 24361 raft_consensus.cc:385] T c5873f7465894eddab6fa84daecdcc84 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:12.119401 24362 ts_tablet_manager.cc:1403] T aac6068ee4554cce8f2d534a106ef417 P b39c386162de49aca92dbebee7f06ace: Time spent bootstrapping tablet: real 0.068s	user 0.018s	sys 0.000s
I20260709 13:09:12.118930 23985 catalog_manager.cc:5697] T f735173e22b242178edcdf4821b6f92b P dea34817fcc148d78f090ef5fa72304f reported cstate change: term changed from 0 to 1, leader changed from <none> to dea34817fcc148d78f090ef5fa72304f (127.14.180.65). New cstate: current_term: 1 leader_uuid: "dea34817fcc148d78f090ef5fa72304f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:12.119973 24361 raft_consensus.cc:740] T c5873f7465894eddab6fa84daecdcc84 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8d4657116f948038a0c73018238c3ba, State: Initialized, Role: FOLLOWER
I20260709 13:09:12.121063 24361 consensus_queue.cc:260] T c5873f7465894eddab6fa84daecdcc84 P f8d4657116f948038a0c73018238c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:12.122857 24360 raft_consensus.cc:359] T 9acec0d1a6e74a4bb39a0d867598acc5 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:12.123725 24361 ts_tablet_manager.cc:1434] T c5873f7465894eddab6fa84daecdcc84 P f8d4657116f948038a0c73018238c3ba: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:09:12.123677 24360 raft_consensus.cc:385] T 9acec0d1a6e74a4bb39a0d867598acc5 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:12.124274 24360 raft_consensus.cc:740] T 9acec0d1a6e74a4bb39a0d867598acc5 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0f503bf8bb94af8a2a1139db4e1c0f5, State: Initialized, Role: FOLLOWER
I20260709 13:09:12.125283 24360 consensus_queue.cc:260] T 9acec0d1a6e74a4bb39a0d867598acc5 P c0f503bf8bb94af8a2a1139db4e1c0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:12.126653 24362 raft_consensus.cc:359] T aac6068ee4554cce8f2d534a106ef417 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:12.127441 24362 raft_consensus.cc:385] T aac6068ee4554cce8f2d534a106ef417 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:12.127758 24362 raft_consensus.cc:740] T aac6068ee4554cce8f2d534a106ef417 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b39c386162de49aca92dbebee7f06ace, State: Initialized, Role: FOLLOWER
I20260709 13:09:12.128170 24359 tablet_bootstrap.cc:492] T 46f373ffd46f4625bac910b5ccf4b767 P dea34817fcc148d78f090ef5fa72304f: No bootstrap required, opened a new log
I20260709 13:09:12.128747 24359 ts_tablet_manager.cc:1403] T 46f373ffd46f4625bac910b5ccf4b767 P dea34817fcc148d78f090ef5fa72304f: Time spent bootstrapping tablet: real 0.046s	user 0.017s	sys 0.014s
I20260709 13:09:12.128561 24362 consensus_queue.cc:260] T aac6068ee4554cce8f2d534a106ef417 P b39c386162de49aca92dbebee7f06ace [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:12.130338 24361 tablet_bootstrap.cc:492] T 47fcd2aa8e994186872c2e0f9995dd8a P f8d4657116f948038a0c73018238c3ba: Bootstrap starting.
I20260709 13:09:12.131474 24360 ts_tablet_manager.cc:1434] T 9acec0d1a6e74a4bb39a0d867598acc5 P c0f503bf8bb94af8a2a1139db4e1c0f5: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.002s
I20260709 13:09:12.131948 24359 raft_consensus.cc:359] T 46f373ffd46f4625bac910b5ccf4b767 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:12.139647 24359 raft_consensus.cc:385] T 46f373ffd46f4625bac910b5ccf4b767 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:12.140025 24359 raft_consensus.cc:740] T 46f373ffd46f4625bac910b5ccf4b767 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dea34817fcc148d78f090ef5fa72304f, State: Initialized, Role: FOLLOWER
I20260709 13:09:12.140205 24360 tablet_bootstrap.cc:492] T 93e868a924d74bbc8bf29aa5a7fc67fd P c0f503bf8bb94af8a2a1139db4e1c0f5: Bootstrap starting.
I20260709 13:09:12.141129 24359 consensus_queue.cc:260] T 46f373ffd46f4625bac910b5ccf4b767 P dea34817fcc148d78f090ef5fa72304f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:12.143766 24362 ts_tablet_manager.cc:1434] T aac6068ee4554cce8f2d534a106ef417 P b39c386162de49aca92dbebee7f06ace: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 13:09:12.143898 24359 ts_tablet_manager.cc:1434] T 46f373ffd46f4625bac910b5ccf4b767 P dea34817fcc148d78f090ef5fa72304f: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:09:12.145243 24362 tablet_bootstrap.cc:492] T 9acec0d1a6e74a4bb39a0d867598acc5 P b39c386162de49aca92dbebee7f06ace: Bootstrap starting.
I20260709 13:09:12.149190 24359 tablet_bootstrap.cc:492] T 47fcd2aa8e994186872c2e0f9995dd8a P dea34817fcc148d78f090ef5fa72304f: Bootstrap starting.
I20260709 13:09:12.149755 24367 raft_consensus.cc:493] T 46f373ffd46f4625bac910b5ccf4b767 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.150302 24367 raft_consensus.cc:515] T 46f373ffd46f4625bac910b5ccf4b767 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:12.152549 24367 leader_election.cc:290] T 46f373ffd46f4625bac910b5ccf4b767 P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561), dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343)
I20260709 13:09:12.154867 24361 tablet_bootstrap.cc:654] T 47fcd2aa8e994186872c2e0f9995dd8a P f8d4657116f948038a0c73018238c3ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:12.155431 24091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f373ffd46f4625bac910b5ccf4b767" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dea34817fcc148d78f090ef5fa72304f" is_pre_election: true
I20260709 13:09:12.155778 24359 tablet_bootstrap.cc:654] T 47fcd2aa8e994186872c2e0f9995dd8a P dea34817fcc148d78f090ef5fa72304f: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:12.156163 24091 raft_consensus.cc:2468] T 46f373ffd46f4625bac910b5ccf4b767 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8d4657116f948038a0c73018238c3ba in term 0.
I20260709 13:09:12.157027 24420 consensus_queue.cc:1048] T 49393e5cc2614c90b69a3bb2348dacb9 P f8d4657116f948038a0c73018238c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:12.159678 24206 leader_election.cc:304] T 46f373ffd46f4625bac910b5ccf4b767 P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dea34817fcc148d78f090ef5fa72304f, f8d4657116f948038a0c73018238c3ba; no voters: 
I20260709 13:09:12.161023 24420 raft_consensus.cc:2804] T 46f373ffd46f4625bac910b5ccf4b767 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:12.161428 24420 raft_consensus.cc:493] T 46f373ffd46f4625bac910b5ccf4b767 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:12.161759 24420 raft_consensus.cc:3060] T 46f373ffd46f4625bac910b5ccf4b767 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:12.162254 24362 tablet_bootstrap.cc:654] T 9acec0d1a6e74a4bb39a0d867598acc5 P b39c386162de49aca92dbebee7f06ace: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:12.163179 24360 tablet_bootstrap.cc:654] T 93e868a924d74bbc8bf29aa5a7fc67fd P c0f503bf8bb94af8a2a1139db4e1c0f5: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:12.164767 24359 tablet_bootstrap.cc:492] T 47fcd2aa8e994186872c2e0f9995dd8a P dea34817fcc148d78f090ef5fa72304f: No bootstrap required, opened a new log
I20260709 13:09:12.165408 24359 ts_tablet_manager.cc:1403] T 47fcd2aa8e994186872c2e0f9995dd8a P dea34817fcc148d78f090ef5fa72304f: Time spent bootstrapping tablet: real 0.016s	user 0.006s	sys 0.008s
I20260709 13:09:12.167649 24393 raft_consensus.cc:493] T 9acec0d1a6e74a4bb39a0d867598acc5 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.168553 24361 tablet_bootstrap.cc:492] T 47fcd2aa8e994186872c2e0f9995dd8a P f8d4657116f948038a0c73018238c3ba: No bootstrap required, opened a new log
I20260709 13:09:12.168186 24393 raft_consensus.cc:515] T 9acec0d1a6e74a4bb39a0d867598acc5 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:12.169060 24361 ts_tablet_manager.cc:1403] T 47fcd2aa8e994186872c2e0f9995dd8a P f8d4657116f948038a0c73018238c3ba: Time spent bootstrapping tablet: real 0.039s	user 0.003s	sys 0.006s
I20260709 13:09:12.169135 24359 raft_consensus.cc:359] T 47fcd2aa8e994186872c2e0f9995dd8a P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:12.169915 24359 raft_consensus.cc:385] T 47fcd2aa8e994186872c2e0f9995dd8a P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:12.170194 24359 raft_consensus.cc:740] T 47fcd2aa8e994186872c2e0f9995dd8a P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dea34817fcc148d78f090ef5fa72304f, State: Initialized, Role: FOLLOWER
I20260709 13:09:12.171052 24359 consensus_queue.cc:260] T 47fcd2aa8e994186872c2e0f9995dd8a P dea34817fcc148d78f090ef5fa72304f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:12.172209 24361 raft_consensus.cc:359] T 47fcd2aa8e994186872c2e0f9995dd8a P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:12.172626 24313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9acec0d1a6e74a4bb39a0d867598acc5" candidate_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace" is_pre_election: true
I20260709 13:09:12.172945 24361 raft_consensus.cc:385] T 47fcd2aa8e994186872c2e0f9995dd8a P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:12.173295 24361 raft_consensus.cc:740] T 47fcd2aa8e994186872c2e0f9995dd8a P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8d4657116f948038a0c73018238c3ba, State: Initialized, Role: FOLLOWER
I20260709 13:09:12.173496 24359 ts_tablet_manager.cc:1434] T 47fcd2aa8e994186872c2e0f9995dd8a P dea34817fcc148d78f090ef5fa72304f: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:09:12.174501 24359 tablet_bootstrap.cc:492] T 45b65ebcb0114044a04e5689db4a466f P dea34817fcc148d78f090ef5fa72304f: Bootstrap starting.
I20260709 13:09:12.174178 24361 consensus_queue.cc:260] T 47fcd2aa8e994186872c2e0f9995dd8a P f8d4657116f948038a0c73018238c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
W20260709 13:09:12.174867 24130 leader_election.cc:343] T 9acec0d1a6e74a4bb39a0d867598acc5 P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:12.175331 24396 raft_consensus.cc:493] T c5873f7465894eddab6fa84daecdcc84 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.175889 24091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9acec0d1a6e74a4bb39a0d867598acc5" candidate_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dea34817fcc148d78f090ef5fa72304f" is_pre_election: true
I20260709 13:09:12.175815 24396 raft_consensus.cc:515] T c5873f7465894eddab6fa84daecdcc84 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
W20260709 13:09:12.177546 24132 leader_election.cc:343] T 9acec0d1a6e74a4bb39a0d867598acc5 P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:12.178062 24132 leader_election.cc:304] T 9acec0d1a6e74a4bb39a0d867598acc5 P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0f503bf8bb94af8a2a1139db4e1c0f5; no voters: b39c386162de49aca92dbebee7f06ace, dea34817fcc148d78f090ef5fa72304f
I20260709 13:09:12.178733 24396 leader_election.cc:290] T c5873f7465894eddab6fa84daecdcc84 P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431), b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561)
I20260709 13:09:12.179699 24393 leader_election.cc:290] T 9acec0d1a6e74a4bb39a0d867598acc5 P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561), dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343)
I20260709 13:09:12.180925 24313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5873f7465894eddab6fa84daecdcc84" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace" is_pre_election: true
I20260709 13:09:12.182183 24359 tablet_bootstrap.cc:654] T 45b65ebcb0114044a04e5689db4a466f P dea34817fcc148d78f090ef5fa72304f: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:12.183035 24166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5873f7465894eddab6fa84daecdcc84" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" is_pre_election: true
I20260709 13:09:12.183921 24166 raft_consensus.cc:2468] T c5873f7465894eddab6fa84daecdcc84 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8d4657116f948038a0c73018238c3ba in term 0.
I20260709 13:09:12.186156 24361 ts_tablet_manager.cc:1434] T 47fcd2aa8e994186872c2e0f9995dd8a P f8d4657116f948038a0c73018238c3ba: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
W20260709 13:09:12.186517 24204 leader_election.cc:343] T c5873f7465894eddab6fa84daecdcc84 P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:12.187765 24361 tablet_bootstrap.cc:492] T 42868db4862647c28215f3d7cb9adf02 P f8d4657116f948038a0c73018238c3ba: Bootstrap starting.
I20260709 13:09:12.188298 24206 leader_election.cc:304] T c5873f7465894eddab6fa84daecdcc84 P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c0f503bf8bb94af8a2a1139db4e1c0f5, f8d4657116f948038a0c73018238c3ba; no voters: b39c386162de49aca92dbebee7f06ace
I20260709 13:09:12.189500 24367 raft_consensus.cc:2804] T c5873f7465894eddab6fa84daecdcc84 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:12.189927 24367 raft_consensus.cc:493] T c5873f7465894eddab6fa84daecdcc84 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:12.190316 24367 raft_consensus.cc:3060] T c5873f7465894eddab6fa84daecdcc84 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:12.181183 24393 raft_consensus.cc:2749] T 9acec0d1a6e74a4bb39a0d867598acc5 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:12.194343 24359 tablet_bootstrap.cc:492] T 45b65ebcb0114044a04e5689db4a466f P dea34817fcc148d78f090ef5fa72304f: No bootstrap required, opened a new log
I20260709 13:09:12.202843 24419 raft_consensus.cc:493] T 42868db4862647c28215f3d7cb9adf02 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.203648 24419 raft_consensus.cc:515] T 42868db4862647c28215f3d7cb9adf02 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:12.217888 24314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f373ffd46f4625bac910b5ccf4b767" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace" is_pre_election: true
I20260709 13:09:12.223157 24240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42868db4862647c28215f3d7cb9adf02" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8d4657116f948038a0c73018238c3ba" is_pre_election: true
I20260709 13:09:12.226464 24359 ts_tablet_manager.cc:1403] T 45b65ebcb0114044a04e5689db4a466f P dea34817fcc148d78f090ef5fa72304f: Time spent bootstrapping tablet: real 0.052s	user 0.032s	sys 0.014s
I20260709 13:09:12.227072 24361 tablet_bootstrap.cc:654] T 42868db4862647c28215f3d7cb9adf02 P f8d4657116f948038a0c73018238c3ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:12.228685 24362 tablet_bootstrap.cc:492] T 9acec0d1a6e74a4bb39a0d867598acc5 P b39c386162de49aca92dbebee7f06ace: No bootstrap required, opened a new log
I20260709 13:09:12.229213 24362 ts_tablet_manager.cc:1403] T 9acec0d1a6e74a4bb39a0d867598acc5 P b39c386162de49aca92dbebee7f06ace: Time spent bootstrapping tablet: real 0.084s	user 0.005s	sys 0.017s
I20260709 13:09:12.213779 24420 raft_consensus.cc:515] T 46f373ffd46f4625bac910b5ccf4b767 P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:12.221676 24314 raft_consensus.cc:2468] T 46f373ffd46f4625bac910b5ccf4b767 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8d4657116f948038a0c73018238c3ba in term 0.
I20260709 13:09:12.228585 24313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42868db4862647c28215f3d7cb9adf02" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace" is_pre_election: true
W20260709 13:09:12.237839 24056 leader_election.cc:343] T 42868db4862647c28215f3d7cb9adf02 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:12.238190 24313 raft_consensus.cc:2468] T 42868db4862647c28215f3d7cb9adf02 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dea34817fcc148d78f090ef5fa72304f in term 0.
I20260709 13:09:12.240114 24055 leader_election.cc:304] T 42868db4862647c28215f3d7cb9adf02 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b39c386162de49aca92dbebee7f06ace, dea34817fcc148d78f090ef5fa72304f; no voters: f8d4657116f948038a0c73018238c3ba
I20260709 13:09:12.229064 24419 leader_election.cc:290] T 42868db4862647c28215f3d7cb9adf02 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171), b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561)
I20260709 13:09:12.241918 24419 raft_consensus.cc:2804] T 42868db4862647c28215f3d7cb9adf02 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:12.242656 24419 raft_consensus.cc:493] T 42868db4862647c28215f3d7cb9adf02 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:12.237088 24359 raft_consensus.cc:359] T 45b65ebcb0114044a04e5689db4a466f P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:12.243737 24359 raft_consensus.cc:385] T 45b65ebcb0114044a04e5689db4a466f P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:12.244057 24359 raft_consensus.cc:740] T 45b65ebcb0114044a04e5689db4a466f P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dea34817fcc148d78f090ef5fa72304f, State: Initialized, Role: FOLLOWER
I20260709 13:09:12.247433 24360 tablet_bootstrap.cc:492] T 93e868a924d74bbc8bf29aa5a7fc67fd P c0f503bf8bb94af8a2a1139db4e1c0f5: No bootstrap required, opened a new log
I20260709 13:09:12.248304 24360 ts_tablet_manager.cc:1403] T 93e868a924d74bbc8bf29aa5a7fc67fd P c0f503bf8bb94af8a2a1139db4e1c0f5: Time spent bootstrapping tablet: real 0.108s	user 0.018s	sys 0.005s
I20260709 13:09:12.249882 24359 consensus_queue.cc:260] T 45b65ebcb0114044a04e5689db4a466f P dea34817fcc148d78f090ef5fa72304f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:12.253362 24367 raft_consensus.cc:515] T c5873f7465894eddab6fa84daecdcc84 P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:12.244561 24419 raft_consensus.cc:3060] T 42868db4862647c28215f3d7cb9adf02 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:12.255052 24362 raft_consensus.cc:359] T 9acec0d1a6e74a4bb39a0d867598acc5 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:12.255951 24362 raft_consensus.cc:385] T 9acec0d1a6e74a4bb39a0d867598acc5 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:12.256438 24362 raft_consensus.cc:740] T 9acec0d1a6e74a4bb39a0d867598acc5 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b39c386162de49aca92dbebee7f06ace, State: Initialized, Role: FOLLOWER
I20260709 13:09:12.257660 24362 consensus_queue.cc:260] T 9acec0d1a6e74a4bb39a0d867598acc5 P b39c386162de49aca92dbebee7f06ace [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:12.262776 24362 ts_tablet_manager.cc:1434] T 9acec0d1a6e74a4bb39a0d867598acc5 P b39c386162de49aca92dbebee7f06ace: Time spent starting tablet: real 0.033s	user 0.008s	sys 0.000s
I20260709 13:09:12.264052 24362 tablet_bootstrap.cc:492] T 1cefd1de9d9a4839b200c2472b3aeefc P b39c386162de49aca92dbebee7f06ace: Bootstrap starting.
I20260709 13:09:12.264137 24371 raft_consensus.cc:493] T 99078769583e49908dd6990f1d806453 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.264773 24371 raft_consensus.cc:515] T 99078769583e49908dd6990f1d806453 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:12.262910 24359 ts_tablet_manager.cc:1434] T 45b65ebcb0114044a04e5689db4a466f P dea34817fcc148d78f090ef5fa72304f: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.001s
I20260709 13:09:12.265825 24360 raft_consensus.cc:359] T 93e868a924d74bbc8bf29aa5a7fc67fd P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:12.266877 24360 raft_consensus.cc:385] T 93e868a924d74bbc8bf29aa5a7fc67fd P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:12.267163 24360 raft_consensus.cc:740] T 93e868a924d74bbc8bf29aa5a7fc67fd P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0f503bf8bb94af8a2a1139db4e1c0f5, State: Initialized, Role: FOLLOWER
I20260709 13:09:12.268059 24360 consensus_queue.cc:260] T 93e868a924d74bbc8bf29aa5a7fc67fd P c0f503bf8bb94af8a2a1139db4e1c0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:12.267252 24359 tablet_bootstrap.cc:492] T 7da69453741f4b73a0092f56f29b1000 P dea34817fcc148d78f090ef5fa72304f: Bootstrap starting.
I20260709 13:09:12.269198 24314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f373ffd46f4625bac910b5ccf4b767" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace"
I20260709 13:09:12.269873 24314 raft_consensus.cc:3060] T 46f373ffd46f4625bac910b5ccf4b767 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:12.270227 24444 raft_consensus.cc:493] T 45b65ebcb0114044a04e5689db4a466f P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.270792 24444 raft_consensus.cc:515] T 45b65ebcb0114044a04e5689db4a466f P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:12.271932 24371 leader_election.cc:290] T 99078769583e49908dd6990f1d806453 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171), b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561)
I20260709 13:09:12.273207 24444 leader_election.cc:290] T 45b65ebcb0114044a04e5689db4a466f P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561), dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343)
I20260709 13:09:12.273911 24313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45b65ebcb0114044a04e5689db4a466f" candidate_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace" is_pre_election: true
I20260709 13:09:12.274358 24360 ts_tablet_manager.cc:1434] T 93e868a924d74bbc8bf29aa5a7fc67fd P c0f503bf8bb94af8a2a1139db4e1c0f5: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.001s
I20260709 13:09:12.274606 24313 raft_consensus.cc:2468] T 45b65ebcb0114044a04e5689db4a466f P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0f503bf8bb94af8a2a1139db4e1c0f5 in term 0.
I20260709 13:09:12.274839 24240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99078769583e49908dd6990f1d806453" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8d4657116f948038a0c73018238c3ba" is_pre_election: true
I20260709 13:09:12.275429 24360 tablet_bootstrap.cc:492] T c7b586130d5842f293b0df4b02792ec6 P c0f503bf8bb94af8a2a1139db4e1c0f5: Bootstrap starting.
W20260709 13:09:12.251749 24132 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:36343, user_credentials={real_user=slave}} blocked reactor thread for 74260.2us
I20260709 13:09:12.277004 24130 leader_election.cc:304] T 45b65ebcb0114044a04e5689db4a466f P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b39c386162de49aca92dbebee7f06ace, c0f503bf8bb94af8a2a1139db4e1c0f5; no voters: 
I20260709 13:09:12.278640 24445 raft_consensus.cc:2804] T 45b65ebcb0114044a04e5689db4a466f P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:12.279726 24090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45b65ebcb0114044a04e5689db4a466f" candidate_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dea34817fcc148d78f090ef5fa72304f" is_pre_election: true
I20260709 13:09:12.287014 24090 raft_consensus.cc:2468] T 45b65ebcb0114044a04e5689db4a466f P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0f503bf8bb94af8a2a1139db4e1c0f5 in term 0.
I20260709 13:09:12.287762 24420 leader_election.cc:290] T 46f373ffd46f4625bac910b5ccf4b767 P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 election: Requested vote from peers b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561), dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343)
I20260709 13:09:12.280468 24313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99078769583e49908dd6990f1d806453" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace" is_pre_election: true
I20260709 13:09:12.288750 24360 tablet_bootstrap.cc:654] T c7b586130d5842f293b0df4b02792ec6 P c0f503bf8bb94af8a2a1139db4e1c0f5: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:12.291636 24361 tablet_bootstrap.cc:492] T 42868db4862647c28215f3d7cb9adf02 P f8d4657116f948038a0c73018238c3ba: No bootstrap required, opened a new log
I20260709 13:09:12.292246 24361 ts_tablet_manager.cc:1403] T 42868db4862647c28215f3d7cb9adf02 P f8d4657116f948038a0c73018238c3ba: Time spent bootstrapping tablet: real 0.105s	user 0.028s	sys 0.004s
W20260709 13:09:12.281229 24056 leader_election.cc:343] T 99078769583e49908dd6990f1d806453 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:12.295611 24361 raft_consensus.cc:359] T 42868db4862647c28215f3d7cb9adf02 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:12.296414 24361 raft_consensus.cc:385] T 42868db4862647c28215f3d7cb9adf02 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:12.296816 24361 raft_consensus.cc:740] T 42868db4862647c28215f3d7cb9adf02 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8d4657116f948038a0c73018238c3ba, State: Initialized, Role: FOLLOWER
I20260709 13:09:12.297142 24090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f373ffd46f4625bac910b5ccf4b767" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dea34817fcc148d78f090ef5fa72304f"
W20260709 13:09:12.296263 24055 leader_election.cc:343] T 99078769583e49908dd6990f1d806453 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:12.297644 24447 consensus_queue.cc:1048] T 49393e5cc2614c90b69a3bb2348dacb9 P f8d4657116f948038a0c73018238c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:12.298290 24367 leader_election.cc:290] T c5873f7465894eddab6fa84daecdcc84 P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 election: Requested vote from peers c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431), b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561)
I20260709 13:09:12.298697 24055 leader_election.cc:304] T 99078769583e49908dd6990f1d806453 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dea34817fcc148d78f090ef5fa72304f; no voters: b39c386162de49aca92dbebee7f06ace, f8d4657116f948038a0c73018238c3ba
I20260709 13:09:12.298940 24367 raft_consensus.cc:493] T aac6068ee4554cce8f2d534a106ef417 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.299746 24371 raft_consensus.cc:2749] T 99078769583e49908dd6990f1d806453 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:12.299567 24367 raft_consensus.cc:515] T aac6068ee4554cce8f2d534a106ef417 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:12.301998 24313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5873f7465894eddab6fa84daecdcc84" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace"
I20260709 13:09:12.298971 24166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5873f7465894eddab6fa84daecdcc84" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5"
I20260709 13:09:12.303973 24166 raft_consensus.cc:3060] T c5873f7465894eddab6fa84daecdcc84 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:12.305109 24362 tablet_bootstrap.cc:654] T 1cefd1de9d9a4839b200c2472b3aeefc P b39c386162de49aca92dbebee7f06ace: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:12.307396 24204 leader_election.cc:343] T c5873f7465894eddab6fa84daecdcc84 P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:12.307859 24313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aac6068ee4554cce8f2d534a106ef417" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace" is_pre_election: true
I20260709 13:09:12.308212 24359 tablet_bootstrap.cc:654] T 7da69453741f4b73a0092f56f29b1000 P dea34817fcc148d78f090ef5fa72304f: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:12.308609 24313 raft_consensus.cc:2468] T aac6068ee4554cce8f2d534a106ef417 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8d4657116f948038a0c73018238c3ba in term 0.
I20260709 13:09:12.297855 24090 raft_consensus.cc:3060] T 46f373ffd46f4625bac910b5ccf4b767 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:12.309512 24164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aac6068ee4554cce8f2d534a106ef417" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" is_pre_election: true
I20260709 13:09:12.314994 24204 leader_election.cc:304] T aac6068ee4554cce8f2d534a106ef417 P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b39c386162de49aca92dbebee7f06ace, f8d4657116f948038a0c73018238c3ba; no voters: 
I20260709 13:09:12.315001 24164 raft_consensus.cc:2468] T aac6068ee4554cce8f2d534a106ef417 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8d4657116f948038a0c73018238c3ba in term 0.
I20260709 13:09:12.316876 24445 raft_consensus.cc:493] T 45b65ebcb0114044a04e5689db4a466f P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:12.317276 24445 raft_consensus.cc:3060] T 45b65ebcb0114044a04e5689db4a466f P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:12.317855 24420 raft_consensus.cc:2804] T aac6068ee4554cce8f2d534a106ef417 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:12.318382 24420 raft_consensus.cc:493] T aac6068ee4554cce8f2d534a106ef417 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:12.318776 24420 raft_consensus.cc:3060] T aac6068ee4554cce8f2d534a106ef417 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:12.319259 24166 raft_consensus.cc:2468] T c5873f7465894eddab6fa84daecdcc84 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8d4657116f948038a0c73018238c3ba in term 1.
I20260709 13:09:12.297730 24361 consensus_queue.cc:260] T 42868db4862647c28215f3d7cb9adf02 P f8d4657116f948038a0c73018238c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:12.321892 24361 ts_tablet_manager.cc:1434] T 42868db4862647c28215f3d7cb9adf02 P f8d4657116f948038a0c73018238c3ba: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.002s
I20260709 13:09:12.301965 24367 leader_election.cc:290] T aac6068ee4554cce8f2d534a106ef417 P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431), b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561)
I20260709 13:09:12.285827 24419 raft_consensus.cc:515] T 42868db4862647c28215f3d7cb9adf02 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:12.327114 24206 leader_election.cc:304] T c5873f7465894eddab6fa84daecdcc84 P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c0f503bf8bb94af8a2a1139db4e1c0f5, f8d4657116f948038a0c73018238c3ba; no voters: b39c386162de49aca92dbebee7f06ace
I20260709 13:09:12.328044 24361 tablet_bootstrap.cc:492] T 95774511405b4ed8aadbab3d362c068e P f8d4657116f948038a0c73018238c3ba: Bootstrap starting.
I20260709 13:09:12.333009 24396 raft_consensus.cc:2804] T c5873f7465894eddab6fa84daecdcc84 P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:12.333096 24445 raft_consensus.cc:515] T 45b65ebcb0114044a04e5689db4a466f P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:12.336530 24313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45b65ebcb0114044a04e5689db4a466f" candidate_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace"
I20260709 13:09:12.337237 24313 raft_consensus.cc:3060] T 45b65ebcb0114044a04e5689db4a466f P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:12.339043 24360 tablet_bootstrap.cc:492] T c7b586130d5842f293b0df4b02792ec6 P c0f503bf8bb94af8a2a1139db4e1c0f5: No bootstrap required, opened a new log
I20260709 13:09:12.339844 24360 ts_tablet_manager.cc:1403] T c7b586130d5842f293b0df4b02792ec6 P c0f503bf8bb94af8a2a1139db4e1c0f5: Time spent bootstrapping tablet: real 0.065s	user 0.015s	sys 0.003s
I20260709 13:09:12.344777 24240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42868db4862647c28215f3d7cb9adf02" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8d4657116f948038a0c73018238c3ba"
I20260709 13:09:12.345495 24240 raft_consensus.cc:3060] T 42868db4862647c28215f3d7cb9adf02 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:12.346171 24360 raft_consensus.cc:359] T c7b586130d5842f293b0df4b02792ec6 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:12.346938 24360 raft_consensus.cc:385] T c7b586130d5842f293b0df4b02792ec6 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:12.347203 24360 raft_consensus.cc:740] T c7b586130d5842f293b0df4b02792ec6 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0f503bf8bb94af8a2a1139db4e1c0f5, State: Initialized, Role: FOLLOWER
I20260709 13:09:12.347898 24360 consensus_queue.cc:260] T c7b586130d5842f293b0df4b02792ec6 P c0f503bf8bb94af8a2a1139db4e1c0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:12.348826 24090 raft_consensus.cc:2468] T 46f373ffd46f4625bac910b5ccf4b767 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8d4657116f948038a0c73018238c3ba in term 1.
I20260709 13:09:12.348992 24314 raft_consensus.cc:2468] T 46f373ffd46f4625bac910b5ccf4b767 P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8d4657116f948038a0c73018238c3ba in term 1.
I20260709 13:09:12.350435 24361 tablet_bootstrap.cc:654] T 95774511405b4ed8aadbab3d362c068e P f8d4657116f948038a0c73018238c3ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:12.350337 24206 leader_election.cc:304] T 46f373ffd46f4625bac910b5ccf4b767 P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dea34817fcc148d78f090ef5fa72304f, f8d4657116f948038a0c73018238c3ba; no voters: 
I20260709 13:09:12.354414 24419 leader_election.cc:290] T 42868db4862647c28215f3d7cb9adf02 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 election: Requested vote from peers f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171), b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561)
I20260709 13:09:12.355798 24360 ts_tablet_manager.cc:1434] T c7b586130d5842f293b0df4b02792ec6 P c0f503bf8bb94af8a2a1139db4e1c0f5: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:09:12.357713 24312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42868db4862647c28215f3d7cb9adf02" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace"
I20260709 13:09:12.358484 24312 raft_consensus.cc:3060] T 42868db4862647c28215f3d7cb9adf02 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:12.360441 24396 raft_consensus.cc:697] T c5873f7465894eddab6fa84daecdcc84 P f8d4657116f948038a0c73018238c3ba [term 1 LEADER]: Becoming Leader. State: Replica: f8d4657116f948038a0c73018238c3ba, State: Running, Role: LEADER
I20260709 13:09:12.361874 24396 consensus_queue.cc:237] T c5873f7465894eddab6fa84daecdcc84 P f8d4657116f948038a0c73018238c3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:12.364085 24360 tablet_bootstrap.cc:492] T 5a8830d169ce4e46807d04168c3bb086 P c0f503bf8bb94af8a2a1139db4e1c0f5: Bootstrap starting.
I20260709 13:09:12.367750 24445 leader_election.cc:290] T 45b65ebcb0114044a04e5689db4a466f P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 1 election: Requested vote from peers b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561), dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343)
I20260709 13:09:12.368026 24091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45b65ebcb0114044a04e5689db4a466f" candidate_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dea34817fcc148d78f090ef5fa72304f"
I20260709 13:09:12.368726 24091 raft_consensus.cc:3060] T 45b65ebcb0114044a04e5689db4a466f P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:12.368788 24312 raft_consensus.cc:2468] T 42868db4862647c28215f3d7cb9adf02 P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dea34817fcc148d78f090ef5fa72304f in term 1.
I20260709 13:09:12.369244 24240 raft_consensus.cc:2468] T 42868db4862647c28215f3d7cb9adf02 P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dea34817fcc148d78f090ef5fa72304f in term 1.
I20260709 13:09:12.370507 24055 leader_election.cc:304] T 42868db4862647c28215f3d7cb9adf02 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b39c386162de49aca92dbebee7f06ace, dea34817fcc148d78f090ef5fa72304f; no voters: 
I20260709 13:09:12.345469 24313 raft_consensus.cc:2468] T 45b65ebcb0114044a04e5689db4a466f P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0f503bf8bb94af8a2a1139db4e1c0f5 in term 1.
I20260709 13:09:12.377242 24130 leader_election.cc:304] T 45b65ebcb0114044a04e5689db4a466f P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b39c386162de49aca92dbebee7f06ace, c0f503bf8bb94af8a2a1139db4e1c0f5; no voters: 
I20260709 13:09:12.377511 24091 raft_consensus.cc:2468] T 45b65ebcb0114044a04e5689db4a466f P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0f503bf8bb94af8a2a1139db4e1c0f5 in term 1.
I20260709 13:09:12.378168 24445 raft_consensus.cc:2804] T 45b65ebcb0114044a04e5689db4a466f P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:12.378747 24445 raft_consensus.cc:697] T 45b65ebcb0114044a04e5689db4a466f P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 LEADER]: Becoming Leader. State: Replica: c0f503bf8bb94af8a2a1139db4e1c0f5, State: Running, Role: LEADER
I20260709 13:09:12.379256 24455 raft_consensus.cc:493] T 47fcd2aa8e994186872c2e0f9995dd8a P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.379655 24445 consensus_queue.cc:237] T 45b65ebcb0114044a04e5689db4a466f P c0f503bf8bb94af8a2a1139db4e1c0f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:12.380302 24362 tablet_bootstrap.cc:492] T 1cefd1de9d9a4839b200c2472b3aeefc P b39c386162de49aca92dbebee7f06ace: No bootstrap required, opened a new log
I20260709 13:09:12.380996 24362 ts_tablet_manager.cc:1403] T 1cefd1de9d9a4839b200c2472b3aeefc P b39c386162de49aca92dbebee7f06ace: Time spent bootstrapping tablet: real 0.117s	user 0.007s	sys 0.005s
I20260709 13:09:12.379806 24455 raft_consensus.cc:515] T 47fcd2aa8e994186872c2e0f9995dd8a P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:12.381522 24361 tablet_bootstrap.cc:492] T 95774511405b4ed8aadbab3d362c068e P f8d4657116f948038a0c73018238c3ba: No bootstrap required, opened a new log
I20260709 13:09:12.382040 24361 ts_tablet_manager.cc:1403] T 95774511405b4ed8aadbab3d362c068e P f8d4657116f948038a0c73018238c3ba: Time spent bootstrapping tablet: real 0.054s	user 0.013s	sys 0.011s
I20260709 13:09:12.383253 24455 leader_election.cc:290] T 47fcd2aa8e994186872c2e0f9995dd8a P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343), c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431)
I20260709 13:09:12.385799 24361 raft_consensus.cc:359] T 95774511405b4ed8aadbab3d362c068e P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:12.386808 24361 raft_consensus.cc:385] T 95774511405b4ed8aadbab3d362c068e P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:12.387240 24361 raft_consensus.cc:740] T 95774511405b4ed8aadbab3d362c068e P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8d4657116f948038a0c73018238c3ba, State: Initialized, Role: FOLLOWER
I20260709 13:09:12.388134 24361 consensus_queue.cc:260] T 95774511405b4ed8aadbab3d362c068e P f8d4657116f948038a0c73018238c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:12.389657 24361 ts_tablet_manager.cc:1434] T 95774511405b4ed8aadbab3d362c068e P f8d4657116f948038a0c73018238c3ba: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:09:12.390596 24361 tablet_bootstrap.cc:492] T f735173e22b242178edcdf4821b6f92b P f8d4657116f948038a0c73018238c3ba: Bootstrap starting.
I20260709 13:09:12.391853 24359 tablet_bootstrap.cc:492] T 7da69453741f4b73a0092f56f29b1000 P dea34817fcc148d78f090ef5fa72304f: No bootstrap required, opened a new log
I20260709 13:09:12.374022 24360 tablet_bootstrap.cc:654] T 5a8830d169ce4e46807d04168c3bb086 P c0f503bf8bb94af8a2a1139db4e1c0f5: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:12.394033 24419 raft_consensus.cc:2804] T 42868db4862647c28215f3d7cb9adf02 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:12.391827 24090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fcd2aa8e994186872c2e0f9995dd8a" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dea34817fcc148d78f090ef5fa72304f" is_pre_election: true
I20260709 13:09:12.395362 24419 raft_consensus.cc:697] T 42868db4862647c28215f3d7cb9adf02 P dea34817fcc148d78f090ef5fa72304f [term 1 LEADER]: Becoming Leader. State: Replica: dea34817fcc148d78f090ef5fa72304f, State: Running, Role: LEADER
I20260709 13:09:12.368887 24447 raft_consensus.cc:2804] T 46f373ffd46f4625bac910b5ccf4b767 P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:12.396373 24359 ts_tablet_manager.cc:1403] T 7da69453741f4b73a0092f56f29b1000 P dea34817fcc148d78f090ef5fa72304f: Time spent bootstrapping tablet: real 0.130s	user 0.012s	sys 0.000s
I20260709 13:09:12.396697 24447 raft_consensus.cc:697] T 46f373ffd46f4625bac910b5ccf4b767 P f8d4657116f948038a0c73018238c3ba [term 1 LEADER]: Becoming Leader. State: Replica: f8d4657116f948038a0c73018238c3ba, State: Running, Role: LEADER
I20260709 13:09:12.397647 24447 consensus_queue.cc:237] T 46f373ffd46f4625bac910b5ccf4b767 P f8d4657116f948038a0c73018238c3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:12.396384 24419 consensus_queue.cc:237] T 42868db4862647c28215f3d7cb9adf02 P dea34817fcc148d78f090ef5fa72304f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:12.404317 24420 raft_consensus.cc:515] T aac6068ee4554cce8f2d534a106ef417 P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:12.401242 24359 raft_consensus.cc:359] T 7da69453741f4b73a0092f56f29b1000 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:12.406236 24359 raft_consensus.cc:385] T 7da69453741f4b73a0092f56f29b1000 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:12.408661 24420 leader_election.cc:290] T aac6068ee4554cce8f2d534a106ef417 P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 election: Requested vote from peers c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431), b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561)
I20260709 13:09:12.408896 24313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aac6068ee4554cce8f2d534a106ef417" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace"
I20260709 13:09:12.409675 24313 raft_consensus.cc:3060] T aac6068ee4554cce8f2d534a106ef417 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:12.411247 24166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aac6068ee4554cce8f2d534a106ef417" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5"
I20260709 13:09:12.412019 24166 raft_consensus.cc:3060] T aac6068ee4554cce8f2d534a106ef417 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:12.407091 24165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fcd2aa8e994186872c2e0f9995dd8a" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" is_pre_election: true
I20260709 13:09:12.414108 24361 tablet_bootstrap.cc:654] T f735173e22b242178edcdf4821b6f92b P f8d4657116f948038a0c73018238c3ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:12.407121 24362 raft_consensus.cc:359] T 1cefd1de9d9a4839b200c2472b3aeefc P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:12.418990 24362 raft_consensus.cc:385] T 1cefd1de9d9a4839b200c2472b3aeefc P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:12.419504 24362 raft_consensus.cc:740] T 1cefd1de9d9a4839b200c2472b3aeefc P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b39c386162de49aca92dbebee7f06ace, State: Initialized, Role: FOLLOWER
I20260709 13:09:12.411118 23986 catalog_manager.cc:5697] T 45b65ebcb0114044a04e5689db4a466f P c0f503bf8bb94af8a2a1139db4e1c0f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66). New cstate: current_term: 1 leader_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:12.424821 24313 raft_consensus.cc:2468] T aac6068ee4554cce8f2d534a106ef417 P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8d4657116f948038a0c73018238c3ba in term 1.
I20260709 13:09:12.425505 24359 raft_consensus.cc:740] T 7da69453741f4b73a0092f56f29b1000 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dea34817fcc148d78f090ef5fa72304f, State: Initialized, Role: FOLLOWER
I20260709 13:09:12.441524 24359 consensus_queue.cc:260] T 7da69453741f4b73a0092f56f29b1000 P dea34817fcc148d78f090ef5fa72304f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:12.428113 24166 raft_consensus.cc:2468] T aac6068ee4554cce8f2d534a106ef417 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8d4657116f948038a0c73018238c3ba in term 1.
I20260709 13:09:12.445711 24359 ts_tablet_manager.cc:1434] T 7da69453741f4b73a0092f56f29b1000 P dea34817fcc148d78f090ef5fa72304f: Time spent starting tablet: real 0.049s	user 0.007s	sys 0.000s
I20260709 13:09:12.432961 24090 raft_consensus.cc:2468] T 47fcd2aa8e994186872c2e0f9995dd8a P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8d4657116f948038a0c73018238c3ba in term 0.
I20260709 13:09:12.444375 23985 catalog_manager.cc:5697] T 42868db4862647c28215f3d7cb9adf02 P dea34817fcc148d78f090ef5fa72304f reported cstate change: term changed from 0 to 1, leader changed from <none> to dea34817fcc148d78f090ef5fa72304f (127.14.180.65). New cstate: current_term: 1 leader_uuid: "dea34817fcc148d78f090ef5fa72304f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:12.447846 24204 leader_election.cc:304] T aac6068ee4554cce8f2d534a106ef417 P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b39c386162de49aca92dbebee7f06ace, f8d4657116f948038a0c73018238c3ba; no voters: 
I20260709 13:09:12.448480 24359 tablet_bootstrap.cc:492] T 93e868a924d74bbc8bf29aa5a7fc67fd P dea34817fcc148d78f090ef5fa72304f: Bootstrap starting.
I20260709 13:09:12.448799 24420 raft_consensus.cc:2804] T aac6068ee4554cce8f2d534a106ef417 P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:12.449323 24420 raft_consensus.cc:697] T aac6068ee4554cce8f2d534a106ef417 P f8d4657116f948038a0c73018238c3ba [term 1 LEADER]: Becoming Leader. State: Replica: f8d4657116f948038a0c73018238c3ba, State: Running, Role: LEADER
I20260709 13:09:12.450214 24420 consensus_queue.cc:237] T aac6068ee4554cce8f2d534a106ef417 P f8d4657116f948038a0c73018238c3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:12.429287 24362 consensus_queue.cc:260] T 1cefd1de9d9a4839b200c2472b3aeefc P b39c386162de49aca92dbebee7f06ace [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:12.461896 24359 tablet_bootstrap.cc:654] T 93e868a924d74bbc8bf29aa5a7fc67fd P dea34817fcc148d78f090ef5fa72304f: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:12.462942 24362 ts_tablet_manager.cc:1434] T 1cefd1de9d9a4839b200c2472b3aeefc P b39c386162de49aca92dbebee7f06ace: Time spent starting tablet: real 0.082s	user 0.007s	sys 0.001s
I20260709 13:09:12.464551 24362 tablet_bootstrap.cc:492] T 1541f6b04d914d10823ad78c03d9a847 P b39c386162de49aca92dbebee7f06ace: Bootstrap starting.
W20260709 13:09:12.432215 24206 leader_election.cc:343] T 47fcd2aa8e994186872c2e0f9995dd8a P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:12.472589 24359 tablet_bootstrap.cc:492] T 93e868a924d74bbc8bf29aa5a7fc67fd P dea34817fcc148d78f090ef5fa72304f: No bootstrap required, opened a new log
I20260709 13:09:12.472811 24166 raft_consensus.cc:3060] T c7b586130d5842f293b0df4b02792ec6 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:12.473157 24359 ts_tablet_manager.cc:1403] T 93e868a924d74bbc8bf29aa5a7fc67fd P dea34817fcc148d78f090ef5fa72304f: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.000s
I20260709 13:09:12.480469 24359 raft_consensus.cc:359] T 93e868a924d74bbc8bf29aa5a7fc67fd P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:12.481915 24359 raft_consensus.cc:385] T 93e868a924d74bbc8bf29aa5a7fc67fd P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:12.482197 24359 raft_consensus.cc:740] T 93e868a924d74bbc8bf29aa5a7fc67fd P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dea34817fcc148d78f090ef5fa72304f, State: Initialized, Role: FOLLOWER
I20260709 13:09:12.482963 24359 consensus_queue.cc:260] T 93e868a924d74bbc8bf29aa5a7fc67fd P dea34817fcc148d78f090ef5fa72304f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:12.484681 24359 ts_tablet_manager.cc:1434] T 93e868a924d74bbc8bf29aa5a7fc67fd P dea34817fcc148d78f090ef5fa72304f: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:09:12.485745 24359 tablet_bootstrap.cc:492] T 861d7d76be4d484a9eb3acf8abffae5f P dea34817fcc148d78f090ef5fa72304f: Bootstrap starting.
I20260709 13:09:12.497972 24206 leader_election.cc:304] T 47fcd2aa8e994186872c2e0f9995dd8a P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dea34817fcc148d78f090ef5fa72304f, f8d4657116f948038a0c73018238c3ba; no voters: c0f503bf8bb94af8a2a1139db4e1c0f5
I20260709 13:09:12.499591 24454 raft_consensus.cc:2804] T 47fcd2aa8e994186872c2e0f9995dd8a P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:12.500197 24454 raft_consensus.cc:493] T 47fcd2aa8e994186872c2e0f9995dd8a P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:12.500624 24454 raft_consensus.cc:3060] T 47fcd2aa8e994186872c2e0f9995dd8a P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:12.500763 24359 tablet_bootstrap.cc:654] T 861d7d76be4d484a9eb3acf8abffae5f P dea34817fcc148d78f090ef5fa72304f: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:12.508556 24420 consensus_queue.cc:1048] T c7b586130d5842f293b0df4b02792ec6 P f8d4657116f948038a0c73018238c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:12.511611 24359 tablet_bootstrap.cc:492] T 861d7d76be4d484a9eb3acf8abffae5f P dea34817fcc148d78f090ef5fa72304f: No bootstrap required, opened a new log
I20260709 13:09:12.512172 24359 ts_tablet_manager.cc:1403] T 861d7d76be4d484a9eb3acf8abffae5f P dea34817fcc148d78f090ef5fa72304f: Time spent bootstrapping tablet: real 0.027s	user 0.010s	sys 0.000s
I20260709 13:09:12.515297 24359 raft_consensus.cc:359] T 861d7d76be4d484a9eb3acf8abffae5f P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:12.516065 24359 raft_consensus.cc:385] T 861d7d76be4d484a9eb3acf8abffae5f P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:12.516347 24359 raft_consensus.cc:740] T 861d7d76be4d484a9eb3acf8abffae5f P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dea34817fcc148d78f090ef5fa72304f, State: Initialized, Role: FOLLOWER
I20260709 13:09:12.517300 24359 consensus_queue.cc:260] T 861d7d76be4d484a9eb3acf8abffae5f P dea34817fcc148d78f090ef5fa72304f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:12.524014 24359 ts_tablet_manager.cc:1434] T 861d7d76be4d484a9eb3acf8abffae5f P dea34817fcc148d78f090ef5fa72304f: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:09:12.524266 24455 consensus_queue.cc:1048] T c7b586130d5842f293b0df4b02792ec6 P f8d4657116f948038a0c73018238c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:12.525152 24359 tablet_bootstrap.cc:492] T 1541f6b04d914d10823ad78c03d9a847 P dea34817fcc148d78f090ef5fa72304f: Bootstrap starting.
I20260709 13:09:12.527683 23985 catalog_manager.cc:5697] T c5873f7465894eddab6fa84daecdcc84 P f8d4657116f948038a0c73018238c3ba reported cstate change: term changed from 0 to 1, leader changed from <none> to f8d4657116f948038a0c73018238c3ba (127.14.180.67). New cstate: current_term: 1 leader_uuid: "f8d4657116f948038a0c73018238c3ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:12.531932 24359 tablet_bootstrap.cc:654] T 1541f6b04d914d10823ad78c03d9a847 P dea34817fcc148d78f090ef5fa72304f: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:12.529978 23985 catalog_manager.cc:5697] T 46f373ffd46f4625bac910b5ccf4b767 P f8d4657116f948038a0c73018238c3ba reported cstate change: term changed from 0 to 1, leader changed from <none> to f8d4657116f948038a0c73018238c3ba (127.14.180.67). New cstate: current_term: 1 leader_uuid: "f8d4657116f948038a0c73018238c3ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:12.550874 24361 tablet_bootstrap.cc:492] T f735173e22b242178edcdf4821b6f92b P f8d4657116f948038a0c73018238c3ba: No bootstrap required, opened a new log
I20260709 13:09:12.551445 24361 ts_tablet_manager.cc:1403] T f735173e22b242178edcdf4821b6f92b P f8d4657116f948038a0c73018238c3ba: Time spent bootstrapping tablet: real 0.161s	user 0.031s	sys 0.048s
I20260709 13:09:12.550905 24360 tablet_bootstrap.cc:492] T 5a8830d169ce4e46807d04168c3bb086 P c0f503bf8bb94af8a2a1139db4e1c0f5: No bootstrap required, opened a new log
I20260709 13:09:12.552383 24360 ts_tablet_manager.cc:1403] T 5a8830d169ce4e46807d04168c3bb086 P c0f503bf8bb94af8a2a1139db4e1c0f5: Time spent bootstrapping tablet: real 0.189s	user 0.031s	sys 0.014s
I20260709 13:09:12.553834 24454 raft_consensus.cc:515] T 47fcd2aa8e994186872c2e0f9995dd8a P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:12.554442 24361 raft_consensus.cc:359] T f735173e22b242178edcdf4821b6f92b P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:12.555545 24361 raft_consensus.cc:385] T f735173e22b242178edcdf4821b6f92b P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:12.555846 24361 raft_consensus.cc:740] T f735173e22b242178edcdf4821b6f92b P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8d4657116f948038a0c73018238c3ba, State: Initialized, Role: FOLLOWER
I20260709 13:09:12.556733 24361 consensus_queue.cc:260] T f735173e22b242178edcdf4821b6f92b P f8d4657116f948038a0c73018238c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:12.557848 24454 leader_election.cc:290] T 47fcd2aa8e994186872c2e0f9995dd8a P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 election: Requested vote from peers dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343), c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431)
I20260709 13:09:12.558854 24361 ts_tablet_manager.cc:1434] T f735173e22b242178edcdf4821b6f92b P f8d4657116f948038a0c73018238c3ba: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:09:12.559360 24166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fcd2aa8e994186872c2e0f9995dd8a" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5"
I20260709 13:09:12.559913 24361 tablet_bootstrap.cc:492] T b1d1d7dd508b43489431371c4ece4fa4 P f8d4657116f948038a0c73018238c3ba: Bootstrap starting.
I20260709 13:09:12.561093 24090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fcd2aa8e994186872c2e0f9995dd8a" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dea34817fcc148d78f090ef5fa72304f"
I20260709 13:09:12.554915 24362 tablet_bootstrap.cc:654] T 1541f6b04d914d10823ad78c03d9a847 P b39c386162de49aca92dbebee7f06ace: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:12.561705 24090 raft_consensus.cc:3060] T 47fcd2aa8e994186872c2e0f9995dd8a P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:12.555860 24360 raft_consensus.cc:359] T 5a8830d169ce4e46807d04168c3bb086 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:12.565128 24360 raft_consensus.cc:385] T 5a8830d169ce4e46807d04168c3bb086 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:09:12.565236 24206 leader_election.cc:343] T 47fcd2aa8e994186872c2e0f9995dd8a P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:12.565466 24360 raft_consensus.cc:740] T 5a8830d169ce4e46807d04168c3bb086 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0f503bf8bb94af8a2a1139db4e1c0f5, State: Initialized, Role: FOLLOWER
I20260709 13:09:12.566236 24360 consensus_queue.cc:260] T 5a8830d169ce4e46807d04168c3bb086 P c0f503bf8bb94af8a2a1139db4e1c0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:12.568197 24377 raft_consensus.cc:493] T 9acec0d1a6e74a4bb39a0d867598acc5 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.568671 24360 ts_tablet_manager.cc:1434] T 5a8830d169ce4e46807d04168c3bb086 P c0f503bf8bb94af8a2a1139db4e1c0f5: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:09:12.568735 24377 raft_consensus.cc:515] T 9acec0d1a6e74a4bb39a0d867598acc5 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:12.571339 24360 tablet_bootstrap.cc:492] T d17a6bbfc9d8478988b08964765c3b86 P c0f503bf8bb94af8a2a1139db4e1c0f5: Bootstrap starting.
I20260709 13:09:12.572578 23986 catalog_manager.cc:5697] T aac6068ee4554cce8f2d534a106ef417 P f8d4657116f948038a0c73018238c3ba reported cstate change: term changed from 0 to 1, leader changed from <none> to f8d4657116f948038a0c73018238c3ba (127.14.180.67). New cstate: current_term: 1 leader_uuid: "f8d4657116f948038a0c73018238c3ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:12.575338 24359 tablet_bootstrap.cc:492] T 1541f6b04d914d10823ad78c03d9a847 P dea34817fcc148d78f090ef5fa72304f: No bootstrap required, opened a new log
I20260709 13:09:12.576161 24166 raft_consensus.cc:3060] T 5a8830d169ce4e46807d04168c3bb086 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:12.577761 24377 leader_election.cc:290] T 9acec0d1a6e74a4bb39a0d867598acc5 P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343), c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431)
I20260709 13:09:12.578801 24377 raft_consensus.cc:493] T 1cefd1de9d9a4839b200c2472b3aeefc P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.579295 24377 raft_consensus.cc:515] T 1cefd1de9d9a4839b200c2472b3aeefc P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:12.576068 24359 ts_tablet_manager.cc:1403] T 1541f6b04d914d10823ad78c03d9a847 P dea34817fcc148d78f090ef5fa72304f: Time spent bootstrapping tablet: real 0.051s	user 0.016s	sys 0.003s
I20260709 13:09:12.581985 24377 leader_election.cc:290] T 1cefd1de9d9a4839b200c2472b3aeefc P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431), f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171)
I20260709 13:09:12.583087 24240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cefd1de9d9a4839b200c2472b3aeefc" candidate_uuid: "b39c386162de49aca92dbebee7f06ace" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8d4657116f948038a0c73018238c3ba" is_pre_election: true
I20260709 13:09:12.583335 24445 raft_consensus.cc:493] T 1541f6b04d914d10823ad78c03d9a847 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.583814 24445 raft_consensus.cc:515] T 1541f6b04d914d10823ad78c03d9a847 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:12.584072 24091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9acec0d1a6e74a4bb39a0d867598acc5" candidate_uuid: "b39c386162de49aca92dbebee7f06ace" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dea34817fcc148d78f090ef5fa72304f" is_pre_election: true
W20260709 13:09:12.584672 24279 leader_election.cc:343] T 1cefd1de9d9a4839b200c2472b3aeefc P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:12.586117 24445 leader_election.cc:290] T 1541f6b04d914d10823ad78c03d9a847 P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561), dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343)
I20260709 13:09:12.587312 24091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1541f6b04d914d10823ad78c03d9a847" candidate_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dea34817fcc148d78f090ef5fa72304f" is_pre_election: true
I20260709 13:09:12.588313 24313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1541f6b04d914d10823ad78c03d9a847" candidate_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace" is_pre_election: true
W20260709 13:09:12.589020 24132 leader_election.cc:343] T 1541f6b04d914d10823ad78c03d9a847 P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:12.589701 24130 leader_election.cc:343] T 1541f6b04d914d10823ad78c03d9a847 P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:12.590148 24130 leader_election.cc:304] T 1541f6b04d914d10823ad78c03d9a847 P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0f503bf8bb94af8a2a1139db4e1c0f5; no voters: b39c386162de49aca92dbebee7f06ace, dea34817fcc148d78f090ef5fa72304f
I20260709 13:09:12.590701 24090 raft_consensus.cc:2468] T 47fcd2aa8e994186872c2e0f9995dd8a P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8d4657116f948038a0c73018238c3ba in term 1.
I20260709 13:09:12.591286 24445 raft_consensus.cc:2749] T 1541f6b04d914d10823ad78c03d9a847 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:12.592046 24206 leader_election.cc:304] T 47fcd2aa8e994186872c2e0f9995dd8a P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dea34817fcc148d78f090ef5fa72304f, f8d4657116f948038a0c73018238c3ba; no voters: c0f503bf8bb94af8a2a1139db4e1c0f5
I20260709 13:09:12.593255 24454 raft_consensus.cc:2804] T 47fcd2aa8e994186872c2e0f9995dd8a P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:12.593979 24454 raft_consensus.cc:697] T 47fcd2aa8e994186872c2e0f9995dd8a P f8d4657116f948038a0c73018238c3ba [term 1 LEADER]: Becoming Leader. State: Replica: f8d4657116f948038a0c73018238c3ba, State: Running, Role: LEADER
I20260709 13:09:12.594882 24454 consensus_queue.cc:237] T 47fcd2aa8e994186872c2e0f9995dd8a P f8d4657116f948038a0c73018238c3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:12.595491 24359 raft_consensus.cc:359] T 1541f6b04d914d10823ad78c03d9a847 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:12.596160 24359 raft_consensus.cc:385] T 1541f6b04d914d10823ad78c03d9a847 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:12.596432 24359 raft_consensus.cc:740] T 1541f6b04d914d10823ad78c03d9a847 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dea34817fcc148d78f090ef5fa72304f, State: Initialized, Role: FOLLOWER
I20260709 13:09:12.598685 24360 tablet_bootstrap.cc:654] T d17a6bbfc9d8478988b08964765c3b86 P c0f503bf8bb94af8a2a1139db4e1c0f5: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:12.602705 24420 raft_consensus.cc:493] T 95774511405b4ed8aadbab3d362c068e P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.603192 24361 tablet_bootstrap.cc:654] T b1d1d7dd508b43489431371c4ece4fa4 P f8d4657116f948038a0c73018238c3ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:12.603241 24420 raft_consensus.cc:515] T 95774511405b4ed8aadbab3d362c068e P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:12.605010 24362 tablet_bootstrap.cc:492] T 1541f6b04d914d10823ad78c03d9a847 P b39c386162de49aca92dbebee7f06ace: No bootstrap required, opened a new log
I20260709 13:09:12.605666 24420 leader_election.cc:290] T 95774511405b4ed8aadbab3d362c068e P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431), b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561)
I20260709 13:09:12.602274 24359 consensus_queue.cc:260] T 1541f6b04d914d10823ad78c03d9a847 P dea34817fcc148d78f090ef5fa72304f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:12.605770 24362 ts_tablet_manager.cc:1403] T 1541f6b04d914d10823ad78c03d9a847 P b39c386162de49aca92dbebee7f06ace: Time spent bootstrapping tablet: real 0.142s	user 0.009s	sys 0.004s
I20260709 13:09:12.609817 24362 raft_consensus.cc:359] T 1541f6b04d914d10823ad78c03d9a847 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:12.612854 24362 raft_consensus.cc:385] T 1541f6b04d914d10823ad78c03d9a847 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:12.613428 24362 raft_consensus.cc:740] T 1541f6b04d914d10823ad78c03d9a847 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b39c386162de49aca92dbebee7f06ace, State: Initialized, Role: FOLLOWER
I20260709 13:09:12.613235 24165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95774511405b4ed8aadbab3d362c068e" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" is_pre_election: true
I20260709 13:09:12.614440 24362 consensus_queue.cc:260] T 1541f6b04d914d10823ad78c03d9a847 P b39c386162de49aca92dbebee7f06ace [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:12.617030 24362 ts_tablet_manager.cc:1434] T 1541f6b04d914d10823ad78c03d9a847 P b39c386162de49aca92dbebee7f06ace: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
W20260709 13:09:12.617274 24206 leader_election.cc:343] T 95774511405b4ed8aadbab3d362c068e P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:12.618626 24359 ts_tablet_manager.cc:1434] T 1541f6b04d914d10823ad78c03d9a847 P dea34817fcc148d78f090ef5fa72304f: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.000s
I20260709 13:09:12.619876 24362 tablet_bootstrap.cc:492] T c5873f7465894eddab6fa84daecdcc84 P b39c386162de49aca92dbebee7f06ace: Bootstrap starting.
I20260709 13:09:12.622295 24359 tablet_bootstrap.cc:492] T b1d1d7dd508b43489431371c4ece4fa4 P dea34817fcc148d78f090ef5fa72304f: Bootstrap starting.
I20260709 13:09:12.627312 24360 tablet_bootstrap.cc:492] T d17a6bbfc9d8478988b08964765c3b86 P c0f503bf8bb94af8a2a1139db4e1c0f5: No bootstrap required, opened a new log
I20260709 13:09:12.627882 23989 catalog_manager.cc:5697] T 47fcd2aa8e994186872c2e0f9995dd8a P f8d4657116f948038a0c73018238c3ba reported cstate change: term changed from 0 to 1, leader changed from <none> to f8d4657116f948038a0c73018238c3ba (127.14.180.67). New cstate: current_term: 1 leader_uuid: "f8d4657116f948038a0c73018238c3ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:12.629350 24313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95774511405b4ed8aadbab3d362c068e" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace" is_pre_election: true
I20260709 13:09:12.632279 24361 tablet_bootstrap.cc:492] T b1d1d7dd508b43489431371c4ece4fa4 P f8d4657116f948038a0c73018238c3ba: No bootstrap required, opened a new log
I20260709 13:09:12.627923 24360 ts_tablet_manager.cc:1403] T d17a6bbfc9d8478988b08964765c3b86 P c0f503bf8bb94af8a2a1139db4e1c0f5: Time spent bootstrapping tablet: real 0.057s	user 0.007s	sys 0.004s
I20260709 13:09:12.632884 24361 ts_tablet_manager.cc:1403] T b1d1d7dd508b43489431371c4ece4fa4 P f8d4657116f948038a0c73018238c3ba: Time spent bootstrapping tablet: real 0.073s	user 0.009s	sys 0.002s
W20260709 13:09:12.634222 24280 leader_election.cc:343] T 9acec0d1a6e74a4bb39a0d867598acc5 P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:12.635728 24361 raft_consensus.cc:359] T b1d1d7dd508b43489431371c4ece4fa4 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:12.636492 24361 raft_consensus.cc:385] T b1d1d7dd508b43489431371c4ece4fa4 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:12.636772 24361 raft_consensus.cc:740] T b1d1d7dd508b43489431371c4ece4fa4 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8d4657116f948038a0c73018238c3ba, State: Initialized, Role: FOLLOWER
I20260709 13:09:12.637367 24419 raft_consensus.cc:493] T 1541f6b04d914d10823ad78c03d9a847 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.640453 24419 raft_consensus.cc:515] T 1541f6b04d914d10823ad78c03d9a847 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:12.642972 24419 leader_election.cc:290] T 1541f6b04d914d10823ad78c03d9a847 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561), c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431)
W20260709 13:09:12.637652 24204 leader_election.cc:343] T 95774511405b4ed8aadbab3d362c068e P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:12.643642 24204 leader_election.cc:304] T 95774511405b4ed8aadbab3d362c068e P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8d4657116f948038a0c73018238c3ba; no voters: b39c386162de49aca92dbebee7f06ace, c0f503bf8bb94af8a2a1139db4e1c0f5
I20260709 13:09:12.645820 24313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1541f6b04d914d10823ad78c03d9a847" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace" is_pre_election: true
I20260709 13:09:12.646639 24165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1541f6b04d914d10823ad78c03d9a847" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" is_pre_election: true
I20260709 13:09:12.646700 24313 raft_consensus.cc:2468] T 1541f6b04d914d10823ad78c03d9a847 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dea34817fcc148d78f090ef5fa72304f in term 0.
I20260709 13:09:12.650288 24055 leader_election.cc:304] T 1541f6b04d914d10823ad78c03d9a847 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b39c386162de49aca92dbebee7f06ace, dea34817fcc148d78f090ef5fa72304f; no voters: 
I20260709 13:09:12.652024 24368 raft_consensus.cc:2804] T 1541f6b04d914d10823ad78c03d9a847 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:12.652472 24368 raft_consensus.cc:493] T 1541f6b04d914d10823ad78c03d9a847 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:12.652834 24368 raft_consensus.cc:3060] T 1541f6b04d914d10823ad78c03d9a847 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:12.653198 24166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9acec0d1a6e74a4bb39a0d867598acc5" candidate_uuid: "b39c386162de49aca92dbebee7f06ace" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" is_pre_election: true
I20260709 13:09:12.653419 24371 consensus_queue.cc:1048] T f735173e22b242178edcdf4821b6f92b P dea34817fcc148d78f090ef5fa72304f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:12.653554 24164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cefd1de9d9a4839b200c2472b3aeefc" candidate_uuid: "b39c386162de49aca92dbebee7f06ace" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" is_pre_election: true
I20260709 13:09:12.653970 24166 raft_consensus.cc:2468] T 9acec0d1a6e74a4bb39a0d867598acc5 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b39c386162de49aca92dbebee7f06ace in term 0.
I20260709 13:09:12.655133 24362 tablet_bootstrap.cc:654] T c5873f7465894eddab6fa84daecdcc84 P b39c386162de49aca92dbebee7f06ace: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:12.655763 24454 raft_consensus.cc:2749] T 95774511405b4ed8aadbab3d362c068e P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:12.639545 24360 raft_consensus.cc:359] T d17a6bbfc9d8478988b08964765c3b86 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:12.647388 24165 raft_consensus.cc:2468] T 1541f6b04d914d10823ad78c03d9a847 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dea34817fcc148d78f090ef5fa72304f in term 0.
I20260709 13:09:12.656692 24360 raft_consensus.cc:385] T d17a6bbfc9d8478988b08964765c3b86 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:12.657060 24360 raft_consensus.cc:740] T d17a6bbfc9d8478988b08964765c3b86 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0f503bf8bb94af8a2a1139db4e1c0f5, State: Initialized, Role: FOLLOWER
I20260709 13:09:12.657847 24360 consensus_queue.cc:260] T d17a6bbfc9d8478988b08964765c3b86 P c0f503bf8bb94af8a2a1139db4e1c0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
W20260709 13:09:12.658396 24280 leader_election.cc:343] T 1cefd1de9d9a4839b200c2472b3aeefc P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:12.659124 24280 leader_election.cc:304] T 1cefd1de9d9a4839b200c2472b3aeefc P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b39c386162de49aca92dbebee7f06ace; no voters: c0f503bf8bb94af8a2a1139db4e1c0f5, f8d4657116f948038a0c73018238c3ba
I20260709 13:09:12.660174 24473 raft_consensus.cc:2749] T 1cefd1de9d9a4839b200c2472b3aeefc P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:12.660701 24361 consensus_queue.cc:260] T b1d1d7dd508b43489431371c4ece4fa4 P f8d4657116f948038a0c73018238c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:12.661640 24280 leader_election.cc:304] T 9acec0d1a6e74a4bb39a0d867598acc5 P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b39c386162de49aca92dbebee7f06ace, c0f503bf8bb94af8a2a1139db4e1c0f5; no voters: dea34817fcc148d78f090ef5fa72304f
I20260709 13:09:12.663096 24361 ts_tablet_manager.cc:1434] T b1d1d7dd508b43489431371c4ece4fa4 P f8d4657116f948038a0c73018238c3ba: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 13:09:12.663024 24473 raft_consensus.cc:2804] T 9acec0d1a6e74a4bb39a0d867598acc5 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:12.663648 24473 raft_consensus.cc:493] T 9acec0d1a6e74a4bb39a0d867598acc5 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:12.664013 24473 raft_consensus.cc:3060] T 9acec0d1a6e74a4bb39a0d867598acc5 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:12.664357 24361 tablet_bootstrap.cc:492] T 861d7d76be4d484a9eb3acf8abffae5f P f8d4657116f948038a0c73018238c3ba: Bootstrap starting.
I20260709 13:09:12.638374 24359 tablet_bootstrap.cc:654] T b1d1d7dd508b43489431371c4ece4fa4 P dea34817fcc148d78f090ef5fa72304f: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:12.660192 24360 ts_tablet_manager.cc:1434] T d17a6bbfc9d8478988b08964765c3b86 P c0f503bf8bb94af8a2a1139db4e1c0f5: Time spent starting tablet: real 0.027s	user 0.005s	sys 0.000s
I20260709 13:09:12.669839 24454 raft_consensus.cc:493] T f735173e22b242178edcdf4821b6f92b P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.670714 24445 raft_consensus.cc:493] T 93e868a924d74bbc8bf29aa5a7fc67fd P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.670511 24454 raft_consensus.cc:515] T f735173e22b242178edcdf4821b6f92b P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:12.671245 24445 raft_consensus.cc:515] T 93e868a924d74bbc8bf29aa5a7fc67fd P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:12.673627 24445 leader_election.cc:290] T 93e868a924d74bbc8bf29aa5a7fc67fd P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343), f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171)
I20260709 13:09:12.676666 24090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e868a924d74bbc8bf29aa5a7fc67fd" candidate_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dea34817fcc148d78f090ef5fa72304f" is_pre_election: true
I20260709 13:09:12.677441 24090 raft_consensus.cc:2468] T 93e868a924d74bbc8bf29aa5a7fc67fd P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0f503bf8bb94af8a2a1139db4e1c0f5 in term 0.
I20260709 13:09:12.677681 24091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f735173e22b242178edcdf4821b6f92b" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dea34817fcc148d78f090ef5fa72304f" is_pre_election: true
I20260709 13:09:12.677862 24240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e868a924d74bbc8bf29aa5a7fc67fd" candidate_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8d4657116f948038a0c73018238c3ba" is_pre_election: true
I20260709 13:09:12.678684 24240 raft_consensus.cc:2468] T 93e868a924d74bbc8bf29aa5a7fc67fd P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0f503bf8bb94af8a2a1139db4e1c0f5 in term 0.
I20260709 13:09:12.678762 24361 tablet_bootstrap.cc:654] T 861d7d76be4d484a9eb3acf8abffae5f P f8d4657116f948038a0c73018238c3ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:12.678833 24132 leader_election.cc:304] T 93e868a924d74bbc8bf29aa5a7fc67fd P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0f503bf8bb94af8a2a1139db4e1c0f5, dea34817fcc148d78f090ef5fa72304f; no voters: 
I20260709 13:09:12.679764 24454 leader_election.cc:290] T f735173e22b242178edcdf4821b6f92b P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561), dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343)
I20260709 13:09:12.680922 24445 raft_consensus.cc:2804] T 93e868a924d74bbc8bf29aa5a7fc67fd P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:12.681360 24445 raft_consensus.cc:493] T 93e868a924d74bbc8bf29aa5a7fc67fd P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:12.681690 24445 raft_consensus.cc:3060] T 93e868a924d74bbc8bf29aa5a7fc67fd P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:12.682902 24473 raft_consensus.cc:515] T 9acec0d1a6e74a4bb39a0d867598acc5 P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:12.695920 24473 leader_election.cc:290] T 9acec0d1a6e74a4bb39a0d867598acc5 P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 1 election: Requested vote from peers dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343), c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431)
I20260709 13:09:12.697234 24312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f735173e22b242178edcdf4821b6f92b" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace" is_pre_election: true
I20260709 13:09:12.699980 24091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9acec0d1a6e74a4bb39a0d867598acc5" candidate_uuid: "b39c386162de49aca92dbebee7f06ace" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dea34817fcc148d78f090ef5fa72304f"
I20260709 13:09:12.704913 24165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9acec0d1a6e74a4bb39a0d867598acc5" candidate_uuid: "b39c386162de49aca92dbebee7f06ace" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5"
I20260709 13:09:12.712297 24165 raft_consensus.cc:3060] T 9acec0d1a6e74a4bb39a0d867598acc5 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:12.670770 24360 tablet_bootstrap.cc:492] T 95774511405b4ed8aadbab3d362c068e P c0f503bf8bb94af8a2a1139db4e1c0f5: Bootstrap starting.
I20260709 13:09:12.665880 24368 raft_consensus.cc:515] T 1541f6b04d914d10823ad78c03d9a847 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:12.710246 24240 raft_consensus.cc:3060] T f735173e22b242178edcdf4821b6f92b P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:12.720743 24165 raft_consensus.cc:2468] T 9acec0d1a6e74a4bb39a0d867598acc5 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b39c386162de49aca92dbebee7f06ace in term 1.
I20260709 13:09:12.721819 24204 leader_election.cc:304] T f735173e22b242178edcdf4821b6f92b P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8d4657116f948038a0c73018238c3ba; no voters: b39c386162de49aca92dbebee7f06ace, dea34817fcc148d78f090ef5fa72304f
I20260709 13:09:12.726511 24166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1541f6b04d914d10823ad78c03d9a847" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5"
I20260709 13:09:12.727454 24166 raft_consensus.cc:3060] T 1541f6b04d914d10823ad78c03d9a847 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:12.726645 24368 leader_election.cc:290] T 1541f6b04d914d10823ad78c03d9a847 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 election: Requested vote from peers b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561), c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431)
I20260709 13:09:12.738752 24360 tablet_bootstrap.cc:654] T 95774511405b4ed8aadbab3d362c068e P c0f503bf8bb94af8a2a1139db4e1c0f5: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:12.697268 24445 raft_consensus.cc:515] T 93e868a924d74bbc8bf29aa5a7fc67fd P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:12.743290 24454 raft_consensus.cc:2749] T f735173e22b242178edcdf4821b6f92b P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:09:12.726480 24280 leader_election.cc:343] T 9acec0d1a6e74a4bb39a0d867598acc5 P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:12.747388 24361 tablet_bootstrap.cc:492] T 861d7d76be4d484a9eb3acf8abffae5f P f8d4657116f948038a0c73018238c3ba: No bootstrap required, opened a new log
I20260709 13:09:12.747925 24362 tablet_bootstrap.cc:492] T c5873f7465894eddab6fa84daecdcc84 P b39c386162de49aca92dbebee7f06ace: No bootstrap required, opened a new log
I20260709 13:09:12.747951 24361 ts_tablet_manager.cc:1403] T 861d7d76be4d484a9eb3acf8abffae5f P f8d4657116f948038a0c73018238c3ba: Time spent bootstrapping tablet: real 0.084s	user 0.020s	sys 0.018s
I20260709 13:09:12.748575 24362 ts_tablet_manager.cc:1403] T c5873f7465894eddab6fa84daecdcc84 P b39c386162de49aca92dbebee7f06ace: Time spent bootstrapping tablet: real 0.129s	user 0.009s	sys 0.025s
I20260709 13:09:12.749907 24359 tablet_bootstrap.cc:492] T b1d1d7dd508b43489431371c4ece4fa4 P dea34817fcc148d78f090ef5fa72304f: No bootstrap required, opened a new log
I20260709 13:09:12.750382 24359 ts_tablet_manager.cc:1403] T b1d1d7dd508b43489431371c4ece4fa4 P dea34817fcc148d78f090ef5fa72304f: Time spent bootstrapping tablet: real 0.128s	user 0.014s	sys 0.028s
I20260709 13:09:12.750901 24312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1541f6b04d914d10823ad78c03d9a847" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace"
I20260709 13:09:12.751197 24361 raft_consensus.cc:359] T 861d7d76be4d484a9eb3acf8abffae5f P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:12.751936 24361 raft_consensus.cc:385] T 861d7d76be4d484a9eb3acf8abffae5f P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:12.751582 24362 raft_consensus.cc:359] T c5873f7465894eddab6fa84daecdcc84 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:12.752282 24361 raft_consensus.cc:740] T 861d7d76be4d484a9eb3acf8abffae5f P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8d4657116f948038a0c73018238c3ba, State: Initialized, Role: FOLLOWER
I20260709 13:09:12.752668 24362 raft_consensus.cc:385] T c5873f7465894eddab6fa84daecdcc84 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:12.753070 24362 raft_consensus.cc:740] T c5873f7465894eddab6fa84daecdcc84 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b39c386162de49aca92dbebee7f06ace, State: Initialized, Role: FOLLOWER
I20260709 13:09:12.751573 24312 raft_consensus.cc:3060] T 1541f6b04d914d10823ad78c03d9a847 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:12.753077 24359 raft_consensus.cc:359] T b1d1d7dd508b43489431371c4ece4fa4 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:12.753226 24361 consensus_queue.cc:260] T 861d7d76be4d484a9eb3acf8abffae5f P f8d4657116f948038a0c73018238c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:12.754073 24359 raft_consensus.cc:385] T b1d1d7dd508b43489431371c4ece4fa4 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:12.754515 24359 raft_consensus.cc:740] T b1d1d7dd508b43489431371c4ece4fa4 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dea34817fcc148d78f090ef5fa72304f, State: Initialized, Role: FOLLOWER
I20260709 13:09:12.753880 24362 consensus_queue.cc:260] T c5873f7465894eddab6fa84daecdcc84 P b39c386162de49aca92dbebee7f06ace [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:12.755201 24359 consensus_queue.cc:260] T b1d1d7dd508b43489431371c4ece4fa4 P dea34817fcc148d78f090ef5fa72304f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:12.756426 24362 ts_tablet_manager.cc:1434] T c5873f7465894eddab6fa84daecdcc84 P b39c386162de49aca92dbebee7f06ace: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:09:12.757503 24362 tablet_bootstrap.cc:492] T d17a6bbfc9d8478988b08964765c3b86 P b39c386162de49aca92dbebee7f06ace: Bootstrap starting.
I20260709 13:09:12.757639 24359 ts_tablet_manager.cc:1434] T b1d1d7dd508b43489431371c4ece4fa4 P dea34817fcc148d78f090ef5fa72304f: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
I20260709 13:09:12.758654 24361 ts_tablet_manager.cc:1434] T 861d7d76be4d484a9eb3acf8abffae5f P f8d4657116f948038a0c73018238c3ba: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:09:12.759972 24361 tablet_bootstrap.cc:492] T 99078769583e49908dd6990f1d806453 P f8d4657116f948038a0c73018238c3ba: Bootstrap starting.
I20260709 13:09:12.760811 24360 tablet_bootstrap.cc:492] T 95774511405b4ed8aadbab3d362c068e P c0f503bf8bb94af8a2a1139db4e1c0f5: No bootstrap required, opened a new log
I20260709 13:09:12.761308 24360 ts_tablet_manager.cc:1403] T 95774511405b4ed8aadbab3d362c068e P c0f503bf8bb94af8a2a1139db4e1c0f5: Time spent bootstrapping tablet: real 0.091s	user 0.010s	sys 0.003s
I20260709 13:09:12.762416 24312 raft_consensus.cc:2468] T 1541f6b04d914d10823ad78c03d9a847 P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dea34817fcc148d78f090ef5fa72304f in term 1.
I20260709 13:09:12.764112 24280 leader_election.cc:304] T 9acec0d1a6e74a4bb39a0d867598acc5 P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b39c386162de49aca92dbebee7f06ace, c0f503bf8bb94af8a2a1139db4e1c0f5; no voters: dea34817fcc148d78f090ef5fa72304f
I20260709 13:09:12.764416 24362 tablet_bootstrap.cc:654] T d17a6bbfc9d8478988b08964765c3b86 P b39c386162de49aca92dbebee7f06ace: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:12.764209 24360 raft_consensus.cc:359] T 95774511405b4ed8aadbab3d362c068e P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:12.765039 24360 raft_consensus.cc:385] T 95774511405b4ed8aadbab3d362c068e P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:12.765329 24360 raft_consensus.cc:740] T 95774511405b4ed8aadbab3d362c068e P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0f503bf8bb94af8a2a1139db4e1c0f5, State: Initialized, Role: FOLLOWER
I20260709 13:09:12.758694 24359 tablet_bootstrap.cc:492] T f662efc86a73450cac065505b63cb883 P dea34817fcc148d78f090ef5fa72304f: Bootstrap starting.
I20260709 13:09:12.766405 24360 consensus_queue.cc:260] T 95774511405b4ed8aadbab3d362c068e P c0f503bf8bb94af8a2a1139db4e1c0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:12.766930 24240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e868a924d74bbc8bf29aa5a7fc67fd" candidate_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8d4657116f948038a0c73018238c3ba"
I20260709 13:09:12.767578 24240 raft_consensus.cc:3060] T 93e868a924d74bbc8bf29aa5a7fc67fd P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:12.765671 24361 tablet_bootstrap.cc:654] T 99078769583e49908dd6990f1d806453 P f8d4657116f948038a0c73018238c3ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:12.773078 24360 ts_tablet_manager.cc:1434] T 95774511405b4ed8aadbab3d362c068e P c0f503bf8bb94af8a2a1139db4e1c0f5: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:09:12.775233 24359 tablet_bootstrap.cc:654] T f662efc86a73450cac065505b63cb883 P dea34817fcc148d78f090ef5fa72304f: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:12.776388 24360 tablet_bootstrap.cc:492] T 47fcd2aa8e994186872c2e0f9995dd8a P c0f503bf8bb94af8a2a1139db4e1c0f5: Bootstrap starting.
I20260709 13:09:12.778482 24445 leader_election.cc:290] T 93e868a924d74bbc8bf29aa5a7fc67fd P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 1 election: Requested vote from peers dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343), f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171)
I20260709 13:09:12.780108 24473 raft_consensus.cc:2804] T 9acec0d1a6e74a4bb39a0d867598acc5 P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:12.781183 24473 raft_consensus.cc:697] T 9acec0d1a6e74a4bb39a0d867598acc5 P b39c386162de49aca92dbebee7f06ace [term 1 LEADER]: Becoming Leader. State: Replica: b39c386162de49aca92dbebee7f06ace, State: Running, Role: LEADER
I20260709 13:09:12.782413 24473 consensus_queue.cc:237] T 9acec0d1a6e74a4bb39a0d867598acc5 P b39c386162de49aca92dbebee7f06ace [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:12.843492 24166 raft_consensus.cc:2468] T 1541f6b04d914d10823ad78c03d9a847 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dea34817fcc148d78f090ef5fa72304f in term 1.
I20260709 13:09:12.849131 24055 leader_election.cc:304] T 1541f6b04d914d10823ad78c03d9a847 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b39c386162de49aca92dbebee7f06ace, dea34817fcc148d78f090ef5fa72304f; no voters: 
I20260709 13:09:12.854126 24090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e868a924d74bbc8bf29aa5a7fc67fd" candidate_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dea34817fcc148d78f090ef5fa72304f"
I20260709 13:09:12.856010 24090 raft_consensus.cc:3060] T 93e868a924d74bbc8bf29aa5a7fc67fd P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:12.861076 24360 tablet_bootstrap.cc:654] T 47fcd2aa8e994186872c2e0f9995dd8a P c0f503bf8bb94af8a2a1139db4e1c0f5: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:12.860738 24280 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:37431, user_credentials={real_user=slave}} blocked reactor thread for 96533.9us
I20260709 13:09:12.862059 24359 tablet_bootstrap.cc:492] T f662efc86a73450cac065505b63cb883 P dea34817fcc148d78f090ef5fa72304f: No bootstrap required, opened a new log
I20260709 13:09:12.863372 24368 raft_consensus.cc:493] T 861d7d76be4d484a9eb3acf8abffae5f P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.863849 24419 consensus_queue.cc:1048] T f735173e22b242178edcdf4821b6f92b P dea34817fcc148d78f090ef5fa72304f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:12.864435 24368 raft_consensus.cc:515] T 861d7d76be4d484a9eb3acf8abffae5f P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:12.867386 24371 raft_consensus.cc:493] T 7da69453741f4b73a0092f56f29b1000 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.874719 24371 raft_consensus.cc:515] T 7da69453741f4b73a0092f56f29b1000 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:12.880204 24361 tablet_bootstrap.cc:492] T 99078769583e49908dd6990f1d806453 P f8d4657116f948038a0c73018238c3ba: No bootstrap required, opened a new log
I20260709 13:09:12.881718 24368 leader_election.cc:290] T 861d7d76be4d484a9eb3acf8abffae5f P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431), f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171)
I20260709 13:09:12.881778 24361 ts_tablet_manager.cc:1403] T 99078769583e49908dd6990f1d806453 P f8d4657116f948038a0c73018238c3ba: Time spent bootstrapping tablet: real 0.122s	user 0.015s	sys 0.003s
I20260709 13:09:12.884792 24455 raft_consensus.cc:493] T b1d1d7dd508b43489431371c4ece4fa4 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.878657 24445 consensus_queue.cc:1048] T 45b65ebcb0114044a04e5689db4a466f P c0f503bf8bb94af8a2a1139db4e1c0f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:09:12.889999 24368 raft_consensus.cc:2804] T 1541f6b04d914d10823ad78c03d9a847 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:12.890725 24368 raft_consensus.cc:697] T 1541f6b04d914d10823ad78c03d9a847 P dea34817fcc148d78f090ef5fa72304f [term 1 LEADER]: Becoming Leader. State: Replica: dea34817fcc148d78f090ef5fa72304f, State: Running, Role: LEADER
I20260709 13:09:12.890475 24361 raft_consensus.cc:359] T 99078769583e49908dd6990f1d806453 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:12.891646 24361 raft_consensus.cc:385] T 99078769583e49908dd6990f1d806453 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:12.891753 24420 consensus_queue.cc:1048] T 46f373ffd46f4625bac910b5ccf4b767 P f8d4657116f948038a0c73018238c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:12.892277 24361 raft_consensus.cc:740] T 99078769583e49908dd6990f1d806453 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8d4657116f948038a0c73018238c3ba, State: Initialized, Role: FOLLOWER
I20260709 13:09:12.892529 24368 consensus_queue.cc:237] T 1541f6b04d914d10823ad78c03d9a847 P dea34817fcc148d78f090ef5fa72304f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:12.893090 24361 consensus_queue.cc:260] T 99078769583e49908dd6990f1d806453 P f8d4657116f948038a0c73018238c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:12.899026 24361 ts_tablet_manager.cc:1434] T 99078769583e49908dd6990f1d806453 P f8d4657116f948038a0c73018238c3ba: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.006s
I20260709 13:09:12.902799 24362 tablet_bootstrap.cc:492] T d17a6bbfc9d8478988b08964765c3b86 P b39c386162de49aca92dbebee7f06ace: No bootstrap required, opened a new log
I20260709 13:09:12.906865 24473 raft_consensus.cc:493] T c5873f7465894eddab6fa84daecdcc84 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.893944 24359 ts_tablet_manager.cc:1403] T f662efc86a73450cac065505b63cb883 P dea34817fcc148d78f090ef5fa72304f: Time spent bootstrapping tablet: real 0.135s	user 0.011s	sys 0.007s
I20260709 13:09:12.885807 24455 raft_consensus.cc:515] T b1d1d7dd508b43489431371c4ece4fa4 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:12.911744 24454 raft_consensus.cc:493] T 861d7d76be4d484a9eb3acf8abffae5f P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.915374 24454 raft_consensus.cc:515] T 861d7d76be4d484a9eb3acf8abffae5f P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:12.920010 24454 leader_election.cc:290] T 861d7d76be4d484a9eb3acf8abffae5f P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343), c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431)
W20260709 13:09:12.920029 24055 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:38561, user_credentials={real_user=slave}} blocked reactor thread for 71510.7us
I20260709 13:09:12.907763 24371 leader_election.cc:290] T 7da69453741f4b73a0092f56f29b1000 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561), c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431)
I20260709 13:09:12.929572 24362 ts_tablet_manager.cc:1403] T d17a6bbfc9d8478988b08964765c3b86 P b39c386162de49aca92dbebee7f06ace: Time spent bootstrapping tablet: real 0.172s	user 0.016s	sys 0.018s
I20260709 13:09:12.929723 24473 raft_consensus.cc:515] T c5873f7465894eddab6fa84daecdcc84 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:12.932448 24089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861d7d76be4d484a9eb3acf8abffae5f" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dea34817fcc148d78f090ef5fa72304f" is_pre_election: true
I20260709 13:09:12.933431 24162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861d7d76be4d484a9eb3acf8abffae5f" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" is_pre_election: true
I20260709 13:09:12.933671 24089 raft_consensus.cc:2468] T 861d7d76be4d484a9eb3acf8abffae5f P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8d4657116f948038a0c73018238c3ba in term 0.
I20260709 13:09:12.941107 24359 raft_consensus.cc:359] T f662efc86a73450cac065505b63cb883 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
W20260709 13:09:12.941576 24206 leader_election.cc:343] T 861d7d76be4d484a9eb3acf8abffae5f P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:12.945603 24362 raft_consensus.cc:359] T d17a6bbfc9d8478988b08964765c3b86 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:12.943341 24206 leader_election.cc:304] T 861d7d76be4d484a9eb3acf8abffae5f P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dea34817fcc148d78f090ef5fa72304f, f8d4657116f948038a0c73018238c3ba; no voters: c0f503bf8bb94af8a2a1139db4e1c0f5
I20260709 13:09:12.968529 24362 raft_consensus.cc:385] T d17a6bbfc9d8478988b08964765c3b86 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:12.946458 24165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861d7d76be4d484a9eb3acf8abffae5f" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" is_pre_election: true
I20260709 13:09:12.932590 24313 raft_consensus.cc:3060] T c5873f7465894eddab6fa84daecdcc84 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:12.958472 24314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d1d7dd508b43489431371c4ece4fa4" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace" is_pre_election: true
I20260709 13:09:12.970510 24362 raft_consensus.cc:740] T d17a6bbfc9d8478988b08964765c3b86 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b39c386162de49aca92dbebee7f06ace, State: Initialized, Role: FOLLOWER
I20260709 13:09:12.957832 24311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da69453741f4b73a0092f56f29b1000" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace" is_pre_election: true
I20260709 13:09:12.955240 24164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da69453741f4b73a0092f56f29b1000" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" is_pre_election: true
W20260709 13:09:12.971832 24204 leader_election.cc:343] T b1d1d7dd508b43489431371c4ece4fa4 P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:12.951201 24455 leader_election.cc:290] T b1d1d7dd508b43489431371c4ece4fa4 P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561), dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343)
I20260709 13:09:12.972533 24362 consensus_queue.cc:260] T d17a6bbfc9d8478988b08964765c3b86 P b39c386162de49aca92dbebee7f06ace [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:12.973170 24359 raft_consensus.cc:385] T f662efc86a73450cac065505b63cb883 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:12.973742 24359 raft_consensus.cc:740] T f662efc86a73450cac065505b63cb883 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dea34817fcc148d78f090ef5fa72304f, State: Initialized, Role: FOLLOWER
I20260709 13:09:12.974872 24359 consensus_queue.cc:260] T f662efc86a73450cac065505b63cb883 P dea34817fcc148d78f090ef5fa72304f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:12.975893 24455 raft_consensus.cc:2804] T 861d7d76be4d484a9eb3acf8abffae5f P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:12.967623 24240 raft_consensus.cc:2468] T 93e868a924d74bbc8bf29aa5a7fc67fd P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0f503bf8bb94af8a2a1139db4e1c0f5 in term 1.
I20260709 13:09:12.978111 24455 raft_consensus.cc:493] T 861d7d76be4d484a9eb3acf8abffae5f P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:12.976544 24089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d1d7dd508b43489431371c4ece4fa4" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dea34817fcc148d78f090ef5fa72304f" is_pre_election: true
I20260709 13:09:12.983960 24455 raft_consensus.cc:3060] T 861d7d76be4d484a9eb3acf8abffae5f P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:13.002789 24238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5873f7465894eddab6fa84daecdcc84" candidate_uuid: "b39c386162de49aca92dbebee7f06ace" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8d4657116f948038a0c73018238c3ba" is_pre_election: true
W20260709 13:09:13.003172 24057 leader_election.cc:343] T 861d7d76be4d484a9eb3acf8abffae5f P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:13.004057 24057 leader_election.cc:343] T 7da69453741f4b73a0092f56f29b1000 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:13.005599 24239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861d7d76be4d484a9eb3acf8abffae5f" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8d4657116f948038a0c73018238c3ba" is_pre_election: true
I20260709 13:09:12.997733 24089 raft_consensus.cc:2468] T b1d1d7dd508b43489431371c4ece4fa4 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8d4657116f948038a0c73018238c3ba in term 0.
I20260709 13:09:13.007856 24361 tablet_bootstrap.cc:492] T ee2c640a38d44afebd95dfec0e30b0d6 P f8d4657116f948038a0c73018238c3ba: Bootstrap starting.
I20260709 13:09:13.008343 24445 raft_consensus.cc:493] T d17a6bbfc9d8478988b08964765c3b86 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.009114 24445 raft_consensus.cc:515] T d17a6bbfc9d8478988b08964765c3b86 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:12.977511 24090 raft_consensus.cc:2468] T 93e868a924d74bbc8bf29aa5a7fc67fd P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0f503bf8bb94af8a2a1139db4e1c0f5 in term 1.
I20260709 13:09:12.947958 24473 leader_election.cc:290] T c5873f7465894eddab6fa84daecdcc84 P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431), f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171)
I20260709 13:09:12.957015 24163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5873f7465894eddab6fa84daecdcc84" candidate_uuid: "b39c386162de49aca92dbebee7f06ace" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" is_pre_election: true
I20260709 13:09:13.014187 24444 consensus_queue.cc:1048] T 45b65ebcb0114044a04e5689db4a466f P c0f503bf8bb94af8a2a1139db4e1c0f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:13.027506 24455 raft_consensus.cc:515] T 861d7d76be4d484a9eb3acf8abffae5f P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:13.028481 24360 tablet_bootstrap.cc:492] T 47fcd2aa8e994186872c2e0f9995dd8a P c0f503bf8bb94af8a2a1139db4e1c0f5: No bootstrap required, opened a new log
I20260709 13:09:13.029224 24360 ts_tablet_manager.cc:1403] T 47fcd2aa8e994186872c2e0f9995dd8a P c0f503bf8bb94af8a2a1139db4e1c0f5: Time spent bootstrapping tablet: real 0.254s	user 0.016s	sys 0.005s
I20260709 13:09:12.957742 24453 consensus_queue.cc:1048] T 46f373ffd46f4625bac910b5ccf4b767 P f8d4657116f948038a0c73018238c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.060s
I20260709 13:09:13.017400 24206 leader_election.cc:304] T b1d1d7dd508b43489431371c4ece4fa4 P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dea34817fcc148d78f090ef5fa72304f, f8d4657116f948038a0c73018238c3ba; no voters: b39c386162de49aca92dbebee7f06ace
I20260709 13:09:13.031466 24132 leader_election.cc:304] T 93e868a924d74bbc8bf29aa5a7fc67fd P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0f503bf8bb94af8a2a1139db4e1c0f5, dea34817fcc148d78f090ef5fa72304f; no voters: 
I20260709 13:09:13.031792 24362 ts_tablet_manager.cc:1434] T d17a6bbfc9d8478988b08964765c3b86 P b39c386162de49aca92dbebee7f06ace: Time spent starting tablet: real 0.102s	user 0.018s	sys 0.005s
I20260709 13:09:13.035589 24239 raft_consensus.cc:2393] T 861d7d76be4d484a9eb3acf8abffae5f P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dea34817fcc148d78f090ef5fa72304f in current term 1: Already voted for candidate f8d4657116f948038a0c73018238c3ba in this term.
I20260709 13:09:13.037719 24359 ts_tablet_manager.cc:1434] T f662efc86a73450cac065505b63cb883 P dea34817fcc148d78f090ef5fa72304f: Time spent starting tablet: real 0.113s	user 0.008s	sys 0.000s
I20260709 13:09:13.041855 24311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d17a6bbfc9d8478988b08964765c3b86" candidate_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace" is_pre_election: true
I20260709 13:09:13.034435 24360 raft_consensus.cc:359] T 47fcd2aa8e994186872c2e0f9995dd8a P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:13.045287 24360 raft_consensus.cc:385] T 47fcd2aa8e994186872c2e0f9995dd8a P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:13.045616 24360 raft_consensus.cc:740] T 47fcd2aa8e994186872c2e0f9995dd8a P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0f503bf8bb94af8a2a1139db4e1c0f5, State: Initialized, Role: FOLLOWER
I20260709 13:09:13.043042 24163 raft_consensus.cc:2393] T c5873f7465894eddab6fa84daecdcc84 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b39c386162de49aca92dbebee7f06ace in current term 1: Already voted for candidate f8d4657116f948038a0c73018238c3ba in this term.
W20260709 13:09:13.046424 24037 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 13:09:13.012081 24055 leader_election.cc:343] T 7da69453741f4b73a0092f56f29b1000 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:13.047420 24360 consensus_queue.cc:260] T 47fcd2aa8e994186872c2e0f9995dd8a P c0f503bf8bb94af8a2a1139db4e1c0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:13.051366 24447 raft_consensus.cc:2804] T b1d1d7dd508b43489431371c4ece4fa4 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:13.054510 24447 raft_consensus.cc:493] T b1d1d7dd508b43489431371c4ece4fa4 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:13.051928 24455 leader_election.cc:290] T 861d7d76be4d484a9eb3acf8abffae5f P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 election: Requested vote from peers dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343), c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431)
I20260709 13:09:13.051591 24311 raft_consensus.cc:2468] T d17a6bbfc9d8478988b08964765c3b86 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0f503bf8bb94af8a2a1139db4e1c0f5 in term 0.
I20260709 13:09:13.055629 24447 raft_consensus.cc:3060] T b1d1d7dd508b43489431371c4ece4fa4 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:13.059211 24444 raft_consensus.cc:2804] T 93e868a924d74bbc8bf29aa5a7fc67fd P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:13.051546 24055 leader_election.cc:304] T 7da69453741f4b73a0092f56f29b1000 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dea34817fcc148d78f090ef5fa72304f; no voters: b39c386162de49aca92dbebee7f06ace, c0f503bf8bb94af8a2a1139db4e1c0f5
W20260709 13:09:13.063625 24055 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:38561, user_credentials={real_user=slave}} blocked reactor thread for 52426.2us
I20260709 13:09:13.068598 24362 tablet_bootstrap.cc:492] T 95774511405b4ed8aadbab3d362c068e P b39c386162de49aca92dbebee7f06ace: Bootstrap starting.
I20260709 13:09:13.070045 24494 raft_consensus.cc:2749] T 7da69453741f4b73a0092f56f29b1000 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:13.072389 24130 leader_election.cc:304] T d17a6bbfc9d8478988b08964765c3b86 P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b39c386162de49aca92dbebee7f06ace, c0f503bf8bb94af8a2a1139db4e1c0f5; no voters: 
I20260709 13:09:13.092212 24454 consensus_queue.cc:1048] T c5873f7465894eddab6fa84daecdcc84 P f8d4657116f948038a0c73018238c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:13.095237 24359 tablet_bootstrap.cc:492] T d17a6bbfc9d8478988b08964765c3b86 P dea34817fcc148d78f090ef5fa72304f: Bootstrap starting.
I20260709 13:09:13.103579 24360 ts_tablet_manager.cc:1434] T 47fcd2aa8e994186872c2e0f9995dd8a P c0f503bf8bb94af8a2a1139db4e1c0f5: Time spent starting tablet: real 0.074s	user 0.009s	sys 0.000s
I20260709 13:09:13.105374 24360 tablet_bootstrap.cc:492] T de5786fbd53646a9bc152ac0a2a9aa53 P c0f503bf8bb94af8a2a1139db4e1c0f5: Bootstrap starting.
I20260709 13:09:13.088532 24445 leader_election.cc:290] T d17a6bbfc9d8478988b08964765c3b86 P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561), dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343)
I20260709 13:09:13.111099 24445 raft_consensus.cc:2804] T d17a6bbfc9d8478988b08964765c3b86 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:13.111543 24445 raft_consensus.cc:493] T d17a6bbfc9d8478988b08964765c3b86 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:13.111869 24445 raft_consensus.cc:3060] T d17a6bbfc9d8478988b08964765c3b86 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:13.111979 24361 tablet_bootstrap.cc:654] T ee2c640a38d44afebd95dfec0e30b0d6 P f8d4657116f948038a0c73018238c3ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:13.116318 24089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861d7d76be4d484a9eb3acf8abffae5f" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dea34817fcc148d78f090ef5fa72304f"
I20260709 13:09:13.114948 24091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d17a6bbfc9d8478988b08964765c3b86" candidate_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dea34817fcc148d78f090ef5fa72304f" is_pre_election: true
I20260709 13:09:13.117085 24089 raft_consensus.cc:3060] T 861d7d76be4d484a9eb3acf8abffae5f P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:13.118690 24132 leader_election.cc:343] T d17a6bbfc9d8478988b08964765c3b86 P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:13.119524 24362 tablet_bootstrap.cc:654] T 95774511405b4ed8aadbab3d362c068e P b39c386162de49aca92dbebee7f06ace: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:13.123536 24455 consensus_queue.cc:1048] T aac6068ee4554cce8f2d534a106ef417 P f8d4657116f948038a0c73018238c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:13.087625 24444 raft_consensus.cc:697] T 93e868a924d74bbc8bf29aa5a7fc67fd P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 LEADER]: Becoming Leader. State: Replica: c0f503bf8bb94af8a2a1139db4e1c0f5, State: Running, Role: LEADER
I20260709 13:09:13.129944 24444 consensus_queue.cc:237] T 93e868a924d74bbc8bf29aa5a7fc67fd P c0f503bf8bb94af8a2a1139db4e1c0f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:13.130803 24089 raft_consensus.cc:2468] T 861d7d76be4d484a9eb3acf8abffae5f P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8d4657116f948038a0c73018238c3ba in term 1.
I20260709 13:09:13.097838 24494 consensus_queue.cc:1048] T 42868db4862647c28215f3d7cb9adf02 P dea34817fcc148d78f090ef5fa72304f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.038s
I20260709 13:09:13.142787 24485 consensus_queue.cc:1048] T 42868db4862647c28215f3d7cb9adf02 P dea34817fcc148d78f090ef5fa72304f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:09:13.149242 24206 leader_election.cc:304] T 861d7d76be4d484a9eb3acf8abffae5f P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dea34817fcc148d78f090ef5fa72304f, f8d4657116f948038a0c73018238c3ba; no voters: 
I20260709 13:09:13.142885 24499 raft_consensus.cc:493] T 47fcd2aa8e994186872c2e0f9995dd8a P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.152761 24455 raft_consensus.cc:2804] T 861d7d76be4d484a9eb3acf8abffae5f P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:13.151793 24499 raft_consensus.cc:515] T 47fcd2aa8e994186872c2e0f9995dd8a P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:13.168147 24362 tablet_bootstrap.cc:492] T 95774511405b4ed8aadbab3d362c068e P b39c386162de49aca92dbebee7f06ace: No bootstrap required, opened a new log
I20260709 13:09:13.168751 24362 ts_tablet_manager.cc:1403] T 95774511405b4ed8aadbab3d362c068e P b39c386162de49aca92dbebee7f06ace: Time spent bootstrapping tablet: real 0.101s	user 0.029s	sys 0.004s
I20260709 13:09:13.169634 24455 raft_consensus.cc:697] T 861d7d76be4d484a9eb3acf8abffae5f P f8d4657116f948038a0c73018238c3ba [term 1 LEADER]: Becoming Leader. State: Replica: f8d4657116f948038a0c73018238c3ba, State: Running, Role: LEADER
W20260709 13:09:13.171336 24493 log.cc:927] Time spent T 45b65ebcb0114044a04e5689db4a466f P b39c386162de49aca92dbebee7f06ace: Append to log took a long time: real 0.092s	user 0.002s	sys 0.000s
I20260709 13:09:13.172446 24362 raft_consensus.cc:359] T 95774511405b4ed8aadbab3d362c068e P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
W20260709 13:09:13.173013 24131 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46171, user_credentials={real_user=slave}} blocked reactor thread for 126592us
I20260709 13:09:13.173252 24362 raft_consensus.cc:385] T 95774511405b4ed8aadbab3d362c068e P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:13.187053 24362 raft_consensus.cc:740] T 95774511405b4ed8aadbab3d362c068e P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b39c386162de49aca92dbebee7f06ace, State: Initialized, Role: FOLLOWER
I20260709 13:09:13.188215 24362 consensus_queue.cc:260] T 95774511405b4ed8aadbab3d362c068e P b39c386162de49aca92dbebee7f06ace [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:13.173807 24089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fcd2aa8e994186872c2e0f9995dd8a" candidate_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dea34817fcc148d78f090ef5fa72304f" is_pre_election: true
I20260709 13:09:13.190177 24089 raft_consensus.cc:2393] T 47fcd2aa8e994186872c2e0f9995dd8a P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0f503bf8bb94af8a2a1139db4e1c0f5 in current term 1: Already voted for candidate f8d4657116f948038a0c73018238c3ba in this term.
I20260709 13:09:13.171132 24455 consensus_queue.cc:237] T 861d7d76be4d484a9eb3acf8abffae5f P f8d4657116f948038a0c73018238c3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:13.175375 24499 leader_election.cc:290] T 47fcd2aa8e994186872c2e0f9995dd8a P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343), f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171)
I20260709 13:09:13.196784 24362 ts_tablet_manager.cc:1434] T 95774511405b4ed8aadbab3d362c068e P b39c386162de49aca92dbebee7f06ace: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.001s
I20260709 13:09:13.198843 24362 tablet_bootstrap.cc:492] T e335cd6afc4349cfaafa2970bccb40ff P b39c386162de49aca92dbebee7f06ace: Bootstrap starting.
I20260709 13:09:13.202507 24447 raft_consensus.cc:515] T b1d1d7dd508b43489431371c4ece4fa4 P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:13.206630 24312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d1d7dd508b43489431371c4ece4fa4" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace"
I20260709 13:09:13.215801 24056 leader_election.cc:304] T 861d7d76be4d484a9eb3acf8abffae5f P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dea34817fcc148d78f090ef5fa72304f; no voters: c0f503bf8bb94af8a2a1139db4e1c0f5, f8d4657116f948038a0c73018238c3ba
I20260709 13:09:13.219111 24089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d1d7dd508b43489431371c4ece4fa4" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dea34817fcc148d78f090ef5fa72304f"
I20260709 13:09:13.219774 24089 raft_consensus.cc:3060] T b1d1d7dd508b43489431371c4ece4fa4 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:13.227958 24204 leader_election.cc:343] T b1d1d7dd508b43489431371c4ece4fa4 P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:13.228847 24485 raft_consensus.cc:2749] T 861d7d76be4d484a9eb3acf8abffae5f P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:09:13.185226 24500 log.cc:927] Time spent T 45b65ebcb0114044a04e5689db4a466f P dea34817fcc148d78f090ef5fa72304f: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
I20260709 13:09:13.231026 24359 tablet_bootstrap.cc:654] T d17a6bbfc9d8478988b08964765c3b86 P dea34817fcc148d78f090ef5fa72304f: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:13.234212 24236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47fcd2aa8e994186872c2e0f9995dd8a" candidate_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8d4657116f948038a0c73018238c3ba" is_pre_election: true
I20260709 13:09:13.232699 23986 catalog_manager.cc:5697] T 1541f6b04d914d10823ad78c03d9a847 P dea34817fcc148d78f090ef5fa72304f reported cstate change: term changed from 0 to 1, leader changed from <none> to dea34817fcc148d78f090ef5fa72304f (127.14.180.65). New cstate: current_term: 1 leader_uuid: "dea34817fcc148d78f090ef5fa72304f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:13.186057 24445 raft_consensus.cc:515] T d17a6bbfc9d8478988b08964765c3b86 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:13.251194 24360 tablet_bootstrap.cc:654] T de5786fbd53646a9bc152ac0a2a9aa53 P c0f503bf8bb94af8a2a1139db4e1c0f5: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:13.255131 24362 tablet_bootstrap.cc:654] T e335cd6afc4349cfaafa2970bccb40ff P b39c386162de49aca92dbebee7f06ace: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:13.239391 24447 leader_election.cc:290] T b1d1d7dd508b43489431371c4ece4fa4 P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 election: Requested vote from peers b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561), dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343)
I20260709 13:09:13.264464 24361 tablet_bootstrap.cc:492] T ee2c640a38d44afebd95dfec0e30b0d6 P f8d4657116f948038a0c73018238c3ba: No bootstrap required, opened a new log
I20260709 13:09:13.265257 24361 ts_tablet_manager.cc:1403] T ee2c640a38d44afebd95dfec0e30b0d6 P f8d4657116f948038a0c73018238c3ba: Time spent bootstrapping tablet: real 0.258s	user 0.029s	sys 0.016s
I20260709 13:09:13.269524 24361 raft_consensus.cc:359] T ee2c640a38d44afebd95dfec0e30b0d6 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:13.270639 24361 raft_consensus.cc:385] T ee2c640a38d44afebd95dfec0e30b0d6 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:13.271142 24361 raft_consensus.cc:740] T ee2c640a38d44afebd95dfec0e30b0d6 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8d4657116f948038a0c73018238c3ba, State: Initialized, Role: FOLLOWER
I20260709 13:09:13.277057 24131 leader_election.cc:304] T 47fcd2aa8e994186872c2e0f9995dd8a P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0f503bf8bb94af8a2a1139db4e1c0f5; no voters: dea34817fcc148d78f090ef5fa72304f, f8d4657116f948038a0c73018238c3ba
I20260709 13:09:13.276929 24453 consensus_queue.cc:1048] T aac6068ee4554cce8f2d534a106ef417 P f8d4657116f948038a0c73018238c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:13.278915 24502 raft_consensus.cc:493] T 95774511405b4ed8aadbab3d362c068e P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.279590 24502 raft_consensus.cc:515] T 95774511405b4ed8aadbab3d362c068e P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:13.283702 24163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861d7d76be4d484a9eb3acf8abffae5f" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5"
I20260709 13:09:13.287642 24361 consensus_queue.cc:260] T ee2c640a38d44afebd95dfec0e30b0d6 P f8d4657116f948038a0c73018238c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:13.259794 24455 consensus_queue.cc:1048] T 47fcd2aa8e994186872c2e0f9995dd8a P f8d4657116f948038a0c73018238c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.028s
I20260709 13:09:13.286113 24499 raft_consensus.cc:3060] T 47fcd2aa8e994186872c2e0f9995dd8a P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:13.293835 24206 leader_election.cc:343] T 861d7d76be4d484a9eb3acf8abffae5f P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:13.289991 24473 raft_consensus.cc:493] T 95774511405b4ed8aadbab3d362c068e P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.308319 24473 raft_consensus.cc:515] T 95774511405b4ed8aadbab3d362c068e P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:13.313243 24499 raft_consensus.cc:2749] T 47fcd2aa8e994186872c2e0f9995dd8a P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:13.300289 24280 leader_election.cc:304] T c5873f7465894eddab6fa84daecdcc84 P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b39c386162de49aca92dbebee7f06ace; no voters: c0f503bf8bb94af8a2a1139db4e1c0f5, f8d4657116f948038a0c73018238c3ba
I20260709 13:09:13.317014 24377 raft_consensus.cc:2749] T c5873f7465894eddab6fa84daecdcc84 P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:13.318737 24447 consensus_queue.cc:1048] T c5873f7465894eddab6fa84daecdcc84 P f8d4657116f948038a0c73018238c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:13.312000 24089 raft_consensus.cc:2468] T b1d1d7dd508b43489431371c4ece4fa4 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8d4657116f948038a0c73018238c3ba in term 1.
I20260709 13:09:13.323895 24473 leader_election.cc:290] T 95774511405b4ed8aadbab3d362c068e P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431), f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171)
I20260709 13:09:13.324640 24502 leader_election.cc:290] T 95774511405b4ed8aadbab3d362c068e P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171), b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561)
I20260709 13:09:13.325150 24239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95774511405b4ed8aadbab3d362c068e" candidate_uuid: "b39c386162de49aca92dbebee7f06ace" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8d4657116f948038a0c73018238c3ba" is_pre_election: true
I20260709 13:09:13.325994 24239 raft_consensus.cc:2468] T 95774511405b4ed8aadbab3d362c068e P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b39c386162de49aca92dbebee7f06ace in term 0.
I20260709 13:09:13.327566 24279 leader_election.cc:304] T 95774511405b4ed8aadbab3d362c068e P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b39c386162de49aca92dbebee7f06ace, f8d4657116f948038a0c73018238c3ba; no voters: 
I20260709 13:09:13.327878 24445 leader_election.cc:290] T d17a6bbfc9d8478988b08964765c3b86 P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 1 election: Requested vote from peers b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561), dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343)
I20260709 13:09:13.328135 24206 leader_election.cc:304] T b1d1d7dd508b43489431371c4ece4fa4 P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dea34817fcc148d78f090ef5fa72304f, f8d4657116f948038a0c73018238c3ba; no voters: b39c386162de49aca92dbebee7f06ace
I20260709 13:09:13.328573 24473 raft_consensus.cc:2804] T 95774511405b4ed8aadbab3d362c068e P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:13.329021 24473 raft_consensus.cc:493] T 95774511405b4ed8aadbab3d362c068e P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:13.331676 24359 tablet_bootstrap.cc:492] T d17a6bbfc9d8478988b08964765c3b86 P dea34817fcc148d78f090ef5fa72304f: No bootstrap required, opened a new log
I20260709 13:09:13.332275 24359 ts_tablet_manager.cc:1403] T d17a6bbfc9d8478988b08964765c3b86 P dea34817fcc148d78f090ef5fa72304f: Time spent bootstrapping tablet: real 0.238s	user 0.009s	sys 0.036s
I20260709 13:09:13.336884 24359 raft_consensus.cc:359] T d17a6bbfc9d8478988b08964765c3b86 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:13.340958 24359 raft_consensus.cc:385] T d17a6bbfc9d8478988b08964765c3b86 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:13.340966 24494 consensus_queue.cc:1048] T 1541f6b04d914d10823ad78c03d9a847 P dea34817fcc148d78f090ef5fa72304f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:13.341652 24359 raft_consensus.cc:740] T d17a6bbfc9d8478988b08964765c3b86 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dea34817fcc148d78f090ef5fa72304f, State: Initialized, Role: FOLLOWER
I20260709 13:09:13.329025 24453 raft_consensus.cc:2804] T b1d1d7dd508b43489431371c4ece4fa4 P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:13.338411 23989 catalog_manager.cc:5697] T 93e868a924d74bbc8bf29aa5a7fc67fd P c0f503bf8bb94af8a2a1139db4e1c0f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66). New cstate: current_term: 1 leader_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:13.332423 24473 raft_consensus.cc:3060] T 95774511405b4ed8aadbab3d362c068e P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:13.348517 24089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d17a6bbfc9d8478988b08964765c3b86" candidate_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dea34817fcc148d78f090ef5fa72304f"
I20260709 13:09:13.342684 24359 consensus_queue.cc:260] T d17a6bbfc9d8478988b08964765c3b86 P dea34817fcc148d78f090ef5fa72304f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:13.374373 24311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95774511405b4ed8aadbab3d362c068e" candidate_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace" is_pre_election: true
W20260709 13:09:13.365267 24280 consensus_peers.cc:597] T 9acec0d1a6e74a4bb39a0d867598acc5 P b39c386162de49aca92dbebee7f06ace -> Peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Couldn't send request to peer dea34817fcc148d78f090ef5fa72304f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:13.373085 24089 raft_consensus.cc:3060] T d17a6bbfc9d8478988b08964765c3b86 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:13.401216 24361 ts_tablet_manager.cc:1434] T ee2c640a38d44afebd95dfec0e30b0d6 P f8d4657116f948038a0c73018238c3ba: Time spent starting tablet: real 0.136s	user 0.010s	sys 0.003s
I20260709 13:09:13.371162 24453 raft_consensus.cc:697] T b1d1d7dd508b43489431371c4ece4fa4 P f8d4657116f948038a0c73018238c3ba [term 1 LEADER]: Becoming Leader. State: Replica: f8d4657116f948038a0c73018238c3ba, State: Running, Role: LEADER
I20260709 13:09:13.382192 24368 raft_consensus.cc:493] T f662efc86a73450cac065505b63cb883 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.420769 24162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95774511405b4ed8aadbab3d362c068e" candidate_uuid: "b39c386162de49aca92dbebee7f06ace" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" is_pre_election: true
I20260709 13:09:13.421919 24162 raft_consensus.cc:2468] T 95774511405b4ed8aadbab3d362c068e P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b39c386162de49aca92dbebee7f06ace in term 0.
I20260709 13:09:13.406652 24455 raft_consensus.cc:493] T ee2c640a38d44afebd95dfec0e30b0d6 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.422163 24453 consensus_queue.cc:237] T b1d1d7dd508b43489431371c4ece4fa4 P f8d4657116f948038a0c73018238c3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:13.423070 24455 raft_consensus.cc:515] T ee2c640a38d44afebd95dfec0e30b0d6 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:13.412066 24360 tablet_bootstrap.cc:492] T de5786fbd53646a9bc152ac0a2a9aa53 P c0f503bf8bb94af8a2a1139db4e1c0f5: No bootstrap required, opened a new log
I20260709 13:09:13.426718 24360 ts_tablet_manager.cc:1403] T de5786fbd53646a9bc152ac0a2a9aa53 P c0f503bf8bb94af8a2a1139db4e1c0f5: Time spent bootstrapping tablet: real 0.322s	user 0.029s	sys 0.023s
I20260709 13:09:13.419116 24314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d17a6bbfc9d8478988b08964765c3b86" candidate_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace"
W20260709 13:09:13.383422 24280 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:36343, user_credentials={real_user=slave}} blocked reactor thread for 49373.4us
I20260709 13:09:13.421794 24368 raft_consensus.cc:515] T f662efc86a73450cac065505b63cb883 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:13.430272 24359 ts_tablet_manager.cc:1434] T d17a6bbfc9d8478988b08964765c3b86 P dea34817fcc148d78f090ef5fa72304f: Time spent starting tablet: real 0.098s	user 0.008s	sys 0.002s
I20260709 13:09:13.425850 24455 leader_election.cc:290] T ee2c640a38d44afebd95dfec0e30b0d6 P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343), c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431)
I20260709 13:09:13.429989 24314 raft_consensus.cc:3060] T d17a6bbfc9d8478988b08964765c3b86 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:13.439143 24396 raft_consensus.cc:493] T 99078769583e49908dd6990f1d806453 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.439795 24396 raft_consensus.cc:515] T 99078769583e49908dd6990f1d806453 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:13.442078 24396 leader_election.cc:290] T 99078769583e49908dd6990f1d806453 P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561), dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343)
I20260709 13:09:13.443992 24377 consensus_queue.cc:1048] T 9acec0d1a6e74a4bb39a0d867598acc5 P b39c386162de49aca92dbebee7f06ace [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:13.437103 24236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95774511405b4ed8aadbab3d362c068e" candidate_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8d4657116f948038a0c73018238c3ba" is_pre_election: true
I20260709 13:09:13.447221 24236 raft_consensus.cc:2468] T 95774511405b4ed8aadbab3d362c068e P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0f503bf8bb94af8a2a1139db4e1c0f5 in term 0.
I20260709 13:09:13.448740 24131 leader_election.cc:304] T 95774511405b4ed8aadbab3d362c068e P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0f503bf8bb94af8a2a1139db4e1c0f5, f8d4657116f948038a0c73018238c3ba; no voters: 
I20260709 13:09:13.450044 24512 raft_consensus.cc:2804] T 95774511405b4ed8aadbab3d362c068e P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:13.451447 24161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2c640a38d44afebd95dfec0e30b0d6" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" is_pre_election: true
I20260709 13:09:13.452104 24368 leader_election.cc:290] T f662efc86a73450cac065505b63cb883 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171), b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561)
I20260709 13:09:13.452783 24512 raft_consensus.cc:493] T 95774511405b4ed8aadbab3d362c068e P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:13.453346 24512 raft_consensus.cc:3060] T 95774511405b4ed8aadbab3d362c068e P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:13.456696 24310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99078769583e49908dd6990f1d806453" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace" is_pre_election: true
I20260709 13:09:13.460486 24360 raft_consensus.cc:359] T de5786fbd53646a9bc152ac0a2a9aa53 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:13.461310 24360 raft_consensus.cc:385] T de5786fbd53646a9bc152ac0a2a9aa53 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:13.461767 24360 raft_consensus.cc:740] T de5786fbd53646a9bc152ac0a2a9aa53 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0f503bf8bb94af8a2a1139db4e1c0f5, State: Initialized, Role: FOLLOWER
I20260709 13:09:13.469383 24420 consensus_queue.cc:1048] T 47fcd2aa8e994186872c2e0f9995dd8a P f8d4657116f948038a0c73018238c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:13.473312 24360 consensus_queue.cc:260] T de5786fbd53646a9bc152ac0a2a9aa53 P c0f503bf8bb94af8a2a1139db4e1c0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:13.477015 24360 ts_tablet_manager.cc:1434] T de5786fbd53646a9bc152ac0a2a9aa53 P c0f503bf8bb94af8a2a1139db4e1c0f5: Time spent starting tablet: real 0.050s	user 0.007s	sys 0.000s
W20260709 13:09:13.477861 24206 leader_election.cc:343] T ee2c640a38d44afebd95dfec0e30b0d6 P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:13.478813 24360 tablet_bootstrap.cc:492] T 7da69453741f4b73a0092f56f29b1000 P c0f503bf8bb94af8a2a1139db4e1c0f5: Bootstrap starting.
I20260709 13:09:13.491405 24473 raft_consensus.cc:515] T 95774511405b4ed8aadbab3d362c068e P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:13.501216 24089 raft_consensus.cc:2468] T d17a6bbfc9d8478988b08964765c3b86 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0f503bf8bb94af8a2a1139db4e1c0f5 in term 1.
I20260709 13:09:13.502099 24361 tablet_bootstrap.cc:492] T 9a126a61cad843b4a3b34fac0f85a1d2 P f8d4657116f948038a0c73018238c3ba: Bootstrap starting.
I20260709 13:09:13.502847 24091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2c640a38d44afebd95dfec0e30b0d6" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dea34817fcc148d78f090ef5fa72304f" is_pre_election: true
I20260709 13:09:13.503661 24359 tablet_bootstrap.cc:492] T 9acec0d1a6e74a4bb39a0d867598acc5 P dea34817fcc148d78f090ef5fa72304f: Bootstrap starting.
I20260709 13:09:13.492552 24090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99078769583e49908dd6990f1d806453" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dea34817fcc148d78f090ef5fa72304f" is_pre_election: true
I20260709 13:09:13.518483 24090 raft_consensus.cc:2468] T 99078769583e49908dd6990f1d806453 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8d4657116f948038a0c73018238c3ba in term 0.
W20260709 13:09:13.524668 24206 leader_election.cc:343] T ee2c640a38d44afebd95dfec0e30b0d6 P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:13.525200 24206 leader_election.cc:304] T ee2c640a38d44afebd95dfec0e30b0d6 P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8d4657116f948038a0c73018238c3ba; no voters: c0f503bf8bb94af8a2a1139db4e1c0f5, dea34817fcc148d78f090ef5fa72304f
I20260709 13:09:13.527566 24453 raft_consensus.cc:2749] T ee2c640a38d44afebd95dfec0e30b0d6 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:13.530490 24444 consensus_queue.cc:1048] T 93e868a924d74bbc8bf29aa5a7fc67fd P c0f503bf8bb94af8a2a1139db4e1c0f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:13.531203 24419 consensus_queue.cc:1048] T 1541f6b04d914d10823ad78c03d9a847 P dea34817fcc148d78f090ef5fa72304f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:13.509124 24362 tablet_bootstrap.cc:492] T e335cd6afc4349cfaafa2970bccb40ff P b39c386162de49aca92dbebee7f06ace: No bootstrap required, opened a new log
I20260709 13:09:13.512123 24236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f662efc86a73450cac065505b63cb883" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8d4657116f948038a0c73018238c3ba" is_pre_election: true
W20260709 13:09:13.509337 24204 leader_election.cc:343] T 99078769583e49908dd6990f1d806453 P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:13.508152 24310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f662efc86a73450cac065505b63cb883" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace" is_pre_election: true
I20260709 13:09:13.536803 24362 ts_tablet_manager.cc:1403] T e335cd6afc4349cfaafa2970bccb40ff P b39c386162de49aca92dbebee7f06ace: Time spent bootstrapping tablet: real 0.338s	user 0.020s	sys 0.051s
I20260709 13:09:13.536475 24361 tablet_bootstrap.cc:654] T 9a126a61cad843b4a3b34fac0f85a1d2 P f8d4657116f948038a0c73018238c3ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:13.548965 24473 leader_election.cc:290] T 95774511405b4ed8aadbab3d362c068e P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 1 election: Requested vote from peers c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431), f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171)
I20260709 13:09:13.549480 24236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95774511405b4ed8aadbab3d362c068e" candidate_uuid: "b39c386162de49aca92dbebee7f06ace" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8d4657116f948038a0c73018238c3ba"
I20260709 13:09:13.548967 24163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95774511405b4ed8aadbab3d362c068e" candidate_uuid: "b39c386162de49aca92dbebee7f06ace" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5"
I20260709 13:09:13.550535 24236 raft_consensus.cc:3060] T 95774511405b4ed8aadbab3d362c068e P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:13.555783 24359 tablet_bootstrap.cc:654] T 9acec0d1a6e74a4bb39a0d867598acc5 P dea34817fcc148d78f090ef5fa72304f: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:13.560966 24311 raft_consensus.cc:2393] T 95774511405b4ed8aadbab3d362c068e P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0f503bf8bb94af8a2a1139db4e1c0f5 in current term 1: Already voted for candidate b39c386162de49aca92dbebee7f06ace in this term.
W20260709 13:09:13.566368 24055 leader_election.cc:343] T f662efc86a73450cac065505b63cb883 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:13.570312 24362 raft_consensus.cc:359] T e335cd6afc4349cfaafa2970bccb40ff P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:13.571641 24362 raft_consensus.cc:385] T e335cd6afc4349cfaafa2970bccb40ff P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:13.571923 24362 raft_consensus.cc:740] T e335cd6afc4349cfaafa2970bccb40ff P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b39c386162de49aca92dbebee7f06ace, State: Initialized, Role: FOLLOWER
I20260709 13:09:13.572549 24362 consensus_queue.cc:260] T e335cd6afc4349cfaafa2970bccb40ff P b39c386162de49aca92dbebee7f06ace [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:13.580597 24132 leader_election.cc:304] T d17a6bbfc9d8478988b08964765c3b86 P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0f503bf8bb94af8a2a1139db4e1c0f5, dea34817fcc148d78f090ef5fa72304f; no voters: 
I20260709 13:09:13.581691 24444 raft_consensus.cc:2804] T d17a6bbfc9d8478988b08964765c3b86 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:13.582286 24444 raft_consensus.cc:697] T d17a6bbfc9d8478988b08964765c3b86 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 LEADER]: Becoming Leader. State: Replica: c0f503bf8bb94af8a2a1139db4e1c0f5, State: Running, Role: LEADER
I20260709 13:09:13.583189 24206 leader_election.cc:304] T 99078769583e49908dd6990f1d806453 P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dea34817fcc148d78f090ef5fa72304f, f8d4657116f948038a0c73018238c3ba; no voters: b39c386162de49aca92dbebee7f06ace
I20260709 13:09:13.583402 24444 consensus_queue.cc:237] T d17a6bbfc9d8478988b08964765c3b86 P c0f503bf8bb94af8a2a1139db4e1c0f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
W20260709 13:09:13.584292 24206 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:36343, user_credentials={real_user=slave}} blocked reactor thread for 57905.2us
I20260709 13:09:13.585269 24420 raft_consensus.cc:2804] T 99078769583e49908dd6990f1d806453 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:13.585669 24420 raft_consensus.cc:493] T 99078769583e49908dd6990f1d806453 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:13.586006 24420 raft_consensus.cc:3060] T 99078769583e49908dd6990f1d806453 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:13.591949 24502 raft_consensus.cc:493] T de5786fbd53646a9bc152ac0a2a9aa53 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.592594 24502 raft_consensus.cc:515] T de5786fbd53646a9bc152ac0a2a9aa53 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:13.596400 24239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5786fbd53646a9bc152ac0a2a9aa53" candidate_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8d4657116f948038a0c73018238c3ba" is_pre_election: true
I20260709 13:09:13.599319 24445 consensus_queue.cc:1048] T 93e868a924d74bbc8bf29aa5a7fc67fd P c0f503bf8bb94af8a2a1139db4e1c0f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:13.599718 24314 raft_consensus.cc:2468] T d17a6bbfc9d8478988b08964765c3b86 P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0f503bf8bb94af8a2a1139db4e1c0f5 in term 1.
I20260709 13:09:13.603044 24502 leader_election.cc:290] T de5786fbd53646a9bc152ac0a2a9aa53 P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171), dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343)
I20260709 13:09:13.604794 24090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5786fbd53646a9bc152ac0a2a9aa53" candidate_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dea34817fcc148d78f090ef5fa72304f" is_pre_election: true
I20260709 13:09:13.605240 24236 raft_consensus.cc:2468] T 95774511405b4ed8aadbab3d362c068e P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b39c386162de49aca92dbebee7f06ace in term 1.
I20260709 13:09:13.606686 24132 leader_election.cc:304] T de5786fbd53646a9bc152ac0a2a9aa53 P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0f503bf8bb94af8a2a1139db4e1c0f5; no voters: dea34817fcc148d78f090ef5fa72304f, f8d4657116f948038a0c73018238c3ba
I20260709 13:09:13.606998 24279 leader_election.cc:304] T 95774511405b4ed8aadbab3d362c068e P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b39c386162de49aca92dbebee7f06ace, f8d4657116f948038a0c73018238c3ba; no voters: 
W20260709 13:09:13.609449 24056 leader_election.cc:343] T f662efc86a73450cac065505b63cb883 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:13.610049 24056 leader_election.cc:304] T f662efc86a73450cac065505b63cb883 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dea34817fcc148d78f090ef5fa72304f; no voters: b39c386162de49aca92dbebee7f06ace, f8d4657116f948038a0c73018238c3ba
I20260709 13:09:13.610623 24502 raft_consensus.cc:2749] T de5786fbd53646a9bc152ac0a2a9aa53 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:13.613792 24368 raft_consensus.cc:2749] T f662efc86a73450cac065505b63cb883 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:13.614462 24473 raft_consensus.cc:2804] T 95774511405b4ed8aadbab3d362c068e P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:13.626962 24362 ts_tablet_manager.cc:1434] T e335cd6afc4349cfaafa2970bccb40ff P b39c386162de49aca92dbebee7f06ace: Time spent starting tablet: real 0.087s	user 0.006s	sys 0.002s
I20260709 13:09:13.626850 24473 raft_consensus.cc:697] T 95774511405b4ed8aadbab3d362c068e P b39c386162de49aca92dbebee7f06ace [term 1 LEADER]: Becoming Leader. State: Replica: b39c386162de49aca92dbebee7f06ace, State: Running, Role: LEADER
I20260709 13:09:13.629652 24473 consensus_queue.cc:237] T 95774511405b4ed8aadbab3d362c068e P b39c386162de49aca92dbebee7f06ace [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:13.632722 24512 raft_consensus.cc:515] T 95774511405b4ed8aadbab3d362c068e P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:13.634087 24163 raft_consensus.cc:2393] T 95774511405b4ed8aadbab3d362c068e P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b39c386162de49aca92dbebee7f06ace in current term 1: Already voted for candidate c0f503bf8bb94af8a2a1139db4e1c0f5 in this term.
I20260709 13:09:13.636746 24359 tablet_bootstrap.cc:492] T 9acec0d1a6e74a4bb39a0d867598acc5 P dea34817fcc148d78f090ef5fa72304f: No bootstrap required, opened a new log
I20260709 13:09:13.637337 24359 ts_tablet_manager.cc:1403] T 9acec0d1a6e74a4bb39a0d867598acc5 P dea34817fcc148d78f090ef5fa72304f: Time spent bootstrapping tablet: real 0.174s	user 0.033s	sys 0.026s
I20260709 13:09:13.641620 24314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95774511405b4ed8aadbab3d362c068e" candidate_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace"
I20260709 13:09:13.642125 24359 raft_consensus.cc:359] T 9acec0d1a6e74a4bb39a0d867598acc5 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:13.643290 24359 raft_consensus.cc:385] T 9acec0d1a6e74a4bb39a0d867598acc5 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:13.643600 24359 raft_consensus.cc:740] T 9acec0d1a6e74a4bb39a0d867598acc5 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dea34817fcc148d78f090ef5fa72304f, State: Initialized, Role: FOLLOWER
I20260709 13:09:13.637272 24512 leader_election.cc:290] T 95774511405b4ed8aadbab3d362c068e P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 1 election: Requested vote from peers f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171), b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561)
I20260709 13:09:13.645490 24359 consensus_queue.cc:260] T 9acec0d1a6e74a4bb39a0d867598acc5 P dea34817fcc148d78f090ef5fa72304f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:13.647338 24360 tablet_bootstrap.cc:654] T 7da69453741f4b73a0092f56f29b1000 P c0f503bf8bb94af8a2a1139db4e1c0f5: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:13.645537 24420 raft_consensus.cc:515] T 99078769583e49908dd6990f1d806453 P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:13.648361 24359 ts_tablet_manager.cc:1434] T 9acec0d1a6e74a4bb39a0d867598acc5 P dea34817fcc148d78f090ef5fa72304f: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:09:13.649626 24359 tablet_bootstrap.cc:492] T ee2c640a38d44afebd95dfec0e30b0d6 P dea34817fcc148d78f090ef5fa72304f: Bootstrap starting.
I20260709 13:09:13.650520 24314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99078769583e49908dd6990f1d806453" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace"
I20260709 13:09:13.650866 24089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99078769583e49908dd6990f1d806453" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dea34817fcc148d78f090ef5fa72304f"
I20260709 13:09:13.658535 24236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95774511405b4ed8aadbab3d362c068e" candidate_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8d4657116f948038a0c73018238c3ba"
I20260709 13:09:13.659539 24236 raft_consensus.cc:2393] T 95774511405b4ed8aadbab3d362c068e P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c0f503bf8bb94af8a2a1139db4e1c0f5 in current term 1: Already voted for candidate b39c386162de49aca92dbebee7f06ace in this term.
I20260709 13:09:13.668834 24359 tablet_bootstrap.cc:654] T ee2c640a38d44afebd95dfec0e30b0d6 P dea34817fcc148d78f090ef5fa72304f: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:13.665256 24206 consensus_peers.cc:597] T 861d7d76be4d484a9eb3acf8abffae5f P f8d4657116f948038a0c73018238c3ba -> Peer c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431): Couldn't send request to peer c0f503bf8bb94af8a2a1139db4e1c0f5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:13.663740 24089 raft_consensus.cc:3060] T 99078769583e49908dd6990f1d806453 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:13.673431 24362 tablet_bootstrap.cc:492] T b1d1d7dd508b43489431371c4ece4fa4 P b39c386162de49aca92dbebee7f06ace: Bootstrap starting.
I20260709 13:09:13.665846 24161 raft_consensus.cc:3060] T de5786fbd53646a9bc152ac0a2a9aa53 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:13.677320 24204 leader_election.cc:343] T 99078769583e49908dd6990f1d806453 P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:13.683856 24362 tablet_bootstrap.cc:654] T b1d1d7dd508b43489431371c4ece4fa4 P b39c386162de49aca92dbebee7f06ace: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:13.659547 24420 leader_election.cc:290] T 99078769583e49908dd6990f1d806453 P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 election: Requested vote from peers b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561), dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343)
I20260709 13:09:13.687427 24131 leader_election.cc:304] T 95774511405b4ed8aadbab3d362c068e P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0f503bf8bb94af8a2a1139db4e1c0f5; no voters: b39c386162de49aca92dbebee7f06ace, f8d4657116f948038a0c73018238c3ba
I20260709 13:09:13.691248 24445 raft_consensus.cc:2749] T 95774511405b4ed8aadbab3d362c068e P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:09:13.698081 24089 raft_consensus.cc:2468] T 99078769583e49908dd6990f1d806453 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8d4657116f948038a0c73018238c3ba in term 1.
I20260709 13:09:13.700709 24360 tablet_bootstrap.cc:492] T 7da69453741f4b73a0092f56f29b1000 P c0f503bf8bb94af8a2a1139db4e1c0f5: No bootstrap required, opened a new log
I20260709 13:09:13.703960 24360 ts_tablet_manager.cc:1403] T 7da69453741f4b73a0092f56f29b1000 P c0f503bf8bb94af8a2a1139db4e1c0f5: Time spent bootstrapping tablet: real 0.226s	user 0.012s	sys 0.004s
I20260709 13:09:13.705080 24206 leader_election.cc:304] T 99078769583e49908dd6990f1d806453 P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dea34817fcc148d78f090ef5fa72304f, f8d4657116f948038a0c73018238c3ba; no voters: b39c386162de49aca92dbebee7f06ace
I20260709 13:09:13.705940 24361 tablet_bootstrap.cc:492] T 9a126a61cad843b4a3b34fac0f85a1d2 P f8d4657116f948038a0c73018238c3ba: No bootstrap required, opened a new log
I20260709 13:09:13.706496 24361 ts_tablet_manager.cc:1403] T 9a126a61cad843b4a3b34fac0f85a1d2 P f8d4657116f948038a0c73018238c3ba: Time spent bootstrapping tablet: real 0.235s	user 0.015s	sys 0.001s
I20260709 13:09:13.706382 24420 raft_consensus.cc:2804] T 99078769583e49908dd6990f1d806453 P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:13.708729 24360 raft_consensus.cc:359] T 7da69453741f4b73a0092f56f29b1000 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:13.710419 24420 raft_consensus.cc:697] T 99078769583e49908dd6990f1d806453 P f8d4657116f948038a0c73018238c3ba [term 1 LEADER]: Becoming Leader. State: Replica: f8d4657116f948038a0c73018238c3ba, State: Running, Role: LEADER
I20260709 13:09:13.710632 24360 raft_consensus.cc:385] T 7da69453741f4b73a0092f56f29b1000 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:13.711290 24360 raft_consensus.cc:740] T 7da69453741f4b73a0092f56f29b1000 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0f503bf8bb94af8a2a1139db4e1c0f5, State: Initialized, Role: FOLLOWER
I20260709 13:09:13.711946 24420 consensus_queue.cc:237] T 99078769583e49908dd6990f1d806453 P f8d4657116f948038a0c73018238c3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:13.712580 24360 consensus_queue.cc:260] T 7da69453741f4b73a0092f56f29b1000 P c0f503bf8bb94af8a2a1139db4e1c0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:13.717155 24360 ts_tablet_manager.cc:1434] T 7da69453741f4b73a0092f56f29b1000 P c0f503bf8bb94af8a2a1139db4e1c0f5: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 13:09:13.717836 24361 raft_consensus.cc:359] T 9a126a61cad843b4a3b34fac0f85a1d2 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:13.718765 24361 raft_consensus.cc:385] T 9a126a61cad843b4a3b34fac0f85a1d2 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:13.718948 24360 tablet_bootstrap.cc:492] T 861d7d76be4d484a9eb3acf8abffae5f P c0f503bf8bb94af8a2a1139db4e1c0f5: Bootstrap starting.
I20260709 13:09:13.719146 24361 raft_consensus.cc:740] T 9a126a61cad843b4a3b34fac0f85a1d2 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8d4657116f948038a0c73018238c3ba, State: Initialized, Role: FOLLOWER
I20260709 13:09:13.720214 24361 consensus_queue.cc:260] T 9a126a61cad843b4a3b34fac0f85a1d2 P f8d4657116f948038a0c73018238c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:13.722755 24361 ts_tablet_manager.cc:1434] T 9a126a61cad843b4a3b34fac0f85a1d2 P f8d4657116f948038a0c73018238c3ba: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.001s
I20260709 13:09:13.738058 24360 tablet_bootstrap.cc:654] T 861d7d76be4d484a9eb3acf8abffae5f P c0f503bf8bb94af8a2a1139db4e1c0f5: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:13.739312 23985 catalog_manager.cc:5697] T 9acec0d1a6e74a4bb39a0d867598acc5 P b39c386162de49aca92dbebee7f06ace reported cstate change: term changed from 0 to 1, leader changed from <none> to b39c386162de49aca92dbebee7f06ace (127.14.180.68). New cstate: current_term: 1 leader_uuid: "b39c386162de49aca92dbebee7f06ace" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:13.745348 24359 tablet_bootstrap.cc:492] T ee2c640a38d44afebd95dfec0e30b0d6 P dea34817fcc148d78f090ef5fa72304f: No bootstrap required, opened a new log
I20260709 13:09:13.747042 24359 ts_tablet_manager.cc:1403] T ee2c640a38d44afebd95dfec0e30b0d6 P dea34817fcc148d78f090ef5fa72304f: Time spent bootstrapping tablet: real 0.098s	user 0.012s	sys 0.014s
I20260709 13:09:13.750933 24359 raft_consensus.cc:359] T ee2c640a38d44afebd95dfec0e30b0d6 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:13.751816 24359 raft_consensus.cc:385] T ee2c640a38d44afebd95dfec0e30b0d6 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:13.752169 24359 raft_consensus.cc:740] T ee2c640a38d44afebd95dfec0e30b0d6 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dea34817fcc148d78f090ef5fa72304f, State: Initialized, Role: FOLLOWER
I20260709 13:09:13.752991 24359 consensus_queue.cc:260] T ee2c640a38d44afebd95dfec0e30b0d6 P dea34817fcc148d78f090ef5fa72304f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:13.755465 24359 ts_tablet_manager.cc:1434] T ee2c640a38d44afebd95dfec0e30b0d6 P dea34817fcc148d78f090ef5fa72304f: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.002s
I20260709 13:09:13.756671 24359 tablet_bootstrap.cc:492] T c9b7bd5d439d455a9173478e086439e8 P dea34817fcc148d78f090ef5fa72304f: Bootstrap starting.
I20260709 13:09:13.761109 24361 tablet_bootstrap.cc:492] T e6f709868be149759ecdc073fe125bec P f8d4657116f948038a0c73018238c3ba: Bootstrap starting.
I20260709 13:09:13.762524 24360 tablet_bootstrap.cc:492] T 861d7d76be4d484a9eb3acf8abffae5f P c0f503bf8bb94af8a2a1139db4e1c0f5: No bootstrap required, opened a new log
I20260709 13:09:13.766844 24360 ts_tablet_manager.cc:1403] T 861d7d76be4d484a9eb3acf8abffae5f P c0f503bf8bb94af8a2a1139db4e1c0f5: Time spent bootstrapping tablet: real 0.048s	user 0.023s	sys 0.000s
I20260709 13:09:13.773327 24360 raft_consensus.cc:359] T 861d7d76be4d484a9eb3acf8abffae5f P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:13.774186 24360 raft_consensus.cc:385] T 861d7d76be4d484a9eb3acf8abffae5f P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:13.774482 24360 raft_consensus.cc:740] T 861d7d76be4d484a9eb3acf8abffae5f P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0f503bf8bb94af8a2a1139db4e1c0f5, State: Initialized, Role: FOLLOWER
I20260709 13:09:13.775614 24419 raft_consensus.cc:493] T ee2c640a38d44afebd95dfec0e30b0d6 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.776337 24419 raft_consensus.cc:515] T ee2c640a38d44afebd95dfec0e30b0d6 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:13.779824 24360 consensus_queue.cc:260] T 861d7d76be4d484a9eb3acf8abffae5f P c0f503bf8bb94af8a2a1139db4e1c0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:13.783041 24360 ts_tablet_manager.cc:1434] T 861d7d76be4d484a9eb3acf8abffae5f P c0f503bf8bb94af8a2a1139db4e1c0f5: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:09:13.783805 24359 tablet_bootstrap.cc:654] T c9b7bd5d439d455a9173478e086439e8 P dea34817fcc148d78f090ef5fa72304f: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:13.780555 24362 tablet_bootstrap.cc:492] T b1d1d7dd508b43489431371c4ece4fa4 P b39c386162de49aca92dbebee7f06ace: No bootstrap required, opened a new log
I20260709 13:09:13.784708 24361 tablet_bootstrap.cc:654] T e6f709868be149759ecdc073fe125bec P f8d4657116f948038a0c73018238c3ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:13.784499 24420 consensus_queue.cc:1048] T 861d7d76be4d484a9eb3acf8abffae5f P f8d4657116f948038a0c73018238c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:13.784545 24362 ts_tablet_manager.cc:1403] T b1d1d7dd508b43489431371c4ece4fa4 P b39c386162de49aca92dbebee7f06ace: Time spent bootstrapping tablet: real 0.111s	user 0.022s	sys 0.018s
I20260709 13:09:13.791010 24362 raft_consensus.cc:359] T b1d1d7dd508b43489431371c4ece4fa4 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:13.792527 24362 raft_consensus.cc:385] T b1d1d7dd508b43489431371c4ece4fa4 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:13.792943 24362 raft_consensus.cc:740] T b1d1d7dd508b43489431371c4ece4fa4 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b39c386162de49aca92dbebee7f06ace, State: Initialized, Role: FOLLOWER
I20260709 13:09:13.792191 24360 tablet_bootstrap.cc:492] T ee2c640a38d44afebd95dfec0e30b0d6 P c0f503bf8bb94af8a2a1139db4e1c0f5: Bootstrap starting.
I20260709 13:09:13.793905 24361 tablet_bootstrap.cc:492] T e6f709868be149759ecdc073fe125bec P f8d4657116f948038a0c73018238c3ba: No bootstrap required, opened a new log
I20260709 13:09:13.794484 24361 ts_tablet_manager.cc:1403] T e6f709868be149759ecdc073fe125bec P f8d4657116f948038a0c73018238c3ba: Time spent bootstrapping tablet: real 0.034s	user 0.012s	sys 0.003s
I20260709 13:09:13.797679 24361 raft_consensus.cc:359] T e6f709868be149759ecdc073fe125bec P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:13.800135 24361 raft_consensus.cc:385] T e6f709868be149759ecdc073fe125bec P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:13.790159 23987 catalog_manager.cc:5697] T 861d7d76be4d484a9eb3acf8abffae5f P f8d4657116f948038a0c73018238c3ba reported cstate change: term changed from 0 to 1, leader changed from <none> to f8d4657116f948038a0c73018238c3ba (127.14.180.67). New cstate: current_term: 1 leader_uuid: "f8d4657116f948038a0c73018238c3ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:13.800732 24361 raft_consensus.cc:740] T e6f709868be149759ecdc073fe125bec P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8d4657116f948038a0c73018238c3ba, State: Initialized, Role: FOLLOWER
I20260709 13:09:13.801604 24361 consensus_queue.cc:260] T e6f709868be149759ecdc073fe125bec P f8d4657116f948038a0c73018238c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:13.802264 24359 tablet_bootstrap.cc:492] T c9b7bd5d439d455a9173478e086439e8 P dea34817fcc148d78f090ef5fa72304f: No bootstrap required, opened a new log
I20260709 13:09:13.802938 24359 ts_tablet_manager.cc:1403] T c9b7bd5d439d455a9173478e086439e8 P dea34817fcc148d78f090ef5fa72304f: Time spent bootstrapping tablet: real 0.047s	user 0.017s	sys 0.007s
I20260709 13:09:13.804132 24361 ts_tablet_manager.cc:1434] T e6f709868be149759ecdc073fe125bec P f8d4657116f948038a0c73018238c3ba: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.003s
I20260709 13:09:13.804860 24360 tablet_bootstrap.cc:654] T ee2c640a38d44afebd95dfec0e30b0d6 P c0f503bf8bb94af8a2a1139db4e1c0f5: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:13.805696 24361 tablet_bootstrap.cc:492] T 1cefd1de9d9a4839b200c2472b3aeefc P f8d4657116f948038a0c73018238c3ba: Bootstrap starting.
I20260709 13:09:13.806241 24359 raft_consensus.cc:359] T c9b7bd5d439d455a9173478e086439e8 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:13.807117 24359 raft_consensus.cc:385] T c9b7bd5d439d455a9173478e086439e8 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:13.807453 24359 raft_consensus.cc:740] T c9b7bd5d439d455a9173478e086439e8 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dea34817fcc148d78f090ef5fa72304f, State: Initialized, Role: FOLLOWER
I20260709 13:09:13.808418 24359 consensus_queue.cc:260] T c9b7bd5d439d455a9173478e086439e8 P dea34817fcc148d78f090ef5fa72304f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:13.809737 24419 leader_election.cc:290] T ee2c640a38d44afebd95dfec0e30b0d6 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431), f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171)
I20260709 13:09:13.780767 24236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2c640a38d44afebd95dfec0e30b0d6" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8d4657116f948038a0c73018238c3ba" is_pre_election: true
I20260709 13:09:13.810859 24359 ts_tablet_manager.cc:1434] T c9b7bd5d439d455a9173478e086439e8 P dea34817fcc148d78f090ef5fa72304f: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:09:13.810853 24236 raft_consensus.cc:2468] T ee2c640a38d44afebd95dfec0e30b0d6 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dea34817fcc148d78f090ef5fa72304f in term 0.
I20260709 13:09:13.799046 24362 consensus_queue.cc:260] T b1d1d7dd508b43489431371c4ece4fa4 P b39c386162de49aca92dbebee7f06ace [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:13.812367 24359 tablet_bootstrap.cc:492] T e845188d32d2466a92eacdb66da16dba P dea34817fcc148d78f090ef5fa72304f: Bootstrap starting.
I20260709 13:09:13.813508 24362 ts_tablet_manager.cc:1434] T b1d1d7dd508b43489431371c4ece4fa4 P b39c386162de49aca92dbebee7f06ace: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 13:09:13.814733 24361 tablet_bootstrap.cc:654] T 1cefd1de9d9a4839b200c2472b3aeefc P f8d4657116f948038a0c73018238c3ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:13.815512 24362 tablet_bootstrap.cc:492] T 9a126a61cad843b4a3b34fac0f85a1d2 P b39c386162de49aca92dbebee7f06ace: Bootstrap starting.
I20260709 13:09:13.819355 24360 tablet_bootstrap.cc:492] T ee2c640a38d44afebd95dfec0e30b0d6 P c0f503bf8bb94af8a2a1139db4e1c0f5: No bootstrap required, opened a new log
I20260709 13:09:13.819870 24359 tablet_bootstrap.cc:654] T e845188d32d2466a92eacdb66da16dba P dea34817fcc148d78f090ef5fa72304f: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:13.820348 24360 ts_tablet_manager.cc:1403] T ee2c640a38d44afebd95dfec0e30b0d6 P c0f503bf8bb94af8a2a1139db4e1c0f5: Time spent bootstrapping tablet: real 0.036s	user 0.015s	sys 0.005s
I20260709 13:09:13.823065 24056 leader_election.cc:304] T ee2c640a38d44afebd95dfec0e30b0d6 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dea34817fcc148d78f090ef5fa72304f, f8d4657116f948038a0c73018238c3ba; no voters: 
I20260709 13:09:13.825498 24368 raft_consensus.cc:2804] T ee2c640a38d44afebd95dfec0e30b0d6 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:13.826143 24368 raft_consensus.cc:493] T ee2c640a38d44afebd95dfec0e30b0d6 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:13.827538 24368 raft_consensus.cc:3060] T ee2c640a38d44afebd95dfec0e30b0d6 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:13.831447 24161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2c640a38d44afebd95dfec0e30b0d6" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" is_pre_election: true
I20260709 13:09:13.835471 24494 raft_consensus.cc:493] T 9acec0d1a6e74a4bb39a0d867598acc5 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.836354 24494 raft_consensus.cc:515] T 9acec0d1a6e74a4bb39a0d867598acc5 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:13.842073 24165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9acec0d1a6e74a4bb39a0d867598acc5" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" is_pre_election: true
I20260709 13:09:13.847132 24314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9acec0d1a6e74a4bb39a0d867598acc5" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace" is_pre_election: true
I20260709 13:09:13.850102 24055 leader_election.cc:304] T 9acec0d1a6e74a4bb39a0d867598acc5 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dea34817fcc148d78f090ef5fa72304f; no voters: b39c386162de49aca92dbebee7f06ace, c0f503bf8bb94af8a2a1139db4e1c0f5
I20260709 13:09:13.855891 24419 raft_consensus.cc:2749] T 9acec0d1a6e74a4bb39a0d867598acc5 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:13.857959 24091 raft_consensus.cc:3060] T 9acec0d1a6e74a4bb39a0d867598acc5 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:13.862862 24362 tablet_bootstrap.cc:654] T 9a126a61cad843b4a3b34fac0f85a1d2 P b39c386162de49aca92dbebee7f06ace: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:13.862675 24494 leader_election.cc:290] T 9acec0d1a6e74a4bb39a0d867598acc5 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561), c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431)
I20260709 13:09:13.824532 24360 raft_consensus.cc:359] T ee2c640a38d44afebd95dfec0e30b0d6 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:13.876670 24360 raft_consensus.cc:385] T ee2c640a38d44afebd95dfec0e30b0d6 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:13.877089 24360 raft_consensus.cc:740] T ee2c640a38d44afebd95dfec0e30b0d6 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0f503bf8bb94af8a2a1139db4e1c0f5, State: Initialized, Role: FOLLOWER
I20260709 13:09:13.878403 24314 raft_consensus.cc:3060] T b1d1d7dd508b43489431371c4ece4fa4 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:13.881814 24368 raft_consensus.cc:515] T ee2c640a38d44afebd95dfec0e30b0d6 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:13.897675 24165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2c640a38d44afebd95dfec0e30b0d6" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5"
I20260709 13:09:13.887959 24360 consensus_queue.cc:260] T ee2c640a38d44afebd95dfec0e30b0d6 P c0f503bf8bb94af8a2a1139db4e1c0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:13.899727 24161 raft_consensus.cc:2468] T ee2c640a38d44afebd95dfec0e30b0d6 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dea34817fcc148d78f090ef5fa72304f in term 0.
I20260709 13:09:13.901446 24368 leader_election.cc:290] T ee2c640a38d44afebd95dfec0e30b0d6 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 election: Requested vote from peers c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431), f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171)
I20260709 13:09:13.901734 24236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2c640a38d44afebd95dfec0e30b0d6" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8d4657116f948038a0c73018238c3ba"
I20260709 13:09:13.902415 24236 raft_consensus.cc:3060] T ee2c640a38d44afebd95dfec0e30b0d6 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:13.907680 24453 consensus_queue.cc:1048] T b1d1d7dd508b43489431371c4ece4fa4 P f8d4657116f948038a0c73018238c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:13.919776 23989 catalog_manager.cc:5697] T d17a6bbfc9d8478988b08964765c3b86 P c0f503bf8bb94af8a2a1139db4e1c0f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66). New cstate: current_term: 1 leader_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:13.921665 24473 raft_consensus.cc:493] T e335cd6afc4349cfaafa2970bccb40ff P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.922250 24473 raft_consensus.cc:515] T e335cd6afc4349cfaafa2970bccb40ff P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:13.925534 24473 leader_election.cc:290] T e335cd6afc4349cfaafa2970bccb40ff P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431), f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171)
I20260709 13:09:13.926748 24239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e335cd6afc4349cfaafa2970bccb40ff" candidate_uuid: "b39c386162de49aca92dbebee7f06ace" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8d4657116f948038a0c73018238c3ba" is_pre_election: true
I20260709 13:09:13.930454 24362 tablet_bootstrap.cc:492] T 9a126a61cad843b4a3b34fac0f85a1d2 P b39c386162de49aca92dbebee7f06ace: No bootstrap required, opened a new log
I20260709 13:09:13.931347 24362 ts_tablet_manager.cc:1403] T 9a126a61cad843b4a3b34fac0f85a1d2 P b39c386162de49aca92dbebee7f06ace: Time spent bootstrapping tablet: real 0.116s	user 0.016s	sys 0.010s
I20260709 13:09:13.932574 24236 raft_consensus.cc:2468] T ee2c640a38d44afebd95dfec0e30b0d6 P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dea34817fcc148d78f090ef5fa72304f in term 1.
I20260709 13:09:13.934631 24056 leader_election.cc:304] T ee2c640a38d44afebd95dfec0e30b0d6 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dea34817fcc148d78f090ef5fa72304f, f8d4657116f948038a0c73018238c3ba; no voters: c0f503bf8bb94af8a2a1139db4e1c0f5
W20260709 13:09:13.934827 24279 leader_election.cc:343] T e335cd6afc4349cfaafa2970bccb40ff P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:13.936054 24368 raft_consensus.cc:2804] T ee2c640a38d44afebd95dfec0e30b0d6 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:13.936625 24368 raft_consensus.cc:697] T ee2c640a38d44afebd95dfec0e30b0d6 P dea34817fcc148d78f090ef5fa72304f [term 1 LEADER]: Becoming Leader. State: Replica: dea34817fcc148d78f090ef5fa72304f, State: Running, Role: LEADER
I20260709 13:09:13.938503 24161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e335cd6afc4349cfaafa2970bccb40ff" candidate_uuid: "b39c386162de49aca92dbebee7f06ace" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" is_pre_election: true
I20260709 13:09:13.940932 24368 consensus_queue.cc:237] T ee2c640a38d44afebd95dfec0e30b0d6 P dea34817fcc148d78f090ef5fa72304f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:13.944383 24360 ts_tablet_manager.cc:1434] T ee2c640a38d44afebd95dfec0e30b0d6 P c0f503bf8bb94af8a2a1139db4e1c0f5: Time spent starting tablet: real 0.123s	user 0.007s	sys 0.001s
I20260709 13:09:13.947561 24494 raft_consensus.cc:493] T c9b7bd5d439d455a9173478e086439e8 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.948414 24494 raft_consensus.cc:515] T c9b7bd5d439d455a9173478e086439e8 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:13.951567 24453 consensus_queue.cc:1048] T b1d1d7dd508b43489431371c4ece4fa4 P f8d4657116f948038a0c73018238c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:09:13.955044 24280 leader_election.cc:343] T e335cd6afc4349cfaafa2970bccb40ff P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:13.955757 24280 leader_election.cc:304] T e335cd6afc4349cfaafa2970bccb40ff P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b39c386162de49aca92dbebee7f06ace; no voters: c0f503bf8bb94af8a2a1139db4e1c0f5, f8d4657116f948038a0c73018238c3ba
I20260709 13:09:13.956287 24360 tablet_bootstrap.cc:492] T 9a126a61cad843b4a3b34fac0f85a1d2 P c0f503bf8bb94af8a2a1139db4e1c0f5: Bootstrap starting.
I20260709 13:09:13.956873 24473 raft_consensus.cc:2749] T e335cd6afc4349cfaafa2970bccb40ff P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:13.961975 24494 leader_election.cc:290] T c9b7bd5d439d455a9173478e086439e8 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171), b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561)
I20260709 13:09:13.970291 24314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9b7bd5d439d455a9173478e086439e8" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace" is_pre_election: true
I20260709 13:09:13.974627 24360 tablet_bootstrap.cc:654] T 9a126a61cad843b4a3b34fac0f85a1d2 P c0f503bf8bb94af8a2a1139db4e1c0f5: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:13.980285 24055 leader_election.cc:343] T c9b7bd5d439d455a9173478e086439e8 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:13.985306 24361 tablet_bootstrap.cc:492] T 1cefd1de9d9a4839b200c2472b3aeefc P f8d4657116f948038a0c73018238c3ba: No bootstrap required, opened a new log
I20260709 13:09:13.986079 24361 ts_tablet_manager.cc:1403] T 1cefd1de9d9a4839b200c2472b3aeefc P f8d4657116f948038a0c73018238c3ba: Time spent bootstrapping tablet: real 0.181s	user 0.048s	sys 0.059s
I20260709 13:09:13.976790 24239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9b7bd5d439d455a9173478e086439e8" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8d4657116f948038a0c73018238c3ba" is_pre_election: true
W20260709 13:09:13.992259 24056 leader_election.cc:343] T c9b7bd5d439d455a9173478e086439e8 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:13.992772 24056 leader_election.cc:304] T c9b7bd5d439d455a9173478e086439e8 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dea34817fcc148d78f090ef5fa72304f; no voters: b39c386162de49aca92dbebee7f06ace, f8d4657116f948038a0c73018238c3ba
I20260709 13:09:13.993921 24368 raft_consensus.cc:2749] T c9b7bd5d439d455a9173478e086439e8 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:13.997489 24361 raft_consensus.cc:359] T 1cefd1de9d9a4839b200c2472b3aeefc P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:13.997973 24453 raft_consensus.cc:493] T e6f709868be149759ecdc073fe125bec P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.998464 24453 raft_consensus.cc:515] T e6f709868be149759ecdc073fe125bec P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:14.000730 24453 leader_election.cc:290] T e6f709868be149759ecdc073fe125bec P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343), c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431)
I20260709 13:09:14.000396 23987 catalog_manager.cc:5697] T 99078769583e49908dd6990f1d806453 P f8d4657116f948038a0c73018238c3ba reported cstate change: term changed from 0 to 1, leader changed from <none> to f8d4657116f948038a0c73018238c3ba (127.14.180.67). New cstate: current_term: 1 leader_uuid: "f8d4657116f948038a0c73018238c3ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:14.002507 23987 catalog_manager.cc:5697] T b1d1d7dd508b43489431371c4ece4fa4 P f8d4657116f948038a0c73018238c3ba reported cstate change: term changed from 0 to 1, leader changed from <none> to f8d4657116f948038a0c73018238c3ba (127.14.180.67). New cstate: current_term: 1 leader_uuid: "f8d4657116f948038a0c73018238c3ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:14.003407 24089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f709868be149759ecdc073fe125bec" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dea34817fcc148d78f090ef5fa72304f" is_pre_election: true
I20260709 13:09:13.998333 24361 raft_consensus.cc:385] T 1cefd1de9d9a4839b200c2472b3aeefc P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:14.004297 24361 raft_consensus.cc:740] T 1cefd1de9d9a4839b200c2472b3aeefc P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8d4657116f948038a0c73018238c3ba, State: Initialized, Role: FOLLOWER
I20260709 13:09:14.004806 24161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f709868be149759ecdc073fe125bec" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" is_pre_election: true
I20260709 13:09:14.007118 24359 tablet_bootstrap.cc:492] T e845188d32d2466a92eacdb66da16dba P dea34817fcc148d78f090ef5fa72304f: No bootstrap required, opened a new log
I20260709 13:09:14.007711 24359 ts_tablet_manager.cc:1403] T e845188d32d2466a92eacdb66da16dba P dea34817fcc148d78f090ef5fa72304f: Time spent bootstrapping tablet: real 0.196s	user 0.048s	sys 0.092s
I20260709 13:09:14.009879 24362 raft_consensus.cc:359] T 9a126a61cad843b4a3b34fac0f85a1d2 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:14.010689 24362 raft_consensus.cc:385] T 9a126a61cad843b4a3b34fac0f85a1d2 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:14.010456 24359 raft_consensus.cc:359] T e845188d32d2466a92eacdb66da16dba P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:14.010999 24362 raft_consensus.cc:740] T 9a126a61cad843b4a3b34fac0f85a1d2 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b39c386162de49aca92dbebee7f06ace, State: Initialized, Role: FOLLOWER
I20260709 13:09:14.005120 24361 consensus_queue.cc:260] T 1cefd1de9d9a4839b200c2472b3aeefc P f8d4657116f948038a0c73018238c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
W20260709 13:09:14.011153 24206 leader_election.cc:343] T e6f709868be149759ecdc073fe125bec P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:14.011765 24362 consensus_queue.cc:260] T 9a126a61cad843b4a3b34fac0f85a1d2 P b39c386162de49aca92dbebee7f06ace [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
W20260709 13:09:14.012054 24206 leader_election.cc:343] T e6f709868be149759ecdc073fe125bec P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:14.012624 24206 leader_election.cc:304] T e6f709868be149759ecdc073fe125bec P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8d4657116f948038a0c73018238c3ba; no voters: c0f503bf8bb94af8a2a1139db4e1c0f5, dea34817fcc148d78f090ef5fa72304f
I20260709 13:09:14.012992 24361 ts_tablet_manager.cc:1434] T 1cefd1de9d9a4839b200c2472b3aeefc P f8d4657116f948038a0c73018238c3ba: Time spent starting tablet: real 0.027s	user 0.009s	sys 0.000s
I20260709 13:09:14.011207 24359 raft_consensus.cc:385] T e845188d32d2466a92eacdb66da16dba P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:14.013648 24420 raft_consensus.cc:2749] T e6f709868be149759ecdc073fe125bec P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:14.013916 24359 raft_consensus.cc:740] T e845188d32d2466a92eacdb66da16dba P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dea34817fcc148d78f090ef5fa72304f, State: Initialized, Role: FOLLOWER
I20260709 13:09:14.014185 24361 tablet_bootstrap.cc:492] T c9b7bd5d439d455a9173478e086439e8 P f8d4657116f948038a0c73018238c3ba: Bootstrap starting.
I20260709 13:09:14.014889 24359 consensus_queue.cc:260] T e845188d32d2466a92eacdb66da16dba P dea34817fcc148d78f090ef5fa72304f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:14.017460 24359 ts_tablet_manager.cc:1434] T e845188d32d2466a92eacdb66da16dba P dea34817fcc148d78f090ef5fa72304f: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.002s
I20260709 13:09:14.018036 24362 ts_tablet_manager.cc:1434] T 9a126a61cad843b4a3b34fac0f85a1d2 P b39c386162de49aca92dbebee7f06ace: Time spent starting tablet: real 0.086s	user 0.007s	sys 0.001s
I20260709 13:09:14.018697 24359 tablet_bootstrap.cc:492] T e6f709868be149759ecdc073fe125bec P dea34817fcc148d78f090ef5fa72304f: Bootstrap starting.
I20260709 13:09:14.019225 24362 tablet_bootstrap.cc:492] T 99078769583e49908dd6990f1d806453 P b39c386162de49aca92dbebee7f06ace: Bootstrap starting.
I20260709 13:09:14.020954 24361 tablet_bootstrap.cc:654] T c9b7bd5d439d455a9173478e086439e8 P f8d4657116f948038a0c73018238c3ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:14.025866 24360 tablet_bootstrap.cc:492] T 9a126a61cad843b4a3b34fac0f85a1d2 P c0f503bf8bb94af8a2a1139db4e1c0f5: No bootstrap required, opened a new log
I20260709 13:09:14.026393 24360 ts_tablet_manager.cc:1403] T 9a126a61cad843b4a3b34fac0f85a1d2 P c0f503bf8bb94af8a2a1139db4e1c0f5: Time spent bootstrapping tablet: real 0.070s	user 0.012s	sys 0.000s
I20260709 13:09:14.029219 24360 raft_consensus.cc:359] T 9a126a61cad843b4a3b34fac0f85a1d2 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:14.029929 24360 raft_consensus.cc:385] T 9a126a61cad843b4a3b34fac0f85a1d2 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:14.030200 24360 raft_consensus.cc:740] T 9a126a61cad843b4a3b34fac0f85a1d2 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0f503bf8bb94af8a2a1139db4e1c0f5, State: Initialized, Role: FOLLOWER
I20260709 13:09:14.031000 24360 consensus_queue.cc:260] T 9a126a61cad843b4a3b34fac0f85a1d2 P c0f503bf8bb94af8a2a1139db4e1c0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:14.032037 23985 catalog_manager.cc:5697] T 95774511405b4ed8aadbab3d362c068e P b39c386162de49aca92dbebee7f06ace reported cstate change: term changed from 0 to 1, leader changed from <none> to b39c386162de49aca92dbebee7f06ace (127.14.180.68). New cstate: current_term: 1 leader_uuid: "b39c386162de49aca92dbebee7f06ace" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:14.033653 24360 ts_tablet_manager.cc:1434] T 9a126a61cad843b4a3b34fac0f85a1d2 P c0f503bf8bb94af8a2a1139db4e1c0f5: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:09:14.034806 24360 tablet_bootstrap.cc:492] T e335cd6afc4349cfaafa2970bccb40ff P c0f503bf8bb94af8a2a1139db4e1c0f5: Bootstrap starting.
I20260709 13:09:14.040424 24359 tablet_bootstrap.cc:654] T e6f709868be149759ecdc073fe125bec P dea34817fcc148d78f090ef5fa72304f: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:14.046154 24360 tablet_bootstrap.cc:654] T e335cd6afc4349cfaafa2970bccb40ff P c0f503bf8bb94af8a2a1139db4e1c0f5: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:14.056855 24360 tablet_bootstrap.cc:492] T e335cd6afc4349cfaafa2970bccb40ff P c0f503bf8bb94af8a2a1139db4e1c0f5: No bootstrap required, opened a new log
I20260709 13:09:14.057375 24360 ts_tablet_manager.cc:1403] T e335cd6afc4349cfaafa2970bccb40ff P c0f503bf8bb94af8a2a1139db4e1c0f5: Time spent bootstrapping tablet: real 0.023s	user 0.003s	sys 0.007s
I20260709 13:09:14.061793 23986 catalog_manager.cc:5697] T ee2c640a38d44afebd95dfec0e30b0d6 P dea34817fcc148d78f090ef5fa72304f reported cstate change: term changed from 0 to 1, leader changed from <none> to dea34817fcc148d78f090ef5fa72304f (127.14.180.65). New cstate: current_term: 1 leader_uuid: "dea34817fcc148d78f090ef5fa72304f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:14.062851 24360 raft_consensus.cc:359] T e335cd6afc4349cfaafa2970bccb40ff P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:14.063575 24360 raft_consensus.cc:385] T e335cd6afc4349cfaafa2970bccb40ff P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:14.063840 24360 raft_consensus.cc:740] T e335cd6afc4349cfaafa2970bccb40ff P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0f503bf8bb94af8a2a1139db4e1c0f5, State: Initialized, Role: FOLLOWER
I20260709 13:09:14.064553 24360 consensus_queue.cc:260] T e335cd6afc4349cfaafa2970bccb40ff P c0f503bf8bb94af8a2a1139db4e1c0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:14.071843 24360 ts_tablet_manager.cc:1434] T e335cd6afc4349cfaafa2970bccb40ff P c0f503bf8bb94af8a2a1139db4e1c0f5: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 13:09:14.073700 24362 tablet_bootstrap.cc:654] T 99078769583e49908dd6990f1d806453 P b39c386162de49aca92dbebee7f06ace: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:14.073092 24360 tablet_bootstrap.cc:492] T 1cefd1de9d9a4839b200c2472b3aeefc P c0f503bf8bb94af8a2a1139db4e1c0f5: Bootstrap starting.
I20260709 13:09:14.082832 24359 tablet_bootstrap.cc:492] T e6f709868be149759ecdc073fe125bec P dea34817fcc148d78f090ef5fa72304f: No bootstrap required, opened a new log
I20260709 13:09:14.083384 24359 ts_tablet_manager.cc:1403] T e6f709868be149759ecdc073fe125bec P dea34817fcc148d78f090ef5fa72304f: Time spent bootstrapping tablet: real 0.065s	user 0.014s	sys 0.009s
I20260709 13:09:14.084759 24362 tablet_bootstrap.cc:492] T 99078769583e49908dd6990f1d806453 P b39c386162de49aca92dbebee7f06ace: No bootstrap required, opened a new log
I20260709 13:09:14.085523 24362 ts_tablet_manager.cc:1403] T 99078769583e49908dd6990f1d806453 P b39c386162de49aca92dbebee7f06ace: Time spent bootstrapping tablet: real 0.067s	user 0.013s	sys 0.000s
I20260709 13:09:14.086323 24359 raft_consensus.cc:359] T e6f709868be149759ecdc073fe125bec P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:14.087172 24359 raft_consensus.cc:385] T e6f709868be149759ecdc073fe125bec P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:14.087456 24359 raft_consensus.cc:740] T e6f709868be149759ecdc073fe125bec P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dea34817fcc148d78f090ef5fa72304f, State: Initialized, Role: FOLLOWER
I20260709 13:09:14.088217 24359 consensus_queue.cc:260] T e6f709868be149759ecdc073fe125bec P dea34817fcc148d78f090ef5fa72304f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:14.090741 24359 ts_tablet_manager.cc:1434] T e6f709868be149759ecdc073fe125bec P dea34817fcc148d78f090ef5fa72304f: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:09:14.091897 24359 tablet_bootstrap.cc:492] T 5bc4e407c8b04739aa0290922bfdbed4 P dea34817fcc148d78f090ef5fa72304f: Bootstrap starting.
I20260709 13:09:14.098753 24360 tablet_bootstrap.cc:654] T 1cefd1de9d9a4839b200c2472b3aeefc P c0f503bf8bb94af8a2a1139db4e1c0f5: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:14.098124 24362 raft_consensus.cc:359] T 99078769583e49908dd6990f1d806453 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:14.099325 24362 raft_consensus.cc:385] T 99078769583e49908dd6990f1d806453 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:14.099781 24362 raft_consensus.cc:740] T 99078769583e49908dd6990f1d806453 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b39c386162de49aca92dbebee7f06ace, State: Initialized, Role: FOLLOWER
I20260709 13:09:14.100838 24362 consensus_queue.cc:260] T 99078769583e49908dd6990f1d806453 P b39c386162de49aca92dbebee7f06ace [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:14.102659 24359 tablet_bootstrap.cc:654] T 5bc4e407c8b04739aa0290922bfdbed4 P dea34817fcc148d78f090ef5fa72304f: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:14.104467 24362 ts_tablet_manager.cc:1434] T 99078769583e49908dd6990f1d806453 P b39c386162de49aca92dbebee7f06ace: Time spent starting tablet: real 0.019s	user 0.011s	sys 0.000s
I20260709 13:09:14.108520 24453 raft_consensus.cc:493] T 9a126a61cad843b4a3b34fac0f85a1d2 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.109439 24453 raft_consensus.cc:515] T 9a126a61cad843b4a3b34fac0f85a1d2 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:14.112202 24360 tablet_bootstrap.cc:492] T 1cefd1de9d9a4839b200c2472b3aeefc P c0f503bf8bb94af8a2a1139db4e1c0f5: No bootstrap required, opened a new log
I20260709 13:09:14.112721 24360 ts_tablet_manager.cc:1403] T 1cefd1de9d9a4839b200c2472b3aeefc P c0f503bf8bb94af8a2a1139db4e1c0f5: Time spent bootstrapping tablet: real 0.040s	user 0.003s	sys 0.011s
I20260709 13:09:14.115732 24360 raft_consensus.cc:359] T 1cefd1de9d9a4839b200c2472b3aeefc P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:14.116509 24360 raft_consensus.cc:385] T 1cefd1de9d9a4839b200c2472b3aeefc P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:14.116793 24360 raft_consensus.cc:740] T 1cefd1de9d9a4839b200c2472b3aeefc P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0f503bf8bb94af8a2a1139db4e1c0f5, State: Initialized, Role: FOLLOWER
I20260709 13:09:14.119509 24359 tablet_bootstrap.cc:492] T 5bc4e407c8b04739aa0290922bfdbed4 P dea34817fcc148d78f090ef5fa72304f: No bootstrap required, opened a new log
I20260709 13:09:14.120110 24359 ts_tablet_manager.cc:1403] T 5bc4e407c8b04739aa0290922bfdbed4 P dea34817fcc148d78f090ef5fa72304f: Time spent bootstrapping tablet: real 0.028s	user 0.006s	sys 0.004s
I20260709 13:09:14.119798 24161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a126a61cad843b4a3b34fac0f85a1d2" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" is_pre_election: true
I20260709 13:09:14.120945 24161 raft_consensus.cc:2468] T 9a126a61cad843b4a3b34fac0f85a1d2 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8d4657116f948038a0c73018238c3ba in term 0.
I20260709 13:09:14.122865 24360 consensus_queue.cc:260] T 1cefd1de9d9a4839b200c2472b3aeefc P c0f503bf8bb94af8a2a1139db4e1c0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:14.122973 24206 leader_election.cc:304] T 9a126a61cad843b4a3b34fac0f85a1d2 P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0f503bf8bb94af8a2a1139db4e1c0f5, f8d4657116f948038a0c73018238c3ba; no voters: 
I20260709 13:09:14.124423 24396 raft_consensus.cc:2804] T 9a126a61cad843b4a3b34fac0f85a1d2 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:14.124878 24396 raft_consensus.cc:493] T 9a126a61cad843b4a3b34fac0f85a1d2 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:14.124986 24359 raft_consensus.cc:359] T 5bc4e407c8b04739aa0290922bfdbed4 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:14.125830 24359 raft_consensus.cc:385] T 5bc4e407c8b04739aa0290922bfdbed4 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:14.126137 24359 raft_consensus.cc:740] T 5bc4e407c8b04739aa0290922bfdbed4 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dea34817fcc148d78f090ef5fa72304f, State: Initialized, Role: FOLLOWER
I20260709 13:09:14.126880 24359 consensus_queue.cc:260] T 5bc4e407c8b04739aa0290922bfdbed4 P dea34817fcc148d78f090ef5fa72304f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:14.129612 24360 ts_tablet_manager.cc:1434] T 1cefd1de9d9a4839b200c2472b3aeefc P c0f503bf8bb94af8a2a1139db4e1c0f5: Time spent starting tablet: real 0.017s	user 0.003s	sys 0.006s
I20260709 13:09:14.131026 24360 tablet_bootstrap.cc:492] T 687efb9bbbd04b0eb768bfa6543380c3 P c0f503bf8bb94af8a2a1139db4e1c0f5: Bootstrap starting.
I20260709 13:09:14.125379 24396 raft_consensus.cc:3060] T 9a126a61cad843b4a3b34fac0f85a1d2 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:14.131773 24359 ts_tablet_manager.cc:1434] T 5bc4e407c8b04739aa0290922bfdbed4 P dea34817fcc148d78f090ef5fa72304f: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:09:14.136934 24359 tablet_bootstrap.cc:492] T 687efb9bbbd04b0eb768bfa6543380c3 P dea34817fcc148d78f090ef5fa72304f: Bootstrap starting.
I20260709 13:09:14.142977 24444 raft_consensus.cc:493] T 861d7d76be4d484a9eb3acf8abffae5f P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.143757 24444 raft_consensus.cc:515] T 861d7d76be4d484a9eb3acf8abffae5f P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:14.148182 24359 tablet_bootstrap.cc:654] T 687efb9bbbd04b0eb768bfa6543380c3 P dea34817fcc148d78f090ef5fa72304f: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:14.148593 24444 leader_election.cc:290] T 861d7d76be4d484a9eb3acf8abffae5f P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343), f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171)
I20260709 13:09:14.141968 24473 consensus_queue.cc:1048] T 95774511405b4ed8aadbab3d362c068e P b39c386162de49aca92dbebee7f06ace [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:09:14.161229 24359 tablet_bootstrap.cc:492] T 687efb9bbbd04b0eb768bfa6543380c3 P dea34817fcc148d78f090ef5fa72304f: No bootstrap required, opened a new log
I20260709 13:09:14.162034 24359 ts_tablet_manager.cc:1403] T 687efb9bbbd04b0eb768bfa6543380c3 P dea34817fcc148d78f090ef5fa72304f: Time spent bootstrapping tablet: real 0.025s	user 0.016s	sys 0.000s
I20260709 13:09:14.169142 24360 tablet_bootstrap.cc:654] T 687efb9bbbd04b0eb768bfa6543380c3 P c0f503bf8bb94af8a2a1139db4e1c0f5: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:14.173555 24088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861d7d76be4d484a9eb3acf8abffae5f" candidate_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dea34817fcc148d78f090ef5fa72304f" is_pre_election: true
I20260709 13:09:14.151222 24239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861d7d76be4d484a9eb3acf8abffae5f" candidate_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8d4657116f948038a0c73018238c3ba" is_pre_election: true
I20260709 13:09:14.165699 24359 raft_consensus.cc:359] T 687efb9bbbd04b0eb768bfa6543380c3 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:14.180539 24359 raft_consensus.cc:385] T 687efb9bbbd04b0eb768bfa6543380c3 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:14.176111 24453 leader_election.cc:290] T 9a126a61cad843b4a3b34fac0f85a1d2 P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431), b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561)
I20260709 13:09:14.181030 24359 raft_consensus.cc:740] T 687efb9bbbd04b0eb768bfa6543380c3 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dea34817fcc148d78f090ef5fa72304f, State: Initialized, Role: FOLLOWER
I20260709 13:09:14.182076 24131 leader_election.cc:304] T 861d7d76be4d484a9eb3acf8abffae5f P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0f503bf8bb94af8a2a1139db4e1c0f5; no voters: dea34817fcc148d78f090ef5fa72304f, f8d4657116f948038a0c73018238c3ba
I20260709 13:09:14.182173 24359 consensus_queue.cc:260] T 687efb9bbbd04b0eb768bfa6543380c3 P dea34817fcc148d78f090ef5fa72304f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:14.184355 24445 raft_consensus.cc:493] T 7da69453741f4b73a0092f56f29b1000 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.184893 24359 ts_tablet_manager.cc:1434] T 687efb9bbbd04b0eb768bfa6543380c3 P dea34817fcc148d78f090ef5fa72304f: Time spent starting tablet: real 0.023s	user 0.009s	sys 0.000s
W20260709 13:09:14.185199 24037 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:14.187726 24396 raft_consensus.cc:515] T 9a126a61cad843b4a3b34fac0f85a1d2 P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:14.189661 24359 tablet_bootstrap.cc:492] T 1dcdde5516f54b19b11611ca9213415d P dea34817fcc148d78f090ef5fa72304f: Bootstrap starting.
I20260709 13:09:14.184942 24445 raft_consensus.cc:515] T 7da69453741f4b73a0092f56f29b1000 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:14.189911 24314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a126a61cad843b4a3b34fac0f85a1d2" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace" is_pre_election: true
I20260709 13:09:14.190732 24314 raft_consensus.cc:2468] T 9a126a61cad843b4a3b34fac0f85a1d2 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8d4657116f948038a0c73018238c3ba in term 0.
I20260709 13:09:14.191627 24309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a126a61cad843b4a3b34fac0f85a1d2" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace"
I20260709 13:09:14.192319 24309 raft_consensus.cc:3060] T 9a126a61cad843b4a3b34fac0f85a1d2 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:14.197582 24445 leader_election.cc:290] T 7da69453741f4b73a0092f56f29b1000 P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561), dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343)
I20260709 13:09:14.184890 24362 tablet_bootstrap.cc:492] T f662efc86a73450cac065505b63cb883 P b39c386162de49aca92dbebee7f06ace: Bootstrap starting.
I20260709 13:09:14.200350 24314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da69453741f4b73a0092f56f29b1000" candidate_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace" is_pre_election: true
W20260709 13:09:14.202302 24130 leader_election.cc:343] T 7da69453741f4b73a0092f56f29b1000 P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:14.188443 24563 raft_consensus.cc:2749] T 861d7d76be4d484a9eb3acf8abffae5f P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:14.206933 24165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a126a61cad843b4a3b34fac0f85a1d2" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5"
I20260709 13:09:14.207671 24165 raft_consensus.cc:3060] T 9a126a61cad843b4a3b34fac0f85a1d2 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:14.212916 24563 consensus_queue.cc:1048] T d17a6bbfc9d8478988b08964765c3b86 P c0f503bf8bb94af8a2a1139db4e1c0f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:14.214177 24091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da69453741f4b73a0092f56f29b1000" candidate_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dea34817fcc148d78f090ef5fa72304f" is_pre_election: true
I20260709 13:09:14.215123 24091 raft_consensus.cc:2468] T 7da69453741f4b73a0092f56f29b1000 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0f503bf8bb94af8a2a1139db4e1c0f5 in term 0.
I20260709 13:09:14.216993 24473 consensus_queue.cc:1048] T 95774511405b4ed8aadbab3d362c068e P b39c386162de49aca92dbebee7f06ace [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:14.176084 24361 tablet_bootstrap.cc:492] T c9b7bd5d439d455a9173478e086439e8 P f8d4657116f948038a0c73018238c3ba: No bootstrap required, opened a new log
I20260709 13:09:14.227837 24132 leader_election.cc:304] T 7da69453741f4b73a0092f56f29b1000 P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c0f503bf8bb94af8a2a1139db4e1c0f5, dea34817fcc148d78f090ef5fa72304f; no voters: b39c386162de49aca92dbebee7f06ace
I20260709 13:09:14.227748 24563 consensus_queue.cc:1048] T d17a6bbfc9d8478988b08964765c3b86 P c0f503bf8bb94af8a2a1139db4e1c0f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:14.228775 24445 raft_consensus.cc:493] T e335cd6afc4349cfaafa2970bccb40ff P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.229306 24445 raft_consensus.cc:515] T e335cd6afc4349cfaafa2970bccb40ff P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:14.229700 24563 raft_consensus.cc:2804] T 7da69453741f4b73a0092f56f29b1000 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:14.230118 24563 raft_consensus.cc:493] T 7da69453741f4b73a0092f56f29b1000 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:14.230427 24563 raft_consensus.cc:3060] T 7da69453741f4b73a0092f56f29b1000 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:14.227865 24361 ts_tablet_manager.cc:1403] T c9b7bd5d439d455a9173478e086439e8 P f8d4657116f948038a0c73018238c3ba: Time spent bootstrapping tablet: real 0.214s	user 0.059s	sys 0.088s
I20260709 13:09:14.231909 24445 leader_election.cc:290] T e335cd6afc4349cfaafa2970bccb40ff P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171), b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561)
I20260709 13:09:14.233858 24314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e335cd6afc4349cfaafa2970bccb40ff" candidate_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace" is_pre_election: true
I20260709 13:09:14.234843 24314 raft_consensus.cc:2468] T e335cd6afc4349cfaafa2970bccb40ff P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0f503bf8bb94af8a2a1139db4e1c0f5 in term 0.
I20260709 13:09:14.239259 24165 raft_consensus.cc:2468] T 9a126a61cad843b4a3b34fac0f85a1d2 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8d4657116f948038a0c73018238c3ba in term 1.
I20260709 13:09:14.240736 24130 leader_election.cc:304] T e335cd6afc4349cfaafa2970bccb40ff P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b39c386162de49aca92dbebee7f06ace, c0f503bf8bb94af8a2a1139db4e1c0f5; no voters: 
I20260709 13:09:14.241952 24445 raft_consensus.cc:2804] T e335cd6afc4349cfaafa2970bccb40ff P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:14.242364 24239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e335cd6afc4349cfaafa2970bccb40ff" candidate_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8d4657116f948038a0c73018238c3ba" is_pre_election: true
I20260709 13:09:14.242686 24445 raft_consensus.cc:493] T e335cd6afc4349cfaafa2970bccb40ff P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:14.244050 24362 tablet_bootstrap.cc:654] T f662efc86a73450cac065505b63cb883 P b39c386162de49aca92dbebee7f06ace: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:14.244289 24445 raft_consensus.cc:3060] T e335cd6afc4349cfaafa2970bccb40ff P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:14.248395 24359 tablet_bootstrap.cc:654] T 1dcdde5516f54b19b11611ca9213415d P dea34817fcc148d78f090ef5fa72304f: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:14.235803 24361 raft_consensus.cc:359] T c9b7bd5d439d455a9173478e086439e8 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:14.249681 24361 raft_consensus.cc:385] T c9b7bd5d439d455a9173478e086439e8 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:14.250062 24361 raft_consensus.cc:740] T c9b7bd5d439d455a9173478e086439e8 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8d4657116f948038a0c73018238c3ba, State: Initialized, Role: FOLLOWER
I20260709 13:09:14.250888 24361 consensus_queue.cc:260] T c9b7bd5d439d455a9173478e086439e8 P f8d4657116f948038a0c73018238c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:14.257616 24361 ts_tablet_manager.cc:1434] T c9b7bd5d439d455a9173478e086439e8 P f8d4657116f948038a0c73018238c3ba: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.000s
I20260709 13:09:14.258780 24361 tablet_bootstrap.cc:492] T e335cd6afc4349cfaafa2970bccb40ff P f8d4657116f948038a0c73018238c3ba: Bootstrap starting.
I20260709 13:09:14.259368 24563 raft_consensus.cc:515] T 7da69453741f4b73a0092f56f29b1000 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:14.263048 24165 raft_consensus.cc:3060] T 861d7d76be4d484a9eb3acf8abffae5f P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:14.267550 24360 tablet_bootstrap.cc:492] T 687efb9bbbd04b0eb768bfa6543380c3 P c0f503bf8bb94af8a2a1139db4e1c0f5: No bootstrap required, opened a new log
I20260709 13:09:14.270624 24313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da69453741f4b73a0092f56f29b1000" candidate_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace"
I20260709 13:09:14.270848 24206 leader_election.cc:304] T 9a126a61cad843b4a3b34fac0f85a1d2 P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0f503bf8bb94af8a2a1139db4e1c0f5, f8d4657116f948038a0c73018238c3ba; no voters: 
I20260709 13:09:14.271157 24563 leader_election.cc:290] T 7da69453741f4b73a0092f56f29b1000 P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 1 election: Requested vote from peers b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561), dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343)
W20260709 13:09:14.272279 24130 leader_election.cc:343] T 7da69453741f4b73a0092f56f29b1000 P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:14.272650 24453 raft_consensus.cc:2804] T 9a126a61cad843b4a3b34fac0f85a1d2 P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:14.273464 24453 raft_consensus.cc:697] T 9a126a61cad843b4a3b34fac0f85a1d2 P f8d4657116f948038a0c73018238c3ba [term 1 LEADER]: Becoming Leader. State: Replica: f8d4657116f948038a0c73018238c3ba, State: Running, Role: LEADER
I20260709 13:09:14.270627 24360 ts_tablet_manager.cc:1403] T 687efb9bbbd04b0eb768bfa6543380c3 P c0f503bf8bb94af8a2a1139db4e1c0f5: Time spent bootstrapping tablet: real 0.140s	user 0.020s	sys 0.013s
I20260709 13:09:14.264156 24396 leader_election.cc:290] T 9a126a61cad843b4a3b34fac0f85a1d2 P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 election: Requested vote from peers c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431), b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561)
I20260709 13:09:14.263087 24309 raft_consensus.cc:2468] T 9a126a61cad843b4a3b34fac0f85a1d2 P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8d4657116f948038a0c73018238c3ba in term 1.
I20260709 13:09:14.295734 24419 raft_consensus.cc:493] T e845188d32d2466a92eacdb66da16dba P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.315105 24419 raft_consensus.cc:515] T e845188d32d2466a92eacdb66da16dba P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:14.319380 24309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e845188d32d2466a92eacdb66da16dba" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace" is_pre_election: true
I20260709 13:09:14.319583 24368 raft_consensus.cc:493] T 5bc4e407c8b04739aa0290922bfdbed4 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.320120 24368 raft_consensus.cc:515] T 5bc4e407c8b04739aa0290922bfdbed4 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:14.321303 24163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e845188d32d2466a92eacdb66da16dba" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" is_pre_election: true
W20260709 13:09:14.327188 24057 leader_election.cc:343] T e845188d32d2466a92eacdb66da16dba P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:14.331981 24362 tablet_bootstrap.cc:492] T f662efc86a73450cac065505b63cb883 P b39c386162de49aca92dbebee7f06ace: No bootstrap required, opened a new log
I20260709 13:09:14.334990 24362 ts_tablet_manager.cc:1403] T f662efc86a73450cac065505b63cb883 P b39c386162de49aca92dbebee7f06ace: Time spent bootstrapping tablet: real 0.229s	user 0.012s	sys 0.007s
I20260709 13:09:14.326316 24419 leader_election.cc:290] T e845188d32d2466a92eacdb66da16dba P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561), c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431)
I20260709 13:09:14.276099 24453 consensus_queue.cc:237] T 9a126a61cad843b4a3b34fac0f85a1d2 P f8d4657116f948038a0c73018238c3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
W20260709 13:09:14.334182 24055 leader_election.cc:343] T e845188d32d2466a92eacdb66da16dba P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:14.360863 24091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da69453741f4b73a0092f56f29b1000" candidate_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dea34817fcc148d78f090ef5fa72304f"
I20260709 13:09:14.361883 24091 raft_consensus.cc:3060] T 7da69453741f4b73a0092f56f29b1000 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:14.343597 24131 leader_election.cc:343] T e335cd6afc4349cfaafa2970bccb40ff P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:14.362363 24360 raft_consensus.cc:359] T 687efb9bbbd04b0eb768bfa6543380c3 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:14.366540 24360 raft_consensus.cc:385] T 687efb9bbbd04b0eb768bfa6543380c3 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:14.367094 24360 raft_consensus.cc:740] T 687efb9bbbd04b0eb768bfa6543380c3 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0f503bf8bb94af8a2a1139db4e1c0f5, State: Initialized, Role: FOLLOWER
I20260709 13:09:14.372797 24361 tablet_bootstrap.cc:654] T e335cd6afc4349cfaafa2970bccb40ff P f8d4657116f948038a0c73018238c3ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:14.371224 24360 consensus_queue.cc:260] T 687efb9bbbd04b0eb768bfa6543380c3 P c0f503bf8bb94af8a2a1139db4e1c0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:14.383865 24360 ts_tablet_manager.cc:1434] T 687efb9bbbd04b0eb768bfa6543380c3 P c0f503bf8bb94af8a2a1139db4e1c0f5: Time spent starting tablet: real 0.101s	user 0.009s	sys 0.000s
I20260709 13:09:14.384538 24565 raft_consensus.cc:493] T 1cefd1de9d9a4839b200c2472b3aeefc P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.385347 24360 tablet_bootstrap.cc:492] T e845188d32d2466a92eacdb66da16dba P c0f503bf8bb94af8a2a1139db4e1c0f5: Bootstrap starting.
I20260709 13:09:14.385169 24565 raft_consensus.cc:515] T 1cefd1de9d9a4839b200c2472b3aeefc P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:14.387624 24565 leader_election.cc:290] T 1cefd1de9d9a4839b200c2472b3aeefc P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431), f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171)
I20260709 13:09:14.389081 24239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cefd1de9d9a4839b200c2472b3aeefc" candidate_uuid: "b39c386162de49aca92dbebee7f06ace" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8d4657116f948038a0c73018238c3ba" is_pre_election: true
I20260709 13:09:14.389947 24239 raft_consensus.cc:2468] T 1cefd1de9d9a4839b200c2472b3aeefc P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b39c386162de49aca92dbebee7f06ace in term 0.
I20260709 13:09:14.391584 24279 leader_election.cc:304] T 1cefd1de9d9a4839b200c2472b3aeefc P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b39c386162de49aca92dbebee7f06ace, f8d4657116f948038a0c73018238c3ba; no voters: 
I20260709 13:09:14.392925 24565 raft_consensus.cc:2804] T 1cefd1de9d9a4839b200c2472b3aeefc P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:14.392884 24055 leader_election.cc:304] T e845188d32d2466a92eacdb66da16dba P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dea34817fcc148d78f090ef5fa72304f; no voters: b39c386162de49aca92dbebee7f06ace, c0f503bf8bb94af8a2a1139db4e1c0f5
I20260709 13:09:14.393712 24565 raft_consensus.cc:493] T 1cefd1de9d9a4839b200c2472b3aeefc P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:14.394246 24565 raft_consensus.cc:3060] T 1cefd1de9d9a4839b200c2472b3aeefc P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:14.394454 24494 raft_consensus.cc:2749] T e845188d32d2466a92eacdb66da16dba P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:14.394934 24445 raft_consensus.cc:515] T e335cd6afc4349cfaafa2970bccb40ff P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:14.396664 24568 raft_consensus.cc:493] T 1cefd1de9d9a4839b200c2472b3aeefc P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.397373 24445 leader_election.cc:290] T e335cd6afc4349cfaafa2970bccb40ff P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 1 election: Requested vote from peers f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171), b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561)
I20260709 13:09:14.397202 24568 raft_consensus.cc:515] T 1cefd1de9d9a4839b200c2472b3aeefc P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
W20260709 13:09:14.395813 24055 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:38561, user_credentials={real_user=slave}} blocked reactor thread for 68618.4us
I20260709 13:09:14.399863 24309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e335cd6afc4349cfaafa2970bccb40ff" candidate_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace"
I20260709 13:09:14.400532 24309 raft_consensus.cc:3060] T e335cd6afc4349cfaafa2970bccb40ff P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:14.403954 24359 tablet_bootstrap.cc:492] T 1dcdde5516f54b19b11611ca9213415d P dea34817fcc148d78f090ef5fa72304f: No bootstrap required, opened a new log
I20260709 13:09:14.404485 24359 ts_tablet_manager.cc:1403] T 1dcdde5516f54b19b11611ca9213415d P dea34817fcc148d78f090ef5fa72304f: Time spent bootstrapping tablet: real 0.215s	user 0.014s	sys 0.017s
I20260709 13:09:14.405332 24313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cefd1de9d9a4839b200c2472b3aeefc" candidate_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace" is_pre_election: true
I20260709 13:09:14.403960 24568 leader_election.cc:290] T 1cefd1de9d9a4839b200c2472b3aeefc P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171), b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561)
I20260709 13:09:14.407846 24359 raft_consensus.cc:359] T 1dcdde5516f54b19b11611ca9213415d P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:14.410411 24359 raft_consensus.cc:385] T 1dcdde5516f54b19b11611ca9213415d P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:14.410828 24359 raft_consensus.cc:740] T 1dcdde5516f54b19b11611ca9213415d P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dea34817fcc148d78f090ef5fa72304f, State: Initialized, Role: FOLLOWER
I20260709 13:09:14.415724 24368 leader_election.cc:290] T 5bc4e407c8b04739aa0290922bfdbed4 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171), b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561)
I20260709 13:09:14.416569 24572 consensus_queue.cc:1048] T 99078769583e49908dd6990f1d806453 P f8d4657116f948038a0c73018238c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:14.419005 24239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc4e407c8b04739aa0290922bfdbed4" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8d4657116f948038a0c73018238c3ba" is_pre_election: true
I20260709 13:09:14.420514 24161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cefd1de9d9a4839b200c2472b3aeefc" candidate_uuid: "b39c386162de49aca92dbebee7f06ace" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" is_pre_election: true
I20260709 13:09:14.421382 24236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cefd1de9d9a4839b200c2472b3aeefc" candidate_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8d4657116f948038a0c73018238c3ba" is_pre_election: true
I20260709 13:09:14.422063 24236 raft_consensus.cc:2468] T 1cefd1de9d9a4839b200c2472b3aeefc P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0f503bf8bb94af8a2a1139db4e1c0f5 in term 0.
I20260709 13:09:14.421790 24359 consensus_queue.cc:260] T 1dcdde5516f54b19b11611ca9213415d P dea34817fcc148d78f090ef5fa72304f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:14.423491 24314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc4e407c8b04739aa0290922bfdbed4" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace" is_pre_election: true
I20260709 13:09:14.427582 24131 leader_election.cc:304] T 1cefd1de9d9a4839b200c2472b3aeefc P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0f503bf8bb94af8a2a1139db4e1c0f5, f8d4657116f948038a0c73018238c3ba; no voters: 
W20260709 13:09:14.430753 24056 leader_election.cc:343] T 5bc4e407c8b04739aa0290922bfdbed4 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:14.424091 24359 ts_tablet_manager.cc:1434] T 1dcdde5516f54b19b11611ca9213415d P dea34817fcc148d78f090ef5fa72304f: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 13:09:14.433025 24359 tablet_bootstrap.cc:492] T bff14fa713b6482f89ecf3e18f785f81 P dea34817fcc148d78f090ef5fa72304f: Bootstrap starting.
I20260709 13:09:14.426343 24239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e335cd6afc4349cfaafa2970bccb40ff" candidate_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8d4657116f948038a0c73018238c3ba"
W20260709 13:09:14.432915 24055 leader_election.cc:343] T 5bc4e407c8b04739aa0290922bfdbed4 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:14.435019 24055 leader_election.cc:304] T 5bc4e407c8b04739aa0290922bfdbed4 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dea34817fcc148d78f090ef5fa72304f; no voters: b39c386162de49aca92dbebee7f06ace, f8d4657116f948038a0c73018238c3ba
I20260709 13:09:14.435809 24419 consensus_queue.cc:1048] T ee2c640a38d44afebd95dfec0e30b0d6 P dea34817fcc148d78f090ef5fa72304f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:14.436381 24494 raft_consensus.cc:2749] T 5bc4e407c8b04739aa0290922bfdbed4 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:09:14.437887 24131 leader_election.cc:343] T e335cd6afc4349cfaafa2970bccb40ff P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:14.421435 24161 raft_consensus.cc:2468] T 1cefd1de9d9a4839b200c2472b3aeefc P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b39c386162de49aca92dbebee7f06ace in term 0.
I20260709 13:09:14.443126 24568 raft_consensus.cc:2804] T 1cefd1de9d9a4839b200c2472b3aeefc P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:14.443835 24309 raft_consensus.cc:2468] T e335cd6afc4349cfaafa2970bccb40ff P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0f503bf8bb94af8a2a1139db4e1c0f5 in term 1.
I20260709 13:09:14.445412 24130 leader_election.cc:304] T e335cd6afc4349cfaafa2970bccb40ff P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b39c386162de49aca92dbebee7f06ace, c0f503bf8bb94af8a2a1139db4e1c0f5; no voters: f8d4657116f948038a0c73018238c3ba
I20260709 13:09:14.446015 24568 raft_consensus.cc:493] T 1cefd1de9d9a4839b200c2472b3aeefc P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:14.446445 24445 raft_consensus.cc:2804] T e335cd6afc4349cfaafa2970bccb40ff P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:14.447227 24445 raft_consensus.cc:697] T e335cd6afc4349cfaafa2970bccb40ff P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 LEADER]: Becoming Leader. State: Replica: c0f503bf8bb94af8a2a1139db4e1c0f5, State: Running, Role: LEADER
I20260709 13:09:14.448211 24445 consensus_queue.cc:237] T e335cd6afc4349cfaafa2970bccb40ff P c0f503bf8bb94af8a2a1139db4e1c0f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:14.460354 24362 raft_consensus.cc:359] T f662efc86a73450cac065505b63cb883 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:14.461318 24362 raft_consensus.cc:385] T f662efc86a73450cac065505b63cb883 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:14.461645 24362 raft_consensus.cc:740] T f662efc86a73450cac065505b63cb883 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b39c386162de49aca92dbebee7f06ace, State: Initialized, Role: FOLLOWER
I20260709 13:09:14.465909 24377 raft_consensus.cc:493] T 99078769583e49908dd6990f1d806453 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.445456 24359 tablet_bootstrap.cc:654] T bff14fa713b6482f89ecf3e18f785f81 P dea34817fcc148d78f090ef5fa72304f: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:14.466827 24377 raft_consensus.cc:515] T 99078769583e49908dd6990f1d806453 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:14.470274 24494 raft_consensus.cc:493] T e6f709868be149759ecdc073fe125bec P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.471184 24494 raft_consensus.cc:515] T e6f709868be149759ecdc073fe125bec P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:14.471514 24239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99078769583e49908dd6990f1d806453" candidate_uuid: "b39c386162de49aca92dbebee7f06ace" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8d4657116f948038a0c73018238c3ba" is_pre_election: true
I20260709 13:09:14.474871 24377 leader_election.cc:290] T 99078769583e49908dd6990f1d806453 P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171), dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343)
I20260709 13:09:14.480151 24568 raft_consensus.cc:3060] T 1cefd1de9d9a4839b200c2472b3aeefc P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:14.483775 24090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99078769583e49908dd6990f1d806453" candidate_uuid: "b39c386162de49aca92dbebee7f06ace" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dea34817fcc148d78f090ef5fa72304f" is_pre_election: true
I20260709 13:09:14.483201 24164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f709868be149759ecdc073fe125bec" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" is_pre_election: true
I20260709 13:09:14.485859 24280 leader_election.cc:304] T 99078769583e49908dd6990f1d806453 P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b39c386162de49aca92dbebee7f06ace; no voters: dea34817fcc148d78f090ef5fa72304f, f8d4657116f948038a0c73018238c3ba
W20260709 13:09:14.486191 24057 leader_election.cc:343] T e6f709868be149759ecdc073fe125bec P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:14.486842 24377 raft_consensus.cc:2749] T 99078769583e49908dd6990f1d806453 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:14.492106 24494 leader_election.cc:290] T e6f709868be149759ecdc073fe125bec P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431), f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171)
I20260709 13:09:14.480739 24362 consensus_queue.cc:260] T f662efc86a73450cac065505b63cb883 P b39c386162de49aca92dbebee7f06ace [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:14.492866 24091 raft_consensus.cc:2468] T 7da69453741f4b73a0092f56f29b1000 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0f503bf8bb94af8a2a1139db4e1c0f5 in term 1.
I20260709 13:09:14.496359 24565 raft_consensus.cc:515] T 1cefd1de9d9a4839b200c2472b3aeefc P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:14.497342 24360 tablet_bootstrap.cc:654] T e845188d32d2466a92eacdb66da16dba P c0f503bf8bb94af8a2a1139db4e1c0f5: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:14.499078 24313 raft_consensus.cc:2393] T 1cefd1de9d9a4839b200c2472b3aeefc P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0f503bf8bb94af8a2a1139db4e1c0f5 in current term 1: Already voted for candidate b39c386162de49aca92dbebee7f06ace in this term.
I20260709 13:09:14.499754 24314 raft_consensus.cc:3060] T 99078769583e49908dd6990f1d806453 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:14.502645 24565 leader_election.cc:290] T 1cefd1de9d9a4839b200c2472b3aeefc P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 1 election: Requested vote from peers c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431), f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171)
I20260709 13:09:14.508004 24236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cefd1de9d9a4839b200c2472b3aeefc" candidate_uuid: "b39c386162de49aca92dbebee7f06ace" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8d4657116f948038a0c73018238c3ba"
I20260709 13:09:14.508877 24236 raft_consensus.cc:3060] T 1cefd1de9d9a4839b200c2472b3aeefc P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:14.512531 24132 leader_election.cc:304] T 7da69453741f4b73a0092f56f29b1000 P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c0f503bf8bb94af8a2a1139db4e1c0f5, dea34817fcc148d78f090ef5fa72304f; no voters: b39c386162de49aca92dbebee7f06ace
I20260709 13:09:14.514528 24563 raft_consensus.cc:2804] T 7da69453741f4b73a0092f56f29b1000 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:14.515337 24563 raft_consensus.cc:697] T 7da69453741f4b73a0092f56f29b1000 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 LEADER]: Becoming Leader. State: Replica: c0f503bf8bb94af8a2a1139db4e1c0f5, State: Running, Role: LEADER
I20260709 13:09:14.516571 24563 consensus_queue.cc:237] T 7da69453741f4b73a0092f56f29b1000 P c0f503bf8bb94af8a2a1139db4e1c0f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:14.528292 24164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cefd1de9d9a4839b200c2472b3aeefc" candidate_uuid: "b39c386162de49aca92dbebee7f06ace" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5"
I20260709 13:09:14.548385 24240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f709868be149759ecdc073fe125bec" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8d4657116f948038a0c73018238c3ba" is_pre_election: true
I20260709 13:09:14.549400 24240 raft_consensus.cc:2468] T e6f709868be149759ecdc073fe125bec P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dea34817fcc148d78f090ef5fa72304f in term 0.
I20260709 13:09:14.552165 24361 tablet_bootstrap.cc:492] T e335cd6afc4349cfaafa2970bccb40ff P f8d4657116f948038a0c73018238c3ba: No bootstrap required, opened a new log
I20260709 13:09:14.552742 24361 ts_tablet_manager.cc:1403] T e335cd6afc4349cfaafa2970bccb40ff P f8d4657116f948038a0c73018238c3ba: Time spent bootstrapping tablet: real 0.294s	user 0.021s	sys 0.041s
I20260709 13:09:14.571818 24362 ts_tablet_manager.cc:1434] T f662efc86a73450cac065505b63cb883 P b39c386162de49aca92dbebee7f06ace: Time spent starting tablet: real 0.236s	user 0.008s	sys 0.002s
I20260709 13:09:14.576509 24359 tablet_bootstrap.cc:492] T bff14fa713b6482f89ecf3e18f785f81 P dea34817fcc148d78f090ef5fa72304f: No bootstrap required, opened a new log
I20260709 13:09:14.577067 24359 ts_tablet_manager.cc:1403] T bff14fa713b6482f89ecf3e18f785f81 P dea34817fcc148d78f090ef5fa72304f: Time spent bootstrapping tablet: real 0.144s	user 0.007s	sys 0.005s
I20260709 13:09:14.579600 24056 leader_election.cc:304] T e6f709868be149759ecdc073fe125bec P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dea34817fcc148d78f090ef5fa72304f, f8d4657116f948038a0c73018238c3ba; no voters: c0f503bf8bb94af8a2a1139db4e1c0f5
I20260709 13:09:14.573496 24444 raft_consensus.cc:493] T 687efb9bbbd04b0eb768bfa6543380c3 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.580955 24444 raft_consensus.cc:515] T 687efb9bbbd04b0eb768bfa6543380c3 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:14.585255 24494 raft_consensus.cc:2804] T e6f709868be149759ecdc073fe125bec P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:14.585814 24494 raft_consensus.cc:493] T e6f709868be149759ecdc073fe125bec P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:14.586195 24494 raft_consensus.cc:3060] T e6f709868be149759ecdc073fe125bec P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:14.587218 24309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687efb9bbbd04b0eb768bfa6543380c3" candidate_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace" is_pre_election: true
I20260709 13:09:14.593386 24362 tablet_bootstrap.cc:492] T 7da69453741f4b73a0092f56f29b1000 P b39c386162de49aca92dbebee7f06ace: Bootstrap starting.
I20260709 13:09:14.597883 24359 raft_consensus.cc:359] T bff14fa713b6482f89ecf3e18f785f81 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:14.599335 24359 raft_consensus.cc:385] T bff14fa713b6482f89ecf3e18f785f81 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:14.599839 24359 raft_consensus.cc:740] T bff14fa713b6482f89ecf3e18f785f81 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dea34817fcc148d78f090ef5fa72304f, State: Initialized, Role: FOLLOWER
W20260709 13:09:14.599124 24130 leader_election.cc:343] T 687efb9bbbd04b0eb768bfa6543380c3 P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:14.611721 24444 leader_election.cc:290] T 687efb9bbbd04b0eb768bfa6543380c3 P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561), dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343)
I20260709 13:09:14.622815 24361 raft_consensus.cc:359] T e335cd6afc4349cfaafa2970bccb40ff P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:14.624436 24361 raft_consensus.cc:385] T e335cd6afc4349cfaafa2970bccb40ff P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:14.624742 24361 raft_consensus.cc:740] T e335cd6afc4349cfaafa2970bccb40ff P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8d4657116f948038a0c73018238c3ba, State: Initialized, Role: FOLLOWER
I20260709 13:09:14.626578 24361 consensus_queue.cc:260] T e335cd6afc4349cfaafa2970bccb40ff P f8d4657116f948038a0c73018238c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:14.635627 24161 raft_consensus.cc:3060] T ee2c640a38d44afebd95dfec0e30b0d6 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:14.634797 24359 consensus_queue.cc:260] T bff14fa713b6482f89ecf3e18f785f81 P dea34817fcc148d78f090ef5fa72304f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:14.643045 24361 ts_tablet_manager.cc:1434] T e335cd6afc4349cfaafa2970bccb40ff P f8d4657116f948038a0c73018238c3ba: Time spent starting tablet: real 0.090s	user 0.009s	sys 0.002s
I20260709 13:09:14.646234 24360 tablet_bootstrap.cc:492] T e845188d32d2466a92eacdb66da16dba P c0f503bf8bb94af8a2a1139db4e1c0f5: No bootstrap required, opened a new log
I20260709 13:09:14.646801 24360 ts_tablet_manager.cc:1403] T e845188d32d2466a92eacdb66da16dba P c0f503bf8bb94af8a2a1139db4e1c0f5: Time spent bootstrapping tablet: real 0.262s	user 0.018s	sys 0.003s
I20260709 13:09:14.634151 24236 raft_consensus.cc:2468] T 1cefd1de9d9a4839b200c2472b3aeefc P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b39c386162de49aca92dbebee7f06ace in term 1.
I20260709 13:09:14.651263 24279 leader_election.cc:304] T 1cefd1de9d9a4839b200c2472b3aeefc P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b39c386162de49aca92dbebee7f06ace, f8d4657116f948038a0c73018238c3ba; no voters: 
I20260709 13:09:14.652426 24377 raft_consensus.cc:2804] T 1cefd1de9d9a4839b200c2472b3aeefc P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:14.652166 24360 raft_consensus.cc:359] T e845188d32d2466a92eacdb66da16dba P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:14.653045 24360 raft_consensus.cc:385] T e845188d32d2466a92eacdb66da16dba P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:14.652974 24377 raft_consensus.cc:697] T 1cefd1de9d9a4839b200c2472b3aeefc P b39c386162de49aca92dbebee7f06ace [term 1 LEADER]: Becoming Leader. State: Replica: b39c386162de49aca92dbebee7f06ace, State: Running, Role: LEADER
I20260709 13:09:14.654031 24377 consensus_queue.cc:237] T 1cefd1de9d9a4839b200c2472b3aeefc P b39c386162de49aca92dbebee7f06ace [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:14.654359 24568 raft_consensus.cc:515] T 1cefd1de9d9a4839b200c2472b3aeefc P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:14.657287 24362 tablet_bootstrap.cc:654] T 7da69453741f4b73a0092f56f29b1000 P b39c386162de49aca92dbebee7f06ace: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:14.654289 24396 consensus_queue.cc:1048] T 99078769583e49908dd6990f1d806453 P f8d4657116f948038a0c73018238c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:09:14.661782 24164 raft_consensus.cc:2393] T 1cefd1de9d9a4839b200c2472b3aeefc P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b39c386162de49aca92dbebee7f06ace in current term 1: Already voted for candidate c0f503bf8bb94af8a2a1139db4e1c0f5 in this term.
I20260709 13:09:14.661933 24236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cefd1de9d9a4839b200c2472b3aeefc" candidate_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8d4657116f948038a0c73018238c3ba"
I20260709 13:09:14.662827 24236 raft_consensus.cc:2393] T 1cefd1de9d9a4839b200c2472b3aeefc P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c0f503bf8bb94af8a2a1139db4e1c0f5 in current term 1: Already voted for candidate b39c386162de49aca92dbebee7f06ace in this term.
I20260709 13:09:14.664027 24565 raft_consensus.cc:493] T f662efc86a73450cac065505b63cb883 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.664618 24565 raft_consensus.cc:515] T f662efc86a73450cac065505b63cb883 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:14.666865 24565 leader_election.cc:290] T f662efc86a73450cac065505b63cb883 P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171), dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343)
I20260709 13:09:14.669572 24360 raft_consensus.cc:740] T e845188d32d2466a92eacdb66da16dba P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0f503bf8bb94af8a2a1139db4e1c0f5, State: Initialized, Role: FOLLOWER
I20260709 13:09:14.673113 24360 consensus_queue.cc:260] T e845188d32d2466a92eacdb66da16dba P c0f503bf8bb94af8a2a1139db4e1c0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:14.674029 24239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f662efc86a73450cac065505b63cb883" candidate_uuid: "b39c386162de49aca92dbebee7f06ace" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8d4657116f948038a0c73018238c3ba" is_pre_election: true
I20260709 13:09:14.679708 24361 tablet_bootstrap.cc:492] T f662efc86a73450cac065505b63cb883 P f8d4657116f948038a0c73018238c3ba: Bootstrap starting.
I20260709 13:09:14.678238 24368 raft_consensus.cc:493] T 687efb9bbbd04b0eb768bfa6543380c3 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.684578 24368 raft_consensus.cc:515] T 687efb9bbbd04b0eb768bfa6543380c3 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:14.687317 24359 ts_tablet_manager.cc:1434] T bff14fa713b6482f89ecf3e18f785f81 P dea34817fcc148d78f090ef5fa72304f: Time spent starting tablet: real 0.110s	user 0.015s	sys 0.005s
I20260709 13:09:14.691191 24309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cefd1de9d9a4839b200c2472b3aeefc" candidate_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace"
I20260709 13:09:14.692112 24359 tablet_bootstrap.cc:492] T b53fa043603b41be836d4ccb5c248df8 P dea34817fcc148d78f090ef5fa72304f: Bootstrap starting.
I20260709 13:09:14.685061 24360 ts_tablet_manager.cc:1434] T e845188d32d2466a92eacdb66da16dba P c0f503bf8bb94af8a2a1139db4e1c0f5: Time spent starting tablet: real 0.038s	user 0.009s	sys 0.000s
I20260709 13:09:14.689733 24368 leader_election.cc:290] T 687efb9bbbd04b0eb768bfa6543380c3 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561), c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431)
I20260709 13:09:14.687392 24091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687efb9bbbd04b0eb768bfa6543380c3" candidate_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dea34817fcc148d78f090ef5fa72304f" is_pre_election: true
I20260709 13:09:14.696159 24091 raft_consensus.cc:2468] T 687efb9bbbd04b0eb768bfa6543380c3 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0f503bf8bb94af8a2a1139db4e1c0f5 in term 0.
I20260709 13:09:14.687194 24568 leader_election.cc:290] T 1cefd1de9d9a4839b200c2472b3aeefc P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 1 election: Requested vote from peers f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171), b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561)
I20260709 13:09:14.685731 23987 catalog_manager.cc:5697] T 9a126a61cad843b4a3b34fac0f85a1d2 P f8d4657116f948038a0c73018238c3ba reported cstate change: term changed from 0 to 1, leader changed from <none> to f8d4657116f948038a0c73018238c3ba (127.14.180.67). New cstate: current_term: 1 leader_uuid: "f8d4657116f948038a0c73018238c3ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:14.702390 24576 log.cc:927] Time spent T 861d7d76be4d484a9eb3acf8abffae5f P c0f503bf8bb94af8a2a1139db4e1c0f5: Append to log took a long time: real 0.073s	user 0.002s	sys 0.002s
W20260709 13:09:14.702517 24279 leader_election.cc:343] T f662efc86a73450cac065505b63cb883 P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:14.702998 24091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f662efc86a73450cac065505b63cb883" candidate_uuid: "b39c386162de49aca92dbebee7f06ace" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dea34817fcc148d78f090ef5fa72304f" is_pre_election: true
I20260709 13:09:14.704349 24091 raft_consensus.cc:2468] T f662efc86a73450cac065505b63cb883 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b39c386162de49aca92dbebee7f06ace in term 0.
I20260709 13:09:14.704732 24360 tablet_bootstrap.cc:492] T e6f709868be149759ecdc073fe125bec P c0f503bf8bb94af8a2a1139db4e1c0f5: Bootstrap starting.
I20260709 13:09:14.711980 24280 leader_election.cc:304] T f662efc86a73450cac065505b63cb883 P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b39c386162de49aca92dbebee7f06ace, dea34817fcc148d78f090ef5fa72304f; no voters: f8d4657116f948038a0c73018238c3ba
I20260709 13:09:14.693707 24130 leader_election.cc:304] T 1cefd1de9d9a4839b200c2472b3aeefc P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0f503bf8bb94af8a2a1139db4e1c0f5; no voters: b39c386162de49aca92dbebee7f06ace, f8d4657116f948038a0c73018238c3ba
I20260709 13:09:14.717137 24568 raft_consensus.cc:2749] T 1cefd1de9d9a4839b200c2472b3aeefc P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:09:14.722579 24565 raft_consensus.cc:2804] T f662efc86a73450cac065505b63cb883 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:14.723279 24565 raft_consensus.cc:493] T f662efc86a73450cac065505b63cb883 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:14.723758 24565 raft_consensus.cc:3060] T f662efc86a73450cac065505b63cb883 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:14.731891 24132 leader_election.cc:304] T 687efb9bbbd04b0eb768bfa6543380c3 P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c0f503bf8bb94af8a2a1139db4e1c0f5, dea34817fcc148d78f090ef5fa72304f; no voters: b39c386162de49aca92dbebee7f06ace
I20260709 13:09:14.732832 24568 raft_consensus.cc:2804] T 687efb9bbbd04b0eb768bfa6543380c3 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:14.733170 24455 raft_consensus.cc:493] T c9b7bd5d439d455a9173478e086439e8 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.733800 24455 raft_consensus.cc:515] T c9b7bd5d439d455a9173478e086439e8 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:14.734033 24494 raft_consensus.cc:515] T e6f709868be149759ecdc073fe125bec P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:14.736012 24494 leader_election.cc:290] T e6f709868be149759ecdc073fe125bec P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 election: Requested vote from peers c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431), f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171)
I20260709 13:09:14.736838 24309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687efb9bbbd04b0eb768bfa6543380c3" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace" is_pre_election: true
I20260709 13:09:14.737764 24359 tablet_bootstrap.cc:654] T b53fa043603b41be836d4ccb5c248df8 P dea34817fcc148d78f090ef5fa72304f: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:14.738147 24313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9b7bd5d439d455a9173478e086439e8" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace" is_pre_election: true
I20260709 13:09:14.733276 24568 raft_consensus.cc:493] T 687efb9bbbd04b0eb768bfa6543380c3 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:14.739097 24568 raft_consensus.cc:3060] T 687efb9bbbd04b0eb768bfa6543380c3 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:14.741688 24584 raft_consensus.cc:493] T 1dcdde5516f54b19b11611ca9213415d P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.736613 24455 leader_election.cc:290] T c9b7bd5d439d455a9173478e086439e8 P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561), dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343)
I20260709 13:09:14.742290 24584 raft_consensus.cc:515] T 1dcdde5516f54b19b11611ca9213415d P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
W20260709 13:09:14.745680 24055 leader_election.cc:343] T 687efb9bbbd04b0eb768bfa6543380c3 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:14.746984 24161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687efb9bbbd04b0eb768bfa6543380c3" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" is_pre_election: true
I20260709 13:09:14.749532 24361 tablet_bootstrap.cc:654] T f662efc86a73450cac065505b63cb883 P f8d4657116f948038a0c73018238c3ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:14.750758 24573 consensus_queue.cc:1048] T ee2c640a38d44afebd95dfec0e30b0d6 P dea34817fcc148d78f090ef5fa72304f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:14.756966 24360 tablet_bootstrap.cc:654] T e6f709868be149759ecdc073fe125bec P c0f503bf8bb94af8a2a1139db4e1c0f5: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:14.765513 24584 leader_election.cc:290] T 1dcdde5516f54b19b11611ca9213415d P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561), c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431)
I20260709 13:09:14.766332 24088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9b7bd5d439d455a9173478e086439e8" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dea34817fcc148d78f090ef5fa72304f" is_pre_election: true
I20260709 13:09:14.766590 24236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f709868be149759ecdc073fe125bec" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8d4657116f948038a0c73018238c3ba"
I20260709 13:09:14.767153 24088 raft_consensus.cc:2468] T c9b7bd5d439d455a9173478e086439e8 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8d4657116f948038a0c73018238c3ba in term 0.
I20260709 13:09:14.768538 24206 leader_election.cc:304] T c9b7bd5d439d455a9173478e086439e8 P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dea34817fcc148d78f090ef5fa72304f, f8d4657116f948038a0c73018238c3ba; no voters: 
W20260709 13:09:14.771608 24204 leader_election.cc:343] T c9b7bd5d439d455a9173478e086439e8 P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:14.775892 24165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f709868be149759ecdc073fe125bec" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5"
I20260709 13:09:14.777245 24164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcdde5516f54b19b11611ca9213415d" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" is_pre_election: true
I20260709 13:09:14.767149 24236 raft_consensus.cc:3060] T e6f709868be149759ecdc073fe125bec P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:14.786301 24571 raft_consensus.cc:2804] T c9b7bd5d439d455a9173478e086439e8 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:14.787132 24571 raft_consensus.cc:493] T c9b7bd5d439d455a9173478e086439e8 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:14.787686 24571 raft_consensus.cc:3060] T c9b7bd5d439d455a9173478e086439e8 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:14.803433 24313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcdde5516f54b19b11611ca9213415d" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace" is_pre_election: true
W20260709 13:09:14.805210 24055 leader_election.cc:343] T 1dcdde5516f54b19b11611ca9213415d P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:14.832971 24565 raft_consensus.cc:515] T f662efc86a73450cac065505b63cb883 P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:14.826121 24445 raft_consensus.cc:493] T e845188d32d2466a92eacdb66da16dba P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.835070 24445 raft_consensus.cc:515] T e845188d32d2466a92eacdb66da16dba P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:14.837321 24445 leader_election.cc:290] T e845188d32d2466a92eacdb66da16dba P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561), dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343)
I20260709 13:09:14.843433 24313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e845188d32d2466a92eacdb66da16dba" candidate_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace" is_pre_election: true
W20260709 13:09:14.845248 24130 leader_election.cc:343] T e845188d32d2466a92eacdb66da16dba P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:14.827255 24057 leader_election.cc:343] T e6f709868be149759ecdc073fe125bec P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:14.848286 24453 raft_consensus.cc:493] T e335cd6afc4349cfaafa2970bccb40ff P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.856779 24453 raft_consensus.cc:515] T e335cd6afc4349cfaafa2970bccb40ff P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:14.857786 24239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f662efc86a73450cac065505b63cb883" candidate_uuid: "b39c386162de49aca92dbebee7f06ace" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8d4657116f948038a0c73018238c3ba"
W20260709 13:09:14.859447 24279 leader_election.cc:343] T f662efc86a73450cac065505b63cb883 P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:14.861687 24314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e335cd6afc4349cfaafa2970bccb40ff" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace" is_pre_election: true
I20260709 13:09:14.862697 24314 raft_consensus.cc:2393] T e335cd6afc4349cfaafa2970bccb40ff P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f8d4657116f948038a0c73018238c3ba in current term 1: Already voted for candidate c0f503bf8bb94af8a2a1139db4e1c0f5 in this term.
I20260709 13:09:14.863116 24453 leader_election.cc:290] T e335cd6afc4349cfaafa2970bccb40ff P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431), b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561)
I20260709 13:09:14.863202 24091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f662efc86a73450cac065505b63cb883" candidate_uuid: "b39c386162de49aca92dbebee7f06ace" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dea34817fcc148d78f090ef5fa72304f"
I20260709 13:09:14.861923 24565 leader_election.cc:290] T f662efc86a73450cac065505b63cb883 P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 1 election: Requested vote from peers f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171), dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343)
I20260709 13:09:14.864382 24091 raft_consensus.cc:3060] T f662efc86a73450cac065505b63cb883 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:14.865869 24164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e335cd6afc4349cfaafa2970bccb40ff" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" is_pre_election: true
I20260709 13:09:14.868119 24360 tablet_bootstrap.cc:492] T e6f709868be149759ecdc073fe125bec P c0f503bf8bb94af8a2a1139db4e1c0f5: No bootstrap required, opened a new log
I20260709 13:09:14.868794 24360 ts_tablet_manager.cc:1403] T e6f709868be149759ecdc073fe125bec P c0f503bf8bb94af8a2a1139db4e1c0f5: Time spent bootstrapping tablet: real 0.168s	user 0.037s	sys 0.035s
I20260709 13:09:14.868881 24362 tablet_bootstrap.cc:492] T 7da69453741f4b73a0092f56f29b1000 P b39c386162de49aca92dbebee7f06ace: No bootstrap required, opened a new log
I20260709 13:09:14.869431 24362 ts_tablet_manager.cc:1403] T 7da69453741f4b73a0092f56f29b1000 P b39c386162de49aca92dbebee7f06ace: Time spent bootstrapping tablet: real 0.279s	user 0.017s	sys 0.010s
I20260709 13:09:14.872709 24206 leader_election.cc:304] T e335cd6afc4349cfaafa2970bccb40ff P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8d4657116f948038a0c73018238c3ba; no voters: b39c386162de49aca92dbebee7f06ace, c0f503bf8bb94af8a2a1139db4e1c0f5
I20260709 13:09:14.876426 24362 raft_consensus.cc:359] T 7da69453741f4b73a0092f56f29b1000 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:14.869244 24568 raft_consensus.cc:515] T 687efb9bbbd04b0eb768bfa6543380c3 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:14.878041 24161 raft_consensus.cc:2393] T 687efb9bbbd04b0eb768bfa6543380c3 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dea34817fcc148d78f090ef5fa72304f in current term 1: Already voted for candidate c0f503bf8bb94af8a2a1139db4e1c0f5 in this term.
W20260709 13:09:14.864392 24057 leader_election.cc:343] T 1dcdde5516f54b19b11611ca9213415d P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:14.879163 24057 leader_election.cc:304] T 1dcdde5516f54b19b11611ca9213415d P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dea34817fcc148d78f090ef5fa72304f; no voters: b39c386162de49aca92dbebee7f06ace, c0f503bf8bb94af8a2a1139db4e1c0f5
I20260709 13:09:14.881524 24360 raft_consensus.cc:359] T e6f709868be149759ecdc073fe125bec P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:14.882364 24455 raft_consensus.cc:3060] T e335cd6afc4349cfaafa2970bccb40ff P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:14.889199 24568 leader_election.cc:290] T 687efb9bbbd04b0eb768bfa6543380c3 P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 1 election: Requested vote from peers b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561), dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343)
I20260709 13:09:14.890762 24236 raft_consensus.cc:2468] T e6f709868be149759ecdc073fe125bec P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dea34817fcc148d78f090ef5fa72304f in term 1.
I20260709 13:09:14.877228 24362 raft_consensus.cc:385] T 7da69453741f4b73a0092f56f29b1000 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:14.891610 24362 raft_consensus.cc:740] T 7da69453741f4b73a0092f56f29b1000 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b39c386162de49aca92dbebee7f06ace, State: Initialized, Role: FOLLOWER
I20260709 13:09:14.892767 24362 consensus_queue.cc:260] T 7da69453741f4b73a0092f56f29b1000 P b39c386162de49aca92dbebee7f06ace [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:14.886971 24360 raft_consensus.cc:385] T e6f709868be149759ecdc073fe125bec P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:14.888859 24573 raft_consensus.cc:2749] T 1dcdde5516f54b19b11611ca9213415d P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:14.896441 24455 raft_consensus.cc:2749] T e335cd6afc4349cfaafa2970bccb40ff P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:14.897006 24362 ts_tablet_manager.cc:1434] T 7da69453741f4b73a0092f56f29b1000 P b39c386162de49aca92dbebee7f06ace: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.001s
I20260709 13:09:14.898506 24362 tablet_bootstrap.cc:492] T e845188d32d2466a92eacdb66da16dba P b39c386162de49aca92dbebee7f06ace: Bootstrap starting.
I20260709 13:09:14.899081 24056 leader_election.cc:304] T e6f709868be149759ecdc073fe125bec P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dea34817fcc148d78f090ef5fa72304f, f8d4657116f948038a0c73018238c3ba; no voters: c0f503bf8bb94af8a2a1139db4e1c0f5
I20260709 13:09:14.900039 24573 raft_consensus.cc:2804] T e6f709868be149759ecdc073fe125bec P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:14.900537 24573 raft_consensus.cc:697] T e6f709868be149759ecdc073fe125bec P dea34817fcc148d78f090ef5fa72304f [term 1 LEADER]: Becoming Leader. State: Replica: dea34817fcc148d78f090ef5fa72304f, State: Running, Role: LEADER
I20260709 13:09:14.901469 24571 raft_consensus.cc:515] T c9b7bd5d439d455a9173478e086439e8 P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:14.901413 24573 consensus_queue.cc:237] T e6f709868be149759ecdc073fe125bec P dea34817fcc148d78f090ef5fa72304f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:14.903811 24571 leader_election.cc:290] T c9b7bd5d439d455a9173478e086439e8 P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 election: Requested vote from peers b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561), dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343)
I20260709 13:09:14.904675 24314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9b7bd5d439d455a9173478e086439e8" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace"
I20260709 13:09:14.906090 24362 tablet_bootstrap.cc:654] T e845188d32d2466a92eacdb66da16dba P b39c386162de49aca92dbebee7f06ace: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:14.906150 24204 leader_election.cc:343] T c9b7bd5d439d455a9173478e086439e8 P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:14.907598 24359 tablet_bootstrap.cc:492] T b53fa043603b41be836d4ccb5c248df8 P dea34817fcc148d78f090ef5fa72304f: No bootstrap required, opened a new log
I20260709 13:09:14.908305 24359 ts_tablet_manager.cc:1403] T b53fa043603b41be836d4ccb5c248df8 P dea34817fcc148d78f090ef5fa72304f: Time spent bootstrapping tablet: real 0.217s	user 0.013s	sys 0.041s
I20260709 13:09:14.910929 24314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687efb9bbbd04b0eb768bfa6543380c3" candidate_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace"
I20260709 13:09:14.894852 24360 raft_consensus.cc:740] T e6f709868be149759ecdc073fe125bec P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0f503bf8bb94af8a2a1139db4e1c0f5, State: Initialized, Role: FOLLOWER
I20260709 13:09:14.922125 24088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9b7bd5d439d455a9173478e086439e8" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dea34817fcc148d78f090ef5fa72304f"
I20260709 13:09:14.922987 24088 raft_consensus.cc:3060] T c9b7bd5d439d455a9173478e086439e8 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:14.914465 24453 consensus_queue.cc:1048] T 9a126a61cad843b4a3b34fac0f85a1d2 P f8d4657116f948038a0c73018238c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:09:14.929351 24359 raft_consensus.cc:359] T b53fa043603b41be836d4ccb5c248df8 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
W20260709 13:09:14.918924 24130 leader_election.cc:343] T 687efb9bbbd04b0eb768bfa6543380c3 P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:14.933092 24088 raft_consensus.cc:2468] T c9b7bd5d439d455a9173478e086439e8 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8d4657116f948038a0c73018238c3ba in term 1.
I20260709 13:09:14.933508 24090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e845188d32d2466a92eacdb66da16dba" candidate_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dea34817fcc148d78f090ef5fa72304f" is_pre_election: true
I20260709 13:09:14.949514 24090 raft_consensus.cc:2468] T e845188d32d2466a92eacdb66da16dba P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0f503bf8bb94af8a2a1139db4e1c0f5 in term 0.
I20260709 13:09:14.935259 24089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687efb9bbbd04b0eb768bfa6543380c3" candidate_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dea34817fcc148d78f090ef5fa72304f"
I20260709 13:09:14.939687 24091 raft_consensus.cc:2468] T f662efc86a73450cac065505b63cb883 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b39c386162de49aca92dbebee7f06ace in term 1.
I20260709 13:09:14.943159 24057 leader_election.cc:304] T 687efb9bbbd04b0eb768bfa6543380c3 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dea34817fcc148d78f090ef5fa72304f; no voters: b39c386162de49aca92dbebee7f06ace, c0f503bf8bb94af8a2a1139db4e1c0f5
I20260709 13:09:14.951342 24206 leader_election.cc:304] T c9b7bd5d439d455a9173478e086439e8 P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dea34817fcc148d78f090ef5fa72304f, f8d4657116f948038a0c73018238c3ba; no voters: b39c386162de49aca92dbebee7f06ace
I20260709 13:09:14.947218 24359 raft_consensus.cc:385] T b53fa043603b41be836d4ccb5c248df8 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:14.952975 24359 raft_consensus.cc:740] T b53fa043603b41be836d4ccb5c248df8 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dea34817fcc148d78f090ef5fa72304f, State: Initialized, Role: FOLLOWER
I20260709 13:09:14.952466 24132 leader_election.cc:304] T e845188d32d2466a92eacdb66da16dba P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c0f503bf8bb94af8a2a1139db4e1c0f5, dea34817fcc148d78f090ef5fa72304f; no voters: b39c386162de49aca92dbebee7f06ace
I20260709 13:09:14.953590 24453 raft_consensus.cc:2804] T c9b7bd5d439d455a9173478e086439e8 P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:14.947813 24360 consensus_queue.cc:260] T e6f709868be149759ecdc073fe125bec P c0f503bf8bb94af8a2a1139db4e1c0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:14.953847 24568 raft_consensus.cc:2804] T e845188d32d2466a92eacdb66da16dba P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:14.954144 24453 raft_consensus.cc:697] T c9b7bd5d439d455a9173478e086439e8 P f8d4657116f948038a0c73018238c3ba [term 1 LEADER]: Becoming Leader. State: Replica: f8d4657116f948038a0c73018238c3ba, State: Running, Role: LEADER
I20260709 13:09:14.954512 24568 raft_consensus.cc:493] T e845188d32d2466a92eacdb66da16dba P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:14.953869 24359 consensus_queue.cc:260] T b53fa043603b41be836d4ccb5c248df8 P dea34817fcc148d78f090ef5fa72304f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:14.954957 24568 raft_consensus.cc:3060] T e845188d32d2466a92eacdb66da16dba P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:14.955231 24453 consensus_queue.cc:237] T c9b7bd5d439d455a9173478e086439e8 P f8d4657116f948038a0c73018238c3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:14.956535 24359 ts_tablet_manager.cc:1434] T b53fa043603b41be836d4ccb5c248df8 P dea34817fcc148d78f090ef5fa72304f: Time spent starting tablet: real 0.048s	user 0.008s	sys 0.000s
I20260709 13:09:14.957562 24359 tablet_bootstrap.cc:492] T ab4ea1ceb7a443be94ec74cd88c9bf47 P dea34817fcc148d78f090ef5fa72304f: Bootstrap starting.
I20260709 13:09:14.964830 24360 ts_tablet_manager.cc:1434] T e6f709868be149759ecdc073fe125bec P c0f503bf8bb94af8a2a1139db4e1c0f5: Time spent starting tablet: real 0.096s	user 0.006s	sys 0.005s
I20260709 13:09:14.965873 24359 tablet_bootstrap.cc:654] T ab4ea1ceb7a443be94ec74cd88c9bf47 P dea34817fcc148d78f090ef5fa72304f: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:14.966037 24360 tablet_bootstrap.cc:492] T 1dcdde5516f54b19b11611ca9213415d P c0f503bf8bb94af8a2a1139db4e1c0f5: Bootstrap starting.
I20260709 13:09:14.966351 24419 raft_consensus.cc:493] T bff14fa713b6482f89ecf3e18f785f81 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.966858 24419 raft_consensus.cc:515] T bff14fa713b6482f89ecf3e18f785f81 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:14.967175 24568 raft_consensus.cc:515] T e845188d32d2466a92eacdb66da16dba P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:14.969485 24568 leader_election.cc:290] T e845188d32d2466a92eacdb66da16dba P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 1 election: Requested vote from peers b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561), dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343)
I20260709 13:09:14.970394 24313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e845188d32d2466a92eacdb66da16dba" candidate_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace"
I20260709 13:09:14.971004 24164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bff14fa713b6482f89ecf3e18f785f81" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" is_pre_election: true
W20260709 13:09:14.973285 24130 leader_election.cc:343] T e845188d32d2466a92eacdb66da16dba P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:14.975433 24057 leader_election.cc:343] T bff14fa713b6482f89ecf3e18f785f81 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:14.976716 24090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e845188d32d2466a92eacdb66da16dba" candidate_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dea34817fcc148d78f090ef5fa72304f"
I20260709 13:09:14.977746 24090 raft_consensus.cc:3060] T e845188d32d2466a92eacdb66da16dba P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:14.950708 24089 raft_consensus.cc:3060] T 687efb9bbbd04b0eb768bfa6543380c3 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:14.998064 23989 catalog_manager.cc:5697] T e335cd6afc4349cfaafa2970bccb40ff P c0f503bf8bb94af8a2a1139db4e1c0f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66). New cstate: current_term: 1 leader_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:15.003736 23989 catalog_manager.cc:5697] T 7da69453741f4b73a0092f56f29b1000 P c0f503bf8bb94af8a2a1139db4e1c0f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66). New cstate: current_term: 1 leader_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:15.004722 24280 leader_election.cc:304] T f662efc86a73450cac065505b63cb883 P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b39c386162de49aca92dbebee7f06ace, dea34817fcc148d78f090ef5fa72304f; no voters: f8d4657116f948038a0c73018238c3ba
I20260709 13:09:15.006012 24565 raft_consensus.cc:2804] T f662efc86a73450cac065505b63cb883 P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:15.006613 24565 raft_consensus.cc:697] T f662efc86a73450cac065505b63cb883 P b39c386162de49aca92dbebee7f06ace [term 1 LEADER]: Becoming Leader. State: Replica: b39c386162de49aca92dbebee7f06ace, State: Running, Role: LEADER
I20260709 13:09:15.007572 24565 consensus_queue.cc:237] T f662efc86a73450cac065505b63cb883 P b39c386162de49aca92dbebee7f06ace [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:15.009361 24419 leader_election.cc:290] T bff14fa713b6482f89ecf3e18f785f81 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431), f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171)
I20260709 13:09:15.011875 24568 consensus_queue.cc:1048] T e335cd6afc4349cfaafa2970bccb40ff P c0f503bf8bb94af8a2a1139db4e1c0f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:15.026746 24361 tablet_bootstrap.cc:492] T f662efc86a73450cac065505b63cb883 P f8d4657116f948038a0c73018238c3ba: No bootstrap required, opened a new log
I20260709 13:09:15.027546 24361 ts_tablet_manager.cc:1403] T f662efc86a73450cac065505b63cb883 P f8d4657116f948038a0c73018238c3ba: Time spent bootstrapping tablet: real 0.352s	user 0.027s	sys 0.034s
I20260709 13:09:15.030905 24239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bff14fa713b6482f89ecf3e18f785f81" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8d4657116f948038a0c73018238c3ba" is_pre_election: true
W20260709 13:09:15.035995 24056 leader_election.cc:343] T bff14fa713b6482f89ecf3e18f785f81 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:15.036613 24056 leader_election.cc:304] T bff14fa713b6482f89ecf3e18f785f81 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dea34817fcc148d78f090ef5fa72304f; no voters: c0f503bf8bb94af8a2a1139db4e1c0f5, f8d4657116f948038a0c73018238c3ba
I20260709 13:09:15.040645 24314 raft_consensus.cc:3060] T 7da69453741f4b73a0092f56f29b1000 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:15.042709 24584 raft_consensus.cc:2749] T bff14fa713b6482f89ecf3e18f785f81 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:15.048596 24563 raft_consensus.cc:493] T e6f709868be149759ecdc073fe125bec P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.049448 24563 raft_consensus.cc:515] T e6f709868be149759ecdc073fe125bec P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:15.050139 24455 consensus_queue.cc:1048] T 9a126a61cad843b4a3b34fac0f85a1d2 P f8d4657116f948038a0c73018238c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:09:15.061554 24361 raft_consensus.cc:359] T f662efc86a73450cac065505b63cb883 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:15.065825 24361 raft_consensus.cc:385] T f662efc86a73450cac065505b63cb883 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:09:15.068459 24599 log.cc:927] Time spent T c9b7bd5d439d455a9173478e086439e8 P f8d4657116f948038a0c73018238c3ba: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 13:09:15.067620 23985 catalog_manager.cc:5697] T e6f709868be149759ecdc073fe125bec P dea34817fcc148d78f090ef5fa72304f reported cstate change: term changed from 0 to 1, leader changed from <none> to dea34817fcc148d78f090ef5fa72304f (127.14.180.65). New cstate: current_term: 1 leader_uuid: "dea34817fcc148d78f090ef5fa72304f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:15.066159 24361 raft_consensus.cc:740] T f662efc86a73450cac065505b63cb883 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8d4657116f948038a0c73018238c3ba, State: Initialized, Role: FOLLOWER
I20260709 13:09:15.073504 24563 leader_election.cc:290] T e6f709868be149759ecdc073fe125bec P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343), f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171)
I20260709 13:09:15.074277 23986 catalog_manager.cc:5697] T 1cefd1de9d9a4839b200c2472b3aeefc P b39c386162de49aca92dbebee7f06ace reported cstate change: term changed from 0 to 1, leader changed from <none> to b39c386162de49aca92dbebee7f06ace (127.14.180.68). New cstate: current_term: 1 leader_uuid: "b39c386162de49aca92dbebee7f06ace" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:15.076972 24239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f709868be149759ecdc073fe125bec" candidate_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8d4657116f948038a0c73018238c3ba" is_pre_election: true
I20260709 13:09:15.079777 24090 raft_consensus.cc:2468] T e845188d32d2466a92eacdb66da16dba P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0f503bf8bb94af8a2a1139db4e1c0f5 in term 1.
I20260709 13:09:15.080646 24239 raft_consensus.cc:2393] T e6f709868be149759ecdc073fe125bec P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0f503bf8bb94af8a2a1139db4e1c0f5 in current term 1: Already voted for candidate dea34817fcc148d78f090ef5fa72304f in this term.
I20260709 13:09:15.081633 24132 leader_election.cc:304] T e845188d32d2466a92eacdb66da16dba P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c0f503bf8bb94af8a2a1139db4e1c0f5, dea34817fcc148d78f090ef5fa72304f; no voters: b39c386162de49aca92dbebee7f06ace
I20260709 13:09:15.082901 24444 consensus_queue.cc:1048] T 7da69453741f4b73a0092f56f29b1000 P c0f503bf8bb94af8a2a1139db4e1c0f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:15.083781 24089 raft_consensus.cc:2468] T 687efb9bbbd04b0eb768bfa6543380c3 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0f503bf8bb94af8a2a1139db4e1c0f5 in term 1.
I20260709 13:09:15.084381 24494 raft_consensus.cc:2749] T 687efb9bbbd04b0eb768bfa6543380c3 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:15.084416 24444 raft_consensus.cc:2804] T e845188d32d2466a92eacdb66da16dba P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:15.085188 24444 raft_consensus.cc:697] T e845188d32d2466a92eacdb66da16dba P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 LEADER]: Becoming Leader. State: Replica: c0f503bf8bb94af8a2a1139db4e1c0f5, State: Running, Role: LEADER
I20260709 13:09:15.086779 24359 tablet_bootstrap.cc:492] T ab4ea1ceb7a443be94ec74cd88c9bf47 P dea34817fcc148d78f090ef5fa72304f: No bootstrap required, opened a new log
I20260709 13:09:15.087333 24359 ts_tablet_manager.cc:1403] T ab4ea1ceb7a443be94ec74cd88c9bf47 P dea34817fcc148d78f090ef5fa72304f: Time spent bootstrapping tablet: real 0.130s	user 0.012s	sys 0.015s
I20260709 13:09:15.078501 24563 consensus_queue.cc:1048] T e335cd6afc4349cfaafa2970bccb40ff P c0f503bf8bb94af8a2a1139db4e1c0f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:15.078867 24091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f709868be149759ecdc073fe125bec" candidate_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dea34817fcc148d78f090ef5fa72304f" is_pre_election: true
I20260709 13:09:15.090866 24359 raft_consensus.cc:359] T ab4ea1ceb7a443be94ec74cd88c9bf47 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:15.091811 24359 raft_consensus.cc:385] T ab4ea1ceb7a443be94ec74cd88c9bf47 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:15.092140 24359 raft_consensus.cc:740] T ab4ea1ceb7a443be94ec74cd88c9bf47 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dea34817fcc148d78f090ef5fa72304f, State: Initialized, Role: FOLLOWER
I20260709 13:09:15.092967 24359 consensus_queue.cc:260] T ab4ea1ceb7a443be94ec74cd88c9bf47 P dea34817fcc148d78f090ef5fa72304f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:15.086114 24444 consensus_queue.cc:237] T e845188d32d2466a92eacdb66da16dba P c0f503bf8bb94af8a2a1139db4e1c0f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:15.096323 24361 consensus_queue.cc:260] T f662efc86a73450cac065505b63cb883 P f8d4657116f948038a0c73018238c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:15.097019 24563 consensus_queue.cc:1048] T 7da69453741f4b73a0092f56f29b1000 P c0f503bf8bb94af8a2a1139db4e1c0f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:15.099023 24361 ts_tablet_manager.cc:1434] T f662efc86a73450cac065505b63cb883 P f8d4657116f948038a0c73018238c3ba: Time spent starting tablet: real 0.071s	user 0.007s	sys 0.002s
I20260709 13:09:15.099272 24132 leader_election.cc:304] T e6f709868be149759ecdc073fe125bec P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0f503bf8bb94af8a2a1139db4e1c0f5; no voters: dea34817fcc148d78f090ef5fa72304f, f8d4657116f948038a0c73018238c3ba
I20260709 13:09:15.100255 24361 tablet_bootstrap.cc:492] T 5bc4e407c8b04739aa0290922bfdbed4 P f8d4657116f948038a0c73018238c3ba: Bootstrap starting.
I20260709 13:09:15.100677 24568 raft_consensus.cc:3060] T e6f709868be149759ecdc073fe125bec P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:15.102499 24360 tablet_bootstrap.cc:654] T 1dcdde5516f54b19b11611ca9213415d P c0f503bf8bb94af8a2a1139db4e1c0f5: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:15.108099 24362 tablet_bootstrap.cc:492] T e845188d32d2466a92eacdb66da16dba P b39c386162de49aca92dbebee7f06ace: No bootstrap required, opened a new log
I20260709 13:09:15.108706 24362 ts_tablet_manager.cc:1403] T e845188d32d2466a92eacdb66da16dba P b39c386162de49aca92dbebee7f06ace: Time spent bootstrapping tablet: real 0.211s	user 0.044s	sys 0.061s
I20260709 13:09:15.110261 24359 ts_tablet_manager.cc:1434] T ab4ea1ceb7a443be94ec74cd88c9bf47 P dea34817fcc148d78f090ef5fa72304f: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.000s
I20260709 13:09:15.111649 24359 tablet_bootstrap.cc:492] T 0dbd3426f3e14ef28e7b0b6c4c7de6a2 P dea34817fcc148d78f090ef5fa72304f: Bootstrap starting.
I20260709 13:09:15.117800 24568 raft_consensus.cc:2749] T e6f709868be149759ecdc073fe125bec P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:15.126072 24132 leader_election.cc:304] T 687efb9bbbd04b0eb768bfa6543380c3 P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c0f503bf8bb94af8a2a1139db4e1c0f5, dea34817fcc148d78f090ef5fa72304f; no voters: b39c386162de49aca92dbebee7f06ace
I20260709 13:09:15.127295 24445 raft_consensus.cc:2804] T 687efb9bbbd04b0eb768bfa6543380c3 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:15.127883 24445 raft_consensus.cc:697] T 687efb9bbbd04b0eb768bfa6543380c3 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 LEADER]: Becoming Leader. State: Replica: c0f503bf8bb94af8a2a1139db4e1c0f5, State: Running, Role: LEADER
I20260709 13:09:15.141016 24445 consensus_queue.cc:237] T 687efb9bbbd04b0eb768bfa6543380c3 P c0f503bf8bb94af8a2a1139db4e1c0f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:15.141531 24473 consensus_queue.cc:1048] T 1cefd1de9d9a4839b200c2472b3aeefc P b39c386162de49aca92dbebee7f06ace [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:15.144459 24361 tablet_bootstrap.cc:654] T 5bc4e407c8b04739aa0290922bfdbed4 P f8d4657116f948038a0c73018238c3ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:15.146602 24494 raft_consensus.cc:493] T b53fa043603b41be836d4ccb5c248df8 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.148734 24494 raft_consensus.cc:515] T b53fa043603b41be836d4ccb5c248df8 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:15.151679 24362 raft_consensus.cc:359] T e845188d32d2466a92eacdb66da16dba P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:15.152614 24362 raft_consensus.cc:385] T e845188d32d2466a92eacdb66da16dba P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:15.154795 24362 raft_consensus.cc:740] T e845188d32d2466a92eacdb66da16dba P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b39c386162de49aca92dbebee7f06ace, State: Initialized, Role: FOLLOWER
I20260709 13:09:15.155231 24239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53fa043603b41be836d4ccb5c248df8" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8d4657116f948038a0c73018238c3ba" is_pre_election: true
I20260709 13:09:15.155846 24362 consensus_queue.cc:260] T e845188d32d2466a92eacdb66da16dba P b39c386162de49aca92dbebee7f06ace [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:15.158635 24362 ts_tablet_manager.cc:1434] T e845188d32d2466a92eacdb66da16dba P b39c386162de49aca92dbebee7f06ace: Time spent starting tablet: real 0.050s	user 0.010s	sys 0.000s
W20260709 13:09:15.158878 24056 leader_election.cc:343] T b53fa043603b41be836d4ccb5c248df8 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:15.159932 24362 tablet_bootstrap.cc:492] T c9b7bd5d439d455a9173478e086439e8 P b39c386162de49aca92dbebee7f06ace: Bootstrap starting.
I20260709 13:09:15.182238 23987 catalog_manager.cc:5697] T c9b7bd5d439d455a9173478e086439e8 P f8d4657116f948038a0c73018238c3ba reported cstate change: term changed from 0 to 1, leader changed from <none> to f8d4657116f948038a0c73018238c3ba (127.14.180.67). New cstate: current_term: 1 leader_uuid: "f8d4657116f948038a0c73018238c3ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:15.195870 24360 tablet_bootstrap.cc:492] T 1dcdde5516f54b19b11611ca9213415d P c0f503bf8bb94af8a2a1139db4e1c0f5: No bootstrap required, opened a new log
I20260709 13:09:15.196491 24360 ts_tablet_manager.cc:1403] T 1dcdde5516f54b19b11611ca9213415d P c0f503bf8bb94af8a2a1139db4e1c0f5: Time spent bootstrapping tablet: real 0.231s	user 0.015s	sys 0.002s
I20260709 13:09:15.185284 24494 leader_election.cc:290] T b53fa043603b41be836d4ccb5c248df8 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171), b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561)
I20260709 13:09:15.212673 24359 tablet_bootstrap.cc:654] T 0dbd3426f3e14ef28e7b0b6c4c7de6a2 P dea34817fcc148d78f090ef5fa72304f: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:15.228555 24309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53fa043603b41be836d4ccb5c248df8" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace" is_pre_election: true
I20260709 13:09:15.230665 24565 consensus_queue.cc:1048] T 1cefd1de9d9a4839b200c2472b3aeefc P b39c386162de49aca92dbebee7f06ace [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:09:15.234025 24055 leader_election.cc:343] T b53fa043603b41be836d4ccb5c248df8 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:15.234685 24055 leader_election.cc:304] T b53fa043603b41be836d4ccb5c248df8 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dea34817fcc148d78f090ef5fa72304f; no voters: b39c386162de49aca92dbebee7f06ace, f8d4657116f948038a0c73018238c3ba
I20260709 13:09:15.243165 24419 raft_consensus.cc:2749] T b53fa043603b41be836d4ccb5c248df8 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:15.277053 24362 tablet_bootstrap.cc:654] T c9b7bd5d439d455a9173478e086439e8 P b39c386162de49aca92dbebee7f06ace: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:15.301659 24419 raft_consensus.cc:493] T ab4ea1ceb7a443be94ec74cd88c9bf47 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.302341 24419 raft_consensus.cc:515] T ab4ea1ceb7a443be94ec74cd88c9bf47 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:15.302747 24360 raft_consensus.cc:359] T 1dcdde5516f54b19b11611ca9213415d P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:15.304512 24360 raft_consensus.cc:385] T 1dcdde5516f54b19b11611ca9213415d P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:15.304777 24360 raft_consensus.cc:740] T 1dcdde5516f54b19b11611ca9213415d P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0f503bf8bb94af8a2a1139db4e1c0f5, State: Initialized, Role: FOLLOWER
I20260709 13:09:15.309645 24360 consensus_queue.cc:260] T 1dcdde5516f54b19b11611ca9213415d P c0f503bf8bb94af8a2a1139db4e1c0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:15.317240 24419 leader_election.cc:290] T ab4ea1ceb7a443be94ec74cd88c9bf47 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431), f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171)
I20260709 13:09:15.321934 24163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab4ea1ceb7a443be94ec74cd88c9bf47" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" is_pre_election: true
I20260709 13:09:15.326829 24360 ts_tablet_manager.cc:1434] T 1dcdde5516f54b19b11611ca9213415d P c0f503bf8bb94af8a2a1139db4e1c0f5: Time spent starting tablet: real 0.130s	user 0.007s	sys 0.003s
I20260709 13:09:15.328104 24360 tablet_bootstrap.cc:492] T bff14fa713b6482f89ecf3e18f785f81 P c0f503bf8bb94af8a2a1139db4e1c0f5: Bootstrap starting.
W20260709 13:09:15.330856 24037 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 13:09:15.335829 24057 leader_election.cc:343] T ab4ea1ceb7a443be94ec74cd88c9bf47 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:15.338265 24236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab4ea1ceb7a443be94ec74cd88c9bf47" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8d4657116f948038a0c73018238c3ba" is_pre_election: true
W20260709 13:09:15.343592 24056 leader_election.cc:343] T ab4ea1ceb7a443be94ec74cd88c9bf47 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:15.344101 24056 leader_election.cc:304] T ab4ea1ceb7a443be94ec74cd88c9bf47 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dea34817fcc148d78f090ef5fa72304f; no voters: c0f503bf8bb94af8a2a1139db4e1c0f5, f8d4657116f948038a0c73018238c3ba
I20260709 13:09:15.345242 24361 tablet_bootstrap.cc:492] T 5bc4e407c8b04739aa0290922bfdbed4 P f8d4657116f948038a0c73018238c3ba: No bootstrap required, opened a new log
I20260709 13:09:15.345782 24361 ts_tablet_manager.cc:1403] T 5bc4e407c8b04739aa0290922bfdbed4 P f8d4657116f948038a0c73018238c3ba: Time spent bootstrapping tablet: real 0.246s	user 0.023s	sys 0.021s
I20260709 13:09:15.346261 24419 raft_consensus.cc:2749] T ab4ea1ceb7a443be94ec74cd88c9bf47 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:15.348831 24361 raft_consensus.cc:359] T 5bc4e407c8b04739aa0290922bfdbed4 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:15.349622 24361 raft_consensus.cc:385] T 5bc4e407c8b04739aa0290922bfdbed4 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:15.349900 24361 raft_consensus.cc:740] T 5bc4e407c8b04739aa0290922bfdbed4 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8d4657116f948038a0c73018238c3ba, State: Initialized, Role: FOLLOWER
I20260709 13:09:15.352314 24360 tablet_bootstrap.cc:654] T bff14fa713b6482f89ecf3e18f785f81 P c0f503bf8bb94af8a2a1139db4e1c0f5: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:15.352974 23987 catalog_manager.cc:5697] T f662efc86a73450cac065505b63cb883 P b39c386162de49aca92dbebee7f06ace reported cstate change: term changed from 0 to 1, leader changed from <none> to b39c386162de49aca92dbebee7f06ace (127.14.180.68). New cstate: current_term: 1 leader_uuid: "b39c386162de49aca92dbebee7f06ace" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:15.357801 24359 tablet_bootstrap.cc:492] T 0dbd3426f3e14ef28e7b0b6c4c7de6a2 P dea34817fcc148d78f090ef5fa72304f: No bootstrap required, opened a new log
I20260709 13:09:15.358362 24359 ts_tablet_manager.cc:1403] T 0dbd3426f3e14ef28e7b0b6c4c7de6a2 P dea34817fcc148d78f090ef5fa72304f: Time spent bootstrapping tablet: real 0.247s	user 0.012s	sys 0.013s
I20260709 13:09:15.358807 24362 tablet_bootstrap.cc:492] T c9b7bd5d439d455a9173478e086439e8 P b39c386162de49aca92dbebee7f06ace: No bootstrap required, opened a new log
I20260709 13:09:15.358633 24361 consensus_queue.cc:260] T 5bc4e407c8b04739aa0290922bfdbed4 P f8d4657116f948038a0c73018238c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:15.359309 24362 ts_tablet_manager.cc:1403] T c9b7bd5d439d455a9173478e086439e8 P b39c386162de49aca92dbebee7f06ace: Time spent bootstrapping tablet: real 0.200s	user 0.012s	sys 0.001s
I20260709 13:09:15.361732 24361 ts_tablet_manager.cc:1434] T 5bc4e407c8b04739aa0290922bfdbed4 P f8d4657116f948038a0c73018238c3ba: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.004s
I20260709 13:09:15.362035 24362 raft_consensus.cc:359] T c9b7bd5d439d455a9173478e086439e8 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:15.362769 24362 raft_consensus.cc:385] T c9b7bd5d439d455a9173478e086439e8 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:15.363054 24362 raft_consensus.cc:740] T c9b7bd5d439d455a9173478e086439e8 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b39c386162de49aca92dbebee7f06ace, State: Initialized, Role: FOLLOWER
I20260709 13:09:15.361420 24359 raft_consensus.cc:359] T 0dbd3426f3e14ef28e7b0b6c4c7de6a2 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:15.363734 24362 consensus_queue.cc:260] T c9b7bd5d439d455a9173478e086439e8 P b39c386162de49aca92dbebee7f06ace [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:15.364419 24359 raft_consensus.cc:385] T 0dbd3426f3e14ef28e7b0b6c4c7de6a2 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:15.364694 24361 tablet_bootstrap.cc:492] T d2ddfc9daac54dc28d63b46ab1777bf3 P f8d4657116f948038a0c73018238c3ba: Bootstrap starting.
I20260709 13:09:15.364938 24360 tablet_bootstrap.cc:492] T bff14fa713b6482f89ecf3e18f785f81 P c0f503bf8bb94af8a2a1139db4e1c0f5: No bootstrap required, opened a new log
I20260709 13:09:15.365422 24360 ts_tablet_manager.cc:1403] T bff14fa713b6482f89ecf3e18f785f81 P c0f503bf8bb94af8a2a1139db4e1c0f5: Time spent bootstrapping tablet: real 0.038s	user 0.008s	sys 0.003s
I20260709 13:09:15.364749 24359 raft_consensus.cc:740] T 0dbd3426f3e14ef28e7b0b6c4c7de6a2 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dea34817fcc148d78f090ef5fa72304f, State: Initialized, Role: FOLLOWER
I20260709 13:09:15.366986 24362 ts_tablet_manager.cc:1434] T c9b7bd5d439d455a9173478e086439e8 P b39c386162de49aca92dbebee7f06ace: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:09:15.367429 24359 consensus_queue.cc:260] T 0dbd3426f3e14ef28e7b0b6c4c7de6a2 P dea34817fcc148d78f090ef5fa72304f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:15.368175 24362 tablet_bootstrap.cc:492] T 687efb9bbbd04b0eb768bfa6543380c3 P b39c386162de49aca92dbebee7f06ace: Bootstrap starting.
I20260709 13:09:15.370162 24360 raft_consensus.cc:359] T bff14fa713b6482f89ecf3e18f785f81 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:15.370811 24360 raft_consensus.cc:385] T bff14fa713b6482f89ecf3e18f785f81 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:15.373080 24359 ts_tablet_manager.cc:1434] T 0dbd3426f3e14ef28e7b0b6c4c7de6a2 P dea34817fcc148d78f090ef5fa72304f: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.003s
I20260709 13:09:15.374374 24359 tablet_bootstrap.cc:492] T e21ef2f479764142935dc2b1b7e87220 P dea34817fcc148d78f090ef5fa72304f: Bootstrap starting.
I20260709 13:09:15.371074 24360 raft_consensus.cc:740] T bff14fa713b6482f89ecf3e18f785f81 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0f503bf8bb94af8a2a1139db4e1c0f5, State: Initialized, Role: FOLLOWER
I20260709 13:09:15.375571 24360 consensus_queue.cc:260] T bff14fa713b6482f89ecf3e18f785f81 P c0f503bf8bb94af8a2a1139db4e1c0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:15.377697 24362 tablet_bootstrap.cc:654] T 687efb9bbbd04b0eb768bfa6543380c3 P b39c386162de49aca92dbebee7f06ace: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:15.380478 23988 catalog_manager.cc:5697] T e845188d32d2466a92eacdb66da16dba P c0f503bf8bb94af8a2a1139db4e1c0f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66). New cstate: current_term: 1 leader_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:15.385926 24361 tablet_bootstrap.cc:654] T d2ddfc9daac54dc28d63b46ab1777bf3 P f8d4657116f948038a0c73018238c3ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:15.389110 24362 tablet_bootstrap.cc:492] T 687efb9bbbd04b0eb768bfa6543380c3 P b39c386162de49aca92dbebee7f06ace: No bootstrap required, opened a new log
I20260709 13:09:15.389034 24313 raft_consensus.cc:3060] T c9b7bd5d439d455a9173478e086439e8 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:15.389871 24362 ts_tablet_manager.cc:1403] T 687efb9bbbd04b0eb768bfa6543380c3 P b39c386162de49aca92dbebee7f06ace: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.005s
I20260709 13:09:15.393083 24362 raft_consensus.cc:359] T 687efb9bbbd04b0eb768bfa6543380c3 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:15.393812 24362 raft_consensus.cc:385] T 687efb9bbbd04b0eb768bfa6543380c3 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:15.394112 24362 raft_consensus.cc:740] T 687efb9bbbd04b0eb768bfa6543380c3 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b39c386162de49aca92dbebee7f06ace, State: Initialized, Role: FOLLOWER
I20260709 13:09:15.394956 24362 consensus_queue.cc:260] T 687efb9bbbd04b0eb768bfa6543380c3 P b39c386162de49aca92dbebee7f06ace [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:15.397717 24362 ts_tablet_manager.cc:1434] T 687efb9bbbd04b0eb768bfa6543380c3 P b39c386162de49aca92dbebee7f06ace: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.005s
I20260709 13:09:15.398190 24360 ts_tablet_manager.cc:1434] T bff14fa713b6482f89ecf3e18f785f81 P c0f503bf8bb94af8a2a1139db4e1c0f5: Time spent starting tablet: real 0.032s	user 0.005s	sys 0.003s
I20260709 13:09:15.398919 24362 tablet_bootstrap.cc:492] T 5bc4e407c8b04739aa0290922bfdbed4 P b39c386162de49aca92dbebee7f06ace: Bootstrap starting.
I20260709 13:09:15.400662 24360 tablet_bootstrap.cc:492] T d2ddfc9daac54dc28d63b46ab1777bf3 P c0f503bf8bb94af8a2a1139db4e1c0f5: Bootstrap starting.
I20260709 13:09:15.404466 24572 raft_consensus.cc:493] T 5bc4e407c8b04739aa0290922bfdbed4 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.405228 24572 raft_consensus.cc:515] T 5bc4e407c8b04739aa0290922bfdbed4 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:15.397822 24359 tablet_bootstrap.cc:654] T e21ef2f479764142935dc2b1b7e87220 P dea34817fcc148d78f090ef5fa72304f: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:15.407210 24236 raft_consensus.cc:3060] T f662efc86a73450cac065505b63cb883 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:15.408372 24572 leader_election.cc:290] T 5bc4e407c8b04739aa0290922bfdbed4 P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561), dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343)
I20260709 13:09:15.409207 24314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc4e407c8b04739aa0290922bfdbed4" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace" is_pre_election: true
I20260709 13:09:15.410598 24362 tablet_bootstrap.cc:654] T 5bc4e407c8b04739aa0290922bfdbed4 P b39c386162de49aca92dbebee7f06ace: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:15.412385 24204 leader_election.cc:343] T 5bc4e407c8b04739aa0290922bfdbed4 P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:15.412719 24377 raft_consensus.cc:493] T e845188d32d2466a92eacdb66da16dba P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.413285 24377 raft_consensus.cc:515] T e845188d32d2466a92eacdb66da16dba P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:15.418880 24610 consensus_queue.cc:1048] T f662efc86a73450cac065505b63cb883 P b39c386162de49aca92dbebee7f06ace [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:15.416464 24377 leader_election.cc:290] T e845188d32d2466a92eacdb66da16dba P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343), c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431)
I20260709 13:09:15.387982 23988 catalog_manager.cc:5697] T 687efb9bbbd04b0eb768bfa6543380c3 P c0f503bf8bb94af8a2a1139db4e1c0f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66). New cstate: current_term: 1 leader_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:15.426822 24584 consensus_queue.cc:1048] T e6f709868be149759ecdc073fe125bec P dea34817fcc148d78f090ef5fa72304f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:15.427582 24360 tablet_bootstrap.cc:654] T d2ddfc9daac54dc28d63b46ab1777bf3 P c0f503bf8bb94af8a2a1139db4e1c0f5: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:15.432461 24161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e845188d32d2466a92eacdb66da16dba" candidate_uuid: "b39c386162de49aca92dbebee7f06ace" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" is_pre_election: true
I20260709 13:09:15.434209 24359 tablet_bootstrap.cc:492] T e21ef2f479764142935dc2b1b7e87220 P dea34817fcc148d78f090ef5fa72304f: No bootstrap required, opened a new log
I20260709 13:09:15.435133 24359 ts_tablet_manager.cc:1403] T e21ef2f479764142935dc2b1b7e87220 P dea34817fcc148d78f090ef5fa72304f: Time spent bootstrapping tablet: real 0.061s	user 0.013s	sys 0.000s
I20260709 13:09:15.436465 24090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e845188d32d2466a92eacdb66da16dba" candidate_uuid: "b39c386162de49aca92dbebee7f06ace" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dea34817fcc148d78f090ef5fa72304f" is_pre_election: true
I20260709 13:09:15.437115 24088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc4e407c8b04739aa0290922bfdbed4" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dea34817fcc148d78f090ef5fa72304f" is_pre_election: true
I20260709 13:09:15.437692 24090 raft_consensus.cc:2393] T e845188d32d2466a92eacdb66da16dba P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b39c386162de49aca92dbebee7f06ace in current term 1: Already voted for candidate c0f503bf8bb94af8a2a1139db4e1c0f5 in this term.
I20260709 13:09:15.437928 24088 raft_consensus.cc:2468] T 5bc4e407c8b04739aa0290922bfdbed4 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8d4657116f948038a0c73018238c3ba in term 0.
I20260709 13:09:15.439427 24280 leader_election.cc:304] T e845188d32d2466a92eacdb66da16dba P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b39c386162de49aca92dbebee7f06ace; no voters: c0f503bf8bb94af8a2a1139db4e1c0f5, dea34817fcc148d78f090ef5fa72304f
I20260709 13:09:15.442138 24377 raft_consensus.cc:3060] T e845188d32d2466a92eacdb66da16dba P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:15.444954 24359 raft_consensus.cc:359] T e21ef2f479764142935dc2b1b7e87220 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:15.446012 24359 raft_consensus.cc:385] T e21ef2f479764142935dc2b1b7e87220 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:15.446400 24359 raft_consensus.cc:740] T e21ef2f479764142935dc2b1b7e87220 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dea34817fcc148d78f090ef5fa72304f, State: Initialized, Role: FOLLOWER
I20260709 13:09:15.446784 24610 consensus_queue.cc:1048] T f662efc86a73450cac065505b63cb883 P b39c386162de49aca92dbebee7f06ace [LEADER]: Connected to new peer: Peer: permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:15.447348 24359 consensus_queue.cc:260] T e21ef2f479764142935dc2b1b7e87220 P dea34817fcc148d78f090ef5fa72304f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:15.451251 24362 tablet_bootstrap.cc:492] T 5bc4e407c8b04739aa0290922bfdbed4 P b39c386162de49aca92dbebee7f06ace: No bootstrap required, opened a new log
I20260709 13:09:15.451821 24362 ts_tablet_manager.cc:1403] T 5bc4e407c8b04739aa0290922bfdbed4 P b39c386162de49aca92dbebee7f06ace: Time spent bootstrapping tablet: real 0.053s	user 0.016s	sys 0.027s
I20260709 13:09:15.452420 24206 leader_election.cc:304] T 5bc4e407c8b04739aa0290922bfdbed4 P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dea34817fcc148d78f090ef5fa72304f, f8d4657116f948038a0c73018238c3ba; no voters: b39c386162de49aca92dbebee7f06ace
I20260709 13:09:15.452807 24360 tablet_bootstrap.cc:492] T d2ddfc9daac54dc28d63b46ab1777bf3 P c0f503bf8bb94af8a2a1139db4e1c0f5: No bootstrap required, opened a new log
I20260709 13:09:15.454041 24360 ts_tablet_manager.cc:1403] T d2ddfc9daac54dc28d63b46ab1777bf3 P c0f503bf8bb94af8a2a1139db4e1c0f5: Time spent bootstrapping tablet: real 0.055s	user 0.010s	sys 0.003s
I20260709 13:09:15.454717 24362 raft_consensus.cc:359] T 5bc4e407c8b04739aa0290922bfdbed4 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:15.455111 24572 raft_consensus.cc:2804] T 5bc4e407c8b04739aa0290922bfdbed4 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:15.455430 24362 raft_consensus.cc:385] T 5bc4e407c8b04739aa0290922bfdbed4 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:15.455680 24572 raft_consensus.cc:493] T 5bc4e407c8b04739aa0290922bfdbed4 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:15.455770 24362 raft_consensus.cc:740] T 5bc4e407c8b04739aa0290922bfdbed4 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b39c386162de49aca92dbebee7f06ace, State: Initialized, Role: FOLLOWER
I20260709 13:09:15.456262 24572 raft_consensus.cc:3060] T 5bc4e407c8b04739aa0290922bfdbed4 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:15.456676 24360 raft_consensus.cc:359] T d2ddfc9daac54dc28d63b46ab1777bf3 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:15.456760 24362 consensus_queue.cc:260] T 5bc4e407c8b04739aa0290922bfdbed4 P b39c386162de49aca92dbebee7f06ace [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:15.457458 24360 raft_consensus.cc:385] T d2ddfc9daac54dc28d63b46ab1777bf3 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:15.457756 24360 raft_consensus.cc:740] T d2ddfc9daac54dc28d63b46ab1777bf3 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0f503bf8bb94af8a2a1139db4e1c0f5, State: Initialized, Role: FOLLOWER
I20260709 13:09:15.458424 24360 consensus_queue.cc:260] T d2ddfc9daac54dc28d63b46ab1777bf3 P c0f503bf8bb94af8a2a1139db4e1c0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:15.459264 24362 ts_tablet_manager.cc:1434] T 5bc4e407c8b04739aa0290922bfdbed4 P b39c386162de49aca92dbebee7f06ace: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:09:15.460336 24362 tablet_bootstrap.cc:492] T d2ddfc9daac54dc28d63b46ab1777bf3 P b39c386162de49aca92dbebee7f06ace: Bootstrap starting.
I20260709 13:09:15.461143 24359 ts_tablet_manager.cc:1434] T e21ef2f479764142935dc2b1b7e87220 P dea34817fcc148d78f090ef5fa72304f: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.001s
I20260709 13:09:15.462277 24359 tablet_bootstrap.cc:492] T 25e4818a4e2e4c9c9f7a8467aa9ef881 P dea34817fcc148d78f090ef5fa72304f: Bootstrap starting.
I20260709 13:09:15.466917 24362 tablet_bootstrap.cc:654] T d2ddfc9daac54dc28d63b46ab1777bf3 P b39c386162de49aca92dbebee7f06ace: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:15.468443 24359 tablet_bootstrap.cc:654] T 25e4818a4e2e4c9c9f7a8467aa9ef881 P dea34817fcc148d78f090ef5fa72304f: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:15.471035 24584 consensus_queue.cc:1048] T e6f709868be149759ecdc073fe125bec P dea34817fcc148d78f090ef5fa72304f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:15.472890 24360 ts_tablet_manager.cc:1434] T d2ddfc9daac54dc28d63b46ab1777bf3 P c0f503bf8bb94af8a2a1139db4e1c0f5: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 13:09:15.474506 24445 raft_consensus.cc:493] T bff14fa713b6482f89ecf3e18f785f81 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.474578 24360 tablet_bootstrap.cc:492] T 352353d793574662ac966f335ae8cfbe P c0f503bf8bb94af8a2a1139db4e1c0f5: Bootstrap starting.
I20260709 13:09:15.475241 24445 raft_consensus.cc:515] T bff14fa713b6482f89ecf3e18f785f81 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:15.477665 24445 leader_election.cc:290] T bff14fa713b6482f89ecf3e18f785f81 P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343), f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171)
I20260709 13:09:15.478751 24362 tablet_bootstrap.cc:492] T d2ddfc9daac54dc28d63b46ab1777bf3 P b39c386162de49aca92dbebee7f06ace: No bootstrap required, opened a new log
I20260709 13:09:15.479278 24362 ts_tablet_manager.cc:1403] T d2ddfc9daac54dc28d63b46ab1777bf3 P b39c386162de49aca92dbebee7f06ace: Time spent bootstrapping tablet: real 0.019s	user 0.008s	sys 0.009s
I20260709 13:09:15.479303 24091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bff14fa713b6482f89ecf3e18f785f81" candidate_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dea34817fcc148d78f090ef5fa72304f" is_pre_election: true
I20260709 13:09:15.479990 24239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bff14fa713b6482f89ecf3e18f785f81" candidate_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8d4657116f948038a0c73018238c3ba" is_pre_election: true
I20260709 13:09:15.480406 24091 raft_consensus.cc:2468] T bff14fa713b6482f89ecf3e18f785f81 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0f503bf8bb94af8a2a1139db4e1c0f5 in term 0.
W20260709 13:09:15.482069 24131 leader_election.cc:343] T bff14fa713b6482f89ecf3e18f785f81 P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:15.483011 24132 leader_election.cc:304] T bff14fa713b6482f89ecf3e18f785f81 P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c0f503bf8bb94af8a2a1139db4e1c0f5, dea34817fcc148d78f090ef5fa72304f; no voters: f8d4657116f948038a0c73018238c3ba
I20260709 13:09:15.484754 24445 raft_consensus.cc:2804] T bff14fa713b6482f89ecf3e18f785f81 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:15.485221 24445 raft_consensus.cc:493] T bff14fa713b6482f89ecf3e18f785f81 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:15.485716 24445 raft_consensus.cc:3060] T bff14fa713b6482f89ecf3e18f785f81 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:15.487569 24377 raft_consensus.cc:2749] T e845188d32d2466a92eacdb66da16dba P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:15.500320 24362 raft_consensus.cc:359] T d2ddfc9daac54dc28d63b46ab1777bf3 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:15.501123 24362 raft_consensus.cc:385] T d2ddfc9daac54dc28d63b46ab1777bf3 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:15.501420 24362 raft_consensus.cc:740] T d2ddfc9daac54dc28d63b46ab1777bf3 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b39c386162de49aca92dbebee7f06ace, State: Initialized, Role: FOLLOWER
I20260709 13:09:15.502230 24362 consensus_queue.cc:260] T d2ddfc9daac54dc28d63b46ab1777bf3 P b39c386162de49aca92dbebee7f06ace [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:15.511054 24362 ts_tablet_manager.cc:1434] T d2ddfc9daac54dc28d63b46ab1777bf3 P b39c386162de49aca92dbebee7f06ace: Time spent starting tablet: real 0.031s	user 0.015s	sys 0.009s
I20260709 13:09:15.518487 24360 tablet_bootstrap.cc:654] T 352353d793574662ac966f335ae8cfbe P c0f503bf8bb94af8a2a1139db4e1c0f5: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:15.538017 24362 tablet_bootstrap.cc:492] T 1dcdde5516f54b19b11611ca9213415d P b39c386162de49aca92dbebee7f06ace: Bootstrap starting.
I20260709 13:09:15.546214 24361 tablet_bootstrap.cc:492] T d2ddfc9daac54dc28d63b46ab1777bf3 P f8d4657116f948038a0c73018238c3ba: No bootstrap required, opened a new log
I20260709 13:09:15.546797 24361 ts_tablet_manager.cc:1403] T d2ddfc9daac54dc28d63b46ab1777bf3 P f8d4657116f948038a0c73018238c3ba: Time spent bootstrapping tablet: real 0.184s	user 0.038s	sys 0.007s
I20260709 13:09:15.549819 24613 raft_consensus.cc:493] T d2ddfc9daac54dc28d63b46ab1777bf3 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.550390 24613 raft_consensus.cc:515] T d2ddfc9daac54dc28d63b46ab1777bf3 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:15.562939 24419 raft_consensus.cc:493] T e21ef2f479764142935dc2b1b7e87220 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.568512 24453 consensus_queue.cc:1048] T c9b7bd5d439d455a9173478e086439e8 P f8d4657116f948038a0c73018238c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:15.563884 24161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2ddfc9daac54dc28d63b46ab1777bf3" candidate_uuid: "b39c386162de49aca92dbebee7f06ace" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" is_pre_election: true
I20260709 13:09:15.568806 24237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2ddfc9daac54dc28d63b46ab1777bf3" candidate_uuid: "b39c386162de49aca92dbebee7f06ace" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8d4657116f948038a0c73018238c3ba" is_pre_election: true
I20260709 13:09:15.569410 24161 raft_consensus.cc:2468] T d2ddfc9daac54dc28d63b46ab1777bf3 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b39c386162de49aca92dbebee7f06ace in term 0.
I20260709 13:09:15.561657 24613 leader_election.cc:290] T d2ddfc9daac54dc28d63b46ab1777bf3 P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431), f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171)
W20260709 13:09:15.570585 24279 leader_election.cc:343] T d2ddfc9daac54dc28d63b46ab1777bf3 P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:15.571352 24362 tablet_bootstrap.cc:654] T 1dcdde5516f54b19b11611ca9213415d P b39c386162de49aca92dbebee7f06ace: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:15.568837 24419 raft_consensus.cc:515] T e21ef2f479764142935dc2b1b7e87220 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:15.571483 24280 leader_election.cc:304] T d2ddfc9daac54dc28d63b46ab1777bf3 P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b39c386162de49aca92dbebee7f06ace, c0f503bf8bb94af8a2a1139db4e1c0f5; no voters: f8d4657116f948038a0c73018238c3ba
I20260709 13:09:15.573416 24613 raft_consensus.cc:2804] T d2ddfc9daac54dc28d63b46ab1777bf3 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:15.573596 24419 leader_election.cc:290] T e21ef2f479764142935dc2b1b7e87220 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171), b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561)
I20260709 13:09:15.574059 24613 raft_consensus.cc:493] T d2ddfc9daac54dc28d63b46ab1777bf3 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:15.574784 24613 raft_consensus.cc:3060] T d2ddfc9daac54dc28d63b46ab1777bf3 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:15.581123 24361 raft_consensus.cc:359] T d2ddfc9daac54dc28d63b46ab1777bf3 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:15.585844 24361 raft_consensus.cc:385] T d2ddfc9daac54dc28d63b46ab1777bf3 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:15.586290 24361 raft_consensus.cc:740] T d2ddfc9daac54dc28d63b46ab1777bf3 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8d4657116f948038a0c73018238c3ba, State: Initialized, Role: FOLLOWER
I20260709 13:09:15.589597 24361 consensus_queue.cc:260] T d2ddfc9daac54dc28d63b46ab1777bf3 P f8d4657116f948038a0c73018238c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:15.588171 24445 raft_consensus.cc:515] T bff14fa713b6482f89ecf3e18f785f81 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:15.582274 24237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e21ef2f479764142935dc2b1b7e87220" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8d4657116f948038a0c73018238c3ba" is_pre_election: true
I20260709 13:09:15.599002 24313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e21ef2f479764142935dc2b1b7e87220" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace" is_pre_election: true
W20260709 13:09:15.600646 24056 leader_election.cc:343] T e21ef2f479764142935dc2b1b7e87220 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:15.605157 24055 leader_election.cc:343] T e21ef2f479764142935dc2b1b7e87220 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:15.605577 24361 ts_tablet_manager.cc:1434] T d2ddfc9daac54dc28d63b46ab1777bf3 P f8d4657116f948038a0c73018238c3ba: Time spent starting tablet: real 0.058s	user 0.008s	sys 0.000s
I20260709 13:09:15.612962 24055 leader_election.cc:304] T e21ef2f479764142935dc2b1b7e87220 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dea34817fcc148d78f090ef5fa72304f; no voters: b39c386162de49aca92dbebee7f06ace, f8d4657116f948038a0c73018238c3ba
I20260709 13:09:15.613530 24359 tablet_bootstrap.cc:492] T 25e4818a4e2e4c9c9f7a8467aa9ef881 P dea34817fcc148d78f090ef5fa72304f: No bootstrap required, opened a new log
I20260709 13:09:15.614015 24419 raft_consensus.cc:2749] T e21ef2f479764142935dc2b1b7e87220 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:15.614590 24584 raft_consensus.cc:493] T 0dbd3426f3e14ef28e7b0b6c4c7de6a2 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.615444 24584 raft_consensus.cc:515] T 0dbd3426f3e14ef28e7b0b6c4c7de6a2 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:15.619659 24455 consensus_queue.cc:1048] T c9b7bd5d439d455a9173478e086439e8 P f8d4657116f948038a0c73018238c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:15.626955 24377 raft_consensus.cc:493] T 687efb9bbbd04b0eb768bfa6543380c3 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.627583 24377 raft_consensus.cc:515] T 687efb9bbbd04b0eb768bfa6543380c3 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:15.628916 24613 raft_consensus.cc:515] T d2ddfc9daac54dc28d63b46ab1777bf3 P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:15.630710 24377 leader_election.cc:290] T 687efb9bbbd04b0eb768bfa6543380c3 P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343), c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431)
I20260709 13:09:15.632555 24163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd3426f3e14ef28e7b0b6c4c7de6a2" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" is_pre_election: true
I20260709 13:09:15.633420 24362 tablet_bootstrap.cc:492] T 1dcdde5516f54b19b11611ca9213415d P b39c386162de49aca92dbebee7f06ace: No bootstrap required, opened a new log
I20260709 13:09:15.633946 24362 ts_tablet_manager.cc:1403] T 1dcdde5516f54b19b11611ca9213415d P b39c386162de49aca92dbebee7f06ace: Time spent bootstrapping tablet: real 0.109s	user 0.019s	sys 0.008s
W20260709 13:09:15.634310 24057 leader_election.cc:343] T 0dbd3426f3e14ef28e7b0b6c4c7de6a2 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:15.618232 24584 leader_election.cc:290] T 0dbd3426f3e14ef28e7b0b6c4c7de6a2 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561), c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431)
I20260709 13:09:15.636727 24362 raft_consensus.cc:359] T 1dcdde5516f54b19b11611ca9213415d P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:15.651877 24377 raft_consensus.cc:493] T 5bc4e407c8b04739aa0290922bfdbed4 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.652827 24239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bff14fa713b6482f89ecf3e18f785f81" candidate_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8d4657116f948038a0c73018238c3ba"
W20260709 13:09:15.658658 24131 leader_election.cc:343] T bff14fa713b6482f89ecf3e18f785f81 P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:15.659031 24572 raft_consensus.cc:515] T 5bc4e407c8b04739aa0290922bfdbed4 P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:15.660000 24362 raft_consensus.cc:385] T 1dcdde5516f54b19b11611ca9213415d P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:15.660565 24362 raft_consensus.cc:740] T 1dcdde5516f54b19b11611ca9213415d P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b39c386162de49aca92dbebee7f06ace, State: Initialized, Role: FOLLOWER
I20260709 13:09:15.661681 24564 consensus_queue.cc:1048] T e845188d32d2466a92eacdb66da16dba P c0f503bf8bb94af8a2a1139db4e1c0f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:15.662233 24362 consensus_queue.cc:260] T 1dcdde5516f54b19b11611ca9213415d P b39c386162de49aca92dbebee7f06ace [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:15.643285 24361 tablet_bootstrap.cc:492] T b53fa043603b41be836d4ccb5c248df8 P f8d4657116f948038a0c73018238c3ba: Bootstrap starting.
I20260709 13:09:15.647158 24163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687efb9bbbd04b0eb768bfa6543380c3" candidate_uuid: "b39c386162de49aca92dbebee7f06ace" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" is_pre_election: true
I20260709 13:09:15.637929 24313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd3426f3e14ef28e7b0b6c4c7de6a2" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace" is_pre_election: true
I20260709 13:09:15.642087 24088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687efb9bbbd04b0eb768bfa6543380c3" candidate_uuid: "b39c386162de49aca92dbebee7f06ace" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dea34817fcc148d78f090ef5fa72304f" is_pre_election: true
I20260709 13:09:15.665184 24088 raft_consensus.cc:2393] T 687efb9bbbd04b0eb768bfa6543380c3 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b39c386162de49aca92dbebee7f06ace in current term 1: Already voted for candidate c0f503bf8bb94af8a2a1139db4e1c0f5 in this term.
W20260709 13:09:15.667413 24055 leader_election.cc:343] T 0dbd3426f3e14ef28e7b0b6c4c7de6a2 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:15.668174 24055 leader_election.cc:304] T 0dbd3426f3e14ef28e7b0b6c4c7de6a2 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dea34817fcc148d78f090ef5fa72304f; no voters: b39c386162de49aca92dbebee7f06ace, c0f503bf8bb94af8a2a1139db4e1c0f5
I20260709 13:09:15.661635 24377 raft_consensus.cc:515] T 5bc4e407c8b04739aa0290922bfdbed4 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:15.670018 24419 raft_consensus.cc:2749] T 0dbd3426f3e14ef28e7b0b6c4c7de6a2 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:15.671983 24239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc4e407c8b04739aa0290922bfdbed4" candidate_uuid: "b39c386162de49aca92dbebee7f06ace" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8d4657116f948038a0c73018238c3ba" is_pre_election: true
I20260709 13:09:15.672361 24313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc4e407c8b04739aa0290922bfdbed4" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace"
I20260709 13:09:15.673071 24239 raft_consensus.cc:2393] T 5bc4e407c8b04739aa0290922bfdbed4 P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b39c386162de49aca92dbebee7f06ace in current term 1: Already voted for candidate f8d4657116f948038a0c73018238c3ba in this term.
I20260709 13:09:15.673188 24313 raft_consensus.cc:3060] T 5bc4e407c8b04739aa0290922bfdbed4 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:15.646993 24089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bff14fa713b6482f89ecf3e18f785f81" candidate_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dea34817fcc148d78f090ef5fa72304f"
I20260709 13:09:15.640776 24445 leader_election.cc:290] T bff14fa713b6482f89ecf3e18f785f81 P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 1 election: Requested vote from peers dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343), f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171)
I20260709 13:09:15.614061 24359 ts_tablet_manager.cc:1403] T 25e4818a4e2e4c9c9f7a8467aa9ef881 P dea34817fcc148d78f090ef5fa72304f: Time spent bootstrapping tablet: real 0.152s	user 0.012s	sys 0.001s
I20260709 13:09:15.675127 24377 leader_election.cc:290] T 5bc4e407c8b04739aa0290922bfdbed4 P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171), dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343)
I20260709 13:09:15.677075 24089 raft_consensus.cc:3060] T bff14fa713b6482f89ecf3e18f785f81 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:15.692548 24314 raft_consensus.cc:3060] T 687efb9bbbd04b0eb768bfa6543380c3 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:15.694527 24362 ts_tablet_manager.cc:1434] T 1dcdde5516f54b19b11611ca9213415d P b39c386162de49aca92dbebee7f06ace: Time spent starting tablet: real 0.060s	user 0.004s	sys 0.004s
I20260709 13:09:15.677181 24280 leader_election.cc:304] T 687efb9bbbd04b0eb768bfa6543380c3 P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b39c386162de49aca92dbebee7f06ace; no voters: c0f503bf8bb94af8a2a1139db4e1c0f5, dea34817fcc148d78f090ef5fa72304f
I20260709 13:09:15.698665 24362 tablet_bootstrap.cc:492] T 0dbd3426f3e14ef28e7b0b6c4c7de6a2 P b39c386162de49aca92dbebee7f06ace: Bootstrap starting.
I20260709 13:09:15.677883 24359 raft_consensus.cc:359] T 25e4818a4e2e4c9c9f7a8467aa9ef881 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:15.701618 24359 raft_consensus.cc:385] T 25e4818a4e2e4c9c9f7a8467aa9ef881 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:15.682785 24360 tablet_bootstrap.cc:492] T 352353d793574662ac966f335ae8cfbe P c0f503bf8bb94af8a2a1139db4e1c0f5: No bootstrap required, opened a new log
I20260709 13:09:15.702220 24360 ts_tablet_manager.cc:1403] T 352353d793574662ac966f335ae8cfbe P c0f503bf8bb94af8a2a1139db4e1c0f5: Time spent bootstrapping tablet: real 0.228s	user 0.024s	sys 0.031s
I20260709 13:09:15.702320 24610 raft_consensus.cc:2749] T 687efb9bbbd04b0eb768bfa6543380c3 P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:15.703248 24163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2ddfc9daac54dc28d63b46ab1777bf3" candidate_uuid: "b39c386162de49aca92dbebee7f06ace" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5"
I20260709 13:09:15.684767 24613 leader_election.cc:290] T d2ddfc9daac54dc28d63b46ab1777bf3 P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 1 election: Requested vote from peers c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431), f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171)
I20260709 13:09:15.703970 24163 raft_consensus.cc:3060] T d2ddfc9daac54dc28d63b46ab1777bf3 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:15.686065 24239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2ddfc9daac54dc28d63b46ab1777bf3" candidate_uuid: "b39c386162de49aca92dbebee7f06ace" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8d4657116f948038a0c73018238c3ba"
I20260709 13:09:15.704861 24239 raft_consensus.cc:3060] T d2ddfc9daac54dc28d63b46ab1777bf3 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:15.705892 24360 raft_consensus.cc:359] T 352353d793574662ac966f335ae8cfbe P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:15.712958 24360 raft_consensus.cc:385] T 352353d793574662ac966f335ae8cfbe P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:15.680286 24090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc4e407c8b04739aa0290922bfdbed4" candidate_uuid: "b39c386162de49aca92dbebee7f06ace" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dea34817fcc148d78f090ef5fa72304f" is_pre_election: true
I20260709 13:09:15.713519 24090 raft_consensus.cc:2468] T 5bc4e407c8b04739aa0290922bfdbed4 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b39c386162de49aca92dbebee7f06ace in term 0.
I20260709 13:09:15.678941 24091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc4e407c8b04739aa0290922bfdbed4" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dea34817fcc148d78f090ef5fa72304f"
I20260709 13:09:15.714641 24091 raft_consensus.cc:3060] T 5bc4e407c8b04739aa0290922bfdbed4 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:15.683735 24313 raft_consensus.cc:2468] T 5bc4e407c8b04739aa0290922bfdbed4 P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8d4657116f948038a0c73018238c3ba in term 1.
I20260709 13:09:15.712484 24359 raft_consensus.cc:740] T 25e4818a4e2e4c9c9f7a8467aa9ef881 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dea34817fcc148d78f090ef5fa72304f, State: Initialized, Role: FOLLOWER
I20260709 13:09:15.701318 24563 consensus_queue.cc:1048] T e845188d32d2466a92eacdb66da16dba P c0f503bf8bb94af8a2a1139db4e1c0f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:15.716323 24360 raft_consensus.cc:740] T 352353d793574662ac966f335ae8cfbe P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0f503bf8bb94af8a2a1139db4e1c0f5, State: Initialized, Role: FOLLOWER
I20260709 13:09:15.717375 24163 raft_consensus.cc:2468] T d2ddfc9daac54dc28d63b46ab1777bf3 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b39c386162de49aca92dbebee7f06ace in term 1.
I20260709 13:09:15.717196 24360 consensus_queue.cc:260] T 352353d793574662ac966f335ae8cfbe P c0f503bf8bb94af8a2a1139db4e1c0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:15.717999 24563 consensus_queue.cc:1048] T 687efb9bbbd04b0eb768bfa6543380c3 P c0f503bf8bb94af8a2a1139db4e1c0f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:15.725445 24360 ts_tablet_manager.cc:1434] T 352353d793574662ac966f335ae8cfbe P c0f503bf8bb94af8a2a1139db4e1c0f5: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.002s
I20260709 13:09:15.731598 24360 tablet_bootstrap.cc:492] T ab4ea1ceb7a443be94ec74cd88c9bf47 P c0f503bf8bb94af8a2a1139db4e1c0f5: Bootstrap starting.
I20260709 13:09:15.718084 24359 consensus_queue.cc:260] T 25e4818a4e2e4c9c9f7a8467aa9ef881 P dea34817fcc148d78f090ef5fa72304f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:15.718273 24280 leader_election.cc:304] T 5bc4e407c8b04739aa0290922bfdbed4 P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b39c386162de49aca92dbebee7f06ace, dea34817fcc148d78f090ef5fa72304f; no voters: f8d4657116f948038a0c73018238c3ba
I20260709 13:09:15.735608 24613 raft_consensus.cc:2764] T 5bc4e407c8b04739aa0290922bfdbed4 P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:09:15.738133 24280 leader_election.cc:304] T d2ddfc9daac54dc28d63b46ab1777bf3 P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b39c386162de49aca92dbebee7f06ace, c0f503bf8bb94af8a2a1139db4e1c0f5; no voters: 
I20260709 13:09:15.661707 24572 leader_election.cc:290] T 5bc4e407c8b04739aa0290922bfdbed4 P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 election: Requested vote from peers b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561), dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343)
I20260709 13:09:15.740389 24613 raft_consensus.cc:2804] T d2ddfc9daac54dc28d63b46ab1777bf3 P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:15.740468 24089 raft_consensus.cc:2468] T bff14fa713b6482f89ecf3e18f785f81 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0f503bf8bb94af8a2a1139db4e1c0f5 in term 1.
I20260709 13:09:15.740993 24613 raft_consensus.cc:697] T d2ddfc9daac54dc28d63b46ab1777bf3 P b39c386162de49aca92dbebee7f06ace [term 1 LEADER]: Becoming Leader. State: Replica: b39c386162de49aca92dbebee7f06ace, State: Running, Role: LEADER
I20260709 13:09:15.741600 24132 leader_election.cc:304] T bff14fa713b6482f89ecf3e18f785f81 P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c0f503bf8bb94af8a2a1139db4e1c0f5, dea34817fcc148d78f090ef5fa72304f; no voters: f8d4657116f948038a0c73018238c3ba
I20260709 13:09:15.743024 24564 raft_consensus.cc:2804] T bff14fa713b6482f89ecf3e18f785f81 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:15.743537 24564 raft_consensus.cc:697] T bff14fa713b6482f89ecf3e18f785f81 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 LEADER]: Becoming Leader. State: Replica: c0f503bf8bb94af8a2a1139db4e1c0f5, State: Running, Role: LEADER
I20260709 13:09:15.741940 24613 consensus_queue.cc:237] T d2ddfc9daac54dc28d63b46ab1777bf3 P b39c386162de49aca92dbebee7f06ace [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:15.744416 24564 consensus_queue.cc:237] T bff14fa713b6482f89ecf3e18f785f81 P c0f503bf8bb94af8a2a1139db4e1c0f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:15.745931 24360 tablet_bootstrap.cc:654] T ab4ea1ceb7a443be94ec74cd88c9bf47 P c0f503bf8bb94af8a2a1139db4e1c0f5: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:15.754163 24359 ts_tablet_manager.cc:1434] T 25e4818a4e2e4c9c9f7a8467aa9ef881 P dea34817fcc148d78f090ef5fa72304f: Time spent starting tablet: real 0.079s	user 0.006s	sys 0.001s
I20260709 13:09:15.755302 24359 tablet_bootstrap.cc:492] T e280ec3a0e394065aca766e4f8bef46d P dea34817fcc148d78f090ef5fa72304f: Bootstrap starting.
I20260709 13:09:15.757138 24091 raft_consensus.cc:2468] T 5bc4e407c8b04739aa0290922bfdbed4 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8d4657116f948038a0c73018238c3ba in term 1.
I20260709 13:09:15.720129 24239 raft_consensus.cc:2468] T d2ddfc9daac54dc28d63b46ab1777bf3 P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b39c386162de49aca92dbebee7f06ace in term 1.
I20260709 13:09:15.722335 24204 leader_election.cc:304] T 5bc4e407c8b04739aa0290922bfdbed4 P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b39c386162de49aca92dbebee7f06ace, f8d4657116f948038a0c73018238c3ba; no voters: 
I20260709 13:09:15.718731 24361 tablet_bootstrap.cc:654] T b53fa043603b41be836d4ccb5c248df8 P f8d4657116f948038a0c73018238c3ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:15.765851 24572 raft_consensus.cc:2804] T 5bc4e407c8b04739aa0290922bfdbed4 P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:15.729990 24362 tablet_bootstrap.cc:654] T 0dbd3426f3e14ef28e7b0b6c4c7de6a2 P b39c386162de49aca92dbebee7f06ace: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:15.769207 24572 raft_consensus.cc:697] T 5bc4e407c8b04739aa0290922bfdbed4 P f8d4657116f948038a0c73018238c3ba [term 1 LEADER]: Becoming Leader. State: Replica: f8d4657116f948038a0c73018238c3ba, State: Running, Role: LEADER
I20260709 13:09:15.770138 24572 consensus_queue.cc:237] T 5bc4e407c8b04739aa0290922bfdbed4 P f8d4657116f948038a0c73018238c3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:15.778079 24563 raft_consensus.cc:493] T 1dcdde5516f54b19b11611ca9213415d P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.778909 24563 raft_consensus.cc:515] T 1dcdde5516f54b19b11611ca9213415d P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:15.783136 24563 leader_election.cc:290] T 1dcdde5516f54b19b11611ca9213415d P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561), dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343)
I20260709 13:09:15.784406 24091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcdde5516f54b19b11611ca9213415d" candidate_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dea34817fcc148d78f090ef5fa72304f" is_pre_election: true
I20260709 13:09:15.785193 24091 raft_consensus.cc:2468] T 1dcdde5516f54b19b11611ca9213415d P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0f503bf8bb94af8a2a1139db4e1c0f5 in term 0.
I20260709 13:09:15.786442 24132 leader_election.cc:304] T 1dcdde5516f54b19b11611ca9213415d P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0f503bf8bb94af8a2a1139db4e1c0f5, dea34817fcc148d78f090ef5fa72304f; no voters: 
I20260709 13:09:15.786618 24314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcdde5516f54b19b11611ca9213415d" candidate_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace" is_pre_election: true
I20260709 13:09:15.787407 24563 raft_consensus.cc:2804] T 1dcdde5516f54b19b11611ca9213415d P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:15.787606 24314 raft_consensus.cc:2468] T 1dcdde5516f54b19b11611ca9213415d P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0f503bf8bb94af8a2a1139db4e1c0f5 in term 0.
I20260709 13:09:15.787858 24563 raft_consensus.cc:493] T 1dcdde5516f54b19b11611ca9213415d P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:15.788869 24563 raft_consensus.cc:3060] T 1dcdde5516f54b19b11611ca9213415d P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:15.793569 24360 tablet_bootstrap.cc:492] T ab4ea1ceb7a443be94ec74cd88c9bf47 P c0f503bf8bb94af8a2a1139db4e1c0f5: No bootstrap required, opened a new log
I20260709 13:09:15.794281 24360 ts_tablet_manager.cc:1403] T ab4ea1ceb7a443be94ec74cd88c9bf47 P c0f503bf8bb94af8a2a1139db4e1c0f5: Time spent bootstrapping tablet: real 0.063s	user 0.015s	sys 0.012s
I20260709 13:09:15.795917 23988 catalog_manager.cc:5697] T bff14fa713b6482f89ecf3e18f785f81 P c0f503bf8bb94af8a2a1139db4e1c0f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66). New cstate: current_term: 1 leader_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:15.797683 24360 raft_consensus.cc:359] T ab4ea1ceb7a443be94ec74cd88c9bf47 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:15.808445 24564 consensus_queue.cc:1048] T 687efb9bbbd04b0eb768bfa6543380c3 P c0f503bf8bb94af8a2a1139db4e1c0f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:15.812520 24360 raft_consensus.cc:385] T ab4ea1ceb7a443be94ec74cd88c9bf47 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:15.812971 24360 raft_consensus.cc:740] T ab4ea1ceb7a443be94ec74cd88c9bf47 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0f503bf8bb94af8a2a1139db4e1c0f5, State: Initialized, Role: FOLLOWER
I20260709 13:09:15.813640 24360 consensus_queue.cc:260] T ab4ea1ceb7a443be94ec74cd88c9bf47 P c0f503bf8bb94af8a2a1139db4e1c0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:15.814366 24362 tablet_bootstrap.cc:492] T 0dbd3426f3e14ef28e7b0b6c4c7de6a2 P b39c386162de49aca92dbebee7f06ace: No bootstrap required, opened a new log
I20260709 13:09:15.814915 24362 ts_tablet_manager.cc:1403] T 0dbd3426f3e14ef28e7b0b6c4c7de6a2 P b39c386162de49aca92dbebee7f06ace: Time spent bootstrapping tablet: real 0.117s	user 0.016s	sys 0.015s
I20260709 13:09:15.817703 24362 raft_consensus.cc:359] T 0dbd3426f3e14ef28e7b0b6c4c7de6a2 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:15.820514 24361 tablet_bootstrap.cc:492] T b53fa043603b41be836d4ccb5c248df8 P f8d4657116f948038a0c73018238c3ba: No bootstrap required, opened a new log
I20260709 13:09:15.821055 24361 ts_tablet_manager.cc:1403] T b53fa043603b41be836d4ccb5c248df8 P f8d4657116f948038a0c73018238c3ba: Time spent bootstrapping tablet: real 0.178s	user 0.011s	sys 0.020s
I20260709 13:09:15.815693 24563 raft_consensus.cc:515] T 1dcdde5516f54b19b11611ca9213415d P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:15.818408 24362 raft_consensus.cc:385] T 0dbd3426f3e14ef28e7b0b6c4c7de6a2 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:15.821723 24360 ts_tablet_manager.cc:1434] T ab4ea1ceb7a443be94ec74cd88c9bf47 P c0f503bf8bb94af8a2a1139db4e1c0f5: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.000s
I20260709 13:09:15.825973 24563 leader_election.cc:290] T 1dcdde5516f54b19b11611ca9213415d P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 1 election: Requested vote from peers b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561), dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343)
I20260709 13:09:15.827044 24360 tablet_bootstrap.cc:492] T 03e06f957f794ca696ddc7207eeabff0 P c0f503bf8bb94af8a2a1139db4e1c0f5: Bootstrap starting.
I20260709 13:09:15.823829 24361 raft_consensus.cc:359] T b53fa043603b41be836d4ccb5c248df8 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:15.830396 23986 catalog_manager.cc:5697] T 5bc4e407c8b04739aa0290922bfdbed4 P f8d4657116f948038a0c73018238c3ba reported cstate change: term changed from 0 to 1, leader changed from <none> to f8d4657116f948038a0c73018238c3ba (127.14.180.67). New cstate: current_term: 1 leader_uuid: "f8d4657116f948038a0c73018238c3ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:15.824092 24362 raft_consensus.cc:740] T 0dbd3426f3e14ef28e7b0b6c4c7de6a2 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b39c386162de49aca92dbebee7f06ace, State: Initialized, Role: FOLLOWER
I20260709 13:09:15.832096 24314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcdde5516f54b19b11611ca9213415d" candidate_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace"
I20260709 13:09:15.831393 24361 raft_consensus.cc:385] T b53fa043603b41be836d4ccb5c248df8 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:15.832908 24361 raft_consensus.cc:740] T b53fa043603b41be836d4ccb5c248df8 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8d4657116f948038a0c73018238c3ba, State: Initialized, Role: FOLLOWER
I20260709 13:09:15.832959 24314 raft_consensus.cc:3060] T 1dcdde5516f54b19b11611ca9213415d P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:15.833626 24361 consensus_queue.cc:260] T b53fa043603b41be836d4ccb5c248df8 P f8d4657116f948038a0c73018238c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:15.825891 24091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcdde5516f54b19b11611ca9213415d" candidate_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dea34817fcc148d78f090ef5fa72304f"
I20260709 13:09:15.834863 24359 tablet_bootstrap.cc:654] T e280ec3a0e394065aca766e4f8bef46d P dea34817fcc148d78f090ef5fa72304f: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:15.835047 24091 raft_consensus.cc:3060] T 1dcdde5516f54b19b11611ca9213415d P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:15.835848 24361 ts_tablet_manager.cc:1434] T b53fa043603b41be836d4ccb5c248df8 P f8d4657116f948038a0c73018238c3ba: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 13:09:15.836992 24361 tablet_bootstrap.cc:492] T bff14fa713b6482f89ecf3e18f785f81 P f8d4657116f948038a0c73018238c3ba: Bootstrap starting.
I20260709 13:09:15.843125 24361 tablet_bootstrap.cc:654] T bff14fa713b6482f89ecf3e18f785f81 P f8d4657116f948038a0c73018238c3ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:15.844820 24091 raft_consensus.cc:2468] T 1dcdde5516f54b19b11611ca9213415d P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0f503bf8bb94af8a2a1139db4e1c0f5 in term 1.
I20260709 13:09:15.832479 24362 consensus_queue.cc:260] T 0dbd3426f3e14ef28e7b0b6c4c7de6a2 P b39c386162de49aca92dbebee7f06ace [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:15.847069 24132 leader_election.cc:304] T 1dcdde5516f54b19b11611ca9213415d P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0f503bf8bb94af8a2a1139db4e1c0f5, dea34817fcc148d78f090ef5fa72304f; no voters: 
I20260709 13:09:15.848018 24563 raft_consensus.cc:2804] T 1dcdde5516f54b19b11611ca9213415d P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:15.849841 24362 ts_tablet_manager.cc:1434] T 0dbd3426f3e14ef28e7b0b6c4c7de6a2 P b39c386162de49aca92dbebee7f06ace: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.000s
I20260709 13:09:15.859045 24362 tablet_bootstrap.cc:492] T 352353d793574662ac966f335ae8cfbe P b39c386162de49aca92dbebee7f06ace: Bootstrap starting.
I20260709 13:09:15.856436 24419 raft_consensus.cc:493] T 25e4818a4e2e4c9c9f7a8467aa9ef881 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.860760 24419 raft_consensus.cc:515] T 25e4818a4e2e4c9c9f7a8467aa9ef881 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:15.863329 24419 leader_election.cc:290] T 25e4818a4e2e4c9c9f7a8467aa9ef881 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431), f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171)
I20260709 13:09:15.864616 24163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e4818a4e2e4c9c9f7a8467aa9ef881" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" is_pre_election: true
I20260709 13:09:15.865042 24239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e4818a4e2e4c9c9f7a8467aa9ef881" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8d4657116f948038a0c73018238c3ba" is_pre_election: true
W20260709 13:09:15.867267 24057 leader_election.cc:343] T 25e4818a4e2e4c9c9f7a8467aa9ef881 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:15.868359 24056 leader_election.cc:343] T 25e4818a4e2e4c9c9f7a8467aa9ef881 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:15.868808 24056 leader_election.cc:304] T 25e4818a4e2e4c9c9f7a8467aa9ef881 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dea34817fcc148d78f090ef5fa72304f; no voters: c0f503bf8bb94af8a2a1139db4e1c0f5, f8d4657116f948038a0c73018238c3ba
I20260709 13:09:15.872491 24419 raft_consensus.cc:2749] T 25e4818a4e2e4c9c9f7a8467aa9ef881 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:15.855186 24563 raft_consensus.cc:697] T 1dcdde5516f54b19b11611ca9213415d P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 LEADER]: Becoming Leader. State: Replica: c0f503bf8bb94af8a2a1139db4e1c0f5, State: Running, Role: LEADER
I20260709 13:09:15.876878 24314 raft_consensus.cc:2468] T 1dcdde5516f54b19b11611ca9213415d P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0f503bf8bb94af8a2a1139db4e1c0f5 in term 1.
I20260709 13:09:15.877081 24563 consensus_queue.cc:237] T 1dcdde5516f54b19b11611ca9213415d P c0f503bf8bb94af8a2a1139db4e1c0f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:15.885893 24361 tablet_bootstrap.cc:492] T bff14fa713b6482f89ecf3e18f785f81 P f8d4657116f948038a0c73018238c3ba: No bootstrap required, opened a new log
I20260709 13:09:15.886281 24360 tablet_bootstrap.cc:654] T 03e06f957f794ca696ddc7207eeabff0 P c0f503bf8bb94af8a2a1139db4e1c0f5: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:15.886349 24362 tablet_bootstrap.cc:654] T 352353d793574662ac966f335ae8cfbe P b39c386162de49aca92dbebee7f06ace: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:15.886447 24361 ts_tablet_manager.cc:1403] T bff14fa713b6482f89ecf3e18f785f81 P f8d4657116f948038a0c73018238c3ba: Time spent bootstrapping tablet: real 0.050s	user 0.011s	sys 0.019s
I20260709 13:09:15.890168 24361 raft_consensus.cc:359] T bff14fa713b6482f89ecf3e18f785f81 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:15.890877 24361 raft_consensus.cc:385] T bff14fa713b6482f89ecf3e18f785f81 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:15.891160 24361 raft_consensus.cc:740] T bff14fa713b6482f89ecf3e18f785f81 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8d4657116f948038a0c73018238c3ba, State: Initialized, Role: FOLLOWER
I20260709 13:09:15.892004 24361 consensus_queue.cc:260] T bff14fa713b6482f89ecf3e18f785f81 P f8d4657116f948038a0c73018238c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:15.894577 24361 ts_tablet_manager.cc:1434] T bff14fa713b6482f89ecf3e18f785f81 P f8d4657116f948038a0c73018238c3ba: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:09:15.895684 24361 tablet_bootstrap.cc:492] T 352353d793574662ac966f335ae8cfbe P f8d4657116f948038a0c73018238c3ba: Bootstrap starting.
I20260709 13:09:15.898669 24359 tablet_bootstrap.cc:492] T e280ec3a0e394065aca766e4f8bef46d P dea34817fcc148d78f090ef5fa72304f: No bootstrap required, opened a new log
I20260709 13:09:15.899209 24359 ts_tablet_manager.cc:1403] T e280ec3a0e394065aca766e4f8bef46d P dea34817fcc148d78f090ef5fa72304f: Time spent bootstrapping tablet: real 0.144s	user 0.004s	sys 0.007s
I20260709 13:09:15.902079 24359 raft_consensus.cc:359] T e280ec3a0e394065aca766e4f8bef46d P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:15.902689 24361 tablet_bootstrap.cc:654] T 352353d793574662ac966f335ae8cfbe P f8d4657116f948038a0c73018238c3ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:15.902855 24359 raft_consensus.cc:385] T e280ec3a0e394065aca766e4f8bef46d P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:15.903154 24359 raft_consensus.cc:740] T e280ec3a0e394065aca766e4f8bef46d P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dea34817fcc148d78f090ef5fa72304f, State: Initialized, Role: FOLLOWER
I20260709 13:09:15.903896 24359 consensus_queue.cc:260] T e280ec3a0e394065aca766e4f8bef46d P dea34817fcc148d78f090ef5fa72304f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:15.919708 24359 ts_tablet_manager.cc:1434] T e280ec3a0e394065aca766e4f8bef46d P dea34817fcc148d78f090ef5fa72304f: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.001s
I20260709 13:09:15.920521 24360 tablet_bootstrap.cc:492] T 03e06f957f794ca696ddc7207eeabff0 P c0f503bf8bb94af8a2a1139db4e1c0f5: No bootstrap required, opened a new log
I20260709 13:09:15.921060 24360 ts_tablet_manager.cc:1403] T 03e06f957f794ca696ddc7207eeabff0 P c0f503bf8bb94af8a2a1139db4e1c0f5: Time spent bootstrapping tablet: real 0.094s	user 0.006s	sys 0.004s
I20260709 13:09:15.921224 24359 tablet_bootstrap.cc:492] T 03e06f957f794ca696ddc7207eeabff0 P dea34817fcc148d78f090ef5fa72304f: Bootstrap starting.
I20260709 13:09:15.923838 24360 raft_consensus.cc:359] T 03e06f957f794ca696ddc7207eeabff0 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:15.924520 24360 raft_consensus.cc:385] T 03e06f957f794ca696ddc7207eeabff0 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:15.924795 24360 raft_consensus.cc:740] T 03e06f957f794ca696ddc7207eeabff0 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0f503bf8bb94af8a2a1139db4e1c0f5, State: Initialized, Role: FOLLOWER
I20260709 13:09:15.928510 24360 consensus_queue.cc:260] T 03e06f957f794ca696ddc7207eeabff0 P c0f503bf8bb94af8a2a1139db4e1c0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:15.929612 23986 catalog_manager.cc:5697] T 1dcdde5516f54b19b11611ca9213415d P c0f503bf8bb94af8a2a1139db4e1c0f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66). New cstate: current_term: 1 leader_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:15.930927 24360 ts_tablet_manager.cc:1434] T 03e06f957f794ca696ddc7207eeabff0 P c0f503bf8bb94af8a2a1139db4e1c0f5: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.004s
I20260709 13:09:15.932884 24360 tablet_bootstrap.cc:492] T 518a35ead60847e98c0b76330b999d6f P c0f503bf8bb94af8a2a1139db4e1c0f5: Bootstrap starting.
I20260709 13:09:15.934487 24362 tablet_bootstrap.cc:492] T 352353d793574662ac966f335ae8cfbe P b39c386162de49aca92dbebee7f06ace: No bootstrap required, opened a new log
I20260709 13:09:15.935160 24362 ts_tablet_manager.cc:1403] T 352353d793574662ac966f335ae8cfbe P b39c386162de49aca92dbebee7f06ace: Time spent bootstrapping tablet: real 0.076s	user 0.021s	sys 0.010s
I20260709 13:09:15.938194 24362 raft_consensus.cc:359] T 352353d793574662ac966f335ae8cfbe P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:15.939036 24362 raft_consensus.cc:385] T 352353d793574662ac966f335ae8cfbe P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:15.939196 24360 tablet_bootstrap.cc:654] T 518a35ead60847e98c0b76330b999d6f P c0f503bf8bb94af8a2a1139db4e1c0f5: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:15.939404 24362 raft_consensus.cc:740] T 352353d793574662ac966f335ae8cfbe P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b39c386162de49aca92dbebee7f06ace, State: Initialized, Role: FOLLOWER
I20260709 13:09:15.940469 24362 consensus_queue.cc:260] T 352353d793574662ac966f335ae8cfbe P b39c386162de49aca92dbebee7f06ace [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:15.942243 24361 tablet_bootstrap.cc:492] T 352353d793574662ac966f335ae8cfbe P f8d4657116f948038a0c73018238c3ba: No bootstrap required, opened a new log
I20260709 13:09:15.944872 24361 ts_tablet_manager.cc:1403] T 352353d793574662ac966f335ae8cfbe P f8d4657116f948038a0c73018238c3ba: Time spent bootstrapping tablet: real 0.049s	user 0.010s	sys 0.004s
I20260709 13:09:15.947746 24361 raft_consensus.cc:359] T 352353d793574662ac966f335ae8cfbe P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:15.948432 24361 raft_consensus.cc:385] T 352353d793574662ac966f335ae8cfbe P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:15.948709 24361 raft_consensus.cc:740] T 352353d793574662ac966f335ae8cfbe P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8d4657116f948038a0c73018238c3ba, State: Initialized, Role: FOLLOWER
I20260709 13:09:15.949353 24361 consensus_queue.cc:260] T 352353d793574662ac966f335ae8cfbe P f8d4657116f948038a0c73018238c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:15.943903 24362 ts_tablet_manager.cc:1434] T 352353d793574662ac966f335ae8cfbe P b39c386162de49aca92dbebee7f06ace: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.004s
I20260709 13:09:15.951572 24362 tablet_bootstrap.cc:492] T e21ef2f479764142935dc2b1b7e87220 P b39c386162de49aca92dbebee7f06ace: Bootstrap starting.
I20260709 13:09:15.958640 24362 tablet_bootstrap.cc:654] T e21ef2f479764142935dc2b1b7e87220 P b39c386162de49aca92dbebee7f06ace: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:15.962589 24361 ts_tablet_manager.cc:1434] T 352353d793574662ac966f335ae8cfbe P f8d4657116f948038a0c73018238c3ba: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.001s
I20260709 13:09:15.963191 23985 catalog_manager.cc:5697] T d2ddfc9daac54dc28d63b46ab1777bf3 P b39c386162de49aca92dbebee7f06ace reported cstate change: term changed from 0 to 1, leader changed from <none> to b39c386162de49aca92dbebee7f06ace (127.14.180.68). New cstate: current_term: 1 leader_uuid: "b39c386162de49aca92dbebee7f06ace" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:15.964264 24361 tablet_bootstrap.cc:492] T ab4ea1ceb7a443be94ec74cd88c9bf47 P f8d4657116f948038a0c73018238c3ba: Bootstrap starting.
I20260709 13:09:15.970711 24361 tablet_bootstrap.cc:654] T ab4ea1ceb7a443be94ec74cd88c9bf47 P f8d4657116f948038a0c73018238c3ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:15.991453 24359 tablet_bootstrap.cc:654] T 03e06f957f794ca696ddc7207eeabff0 P dea34817fcc148d78f090ef5fa72304f: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:15.997663 24360 tablet_bootstrap.cc:492] T 518a35ead60847e98c0b76330b999d6f P c0f503bf8bb94af8a2a1139db4e1c0f5: No bootstrap required, opened a new log
I20260709 13:09:15.998186 24360 ts_tablet_manager.cc:1403] T 518a35ead60847e98c0b76330b999d6f P c0f503bf8bb94af8a2a1139db4e1c0f5: Time spent bootstrapping tablet: real 0.066s	user 0.035s	sys 0.028s
I20260709 13:09:16.002903 24361 tablet_bootstrap.cc:492] T ab4ea1ceb7a443be94ec74cd88c9bf47 P f8d4657116f948038a0c73018238c3ba: No bootstrap required, opened a new log
I20260709 13:09:16.003764 24359 tablet_bootstrap.cc:492] T 03e06f957f794ca696ddc7207eeabff0 P dea34817fcc148d78f090ef5fa72304f: No bootstrap required, opened a new log
I20260709 13:09:16.004287 24359 ts_tablet_manager.cc:1403] T 03e06f957f794ca696ddc7207eeabff0 P dea34817fcc148d78f090ef5fa72304f: Time spent bootstrapping tablet: real 0.083s	user 0.010s	sys 0.001s
I20260709 13:09:16.005237 24361 ts_tablet_manager.cc:1403] T ab4ea1ceb7a443be94ec74cd88c9bf47 P f8d4657116f948038a0c73018238c3ba: Time spent bootstrapping tablet: real 0.042s	user 0.013s	sys 0.005s
I20260709 13:09:16.007333 24359 raft_consensus.cc:359] T 03e06f957f794ca696ddc7207eeabff0 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:16.008083 24359 raft_consensus.cc:385] T 03e06f957f794ca696ddc7207eeabff0 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:16.008414 24359 raft_consensus.cc:740] T 03e06f957f794ca696ddc7207eeabff0 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dea34817fcc148d78f090ef5fa72304f, State: Initialized, Role: FOLLOWER
I20260709 13:09:16.009079 24359 consensus_queue.cc:260] T 03e06f957f794ca696ddc7207eeabff0 P dea34817fcc148d78f090ef5fa72304f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:16.009768 24360 raft_consensus.cc:359] T 518a35ead60847e98c0b76330b999d6f P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:16.010296 24362 tablet_bootstrap.cc:492] T e21ef2f479764142935dc2b1b7e87220 P b39c386162de49aca92dbebee7f06ace: No bootstrap required, opened a new log
I20260709 13:09:16.010505 24360 raft_consensus.cc:385] T 518a35ead60847e98c0b76330b999d6f P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:16.010821 24362 ts_tablet_manager.cc:1403] T e21ef2f479764142935dc2b1b7e87220 P b39c386162de49aca92dbebee7f06ace: Time spent bootstrapping tablet: real 0.060s	user 0.008s	sys 0.014s
I20260709 13:09:16.010869 24360 raft_consensus.cc:740] T 518a35ead60847e98c0b76330b999d6f P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0f503bf8bb94af8a2a1139db4e1c0f5, State: Initialized, Role: FOLLOWER
I20260709 13:09:16.011169 24359 ts_tablet_manager.cc:1434] T 03e06f957f794ca696ddc7207eeabff0 P dea34817fcc148d78f090ef5fa72304f: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.002s
I20260709 13:09:16.007985 24361 raft_consensus.cc:359] T ab4ea1ceb7a443be94ec74cd88c9bf47 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:16.011715 24360 consensus_queue.cc:260] T 518a35ead60847e98c0b76330b999d6f P c0f503bf8bb94af8a2a1139db4e1c0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:16.012135 24361 raft_consensus.cc:385] T ab4ea1ceb7a443be94ec74cd88c9bf47 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:16.013680 24362 raft_consensus.cc:359] T e21ef2f479764142935dc2b1b7e87220 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:16.014173 24361 raft_consensus.cc:740] T ab4ea1ceb7a443be94ec74cd88c9bf47 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8d4657116f948038a0c73018238c3ba, State: Initialized, Role: FOLLOWER
I20260709 13:09:16.014384 24362 raft_consensus.cc:385] T e21ef2f479764142935dc2b1b7e87220 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:16.014750 24362 raft_consensus.cc:740] T e21ef2f479764142935dc2b1b7e87220 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b39c386162de49aca92dbebee7f06ace, State: Initialized, Role: FOLLOWER
I20260709 13:09:16.014940 24361 consensus_queue.cc:260] T ab4ea1ceb7a443be94ec74cd88c9bf47 P f8d4657116f948038a0c73018238c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:16.015385 24362 consensus_queue.cc:260] T e21ef2f479764142935dc2b1b7e87220 P b39c386162de49aca92dbebee7f06ace [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:16.017166 24361 ts_tablet_manager.cc:1434] T ab4ea1ceb7a443be94ec74cd88c9bf47 P f8d4657116f948038a0c73018238c3ba: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.000s
I20260709 13:09:16.017961 24362 ts_tablet_manager.cc:1434] T e21ef2f479764142935dc2b1b7e87220 P b39c386162de49aca92dbebee7f06ace: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:09:16.019310 24361 tablet_bootstrap.cc:492] T e21ef2f479764142935dc2b1b7e87220 P f8d4657116f948038a0c73018238c3ba: Bootstrap starting.
I20260709 13:09:16.013085 24359 tablet_bootstrap.cc:492] T 7a76ed4e1b6a4c2698999f722da5cfd7 P dea34817fcc148d78f090ef5fa72304f: Bootstrap starting.
I20260709 13:09:16.013785 24360 ts_tablet_manager.cc:1434] T 518a35ead60847e98c0b76330b999d6f P c0f503bf8bb94af8a2a1139db4e1c0f5: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:09:16.021106 24360 tablet_bootstrap.cc:492] T 0dbd3426f3e14ef28e7b0b6c4c7de6a2 P c0f503bf8bb94af8a2a1139db4e1c0f5: Bootstrap starting.
I20260709 13:09:16.025502 24361 tablet_bootstrap.cc:654] T e21ef2f479764142935dc2b1b7e87220 P f8d4657116f948038a0c73018238c3ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:16.027103 24360 tablet_bootstrap.cc:654] T 0dbd3426f3e14ef28e7b0b6c4c7de6a2 P c0f503bf8bb94af8a2a1139db4e1c0f5: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:16.029239 24362 tablet_bootstrap.cc:492] T b53fa043603b41be836d4ccb5c248df8 P b39c386162de49aca92dbebee7f06ace: Bootstrap starting.
I20260709 13:09:16.035344 24362 tablet_bootstrap.cc:654] T b53fa043603b41be836d4ccb5c248df8 P b39c386162de49aca92dbebee7f06ace: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:16.040109 24359 tablet_bootstrap.cc:654] T 7a76ed4e1b6a4c2698999f722da5cfd7 P dea34817fcc148d78f090ef5fa72304f: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:16.050251 24362 tablet_bootstrap.cc:492] T b53fa043603b41be836d4ccb5c248df8 P b39c386162de49aca92dbebee7f06ace: No bootstrap required, opened a new log
I20260709 13:09:16.050963 24362 ts_tablet_manager.cc:1403] T b53fa043603b41be836d4ccb5c248df8 P b39c386162de49aca92dbebee7f06ace: Time spent bootstrapping tablet: real 0.022s	user 0.005s	sys 0.011s
I20260709 13:09:16.054628 24362 raft_consensus.cc:359] T b53fa043603b41be836d4ccb5c248df8 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:16.055722 24362 raft_consensus.cc:385] T b53fa043603b41be836d4ccb5c248df8 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:16.056026 24362 raft_consensus.cc:740] T b53fa043603b41be836d4ccb5c248df8 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b39c386162de49aca92dbebee7f06ace, State: Initialized, Role: FOLLOWER
I20260709 13:09:16.056687 24362 consensus_queue.cc:260] T b53fa043603b41be836d4ccb5c248df8 P b39c386162de49aca92dbebee7f06ace [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:16.057153 24359 tablet_bootstrap.cc:492] T 7a76ed4e1b6a4c2698999f722da5cfd7 P dea34817fcc148d78f090ef5fa72304f: No bootstrap required, opened a new log
I20260709 13:09:16.057716 24359 ts_tablet_manager.cc:1403] T 7a76ed4e1b6a4c2698999f722da5cfd7 P dea34817fcc148d78f090ef5fa72304f: Time spent bootstrapping tablet: real 0.045s	user 0.010s	sys 0.006s
I20260709 13:09:16.058368 24360 tablet_bootstrap.cc:492] T 0dbd3426f3e14ef28e7b0b6c4c7de6a2 P c0f503bf8bb94af8a2a1139db4e1c0f5: No bootstrap required, opened a new log
I20260709 13:09:16.058656 24361 tablet_bootstrap.cc:492] T e21ef2f479764142935dc2b1b7e87220 P f8d4657116f948038a0c73018238c3ba: No bootstrap required, opened a new log
I20260709 13:09:16.059015 24360 ts_tablet_manager.cc:1403] T 0dbd3426f3e14ef28e7b0b6c4c7de6a2 P c0f503bf8bb94af8a2a1139db4e1c0f5: Time spent bootstrapping tablet: real 0.038s	user 0.011s	sys 0.006s
I20260709 13:09:16.059653 24361 ts_tablet_manager.cc:1403] T e21ef2f479764142935dc2b1b7e87220 P f8d4657116f948038a0c73018238c3ba: Time spent bootstrapping tablet: real 0.041s	user 0.012s	sys 0.004s
I20260709 13:09:16.062350 24362 ts_tablet_manager.cc:1434] T b53fa043603b41be836d4ccb5c248df8 P b39c386162de49aca92dbebee7f06ace: Time spent starting tablet: real 0.011s	user 0.002s	sys 0.005s
I20260709 13:09:16.063027 24360 raft_consensus.cc:359] T 0dbd3426f3e14ef28e7b0b6c4c7de6a2 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:16.063468 24362 tablet_bootstrap.cc:492] T 518a35ead60847e98c0b76330b999d6f P b39c386162de49aca92dbebee7f06ace: Bootstrap starting.
I20260709 13:09:16.063925 24360 raft_consensus.cc:385] T 0dbd3426f3e14ef28e7b0b6c4c7de6a2 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:16.064643 24360 raft_consensus.cc:740] T 0dbd3426f3e14ef28e7b0b6c4c7de6a2 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0f503bf8bb94af8a2a1139db4e1c0f5, State: Initialized, Role: FOLLOWER
I20260709 13:09:16.064745 24359 raft_consensus.cc:359] T 7a76ed4e1b6a4c2698999f722da5cfd7 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:16.065659 24359 raft_consensus.cc:385] T 7a76ed4e1b6a4c2698999f722da5cfd7 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:16.065968 24359 raft_consensus.cc:740] T 7a76ed4e1b6a4c2698999f722da5cfd7 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dea34817fcc148d78f090ef5fa72304f, State: Initialized, Role: FOLLOWER
I20260709 13:09:16.066449 24360 consensus_queue.cc:260] T 0dbd3426f3e14ef28e7b0b6c4c7de6a2 P c0f503bf8bb94af8a2a1139db4e1c0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:16.066915 24359 consensus_queue.cc:260] T 7a76ed4e1b6a4c2698999f722da5cfd7 P dea34817fcc148d78f090ef5fa72304f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:16.070465 24360 ts_tablet_manager.cc:1434] T 0dbd3426f3e14ef28e7b0b6c4c7de6a2 P c0f503bf8bb94af8a2a1139db4e1c0f5: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.004s
I20260709 13:09:16.071846 24360 tablet_bootstrap.cc:492] T e280ec3a0e394065aca766e4f8bef46d P c0f503bf8bb94af8a2a1139db4e1c0f5: Bootstrap starting.
I20260709 13:09:16.074190 24614 raft_consensus.cc:493] T 0dbd3426f3e14ef28e7b0b6c4c7de6a2 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.074836 24614 raft_consensus.cc:515] T 0dbd3426f3e14ef28e7b0b6c4c7de6a2 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:16.079516 24361 raft_consensus.cc:359] T e21ef2f479764142935dc2b1b7e87220 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:16.080293 24163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd3426f3e14ef28e7b0b6c4c7de6a2" candidate_uuid: "b39c386162de49aca92dbebee7f06ace" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" is_pre_election: true
I20260709 13:09:16.081132 24163 raft_consensus.cc:2468] T 0dbd3426f3e14ef28e7b0b6c4c7de6a2 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b39c386162de49aca92dbebee7f06ace in term 0.
I20260709 13:09:16.081584 24091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd3426f3e14ef28e7b0b6c4c7de6a2" candidate_uuid: "b39c386162de49aca92dbebee7f06ace" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dea34817fcc148d78f090ef5fa72304f" is_pre_election: true
I20260709 13:09:16.082206 24091 raft_consensus.cc:2468] T 0dbd3426f3e14ef28e7b0b6c4c7de6a2 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b39c386162de49aca92dbebee7f06ace in term 0.
I20260709 13:09:16.083130 24280 leader_election.cc:304] T 0dbd3426f3e14ef28e7b0b6c4c7de6a2 P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b39c386162de49aca92dbebee7f06ace, c0f503bf8bb94af8a2a1139db4e1c0f5; no voters: 
I20260709 13:09:16.082250 24614 leader_election.cc:290] T 0dbd3426f3e14ef28e7b0b6c4c7de6a2 P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343), c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431)
I20260709 13:09:16.083966 24613 raft_consensus.cc:2804] T 0dbd3426f3e14ef28e7b0b6c4c7de6a2 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:16.085043 24613 raft_consensus.cc:493] T 0dbd3426f3e14ef28e7b0b6c4c7de6a2 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:16.085461 24613 raft_consensus.cc:3060] T 0dbd3426f3e14ef28e7b0b6c4c7de6a2 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:16.086249 24362 tablet_bootstrap.cc:654] T 518a35ead60847e98c0b76330b999d6f P b39c386162de49aca92dbebee7f06ace: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:16.087627 24360 tablet_bootstrap.cc:654] T e280ec3a0e394065aca766e4f8bef46d P c0f503bf8bb94af8a2a1139db4e1c0f5: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:16.080389 24361 raft_consensus.cc:385] T e21ef2f479764142935dc2b1b7e87220 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:16.089484 24361 raft_consensus.cc:740] T e21ef2f479764142935dc2b1b7e87220 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8d4657116f948038a0c73018238c3ba, State: Initialized, Role: FOLLOWER
I20260709 13:09:16.090240 24361 consensus_queue.cc:260] T e21ef2f479764142935dc2b1b7e87220 P f8d4657116f948038a0c73018238c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:16.092379 24361 ts_tablet_manager.cc:1434] T e21ef2f479764142935dc2b1b7e87220 P f8d4657116f948038a0c73018238c3ba: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.000s
I20260709 13:09:16.093451 24361 tablet_bootstrap.cc:492] T 518a35ead60847e98c0b76330b999d6f P f8d4657116f948038a0c73018238c3ba: Bootstrap starting.
I20260709 13:09:16.099433 24584 raft_consensus.cc:493] T e280ec3a0e394065aca766e4f8bef46d P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.100299 24584 raft_consensus.cc:515] T e280ec3a0e394065aca766e4f8bef46d P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:16.102211 24361 tablet_bootstrap.cc:654] T 518a35ead60847e98c0b76330b999d6f P f8d4657116f948038a0c73018238c3ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:16.103693 24313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e280ec3a0e394065aca766e4f8bef46d" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace" is_pre_election: true
I20260709 13:09:16.104396 24584 leader_election.cc:290] T e280ec3a0e394065aca766e4f8bef46d P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561), c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431)
I20260709 13:09:16.104740 24161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e280ec3a0e394065aca766e4f8bef46d" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" is_pre_election: true
I20260709 13:09:16.107498 24359 ts_tablet_manager.cc:1434] T 7a76ed4e1b6a4c2698999f722da5cfd7 P dea34817fcc148d78f090ef5fa72304f: Time spent starting tablet: real 0.049s	user 0.007s	sys 0.001s
W20260709 13:09:16.105057 24055 leader_election.cc:343] T e280ec3a0e394065aca766e4f8bef46d P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:16.109728 24057 leader_election.cc:343] T e280ec3a0e394065aca766e4f8bef46d P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:16.110395 24057 leader_election.cc:304] T e280ec3a0e394065aca766e4f8bef46d P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dea34817fcc148d78f090ef5fa72304f; no voters: b39c386162de49aca92dbebee7f06ace, c0f503bf8bb94af8a2a1139db4e1c0f5
I20260709 13:09:16.115034 24359 tablet_bootstrap.cc:492] T aaf99a05bd8842ed9ea668a9da85dbcc P dea34817fcc148d78f090ef5fa72304f: Bootstrap starting.
I20260709 13:09:16.135531 24368 raft_consensus.cc:2749] T e280ec3a0e394065aca766e4f8bef46d P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:16.150866 24610 raft_consensus.cc:493] T 352353d793574662ac966f335ae8cfbe P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.151778 24610 raft_consensus.cc:515] T 352353d793574662ac966f335ae8cfbe P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:16.156530 24568 raft_consensus.cc:493] T ab4ea1ceb7a443be94ec74cd88c9bf47 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.157182 24568 raft_consensus.cc:515] T ab4ea1ceb7a443be94ec74cd88c9bf47 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:16.159859 24163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "352353d793574662ac966f335ae8cfbe" candidate_uuid: "b39c386162de49aca92dbebee7f06ace" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" is_pre_election: true
I20260709 13:09:16.160220 24239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "352353d793574662ac966f335ae8cfbe" candidate_uuid: "b39c386162de49aca92dbebee7f06ace" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8d4657116f948038a0c73018238c3ba" is_pre_election: true
I20260709 13:09:16.160642 24163 raft_consensus.cc:2468] T 352353d793574662ac966f335ae8cfbe P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b39c386162de49aca92dbebee7f06ace in term 0.
I20260709 13:09:16.161088 24239 raft_consensus.cc:2468] T 352353d793574662ac966f335ae8cfbe P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b39c386162de49aca92dbebee7f06ace in term 0.
I20260709 13:09:16.161777 24368 raft_consensus.cc:493] T 03e06f957f794ca696ddc7207eeabff0 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.162458 24368 raft_consensus.cc:515] T 03e06f957f794ca696ddc7207eeabff0 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:16.162859 24279 leader_election.cc:304] T 352353d793574662ac966f335ae8cfbe P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b39c386162de49aca92dbebee7f06ace, f8d4657116f948038a0c73018238c3ba; no voters: 
I20260709 13:09:16.164184 24614 raft_consensus.cc:2804] T 352353d793574662ac966f335ae8cfbe P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:16.164693 24614 raft_consensus.cc:493] T 352353d793574662ac966f335ae8cfbe P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:16.165143 24614 raft_consensus.cc:3060] T 352353d793574662ac966f335ae8cfbe P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:16.169304 24091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab4ea1ceb7a443be94ec74cd88c9bf47" candidate_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dea34817fcc148d78f090ef5fa72304f" is_pre_election: true
I20260709 13:09:16.170174 24091 raft_consensus.cc:2468] T ab4ea1ceb7a443be94ec74cd88c9bf47 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0f503bf8bb94af8a2a1139db4e1c0f5 in term 0.
I20260709 13:09:16.172484 24563 consensus_queue.cc:1048] T bff14fa713b6482f89ecf3e18f785f81 P c0f503bf8bb94af8a2a1139db4e1c0f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:16.175297 24163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e06f957f794ca696ddc7207eeabff0" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" is_pre_election: true
I20260709 13:09:16.176262 24163 raft_consensus.cc:2468] T 03e06f957f794ca696ddc7207eeabff0 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dea34817fcc148d78f090ef5fa72304f in term 0.
I20260709 13:09:16.176589 24236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e06f957f794ca696ddc7207eeabff0" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8d4657116f948038a0c73018238c3ba" is_pre_election: true
I20260709 13:09:16.178113 24419 raft_consensus.cc:493] T 7a76ed4e1b6a4c2698999f722da5cfd7 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.178936 24419 raft_consensus.cc:515] T 7a76ed4e1b6a4c2698999f722da5cfd7 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:16.185640 24610 leader_election.cc:290] T 352353d793574662ac966f335ae8cfbe P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431), f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171)
W20260709 13:09:16.181418 24056 leader_election.cc:343] T 03e06f957f794ca696ddc7207eeabff0 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:16.182008 24419 leader_election.cc:290] T 7a76ed4e1b6a4c2698999f722da5cfd7 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171), b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561)
I20260709 13:09:16.184821 24132 leader_election.cc:304] T ab4ea1ceb7a443be94ec74cd88c9bf47 P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0f503bf8bb94af8a2a1139db4e1c0f5, dea34817fcc148d78f090ef5fa72304f; no voters: 
I20260709 13:09:16.204622 24445 raft_consensus.cc:2804] T ab4ea1ceb7a443be94ec74cd88c9bf47 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:16.205008 24239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a76ed4e1b6a4c2698999f722da5cfd7" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8d4657116f948038a0c73018238c3ba" is_pre_election: true
I20260709 13:09:16.205067 24445 raft_consensus.cc:493] T ab4ea1ceb7a443be94ec74cd88c9bf47 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:16.205955 24445 raft_consensus.cc:3060] T ab4ea1ceb7a443be94ec74cd88c9bf47 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:16.221848 24377 consensus_queue.cc:1048] T d2ddfc9daac54dc28d63b46ab1777bf3 P b39c386162de49aca92dbebee7f06ace [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:16.185561 24313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a76ed4e1b6a4c2698999f722da5cfd7" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace" is_pre_election: true
W20260709 13:09:16.225144 24055 leader_election.cc:343] T 7a76ed4e1b6a4c2698999f722da5cfd7 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:16.229399 24132 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:36343, user_credentials={real_user=slave}} blocked reactor thread for 44723us
I20260709 13:09:16.254618 24057 leader_election.cc:304] T 03e06f957f794ca696ddc7207eeabff0 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c0f503bf8bb94af8a2a1139db4e1c0f5, dea34817fcc148d78f090ef5fa72304f; no voters: f8d4657116f948038a0c73018238c3ba
W20260709 13:09:16.256547 24057 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:37431, user_credentials={real_user=slave}} blocked reactor thread for 72240.2us
I20260709 13:09:16.261823 24584 raft_consensus.cc:2804] T 03e06f957f794ca696ddc7207eeabff0 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:16.262450 24584 raft_consensus.cc:493] T 03e06f957f794ca696ddc7207eeabff0 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:16.262938 24584 raft_consensus.cc:3060] T 03e06f957f794ca696ddc7207eeabff0 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:16.165239 24368 leader_election.cc:290] T 03e06f957f794ca696ddc7207eeabff0 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431), f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171)
I20260709 13:09:16.297163 24572 raft_consensus.cc:493] T e21ef2f479764142935dc2b1b7e87220 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.297851 24572 raft_consensus.cc:515] T e21ef2f479764142935dc2b1b7e87220 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:16.300233 24572 leader_election.cc:290] T e21ef2f479764142935dc2b1b7e87220 P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561), dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343)
I20260709 13:09:16.300945 24362 tablet_bootstrap.cc:492] T 518a35ead60847e98c0b76330b999d6f P b39c386162de49aca92dbebee7f06ace: No bootstrap required, opened a new log
I20260709 13:09:16.301492 24362 ts_tablet_manager.cc:1403] T 518a35ead60847e98c0b76330b999d6f P b39c386162de49aca92dbebee7f06ace: Time spent bootstrapping tablet: real 0.238s	user 0.021s	sys 0.007s
I20260709 13:09:16.303666 24314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e21ef2f479764142935dc2b1b7e87220" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace" is_pre_election: true
I20260709 13:09:16.304534 24314 raft_consensus.cc:2468] T e21ef2f479764142935dc2b1b7e87220 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8d4657116f948038a0c73018238c3ba in term 0.
I20260709 13:09:16.304795 24362 raft_consensus.cc:359] T 518a35ead60847e98c0b76330b999d6f P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:16.305294 24455 raft_consensus.cc:493] T b53fa043603b41be836d4ccb5c248df8 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.305673 24362 raft_consensus.cc:385] T 518a35ead60847e98c0b76330b999d6f P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:16.306011 24362 raft_consensus.cc:740] T 518a35ead60847e98c0b76330b999d6f P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b39c386162de49aca92dbebee7f06ace, State: Initialized, Role: FOLLOWER
I20260709 13:09:16.306021 24455 raft_consensus.cc:515] T b53fa043603b41be836d4ccb5c248df8 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:16.306862 24362 consensus_queue.cc:260] T 518a35ead60847e98c0b76330b999d6f P b39c386162de49aca92dbebee7f06ace [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:16.308267 24568 leader_election.cc:290] T ab4ea1ceb7a443be94ec74cd88c9bf47 P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343), f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171)
I20260709 13:09:16.309758 24455 leader_election.cc:290] T b53fa043603b41be836d4ccb5c248df8 P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561), dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343)
I20260709 13:09:16.310372 24361 tablet_bootstrap.cc:492] T 518a35ead60847e98c0b76330b999d6f P f8d4657116f948038a0c73018238c3ba: No bootstrap required, opened a new log
I20260709 13:09:16.310163 24237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab4ea1ceb7a443be94ec74cd88c9bf47" candidate_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8d4657116f948038a0c73018238c3ba" is_pre_election: true
I20260709 13:09:16.310981 24361 ts_tablet_manager.cc:1403] T 518a35ead60847e98c0b76330b999d6f P f8d4657116f948038a0c73018238c3ba: Time spent bootstrapping tablet: real 0.218s	user 0.017s	sys 0.005s
I20260709 13:09:16.311069 24237 raft_consensus.cc:2468] T ab4ea1ceb7a443be94ec74cd88c9bf47 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0f503bf8bb94af8a2a1139db4e1c0f5 in term 0.
I20260709 13:09:16.313943 24361 raft_consensus.cc:359] T 518a35ead60847e98c0b76330b999d6f P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:16.314724 24361 raft_consensus.cc:385] T 518a35ead60847e98c0b76330b999d6f P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:16.315006 24361 raft_consensus.cc:740] T 518a35ead60847e98c0b76330b999d6f P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8d4657116f948038a0c73018238c3ba, State: Initialized, Role: FOLLOWER
I20260709 13:09:16.315747 24361 consensus_queue.cc:260] T 518a35ead60847e98c0b76330b999d6f P f8d4657116f948038a0c73018238c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:16.318017 24361 ts_tablet_manager.cc:1434] T 518a35ead60847e98c0b76330b999d6f P f8d4657116f948038a0c73018238c3ba: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:09:16.318755 24204 leader_election.cc:304] T e21ef2f479764142935dc2b1b7e87220 P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b39c386162de49aca92dbebee7f06ace, f8d4657116f948038a0c73018238c3ba; no voters: 
I20260709 13:09:16.320549 24361 tablet_bootstrap.cc:492] T 03e06f957f794ca696ddc7207eeabff0 P f8d4657116f948038a0c73018238c3ba: Bootstrap starting.
I20260709 13:09:16.321372 24564 consensus_queue.cc:1048] T 1dcdde5516f54b19b11611ca9213415d P c0f503bf8bb94af8a2a1139db4e1c0f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:16.322026 24360 tablet_bootstrap.cc:492] T e280ec3a0e394065aca766e4f8bef46d P c0f503bf8bb94af8a2a1139db4e1c0f5: No bootstrap required, opened a new log
I20260709 13:09:16.322913 24360 ts_tablet_manager.cc:1403] T e280ec3a0e394065aca766e4f8bef46d P c0f503bf8bb94af8a2a1139db4e1c0f5: Time spent bootstrapping tablet: real 0.251s	user 0.033s	sys 0.030s
I20260709 13:09:16.327571 24361 tablet_bootstrap.cc:654] T 03e06f957f794ca696ddc7207eeabff0 P f8d4657116f948038a0c73018238c3ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:16.327478 24360 raft_consensus.cc:359] T e280ec3a0e394065aca766e4f8bef46d P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:16.328655 24360 raft_consensus.cc:385] T e280ec3a0e394065aca766e4f8bef46d P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:16.329039 24360 raft_consensus.cc:740] T e280ec3a0e394065aca766e4f8bef46d P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0f503bf8bb94af8a2a1139db4e1c0f5, State: Initialized, Role: FOLLOWER
I20260709 13:09:16.331368 24572 raft_consensus.cc:2804] T e21ef2f479764142935dc2b1b7e87220 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:16.332055 24572 raft_consensus.cc:493] T e21ef2f479764142935dc2b1b7e87220 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:16.332527 24572 raft_consensus.cc:3060] T e21ef2f479764142935dc2b1b7e87220 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:16.334841 24377 consensus_queue.cc:1048] T d2ddfc9daac54dc28d63b46ab1777bf3 P b39c386162de49aca92dbebee7f06ace [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:16.340076 24314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53fa043603b41be836d4ccb5c248df8" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace" is_pre_election: true
I20260709 13:09:16.341146 24314 raft_consensus.cc:2468] T b53fa043603b41be836d4ccb5c248df8 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8d4657116f948038a0c73018238c3ba in term 0.
I20260709 13:09:16.329882 24360 consensus_queue.cc:260] T e280ec3a0e394065aca766e4f8bef46d P c0f503bf8bb94af8a2a1139db4e1c0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:16.350131 24669 raft_consensus.cc:493] T bff14fa713b6482f89ecf3e18f785f81 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.350967 24359 tablet_bootstrap.cc:654] T aaf99a05bd8842ed9ea668a9da85dbcc P dea34817fcc148d78f090ef5fa72304f: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:16.364085 24362 ts_tablet_manager.cc:1434] T 518a35ead60847e98c0b76330b999d6f P b39c386162de49aca92dbebee7f06ace: Time spent starting tablet: real 0.062s	user 0.014s	sys 0.008s
I20260709 13:09:16.368462 24360 ts_tablet_manager.cc:1434] T e280ec3a0e394065aca766e4f8bef46d P c0f503bf8bb94af8a2a1139db4e1c0f5: Time spent starting tablet: real 0.045s	user 0.008s	sys 0.000s
I20260709 13:09:16.345544 24613 raft_consensus.cc:515] T 0dbd3426f3e14ef28e7b0b6c4c7de6a2 P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:16.351292 24669 raft_consensus.cc:515] T bff14fa713b6482f89ecf3e18f785f81 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:16.378902 24362 tablet_bootstrap.cc:492] T e280ec3a0e394065aca766e4f8bef46d P b39c386162de49aca92dbebee7f06ace: Bootstrap starting.
I20260709 13:09:16.388219 24669 leader_election.cc:290] T bff14fa713b6482f89ecf3e18f785f81 P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343), c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431)
I20260709 13:09:16.382951 24204 leader_election.cc:304] T b53fa043603b41be836d4ccb5c248df8 P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b39c386162de49aca92dbebee7f06ace, f8d4657116f948038a0c73018238c3ba; no voters: 
I20260709 13:09:16.391166 24362 tablet_bootstrap.cc:654] T e280ec3a0e394065aca766e4f8bef46d P b39c386162de49aca92dbebee7f06ace: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:16.368120 24056 leader_election.cc:343] T 7a76ed4e1b6a4c2698999f722da5cfd7 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:16.398875 24360 tablet_bootstrap.cc:492] T 25e4818a4e2e4c9c9f7a8467aa9ef881 P c0f503bf8bb94af8a2a1139db4e1c0f5: Bootstrap starting.
W20260709 13:09:16.375104 24279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46171, user_credentials={real_user=slave}} blocked reactor thread for 57818.9us
I20260709 13:09:16.397508 24669 raft_consensus.cc:2804] T b53fa043603b41be836d4ccb5c248df8 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:16.423413 24239 raft_consensus.cc:3060] T bff14fa713b6482f89ecf3e18f785f81 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:16.427317 24613 leader_election.cc:290] T 0dbd3426f3e14ef28e7b0b6c4c7de6a2 P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 1 election: Requested vote from peers dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343), c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431)
I20260709 13:09:16.425536 24584 raft_consensus.cc:515] T 03e06f957f794ca696ddc7207eeabff0 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:16.416041 24669 raft_consensus.cc:493] T b53fa043603b41be836d4ccb5c248df8 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:16.401335 24056 leader_election.cc:304] T 7a76ed4e1b6a4c2698999f722da5cfd7 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dea34817fcc148d78f090ef5fa72304f; no voters: b39c386162de49aca92dbebee7f06ace, f8d4657116f948038a0c73018238c3ba
I20260709 13:09:16.411453 24445 raft_consensus.cc:515] T ab4ea1ceb7a443be94ec74cd88c9bf47 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:16.448009 24361 tablet_bootstrap.cc:492] T 03e06f957f794ca696ddc7207eeabff0 P f8d4657116f948038a0c73018238c3ba: No bootstrap required, opened a new log
I20260709 13:09:16.449066 24361 ts_tablet_manager.cc:1403] T 03e06f957f794ca696ddc7207eeabff0 P f8d4657116f948038a0c73018238c3ba: Time spent bootstrapping tablet: real 0.129s	user 0.017s	sys 0.027s
I20260709 13:09:16.440457 24669 raft_consensus.cc:3060] T b53fa043603b41be836d4ccb5c248df8 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:16.449368 24368 raft_consensus.cc:2749] T 7a76ed4e1b6a4c2698999f722da5cfd7 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:09:16.460567 24667 log.cc:927] Time spent T 1dcdde5516f54b19b11611ca9213415d P dea34817fcc148d78f090ef5fa72304f: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:09:16.462687 24614 raft_consensus.cc:515] T 352353d793574662ac966f335ae8cfbe P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:16.472067 24237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "352353d793574662ac966f335ae8cfbe" candidate_uuid: "b39c386162de49aca92dbebee7f06ace" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8d4657116f948038a0c73018238c3ba"
I20260709 13:09:16.472891 24237 raft_consensus.cc:3060] T 352353d793574662ac966f335ae8cfbe P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:16.479543 24361 raft_consensus.cc:359] T 03e06f957f794ca696ddc7207eeabff0 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:16.480841 24361 raft_consensus.cc:385] T 03e06f957f794ca696ddc7207eeabff0 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:09:16.457198 24056 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46171, user_credentials={real_user=slave}} blocked reactor thread for 89998.7us
I20260709 13:09:16.481199 24361 raft_consensus.cc:740] T 03e06f957f794ca696ddc7207eeabff0 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8d4657116f948038a0c73018238c3ba, State: Initialized, Role: FOLLOWER
I20260709 13:09:16.484587 24361 consensus_queue.cc:260] T 03e06f957f794ca696ddc7207eeabff0 P f8d4657116f948038a0c73018238c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:16.475904 24614 leader_election.cc:290] T 352353d793574662ac966f335ae8cfbe P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 1 election: Requested vote from peers c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431), f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171)
I20260709 13:09:16.502169 24362 tablet_bootstrap.cc:492] T e280ec3a0e394065aca766e4f8bef46d P b39c386162de49aca92dbebee7f06ace: No bootstrap required, opened a new log
I20260709 13:09:16.503022 24362 ts_tablet_manager.cc:1403] T e280ec3a0e394065aca766e4f8bef46d P b39c386162de49aca92dbebee7f06ace: Time spent bootstrapping tablet: real 0.126s	user 0.019s	sys 0.008s
I20260709 13:09:16.490474 24161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd3426f3e14ef28e7b0b6c4c7de6a2" candidate_uuid: "b39c386162de49aca92dbebee7f06ace" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5"
I20260709 13:09:16.505820 24568 raft_consensus.cc:493] T 518a35ead60847e98c0b76330b999d6f P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.528726 24359 tablet_bootstrap.cc:492] T aaf99a05bd8842ed9ea668a9da85dbcc P dea34817fcc148d78f090ef5fa72304f: No bootstrap required, opened a new log
I20260709 13:09:16.529351 24359 ts_tablet_manager.cc:1403] T aaf99a05bd8842ed9ea668a9da85dbcc P dea34817fcc148d78f090ef5fa72304f: Time spent bootstrapping tablet: real 0.415s	user 0.021s	sys 0.003s
I20260709 13:09:16.518615 24161 raft_consensus.cc:3060] T 0dbd3426f3e14ef28e7b0b6c4c7de6a2 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:16.535732 24445 leader_election.cc:290] T ab4ea1ceb7a443be94ec74cd88c9bf47 P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 1 election: Requested vote from peers dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343), f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171)
I20260709 13:09:16.539474 24361 ts_tablet_manager.cc:1434] T 03e06f957f794ca696ddc7207eeabff0 P f8d4657116f948038a0c73018238c3ba: Time spent starting tablet: real 0.090s	user 0.013s	sys 0.027s
I20260709 13:09:16.528867 24568 raft_consensus.cc:515] T 518a35ead60847e98c0b76330b999d6f P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:16.549489 24165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "352353d793574662ac966f335ae8cfbe" candidate_uuid: "b39c386162de49aca92dbebee7f06ace" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5"
I20260709 13:09:16.583849 24361 tablet_bootstrap.cc:492] T ef112a95c7964753b1c7c5a17656161b P f8d4657116f948038a0c73018238c3ba: Bootstrap starting.
I20260709 13:09:16.591729 24362 raft_consensus.cc:359] T e280ec3a0e394065aca766e4f8bef46d P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:16.593323 24362 raft_consensus.cc:385] T e280ec3a0e394065aca766e4f8bef46d P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:16.593771 24362 raft_consensus.cc:740] T e280ec3a0e394065aca766e4f8bef46d P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b39c386162de49aca92dbebee7f06ace, State: Initialized, Role: FOLLOWER
I20260709 13:09:16.593447 24359 raft_consensus.cc:359] T aaf99a05bd8842ed9ea668a9da85dbcc P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:16.594517 24359 raft_consensus.cc:385] T aaf99a05bd8842ed9ea668a9da85dbcc P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:16.594959 24359 raft_consensus.cc:740] T aaf99a05bd8842ed9ea668a9da85dbcc P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dea34817fcc148d78f090ef5fa72304f, State: Initialized, Role: FOLLOWER
I20260709 13:09:16.592728 24360 tablet_bootstrap.cc:654] T 25e4818a4e2e4c9c9f7a8467aa9ef881 P c0f503bf8bb94af8a2a1139db4e1c0f5: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:16.594708 24362 consensus_queue.cc:260] T e280ec3a0e394065aca766e4f8bef46d P b39c386162de49aca92dbebee7f06ace [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:16.597467 24359 consensus_queue.cc:260] T aaf99a05bd8842ed9ea668a9da85dbcc P dea34817fcc148d78f090ef5fa72304f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:16.549469 24572 raft_consensus.cc:515] T e21ef2f479764142935dc2b1b7e87220 P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:16.605387 24362 ts_tablet_manager.cc:1434] T e280ec3a0e394065aca766e4f8bef46d P b39c386162de49aca92dbebee7f06ace: Time spent starting tablet: real 0.102s	user 0.008s	sys 0.000s
I20260709 13:09:16.595609 24165 raft_consensus.cc:3060] T 352353d793574662ac966f335ae8cfbe P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:16.619263 24162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bff14fa713b6482f89ecf3e18f785f81" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" is_pre_election: true
I20260709 13:09:16.624915 24677 raft_consensus.cc:493] T 518a35ead60847e98c0b76330b999d6f P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.625535 24677 raft_consensus.cc:515] T 518a35ead60847e98c0b76330b999d6f P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:16.628377 24679 consensus_queue.cc:1048] T 5bc4e407c8b04739aa0290922bfdbed4 P f8d4657116f948038a0c73018238c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:16.635363 24362 tablet_bootstrap.cc:492] T 7a76ed4e1b6a4c2698999f722da5cfd7 P b39c386162de49aca92dbebee7f06ace: Bootstrap starting.
I20260709 13:09:16.643985 24359 ts_tablet_manager.cc:1434] T aaf99a05bd8842ed9ea668a9da85dbcc P dea34817fcc148d78f090ef5fa72304f: Time spent starting tablet: real 0.114s	user 0.006s	sys 0.004s
I20260709 13:09:16.675067 24359 tablet_bootstrap.cc:492] T 65f010ca5ab74fa1b0f45b7d5dced706 P dea34817fcc148d78f090ef5fa72304f: Bootstrap starting.
I20260709 13:09:16.678172 24090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0dbd3426f3e14ef28e7b0b6c4c7de6a2" candidate_uuid: "b39c386162de49aca92dbebee7f06ace" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dea34817fcc148d78f090ef5fa72304f"
I20260709 13:09:16.680419 24090 raft_consensus.cc:3060] T 0dbd3426f3e14ef28e7b0b6c4c7de6a2 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:16.651633 24237 raft_consensus.cc:2468] T 352353d793574662ac966f335ae8cfbe P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b39c386162de49aca92dbebee7f06ace in term 1.
W20260709 13:09:16.649036 24057 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:37431, user_credentials={real_user=slave}} blocked reactor thread for 109880us
I20260709 13:09:16.702977 24279 leader_election.cc:304] T 352353d793574662ac966f335ae8cfbe P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b39c386162de49aca92dbebee7f06ace, f8d4657116f948038a0c73018238c3ba; no voters: 
I20260709 13:09:16.704375 24666 raft_consensus.cc:2804] T 352353d793574662ac966f335ae8cfbe P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:16.704909 24666 raft_consensus.cc:697] T 352353d793574662ac966f335ae8cfbe P b39c386162de49aca92dbebee7f06ace [term 1 LEADER]: Becoming Leader. State: Replica: b39c386162de49aca92dbebee7f06ace, State: Running, Role: LEADER
I20260709 13:09:16.706194 24361 tablet_bootstrap.cc:654] T ef112a95c7964753b1c7c5a17656161b P f8d4657116f948038a0c73018238c3ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:16.706888 24568 leader_election.cc:290] T 518a35ead60847e98c0b76330b999d6f P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171), b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561)
I20260709 13:09:16.708637 24313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "518a35ead60847e98c0b76330b999d6f" candidate_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace" is_pre_election: true
I20260709 13:09:16.709378 24313 raft_consensus.cc:2468] T 518a35ead60847e98c0b76330b999d6f P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0f503bf8bb94af8a2a1139db4e1c0f5 in term 0.
I20260709 13:09:16.710876 24130 leader_election.cc:304] T 518a35ead60847e98c0b76330b999d6f P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b39c386162de49aca92dbebee7f06ace, c0f503bf8bb94af8a2a1139db4e1c0f5; no voters: 
I20260709 13:09:16.710973 24572 leader_election.cc:290] T e21ef2f479764142935dc2b1b7e87220 P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 election: Requested vote from peers b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561), dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343)
I20260709 13:09:16.705765 24666 consensus_queue.cc:237] T 352353d793574662ac966f335ae8cfbe P b39c386162de49aca92dbebee7f06ace [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:16.722168 24669 raft_consensus.cc:515] T b53fa043603b41be836d4ccb5c248df8 P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:16.723300 24087 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53fa043603b41be836d4ccb5c248df8" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dea34817fcc148d78f090ef5fa72304f" is_pre_election: true
I20260709 13:09:16.724457 24088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bff14fa713b6482f89ecf3e18f785f81" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dea34817fcc148d78f090ef5fa72304f" is_pre_election: true
W20260709 13:09:16.745456 24206 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:36343, user_credentials={real_user=slave}} blocked reactor thread for 45291.6us
I20260709 13:09:16.729128 24089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e21ef2f479764142935dc2b1b7e87220" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dea34817fcc148d78f090ef5fa72304f" is_pre_election: true
I20260709 13:09:16.696134 24677 leader_election.cc:290] T 518a35ead60847e98c0b76330b999d6f P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431), b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561)
I20260709 13:09:16.732224 24360 tablet_bootstrap.cc:492] T 25e4818a4e2e4c9c9f7a8467aa9ef881 P c0f503bf8bb94af8a2a1139db4e1c0f5: No bootstrap required, opened a new log
I20260709 13:09:16.737368 24311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "518a35ead60847e98c0b76330b999d6f" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace" is_pre_election: true
I20260709 13:09:16.749402 24360 ts_tablet_manager.cc:1403] T 25e4818a4e2e4c9c9f7a8467aa9ef881 P c0f503bf8bb94af8a2a1139db4e1c0f5: Time spent bootstrapping tablet: real 0.355s	user 0.013s	sys 0.010s
I20260709 13:09:16.760447 24237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab4ea1ceb7a443be94ec74cd88c9bf47" candidate_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8d4657116f948038a0c73018238c3ba"
I20260709 13:09:16.761123 24237 raft_consensus.cc:3060] T ab4ea1ceb7a443be94ec74cd88c9bf47 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:16.757490 24311 raft_consensus.cc:2468] T 518a35ead60847e98c0b76330b999d6f P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8d4657116f948038a0c73018238c3ba in term 0.
W20260709 13:09:16.762346 24130 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:38561, user_credentials={real_user=slave}} blocked reactor thread for 51596us
I20260709 13:09:16.762748 24445 raft_consensus.cc:2804] T 518a35ead60847e98c0b76330b999d6f P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:16.739611 24563 consensus_queue.cc:1048] T 1dcdde5516f54b19b11611ca9213415d P c0f503bf8bb94af8a2a1139db4e1c0f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 13:09:16.744861 24165 raft_consensus.cc:2468] T 352353d793574662ac966f335ae8cfbe P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b39c386162de49aca92dbebee7f06ace in term 1.
I20260709 13:09:16.766749 24445 raft_consensus.cc:493] T 518a35ead60847e98c0b76330b999d6f P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:16.775972 24445 raft_consensus.cc:3060] T 518a35ead60847e98c0b76330b999d6f P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:16.753499 24089 raft_consensus.cc:2468] T e21ef2f479764142935dc2b1b7e87220 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8d4657116f948038a0c73018238c3ba in term 0.
I20260709 13:09:16.759179 24313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e21ef2f479764142935dc2b1b7e87220" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace"
I20260709 13:09:16.778002 24313 raft_consensus.cc:3060] T e21ef2f479764142935dc2b1b7e87220 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:16.779845 24161 raft_consensus.cc:2468] T 0dbd3426f3e14ef28e7b0b6c4c7de6a2 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b39c386162de49aca92dbebee7f06ace in term 1.
I20260709 13:09:16.748140 24087 raft_consensus.cc:2468] T b53fa043603b41be836d4ccb5c248df8 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8d4657116f948038a0c73018238c3ba in term 0.
I20260709 13:09:16.781869 24091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab4ea1ceb7a443be94ec74cd88c9bf47" candidate_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dea34817fcc148d78f090ef5fa72304f"
I20260709 13:09:16.783362 24091 raft_consensus.cc:3060] T ab4ea1ceb7a443be94ec74cd88c9bf47 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:16.788575 24568 raft_consensus.cc:493] T e280ec3a0e394065aca766e4f8bef46d P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.790269 24280 leader_election.cc:304] T 0dbd3426f3e14ef28e7b0b6c4c7de6a2 P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b39c386162de49aca92dbebee7f06ace, c0f503bf8bb94af8a2a1139db4e1c0f5; no voters: 
I20260709 13:09:16.793355 24610 raft_consensus.cc:2804] T 0dbd3426f3e14ef28e7b0b6c4c7de6a2 P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:16.809935 24206 leader_election.cc:304] T bff14fa713b6482f89ecf3e18f785f81 P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8d4657116f948038a0c73018238c3ba; no voters: c0f503bf8bb94af8a2a1139db4e1c0f5, dea34817fcc148d78f090ef5fa72304f
I20260709 13:09:16.795682 24568 raft_consensus.cc:515] T e280ec3a0e394065aca766e4f8bef46d P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:16.812620 24684 consensus_queue.cc:1048] T 5bc4e407c8b04739aa0290922bfdbed4 P f8d4657116f948038a0c73018238c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.048s
I20260709 13:09:16.868512 24359 tablet_bootstrap.cc:654] T 65f010ca5ab74fa1b0f45b7d5dced706 P dea34817fcc148d78f090ef5fa72304f: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:16.813004 24204 leader_election.cc:304] T 518a35ead60847e98c0b76330b999d6f P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b39c386162de49aca92dbebee7f06ace, f8d4657116f948038a0c73018238c3ba; no voters: 
W20260709 13:09:16.870054 24204 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:38561, user_credentials={real_user=slave}} blocked reactor thread for 63088.4us
I20260709 13:09:16.870390 24090 raft_consensus.cc:2468] T 0dbd3426f3e14ef28e7b0b6c4c7de6a2 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b39c386162de49aca92dbebee7f06ace in term 1.
I20260709 13:09:16.825088 24610 raft_consensus.cc:697] T 0dbd3426f3e14ef28e7b0b6c4c7de6a2 P b39c386162de49aca92dbebee7f06ace [term 1 LEADER]: Becoming Leader. State: Replica: b39c386162de49aca92dbebee7f06ace, State: Running, Role: LEADER
I20260709 13:09:16.882608 24362 tablet_bootstrap.cc:654] T 7a76ed4e1b6a4c2698999f722da5cfd7 P b39c386162de49aca92dbebee7f06ace: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:16.884622 24091 raft_consensus.cc:2468] T ab4ea1ceb7a443be94ec74cd88c9bf47 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0f503bf8bb94af8a2a1139db4e1c0f5 in term 1.
I20260709 13:09:16.884544 24360 raft_consensus.cc:359] T 25e4818a4e2e4c9c9f7a8467aa9ef881 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:16.885627 24360 raft_consensus.cc:385] T 25e4818a4e2e4c9c9f7a8467aa9ef881 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:16.886021 24360 raft_consensus.cc:740] T 25e4818a4e2e4c9c9f7a8467aa9ef881 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0f503bf8bb94af8a2a1139db4e1c0f5, State: Initialized, Role: FOLLOWER
I20260709 13:09:16.887192 24360 consensus_queue.cc:260] T 25e4818a4e2e4c9c9f7a8467aa9ef881 P c0f503bf8bb94af8a2a1139db4e1c0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:16.874076 24568 leader_election.cc:290] T e280ec3a0e394065aca766e4f8bef46d P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561), dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343)
I20260709 13:09:16.870483 24668 raft_consensus.cc:2804] T 518a35ead60847e98c0b76330b999d6f P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:16.920027 24361 tablet_bootstrap.cc:492] T ef112a95c7964753b1c7c5a17656161b P f8d4657116f948038a0c73018238c3ba: No bootstrap required, opened a new log
I20260709 13:09:16.922343 24361 ts_tablet_manager.cc:1403] T ef112a95c7964753b1c7c5a17656161b P f8d4657116f948038a0c73018238c3ba: Time spent bootstrapping tablet: real 0.365s	user 0.033s	sys 0.021s
I20260709 13:09:16.877506 24692 raft_consensus.cc:2749] T bff14fa713b6482f89ecf3e18f785f81 P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:16.879506 24237 raft_consensus.cc:2468] T ab4ea1ceb7a443be94ec74cd88c9bf47 P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0f503bf8bb94af8a2a1139db4e1c0f5 in term 1.
I20260709 13:09:16.926421 24360 ts_tablet_manager.cc:1434] T 25e4818a4e2e4c9c9f7a8467aa9ef881 P c0f503bf8bb94af8a2a1139db4e1c0f5: Time spent starting tablet: real 0.175s	user 0.007s	sys 0.002s
I20260709 13:09:16.917966 24240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "518a35ead60847e98c0b76330b999d6f" candidate_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8d4657116f948038a0c73018238c3ba" is_pre_election: true
I20260709 13:09:16.921600 24668 raft_consensus.cc:493] T 518a35ead60847e98c0b76330b999d6f P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:16.948619 24668 raft_consensus.cc:3060] T 518a35ead60847e98c0b76330b999d6f P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:16.950358 24312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e280ec3a0e394065aca766e4f8bef46d" candidate_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace" is_pre_election: true
I20260709 13:09:16.951252 24312 raft_consensus.cc:2468] T e280ec3a0e394065aca766e4f8bef46d P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0f503bf8bb94af8a2a1139db4e1c0f5 in term 0.
I20260709 13:09:16.956106 24610 consensus_queue.cc:237] T 0dbd3426f3e14ef28e7b0b6c4c7de6a2 P b39c386162de49aca92dbebee7f06ace [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:16.957208 24361 raft_consensus.cc:359] T ef112a95c7964753b1c7c5a17656161b P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:16.957994 24361 raft_consensus.cc:385] T ef112a95c7964753b1c7c5a17656161b P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:16.958266 24361 raft_consensus.cc:740] T ef112a95c7964753b1c7c5a17656161b P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8d4657116f948038a0c73018238c3ba, State: Initialized, Role: FOLLOWER
I20260709 13:09:16.972293 24163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e06f957f794ca696ddc7207eeabff0" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5"
I20260709 13:09:16.947180 24669 leader_election.cc:290] T b53fa043603b41be836d4ccb5c248df8 P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 election: Requested vote from peers b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561), dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343)
I20260709 13:09:16.973060 24163 raft_consensus.cc:3060] T 03e06f957f794ca696ddc7207eeabff0 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:16.978281 24311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53fa043603b41be836d4ccb5c248df8" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace"
I20260709 13:09:16.979363 24311 raft_consensus.cc:3060] T b53fa043603b41be836d4ccb5c248df8 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:16.981222 24090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e280ec3a0e394065aca766e4f8bef46d" candidate_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dea34817fcc148d78f090ef5fa72304f" is_pre_election: true
I20260709 13:09:16.982277 24090 raft_consensus.cc:2468] T e280ec3a0e394065aca766e4f8bef46d P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0f503bf8bb94af8a2a1139db4e1c0f5 in term 0.
I20260709 13:09:16.983522 24584 leader_election.cc:290] T 03e06f957f794ca696ddc7207eeabff0 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 election: Requested vote from peers c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431), f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171)
I20260709 13:09:16.957242 24132 leader_election.cc:304] T ab4ea1ceb7a443be94ec74cd88c9bf47 P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0f503bf8bb94af8a2a1139db4e1c0f5, dea34817fcc148d78f090ef5fa72304f; no voters: 
I20260709 13:09:16.987782 24698 raft_consensus.cc:493] T 25e4818a4e2e4c9c9f7a8467aa9ef881 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.964653 24313 raft_consensus.cc:2468] T e21ef2f479764142935dc2b1b7e87220 P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8d4657116f948038a0c73018238c3ba in term 1.
I20260709 13:09:16.965595 24676 raft_consensus.cc:493] T 03e06f957f794ca696ddc7207eeabff0 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.966279 24445 raft_consensus.cc:515] T 518a35ead60847e98c0b76330b999d6f P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:16.988334 24698 raft_consensus.cc:515] T 25e4818a4e2e4c9c9f7a8467aa9ef881 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:17.022951 24698 leader_election.cc:290] T 25e4818a4e2e4c9c9f7a8467aa9ef881 P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343), f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171)
I20260709 13:09:17.029460 24162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "518a35ead60847e98c0b76330b999d6f" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" is_pre_election: true
I20260709 13:09:17.032586 24204 leader_election.cc:304] T e21ef2f479764142935dc2b1b7e87220 P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b39c386162de49aca92dbebee7f06ace, f8d4657116f948038a0c73018238c3ba; no voters: 
I20260709 13:09:17.033875 24692 raft_consensus.cc:2804] T e21ef2f479764142935dc2b1b7e87220 P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:17.034578 24692 raft_consensus.cc:697] T e21ef2f479764142935dc2b1b7e87220 P f8d4657116f948038a0c73018238c3ba [term 1 LEADER]: Becoming Leader. State: Replica: f8d4657116f948038a0c73018238c3ba, State: Running, Role: LEADER
I20260709 13:09:17.035771 24692 consensus_queue.cc:237] T e21ef2f479764142935dc2b1b7e87220 P f8d4657116f948038a0c73018238c3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:17.038180 24445 leader_election.cc:290] T 518a35ead60847e98c0b76330b999d6f P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 1 election: Requested vote from peers f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171), b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561)
I20260709 13:09:17.039346 24162 raft_consensus.cc:2393] T 518a35ead60847e98c0b76330b999d6f P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f8d4657116f948038a0c73018238c3ba in current term 1: Already voted for candidate c0f503bf8bb94af8a2a1139db4e1c0f5 in this term.
I20260709 13:09:17.041548 24088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b53fa043603b41be836d4ccb5c248df8" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dea34817fcc148d78f090ef5fa72304f"
I20260709 13:09:17.042248 24088 raft_consensus.cc:3060] T b53fa043603b41be836d4ccb5c248df8 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:17.042790 24676 raft_consensus.cc:515] T 03e06f957f794ca696ddc7207eeabff0 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:17.045562 24676 leader_election.cc:290] T 03e06f957f794ca696ddc7207eeabff0 P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343), c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431)
I20260709 13:09:17.050885 24132 leader_election.cc:304] T e280ec3a0e394065aca766e4f8bef46d P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0f503bf8bb94af8a2a1139db4e1c0f5, dea34817fcc148d78f090ef5fa72304f; no voters: 
I20260709 13:09:17.053026 24568 raft_consensus.cc:2804] T e280ec3a0e394065aca766e4f8bef46d P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:17.053481 24568 raft_consensus.cc:493] T e280ec3a0e394065aca766e4f8bef46d P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:17.053853 24568 raft_consensus.cc:3060] T e280ec3a0e394065aca766e4f8bef46d P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:16.990722 24361 consensus_queue.cc:260] T ef112a95c7964753b1c7c5a17656161b P f8d4657116f948038a0c73018238c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:17.054378 24089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e4818a4e2e4c9c9f7a8467aa9ef881" candidate_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dea34817fcc148d78f090ef5fa72304f" is_pre_election: true
I20260709 13:09:17.055217 24089 raft_consensus.cc:2468] T 25e4818a4e2e4c9c9f7a8467aa9ef881 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0f503bf8bb94af8a2a1139db4e1c0f5 in term 0.
I20260709 13:09:16.989199 24564 raft_consensus.cc:2804] T ab4ea1ceb7a443be94ec74cd88c9bf47 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:17.056181 24361 ts_tablet_manager.cc:1434] T ef112a95c7964753b1c7c5a17656161b P f8d4657116f948038a0c73018238c3ba: Time spent starting tablet: real 0.132s	user 0.005s	sys 0.002s
I20260709 13:09:17.056442 24564 raft_consensus.cc:697] T ab4ea1ceb7a443be94ec74cd88c9bf47 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 LEADER]: Becoming Leader. State: Replica: c0f503bf8bb94af8a2a1139db4e1c0f5, State: Running, Role: LEADER
I20260709 13:09:17.061283 24668 raft_consensus.cc:515] T 518a35ead60847e98c0b76330b999d6f P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:17.063258 24240 raft_consensus.cc:2393] T 518a35ead60847e98c0b76330b999d6f P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0f503bf8bb94af8a2a1139db4e1c0f5 in current term 1: Already voted for candidate f8d4657116f948038a0c73018238c3ba in this term.
W20260709 13:09:17.063982 24206 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:37431, user_credentials={real_user=slave}} blocked reactor thread for 60856.8us
I20260709 13:09:17.057711 24564 consensus_queue.cc:237] T ab4ea1ceb7a443be94ec74cd88c9bf47 P c0f503bf8bb94af8a2a1139db4e1c0f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:17.070029 24312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "518a35ead60847e98c0b76330b999d6f" candidate_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace"
I20260709 13:09:17.071033 24312 raft_consensus.cc:3060] T 518a35ead60847e98c0b76330b999d6f P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:17.074287 24308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "518a35ead60847e98c0b76330b999d6f" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace"
W20260709 13:09:17.076413 24131 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46171, user_credentials={real_user=slave}} blocked reactor thread for 101591us
I20260709 13:09:17.078115 24238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e06f957f794ca696ddc7207eeabff0" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8d4657116f948038a0c73018238c3ba"
I20260709 13:09:17.078860 24238 raft_consensus.cc:3060] T 03e06f957f794ca696ddc7207eeabff0 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:17.085562 24132 leader_election.cc:304] T 25e4818a4e2e4c9c9f7a8467aa9ef881 P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0f503bf8bb94af8a2a1139db4e1c0f5, dea34817fcc148d78f090ef5fa72304f; no voters: 
I20260709 13:09:17.091101 24445 raft_consensus.cc:2804] T 25e4818a4e2e4c9c9f7a8467aa9ef881 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:17.091904 24445 raft_consensus.cc:493] T 25e4818a4e2e4c9c9f7a8467aa9ef881 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:17.092133 24083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e06f957f794ca696ddc7207eeabff0" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dea34817fcc148d78f090ef5fa72304f" is_pre_election: true
I20260709 13:09:17.092528 24445 raft_consensus.cc:3060] T 25e4818a4e2e4c9c9f7a8467aa9ef881 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:17.093146 24083 raft_consensus.cc:2393] T 03e06f957f794ca696ddc7207eeabff0 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f8d4657116f948038a0c73018238c3ba in current term 1: Already voted for candidate dea34817fcc148d78f090ef5fa72304f in this term.
I20260709 13:09:17.057714 24361 tablet_bootstrap.cc:492] T 7a76ed4e1b6a4c2698999f722da5cfd7 P f8d4657116f948038a0c73018238c3ba: Bootstrap starting.
I20260709 13:09:16.877628 24085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e21ef2f479764142935dc2b1b7e87220" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dea34817fcc148d78f090ef5fa72304f"
I20260709 13:09:16.877774 24687 consensus_queue.cc:1048] T bff14fa713b6482f89ecf3e18f785f81 P c0f503bf8bb94af8a2a1139db4e1c0f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.220s
I20260709 13:09:17.121605 24085 raft_consensus.cc:3060] T e21ef2f479764142935dc2b1b7e87220 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:17.115228 24668 leader_election.cc:290] T 518a35ead60847e98c0b76330b999d6f P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 election: Requested vote from peers c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431), b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561)
I20260709 13:09:17.163190 24360 tablet_bootstrap.cc:492] T ef112a95c7964753b1c7c5a17656161b P c0f503bf8bb94af8a2a1139db4e1c0f5: Bootstrap starting.
I20260709 13:09:17.175598 24359 tablet_bootstrap.cc:492] T 65f010ca5ab74fa1b0f45b7d5dced706 P dea34817fcc148d78f090ef5fa72304f: No bootstrap required, opened a new log
I20260709 13:09:17.176723 24359 ts_tablet_manager.cc:1403] T 65f010ca5ab74fa1b0f45b7d5dced706 P dea34817fcc148d78f090ef5fa72304f: Time spent bootstrapping tablet: real 0.521s	user 0.060s	sys 0.111s
I20260709 13:09:17.191926 24362 tablet_bootstrap.cc:492] T 7a76ed4e1b6a4c2698999f722da5cfd7 P b39c386162de49aca92dbebee7f06ace: No bootstrap required, opened a new log
I20260709 13:09:17.192811 24362 ts_tablet_manager.cc:1403] T 7a76ed4e1b6a4c2698999f722da5cfd7 P b39c386162de49aca92dbebee7f06ace: Time spent bootstrapping tablet: real 0.561s	user 0.018s	sys 0.014s
I20260709 13:09:17.165421 24368 raft_consensus.cc:493] T aaf99a05bd8842ed9ea668a9da85dbcc P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.207580 24163 raft_consensus.cc:2468] T 03e06f957f794ca696ddc7207eeabff0 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dea34817fcc148d78f090ef5fa72304f in term 1.
I20260709 13:09:17.212221 24368 raft_consensus.cc:515] T aaf99a05bd8842ed9ea668a9da85dbcc P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:17.213660 24088 raft_consensus.cc:2468] T b53fa043603b41be836d4ccb5c248df8 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8d4657116f948038a0c73018238c3ba in term 1.
I20260709 13:09:17.215380 24568 raft_consensus.cc:515] T e280ec3a0e394065aca766e4f8bef46d P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:17.170392 24238 raft_consensus.cc:2468] T 03e06f957f794ca696ddc7207eeabff0 P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dea34817fcc148d78f090ef5fa72304f in term 1.
I20260709 13:09:17.226157 24057 leader_election.cc:304] T 03e06f957f794ca696ddc7207eeabff0 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0f503bf8bb94af8a2a1139db4e1c0f5, dea34817fcc148d78f090ef5fa72304f; no voters: 
I20260709 13:09:17.234084 24368 leader_election.cc:290] T aaf99a05bd8842ed9ea668a9da85dbcc P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171), b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561)
I20260709 13:09:17.234496 24680 raft_consensus.cc:2804] T 03e06f957f794ca696ddc7207eeabff0 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:17.235262 24680 raft_consensus.cc:697] T 03e06f957f794ca696ddc7207eeabff0 P dea34817fcc148d78f090ef5fa72304f [term 1 LEADER]: Becoming Leader. State: Replica: dea34817fcc148d78f090ef5fa72304f, State: Running, Role: LEADER
I20260709 13:09:17.236334 24680 consensus_queue.cc:237] T 03e06f957f794ca696ddc7207eeabff0 P dea34817fcc148d78f090ef5fa72304f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:17.237135 24160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "518a35ead60847e98c0b76330b999d6f" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5"
I20260709 13:09:17.238030 24160 raft_consensus.cc:2393] T 518a35ead60847e98c0b76330b999d6f P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f8d4657116f948038a0c73018238c3ba in current term 1: Already voted for candidate c0f503bf8bb94af8a2a1139db4e1c0f5 in this term.
I20260709 13:09:17.227094 24311 raft_consensus.cc:2468] T b53fa043603b41be836d4ccb5c248df8 P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8d4657116f948038a0c73018238c3ba in term 1.
I20260709 13:09:17.217486 24164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e06f957f794ca696ddc7207eeabff0" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" is_pre_election: true
I20260709 13:09:17.244604 24164 raft_consensus.cc:2393] T 03e06f957f794ca696ddc7207eeabff0 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f8d4657116f948038a0c73018238c3ba in current term 1: Already voted for candidate dea34817fcc148d78f090ef5fa72304f in this term.
I20260709 13:09:17.246749 24309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e280ec3a0e394065aca766e4f8bef46d" candidate_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace"
I20260709 13:09:17.247705 24309 raft_consensus.cc:3060] T e280ec3a0e394065aca766e4f8bef46d P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:17.249171 24361 tablet_bootstrap.cc:654] T 7a76ed4e1b6a4c2698999f722da5cfd7 P f8d4657116f948038a0c73018238c3ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:17.251896 24445 raft_consensus.cc:515] T 25e4818a4e2e4c9c9f7a8467aa9ef881 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:17.254288 24445 leader_election.cc:290] T 25e4818a4e2e4c9c9f7a8467aa9ef881 P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 1 election: Requested vote from peers dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343), f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171)
I20260709 13:09:17.255833 24084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e4818a4e2e4c9c9f7a8467aa9ef881" candidate_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dea34817fcc148d78f090ef5fa72304f"
I20260709 13:09:17.256610 24084 raft_consensus.cc:3060] T 25e4818a4e2e4c9c9f7a8467aa9ef881 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:17.253432 24359 raft_consensus.cc:359] T 65f010ca5ab74fa1b0f45b7d5dced706 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:17.260253 24359 raft_consensus.cc:385] T 65f010ca5ab74fa1b0f45b7d5dced706 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:17.260748 24359 raft_consensus.cc:740] T 65f010ca5ab74fa1b0f45b7d5dced706 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dea34817fcc148d78f090ef5fa72304f, State: Initialized, Role: FOLLOWER
I20260709 13:09:17.267055 24204 leader_election.cc:304] T b53fa043603b41be836d4ccb5c248df8 P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b39c386162de49aca92dbebee7f06ace, f8d4657116f948038a0c73018238c3ba; no voters: 
I20260709 13:09:17.268783 24359 consensus_queue.cc:260] T 65f010ca5ab74fa1b0f45b7d5dced706 P dea34817fcc148d78f090ef5fa72304f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:17.276693 24692 raft_consensus.cc:2804] T b53fa043603b41be836d4ccb5c248df8 P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:17.285050 24359 ts_tablet_manager.cc:1434] T 65f010ca5ab74fa1b0f45b7d5dced706 P dea34817fcc148d78f090ef5fa72304f: Time spent starting tablet: real 0.108s	user 0.006s	sys 0.003s
I20260709 13:09:17.276371 24568 leader_election.cc:290] T e280ec3a0e394065aca766e4f8bef46d P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 1 election: Requested vote from peers b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561), dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343)
I20260709 13:09:17.289753 24089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e280ec3a0e394065aca766e4f8bef46d" candidate_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dea34817fcc148d78f090ef5fa72304f"
I20260709 13:09:17.290518 24089 raft_consensus.cc:3060] T e280ec3a0e394065aca766e4f8bef46d P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:17.291399 24673 raft_consensus.cc:493] T ef112a95c7964753b1c7c5a17656161b P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.295341 24673 raft_consensus.cc:515] T ef112a95c7964753b1c7c5a17656161b P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:17.297829 24673 leader_election.cc:290] T ef112a95c7964753b1c7c5a17656161b P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431), b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561)
I20260709 13:09:17.302202 24089 raft_consensus.cc:2468] T e280ec3a0e394065aca766e4f8bef46d P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0f503bf8bb94af8a2a1139db4e1c0f5 in term 1.
I20260709 13:09:17.304030 24132 leader_election.cc:304] T e280ec3a0e394065aca766e4f8bef46d P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0f503bf8bb94af8a2a1139db4e1c0f5, dea34817fcc148d78f090ef5fa72304f; no voters: 
W20260709 13:09:17.304457 24037 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:17.305251 24701 raft_consensus.cc:2804] T e280ec3a0e394065aca766e4f8bef46d P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:17.305488 24240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e4818a4e2e4c9c9f7a8467aa9ef881" candidate_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8d4657116f948038a0c73018238c3ba" is_pre_election: true
I20260709 13:09:17.306041 24701 raft_consensus.cc:697] T e280ec3a0e394065aca766e4f8bef46d P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 LEADER]: Becoming Leader. State: Replica: c0f503bf8bb94af8a2a1139db4e1c0f5, State: Running, Role: LEADER
I20260709 13:09:17.306983 24701 consensus_queue.cc:237] T e280ec3a0e394065aca766e4f8bef46d P c0f503bf8bb94af8a2a1139db4e1c0f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:17.310496 24360 tablet_bootstrap.cc:654] T ef112a95c7964753b1c7c5a17656161b P c0f503bf8bb94af8a2a1139db4e1c0f5: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:17.291435 24359 tablet_bootstrap.cc:492] T b25c31c2fcad44f281a8a045e6cb0c19 P dea34817fcc148d78f090ef5fa72304f: Bootstrap starting.
I20260709 13:09:17.324337 24206 leader_election.cc:304] T 518a35ead60847e98c0b76330b999d6f P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8d4657116f948038a0c73018238c3ba; no voters: b39c386162de49aca92dbebee7f06ace, c0f503bf8bb94af8a2a1139db4e1c0f5
I20260709 13:09:17.331369 24362 raft_consensus.cc:359] T 7a76ed4e1b6a4c2698999f722da5cfd7 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:17.332480 24362 raft_consensus.cc:385] T 7a76ed4e1b6a4c2698999f722da5cfd7 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:17.332852 24362 raft_consensus.cc:740] T 7a76ed4e1b6a4c2698999f722da5cfd7 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b39c386162de49aca92dbebee7f06ace, State: Initialized, Role: FOLLOWER
I20260709 13:09:17.321026 24162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef112a95c7964753b1c7c5a17656161b" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" is_pre_election: true
I20260709 13:09:17.319701 24310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef112a95c7964753b1c7c5a17656161b" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace" is_pre_election: true
I20260709 13:09:17.323102 24240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaf99a05bd8842ed9ea668a9da85dbcc" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8d4657116f948038a0c73018238c3ba" is_pre_election: true
I20260709 13:09:17.293422 24312 raft_consensus.cc:2468] T 518a35ead60847e98c0b76330b999d6f P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0f503bf8bb94af8a2a1139db4e1c0f5 in term 1.
I20260709 13:09:17.311057 24238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "518a35ead60847e98c0b76330b999d6f" candidate_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8d4657116f948038a0c73018238c3ba"
I20260709 13:09:17.339459 24238 raft_consensus.cc:2393] T 518a35ead60847e98c0b76330b999d6f P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c0f503bf8bb94af8a2a1139db4e1c0f5 in current term 1: Already voted for candidate f8d4657116f948038a0c73018238c3ba in this term.
I20260709 13:09:17.341766 24130 leader_election.cc:304] T 518a35ead60847e98c0b76330b999d6f P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b39c386162de49aca92dbebee7f06ace, c0f503bf8bb94af8a2a1139db4e1c0f5; no voters: 
I20260709 13:09:17.344512 24445 raft_consensus.cc:2804] T 518a35ead60847e98c0b76330b999d6f P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:17.345005 24445 raft_consensus.cc:697] T 518a35ead60847e98c0b76330b999d6f P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 LEADER]: Becoming Leader. State: Replica: c0f503bf8bb94af8a2a1139db4e1c0f5, State: Running, Role: LEADER
I20260709 13:09:17.345749 24445 consensus_queue.cc:237] T 518a35ead60847e98c0b76330b999d6f P c0f503bf8bb94af8a2a1139db4e1c0f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:17.349429 24084 raft_consensus.cc:2468] T 25e4818a4e2e4c9c9f7a8467aa9ef881 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0f503bf8bb94af8a2a1139db4e1c0f5 in term 1.
I20260709 13:09:17.350176 24681 raft_consensus.cc:2749] T 518a35ead60847e98c0b76330b999d6f P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:09:17.351208 24132 leader_election.cc:304] T 25e4818a4e2e4c9c9f7a8467aa9ef881 P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0f503bf8bb94af8a2a1139db4e1c0f5, dea34817fcc148d78f090ef5fa72304f; no voters: 
I20260709 13:09:17.352185 24563 raft_consensus.cc:2804] T 25e4818a4e2e4c9c9f7a8467aa9ef881 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:17.352432 24311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaf99a05bd8842ed9ea668a9da85dbcc" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace" is_pre_election: true
I20260709 13:09:17.352735 24563 raft_consensus.cc:697] T 25e4818a4e2e4c9c9f7a8467aa9ef881 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 LEADER]: Becoming Leader. State: Replica: c0f503bf8bb94af8a2a1139db4e1c0f5, State: Running, Role: LEADER
I20260709 13:09:17.353839 24692 raft_consensus.cc:697] T b53fa043603b41be836d4ccb5c248df8 P f8d4657116f948038a0c73018238c3ba [term 1 LEADER]: Becoming Leader. State: Replica: f8d4657116f948038a0c73018238c3ba, State: Running, Role: LEADER
I20260709 13:09:17.353735 24563 consensus_queue.cc:237] T 25e4818a4e2e4c9c9f7a8467aa9ef881 P c0f503bf8bb94af8a2a1139db4e1c0f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:17.333868 24362 consensus_queue.cc:260] T 7a76ed4e1b6a4c2698999f722da5cfd7 P b39c386162de49aca92dbebee7f06ace [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:17.355283 24692 consensus_queue.cc:237] T b53fa043603b41be836d4ccb5c248df8 P f8d4657116f948038a0c73018238c3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:17.326375 24085 raft_consensus.cc:2468] T e21ef2f479764142935dc2b1b7e87220 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8d4657116f948038a0c73018238c3ba in term 1.
I20260709 13:09:17.417501 24362 ts_tablet_manager.cc:1434] T 7a76ed4e1b6a4c2698999f722da5cfd7 P b39c386162de49aca92dbebee7f06ace: Time spent starting tablet: real 0.224s	user 0.012s	sys 0.000s
I20260709 13:09:17.426442 24206 leader_election.cc:304] T 03e06f957f794ca696ddc7207eeabff0 P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8d4657116f948038a0c73018238c3ba; no voters: c0f503bf8bb94af8a2a1139db4e1c0f5, dea34817fcc148d78f090ef5fa72304f
I20260709 13:09:17.437654 24681 raft_consensus.cc:2749] T 03e06f957f794ca696ddc7207eeabff0 P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:17.437731 24362 tablet_bootstrap.cc:492] T ef112a95c7964753b1c7c5a17656161b P b39c386162de49aca92dbebee7f06ace: Bootstrap starting.
W20260709 13:09:17.416159 24055 leader_election.cc:343] T aaf99a05bd8842ed9ea668a9da85dbcc P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:17.432184 24204 leader_election.cc:343] T ef112a95c7964753b1c7c5a17656161b P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:17.467869 24131 leader_election.cc:343] T 25e4818a4e2e4c9c9f7a8467aa9ef881 P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:17.473930 24362 tablet_bootstrap.cc:654] T ef112a95c7964753b1c7c5a17656161b P b39c386162de49aca92dbebee7f06ace: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:17.474650 24715 log.cc:927] Time spent T 5bc4e407c8b04739aa0290922bfdbed4 P f8d4657116f948038a0c73018238c3ba: Append to log took a long time: real 0.155s	user 0.001s	sys 0.000s
W20260709 13:09:17.475713 24720 log.cc:927] Time spent T bff14fa713b6482f89ecf3e18f785f81 P f8d4657116f948038a0c73018238c3ba: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
W20260709 13:09:17.483695 24206 leader_election.cc:343] T ef112a95c7964753b1c7c5a17656161b P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:17.486008 24361 tablet_bootstrap.cc:492] T 7a76ed4e1b6a4c2698999f722da5cfd7 P f8d4657116f948038a0c73018238c3ba: No bootstrap required, opened a new log
W20260709 13:09:17.459051 24055 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:38561, user_credentials={real_user=slave}} blocked reactor thread for 47581.6us
I20260709 13:09:17.486652 24361 ts_tablet_manager.cc:1403] T 7a76ed4e1b6a4c2698999f722da5cfd7 P f8d4657116f948038a0c73018238c3ba: Time spent bootstrapping tablet: real 0.429s	user 0.037s	sys 0.027s
W20260709 13:09:17.483626 24204 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:38561, user_credentials={real_user=slave}} blocked reactor thread for 54846.1us
W20260709 13:09:17.460228 24056 leader_election.cc:343] T aaf99a05bd8842ed9ea668a9da85dbcc P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:17.489867 24361 raft_consensus.cc:359] T 7a76ed4e1b6a4c2698999f722da5cfd7 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:17.505963 24613 consensus_queue.cc:1048] T 352353d793574662ac966f335ae8cfbe P b39c386162de49aca92dbebee7f06ace [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:17.502930 24206 leader_election.cc:304] T ef112a95c7964753b1c7c5a17656161b P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8d4657116f948038a0c73018238c3ba; no voters: b39c386162de49aca92dbebee7f06ace, c0f503bf8bb94af8a2a1139db4e1c0f5
I20260709 13:09:17.511884 24361 raft_consensus.cc:385] T 7a76ed4e1b6a4c2698999f722da5cfd7 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:17.513180 24239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e4818a4e2e4c9c9f7a8467aa9ef881" candidate_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8d4657116f948038a0c73018238c3ba"
I20260709 13:09:17.514250 24677 raft_consensus.cc:2749] T ef112a95c7964753b1c7c5a17656161b P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:17.517823 24359 tablet_bootstrap.cc:654] T b25c31c2fcad44f281a8a045e6cb0c19 P dea34817fcc148d78f090ef5fa72304f: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:17.521638 24131 leader_election.cc:343] T 25e4818a4e2e4c9c9f7a8467aa9ef881 P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:17.512375 24361 raft_consensus.cc:740] T 7a76ed4e1b6a4c2698999f722da5cfd7 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8d4657116f948038a0c73018238c3ba, State: Initialized, Role: FOLLOWER
I20260709 13:09:17.524741 24361 consensus_queue.cc:260] T 7a76ed4e1b6a4c2698999f722da5cfd7 P f8d4657116f948038a0c73018238c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
W20260709 13:09:17.530030 24725 log.cc:927] Time spent T b53fa043603b41be836d4ccb5c248df8 P f8d4657116f948038a0c73018238c3ba: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 13:09:17.532768 24360 tablet_bootstrap.cc:492] T ef112a95c7964753b1c7c5a17656161b P c0f503bf8bb94af8a2a1139db4e1c0f5: No bootstrap required, opened a new log
I20260709 13:09:17.533743 24360 ts_tablet_manager.cc:1403] T ef112a95c7964753b1c7c5a17656161b P c0f503bf8bb94af8a2a1139db4e1c0f5: Time spent bootstrapping tablet: real 0.379s	user 0.013s	sys 0.008s
I20260709 13:09:17.538488 24056 leader_election.cc:304] T aaf99a05bd8842ed9ea668a9da85dbcc P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dea34817fcc148d78f090ef5fa72304f; no voters: b39c386162de49aca92dbebee7f06ace, f8d4657116f948038a0c73018238c3ba
I20260709 13:09:17.539834 24685 raft_consensus.cc:2749] T aaf99a05bd8842ed9ea668a9da85dbcc P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:09:17.541061 24056 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:46171, user_credentials={real_user=slave}} blocked reactor thread for 96313.8us
I20260709 13:09:17.528328 24309 raft_consensus.cc:2468] T e280ec3a0e394065aca766e4f8bef46d P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0f503bf8bb94af8a2a1139db4e1c0f5 in term 1.
I20260709 13:09:17.543493 24361 ts_tablet_manager.cc:1434] T 7a76ed4e1b6a4c2698999f722da5cfd7 P f8d4657116f948038a0c73018238c3ba: Time spent starting tablet: real 0.056s	user 0.007s	sys 0.001s
I20260709 13:09:17.549080 24361 tablet_bootstrap.cc:492] T 25e4818a4e2e4c9c9f7a8467aa9ef881 P f8d4657116f948038a0c73018238c3ba: Bootstrap starting.
I20260709 13:09:17.553968 24362 tablet_bootstrap.cc:492] T ef112a95c7964753b1c7c5a17656161b P b39c386162de49aca92dbebee7f06ace: No bootstrap required, opened a new log
I20260709 13:09:17.554795 24362 ts_tablet_manager.cc:1403] T ef112a95c7964753b1c7c5a17656161b P b39c386162de49aca92dbebee7f06ace: Time spent bootstrapping tablet: real 0.117s	user 0.040s	sys 0.020s
I20260709 13:09:17.557787 24362 raft_consensus.cc:359] T ef112a95c7964753b1c7c5a17656161b P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:17.558514 24362 raft_consensus.cc:385] T ef112a95c7964753b1c7c5a17656161b P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:17.558840 24362 raft_consensus.cc:740] T ef112a95c7964753b1c7c5a17656161b P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b39c386162de49aca92dbebee7f06ace, State: Initialized, Role: FOLLOWER
I20260709 13:09:17.560040 24568 consensus_queue.cc:1048] T ab4ea1ceb7a443be94ec74cd88c9bf47 P c0f503bf8bb94af8a2a1139db4e1c0f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:17.564357 24361 tablet_bootstrap.cc:654] T 25e4818a4e2e4c9c9f7a8467aa9ef881 P f8d4657116f948038a0c73018238c3ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:17.570453 24362 consensus_queue.cc:260] T ef112a95c7964753b1c7c5a17656161b P b39c386162de49aca92dbebee7f06ace [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:17.574107 24362 ts_tablet_manager.cc:1434] T ef112a95c7964753b1c7c5a17656161b P b39c386162de49aca92dbebee7f06ace: Time spent starting tablet: real 0.019s	user 0.000s	sys 0.006s
I20260709 13:09:17.575482 24362 tablet_bootstrap.cc:492] T aaf99a05bd8842ed9ea668a9da85dbcc P b39c386162de49aca92dbebee7f06ace: Bootstrap starting.
I20260709 13:09:17.575886 24361 tablet_bootstrap.cc:492] T 25e4818a4e2e4c9c9f7a8467aa9ef881 P f8d4657116f948038a0c73018238c3ba: No bootstrap required, opened a new log
I20260709 13:09:17.576424 24361 ts_tablet_manager.cc:1403] T 25e4818a4e2e4c9c9f7a8467aa9ef881 P f8d4657116f948038a0c73018238c3ba: Time spent bootstrapping tablet: real 0.028s	user 0.011s	sys 0.002s
I20260709 13:09:17.585286 24362 tablet_bootstrap.cc:654] T aaf99a05bd8842ed9ea668a9da85dbcc P b39c386162de49aca92dbebee7f06ace: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:17.591467 24361 raft_consensus.cc:359] T 25e4818a4e2e4c9c9f7a8467aa9ef881 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:17.592386 24361 raft_consensus.cc:385] T 25e4818a4e2e4c9c9f7a8467aa9ef881 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:17.592701 24361 raft_consensus.cc:740] T 25e4818a4e2e4c9c9f7a8467aa9ef881 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8d4657116f948038a0c73018238c3ba, State: Initialized, Role: FOLLOWER
I20260709 13:09:17.593504 24361 consensus_queue.cc:260] T 25e4818a4e2e4c9c9f7a8467aa9ef881 P f8d4657116f948038a0c73018238c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:17.586009 23985 catalog_manager.cc:5697] T 518a35ead60847e98c0b76330b999d6f P c0f503bf8bb94af8a2a1139db4e1c0f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66). New cstate: current_term: 1 leader_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:17.596058 24361 ts_tablet_manager.cc:1434] T 25e4818a4e2e4c9c9f7a8467aa9ef881 P f8d4657116f948038a0c73018238c3ba: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.002s
I20260709 13:09:17.597332 24361 tablet_bootstrap.cc:492] T aaf99a05bd8842ed9ea668a9da85dbcc P f8d4657116f948038a0c73018238c3ba: Bootstrap starting.
I20260709 13:09:17.596837 23985 catalog_manager.cc:5697] T 25e4818a4e2e4c9c9f7a8467aa9ef881 P c0f503bf8bb94af8a2a1139db4e1c0f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66). New cstate: current_term: 1 leader_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:17.599028 24614 consensus_queue.cc:1048] T 0dbd3426f3e14ef28e7b0b6c4c7de6a2 P b39c386162de49aca92dbebee7f06ace [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:17.600162 24610 raft_consensus.cc:493] T ef112a95c7964753b1c7c5a17656161b P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.600701 24610 raft_consensus.cc:515] T ef112a95c7964753b1c7c5a17656161b P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:17.604347 24360 raft_consensus.cc:359] T ef112a95c7964753b1c7c5a17656161b P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:17.605269 24360 raft_consensus.cc:385] T ef112a95c7964753b1c7c5a17656161b P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:17.603081 24610 leader_election.cc:290] T ef112a95c7964753b1c7c5a17656161b P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431), f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171)
I20260709 13:09:17.605691 24360 raft_consensus.cc:740] T ef112a95c7964753b1c7c5a17656161b P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0f503bf8bb94af8a2a1139db4e1c0f5, State: Initialized, Role: FOLLOWER
I20260709 13:09:17.605106 24237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef112a95c7964753b1c7c5a17656161b" candidate_uuid: "b39c386162de49aca92dbebee7f06ace" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8d4657116f948038a0c73018238c3ba" is_pre_election: true
I20260709 13:09:17.606426 24237 raft_consensus.cc:2468] T ef112a95c7964753b1c7c5a17656161b P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b39c386162de49aca92dbebee7f06ace in term 0.
I20260709 13:09:17.607868 24279 leader_election.cc:304] T ef112a95c7964753b1c7c5a17656161b P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b39c386162de49aca92dbebee7f06ace, f8d4657116f948038a0c73018238c3ba; no voters: 
I20260709 13:09:17.607758 24568 consensus_queue.cc:1048] T ab4ea1ceb7a443be94ec74cd88c9bf47 P c0f503bf8bb94af8a2a1139db4e1c0f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:17.608899 24610 raft_consensus.cc:2804] T ef112a95c7964753b1c7c5a17656161b P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:17.609321 24610 raft_consensus.cc:493] T ef112a95c7964753b1c7c5a17656161b P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:17.609804 24610 raft_consensus.cc:3060] T ef112a95c7964753b1c7c5a17656161b P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:17.616962 24677 raft_consensus.cc:493] T 7a76ed4e1b6a4c2698999f722da5cfd7 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.617655 24677 raft_consensus.cc:515] T 7a76ed4e1b6a4c2698999f722da5cfd7 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:17.619578 24614 consensus_queue.cc:1048] T 352353d793574662ac966f335ae8cfbe P b39c386162de49aca92dbebee7f06ace [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:17.621447 24677 leader_election.cc:290] T 7a76ed4e1b6a4c2698999f722da5cfd7 P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561), dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343)
I20260709 13:09:17.623751 24162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef112a95c7964753b1c7c5a17656161b" candidate_uuid: "b39c386162de49aca92dbebee7f06ace" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" is_pre_election: true
I20260709 13:09:17.630266 24360 consensus_queue.cc:260] T ef112a95c7964753b1c7c5a17656161b P c0f503bf8bb94af8a2a1139db4e1c0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:17.633227 24685 raft_consensus.cc:493] T 65f010ca5ab74fa1b0f45b7d5dced706 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.633515 24162 raft_consensus.cc:2468] T ef112a95c7964753b1c7c5a17656161b P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b39c386162de49aca92dbebee7f06ace in term 0.
I20260709 13:09:17.633826 24685 raft_consensus.cc:515] T 65f010ca5ab74fa1b0f45b7d5dced706 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:17.636390 24669 consensus_queue.cc:1048] T e21ef2f479764142935dc2b1b7e87220 P f8d4657116f948038a0c73018238c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:17.639990 24162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65f010ca5ab74fa1b0f45b7d5dced706" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" is_pre_election: true
I20260709 13:09:17.632601 23985 catalog_manager.cc:5697] T e280ec3a0e394065aca766e4f8bef46d P c0f503bf8bb94af8a2a1139db4e1c0f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66). New cstate: current_term: 1 leader_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:17.647200 23985 catalog_manager.cc:5697] T ab4ea1ceb7a443be94ec74cd88c9bf47 P c0f503bf8bb94af8a2a1139db4e1c0f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66). New cstate: current_term: 1 leader_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:17.654633 24685 leader_election.cc:290] T 65f010ca5ab74fa1b0f45b7d5dced706 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431), f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171)
I20260709 13:09:17.655661 24311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a76ed4e1b6a4c2698999f722da5cfd7" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace" is_pre_election: true
I20260709 13:09:17.656424 24311 raft_consensus.cc:2468] T 7a76ed4e1b6a4c2698999f722da5cfd7 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8d4657116f948038a0c73018238c3ba in term 0.
I20260709 13:09:17.657760 24359 tablet_bootstrap.cc:492] T b25c31c2fcad44f281a8a045e6cb0c19 P dea34817fcc148d78f090ef5fa72304f: No bootstrap required, opened a new log
I20260709 13:09:17.657933 24089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a76ed4e1b6a4c2698999f722da5cfd7" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dea34817fcc148d78f090ef5fa72304f" is_pre_election: true
I20260709 13:09:17.658334 24359 ts_tablet_manager.cc:1403] T b25c31c2fcad44f281a8a045e6cb0c19 P dea34817fcc148d78f090ef5fa72304f: Time spent bootstrapping tablet: real 0.367s	user 0.028s	sys 0.018s
I20260709 13:09:17.658663 24089 raft_consensus.cc:2468] T 7a76ed4e1b6a4c2698999f722da5cfd7 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8d4657116f948038a0c73018238c3ba in term 0.
W20260709 13:09:17.659283 24057 leader_election.cc:343] T 65f010ca5ab74fa1b0f45b7d5dced706 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:17.661268 24359 raft_consensus.cc:359] T b25c31c2fcad44f281a8a045e6cb0c19 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:17.663681 24359 raft_consensus.cc:385] T b25c31c2fcad44f281a8a045e6cb0c19 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:17.664569 24360 ts_tablet_manager.cc:1434] T ef112a95c7964753b1c7c5a17656161b P c0f503bf8bb94af8a2a1139db4e1c0f5: Time spent starting tablet: real 0.129s	user 0.010s	sys 0.000s
I20260709 13:09:17.664245 24359 raft_consensus.cc:740] T b25c31c2fcad44f281a8a045e6cb0c19 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dea34817fcc148d78f090ef5fa72304f, State: Initialized, Role: FOLLOWER
I20260709 13:09:17.665970 24360 tablet_bootstrap.cc:492] T 65f010ca5ab74fa1b0f45b7d5dced706 P c0f503bf8bb94af8a2a1139db4e1c0f5: Bootstrap starting.
I20260709 13:09:17.667120 24613 consensus_queue.cc:1048] T 0dbd3426f3e14ef28e7b0b6c4c7de6a2 P b39c386162de49aca92dbebee7f06ace [LEADER]: Connected to new peer: Peer: permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:17.668370 24204 leader_election.cc:304] T 7a76ed4e1b6a4c2698999f722da5cfd7 P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b39c386162de49aca92dbebee7f06ace, f8d4657116f948038a0c73018238c3ba; no voters: 
I20260709 13:09:17.668437 24669 consensus_queue.cc:1048] T e21ef2f479764142935dc2b1b7e87220 P f8d4657116f948038a0c73018238c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:17.670303 24677 raft_consensus.cc:2804] T 7a76ed4e1b6a4c2698999f722da5cfd7 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:17.670800 24677 raft_consensus.cc:493] T 7a76ed4e1b6a4c2698999f722da5cfd7 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:17.671168 24677 raft_consensus.cc:3060] T 7a76ed4e1b6a4c2698999f722da5cfd7 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:17.671573 24359 consensus_queue.cc:260] T b25c31c2fcad44f281a8a045e6cb0c19 P dea34817fcc148d78f090ef5fa72304f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:17.684495 24239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65f010ca5ab74fa1b0f45b7d5dced706" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8d4657116f948038a0c73018238c3ba" is_pre_election: true
I20260709 13:09:17.688758 24610 raft_consensus.cc:515] T ef112a95c7964753b1c7c5a17656161b P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:17.692638 24238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef112a95c7964753b1c7c5a17656161b" candidate_uuid: "b39c386162de49aca92dbebee7f06ace" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8d4657116f948038a0c73018238c3ba"
I20260709 13:09:17.693354 24238 raft_consensus.cc:3060] T ef112a95c7964753b1c7c5a17656161b P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:17.696444 24162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef112a95c7964753b1c7c5a17656161b" candidate_uuid: "b39c386162de49aca92dbebee7f06ace" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5"
I20260709 13:09:17.697463 24162 raft_consensus.cc:3060] T ef112a95c7964753b1c7c5a17656161b P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:17.732380 24162 raft_consensus.cc:2468] T ef112a95c7964753b1c7c5a17656161b P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b39c386162de49aca92dbebee7f06ace in term 1.
I20260709 13:09:17.730373 24677 raft_consensus.cc:515] T 7a76ed4e1b6a4c2698999f722da5cfd7 P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:17.734658 24359 ts_tablet_manager.cc:1434] T b25c31c2fcad44f281a8a045e6cb0c19 P dea34817fcc148d78f090ef5fa72304f: Time spent starting tablet: real 0.075s	user 0.004s	sys 0.003s
I20260709 13:09:17.736656 24610 leader_election.cc:290] T ef112a95c7964753b1c7c5a17656161b P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 1 election: Requested vote from peers c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431), f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171)
I20260709 13:09:17.746958 24359 tablet_bootstrap.cc:492] T 2dbbcd71c86041ba949fac653102e076 P dea34817fcc148d78f090ef5fa72304f: Bootstrap starting.
I20260709 13:09:17.744378 24280 leader_election.cc:304] T ef112a95c7964753b1c7c5a17656161b P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b39c386162de49aca92dbebee7f06ace, c0f503bf8bb94af8a2a1139db4e1c0f5; no voters: 
I20260709 13:09:17.757388 24362 tablet_bootstrap.cc:492] T aaf99a05bd8842ed9ea668a9da85dbcc P b39c386162de49aca92dbebee7f06ace: No bootstrap required, opened a new log
I20260709 13:09:17.757915 24362 ts_tablet_manager.cc:1403] T aaf99a05bd8842ed9ea668a9da85dbcc P b39c386162de49aca92dbebee7f06ace: Time spent bootstrapping tablet: real 0.183s	user 0.025s	sys 0.006s
I20260709 13:09:17.755934 24677 leader_election.cc:290] T 7a76ed4e1b6a4c2698999f722da5cfd7 P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 election: Requested vote from peers b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561), dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343)
I20260709 13:09:17.761701 24361 tablet_bootstrap.cc:654] T aaf99a05bd8842ed9ea668a9da85dbcc P f8d4657116f948038a0c73018238c3ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:17.752216 24614 raft_consensus.cc:2804] T ef112a95c7964753b1c7c5a17656161b P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:17.766657 24614 raft_consensus.cc:697] T ef112a95c7964753b1c7c5a17656161b P b39c386162de49aca92dbebee7f06ace [term 1 LEADER]: Becoming Leader. State: Replica: b39c386162de49aca92dbebee7f06ace, State: Running, Role: LEADER
I20260709 13:09:17.769271 24311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a76ed4e1b6a4c2698999f722da5cfd7" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace"
I20260709 13:09:17.770011 24311 raft_consensus.cc:3060] T 7a76ed4e1b6a4c2698999f722da5cfd7 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:17.768565 24614 consensus_queue.cc:237] T ef112a95c7964753b1c7c5a17656161b P b39c386162de49aca92dbebee7f06ace [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:17.765753 24362 raft_consensus.cc:359] T aaf99a05bd8842ed9ea668a9da85dbcc P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:17.772333 24362 raft_consensus.cc:385] T aaf99a05bd8842ed9ea668a9da85dbcc P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:17.772687 24362 raft_consensus.cc:740] T aaf99a05bd8842ed9ea668a9da85dbcc P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b39c386162de49aca92dbebee7f06ace, State: Initialized, Role: FOLLOWER
W20260709 13:09:17.775640 24056 leader_election.cc:343] T 65f010ca5ab74fa1b0f45b7d5dced706 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:17.776438 24056 leader_election.cc:304] T 65f010ca5ab74fa1b0f45b7d5dced706 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dea34817fcc148d78f090ef5fa72304f; no voters: c0f503bf8bb94af8a2a1139db4e1c0f5, f8d4657116f948038a0c73018238c3ba
I20260709 13:09:17.777612 24680 raft_consensus.cc:2749] T 65f010ca5ab74fa1b0f45b7d5dced706 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:17.773360 24362 consensus_queue.cc:260] T aaf99a05bd8842ed9ea668a9da85dbcc P b39c386162de49aca92dbebee7f06ace [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:17.786219 24086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a76ed4e1b6a4c2698999f722da5cfd7" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dea34817fcc148d78f090ef5fa72304f"
I20260709 13:09:17.786966 24086 raft_consensus.cc:3060] T 7a76ed4e1b6a4c2698999f722da5cfd7 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:17.801223 24680 raft_consensus.cc:493] T b25c31c2fcad44f281a8a045e6cb0c19 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.802032 24680 raft_consensus.cc:515] T b25c31c2fcad44f281a8a045e6cb0c19 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:17.804328 24360 tablet_bootstrap.cc:654] T 65f010ca5ab74fa1b0f45b7d5dced706 P c0f503bf8bb94af8a2a1139db4e1c0f5: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:17.808279 24160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25c31c2fcad44f281a8a045e6cb0c19" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" is_pre_election: true
I20260709 13:09:17.815196 24362 ts_tablet_manager.cc:1434] T aaf99a05bd8842ed9ea668a9da85dbcc P b39c386162de49aca92dbebee7f06ace: Time spent starting tablet: real 0.057s	user 0.008s	sys 0.001s
I20260709 13:09:17.815116 24680 leader_election.cc:290] T b25c31c2fcad44f281a8a045e6cb0c19 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561), c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431)
I20260709 13:09:17.828609 24312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25c31c2fcad44f281a8a045e6cb0c19" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace" is_pre_election: true
I20260709 13:09:17.840087 24311 raft_consensus.cc:2468] T 7a76ed4e1b6a4c2698999f722da5cfd7 P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8d4657116f948038a0c73018238c3ba in term 1.
W20260709 13:09:17.831866 24057 leader_election.cc:343] T b25c31c2fcad44f281a8a045e6cb0c19 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:17.838400 24238 raft_consensus.cc:2468] T ef112a95c7964753b1c7c5a17656161b P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b39c386162de49aca92dbebee7f06ace in term 1.
I20260709 13:09:17.855034 24362 tablet_bootstrap.cc:492] T 2dbbcd71c86041ba949fac653102e076 P b39c386162de49aca92dbebee7f06ace: Bootstrap starting.
W20260709 13:09:17.849177 24055 leader_election.cc:343] T b25c31c2fcad44f281a8a045e6cb0c19 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:17.856062 24055 leader_election.cc:304] T b25c31c2fcad44f281a8a045e6cb0c19 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dea34817fcc148d78f090ef5fa72304f; no voters: b39c386162de49aca92dbebee7f06ace, c0f503bf8bb94af8a2a1139db4e1c0f5
I20260709 13:09:17.857301 24584 raft_consensus.cc:2749] T b25c31c2fcad44f281a8a045e6cb0c19 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:17.851970 24204 leader_election.cc:304] T 7a76ed4e1b6a4c2698999f722da5cfd7 P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b39c386162de49aca92dbebee7f06ace, f8d4657116f948038a0c73018238c3ba; no voters: 
I20260709 13:09:17.865002 24713 raft_consensus.cc:2804] T 7a76ed4e1b6a4c2698999f722da5cfd7 P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:17.865636 24713 raft_consensus.cc:697] T 7a76ed4e1b6a4c2698999f722da5cfd7 P f8d4657116f948038a0c73018238c3ba [term 1 LEADER]: Becoming Leader. State: Replica: f8d4657116f948038a0c73018238c3ba, State: Running, Role: LEADER
I20260709 13:09:17.853132 24086 raft_consensus.cc:2468] T 7a76ed4e1b6a4c2698999f722da5cfd7 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8d4657116f948038a0c73018238c3ba in term 1.
I20260709 13:09:17.866595 24713 consensus_queue.cc:237] T 7a76ed4e1b6a4c2698999f722da5cfd7 P f8d4657116f948038a0c73018238c3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:17.869019 24568 consensus_queue.cc:1048] T 25e4818a4e2e4c9c9f7a8467aa9ef881 P c0f503bf8bb94af8a2a1139db4e1c0f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:17.861049 24564 consensus_queue.cc:1048] T 518a35ead60847e98c0b76330b999d6f P c0f503bf8bb94af8a2a1139db4e1c0f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:09:17.874699 24359 tablet_bootstrap.cc:654] T 2dbbcd71c86041ba949fac653102e076 P dea34817fcc148d78f090ef5fa72304f: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:17.876238 24361 tablet_bootstrap.cc:492] T aaf99a05bd8842ed9ea668a9da85dbcc P f8d4657116f948038a0c73018238c3ba: No bootstrap required, opened a new log
I20260709 13:09:17.876945 24361 ts_tablet_manager.cc:1403] T aaf99a05bd8842ed9ea668a9da85dbcc P f8d4657116f948038a0c73018238c3ba: Time spent bootstrapping tablet: real 0.280s	user 0.016s	sys 0.042s
I20260709 13:09:17.879733 24362 tablet_bootstrap.cc:654] T 2dbbcd71c86041ba949fac653102e076 P b39c386162de49aca92dbebee7f06ace: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:17.882813 24698 consensus_queue.cc:1048] T e280ec3a0e394065aca766e4f8bef46d P c0f503bf8bb94af8a2a1139db4e1c0f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:17.849119 24680 consensus_queue.cc:1048] T 03e06f957f794ca696ddc7207eeabff0 P dea34817fcc148d78f090ef5fa72304f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.036s
I20260709 13:09:17.886309 24360 tablet_bootstrap.cc:492] T 65f010ca5ab74fa1b0f45b7d5dced706 P c0f503bf8bb94af8a2a1139db4e1c0f5: No bootstrap required, opened a new log
I20260709 13:09:17.887419 24360 ts_tablet_manager.cc:1403] T 65f010ca5ab74fa1b0f45b7d5dced706 P c0f503bf8bb94af8a2a1139db4e1c0f5: Time spent bootstrapping tablet: real 0.222s	user 0.019s	sys 0.002s
I20260709 13:09:17.896484 24361 raft_consensus.cc:359] T aaf99a05bd8842ed9ea668a9da85dbcc P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:17.897557 24361 raft_consensus.cc:385] T aaf99a05bd8842ed9ea668a9da85dbcc P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:17.927371 24359 tablet_bootstrap.cc:492] T 2dbbcd71c86041ba949fac653102e076 P dea34817fcc148d78f090ef5fa72304f: No bootstrap required, opened a new log
I20260709 13:09:17.928043 24359 ts_tablet_manager.cc:1403] T 2dbbcd71c86041ba949fac653102e076 P dea34817fcc148d78f090ef5fa72304f: Time spent bootstrapping tablet: real 0.189s	user 0.010s	sys 0.028s
I20260709 13:09:17.928112 24360 raft_consensus.cc:359] T 65f010ca5ab74fa1b0f45b7d5dced706 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:17.928915 24360 raft_consensus.cc:385] T 65f010ca5ab74fa1b0f45b7d5dced706 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:17.929208 24360 raft_consensus.cc:740] T 65f010ca5ab74fa1b0f45b7d5dced706 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0f503bf8bb94af8a2a1139db4e1c0f5, State: Initialized, Role: FOLLOWER
I20260709 13:09:17.931182 24359 raft_consensus.cc:359] T 2dbbcd71c86041ba949fac653102e076 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:17.932156 24359 raft_consensus.cc:385] T 2dbbcd71c86041ba949fac653102e076 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:17.932050 24680 consensus_queue.cc:1048] T 03e06f957f794ca696ddc7207eeabff0 P dea34817fcc148d78f090ef5fa72304f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:17.932622 24359 raft_consensus.cc:740] T 2dbbcd71c86041ba949fac653102e076 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dea34817fcc148d78f090ef5fa72304f, State: Initialized, Role: FOLLOWER
I20260709 13:09:17.933653 24359 consensus_queue.cc:260] T 2dbbcd71c86041ba949fac653102e076 P dea34817fcc148d78f090ef5fa72304f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:17.935117 24445 consensus_queue.cc:1048] T 518a35ead60847e98c0b76330b999d6f P c0f503bf8bb94af8a2a1139db4e1c0f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:17.930102 24360 consensus_queue.cc:260] T 65f010ca5ab74fa1b0f45b7d5dced706 P c0f503bf8bb94af8a2a1139db4e1c0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:17.939049 24359 ts_tablet_manager.cc:1434] T 2dbbcd71c86041ba949fac653102e076 P dea34817fcc148d78f090ef5fa72304f: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.003s
I20260709 13:09:17.897841 24361 raft_consensus.cc:740] T aaf99a05bd8842ed9ea668a9da85dbcc P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8d4657116f948038a0c73018238c3ba, State: Initialized, Role: FOLLOWER
I20260709 13:09:17.940310 24361 consensus_queue.cc:260] T aaf99a05bd8842ed9ea668a9da85dbcc P f8d4657116f948038a0c73018238c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:17.941732 24359 tablet_bootstrap.cc:492] T 01f1144c4a1c482894ec993e5ce24bc4 P dea34817fcc148d78f090ef5fa72304f: Bootstrap starting.
I20260709 13:09:17.989984 24360 ts_tablet_manager.cc:1434] T 65f010ca5ab74fa1b0f45b7d5dced706 P c0f503bf8bb94af8a2a1139db4e1c0f5: Time spent starting tablet: real 0.102s	user 0.007s	sys 0.001s
I20260709 13:09:18.000774 24361 ts_tablet_manager.cc:1434] T aaf99a05bd8842ed9ea668a9da85dbcc P f8d4657116f948038a0c73018238c3ba: Time spent starting tablet: real 0.123s	user 0.007s	sys 0.007s
I20260709 13:09:18.007056 24677 consensus_queue.cc:1048] T b53fa043603b41be836d4ccb5c248df8 P f8d4657116f948038a0c73018238c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:18.018316 24362 tablet_bootstrap.cc:492] T 2dbbcd71c86041ba949fac653102e076 P b39c386162de49aca92dbebee7f06ace: No bootstrap required, opened a new log
I20260709 13:09:18.018616 24360 tablet_bootstrap.cc:492] T 6bdf4f0b87584bdab10ccc418ab54f02 P c0f503bf8bb94af8a2a1139db4e1c0f5: Bootstrap starting.
I20260709 13:09:18.019045 24362 ts_tablet_manager.cc:1403] T 2dbbcd71c86041ba949fac653102e076 P b39c386162de49aca92dbebee7f06ace: Time spent bootstrapping tablet: real 0.166s	user 0.028s	sys 0.011s
I20260709 13:09:18.020999 24677 consensus_queue.cc:1048] T b53fa043603b41be836d4ccb5c248df8 P f8d4657116f948038a0c73018238c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:18.022668 24362 raft_consensus.cc:359] T 2dbbcd71c86041ba949fac653102e076 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:18.023447 24362 raft_consensus.cc:385] T 2dbbcd71c86041ba949fac653102e076 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:18.023772 24362 raft_consensus.cc:740] T 2dbbcd71c86041ba949fac653102e076 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b39c386162de49aca92dbebee7f06ace, State: Initialized, Role: FOLLOWER
I20260709 13:09:18.024530 24362 consensus_queue.cc:260] T 2dbbcd71c86041ba949fac653102e076 P b39c386162de49aca92dbebee7f06ace [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:18.028049 24362 ts_tablet_manager.cc:1434] T 2dbbcd71c86041ba949fac653102e076 P b39c386162de49aca92dbebee7f06ace: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:09:18.031252 24362 tablet_bootstrap.cc:492] T b25c31c2fcad44f281a8a045e6cb0c19 P b39c386162de49aca92dbebee7f06ace: Bootstrap starting.
I20260709 13:09:18.040597 24361 tablet_bootstrap.cc:492] T 65f010ca5ab74fa1b0f45b7d5dced706 P f8d4657116f948038a0c73018238c3ba: Bootstrap starting.
I20260709 13:09:18.106333 24613 raft_consensus.cc:493] T aaf99a05bd8842ed9ea668a9da85dbcc P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.106999 24613 raft_consensus.cc:515] T aaf99a05bd8842ed9ea668a9da85dbcc P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:18.109200 24613 leader_election.cc:290] T aaf99a05bd8842ed9ea668a9da85dbcc P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171), dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343)
I20260709 13:09:18.095672 24698 consensus_queue.cc:1048] T e280ec3a0e394065aca766e4f8bef46d P c0f503bf8bb94af8a2a1139db4e1c0f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 13:09:18.113722 24714 raft_consensus.cc:493] T 25e4818a4e2e4c9c9f7a8467aa9ef881 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.114313 24714 raft_consensus.cc:515] T 25e4818a4e2e4c9c9f7a8467aa9ef881 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:18.120754 24361 tablet_bootstrap.cc:654] T 65f010ca5ab74fa1b0f45b7d5dced706 P f8d4657116f948038a0c73018238c3ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:18.135941 24237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaf99a05bd8842ed9ea668a9da85dbcc" candidate_uuid: "b39c386162de49aca92dbebee7f06ace" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8d4657116f948038a0c73018238c3ba" is_pre_election: true
I20260709 13:09:18.136723 24237 raft_consensus.cc:2468] T aaf99a05bd8842ed9ea668a9da85dbcc P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b39c386162de49aca92dbebee7f06ace in term 0.
I20260709 13:09:18.141716 24714 leader_election.cc:290] T 25e4818a4e2e4c9c9f7a8467aa9ef881 P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343), c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431)
I20260709 13:09:18.125837 24090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaf99a05bd8842ed9ea668a9da85dbcc" candidate_uuid: "b39c386162de49aca92dbebee7f06ace" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dea34817fcc148d78f090ef5fa72304f" is_pre_election: true
I20260709 13:09:18.147147 24090 raft_consensus.cc:2468] T aaf99a05bd8842ed9ea668a9da85dbcc P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b39c386162de49aca92dbebee7f06ace in term 0.
I20260709 13:09:18.148154 24239 raft_consensus.cc:3060] T 25e4818a4e2e4c9c9f7a8467aa9ef881 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:18.153515 24280 leader_election.cc:304] T aaf99a05bd8842ed9ea668a9da85dbcc P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b39c386162de49aca92dbebee7f06ace, dea34817fcc148d78f090ef5fa72304f; no voters: 
I20260709 13:09:18.160461 24088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e4818a4e2e4c9c9f7a8467aa9ef881" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dea34817fcc148d78f090ef5fa72304f" is_pre_election: true
I20260709 13:09:18.160470 24368 raft_consensus.cc:493] T 2dbbcd71c86041ba949fac653102e076 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.162659 24368 raft_consensus.cc:515] T 2dbbcd71c86041ba949fac653102e076 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:18.155807 24614 raft_consensus.cc:2804] T aaf99a05bd8842ed9ea668a9da85dbcc P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:18.165226 24368 leader_election.cc:290] T 2dbbcd71c86041ba949fac653102e076 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561), c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431)
I20260709 13:09:18.165584 24614 raft_consensus.cc:493] T aaf99a05bd8842ed9ea668a9da85dbcc P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:18.172994 24362 tablet_bootstrap.cc:654] T b25c31c2fcad44f281a8a045e6cb0c19 P b39c386162de49aca92dbebee7f06ace: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:18.171164 24614 raft_consensus.cc:3060] T aaf99a05bd8842ed9ea668a9da85dbcc P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:18.192621 24162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbbcd71c86041ba949fac653102e076" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" is_pre_election: true
I20260709 13:09:18.200714 24359 tablet_bootstrap.cc:654] T 01f1144c4a1c482894ec993e5ce24bc4 P dea34817fcc148d78f090ef5fa72304f: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:18.167461 24568 raft_consensus.cc:493] T 65f010ca5ab74fa1b0f45b7d5dced706 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.205068 24568 raft_consensus.cc:515] T 65f010ca5ab74fa1b0f45b7d5dced706 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:18.206328 24160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e4818a4e2e4c9c9f7a8467aa9ef881" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" is_pre_election: true
W20260709 13:09:18.207018 24057 leader_election.cc:343] T 2dbbcd71c86041ba949fac653102e076 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:18.209317 24568 leader_election.cc:290] T 65f010ca5ab74fa1b0f45b7d5dced706 P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343), f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171)
I20260709 13:09:18.230068 24313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbbcd71c86041ba949fac653102e076" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace" is_pre_election: true
I20260709 13:09:18.258507 24313 raft_consensus.cc:2468] T 2dbbcd71c86041ba949fac653102e076 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dea34817fcc148d78f090ef5fa72304f in term 0.
I20260709 13:09:18.230813 24613 consensus_queue.cc:1048] T ef112a95c7964753b1c7c5a17656161b P b39c386162de49aca92dbebee7f06ace [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:18.231810 24206 leader_election.cc:304] T 25e4818a4e2e4c9c9f7a8467aa9ef881 P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8d4657116f948038a0c73018238c3ba; no voters: c0f503bf8bb94af8a2a1139db4e1c0f5, dea34817fcc148d78f090ef5fa72304f
I20260709 13:09:18.261508 24055 leader_election.cc:304] T 2dbbcd71c86041ba949fac653102e076 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b39c386162de49aca92dbebee7f06ace, dea34817fcc148d78f090ef5fa72304f; no voters: c0f503bf8bb94af8a2a1139db4e1c0f5
I20260709 13:09:18.238382 24090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65f010ca5ab74fa1b0f45b7d5dced706" candidate_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dea34817fcc148d78f090ef5fa72304f" is_pre_election: true
I20260709 13:09:18.263047 24090 raft_consensus.cc:2468] T 65f010ca5ab74fa1b0f45b7d5dced706 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0f503bf8bb94af8a2a1139db4e1c0f5 in term 0.
I20260709 13:09:18.248526 24239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65f010ca5ab74fa1b0f45b7d5dced706" candidate_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8d4657116f948038a0c73018238c3ba" is_pre_election: true
I20260709 13:09:18.214385 24360 tablet_bootstrap.cc:654] T 6bdf4f0b87584bdab10ccc418ab54f02 P c0f503bf8bb94af8a2a1139db4e1c0f5: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:18.269922 24368 raft_consensus.cc:2804] T 2dbbcd71c86041ba949fac653102e076 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:18.270520 24368 raft_consensus.cc:493] T 2dbbcd71c86041ba949fac653102e076 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:18.271063 24368 raft_consensus.cc:3060] T 2dbbcd71c86041ba949fac653102e076 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:18.262283 24682 raft_consensus.cc:2749] T 25e4818a4e2e4c9c9f7a8467aa9ef881 P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:18.283819 24132 leader_election.cc:304] T 65f010ca5ab74fa1b0f45b7d5dced706 P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0f503bf8bb94af8a2a1139db4e1c0f5, dea34817fcc148d78f090ef5fa72304f; no voters: 
I20260709 13:09:18.284802 24564 raft_consensus.cc:2804] T 65f010ca5ab74fa1b0f45b7d5dced706 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:18.285238 24564 raft_consensus.cc:493] T 65f010ca5ab74fa1b0f45b7d5dced706 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:18.285617 24564 raft_consensus.cc:3060] T 65f010ca5ab74fa1b0f45b7d5dced706 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:18.222277 24614 raft_consensus.cc:515] T aaf99a05bd8842ed9ea668a9da85dbcc P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:18.299535 24359 tablet_bootstrap.cc:492] T 01f1144c4a1c482894ec993e5ce24bc4 P dea34817fcc148d78f090ef5fa72304f: No bootstrap required, opened a new log
I20260709 13:09:18.300196 24359 ts_tablet_manager.cc:1403] T 01f1144c4a1c482894ec993e5ce24bc4 P dea34817fcc148d78f090ef5fa72304f: Time spent bootstrapping tablet: real 0.359s	user 0.011s	sys 0.006s
I20260709 13:09:18.304944 24361 tablet_bootstrap.cc:492] T 65f010ca5ab74fa1b0f45b7d5dced706 P f8d4657116f948038a0c73018238c3ba: No bootstrap required, opened a new log
I20260709 13:09:18.305655 24361 ts_tablet_manager.cc:1403] T 65f010ca5ab74fa1b0f45b7d5dced706 P f8d4657116f948038a0c73018238c3ba: Time spent bootstrapping tablet: real 0.265s	user 0.014s	sys 0.010s
I20260709 13:09:18.311421 24359 raft_consensus.cc:359] T 01f1144c4a1c482894ec993e5ce24bc4 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:18.319062 24359 raft_consensus.cc:385] T 01f1144c4a1c482894ec993e5ce24bc4 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:18.319412 24359 raft_consensus.cc:740] T 01f1144c4a1c482894ec993e5ce24bc4 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dea34817fcc148d78f090ef5fa72304f, State: Initialized, Role: FOLLOWER
I20260709 13:09:18.315294 24362 tablet_bootstrap.cc:492] T b25c31c2fcad44f281a8a045e6cb0c19 P b39c386162de49aca92dbebee7f06ace: No bootstrap required, opened a new log
I20260709 13:09:18.316838 24698 consensus_queue.cc:1048] T 25e4818a4e2e4c9c9f7a8467aa9ef881 P c0f503bf8bb94af8a2a1139db4e1c0f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:18.325413 24614 leader_election.cc:290] T aaf99a05bd8842ed9ea668a9da85dbcc P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 1 election: Requested vote from peers f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171), dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343)
I20260709 13:09:18.327675 24239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaf99a05bd8842ed9ea668a9da85dbcc" candidate_uuid: "b39c386162de49aca92dbebee7f06ace" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8d4657116f948038a0c73018238c3ba"
I20260709 13:09:18.328053 24086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaf99a05bd8842ed9ea668a9da85dbcc" candidate_uuid: "b39c386162de49aca92dbebee7f06ace" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dea34817fcc148d78f090ef5fa72304f"
I20260709 13:09:18.328428 24239 raft_consensus.cc:3060] T aaf99a05bd8842ed9ea668a9da85dbcc P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:18.328809 24086 raft_consensus.cc:3060] T aaf99a05bd8842ed9ea668a9da85dbcc P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:18.332798 23987 catalog_manager.cc:5697] T 352353d793574662ac966f335ae8cfbe P f8d4657116f948038a0c73018238c3ba reported cstate change: term changed from 0 to 1, leader changed from <none> to b39c386162de49aca92dbebee7f06ace (127.14.180.68). New cstate: current_term: 1 leader_uuid: "b39c386162de49aca92dbebee7f06ace" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } }
I20260709 13:09:18.334718 23987 catalog_manager.cc:5697] T e21ef2f479764142935dc2b1b7e87220 P f8d4657116f948038a0c73018238c3ba reported cstate change: term changed from 0 to 1, leader changed from <none> to f8d4657116f948038a0c73018238c3ba (127.14.180.67). New cstate: current_term: 1 leader_uuid: "f8d4657116f948038a0c73018238c3ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:18.320192 24362 ts_tablet_manager.cc:1403] T b25c31c2fcad44f281a8a045e6cb0c19 P b39c386162de49aca92dbebee7f06ace: Time spent bootstrapping tablet: real 0.289s	user 0.013s	sys 0.011s
I20260709 13:09:18.312268 24368 raft_consensus.cc:515] T 2dbbcd71c86041ba949fac653102e076 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:18.344203 24564 raft_consensus.cc:515] T 65f010ca5ab74fa1b0f45b7d5dced706 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:18.345687 24368 leader_election.cc:290] T 2dbbcd71c86041ba949fac653102e076 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 election: Requested vote from peers b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561), c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431)
I20260709 13:09:18.341383 24239 raft_consensus.cc:2468] T aaf99a05bd8842ed9ea668a9da85dbcc P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b39c386162de49aca92dbebee7f06ace in term 1.
I20260709 13:09:18.342154 24086 raft_consensus.cc:2468] T aaf99a05bd8842ed9ea668a9da85dbcc P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b39c386162de49aca92dbebee7f06ace in term 1.
W20260709 13:09:18.343075 24131 leader_election.cc:343] T 65f010ca5ab74fa1b0f45b7d5dced706 P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:18.345322 24360 tablet_bootstrap.cc:492] T 6bdf4f0b87584bdab10ccc418ab54f02 P c0f503bf8bb94af8a2a1139db4e1c0f5: No bootstrap required, opened a new log
I20260709 13:09:18.346453 24308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbbcd71c86041ba949fac653102e076" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace"
W20260709 13:09:18.338778 24037 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:18.347265 24359 consensus_queue.cc:260] T 01f1144c4a1c482894ec993e5ce24bc4 P dea34817fcc148d78f090ef5fa72304f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:18.351118 24279 leader_election.cc:304] T aaf99a05bd8842ed9ea668a9da85dbcc P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b39c386162de49aca92dbebee7f06ace, f8d4657116f948038a0c73018238c3ba; no voters: 
I20260709 13:09:18.351531 24086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65f010ca5ab74fa1b0f45b7d5dced706" candidate_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dea34817fcc148d78f090ef5fa72304f"
I20260709 13:09:18.348006 24564 leader_election.cc:290] T 65f010ca5ab74fa1b0f45b7d5dced706 P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 1 election: Requested vote from peers dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343), f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171)
I20260709 13:09:18.352296 24086 raft_consensus.cc:3060] T 65f010ca5ab74fa1b0f45b7d5dced706 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:18.353048 24359 ts_tablet_manager.cc:1434] T 01f1144c4a1c482894ec993e5ce24bc4 P dea34817fcc148d78f090ef5fa72304f: Time spent starting tablet: real 0.053s	user 0.007s	sys 0.000s
I20260709 13:09:18.354166 24359 tablet_bootstrap.cc:492] T 430894245c954e33b6586b4704c66b3c P dea34817fcc148d78f090ef5fa72304f: Bootstrap starting.
I20260709 13:09:18.356555 24614 raft_consensus.cc:2804] T aaf99a05bd8842ed9ea668a9da85dbcc P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:18.360265 24614 raft_consensus.cc:697] T aaf99a05bd8842ed9ea668a9da85dbcc P b39c386162de49aca92dbebee7f06ace [term 1 LEADER]: Becoming Leader. State: Replica: b39c386162de49aca92dbebee7f06ace, State: Running, Role: LEADER
I20260709 13:09:18.361380 24614 consensus_queue.cc:237] T aaf99a05bd8842ed9ea668a9da85dbcc P b39c386162de49aca92dbebee7f06ace [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:18.348479 24362 raft_consensus.cc:359] T b25c31c2fcad44f281a8a045e6cb0c19 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:18.337035 23987 catalog_manager.cc:5697] T b53fa043603b41be836d4ccb5c248df8 P f8d4657116f948038a0c73018238c3ba reported cstate change: term changed from 0 to 1, leader changed from <none> to f8d4657116f948038a0c73018238c3ba (127.14.180.67). New cstate: current_term: 1 leader_uuid: "f8d4657116f948038a0c73018238c3ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:18.350325 24162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbbcd71c86041ba949fac653102e076" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5"
I20260709 13:09:18.363533 24362 raft_consensus.cc:385] T b25c31c2fcad44f281a8a045e6cb0c19 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:18.363938 24362 raft_consensus.cc:740] T b25c31c2fcad44f281a8a045e6cb0c19 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b39c386162de49aca92dbebee7f06ace, State: Initialized, Role: FOLLOWER
I20260709 13:09:18.350657 24360 ts_tablet_manager.cc:1403] T 6bdf4f0b87584bdab10ccc418ab54f02 P c0f503bf8bb94af8a2a1139db4e1c0f5: Time spent bootstrapping tablet: real 0.347s	user 0.013s	sys 0.002s
I20260709 13:09:18.350682 24308 raft_consensus.cc:3060] T 2dbbcd71c86041ba949fac653102e076 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:18.364923 24362 consensus_queue.cc:260] T b25c31c2fcad44f281a8a045e6cb0c19 P b39c386162de49aca92dbebee7f06ace [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:18.361773 24086 raft_consensus.cc:2468] T 65f010ca5ab74fa1b0f45b7d5dced706 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0f503bf8bb94af8a2a1139db4e1c0f5 in term 1.
I20260709 13:09:18.348088 24361 raft_consensus.cc:359] T 65f010ca5ab74fa1b0f45b7d5dced706 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:18.367568 24361 raft_consensus.cc:385] T 65f010ca5ab74fa1b0f45b7d5dced706 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:18.367949 24361 raft_consensus.cc:740] T 65f010ca5ab74fa1b0f45b7d5dced706 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8d4657116f948038a0c73018238c3ba, State: Initialized, Role: FOLLOWER
I20260709 13:09:18.367949 24360 raft_consensus.cc:359] T 6bdf4f0b87584bdab10ccc418ab54f02 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:18.369247 24360 raft_consensus.cc:385] T 6bdf4f0b87584bdab10ccc418ab54f02 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:18.369608 24360 raft_consensus.cc:740] T 6bdf4f0b87584bdab10ccc418ab54f02 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0f503bf8bb94af8a2a1139db4e1c0f5, State: Initialized, Role: FOLLOWER
I20260709 13:09:18.371806 24361 consensus_queue.cc:260] T 65f010ca5ab74fa1b0f45b7d5dced706 P f8d4657116f948038a0c73018238c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:18.367620 24362 ts_tablet_manager.cc:1434] T b25c31c2fcad44f281a8a045e6cb0c19 P b39c386162de49aca92dbebee7f06ace: Time spent starting tablet: real 0.031s	user 0.004s	sys 0.002s
I20260709 13:09:18.373242 24308 raft_consensus.cc:2468] T 2dbbcd71c86041ba949fac653102e076 P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dea34817fcc148d78f090ef5fa72304f in term 1.
I20260709 13:09:18.374810 24055 leader_election.cc:304] T 2dbbcd71c86041ba949fac653102e076 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b39c386162de49aca92dbebee7f06ace, dea34817fcc148d78f090ef5fa72304f; no voters: 
I20260709 13:09:18.370376 24360 consensus_queue.cc:260] T 6bdf4f0b87584bdab10ccc418ab54f02 P c0f503bf8bb94af8a2a1139db4e1c0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:18.378880 24362 tablet_bootstrap.cc:492] T 6bdf4f0b87584bdab10ccc418ab54f02 P b39c386162de49aca92dbebee7f06ace: Bootstrap starting.
I20260709 13:09:18.382359 24361 ts_tablet_manager.cc:1434] T 65f010ca5ab74fa1b0f45b7d5dced706 P f8d4657116f948038a0c73018238c3ba: Time spent starting tablet: real 0.076s	user 0.006s	sys 0.001s
I20260709 13:09:18.383598 24361 tablet_bootstrap.cc:492] T 6bdf4f0b87584bdab10ccc418ab54f02 P f8d4657116f948038a0c73018238c3ba: Bootstrap starting.
I20260709 13:09:18.385556 24368 raft_consensus.cc:2804] T 2dbbcd71c86041ba949fac653102e076 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:18.386679 24368 raft_consensus.cc:697] T 2dbbcd71c86041ba949fac653102e076 P dea34817fcc148d78f090ef5fa72304f [term 1 LEADER]: Becoming Leader. State: Replica: dea34817fcc148d78f090ef5fa72304f, State: Running, Role: LEADER
I20260709 13:09:18.387681 24368 consensus_queue.cc:237] T 2dbbcd71c86041ba949fac653102e076 P dea34817fcc148d78f090ef5fa72304f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:18.393275 24359 tablet_bootstrap.cc:654] T 430894245c954e33b6586b4704c66b3c P dea34817fcc148d78f090ef5fa72304f: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:18.395304 23988 catalog_manager.cc:5697] T 0dbd3426f3e14ef28e7b0b6c4c7de6a2 P b39c386162de49aca92dbebee7f06ace reported cstate change: term changed from 0 to 1, leader changed from <none> to b39c386162de49aca92dbebee7f06ace (127.14.180.68). New cstate: current_term: 1 leader_uuid: "b39c386162de49aca92dbebee7f06ace" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:18.404124 24361 tablet_bootstrap.cc:654] T 6bdf4f0b87584bdab10ccc418ab54f02 P f8d4657116f948038a0c73018238c3ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:18.403853 24237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65f010ca5ab74fa1b0f45b7d5dced706" candidate_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8d4657116f948038a0c73018238c3ba"
I20260709 13:09:18.404738 24237 raft_consensus.cc:3060] T 65f010ca5ab74fa1b0f45b7d5dced706 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:18.410681 24360 ts_tablet_manager.cc:1434] T 6bdf4f0b87584bdab10ccc418ab54f02 P c0f503bf8bb94af8a2a1139db4e1c0f5: Time spent starting tablet: real 0.046s	user 0.007s	sys 0.000s
I20260709 13:09:18.410389 23986 catalog_manager.cc:5697] T 03e06f957f794ca696ddc7207eeabff0 P dea34817fcc148d78f090ef5fa72304f reported cstate change: term changed from 0 to 1, leader changed from <none> to dea34817fcc148d78f090ef5fa72304f (127.14.180.65). New cstate: current_term: 1 leader_uuid: "dea34817fcc148d78f090ef5fa72304f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:18.416373 24682 consensus_queue.cc:1048] T 7a76ed4e1b6a4c2698999f722da5cfd7 P f8d4657116f948038a0c73018238c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:18.417575 24713 consensus_queue.cc:1048] T 7a76ed4e1b6a4c2698999f722da5cfd7 P f8d4657116f948038a0c73018238c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:18.424831 24132 leader_election.cc:304] T 65f010ca5ab74fa1b0f45b7d5dced706 P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0f503bf8bb94af8a2a1139db4e1c0f5, dea34817fcc148d78f090ef5fa72304f; no voters: 
I20260709 13:09:18.425434 24614 consensus_queue.cc:1048] T ef112a95c7964753b1c7c5a17656161b P b39c386162de49aca92dbebee7f06ace [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:09:18.429670 24057 leader_election.cc:343] T 2dbbcd71c86041ba949fac653102e076 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:18.431071 24360 tablet_bootstrap.cc:492] T b25c31c2fcad44f281a8a045e6cb0c19 P c0f503bf8bb94af8a2a1139db4e1c0f5: Bootstrap starting.
I20260709 13:09:18.434821 24564 raft_consensus.cc:2804] T 65f010ca5ab74fa1b0f45b7d5dced706 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:18.435740 24564 raft_consensus.cc:697] T 65f010ca5ab74fa1b0f45b7d5dced706 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 LEADER]: Becoming Leader. State: Replica: c0f503bf8bb94af8a2a1139db4e1c0f5, State: Running, Role: LEADER
I20260709 13:09:18.436755 24564 consensus_queue.cc:237] T 65f010ca5ab74fa1b0f45b7d5dced706 P c0f503bf8bb94af8a2a1139db4e1c0f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:18.389698 24362 tablet_bootstrap.cc:654] T 6bdf4f0b87584bdab10ccc418ab54f02 P b39c386162de49aca92dbebee7f06ace: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:18.420463 24237 raft_consensus.cc:2468] T 65f010ca5ab74fa1b0f45b7d5dced706 P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0f503bf8bb94af8a2a1139db4e1c0f5 in term 1.
I20260709 13:09:18.488664 23989 catalog_manager.cc:5697] T ef112a95c7964753b1c7c5a17656161b P b39c386162de49aca92dbebee7f06ace reported cstate change: term changed from 0 to 1, leader changed from <none> to b39c386162de49aca92dbebee7f06ace (127.14.180.68). New cstate: current_term: 1 leader_uuid: "b39c386162de49aca92dbebee7f06ace" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:18.491719 23989 catalog_manager.cc:5697] T aaf99a05bd8842ed9ea668a9da85dbcc P b39c386162de49aca92dbebee7f06ace reported cstate change: term changed from 0 to 1, leader changed from <none> to b39c386162de49aca92dbebee7f06ace (127.14.180.68). New cstate: current_term: 1 leader_uuid: "b39c386162de49aca92dbebee7f06ace" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:18.497095 24359 tablet_bootstrap.cc:492] T 430894245c954e33b6586b4704c66b3c P dea34817fcc148d78f090ef5fa72304f: No bootstrap required, opened a new log
I20260709 13:09:18.500052 24359 ts_tablet_manager.cc:1403] T 430894245c954e33b6586b4704c66b3c P dea34817fcc148d78f090ef5fa72304f: Time spent bootstrapping tablet: real 0.146s	user 0.011s	sys 0.014s
W20260709 13:09:18.517334 24768 log.cc:927] Time spent T 7a76ed4e1b6a4c2698999f722da5cfd7 P b39c386162de49aca92dbebee7f06ace: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 13:09:18.532336 24361 tablet_bootstrap.cc:492] T 6bdf4f0b87584bdab10ccc418ab54f02 P f8d4657116f948038a0c73018238c3ba: No bootstrap required, opened a new log
I20260709 13:09:18.533177 24361 ts_tablet_manager.cc:1403] T 6bdf4f0b87584bdab10ccc418ab54f02 P f8d4657116f948038a0c73018238c3ba: Time spent bootstrapping tablet: real 0.150s	user 0.019s	sys 0.036s
I20260709 13:09:18.536652 24361 raft_consensus.cc:359] T 6bdf4f0b87584bdab10ccc418ab54f02 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:18.537480 24361 raft_consensus.cc:385] T 6bdf4f0b87584bdab10ccc418ab54f02 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:18.537817 24361 raft_consensus.cc:740] T 6bdf4f0b87584bdab10ccc418ab54f02 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8d4657116f948038a0c73018238c3ba, State: Initialized, Role: FOLLOWER
I20260709 13:09:18.538671 24361 consensus_queue.cc:260] T 6bdf4f0b87584bdab10ccc418ab54f02 P f8d4657116f948038a0c73018238c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:18.541666 24361 ts_tablet_manager.cc:1434] T 6bdf4f0b87584bdab10ccc418ab54f02 P f8d4657116f948038a0c73018238c3ba: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:09:18.543012 24361 tablet_bootstrap.cc:492] T 430894245c954e33b6586b4704c66b3c P f8d4657116f948038a0c73018238c3ba: Bootstrap starting.
I20260709 13:09:18.549988 24361 tablet_bootstrap.cc:654] T 430894245c954e33b6586b4704c66b3c P f8d4657116f948038a0c73018238c3ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:18.561277 24677 raft_consensus.cc:493] T 6bdf4f0b87584bdab10ccc418ab54f02 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.561946 24677 raft_consensus.cc:515] T 6bdf4f0b87584bdab10ccc418ab54f02 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:18.631373 24360 tablet_bootstrap.cc:654] T b25c31c2fcad44f281a8a045e6cb0c19 P c0f503bf8bb94af8a2a1139db4e1c0f5: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:18.686426 24362 tablet_bootstrap.cc:492] T 6bdf4f0b87584bdab10ccc418ab54f02 P b39c386162de49aca92dbebee7f06ace: No bootstrap required, opened a new log
I20260709 13:09:18.687295 24362 ts_tablet_manager.cc:1403] T 6bdf4f0b87584bdab10ccc418ab54f02 P b39c386162de49aca92dbebee7f06ace: Time spent bootstrapping tablet: real 0.313s	user 0.028s	sys 0.024s
W20260709 13:09:18.683632 24764 log.cc:927] Time spent T 2dbbcd71c86041ba949fac653102e076 P dea34817fcc148d78f090ef5fa72304f: Append to log took a long time: real 0.178s	user 0.000s	sys 0.001s
I20260709 13:09:18.695063 24359 raft_consensus.cc:359] T 430894245c954e33b6586b4704c66b3c P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:18.695849 24359 raft_consensus.cc:385] T 430894245c954e33b6586b4704c66b3c P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:18.696135 24359 raft_consensus.cc:740] T 430894245c954e33b6586b4704c66b3c P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dea34817fcc148d78f090ef5fa72304f, State: Initialized, Role: FOLLOWER
I20260709 13:09:18.696735 24359 consensus_queue.cc:260] T 430894245c954e33b6586b4704c66b3c P dea34817fcc148d78f090ef5fa72304f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:18.696907 23989 catalog_manager.cc:5697] T 7a76ed4e1b6a4c2698999f722da5cfd7 P b39c386162de49aca92dbebee7f06ace reported cstate change: term changed from 0 to 1, leader changed from <none> to f8d4657116f948038a0c73018238c3ba (127.14.180.67). New cstate: current_term: 1 leader_uuid: "f8d4657116f948038a0c73018238c3ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } }
I20260709 13:09:18.701143 24362 raft_consensus.cc:359] T 6bdf4f0b87584bdab10ccc418ab54f02 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:18.701989 24362 raft_consensus.cc:385] T 6bdf4f0b87584bdab10ccc418ab54f02 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:18.702271 24362 raft_consensus.cc:740] T 6bdf4f0b87584bdab10ccc418ab54f02 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b39c386162de49aca92dbebee7f06ace, State: Initialized, Role: FOLLOWER
I20260709 13:09:18.698371 24359 ts_tablet_manager.cc:1434] T 430894245c954e33b6586b4704c66b3c P dea34817fcc148d78f090ef5fa72304f: Time spent starting tablet: real 0.198s	user 0.002s	sys 0.001s
I20260709 13:09:18.688544 24614 raft_consensus.cc:493] T b25c31c2fcad44f281a8a045e6cb0c19 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.703616 24362 consensus_queue.cc:260] T 6bdf4f0b87584bdab10ccc418ab54f02 P b39c386162de49aca92dbebee7f06ace [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:18.719369 24361 tablet_bootstrap.cc:492] T 430894245c954e33b6586b4704c66b3c P f8d4657116f948038a0c73018238c3ba: No bootstrap required, opened a new log
I20260709 13:09:18.720072 24361 ts_tablet_manager.cc:1403] T 430894245c954e33b6586b4704c66b3c P f8d4657116f948038a0c73018238c3ba: Time spent bootstrapping tablet: real 0.177s	user 0.020s	sys 0.038s
I20260709 13:09:18.721163 24677 leader_election.cc:290] T 6bdf4f0b87584bdab10ccc418ab54f02 P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431), b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561)
I20260709 13:09:18.725726 24614 raft_consensus.cc:515] T b25c31c2fcad44f281a8a045e6cb0c19 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:18.728147 24614 leader_election.cc:290] T b25c31c2fcad44f281a8a045e6cb0c19 P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343), c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431)
I20260709 13:09:18.728850 24359 tablet_bootstrap.cc:492] T 99b130381d71460388507938ba053f8f P dea34817fcc148d78f090ef5fa72304f: Bootstrap starting.
I20260709 13:09:18.729539 24086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25c31c2fcad44f281a8a045e6cb0c19" candidate_uuid: "b39c386162de49aca92dbebee7f06ace" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dea34817fcc148d78f090ef5fa72304f" is_pre_election: true
I20260709 13:09:18.730238 24086 raft_consensus.cc:2468] T b25c31c2fcad44f281a8a045e6cb0c19 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b39c386162de49aca92dbebee7f06ace in term 0.
I20260709 13:09:18.731544 24280 leader_election.cc:304] T b25c31c2fcad44f281a8a045e6cb0c19 P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b39c386162de49aca92dbebee7f06ace, dea34817fcc148d78f090ef5fa72304f; no voters: 
I20260709 13:09:18.732577 24362 ts_tablet_manager.cc:1434] T 6bdf4f0b87584bdab10ccc418ab54f02 P b39c386162de49aca92dbebee7f06ace: Time spent starting tablet: real 0.045s	user 0.007s	sys 0.000s
I20260709 13:09:18.727458 24361 raft_consensus.cc:359] T 430894245c954e33b6586b4704c66b3c P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:18.736717 24361 raft_consensus.cc:385] T 430894245c954e33b6586b4704c66b3c P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:18.737082 24361 raft_consensus.cc:740] T 430894245c954e33b6586b4704c66b3c P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8d4657116f948038a0c73018238c3ba, State: Initialized, Role: FOLLOWER
I20260709 13:09:18.737757 24361 consensus_queue.cc:260] T 430894245c954e33b6586b4704c66b3c P f8d4657116f948038a0c73018238c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
W20260709 13:09:18.739792 24206 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:36343, user_credentials={real_user=slave}} blocked reactor thread for 60081.7us
I20260709 13:09:18.735116 24614 raft_consensus.cc:2804] T b25c31c2fcad44f281a8a045e6cb0c19 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:18.748001 24362 tablet_bootstrap.cc:492] T 99b130381d71460388507938ba053f8f P b39c386162de49aca92dbebee7f06ace: Bootstrap starting.
I20260709 13:09:18.749697 24361 ts_tablet_manager.cc:1434] T 430894245c954e33b6586b4704c66b3c P f8d4657116f948038a0c73018238c3ba: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
I20260709 13:09:18.756701 24360 tablet_bootstrap.cc:492] T b25c31c2fcad44f281a8a045e6cb0c19 P c0f503bf8bb94af8a2a1139db4e1c0f5: No bootstrap required, opened a new log
I20260709 13:09:18.757313 24360 ts_tablet_manager.cc:1403] T b25c31c2fcad44f281a8a045e6cb0c19 P c0f503bf8bb94af8a2a1139db4e1c0f5: Time spent bootstrapping tablet: real 0.345s	user 0.015s	sys 0.007s
I20260709 13:09:18.758122 24162 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25c31c2fcad44f281a8a045e6cb0c19" candidate_uuid: "b39c386162de49aca92dbebee7f06ace" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" is_pre_election: true
I20260709 13:09:18.761204 24360 raft_consensus.cc:359] T b25c31c2fcad44f281a8a045e6cb0c19 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:18.762066 24360 raft_consensus.cc:385] T b25c31c2fcad44f281a8a045e6cb0c19 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:18.762490 24360 raft_consensus.cc:740] T b25c31c2fcad44f281a8a045e6cb0c19 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0f503bf8bb94af8a2a1139db4e1c0f5, State: Initialized, Role: FOLLOWER
I20260709 13:09:18.763198 24360 consensus_queue.cc:260] T b25c31c2fcad44f281a8a045e6cb0c19 P c0f503bf8bb94af8a2a1139db4e1c0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:18.772535 24360 ts_tablet_manager.cc:1434] T b25c31c2fcad44f281a8a045e6cb0c19 P c0f503bf8bb94af8a2a1139db4e1c0f5: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.000s
I20260709 13:09:18.772228 24568 raft_consensus.cc:493] T 6bdf4f0b87584bdab10ccc418ab54f02 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.750223 24614 raft_consensus.cc:493] T b25c31c2fcad44f281a8a045e6cb0c19 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:18.777701 24361 tablet_bootstrap.cc:492] T c5dc7f36da134739916e9685345be3ac P f8d4657116f948038a0c73018238c3ba: Bootstrap starting.
I20260709 13:09:18.774144 24308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bdf4f0b87584bdab10ccc418ab54f02" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace" is_pre_election: true
I20260709 13:09:18.782747 24308 raft_consensus.cc:2468] T 6bdf4f0b87584bdab10ccc418ab54f02 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8d4657116f948038a0c73018238c3ba in term 0.
I20260709 13:09:18.778493 24614 raft_consensus.cc:3060] T b25c31c2fcad44f281a8a045e6cb0c19 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:18.776217 24568 raft_consensus.cc:515] T 6bdf4f0b87584bdab10ccc418ab54f02 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:18.794344 24164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bdf4f0b87584bdab10ccc418ab54f02" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" is_pre_election: true
I20260709 13:09:18.809806 24162 raft_consensus.cc:2468] T b25c31c2fcad44f281a8a045e6cb0c19 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b39c386162de49aca92dbebee7f06ace in term 0.
I20260709 13:09:18.810838 24164 raft_consensus.cc:2468] T 6bdf4f0b87584bdab10ccc418ab54f02 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8d4657116f948038a0c73018238c3ba in term 0.
I20260709 13:09:18.812875 24584 raft_consensus.cc:493] T 01f1144c4a1c482894ec993e5ce24bc4 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.813573 24584 raft_consensus.cc:515] T 01f1144c4a1c482894ec993e5ce24bc4 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:18.819828 24206 leader_election.cc:304] T 6bdf4f0b87584bdab10ccc418ab54f02 P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0f503bf8bb94af8a2a1139db4e1c0f5, f8d4657116f948038a0c73018238c3ba; no voters: 
I20260709 13:09:18.822916 24778 raft_consensus.cc:2804] T 6bdf4f0b87584bdab10ccc418ab54f02 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:18.823418 24778 raft_consensus.cc:493] T 6bdf4f0b87584bdab10ccc418ab54f02 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:18.823808 24778 raft_consensus.cc:3060] T 6bdf4f0b87584bdab10ccc418ab54f02 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:18.826944 24568 leader_election.cc:290] T 6bdf4f0b87584bdab10ccc418ab54f02 P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171), b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561)
I20260709 13:09:18.827768 24237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bdf4f0b87584bdab10ccc418ab54f02" candidate_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8d4657116f948038a0c73018238c3ba" is_pre_election: true
I20260709 13:09:18.828367 24236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f1144c4a1c482894ec993e5ce24bc4" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8d4657116f948038a0c73018238c3ba" is_pre_election: true
I20260709 13:09:18.829442 24313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bdf4f0b87584bdab10ccc418ab54f02" candidate_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace" is_pre_election: true
W20260709 13:09:18.830138 24056 leader_election.cc:343] T 01f1144c4a1c482894ec993e5ce24bc4 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:18.830273 24313 raft_consensus.cc:2468] T 6bdf4f0b87584bdab10ccc418ab54f02 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0f503bf8bb94af8a2a1139db4e1c0f5 in term 0.
I20260709 13:09:18.831403 24584 leader_election.cc:290] T 01f1144c4a1c482894ec993e5ce24bc4 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171), b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561)
I20260709 13:09:18.836443 24130 leader_election.cc:304] T 6bdf4f0b87584bdab10ccc418ab54f02 P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b39c386162de49aca92dbebee7f06ace, c0f503bf8bb94af8a2a1139db4e1c0f5; no voters: 
I20260709 13:09:18.839123 24772 raft_consensus.cc:2804] T 6bdf4f0b87584bdab10ccc418ab54f02 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:18.839684 24772 raft_consensus.cc:493] T 6bdf4f0b87584bdab10ccc418ab54f02 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:18.840065 24772 raft_consensus.cc:3060] T 6bdf4f0b87584bdab10ccc418ab54f02 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:18.845912 24362 tablet_bootstrap.cc:654] T 99b130381d71460388507938ba053f8f P b39c386162de49aca92dbebee7f06ace: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:18.835084 24308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f1144c4a1c482894ec993e5ce24bc4" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace" is_pre_election: true
I20260709 13:09:18.845568 24779 raft_consensus.cc:493] T 430894245c954e33b6586b4704c66b3c P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.859256 24359 tablet_bootstrap.cc:654] T 99b130381d71460388507938ba053f8f P dea34817fcc148d78f090ef5fa72304f: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:18.859864 24360 tablet_bootstrap.cc:492] T 2dbbcd71c86041ba949fac653102e076 P c0f503bf8bb94af8a2a1139db4e1c0f5: Bootstrap starting.
W20260709 13:09:18.860008 24777 log.cc:927] Time spent T ef112a95c7964753b1c7c5a17656161b P c0f503bf8bb94af8a2a1139db4e1c0f5: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:09:18.859989 23987 catalog_manager.cc:5697] T 65f010ca5ab74fa1b0f45b7d5dced706 P c0f503bf8bb94af8a2a1139db4e1c0f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66). New cstate: current_term: 1 leader_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:18.861358 24055 leader_election.cc:343] T 01f1144c4a1c482894ec993e5ce24bc4 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:18.872810 24055 leader_election.cc:304] T 01f1144c4a1c482894ec993e5ce24bc4 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dea34817fcc148d78f090ef5fa72304f; no voters: b39c386162de49aca92dbebee7f06ace, f8d4657116f948038a0c73018238c3ba
I20260709 13:09:18.874430 24680 raft_consensus.cc:2749] T 01f1144c4a1c482894ec993e5ce24bc4 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:18.865298 24779 raft_consensus.cc:515] T 430894245c954e33b6586b4704c66b3c P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:18.880084 24772 raft_consensus.cc:515] T 6bdf4f0b87584bdab10ccc418ab54f02 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
W20260709 13:09:18.892055 24057 consensus_peers.cc:597] T 2dbbcd71c86041ba949fac653102e076 P dea34817fcc148d78f090ef5fa72304f -> Peer c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431): Couldn't send request to peer c0f503bf8bb94af8a2a1139db4e1c0f5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:18.884778 24089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430894245c954e33b6586b4704c66b3c" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dea34817fcc148d78f090ef5fa72304f" is_pre_election: true
I20260709 13:09:18.899315 24089 raft_consensus.cc:2468] T 430894245c954e33b6586b4704c66b3c P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8d4657116f948038a0c73018238c3ba in term 0.
I20260709 13:09:18.900256 24778 raft_consensus.cc:515] T 6bdf4f0b87584bdab10ccc418ab54f02 P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:18.902930 24237 raft_consensus.cc:2393] T 6bdf4f0b87584bdab10ccc418ab54f02 P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0f503bf8bb94af8a2a1139db4e1c0f5 in current term 1: Already voted for candidate f8d4657116f948038a0c73018238c3ba in this term.
I20260709 13:09:18.904709 24778 leader_election.cc:290] T 6bdf4f0b87584bdab10ccc418ab54f02 P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 election: Requested vote from peers c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431), b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561)
I20260709 13:09:18.905786 24779 leader_election.cc:290] T 430894245c954e33b6586b4704c66b3c P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343), c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431)
I20260709 13:09:18.906309 24206 leader_election.cc:304] T 430894245c954e33b6586b4704c66b3c P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dea34817fcc148d78f090ef5fa72304f, f8d4657116f948038a0c73018238c3ba; no voters: 
I20260709 13:09:18.907534 24779 raft_consensus.cc:2804] T 430894245c954e33b6586b4704c66b3c P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:18.907943 24779 raft_consensus.cc:493] T 430894245c954e33b6586b4704c66b3c P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:18.908275 24779 raft_consensus.cc:3060] T 430894245c954e33b6586b4704c66b3c P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:18.908888 24361 tablet_bootstrap.cc:654] T c5dc7f36da134739916e9685345be3ac P f8d4657116f948038a0c73018238c3ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:18.913144 23986 catalog_manager.cc:5697] T 2dbbcd71c86041ba949fac653102e076 P dea34817fcc148d78f090ef5fa72304f reported cstate change: term changed from 0 to 1, leader changed from <none> to dea34817fcc148d78f090ef5fa72304f (127.14.180.65). New cstate: current_term: 1 leader_uuid: "dea34817fcc148d78f090ef5fa72304f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:18.914731 24360 tablet_bootstrap.cc:654] T 2dbbcd71c86041ba949fac653102e076 P c0f503bf8bb94af8a2a1139db4e1c0f5: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:18.915849 24362 tablet_bootstrap.cc:492] T 99b130381d71460388507938ba053f8f P b39c386162de49aca92dbebee7f06ace: No bootstrap required, opened a new log
I20260709 13:09:18.916378 24362 ts_tablet_manager.cc:1403] T 99b130381d71460388507938ba053f8f P b39c386162de49aca92dbebee7f06ace: Time spent bootstrapping tablet: real 0.173s	user 0.015s	sys 0.007s
I20260709 13:09:18.919171 24308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bdf4f0b87584bdab10ccc418ab54f02" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace"
I20260709 13:09:18.923940 24308 raft_consensus.cc:3060] T 6bdf4f0b87584bdab10ccc418ab54f02 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:18.931342 24160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430894245c954e33b6586b4704c66b3c" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" is_pre_election: true
I20260709 13:09:18.932641 24614 raft_consensus.cc:515] T b25c31c2fcad44f281a8a045e6cb0c19 P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:18.933830 24772 leader_election.cc:290] T 6bdf4f0b87584bdab10ccc418ab54f02 P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 1 election: Requested vote from peers f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171), b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561)
I20260709 13:09:18.934352 24775 consensus_queue.cc:1048] T 2dbbcd71c86041ba949fac653102e076 P dea34817fcc148d78f090ef5fa72304f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:18.934973 24614 leader_election.cc:290] T b25c31c2fcad44f281a8a045e6cb0c19 P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 1 election: Requested vote from peers dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343), c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431)
I20260709 13:09:18.931197 24164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bdf4f0b87584bdab10ccc418ab54f02" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5"
I20260709 13:09:18.936295 24164 raft_consensus.cc:2393] T 6bdf4f0b87584bdab10ccc418ab54f02 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f8d4657116f948038a0c73018238c3ba in current term 1: Already voted for candidate c0f503bf8bb94af8a2a1139db4e1c0f5 in this term.
I20260709 13:09:18.934258 24362 raft_consensus.cc:359] T 99b130381d71460388507938ba053f8f P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:18.938234 24362 raft_consensus.cc:385] T 99b130381d71460388507938ba053f8f P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:18.942932 24362 raft_consensus.cc:740] T 99b130381d71460388507938ba053f8f P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b39c386162de49aca92dbebee7f06ace, State: Initialized, Role: FOLLOWER
I20260709 13:09:18.950407 24362 consensus_queue.cc:260] T 99b130381d71460388507938ba053f8f P b39c386162de49aca92dbebee7f06ace [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:18.953218 24164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25c31c2fcad44f281a8a045e6cb0c19" candidate_uuid: "b39c386162de49aca92dbebee7f06ace" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5"
I20260709 13:09:18.953652 24362 ts_tablet_manager.cc:1434] T 99b130381d71460388507938ba053f8f P b39c386162de49aca92dbebee7f06ace: Time spent starting tablet: real 0.037s	user 0.008s	sys 0.001s
I20260709 13:09:18.960577 24308 raft_consensus.cc:2468] T 6bdf4f0b87584bdab10ccc418ab54f02 P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8d4657116f948038a0c73018238c3ba in term 1.
I20260709 13:09:18.961200 24362 tablet_bootstrap.cc:492] T c5dc7f36da134739916e9685345be3ac P b39c386162de49aca92dbebee7f06ace: Bootstrap starting.
I20260709 13:09:18.961969 24204 leader_election.cc:304] T 6bdf4f0b87584bdab10ccc418ab54f02 P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b39c386162de49aca92dbebee7f06ace, f8d4657116f948038a0c73018238c3ba; no voters: 
I20260709 13:09:18.938755 24086 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25c31c2fcad44f281a8a045e6cb0c19" candidate_uuid: "b39c386162de49aca92dbebee7f06ace" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dea34817fcc148d78f090ef5fa72304f"
I20260709 13:09:18.963054 24086 raft_consensus.cc:3060] T b25c31c2fcad44f281a8a045e6cb0c19 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:18.962883 24377 consensus_queue.cc:1048] T aaf99a05bd8842ed9ea668a9da85dbcc P b39c386162de49aca92dbebee7f06ace [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:18.965256 24668 raft_consensus.cc:2804] T 6bdf4f0b87584bdab10ccc418ab54f02 P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:18.966130 24668 raft_consensus.cc:697] T 6bdf4f0b87584bdab10ccc418ab54f02 P f8d4657116f948038a0c73018238c3ba [term 1 LEADER]: Becoming Leader. State: Replica: f8d4657116f948038a0c73018238c3ba, State: Running, Role: LEADER
I20260709 13:09:18.958293 24312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bdf4f0b87584bdab10ccc418ab54f02" candidate_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace"
W20260709 13:09:18.954939 24206 leader_election.cc:343] T 430894245c954e33b6586b4704c66b3c P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:18.986603 24164 raft_consensus.cc:3060] T b25c31c2fcad44f281a8a045e6cb0c19 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:19.001235 24237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bdf4f0b87584bdab10ccc418ab54f02" candidate_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8d4657116f948038a0c73018238c3ba"
I20260709 13:09:19.009006 24312 raft_consensus.cc:2393] T 6bdf4f0b87584bdab10ccc418ab54f02 P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c0f503bf8bb94af8a2a1139db4e1c0f5 in current term 1: Already voted for candidate f8d4657116f948038a0c73018238c3ba in this term.
I20260709 13:09:18.967084 24668 consensus_queue.cc:237] T 6bdf4f0b87584bdab10ccc418ab54f02 P f8d4657116f948038a0c73018238c3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:19.030185 24564 consensus_queue.cc:1048] T 65f010ca5ab74fa1b0f45b7d5dced706 P c0f503bf8bb94af8a2a1139db4e1c0f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:19.039155 24131 leader_election.cc:304] T 6bdf4f0b87584bdab10ccc418ab54f02 P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0f503bf8bb94af8a2a1139db4e1c0f5; no voters: b39c386162de49aca92dbebee7f06ace, f8d4657116f948038a0c73018238c3ba
I20260709 13:09:19.040742 24772 raft_consensus.cc:2749] T 6bdf4f0b87584bdab10ccc418ab54f02 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:09:19.025133 24377 consensus_queue.cc:1048] T aaf99a05bd8842ed9ea668a9da85dbcc P b39c386162de49aca92dbebee7f06ace [LEADER]: Connected to new peer: Peer: permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.019s
I20260709 13:09:19.028270 24779 raft_consensus.cc:515] T 430894245c954e33b6586b4704c66b3c P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:19.047878 24779 leader_election.cc:290] T 430894245c954e33b6586b4704c66b3c P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 election: Requested vote from peers dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343), c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431)
I20260709 13:09:19.051470 24360 tablet_bootstrap.cc:492] T 2dbbcd71c86041ba949fac653102e076 P c0f503bf8bb94af8a2a1139db4e1c0f5: No bootstrap required, opened a new log
I20260709 13:09:19.052409 24360 ts_tablet_manager.cc:1403] T 2dbbcd71c86041ba949fac653102e076 P c0f503bf8bb94af8a2a1139db4e1c0f5: Time spent bootstrapping tablet: real 0.193s	user 0.021s	sys 0.027s
I20260709 13:09:19.053061 24086 raft_consensus.cc:2468] T b25c31c2fcad44f281a8a045e6cb0c19 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b39c386162de49aca92dbebee7f06ace in term 1.
I20260709 13:09:19.055934 24280 leader_election.cc:304] T b25c31c2fcad44f281a8a045e6cb0c19 P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b39c386162de49aca92dbebee7f06ace, dea34817fcc148d78f090ef5fa72304f; no voters: 
I20260709 13:09:19.056890 24377 raft_consensus.cc:2804] T b25c31c2fcad44f281a8a045e6cb0c19 P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:19.058959 24362 tablet_bootstrap.cc:654] T c5dc7f36da134739916e9685345be3ac P b39c386162de49aca92dbebee7f06ace: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:19.060475 24360 raft_consensus.cc:359] T 2dbbcd71c86041ba949fac653102e076 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:19.061280 24360 raft_consensus.cc:385] T 2dbbcd71c86041ba949fac653102e076 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:19.059072 24377 raft_consensus.cc:697] T b25c31c2fcad44f281a8a045e6cb0c19 P b39c386162de49aca92dbebee7f06ace [term 1 LEADER]: Becoming Leader. State: Replica: b39c386162de49aca92dbebee7f06ace, State: Running, Role: LEADER
I20260709 13:09:19.061581 24360 raft_consensus.cc:740] T 2dbbcd71c86041ba949fac653102e076 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0f503bf8bb94af8a2a1139db4e1c0f5, State: Initialized, Role: FOLLOWER
I20260709 13:09:19.062124 24613 raft_consensus.cc:493] T 99b130381d71460388507938ba053f8f P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:19.066696 24166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430894245c954e33b6586b4704c66b3c" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5"
I20260709 13:09:19.067553 24360 consensus_queue.cc:260] T 2dbbcd71c86041ba949fac653102e076 P c0f503bf8bb94af8a2a1139db4e1c0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:19.067513 24613 raft_consensus.cc:515] T 99b130381d71460388507938ba053f8f P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:19.070421 24360 ts_tablet_manager.cc:1434] T 2dbbcd71c86041ba949fac653102e076 P c0f503bf8bb94af8a2a1139db4e1c0f5: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.002s
I20260709 13:09:19.071381 24164 raft_consensus.cc:2468] T b25c31c2fcad44f281a8a045e6cb0c19 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b39c386162de49aca92dbebee7f06ace in term 1.
I20260709 13:09:19.071664 24360 tablet_bootstrap.cc:492] T c5dc7f36da134739916e9685345be3ac P c0f503bf8bb94af8a2a1139db4e1c0f5: Bootstrap starting.
I20260709 13:09:19.071899 24613 leader_election.cc:290] T 99b130381d71460388507938ba053f8f P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343), c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431)
W20260709 13:09:19.081163 24206 leader_election.cc:343] T 430894245c954e33b6586b4704c66b3c P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:19.067513 24084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430894245c954e33b6586b4704c66b3c" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dea34817fcc148d78f090ef5fa72304f"
I20260709 13:09:19.067696 24377 consensus_queue.cc:237] T b25c31c2fcad44f281a8a045e6cb0c19 P b39c386162de49aca92dbebee7f06ace [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:19.123337 24359 tablet_bootstrap.cc:492] T 99b130381d71460388507938ba053f8f P dea34817fcc148d78f090ef5fa72304f: No bootstrap required, opened a new log
I20260709 13:09:19.123998 24359 ts_tablet_manager.cc:1403] T 99b130381d71460388507938ba053f8f P dea34817fcc148d78f090ef5fa72304f: Time spent bootstrapping tablet: real 0.395s	user 0.026s	sys 0.015s
I20260709 13:09:19.124019 24360 tablet_bootstrap.cc:654] T c5dc7f36da134739916e9685345be3ac P c0f503bf8bb94af8a2a1139db4e1c0f5: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:19.094851 24084 raft_consensus.cc:3060] T 430894245c954e33b6586b4704c66b3c P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:19.097930 24166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b130381d71460388507938ba053f8f" candidate_uuid: "b39c386162de49aca92dbebee7f06ace" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" is_pre_election: true
I20260709 13:09:19.104296 24088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b130381d71460388507938ba053f8f" candidate_uuid: "b39c386162de49aca92dbebee7f06ace" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dea34817fcc148d78f090ef5fa72304f" is_pre_election: true
I20260709 13:09:19.137259 24359 raft_consensus.cc:359] T 99b130381d71460388507938ba053f8f P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:19.140600 24359 raft_consensus.cc:385] T 99b130381d71460388507938ba053f8f P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:19.141023 24359 raft_consensus.cc:740] T 99b130381d71460388507938ba053f8f P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dea34817fcc148d78f090ef5fa72304f, State: Initialized, Role: FOLLOWER
W20260709 13:09:19.145206 24280 leader_election.cc:343] T 99b130381d71460388507938ba053f8f P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:19.150823 24361 tablet_bootstrap.cc:492] T c5dc7f36da134739916e9685345be3ac P f8d4657116f948038a0c73018238c3ba: No bootstrap required, opened a new log
I20260709 13:09:19.151429 24361 ts_tablet_manager.cc:1403] T c5dc7f36da134739916e9685345be3ac P f8d4657116f948038a0c73018238c3ba: Time spent bootstrapping tablet: real 0.384s	user 0.026s	sys 0.017s
I20260709 13:09:19.155159 24359 consensus_queue.cc:260] T 99b130381d71460388507938ba053f8f P dea34817fcc148d78f090ef5fa72304f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:19.158535 24088 raft_consensus.cc:2468] T 99b130381d71460388507938ba053f8f P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b39c386162de49aca92dbebee7f06ace in term 0.
I20260709 13:09:19.158392 23987 catalog_manager.cc:5697] T 6bdf4f0b87584bdab10ccc418ab54f02 P f8d4657116f948038a0c73018238c3ba reported cstate change: term changed from 0 to 1, leader changed from <none> to f8d4657116f948038a0c73018238c3ba (127.14.180.67). New cstate: current_term: 1 leader_uuid: "f8d4657116f948038a0c73018238c3ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:19.160521 24280 leader_election.cc:304] T 99b130381d71460388507938ba053f8f P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b39c386162de49aca92dbebee7f06ace, dea34817fcc148d78f090ef5fa72304f; no voters: c0f503bf8bb94af8a2a1139db4e1c0f5
I20260709 13:09:19.174279 24359 ts_tablet_manager.cc:1434] T 99b130381d71460388507938ba053f8f P dea34817fcc148d78f090ef5fa72304f: Time spent starting tablet: real 0.050s	user 0.005s	sys 0.003s
I20260709 13:09:19.203709 24359 tablet_bootstrap.cc:492] T 03bfe46bf2b74722b6e8eb3015e38f43 P dea34817fcc148d78f090ef5fa72304f: Bootstrap starting.
I20260709 13:09:19.227612 24362 tablet_bootstrap.cc:492] T c5dc7f36da134739916e9685345be3ac P b39c386162de49aca92dbebee7f06ace: No bootstrap required, opened a new log
I20260709 13:09:19.228281 24362 ts_tablet_manager.cc:1403] T c5dc7f36da134739916e9685345be3ac P b39c386162de49aca92dbebee7f06ace: Time spent bootstrapping tablet: real 0.267s	user 0.017s	sys 0.007s
I20260709 13:09:19.222955 24610 raft_consensus.cc:2804] T 99b130381d71460388507938ba053f8f P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:19.198428 24568 consensus_queue.cc:1048] T 65f010ca5ab74fa1b0f45b7d5dced706 P c0f503bf8bb94af8a2a1139db4e1c0f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.030s
I20260709 13:09:19.235030 24610 raft_consensus.cc:493] T 99b130381d71460388507938ba053f8f P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:19.259963 24361 raft_consensus.cc:359] T c5dc7f36da134739916e9685345be3ac P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:19.261108 24361 raft_consensus.cc:385] T c5dc7f36da134739916e9685345be3ac P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:19.261425 24361 raft_consensus.cc:740] T c5dc7f36da134739916e9685345be3ac P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8d4657116f948038a0c73018238c3ba, State: Initialized, Role: FOLLOWER
I20260709 13:09:19.262355 24361 consensus_queue.cc:260] T c5dc7f36da134739916e9685345be3ac P f8d4657116f948038a0c73018238c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:19.274130 24361 ts_tablet_manager.cc:1434] T c5dc7f36da134739916e9685345be3ac P f8d4657116f948038a0c73018238c3ba: Time spent starting tablet: real 0.122s	user 0.010s	sys 0.000s
I20260709 13:09:19.283164 24360 tablet_bootstrap.cc:492] T c5dc7f36da134739916e9685345be3ac P c0f503bf8bb94af8a2a1139db4e1c0f5: No bootstrap required, opened a new log
I20260709 13:09:19.283986 24360 ts_tablet_manager.cc:1403] T c5dc7f36da134739916e9685345be3ac P c0f503bf8bb94af8a2a1139db4e1c0f5: Time spent bootstrapping tablet: real 0.213s	user 0.014s	sys 0.009s
I20260709 13:09:19.265018 24610 raft_consensus.cc:3060] T 99b130381d71460388507938ba053f8f P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:19.286935 24362 raft_consensus.cc:359] T c5dc7f36da134739916e9685345be3ac P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:19.292483 24362 raft_consensus.cc:385] T c5dc7f36da134739916e9685345be3ac P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:19.292959 24362 raft_consensus.cc:740] T c5dc7f36da134739916e9685345be3ac P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b39c386162de49aca92dbebee7f06ace, State: Initialized, Role: FOLLOWER
W20260709 13:09:19.286583 24792 log.cc:927] Time spent T 65f010ca5ab74fa1b0f45b7d5dced706 P dea34817fcc148d78f090ef5fa72304f: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:09:19.297576 24362 consensus_queue.cc:260] T c5dc7f36da134739916e9685345be3ac P b39c386162de49aca92dbebee7f06ace [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:19.314934 24359 tablet_bootstrap.cc:654] T 03bfe46bf2b74722b6e8eb3015e38f43 P dea34817fcc148d78f090ef5fa72304f: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:19.333125 24362 ts_tablet_manager.cc:1434] T c5dc7f36da134739916e9685345be3ac P b39c386162de49aca92dbebee7f06ace: Time spent starting tablet: real 0.104s	user 0.007s	sys 0.001s
I20260709 13:09:19.310989 24084 raft_consensus.cc:2468] T 430894245c954e33b6586b4704c66b3c P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8d4657116f948038a0c73018238c3ba in term 1.
I20260709 13:09:19.347286 24362 tablet_bootstrap.cc:492] T 01f1144c4a1c482894ec993e5ce24bc4 P b39c386162de49aca92dbebee7f06ace: Bootstrap starting.
I20260709 13:09:19.331791 24677 raft_consensus.cc:493] T c5dc7f36da134739916e9685345be3ac P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:19.358103 24677 raft_consensus.cc:515] T c5dc7f36da134739916e9685345be3ac P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:19.360396 24677 leader_election.cc:290] T c5dc7f36da134739916e9685345be3ac P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431), b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561)
I20260709 13:09:19.364697 24361 tablet_bootstrap.cc:492] T 01f1144c4a1c482894ec993e5ce24bc4 P f8d4657116f948038a0c73018238c3ba: Bootstrap starting.
I20260709 13:09:19.379050 24313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5dc7f36da134739916e9685345be3ac" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace" is_pre_election: true
I20260709 13:09:19.379808 24313 raft_consensus.cc:2468] T c5dc7f36da134739916e9685345be3ac P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8d4657116f948038a0c73018238c3ba in term 0.
I20260709 13:09:19.398192 24204 leader_election.cc:304] T c5dc7f36da134739916e9685345be3ac P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b39c386162de49aca92dbebee7f06ace, f8d4657116f948038a0c73018238c3ba; no voters: 
I20260709 13:09:19.410060 24568 raft_consensus.cc:493] T 2dbbcd71c86041ba949fac653102e076 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:19.445807 24204 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:38561, user_credentials={real_user=slave}} blocked reactor thread for 47750.3us
I20260709 13:09:19.446439 24669 raft_consensus.cc:2804] T c5dc7f36da134739916e9685345be3ac P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:19.459035 23986 catalog_manager.cc:5697] T b25c31c2fcad44f281a8a045e6cb0c19 P b39c386162de49aca92dbebee7f06ace reported cstate change: term changed from 0 to 1, leader changed from <none> to b39c386162de49aca92dbebee7f06ace (127.14.180.68). New cstate: current_term: 1 leader_uuid: "b39c386162de49aca92dbebee7f06ace" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:19.473505 24360 raft_consensus.cc:359] T c5dc7f36da134739916e9685345be3ac P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:19.476423 24360 raft_consensus.cc:385] T c5dc7f36da134739916e9685345be3ac P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:19.476735 24360 raft_consensus.cc:740] T c5dc7f36da134739916e9685345be3ac P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0f503bf8bb94af8a2a1139db4e1c0f5, State: Initialized, Role: FOLLOWER
I20260709 13:09:19.475347 24669 raft_consensus.cc:493] T c5dc7f36da134739916e9685345be3ac P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:19.484609 24669 raft_consensus.cc:3060] T c5dc7f36da134739916e9685345be3ac P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:19.488093 24037 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:19.477389 24360 consensus_queue.cc:260] T c5dc7f36da134739916e9685345be3ac P c0f503bf8bb94af8a2a1139db4e1c0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:19.495958 24161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5dc7f36da134739916e9685345be3ac" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" is_pre_election: true
I20260709 13:09:19.496774 24161 raft_consensus.cc:2468] T c5dc7f36da134739916e9685345be3ac P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8d4657116f948038a0c73018238c3ba in term 0.
I20260709 13:09:19.502012 24361 tablet_bootstrap.cc:654] T 01f1144c4a1c482894ec993e5ce24bc4 P f8d4657116f948038a0c73018238c3ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:19.478683 24568 raft_consensus.cc:515] T 2dbbcd71c86041ba949fac653102e076 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:19.507812 24568 leader_election.cc:290] T 2dbbcd71c86041ba949fac653102e076 P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561), dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343)
I20260709 13:09:19.512179 24161 raft_consensus.cc:3060] T 2dbbcd71c86041ba949fac653102e076 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:19.512775 24312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbbcd71c86041ba949fac653102e076" candidate_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace" is_pre_election: true
W20260709 13:09:19.520376 24132 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:36343, user_credentials={real_user=slave}} blocked reactor thread for 43698.8us
I20260709 13:09:19.522964 24360 ts_tablet_manager.cc:1434] T c5dc7f36da134739916e9685345be3ac P c0f503bf8bb94af8a2a1139db4e1c0f5: Time spent starting tablet: real 0.239s	user 0.010s	sys 0.001s
I20260709 13:09:19.546417 24089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbbcd71c86041ba949fac653102e076" candidate_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dea34817fcc148d78f090ef5fa72304f" is_pre_election: true
W20260709 13:09:19.549723 24206 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:36343, user_credentials={real_user=slave}} blocked reactor thread for 102233us
I20260709 13:09:19.550979 24360 tablet_bootstrap.cc:492] T 430894245c954e33b6586b4704c66b3c P c0f503bf8bb94af8a2a1139db4e1c0f5: Bootstrap starting.
I20260709 13:09:19.551602 24206 leader_election.cc:304] T 430894245c954e33b6586b4704c66b3c P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dea34817fcc148d78f090ef5fa72304f, f8d4657116f948038a0c73018238c3ba; no voters: c0f503bf8bb94af8a2a1139db4e1c0f5
I20260709 13:09:19.545965 24610 raft_consensus.cc:515] T 99b130381d71460388507938ba053f8f P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:19.542896 24669 raft_consensus.cc:515] T c5dc7f36da134739916e9685345be3ac P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:19.561885 24713 raft_consensus.cc:2804] T 430894245c954e33b6586b4704c66b3c P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:19.552453 24779 consensus_queue.cc:1048] T 6bdf4f0b87584bdab10ccc418ab54f02 P f8d4657116f948038a0c73018238c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260709 13:09:19.567608 24130 leader_election.cc:304] T 2dbbcd71c86041ba949fac653102e076 P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0f503bf8bb94af8a2a1139db4e1c0f5; no voters: b39c386162de49aca92dbebee7f06ace, dea34817fcc148d78f090ef5fa72304f
I20260709 13:09:19.597530 24359 tablet_bootstrap.cc:492] T 03bfe46bf2b74722b6e8eb3015e38f43 P dea34817fcc148d78f090ef5fa72304f: No bootstrap required, opened a new log
I20260709 13:09:19.608001 24359 ts_tablet_manager.cc:1403] T 03bfe46bf2b74722b6e8eb3015e38f43 P dea34817fcc148d78f090ef5fa72304f: Time spent bootstrapping tablet: real 0.410s	user 0.030s	sys 0.035s
I20260709 13:09:19.598672 24713 raft_consensus.cc:697] T 430894245c954e33b6586b4704c66b3c P f8d4657116f948038a0c73018238c3ba [term 1 LEADER]: Becoming Leader. State: Replica: f8d4657116f948038a0c73018238c3ba, State: Running, Role: LEADER
I20260709 13:09:19.599946 24610 leader_election.cc:290] T 99b130381d71460388507938ba053f8f P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 1 election: Requested vote from peers dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343), c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431)
I20260709 13:09:19.641305 24362 tablet_bootstrap.cc:654] T 01f1144c4a1c482894ec993e5ce24bc4 P b39c386162de49aca92dbebee7f06ace: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:19.586440 24669 leader_election.cc:290] T c5dc7f36da134739916e9685345be3ac P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 election: Requested vote from peers c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431), b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561)
I20260709 13:09:19.665225 24165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b130381d71460388507938ba053f8f" candidate_uuid: "b39c386162de49aca92dbebee7f06ace" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5"
I20260709 13:09:19.660718 24359 raft_consensus.cc:359] T 03bfe46bf2b74722b6e8eb3015e38f43 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:19.667177 24359 raft_consensus.cc:385] T 03bfe46bf2b74722b6e8eb3015e38f43 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:19.667598 24359 raft_consensus.cc:740] T 03bfe46bf2b74722b6e8eb3015e38f43 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dea34817fcc148d78f090ef5fa72304f, State: Initialized, Role: FOLLOWER
I20260709 13:09:19.668625 24359 consensus_queue.cc:260] T 03bfe46bf2b74722b6e8eb3015e38f43 P dea34817fcc148d78f090ef5fa72304f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:19.640497 24089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b130381d71460388507938ba053f8f" candidate_uuid: "b39c386162de49aca92dbebee7f06ace" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dea34817fcc148d78f090ef5fa72304f"
I20260709 13:09:19.653700 24312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5dc7f36da134739916e9685345be3ac" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace"
W20260709 13:09:19.675149 24280 leader_election.cc:343] T 99b130381d71460388507938ba053f8f P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:19.688269 24206 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:36343, user_credentials={real_user=slave}} blocked reactor thread for 118626us
I20260709 13:09:19.685359 24312 raft_consensus.cc:3060] T c5dc7f36da134739916e9685345be3ac P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:19.678112 24130 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.68:38561, user_credentials={real_user=slave}} blocked reactor thread for 114165us
I20260709 13:09:19.687515 24089 raft_consensus.cc:3060] T 99b130381d71460388507938ba053f8f P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:19.691560 24564 raft_consensus.cc:2749] T 2dbbcd71c86041ba949fac653102e076 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:19.688282 24610 consensus_queue.cc:1048] T b25c31c2fcad44f281a8a045e6cb0c19 P b39c386162de49aca92dbebee7f06ace [LEADER]: Connected to new peer: Peer: permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.032s
I20260709 13:09:19.731911 24361 tablet_bootstrap.cc:492] T 01f1144c4a1c482894ec993e5ce24bc4 P f8d4657116f948038a0c73018238c3ba: No bootstrap required, opened a new log
I20260709 13:09:19.733574 24360 tablet_bootstrap.cc:654] T 430894245c954e33b6586b4704c66b3c P c0f503bf8bb94af8a2a1139db4e1c0f5: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:19.734619 24361 ts_tablet_manager.cc:1403] T 01f1144c4a1c482894ec993e5ce24bc4 P f8d4657116f948038a0c73018238c3ba: Time spent bootstrapping tablet: real 0.370s	user 0.024s	sys 0.003s
I20260709 13:09:19.742264 24361 raft_consensus.cc:359] T 01f1144c4a1c482894ec993e5ce24bc4 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:19.743381 24361 raft_consensus.cc:385] T 01f1144c4a1c482894ec993e5ce24bc4 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:19.743804 24361 raft_consensus.cc:740] T 01f1144c4a1c482894ec993e5ce24bc4 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8d4657116f948038a0c73018238c3ba, State: Initialized, Role: FOLLOWER
I20260709 13:09:19.745180 24312 raft_consensus.cc:2468] T c5dc7f36da134739916e9685345be3ac P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8d4657116f948038a0c73018238c3ba in term 1.
I20260709 13:09:19.744716 24361 consensus_queue.cc:260] T 01f1144c4a1c482894ec993e5ce24bc4 P f8d4657116f948038a0c73018238c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:19.747985 24204 leader_election.cc:304] T c5dc7f36da134739916e9685345be3ac P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b39c386162de49aca92dbebee7f06ace, f8d4657116f948038a0c73018238c3ba; no voters: 
I20260709 13:09:19.750837 24158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5dc7f36da134739916e9685345be3ac" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5"
I20260709 13:09:19.751648 24158 raft_consensus.cc:3060] T c5dc7f36da134739916e9685345be3ac P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:19.751857 24805 raft_consensus.cc:2804] T c5dc7f36da134739916e9685345be3ac P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:19.698007 24713 consensus_queue.cc:237] T 430894245c954e33b6586b4704c66b3c P f8d4657116f948038a0c73018238c3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:19.752466 24805 raft_consensus.cc:697] T c5dc7f36da134739916e9685345be3ac P f8d4657116f948038a0c73018238c3ba [term 1 LEADER]: Becoming Leader. State: Replica: f8d4657116f948038a0c73018238c3ba, State: Running, Role: LEADER
I20260709 13:09:19.753404 24805 consensus_queue.cc:237] T c5dc7f36da134739916e9685345be3ac P f8d4657116f948038a0c73018238c3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:19.788197 24361 ts_tablet_manager.cc:1434] T 01f1144c4a1c482894ec993e5ce24bc4 P f8d4657116f948038a0c73018238c3ba: Time spent starting tablet: real 0.053s	user 0.008s	sys 0.000s
W20260709 13:09:19.778399 24055 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:38561, user_credentials={real_user=slave}} blocked reactor thread for 98872.4us
I20260709 13:09:19.815369 24089 raft_consensus.cc:2468] T 99b130381d71460388507938ba053f8f P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b39c386162de49aca92dbebee7f06ace in term 1.
I20260709 13:09:19.818297 24280 leader_election.cc:304] T 99b130381d71460388507938ba053f8f P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b39c386162de49aca92dbebee7f06ace, dea34817fcc148d78f090ef5fa72304f; no voters: c0f503bf8bb94af8a2a1139db4e1c0f5
I20260709 13:09:19.821713 24362 tablet_bootstrap.cc:492] T 01f1144c4a1c482894ec993e5ce24bc4 P b39c386162de49aca92dbebee7f06ace: No bootstrap required, opened a new log
I20260709 13:09:19.822329 24362 ts_tablet_manager.cc:1403] T 01f1144c4a1c482894ec993e5ce24bc4 P b39c386162de49aca92dbebee7f06ace: Time spent bootstrapping tablet: real 0.478s	user 0.022s	sys 0.010s
I20260709 13:09:19.804111 24812 consensus_queue.cc:1048] T 6bdf4f0b87584bdab10ccc418ab54f02 P f8d4657116f948038a0c73018238c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.020s
I20260709 13:09:19.846052 24158 raft_consensus.cc:2468] T c5dc7f36da134739916e9685345be3ac P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8d4657116f948038a0c73018238c3ba in term 1.
I20260709 13:09:19.821657 24610 consensus_queue.cc:1048] T b25c31c2fcad44f281a8a045e6cb0c19 P b39c386162de49aca92dbebee7f06ace [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.028s
I20260709 13:09:19.822419 24804 raft_consensus.cc:2804] T 99b130381d71460388507938ba053f8f P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:09:19.856796 24819 log.cc:927] Time spent T 6bdf4f0b87584bdab10ccc418ab54f02 P b39c386162de49aca92dbebee7f06ace: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:09:19.859797 24362 raft_consensus.cc:359] T 01f1144c4a1c482894ec993e5ce24bc4 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:19.863255 24362 raft_consensus.cc:385] T 01f1144c4a1c482894ec993e5ce24bc4 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:19.863642 24362 raft_consensus.cc:740] T 01f1144c4a1c482894ec993e5ce24bc4 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b39c386162de49aca92dbebee7f06ace, State: Initialized, Role: FOLLOWER
I20260709 13:09:19.864200 24362 consensus_queue.cc:260] T 01f1144c4a1c482894ec993e5ce24bc4 P b39c386162de49aca92dbebee7f06ace [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:19.867156 24361 tablet_bootstrap.cc:492] T a0ff7e0491fb406d9e1f13941504372f P f8d4657116f948038a0c73018238c3ba: Bootstrap starting.
I20260709 13:09:19.873220 24359 ts_tablet_manager.cc:1434] T 03bfe46bf2b74722b6e8eb3015e38f43 P dea34817fcc148d78f090ef5fa72304f: Time spent starting tablet: real 0.265s	user 0.019s	sys 0.011s
I20260709 13:09:19.884941 24362 ts_tablet_manager.cc:1434] T 01f1144c4a1c482894ec993e5ce24bc4 P b39c386162de49aca92dbebee7f06ace: Time spent starting tablet: real 0.062s	user 0.007s	sys 0.000s
I20260709 13:09:19.868191 24804 raft_consensus.cc:697] T 99b130381d71460388507938ba053f8f P b39c386162de49aca92dbebee7f06ace [term 1 LEADER]: Becoming Leader. State: Replica: b39c386162de49aca92dbebee7f06ace, State: Running, Role: LEADER
I20260709 13:09:19.910436 24359 tablet_bootstrap.cc:492] T 662a938528e545e6aa4592052da18101 P dea34817fcc148d78f090ef5fa72304f: Bootstrap starting.
I20260709 13:09:19.917963 24804 consensus_queue.cc:237] T 99b130381d71460388507938ba053f8f P b39c386162de49aca92dbebee7f06ace [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:19.921160 24360 tablet_bootstrap.cc:492] T 430894245c954e33b6586b4704c66b3c P c0f503bf8bb94af8a2a1139db4e1c0f5: No bootstrap required, opened a new log
I20260709 13:09:19.921831 24360 ts_tablet_manager.cc:1403] T 430894245c954e33b6586b4704c66b3c P c0f503bf8bb94af8a2a1139db4e1c0f5: Time spent bootstrapping tablet: real 0.385s	user 0.021s	sys 0.012s
I20260709 13:09:19.921974 24362 tablet_bootstrap.cc:492] T 71cb3d981445473ca321bbe44299879c P b39c386162de49aca92dbebee7f06ace: Bootstrap starting.
I20260709 13:09:19.925047 24360 raft_consensus.cc:359] T 430894245c954e33b6586b4704c66b3c P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:19.925848 24360 raft_consensus.cc:385] T 430894245c954e33b6586b4704c66b3c P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:19.926177 24360 raft_consensus.cc:740] T 430894245c954e33b6586b4704c66b3c P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0f503bf8bb94af8a2a1139db4e1c0f5, State: Initialized, Role: FOLLOWER
I20260709 13:09:19.927791 24360 consensus_queue.cc:260] T 430894245c954e33b6586b4704c66b3c P c0f503bf8bb94af8a2a1139db4e1c0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:19.930799 24360 ts_tablet_manager.cc:1434] T 430894245c954e33b6586b4704c66b3c P c0f503bf8bb94af8a2a1139db4e1c0f5: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:09:19.940392 24360 tablet_bootstrap.cc:492] T 03bfe46bf2b74722b6e8eb3015e38f43 P c0f503bf8bb94af8a2a1139db4e1c0f5: Bootstrap starting.
I20260709 13:09:19.967757 24361 tablet_bootstrap.cc:654] T a0ff7e0491fb406d9e1f13941504372f P f8d4657116f948038a0c73018238c3ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:19.970003 24362 tablet_bootstrap.cc:654] T 71cb3d981445473ca321bbe44299879c P b39c386162de49aca92dbebee7f06ace: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:19.977969 24359 tablet_bootstrap.cc:654] T 662a938528e545e6aa4592052da18101 P dea34817fcc148d78f090ef5fa72304f: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:19.992060 24362 tablet_bootstrap.cc:492] T 71cb3d981445473ca321bbe44299879c P b39c386162de49aca92dbebee7f06ace: No bootstrap required, opened a new log
I20260709 13:09:19.992715 24362 ts_tablet_manager.cc:1403] T 71cb3d981445473ca321bbe44299879c P b39c386162de49aca92dbebee7f06ace: Time spent bootstrapping tablet: real 0.071s	user 0.008s	sys 0.004s
I20260709 13:09:19.995767 24362 raft_consensus.cc:359] T 71cb3d981445473ca321bbe44299879c P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:20.001268 24361 tablet_bootstrap.cc:492] T a0ff7e0491fb406d9e1f13941504372f P f8d4657116f948038a0c73018238c3ba: No bootstrap required, opened a new log
I20260709 13:09:20.001835 24361 ts_tablet_manager.cc:1403] T a0ff7e0491fb406d9e1f13941504372f P f8d4657116f948038a0c73018238c3ba: Time spent bootstrapping tablet: real 0.196s	user 0.011s	sys 0.000s
I20260709 13:09:20.004603 24361 raft_consensus.cc:359] T a0ff7e0491fb406d9e1f13941504372f P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:20.005301 24361 raft_consensus.cc:385] T a0ff7e0491fb406d9e1f13941504372f P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:20.005493 24361 raft_consensus.cc:740] T a0ff7e0491fb406d9e1f13941504372f P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8d4657116f948038a0c73018238c3ba, State: Initialized, Role: FOLLOWER
I20260709 13:09:19.996502 24362 raft_consensus.cc:385] T 71cb3d981445473ca321bbe44299879c P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:20.006016 24362 raft_consensus.cc:740] T 71cb3d981445473ca321bbe44299879c P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b39c386162de49aca92dbebee7f06ace, State: Initialized, Role: FOLLOWER
I20260709 13:09:20.006919 24362 consensus_queue.cc:260] T 71cb3d981445473ca321bbe44299879c P b39c386162de49aca92dbebee7f06ace [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:20.008709 24362 ts_tablet_manager.cc:1434] T 71cb3d981445473ca321bbe44299879c P b39c386162de49aca92dbebee7f06ace: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:09:20.006023 24361 consensus_queue.cc:260] T a0ff7e0491fb406d9e1f13941504372f P f8d4657116f948038a0c73018238c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:20.010540 24362 tablet_bootstrap.cc:492] T a0ff7e0491fb406d9e1f13941504372f P b39c386162de49aca92dbebee7f06ace: Bootstrap starting.
I20260709 13:09:20.012200 24361 ts_tablet_manager.cc:1434] T a0ff7e0491fb406d9e1f13941504372f P f8d4657116f948038a0c73018238c3ba: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.002s
I20260709 13:09:20.013214 24361 tablet_bootstrap.cc:492] T 662a938528e545e6aa4592052da18101 P f8d4657116f948038a0c73018238c3ba: Bootstrap starting.
I20260709 13:09:20.017602 24362 tablet_bootstrap.cc:654] T a0ff7e0491fb406d9e1f13941504372f P b39c386162de49aca92dbebee7f06ace: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:20.024384 23987 catalog_manager.cc:5697] T c5dc7f36da134739916e9685345be3ac P f8d4657116f948038a0c73018238c3ba reported cstate change: term changed from 0 to 1, leader changed from <none> to f8d4657116f948038a0c73018238c3ba (127.14.180.67). New cstate: current_term: 1 leader_uuid: "f8d4657116f948038a0c73018238c3ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:20.026247 23987 catalog_manager.cc:5697] T 430894245c954e33b6586b4704c66b3c P f8d4657116f948038a0c73018238c3ba reported cstate change: term changed from 0 to 1, leader changed from <none> to f8d4657116f948038a0c73018238c3ba (127.14.180.67). New cstate: current_term: 1 leader_uuid: "f8d4657116f948038a0c73018238c3ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:20.033722 24361 tablet_bootstrap.cc:654] T 662a938528e545e6aa4592052da18101 P f8d4657116f948038a0c73018238c3ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:20.035279 24362 tablet_bootstrap.cc:492] T a0ff7e0491fb406d9e1f13941504372f P b39c386162de49aca92dbebee7f06ace: No bootstrap required, opened a new log
I20260709 13:09:20.035987 24362 ts_tablet_manager.cc:1403] T a0ff7e0491fb406d9e1f13941504372f P b39c386162de49aca92dbebee7f06ace: Time spent bootstrapping tablet: real 0.026s	user 0.006s	sys 0.016s
I20260709 13:09:20.039796 24362 raft_consensus.cc:359] T a0ff7e0491fb406d9e1f13941504372f P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:20.040789 24362 raft_consensus.cc:385] T a0ff7e0491fb406d9e1f13941504372f P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:20.041141 24362 raft_consensus.cc:740] T a0ff7e0491fb406d9e1f13941504372f P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b39c386162de49aca92dbebee7f06ace, State: Initialized, Role: FOLLOWER
I20260709 13:09:20.042519 24362 consensus_queue.cc:260] T a0ff7e0491fb406d9e1f13941504372f P b39c386162de49aca92dbebee7f06ace [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:20.045666 24360 tablet_bootstrap.cc:654] T 03bfe46bf2b74722b6e8eb3015e38f43 P c0f503bf8bb94af8a2a1139db4e1c0f5: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:20.046072 24362 ts_tablet_manager.cc:1434] T a0ff7e0491fb406d9e1f13941504372f P b39c386162de49aca92dbebee7f06ace: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.006s
I20260709 13:09:20.055160 24361 tablet_bootstrap.cc:492] T 662a938528e545e6aa4592052da18101 P f8d4657116f948038a0c73018238c3ba: No bootstrap required, opened a new log
I20260709 13:09:20.058768 24361 ts_tablet_manager.cc:1403] T 662a938528e545e6aa4592052da18101 P f8d4657116f948038a0c73018238c3ba: Time spent bootstrapping tablet: real 0.046s	user 0.013s	sys 0.000s
I20260709 13:09:20.059260 24362 tablet_bootstrap.cc:492] T 662a938528e545e6aa4592052da18101 P b39c386162de49aca92dbebee7f06ace: Bootstrap starting.
I20260709 13:09:20.061694 24361 raft_consensus.cc:359] T 662a938528e545e6aa4592052da18101 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:20.062858 24361 raft_consensus.cc:385] T 662a938528e545e6aa4592052da18101 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:20.063140 24361 raft_consensus.cc:740] T 662a938528e545e6aa4592052da18101 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8d4657116f948038a0c73018238c3ba, State: Initialized, Role: FOLLOWER
I20260709 13:09:20.063759 24361 consensus_queue.cc:260] T 662a938528e545e6aa4592052da18101 P f8d4657116f948038a0c73018238c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:20.065794 24362 tablet_bootstrap.cc:654] T 662a938528e545e6aa4592052da18101 P b39c386162de49aca92dbebee7f06ace: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:20.066874 24361 ts_tablet_manager.cc:1434] T 662a938528e545e6aa4592052da18101 P f8d4657116f948038a0c73018238c3ba: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:09:20.067162 24805 raft_consensus.cc:493] T 01f1144c4a1c482894ec993e5ce24bc4 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:20.067754 24805 raft_consensus.cc:515] T 01f1144c4a1c482894ec993e5ce24bc4 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:20.068588 24361 tablet_bootstrap.cc:492] T 3bcebec1ac994b99a49430f4f892d615 P f8d4657116f948038a0c73018238c3ba: Bootstrap starting.
I20260709 13:09:20.076550 24818 raft_consensus.cc:493] T 03bfe46bf2b74722b6e8eb3015e38f43 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:20.077272 24818 raft_consensus.cc:515] T 03bfe46bf2b74722b6e8eb3015e38f43 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:20.083034 24085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f1144c4a1c482894ec993e5ce24bc4" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dea34817fcc148d78f090ef5fa72304f" is_pre_election: true
I20260709 13:09:20.084087 24085 raft_consensus.cc:2468] T 01f1144c4a1c482894ec993e5ce24bc4 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8d4657116f948038a0c73018238c3ba in term 0.
I20260709 13:09:20.093365 24361 tablet_bootstrap.cc:654] T 3bcebec1ac994b99a49430f4f892d615 P f8d4657116f948038a0c73018238c3ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:20.097661 24206 leader_election.cc:304] T 01f1144c4a1c482894ec993e5ce24bc4 P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dea34817fcc148d78f090ef5fa72304f, f8d4657116f948038a0c73018238c3ba; no voters: 
I20260709 13:09:20.101289 24682 raft_consensus.cc:2804] T 01f1144c4a1c482894ec993e5ce24bc4 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:20.101773 24682 raft_consensus.cc:493] T 01f1144c4a1c482894ec993e5ce24bc4 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:20.102175 24682 raft_consensus.cc:3060] T 01f1144c4a1c482894ec993e5ce24bc4 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:20.113684 24682 raft_consensus.cc:515] T 01f1144c4a1c482894ec993e5ce24bc4 P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:20.119908 24682 leader_election.cc:290] T 01f1144c4a1c482894ec993e5ce24bc4 P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 election: Requested vote from peers b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561), dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343)
I20260709 13:09:20.132092 24160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bfe46bf2b74722b6e8eb3015e38f43" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" is_pre_election: true
W20260709 13:09:20.135490 24057 leader_election.cc:343] T 03bfe46bf2b74722b6e8eb3015e38f43 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:20.070255 24805 leader_election.cc:290] T 01f1144c4a1c482894ec993e5ce24bc4 P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561), dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343)
I20260709 13:09:20.080554 24818 leader_election.cc:290] T 03bfe46bf2b74722b6e8eb3015e38f43 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561), c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431)
I20260709 13:09:20.154690 24804 raft_consensus.cc:493] T a0ff7e0491fb406d9e1f13941504372f P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:20.155789 24804 raft_consensus.cc:515] T a0ff7e0491fb406d9e1f13941504372f P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:20.166667 24804 leader_election.cc:290] T a0ff7e0491fb406d9e1f13941504372f P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171), dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343)
W20260709 13:09:20.163381 24206 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:37431, user_credentials={real_user=slave}} blocked reactor thread for 58061.1us
I20260709 13:09:20.169211 24236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0ff7e0491fb406d9e1f13941504372f" candidate_uuid: "b39c386162de49aca92dbebee7f06ace" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8d4657116f948038a0c73018238c3ba" is_pre_election: true
I20260709 13:09:20.170334 24236 raft_consensus.cc:2468] T a0ff7e0491fb406d9e1f13941504372f P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b39c386162de49aca92dbebee7f06ace in term 0.
I20260709 13:09:20.174422 24279 leader_election.cc:304] T a0ff7e0491fb406d9e1f13941504372f P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b39c386162de49aca92dbebee7f06ace, f8d4657116f948038a0c73018238c3ba; no voters: 
I20260709 13:09:20.175706 24668 raft_consensus.cc:493] T 662a938528e545e6aa4592052da18101 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:20.176347 24668 raft_consensus.cc:515] T 662a938528e545e6aa4592052da18101 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:20.177989 24804 raft_consensus.cc:2804] T a0ff7e0491fb406d9e1f13941504372f P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:20.178813 24804 raft_consensus.cc:493] T a0ff7e0491fb406d9e1f13941504372f P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:20.179006 24668 leader_election.cc:290] T 662a938528e545e6aa4592052da18101 P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561), dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343)
I20260709 13:09:20.179513 24804 raft_consensus.cc:3060] T a0ff7e0491fb406d9e1f13941504372f P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:20.181794 24085 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f1144c4a1c482894ec993e5ce24bc4" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dea34817fcc148d78f090ef5fa72304f"
I20260709 13:09:20.182819 24085 raft_consensus.cc:3060] T 01f1144c4a1c482894ec993e5ce24bc4 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:20.196725 24804 raft_consensus.cc:515] T a0ff7e0491fb406d9e1f13941504372f P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
W20260709 13:09:20.250123 24206 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:37431, user_credentials={real_user=slave}} blocked reactor thread for 76436us
I20260709 13:09:20.273600 24240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0ff7e0491fb406d9e1f13941504372f" candidate_uuid: "b39c386162de49aca92dbebee7f06ace" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8d4657116f948038a0c73018238c3ba"
I20260709 13:09:20.274708 24240 raft_consensus.cc:3060] T a0ff7e0491fb406d9e1f13941504372f P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:20.283241 24804 leader_election.cc:290] T a0ff7e0491fb406d9e1f13941504372f P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 1 election: Requested vote from peers f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171), dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343)
W20260709 13:09:20.347468 24206 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:36343, user_credentials={real_user=slave}} blocked reactor thread for 54459.4us
I20260709 13:09:20.353917 24815 consensus_queue.cc:1048] T c5dc7f36da134739916e9685345be3ac P f8d4657116f948038a0c73018238c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:20.396971 24445 raft_consensus.cc:493] T 430894245c954e33b6586b4704c66b3c P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:20.398351 24445 raft_consensus.cc:515] T 430894245c954e33b6586b4704c66b3c P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:20.430040 24313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "662a938528e545e6aa4592052da18101" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace" is_pre_election: true
I20260709 13:09:20.419277 24088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "662a938528e545e6aa4592052da18101" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dea34817fcc148d78f090ef5fa72304f" is_pre_election: true
I20260709 13:09:20.414783 24312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f1144c4a1c482894ec993e5ce24bc4" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace" is_pre_election: true
I20260709 13:09:20.448105 24445 leader_election.cc:290] T 430894245c954e33b6586b4704c66b3c P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343), f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171)
I20260709 13:09:20.434602 24309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f1144c4a1c482894ec993e5ce24bc4" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace"
I20260709 13:09:20.451220 24312 raft_consensus.cc:2468] T 01f1144c4a1c482894ec993e5ce24bc4 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8d4657116f948038a0c73018238c3ba in term 0.
W20260709 13:09:20.458045 24206 leader_election.cc:343] T 662a938528e545e6aa4592052da18101 P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:20.458034 24359 tablet_bootstrap.cc:492] T 662a938528e545e6aa4592052da18101 P dea34817fcc148d78f090ef5fa72304f: No bootstrap required, opened a new log
I20260709 13:09:20.476106 24359 ts_tablet_manager.cc:1403] T 662a938528e545e6aa4592052da18101 P dea34817fcc148d78f090ef5fa72304f: Time spent bootstrapping tablet: real 0.580s	user 0.027s	sys 0.090s
W20260709 13:09:20.510890 24204 leader_election.cc:343] T 662a938528e545e6aa4592052da18101 P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:20.511468 24204 leader_election.cc:304] T 662a938528e545e6aa4592052da18101 P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8d4657116f948038a0c73018238c3ba; no voters: b39c386162de49aca92dbebee7f06ace, dea34817fcc148d78f090ef5fa72304f
I20260709 13:09:20.511487 24089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0ff7e0491fb406d9e1f13941504372f" candidate_uuid: "b39c386162de49aca92dbebee7f06ace" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dea34817fcc148d78f090ef5fa72304f" is_pre_election: true
I20260709 13:09:20.454293 24085 raft_consensus.cc:2468] T 01f1144c4a1c482894ec993e5ce24bc4 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8d4657116f948038a0c73018238c3ba in term 1.
I20260709 13:09:20.511191 24166 raft_consensus.cc:3060] T 430894245c954e33b6586b4704c66b3c P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:20.529778 24359 raft_consensus.cc:359] T 662a938528e545e6aa4592052da18101 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:20.549075 24359 raft_consensus.cc:385] T 662a938528e545e6aa4592052da18101 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:20.549631 24359 raft_consensus.cc:740] T 662a938528e545e6aa4592052da18101 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dea34817fcc148d78f090ef5fa72304f, State: Initialized, Role: FOLLOWER
I20260709 13:09:20.550689 24359 consensus_queue.cc:260] T 662a938528e545e6aa4592052da18101 P dea34817fcc148d78f090ef5fa72304f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:20.579731 24359 ts_tablet_manager.cc:1434] T 662a938528e545e6aa4592052da18101 P dea34817fcc148d78f090ef5fa72304f: Time spent starting tablet: real 0.103s	user 0.011s	sys 0.000s
I20260709 13:09:20.602063 24359 tablet_bootstrap.cc:492] T a0ff7e0491fb406d9e1f13941504372f P dea34817fcc148d78f090ef5fa72304f: Bootstrap starting.
I20260709 13:09:20.621188 24362 tablet_bootstrap.cc:492] T 662a938528e545e6aa4592052da18101 P b39c386162de49aca92dbebee7f06ace: No bootstrap required, opened a new log
I20260709 13:09:20.621341 24613 raft_consensus.cc:493] T 71cb3d981445473ca321bbe44299879c P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:20.621727 24037 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:20.622011 24613 raft_consensus.cc:515] T 71cb3d981445473ca321bbe44299879c P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:20.621886 24362 ts_tablet_manager.cc:1403] T 662a938528e545e6aa4592052da18101 P b39c386162de49aca92dbebee7f06ace: Time spent bootstrapping tablet: real 0.563s	user 0.078s	sys 0.102s
I20260709 13:09:20.632658 24240 raft_consensus.cc:2468] T a0ff7e0491fb406d9e1f13941504372f P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b39c386162de49aca92dbebee7f06ace in term 1.
I20260709 13:09:20.635110 24362 raft_consensus.cc:359] T 662a938528e545e6aa4592052da18101 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:20.635986 24362 raft_consensus.cc:385] T 662a938528e545e6aa4592052da18101 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:20.636274 24362 raft_consensus.cc:740] T 662a938528e545e6aa4592052da18101 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b39c386162de49aca92dbebee7f06ace, State: Initialized, Role: FOLLOWER
I20260709 13:09:20.636988 24362 consensus_queue.cc:260] T 662a938528e545e6aa4592052da18101 P b39c386162de49aca92dbebee7f06ace [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:20.637558 24361 tablet_bootstrap.cc:492] T 3bcebec1ac994b99a49430f4f892d615 P f8d4657116f948038a0c73018238c3ba: No bootstrap required, opened a new log
I20260709 13:09:20.638185 24361 ts_tablet_manager.cc:1403] T 3bcebec1ac994b99a49430f4f892d615 P f8d4657116f948038a0c73018238c3ba: Time spent bootstrapping tablet: real 0.570s	user 0.044s	sys 0.096s
I20260709 13:09:20.597867 24668 raft_consensus.cc:2749] T 662a938528e545e6aa4592052da18101 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:20.641485 24360 tablet_bootstrap.cc:492] T 03bfe46bf2b74722b6e8eb3015e38f43 P c0f503bf8bb94af8a2a1139db4e1c0f5: No bootstrap required, opened a new log
I20260709 13:09:20.642122 24360 ts_tablet_manager.cc:1403] T 03bfe46bf2b74722b6e8eb3015e38f43 P c0f503bf8bb94af8a2a1139db4e1c0f5: Time spent bootstrapping tablet: real 0.702s	user 0.047s	sys 0.118s
I20260709 13:09:20.645262 24360 raft_consensus.cc:359] T 03bfe46bf2b74722b6e8eb3015e38f43 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:20.646044 24360 raft_consensus.cc:385] T 03bfe46bf2b74722b6e8eb3015e38f43 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:20.647481 24084 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0ff7e0491fb406d9e1f13941504372f" candidate_uuid: "b39c386162de49aca92dbebee7f06ace" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dea34817fcc148d78f090ef5fa72304f"
I20260709 13:09:20.648173 24361 raft_consensus.cc:359] T 3bcebec1ac994b99a49430f4f892d615 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:20.649045 24361 raft_consensus.cc:385] T 3bcebec1ac994b99a49430f4f892d615 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:20.649350 24361 raft_consensus.cc:740] T 3bcebec1ac994b99a49430f4f892d615 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8d4657116f948038a0c73018238c3ba, State: Initialized, Role: FOLLOWER
I20260709 13:09:20.650075 24361 consensus_queue.cc:260] T 3bcebec1ac994b99a49430f4f892d615 P f8d4657116f948038a0c73018238c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:20.646363 24360 raft_consensus.cc:740] T 03bfe46bf2b74722b6e8eb3015e38f43 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0f503bf8bb94af8a2a1139db4e1c0f5, State: Initialized, Role: FOLLOWER
I20260709 13:09:20.651669 24362 ts_tablet_manager.cc:1434] T 662a938528e545e6aa4592052da18101 P b39c386162de49aca92dbebee7f06ace: Time spent starting tablet: real 0.021s	user 0.004s	sys 0.004s
I20260709 13:09:20.651815 24360 consensus_queue.cc:260] T 03bfe46bf2b74722b6e8eb3015e38f43 P c0f503bf8bb94af8a2a1139db4e1c0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:20.652994 24362 tablet_bootstrap.cc:492] T 03bfe46bf2b74722b6e8eb3015e38f43 P b39c386162de49aca92dbebee7f06ace: Bootstrap starting.
I20260709 13:09:20.654748 24361 ts_tablet_manager.cc:1434] T 3bcebec1ac994b99a49430f4f892d615 P f8d4657116f948038a0c73018238c3ba: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.000s
I20260709 13:09:20.655912 24361 tablet_bootstrap.cc:492] T 71cb3d981445473ca321bbe44299879c P f8d4657116f948038a0c73018238c3ba: Bootstrap starting.
I20260709 13:09:20.669593 24613 leader_election.cc:290] T 71cb3d981445473ca321bbe44299879c P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431), f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171)
W20260709 13:09:20.675254 24206 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:37431, user_credentials={real_user=slave}} blocked reactor thread for 166706us
I20260709 13:09:20.677785 24847 consensus_queue.cc:1048] T 430894245c954e33b6586b4704c66b3c P f8d4657116f948038a0c73018238c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:20.681321 24206 leader_election.cc:304] T 01f1144c4a1c482894ec993e5ce24bc4 P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dea34817fcc148d78f090ef5fa72304f, f8d4657116f948038a0c73018238c3ba; no voters: b39c386162de49aca92dbebee7f06ace
I20260709 13:09:20.682684 24279 leader_election.cc:304] T a0ff7e0491fb406d9e1f13941504372f P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b39c386162de49aca92dbebee7f06ace, f8d4657116f948038a0c73018238c3ba; no voters: 
I20260709 13:09:20.684342 24845 raft_consensus.cc:2804] T 01f1144c4a1c482894ec993e5ce24bc4 P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:20.685163 24845 raft_consensus.cc:697] T 01f1144c4a1c482894ec993e5ce24bc4 P f8d4657116f948038a0c73018238c3ba [term 1 LEADER]: Becoming Leader. State: Replica: f8d4657116f948038a0c73018238c3ba, State: Running, Role: LEADER
I20260709 13:09:20.686319 24845 consensus_queue.cc:237] T 01f1144c4a1c482894ec993e5ce24bc4 P f8d4657116f948038a0c73018238c3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:20.691960 24359 tablet_bootstrap.cc:654] T a0ff7e0491fb406d9e1f13941504372f P dea34817fcc148d78f090ef5fa72304f: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:20.691784 24204 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:38561, user_credentials={real_user=slave}} blocked reactor thread for 178498us
I20260709 13:09:20.695899 24360 ts_tablet_manager.cc:1434] T 03bfe46bf2b74722b6e8eb3015e38f43 P c0f503bf8bb94af8a2a1139db4e1c0f5: Time spent starting tablet: real 0.053s	user 0.006s	sys 0.000s
I20260709 13:09:20.699333 24613 raft_consensus.cc:2804] T a0ff7e0491fb406d9e1f13941504372f P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:20.706120 24613 raft_consensus.cc:697] T a0ff7e0491fb406d9e1f13941504372f P b39c386162de49aca92dbebee7f06ace [term 1 LEADER]: Becoming Leader. State: Replica: b39c386162de49aca92dbebee7f06ace, State: Running, Role: LEADER
W20260709 13:09:20.699833 24280 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:36343, user_credentials={real_user=slave}} blocked reactor thread for 182165us
W20260709 13:09:20.700141 24057 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:37431, user_credentials={real_user=slave}} blocked reactor thread for 82692.6us
I20260709 13:09:20.707573 24613 consensus_queue.cc:237] T a0ff7e0491fb406d9e1f13941504372f P b39c386162de49aca92dbebee7f06ace [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:20.709513 24088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430894245c954e33b6586b4704c66b3c" candidate_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dea34817fcc148d78f090ef5fa72304f" is_pre_election: true
I20260709 13:09:20.714434 24313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bfe46bf2b74722b6e8eb3015e38f43" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace" is_pre_election: true
I20260709 13:09:20.715701 24238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71cb3d981445473ca321bbe44299879c" candidate_uuid: "b39c386162de49aca92dbebee7f06ace" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8d4657116f948038a0c73018238c3ba" is_pre_election: true
I20260709 13:09:20.718182 24236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430894245c954e33b6586b4704c66b3c" candidate_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8d4657116f948038a0c73018238c3ba" is_pre_election: true
I20260709 13:09:20.735805 24360 tablet_bootstrap.cc:492] T 3bcebec1ac994b99a49430f4f892d615 P c0f503bf8bb94af8a2a1139db4e1c0f5: Bootstrap starting.
I20260709 13:09:20.739948 24088 raft_consensus.cc:2393] T 430894245c954e33b6586b4704c66b3c P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0f503bf8bb94af8a2a1139db4e1c0f5 in current term 1: Already voted for candidate f8d4657116f948038a0c73018238c3ba in this term.
W20260709 13:09:20.748334 24279 leader_election.cc:343] T 71cb3d981445473ca321bbe44299879c P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:20.751588 24361 tablet_bootstrap.cc:654] T 71cb3d981445473ca321bbe44299879c P f8d4657116f948038a0c73018238c3ba: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:20.759390 24847 consensus_queue.cc:1048] T 430894245c954e33b6586b4704c66b3c P f8d4657116f948038a0c73018238c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:20.764788 24360 tablet_bootstrap.cc:654] T 3bcebec1ac994b99a49430f4f892d615 P c0f503bf8bb94af8a2a1139db4e1c0f5: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:20.744930 24362 tablet_bootstrap.cc:654] T 03bfe46bf2b74722b6e8eb3015e38f43 P b39c386162de49aca92dbebee7f06ace: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:20.787961 23986 catalog_manager.cc:5697] T 99b130381d71460388507938ba053f8f P b39c386162de49aca92dbebee7f06ace reported cstate change: term changed from 0 to 1, leader changed from <none> to b39c386162de49aca92dbebee7f06ace (127.14.180.68). New cstate: current_term: 1 leader_uuid: "b39c386162de49aca92dbebee7f06ace" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:20.801802 24359 tablet_bootstrap.cc:492] T a0ff7e0491fb406d9e1f13941504372f P dea34817fcc148d78f090ef5fa72304f: No bootstrap required, opened a new log
I20260709 13:09:20.802428 24359 ts_tablet_manager.cc:1403] T a0ff7e0491fb406d9e1f13941504372f P dea34817fcc148d78f090ef5fa72304f: Time spent bootstrapping tablet: real 0.201s	user 0.013s	sys 0.000s
I20260709 13:09:20.805065 24131 leader_election.cc:304] T 430894245c954e33b6586b4704c66b3c P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0f503bf8bb94af8a2a1139db4e1c0f5; no voters: dea34817fcc148d78f090ef5fa72304f, f8d4657116f948038a0c73018238c3ba
W20260709 13:09:20.819358 24055 leader_election.cc:343] T 03bfe46bf2b74722b6e8eb3015e38f43 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:20.820106 24055 leader_election.cc:304] T 03bfe46bf2b74722b6e8eb3015e38f43 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dea34817fcc148d78f090ef5fa72304f; no voters: b39c386162de49aca92dbebee7f06ace, c0f503bf8bb94af8a2a1139db4e1c0f5
I20260709 13:09:20.820963 24800 raft_consensus.cc:2749] T 03bfe46bf2b74722b6e8eb3015e38f43 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:20.832621 24848 consensus_queue.cc:1048] T c5dc7f36da134739916e9685345be3ac P f8d4657116f948038a0c73018238c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:20.833156 24166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71cb3d981445473ca321bbe44299879c" candidate_uuid: "b39c386162de49aca92dbebee7f06ace" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" is_pre_election: true
I20260709 13:09:20.835415 24361 tablet_bootstrap.cc:492] T 71cb3d981445473ca321bbe44299879c P f8d4657116f948038a0c73018238c3ba: No bootstrap required, opened a new log
I20260709 13:09:20.836153 24361 ts_tablet_manager.cc:1403] T 71cb3d981445473ca321bbe44299879c P f8d4657116f948038a0c73018238c3ba: Time spent bootstrapping tablet: real 0.180s	user 0.014s	sys 0.004s
I20260709 13:09:20.839108 24841 raft_consensus.cc:2749] T 430894245c954e33b6586b4704c66b3c P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:20.844393 24361 raft_consensus.cc:359] T 71cb3d981445473ca321bbe44299879c P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:20.845223 24361 raft_consensus.cc:385] T 71cb3d981445473ca321bbe44299879c P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:20.845502 24361 raft_consensus.cc:740] T 71cb3d981445473ca321bbe44299879c P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8d4657116f948038a0c73018238c3ba, State: Initialized, Role: FOLLOWER
I20260709 13:09:20.846218 24361 consensus_queue.cc:260] T 71cb3d981445473ca321bbe44299879c P f8d4657116f948038a0c73018238c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:20.854389 24361 ts_tablet_manager.cc:1434] T 71cb3d981445473ca321bbe44299879c P f8d4657116f948038a0c73018238c3ba: Time spent starting tablet: real 0.018s	user 0.009s	sys 0.000s
W20260709 13:09:20.856536 24280 consensus_peers.cc:597] T 99b130381d71460388507938ba053f8f P b39c386162de49aca92dbebee7f06ace -> Peer c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431): Couldn't send request to peer c0f503bf8bb94af8a2a1139db4e1c0f5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:20.857519 24280 leader_election.cc:343] T 71cb3d981445473ca321bbe44299879c P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:20.858016 24280 leader_election.cc:304] T 71cb3d981445473ca321bbe44299879c P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b39c386162de49aca92dbebee7f06ace; no voters: c0f503bf8bb94af8a2a1139db4e1c0f5, f8d4657116f948038a0c73018238c3ba
I20260709 13:09:20.859277 24362 tablet_bootstrap.cc:492] T 03bfe46bf2b74722b6e8eb3015e38f43 P b39c386162de49aca92dbebee7f06ace: No bootstrap required, opened a new log
I20260709 13:09:20.860163 24802 raft_consensus.cc:2749] T 71cb3d981445473ca321bbe44299879c P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:20.873617 24360 tablet_bootstrap.cc:492] T 3bcebec1ac994b99a49430f4f892d615 P c0f503bf8bb94af8a2a1139db4e1c0f5: No bootstrap required, opened a new log
W20260709 13:09:20.876360 24280 leader_election.cc:343] T a0ff7e0491fb406d9e1f13941504372f P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:20.891688 24280 leader_election.cc:343] T a0ff7e0491fb406d9e1f13941504372f P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:20.893378 24846 consensus_queue.cc:1048] T 99b130381d71460388507938ba053f8f P b39c386162de49aca92dbebee7f06ace [LEADER]: Connected to new peer: Peer: permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:20.879290 24362 ts_tablet_manager.cc:1403] T 03bfe46bf2b74722b6e8eb3015e38f43 P b39c386162de49aca92dbebee7f06ace: Time spent bootstrapping tablet: real 0.227s	user 0.016s	sys 0.000s
I20260709 13:09:20.913010 24360 ts_tablet_manager.cc:1403] T 3bcebec1ac994b99a49430f4f892d615 P c0f503bf8bb94af8a2a1139db4e1c0f5: Time spent bootstrapping tablet: real 0.199s	user 0.004s	sys 0.018s
I20260709 13:09:20.806166 24359 raft_consensus.cc:359] T a0ff7e0491fb406d9e1f13941504372f P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:20.918576 24359 raft_consensus.cc:385] T a0ff7e0491fb406d9e1f13941504372f P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:20.918921 24359 raft_consensus.cc:740] T a0ff7e0491fb406d9e1f13941504372f P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dea34817fcc148d78f090ef5fa72304f, State: Initialized, Role: FOLLOWER
I20260709 13:09:20.923360 24359 consensus_queue.cc:260] T a0ff7e0491fb406d9e1f13941504372f P dea34817fcc148d78f090ef5fa72304f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:20.925674 24359 ts_tablet_manager.cc:1434] T a0ff7e0491fb406d9e1f13941504372f P dea34817fcc148d78f090ef5fa72304f: Time spent starting tablet: real 0.123s	user 0.005s	sys 0.000s
I20260709 13:09:20.926892 24359 tablet_bootstrap.cc:492] T 3bcebec1ac994b99a49430f4f892d615 P dea34817fcc148d78f090ef5fa72304f: Bootstrap starting.
I20260709 13:09:20.926949 23989 catalog_manager.cc:5697] T 01f1144c4a1c482894ec993e5ce24bc4 P f8d4657116f948038a0c73018238c3ba reported cstate change: term changed from 0 to 1, leader changed from <none> to f8d4657116f948038a0c73018238c3ba (127.14.180.67). New cstate: current_term: 1 leader_uuid: "f8d4657116f948038a0c73018238c3ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:20.930779 24362 raft_consensus.cc:359] T 03bfe46bf2b74722b6e8eb3015e38f43 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:20.931546 24362 raft_consensus.cc:385] T 03bfe46bf2b74722b6e8eb3015e38f43 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:20.936337 24362 raft_consensus.cc:740] T 03bfe46bf2b74722b6e8eb3015e38f43 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b39c386162de49aca92dbebee7f06ace, State: Initialized, Role: FOLLOWER
I20260709 13:09:20.937019 24362 consensus_queue.cc:260] T 03bfe46bf2b74722b6e8eb3015e38f43 P b39c386162de49aca92dbebee7f06ace [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:20.940026 24360 raft_consensus.cc:359] T 3bcebec1ac994b99a49430f4f892d615 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:20.942929 24360 raft_consensus.cc:385] T 3bcebec1ac994b99a49430f4f892d615 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:20.943361 24360 raft_consensus.cc:740] T 3bcebec1ac994b99a49430f4f892d615 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0f503bf8bb94af8a2a1139db4e1c0f5, State: Initialized, Role: FOLLOWER
I20260709 13:09:20.944236 24360 consensus_queue.cc:260] T 3bcebec1ac994b99a49430f4f892d615 P c0f503bf8bb94af8a2a1139db4e1c0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:20.942039 24362 ts_tablet_manager.cc:1434] T 03bfe46bf2b74722b6e8eb3015e38f43 P b39c386162de49aca92dbebee7f06ace: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.000s
I20260709 13:09:20.950002 24360 ts_tablet_manager.cc:1434] T 3bcebec1ac994b99a49430f4f892d615 P c0f503bf8bb94af8a2a1139db4e1c0f5: Time spent starting tablet: real 0.036s	user 0.002s	sys 0.005s
I20260709 13:09:20.951357 24360 tablet_bootstrap.cc:492] T 99b130381d71460388507938ba053f8f P c0f503bf8bb94af8a2a1139db4e1c0f5: Bootstrap starting.
I20260709 13:09:20.953846 24359 tablet_bootstrap.cc:654] T 3bcebec1ac994b99a49430f4f892d615 P dea34817fcc148d78f090ef5fa72304f: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:20.957885 24849 raft_consensus.cc:493] T 662a938528e545e6aa4592052da18101 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:20.958632 24849 raft_consensus.cc:515] T 662a938528e545e6aa4592052da18101 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:20.963039 24313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "662a938528e545e6aa4592052da18101" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace" is_pre_election: true
I20260709 13:09:20.963316 24240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "662a938528e545e6aa4592052da18101" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8d4657116f948038a0c73018238c3ba" is_pre_election: true
I20260709 13:09:20.963814 24313 raft_consensus.cc:2468] T 662a938528e545e6aa4592052da18101 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dea34817fcc148d78f090ef5fa72304f in term 0.
I20260709 13:09:20.964061 24240 raft_consensus.cc:2468] T 662a938528e545e6aa4592052da18101 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dea34817fcc148d78f090ef5fa72304f in term 0.
I20260709 13:09:20.971385 24056 leader_election.cc:304] T 662a938528e545e6aa4592052da18101 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dea34817fcc148d78f090ef5fa72304f, f8d4657116f948038a0c73018238c3ba; no voters: 
I20260709 13:09:20.973166 24800 raft_consensus.cc:2804] T 662a938528e545e6aa4592052da18101 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:20.973631 24800 raft_consensus.cc:493] T 662a938528e545e6aa4592052da18101 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:20.974005 24800 raft_consensus.cc:3060] T 662a938528e545e6aa4592052da18101 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:20.991999 24849 leader_election.cc:290] T 662a938528e545e6aa4592052da18101 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171), b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561)
I20260709 13:09:20.989728 23987 catalog_manager.cc:5697] T a0ff7e0491fb406d9e1f13941504372f P b39c386162de49aca92dbebee7f06ace reported cstate change: term changed from 0 to 1, leader changed from <none> to b39c386162de49aca92dbebee7f06ace (127.14.180.68). New cstate: current_term: 1 leader_uuid: "b39c386162de49aca92dbebee7f06ace" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:21.004947 24800 raft_consensus.cc:515] T 662a938528e545e6aa4592052da18101 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:21.008313 24240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "662a938528e545e6aa4592052da18101" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8d4657116f948038a0c73018238c3ba"
I20260709 13:09:21.008639 24308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "662a938528e545e6aa4592052da18101" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace"
I20260709 13:09:21.008968 24240 raft_consensus.cc:3060] T 662a938528e545e6aa4592052da18101 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:21.009415 24308 raft_consensus.cc:3060] T 662a938528e545e6aa4592052da18101 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:21.015640 24360 tablet_bootstrap.cc:654] T 99b130381d71460388507938ba053f8f P c0f503bf8bb94af8a2a1139db4e1c0f5: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:21.017105 24240 raft_consensus.cc:2468] T 662a938528e545e6aa4592052da18101 P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dea34817fcc148d78f090ef5fa72304f in term 1.
I20260709 13:09:21.018539 24056 leader_election.cc:304] T 662a938528e545e6aa4592052da18101 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dea34817fcc148d78f090ef5fa72304f, f8d4657116f948038a0c73018238c3ba; no voters: 
I20260709 13:09:21.019531 24849 raft_consensus.cc:2804] T 662a938528e545e6aa4592052da18101 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:21.020257 24849 raft_consensus.cc:697] T 662a938528e545e6aa4592052da18101 P dea34817fcc148d78f090ef5fa72304f [term 1 LEADER]: Becoming Leader. State: Replica: dea34817fcc148d78f090ef5fa72304f, State: Running, Role: LEADER
I20260709 13:09:21.021236 24849 consensus_queue.cc:237] T 662a938528e545e6aa4592052da18101 P dea34817fcc148d78f090ef5fa72304f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:21.022404 24308 raft_consensus.cc:2468] T 662a938528e545e6aa4592052da18101 P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dea34817fcc148d78f090ef5fa72304f in term 1.
I20260709 13:09:21.022678 24800 leader_election.cc:290] T 662a938528e545e6aa4592052da18101 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 1 election: Requested vote from peers f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171), b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561)
I20260709 13:09:21.029402 24360 tablet_bootstrap.cc:492] T 99b130381d71460388507938ba053f8f P c0f503bf8bb94af8a2a1139db4e1c0f5: No bootstrap required, opened a new log
I20260709 13:09:21.030134 24360 ts_tablet_manager.cc:1403] T 99b130381d71460388507938ba053f8f P c0f503bf8bb94af8a2a1139db4e1c0f5: Time spent bootstrapping tablet: real 0.079s	user 0.007s	sys 0.005s
I20260709 13:09:21.033614 24360 raft_consensus.cc:359] T 99b130381d71460388507938ba053f8f P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:21.034395 24360 raft_consensus.cc:385] T 99b130381d71460388507938ba053f8f P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:21.034737 24360 raft_consensus.cc:740] T 99b130381d71460388507938ba053f8f P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0f503bf8bb94af8a2a1139db4e1c0f5, State: Initialized, Role: FOLLOWER
I20260709 13:09:21.035725 24360 consensus_queue.cc:260] T 99b130381d71460388507938ba053f8f P c0f503bf8bb94af8a2a1139db4e1c0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:21.038125 24360 ts_tablet_manager.cc:1434] T 99b130381d71460388507938ba053f8f P c0f503bf8bb94af8a2a1139db4e1c0f5: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:09:21.039423 24360 tablet_bootstrap.cc:492] T 71cb3d981445473ca321bbe44299879c P c0f503bf8bb94af8a2a1139db4e1c0f5: Bootstrap starting.
I20260709 13:09:21.060755 24360 tablet_bootstrap.cc:654] T 71cb3d981445473ca321bbe44299879c P c0f503bf8bb94af8a2a1139db4e1c0f5: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:21.067734 24847 raft_consensus.cc:493] T 3bcebec1ac994b99a49430f4f892d615 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:21.068424 24847 raft_consensus.cc:515] T 3bcebec1ac994b99a49430f4f892d615 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:21.070698 24847 leader_election.cc:290] T 3bcebec1ac994b99a49430f4f892d615 P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343), c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431)
I20260709 13:09:21.072993 24083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bcebec1ac994b99a49430f4f892d615" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dea34817fcc148d78f090ef5fa72304f" is_pre_election: true
I20260709 13:09:21.074530 24160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bcebec1ac994b99a49430f4f892d615" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" is_pre_election: true
I20260709 13:09:21.075367 24160 raft_consensus.cc:2468] T 3bcebec1ac994b99a49430f4f892d615 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8d4657116f948038a0c73018238c3ba in term 0.
W20260709 13:09:21.077330 24206 leader_election.cc:343] T 3bcebec1ac994b99a49430f4f892d615 P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:21.078025 24206 leader_election.cc:304] T 3bcebec1ac994b99a49430f4f892d615 P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c0f503bf8bb94af8a2a1139db4e1c0f5, f8d4657116f948038a0c73018238c3ba; no voters: dea34817fcc148d78f090ef5fa72304f
I20260709 13:09:21.080866 24713 raft_consensus.cc:2804] T 3bcebec1ac994b99a49430f4f892d615 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:21.081306 24713 raft_consensus.cc:493] T 3bcebec1ac994b99a49430f4f892d615 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:21.081627 24713 raft_consensus.cc:3060] T 3bcebec1ac994b99a49430f4f892d615 P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:21.088881 24853 raft_consensus.cc:493] T 03bfe46bf2b74722b6e8eb3015e38f43 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:21.089507 24853 raft_consensus.cc:515] T 03bfe46bf2b74722b6e8eb3015e38f43 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:21.092504 24308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bfe46bf2b74722b6e8eb3015e38f43" candidate_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace" is_pre_election: true
I20260709 13:09:21.093302 24308 raft_consensus.cc:2468] T 03bfe46bf2b74722b6e8eb3015e38f43 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0f503bf8bb94af8a2a1139db4e1c0f5 in term 0.
I20260709 13:09:21.094911 24130 leader_election.cc:304] T 03bfe46bf2b74722b6e8eb3015e38f43 P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b39c386162de49aca92dbebee7f06ace, c0f503bf8bb94af8a2a1139db4e1c0f5; no voters: 
I20260709 13:09:21.095956 24841 raft_consensus.cc:2804] T 03bfe46bf2b74722b6e8eb3015e38f43 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:21.096364 24841 raft_consensus.cc:493] T 03bfe46bf2b74722b6e8eb3015e38f43 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:21.096720 24841 raft_consensus.cc:3060] T 03bfe46bf2b74722b6e8eb3015e38f43 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:21.102535 24853 leader_election.cc:290] T 03bfe46bf2b74722b6e8eb3015e38f43 P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561), dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343)
I20260709 13:09:21.103753 24083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bfe46bf2b74722b6e8eb3015e38f43" candidate_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dea34817fcc148d78f090ef5fa72304f" is_pre_election: true
I20260709 13:09:21.104506 24083 raft_consensus.cc:2468] T 03bfe46bf2b74722b6e8eb3015e38f43 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0f503bf8bb94af8a2a1139db4e1c0f5 in term 0.
I20260709 13:09:21.110042 24841 raft_consensus.cc:515] T 03bfe46bf2b74722b6e8eb3015e38f43 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:21.113971 24308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bfe46bf2b74722b6e8eb3015e38f43" candidate_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace"
I20260709 13:09:21.114974 24308 raft_consensus.cc:3060] T 03bfe46bf2b74722b6e8eb3015e38f43 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:21.124923 24841 leader_election.cc:290] T 03bfe46bf2b74722b6e8eb3015e38f43 P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 1 election: Requested vote from peers b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561), dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343)
I20260709 13:09:21.125538 24088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bfe46bf2b74722b6e8eb3015e38f43" candidate_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dea34817fcc148d78f090ef5fa72304f"
I20260709 13:09:21.126247 24088 raft_consensus.cc:3060] T 03bfe46bf2b74722b6e8eb3015e38f43 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:21.127808 24308 raft_consensus.cc:2468] T 03bfe46bf2b74722b6e8eb3015e38f43 P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0f503bf8bb94af8a2a1139db4e1c0f5 in term 1.
I20260709 13:09:21.129302 24130 leader_election.cc:304] T 03bfe46bf2b74722b6e8eb3015e38f43 P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b39c386162de49aca92dbebee7f06ace, c0f503bf8bb94af8a2a1139db4e1c0f5; no voters: 
I20260709 13:09:21.130915 24841 raft_consensus.cc:2804] T 03bfe46bf2b74722b6e8eb3015e38f43 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:21.131520 24841 raft_consensus.cc:697] T 03bfe46bf2b74722b6e8eb3015e38f43 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 LEADER]: Becoming Leader. State: Replica: c0f503bf8bb94af8a2a1139db4e1c0f5, State: Running, Role: LEADER
I20260709 13:09:21.134038 24841 consensus_queue.cc:237] T 03bfe46bf2b74722b6e8eb3015e38f43 P c0f503bf8bb94af8a2a1139db4e1c0f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:21.145442 24359 tablet_bootstrap.cc:492] T 3bcebec1ac994b99a49430f4f892d615 P dea34817fcc148d78f090ef5fa72304f: No bootstrap required, opened a new log
I20260709 13:09:21.146152 24359 ts_tablet_manager.cc:1403] T 3bcebec1ac994b99a49430f4f892d615 P dea34817fcc148d78f090ef5fa72304f: Time spent bootstrapping tablet: real 0.219s	user 0.024s	sys 0.020s
I20260709 13:09:21.181017 24359 raft_consensus.cc:359] T 3bcebec1ac994b99a49430f4f892d615 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:21.181923 24359 raft_consensus.cc:385] T 3bcebec1ac994b99a49430f4f892d615 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:21.183364 24359 raft_consensus.cc:740] T 3bcebec1ac994b99a49430f4f892d615 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dea34817fcc148d78f090ef5fa72304f, State: Initialized, Role: FOLLOWER
I20260709 13:09:21.185149 24359 consensus_queue.cc:260] T 3bcebec1ac994b99a49430f4f892d615 P dea34817fcc148d78f090ef5fa72304f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:21.181003 24088 raft_consensus.cc:2468] T 03bfe46bf2b74722b6e8eb3015e38f43 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0f503bf8bb94af8a2a1139db4e1c0f5 in term 1.
I20260709 13:09:21.188685 24359 ts_tablet_manager.cc:1434] T 3bcebec1ac994b99a49430f4f892d615 P dea34817fcc148d78f090ef5fa72304f: Time spent starting tablet: real 0.042s	user 0.005s	sys 0.003s
I20260709 13:09:21.192217 24796 consensus_queue.cc:1048] T a0ff7e0491fb406d9e1f13941504372f P b39c386162de49aca92dbebee7f06ace [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:21.197525 24713 raft_consensus.cc:515] T 3bcebec1ac994b99a49430f4f892d615 P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:21.213443 24843 raft_consensus.cc:493] T 71cb3d981445473ca321bbe44299879c P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:21.214766 24843 raft_consensus.cc:515] T 71cb3d981445473ca321bbe44299879c P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:21.214385 23985 catalog_manager.cc:5697] T 03bfe46bf2b74722b6e8eb3015e38f43 P c0f503bf8bb94af8a2a1139db4e1c0f5 reported cstate change: term changed from 0 to 1, leader changed from <none> to c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66). New cstate: current_term: 1 leader_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:21.217510 24445 raft_consensus.cc:493] T 99b130381d71460388507938ba053f8f P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:21.218113 24445 raft_consensus.cc:515] T 99b130381d71460388507938ba053f8f P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:21.219240 24843 leader_election.cc:290] T 71cb3d981445473ca321bbe44299879c P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431), b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561)
I20260709 13:09:21.220170 24445 leader_election.cc:290] T 99b130381d71460388507938ba053f8f P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561), dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343)
I20260709 13:09:21.201682 24088 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bcebec1ac994b99a49430f4f892d615" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dea34817fcc148d78f090ef5fa72304f"
I20260709 13:09:21.220880 24088 raft_consensus.cc:3060] T 3bcebec1ac994b99a49430f4f892d615 P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:21.221784 24083 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b130381d71460388507938ba053f8f" candidate_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dea34817fcc148d78f090ef5fa72304f" is_pre_election: true
I20260709 13:09:21.222064 24308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b130381d71460388507938ba053f8f" candidate_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace" is_pre_election: true
I20260709 13:09:21.223730 24130 leader_election.cc:304] T 99b130381d71460388507938ba053f8f P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0f503bf8bb94af8a2a1139db4e1c0f5; no voters: b39c386162de49aca92dbebee7f06ace, dea34817fcc148d78f090ef5fa72304f
I20260709 13:09:21.225551 24853 raft_consensus.cc:2749] T 99b130381d71460388507938ba053f8f P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:21.225626 24160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71cb3d981445473ca321bbe44299879c" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" is_pre_election: true
W20260709 13:09:21.227072 24206 leader_election.cc:343] T 71cb3d981445473ca321bbe44299879c P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:21.203963 23987 catalog_manager.cc:5697] T 662a938528e545e6aa4592052da18101 P dea34817fcc148d78f090ef5fa72304f reported cstate change: term changed from 0 to 1, leader changed from <none> to dea34817fcc148d78f090ef5fa72304f (127.14.180.65). New cstate: current_term: 1 leader_uuid: "dea34817fcc148d78f090ef5fa72304f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:21.228652 24713 leader_election.cc:290] T 3bcebec1ac994b99a49430f4f892d615 P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 election: Requested vote from peers dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343), c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431)
I20260709 13:09:21.230875 24360 tablet_bootstrap.cc:492] T 71cb3d981445473ca321bbe44299879c P c0f503bf8bb94af8a2a1139db4e1c0f5: No bootstrap required, opened a new log
I20260709 13:09:21.231487 24360 ts_tablet_manager.cc:1403] T 71cb3d981445473ca321bbe44299879c P c0f503bf8bb94af8a2a1139db4e1c0f5: Time spent bootstrapping tablet: real 0.192s	user 0.051s	sys 0.016s
I20260709 13:09:21.231848 24308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71cb3d981445473ca321bbe44299879c" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace" is_pre_election: true
I20260709 13:09:21.232700 24308 raft_consensus.cc:2468] T 71cb3d981445473ca321bbe44299879c P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8d4657116f948038a0c73018238c3ba in term 0.
I20260709 13:09:21.237214 24160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bcebec1ac994b99a49430f4f892d615" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5"
I20260709 13:09:21.237926 24204 leader_election.cc:304] T 71cb3d981445473ca321bbe44299879c P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b39c386162de49aca92dbebee7f06ace, f8d4657116f948038a0c73018238c3ba; no voters: c0f503bf8bb94af8a2a1139db4e1c0f5
I20260709 13:09:21.238092 24160 raft_consensus.cc:3060] T 3bcebec1ac994b99a49430f4f892d615 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:21.238458 24360 raft_consensus.cc:359] T 71cb3d981445473ca321bbe44299879c P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:21.240067 24805 raft_consensus.cc:2804] T 71cb3d981445473ca321bbe44299879c P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:21.240535 24805 raft_consensus.cc:493] T 71cb3d981445473ca321bbe44299879c P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:21.240896 24805 raft_consensus.cc:3060] T 71cb3d981445473ca321bbe44299879c P f8d4657116f948038a0c73018238c3ba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:21.242601 24088 raft_consensus.cc:2468] T 3bcebec1ac994b99a49430f4f892d615 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8d4657116f948038a0c73018238c3ba in term 1.
I20260709 13:09:21.239303 24360 raft_consensus.cc:385] T 71cb3d981445473ca321bbe44299879c P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:21.255462 24206 leader_election.cc:304] T 3bcebec1ac994b99a49430f4f892d615 P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dea34817fcc148d78f090ef5fa72304f, f8d4657116f948038a0c73018238c3ba; no voters: 
I20260709 13:09:21.256325 24360 raft_consensus.cc:740] T 71cb3d981445473ca321bbe44299879c P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0f503bf8bb94af8a2a1139db4e1c0f5, State: Initialized, Role: FOLLOWER
I20260709 13:09:21.256963 24806 raft_consensus.cc:2804] T 3bcebec1ac994b99a49430f4f892d615 P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:21.257565 24806 raft_consensus.cc:697] T 3bcebec1ac994b99a49430f4f892d615 P f8d4657116f948038a0c73018238c3ba [term 1 LEADER]: Becoming Leader. State: Replica: f8d4657116f948038a0c73018238c3ba, State: Running, Role: LEADER
I20260709 13:09:21.257412 24360 consensus_queue.cc:260] T 71cb3d981445473ca321bbe44299879c P c0f503bf8bb94af8a2a1139db4e1c0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:21.258782 24806 consensus_queue.cc:237] T 3bcebec1ac994b99a49430f4f892d615 P f8d4657116f948038a0c73018238c3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:21.260524 24360 ts_tablet_manager.cc:1434] T 71cb3d981445473ca321bbe44299879c P c0f503bf8bb94af8a2a1139db4e1c0f5: Time spent starting tablet: real 0.029s	user 0.008s	sys 0.000s
I20260709 13:09:21.276116 24805 raft_consensus.cc:515] T 71cb3d981445473ca321bbe44299879c P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:21.299654 24713 consensus_queue.cc:1048] T 01f1144c4a1c482894ec993e5ce24bc4 P f8d4657116f948038a0c73018238c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:09:21.310101 24083 raft_consensus.cc:3060] T a0ff7e0491fb406d9e1f13941504372f P dea34817fcc148d78f090ef5fa72304f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:21.317982 24313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71cb3d981445473ca321bbe44299879c" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace"
I20260709 13:09:21.318780 24313 raft_consensus.cc:3060] T 71cb3d981445473ca321bbe44299879c P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:21.306290 24805 leader_election.cc:290] T 71cb3d981445473ca321bbe44299879c P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 election: Requested vote from peers c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431), b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561)
I20260709 13:09:21.321745 24163 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71cb3d981445473ca321bbe44299879c" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5"
I20260709 13:09:21.322575 24163 raft_consensus.cc:3060] T 71cb3d981445473ca321bbe44299879c P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:21.302421 24308 raft_consensus.cc:3060] T 01f1144c4a1c482894ec993e5ce24bc4 P b39c386162de49aca92dbebee7f06ace [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:21.330155 23985 catalog_manager.cc:5697] T 3bcebec1ac994b99a49430f4f892d615 P f8d4657116f948038a0c73018238c3ba reported cstate change: term changed from 0 to 1, leader changed from <none> to f8d4657116f948038a0c73018238c3ba (127.14.180.67). New cstate: current_term: 1 leader_uuid: "f8d4657116f948038a0c73018238c3ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:21.340559 24160 raft_consensus.cc:2468] T 3bcebec1ac994b99a49430f4f892d615 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8d4657116f948038a0c73018238c3ba in term 1.
I20260709 13:09:21.348549 24313 raft_consensus.cc:2468] T 71cb3d981445473ca321bbe44299879c P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8d4657116f948038a0c73018238c3ba in term 1.
I20260709 13:09:21.354637 24204 leader_election.cc:304] T 71cb3d981445473ca321bbe44299879c P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b39c386162de49aca92dbebee7f06ace, f8d4657116f948038a0c73018238c3ba; no voters: 
I20260709 13:09:21.357434 24805 raft_consensus.cc:2804] T 71cb3d981445473ca321bbe44299879c P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:21.372908 24158 raft_consensus.cc:3060] T 99b130381d71460388507938ba053f8f P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:21.376214 24805 raft_consensus.cc:697] T 71cb3d981445473ca321bbe44299879c P f8d4657116f948038a0c73018238c3ba [term 1 LEADER]: Becoming Leader. State: Replica: f8d4657116f948038a0c73018238c3ba, State: Running, Role: LEADER
I20260709 13:09:21.389106 24805 consensus_queue.cc:237] T 71cb3d981445473ca321bbe44299879c P f8d4657116f948038a0c73018238c3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:21.407052 24849 raft_consensus.cc:493] T a0ff7e0491fb406d9e1f13941504372f P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:21.408228 24849 raft_consensus.cc:515] T a0ff7e0491fb406d9e1f13941504372f P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:21.419407 24802 consensus_queue.cc:1048] T a0ff7e0491fb406d9e1f13941504372f P b39c386162de49aca92dbebee7f06ace [LEADER]: Connected to new peer: Peer: permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:09:21.436618 24849 leader_election.cc:290] T a0ff7e0491fb406d9e1f13941504372f P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171), b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561)
I20260709 13:09:21.447255 24314 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0ff7e0491fb406d9e1f13941504372f" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace" is_pre_election: true
I20260709 13:09:21.455130 24163 raft_consensus.cc:2468] T 71cb3d981445473ca321bbe44299879c P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8d4657116f948038a0c73018238c3ba in term 1.
I20260709 13:09:21.469360 24238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0ff7e0491fb406d9e1f13941504372f" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8d4657116f948038a0c73018238c3ba" is_pre_election: true
I20260709 13:09:21.470913 24056 leader_election.cc:304] T a0ff7e0491fb406d9e1f13941504372f P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dea34817fcc148d78f090ef5fa72304f; no voters: b39c386162de49aca92dbebee7f06ace, f8d4657116f948038a0c73018238c3ba
I20260709 13:09:21.472263 24849 raft_consensus.cc:2749] T a0ff7e0491fb406d9e1f13941504372f P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:09:21.486675 24204 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:38561, user_credentials={real_user=slave}} blocked reactor thread for 46480.1us
I20260709 13:09:21.491971 24877 consensus_queue.cc:1048] T 01f1144c4a1c482894ec993e5ce24bc4 P f8d4657116f948038a0c73018238c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:21.458081 23987 catalog_manager.cc:5697] T 71cb3d981445473ca321bbe44299879c P f8d4657116f948038a0c73018238c3ba reported cstate change: term changed from 0 to 1, leader changed from <none> to f8d4657116f948038a0c73018238c3ba (127.14.180.67). New cstate: current_term: 1 leader_uuid: "f8d4657116f948038a0c73018238c3ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:21.544731 24849 consensus_queue.cc:1048] T 662a938528e545e6aa4592052da18101 P dea34817fcc148d78f090ef5fa72304f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:21.573247 24849 consensus_queue.cc:1048] T 662a938528e545e6aa4592052da18101 P dea34817fcc148d78f090ef5fa72304f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:21.581640 24853 consensus_queue.cc:1048] T 03bfe46bf2b74722b6e8eb3015e38f43 P c0f503bf8bb94af8a2a1139db4e1c0f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:21.609513 24841 consensus_queue.cc:1048] T 03bfe46bf2b74722b6e8eb3015e38f43 P c0f503bf8bb94af8a2a1139db4e1c0f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:21.794483 24847 consensus_queue.cc:1048] T 3bcebec1ac994b99a49430f4f892d615 P f8d4657116f948038a0c73018238c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:21.812951 24806 consensus_queue.cc:1048] T 3bcebec1ac994b99a49430f4f892d615 P f8d4657116f948038a0c73018238c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:21.845100 24806 consensus_queue.cc:1048] T 71cb3d981445473ca321bbe44299879c P f8d4657116f948038a0c73018238c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:21.857455 24806 consensus_queue.cc:1048] T 71cb3d981445473ca321bbe44299879c P f8d4657116f948038a0c73018238c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:09:22.065547 24204 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.68:38561, user_credentials={real_user=slave}} blocked reactor thread for 46390.5us
I20260709 13:09:22.113399 15057 tablet_server.cc:179] TabletServer@127.14.180.65:0 shutting down...
W20260709 13:09:22.119699 24132 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 1 similar messages]
W20260709 13:09:22.127511 24132 consensus_peers.cc:597] T 03bfe46bf2b74722b6e8eb3015e38f43 P c0f503bf8bb94af8a2a1139db4e1c0f5 -> Peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Couldn't send request to peer dea34817fcc148d78f090ef5fa72304f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:22.135775 24206 consensus_peers.cc:597] T 49393e5cc2614c90b69a3bb2348dacb9 P f8d4657116f948038a0c73018238c3ba -> Peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Couldn't send request to peer dea34817fcc148d78f090ef5fa72304f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:22.151608 24132 consensus_peers.cc:597] T 45b65ebcb0114044a04e5689db4a466f P c0f503bf8bb94af8a2a1139db4e1c0f5 -> Peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Couldn't send request to peer dea34817fcc148d78f090ef5fa72304f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:22.153570 24280 consensus_peers.cc:597] T b25c31c2fcad44f281a8a045e6cb0c19 P b39c386162de49aca92dbebee7f06ace -> Peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Couldn't send request to peer dea34817fcc148d78f090ef5fa72304f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:22.156380 24206 consensus_peers.cc:597] T 5bc4e407c8b04739aa0290922bfdbed4 P f8d4657116f948038a0c73018238c3ba -> Peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Couldn't send request to peer dea34817fcc148d78f090ef5fa72304f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:22.172523 15057 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:09:22.173580 24132 consensus_peers.cc:597] T bff14fa713b6482f89ecf3e18f785f81 P c0f503bf8bb94af8a2a1139db4e1c0f5 -> Peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Couldn't send request to peer dea34817fcc148d78f090ef5fa72304f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:22.175359 15057 tablet_replica.cc:333] T a0ff7e0491fb406d9e1f13941504372f P dea34817fcc148d78f090ef5fa72304f: stopping tablet replica
I20260709 13:09:22.176332 15057 raft_consensus.cc:2243] T a0ff7e0491fb406d9e1f13941504372f P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:22.176957 15057 raft_consensus.cc:2272] T a0ff7e0491fb406d9e1f13941504372f P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:22.180320 15057 tablet_replica.cc:333] T 662a938528e545e6aa4592052da18101 P dea34817fcc148d78f090ef5fa72304f: stopping tablet replica
I20260709 13:09:22.181497 15057 raft_consensus.cc:2243] T 662a938528e545e6aa4592052da18101 P dea34817fcc148d78f090ef5fa72304f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:22.182482 15057 raft_consensus.cc:2272] T 662a938528e545e6aa4592052da18101 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:22.185380 15057 tablet_replica.cc:333] T 99b130381d71460388507938ba053f8f P dea34817fcc148d78f090ef5fa72304f: stopping tablet replica
I20260709 13:09:22.186236 15057 raft_consensus.cc:2243] T 99b130381d71460388507938ba053f8f P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:22.186781 15057 raft_consensus.cc:2272] T 99b130381d71460388507938ba053f8f P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:22.188882 15057 tablet_replica.cc:333] T 430894245c954e33b6586b4704c66b3c P dea34817fcc148d78f090ef5fa72304f: stopping tablet replica
I20260709 13:09:22.189642 15057 raft_consensus.cc:2243] T 430894245c954e33b6586b4704c66b3c P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:22.190147 15057 raft_consensus.cc:2272] T 430894245c954e33b6586b4704c66b3c P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:22.192346 15057 tablet_replica.cc:333] T aaf99a05bd8842ed9ea668a9da85dbcc P dea34817fcc148d78f090ef5fa72304f: stopping tablet replica
I20260709 13:09:22.193111 15057 raft_consensus.cc:2243] T aaf99a05bd8842ed9ea668a9da85dbcc P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:22.193568 15057 raft_consensus.cc:2272] T aaf99a05bd8842ed9ea668a9da85dbcc P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:22.195675 15057 tablet_replica.cc:333] T 7a76ed4e1b6a4c2698999f722da5cfd7 P dea34817fcc148d78f090ef5fa72304f: stopping tablet replica
I20260709 13:09:22.196290 15057 raft_consensus.cc:2243] T 7a76ed4e1b6a4c2698999f722da5cfd7 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:22.196796 15057 raft_consensus.cc:2272] T 7a76ed4e1b6a4c2698999f722da5cfd7 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:22.199297 15057 tablet_replica.cc:333] T 65f010ca5ab74fa1b0f45b7d5dced706 P dea34817fcc148d78f090ef5fa72304f: stopping tablet replica
I20260709 13:09:22.200222 15057 raft_consensus.cc:2243] T 65f010ca5ab74fa1b0f45b7d5dced706 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:22.200784 15057 raft_consensus.cc:2272] T 65f010ca5ab74fa1b0f45b7d5dced706 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:22.203944 15057 tablet_replica.cc:333] T 03e06f957f794ca696ddc7207eeabff0 P dea34817fcc148d78f090ef5fa72304f: stopping tablet replica
I20260709 13:09:22.204860 15057 raft_consensus.cc:2243] T 03e06f957f794ca696ddc7207eeabff0 P dea34817fcc148d78f090ef5fa72304f [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:09:22.205644 24206 consensus_peers.cc:597] T 861d7d76be4d484a9eb3acf8abffae5f P f8d4657116f948038a0c73018238c3ba -> Peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Couldn't send request to peer dea34817fcc148d78f090ef5fa72304f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:22.205955 15057 raft_consensus.cc:2272] T 03e06f957f794ca696ddc7207eeabff0 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:22.208323 15057 tablet_replica.cc:333] T e280ec3a0e394065aca766e4f8bef46d P dea34817fcc148d78f090ef5fa72304f: stopping tablet replica
I20260709 13:09:22.209046 15057 raft_consensus.cc:2243] T e280ec3a0e394065aca766e4f8bef46d P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:22.209537 15057 raft_consensus.cc:2272] T e280ec3a0e394065aca766e4f8bef46d P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:22.211761 15057 tablet_replica.cc:333] T 25e4818a4e2e4c9c9f7a8467aa9ef881 P dea34817fcc148d78f090ef5fa72304f: stopping tablet replica
I20260709 13:09:22.212425 15057 raft_consensus.cc:2243] T 25e4818a4e2e4c9c9f7a8467aa9ef881 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:22.213042 15057 raft_consensus.cc:2272] T 25e4818a4e2e4c9c9f7a8467aa9ef881 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:22.215410 15057 tablet_replica.cc:333] T 0dbd3426f3e14ef28e7b0b6c4c7de6a2 P dea34817fcc148d78f090ef5fa72304f: stopping tablet replica
I20260709 13:09:22.216205 15057 raft_consensus.cc:2243] T 0dbd3426f3e14ef28e7b0b6c4c7de6a2 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:22.216785 15057 raft_consensus.cc:2272] T 0dbd3426f3e14ef28e7b0b6c4c7de6a2 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:22.218948 15057 tablet_replica.cc:333] T 3bcebec1ac994b99a49430f4f892d615 P dea34817fcc148d78f090ef5fa72304f: stopping tablet replica
I20260709 13:09:22.219679 15057 raft_consensus.cc:2243] T 3bcebec1ac994b99a49430f4f892d615 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:22.220165 15057 raft_consensus.cc:2272] T 3bcebec1ac994b99a49430f4f892d615 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:22.222820 15057 tablet_replica.cc:333] T ab4ea1ceb7a443be94ec74cd88c9bf47 P dea34817fcc148d78f090ef5fa72304f: stopping tablet replica
I20260709 13:09:22.223569 15057 raft_consensus.cc:2243] T ab4ea1ceb7a443be94ec74cd88c9bf47 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:22.224054 15057 raft_consensus.cc:2272] T ab4ea1ceb7a443be94ec74cd88c9bf47 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:22.226015 15057 tablet_replica.cc:333] T bff14fa713b6482f89ecf3e18f785f81 P dea34817fcc148d78f090ef5fa72304f: stopping tablet replica
I20260709 13:09:22.226884 15057 raft_consensus.cc:2243] T bff14fa713b6482f89ecf3e18f785f81 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:22.227758 15057 raft_consensus.cc:2272] T bff14fa713b6482f89ecf3e18f785f81 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:22.230286 15057 tablet_replica.cc:333] T b25c31c2fcad44f281a8a045e6cb0c19 P dea34817fcc148d78f090ef5fa72304f: stopping tablet replica
I20260709 13:09:22.231211 15057 raft_consensus.cc:2243] T b25c31c2fcad44f281a8a045e6cb0c19 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:22.231824 15057 raft_consensus.cc:2272] T b25c31c2fcad44f281a8a045e6cb0c19 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:22.235072 15057 tablet_replica.cc:333] T 1dcdde5516f54b19b11611ca9213415d P dea34817fcc148d78f090ef5fa72304f: stopping tablet replica
I20260709 13:09:22.236032 15057 raft_consensus.cc:2243] T 1dcdde5516f54b19b11611ca9213415d P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:22.236618 15057 raft_consensus.cc:2272] T 1dcdde5516f54b19b11611ca9213415d P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:22.237758 24206 consensus_peers.cc:597] T e21ef2f479764142935dc2b1b7e87220 P f8d4657116f948038a0c73018238c3ba -> Peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Couldn't send request to peer dea34817fcc148d78f090ef5fa72304f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:22.239065 15057 tablet_replica.cc:333] T 687efb9bbbd04b0eb768bfa6543380c3 P dea34817fcc148d78f090ef5fa72304f: stopping tablet replica
I20260709 13:09:22.240048 15057 raft_consensus.cc:2243] T 687efb9bbbd04b0eb768bfa6543380c3 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:22.240605 15057 raft_consensus.cc:2272] T 687efb9bbbd04b0eb768bfa6543380c3 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:22.243649 15057 tablet_replica.cc:333] T 9acec0d1a6e74a4bb39a0d867598acc5 P dea34817fcc148d78f090ef5fa72304f: stopping tablet replica
I20260709 13:09:22.244529 15057 raft_consensus.cc:2243] T 9acec0d1a6e74a4bb39a0d867598acc5 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:22.245069 15057 raft_consensus.cc:2272] T 9acec0d1a6e74a4bb39a0d867598acc5 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:22.247165 15057 tablet_replica.cc:333] T 93e868a924d74bbc8bf29aa5a7fc67fd P dea34817fcc148d78f090ef5fa72304f: stopping tablet replica
I20260709 13:09:22.247819 15057 raft_consensus.cc:2243] T 93e868a924d74bbc8bf29aa5a7fc67fd P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:22.248318 15057 raft_consensus.cc:2272] T 93e868a924d74bbc8bf29aa5a7fc67fd P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:22.250425 15057 tablet_replica.cc:333] T ee2c640a38d44afebd95dfec0e30b0d6 P dea34817fcc148d78f090ef5fa72304f: stopping tablet replica
I20260709 13:09:22.251163 15057 raft_consensus.cc:2243] T ee2c640a38d44afebd95dfec0e30b0d6 P dea34817fcc148d78f090ef5fa72304f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:22.252010 15057 raft_consensus.cc:2272] T ee2c640a38d44afebd95dfec0e30b0d6 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:22.254490 15057 tablet_replica.cc:333] T e21ef2f479764142935dc2b1b7e87220 P dea34817fcc148d78f090ef5fa72304f: stopping tablet replica
I20260709 13:09:22.255333 15057 raft_consensus.cc:2243] T e21ef2f479764142935dc2b1b7e87220 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:22.255925 15057 raft_consensus.cc:2272] T e21ef2f479764142935dc2b1b7e87220 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:22.257251 24280 consensus_peers.cc:597] T 0dbd3426f3e14ef28e7b0b6c4c7de6a2 P b39c386162de49aca92dbebee7f06ace -> Peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Couldn't send request to peer dea34817fcc148d78f090ef5fa72304f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:22.258204 15057 tablet_replica.cc:333] T d17a6bbfc9d8478988b08964765c3b86 P dea34817fcc148d78f090ef5fa72304f: stopping tablet replica
I20260709 13:09:22.259086 15057 raft_consensus.cc:2243] T d17a6bbfc9d8478988b08964765c3b86 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:22.259657 15057 raft_consensus.cc:2272] T d17a6bbfc9d8478988b08964765c3b86 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:22.261749 15057 tablet_replica.cc:333] T 2dbbcd71c86041ba949fac653102e076 P dea34817fcc148d78f090ef5fa72304f: stopping tablet replica
I20260709 13:09:22.262405 15057 raft_consensus.cc:2243] T 2dbbcd71c86041ba949fac653102e076 P dea34817fcc148d78f090ef5fa72304f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:22.263374 15057 raft_consensus.cc:2272] T 2dbbcd71c86041ba949fac653102e076 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:22.265908 15057 tablet_replica.cc:333] T e6f709868be149759ecdc073fe125bec P dea34817fcc148d78f090ef5fa72304f: stopping tablet replica
I20260709 13:09:22.266652 15057 raft_consensus.cc:2243] T e6f709868be149759ecdc073fe125bec P dea34817fcc148d78f090ef5fa72304f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:22.267491 15057 raft_consensus.cc:2272] T e6f709868be149759ecdc073fe125bec P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:22.269697 15057 tablet_replica.cc:333] T f662efc86a73450cac065505b63cb883 P dea34817fcc148d78f090ef5fa72304f: stopping tablet replica
I20260709 13:09:22.270812 15057 raft_consensus.cc:2243] T f662efc86a73450cac065505b63cb883 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:22.271368 15057 raft_consensus.cc:2272] T f662efc86a73450cac065505b63cb883 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:22.274212 15057 tablet_replica.cc:333] T 1541f6b04d914d10823ad78c03d9a847 P dea34817fcc148d78f090ef5fa72304f: stopping tablet replica
I20260709 13:09:22.275128 15057 raft_consensus.cc:2243] T 1541f6b04d914d10823ad78c03d9a847 P dea34817fcc148d78f090ef5fa72304f [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:09:22.275585 24132 consensus_peers.cc:597] T 687efb9bbbd04b0eb768bfa6543380c3 P c0f503bf8bb94af8a2a1139db4e1c0f5 -> Peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Couldn't send request to peer dea34817fcc148d78f090ef5fa72304f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:22.276103 15057 raft_consensus.cc:2272] T 1541f6b04d914d10823ad78c03d9a847 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:22.278411 15057 tablet_replica.cc:333] T c9b7bd5d439d455a9173478e086439e8 P dea34817fcc148d78f090ef5fa72304f: stopping tablet replica
I20260709 13:09:22.279311 15057 raft_consensus.cc:2243] T c9b7bd5d439d455a9173478e086439e8 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:22.279995 15057 raft_consensus.cc:2272] T c9b7bd5d439d455a9173478e086439e8 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:22.282395 15057 tablet_replica.cc:333] T 861d7d76be4d484a9eb3acf8abffae5f P dea34817fcc148d78f090ef5fa72304f: stopping tablet replica
I20260709 13:09:22.283110 15057 raft_consensus.cc:2243] T 861d7d76be4d484a9eb3acf8abffae5f P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:22.283686 15057 raft_consensus.cc:2272] T 861d7d76be4d484a9eb3acf8abffae5f P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:22.286615 15057 tablet_replica.cc:333] T 45b65ebcb0114044a04e5689db4a466f P dea34817fcc148d78f090ef5fa72304f: stopping tablet replica
I20260709 13:09:22.287312 15057 raft_consensus.cc:2243] T 45b65ebcb0114044a04e5689db4a466f P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:22.287817 15057 raft_consensus.cc:2272] T 45b65ebcb0114044a04e5689db4a466f P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:22.290220 15057 tablet_replica.cc:333] T 5bc4e407c8b04739aa0290922bfdbed4 P dea34817fcc148d78f090ef5fa72304f: stopping tablet replica
I20260709 13:09:22.290977 15057 raft_consensus.cc:2243] T 5bc4e407c8b04739aa0290922bfdbed4 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:22.291514 15057 raft_consensus.cc:2272] T 5bc4e407c8b04739aa0290922bfdbed4 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:22.293664 24206 consensus_peers.cc:597] T b1d1d7dd508b43489431371c4ece4fa4 P f8d4657116f948038a0c73018238c3ba -> Peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Couldn't send request to peer dea34817fcc148d78f090ef5fa72304f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:22.294106 15057 tablet_replica.cc:333] T 01f1144c4a1c482894ec993e5ce24bc4 P dea34817fcc148d78f090ef5fa72304f: stopping tablet replica
I20260709 13:09:22.295095 15057 raft_consensus.cc:2243] T 01f1144c4a1c482894ec993e5ce24bc4 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:22.295671 15057 raft_consensus.cc:2272] T 01f1144c4a1c482894ec993e5ce24bc4 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:22.298784 15057 tablet_replica.cc:333] T 99078769583e49908dd6990f1d806453 P dea34817fcc148d78f090ef5fa72304f: stopping tablet replica
I20260709 13:09:22.299726 15057 raft_consensus.cc:2243] T 99078769583e49908dd6990f1d806453 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:22.300369 15057 raft_consensus.cc:2272] T 99078769583e49908dd6990f1d806453 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:22.303102 15057 tablet_replica.cc:333] T b1d1d7dd508b43489431371c4ece4fa4 P dea34817fcc148d78f090ef5fa72304f: stopping tablet replica
I20260709 13:09:22.303894 15057 raft_consensus.cc:2243] T b1d1d7dd508b43489431371c4ece4fa4 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:22.304553 15057 raft_consensus.cc:2272] T b1d1d7dd508b43489431371c4ece4fa4 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:22.305943 24132 consensus_peers.cc:597] T 7da69453741f4b73a0092f56f29b1000 P c0f503bf8bb94af8a2a1139db4e1c0f5 -> Peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Couldn't send request to peer dea34817fcc148d78f090ef5fa72304f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:22.307741 15057 tablet_replica.cc:333] T f735173e22b242178edcdf4821b6f92b P dea34817fcc148d78f090ef5fa72304f: stopping tablet replica
I20260709 13:09:22.308776 15057 raft_consensus.cc:2243] T f735173e22b242178edcdf4821b6f92b P dea34817fcc148d78f090ef5fa72304f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:22.309989 15057 raft_consensus.cc:2272] T f735173e22b242178edcdf4821b6f92b P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:22.312840 15057 tablet_replica.cc:333] T b53fa043603b41be836d4ccb5c248df8 P dea34817fcc148d78f090ef5fa72304f: stopping tablet replica
I20260709 13:09:22.313549 15057 raft_consensus.cc:2243] T b53fa043603b41be836d4ccb5c248df8 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:22.314128 15057 raft_consensus.cc:2272] T b53fa043603b41be836d4ccb5c248df8 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:22.316224 15057 tablet_replica.cc:333] T 7da69453741f4b73a0092f56f29b1000 P dea34817fcc148d78f090ef5fa72304f: stopping tablet replica
I20260709 13:09:22.316820 15057 raft_consensus.cc:2243] T 7da69453741f4b73a0092f56f29b1000 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:22.317270 15057 raft_consensus.cc:2272] T 7da69453741f4b73a0092f56f29b1000 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:22.319551 15057 tablet_replica.cc:333] T 42868db4862647c28215f3d7cb9adf02 P dea34817fcc148d78f090ef5fa72304f: stopping tablet replica
I20260709 13:09:22.320118 15057 raft_consensus.cc:2243] T 42868db4862647c28215f3d7cb9adf02 P dea34817fcc148d78f090ef5fa72304f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:22.320909 15057 raft_consensus.cc:2272] T 42868db4862647c28215f3d7cb9adf02 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:22.323230 15057 tablet_replica.cc:333] T 502fe798081f4dc693eed179efa2a241 P dea34817fcc148d78f090ef5fa72304f: stopping tablet replica
I20260709 13:09:22.324086 15057 raft_consensus.cc:2243] T 502fe798081f4dc693eed179efa2a241 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:22.324738 15057 raft_consensus.cc:2272] T 502fe798081f4dc693eed179efa2a241 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:22.327482 24132 consensus_peers.cc:597] T d17a6bbfc9d8478988b08964765c3b86 P c0f503bf8bb94af8a2a1139db4e1c0f5 -> Peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Couldn't send request to peer dea34817fcc148d78f090ef5fa72304f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:22.327796 15057 tablet_replica.cc:333] T 49393e5cc2614c90b69a3bb2348dacb9 P dea34817fcc148d78f090ef5fa72304f: stopping tablet replica
I20260709 13:09:22.328696 15057 raft_consensus.cc:2243] T 49393e5cc2614c90b69a3bb2348dacb9 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:22.329308 15057 raft_consensus.cc:2272] T 49393e5cc2614c90b69a3bb2348dacb9 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:22.332850 15057 tablet_replica.cc:333] T e845188d32d2466a92eacdb66da16dba P dea34817fcc148d78f090ef5fa72304f: stopping tablet replica
I20260709 13:09:22.333724 15057 raft_consensus.cc:2243] T e845188d32d2466a92eacdb66da16dba P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:22.334311 15057 raft_consensus.cc:2272] T e845188d32d2466a92eacdb66da16dba P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:22.334652 24206 consensus_peers.cc:597] T 3bcebec1ac994b99a49430f4f892d615 P f8d4657116f948038a0c73018238c3ba -> Peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Couldn't send request to peer dea34817fcc148d78f090ef5fa72304f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:22.337373 15057 tablet_replica.cc:333] T 47fcd2aa8e994186872c2e0f9995dd8a P dea34817fcc148d78f090ef5fa72304f: stopping tablet replica
I20260709 13:09:22.338317 15057 raft_consensus.cc:2243] T 47fcd2aa8e994186872c2e0f9995dd8a P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:22.339010 15057 raft_consensus.cc:2272] T 47fcd2aa8e994186872c2e0f9995dd8a P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:22.341946 15057 tablet_replica.cc:333] T 03bfe46bf2b74722b6e8eb3015e38f43 P dea34817fcc148d78f090ef5fa72304f: stopping tablet replica
I20260709 13:09:22.342777 15057 raft_consensus.cc:2243] T 03bfe46bf2b74722b6e8eb3015e38f43 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:22.343318 15057 raft_consensus.cc:2272] T 03bfe46bf2b74722b6e8eb3015e38f43 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:22.345986 15057 tablet_replica.cc:333] T de5786fbd53646a9bc152ac0a2a9aa53 P dea34817fcc148d78f090ef5fa72304f: stopping tablet replica
I20260709 13:09:22.346655 15057 raft_consensus.cc:2243] T de5786fbd53646a9bc152ac0a2a9aa53 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:22.347189 15057 raft_consensus.cc:2272] T de5786fbd53646a9bc152ac0a2a9aa53 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:22.350404 15057 tablet_replica.cc:333] T 5a8830d169ce4e46807d04168c3bb086 P dea34817fcc148d78f090ef5fa72304f: stopping tablet replica
I20260709 13:09:22.351246 15057 raft_consensus.cc:2243] T 5a8830d169ce4e46807d04168c3bb086 P dea34817fcc148d78f090ef5fa72304f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:22.352279 15057 raft_consensus.cc:2272] T 5a8830d169ce4e46807d04168c3bb086 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:22.353026 24206 consensus_peers.cc:597] T 7a76ed4e1b6a4c2698999f722da5cfd7 P f8d4657116f948038a0c73018238c3ba -> Peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Couldn't send request to peer dea34817fcc148d78f090ef5fa72304f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:22.355497 15057 tablet_replica.cc:333] T 46f373ffd46f4625bac910b5ccf4b767 P dea34817fcc148d78f090ef5fa72304f: stopping tablet replica
I20260709 13:09:22.356371 15057 raft_consensus.cc:2243] T 46f373ffd46f4625bac910b5ccf4b767 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:22.356971 15057 raft_consensus.cc:2272] T 46f373ffd46f4625bac910b5ccf4b767 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:22.382382 24280 consensus_peers.cc:597] T f662efc86a73450cac065505b63cb883 P b39c386162de49aca92dbebee7f06ace -> Peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Couldn't send request to peer dea34817fcc148d78f090ef5fa72304f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:22.397238 24206 consensus_peers.cc:597] T de5786fbd53646a9bc152ac0a2a9aa53 P f8d4657116f948038a0c73018238c3ba -> Peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Couldn't send request to peer dea34817fcc148d78f090ef5fa72304f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:22.402237 24206 consensus_peers.cc:597] T 430894245c954e33b6586b4704c66b3c P f8d4657116f948038a0c73018238c3ba -> Peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Couldn't send request to peer dea34817fcc148d78f090ef5fa72304f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:22.404451 24132 consensus_peers.cc:597] T 65f010ca5ab74fa1b0f45b7d5dced706 P c0f503bf8bb94af8a2a1139db4e1c0f5 -> Peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Couldn't send request to peer dea34817fcc148d78f090ef5fa72304f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:22.408699 24280 consensus_peers.cc:597] T aaf99a05bd8842ed9ea668a9da85dbcc P b39c386162de49aca92dbebee7f06ace -> Peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Couldn't send request to peer dea34817fcc148d78f090ef5fa72304f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:22.414012 24206 consensus_peers.cc:597] T 47fcd2aa8e994186872c2e0f9995dd8a P f8d4657116f948038a0c73018238c3ba -> Peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Couldn't send request to peer dea34817fcc148d78f090ef5fa72304f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:22.432164 15057 tablet_server.cc:196] TabletServer@127.14.180.65:0 shutdown complete.
W20260709 13:09:22.436937 24280 consensus_peers.cc:597] T a0ff7e0491fb406d9e1f13941504372f P b39c386162de49aca92dbebee7f06ace -> Peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Couldn't send request to peer dea34817fcc148d78f090ef5fa72304f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:36343: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:22.470500 24132 consensus_peers.cc:597] T e280ec3a0e394065aca766e4f8bef46d P c0f503bf8bb94af8a2a1139db4e1c0f5 -> Peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Couldn't send request to peer dea34817fcc148d78f090ef5fa72304f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:36343: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:22.471256 24132 consensus_peers.cc:597] T ab4ea1ceb7a443be94ec74cd88c9bf47 P c0f503bf8bb94af8a2a1139db4e1c0f5 -> Peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Couldn't send request to peer dea34817fcc148d78f090ef5fa72304f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:36343: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:22.501667 24280 consensus_peers.cc:597] T 99b130381d71460388507938ba053f8f P b39c386162de49aca92dbebee7f06ace -> Peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Couldn't send request to peer dea34817fcc148d78f090ef5fa72304f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:36343: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:22.598491 15057 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:22.616888 24895 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:22.619292 24896 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:22.627926 15057 server_base.cc:1061] running on GCE node
W20260709 13:09:22.630934 24898 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:22.633946 15057 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:22.634300 15057 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:22.634512 15057 hybrid_clock.cc:648] HybridClock initialized: now 1783602562634475 us; error 0 us; skew 500 ppm
I20260709 13:09:22.635315 15057 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:22.639492 15057 webserver.cc:533] Webserver started at http://127.14.180.65:46761/ using document root <none> and password file <none>
I20260709 13:09:22.640173 15057 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:22.640431 15057 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:09:22.649252 15057 fs_manager.cc:714] Time spent opening directory manager: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:09:22.663316 24904 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:22.664757 15057 fs_manager.cc:730] Time spent opening block manager: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:09:22.665309 15057 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602283040513-15057-0/minicluster-data/ts-0-root
uuid: "dea34817fcc148d78f090ef5fa72304f"
format_stamp: "Formatted at 2026-07-09 13:09:09 on dist-test-slave-r9m8"
I20260709 13:09:22.666034 15057 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602283040513-15057-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602283040513-15057-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602283040513-15057-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:22.782805 15057 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:22.784595 15057 kserver.cc:163] Server-wide thread pool size limit: 3276
W20260709 13:09:22.792532 24206 consensus_peers.cc:597] T 46f373ffd46f4625bac910b5ccf4b767 P f8d4657116f948038a0c73018238c3ba -> Peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Couldn't send request to peer dea34817fcc148d78f090ef5fa72304f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:36343: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:22.821857 15057 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
W20260709 13:09:22.835073 24206 consensus_peers.cc:597] T 502fe798081f4dc693eed179efa2a241 P f8d4657116f948038a0c73018238c3ba -> Peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Couldn't send request to peer dea34817fcc148d78f090ef5fa72304f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:36343: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:22.837023 24206 consensus_peers.cc:597] T c9b7bd5d439d455a9173478e086439e8 P f8d4657116f948038a0c73018238c3ba -> Peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Couldn't send request to peer dea34817fcc148d78f090ef5fa72304f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:36343: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:22.837662 24206 consensus_peers.cc:597] T 99078769583e49908dd6990f1d806453 P f8d4657116f948038a0c73018238c3ba -> Peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Couldn't send request to peer dea34817fcc148d78f090ef5fa72304f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:36343: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:22.841511 24132 consensus_peers.cc:597] T 25e4818a4e2e4c9c9f7a8467aa9ef881 P c0f503bf8bb94af8a2a1139db4e1c0f5 -> Peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Couldn't send request to peer dea34817fcc148d78f090ef5fa72304f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:36343: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:22.846138 24206 consensus_peers.cc:597] T b53fa043603b41be836d4ccb5c248df8 P f8d4657116f948038a0c73018238c3ba -> Peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Couldn't send request to peer dea34817fcc148d78f090ef5fa72304f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:36343: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:22.847116 24206 consensus_peers.cc:597] T 01f1144c4a1c482894ec993e5ce24bc4 P f8d4657116f948038a0c73018238c3ba -> Peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Couldn't send request to peer dea34817fcc148d78f090ef5fa72304f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:36343: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:22.847342 24921 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
W20260709 13:09:22.889947 24132 consensus_peers.cc:597] T e845188d32d2466a92eacdb66da16dba P c0f503bf8bb94af8a2a1139db4e1c0f5 -> Peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Couldn't send request to peer dea34817fcc148d78f090ef5fa72304f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:36343: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:22.893337 24132 consensus_peers.cc:597] T 1dcdde5516f54b19b11611ca9213415d P c0f503bf8bb94af8a2a1139db4e1c0f5 -> Peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Couldn't send request to peer dea34817fcc148d78f090ef5fa72304f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:36343: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:22.911856 24280 consensus_peers.cc:597] T 9acec0d1a6e74a4bb39a0d867598acc5 P b39c386162de49aca92dbebee7f06ace -> Peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Couldn't send request to peer dea34817fcc148d78f090ef5fa72304f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:36343: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:22.993490 24132 consensus_peers.cc:597] T 93e868a924d74bbc8bf29aa5a7fc67fd P c0f503bf8bb94af8a2a1139db4e1c0f5 -> Peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Couldn't send request to peer dea34817fcc148d78f090ef5fa72304f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:36343: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:22.994781 24132 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:36343, user_credentials={real_user=slave}} blocked reactor thread for 79453.1us
W20260709 13:09:23.007652 24279 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46171, user_credentials={real_user=slave}} blocked reactor thread for 81985.2us
W20260709 13:09:23.031018 24206 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:37431, user_credentials={real_user=slave}} blocked reactor thread for 99177.9us
W20260709 13:09:23.065534 24131 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:46171, user_credentials={real_user=slave}} blocked reactor thread for 73086.1us
I20260709 13:09:23.229833 24912 raft_consensus.cc:493] T 03e06f957f794ca696ddc7207eeabff0 P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dea34817fcc148d78f090ef5fa72304f)
I20260709 13:09:23.230818 24912 raft_consensus.cc:515] T 03e06f957f794ca696ddc7207eeabff0 P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:23.233732 24912 leader_election.cc:290] T 03e06f957f794ca696ddc7207eeabff0 P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343), c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431)
I20260709 13:09:23.235533 24164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e06f957f794ca696ddc7207eeabff0" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" is_pre_election: true
W20260709 13:09:23.237900 24206 leader_election.cc:336] T 03e06f957f794ca696ddc7207eeabff0 P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Network error: Client connection negotiation failed: client connection to 127.14.180.65:36343: connect: Connection refused (error 111)
I20260709 13:09:23.238389 24206 leader_election.cc:304] T 03e06f957f794ca696ddc7207eeabff0 P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8d4657116f948038a0c73018238c3ba; no voters: c0f503bf8bb94af8a2a1139db4e1c0f5, dea34817fcc148d78f090ef5fa72304f
I20260709 13:09:23.239320 24907 raft_consensus.cc:2749] T 03e06f957f794ca696ddc7207eeabff0 P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:23.332653 24924 raft_consensus.cc:493] T 03e06f957f794ca696ddc7207eeabff0 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dea34817fcc148d78f090ef5fa72304f)
I20260709 13:09:23.333353 24924 raft_consensus.cc:515] T 03e06f957f794ca696ddc7207eeabff0 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:23.335590 24924 leader_election.cc:290] T 03e06f957f794ca696ddc7207eeabff0 P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343), f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171)
I20260709 13:09:23.337455 24237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e06f957f794ca696ddc7207eeabff0" candidate_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8d4657116f948038a0c73018238c3ba" is_pre_election: true
I20260709 13:09:23.338323 24237 raft_consensus.cc:2468] T 03e06f957f794ca696ddc7207eeabff0 P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0f503bf8bb94af8a2a1139db4e1c0f5 in term 1.
I20260709 13:09:23.340027 24131 leader_election.cc:304] T 03e06f957f794ca696ddc7207eeabff0 P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0f503bf8bb94af8a2a1139db4e1c0f5, f8d4657116f948038a0c73018238c3ba; no voters: 
W20260709 13:09:23.340981 24132 leader_election.cc:336] T 03e06f957f794ca696ddc7207eeabff0 P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Network error: Client connection negotiation failed: client connection to 127.14.180.65:36343: connect: Connection refused (error 111)
I20260709 13:09:23.341012 24924 raft_consensus.cc:2804] T 03e06f957f794ca696ddc7207eeabff0 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:23.341773 24924 raft_consensus.cc:493] T 03e06f957f794ca696ddc7207eeabff0 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader dea34817fcc148d78f090ef5fa72304f)
I20260709 13:09:23.342178 24924 raft_consensus.cc:3060] T 03e06f957f794ca696ddc7207eeabff0 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:23.351743 24924 raft_consensus.cc:515] T 03e06f957f794ca696ddc7207eeabff0 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:23.353878 24924 leader_election.cc:290] T 03e06f957f794ca696ddc7207eeabff0 P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 2 election: Requested vote from peers dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343), f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171)
I20260709 13:09:23.355108 24237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e06f957f794ca696ddc7207eeabff0" candidate_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8d4657116f948038a0c73018238c3ba"
I20260709 13:09:23.355873 24237 raft_consensus.cc:3060] T 03e06f957f794ca696ddc7207eeabff0 P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:23.357724 24132 leader_election.cc:336] T 03e06f957f794ca696ddc7207eeabff0 P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Network error: Client connection negotiation failed: client connection to 127.14.180.65:36343: connect: Connection refused (error 111)
I20260709 13:09:23.362638 15057 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 13:09:23.363169 15057 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.521s	user 0.009s	sys 0.003s
I20260709 13:09:23.363729 15057 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 13:09:23.380260 24921 tablet_bootstrap.cc:492] T f662efc86a73450cac065505b63cb883 P dea34817fcc148d78f090ef5fa72304f: Bootstrap starting.
I20260709 13:09:23.386991 24237 raft_consensus.cc:2468] T 03e06f957f794ca696ddc7207eeabff0 P f8d4657116f948038a0c73018238c3ba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0f503bf8bb94af8a2a1139db4e1c0f5 in term 2.
I20260709 13:09:23.391481 24131 leader_election.cc:304] T 03e06f957f794ca696ddc7207eeabff0 P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c0f503bf8bb94af8a2a1139db4e1c0f5, f8d4657116f948038a0c73018238c3ba; no voters: dea34817fcc148d78f090ef5fa72304f
I20260709 13:09:23.392762 24924 raft_consensus.cc:2804] T 03e06f957f794ca696ddc7207eeabff0 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:23.393424 24924 raft_consensus.cc:697] T 03e06f957f794ca696ddc7207eeabff0 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 2 LEADER]: Becoming Leader. State: Replica: c0f503bf8bb94af8a2a1139db4e1c0f5, State: Running, Role: LEADER
I20260709 13:09:23.394758 24924 consensus_queue.cc:237] T 03e06f957f794ca696ddc7207eeabff0 P c0f503bf8bb94af8a2a1139db4e1c0f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:23.414505 24926 raft_consensus.cc:493] T ee2c640a38d44afebd95dfec0e30b0d6 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dea34817fcc148d78f090ef5fa72304f)
I20260709 13:09:23.415184 24926 raft_consensus.cc:515] T ee2c640a38d44afebd95dfec0e30b0d6 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:23.417415 24926 leader_election.cc:290] T ee2c640a38d44afebd95dfec0e30b0d6 P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343), f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171)
I20260709 13:09:23.422282 24237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2c640a38d44afebd95dfec0e30b0d6" candidate_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8d4657116f948038a0c73018238c3ba" is_pre_election: true
W20260709 13:09:23.435043 24132 leader_election.cc:336] T ee2c640a38d44afebd95dfec0e30b0d6 P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Network error: Client connection negotiation failed: client connection to 127.14.180.65:36343: connect: Connection refused (error 111)
I20260709 13:09:23.435561 24132 leader_election.cc:304] T ee2c640a38d44afebd95dfec0e30b0d6 P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0f503bf8bb94af8a2a1139db4e1c0f5; no voters: dea34817fcc148d78f090ef5fa72304f, f8d4657116f948038a0c73018238c3ba
I20260709 13:09:23.440799 24910 raft_consensus.cc:2749] T ee2c640a38d44afebd95dfec0e30b0d6 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:23.453994 24921 tablet_bootstrap.cc:492] T f662efc86a73450cac065505b63cb883 P dea34817fcc148d78f090ef5fa72304f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:23.455194 24921 tablet_bootstrap.cc:492] T f662efc86a73450cac065505b63cb883 P dea34817fcc148d78f090ef5fa72304f: Bootstrap complete.
I20260709 13:09:23.455973 24921 ts_tablet_manager.cc:1403] T f662efc86a73450cac065505b63cb883 P dea34817fcc148d78f090ef5fa72304f: Time spent bootstrapping tablet: real 0.076s	user 0.014s	sys 0.037s
I20260709 13:09:23.459654 24921 raft_consensus.cc:359] T f662efc86a73450cac065505b63cb883 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:23.460412 24921 raft_consensus.cc:740] T f662efc86a73450cac065505b63cb883 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: dea34817fcc148d78f090ef5fa72304f, State: Initialized, Role: FOLLOWER
I20260709 13:09:23.461243 24921 consensus_queue.cc:260] T f662efc86a73450cac065505b63cb883 P dea34817fcc148d78f090ef5fa72304f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:23.461210 23985 catalog_manager.cc:5697] T 03e06f957f794ca696ddc7207eeabff0 P c0f503bf8bb94af8a2a1139db4e1c0f5 reported cstate change: term changed from 1 to 2, leader changed from dea34817fcc148d78f090ef5fa72304f (127.14.180.65) to c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66). New cstate: current_term: 2 leader_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:23.487651 24802 raft_consensus.cc:493] T 1541f6b04d914d10823ad78c03d9a847 P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dea34817fcc148d78f090ef5fa72304f)
I20260709 13:09:23.487488 24912 raft_consensus.cc:493] T 662a938528e545e6aa4592052da18101 P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dea34817fcc148d78f090ef5fa72304f)
I20260709 13:09:23.488555 24802 raft_consensus.cc:515] T 1541f6b04d914d10823ad78c03d9a847 P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:23.488746 24912 raft_consensus.cc:515] T 662a938528e545e6aa4592052da18101 P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:23.491042 24802 leader_election.cc:290] T 1541f6b04d914d10823ad78c03d9a847 P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343), c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431)
I20260709 13:09:23.505741 24164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1541f6b04d914d10823ad78c03d9a847" candidate_uuid: "b39c386162de49aca92dbebee7f06ace" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" is_pre_election: true
I20260709 13:09:23.504959 24906 raft_consensus.cc:493] T ee2c640a38d44afebd95dfec0e30b0d6 P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dea34817fcc148d78f090ef5fa72304f)
I20260709 13:09:23.507678 24906 raft_consensus.cc:515] T ee2c640a38d44afebd95dfec0e30b0d6 P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:23.510022 24912 leader_election.cc:290] T 662a938528e545e6aa4592052da18101 P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561), dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343)
I20260709 13:09:23.510458 24802 raft_consensus.cc:493] T 2dbbcd71c86041ba949fac653102e076 P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dea34817fcc148d78f090ef5fa72304f)
I20260709 13:09:23.511253 24802 raft_consensus.cc:515] T 2dbbcd71c86041ba949fac653102e076 P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:23.513582 24802 leader_election.cc:290] T 2dbbcd71c86041ba949fac653102e076 P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343), c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431)
I20260709 13:09:23.510313 24906 leader_election.cc:290] T ee2c640a38d44afebd95dfec0e30b0d6 P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343), c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431)
I20260709 13:09:23.517201 24921 ts_tablet_manager.cc:1434] T f662efc86a73450cac065505b63cb883 P dea34817fcc148d78f090ef5fa72304f: Time spent starting tablet: real 0.061s	user 0.007s	sys 0.049s
W20260709 13:09:23.510272 24280 leader_election.cc:336] T 1541f6b04d914d10823ad78c03d9a847 P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Network error: Client connection negotiation failed: client connection to 127.14.180.65:36343: connect: Connection refused (error 111)
I20260709 13:09:23.518038 24280 leader_election.cc:304] T 1541f6b04d914d10823ad78c03d9a847 P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b39c386162de49aca92dbebee7f06ace; no voters: c0f503bf8bb94af8a2a1139db4e1c0f5, dea34817fcc148d78f090ef5fa72304f
I20260709 13:09:23.518276 24921 tablet_bootstrap.cc:492] T 2dbbcd71c86041ba949fac653102e076 P dea34817fcc148d78f090ef5fa72304f: Bootstrap starting.
I20260709 13:09:23.518270 24802 raft_consensus.cc:493] T 662a938528e545e6aa4592052da18101 P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dea34817fcc148d78f090ef5fa72304f)
I20260709 13:09:23.518587 24164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2c640a38d44afebd95dfec0e30b0d6" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" is_pre_election: true
I20260709 13:09:23.519522 24164 raft_consensus.cc:2468] T ee2c640a38d44afebd95dfec0e30b0d6 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8d4657116f948038a0c73018238c3ba in term 1.
I20260709 13:09:23.519199 24802 raft_consensus.cc:515] T 662a938528e545e6aa4592052da18101 P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:23.520201 24308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "662a938528e545e6aa4592052da18101" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace" is_pre_election: true
I20260709 13:09:23.520658 24923 raft_consensus.cc:2749] T 1541f6b04d914d10823ad78c03d9a847 P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:23.520888 24308 raft_consensus.cc:2468] T 662a938528e545e6aa4592052da18101 P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8d4657116f948038a0c73018238c3ba in term 1.
I20260709 13:09:23.522639 24802 leader_election.cc:290] T 662a938528e545e6aa4592052da18101 P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171), dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343)
I20260709 13:09:23.526244 24206 leader_election.cc:304] T ee2c640a38d44afebd95dfec0e30b0d6 P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0f503bf8bb94af8a2a1139db4e1c0f5, f8d4657116f948038a0c73018238c3ba; no voters: 
I20260709 13:09:23.527221 24906 raft_consensus.cc:2804] T ee2c640a38d44afebd95dfec0e30b0d6 P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:23.527609 24906 raft_consensus.cc:493] T ee2c640a38d44afebd95dfec0e30b0d6 P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Starting leader election (detected failure of leader dea34817fcc148d78f090ef5fa72304f)
I20260709 13:09:23.528010 24906 raft_consensus.cc:3060] T ee2c640a38d44afebd95dfec0e30b0d6 P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:23.526453 24164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbbcd71c86041ba949fac653102e076" candidate_uuid: "b39c386162de49aca92dbebee7f06ace" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" is_pre_election: true
I20260709 13:09:23.531929 24204 leader_election.cc:304] T 662a938528e545e6aa4592052da18101 P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b39c386162de49aca92dbebee7f06ace, f8d4657116f948038a0c73018238c3ba; no voters: 
I20260709 13:09:23.533746 24237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "662a938528e545e6aa4592052da18101" candidate_uuid: "b39c386162de49aca92dbebee7f06ace" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8d4657116f948038a0c73018238c3ba" is_pre_election: true
I20260709 13:09:23.534534 24237 raft_consensus.cc:2468] T 662a938528e545e6aa4592052da18101 P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b39c386162de49aca92dbebee7f06ace in term 1.
I20260709 13:09:23.537941 24279 leader_election.cc:304] T 662a938528e545e6aa4592052da18101 P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b39c386162de49aca92dbebee7f06ace, f8d4657116f948038a0c73018238c3ba; no voters: 
W20260709 13:09:23.538748 24206 leader_election.cc:336] T ee2c640a38d44afebd95dfec0e30b0d6 P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Network error: Client connection negotiation failed: client connection to 127.14.180.65:36343: connect: Connection refused (error 111)
I20260709 13:09:23.539038 24802 raft_consensus.cc:2804] T 662a938528e545e6aa4592052da18101 P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:23.539564 24802 raft_consensus.cc:493] T 662a938528e545e6aa4592052da18101 P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Starting leader election (detected failure of leader dea34817fcc148d78f090ef5fa72304f)
W20260709 13:09:23.539760 24206 leader_election.cc:336] T 662a938528e545e6aa4592052da18101 P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Network error: Client connection negotiation failed: client connection to 127.14.180.65:36343: connect: Connection refused (error 111)
I20260709 13:09:23.539983 24802 raft_consensus.cc:3060] T 662a938528e545e6aa4592052da18101 P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:23.544334 24280 leader_election.cc:336] T 2dbbcd71c86041ba949fac653102e076 P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Network error: Client connection negotiation failed: client connection to 127.14.180.65:36343: connect: Connection refused (error 111)
W20260709 13:09:23.544837 24280 leader_election.cc:336] T 662a938528e545e6aa4592052da18101 P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Network error: Client connection negotiation failed: client connection to 127.14.180.65:36343: connect: Connection refused (error 111)
W20260709 13:09:23.547051 24020 debug-util.cc:398] Leaking SignalData structure 0x7b0800049440 after lost signal to thread 15060
W20260709 13:09:23.548766 24020 debug-util.cc:398] Leaking SignalData structure 0x7b080029c820 after lost signal to thread 24023
W20260709 13:09:23.551034 24020 debug-util.cc:398] Leaking SignalData structure 0x7b0800119de0 after lost signal to thread 24190
I20260709 13:09:23.543267 24912 raft_consensus.cc:2804] T 662a938528e545e6aa4592052da18101 P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:23.551643 24912 raft_consensus.cc:493] T 662a938528e545e6aa4592052da18101 P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Starting leader election (detected failure of leader dea34817fcc148d78f090ef5fa72304f)
I20260709 13:09:23.552100 24912 raft_consensus.cc:3060] T 662a938528e545e6aa4592052da18101 P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:23.553552 24020 debug-util.cc:398] Leaking SignalData structure 0x7b08002725e0 after lost signal to thread 24264
I20260709 13:09:23.556948 24280 leader_election.cc:304] T 2dbbcd71c86041ba949fac653102e076 P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b39c386162de49aca92dbebee7f06ace; no voters: c0f503bf8bb94af8a2a1139db4e1c0f5, dea34817fcc148d78f090ef5fa72304f
W20260709 13:09:23.564550 24020 debug-util.cc:398] Leaking SignalData structure 0x7b080019ba00 after lost signal to thread 24338
W20260709 13:09:23.565508 24020 debug-util.cc:398] Leaking SignalData structure 0x7b08001384a0 after lost signal to thread 24879
I20260709 13:09:23.562872 24923 raft_consensus.cc:2749] T 2dbbcd71c86041ba949fac653102e076 P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:23.567478 24906 raft_consensus.cc:515] T ee2c640a38d44afebd95dfec0e30b0d6 P f8d4657116f948038a0c73018238c3ba [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:23.569957 24906 leader_election.cc:290] T ee2c640a38d44afebd95dfec0e30b0d6 P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 2 election: Requested vote from peers dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343), c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431)
I20260709 13:09:23.577913 24912 raft_consensus.cc:515] T 662a938528e545e6aa4592052da18101 P f8d4657116f948038a0c73018238c3ba [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:23.580621 24164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2c640a38d44afebd95dfec0e30b0d6" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5"
I20260709 13:09:23.591956 24164 raft_consensus.cc:3060] T ee2c640a38d44afebd95dfec0e30b0d6 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:23.592742 24912 leader_election.cc:290] T 662a938528e545e6aa4592052da18101 P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 2 election: Requested vote from peers b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561), dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343)
I20260709 13:09:23.595243 24923 raft_consensus.cc:493] T f735173e22b242178edcdf4821b6f92b P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dea34817fcc148d78f090ef5fa72304f)
I20260709 13:09:23.596251 24923 raft_consensus.cc:515] T f735173e22b242178edcdf4821b6f92b P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:23.599882 24237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f735173e22b242178edcdf4821b6f92b" candidate_uuid: "b39c386162de49aca92dbebee7f06ace" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8d4657116f948038a0c73018238c3ba" is_pre_election: true
I20260709 13:09:23.602370 24923 leader_election.cc:290] T f735173e22b242178edcdf4821b6f92b P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171), dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343)
I20260709 13:09:23.604664 24308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "662a938528e545e6aa4592052da18101" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace"
W20260709 13:09:23.609056 24280 leader_election.cc:336] T f735173e22b242178edcdf4821b6f92b P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Network error: Client connection negotiation failed: client connection to 127.14.180.65:36343: connect: Connection refused (error 111)
I20260709 13:09:23.610309 24280 leader_election.cc:304] T f735173e22b242178edcdf4821b6f92b P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b39c386162de49aca92dbebee7f06ace; no voters: dea34817fcc148d78f090ef5fa72304f, f8d4657116f948038a0c73018238c3ba
I20260709 13:09:23.614784 24923 raft_consensus.cc:2749] T f735173e22b242178edcdf4821b6f92b P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:23.614770 24912 raft_consensus.cc:493] T e6f709868be149759ecdc073fe125bec P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dea34817fcc148d78f090ef5fa72304f)
I20260709 13:09:23.616658 24912 raft_consensus.cc:515] T e6f709868be149759ecdc073fe125bec P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:23.619237 24912 leader_election.cc:290] T e6f709868be149759ecdc073fe125bec P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343), c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431)
I20260709 13:09:23.623158 24164 raft_consensus.cc:2468] T ee2c640a38d44afebd95dfec0e30b0d6 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8d4657116f948038a0c73018238c3ba in term 2.
I20260709 13:09:23.579979 24802 raft_consensus.cc:515] T 662a938528e545e6aa4592052da18101 P b39c386162de49aca92dbebee7f06ace [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:23.626297 24308 raft_consensus.cc:2393] T 662a938528e545e6aa4592052da18101 P b39c386162de49aca92dbebee7f06ace [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate f8d4657116f948038a0c73018238c3ba in current term 2: Already voted for candidate b39c386162de49aca92dbebee7f06ace in this term.
I20260709 13:09:23.627730 24918 raft_consensus.cc:493] T e6f709868be149759ecdc073fe125bec P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dea34817fcc148d78f090ef5fa72304f)
I20260709 13:09:23.628484 24918 raft_consensus.cc:515] T e6f709868be149759ecdc073fe125bec P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
W20260709 13:09:23.591118 24206 leader_election.cc:336] T ee2c640a38d44afebd95dfec0e30b0d6 P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Network error: Client connection negotiation failed: client connection to 127.14.180.65:36343: connect: Connection refused (error 111)
I20260709 13:09:23.634721 24918 leader_election.cc:290] T e6f709868be149759ecdc073fe125bec P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343), f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171)
I20260709 13:09:23.635257 24237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f709868be149759ecdc073fe125bec" candidate_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8d4657116f948038a0c73018238c3ba" is_pre_election: true
I20260709 13:09:23.636325 24237 raft_consensus.cc:2468] T e6f709868be149759ecdc073fe125bec P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0f503bf8bb94af8a2a1139db4e1c0f5 in term 1.
W20260709 13:09:23.637058 24132 leader_election.cc:336] T e6f709868be149759ecdc073fe125bec P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Network error: Client connection negotiation failed: client connection to 127.14.180.65:36343: connect: Connection refused (error 111)
I20260709 13:09:23.638073 24131 leader_election.cc:304] T e6f709868be149759ecdc073fe125bec P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c0f503bf8bb94af8a2a1139db4e1c0f5, f8d4657116f948038a0c73018238c3ba; no voters: dea34817fcc148d78f090ef5fa72304f
I20260709 13:09:23.639168 24918 raft_consensus.cc:2804] T e6f709868be149759ecdc073fe125bec P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:23.639575 24918 raft_consensus.cc:493] T e6f709868be149759ecdc073fe125bec P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader dea34817fcc148d78f090ef5fa72304f)
I20260709 13:09:23.639940 24918 raft_consensus.cc:3060] T e6f709868be149759ecdc073fe125bec P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:23.646643 24161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f709868be149759ecdc073fe125bec" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" is_pre_election: true
I20260709 13:09:23.649214 24912 raft_consensus.cc:493] T f735173e22b242178edcdf4821b6f92b P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dea34817fcc148d78f090ef5fa72304f)
I20260709 13:09:23.649956 24912 raft_consensus.cc:515] T f735173e22b242178edcdf4821b6f92b P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:23.652441 24912 leader_election.cc:290] T f735173e22b242178edcdf4821b6f92b P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561), dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343)
I20260709 13:09:23.654423 24918 raft_consensus.cc:515] T e6f709868be149759ecdc073fe125bec P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:23.655783 24161 raft_consensus.cc:2393] T e6f709868be149759ecdc073fe125bec P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f8d4657116f948038a0c73018238c3ba in current term 2: Already voted for candidate c0f503bf8bb94af8a2a1139db4e1c0f5 in this term.
I20260709 13:09:23.656318 24237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "662a938528e545e6aa4592052da18101" candidate_uuid: "b39c386162de49aca92dbebee7f06ace" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8d4657116f948038a0c73018238c3ba"
I20260709 13:09:23.657253 24237 raft_consensus.cc:2393] T 662a938528e545e6aa4592052da18101 P f8d4657116f948038a0c73018238c3ba [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b39c386162de49aca92dbebee7f06ace in current term 2: Already voted for candidate f8d4657116f948038a0c73018238c3ba in this term.
I20260709 13:09:23.658998 24308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f735173e22b242178edcdf4821b6f92b" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace" is_pre_election: true
I20260709 13:09:23.659797 24308 raft_consensus.cc:2468] T f735173e22b242178edcdf4821b6f92b P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8d4657116f948038a0c73018238c3ba in term 1.
I20260709 13:09:23.660939 24923 raft_consensus.cc:493] T 5a8830d169ce4e46807d04168c3bb086 P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dea34817fcc148d78f090ef5fa72304f)
I20260709 13:09:23.661963 24918 leader_election.cc:290] T e6f709868be149759ecdc073fe125bec P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 2 election: Requested vote from peers dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343), f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171)
I20260709 13:09:23.662899 24204 leader_election.cc:304] T f735173e22b242178edcdf4821b6f92b P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b39c386162de49aca92dbebee7f06ace, f8d4657116f948038a0c73018238c3ba; no voters: 
I20260709 13:09:23.661684 24923 raft_consensus.cc:515] T 5a8830d169ce4e46807d04168c3bb086 P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:23.664288 24906 raft_consensus.cc:2804] T f735173e22b242178edcdf4821b6f92b P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:23.664810 24906 raft_consensus.cc:493] T f735173e22b242178edcdf4821b6f92b P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Starting leader election (detected failure of leader dea34817fcc148d78f090ef5fa72304f)
I20260709 13:09:23.665338 24906 raft_consensus.cc:3060] T f735173e22b242178edcdf4821b6f92b P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:23.667210 24132 leader_election.cc:336] T e6f709868be149759ecdc073fe125bec P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Network error: Client connection negotiation failed: client connection to 127.14.180.65:36343: connect: Connection refused (error 111)
I20260709 13:09:23.667445 24161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8830d169ce4e46807d04168c3bb086" candidate_uuid: "b39c386162de49aca92dbebee7f06ace" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" is_pre_election: true
I20260709 13:09:23.668550 24238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f709868be149759ecdc073fe125bec" candidate_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8d4657116f948038a0c73018238c3ba"
I20260709 13:09:23.669299 24238 raft_consensus.cc:3060] T e6f709868be149759ecdc073fe125bec P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:23.672955 24280 leader_election.cc:336] T 5a8830d169ce4e46807d04168c3bb086 P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Network error: Client connection negotiation failed: client connection to 127.14.180.65:36343: connect: Connection refused (error 111)
I20260709 13:09:23.673523 24280 leader_election.cc:304] T 5a8830d169ce4e46807d04168c3bb086 P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b39c386162de49aca92dbebee7f06ace; no voters: c0f503bf8bb94af8a2a1139db4e1c0f5, dea34817fcc148d78f090ef5fa72304f
I20260709 13:09:23.674559 24613 raft_consensus.cc:2749] T 5a8830d169ce4e46807d04168c3bb086 P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:23.676209 24906 raft_consensus.cc:515] T f735173e22b242178edcdf4821b6f92b P f8d4657116f948038a0c73018238c3ba [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:23.679571 24906 leader_election.cc:290] T f735173e22b242178edcdf4821b6f92b P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 2 election: Requested vote from peers b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561), dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343)
I20260709 13:09:23.679662 24308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f735173e22b242178edcdf4821b6f92b" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace"
I20260709 13:09:23.681360 24308 raft_consensus.cc:3060] T f735173e22b242178edcdf4821b6f92b P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:23.682327 24924 raft_consensus.cc:493] T 2dbbcd71c86041ba949fac653102e076 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dea34817fcc148d78f090ef5fa72304f)
I20260709 13:09:23.683043 24924 raft_consensus.cc:515] T 2dbbcd71c86041ba949fac653102e076 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:23.686436 24313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbbcd71c86041ba949fac653102e076" candidate_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace" is_pre_election: true
I20260709 13:09:23.687168 24313 raft_consensus.cc:2468] T 2dbbcd71c86041ba949fac653102e076 P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0f503bf8bb94af8a2a1139db4e1c0f5 in term 1.
I20260709 13:09:23.688735 24130 leader_election.cc:304] T 2dbbcd71c86041ba949fac653102e076 P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b39c386162de49aca92dbebee7f06ace, c0f503bf8bb94af8a2a1139db4e1c0f5; no voters: 
I20260709 13:09:23.690052 24772 raft_consensus.cc:2804] T 2dbbcd71c86041ba949fac653102e076 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:23.690470 24772 raft_consensus.cc:493] T 2dbbcd71c86041ba949fac653102e076 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader dea34817fcc148d78f090ef5fa72304f)
I20260709 13:09:23.691054 24772 raft_consensus.cc:3060] T 2dbbcd71c86041ba949fac653102e076 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:23.693075 24308 raft_consensus.cc:2468] T f735173e22b242178edcdf4821b6f92b P b39c386162de49aca92dbebee7f06ace [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8d4657116f948038a0c73018238c3ba in term 2.
I20260709 13:09:23.694682 24204 leader_election.cc:304] T f735173e22b242178edcdf4821b6f92b P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b39c386162de49aca92dbebee7f06ace, f8d4657116f948038a0c73018238c3ba; no voters: 
I20260709 13:09:23.695479 24802 leader_election.cc:290] T 662a938528e545e6aa4592052da18101 P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 2 election: Requested vote from peers f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171), dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343)
I20260709 13:09:23.669195 24923 leader_election.cc:290] T 5a8830d169ce4e46807d04168c3bb086 P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431), dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343)
I20260709 13:09:23.700112 24924 leader_election.cc:290] T 2dbbcd71c86041ba949fac653102e076 P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561), dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343)
I20260709 13:09:23.701539 24924 raft_consensus.cc:493] T 1541f6b04d914d10823ad78c03d9a847 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dea34817fcc148d78f090ef5fa72304f)
I20260709 13:09:23.702229 24924 raft_consensus.cc:515] T 1541f6b04d914d10823ad78c03d9a847 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:23.705538 24308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1541f6b04d914d10823ad78c03d9a847" candidate_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace" is_pre_election: true
I20260709 13:09:23.706257 24308 raft_consensus.cc:2468] T 1541f6b04d914d10823ad78c03d9a847 P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0f503bf8bb94af8a2a1139db4e1c0f5 in term 1.
W20260709 13:09:23.706794 24132 leader_election.cc:336] T 2dbbcd71c86041ba949fac653102e076 P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Network error: Client connection negotiation failed: client connection to 127.14.180.65:36343: connect: Connection refused (error 111)
I20260709 13:09:23.707351 24130 leader_election.cc:304] T 1541f6b04d914d10823ad78c03d9a847 P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b39c386162de49aca92dbebee7f06ace, c0f503bf8bb94af8a2a1139db4e1c0f5; no voters: 
I20260709 13:09:23.708189 24926 raft_consensus.cc:2804] T 1541f6b04d914d10823ad78c03d9a847 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:09:23.709061 24280 leader_election.cc:336] T 662a938528e545e6aa4592052da18101 P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Network error: Client connection negotiation failed: client connection to 127.14.180.65:36343: connect: Connection refused (error 111)
I20260709 13:09:23.709774 24280 leader_election.cc:304] T 662a938528e545e6aa4592052da18101 P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b39c386162de49aca92dbebee7f06ace; no voters: dea34817fcc148d78f090ef5fa72304f, f8d4657116f948038a0c73018238c3ba
I20260709 13:09:23.708710 24926 raft_consensus.cc:493] T 1541f6b04d914d10823ad78c03d9a847 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader dea34817fcc148d78f090ef5fa72304f)
I20260709 13:09:23.711359 24926 raft_consensus.cc:3060] T 1541f6b04d914d10823ad78c03d9a847 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:23.711545 24912 raft_consensus.cc:2804] T f735173e22b242178edcdf4821b6f92b P f8d4657116f948038a0c73018238c3ba [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:23.714695 24923 raft_consensus.cc:2749] T 662a938528e545e6aa4592052da18101 P b39c386162de49aca92dbebee7f06ace [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:09:23.718704 24132 leader_election.cc:336] T 1541f6b04d914d10823ad78c03d9a847 P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Network error: Client connection negotiation failed: client connection to 127.14.180.65:36343: connect: Connection refused (error 111)
I20260709 13:09:23.719012 24238 raft_consensus.cc:2468] T e6f709868be149759ecdc073fe125bec P f8d4657116f948038a0c73018238c3ba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0f503bf8bb94af8a2a1139db4e1c0f5 in term 2.
I20260709 13:09:23.712354 24912 raft_consensus.cc:697] T f735173e22b242178edcdf4821b6f92b P f8d4657116f948038a0c73018238c3ba [term 2 LEADER]: Becoming Leader. State: Replica: f8d4657116f948038a0c73018238c3ba, State: Running, Role: LEADER
I20260709 13:09:23.720541 24131 leader_election.cc:304] T e6f709868be149759ecdc073fe125bec P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c0f503bf8bb94af8a2a1139db4e1c0f5, f8d4657116f948038a0c73018238c3ba; no voters: dea34817fcc148d78f090ef5fa72304f
I20260709 13:09:23.721007 24912 consensus_queue.cc:237] T f735173e22b242178edcdf4821b6f92b P f8d4657116f948038a0c73018238c3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:23.721833 24918 raft_consensus.cc:2804] T e6f709868be149759ecdc073fe125bec P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:23.722903 24918 raft_consensus.cc:697] T e6f709868be149759ecdc073fe125bec P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 2 LEADER]: Becoming Leader. State: Replica: c0f503bf8bb94af8a2a1139db4e1c0f5, State: Running, Role: LEADER
I20260709 13:09:23.725178 24772 raft_consensus.cc:515] T 2dbbcd71c86041ba949fac653102e076 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:23.728302 24918 consensus_queue.cc:237] T e6f709868be149759ecdc073fe125bec P c0f503bf8bb94af8a2a1139db4e1c0f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:23.729719 24926 raft_consensus.cc:515] T 1541f6b04d914d10823ad78c03d9a847 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:23.705701 24924 leader_election.cc:290] T 1541f6b04d914d10823ad78c03d9a847 P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561), dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343)
I20260709 13:09:23.739140 24906 raft_consensus.cc:493] T 42868db4862647c28215f3d7cb9adf02 P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dea34817fcc148d78f090ef5fa72304f)
I20260709 13:09:23.739722 24308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1541f6b04d914d10823ad78c03d9a847" candidate_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace"
I20260709 13:09:23.739886 24906 raft_consensus.cc:515] T 42868db4862647c28215f3d7cb9adf02 P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:23.741256 24206 leader_election.cc:304] T ee2c640a38d44afebd95dfec0e30b0d6 P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c0f503bf8bb94af8a2a1139db4e1c0f5, f8d4657116f948038a0c73018238c3ba; no voters: dea34817fcc148d78f090ef5fa72304f
I20260709 13:09:23.740367 24308 raft_consensus.cc:3060] T 1541f6b04d914d10823ad78c03d9a847 P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:23.742463 24906 leader_election.cc:290] T 42868db4862647c28215f3d7cb9adf02 P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561), dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343)
I20260709 13:09:23.743314 24313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42868db4862647c28215f3d7cb9adf02" candidate_uuid: "f8d4657116f948038a0c73018238c3ba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace" is_pre_election: true
I20260709 13:09:23.745749 24805 raft_consensus.cc:2804] T ee2c640a38d44afebd95dfec0e30b0d6 P f8d4657116f948038a0c73018238c3ba [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:23.746351 24805 raft_consensus.cc:697] T ee2c640a38d44afebd95dfec0e30b0d6 P f8d4657116f948038a0c73018238c3ba [term 2 LEADER]: Becoming Leader. State: Replica: f8d4657116f948038a0c73018238c3ba, State: Running, Role: LEADER
I20260709 13:09:23.747426 24313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbbcd71c86041ba949fac653102e076" candidate_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace"
I20260709 13:09:23.755359 24805 consensus_queue.cc:237] T ee2c640a38d44afebd95dfec0e30b0d6 P f8d4657116f948038a0c73018238c3ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:23.755487 24313 raft_consensus.cc:3060] T 2dbbcd71c86041ba949fac653102e076 P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:23.760102 24206 leader_election.cc:336] T 662a938528e545e6aa4592052da18101 P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Network error: Client connection negotiation failed: client connection to 127.14.180.65:36343: connect: Connection refused (error 111)
I20260709 13:09:23.760955 24206 leader_election.cc:304] T 662a938528e545e6aa4592052da18101 P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8d4657116f948038a0c73018238c3ba; no voters: b39c386162de49aca92dbebee7f06ace, dea34817fcc148d78f090ef5fa72304f
I20260709 13:09:23.761694 24907 raft_consensus.cc:2749] T 662a938528e545e6aa4592052da18101 P f8d4657116f948038a0c73018238c3ba [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:09:23.761925 24206 leader_election.cc:336] T e6f709868be149759ecdc073fe125bec P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Network error: Client connection negotiation failed: client connection to 127.14.180.65:36343: connect: Connection refused (error 111)
I20260709 13:09:23.752731 24308 raft_consensus.cc:2468] T 1541f6b04d914d10823ad78c03d9a847 P b39c386162de49aca92dbebee7f06ace [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0f503bf8bb94af8a2a1139db4e1c0f5 in term 2.
W20260709 13:09:23.752933 24132 leader_election.cc:336] T 1541f6b04d914d10823ad78c03d9a847 P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Network error: Client connection negotiation failed: client connection to 127.14.180.65:36343: connect: Connection refused (error 111)
I20260709 13:09:23.771261 24130 leader_election.cc:304] T 1541f6b04d914d10823ad78c03d9a847 P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b39c386162de49aca92dbebee7f06ace, c0f503bf8bb94af8a2a1139db4e1c0f5; no voters: dea34817fcc148d78f090ef5fa72304f
I20260709 13:09:23.773154 24910 raft_consensus.cc:2804] T 1541f6b04d914d10823ad78c03d9a847 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:23.773710 24910 raft_consensus.cc:697] T 1541f6b04d914d10823ad78c03d9a847 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 2 LEADER]: Becoming Leader. State: Replica: c0f503bf8bb94af8a2a1139db4e1c0f5, State: Running, Role: LEADER
I20260709 13:09:23.762447 24206 leader_election.cc:304] T e6f709868be149759ecdc073fe125bec P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8d4657116f948038a0c73018238c3ba; no voters: c0f503bf8bb94af8a2a1139db4e1c0f5, dea34817fcc148d78f090ef5fa72304f
I20260709 13:09:23.775102 24906 raft_consensus.cc:2749] T e6f709868be149759ecdc073fe125bec P f8d4657116f948038a0c73018238c3ba [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:23.774664 24910 consensus_queue.cc:237] T 1541f6b04d914d10823ad78c03d9a847 P c0f503bf8bb94af8a2a1139db4e1c0f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:23.774217 24921 tablet_bootstrap.cc:492] T 2dbbcd71c86041ba949fac653102e076 P dea34817fcc148d78f090ef5fa72304f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:23.746061 24926 leader_election.cc:290] T 1541f6b04d914d10823ad78c03d9a847 P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 2 election: Requested vote from peers b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561), dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343)
I20260709 13:09:23.782388 24921 tablet_bootstrap.cc:492] T 2dbbcd71c86041ba949fac653102e076 P dea34817fcc148d78f090ef5fa72304f: Bootstrap complete.
W20260709 13:09:23.773159 24132 leader_election.cc:336] T 2dbbcd71c86041ba949fac653102e076 P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Network error: Client connection negotiation failed: client connection to 127.14.180.65:36343: connect: Connection refused (error 111)
I20260709 13:09:23.783349 24921 ts_tablet_manager.cc:1403] T 2dbbcd71c86041ba949fac653102e076 P dea34817fcc148d78f090ef5fa72304f: Time spent bootstrapping tablet: real 0.265s	user 0.066s	sys 0.043s
I20260709 13:09:23.792644 24313 raft_consensus.cc:2468] T 2dbbcd71c86041ba949fac653102e076 P b39c386162de49aca92dbebee7f06ace [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0f503bf8bb94af8a2a1139db4e1c0f5 in term 2.
I20260709 13:09:23.795710 24921 raft_consensus.cc:359] T 2dbbcd71c86041ba949fac653102e076 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:23.797744 24921 raft_consensus.cc:740] T 2dbbcd71c86041ba949fac653102e076 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: dea34817fcc148d78f090ef5fa72304f, State: Initialized, Role: FOLLOWER
I20260709 13:09:23.798604 24921 consensus_queue.cc:260] T 2dbbcd71c86041ba949fac653102e076 P dea34817fcc148d78f090ef5fa72304f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
W20260709 13:09:23.796262 24206 leader_election.cc:336] T f735173e22b242178edcdf4821b6f92b P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Network error: Client connection negotiation failed: client connection to 127.14.180.65:36343: connect: Connection refused (error 111)
I20260709 13:09:23.800987 24921 ts_tablet_manager.cc:1434] T 2dbbcd71c86041ba949fac653102e076 P dea34817fcc148d78f090ef5fa72304f: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 13:09:23.746749 24772 leader_election.cc:290] T 2dbbcd71c86041ba949fac653102e076 P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 2 election: Requested vote from peers b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561), dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343)
I20260709 13:09:23.809224 24130 leader_election.cc:304] T 2dbbcd71c86041ba949fac653102e076 P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b39c386162de49aca92dbebee7f06ace, c0f503bf8bb94af8a2a1139db4e1c0f5; no voters: dea34817fcc148d78f090ef5fa72304f
W20260709 13:09:23.807346 24206 leader_election.cc:336] T f735173e22b242178edcdf4821b6f92b P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Network error: Client connection negotiation failed: client connection to 127.14.180.65:36343: connect: Connection refused (error 111)
I20260709 13:09:23.810993 24613 raft_consensus.cc:493] T 42868db4862647c28215f3d7cb9adf02 P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dea34817fcc148d78f090ef5fa72304f)
I20260709 13:09:23.811704 24613 raft_consensus.cc:515] T 42868db4862647c28215f3d7cb9adf02 P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:23.807701 24921 tablet_bootstrap.cc:492] T b1d1d7dd508b43489431371c4ece4fa4 P dea34817fcc148d78f090ef5fa72304f: Bootstrap starting.
I20260709 13:09:23.813855 24613 leader_election.cc:290] T 42868db4862647c28215f3d7cb9adf02 P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171), dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343)
I20260709 13:09:23.815801 24238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42868db4862647c28215f3d7cb9adf02" candidate_uuid: "b39c386162de49aca92dbebee7f06ace" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8d4657116f948038a0c73018238c3ba" is_pre_election: true
I20260709 13:09:23.816591 24238 raft_consensus.cc:2468] T 42868db4862647c28215f3d7cb9adf02 P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b39c386162de49aca92dbebee7f06ace in term 1.
I20260709 13:09:23.820340 24279 leader_election.cc:304] T 42868db4862647c28215f3d7cb9adf02 P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b39c386162de49aca92dbebee7f06ace, f8d4657116f948038a0c73018238c3ba; no voters: 
W20260709 13:09:23.826094 24280 leader_election.cc:336] T 42868db4862647c28215f3d7cb9adf02 P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Network error: Client connection negotiation failed: client connection to 127.14.180.65:36343: connect: Connection refused (error 111)
I20260709 13:09:23.826784 24918 raft_consensus.cc:2804] T 2dbbcd71c86041ba949fac653102e076 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:23.827430 24918 raft_consensus.cc:697] T 2dbbcd71c86041ba949fac653102e076 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 2 LEADER]: Becoming Leader. State: Replica: c0f503bf8bb94af8a2a1139db4e1c0f5, State: Running, Role: LEADER
I20260709 13:09:23.828445 24918 consensus_queue.cc:237] T 2dbbcd71c86041ba949fac653102e076 P c0f503bf8bb94af8a2a1139db4e1c0f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:23.829187 24934 raft_consensus.cc:2804] T 42868db4862647c28215f3d7cb9adf02 P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:23.829704 24934 raft_consensus.cc:493] T 42868db4862647c28215f3d7cb9adf02 P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Starting leader election (detected failure of leader dea34817fcc148d78f090ef5fa72304f)
I20260709 13:09:23.830070 24934 raft_consensus.cc:3060] T 42868db4862647c28215f3d7cb9adf02 P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:23.839980 24206 leader_election.cc:336] T 42868db4862647c28215f3d7cb9adf02 P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Network error: Client connection negotiation failed: client connection to 127.14.180.65:36343: connect: Connection refused (error 111)
I20260709 13:09:23.840572 24206 leader_election.cc:304] T 42868db4862647c28215f3d7cb9adf02 P f8d4657116f948038a0c73018238c3ba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f8d4657116f948038a0c73018238c3ba; no voters: b39c386162de49aca92dbebee7f06ace, dea34817fcc148d78f090ef5fa72304f
I20260709 13:09:23.841364 24805 raft_consensus.cc:2749] T 42868db4862647c28215f3d7cb9adf02 P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:23.841017 23985 catalog_manager.cc:5697] T f735173e22b242178edcdf4821b6f92b P f8d4657116f948038a0c73018238c3ba reported cstate change: term changed from 1 to 2, leader changed from dea34817fcc148d78f090ef5fa72304f (127.14.180.65) to f8d4657116f948038a0c73018238c3ba (127.14.180.67). New cstate: current_term: 2 leader_uuid: "f8d4657116f948038a0c73018238c3ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:23.853642 24924 raft_consensus.cc:493] T 5a8830d169ce4e46807d04168c3bb086 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dea34817fcc148d78f090ef5fa72304f)
I20260709 13:09:23.859094 24924 raft_consensus.cc:515] T 5a8830d169ce4e46807d04168c3bb086 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:23.858294 23987 catalog_manager.cc:5697] T e6f709868be149759ecdc073fe125bec P c0f503bf8bb94af8a2a1139db4e1c0f5 reported cstate change: term changed from 1 to 2, leader changed from dea34817fcc148d78f090ef5fa72304f (127.14.180.65) to c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66). New cstate: current_term: 2 leader_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:23.861382 24924 leader_election.cc:290] T 5a8830d169ce4e46807d04168c3bb086 P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343), b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561)
W20260709 13:09:23.868607 24132 leader_election.cc:336] T 5a8830d169ce4e46807d04168c3bb086 P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Network error: Client connection negotiation failed: client connection to 127.14.180.65:36343: connect: Connection refused (error 111)
I20260709 13:09:23.862125 23987 catalog_manager.cc:5697] T 1541f6b04d914d10823ad78c03d9a847 P c0f503bf8bb94af8a2a1139db4e1c0f5 reported cstate change: term changed from 1 to 2, leader changed from dea34817fcc148d78f090ef5fa72304f (127.14.180.65) to c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66). New cstate: current_term: 2 leader_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } health_report { overall_health: HEALTHY } } }
W20260709 13:09:23.881699 24132 consensus_peers.cc:597] T 03e06f957f794ca696ddc7207eeabff0 P c0f503bf8bb94af8a2a1139db4e1c0f5 -> Peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Couldn't send request to peer dea34817fcc148d78f090ef5fa72304f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:36343: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:23.880523 24308 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8830d169ce4e46807d04168c3bb086" candidate_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace" is_pre_election: true
I20260709 13:09:23.884902 24308 raft_consensus.cc:2468] T 5a8830d169ce4e46807d04168c3bb086 P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0f503bf8bb94af8a2a1139db4e1c0f5 in term 1.
I20260709 13:09:23.921362 24130 leader_election.cc:304] T 5a8830d169ce4e46807d04168c3bb086 P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b39c386162de49aca92dbebee7f06ace, c0f503bf8bb94af8a2a1139db4e1c0f5; no voters: dea34817fcc148d78f090ef5fa72304f
I20260709 13:09:23.924399 24910 raft_consensus.cc:2804] T 5a8830d169ce4e46807d04168c3bb086 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:23.924942 24910 raft_consensus.cc:493] T 5a8830d169ce4e46807d04168c3bb086 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader dea34817fcc148d78f090ef5fa72304f)
I20260709 13:09:23.925388 24910 raft_consensus.cc:3060] T 5a8830d169ce4e46807d04168c3bb086 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:23.929320 24934 raft_consensus.cc:515] T 42868db4862647c28215f3d7cb9adf02 P b39c386162de49aca92dbebee7f06ace [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:23.974012 24237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42868db4862647c28215f3d7cb9adf02" candidate_uuid: "b39c386162de49aca92dbebee7f06ace" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8d4657116f948038a0c73018238c3ba"
I20260709 13:09:23.974766 24237 raft_consensus.cc:3060] T 42868db4862647c28215f3d7cb9adf02 P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:23.979681 24921 tablet_bootstrap.cc:492] T b1d1d7dd508b43489431371c4ece4fa4 P dea34817fcc148d78f090ef5fa72304f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:23.983654 24921 tablet_bootstrap.cc:492] T b1d1d7dd508b43489431371c4ece4fa4 P dea34817fcc148d78f090ef5fa72304f: Bootstrap complete.
I20260709 13:09:23.984524 24921 ts_tablet_manager.cc:1403] T b1d1d7dd508b43489431371c4ece4fa4 P dea34817fcc148d78f090ef5fa72304f: Time spent bootstrapping tablet: real 0.177s	user 0.054s	sys 0.031s
I20260709 13:09:23.987141 24934 leader_election.cc:290] T 42868db4862647c28215f3d7cb9adf02 P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 2 election: Requested vote from peers f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171), dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343)
I20260709 13:09:23.987299 24237 raft_consensus.cc:2468] T 42868db4862647c28215f3d7cb9adf02 P f8d4657116f948038a0c73018238c3ba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b39c386162de49aca92dbebee7f06ace in term 2.
I20260709 13:09:23.971026 24238 raft_consensus.cc:1275] T 03e06f957f794ca696ddc7207eeabff0 P f8d4657116f948038a0c73018238c3ba [term 2 FOLLOWER]: Refusing update from remote peer c0f503bf8bb94af8a2a1139db4e1c0f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:23.966928 23985 catalog_manager.cc:5697] T ee2c640a38d44afebd95dfec0e30b0d6 P f8d4657116f948038a0c73018238c3ba reported cstate change: term changed from 1 to 2, leader changed from dea34817fcc148d78f090ef5fa72304f (127.14.180.65) to f8d4657116f948038a0c73018238c3ba (127.14.180.67). New cstate: current_term: 2 leader_uuid: "f8d4657116f948038a0c73018238c3ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:23.991148 24921 raft_consensus.cc:359] T b1d1d7dd508b43489431371c4ece4fa4 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:23.992089 24921 raft_consensus.cc:740] T b1d1d7dd508b43489431371c4ece4fa4 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: dea34817fcc148d78f090ef5fa72304f, State: Initialized, Role: FOLLOWER
I20260709 13:09:23.994078 24921 consensus_queue.cc:260] T b1d1d7dd508b43489431371c4ece4fa4 P dea34817fcc148d78f090ef5fa72304f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:23.996464 24921 ts_tablet_manager.cc:1434] T b1d1d7dd508b43489431371c4ece4fa4 P dea34817fcc148d78f090ef5fa72304f: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 13:09:23.996863 24772 consensus_queue.cc:1048] T 03e06f957f794ca696ddc7207eeabff0 P c0f503bf8bb94af8a2a1139db4e1c0f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:23.997583 24921 tablet_bootstrap.cc:492] T 7da69453741f4b73a0092f56f29b1000 P dea34817fcc148d78f090ef5fa72304f: Bootstrap starting.
I20260709 13:09:24.001900 24279 leader_election.cc:304] T 42868db4862647c28215f3d7cb9adf02 P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b39c386162de49aca92dbebee7f06ace, f8d4657116f948038a0c73018238c3ba; no voters: 
I20260709 13:09:24.002941 24613 raft_consensus.cc:2804] T 42868db4862647c28215f3d7cb9adf02 P b39c386162de49aca92dbebee7f06ace [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:24.003453 24613 raft_consensus.cc:697] T 42868db4862647c28215f3d7cb9adf02 P b39c386162de49aca92dbebee7f06ace [term 2 LEADER]: Becoming Leader. State: Replica: b39c386162de49aca92dbebee7f06ace, State: Running, Role: LEADER
I20260709 13:09:24.004359 24613 consensus_queue.cc:237] T 42868db4862647c28215f3d7cb9adf02 P b39c386162de49aca92dbebee7f06ace [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
W20260709 13:09:24.019023 24280 leader_election.cc:336] T 42868db4862647c28215f3d7cb9adf02 P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Network error: Client connection negotiation failed: client connection to 127.14.180.65:36343: connect: Connection refused (error 111)
I20260709 13:09:24.022987 24921 tablet_bootstrap.cc:492] T 7da69453741f4b73a0092f56f29b1000 P dea34817fcc148d78f090ef5fa72304f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:24.024278 24921 tablet_bootstrap.cc:492] T 7da69453741f4b73a0092f56f29b1000 P dea34817fcc148d78f090ef5fa72304f: Bootstrap complete.
I20260709 13:09:24.026213 24921 ts_tablet_manager.cc:1403] T 7da69453741f4b73a0092f56f29b1000 P dea34817fcc148d78f090ef5fa72304f: Time spent bootstrapping tablet: real 0.029s	user 0.021s	sys 0.004s
I20260709 13:09:24.009652 24910 raft_consensus.cc:515] T 5a8830d169ce4e46807d04168c3bb086 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:24.030042 24921 raft_consensus.cc:359] T 7da69453741f4b73a0092f56f29b1000 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:24.030893 24921 raft_consensus.cc:740] T 7da69453741f4b73a0092f56f29b1000 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: dea34817fcc148d78f090ef5fa72304f, State: Initialized, Role: FOLLOWER
I20260709 13:09:24.032001 24921 consensus_queue.cc:260] T 7da69453741f4b73a0092f56f29b1000 P dea34817fcc148d78f090ef5fa72304f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:24.034669 24921 ts_tablet_manager.cc:1434] T 7da69453741f4b73a0092f56f29b1000 P dea34817fcc148d78f090ef5fa72304f: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:09:24.035787 24921 tablet_bootstrap.cc:492] T 49393e5cc2614c90b69a3bb2348dacb9 P dea34817fcc148d78f090ef5fa72304f: Bootstrap starting.
I20260709 13:09:24.042541 23985 catalog_manager.cc:5697] T 2dbbcd71c86041ba949fac653102e076 P c0f503bf8bb94af8a2a1139db4e1c0f5 reported cstate change: term changed from 1 to 2, leader changed from dea34817fcc148d78f090ef5fa72304f (127.14.180.65) to c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66). New cstate: current_term: 2 leader_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:24.047688 24311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a8830d169ce4e46807d04168c3bb086" candidate_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace"
I20260709 13:09:24.048477 24311 raft_consensus.cc:3060] T 5a8830d169ce4e46807d04168c3bb086 P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:24.060315 24910 leader_election.cc:290] T 5a8830d169ce4e46807d04168c3bb086 P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 2 election: Requested vote from peers dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343), b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561)
I20260709 13:09:24.060920 24921 tablet_bootstrap.cc:492] T 49393e5cc2614c90b69a3bb2348dacb9 P dea34817fcc148d78f090ef5fa72304f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:24.065104 24921 tablet_bootstrap.cc:492] T 49393e5cc2614c90b69a3bb2348dacb9 P dea34817fcc148d78f090ef5fa72304f: Bootstrap complete.
I20260709 13:09:24.065903 24921 ts_tablet_manager.cc:1403] T 49393e5cc2614c90b69a3bb2348dacb9 P dea34817fcc148d78f090ef5fa72304f: Time spent bootstrapping tablet: real 0.030s	user 0.014s	sys 0.010s
W20260709 13:09:24.067663 24132 leader_election.cc:336] T 5a8830d169ce4e46807d04168c3bb086 P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Network error: Client connection negotiation failed: client connection to 127.14.180.65:36343: connect: Connection refused (error 111)
I20260709 13:09:24.068914 24921 raft_consensus.cc:359] T 49393e5cc2614c90b69a3bb2348dacb9 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:24.069767 24921 raft_consensus.cc:740] T 49393e5cc2614c90b69a3bb2348dacb9 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: dea34817fcc148d78f090ef5fa72304f, State: Initialized, Role: FOLLOWER
I20260709 13:09:24.073227 24311 raft_consensus.cc:2468] T 5a8830d169ce4e46807d04168c3bb086 P b39c386162de49aca92dbebee7f06ace [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0f503bf8bb94af8a2a1139db4e1c0f5 in term 2.
I20260709 13:09:24.084522 24130 leader_election.cc:304] T 5a8830d169ce4e46807d04168c3bb086 P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b39c386162de49aca92dbebee7f06ace, c0f503bf8bb94af8a2a1139db4e1c0f5; no voters: dea34817fcc148d78f090ef5fa72304f
I20260709 13:09:24.085361 24910 raft_consensus.cc:2804] T 5a8830d169ce4e46807d04168c3bb086 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:24.070549 24921 consensus_queue.cc:260] T 49393e5cc2614c90b69a3bb2348dacb9 P dea34817fcc148d78f090ef5fa72304f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:24.086808 24910 raft_consensus.cc:697] T 5a8830d169ce4e46807d04168c3bb086 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 2 LEADER]: Becoming Leader. State: Replica: c0f503bf8bb94af8a2a1139db4e1c0f5, State: Running, Role: LEADER
I20260709 13:09:24.088686 24921 ts_tablet_manager.cc:1434] T 49393e5cc2614c90b69a3bb2348dacb9 P dea34817fcc148d78f090ef5fa72304f: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.003s
I20260709 13:09:24.088533 24910 consensus_queue.cc:237] T 5a8830d169ce4e46807d04168c3bb086 P c0f503bf8bb94af8a2a1139db4e1c0f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:24.089627 24921 tablet_bootstrap.cc:492] T 03bfe46bf2b74722b6e8eb3015e38f43 P dea34817fcc148d78f090ef5fa72304f: Bootstrap starting.
I20260709 13:09:24.124868 24238 raft_consensus.cc:1275] T e6f709868be149759ecdc073fe125bec P f8d4657116f948038a0c73018238c3ba [term 2 FOLLOWER]: Refusing update from remote peer c0f503bf8bb94af8a2a1139db4e1c0f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:24.131916 24772 consensus_queue.cc:1048] T e6f709868be149759ecdc073fe125bec P c0f503bf8bb94af8a2a1139db4e1c0f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:24.139197 24921 tablet_bootstrap.cc:492] T 03bfe46bf2b74722b6e8eb3015e38f43 P dea34817fcc148d78f090ef5fa72304f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:24.140653 24921 tablet_bootstrap.cc:492] T 03bfe46bf2b74722b6e8eb3015e38f43 P dea34817fcc148d78f090ef5fa72304f: Bootstrap complete.
I20260709 13:09:24.141614 24921 ts_tablet_manager.cc:1403] T 03bfe46bf2b74722b6e8eb3015e38f43 P dea34817fcc148d78f090ef5fa72304f: Time spent bootstrapping tablet: real 0.052s	user 0.028s	sys 0.020s
I20260709 13:09:24.144838 24921 raft_consensus.cc:359] T 03bfe46bf2b74722b6e8eb3015e38f43 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:24.149085 24921 raft_consensus.cc:740] T 03bfe46bf2b74722b6e8eb3015e38f43 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: dea34817fcc148d78f090ef5fa72304f, State: Initialized, Role: FOLLOWER
I20260709 13:09:24.150135 24921 consensus_queue.cc:260] T 03bfe46bf2b74722b6e8eb3015e38f43 P dea34817fcc148d78f090ef5fa72304f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:24.153008 24921 ts_tablet_manager.cc:1434] T 03bfe46bf2b74722b6e8eb3015e38f43 P dea34817fcc148d78f090ef5fa72304f: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.001s
I20260709 13:09:24.154055 24921 tablet_bootstrap.cc:492] T 1541f6b04d914d10823ad78c03d9a847 P dea34817fcc148d78f090ef5fa72304f: Bootstrap starting.
I20260709 13:09:24.182219 24310 raft_consensus.cc:1275] T f735173e22b242178edcdf4821b6f92b P b39c386162de49aca92dbebee7f06ace [term 2 FOLLOWER]: Refusing update from remote peer f8d4657116f948038a0c73018238c3ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:24.186045 24906 consensus_queue.cc:1048] T f735173e22b242178edcdf4821b6f92b P f8d4657116f948038a0c73018238c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:24.189222 24921 tablet_bootstrap.cc:492] T 1541f6b04d914d10823ad78c03d9a847 P dea34817fcc148d78f090ef5fa72304f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:24.190426 24921 tablet_bootstrap.cc:492] T 1541f6b04d914d10823ad78c03d9a847 P dea34817fcc148d78f090ef5fa72304f: Bootstrap complete.
I20260709 13:09:24.191737 24921 ts_tablet_manager.cc:1403] T 1541f6b04d914d10823ad78c03d9a847 P dea34817fcc148d78f090ef5fa72304f: Time spent bootstrapping tablet: real 0.038s	user 0.025s	sys 0.000s
I20260709 13:09:24.194694 24313 raft_consensus.cc:1275] T 1541f6b04d914d10823ad78c03d9a847 P b39c386162de49aca92dbebee7f06ace [term 2 FOLLOWER]: Refusing update from remote peer c0f503bf8bb94af8a2a1139db4e1c0f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:24.216084 23987 catalog_manager.cc:5697] T 5a8830d169ce4e46807d04168c3bb086 P c0f503bf8bb94af8a2a1139db4e1c0f5 reported cstate change: term changed from 1 to 2, leader changed from dea34817fcc148d78f090ef5fa72304f (127.14.180.65) to c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66). New cstate: current_term: 2 leader_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:24.220633 24921 raft_consensus.cc:359] T 1541f6b04d914d10823ad78c03d9a847 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:24.225241 24921 raft_consensus.cc:740] T 1541f6b04d914d10823ad78c03d9a847 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: dea34817fcc148d78f090ef5fa72304f, State: Initialized, Role: FOLLOWER
I20260709 13:09:24.199352 24772 consensus_queue.cc:1048] T 1541f6b04d914d10823ad78c03d9a847 P c0f503bf8bb94af8a2a1139db4e1c0f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 13:09:24.226218 24921 consensus_queue.cc:260] T 1541f6b04d914d10823ad78c03d9a847 P dea34817fcc148d78f090ef5fa72304f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:24.228900 24921 ts_tablet_manager.cc:1434] T 1541f6b04d914d10823ad78c03d9a847 P dea34817fcc148d78f090ef5fa72304f: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.000s
I20260709 13:09:24.238399 24921 tablet_bootstrap.cc:492] T 687efb9bbbd04b0eb768bfa6543380c3 P dea34817fcc148d78f090ef5fa72304f: Bootstrap starting.
W20260709 13:09:24.229292 24132 consensus_peers.cc:597] T e6f709868be149759ecdc073fe125bec P c0f503bf8bb94af8a2a1139db4e1c0f5 -> Peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Couldn't send request to peer dea34817fcc148d78f090ef5fa72304f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:36343: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:24.243628 23985 catalog_manager.cc:5697] T 42868db4862647c28215f3d7cb9adf02 P b39c386162de49aca92dbebee7f06ace reported cstate change: term changed from 1 to 2, leader changed from dea34817fcc148d78f090ef5fa72304f (127.14.180.65) to b39c386162de49aca92dbebee7f06ace (127.14.180.68). New cstate: current_term: 2 leader_uuid: "b39c386162de49aca92dbebee7f06ace" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:24.276976 24161 raft_consensus.cc:1275] T ee2c640a38d44afebd95dfec0e30b0d6 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 2 FOLLOWER]: Refusing update from remote peer f8d4657116f948038a0c73018238c3ba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:24.288708 24805 consensus_queue.cc:1048] T ee2c640a38d44afebd95dfec0e30b0d6 P f8d4657116f948038a0c73018238c3ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:09:24.291605 24206 consensus_peers.cc:597] T f735173e22b242178edcdf4821b6f92b P f8d4657116f948038a0c73018238c3ba -> Peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Couldn't send request to peer dea34817fcc148d78f090ef5fa72304f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:36343: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:24.296542 15057 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 13:09:24.298079 15057 ts_tablet_manager.cc:595] Time spent register tablets: real 0.934s	user 0.360s	sys 0.001s
W20260709 13:09:24.307045 24132 consensus_peers.cc:597] T 1541f6b04d914d10823ad78c03d9a847 P c0f503bf8bb94af8a2a1139db4e1c0f5 -> Peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Couldn't send request to peer dea34817fcc148d78f090ef5fa72304f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:36343: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:24.313477 24308 raft_consensus.cc:1275] T 2dbbcd71c86041ba949fac653102e076 P b39c386162de49aca92dbebee7f06ace [term 2 FOLLOWER]: Refusing update from remote peer c0f503bf8bb94af8a2a1139db4e1c0f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:24.317864 24921 tablet_bootstrap.cc:492] T 687efb9bbbd04b0eb768bfa6543380c3 P dea34817fcc148d78f090ef5fa72304f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:24.318106 24910 consensus_queue.cc:1048] T 2dbbcd71c86041ba949fac653102e076 P c0f503bf8bb94af8a2a1139db4e1c0f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:24.319371 24921 tablet_bootstrap.cc:492] T 687efb9bbbd04b0eb768bfa6543380c3 P dea34817fcc148d78f090ef5fa72304f: Bootstrap complete.
I20260709 13:09:24.320405 24921 ts_tablet_manager.cc:1403] T 687efb9bbbd04b0eb768bfa6543380c3 P dea34817fcc148d78f090ef5fa72304f: Time spent bootstrapping tablet: real 0.082s	user 0.027s	sys 0.005s
I20260709 13:09:24.335786 24921 raft_consensus.cc:359] T 687efb9bbbd04b0eb768bfa6543380c3 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:24.336635 24921 raft_consensus.cc:740] T 687efb9bbbd04b0eb768bfa6543380c3 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: dea34817fcc148d78f090ef5fa72304f, State: Initialized, Role: FOLLOWER
I20260709 13:09:24.337667 24921 consensus_queue.cc:260] T 687efb9bbbd04b0eb768bfa6543380c3 P dea34817fcc148d78f090ef5fa72304f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:24.339838 24921 ts_tablet_manager.cc:1434] T 687efb9bbbd04b0eb768bfa6543380c3 P dea34817fcc148d78f090ef5fa72304f: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 13:09:24.340780 24921 tablet_bootstrap.cc:492] T 3bcebec1ac994b99a49430f4f892d615 P dea34817fcc148d78f090ef5fa72304f: Bootstrap starting.
W20260709 13:09:24.427449 24132 consensus_peers.cc:597] T 2dbbcd71c86041ba949fac653102e076 P c0f503bf8bb94af8a2a1139db4e1c0f5 -> Peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Couldn't send request to peer dea34817fcc148d78f090ef5fa72304f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:36343: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:24.480295 24921 tablet_bootstrap.cc:492] T 3bcebec1ac994b99a49430f4f892d615 P dea34817fcc148d78f090ef5fa72304f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:24.481787 24921 tablet_bootstrap.cc:492] T 3bcebec1ac994b99a49430f4f892d615 P dea34817fcc148d78f090ef5fa72304f: Bootstrap complete.
I20260709 13:09:24.482702 24921 ts_tablet_manager.cc:1403] T 3bcebec1ac994b99a49430f4f892d615 P dea34817fcc148d78f090ef5fa72304f: Time spent bootstrapping tablet: real 0.142s	user 0.034s	sys 0.011s
I20260709 13:09:24.485149 24237 raft_consensus.cc:1275] T 42868db4862647c28215f3d7cb9adf02 P f8d4657116f948038a0c73018238c3ba [term 2 FOLLOWER]: Refusing update from remote peer b39c386162de49aca92dbebee7f06ace: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:24.485827 24921 raft_consensus.cc:359] T 3bcebec1ac994b99a49430f4f892d615 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
W20260709 13:09:24.493549 24206 consensus_peers.cc:597] T ee2c640a38d44afebd95dfec0e30b0d6 P f8d4657116f948038a0c73018238c3ba -> Peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Couldn't send request to peer dea34817fcc148d78f090ef5fa72304f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:36343: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:24.500938 24934 consensus_queue.cc:1048] T 42868db4862647c28215f3d7cb9adf02 P b39c386162de49aca92dbebee7f06ace [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:24.493851 24921 raft_consensus.cc:740] T 3bcebec1ac994b99a49430f4f892d615 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: dea34817fcc148d78f090ef5fa72304f, State: Initialized, Role: FOLLOWER
I20260709 13:09:24.503486 24921 consensus_queue.cc:260] T 3bcebec1ac994b99a49430f4f892d615 P dea34817fcc148d78f090ef5fa72304f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:24.505944 24921 ts_tablet_manager.cc:1434] T 3bcebec1ac994b99a49430f4f892d615 P dea34817fcc148d78f090ef5fa72304f: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260709 13:09:24.507093 24921 tablet_bootstrap.cc:492] T f735173e22b242178edcdf4821b6f92b P dea34817fcc148d78f090ef5fa72304f: Bootstrap starting.
I20260709 13:09:24.533113 24921 tablet_bootstrap.cc:492] T f735173e22b242178edcdf4821b6f92b P dea34817fcc148d78f090ef5fa72304f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:24.534272 24921 tablet_bootstrap.cc:492] T f735173e22b242178edcdf4821b6f92b P dea34817fcc148d78f090ef5fa72304f: Bootstrap complete.
I20260709 13:09:24.535095 24921 ts_tablet_manager.cc:1403] T f735173e22b242178edcdf4821b6f92b P dea34817fcc148d78f090ef5fa72304f: Time spent bootstrapping tablet: real 0.028s	user 0.022s	sys 0.002s
I20260709 13:09:24.539497 24921 raft_consensus.cc:359] T f735173e22b242178edcdf4821b6f92b P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:24.540247 24921 raft_consensus.cc:740] T f735173e22b242178edcdf4821b6f92b P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: dea34817fcc148d78f090ef5fa72304f, State: Initialized, Role: FOLLOWER
I20260709 13:09:24.541091 24921 consensus_queue.cc:260] T f735173e22b242178edcdf4821b6f92b P dea34817fcc148d78f090ef5fa72304f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:24.543795 24921 ts_tablet_manager.cc:1434] T f735173e22b242178edcdf4821b6f92b P dea34817fcc148d78f090ef5fa72304f: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:09:24.544653 24921 tablet_bootstrap.cc:492] T 0dbd3426f3e14ef28e7b0b6c4c7de6a2 P dea34817fcc148d78f090ef5fa72304f: Bootstrap starting.
I20260709 13:09:24.577780 24921 tablet_bootstrap.cc:492] T 0dbd3426f3e14ef28e7b0b6c4c7de6a2 P dea34817fcc148d78f090ef5fa72304f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:24.578837 24921 tablet_bootstrap.cc:492] T 0dbd3426f3e14ef28e7b0b6c4c7de6a2 P dea34817fcc148d78f090ef5fa72304f: Bootstrap complete.
I20260709 13:09:24.579574 24921 ts_tablet_manager.cc:1403] T 0dbd3426f3e14ef28e7b0b6c4c7de6a2 P dea34817fcc148d78f090ef5fa72304f: Time spent bootstrapping tablet: real 0.035s	user 0.016s	sys 0.007s
I20260709 13:09:24.582250 24921 raft_consensus.cc:359] T 0dbd3426f3e14ef28e7b0b6c4c7de6a2 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:24.583052 24921 raft_consensus.cc:740] T 0dbd3426f3e14ef28e7b0b6c4c7de6a2 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: dea34817fcc148d78f090ef5fa72304f, State: Initialized, Role: FOLLOWER
I20260709 13:09:24.583899 24921 consensus_queue.cc:260] T 0dbd3426f3e14ef28e7b0b6c4c7de6a2 P dea34817fcc148d78f090ef5fa72304f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:24.586004 24921 ts_tablet_manager.cc:1434] T 0dbd3426f3e14ef28e7b0b6c4c7de6a2 P dea34817fcc148d78f090ef5fa72304f: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:09:24.587193 24921 tablet_bootstrap.cc:492] T e21ef2f479764142935dc2b1b7e87220 P dea34817fcc148d78f090ef5fa72304f: Bootstrap starting.
W20260709 13:09:24.607146 24132 consensus_peers.cc:597] T 687efb9bbbd04b0eb768bfa6543380c3 P c0f503bf8bb94af8a2a1139db4e1c0f5 -> Peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Couldn't send request to peer dea34817fcc148d78f090ef5fa72304f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:36343: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:24.610846 24132 consensus_peers.cc:597] T 03bfe46bf2b74722b6e8eb3015e38f43 P c0f503bf8bb94af8a2a1139db4e1c0f5 -> Peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Couldn't send request to peer dea34817fcc148d78f090ef5fa72304f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:36343: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:24.623983 24280 consensus_peers.cc:597] T 42868db4862647c28215f3d7cb9adf02 P b39c386162de49aca92dbebee7f06ace -> Peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Couldn't send request to peer dea34817fcc148d78f090ef5fa72304f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:36343: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:24.631373 24921 tablet_bootstrap.cc:492] T e21ef2f479764142935dc2b1b7e87220 P dea34817fcc148d78f090ef5fa72304f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:24.632599 24921 tablet_bootstrap.cc:492] T e21ef2f479764142935dc2b1b7e87220 P dea34817fcc148d78f090ef5fa72304f: Bootstrap complete.
I20260709 13:09:24.633445 24921 ts_tablet_manager.cc:1403] T e21ef2f479764142935dc2b1b7e87220 P dea34817fcc148d78f090ef5fa72304f: Time spent bootstrapping tablet: real 0.047s	user 0.017s	sys 0.009s
I20260709 13:09:24.636734 24921 raft_consensus.cc:359] T e21ef2f479764142935dc2b1b7e87220 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:24.637471 24921 raft_consensus.cc:740] T e21ef2f479764142935dc2b1b7e87220 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: dea34817fcc148d78f090ef5fa72304f, State: Initialized, Role: FOLLOWER
I20260709 13:09:24.638259 24921 consensus_queue.cc:260] T e21ef2f479764142935dc2b1b7e87220 P dea34817fcc148d78f090ef5fa72304f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:24.640872 24921 ts_tablet_manager.cc:1434] T e21ef2f479764142935dc2b1b7e87220 P dea34817fcc148d78f090ef5fa72304f: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:09:24.641793 24921 tablet_bootstrap.cc:492] T c9b7bd5d439d455a9173478e086439e8 P dea34817fcc148d78f090ef5fa72304f: Bootstrap starting.
W20260709 13:09:24.657895 24132 consensus_peers.cc:597] T 5a8830d169ce4e46807d04168c3bb086 P c0f503bf8bb94af8a2a1139db4e1c0f5 -> Peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Couldn't send request to peer dea34817fcc148d78f090ef5fa72304f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:36343: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:24.665452 24921 tablet_bootstrap.cc:492] T c9b7bd5d439d455a9173478e086439e8 P dea34817fcc148d78f090ef5fa72304f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:24.666838 24921 tablet_bootstrap.cc:492] T c9b7bd5d439d455a9173478e086439e8 P dea34817fcc148d78f090ef5fa72304f: Bootstrap complete.
I20260709 13:09:24.667402 24929 raft_consensus.cc:493] T f662efc86a73450cac065505b63cb883 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:24.668033 24929 raft_consensus.cc:515] T f662efc86a73450cac065505b63cb883 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:24.675021 24929 leader_election.cc:290] T f662efc86a73450cac065505b63cb883 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171), b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561)
W20260709 13:09:24.682215 24206 consensus_peers.cc:597] T de5786fbd53646a9bc152ac0a2a9aa53 P f8d4657116f948038a0c73018238c3ba -> Peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Couldn't send request to peer dea34817fcc148d78f090ef5fa72304f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:36343: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:24.679446 24921 ts_tablet_manager.cc:1403] T c9b7bd5d439d455a9173478e086439e8 P dea34817fcc148d78f090ef5fa72304f: Time spent bootstrapping tablet: real 0.038s	user 0.018s	sys 0.006s
I20260709 13:09:24.705255 24921 raft_consensus.cc:359] T c9b7bd5d439d455a9173478e086439e8 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:24.713625 24313 raft_consensus.cc:1275] T 5a8830d169ce4e46807d04168c3bb086 P b39c386162de49aca92dbebee7f06ace [term 2 FOLLOWER]: Refusing update from remote peer c0f503bf8bb94af8a2a1139db4e1c0f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:24.718205 24921 raft_consensus.cc:740] T c9b7bd5d439d455a9173478e086439e8 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: dea34817fcc148d78f090ef5fa72304f, State: Initialized, Role: FOLLOWER
I20260709 13:09:24.719370 24921 consensus_queue.cc:260] T c9b7bd5d439d455a9173478e086439e8 P dea34817fcc148d78f090ef5fa72304f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:24.720155 24943 consensus_queue.cc:1048] T 5a8830d169ce4e46807d04168c3bb086 P c0f503bf8bb94af8a2a1139db4e1c0f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:09:24.717509 24280 consensus_peers.cc:597] T 0dbd3426f3e14ef28e7b0b6c4c7de6a2 P b39c386162de49aca92dbebee7f06ace -> Peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Couldn't send request to peer dea34817fcc148d78f090ef5fa72304f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:36343: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:24.724545 24206 consensus_peers.cc:597] T b1d1d7dd508b43489431371c4ece4fa4 P f8d4657116f948038a0c73018238c3ba -> Peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Couldn't send request to peer dea34817fcc148d78f090ef5fa72304f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:36343: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:24.727628 24921 ts_tablet_manager.cc:1434] T c9b7bd5d439d455a9173478e086439e8 P dea34817fcc148d78f090ef5fa72304f: Time spent starting tablet: real 0.042s	user 0.007s	sys 0.000s
I20260709 13:09:24.728971 24921 tablet_bootstrap.cc:492] T 430894245c954e33b6586b4704c66b3c P dea34817fcc148d78f090ef5fa72304f: Bootstrap starting.
I20260709 13:09:24.741984 24311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f662efc86a73450cac065505b63cb883" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace" is_pre_election: true
I20260709 13:09:24.759858 24921 tablet_bootstrap.cc:492] T 430894245c954e33b6586b4704c66b3c P dea34817fcc148d78f090ef5fa72304f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:09:24.761067 24206 consensus_peers.cc:597] T 502fe798081f4dc693eed179efa2a241 P f8d4657116f948038a0c73018238c3ba -> Peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Couldn't send request to peer dea34817fcc148d78f090ef5fa72304f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:36343: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:24.761551 24921 tablet_bootstrap.cc:492] T 430894245c954e33b6586b4704c66b3c P dea34817fcc148d78f090ef5fa72304f: Bootstrap complete.
I20260709 13:09:24.762342 24921 ts_tablet_manager.cc:1403] T 430894245c954e33b6586b4704c66b3c P dea34817fcc148d78f090ef5fa72304f: Time spent bootstrapping tablet: real 0.034s	user 0.024s	sys 0.004s
I20260709 13:09:24.765259 24921 raft_consensus.cc:359] T 430894245c954e33b6586b4704c66b3c P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:24.766153 24921 raft_consensus.cc:740] T 430894245c954e33b6586b4704c66b3c P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: dea34817fcc148d78f090ef5fa72304f, State: Initialized, Role: FOLLOWER
I20260709 13:09:24.767231 24921 consensus_queue.cc:260] T 430894245c954e33b6586b4704c66b3c P dea34817fcc148d78f090ef5fa72304f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:24.771207 24921 ts_tablet_manager.cc:1434] T 430894245c954e33b6586b4704c66b3c P dea34817fcc148d78f090ef5fa72304f: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.003s
I20260709 13:09:24.772210 24921 tablet_bootstrap.cc:492] T 03e06f957f794ca696ddc7207eeabff0 P dea34817fcc148d78f090ef5fa72304f: Bootstrap starting.
W20260709 13:09:24.782631 24206 consensus_peers.cc:597] T 49393e5cc2614c90b69a3bb2348dacb9 P f8d4657116f948038a0c73018238c3ba -> Peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Couldn't send request to peer dea34817fcc148d78f090ef5fa72304f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:36343: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:24.798264 24921 tablet_bootstrap.cc:492] T 03e06f957f794ca696ddc7207eeabff0 P dea34817fcc148d78f090ef5fa72304f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:24.799827 24921 tablet_bootstrap.cc:492] T 03e06f957f794ca696ddc7207eeabff0 P dea34817fcc148d78f090ef5fa72304f: Bootstrap complete.
I20260709 13:09:24.800735 24921 ts_tablet_manager.cc:1403] T 03e06f957f794ca696ddc7207eeabff0 P dea34817fcc148d78f090ef5fa72304f: Time spent bootstrapping tablet: real 0.029s	user 0.021s	sys 0.004s
I20260709 13:09:24.803954 24921 raft_consensus.cc:359] T 03e06f957f794ca696ddc7207eeabff0 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:24.804771 24921 raft_consensus.cc:740] T 03e06f957f794ca696ddc7207eeabff0 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: dea34817fcc148d78f090ef5fa72304f, State: Initialized, Role: FOLLOWER
I20260709 13:09:24.805684 24921 consensus_queue.cc:260] T 03e06f957f794ca696ddc7207eeabff0 P dea34817fcc148d78f090ef5fa72304f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
W20260709 13:09:24.807519 24132 consensus_peers.cc:597] T e280ec3a0e394065aca766e4f8bef46d P c0f503bf8bb94af8a2a1139db4e1c0f5 -> Peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Couldn't send request to peer dea34817fcc148d78f090ef5fa72304f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:36343: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:24.808176 24921 ts_tablet_manager.cc:1434] T 03e06f957f794ca696ddc7207eeabff0 P dea34817fcc148d78f090ef5fa72304f: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:09:24.809115 24921 tablet_bootstrap.cc:492] T d17a6bbfc9d8478988b08964765c3b86 P dea34817fcc148d78f090ef5fa72304f: Bootstrap starting.
W20260709 13:09:24.816038 24206 consensus_peers.cc:597] T e21ef2f479764142935dc2b1b7e87220 P f8d4657116f948038a0c73018238c3ba -> Peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Couldn't send request to peer dea34817fcc148d78f090ef5fa72304f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:36343: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:24.839291 24238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f662efc86a73450cac065505b63cb883" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8d4657116f948038a0c73018238c3ba" is_pre_election: true
I20260709 13:09:24.841063 24913 leader_election.cc:304] T f662efc86a73450cac065505b63cb883 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dea34817fcc148d78f090ef5fa72304f; no voters: b39c386162de49aca92dbebee7f06ace, f8d4657116f948038a0c73018238c3ba
I20260709 13:09:24.842399 24929 raft_consensus.cc:2749] T f662efc86a73450cac065505b63cb883 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:24.843001 24921 tablet_bootstrap.cc:492] T d17a6bbfc9d8478988b08964765c3b86 P dea34817fcc148d78f090ef5fa72304f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:24.844054 24921 tablet_bootstrap.cc:492] T d17a6bbfc9d8478988b08964765c3b86 P dea34817fcc148d78f090ef5fa72304f: Bootstrap complete.
I20260709 13:09:24.844769 24921 ts_tablet_manager.cc:1403] T d17a6bbfc9d8478988b08964765c3b86 P dea34817fcc148d78f090ef5fa72304f: Time spent bootstrapping tablet: real 0.036s	user 0.014s	sys 0.009s
W20260709 13:09:24.843060 24206 consensus_peers.cc:597] T 5bc4e407c8b04739aa0290922bfdbed4 P f8d4657116f948038a0c73018238c3ba -> Peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Couldn't send request to peer dea34817fcc148d78f090ef5fa72304f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:36343: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:24.849375 24921 raft_consensus.cc:359] T d17a6bbfc9d8478988b08964765c3b86 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:24.850257 24921 raft_consensus.cc:740] T d17a6bbfc9d8478988b08964765c3b86 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: dea34817fcc148d78f090ef5fa72304f, State: Initialized, Role: FOLLOWER
I20260709 13:09:24.851075 24921 consensus_queue.cc:260] T d17a6bbfc9d8478988b08964765c3b86 P dea34817fcc148d78f090ef5fa72304f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:24.855139 24921 ts_tablet_manager.cc:1434] T d17a6bbfc9d8478988b08964765c3b86 P dea34817fcc148d78f090ef5fa72304f: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:09:24.856006 24921 tablet_bootstrap.cc:492] T 99b130381d71460388507938ba053f8f P dea34817fcc148d78f090ef5fa72304f: Bootstrap starting.
W20260709 13:09:24.857112 24206 consensus_peers.cc:597] T 46f373ffd46f4625bac910b5ccf4b767 P f8d4657116f948038a0c73018238c3ba -> Peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Couldn't send request to peer dea34817fcc148d78f090ef5fa72304f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:36343: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:24.860248 24132 consensus_peers.cc:597] T bff14fa713b6482f89ecf3e18f785f81 P c0f503bf8bb94af8a2a1139db4e1c0f5 -> Peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Couldn't send request to peer dea34817fcc148d78f090ef5fa72304f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:36343: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:24.866539 24206 consensus_peers.cc:597] T 3bcebec1ac994b99a49430f4f892d615 P f8d4657116f948038a0c73018238c3ba -> Peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Couldn't send request to peer dea34817fcc148d78f090ef5fa72304f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:36343: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:24.887416 24206 consensus_peers.cc:597] T 47fcd2aa8e994186872c2e0f9995dd8a P f8d4657116f948038a0c73018238c3ba -> Peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Couldn't send request to peer dea34817fcc148d78f090ef5fa72304f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:36343: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:24.881026 24132 consensus_peers.cc:597] T 65f010ca5ab74fa1b0f45b7d5dced706 P c0f503bf8bb94af8a2a1139db4e1c0f5 -> Peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Couldn't send request to peer dea34817fcc148d78f090ef5fa72304f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:36343: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:24.899550 24280 consensus_peers.cc:597] T f662efc86a73450cac065505b63cb883 P b39c386162de49aca92dbebee7f06ace -> Peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Couldn't send request to peer dea34817fcc148d78f090ef5fa72304f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:36343: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:24.909394 24921 tablet_bootstrap.cc:492] T 99b130381d71460388507938ba053f8f P dea34817fcc148d78f090ef5fa72304f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:24.910635 24921 tablet_bootstrap.cc:492] T 99b130381d71460388507938ba053f8f P dea34817fcc148d78f090ef5fa72304f: Bootstrap complete.
I20260709 13:09:24.911581 24921 ts_tablet_manager.cc:1403] T 99b130381d71460388507938ba053f8f P dea34817fcc148d78f090ef5fa72304f: Time spent bootstrapping tablet: real 0.056s	user 0.026s	sys 0.008s
W20260709 13:09:24.916747 24280 consensus_peers.cc:597] T 99b130381d71460388507938ba053f8f P b39c386162de49aca92dbebee7f06ace -> Peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Couldn't send request to peer dea34817fcc148d78f090ef5fa72304f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:36343: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:24.919246 24921 raft_consensus.cc:359] T 99b130381d71460388507938ba053f8f P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:24.920162 24921 raft_consensus.cc:740] T 99b130381d71460388507938ba053f8f P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: dea34817fcc148d78f090ef5fa72304f, State: Initialized, Role: FOLLOWER
I20260709 13:09:24.921146 24921 consensus_queue.cc:260] T 99b130381d71460388507938ba053f8f P dea34817fcc148d78f090ef5fa72304f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:24.923832 24921 ts_tablet_manager.cc:1434] T 99b130381d71460388507938ba053f8f P dea34817fcc148d78f090ef5fa72304f: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:09:24.924818 24921 tablet_bootstrap.cc:492] T aaf99a05bd8842ed9ea668a9da85dbcc P dea34817fcc148d78f090ef5fa72304f: Bootstrap starting.
W20260709 13:09:24.928661 24132 consensus_peers.cc:597] T 7da69453741f4b73a0092f56f29b1000 P c0f503bf8bb94af8a2a1139db4e1c0f5 -> Peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Couldn't send request to peer dea34817fcc148d78f090ef5fa72304f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:36343: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:24.954824 24921 tablet_bootstrap.cc:492] T aaf99a05bd8842ed9ea668a9da85dbcc P dea34817fcc148d78f090ef5fa72304f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:24.956094 24921 tablet_bootstrap.cc:492] T aaf99a05bd8842ed9ea668a9da85dbcc P dea34817fcc148d78f090ef5fa72304f: Bootstrap complete.
I20260709 13:09:24.956923 24921 ts_tablet_manager.cc:1403] T aaf99a05bd8842ed9ea668a9da85dbcc P dea34817fcc148d78f090ef5fa72304f: Time spent bootstrapping tablet: real 0.032s	user 0.020s	sys 0.003s
W20260709 13:09:24.960827 24280 consensus_peers.cc:597] T b25c31c2fcad44f281a8a045e6cb0c19 P b39c386162de49aca92dbebee7f06ace -> Peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Couldn't send request to peer dea34817fcc148d78f090ef5fa72304f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:36343: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:24.962108 24921 raft_consensus.cc:359] T aaf99a05bd8842ed9ea668a9da85dbcc P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:24.962982 24921 raft_consensus.cc:740] T aaf99a05bd8842ed9ea668a9da85dbcc P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: dea34817fcc148d78f090ef5fa72304f, State: Initialized, Role: FOLLOWER
I20260709 13:09:24.963930 24921 consensus_queue.cc:260] T aaf99a05bd8842ed9ea668a9da85dbcc P dea34817fcc148d78f090ef5fa72304f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:24.966698 24921 ts_tablet_manager.cc:1434] T aaf99a05bd8842ed9ea668a9da85dbcc P dea34817fcc148d78f090ef5fa72304f: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:09:24.967936 24921 tablet_bootstrap.cc:492] T ab4ea1ceb7a443be94ec74cd88c9bf47 P dea34817fcc148d78f090ef5fa72304f: Bootstrap starting.
W20260709 13:09:24.975641 24132 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.14.180.126:35949, user_credentials={real_user=slave}} blocked reactor thread for 45436.5us
I20260709 13:09:24.996711 24921 tablet_bootstrap.cc:492] T ab4ea1ceb7a443be94ec74cd88c9bf47 P dea34817fcc148d78f090ef5fa72304f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:24.997999 24921 tablet_bootstrap.cc:492] T ab4ea1ceb7a443be94ec74cd88c9bf47 P dea34817fcc148d78f090ef5fa72304f: Bootstrap complete.
I20260709 13:09:24.998854 24921 ts_tablet_manager.cc:1403] T ab4ea1ceb7a443be94ec74cd88c9bf47 P dea34817fcc148d78f090ef5fa72304f: Time spent bootstrapping tablet: real 0.031s	user 0.016s	sys 0.008s
I20260709 13:09:25.002166 24921 raft_consensus.cc:359] T ab4ea1ceb7a443be94ec74cd88c9bf47 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:25.003228 24921 raft_consensus.cc:740] T ab4ea1ceb7a443be94ec74cd88c9bf47 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: dea34817fcc148d78f090ef5fa72304f, State: Initialized, Role: FOLLOWER
I20260709 13:09:25.004251 24921 consensus_queue.cc:260] T ab4ea1ceb7a443be94ec74cd88c9bf47 P dea34817fcc148d78f090ef5fa72304f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:25.007477 24921 ts_tablet_manager.cc:1434] T ab4ea1ceb7a443be94ec74cd88c9bf47 P dea34817fcc148d78f090ef5fa72304f: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 13:09:25.009999 24921 tablet_bootstrap.cc:492] T 7a76ed4e1b6a4c2698999f722da5cfd7 P dea34817fcc148d78f090ef5fa72304f: Bootstrap starting.
I20260709 13:09:25.039783 24921 tablet_bootstrap.cc:492] T 7a76ed4e1b6a4c2698999f722da5cfd7 P dea34817fcc148d78f090ef5fa72304f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:25.040756 24921 tablet_bootstrap.cc:492] T 7a76ed4e1b6a4c2698999f722da5cfd7 P dea34817fcc148d78f090ef5fa72304f: Bootstrap complete.
I20260709 13:09:25.041460 24921 ts_tablet_manager.cc:1403] T 7a76ed4e1b6a4c2698999f722da5cfd7 P dea34817fcc148d78f090ef5fa72304f: Time spent bootstrapping tablet: real 0.032s	user 0.014s	sys 0.011s
I20260709 13:09:25.044155 24921 raft_consensus.cc:359] T 7a76ed4e1b6a4c2698999f722da5cfd7 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:25.044872 24921 raft_consensus.cc:740] T 7a76ed4e1b6a4c2698999f722da5cfd7 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: dea34817fcc148d78f090ef5fa72304f, State: Initialized, Role: FOLLOWER
I20260709 13:09:25.045729 24921 consensus_queue.cc:260] T 7a76ed4e1b6a4c2698999f722da5cfd7 P dea34817fcc148d78f090ef5fa72304f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
W20260709 13:09:25.048084 24206 consensus_peers.cc:597] T b53fa043603b41be836d4ccb5c248df8 P f8d4657116f948038a0c73018238c3ba -> Peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Couldn't send request to peer dea34817fcc148d78f090ef5fa72304f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:36343: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:25.048148 24921 ts_tablet_manager.cc:1434] T 7a76ed4e1b6a4c2698999f722da5cfd7 P dea34817fcc148d78f090ef5fa72304f: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 13:09:25.049091 24921 tablet_bootstrap.cc:492] T b25c31c2fcad44f281a8a045e6cb0c19 P dea34817fcc148d78f090ef5fa72304f: Bootstrap starting.
W20260709 13:09:25.051977 24280 consensus_peers.cc:597] T aaf99a05bd8842ed9ea668a9da85dbcc P b39c386162de49aca92dbebee7f06ace -> Peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Couldn't send request to peer dea34817fcc148d78f090ef5fa72304f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:36343: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:25.048815 24132 consensus_peers.cc:597] T 45b65ebcb0114044a04e5689db4a466f P c0f503bf8bb94af8a2a1139db4e1c0f5 -> Peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Couldn't send request to peer dea34817fcc148d78f090ef5fa72304f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:36343: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:25.066833 24206 consensus_peers.cc:597] T 7a76ed4e1b6a4c2698999f722da5cfd7 P f8d4657116f948038a0c73018238c3ba -> Peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Couldn't send request to peer dea34817fcc148d78f090ef5fa72304f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:36343: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:25.074267 24921 tablet_bootstrap.cc:492] T b25c31c2fcad44f281a8a045e6cb0c19 P dea34817fcc148d78f090ef5fa72304f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:25.075825 24921 tablet_bootstrap.cc:492] T b25c31c2fcad44f281a8a045e6cb0c19 P dea34817fcc148d78f090ef5fa72304f: Bootstrap complete.
I20260709 13:09:25.076565 24921 ts_tablet_manager.cc:1403] T b25c31c2fcad44f281a8a045e6cb0c19 P dea34817fcc148d78f090ef5fa72304f: Time spent bootstrapping tablet: real 0.028s	user 0.014s	sys 0.007s
I20260709 13:09:25.080272 24921 raft_consensus.cc:359] T b25c31c2fcad44f281a8a045e6cb0c19 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:25.081135 24921 raft_consensus.cc:740] T b25c31c2fcad44f281a8a045e6cb0c19 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: dea34817fcc148d78f090ef5fa72304f, State: Initialized, Role: FOLLOWER
I20260709 13:09:25.081974 24921 consensus_queue.cc:260] T b25c31c2fcad44f281a8a045e6cb0c19 P dea34817fcc148d78f090ef5fa72304f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:25.084355 24921 ts_tablet_manager.cc:1434] T b25c31c2fcad44f281a8a045e6cb0c19 P dea34817fcc148d78f090ef5fa72304f: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:09:25.085227 24921 tablet_bootstrap.cc:492] T 46f373ffd46f4625bac910b5ccf4b767 P dea34817fcc148d78f090ef5fa72304f: Bootstrap starting.
W20260709 13:09:25.085520 24132 consensus_peers.cc:597] T 25e4818a4e2e4c9c9f7a8467aa9ef881 P c0f503bf8bb94af8a2a1139db4e1c0f5 -> Peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Couldn't send request to peer dea34817fcc148d78f090ef5fa72304f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:36343: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:25.107892 24132 consensus_peers.cc:597] T ab4ea1ceb7a443be94ec74cd88c9bf47 P c0f503bf8bb94af8a2a1139db4e1c0f5 -> Peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Couldn't send request to peer dea34817fcc148d78f090ef5fa72304f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:36343: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:25.112131 24280 consensus_peers.cc:597] T a0ff7e0491fb406d9e1f13941504372f P b39c386162de49aca92dbebee7f06ace -> Peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Couldn't send request to peer dea34817fcc148d78f090ef5fa72304f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:36343: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:25.113883 24921 tablet_bootstrap.cc:492] T 46f373ffd46f4625bac910b5ccf4b767 P dea34817fcc148d78f090ef5fa72304f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:25.116832 24921 tablet_bootstrap.cc:492] T 46f373ffd46f4625bac910b5ccf4b767 P dea34817fcc148d78f090ef5fa72304f: Bootstrap complete.
W20260709 13:09:25.116885 24206 consensus_peers.cc:597] T 861d7d76be4d484a9eb3acf8abffae5f P f8d4657116f948038a0c73018238c3ba -> Peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Couldn't send request to peer dea34817fcc148d78f090ef5fa72304f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:36343: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:25.117697 24921 ts_tablet_manager.cc:1403] T 46f373ffd46f4625bac910b5ccf4b767 P dea34817fcc148d78f090ef5fa72304f: Time spent bootstrapping tablet: real 0.033s	user 0.023s	sys 0.000s
I20260709 13:09:25.120779 24921 raft_consensus.cc:359] T 46f373ffd46f4625bac910b5ccf4b767 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:25.121613 24921 raft_consensus.cc:740] T 46f373ffd46f4625bac910b5ccf4b767 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: dea34817fcc148d78f090ef5fa72304f, State: Initialized, Role: FOLLOWER
I20260709 13:09:25.122578 24921 consensus_queue.cc:260] T 46f373ffd46f4625bac910b5ccf4b767 P dea34817fcc148d78f090ef5fa72304f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:25.125717 24921 ts_tablet_manager.cc:1434] T 46f373ffd46f4625bac910b5ccf4b767 P dea34817fcc148d78f090ef5fa72304f: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:09:25.126736 24921 tablet_bootstrap.cc:492] T e280ec3a0e394065aca766e4f8bef46d P dea34817fcc148d78f090ef5fa72304f: Bootstrap starting.
W20260709 13:09:25.137578 24206 consensus_peers.cc:597] T 430894245c954e33b6586b4704c66b3c P f8d4657116f948038a0c73018238c3ba -> Peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Couldn't send request to peer dea34817fcc148d78f090ef5fa72304f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:36343: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:25.302317 24929 raft_consensus.cc:493] T 2dbbcd71c86041ba949fac653102e076 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:25.303038 24929 raft_consensus.cc:515] T 2dbbcd71c86041ba949fac653102e076 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:25.307595 24929 leader_election.cc:290] T 2dbbcd71c86041ba949fac653102e076 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561), c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431)
W20260709 13:09:25.312844 24280 consensus_peers.cc:597] T 9acec0d1a6e74a4bb39a0d867598acc5 P b39c386162de49aca92dbebee7f06ace -> Peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Couldn't send request to peer dea34817fcc148d78f090ef5fa72304f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:36343: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:25.342542 24921 tablet_bootstrap.cc:492] T e280ec3a0e394065aca766e4f8bef46d P dea34817fcc148d78f090ef5fa72304f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:25.343899 24921 tablet_bootstrap.cc:492] T e280ec3a0e394065aca766e4f8bef46d P dea34817fcc148d78f090ef5fa72304f: Bootstrap complete.
I20260709 13:09:25.345106 24921 ts_tablet_manager.cc:1403] T e280ec3a0e394065aca766e4f8bef46d P dea34817fcc148d78f090ef5fa72304f: Time spent bootstrapping tablet: real 0.219s	user 0.035s	sys 0.075s
W20260709 13:09:25.350286 24206 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:36343, user_credentials={real_user=slave}} blocked reactor thread for 55156.9us
I20260709 13:09:25.352067 24929 raft_consensus.cc:493] T b1d1d7dd508b43489431371c4ece4fa4 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:25.352257 24206 consensus_peers.cc:597] T 01f1144c4a1c482894ec993e5ce24bc4 P f8d4657116f948038a0c73018238c3ba -> Peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Couldn't send request to peer dea34817fcc148d78f090ef5fa72304f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:36343: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:25.352967 24929 raft_consensus.cc:515] T b1d1d7dd508b43489431371c4ece4fa4 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:25.357079 24929 leader_election.cc:290] T b1d1d7dd508b43489431371c4ece4fa4 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171), b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561)
I20260709 13:09:25.357631 24236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d1d7dd508b43489431371c4ece4fa4" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8d4657116f948038a0c73018238c3ba" is_pre_election: true
W20260709 13:09:25.365799 24132 consensus_peers.cc:597] T d17a6bbfc9d8478988b08964765c3b86 P c0f503bf8bb94af8a2a1139db4e1c0f5 -> Peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Couldn't send request to peer dea34817fcc148d78f090ef5fa72304f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:36343: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:25.351534 24921 raft_consensus.cc:359] T e280ec3a0e394065aca766e4f8bef46d P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:25.372314 24921 raft_consensus.cc:740] T e280ec3a0e394065aca766e4f8bef46d P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: dea34817fcc148d78f090ef5fa72304f, State: Initialized, Role: FOLLOWER
I20260709 13:09:25.373306 24921 consensus_queue.cc:260] T e280ec3a0e394065aca766e4f8bef46d P dea34817fcc148d78f090ef5fa72304f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:25.383203 24921 ts_tablet_manager.cc:1434] T e280ec3a0e394065aca766e4f8bef46d P dea34817fcc148d78f090ef5fa72304f: Time spent starting tablet: real 0.038s	user 0.011s	sys 0.000s
I20260709 13:09:25.383852 24313 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d1d7dd508b43489431371c4ece4fa4" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace" is_pre_election: true
I20260709 13:09:25.384295 24921 tablet_bootstrap.cc:492] T bff14fa713b6482f89ecf3e18f785f81 P dea34817fcc148d78f090ef5fa72304f: Bootstrap starting.
I20260709 13:09:25.386857 24311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbbcd71c86041ba949fac653102e076" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace" is_pre_election: true
W20260709 13:09:25.415004 24132 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:36343, user_credentials={real_user=slave}} blocked reactor thread for 48588.6us
W20260709 13:09:25.448483 24280 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:37431, user_credentials={real_user=slave}} blocked reactor thread for 55192.1us
W20260709 13:09:25.467401 24132 consensus_peers.cc:597] T 1dcdde5516f54b19b11611ca9213415d P c0f503bf8bb94af8a2a1139db4e1c0f5 -> Peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Couldn't send request to peer dea34817fcc148d78f090ef5fa72304f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:36343: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:25.479561 24929 raft_consensus.cc:493] T 7da69453741f4b73a0092f56f29b1000 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:25.480948 24929 raft_consensus.cc:515] T 7da69453741f4b73a0092f56f29b1000 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:25.483790 24929 leader_election.cc:290] T 7da69453741f4b73a0092f56f29b1000 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561), c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431)
I20260709 13:09:25.475260 24911 leader_election.cc:304] T b1d1d7dd508b43489431371c4ece4fa4 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dea34817fcc148d78f090ef5fa72304f; no voters: b39c386162de49aca92dbebee7f06ace, f8d4657116f948038a0c73018238c3ba
I20260709 13:09:25.491515 24929 raft_consensus.cc:2749] T b1d1d7dd508b43489431371c4ece4fa4 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:25.523026 24312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da69453741f4b73a0092f56f29b1000" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace" is_pre_election: true
W20260709 13:09:25.522037 24132 consensus_peers.cc:597] T e845188d32d2466a92eacdb66da16dba P c0f503bf8bb94af8a2a1139db4e1c0f5 -> Peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Couldn't send request to peer dea34817fcc148d78f090ef5fa72304f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:36343: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:25.535769 24165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dbbcd71c86041ba949fac653102e076" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" is_pre_election: true
I20260709 13:09:25.536024 24161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7da69453741f4b73a0092f56f29b1000" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" is_pre_election: true
I20260709 13:09:25.538733 24914 leader_election.cc:304] T 2dbbcd71c86041ba949fac653102e076 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dea34817fcc148d78f090ef5fa72304f; no voters: b39c386162de49aca92dbebee7f06ace, c0f503bf8bb94af8a2a1139db4e1c0f5
I20260709 13:09:25.540025 24929 raft_consensus.cc:2749] T 2dbbcd71c86041ba949fac653102e076 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:25.542343 24921 tablet_bootstrap.cc:492] T bff14fa713b6482f89ecf3e18f785f81 P dea34817fcc148d78f090ef5fa72304f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:25.543416 24921 tablet_bootstrap.cc:492] T bff14fa713b6482f89ecf3e18f785f81 P dea34817fcc148d78f090ef5fa72304f: Bootstrap complete.
I20260709 13:09:25.544122 24921 ts_tablet_manager.cc:1403] T bff14fa713b6482f89ecf3e18f785f81 P dea34817fcc148d78f090ef5fa72304f: Time spent bootstrapping tablet: real 0.160s	user 0.025s	sys 0.000s
W20260709 13:09:25.544971 24206 consensus_peers.cc:597] T c9b7bd5d439d455a9173478e086439e8 P f8d4657116f948038a0c73018238c3ba -> Peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Couldn't send request to peer dea34817fcc148d78f090ef5fa72304f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:36343: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:25.546083 24206 consensus_peers.cc:597] T 99078769583e49908dd6990f1d806453 P f8d4657116f948038a0c73018238c3ba -> Peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Couldn't send request to peer dea34817fcc148d78f090ef5fa72304f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:36343: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:25.546895 24921 raft_consensus.cc:359] T bff14fa713b6482f89ecf3e18f785f81 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:25.547684 24921 raft_consensus.cc:740] T bff14fa713b6482f89ecf3e18f785f81 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: dea34817fcc148d78f090ef5fa72304f, State: Initialized, Role: FOLLOWER
I20260709 13:09:25.548391 24921 consensus_queue.cc:260] T bff14fa713b6482f89ecf3e18f785f81 P dea34817fcc148d78f090ef5fa72304f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:25.570138 24921 ts_tablet_manager.cc:1434] T bff14fa713b6482f89ecf3e18f785f81 P dea34817fcc148d78f090ef5fa72304f: Time spent starting tablet: real 0.026s	user 0.009s	sys 0.000s
I20260709 13:09:25.572387 24921 tablet_bootstrap.cc:492] T b53fa043603b41be836d4ccb5c248df8 P dea34817fcc148d78f090ef5fa72304f: Bootstrap starting.
I20260709 13:09:25.567499 24911 leader_election.cc:304] T 7da69453741f4b73a0092f56f29b1000 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dea34817fcc148d78f090ef5fa72304f; no voters: b39c386162de49aca92dbebee7f06ace, c0f503bf8bb94af8a2a1139db4e1c0f5
W20260709 13:09:25.581314 24132 consensus_peers.cc:597] T 93e868a924d74bbc8bf29aa5a7fc67fd P c0f503bf8bb94af8a2a1139db4e1c0f5 -> Peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Couldn't send request to peer dea34817fcc148d78f090ef5fa72304f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:36343: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:25.580169 24929 raft_consensus.cc:2749] T 7da69453741f4b73a0092f56f29b1000 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:25.614492 24934 raft_consensus.cc:493] T 662a938528e545e6aa4592052da18101 P b39c386162de49aca92dbebee7f06ace [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:25.615288 24934 raft_consensus.cc:515] T 662a938528e545e6aa4592052da18101 P b39c386162de49aca92dbebee7f06ace [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:25.619275 24236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "662a938528e545e6aa4592052da18101" candidate_uuid: "b39c386162de49aca92dbebee7f06ace" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8d4657116f948038a0c73018238c3ba" is_pre_election: true
I20260709 13:09:25.620180 24236 raft_consensus.cc:2468] T 662a938528e545e6aa4592052da18101 P f8d4657116f948038a0c73018238c3ba [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b39c386162de49aca92dbebee7f06ace in term 2.
I20260709 13:09:25.626827 24279 leader_election.cc:304] T 662a938528e545e6aa4592052da18101 P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b39c386162de49aca92dbebee7f06ace, f8d4657116f948038a0c73018238c3ba; no voters: 
I20260709 13:09:25.628103 25035 raft_consensus.cc:2804] T 662a938528e545e6aa4592052da18101 P b39c386162de49aca92dbebee7f06ace [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:25.628630 25035 raft_consensus.cc:493] T 662a938528e545e6aa4592052da18101 P b39c386162de49aca92dbebee7f06ace [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:25.629261 25035 raft_consensus.cc:3060] T 662a938528e545e6aa4592052da18101 P b39c386162de49aca92dbebee7f06ace [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:25.643245 24934 leader_election.cc:290] T 662a938528e545e6aa4592052da18101 P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171), dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343)
I20260709 13:09:25.645437 24921 tablet_bootstrap.cc:492] T b53fa043603b41be836d4ccb5c248df8 P dea34817fcc148d78f090ef5fa72304f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:25.647002 24921 tablet_bootstrap.cc:492] T b53fa043603b41be836d4ccb5c248df8 P dea34817fcc148d78f090ef5fa72304f: Bootstrap complete.
I20260709 13:09:25.647790 24921 ts_tablet_manager.cc:1403] T b53fa043603b41be836d4ccb5c248df8 P dea34817fcc148d78f090ef5fa72304f: Time spent bootstrapping tablet: real 0.076s	user 0.017s	sys 0.007s
I20260709 13:09:25.650800 24921 raft_consensus.cc:359] T b53fa043603b41be836d4ccb5c248df8 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:25.651556 24921 raft_consensus.cc:740] T b53fa043603b41be836d4ccb5c248df8 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: dea34817fcc148d78f090ef5fa72304f, State: Initialized, Role: FOLLOWER
I20260709 13:09:25.653481 24921 consensus_queue.cc:260] T b53fa043603b41be836d4ccb5c248df8 P dea34817fcc148d78f090ef5fa72304f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
W20260709 13:09:25.655282 24280 leader_election.cc:336] T 662a938528e545e6aa4592052da18101 P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Network error: Client connection negotiation failed: client connection to 127.14.180.65:36343: connect: Connection refused (error 111)
I20260709 13:09:25.657061 24921 ts_tablet_manager.cc:1434] T b53fa043603b41be836d4ccb5c248df8 P dea34817fcc148d78f090ef5fa72304f: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:09:25.657984 24921 tablet_bootstrap.cc:492] T 1dcdde5516f54b19b11611ca9213415d P dea34817fcc148d78f090ef5fa72304f: Bootstrap starting.
I20260709 13:09:25.660550 24929 raft_consensus.cc:493] T 03bfe46bf2b74722b6e8eb3015e38f43 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:25.661201 24929 raft_consensus.cc:515] T 03bfe46bf2b74722b6e8eb3015e38f43 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:25.665515 24161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bfe46bf2b74722b6e8eb3015e38f43" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" is_pre_election: true
I20260709 13:09:25.663671 24929 leader_election.cc:290] T 03bfe46bf2b74722b6e8eb3015e38f43 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561), c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431)
I20260709 13:09:25.668243 24310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bfe46bf2b74722b6e8eb3015e38f43" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace" is_pre_election: true
I20260709 13:09:25.670776 24911 leader_election.cc:304] T 03bfe46bf2b74722b6e8eb3015e38f43 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dea34817fcc148d78f090ef5fa72304f; no voters: b39c386162de49aca92dbebee7f06ace, c0f503bf8bb94af8a2a1139db4e1c0f5
I20260709 13:09:25.670809 25035 raft_consensus.cc:515] T 662a938528e545e6aa4592052da18101 P b39c386162de49aca92dbebee7f06ace [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:25.672066 24929 raft_consensus.cc:2749] T 03bfe46bf2b74722b6e8eb3015e38f43 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:25.674381 24236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "662a938528e545e6aa4592052da18101" candidate_uuid: "b39c386162de49aca92dbebee7f06ace" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8d4657116f948038a0c73018238c3ba"
I20260709 13:09:25.675300 24236 raft_consensus.cc:3060] T 662a938528e545e6aa4592052da18101 P f8d4657116f948038a0c73018238c3ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:25.703300 24921 tablet_bootstrap.cc:492] T 1dcdde5516f54b19b11611ca9213415d P dea34817fcc148d78f090ef5fa72304f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:25.705785 24921 tablet_bootstrap.cc:492] T 1dcdde5516f54b19b11611ca9213415d P dea34817fcc148d78f090ef5fa72304f: Bootstrap complete.
I20260709 13:09:25.706640 24921 ts_tablet_manager.cc:1403] T 1dcdde5516f54b19b11611ca9213415d P dea34817fcc148d78f090ef5fa72304f: Time spent bootstrapping tablet: real 0.049s	user 0.022s	sys 0.012s
I20260709 13:09:25.710007 24921 raft_consensus.cc:359] T 1dcdde5516f54b19b11611ca9213415d P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:25.711947 24236 raft_consensus.cc:2468] T 662a938528e545e6aa4592052da18101 P f8d4657116f948038a0c73018238c3ba [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b39c386162de49aca92dbebee7f06ace in term 3.
I20260709 13:09:25.710736 24921 raft_consensus.cc:740] T 1dcdde5516f54b19b11611ca9213415d P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: dea34817fcc148d78f090ef5fa72304f, State: Initialized, Role: FOLLOWER
I20260709 13:09:25.715739 24279 leader_election.cc:304] T 662a938528e545e6aa4592052da18101 P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b39c386162de49aca92dbebee7f06ace, f8d4657116f948038a0c73018238c3ba; no voters: 
I20260709 13:09:25.715107 24921 consensus_queue.cc:260] T 1dcdde5516f54b19b11611ca9213415d P dea34817fcc148d78f090ef5fa72304f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:25.716744 24934 raft_consensus.cc:2804] T 662a938528e545e6aa4592052da18101 P b39c386162de49aca92dbebee7f06ace [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:25.717260 24934 raft_consensus.cc:697] T 662a938528e545e6aa4592052da18101 P b39c386162de49aca92dbebee7f06ace [term 3 LEADER]: Becoming Leader. State: Replica: b39c386162de49aca92dbebee7f06ace, State: Running, Role: LEADER
I20260709 13:09:25.718161 24934 consensus_queue.cc:237] T 662a938528e545e6aa4592052da18101 P b39c386162de49aca92dbebee7f06ace [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
W20260709 13:09:25.719200 24280 leader_election.cc:336] T 662a938528e545e6aa4592052da18101 P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Network error: Client connection negotiation failed: client connection to 127.14.180.65:36343: connect: Connection refused (error 111)
I20260709 13:09:25.720216 24921 ts_tablet_manager.cc:1434] T 1dcdde5516f54b19b11611ca9213415d P dea34817fcc148d78f090ef5fa72304f: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:09:25.721156 24921 tablet_bootstrap.cc:492] T 25e4818a4e2e4c9c9f7a8467aa9ef881 P dea34817fcc148d78f090ef5fa72304f: Bootstrap starting.
I20260709 13:09:25.712936 25035 leader_election.cc:290] T 662a938528e545e6aa4592052da18101 P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 3 election: Requested vote from peers f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171), dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343)
I20260709 13:09:25.757859 24921 tablet_bootstrap.cc:492] T 25e4818a4e2e4c9c9f7a8467aa9ef881 P dea34817fcc148d78f090ef5fa72304f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:25.759116 24921 tablet_bootstrap.cc:492] T 25e4818a4e2e4c9c9f7a8467aa9ef881 P dea34817fcc148d78f090ef5fa72304f: Bootstrap complete.
I20260709 13:09:25.762672 24921 ts_tablet_manager.cc:1403] T 25e4818a4e2e4c9c9f7a8467aa9ef881 P dea34817fcc148d78f090ef5fa72304f: Time spent bootstrapping tablet: real 0.042s	user 0.018s	sys 0.008s
I20260709 13:09:25.765808 24929 raft_consensus.cc:493] T 49393e5cc2614c90b69a3bb2348dacb9 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:25.766518 24921 raft_consensus.cc:359] T 25e4818a4e2e4c9c9f7a8467aa9ef881 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:25.766664 24929 raft_consensus.cc:515] T 49393e5cc2614c90b69a3bb2348dacb9 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:25.767691 24921 raft_consensus.cc:740] T 25e4818a4e2e4c9c9f7a8467aa9ef881 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: dea34817fcc148d78f090ef5fa72304f, State: Initialized, Role: FOLLOWER
I20260709 13:09:25.768818 24921 consensus_queue.cc:260] T 25e4818a4e2e4c9c9f7a8467aa9ef881 P dea34817fcc148d78f090ef5fa72304f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:25.771251 24165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393e5cc2614c90b69a3bb2348dacb9" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" is_pre_election: true
I20260709 13:09:25.780918 24921 ts_tablet_manager.cc:1434] T 25e4818a4e2e4c9c9f7a8467aa9ef881 P dea34817fcc148d78f090ef5fa72304f: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.008s
I20260709 13:09:25.784206 24921 tablet_bootstrap.cc:492] T 93e868a924d74bbc8bf29aa5a7fc67fd P dea34817fcc148d78f090ef5fa72304f: Bootstrap starting.
I20260709 13:09:25.785652 24929 leader_election.cc:290] T 49393e5cc2614c90b69a3bb2348dacb9 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431), f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171)
I20260709 13:09:25.787497 24236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49393e5cc2614c90b69a3bb2348dacb9" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8d4657116f948038a0c73018238c3ba" is_pre_election: true
I20260709 13:09:25.789321 24913 leader_election.cc:304] T 49393e5cc2614c90b69a3bb2348dacb9 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dea34817fcc148d78f090ef5fa72304f; no voters: c0f503bf8bb94af8a2a1139db4e1c0f5, f8d4657116f948038a0c73018238c3ba
I20260709 13:09:25.791158 24929 raft_consensus.cc:2749] T 49393e5cc2614c90b69a3bb2348dacb9 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:09:25.799988 24206 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:36343, user_credentials={real_user=slave}} blocked reactor thread for 47899.4us
I20260709 13:09:25.803659 23987 catalog_manager.cc:5697] T 662a938528e545e6aa4592052da18101 P b39c386162de49aca92dbebee7f06ace reported cstate change: term changed from 1 to 3, leader changed from dea34817fcc148d78f090ef5fa72304f (127.14.180.65) to b39c386162de49aca92dbebee7f06ace (127.14.180.68). New cstate: current_term: 3 leader_uuid: "b39c386162de49aca92dbebee7f06ace" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:25.811724 24921 tablet_bootstrap.cc:492] T 93e868a924d74bbc8bf29aa5a7fc67fd P dea34817fcc148d78f090ef5fa72304f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:25.812911 24921 tablet_bootstrap.cc:492] T 93e868a924d74bbc8bf29aa5a7fc67fd P dea34817fcc148d78f090ef5fa72304f: Bootstrap complete.
I20260709 13:09:25.813643 24921 ts_tablet_manager.cc:1403] T 93e868a924d74bbc8bf29aa5a7fc67fd P dea34817fcc148d78f090ef5fa72304f: Time spent bootstrapping tablet: real 0.032s	user 0.019s	sys 0.004s
I20260709 13:09:25.816956 24921 raft_consensus.cc:359] T 93e868a924d74bbc8bf29aa5a7fc67fd P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:25.817695 24921 raft_consensus.cc:740] T 93e868a924d74bbc8bf29aa5a7fc67fd P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: dea34817fcc148d78f090ef5fa72304f, State: Initialized, Role: FOLLOWER
I20260709 13:09:25.818365 24921 consensus_queue.cc:260] T 93e868a924d74bbc8bf29aa5a7fc67fd P dea34817fcc148d78f090ef5fa72304f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:25.821605 24921 ts_tablet_manager.cc:1434] T 93e868a924d74bbc8bf29aa5a7fc67fd P dea34817fcc148d78f090ef5fa72304f: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:09:25.900336 24921 tablet_bootstrap.cc:492] T 861d7d76be4d484a9eb3acf8abffae5f P dea34817fcc148d78f090ef5fa72304f: Bootstrap starting.
I20260709 13:09:25.936157 24929 raft_consensus.cc:493] T 1541f6b04d914d10823ad78c03d9a847 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:25.936959 24929 raft_consensus.cc:515] T 1541f6b04d914d10823ad78c03d9a847 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:25.941464 24929 leader_election.cc:290] T 1541f6b04d914d10823ad78c03d9a847 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561), c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431)
I20260709 13:09:25.955363 24929 raft_consensus.cc:493] T 687efb9bbbd04b0eb768bfa6543380c3 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:25.956243 24929 raft_consensus.cc:515] T 687efb9bbbd04b0eb768bfa6543380c3 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:25.960479 24929 leader_election.cc:290] T 687efb9bbbd04b0eb768bfa6543380c3 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561), c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431)
I20260709 13:09:25.972170 24921 tablet_bootstrap.cc:492] T 861d7d76be4d484a9eb3acf8abffae5f P dea34817fcc148d78f090ef5fa72304f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:25.973269 24921 tablet_bootstrap.cc:492] T 861d7d76be4d484a9eb3acf8abffae5f P dea34817fcc148d78f090ef5fa72304f: Bootstrap complete.
I20260709 13:09:25.973971 24921 ts_tablet_manager.cc:1403] T 861d7d76be4d484a9eb3acf8abffae5f P dea34817fcc148d78f090ef5fa72304f: Time spent bootstrapping tablet: real 0.152s	user 0.028s	sys 0.022s
I20260709 13:09:25.977732 24161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1541f6b04d914d10823ad78c03d9a847" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" is_pre_election: true
I20260709 13:09:25.978401 24921 raft_consensus.cc:359] T 861d7d76be4d484a9eb3acf8abffae5f P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:25.979362 24921 raft_consensus.cc:740] T 861d7d76be4d484a9eb3acf8abffae5f P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: dea34817fcc148d78f090ef5fa72304f, State: Initialized, Role: FOLLOWER
I20260709 13:09:25.980245 24921 consensus_queue.cc:260] T 861d7d76be4d484a9eb3acf8abffae5f P dea34817fcc148d78f090ef5fa72304f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:25.980873 24161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687efb9bbbd04b0eb768bfa6543380c3" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" is_pre_election: true
I20260709 13:09:25.982646 24921 ts_tablet_manager.cc:1434] T 861d7d76be4d484a9eb3acf8abffae5f P dea34817fcc148d78f090ef5fa72304f: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:09:25.983896 24921 tablet_bootstrap.cc:492] T 45b65ebcb0114044a04e5689db4a466f P dea34817fcc148d78f090ef5fa72304f: Bootstrap starting.
I20260709 13:09:26.023037 24921 tablet_bootstrap.cc:492] T 45b65ebcb0114044a04e5689db4a466f P dea34817fcc148d78f090ef5fa72304f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:26.024078 24921 tablet_bootstrap.cc:492] T 45b65ebcb0114044a04e5689db4a466f P dea34817fcc148d78f090ef5fa72304f: Bootstrap complete.
I20260709 13:09:26.024796 24921 ts_tablet_manager.cc:1403] T 45b65ebcb0114044a04e5689db4a466f P dea34817fcc148d78f090ef5fa72304f: Time spent bootstrapping tablet: real 0.041s	user 0.023s	sys 0.008s
I20260709 13:09:26.025489 24311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1541f6b04d914d10823ad78c03d9a847" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace" is_pre_election: true
I20260709 13:09:26.027928 24311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687efb9bbbd04b0eb768bfa6543380c3" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace" is_pre_election: true
I20260709 13:09:26.029064 24921 raft_consensus.cc:359] T 45b65ebcb0114044a04e5689db4a466f P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:26.029887 24921 raft_consensus.cc:740] T 45b65ebcb0114044a04e5689db4a466f P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: dea34817fcc148d78f090ef5fa72304f, State: Initialized, Role: FOLLOWER
I20260709 13:09:26.030674 24921 consensus_queue.cc:260] T 45b65ebcb0114044a04e5689db4a466f P dea34817fcc148d78f090ef5fa72304f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:26.033195 24911 leader_election.cc:304] T 1541f6b04d914d10823ad78c03d9a847 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dea34817fcc148d78f090ef5fa72304f; no voters: b39c386162de49aca92dbebee7f06ace, c0f503bf8bb94af8a2a1139db4e1c0f5
I20260709 13:09:26.034768 24929 raft_consensus.cc:2749] T 1541f6b04d914d10823ad78c03d9a847 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:26.038965 24911 leader_election.cc:304] T 687efb9bbbd04b0eb768bfa6543380c3 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dea34817fcc148d78f090ef5fa72304f; no voters: b39c386162de49aca92dbebee7f06ace, c0f503bf8bb94af8a2a1139db4e1c0f5
I20260709 13:09:26.040597 24929 raft_consensus.cc:2749] T 687efb9bbbd04b0eb768bfa6543380c3 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:26.042620 24921 ts_tablet_manager.cc:1434] T 45b65ebcb0114044a04e5689db4a466f P dea34817fcc148d78f090ef5fa72304f: Time spent starting tablet: real 0.018s	user 0.009s	sys 0.000s
I20260709 13:09:26.043632 24921 tablet_bootstrap.cc:492] T 5a8830d169ce4e46807d04168c3bb086 P dea34817fcc148d78f090ef5fa72304f: Bootstrap starting.
I20260709 13:09:26.063270 24929 raft_consensus.cc:493] T f735173e22b242178edcdf4821b6f92b P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.063988 24929 raft_consensus.cc:515] T f735173e22b242178edcdf4821b6f92b P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:26.067960 24929 leader_election.cc:290] T f735173e22b242178edcdf4821b6f92b P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171), b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561)
I20260709 13:09:26.068998 24236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f735173e22b242178edcdf4821b6f92b" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8d4657116f948038a0c73018238c3ba" is_pre_election: true
I20260709 13:09:26.088197 24311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f735173e22b242178edcdf4821b6f92b" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace" is_pre_election: true
I20260709 13:09:26.093428 24911 leader_election.cc:304] T f735173e22b242178edcdf4821b6f92b P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dea34817fcc148d78f090ef5fa72304f; no voters: b39c386162de49aca92dbebee7f06ace, f8d4657116f948038a0c73018238c3ba
I20260709 13:09:26.094909 24929 raft_consensus.cc:2749] T f735173e22b242178edcdf4821b6f92b P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:26.120935 24929 raft_consensus.cc:493] T e21ef2f479764142935dc2b1b7e87220 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.121559 24929 raft_consensus.cc:515] T e21ef2f479764142935dc2b1b7e87220 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:26.126451 25063 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.180.65:36343 every 8 connection(s)
I20260709 13:09:26.127127 15057 rpc_server.cc:307] RPC server started. Bound to: 127.14.180.65:36343
I20260709 13:09:26.127239 24236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e21ef2f479764142935dc2b1b7e87220" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8d4657116f948038a0c73018238c3ba" is_pre_election: true
I20260709 13:09:26.137195 24929 leader_election.cc:290] T e21ef2f479764142935dc2b1b7e87220 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171), b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561)
I20260709 13:09:26.139186 24310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e21ef2f479764142935dc2b1b7e87220" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace" is_pre_election: true
I20260709 13:09:26.141202 24911 leader_election.cc:304] T e21ef2f479764142935dc2b1b7e87220 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dea34817fcc148d78f090ef5fa72304f; no voters: b39c386162de49aca92dbebee7f06ace, f8d4657116f948038a0c73018238c3ba
I20260709 13:09:26.141613 24921 tablet_bootstrap.cc:492] T 5a8830d169ce4e46807d04168c3bb086 P dea34817fcc148d78f090ef5fa72304f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:26.142673 24921 tablet_bootstrap.cc:492] T 5a8830d169ce4e46807d04168c3bb086 P dea34817fcc148d78f090ef5fa72304f: Bootstrap complete.
I20260709 13:09:26.142611 24929 raft_consensus.cc:2749] T e21ef2f479764142935dc2b1b7e87220 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:26.143543 24921 ts_tablet_manager.cc:1403] T 5a8830d169ce4e46807d04168c3bb086 P dea34817fcc148d78f090ef5fa72304f: Time spent bootstrapping tablet: real 0.100s	user 0.024s	sys 0.016s
I20260709 13:09:26.146414 24921 raft_consensus.cc:359] T 5a8830d169ce4e46807d04168c3bb086 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:26.147197 24921 raft_consensus.cc:740] T 5a8830d169ce4e46807d04168c3bb086 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: dea34817fcc148d78f090ef5fa72304f, State: Initialized, Role: FOLLOWER
I20260709 13:09:26.152274 24921 consensus_queue.cc:260] T 5a8830d169ce4e46807d04168c3bb086 P dea34817fcc148d78f090ef5fa72304f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:26.154320 24921 ts_tablet_manager.cc:1434] T 5a8830d169ce4e46807d04168c3bb086 P dea34817fcc148d78f090ef5fa72304f: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:09:26.155354 24921 tablet_bootstrap.cc:492] T 01f1144c4a1c482894ec993e5ce24bc4 P dea34817fcc148d78f090ef5fa72304f: Bootstrap starting.
I20260709 13:09:26.257503 24929 raft_consensus.cc:493] T 7a76ed4e1b6a4c2698999f722da5cfd7 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.258376 24929 raft_consensus.cc:515] T 7a76ed4e1b6a4c2698999f722da5cfd7 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:26.263605 24929 leader_election.cc:290] T 7a76ed4e1b6a4c2698999f722da5cfd7 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171), b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561)
I20260709 13:09:26.264288 24312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a76ed4e1b6a4c2698999f722da5cfd7" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace" is_pre_election: true
W20260709 13:09:26.275952 24206 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:37431, user_credentials={real_user=slave}} blocked reactor thread for 51932.1us
I20260709 13:09:26.276741 24236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a76ed4e1b6a4c2698999f722da5cfd7" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8d4657116f948038a0c73018238c3ba" is_pre_election: true
I20260709 13:09:26.279160 24913 leader_election.cc:304] T 7a76ed4e1b6a4c2698999f722da5cfd7 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dea34817fcc148d78f090ef5fa72304f; no voters: b39c386162de49aca92dbebee7f06ace, f8d4657116f948038a0c73018238c3ba
I20260709 13:09:26.280813 24929 raft_consensus.cc:2749] T 7a76ed4e1b6a4c2698999f722da5cfd7 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:26.310410 24929 raft_consensus.cc:493] T 99b130381d71460388507938ba053f8f P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:26.310433 24280 consensus_peers.cc:597] T 662a938528e545e6aa4592052da18101 P b39c386162de49aca92dbebee7f06ace -> Peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Couldn't send request to peer dea34817fcc148d78f090ef5fa72304f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:26.311305 24929 raft_consensus.cc:515] T 99b130381d71460388507938ba053f8f P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:26.314249 24929 leader_election.cc:290] T 99b130381d71460388507938ba053f8f P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561), c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431)
I20260709 13:09:26.316432 25064 heartbeater.cc:344] Connected to a master server at 127.14.180.126:35949
I20260709 13:09:26.316772 24164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b130381d71460388507938ba053f8f" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" is_pre_election: true
I20260709 13:09:26.317011 25064 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:26.317517 24921 tablet_bootstrap.cc:492] T 01f1144c4a1c482894ec993e5ce24bc4 P dea34817fcc148d78f090ef5fa72304f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:26.318360 25064 heartbeater.cc:507] Master 127.14.180.126:35949 requested a full tablet report, sending...
I20260709 13:09:26.318575 24921 tablet_bootstrap.cc:492] T 01f1144c4a1c482894ec993e5ce24bc4 P dea34817fcc148d78f090ef5fa72304f: Bootstrap complete.
I20260709 13:09:26.319275 24921 ts_tablet_manager.cc:1403] T 01f1144c4a1c482894ec993e5ce24bc4 P dea34817fcc148d78f090ef5fa72304f: Time spent bootstrapping tablet: real 0.164s	user 0.060s	sys 0.076s
I20260709 13:09:26.320315 24929 raft_consensus.cc:493] T ab4ea1ceb7a443be94ec74cd88c9bf47 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.322973 24921 raft_consensus.cc:359] T 01f1144c4a1c482894ec993e5ce24bc4 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:26.323753 24921 raft_consensus.cc:740] T 01f1144c4a1c482894ec993e5ce24bc4 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: dea34817fcc148d78f090ef5fa72304f, State: Initialized, Role: FOLLOWER
I20260709 13:09:26.320869 24929 raft_consensus.cc:515] T ab4ea1ceb7a443be94ec74cd88c9bf47 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:26.324491 24921 consensus_queue.cc:260] T 01f1144c4a1c482894ec993e5ce24bc4 P dea34817fcc148d78f090ef5fa72304f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:26.327410 24310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b130381d71460388507938ba053f8f" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace" is_pre_election: true
I20260709 13:09:26.334008 24236 raft_consensus.cc:1275] T 662a938528e545e6aa4592052da18101 P f8d4657116f948038a0c73018238c3ba [term 3 FOLLOWER]: Refusing update from remote peer b39c386162de49aca92dbebee7f06ace: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:26.334362 24238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab4ea1ceb7a443be94ec74cd88c9bf47" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8d4657116f948038a0c73018238c3ba" is_pre_election: true
I20260709 13:09:26.336427 24934 consensus_queue.cc:1048] T 662a938528e545e6aa4592052da18101 P b39c386162de49aca92dbebee7f06ace [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:26.337252 24164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab4ea1ceb7a443be94ec74cd88c9bf47" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" is_pre_election: true
I20260709 13:09:26.326152 24929 leader_election.cc:290] T ab4ea1ceb7a443be94ec74cd88c9bf47 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431), f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171)
I20260709 13:09:26.342926 24913 leader_election.cc:304] T ab4ea1ceb7a443be94ec74cd88c9bf47 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dea34817fcc148d78f090ef5fa72304f; no voters: c0f503bf8bb94af8a2a1139db4e1c0f5, f8d4657116f948038a0c73018238c3ba
I20260709 13:09:26.345129 24929 raft_consensus.cc:2749] T ab4ea1ceb7a443be94ec74cd88c9bf47 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:26.345875 24929 raft_consensus.cc:493] T 3bcebec1ac994b99a49430f4f892d615 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.346330 24929 raft_consensus.cc:515] T 3bcebec1ac994b99a49430f4f892d615 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:26.348968 24929 leader_election.cc:290] T 3bcebec1ac994b99a49430f4f892d615 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431), f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171)
I20260709 13:09:26.350220 24165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bcebec1ac994b99a49430f4f892d615" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" is_pre_election: true
I20260709 13:09:26.353240 24237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bcebec1ac994b99a49430f4f892d615" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8d4657116f948038a0c73018238c3ba" is_pre_election: true
I20260709 13:09:26.354929 24913 leader_election.cc:304] T 3bcebec1ac994b99a49430f4f892d615 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dea34817fcc148d78f090ef5fa72304f; no voters: c0f503bf8bb94af8a2a1139db4e1c0f5, f8d4657116f948038a0c73018238c3ba
I20260709 13:09:26.356386 24929 raft_consensus.cc:2749] T 3bcebec1ac994b99a49430f4f892d615 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:26.361121 24911 leader_election.cc:304] T 99b130381d71460388507938ba053f8f P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dea34817fcc148d78f090ef5fa72304f; no voters: b39c386162de49aca92dbebee7f06ace, c0f503bf8bb94af8a2a1139db4e1c0f5
I20260709 13:09:26.367376 24929 raft_consensus.cc:2749] T 99b130381d71460388507938ba053f8f P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:26.384563 24921 ts_tablet_manager.cc:1434] T 01f1144c4a1c482894ec993e5ce24bc4 P dea34817fcc148d78f090ef5fa72304f: Time spent starting tablet: real 0.065s	user 0.034s	sys 0.027s
I20260709 13:09:26.385617 24921 tablet_bootstrap.cc:492] T 42868db4862647c28215f3d7cb9adf02 P dea34817fcc148d78f090ef5fa72304f: Bootstrap starting.
I20260709 13:09:26.388854 23987 ts_manager.cc:194] Re-registered known tserver with Master: dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343)
I20260709 13:09:26.466760 24921 tablet_bootstrap.cc:492] T 42868db4862647c28215f3d7cb9adf02 P dea34817fcc148d78f090ef5fa72304f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:26.474936 24921 tablet_bootstrap.cc:492] T 42868db4862647c28215f3d7cb9adf02 P dea34817fcc148d78f090ef5fa72304f: Bootstrap complete.
I20260709 13:09:26.476442 24921 ts_tablet_manager.cc:1403] T 42868db4862647c28215f3d7cb9adf02 P dea34817fcc148d78f090ef5fa72304f: Time spent bootstrapping tablet: real 0.091s	user 0.014s	sys 0.006s
I20260709 13:09:26.495549 25074 raft_consensus.cc:493] T d17a6bbfc9d8478988b08964765c3b86 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.496225 25074 raft_consensus.cc:515] T d17a6bbfc9d8478988b08964765c3b86 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:26.500731 24311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d17a6bbfc9d8478988b08964765c3b86" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace" is_pre_election: true
I20260709 13:09:26.506568 24164 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d17a6bbfc9d8478988b08964765c3b86" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" is_pre_election: true
I20260709 13:09:26.508597 24914 leader_election.cc:304] T d17a6bbfc9d8478988b08964765c3b86 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dea34817fcc148d78f090ef5fa72304f; no voters: b39c386162de49aca92dbebee7f06ace, c0f503bf8bb94af8a2a1139db4e1c0f5
I20260709 13:09:26.509832 25073 raft_consensus.cc:2749] T d17a6bbfc9d8478988b08964765c3b86 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:26.511756 25074 leader_election.cc:290] T d17a6bbfc9d8478988b08964765c3b86 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561), c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431)
I20260709 13:09:26.518376 24921 raft_consensus.cc:359] T 42868db4862647c28215f3d7cb9adf02 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:26.519163 24921 raft_consensus.cc:740] T 42868db4862647c28215f3d7cb9adf02 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: dea34817fcc148d78f090ef5fa72304f, State: Initialized, Role: FOLLOWER
I20260709 13:09:26.520176 24921 consensus_queue.cc:260] T 42868db4862647c28215f3d7cb9adf02 P dea34817fcc148d78f090ef5fa72304f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:26.522604 24921 ts_tablet_manager.cc:1434] T 42868db4862647c28215f3d7cb9adf02 P dea34817fcc148d78f090ef5fa72304f: Time spent starting tablet: real 0.046s	user 0.007s	sys 0.001s
I20260709 13:09:26.523435 24921 tablet_bootstrap.cc:492] T e6f709868be149759ecdc073fe125bec P dea34817fcc148d78f090ef5fa72304f: Bootstrap starting.
I20260709 13:09:26.555226 23987 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37556
I20260709 13:09:26.563891 25004 raft_consensus.cc:3060] T 42868db4862647c28215f3d7cb9adf02 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:26.564636 25064 heartbeater.cc:499] Master 127.14.180.126:35949 was elected leader, sending a full tablet report...
I20260709 13:09:26.578632 25074 raft_consensus.cc:493] T aaf99a05bd8842ed9ea668a9da85dbcc P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.579200 25074 raft_consensus.cc:515] T aaf99a05bd8842ed9ea668a9da85dbcc P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:26.581413 25074 leader_election.cc:290] T aaf99a05bd8842ed9ea668a9da85dbcc P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171), b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561)
I20260709 13:09:26.587802 24237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaf99a05bd8842ed9ea668a9da85dbcc" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8d4657116f948038a0c73018238c3ba" is_pre_election: true
I20260709 13:09:26.593837 24311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aaf99a05bd8842ed9ea668a9da85dbcc" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace" is_pre_election: true
I20260709 13:09:26.610407 25013 raft_consensus.cc:3060] T f735173e22b242178edcdf4821b6f92b P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:26.610617 24911 leader_election.cc:304] T aaf99a05bd8842ed9ea668a9da85dbcc P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dea34817fcc148d78f090ef5fa72304f; no voters: b39c386162de49aca92dbebee7f06ace, f8d4657116f948038a0c73018238c3ba
I20260709 13:09:26.614719 25073 raft_consensus.cc:493] T 03e06f957f794ca696ddc7207eeabff0 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.615278 25073 raft_consensus.cc:515] T 03e06f957f794ca696ddc7207eeabff0 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:26.618408 25073 leader_election.cc:290] T 03e06f957f794ca696ddc7207eeabff0 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431), f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171)
I20260709 13:09:26.619637 24237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e06f957f794ca696ddc7207eeabff0" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8d4657116f948038a0c73018238c3ba" is_pre_election: true
I20260709 13:09:26.620059 24158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e06f957f794ca696ddc7207eeabff0" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" is_pre_election: true
I20260709 13:09:26.623003 24914 leader_election.cc:304] T 03e06f957f794ca696ddc7207eeabff0 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dea34817fcc148d78f090ef5fa72304f; no voters: c0f503bf8bb94af8a2a1139db4e1c0f5, f8d4657116f948038a0c73018238c3ba
I20260709 13:09:26.626778 25074 raft_consensus.cc:2749] T aaf99a05bd8842ed9ea668a9da85dbcc P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:26.631554 25073 raft_consensus.cc:2749] T 03e06f957f794ca696ddc7207eeabff0 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:26.647630 24921 tablet_bootstrap.cc:492] T e6f709868be149759ecdc073fe125bec P dea34817fcc148d78f090ef5fa72304f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:26.649420 24921 tablet_bootstrap.cc:492] T e6f709868be149759ecdc073fe125bec P dea34817fcc148d78f090ef5fa72304f: Bootstrap complete.
I20260709 13:09:26.651157 24921 ts_tablet_manager.cc:1403] T e6f709868be149759ecdc073fe125bec P dea34817fcc148d78f090ef5fa72304f: Time spent bootstrapping tablet: real 0.128s	user 0.027s	sys 0.012s
I20260709 13:09:26.656044 24921 raft_consensus.cc:359] T e6f709868be149759ecdc073fe125bec P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:26.659524 24921 raft_consensus.cc:740] T e6f709868be149759ecdc073fe125bec P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: dea34817fcc148d78f090ef5fa72304f, State: Initialized, Role: FOLLOWER
I20260709 13:09:26.660476 24921 consensus_queue.cc:260] T e6f709868be149759ecdc073fe125bec P dea34817fcc148d78f090ef5fa72304f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:26.683308 24921 ts_tablet_manager.cc:1434] T e6f709868be149759ecdc073fe125bec P dea34817fcc148d78f090ef5fa72304f: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.002s
I20260709 13:09:26.689401 24921 tablet_bootstrap.cc:492] T 9acec0d1a6e74a4bb39a0d867598acc5 P dea34817fcc148d78f090ef5fa72304f: Bootstrap starting.
I20260709 13:09:26.704819 24921 tablet_bootstrap.cc:492] T 9acec0d1a6e74a4bb39a0d867598acc5 P dea34817fcc148d78f090ef5fa72304f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:26.705827 24921 tablet_bootstrap.cc:492] T 9acec0d1a6e74a4bb39a0d867598acc5 P dea34817fcc148d78f090ef5fa72304f: Bootstrap complete.
I20260709 13:09:26.706640 24921 ts_tablet_manager.cc:1403] T 9acec0d1a6e74a4bb39a0d867598acc5 P dea34817fcc148d78f090ef5fa72304f: Time spent bootstrapping tablet: real 0.017s	user 0.016s	sys 0.000s
I20260709 13:09:26.709415 24921 raft_consensus.cc:359] T 9acec0d1a6e74a4bb39a0d867598acc5 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:26.710218 24921 raft_consensus.cc:740] T 9acec0d1a6e74a4bb39a0d867598acc5 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: dea34817fcc148d78f090ef5fa72304f, State: Initialized, Role: FOLLOWER
I20260709 13:09:26.711019 24921 consensus_queue.cc:260] T 9acec0d1a6e74a4bb39a0d867598acc5 P dea34817fcc148d78f090ef5fa72304f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:26.713743 24921 ts_tablet_manager.cc:1434] T 9acec0d1a6e74a4bb39a0d867598acc5 P dea34817fcc148d78f090ef5fa72304f: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:09:26.714743 24921 tablet_bootstrap.cc:492] T 5bc4e407c8b04739aa0290922bfdbed4 P dea34817fcc148d78f090ef5fa72304f: Bootstrap starting.
I20260709 13:09:26.734203 24921 tablet_bootstrap.cc:492] T 5bc4e407c8b04739aa0290922bfdbed4 P dea34817fcc148d78f090ef5fa72304f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:26.735277 24921 tablet_bootstrap.cc:492] T 5bc4e407c8b04739aa0290922bfdbed4 P dea34817fcc148d78f090ef5fa72304f: Bootstrap complete.
I20260709 13:09:26.736012 24921 ts_tablet_manager.cc:1403] T 5bc4e407c8b04739aa0290922bfdbed4 P dea34817fcc148d78f090ef5fa72304f: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.005s
I20260709 13:09:26.738804 24921 raft_consensus.cc:359] T 5bc4e407c8b04739aa0290922bfdbed4 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:26.739585 24921 raft_consensus.cc:740] T 5bc4e407c8b04739aa0290922bfdbed4 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: dea34817fcc148d78f090ef5fa72304f, State: Initialized, Role: FOLLOWER
I20260709 13:09:26.740254 24921 consensus_queue.cc:260] T 5bc4e407c8b04739aa0290922bfdbed4 P dea34817fcc148d78f090ef5fa72304f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:26.742511 24921 ts_tablet_manager.cc:1434] T 5bc4e407c8b04739aa0290922bfdbed4 P dea34817fcc148d78f090ef5fa72304f: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:09:26.743289 24921 tablet_bootstrap.cc:492] T 47fcd2aa8e994186872c2e0f9995dd8a P dea34817fcc148d78f090ef5fa72304f: Bootstrap starting.
I20260709 13:09:26.759789 24921 tablet_bootstrap.cc:492] T 47fcd2aa8e994186872c2e0f9995dd8a P dea34817fcc148d78f090ef5fa72304f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:26.760735 24921 tablet_bootstrap.cc:492] T 47fcd2aa8e994186872c2e0f9995dd8a P dea34817fcc148d78f090ef5fa72304f: Bootstrap complete.
I20260709 13:09:26.761318 24921 ts_tablet_manager.cc:1403] T 47fcd2aa8e994186872c2e0f9995dd8a P dea34817fcc148d78f090ef5fa72304f: Time spent bootstrapping tablet: real 0.018s	user 0.014s	sys 0.000s
I20260709 13:09:26.763525 24921 raft_consensus.cc:359] T 47fcd2aa8e994186872c2e0f9995dd8a P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:26.764216 24921 raft_consensus.cc:740] T 47fcd2aa8e994186872c2e0f9995dd8a P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: dea34817fcc148d78f090ef5fa72304f, State: Initialized, Role: FOLLOWER
I20260709 13:09:26.764834 24921 consensus_queue.cc:260] T 47fcd2aa8e994186872c2e0f9995dd8a P dea34817fcc148d78f090ef5fa72304f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:26.766846 24921 ts_tablet_manager.cc:1434] T 47fcd2aa8e994186872c2e0f9995dd8a P dea34817fcc148d78f090ef5fa72304f: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:09:26.767590 24921 tablet_bootstrap.cc:492] T a0ff7e0491fb406d9e1f13941504372f P dea34817fcc148d78f090ef5fa72304f: Bootstrap starting.
I20260709 13:09:26.790961 24921 tablet_bootstrap.cc:492] T a0ff7e0491fb406d9e1f13941504372f P dea34817fcc148d78f090ef5fa72304f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:26.792143 24921 tablet_bootstrap.cc:492] T a0ff7e0491fb406d9e1f13941504372f P dea34817fcc148d78f090ef5fa72304f: Bootstrap complete.
I20260709 13:09:26.793223 24921 ts_tablet_manager.cc:1403] T a0ff7e0491fb406d9e1f13941504372f P dea34817fcc148d78f090ef5fa72304f: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.008s
I20260709 13:09:26.796324 24921 raft_consensus.cc:359] T a0ff7e0491fb406d9e1f13941504372f P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:26.797247 24921 raft_consensus.cc:740] T a0ff7e0491fb406d9e1f13941504372f P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: dea34817fcc148d78f090ef5fa72304f, State: Initialized, Role: FOLLOWER
I20260709 13:09:26.799243 24921 consensus_queue.cc:260] T a0ff7e0491fb406d9e1f13941504372f P dea34817fcc148d78f090ef5fa72304f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:26.809686 24921 ts_tablet_manager.cc:1434] T a0ff7e0491fb406d9e1f13941504372f P dea34817fcc148d78f090ef5fa72304f: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:09:26.810798 24921 tablet_bootstrap.cc:492] T 502fe798081f4dc693eed179efa2a241 P dea34817fcc148d78f090ef5fa72304f: Bootstrap starting.
I20260709 13:09:26.848889 24921 tablet_bootstrap.cc:492] T 502fe798081f4dc693eed179efa2a241 P dea34817fcc148d78f090ef5fa72304f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:26.850063 24921 tablet_bootstrap.cc:492] T 502fe798081f4dc693eed179efa2a241 P dea34817fcc148d78f090ef5fa72304f: Bootstrap complete.
I20260709 13:09:26.850948 24921 ts_tablet_manager.cc:1403] T 502fe798081f4dc693eed179efa2a241 P dea34817fcc148d78f090ef5fa72304f: Time spent bootstrapping tablet: real 0.040s	user 0.014s	sys 0.014s
I20260709 13:09:26.858271 24921 raft_consensus.cc:359] T 502fe798081f4dc693eed179efa2a241 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:26.859107 24921 raft_consensus.cc:740] T 502fe798081f4dc693eed179efa2a241 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: dea34817fcc148d78f090ef5fa72304f, State: Initialized, Role: FOLLOWER
I20260709 13:09:26.860101 24921 consensus_queue.cc:260] T 502fe798081f4dc693eed179efa2a241 P dea34817fcc148d78f090ef5fa72304f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:26.862496 24921 ts_tablet_manager.cc:1434] T 502fe798081f4dc693eed179efa2a241 P dea34817fcc148d78f090ef5fa72304f: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:09:26.863597 24921 tablet_bootstrap.cc:492] T 65f010ca5ab74fa1b0f45b7d5dced706 P dea34817fcc148d78f090ef5fa72304f: Bootstrap starting.
I20260709 13:09:26.928085 24921 tablet_bootstrap.cc:492] T 65f010ca5ab74fa1b0f45b7d5dced706 P dea34817fcc148d78f090ef5fa72304f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:26.931646 24921 tablet_bootstrap.cc:492] T 65f010ca5ab74fa1b0f45b7d5dced706 P dea34817fcc148d78f090ef5fa72304f: Bootstrap complete.
I20260709 13:09:26.932437 24921 ts_tablet_manager.cc:1403] T 65f010ca5ab74fa1b0f45b7d5dced706 P dea34817fcc148d78f090ef5fa72304f: Time spent bootstrapping tablet: real 0.069s	user 0.027s	sys 0.016s
I20260709 13:09:26.935402 24921 raft_consensus.cc:359] T 65f010ca5ab74fa1b0f45b7d5dced706 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:26.936160 24921 raft_consensus.cc:740] T 65f010ca5ab74fa1b0f45b7d5dced706 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: dea34817fcc148d78f090ef5fa72304f, State: Initialized, Role: FOLLOWER
I20260709 13:09:26.937249 24921 consensus_queue.cc:260] T 65f010ca5ab74fa1b0f45b7d5dced706 P dea34817fcc148d78f090ef5fa72304f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:26.939901 24921 ts_tablet_manager.cc:1434] T 65f010ca5ab74fa1b0f45b7d5dced706 P dea34817fcc148d78f090ef5fa72304f: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:09:26.942087 25074 raft_consensus.cc:493] T e280ec3a0e394065aca766e4f8bef46d P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:26.942759 25074 raft_consensus.cc:515] T e280ec3a0e394065aca766e4f8bef46d P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:26.945060 25074 leader_election.cc:290] T e280ec3a0e394065aca766e4f8bef46d P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561), c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431)
I20260709 13:09:26.947530 24312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e280ec3a0e394065aca766e4f8bef46d" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b39c386162de49aca92dbebee7f06ace" is_pre_election: true
I20260709 13:09:26.947614 24158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e280ec3a0e394065aca766e4f8bef46d" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" is_pre_election: true
I20260709 13:09:26.949738 24921 tablet_bootstrap.cc:492] T 662a938528e545e6aa4592052da18101 P dea34817fcc148d78f090ef5fa72304f: Bootstrap starting.
I20260709 13:09:26.954659 24914 leader_election.cc:304] T e280ec3a0e394065aca766e4f8bef46d P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dea34817fcc148d78f090ef5fa72304f; no voters: b39c386162de49aca92dbebee7f06ace, c0f503bf8bb94af8a2a1139db4e1c0f5
I20260709 13:09:26.962811 25074 raft_consensus.cc:2749] T e280ec3a0e394065aca766e4f8bef46d P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:09:26.968488 24206 consensus_peers.cc:597] T ee2c640a38d44afebd95dfec0e30b0d6 P f8d4657116f948038a0c73018238c3ba -> Peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Couldn't send request to peer dea34817fcc148d78f090ef5fa72304f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:26.970062 24921 tablet_bootstrap.cc:492] T 662a938528e545e6aa4592052da18101 P dea34817fcc148d78f090ef5fa72304f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:26.971287 24921 tablet_bootstrap.cc:492] T 662a938528e545e6aa4592052da18101 P dea34817fcc148d78f090ef5fa72304f: Bootstrap complete.
I20260709 13:09:26.972167 24921 ts_tablet_manager.cc:1403] T 662a938528e545e6aa4592052da18101 P dea34817fcc148d78f090ef5fa72304f: Time spent bootstrapping tablet: real 0.030s	user 0.018s	sys 0.000s
I20260709 13:09:26.975284 24921 raft_consensus.cc:359] T 662a938528e545e6aa4592052da18101 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:26.976192 24921 raft_consensus.cc:740] T 662a938528e545e6aa4592052da18101 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: dea34817fcc148d78f090ef5fa72304f, State: Initialized, Role: FOLLOWER
I20260709 13:09:26.976998 24921 consensus_queue.cc:260] T 662a938528e545e6aa4592052da18101 P dea34817fcc148d78f090ef5fa72304f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:26.979732 24921 ts_tablet_manager.cc:1434] T 662a938528e545e6aa4592052da18101 P dea34817fcc148d78f090ef5fa72304f: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:09:26.981068 24921 tablet_bootstrap.cc:492] T 99078769583e49908dd6990f1d806453 P dea34817fcc148d78f090ef5fa72304f: Bootstrap starting.
I20260709 13:09:27.007206 24921 tablet_bootstrap.cc:492] T 99078769583e49908dd6990f1d806453 P dea34817fcc148d78f090ef5fa72304f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:27.008037 24921 tablet_bootstrap.cc:492] T 99078769583e49908dd6990f1d806453 P dea34817fcc148d78f090ef5fa72304f: Bootstrap complete.
I20260709 13:09:27.008677 24921 ts_tablet_manager.cc:1403] T 99078769583e49908dd6990f1d806453 P dea34817fcc148d78f090ef5fa72304f: Time spent bootstrapping tablet: real 0.028s	user 0.022s	sys 0.003s
I20260709 13:09:27.011484 24921 raft_consensus.cc:359] T 99078769583e49908dd6990f1d806453 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:27.019199 24921 raft_consensus.cc:740] T 99078769583e49908dd6990f1d806453 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: dea34817fcc148d78f090ef5fa72304f, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.020478 24921 consensus_queue.cc:260] T 99078769583e49908dd6990f1d806453 P dea34817fcc148d78f090ef5fa72304f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:27.023687 24921 ts_tablet_manager.cc:1434] T 99078769583e49908dd6990f1d806453 P dea34817fcc148d78f090ef5fa72304f: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.001s
I20260709 13:09:27.024637 24921 tablet_bootstrap.cc:492] T e845188d32d2466a92eacdb66da16dba P dea34817fcc148d78f090ef5fa72304f: Bootstrap starting.
I20260709 13:09:27.090050 25074 raft_consensus.cc:493] T 25e4818a4e2e4c9c9f7a8467aa9ef881 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:27.090971 25074 raft_consensus.cc:515] T 25e4818a4e2e4c9c9f7a8467aa9ef881 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:27.098212 24158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e4818a4e2e4c9c9f7a8467aa9ef881" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" is_pre_election: true
I20260709 13:09:27.100888 24237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25e4818a4e2e4c9c9f7a8467aa9ef881" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f8d4657116f948038a0c73018238c3ba" is_pre_election: true
I20260709 13:09:27.127488 24921 tablet_bootstrap.cc:492] T e845188d32d2466a92eacdb66da16dba P dea34817fcc148d78f090ef5fa72304f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:27.128700 24921 tablet_bootstrap.cc:492] T e845188d32d2466a92eacdb66da16dba P dea34817fcc148d78f090ef5fa72304f: Bootstrap complete.
I20260709 13:09:27.129493 24921 ts_tablet_manager.cc:1403] T e845188d32d2466a92eacdb66da16dba P dea34817fcc148d78f090ef5fa72304f: Time spent bootstrapping tablet: real 0.105s	user 0.025s	sys 0.013s
I20260709 13:09:27.129693 24913 leader_election.cc:304] T 25e4818a4e2e4c9c9f7a8467aa9ef881 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dea34817fcc148d78f090ef5fa72304f; no voters: c0f503bf8bb94af8a2a1139db4e1c0f5, f8d4657116f948038a0c73018238c3ba
I20260709 13:09:27.102566 25074 leader_election.cc:290] T 25e4818a4e2e4c9c9f7a8467aa9ef881 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431), f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171)
I20260709 13:09:27.130748 25073 raft_consensus.cc:2749] T 25e4818a4e2e4c9c9f7a8467aa9ef881 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:27.134210 24921 raft_consensus.cc:359] T e845188d32d2466a92eacdb66da16dba P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:27.134990 24921 raft_consensus.cc:740] T e845188d32d2466a92eacdb66da16dba P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: dea34817fcc148d78f090ef5fa72304f, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.135660 24921 consensus_queue.cc:260] T e845188d32d2466a92eacdb66da16dba P dea34817fcc148d78f090ef5fa72304f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:27.138449 24921 ts_tablet_manager.cc:1434] T e845188d32d2466a92eacdb66da16dba P dea34817fcc148d78f090ef5fa72304f: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
W20260709 13:09:27.159169 24206 consensus_peers.cc:597] T de5786fbd53646a9bc152ac0a2a9aa53 P f8d4657116f948038a0c73018238c3ba -> Peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Couldn't send request to peer dea34817fcc148d78f090ef5fa72304f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:09:27.165719 25011 raft_consensus.cc:3060] T 2dbbcd71c86041ba949fac653102e076 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:27.190405 24921 tablet_bootstrap.cc:492] T de5786fbd53646a9bc152ac0a2a9aa53 P dea34817fcc148d78f090ef5fa72304f: Bootstrap starting.
I20260709 13:09:27.225616 25013 raft_consensus.cc:3060] T 03e06f957f794ca696ddc7207eeabff0 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:27.232987 25007 raft_consensus.cc:3060] T e6f709868be149759ecdc073fe125bec P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:27.243875 25004 raft_consensus.cc:3060] T 1541f6b04d914d10823ad78c03d9a847 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:27.247897 25005 raft_consensus.cc:3060] T 5a8830d169ce4e46807d04168c3bb086 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:27.306202 24921 tablet_bootstrap.cc:492] T de5786fbd53646a9bc152ac0a2a9aa53 P dea34817fcc148d78f090ef5fa72304f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:27.307675 24921 tablet_bootstrap.cc:492] T de5786fbd53646a9bc152ac0a2a9aa53 P dea34817fcc148d78f090ef5fa72304f: Bootstrap complete.
I20260709 13:09:27.308637 24921 ts_tablet_manager.cc:1403] T de5786fbd53646a9bc152ac0a2a9aa53 P dea34817fcc148d78f090ef5fa72304f: Time spent bootstrapping tablet: real 0.119s	user 0.016s	sys 0.007s
I20260709 13:09:27.318774 25010 raft_consensus.cc:3060] T 662a938528e545e6aa4592052da18101 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:09:27.319259 24921 raft_consensus.cc:359] T de5786fbd53646a9bc152ac0a2a9aa53 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:27.320334 24921 raft_consensus.cc:740] T de5786fbd53646a9bc152ac0a2a9aa53 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: dea34817fcc148d78f090ef5fa72304f, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.340939 24921 consensus_queue.cc:260] T de5786fbd53646a9bc152ac0a2a9aa53 P dea34817fcc148d78f090ef5fa72304f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:27.344628 24921 ts_tablet_manager.cc:1434] T de5786fbd53646a9bc152ac0a2a9aa53 P dea34817fcc148d78f090ef5fa72304f: Time spent starting tablet: real 0.036s	user 0.010s	sys 0.000s
I20260709 13:09:27.371394 24921 tablet_bootstrap.cc:492] T ee2c640a38d44afebd95dfec0e30b0d6 P dea34817fcc148d78f090ef5fa72304f: Bootstrap starting.
I20260709 13:09:27.456264 24921 tablet_bootstrap.cc:492] T ee2c640a38d44afebd95dfec0e30b0d6 P dea34817fcc148d78f090ef5fa72304f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:27.457772 24921 tablet_bootstrap.cc:492] T ee2c640a38d44afebd95dfec0e30b0d6 P dea34817fcc148d78f090ef5fa72304f: Bootstrap complete.
I20260709 13:09:27.459448 24921 ts_tablet_manager.cc:1403] T ee2c640a38d44afebd95dfec0e30b0d6 P dea34817fcc148d78f090ef5fa72304f: Time spent bootstrapping tablet: real 0.088s	user 0.018s	sys 0.010s
I20260709 13:09:27.462687 24921 raft_consensus.cc:359] T ee2c640a38d44afebd95dfec0e30b0d6 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:27.463778 24921 raft_consensus.cc:740] T ee2c640a38d44afebd95dfec0e30b0d6 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: dea34817fcc148d78f090ef5fa72304f, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.464787 24921 consensus_queue.cc:260] T ee2c640a38d44afebd95dfec0e30b0d6 P dea34817fcc148d78f090ef5fa72304f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:27.468554 24921 ts_tablet_manager.cc:1434] T ee2c640a38d44afebd95dfec0e30b0d6 P dea34817fcc148d78f090ef5fa72304f: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:09:27.534463 25010 raft_consensus.cc:3060] T ee2c640a38d44afebd95dfec0e30b0d6 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:29.462965 24206 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:37431, user_credentials={real_user=slave}} blocked reactor thread for 47217.6us
W20260709 13:09:29.486908 24132 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:36343, user_credentials={real_user=slave}} blocked reactor thread for 70719.7us
I20260709 13:09:36.152181 15057 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:36.225522 24158 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "03e06f957f794ca696ddc7207eeabff0"
dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5"
mode: GRACEFUL
new_leader_uuid: "dea34817fcc148d78f090ef5fa72304f"
 from {username='slave'} at 127.0.0.1:55352
I20260709 13:09:36.226379 24158 raft_consensus.cc:606] T 03e06f957f794ca696ddc7207eeabff0 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 2 LEADER]: Received request to transfer leadership to TS dea34817fcc148d78f090ef5fa72304f
I20260709 13:09:36.229452 24158 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "518a35ead60847e98c0b76330b999d6f"
dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5"
mode: GRACEFUL
new_leader_uuid: "b39c386162de49aca92dbebee7f06ace"
 from {username='slave'} at 127.0.0.1:55352
I20260709 13:09:36.230054 24158 raft_consensus.cc:606] T 518a35ead60847e98c0b76330b999d6f P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 LEADER]: Received request to transfer leadership to TS b39c386162de49aca92dbebee7f06ace
I20260709 13:09:36.232872 24158 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "65f010ca5ab74fa1b0f45b7d5dced706"
dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5"
mode: GRACEFUL
new_leader_uuid: "dea34817fcc148d78f090ef5fa72304f"
 from {username='slave'} at 127.0.0.1:55352
I20260709 13:09:36.233402 24158 raft_consensus.cc:606] T 65f010ca5ab74fa1b0f45b7d5dced706 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 LEADER]: Received request to transfer leadership to TS dea34817fcc148d78f090ef5fa72304f
I20260709 13:09:36.247875 24238 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "861d7d76be4d484a9eb3acf8abffae5f"
dest_uuid: "f8d4657116f948038a0c73018238c3ba"
mode: GRACEFUL
new_leader_uuid: "dea34817fcc148d78f090ef5fa72304f"
 from {username='slave'} at 127.0.0.1:58896
I20260709 13:09:36.248689 24238 raft_consensus.cc:606] T 861d7d76be4d484a9eb3acf8abffae5f P f8d4657116f948038a0c73018238c3ba [term 1 LEADER]: Received request to transfer leadership to TS dea34817fcc148d78f090ef5fa72304f
I20260709 13:09:36.251842 24158 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "93e868a924d74bbc8bf29aa5a7fc67fd"
dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5"
mode: GRACEFUL
new_leader_uuid: "dea34817fcc148d78f090ef5fa72304f"
 from {username='slave'} at 127.0.0.1:55352
I20260709 13:09:36.252328 24158 raft_consensus.cc:606] T 93e868a924d74bbc8bf29aa5a7fc67fd P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 LEADER]: Received request to transfer leadership to TS dea34817fcc148d78f090ef5fa72304f
I20260709 13:09:36.254974 24158 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e335cd6afc4349cfaafa2970bccb40ff"
dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5"
mode: GRACEFUL
new_leader_uuid: "b39c386162de49aca92dbebee7f06ace"
 from {username='slave'} at 127.0.0.1:55352
I20260709 13:09:36.255425 24158 raft_consensus.cc:606] T e335cd6afc4349cfaafa2970bccb40ff P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 LEADER]: Received request to transfer leadership to TS b39c386162de49aca92dbebee7f06ace
I20260709 13:09:36.256549 15057 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:09:36.257838 15057 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:36.438017 25127 raft_consensus.cc:993] T 861d7d76be4d484a9eb3acf8abffae5f P f8d4657116f948038a0c73018238c3ba: : Instructing follower dea34817fcc148d78f090ef5fa72304f to start an election
I20260709 13:09:36.438706 25131 raft_consensus.cc:1081] T 861d7d76be4d484a9eb3acf8abffae5f P f8d4657116f948038a0c73018238c3ba [term 1 LEADER]: Signalling peer dea34817fcc148d78f090ef5fa72304f to start an election
I20260709 13:09:36.440399 25013 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "861d7d76be4d484a9eb3acf8abffae5f"
dest_uuid: "dea34817fcc148d78f090ef5fa72304f"
 from {username='slave'} at 127.0.0.1:37168
I20260709 13:09:36.440902 25013 raft_consensus.cc:493] T 861d7d76be4d484a9eb3acf8abffae5f P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:36.441193 25013 raft_consensus.cc:3060] T 861d7d76be4d484a9eb3acf8abffae5f P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:36.450060 25013 raft_consensus.cc:515] T 861d7d76be4d484a9eb3acf8abffae5f P dea34817fcc148d78f090ef5fa72304f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:36.451932 25013 leader_election.cc:290] T 861d7d76be4d484a9eb3acf8abffae5f P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 2 election: Requested vote from peers c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431), f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171)
I20260709 13:09:36.452929 24158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861d7d76be4d484a9eb3acf8abffae5f" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5"
I20260709 13:09:36.453168 24238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "861d7d76be4d484a9eb3acf8abffae5f" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f8d4657116f948038a0c73018238c3ba"
I20260709 13:09:36.453774 24158 raft_consensus.cc:3060] T 861d7d76be4d484a9eb3acf8abffae5f P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:36.453810 24238 raft_consensus.cc:3055] T 861d7d76be4d484a9eb3acf8abffae5f P f8d4657116f948038a0c73018238c3ba [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:36.454263 24238 raft_consensus.cc:740] T 861d7d76be4d484a9eb3acf8abffae5f P f8d4657116f948038a0c73018238c3ba [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f8d4657116f948038a0c73018238c3ba, State: Running, Role: LEADER
I20260709 13:09:36.455111 24238 consensus_queue.cc:260] T 861d7d76be4d484a9eb3acf8abffae5f P f8d4657116f948038a0c73018238c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:36.456353 24238 raft_consensus.cc:3060] T 861d7d76be4d484a9eb3acf8abffae5f P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:36.460320 24158 raft_consensus.cc:2468] T 861d7d76be4d484a9eb3acf8abffae5f P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dea34817fcc148d78f090ef5fa72304f in term 2.
I20260709 13:09:36.461839 24914 leader_election.cc:304] T 861d7d76be4d484a9eb3acf8abffae5f P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0f503bf8bb94af8a2a1139db4e1c0f5, dea34817fcc148d78f090ef5fa72304f; no voters: 
I20260709 13:09:36.462451 24238 raft_consensus.cc:2468] T 861d7d76be4d484a9eb3acf8abffae5f P f8d4657116f948038a0c73018238c3ba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dea34817fcc148d78f090ef5fa72304f in term 2.
I20260709 13:09:36.464738 25132 raft_consensus.cc:2804] T 861d7d76be4d484a9eb3acf8abffae5f P dea34817fcc148d78f090ef5fa72304f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:36.466288 25132 raft_consensus.cc:697] T 861d7d76be4d484a9eb3acf8abffae5f P dea34817fcc148d78f090ef5fa72304f [term 2 LEADER]: Becoming Leader. State: Replica: dea34817fcc148d78f090ef5fa72304f, State: Running, Role: LEADER
I20260709 13:09:36.467723 25132 consensus_queue.cc:237] T 861d7d76be4d484a9eb3acf8abffae5f P dea34817fcc148d78f090ef5fa72304f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:36.483153 23987 catalog_manager.cc:5697] T 861d7d76be4d484a9eb3acf8abffae5f P dea34817fcc148d78f090ef5fa72304f reported cstate change: term changed from 1 to 2, leader changed from f8d4657116f948038a0c73018238c3ba (127.14.180.67) to dea34817fcc148d78f090ef5fa72304f (127.14.180.65). New cstate: current_term: 2 leader_uuid: "dea34817fcc148d78f090ef5fa72304f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:36.581918 25112 raft_consensus.cc:993] T 518a35ead60847e98c0b76330b999d6f P c0f503bf8bb94af8a2a1139db4e1c0f5: : Instructing follower b39c386162de49aca92dbebee7f06ace to start an election
I20260709 13:09:36.582442 25126 raft_consensus.cc:1081] T 518a35ead60847e98c0b76330b999d6f P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 LEADER]: Signalling peer b39c386162de49aca92dbebee7f06ace to start an election
I20260709 13:09:36.584057 24311 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "518a35ead60847e98c0b76330b999d6f"
dest_uuid: "b39c386162de49aca92dbebee7f06ace"
 from {username='slave'} at 127.0.0.1:54318
I20260709 13:09:36.584564 24311 raft_consensus.cc:493] T 518a35ead60847e98c0b76330b999d6f P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:36.584851 24311 raft_consensus.cc:3060] T 518a35ead60847e98c0b76330b999d6f P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:36.591601 24311 raft_consensus.cc:515] T 518a35ead60847e98c0b76330b999d6f P b39c386162de49aca92dbebee7f06ace [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:36.593838 24311 leader_election.cc:290] T 518a35ead60847e98c0b76330b999d6f P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 2 election: Requested vote from peers c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431), f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171)
I20260709 13:09:36.594480 24158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "518a35ead60847e98c0b76330b999d6f" candidate_uuid: "b39c386162de49aca92dbebee7f06ace" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5"
I20260709 13:09:36.594831 24238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "518a35ead60847e98c0b76330b999d6f" candidate_uuid: "b39c386162de49aca92dbebee7f06ace" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f8d4657116f948038a0c73018238c3ba"
I20260709 13:09:36.595175 24158 raft_consensus.cc:3055] T 518a35ead60847e98c0b76330b999d6f P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:36.595468 24238 raft_consensus.cc:3060] T 518a35ead60847e98c0b76330b999d6f P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:36.595564 24158 raft_consensus.cc:740] T 518a35ead60847e98c0b76330b999d6f P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c0f503bf8bb94af8a2a1139db4e1c0f5, State: Running, Role: LEADER
I20260709 13:09:36.596582 24158 consensus_queue.cc:260] T 518a35ead60847e98c0b76330b999d6f P c0f503bf8bb94af8a2a1139db4e1c0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:36.597819 24158 raft_consensus.cc:3060] T 518a35ead60847e98c0b76330b999d6f P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:36.606532 24158 raft_consensus.cc:2468] T 518a35ead60847e98c0b76330b999d6f P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b39c386162de49aca92dbebee7f06ace in term 2.
I20260709 13:09:36.609166 24238 raft_consensus.cc:2468] T 518a35ead60847e98c0b76330b999d6f P f8d4657116f948038a0c73018238c3ba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b39c386162de49aca92dbebee7f06ace in term 2.
I20260709 13:09:36.611025 24279 leader_election.cc:304] T 518a35ead60847e98c0b76330b999d6f P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b39c386162de49aca92dbebee7f06ace, f8d4657116f948038a0c73018238c3ba; no voters: 
I20260709 13:09:36.612802 25125 raft_consensus.cc:2804] T 518a35ead60847e98c0b76330b999d6f P b39c386162de49aca92dbebee7f06ace [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:36.613451 25125 raft_consensus.cc:697] T 518a35ead60847e98c0b76330b999d6f P b39c386162de49aca92dbebee7f06ace [term 2 LEADER]: Becoming Leader. State: Replica: b39c386162de49aca92dbebee7f06ace, State: Running, Role: LEADER
I20260709 13:09:36.614585 25125 consensus_queue.cc:237] T 518a35ead60847e98c0b76330b999d6f P b39c386162de49aca92dbebee7f06ace [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:36.618155 25126 raft_consensus.cc:993] T 03e06f957f794ca696ddc7207eeabff0 P c0f503bf8bb94af8a2a1139db4e1c0f5: : Instructing follower dea34817fcc148d78f090ef5fa72304f to start an election
I20260709 13:09:36.618822 25112 raft_consensus.cc:1081] T 03e06f957f794ca696ddc7207eeabff0 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 2 LEADER]: Signalling peer dea34817fcc148d78f090ef5fa72304f to start an election
I20260709 13:09:36.620611 25005 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "03e06f957f794ca696ddc7207eeabff0"
dest_uuid: "dea34817fcc148d78f090ef5fa72304f"
 from {username='slave'} at 127.0.0.1:37108
I20260709 13:09:36.624420 25005 raft_consensus.cc:493] T 03e06f957f794ca696ddc7207eeabff0 P dea34817fcc148d78f090ef5fa72304f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:36.624782 25005 raft_consensus.cc:3060] T 03e06f957f794ca696ddc7207eeabff0 P dea34817fcc148d78f090ef5fa72304f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:36.625731 25126 raft_consensus.cc:993] T e335cd6afc4349cfaafa2970bccb40ff P c0f503bf8bb94af8a2a1139db4e1c0f5: : Instructing follower b39c386162de49aca92dbebee7f06ace to start an election
I20260709 13:09:36.626289 25112 raft_consensus.cc:1081] T e335cd6afc4349cfaafa2970bccb40ff P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 LEADER]: Signalling peer b39c386162de49aca92dbebee7f06ace to start an election
I20260709 13:09:36.628427 23987 catalog_manager.cc:5697] T 518a35ead60847e98c0b76330b999d6f P b39c386162de49aca92dbebee7f06ace reported cstate change: term changed from 1 to 2, leader changed from c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66) to b39c386162de49aca92dbebee7f06ace (127.14.180.68). New cstate: current_term: 2 leader_uuid: "b39c386162de49aca92dbebee7f06ace" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:36.631341 24311 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e335cd6afc4349cfaafa2970bccb40ff"
dest_uuid: "b39c386162de49aca92dbebee7f06ace"
 from {username='slave'} at 127.0.0.1:54318
I20260709 13:09:36.632016 24311 raft_consensus.cc:493] T e335cd6afc4349cfaafa2970bccb40ff P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:36.631632 25005 raft_consensus.cc:515] T 03e06f957f794ca696ddc7207eeabff0 P dea34817fcc148d78f090ef5fa72304f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:36.632449 24311 raft_consensus.cc:3060] T e335cd6afc4349cfaafa2970bccb40ff P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:36.634642 24158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e06f957f794ca696ddc7207eeabff0" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5"
I20260709 13:09:36.635205 24158 raft_consensus.cc:3055] T 03e06f957f794ca696ddc7207eeabff0 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:36.635406 25005 leader_election.cc:290] T 03e06f957f794ca696ddc7207eeabff0 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 3 election: Requested vote from peers c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431), f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171)
I20260709 13:09:36.635493 24158 raft_consensus.cc:740] T 03e06f957f794ca696ddc7207eeabff0 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c0f503bf8bb94af8a2a1139db4e1c0f5, State: Running, Role: LEADER
I20260709 13:09:36.636617 24158 consensus_queue.cc:260] T 03e06f957f794ca696ddc7207eeabff0 P c0f503bf8bb94af8a2a1139db4e1c0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:36.637728 24158 raft_consensus.cc:3060] T 03e06f957f794ca696ddc7207eeabff0 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:36.637841 24238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03e06f957f794ca696ddc7207eeabff0" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f8d4657116f948038a0c73018238c3ba"
I20260709 13:09:36.638499 24238 raft_consensus.cc:3060] T 03e06f957f794ca696ddc7207eeabff0 P f8d4657116f948038a0c73018238c3ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:36.643429 24311 raft_consensus.cc:515] T e335cd6afc4349cfaafa2970bccb40ff P b39c386162de49aca92dbebee7f06ace [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:36.646251 24165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e335cd6afc4349cfaafa2970bccb40ff" candidate_uuid: "b39c386162de49aca92dbebee7f06ace" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5"
I20260709 13:09:36.646772 24237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e335cd6afc4349cfaafa2970bccb40ff" candidate_uuid: "b39c386162de49aca92dbebee7f06ace" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f8d4657116f948038a0c73018238c3ba"
I20260709 13:09:36.645673 24158 raft_consensus.cc:2468] T 03e06f957f794ca696ddc7207eeabff0 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dea34817fcc148d78f090ef5fa72304f in term 3.
I20260709 13:09:36.647372 24237 raft_consensus.cc:3060] T e335cd6afc4349cfaafa2970bccb40ff P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:36.647610 24311 leader_election.cc:290] T e335cd6afc4349cfaafa2970bccb40ff P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 2 election: Requested vote from peers c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431), f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171)
I20260709 13:09:36.648798 24914 leader_election.cc:304] T 03e06f957f794ca696ddc7207eeabff0 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0f503bf8bb94af8a2a1139db4e1c0f5, dea34817fcc148d78f090ef5fa72304f; no voters: 
I20260709 13:09:36.646914 24165 raft_consensus.cc:3055] T e335cd6afc4349cfaafa2970bccb40ff P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:36.650794 24165 raft_consensus.cc:740] T e335cd6afc4349cfaafa2970bccb40ff P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c0f503bf8bb94af8a2a1139db4e1c0f5, State: Running, Role: LEADER
I20260709 13:09:36.651198 24238 raft_consensus.cc:2468] T 03e06f957f794ca696ddc7207eeabff0 P f8d4657116f948038a0c73018238c3ba [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dea34817fcc148d78f090ef5fa72304f in term 3.
I20260709 13:09:36.651660 24165 consensus_queue.cc:260] T e335cd6afc4349cfaafa2970bccb40ff P c0f503bf8bb94af8a2a1139db4e1c0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:36.653066 24165 raft_consensus.cc:3060] T e335cd6afc4349cfaafa2970bccb40ff P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:36.652721 25132 raft_consensus.cc:2804] T 03e06f957f794ca696ddc7207eeabff0 P dea34817fcc148d78f090ef5fa72304f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:36.655280 25132 raft_consensus.cc:697] T 03e06f957f794ca696ddc7207eeabff0 P dea34817fcc148d78f090ef5fa72304f [term 3 LEADER]: Becoming Leader. State: Replica: dea34817fcc148d78f090ef5fa72304f, State: Running, Role: LEADER
I20260709 13:09:36.656265 25132 consensus_queue.cc:237] T 03e06f957f794ca696ddc7207eeabff0 P dea34817fcc148d78f090ef5fa72304f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:36.657747 24237 raft_consensus.cc:2468] T e335cd6afc4349cfaafa2970bccb40ff P f8d4657116f948038a0c73018238c3ba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b39c386162de49aca92dbebee7f06ace in term 2.
I20260709 13:09:36.659088 24279 leader_election.cc:304] T e335cd6afc4349cfaafa2970bccb40ff P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b39c386162de49aca92dbebee7f06ace, f8d4657116f948038a0c73018238c3ba; no voters: 
I20260709 13:09:36.660187 25122 raft_consensus.cc:2804] T e335cd6afc4349cfaafa2970bccb40ff P b39c386162de49aca92dbebee7f06ace [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:36.663975 24165 raft_consensus.cc:2468] T e335cd6afc4349cfaafa2970bccb40ff P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b39c386162de49aca92dbebee7f06ace in term 2.
I20260709 13:09:36.673614 25122 raft_consensus.cc:697] T e335cd6afc4349cfaafa2970bccb40ff P b39c386162de49aca92dbebee7f06ace [term 2 LEADER]: Becoming Leader. State: Replica: b39c386162de49aca92dbebee7f06ace, State: Running, Role: LEADER
I20260709 13:09:36.675137 25122 consensus_queue.cc:237] T e335cd6afc4349cfaafa2970bccb40ff P b39c386162de49aca92dbebee7f06ace [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:36.695797 23987 catalog_manager.cc:5697] T 03e06f957f794ca696ddc7207eeabff0 P dea34817fcc148d78f090ef5fa72304f reported cstate change: term changed from 2 to 3, leader changed from c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66) to dea34817fcc148d78f090ef5fa72304f (127.14.180.65). New cstate: current_term: 3 leader_uuid: "dea34817fcc148d78f090ef5fa72304f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:36.702315 25126 raft_consensus.cc:993] T 65f010ca5ab74fa1b0f45b7d5dced706 P c0f503bf8bb94af8a2a1139db4e1c0f5: : Instructing follower dea34817fcc148d78f090ef5fa72304f to start an election
I20260709 13:09:36.702916 25126 raft_consensus.cc:993] T 93e868a924d74bbc8bf29aa5a7fc67fd P c0f503bf8bb94af8a2a1139db4e1c0f5: : Instructing follower dea34817fcc148d78f090ef5fa72304f to start an election
I20260709 13:09:36.703256 25140 raft_consensus.cc:1081] T 65f010ca5ab74fa1b0f45b7d5dced706 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 LEADER]: Signalling peer dea34817fcc148d78f090ef5fa72304f to start an election
I20260709 13:09:36.703377 25126 raft_consensus.cc:1081] T 93e868a924d74bbc8bf29aa5a7fc67fd P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 LEADER]: Signalling peer dea34817fcc148d78f090ef5fa72304f to start an election
I20260709 13:09:36.701921 23985 catalog_manager.cc:5697] T e335cd6afc4349cfaafa2970bccb40ff P b39c386162de49aca92dbebee7f06ace reported cstate change: term changed from 1 to 2, leader changed from c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66) to b39c386162de49aca92dbebee7f06ace (127.14.180.68). New cstate: current_term: 2 leader_uuid: "b39c386162de49aca92dbebee7f06ace" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:36.706599 25010 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "65f010ca5ab74fa1b0f45b7d5dced706"
dest_uuid: "dea34817fcc148d78f090ef5fa72304f"
 from {username='slave'} at 127.0.0.1:37108
I20260709 13:09:36.706930 25005 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "93e868a924d74bbc8bf29aa5a7fc67fd"
dest_uuid: "dea34817fcc148d78f090ef5fa72304f"
 from {username='slave'} at 127.0.0.1:37108
I20260709 13:09:36.707247 25010 raft_consensus.cc:493] T 65f010ca5ab74fa1b0f45b7d5dced706 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:36.707499 25005 raft_consensus.cc:493] T 93e868a924d74bbc8bf29aa5a7fc67fd P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:36.707690 25010 raft_consensus.cc:3060] T 65f010ca5ab74fa1b0f45b7d5dced706 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:36.707890 25005 raft_consensus.cc:3060] T 93e868a924d74bbc8bf29aa5a7fc67fd P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:36.716615 25005 raft_consensus.cc:515] T 93e868a924d74bbc8bf29aa5a7fc67fd P dea34817fcc148d78f090ef5fa72304f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:36.716325 25010 raft_consensus.cc:515] T 65f010ca5ab74fa1b0f45b7d5dced706 P dea34817fcc148d78f090ef5fa72304f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:36.719228 24165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e868a924d74bbc8bf29aa5a7fc67fd" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5"
I20260709 13:09:36.720543 24165 raft_consensus.cc:3055] T 93e868a924d74bbc8bf29aa5a7fc67fd P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:36.720677 24237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e868a924d74bbc8bf29aa5a7fc67fd" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f8d4657116f948038a0c73018238c3ba"
I20260709 13:09:36.720959 24165 raft_consensus.cc:740] T 93e868a924d74bbc8bf29aa5a7fc67fd P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c0f503bf8bb94af8a2a1139db4e1c0f5, State: Running, Role: LEADER
I20260709 13:09:36.721063 24238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65f010ca5ab74fa1b0f45b7d5dced706" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f8d4657116f948038a0c73018238c3ba"
I20260709 13:09:36.721290 24237 raft_consensus.cc:3060] T 93e868a924d74bbc8bf29aa5a7fc67fd P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:36.721633 24238 raft_consensus.cc:3060] T 65f010ca5ab74fa1b0f45b7d5dced706 P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:36.721892 24165 consensus_queue.cc:260] T 93e868a924d74bbc8bf29aa5a7fc67fd P c0f503bf8bb94af8a2a1139db4e1c0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:36.722976 24165 raft_consensus.cc:3060] T 93e868a924d74bbc8bf29aa5a7fc67fd P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:36.728533 24237 raft_consensus.cc:2468] T 93e868a924d74bbc8bf29aa5a7fc67fd P f8d4657116f948038a0c73018238c3ba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dea34817fcc148d78f090ef5fa72304f in term 2.
I20260709 13:09:36.719437 25005 leader_election.cc:290] T 93e868a924d74bbc8bf29aa5a7fc67fd P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 2 election: Requested vote from peers c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431), f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171)
I20260709 13:09:36.719579 24158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65f010ca5ab74fa1b0f45b7d5dced706" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5"
I20260709 13:09:36.729709 24158 raft_consensus.cc:3055] T 65f010ca5ab74fa1b0f45b7d5dced706 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:36.729987 24158 raft_consensus.cc:740] T 65f010ca5ab74fa1b0f45b7d5dced706 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c0f503bf8bb94af8a2a1139db4e1c0f5, State: Running, Role: LEADER
I20260709 13:09:36.731088 24158 consensus_queue.cc:260] T 65f010ca5ab74fa1b0f45b7d5dced706 P c0f503bf8bb94af8a2a1139db4e1c0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:36.731215 24913 leader_election.cc:304] T 93e868a924d74bbc8bf29aa5a7fc67fd P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dea34817fcc148d78f090ef5fa72304f, f8d4657116f948038a0c73018238c3ba; no voters: 
I20260709 13:09:36.732216 24158 raft_consensus.cc:3060] T 65f010ca5ab74fa1b0f45b7d5dced706 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:36.733840 24165 raft_consensus.cc:2468] T 93e868a924d74bbc8bf29aa5a7fc67fd P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dea34817fcc148d78f090ef5fa72304f in term 2.
I20260709 13:09:36.736136 25132 raft_consensus.cc:2804] T 93e868a924d74bbc8bf29aa5a7fc67fd P dea34817fcc148d78f090ef5fa72304f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:36.736748 25132 raft_consensus.cc:697] T 93e868a924d74bbc8bf29aa5a7fc67fd P dea34817fcc148d78f090ef5fa72304f [term 2 LEADER]: Becoming Leader. State: Replica: dea34817fcc148d78f090ef5fa72304f, State: Running, Role: LEADER
I20260709 13:09:36.737706 25132 consensus_queue.cc:237] T 93e868a924d74bbc8bf29aa5a7fc67fd P dea34817fcc148d78f090ef5fa72304f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:36.719521 25010 leader_election.cc:290] T 65f010ca5ab74fa1b0f45b7d5dced706 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 2 election: Requested vote from peers c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431), f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171)
I20260709 13:09:36.728502 24238 raft_consensus.cc:2468] T 65f010ca5ab74fa1b0f45b7d5dced706 P f8d4657116f948038a0c73018238c3ba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dea34817fcc148d78f090ef5fa72304f in term 2.
I20260709 13:09:36.739924 24158 raft_consensus.cc:2468] T 65f010ca5ab74fa1b0f45b7d5dced706 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dea34817fcc148d78f090ef5fa72304f in term 2.
I20260709 13:09:36.741705 24913 leader_election.cc:304] T 65f010ca5ab74fa1b0f45b7d5dced706 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dea34817fcc148d78f090ef5fa72304f, f8d4657116f948038a0c73018238c3ba; no voters: 
I20260709 13:09:36.744042 25133 raft_consensus.cc:2804] T 65f010ca5ab74fa1b0f45b7d5dced706 P dea34817fcc148d78f090ef5fa72304f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:36.752931 25133 raft_consensus.cc:697] T 65f010ca5ab74fa1b0f45b7d5dced706 P dea34817fcc148d78f090ef5fa72304f [term 2 LEADER]: Becoming Leader. State: Replica: dea34817fcc148d78f090ef5fa72304f, State: Running, Role: LEADER
I20260709 13:09:36.755369 25133 consensus_queue.cc:237] T 65f010ca5ab74fa1b0f45b7d5dced706 P dea34817fcc148d78f090ef5fa72304f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:36.759312 23985 catalog_manager.cc:5697] T 93e868a924d74bbc8bf29aa5a7fc67fd P dea34817fcc148d78f090ef5fa72304f reported cstate change: term changed from 1 to 2, leader changed from c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66) to dea34817fcc148d78f090ef5fa72304f (127.14.180.65). New cstate: current_term: 2 leader_uuid: "dea34817fcc148d78f090ef5fa72304f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:36.783954 23985 catalog_manager.cc:5697] T 65f010ca5ab74fa1b0f45b7d5dced706 P dea34817fcc148d78f090ef5fa72304f reported cstate change: term changed from 1 to 2, leader changed from c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66) to dea34817fcc148d78f090ef5fa72304f (127.14.180.65). New cstate: current_term: 2 leader_uuid: "dea34817fcc148d78f090ef5fa72304f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:36.990185 24158 raft_consensus.cc:1275] T 861d7d76be4d484a9eb3acf8abffae5f P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 2 FOLLOWER]: Refusing update from remote peer dea34817fcc148d78f090ef5fa72304f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:36.991634 25133 consensus_queue.cc:1048] T 861d7d76be4d484a9eb3acf8abffae5f P dea34817fcc148d78f090ef5fa72304f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:37.004318 24237 raft_consensus.cc:1275] T 861d7d76be4d484a9eb3acf8abffae5f P f8d4657116f948038a0c73018238c3ba [term 2 FOLLOWER]: Refusing update from remote peer dea34817fcc148d78f090ef5fa72304f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:37.007704 25132 consensus_queue.cc:1048] T 861d7d76be4d484a9eb3acf8abffae5f P dea34817fcc148d78f090ef5fa72304f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:37.051757 24158 raft_consensus.cc:1275] T 518a35ead60847e98c0b76330b999d6f P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 2 FOLLOWER]: Refusing update from remote peer b39c386162de49aca92dbebee7f06ace: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:37.053009 24165 raft_consensus.cc:1275] T 03e06f957f794ca696ddc7207eeabff0 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 3 FOLLOWER]: Refusing update from remote peer dea34817fcc148d78f090ef5fa72304f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:37.053432 25143 consensus_queue.cc:1048] T 518a35ead60847e98c0b76330b999d6f P b39c386162de49aca92dbebee7f06ace [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:37.054382 25132 consensus_queue.cc:1048] T 03e06f957f794ca696ddc7207eeabff0 P dea34817fcc148d78f090ef5fa72304f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:37.056989 24237 raft_consensus.cc:1275] T 03e06f957f794ca696ddc7207eeabff0 P f8d4657116f948038a0c73018238c3ba [term 3 FOLLOWER]: Refusing update from remote peer dea34817fcc148d78f090ef5fa72304f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:37.058647 25133 consensus_queue.cc:1048] T 03e06f957f794ca696ddc7207eeabff0 P dea34817fcc148d78f090ef5fa72304f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:37.116048 24237 raft_consensus.cc:1275] T 518a35ead60847e98c0b76330b999d6f P f8d4657116f948038a0c73018238c3ba [term 2 FOLLOWER]: Refusing update from remote peer b39c386162de49aca92dbebee7f06ace: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:37.117586 25143 consensus_queue.cc:1048] T 518a35ead60847e98c0b76330b999d6f P b39c386162de49aca92dbebee7f06ace [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:37.144438 24237 raft_consensus.cc:1275] T 65f010ca5ab74fa1b0f45b7d5dced706 P f8d4657116f948038a0c73018238c3ba [term 2 FOLLOWER]: Refusing update from remote peer dea34817fcc148d78f090ef5fa72304f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:37.146740 25132 consensus_queue.cc:1048] T 65f010ca5ab74fa1b0f45b7d5dced706 P dea34817fcc148d78f090ef5fa72304f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:37.160019 24158 raft_consensus.cc:1275] T 65f010ca5ab74fa1b0f45b7d5dced706 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 2 FOLLOWER]: Refusing update from remote peer dea34817fcc148d78f090ef5fa72304f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:37.161527 25132 consensus_queue.cc:1048] T 65f010ca5ab74fa1b0f45b7d5dced706 P dea34817fcc148d78f090ef5fa72304f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:37.219691 24237 raft_consensus.cc:1275] T e335cd6afc4349cfaafa2970bccb40ff P f8d4657116f948038a0c73018238c3ba [term 2 FOLLOWER]: Refusing update from remote peer b39c386162de49aca92dbebee7f06ace: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:37.221181 25122 consensus_queue.cc:1048] T e335cd6afc4349cfaafa2970bccb40ff P b39c386162de49aca92dbebee7f06ace [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:37.221800 24158 raft_consensus.cc:1275] T e335cd6afc4349cfaafa2970bccb40ff P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 2 FOLLOWER]: Refusing update from remote peer b39c386162de49aca92dbebee7f06ace: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:37.223510 25122 consensus_queue.cc:1048] T e335cd6afc4349cfaafa2970bccb40ff P b39c386162de49aca92dbebee7f06ace [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:37.258834 15057 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:37.279237 24237 raft_consensus.cc:1275] T 93e868a924d74bbc8bf29aa5a7fc67fd P f8d4657116f948038a0c73018238c3ba [term 2 FOLLOWER]: Refusing update from remote peer dea34817fcc148d78f090ef5fa72304f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:37.280592 25132 consensus_queue.cc:1048] T 93e868a924d74bbc8bf29aa5a7fc67fd P dea34817fcc148d78f090ef5fa72304f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:37.297196 24165 raft_consensus.cc:1275] T 93e868a924d74bbc8bf29aa5a7fc67fd P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 2 FOLLOWER]: Refusing update from remote peer dea34817fcc148d78f090ef5fa72304f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:37.300631 25149 consensus_queue.cc:1048] T 93e868a924d74bbc8bf29aa5a7fc67fd P dea34817fcc148d78f090ef5fa72304f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:37.325759 15057 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:37.379999 24237 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3bcebec1ac994b99a49430f4f892d615"
dest_uuid: "f8d4657116f948038a0c73018238c3ba"
mode: GRACEFUL
new_leader_uuid: "dea34817fcc148d78f090ef5fa72304f"
 from {username='slave'} at 127.0.0.1:58896
I20260709 13:09:37.380962 24237 raft_consensus.cc:606] T 3bcebec1ac994b99a49430f4f892d615 P f8d4657116f948038a0c73018238c3ba [term 1 LEADER]: Received request to transfer leadership to TS dea34817fcc148d78f090ef5fa72304f
I20260709 13:09:37.406106 24312 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "518a35ead60847e98c0b76330b999d6f"
dest_uuid: "b39c386162de49aca92dbebee7f06ace"
mode: GRACEFUL
new_leader_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5"
 from {username='slave'} at 127.0.0.1:36444
I20260709 13:09:37.406795 24312 raft_consensus.cc:606] T 518a35ead60847e98c0b76330b999d6f P b39c386162de49aca92dbebee7f06ace [term 2 LEADER]: Received request to transfer leadership to TS c0f503bf8bb94af8a2a1139db4e1c0f5
I20260709 13:09:37.409813 24237 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6bdf4f0b87584bdab10ccc418ab54f02"
dest_uuid: "f8d4657116f948038a0c73018238c3ba"
mode: GRACEFUL
new_leader_uuid: "b39c386162de49aca92dbebee7f06ace"
 from {username='slave'} at 127.0.0.1:58896
I20260709 13:09:37.410430 24237 raft_consensus.cc:606] T 6bdf4f0b87584bdab10ccc418ab54f02 P f8d4657116f948038a0c73018238c3ba [term 1 LEADER]: Received request to transfer leadership to TS b39c386162de49aca92dbebee7f06ace
I20260709 13:09:37.413369 24237 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "71cb3d981445473ca321bbe44299879c"
dest_uuid: "f8d4657116f948038a0c73018238c3ba"
mode: GRACEFUL
new_leader_uuid: "b39c386162de49aca92dbebee7f06ace"
 from {username='slave'} at 127.0.0.1:58896
I20260709 13:09:37.414095 24237 raft_consensus.cc:606] T 71cb3d981445473ca321bbe44299879c P f8d4657116f948038a0c73018238c3ba [term 1 LEADER]: Received request to transfer leadership to TS b39c386162de49aca92dbebee7f06ace
I20260709 13:09:37.425482 24237 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e21ef2f479764142935dc2b1b7e87220"
dest_uuid: "f8d4657116f948038a0c73018238c3ba"
mode: GRACEFUL
new_leader_uuid: "dea34817fcc148d78f090ef5fa72304f"
 from {username='slave'} at 127.0.0.1:58896
I20260709 13:09:37.427960 24237 raft_consensus.cc:606] T e21ef2f479764142935dc2b1b7e87220 P f8d4657116f948038a0c73018238c3ba [term 1 LEADER]: Received request to transfer leadership to TS dea34817fcc148d78f090ef5fa72304f
I20260709 13:09:37.429941 15057 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:09:37.433215 15057 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:37.585510 25127 raft_consensus.cc:993] T 71cb3d981445473ca321bbe44299879c P f8d4657116f948038a0c73018238c3ba: : Instructing follower b39c386162de49aca92dbebee7f06ace to start an election
I20260709 13:09:37.586179 25123 raft_consensus.cc:1081] T 71cb3d981445473ca321bbe44299879c P f8d4657116f948038a0c73018238c3ba [term 1 LEADER]: Signalling peer b39c386162de49aca92dbebee7f06ace to start an election
I20260709 13:09:37.588544 24311 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "71cb3d981445473ca321bbe44299879c"
dest_uuid: "b39c386162de49aca92dbebee7f06ace"
 from {username='slave'} at 127.0.0.1:54334
I20260709 13:09:37.589128 24311 raft_consensus.cc:493] T 71cb3d981445473ca321bbe44299879c P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:37.589488 24311 raft_consensus.cc:3060] T 71cb3d981445473ca321bbe44299879c P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:37.597285 24311 raft_consensus.cc:515] T 71cb3d981445473ca321bbe44299879c P b39c386162de49aca92dbebee7f06ace [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:37.598904 24311 leader_election.cc:290] T 71cb3d981445473ca321bbe44299879c P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 2 election: Requested vote from peers c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431), f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171)
I20260709 13:09:37.599895 24165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71cb3d981445473ca321bbe44299879c" candidate_uuid: "b39c386162de49aca92dbebee7f06ace" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5"
I20260709 13:09:37.599937 24237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71cb3d981445473ca321bbe44299879c" candidate_uuid: "b39c386162de49aca92dbebee7f06ace" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f8d4657116f948038a0c73018238c3ba"
I20260709 13:09:37.600662 24165 raft_consensus.cc:3060] T 71cb3d981445473ca321bbe44299879c P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:37.600772 24237 raft_consensus.cc:3055] T 71cb3d981445473ca321bbe44299879c P f8d4657116f948038a0c73018238c3ba [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:37.601290 24237 raft_consensus.cc:740] T 71cb3d981445473ca321bbe44299879c P f8d4657116f948038a0c73018238c3ba [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f8d4657116f948038a0c73018238c3ba, State: Running, Role: LEADER
I20260709 13:09:37.602758 24237 consensus_queue.cc:260] T 71cb3d981445473ca321bbe44299879c P f8d4657116f948038a0c73018238c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:37.604028 24237 raft_consensus.cc:3060] T 71cb3d981445473ca321bbe44299879c P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:37.608598 24165 raft_consensus.cc:2468] T 71cb3d981445473ca321bbe44299879c P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b39c386162de49aca92dbebee7f06ace in term 2.
I20260709 13:09:37.610033 25125 raft_consensus.cc:993] T 518a35ead60847e98c0b76330b999d6f P b39c386162de49aca92dbebee7f06ace: : Instructing follower c0f503bf8bb94af8a2a1139db4e1c0f5 to start an election
I20260709 13:09:37.610522 24280 leader_election.cc:304] T 71cb3d981445473ca321bbe44299879c P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b39c386162de49aca92dbebee7f06ace, c0f503bf8bb94af8a2a1139db4e1c0f5; no voters: 
I20260709 13:09:37.610646 25125 raft_consensus.cc:1081] T 518a35ead60847e98c0b76330b999d6f P b39c386162de49aca92dbebee7f06ace [term 2 LEADER]: Signalling peer c0f503bf8bb94af8a2a1139db4e1c0f5 to start an election
I20260709 13:09:37.611457 25122 raft_consensus.cc:2804] T 71cb3d981445473ca321bbe44299879c P b39c386162de49aca92dbebee7f06ace [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:37.611949 25122 raft_consensus.cc:697] T 71cb3d981445473ca321bbe44299879c P b39c386162de49aca92dbebee7f06ace [term 2 LEADER]: Becoming Leader. State: Replica: b39c386162de49aca92dbebee7f06ace, State: Running, Role: LEADER
I20260709 13:09:37.612648 24165 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "518a35ead60847e98c0b76330b999d6f"
dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5"
 from {username='slave'} at 127.0.0.1:59142
I20260709 13:09:37.612964 24237 raft_consensus.cc:2468] T 71cb3d981445473ca321bbe44299879c P f8d4657116f948038a0c73018238c3ba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b39c386162de49aca92dbebee7f06ace in term 2.
I20260709 13:09:37.613219 24165 raft_consensus.cc:493] T 518a35ead60847e98c0b76330b999d6f P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:37.612820 25122 consensus_queue.cc:237] T 71cb3d981445473ca321bbe44299879c P b39c386162de49aca92dbebee7f06ace [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:37.613696 24165 raft_consensus.cc:3060] T 518a35ead60847e98c0b76330b999d6f P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:37.619925 24912 raft_consensus.cc:993] T 3bcebec1ac994b99a49430f4f892d615 P f8d4657116f948038a0c73018238c3ba: : Instructing follower dea34817fcc148d78f090ef5fa72304f to start an election
I20260709 13:09:37.620512 24912 raft_consensus.cc:1081] T 3bcebec1ac994b99a49430f4f892d615 P f8d4657116f948038a0c73018238c3ba [term 1 LEADER]: Signalling peer dea34817fcc148d78f090ef5fa72304f to start an election
I20260709 13:09:37.623471 25005 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3bcebec1ac994b99a49430f4f892d615"
dest_uuid: "dea34817fcc148d78f090ef5fa72304f"
 from {username='slave'} at 127.0.0.1:37168
I20260709 13:09:37.623986 25005 raft_consensus.cc:493] T 3bcebec1ac994b99a49430f4f892d615 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:37.624286 25005 raft_consensus.cc:3060] T 3bcebec1ac994b99a49430f4f892d615 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:37.626303 24165 raft_consensus.cc:515] T 518a35ead60847e98c0b76330b999d6f P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:37.631860 24312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "518a35ead60847e98c0b76330b999d6f" candidate_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b39c386162de49aca92dbebee7f06ace"
I20260709 13:09:37.632203 24165 leader_election.cc:290] T 518a35ead60847e98c0b76330b999d6f P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 3 election: Requested vote from peers f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171), b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561)
I20260709 13:09:37.632625 24312 raft_consensus.cc:3055] T 518a35ead60847e98c0b76330b999d6f P b39c386162de49aca92dbebee7f06ace [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:37.635061 24312 raft_consensus.cc:740] T 518a35ead60847e98c0b76330b999d6f P b39c386162de49aca92dbebee7f06ace [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b39c386162de49aca92dbebee7f06ace, State: Running, Role: LEADER
I20260709 13:09:37.635700 25005 raft_consensus.cc:515] T 3bcebec1ac994b99a49430f4f892d615 P dea34817fcc148d78f090ef5fa72304f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:37.636003 24312 consensus_queue.cc:260] T 518a35ead60847e98c0b76330b999d6f P b39c386162de49aca92dbebee7f06ace [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:37.637552 24312 raft_consensus.cc:3060] T 518a35ead60847e98c0b76330b999d6f P b39c386162de49aca92dbebee7f06ace [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:37.639794 23987 catalog_manager.cc:5697] T 71cb3d981445473ca321bbe44299879c P b39c386162de49aca92dbebee7f06ace reported cstate change: term changed from 1 to 2, leader changed from f8d4657116f948038a0c73018238c3ba (127.14.180.67) to b39c386162de49aca92dbebee7f06ace (127.14.180.68). New cstate: current_term: 2 leader_uuid: "b39c386162de49aca92dbebee7f06ace" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:37.640661 25005 leader_election.cc:290] T 3bcebec1ac994b99a49430f4f892d615 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 2 election: Requested vote from peers c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431), f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171)
I20260709 13:09:37.641773 24165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bcebec1ac994b99a49430f4f892d615" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5"
I20260709 13:09:37.642338 24165 raft_consensus.cc:3060] T 3bcebec1ac994b99a49430f4f892d615 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:37.643452 24912 raft_consensus.cc:993] T e21ef2f479764142935dc2b1b7e87220 P f8d4657116f948038a0c73018238c3ba: : Instructing follower dea34817fcc148d78f090ef5fa72304f to start an election
I20260709 13:09:37.643950 24912 raft_consensus.cc:1081] T e21ef2f479764142935dc2b1b7e87220 P f8d4657116f948038a0c73018238c3ba [term 1 LEADER]: Signalling peer dea34817fcc148d78f090ef5fa72304f to start an election
I20260709 13:09:37.645193 24238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bcebec1ac994b99a49430f4f892d615" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f8d4657116f948038a0c73018238c3ba"
I20260709 13:09:37.645823 24238 raft_consensus.cc:3055] T 3bcebec1ac994b99a49430f4f892d615 P f8d4657116f948038a0c73018238c3ba [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:37.646121 24238 raft_consensus.cc:740] T 3bcebec1ac994b99a49430f4f892d615 P f8d4657116f948038a0c73018238c3ba [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f8d4657116f948038a0c73018238c3ba, State: Running, Role: LEADER
I20260709 13:09:37.645988 25010 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e21ef2f479764142935dc2b1b7e87220"
dest_uuid: "dea34817fcc148d78f090ef5fa72304f"
 from {username='slave'} at 127.0.0.1:37168
I20260709 13:09:37.646860 25010 raft_consensus.cc:493] T e21ef2f479764142935dc2b1b7e87220 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:37.647330 25010 raft_consensus.cc:3060] T e21ef2f479764142935dc2b1b7e87220 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:37.647039 24238 consensus_queue.cc:260] T 3bcebec1ac994b99a49430f4f892d615 P f8d4657116f948038a0c73018238c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:37.648530 24238 raft_consensus.cc:3060] T 3bcebec1ac994b99a49430f4f892d615 P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:37.656833 24165 raft_consensus.cc:2468] T 3bcebec1ac994b99a49430f4f892d615 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dea34817fcc148d78f090ef5fa72304f in term 2.
I20260709 13:09:37.657294 24912 raft_consensus.cc:993] T 6bdf4f0b87584bdab10ccc418ab54f02 P f8d4657116f948038a0c73018238c3ba: : Instructing follower b39c386162de49aca92dbebee7f06ace to start an election
I20260709 13:09:37.657768 25127 raft_consensus.cc:1081] T 6bdf4f0b87584bdab10ccc418ab54f02 P f8d4657116f948038a0c73018238c3ba [term 1 LEADER]: Signalling peer b39c386162de49aca92dbebee7f06ace to start an election
I20260709 13:09:37.657992 24237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "518a35ead60847e98c0b76330b999d6f" candidate_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f8d4657116f948038a0c73018238c3ba"
I20260709 13:09:37.661247 24914 leader_election.cc:304] T 3bcebec1ac994b99a49430f4f892d615 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0f503bf8bb94af8a2a1139db4e1c0f5, dea34817fcc148d78f090ef5fa72304f; no voters: 
I20260709 13:09:37.663837 25149 raft_consensus.cc:2804] T 3bcebec1ac994b99a49430f4f892d615 P dea34817fcc148d78f090ef5fa72304f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:37.664281 24311 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6bdf4f0b87584bdab10ccc418ab54f02"
dest_uuid: "b39c386162de49aca92dbebee7f06ace"
 from {username='slave'} at 127.0.0.1:54334
I20260709 13:09:37.664474 25149 raft_consensus.cc:697] T 3bcebec1ac994b99a49430f4f892d615 P dea34817fcc148d78f090ef5fa72304f [term 2 LEADER]: Becoming Leader. State: Replica: dea34817fcc148d78f090ef5fa72304f, State: Running, Role: LEADER
I20260709 13:09:37.664870 24311 raft_consensus.cc:493] T 6bdf4f0b87584bdab10ccc418ab54f02 P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:37.665333 24311 raft_consensus.cc:3060] T 6bdf4f0b87584bdab10ccc418ab54f02 P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:37.665599 25149 consensus_queue.cc:237] T 3bcebec1ac994b99a49430f4f892d615 P dea34817fcc148d78f090ef5fa72304f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } }
I20260709 13:09:37.668120 24237 raft_consensus.cc:3060] T 518a35ead60847e98c0b76330b999d6f P f8d4657116f948038a0c73018238c3ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:37.667023 25010 raft_consensus.cc:515] T e21ef2f479764142935dc2b1b7e87220 P dea34817fcc148d78f090ef5fa72304f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:37.661346 24312 raft_consensus.cc:2468] T 518a35ead60847e98c0b76330b999d6f P b39c386162de49aca92dbebee7f06ace [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0f503bf8bb94af8a2a1139db4e1c0f5 in term 3.
I20260709 13:09:37.662308 24238 raft_consensus.cc:2468] T 3bcebec1ac994b99a49430f4f892d615 P f8d4657116f948038a0c73018238c3ba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dea34817fcc148d78f090ef5fa72304f in term 2.
I20260709 13:09:37.676795 24130 leader_election.cc:304] T 518a35ead60847e98c0b76330b999d6f P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b39c386162de49aca92dbebee7f06ace, c0f503bf8bb94af8a2a1139db4e1c0f5; no voters: 
I20260709 13:09:37.677711 25139 raft_consensus.cc:2804] T 518a35ead60847e98c0b76330b999d6f P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:37.679191 24237 raft_consensus.cc:2468] T 518a35ead60847e98c0b76330b999d6f P f8d4657116f948038a0c73018238c3ba [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0f503bf8bb94af8a2a1139db4e1c0f5 in term 3.
I20260709 13:09:37.679531 25010 leader_election.cc:290] T e21ef2f479764142935dc2b1b7e87220 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 2 election: Requested vote from peers f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171), b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561)
I20260709 13:09:37.679292 24238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e21ef2f479764142935dc2b1b7e87220" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f8d4657116f948038a0c73018238c3ba"
I20260709 13:09:37.681041 24238 raft_consensus.cc:3055] T e21ef2f479764142935dc2b1b7e87220 P f8d4657116f948038a0c73018238c3ba [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:37.681365 24238 raft_consensus.cc:740] T e21ef2f479764142935dc2b1b7e87220 P f8d4657116f948038a0c73018238c3ba [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f8d4657116f948038a0c73018238c3ba, State: Running, Role: LEADER
I20260709 13:09:37.681608 25139 raft_consensus.cc:697] T 518a35ead60847e98c0b76330b999d6f P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 3 LEADER]: Becoming Leader. State: Replica: c0f503bf8bb94af8a2a1139db4e1c0f5, State: Running, Role: LEADER
I20260709 13:09:37.683380 24238 consensus_queue.cc:260] T e21ef2f479764142935dc2b1b7e87220 P f8d4657116f948038a0c73018238c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:37.683014 25139 consensus_queue.cc:237] T 518a35ead60847e98c0b76330b999d6f P c0f503bf8bb94af8a2a1139db4e1c0f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:37.685472 24312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e21ef2f479764142935dc2b1b7e87220" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b39c386162de49aca92dbebee7f06ace"
I20260709 13:09:37.686118 24312 raft_consensus.cc:3060] T e21ef2f479764142935dc2b1b7e87220 P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:37.699272 24238 raft_consensus.cc:3060] T e21ef2f479764142935dc2b1b7e87220 P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:37.706924 24238 raft_consensus.cc:2468] T e21ef2f479764142935dc2b1b7e87220 P f8d4657116f948038a0c73018238c3ba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dea34817fcc148d78f090ef5fa72304f in term 2.
I20260709 13:09:37.706020 23989 catalog_manager.cc:5697] T 518a35ead60847e98c0b76330b999d6f P c0f503bf8bb94af8a2a1139db4e1c0f5 reported cstate change: term changed from 2 to 3, leader changed from b39c386162de49aca92dbebee7f06ace (127.14.180.68) to c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66). New cstate: current_term: 3 leader_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:37.708107 24913 leader_election.cc:304] T e21ef2f479764142935dc2b1b7e87220 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dea34817fcc148d78f090ef5fa72304f, f8d4657116f948038a0c73018238c3ba; no voters: 
I20260709 13:09:37.709095 25133 raft_consensus.cc:2804] T e21ef2f479764142935dc2b1b7e87220 P dea34817fcc148d78f090ef5fa72304f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:37.709592 25133 raft_consensus.cc:697] T e21ef2f479764142935dc2b1b7e87220 P dea34817fcc148d78f090ef5fa72304f [term 2 LEADER]: Becoming Leader. State: Replica: dea34817fcc148d78f090ef5fa72304f, State: Running, Role: LEADER
I20260709 13:09:37.710516 25133 consensus_queue.cc:237] T e21ef2f479764142935dc2b1b7e87220 P dea34817fcc148d78f090ef5fa72304f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:37.697788 24311 raft_consensus.cc:515] T 6bdf4f0b87584bdab10ccc418ab54f02 P b39c386162de49aca92dbebee7f06ace [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:37.708015 24312 raft_consensus.cc:2468] T e21ef2f479764142935dc2b1b7e87220 P b39c386162de49aca92dbebee7f06ace [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dea34817fcc148d78f090ef5fa72304f in term 2.
I20260709 13:09:37.713991 24165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bdf4f0b87584bdab10ccc418ab54f02" candidate_uuid: "b39c386162de49aca92dbebee7f06ace" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5"
I20260709 13:09:37.714582 24165 raft_consensus.cc:3060] T 6bdf4f0b87584bdab10ccc418ab54f02 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:37.716487 24311 leader_election.cc:290] T 6bdf4f0b87584bdab10ccc418ab54f02 P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 2 election: Requested vote from peers c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431), f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171)
I20260709 13:09:37.727012 24165 raft_consensus.cc:2468] T 6bdf4f0b87584bdab10ccc418ab54f02 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b39c386162de49aca92dbebee7f06ace in term 2.
I20260709 13:09:37.728578 24280 leader_election.cc:304] T 6bdf4f0b87584bdab10ccc418ab54f02 P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b39c386162de49aca92dbebee7f06ace, c0f503bf8bb94af8a2a1139db4e1c0f5; no voters: 
I20260709 13:09:37.729714 24238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bdf4f0b87584bdab10ccc418ab54f02" candidate_uuid: "b39c386162de49aca92dbebee7f06ace" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f8d4657116f948038a0c73018238c3ba"
I20260709 13:09:37.730422 24238 raft_consensus.cc:3055] T 6bdf4f0b87584bdab10ccc418ab54f02 P f8d4657116f948038a0c73018238c3ba [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:37.730420 25143 raft_consensus.cc:2804] T 6bdf4f0b87584bdab10ccc418ab54f02 P b39c386162de49aca92dbebee7f06ace [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:37.732267 24238 raft_consensus.cc:740] T 6bdf4f0b87584bdab10ccc418ab54f02 P f8d4657116f948038a0c73018238c3ba [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f8d4657116f948038a0c73018238c3ba, State: Running, Role: LEADER
I20260709 13:09:37.732460 25143 raft_consensus.cc:697] T 6bdf4f0b87584bdab10ccc418ab54f02 P b39c386162de49aca92dbebee7f06ace [term 2 LEADER]: Becoming Leader. State: Replica: b39c386162de49aca92dbebee7f06ace, State: Running, Role: LEADER
I20260709 13:09:37.734331 24238 consensus_queue.cc:260] T 6bdf4f0b87584bdab10ccc418ab54f02 P f8d4657116f948038a0c73018238c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:37.735682 24238 raft_consensus.cc:3060] T 6bdf4f0b87584bdab10ccc418ab54f02 P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:37.733788 25143 consensus_queue.cc:237] T 6bdf4f0b87584bdab10ccc418ab54f02 P b39c386162de49aca92dbebee7f06ace [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:37.747051 24238 raft_consensus.cc:2468] T 6bdf4f0b87584bdab10ccc418ab54f02 P f8d4657116f948038a0c73018238c3ba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b39c386162de49aca92dbebee7f06ace in term 2.
I20260709 13:09:37.751204 23989 catalog_manager.cc:5697] T 3bcebec1ac994b99a49430f4f892d615 P dea34817fcc148d78f090ef5fa72304f reported cstate change: term changed from 1 to 2, leader changed from f8d4657116f948038a0c73018238c3ba (127.14.180.67) to dea34817fcc148d78f090ef5fa72304f (127.14.180.65). New cstate: current_term: 2 leader_uuid: "dea34817fcc148d78f090ef5fa72304f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:37.776619 23987 catalog_manager.cc:5697] T 6bdf4f0b87584bdab10ccc418ab54f02 P b39c386162de49aca92dbebee7f06ace reported cstate change: term changed from 1 to 2, leader changed from f8d4657116f948038a0c73018238c3ba (127.14.180.67) to b39c386162de49aca92dbebee7f06ace (127.14.180.68). New cstate: current_term: 2 leader_uuid: "b39c386162de49aca92dbebee7f06ace" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:37.776765 23989 catalog_manager.cc:5697] T e21ef2f479764142935dc2b1b7e87220 P dea34817fcc148d78f090ef5fa72304f reported cstate change: term changed from 1 to 2, leader changed from f8d4657116f948038a0c73018238c3ba (127.14.180.67) to dea34817fcc148d78f090ef5fa72304f (127.14.180.65). New cstate: current_term: 2 leader_uuid: "dea34817fcc148d78f090ef5fa72304f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:38.060787 24237 raft_consensus.cc:1275] T 3bcebec1ac994b99a49430f4f892d615 P f8d4657116f948038a0c73018238c3ba [term 2 FOLLOWER]: Refusing update from remote peer dea34817fcc148d78f090ef5fa72304f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:38.062073 25149 consensus_queue.cc:1048] T 3bcebec1ac994b99a49430f4f892d615 P dea34817fcc148d78f090ef5fa72304f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:38.077486 24158 raft_consensus.cc:1275] T 3bcebec1ac994b99a49430f4f892d615 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 2 FOLLOWER]: Refusing update from remote peer dea34817fcc148d78f090ef5fa72304f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:38.079064 25132 consensus_queue.cc:1048] T 3bcebec1ac994b99a49430f4f892d615 P dea34817fcc148d78f090ef5fa72304f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:38.095592 24238 raft_consensus.cc:1275] T e21ef2f479764142935dc2b1b7e87220 P f8d4657116f948038a0c73018238c3ba [term 2 FOLLOWER]: Refusing update from remote peer dea34817fcc148d78f090ef5fa72304f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:38.096210 24158 raft_consensus.cc:1275] T 71cb3d981445473ca321bbe44299879c P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 2 FOLLOWER]: Refusing update from remote peer b39c386162de49aca92dbebee7f06ace: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:38.097246 25133 consensus_queue.cc:1048] T e21ef2f479764142935dc2b1b7e87220 P dea34817fcc148d78f090ef5fa72304f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:38.097514 25125 consensus_queue.cc:1048] T 71cb3d981445473ca321bbe44299879c P b39c386162de49aca92dbebee7f06ace [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:38.124063 24312 raft_consensus.cc:1275] T e21ef2f479764142935dc2b1b7e87220 P b39c386162de49aca92dbebee7f06ace [term 2 FOLLOWER]: Refusing update from remote peer dea34817fcc148d78f090ef5fa72304f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:38.127197 25149 consensus_queue.cc:1048] T e21ef2f479764142935dc2b1b7e87220 P dea34817fcc148d78f090ef5fa72304f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:38.152022 24238 raft_consensus.cc:1275] T 71cb3d981445473ca321bbe44299879c P f8d4657116f948038a0c73018238c3ba [term 2 FOLLOWER]: Refusing update from remote peer b39c386162de49aca92dbebee7f06ace: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:38.153970 25143 consensus_queue.cc:1048] T 71cb3d981445473ca321bbe44299879c P b39c386162de49aca92dbebee7f06ace [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:38.195588 24238 raft_consensus.cc:1275] T 6bdf4f0b87584bdab10ccc418ab54f02 P f8d4657116f948038a0c73018238c3ba [term 2 FOLLOWER]: Refusing update from remote peer b39c386162de49aca92dbebee7f06ace: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:38.196808 25143 consensus_queue.cc:1048] T 6bdf4f0b87584bdab10ccc418ab54f02 P b39c386162de49aca92dbebee7f06ace [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:38.207561 24165 raft_consensus.cc:1275] T 6bdf4f0b87584bdab10ccc418ab54f02 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 2 FOLLOWER]: Refusing update from remote peer b39c386162de49aca92dbebee7f06ace: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:38.209753 25122 consensus_queue.cc:1048] T 6bdf4f0b87584bdab10ccc418ab54f02 P b39c386162de49aca92dbebee7f06ace [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:38.218820 24238 raft_consensus.cc:1275] T 518a35ead60847e98c0b76330b999d6f P f8d4657116f948038a0c73018238c3ba [term 3 FOLLOWER]: Refusing update from remote peer c0f503bf8bb94af8a2a1139db4e1c0f5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:38.220959 25139 consensus_queue.cc:1048] T 518a35ead60847e98c0b76330b999d6f P c0f503bf8bb94af8a2a1139db4e1c0f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:38.239308 24312 raft_consensus.cc:1275] T 518a35ead60847e98c0b76330b999d6f P b39c386162de49aca92dbebee7f06ace [term 3 FOLLOWER]: Refusing update from remote peer c0f503bf8bb94af8a2a1139db4e1c0f5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:38.240916 25139 consensus_queue.cc:1048] T 518a35ead60847e98c0b76330b999d6f P c0f503bf8bb94af8a2a1139db4e1c0f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:38.434334 15057 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:38.478808 15057 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:38.530352 24165 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "518a35ead60847e98c0b76330b999d6f"
dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5"
mode: GRACEFUL
new_leader_uuid: "b39c386162de49aca92dbebee7f06ace"
 from {username='slave'} at 127.0.0.1:55352
I20260709 13:09:38.531023 24165 raft_consensus.cc:606] T 518a35ead60847e98c0b76330b999d6f P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 3 LEADER]: Received request to transfer leadership to TS b39c386162de49aca92dbebee7f06ace
I20260709 13:09:38.534219 24311 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6bdf4f0b87584bdab10ccc418ab54f02"
dest_uuid: "b39c386162de49aca92dbebee7f06ace"
mode: GRACEFUL
new_leader_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5"
 from {username='slave'} at 127.0.0.1:36444
I20260709 13:09:38.534861 24311 raft_consensus.cc:606] T 6bdf4f0b87584bdab10ccc418ab54f02 P b39c386162de49aca92dbebee7f06ace [term 2 LEADER]: Received request to transfer leadership to TS c0f503bf8bb94af8a2a1139db4e1c0f5
I20260709 13:09:38.537954 24238 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7a76ed4e1b6a4c2698999f722da5cfd7"
dest_uuid: "f8d4657116f948038a0c73018238c3ba"
mode: GRACEFUL
new_leader_uuid: "dea34817fcc148d78f090ef5fa72304f"
 from {username='slave'} at 127.0.0.1:58896
I20260709 13:09:38.538641 24238 raft_consensus.cc:606] T 7a76ed4e1b6a4c2698999f722da5cfd7 P f8d4657116f948038a0c73018238c3ba [term 1 LEADER]: Received request to transfer leadership to TS dea34817fcc148d78f090ef5fa72304f
I20260709 13:09:38.541294 24311 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b25c31c2fcad44f281a8a045e6cb0c19"
dest_uuid: "b39c386162de49aca92dbebee7f06ace"
mode: GRACEFUL
new_leader_uuid: "dea34817fcc148d78f090ef5fa72304f"
 from {username='slave'} at 127.0.0.1:36444
I20260709 13:09:38.541883 24311 raft_consensus.cc:606] T b25c31c2fcad44f281a8a045e6cb0c19 P b39c386162de49aca92dbebee7f06ace [term 1 LEADER]: Received request to transfer leadership to TS dea34817fcc148d78f090ef5fa72304f
I20260709 13:09:38.544661 24238 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c9b7bd5d439d455a9173478e086439e8"
dest_uuid: "f8d4657116f948038a0c73018238c3ba"
mode: GRACEFUL
new_leader_uuid: "dea34817fcc148d78f090ef5fa72304f"
 from {username='slave'} at 127.0.0.1:58896
I20260709 13:09:38.545226 24238 raft_consensus.cc:606] T c9b7bd5d439d455a9173478e086439e8 P f8d4657116f948038a0c73018238c3ba [term 1 LEADER]: Received request to transfer leadership to TS dea34817fcc148d78f090ef5fa72304f
I20260709 13:09:38.546411 15057 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:09:38.548713 15057 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:38.711146 25195 raft_consensus.cc:993] T 6bdf4f0b87584bdab10ccc418ab54f02 P b39c386162de49aca92dbebee7f06ace: : Instructing follower c0f503bf8bb94af8a2a1139db4e1c0f5 to start an election
I20260709 13:09:38.711943 25143 raft_consensus.cc:1081] T 6bdf4f0b87584bdab10ccc418ab54f02 P b39c386162de49aca92dbebee7f06ace [term 2 LEADER]: Signalling peer c0f503bf8bb94af8a2a1139db4e1c0f5 to start an election
I20260709 13:09:38.713784 24165 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6bdf4f0b87584bdab10ccc418ab54f02"
dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5"
 from {username='slave'} at 127.0.0.1:59142
I20260709 13:09:38.714394 24165 raft_consensus.cc:493] T 6bdf4f0b87584bdab10ccc418ab54f02 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:38.714743 24165 raft_consensus.cc:3060] T 6bdf4f0b87584bdab10ccc418ab54f02 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:38.722035 24165 raft_consensus.cc:515] T 6bdf4f0b87584bdab10ccc418ab54f02 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:38.724062 24165 leader_election.cc:290] T 6bdf4f0b87584bdab10ccc418ab54f02 P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 3 election: Requested vote from peers f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171), b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561)
I20260709 13:09:38.725082 24311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bdf4f0b87584bdab10ccc418ab54f02" candidate_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b39c386162de49aca92dbebee7f06ace"
I20260709 13:09:38.725082 24238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bdf4f0b87584bdab10ccc418ab54f02" candidate_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f8d4657116f948038a0c73018238c3ba"
I20260709 13:09:38.725996 24311 raft_consensus.cc:3055] T 6bdf4f0b87584bdab10ccc418ab54f02 P b39c386162de49aca92dbebee7f06ace [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:38.726032 24238 raft_consensus.cc:3060] T 6bdf4f0b87584bdab10ccc418ab54f02 P f8d4657116f948038a0c73018238c3ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:38.726519 24311 raft_consensus.cc:740] T 6bdf4f0b87584bdab10ccc418ab54f02 P b39c386162de49aca92dbebee7f06ace [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b39c386162de49aca92dbebee7f06ace, State: Running, Role: LEADER
I20260709 13:09:38.727535 24311 consensus_queue.cc:260] T 6bdf4f0b87584bdab10ccc418ab54f02 P b39c386162de49aca92dbebee7f06ace [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:38.729015 24311 raft_consensus.cc:3060] T 6bdf4f0b87584bdab10ccc418ab54f02 P b39c386162de49aca92dbebee7f06ace [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:38.736493 24238 raft_consensus.cc:2468] T 6bdf4f0b87584bdab10ccc418ab54f02 P f8d4657116f948038a0c73018238c3ba [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0f503bf8bb94af8a2a1139db4e1c0f5 in term 3.
I20260709 13:09:38.738325 24131 leader_election.cc:304] T 6bdf4f0b87584bdab10ccc418ab54f02 P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0f503bf8bb94af8a2a1139db4e1c0f5, f8d4657116f948038a0c73018238c3ba; no voters: 
I20260709 13:09:38.739487 25139 raft_consensus.cc:2804] T 6bdf4f0b87584bdab10ccc418ab54f02 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:38.739981 25139 raft_consensus.cc:697] T 6bdf4f0b87584bdab10ccc418ab54f02 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 3 LEADER]: Becoming Leader. State: Replica: c0f503bf8bb94af8a2a1139db4e1c0f5, State: Running, Role: LEADER
I20260709 13:09:38.740916 25139 consensus_queue.cc:237] T 6bdf4f0b87584bdab10ccc418ab54f02 P c0f503bf8bb94af8a2a1139db4e1c0f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:38.741415 24311 raft_consensus.cc:2468] T 6bdf4f0b87584bdab10ccc418ab54f02 P b39c386162de49aca92dbebee7f06ace [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0f503bf8bb94af8a2a1139db4e1c0f5 in term 3.
I20260709 13:09:38.752249 23987 catalog_manager.cc:5697] T 6bdf4f0b87584bdab10ccc418ab54f02 P c0f503bf8bb94af8a2a1139db4e1c0f5 reported cstate change: term changed from 2 to 3, leader changed from b39c386162de49aca92dbebee7f06ace (127.14.180.68) to c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66). New cstate: current_term: 3 leader_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:38.797622 25139 raft_consensus.cc:993] T 518a35ead60847e98c0b76330b999d6f P c0f503bf8bb94af8a2a1139db4e1c0f5: : Instructing follower b39c386162de49aca92dbebee7f06ace to start an election
I20260709 13:09:38.798281 25139 raft_consensus.cc:1081] T 518a35ead60847e98c0b76330b999d6f P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 3 LEADER]: Signalling peer b39c386162de49aca92dbebee7f06ace to start an election
I20260709 13:09:38.800307 24311 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "518a35ead60847e98c0b76330b999d6f"
dest_uuid: "b39c386162de49aca92dbebee7f06ace"
 from {username='slave'} at 127.0.0.1:54318
I20260709 13:09:38.800915 24311 raft_consensus.cc:493] T 518a35ead60847e98c0b76330b999d6f P b39c386162de49aca92dbebee7f06ace [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:38.801278 24311 raft_consensus.cc:3060] T 518a35ead60847e98c0b76330b999d6f P b39c386162de49aca92dbebee7f06ace [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:38.807910 24311 raft_consensus.cc:515] T 518a35ead60847e98c0b76330b999d6f P b39c386162de49aca92dbebee7f06ace [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:38.809741 24311 leader_election.cc:290] T 518a35ead60847e98c0b76330b999d6f P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 4 election: Requested vote from peers c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431), f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171)
I20260709 13:09:38.810482 24165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "518a35ead60847e98c0b76330b999d6f" candidate_uuid: "b39c386162de49aca92dbebee7f06ace" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5"
I20260709 13:09:38.811215 24165 raft_consensus.cc:3055] T 518a35ead60847e98c0b76330b999d6f P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:38.811612 24165 raft_consensus.cc:740] T 518a35ead60847e98c0b76330b999d6f P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c0f503bf8bb94af8a2a1139db4e1c0f5, State: Running, Role: LEADER
I20260709 13:09:38.811529 24238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "518a35ead60847e98c0b76330b999d6f" candidate_uuid: "b39c386162de49aca92dbebee7f06ace" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "f8d4657116f948038a0c73018238c3ba"
I20260709 13:09:38.812270 24238 raft_consensus.cc:3060] T 518a35ead60847e98c0b76330b999d6f P f8d4657116f948038a0c73018238c3ba [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:38.812582 24165 consensus_queue.cc:260] T 518a35ead60847e98c0b76330b999d6f P c0f503bf8bb94af8a2a1139db4e1c0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:38.813829 24165 raft_consensus.cc:3060] T 518a35ead60847e98c0b76330b999d6f P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:38.819866 24238 raft_consensus.cc:2468] T 518a35ead60847e98c0b76330b999d6f P f8d4657116f948038a0c73018238c3ba [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b39c386162de49aca92dbebee7f06ace in term 4.
I20260709 13:09:38.821300 24279 leader_election.cc:304] T 518a35ead60847e98c0b76330b999d6f P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b39c386162de49aca92dbebee7f06ace, f8d4657116f948038a0c73018238c3ba; no voters: 
I20260709 13:09:38.821772 24165 raft_consensus.cc:2468] T 518a35ead60847e98c0b76330b999d6f P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b39c386162de49aca92dbebee7f06ace in term 4.
I20260709 13:09:38.822268 25195 raft_consensus.cc:2804] T 518a35ead60847e98c0b76330b999d6f P b39c386162de49aca92dbebee7f06ace [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:38.822851 25195 raft_consensus.cc:697] T 518a35ead60847e98c0b76330b999d6f P b39c386162de49aca92dbebee7f06ace [term 4 LEADER]: Becoming Leader. State: Replica: b39c386162de49aca92dbebee7f06ace, State: Running, Role: LEADER
I20260709 13:09:38.824244 25195 consensus_queue.cc:237] T 518a35ead60847e98c0b76330b999d6f P b39c386162de49aca92dbebee7f06ace [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:38.828732 25143 raft_consensus.cc:993] T b25c31c2fcad44f281a8a045e6cb0c19 P b39c386162de49aca92dbebee7f06ace: : Instructing follower dea34817fcc148d78f090ef5fa72304f to start an election
I20260709 13:09:38.829567 25143 raft_consensus.cc:1081] T b25c31c2fcad44f281a8a045e6cb0c19 P b39c386162de49aca92dbebee7f06ace [term 1 LEADER]: Signalling peer dea34817fcc148d78f090ef5fa72304f to start an election
I20260709 13:09:38.833310 25005 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b25c31c2fcad44f281a8a045e6cb0c19"
dest_uuid: "dea34817fcc148d78f090ef5fa72304f"
 from {username='slave'} at 127.0.0.1:37152
I20260709 13:09:38.834067 25005 raft_consensus.cc:493] T b25c31c2fcad44f281a8a045e6cb0c19 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:38.834444 25005 raft_consensus.cc:3060] T b25c31c2fcad44f281a8a045e6cb0c19 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:38.839811 23987 catalog_manager.cc:5697] T 518a35ead60847e98c0b76330b999d6f P b39c386162de49aca92dbebee7f06ace reported cstate change: term changed from 3 to 4, leader changed from c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66) to b39c386162de49aca92dbebee7f06ace (127.14.180.68). New cstate: current_term: 4 leader_uuid: "b39c386162de49aca92dbebee7f06ace" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:38.845836 25005 raft_consensus.cc:515] T b25c31c2fcad44f281a8a045e6cb0c19 P dea34817fcc148d78f090ef5fa72304f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:38.849984 25005 leader_election.cc:290] T b25c31c2fcad44f281a8a045e6cb0c19 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 2 election: Requested vote from peers b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561), c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431)
I20260709 13:09:38.852373 24311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25c31c2fcad44f281a8a045e6cb0c19" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b39c386162de49aca92dbebee7f06ace"
I20260709 13:09:38.851547 24165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b25c31c2fcad44f281a8a045e6cb0c19" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5"
I20260709 13:09:38.853119 24311 raft_consensus.cc:3055] T b25c31c2fcad44f281a8a045e6cb0c19 P b39c386162de49aca92dbebee7f06ace [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:38.853576 24311 raft_consensus.cc:740] T b25c31c2fcad44f281a8a045e6cb0c19 P b39c386162de49aca92dbebee7f06ace [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b39c386162de49aca92dbebee7f06ace, State: Running, Role: LEADER
I20260709 13:09:38.853752 24165 raft_consensus.cc:3060] T b25c31c2fcad44f281a8a045e6cb0c19 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:38.854982 24311 consensus_queue.cc:260] T b25c31c2fcad44f281a8a045e6cb0c19 P b39c386162de49aca92dbebee7f06ace [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:38.856156 24311 raft_consensus.cc:3060] T b25c31c2fcad44f281a8a045e6cb0c19 P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:38.859815 24165 raft_consensus.cc:2468] T b25c31c2fcad44f281a8a045e6cb0c19 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dea34817fcc148d78f090ef5fa72304f in term 2.
I20260709 13:09:38.861028 24914 leader_election.cc:304] T b25c31c2fcad44f281a8a045e6cb0c19 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0f503bf8bb94af8a2a1139db4e1c0f5, dea34817fcc148d78f090ef5fa72304f; no voters: 
I20260709 13:09:38.861889 25133 raft_consensus.cc:2804] T b25c31c2fcad44f281a8a045e6cb0c19 P dea34817fcc148d78f090ef5fa72304f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:38.861827 24311 raft_consensus.cc:2468] T b25c31c2fcad44f281a8a045e6cb0c19 P b39c386162de49aca92dbebee7f06ace [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dea34817fcc148d78f090ef5fa72304f in term 2.
I20260709 13:09:38.862661 25133 raft_consensus.cc:697] T b25c31c2fcad44f281a8a045e6cb0c19 P dea34817fcc148d78f090ef5fa72304f [term 2 LEADER]: Becoming Leader. State: Replica: dea34817fcc148d78f090ef5fa72304f, State: Running, Role: LEADER
I20260709 13:09:38.863807 25133 consensus_queue.cc:237] T b25c31c2fcad44f281a8a045e6cb0c19 P dea34817fcc148d78f090ef5fa72304f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:38.877012 23987 catalog_manager.cc:5697] T b25c31c2fcad44f281a8a045e6cb0c19 P dea34817fcc148d78f090ef5fa72304f reported cstate change: term changed from 1 to 2, leader changed from b39c386162de49aca92dbebee7f06ace (127.14.180.68) to dea34817fcc148d78f090ef5fa72304f (127.14.180.65). New cstate: current_term: 2 leader_uuid: "dea34817fcc148d78f090ef5fa72304f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:38.881471 24912 raft_consensus.cc:993] T c9b7bd5d439d455a9173478e086439e8 P f8d4657116f948038a0c73018238c3ba: : Instructing follower dea34817fcc148d78f090ef5fa72304f to start an election
I20260709 13:09:38.883773 25123 raft_consensus.cc:1081] T c9b7bd5d439d455a9173478e086439e8 P f8d4657116f948038a0c73018238c3ba [term 1 LEADER]: Signalling peer dea34817fcc148d78f090ef5fa72304f to start an election
I20260709 13:09:38.890412 25005 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c9b7bd5d439d455a9173478e086439e8"
dest_uuid: "dea34817fcc148d78f090ef5fa72304f"
 from {username='slave'} at 127.0.0.1:37168
I20260709 13:09:38.891122 24912 raft_consensus.cc:993] T 7a76ed4e1b6a4c2698999f722da5cfd7 P f8d4657116f948038a0c73018238c3ba: : Instructing follower dea34817fcc148d78f090ef5fa72304f to start an election
I20260709 13:09:38.891731 24912 raft_consensus.cc:1081] T 7a76ed4e1b6a4c2698999f722da5cfd7 P f8d4657116f948038a0c73018238c3ba [term 1 LEADER]: Signalling peer dea34817fcc148d78f090ef5fa72304f to start an election
I20260709 13:09:38.891170 25005 raft_consensus.cc:493] T c9b7bd5d439d455a9173478e086439e8 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:38.892549 25005 raft_consensus.cc:3060] T c9b7bd5d439d455a9173478e086439e8 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:38.893486 25010 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7a76ed4e1b6a4c2698999f722da5cfd7"
dest_uuid: "dea34817fcc148d78f090ef5fa72304f"
 from {username='slave'} at 127.0.0.1:37168
I20260709 13:09:38.894145 25010 raft_consensus.cc:493] T 7a76ed4e1b6a4c2698999f722da5cfd7 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:38.894497 25010 raft_consensus.cc:3060] T 7a76ed4e1b6a4c2698999f722da5cfd7 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:38.899101 25005 raft_consensus.cc:515] T c9b7bd5d439d455a9173478e086439e8 P dea34817fcc148d78f090ef5fa72304f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:38.900049 25010 raft_consensus.cc:515] T 7a76ed4e1b6a4c2698999f722da5cfd7 P dea34817fcc148d78f090ef5fa72304f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:38.901432 25005 leader_election.cc:290] T c9b7bd5d439d455a9173478e086439e8 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 2 election: Requested vote from peers f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171), b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561)
I20260709 13:09:38.902046 25010 leader_election.cc:290] T 7a76ed4e1b6a4c2698999f722da5cfd7 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 2 election: Requested vote from peers f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171), b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561)
I20260709 13:09:38.902906 24237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9b7bd5d439d455a9173478e086439e8" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f8d4657116f948038a0c73018238c3ba"
I20260709 13:09:38.903541 24237 raft_consensus.cc:3055] T c9b7bd5d439d455a9173478e086439e8 P f8d4657116f948038a0c73018238c3ba [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:38.903657 24311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9b7bd5d439d455a9173478e086439e8" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b39c386162de49aca92dbebee7f06ace"
I20260709 13:09:38.903892 24237 raft_consensus.cc:740] T c9b7bd5d439d455a9173478e086439e8 P f8d4657116f948038a0c73018238c3ba [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f8d4657116f948038a0c73018238c3ba, State: Running, Role: LEADER
I20260709 13:09:38.903954 24312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a76ed4e1b6a4c2698999f722da5cfd7" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b39c386162de49aca92dbebee7f06ace"
I20260709 13:09:38.904335 24311 raft_consensus.cc:3060] T c9b7bd5d439d455a9173478e086439e8 P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:38.904649 24312 raft_consensus.cc:3060] T 7a76ed4e1b6a4c2698999f722da5cfd7 P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:38.904757 24237 consensus_queue.cc:260] T c9b7bd5d439d455a9173478e086439e8 P f8d4657116f948038a0c73018238c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:38.906000 24236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a76ed4e1b6a4c2698999f722da5cfd7" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f8d4657116f948038a0c73018238c3ba"
I20260709 13:09:38.906659 24236 raft_consensus.cc:3055] T 7a76ed4e1b6a4c2698999f722da5cfd7 P f8d4657116f948038a0c73018238c3ba [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:38.906944 24237 raft_consensus.cc:3060] T c9b7bd5d439d455a9173478e086439e8 P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:38.906980 24236 raft_consensus.cc:740] T 7a76ed4e1b6a4c2698999f722da5cfd7 P f8d4657116f948038a0c73018238c3ba [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f8d4657116f948038a0c73018238c3ba, State: Running, Role: LEADER
I20260709 13:09:38.909373 24236 consensus_queue.cc:260] T 7a76ed4e1b6a4c2698999f722da5cfd7 P f8d4657116f948038a0c73018238c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:38.910749 24236 raft_consensus.cc:3060] T 7a76ed4e1b6a4c2698999f722da5cfd7 P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:38.912335 24312 raft_consensus.cc:2468] T 7a76ed4e1b6a4c2698999f722da5cfd7 P b39c386162de49aca92dbebee7f06ace [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dea34817fcc148d78f090ef5fa72304f in term 2.
I20260709 13:09:38.915519 24911 leader_election.cc:304] T 7a76ed4e1b6a4c2698999f722da5cfd7 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b39c386162de49aca92dbebee7f06ace, dea34817fcc148d78f090ef5fa72304f; no voters: 
I20260709 13:09:38.916443 25133 raft_consensus.cc:2804] T 7a76ed4e1b6a4c2698999f722da5cfd7 P dea34817fcc148d78f090ef5fa72304f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:38.916991 25133 raft_consensus.cc:697] T 7a76ed4e1b6a4c2698999f722da5cfd7 P dea34817fcc148d78f090ef5fa72304f [term 2 LEADER]: Becoming Leader. State: Replica: dea34817fcc148d78f090ef5fa72304f, State: Running, Role: LEADER
I20260709 13:09:38.917948 25133 consensus_queue.cc:237] T 7a76ed4e1b6a4c2698999f722da5cfd7 P dea34817fcc148d78f090ef5fa72304f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:38.922482 24236 raft_consensus.cc:2468] T 7a76ed4e1b6a4c2698999f722da5cfd7 P f8d4657116f948038a0c73018238c3ba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dea34817fcc148d78f090ef5fa72304f in term 2.
I20260709 13:09:38.925926 24237 raft_consensus.cc:2468] T c9b7bd5d439d455a9173478e086439e8 P f8d4657116f948038a0c73018238c3ba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dea34817fcc148d78f090ef5fa72304f in term 2.
I20260709 13:09:38.927241 24913 leader_election.cc:304] T c9b7bd5d439d455a9173478e086439e8 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dea34817fcc148d78f090ef5fa72304f, f8d4657116f948038a0c73018238c3ba; no voters: 
I20260709 13:09:38.928287 25132 raft_consensus.cc:2804] T c9b7bd5d439d455a9173478e086439e8 P dea34817fcc148d78f090ef5fa72304f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:38.928805 25132 raft_consensus.cc:697] T c9b7bd5d439d455a9173478e086439e8 P dea34817fcc148d78f090ef5fa72304f [term 2 LEADER]: Becoming Leader. State: Replica: dea34817fcc148d78f090ef5fa72304f, State: Running, Role: LEADER
I20260709 13:09:38.929858 24311 raft_consensus.cc:2468] T c9b7bd5d439d455a9173478e086439e8 P b39c386162de49aca92dbebee7f06ace [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dea34817fcc148d78f090ef5fa72304f in term 2.
I20260709 13:09:38.929733 25132 consensus_queue.cc:237] T c9b7bd5d439d455a9173478e086439e8 P dea34817fcc148d78f090ef5fa72304f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:38.936362 23987 catalog_manager.cc:5697] T 7a76ed4e1b6a4c2698999f722da5cfd7 P dea34817fcc148d78f090ef5fa72304f reported cstate change: term changed from 1 to 2, leader changed from f8d4657116f948038a0c73018238c3ba (127.14.180.67) to dea34817fcc148d78f090ef5fa72304f (127.14.180.65). New cstate: current_term: 2 leader_uuid: "dea34817fcc148d78f090ef5fa72304f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:38.953375 23987 catalog_manager.cc:5697] T c9b7bd5d439d455a9173478e086439e8 P dea34817fcc148d78f090ef5fa72304f reported cstate change: term changed from 1 to 2, leader changed from f8d4657116f948038a0c73018238c3ba (127.14.180.67) to dea34817fcc148d78f090ef5fa72304f (127.14.180.65). New cstate: current_term: 2 leader_uuid: "dea34817fcc148d78f090ef5fa72304f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:39.151183 24236 raft_consensus.cc:1275] T 6bdf4f0b87584bdab10ccc418ab54f02 P f8d4657116f948038a0c73018238c3ba [term 3 FOLLOWER]: Refusing update from remote peer c0f503bf8bb94af8a2a1139db4e1c0f5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:39.152757 25139 consensus_queue.cc:1048] T 6bdf4f0b87584bdab10ccc418ab54f02 P c0f503bf8bb94af8a2a1139db4e1c0f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:39.165748 24312 raft_consensus.cc:1275] T 6bdf4f0b87584bdab10ccc418ab54f02 P b39c386162de49aca92dbebee7f06ace [term 3 FOLLOWER]: Refusing update from remote peer c0f503bf8bb94af8a2a1139db4e1c0f5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:39.167397 25199 consensus_queue.cc:1048] T 6bdf4f0b87584bdab10ccc418ab54f02 P c0f503bf8bb94af8a2a1139db4e1c0f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:39.306260 24165 raft_consensus.cc:1275] T b25c31c2fcad44f281a8a045e6cb0c19 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 2 FOLLOWER]: Refusing update from remote peer dea34817fcc148d78f090ef5fa72304f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:39.307679 25149 consensus_queue.cc:1048] T b25c31c2fcad44f281a8a045e6cb0c19 P dea34817fcc148d78f090ef5fa72304f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:39.323661 24312 raft_consensus.cc:1275] T b25c31c2fcad44f281a8a045e6cb0c19 P b39c386162de49aca92dbebee7f06ace [term 2 FOLLOWER]: Refusing update from remote peer dea34817fcc148d78f090ef5fa72304f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:39.325188 25149 consensus_queue.cc:1048] T b25c31c2fcad44f281a8a045e6cb0c19 P dea34817fcc148d78f090ef5fa72304f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:39.340869 24237 raft_consensus.cc:1275] T 518a35ead60847e98c0b76330b999d6f P f8d4657116f948038a0c73018238c3ba [term 4 FOLLOWER]: Refusing update from remote peer b39c386162de49aca92dbebee7f06ace: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:09:39.344321 24237 raft_consensus.cc:1275] T c9b7bd5d439d455a9173478e086439e8 P f8d4657116f948038a0c73018238c3ba [term 2 FOLLOWER]: Refusing update from remote peer dea34817fcc148d78f090ef5fa72304f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:39.345206 25125 consensus_queue.cc:1048] T 518a35ead60847e98c0b76330b999d6f P b39c386162de49aca92dbebee7f06ace [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:39.346103 24165 raft_consensus.cc:1275] T 518a35ead60847e98c0b76330b999d6f P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 4 FOLLOWER]: Refusing update from remote peer b39c386162de49aca92dbebee7f06ace: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:09:39.348279 25149 consensus_queue.cc:1048] T c9b7bd5d439d455a9173478e086439e8 P dea34817fcc148d78f090ef5fa72304f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:39.350636 25122 consensus_queue.cc:1048] T 518a35ead60847e98c0b76330b999d6f P b39c386162de49aca92dbebee7f06ace [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:39.365232 24311 raft_consensus.cc:1275] T c9b7bd5d439d455a9173478e086439e8 P b39c386162de49aca92dbebee7f06ace [term 2 FOLLOWER]: Refusing update from remote peer dea34817fcc148d78f090ef5fa72304f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:39.368505 25133 consensus_queue.cc:1048] T c9b7bd5d439d455a9173478e086439e8 P dea34817fcc148d78f090ef5fa72304f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:39.470137 24311 raft_consensus.cc:1275] T 7a76ed4e1b6a4c2698999f722da5cfd7 P b39c386162de49aca92dbebee7f06ace [term 2 FOLLOWER]: Refusing update from remote peer dea34817fcc148d78f090ef5fa72304f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:39.472158 25133 consensus_queue.cc:1048] T 7a76ed4e1b6a4c2698999f722da5cfd7 P dea34817fcc148d78f090ef5fa72304f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:39.487869 24236 raft_consensus.cc:1275] T 7a76ed4e1b6a4c2698999f722da5cfd7 P f8d4657116f948038a0c73018238c3ba [term 2 FOLLOWER]: Refusing update from remote peer dea34817fcc148d78f090ef5fa72304f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:39.490408 25132 consensus_queue.cc:1048] T 7a76ed4e1b6a4c2698999f722da5cfd7 P dea34817fcc148d78f090ef5fa72304f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:39.549813 15057 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:39.599100 15057 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:39.642930 24161 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1dcdde5516f54b19b11611ca9213415d"
dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5"
mode: GRACEFUL
new_leader_uuid: "dea34817fcc148d78f090ef5fa72304f"
 from {username='slave'} at 127.0.0.1:55352
I20260709 13:09:39.643575 24161 raft_consensus.cc:606] T 1dcdde5516f54b19b11611ca9213415d P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 LEADER]: Received request to transfer leadership to TS dea34817fcc148d78f090ef5fa72304f
I20260709 13:09:39.649859 24312 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "662a938528e545e6aa4592052da18101"
dest_uuid: "b39c386162de49aca92dbebee7f06ace"
mode: GRACEFUL
new_leader_uuid: "dea34817fcc148d78f090ef5fa72304f"
 from {username='slave'} at 127.0.0.1:36444
I20260709 13:09:39.650859 24312 raft_consensus.cc:606] T 662a938528e545e6aa4592052da18101 P b39c386162de49aca92dbebee7f06ace [term 3 LEADER]: Received request to transfer leadership to TS dea34817fcc148d78f090ef5fa72304f
I20260709 13:09:39.654495 24237 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9a126a61cad843b4a3b34fac0f85a1d2"
dest_uuid: "f8d4657116f948038a0c73018238c3ba"
mode: GRACEFUL
new_leader_uuid: "b39c386162de49aca92dbebee7f06ace"
 from {username='slave'} at 127.0.0.1:58896
I20260709 13:09:39.655195 24237 raft_consensus.cc:606] T 9a126a61cad843b4a3b34fac0f85a1d2 P f8d4657116f948038a0c73018238c3ba [term 1 LEADER]: Received request to transfer leadership to TS b39c386162de49aca92dbebee7f06ace
I20260709 13:09:39.658325 24237 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c5873f7465894eddab6fa84daecdcc84"
dest_uuid: "f8d4657116f948038a0c73018238c3ba"
mode: GRACEFUL
new_leader_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5"
 from {username='slave'} at 127.0.0.1:58896
I20260709 13:09:39.659017 24237 raft_consensus.cc:606] T c5873f7465894eddab6fa84daecdcc84 P f8d4657116f948038a0c73018238c3ba [term 1 LEADER]: Received request to transfer leadership to TS c0f503bf8bb94af8a2a1139db4e1c0f5
I20260709 13:09:39.661859 24237 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c7b586130d5842f293b0df4b02792ec6"
dest_uuid: "f8d4657116f948038a0c73018238c3ba"
mode: GRACEFUL
new_leader_uuid: "b39c386162de49aca92dbebee7f06ace"
 from {username='slave'} at 127.0.0.1:58896
I20260709 13:09:39.662463 24237 raft_consensus.cc:606] T c7b586130d5842f293b0df4b02792ec6 P f8d4657116f948038a0c73018238c3ba [term 1 LEADER]: Received request to transfer leadership to TS b39c386162de49aca92dbebee7f06ace
I20260709 13:09:39.663897 15057 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:09:39.665665 15057 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:39.900017 24912 raft_consensus.cc:993] T c5873f7465894eddab6fa84daecdcc84 P f8d4657116f948038a0c73018238c3ba: : Instructing follower c0f503bf8bb94af8a2a1139db4e1c0f5 to start an election
I20260709 13:09:39.900637 25123 raft_consensus.cc:1081] T c5873f7465894eddab6fa84daecdcc84 P f8d4657116f948038a0c73018238c3ba [term 1 LEADER]: Signalling peer c0f503bf8bb94af8a2a1139db4e1c0f5 to start an election
I20260709 13:09:39.902882 24165 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c5873f7465894eddab6fa84daecdcc84"
dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5"
 from {username='slave'} at 127.0.0.1:59140
I20260709 13:09:39.903472 24165 raft_consensus.cc:493] T c5873f7465894eddab6fa84daecdcc84 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:39.903888 24165 raft_consensus.cc:3060] T c5873f7465894eddab6fa84daecdcc84 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:39.909132 24165 raft_consensus.cc:515] T c5873f7465894eddab6fa84daecdcc84 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:39.911111 24165 leader_election.cc:290] T c5873f7465894eddab6fa84daecdcc84 P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 2 election: Requested vote from peers f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171), b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561)
I20260709 13:09:39.929423 24236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5873f7465894eddab6fa84daecdcc84" candidate_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f8d4657116f948038a0c73018238c3ba"
I20260709 13:09:39.930106 24312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5873f7465894eddab6fa84daecdcc84" candidate_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b39c386162de49aca92dbebee7f06ace"
I20260709 13:09:39.930145 24236 raft_consensus.cc:3055] T c5873f7465894eddab6fa84daecdcc84 P f8d4657116f948038a0c73018238c3ba [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:39.930744 24236 raft_consensus.cc:740] T c5873f7465894eddab6fa84daecdcc84 P f8d4657116f948038a0c73018238c3ba [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f8d4657116f948038a0c73018238c3ba, State: Running, Role: LEADER
I20260709 13:09:39.931556 24236 consensus_queue.cc:260] T c5873f7465894eddab6fa84daecdcc84 P f8d4657116f948038a0c73018238c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:39.932857 24236 raft_consensus.cc:3060] T c5873f7465894eddab6fa84daecdcc84 P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:39.930771 24312 raft_consensus.cc:3060] T c5873f7465894eddab6fa84daecdcc84 P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:39.946691 25218 raft_consensus.cc:993] T 1dcdde5516f54b19b11611ca9213415d P c0f503bf8bb94af8a2a1139db4e1c0f5: : Instructing follower dea34817fcc148d78f090ef5fa72304f to start an election
I20260709 13:09:39.947312 25218 raft_consensus.cc:1081] T 1dcdde5516f54b19b11611ca9213415d P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 LEADER]: Signalling peer dea34817fcc148d78f090ef5fa72304f to start an election
I20260709 13:09:39.953229 24312 raft_consensus.cc:2468] T c5873f7465894eddab6fa84daecdcc84 P b39c386162de49aca92dbebee7f06ace [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0f503bf8bb94af8a2a1139db4e1c0f5 in term 2.
I20260709 13:09:39.954658 24130 leader_election.cc:304] T c5873f7465894eddab6fa84daecdcc84 P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b39c386162de49aca92dbebee7f06ace, c0f503bf8bb94af8a2a1139db4e1c0f5; no voters: 
I20260709 13:09:39.955575 25141 raft_consensus.cc:2804] T c5873f7465894eddab6fa84daecdcc84 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:39.956108 25141 raft_consensus.cc:697] T c5873f7465894eddab6fa84daecdcc84 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 2 LEADER]: Becoming Leader. State: Replica: c0f503bf8bb94af8a2a1139db4e1c0f5, State: Running, Role: LEADER
I20260709 13:09:39.956028 25007 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1dcdde5516f54b19b11611ca9213415d"
dest_uuid: "dea34817fcc148d78f090ef5fa72304f"
 from {username='slave'} at 127.0.0.1:37108
I20260709 13:09:39.957204 25141 consensus_queue.cc:237] T c5873f7465894eddab6fa84daecdcc84 P c0f503bf8bb94af8a2a1139db4e1c0f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:39.957789 24236 raft_consensus.cc:2468] T c5873f7465894eddab6fa84daecdcc84 P f8d4657116f948038a0c73018238c3ba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0f503bf8bb94af8a2a1139db4e1c0f5 in term 2.
I20260709 13:09:39.957532 25007 raft_consensus.cc:493] T 1dcdde5516f54b19b11611ca9213415d P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:39.958572 25007 raft_consensus.cc:3060] T 1dcdde5516f54b19b11611ca9213415d P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:39.966460 25007 raft_consensus.cc:515] T 1dcdde5516f54b19b11611ca9213415d P dea34817fcc148d78f090ef5fa72304f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:39.967888 25203 raft_consensus.cc:993] T c7b586130d5842f293b0df4b02792ec6 P f8d4657116f948038a0c73018238c3ba: : Instructing follower b39c386162de49aca92dbebee7f06ace to start an election
I20260709 13:09:39.968562 25203 raft_consensus.cc:1081] T c7b586130d5842f293b0df4b02792ec6 P f8d4657116f948038a0c73018238c3ba [term 1 LEADER]: Signalling peer b39c386162de49aca92dbebee7f06ace to start an election
I20260709 13:09:39.970590 24312 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c7b586130d5842f293b0df4b02792ec6"
dest_uuid: "b39c386162de49aca92dbebee7f06ace"
 from {username='slave'} at 127.0.0.1:54334
I20260709 13:09:39.971174 24312 raft_consensus.cc:493] T c7b586130d5842f293b0df4b02792ec6 P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:39.971527 24312 raft_consensus.cc:3060] T c7b586130d5842f293b0df4b02792ec6 P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:39.972682 25007 leader_election.cc:290] T 1dcdde5516f54b19b11611ca9213415d P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 2 election: Requested vote from peers b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561), c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431)
I20260709 13:09:39.974738 24311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcdde5516f54b19b11611ca9213415d" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b39c386162de49aca92dbebee7f06ace"
I20260709 13:09:39.975396 24311 raft_consensus.cc:3060] T 1dcdde5516f54b19b11611ca9213415d P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:39.977552 23989 catalog_manager.cc:5697] T c5873f7465894eddab6fa84daecdcc84 P c0f503bf8bb94af8a2a1139db4e1c0f5 reported cstate change: term changed from 1 to 2, leader changed from f8d4657116f948038a0c73018238c3ba (127.14.180.67) to c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66). New cstate: current_term: 2 leader_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:39.978627 24312 raft_consensus.cc:515] T c7b586130d5842f293b0df4b02792ec6 P b39c386162de49aca92dbebee7f06ace [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:39.980618 24312 leader_election.cc:290] T c7b586130d5842f293b0df4b02792ec6 P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 2 election: Requested vote from peers c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431), f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171)
I20260709 13:09:39.981364 24165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcdde5516f54b19b11611ca9213415d" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5"
I20260709 13:09:39.982002 24165 raft_consensus.cc:3055] T 1dcdde5516f54b19b11611ca9213415d P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:39.982372 24165 raft_consensus.cc:740] T 1dcdde5516f54b19b11611ca9213415d P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c0f503bf8bb94af8a2a1139db4e1c0f5, State: Running, Role: LEADER
I20260709 13:09:39.983266 24165 consensus_queue.cc:260] T 1dcdde5516f54b19b11611ca9213415d P c0f503bf8bb94af8a2a1139db4e1c0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:39.984280 24158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7b586130d5842f293b0df4b02792ec6" candidate_uuid: "b39c386162de49aca92dbebee7f06ace" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5"
I20260709 13:09:39.984705 24165 raft_consensus.cc:3060] T 1dcdde5516f54b19b11611ca9213415d P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:39.984921 24158 raft_consensus.cc:3060] T c7b586130d5842f293b0df4b02792ec6 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:39.987742 24236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7b586130d5842f293b0df4b02792ec6" candidate_uuid: "b39c386162de49aca92dbebee7f06ace" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f8d4657116f948038a0c73018238c3ba"
I20260709 13:09:39.988432 24236 raft_consensus.cc:3055] T c7b586130d5842f293b0df4b02792ec6 P f8d4657116f948038a0c73018238c3ba [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:39.988727 24236 raft_consensus.cc:740] T c7b586130d5842f293b0df4b02792ec6 P f8d4657116f948038a0c73018238c3ba [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f8d4657116f948038a0c73018238c3ba, State: Running, Role: LEADER
I20260709 13:09:39.989591 24236 consensus_queue.cc:260] T c7b586130d5842f293b0df4b02792ec6 P f8d4657116f948038a0c73018238c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:39.993441 24236 raft_consensus.cc:3060] T c7b586130d5842f293b0df4b02792ec6 P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:39.995980 24158 raft_consensus.cc:2468] T c7b586130d5842f293b0df4b02792ec6 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b39c386162de49aca92dbebee7f06ace in term 2.
I20260709 13:09:40.003108 24280 leader_election.cc:304] T c7b586130d5842f293b0df4b02792ec6 P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b39c386162de49aca92dbebee7f06ace, c0f503bf8bb94af8a2a1139db4e1c0f5; no voters: 
I20260709 13:09:40.003750 24165 raft_consensus.cc:2468] T 1dcdde5516f54b19b11611ca9213415d P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dea34817fcc148d78f090ef5fa72304f in term 2.
I20260709 13:09:40.006335 25125 raft_consensus.cc:2804] T c7b586130d5842f293b0df4b02792ec6 P b39c386162de49aca92dbebee7f06ace [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:40.006515 24914 leader_election.cc:304] T 1dcdde5516f54b19b11611ca9213415d P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0f503bf8bb94af8a2a1139db4e1c0f5, dea34817fcc148d78f090ef5fa72304f; no voters: 
I20260709 13:09:40.006860 24311 raft_consensus.cc:2468] T 1dcdde5516f54b19b11611ca9213415d P b39c386162de49aca92dbebee7f06ace [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dea34817fcc148d78f090ef5fa72304f in term 2.
I20260709 13:09:40.007576 25132 raft_consensus.cc:2804] T 1dcdde5516f54b19b11611ca9213415d P dea34817fcc148d78f090ef5fa72304f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:40.008064 25132 raft_consensus.cc:697] T 1dcdde5516f54b19b11611ca9213415d P dea34817fcc148d78f090ef5fa72304f [term 2 LEADER]: Becoming Leader. State: Replica: dea34817fcc148d78f090ef5fa72304f, State: Running, Role: LEADER
I20260709 13:09:40.009078 25132 consensus_queue.cc:237] T 1dcdde5516f54b19b11611ca9213415d P dea34817fcc148d78f090ef5fa72304f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:40.010687 25125 raft_consensus.cc:697] T c7b586130d5842f293b0df4b02792ec6 P b39c386162de49aca92dbebee7f06ace [term 2 LEADER]: Becoming Leader. State: Replica: b39c386162de49aca92dbebee7f06ace, State: Running, Role: LEADER
I20260709 13:09:40.011765 25125 consensus_queue.cc:237] T c7b586130d5842f293b0df4b02792ec6 P b39c386162de49aca92dbebee7f06ace [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:40.025625 24236 raft_consensus.cc:2468] T c7b586130d5842f293b0df4b02792ec6 P f8d4657116f948038a0c73018238c3ba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b39c386162de49aca92dbebee7f06ace in term 2.
I20260709 13:09:40.032017 23989 catalog_manager.cc:5697] T 1dcdde5516f54b19b11611ca9213415d P dea34817fcc148d78f090ef5fa72304f reported cstate change: term changed from 1 to 2, leader changed from c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66) to dea34817fcc148d78f090ef5fa72304f (127.14.180.65). New cstate: current_term: 2 leader_uuid: "dea34817fcc148d78f090ef5fa72304f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:40.034138 23985 catalog_manager.cc:5697] T c7b586130d5842f293b0df4b02792ec6 P b39c386162de49aca92dbebee7f06ace reported cstate change: term changed from 1 to 2, leader changed from f8d4657116f948038a0c73018238c3ba (127.14.180.67) to b39c386162de49aca92dbebee7f06ace (127.14.180.68). New cstate: current_term: 2 leader_uuid: "b39c386162de49aca92dbebee7f06ace" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:40.043952 25125 raft_consensus.cc:993] T 662a938528e545e6aa4592052da18101 P b39c386162de49aca92dbebee7f06ace: : Instructing follower dea34817fcc148d78f090ef5fa72304f to start an election
I20260709 13:09:40.044720 25122 raft_consensus.cc:1081] T 662a938528e545e6aa4592052da18101 P b39c386162de49aca92dbebee7f06ace [term 3 LEADER]: Signalling peer dea34817fcc148d78f090ef5fa72304f to start an election
I20260709 13:09:40.047912 25007 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "662a938528e545e6aa4592052da18101"
dest_uuid: "dea34817fcc148d78f090ef5fa72304f"
 from {username='slave'} at 127.0.0.1:37152
I20260709 13:09:40.048832 25007 raft_consensus.cc:493] T 662a938528e545e6aa4592052da18101 P dea34817fcc148d78f090ef5fa72304f [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:40.049376 25007 raft_consensus.cc:3060] T 662a938528e545e6aa4592052da18101 P dea34817fcc148d78f090ef5fa72304f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:40.056308 25007 raft_consensus.cc:515] T 662a938528e545e6aa4592052da18101 P dea34817fcc148d78f090ef5fa72304f [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:40.058365 25007 leader_election.cc:290] T 662a938528e545e6aa4592052da18101 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 4 election: Requested vote from peers f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171), b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561)
I20260709 13:09:40.059242 24236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "662a938528e545e6aa4592052da18101" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "f8d4657116f948038a0c73018238c3ba"
I20260709 13:09:40.059556 24310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "662a938528e545e6aa4592052da18101" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "b39c386162de49aca92dbebee7f06ace"
I20260709 13:09:40.060042 24236 raft_consensus.cc:3060] T 662a938528e545e6aa4592052da18101 P f8d4657116f948038a0c73018238c3ba [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:40.060295 24310 raft_consensus.cc:3055] T 662a938528e545e6aa4592052da18101 P b39c386162de49aca92dbebee7f06ace [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:40.060736 24310 raft_consensus.cc:740] T 662a938528e545e6aa4592052da18101 P b39c386162de49aca92dbebee7f06ace [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b39c386162de49aca92dbebee7f06ace, State: Running, Role: LEADER
I20260709 13:09:40.061558 24310 consensus_queue.cc:260] T 662a938528e545e6aa4592052da18101 P b39c386162de49aca92dbebee7f06ace [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:40.063050 24310 raft_consensus.cc:3060] T 662a938528e545e6aa4592052da18101 P b39c386162de49aca92dbebee7f06ace [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:40.067000 24236 raft_consensus.cc:2468] T 662a938528e545e6aa4592052da18101 P f8d4657116f948038a0c73018238c3ba [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dea34817fcc148d78f090ef5fa72304f in term 4.
I20260709 13:09:40.068370 24913 leader_election.cc:304] T 662a938528e545e6aa4592052da18101 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dea34817fcc148d78f090ef5fa72304f, f8d4657116f948038a0c73018238c3ba; no voters: 
I20260709 13:09:40.069161 25132 raft_consensus.cc:2804] T 662a938528e545e6aa4592052da18101 P dea34817fcc148d78f090ef5fa72304f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:40.069603 25132 raft_consensus.cc:697] T 662a938528e545e6aa4592052da18101 P dea34817fcc148d78f090ef5fa72304f [term 4 LEADER]: Becoming Leader. State: Replica: dea34817fcc148d78f090ef5fa72304f, State: Running, Role: LEADER
I20260709 13:09:40.070473 25132 consensus_queue.cc:237] T 662a938528e545e6aa4592052da18101 P dea34817fcc148d78f090ef5fa72304f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:40.070740 24310 raft_consensus.cc:2468] T 662a938528e545e6aa4592052da18101 P b39c386162de49aca92dbebee7f06ace [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dea34817fcc148d78f090ef5fa72304f in term 4.
I20260709 13:09:40.081913 23989 catalog_manager.cc:5697] T 662a938528e545e6aa4592052da18101 P dea34817fcc148d78f090ef5fa72304f reported cstate change: term changed from 3 to 4, leader changed from b39c386162de49aca92dbebee7f06ace (127.14.180.68) to dea34817fcc148d78f090ef5fa72304f (127.14.180.65). New cstate: current_term: 4 leader_uuid: "dea34817fcc148d78f090ef5fa72304f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:40.127852 24912 raft_consensus.cc:993] T 9a126a61cad843b4a3b34fac0f85a1d2 P f8d4657116f948038a0c73018238c3ba: : Instructing follower b39c386162de49aca92dbebee7f06ace to start an election
I20260709 13:09:40.128438 24912 raft_consensus.cc:1081] T 9a126a61cad843b4a3b34fac0f85a1d2 P f8d4657116f948038a0c73018238c3ba [term 1 LEADER]: Signalling peer b39c386162de49aca92dbebee7f06ace to start an election
I20260709 13:09:40.130177 24310 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9a126a61cad843b4a3b34fac0f85a1d2"
dest_uuid: "b39c386162de49aca92dbebee7f06ace"
 from {username='slave'} at 127.0.0.1:54334
I20260709 13:09:40.130721 24310 raft_consensus.cc:493] T 9a126a61cad843b4a3b34fac0f85a1d2 P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:40.131043 24310 raft_consensus.cc:3060] T 9a126a61cad843b4a3b34fac0f85a1d2 P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:40.137130 24310 raft_consensus.cc:515] T 9a126a61cad843b4a3b34fac0f85a1d2 P b39c386162de49aca92dbebee7f06ace [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:40.138789 24310 leader_election.cc:290] T 9a126a61cad843b4a3b34fac0f85a1d2 P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 2 election: Requested vote from peers c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431), f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171)
I20260709 13:09:40.139578 24158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a126a61cad843b4a3b34fac0f85a1d2" candidate_uuid: "b39c386162de49aca92dbebee7f06ace" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5"
I20260709 13:09:40.139842 24236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a126a61cad843b4a3b34fac0f85a1d2" candidate_uuid: "b39c386162de49aca92dbebee7f06ace" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f8d4657116f948038a0c73018238c3ba"
I20260709 13:09:40.140417 24158 raft_consensus.cc:3060] T 9a126a61cad843b4a3b34fac0f85a1d2 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:40.140486 24236 raft_consensus.cc:3055] T 9a126a61cad843b4a3b34fac0f85a1d2 P f8d4657116f948038a0c73018238c3ba [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:40.140919 24236 raft_consensus.cc:740] T 9a126a61cad843b4a3b34fac0f85a1d2 P f8d4657116f948038a0c73018238c3ba [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f8d4657116f948038a0c73018238c3ba, State: Running, Role: LEADER
I20260709 13:09:40.141526 24236 consensus_queue.cc:260] T 9a126a61cad843b4a3b34fac0f85a1d2 P f8d4657116f948038a0c73018238c3ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:40.142683 24236 raft_consensus.cc:3060] T 9a126a61cad843b4a3b34fac0f85a1d2 P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:40.146463 24158 raft_consensus.cc:2468] T 9a126a61cad843b4a3b34fac0f85a1d2 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b39c386162de49aca92dbebee7f06ace in term 2.
I20260709 13:09:40.147956 24280 leader_election.cc:304] T 9a126a61cad843b4a3b34fac0f85a1d2 P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b39c386162de49aca92dbebee7f06ace, c0f503bf8bb94af8a2a1139db4e1c0f5; no voters: 
I20260709 13:09:40.148756 25125 raft_consensus.cc:2804] T 9a126a61cad843b4a3b34fac0f85a1d2 P b39c386162de49aca92dbebee7f06ace [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:40.149246 25125 raft_consensus.cc:697] T 9a126a61cad843b4a3b34fac0f85a1d2 P b39c386162de49aca92dbebee7f06ace [term 2 LEADER]: Becoming Leader. State: Replica: b39c386162de49aca92dbebee7f06ace, State: Running, Role: LEADER
I20260709 13:09:40.149266 24236 raft_consensus.cc:2468] T 9a126a61cad843b4a3b34fac0f85a1d2 P f8d4657116f948038a0c73018238c3ba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b39c386162de49aca92dbebee7f06ace in term 2.
I20260709 13:09:40.150656 25125 consensus_queue.cc:237] T 9a126a61cad843b4a3b34fac0f85a1d2 P b39c386162de49aca92dbebee7f06ace [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:40.161361 23989 catalog_manager.cc:5697] T 9a126a61cad843b4a3b34fac0f85a1d2 P b39c386162de49aca92dbebee7f06ace reported cstate change: term changed from 1 to 2, leader changed from f8d4657116f948038a0c73018238c3ba (127.14.180.67) to b39c386162de49aca92dbebee7f06ace (127.14.180.68). New cstate: current_term: 2 leader_uuid: "b39c386162de49aca92dbebee7f06ace" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:40.373581 24310 raft_consensus.cc:1275] T c5873f7465894eddab6fa84daecdcc84 P b39c386162de49aca92dbebee7f06ace [term 2 FOLLOWER]: Refusing update from remote peer c0f503bf8bb94af8a2a1139db4e1c0f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:40.375079 25218 consensus_queue.cc:1048] T c5873f7465894eddab6fa84daecdcc84 P c0f503bf8bb94af8a2a1139db4e1c0f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:40.390487 24236 raft_consensus.cc:1275] T c5873f7465894eddab6fa84daecdcc84 P f8d4657116f948038a0c73018238c3ba [term 2 FOLLOWER]: Refusing update from remote peer c0f503bf8bb94af8a2a1139db4e1c0f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:40.394151 25218 consensus_queue.cc:1048] T c5873f7465894eddab6fa84daecdcc84 P c0f503bf8bb94af8a2a1139db4e1c0f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:40.449214 24165 raft_consensus.cc:1275] T c7b586130d5842f293b0df4b02792ec6 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 2 FOLLOWER]: Refusing update from remote peer b39c386162de49aca92dbebee7f06ace: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:40.451205 25125 consensus_queue.cc:1048] T c7b586130d5842f293b0df4b02792ec6 P b39c386162de49aca92dbebee7f06ace [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:40.465924 24240 raft_consensus.cc:1275] T c7b586130d5842f293b0df4b02792ec6 P f8d4657116f948038a0c73018238c3ba [term 2 FOLLOWER]: Refusing update from remote peer b39c386162de49aca92dbebee7f06ace: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:40.469234 24312 raft_consensus.cc:1275] T 662a938528e545e6aa4592052da18101 P b39c386162de49aca92dbebee7f06ace [term 4 FOLLOWER]: Refusing update from remote peer dea34817fcc148d78f090ef5fa72304f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:09:40.471375 25132 consensus_queue.cc:1048] T 662a938528e545e6aa4592052da18101 P dea34817fcc148d78f090ef5fa72304f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:40.470279 25125 consensus_queue.cc:1048] T c7b586130d5842f293b0df4b02792ec6 P b39c386162de49aca92dbebee7f06ace [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:09:40.524537 24240 raft_consensus.cc:1275] T 662a938528e545e6aa4592052da18101 P f8d4657116f948038a0c73018238c3ba [term 4 FOLLOWER]: Refusing update from remote peer dea34817fcc148d78f090ef5fa72304f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:09:40.526603 25132 consensus_queue.cc:1048] T 662a938528e545e6aa4592052da18101 P dea34817fcc148d78f090ef5fa72304f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:40.576262 24312 raft_consensus.cc:1275] T 1dcdde5516f54b19b11611ca9213415d P b39c386162de49aca92dbebee7f06ace [term 2 FOLLOWER]: Refusing update from remote peer dea34817fcc148d78f090ef5fa72304f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:40.578003 24165 raft_consensus.cc:1275] T 1dcdde5516f54b19b11611ca9213415d P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 2 FOLLOWER]: Refusing update from remote peer dea34817fcc148d78f090ef5fa72304f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:40.577817 25149 consensus_queue.cc:1048] T 1dcdde5516f54b19b11611ca9213415d P dea34817fcc148d78f090ef5fa72304f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:40.579481 25132 consensus_queue.cc:1048] T 1dcdde5516f54b19b11611ca9213415d P dea34817fcc148d78f090ef5fa72304f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:40.666675 15057 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:40.680138 24238 raft_consensus.cc:1275] T 9a126a61cad843b4a3b34fac0f85a1d2 P f8d4657116f948038a0c73018238c3ba [term 2 FOLLOWER]: Refusing update from remote peer b39c386162de49aca92dbebee7f06ace: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:40.682000 25235 consensus_queue.cc:1048] T 9a126a61cad843b4a3b34fac0f85a1d2 P b39c386162de49aca92dbebee7f06ace [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:40.699877 24165 raft_consensus.cc:1275] T 9a126a61cad843b4a3b34fac0f85a1d2 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 2 FOLLOWER]: Refusing update from remote peer b39c386162de49aca92dbebee7f06ace: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:40.702085 25235 consensus_queue.cc:1048] T 9a126a61cad843b4a3b34fac0f85a1d2 P b39c386162de49aca92dbebee7f06ace [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:40.733484 15057 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:40.777631 24310 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "42868db4862647c28215f3d7cb9adf02"
dest_uuid: "b39c386162de49aca92dbebee7f06ace"
mode: GRACEFUL
new_leader_uuid: "dea34817fcc148d78f090ef5fa72304f"
 from {username='slave'} at 127.0.0.1:36444
I20260709 13:09:40.778211 24310 raft_consensus.cc:606] T 42868db4862647c28215f3d7cb9adf02 P b39c386162de49aca92dbebee7f06ace [term 2 LEADER]: Received request to transfer leadership to TS dea34817fcc148d78f090ef5fa72304f
I20260709 13:09:40.781065 24310 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "99b130381d71460388507938ba053f8f"
dest_uuid: "b39c386162de49aca92dbebee7f06ace"
mode: GRACEFUL
new_leader_uuid: "dea34817fcc148d78f090ef5fa72304f"
 from {username='slave'} at 127.0.0.1:36444
I20260709 13:09:40.781741 24310 raft_consensus.cc:606] T 99b130381d71460388507938ba053f8f P b39c386162de49aca92dbebee7f06ace [term 1 LEADER]: Received request to transfer leadership to TS dea34817fcc148d78f090ef5fa72304f
I20260709 13:09:40.784579 24165 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c5873f7465894eddab6fa84daecdcc84"
dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5"
mode: GRACEFUL
new_leader_uuid: "b39c386162de49aca92dbebee7f06ace"
 from {username='slave'} at 127.0.0.1:55352
I20260709 13:09:40.785131 24165 raft_consensus.cc:606] T c5873f7465894eddab6fa84daecdcc84 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 2 LEADER]: Received request to transfer leadership to TS b39c386162de49aca92dbebee7f06ace
I20260709 13:09:40.786298 15057 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:09:40.788142 15057 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:40.933913 25235 raft_consensus.cc:993] T 42868db4862647c28215f3d7cb9adf02 P b39c386162de49aca92dbebee7f06ace: : Instructing follower dea34817fcc148d78f090ef5fa72304f to start an election
I20260709 13:09:40.934541 25235 raft_consensus.cc:1081] T 42868db4862647c28215f3d7cb9adf02 P b39c386162de49aca92dbebee7f06ace [term 2 LEADER]: Signalling peer dea34817fcc148d78f090ef5fa72304f to start an election
I20260709 13:09:40.937865 25010 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "42868db4862647c28215f3d7cb9adf02"
dest_uuid: "dea34817fcc148d78f090ef5fa72304f"
 from {username='slave'} at 127.0.0.1:37152
I20260709 13:09:40.938483 25010 raft_consensus.cc:493] T 42868db4862647c28215f3d7cb9adf02 P dea34817fcc148d78f090ef5fa72304f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:40.938941 25010 raft_consensus.cc:3060] T 42868db4862647c28215f3d7cb9adf02 P dea34817fcc148d78f090ef5fa72304f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:40.944391 25010 raft_consensus.cc:515] T 42868db4862647c28215f3d7cb9adf02 P dea34817fcc148d78f090ef5fa72304f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:40.947009 25010 leader_election.cc:290] T 42868db4862647c28215f3d7cb9adf02 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 3 election: Requested vote from peers f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171), b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561)
I20260709 13:09:40.947165 24238 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42868db4862647c28215f3d7cb9adf02" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f8d4657116f948038a0c73018238c3ba"
I20260709 13:09:40.947827 24238 raft_consensus.cc:3060] T 42868db4862647c28215f3d7cb9adf02 P f8d4657116f948038a0c73018238c3ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:40.947996 24312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42868db4862647c28215f3d7cb9adf02" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b39c386162de49aca92dbebee7f06ace"
I20260709 13:09:40.948590 24312 raft_consensus.cc:3055] T 42868db4862647c28215f3d7cb9adf02 P b39c386162de49aca92dbebee7f06ace [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:40.948886 24312 raft_consensus.cc:740] T 42868db4862647c28215f3d7cb9adf02 P b39c386162de49aca92dbebee7f06ace [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b39c386162de49aca92dbebee7f06ace, State: Running, Role: LEADER
I20260709 13:09:40.949710 24312 consensus_queue.cc:260] T 42868db4862647c28215f3d7cb9adf02 P b39c386162de49aca92dbebee7f06ace [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:40.950997 24312 raft_consensus.cc:3060] T 42868db4862647c28215f3d7cb9adf02 P b39c386162de49aca92dbebee7f06ace [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:40.958694 24312 raft_consensus.cc:2468] T 42868db4862647c28215f3d7cb9adf02 P b39c386162de49aca92dbebee7f06ace [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dea34817fcc148d78f090ef5fa72304f in term 3.
I20260709 13:09:40.959484 24238 raft_consensus.cc:2468] T 42868db4862647c28215f3d7cb9adf02 P f8d4657116f948038a0c73018238c3ba [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dea34817fcc148d78f090ef5fa72304f in term 3.
I20260709 13:09:40.960150 24911 leader_election.cc:304] T 42868db4862647c28215f3d7cb9adf02 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b39c386162de49aca92dbebee7f06ace, dea34817fcc148d78f090ef5fa72304f; no voters: 
I20260709 13:09:40.961229 25149 raft_consensus.cc:2804] T 42868db4862647c28215f3d7cb9adf02 P dea34817fcc148d78f090ef5fa72304f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:40.961778 25149 raft_consensus.cc:697] T 42868db4862647c28215f3d7cb9adf02 P dea34817fcc148d78f090ef5fa72304f [term 3 LEADER]: Becoming Leader. State: Replica: dea34817fcc148d78f090ef5fa72304f, State: Running, Role: LEADER
I20260709 13:09:40.962699 25149 consensus_queue.cc:237] T 42868db4862647c28215f3d7cb9adf02 P dea34817fcc148d78f090ef5fa72304f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:40.969677 25235 raft_consensus.cc:993] T 99b130381d71460388507938ba053f8f P b39c386162de49aca92dbebee7f06ace: : Instructing follower dea34817fcc148d78f090ef5fa72304f to start an election
I20260709 13:09:40.970695 25125 raft_consensus.cc:1081] T 99b130381d71460388507938ba053f8f P b39c386162de49aca92dbebee7f06ace [term 1 LEADER]: Signalling peer dea34817fcc148d78f090ef5fa72304f to start an election
I20260709 13:09:40.972625 25010 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "99b130381d71460388507938ba053f8f"
dest_uuid: "dea34817fcc148d78f090ef5fa72304f"
 from {username='slave'} at 127.0.0.1:37152
I20260709 13:09:40.973695 25010 raft_consensus.cc:493] T 99b130381d71460388507938ba053f8f P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:40.974116 25010 raft_consensus.cc:3060] T 99b130381d71460388507938ba053f8f P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:40.976467 23987 catalog_manager.cc:5697] T 42868db4862647c28215f3d7cb9adf02 P dea34817fcc148d78f090ef5fa72304f reported cstate change: term changed from 2 to 3, leader changed from b39c386162de49aca92dbebee7f06ace (127.14.180.68) to dea34817fcc148d78f090ef5fa72304f (127.14.180.65). New cstate: current_term: 3 leader_uuid: "dea34817fcc148d78f090ef5fa72304f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:40.980924 25218 raft_consensus.cc:993] T c5873f7465894eddab6fa84daecdcc84 P c0f503bf8bb94af8a2a1139db4e1c0f5: : Instructing follower b39c386162de49aca92dbebee7f06ace to start an election
I20260709 13:09:40.981514 25250 raft_consensus.cc:1081] T c5873f7465894eddab6fa84daecdcc84 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 2 LEADER]: Signalling peer b39c386162de49aca92dbebee7f06ace to start an election
I20260709 13:09:40.982174 25010 raft_consensus.cc:515] T 99b130381d71460388507938ba053f8f P dea34817fcc148d78f090ef5fa72304f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:40.983566 24312 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c5873f7465894eddab6fa84daecdcc84"
dest_uuid: "b39c386162de49aca92dbebee7f06ace"
 from {username='slave'} at 127.0.0.1:54318
I20260709 13:09:40.984350 24312 raft_consensus.cc:493] T c5873f7465894eddab6fa84daecdcc84 P b39c386162de49aca92dbebee7f06ace [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:40.984571 25010 leader_election.cc:290] T 99b130381d71460388507938ba053f8f P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 2 election: Requested vote from peers b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561), c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431)
I20260709 13:09:40.984833 24312 raft_consensus.cc:3060] T c5873f7465894eddab6fa84daecdcc84 P b39c386162de49aca92dbebee7f06ace [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:40.985586 24158 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b130381d71460388507938ba053f8f" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5"
I20260709 13:09:40.986164 24158 raft_consensus.cc:3060] T 99b130381d71460388507938ba053f8f P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:40.986316 24310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99b130381d71460388507938ba053f8f" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b39c386162de49aca92dbebee7f06ace"
I20260709 13:09:40.986950 24310 raft_consensus.cc:3055] T 99b130381d71460388507938ba053f8f P b39c386162de49aca92dbebee7f06ace [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:40.987274 24310 raft_consensus.cc:740] T 99b130381d71460388507938ba053f8f P b39c386162de49aca92dbebee7f06ace [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b39c386162de49aca92dbebee7f06ace, State: Running, Role: LEADER
I20260709 13:09:40.988040 24310 consensus_queue.cc:260] T 99b130381d71460388507938ba053f8f P b39c386162de49aca92dbebee7f06ace [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:40.989315 24310 raft_consensus.cc:3060] T 99b130381d71460388507938ba053f8f P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:40.992379 24312 raft_consensus.cc:515] T c5873f7465894eddab6fa84daecdcc84 P b39c386162de49aca92dbebee7f06ace [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:40.993564 24158 raft_consensus.cc:2468] T 99b130381d71460388507938ba053f8f P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dea34817fcc148d78f090ef5fa72304f in term 2.
I20260709 13:09:40.994881 24914 leader_election.cc:304] T 99b130381d71460388507938ba053f8f P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0f503bf8bb94af8a2a1139db4e1c0f5, dea34817fcc148d78f090ef5fa72304f; no voters: 
I20260709 13:09:40.995064 24312 leader_election.cc:290] T c5873f7465894eddab6fa84daecdcc84 P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 3 election: Requested vote from peers c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431), f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171)
I20260709 13:09:40.995428 24165 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5873f7465894eddab6fa84daecdcc84" candidate_uuid: "b39c386162de49aca92dbebee7f06ace" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5"
I20260709 13:09:40.996105 24165 raft_consensus.cc:3055] T c5873f7465894eddab6fa84daecdcc84 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:40.996439 24165 raft_consensus.cc:740] T c5873f7465894eddab6fa84daecdcc84 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c0f503bf8bb94af8a2a1139db4e1c0f5, State: Running, Role: LEADER
I20260709 13:09:40.997156 24165 consensus_queue.cc:260] T c5873f7465894eddab6fa84daecdcc84 P c0f503bf8bb94af8a2a1139db4e1c0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:40.998205 24165 raft_consensus.cc:3060] T c5873f7465894eddab6fa84daecdcc84 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:40.999063 24310 raft_consensus.cc:2468] T 99b130381d71460388507938ba053f8f P b39c386162de49aca92dbebee7f06ace [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dea34817fcc148d78f090ef5fa72304f in term 2.
I20260709 13:09:41.002190 24240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5873f7465894eddab6fa84daecdcc84" candidate_uuid: "b39c386162de49aca92dbebee7f06ace" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f8d4657116f948038a0c73018238c3ba"
I20260709 13:09:41.002913 24240 raft_consensus.cc:3060] T c5873f7465894eddab6fa84daecdcc84 P f8d4657116f948038a0c73018238c3ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:41.000818 25219 raft_consensus.cc:2804] T 99b130381d71460388507938ba053f8f P dea34817fcc148d78f090ef5fa72304f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:41.008395 25219 raft_consensus.cc:697] T 99b130381d71460388507938ba053f8f P dea34817fcc148d78f090ef5fa72304f [term 2 LEADER]: Becoming Leader. State: Replica: dea34817fcc148d78f090ef5fa72304f, State: Running, Role: LEADER
I20260709 13:09:41.009495 25219 consensus_queue.cc:237] T 99b130381d71460388507938ba053f8f P dea34817fcc148d78f090ef5fa72304f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:41.017223 24165 raft_consensus.cc:2468] T c5873f7465894eddab6fa84daecdcc84 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b39c386162de49aca92dbebee7f06ace in term 3.
I20260709 13:09:41.018944 24280 leader_election.cc:304] T c5873f7465894eddab6fa84daecdcc84 P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b39c386162de49aca92dbebee7f06ace, c0f503bf8bb94af8a2a1139db4e1c0f5; no voters: 
I20260709 13:09:41.019917 25235 raft_consensus.cc:2804] T c5873f7465894eddab6fa84daecdcc84 P b39c386162de49aca92dbebee7f06ace [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:41.020692 25235 raft_consensus.cc:697] T c5873f7465894eddab6fa84daecdcc84 P b39c386162de49aca92dbebee7f06ace [term 3 LEADER]: Becoming Leader. State: Replica: b39c386162de49aca92dbebee7f06ace, State: Running, Role: LEADER
I20260709 13:09:41.021713 25235 consensus_queue.cc:237] T c5873f7465894eddab6fa84daecdcc84 P b39c386162de49aca92dbebee7f06ace [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:41.021631 24240 raft_consensus.cc:2468] T c5873f7465894eddab6fa84daecdcc84 P f8d4657116f948038a0c73018238c3ba [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b39c386162de49aca92dbebee7f06ace in term 3.
I20260709 13:09:41.041976 23987 catalog_manager.cc:5697] T c5873f7465894eddab6fa84daecdcc84 P b39c386162de49aca92dbebee7f06ace reported cstate change: term changed from 2 to 3, leader changed from c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66) to b39c386162de49aca92dbebee7f06ace (127.14.180.68). New cstate: current_term: 3 leader_uuid: "b39c386162de49aca92dbebee7f06ace" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:41.047654 23989 catalog_manager.cc:5697] T 99b130381d71460388507938ba053f8f P dea34817fcc148d78f090ef5fa72304f reported cstate change: term changed from 1 to 2, leader changed from b39c386162de49aca92dbebee7f06ace (127.14.180.68) to dea34817fcc148d78f090ef5fa72304f (127.14.180.65). New cstate: current_term: 2 leader_uuid: "dea34817fcc148d78f090ef5fa72304f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:41.427198 24310 raft_consensus.cc:1275] T 99b130381d71460388507938ba053f8f P b39c386162de49aca92dbebee7f06ace [term 2 FOLLOWER]: Refusing update from remote peer dea34817fcc148d78f090ef5fa72304f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:41.428540 25149 consensus_queue.cc:1048] T 99b130381d71460388507938ba053f8f P dea34817fcc148d78f090ef5fa72304f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:41.439538 24312 raft_consensus.cc:1275] T 42868db4862647c28215f3d7cb9adf02 P b39c386162de49aca92dbebee7f06ace [term 3 FOLLOWER]: Refusing update from remote peer dea34817fcc148d78f090ef5fa72304f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:41.440991 25132 consensus_queue.cc:1048] T 42868db4862647c28215f3d7cb9adf02 P dea34817fcc148d78f090ef5fa72304f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:41.447943 24158 raft_consensus.cc:1275] T 99b130381d71460388507938ba053f8f P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 2 FOLLOWER]: Refusing update from remote peer dea34817fcc148d78f090ef5fa72304f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:41.450687 25132 consensus_queue.cc:1048] T 99b130381d71460388507938ba053f8f P dea34817fcc148d78f090ef5fa72304f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:41.463470 24238 raft_consensus.cc:1275] T 42868db4862647c28215f3d7cb9adf02 P f8d4657116f948038a0c73018238c3ba [term 3 FOLLOWER]: Refusing update from remote peer dea34817fcc148d78f090ef5fa72304f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:41.468057 25219 consensus_queue.cc:1048] T 42868db4862647c28215f3d7cb9adf02 P dea34817fcc148d78f090ef5fa72304f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:41.491971 24237 raft_consensus.cc:1275] T c5873f7465894eddab6fa84daecdcc84 P f8d4657116f948038a0c73018238c3ba [term 3 FOLLOWER]: Refusing update from remote peer b39c386162de49aca92dbebee7f06ace: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:41.496526 25122 consensus_queue.cc:1048] T c5873f7465894eddab6fa84daecdcc84 P b39c386162de49aca92dbebee7f06ace [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:09:41.527040 24914 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:37431, user_credentials={real_user=slave}} blocked reactor thread for 56139.8us
I20260709 13:09:41.541987 24158 raft_consensus.cc:1275] T c5873f7465894eddab6fa84daecdcc84 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 3 FOLLOWER]: Refusing update from remote peer b39c386162de49aca92dbebee7f06ace: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:41.545066 25245 consensus_queue.cc:1048] T c5873f7465894eddab6fa84daecdcc84 P b39c386162de49aca92dbebee7f06ace [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:41.789224 15057 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:41.854525 15057 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:41.908707 24310 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d2ddfc9daac54dc28d63b46ab1777bf3"
dest_uuid: "b39c386162de49aca92dbebee7f06ace"
mode: GRACEFUL
new_leader_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5"
 from {username='slave'} at 127.0.0.1:36444
I20260709 13:09:41.909442 24310 raft_consensus.cc:606] T d2ddfc9daac54dc28d63b46ab1777bf3 P b39c386162de49aca92dbebee7f06ace [term 1 LEADER]: Received request to transfer leadership to TS c0f503bf8bb94af8a2a1139db4e1c0f5
I20260709 13:09:41.911965 15057 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:09:41.913940 15057 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:42.307343 25235 raft_consensus.cc:993] T d2ddfc9daac54dc28d63b46ab1777bf3 P b39c386162de49aca92dbebee7f06ace: : Instructing follower c0f503bf8bb94af8a2a1139db4e1c0f5 to start an election
I20260709 13:09:42.307832 25245 raft_consensus.cc:1081] T d2ddfc9daac54dc28d63b46ab1777bf3 P b39c386162de49aca92dbebee7f06ace [term 1 LEADER]: Signalling peer c0f503bf8bb94af8a2a1139db4e1c0f5 to start an election
I20260709 13:09:42.309438 24165 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d2ddfc9daac54dc28d63b46ab1777bf3"
dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5"
 from {username='slave'} at 127.0.0.1:59142
I20260709 13:09:42.310029 24165 raft_consensus.cc:493] T d2ddfc9daac54dc28d63b46ab1777bf3 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:42.310356 24165 raft_consensus.cc:3060] T d2ddfc9daac54dc28d63b46ab1777bf3 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:42.317910 24165 raft_consensus.cc:515] T d2ddfc9daac54dc28d63b46ab1777bf3 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:42.320031 24165 leader_election.cc:290] T d2ddfc9daac54dc28d63b46ab1777bf3 P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 2 election: Requested vote from peers f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171), b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561)
I20260709 13:09:42.320945 24237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2ddfc9daac54dc28d63b46ab1777bf3" candidate_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f8d4657116f948038a0c73018238c3ba"
I20260709 13:09:42.321174 24310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2ddfc9daac54dc28d63b46ab1777bf3" candidate_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b39c386162de49aca92dbebee7f06ace"
I20260709 13:09:42.321616 24237 raft_consensus.cc:3060] T d2ddfc9daac54dc28d63b46ab1777bf3 P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:42.321868 24310 raft_consensus.cc:3055] T d2ddfc9daac54dc28d63b46ab1777bf3 P b39c386162de49aca92dbebee7f06ace [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:42.322225 24310 raft_consensus.cc:740] T d2ddfc9daac54dc28d63b46ab1777bf3 P b39c386162de49aca92dbebee7f06ace [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b39c386162de49aca92dbebee7f06ace, State: Running, Role: LEADER
I20260709 13:09:42.323028 24310 consensus_queue.cc:260] T d2ddfc9daac54dc28d63b46ab1777bf3 P b39c386162de49aca92dbebee7f06ace [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:42.324398 24310 raft_consensus.cc:3060] T d2ddfc9daac54dc28d63b46ab1777bf3 P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:42.329123 24237 raft_consensus.cc:2468] T d2ddfc9daac54dc28d63b46ab1777bf3 P f8d4657116f948038a0c73018238c3ba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0f503bf8bb94af8a2a1139db4e1c0f5 in term 2.
I20260709 13:09:42.331858 24131 leader_election.cc:304] T d2ddfc9daac54dc28d63b46ab1777bf3 P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0f503bf8bb94af8a2a1139db4e1c0f5, f8d4657116f948038a0c73018238c3ba; no voters: 
I20260709 13:09:42.334055 24310 raft_consensus.cc:2468] T d2ddfc9daac54dc28d63b46ab1777bf3 P b39c386162de49aca92dbebee7f06ace [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0f503bf8bb94af8a2a1139db4e1c0f5 in term 2.
I20260709 13:09:42.334987 25250 raft_consensus.cc:2804] T d2ddfc9daac54dc28d63b46ab1777bf3 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:42.335579 25250 raft_consensus.cc:697] T d2ddfc9daac54dc28d63b46ab1777bf3 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 2 LEADER]: Becoming Leader. State: Replica: c0f503bf8bb94af8a2a1139db4e1c0f5, State: Running, Role: LEADER
I20260709 13:09:42.336498 25250 consensus_queue.cc:237] T d2ddfc9daac54dc28d63b46ab1777bf3 P c0f503bf8bb94af8a2a1139db4e1c0f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:42.349484 23989 catalog_manager.cc:5697] T d2ddfc9daac54dc28d63b46ab1777bf3 P c0f503bf8bb94af8a2a1139db4e1c0f5 reported cstate change: term changed from 1 to 2, leader changed from b39c386162de49aca92dbebee7f06ace (127.14.180.68) to c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66). New cstate: current_term: 2 leader_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:42.763984 24237 raft_consensus.cc:1275] T d2ddfc9daac54dc28d63b46ab1777bf3 P f8d4657116f948038a0c73018238c3ba [term 2 FOLLOWER]: Refusing update from remote peer c0f503bf8bb94af8a2a1139db4e1c0f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:42.765626 25249 consensus_queue.cc:1048] T d2ddfc9daac54dc28d63b46ab1777bf3 P c0f503bf8bb94af8a2a1139db4e1c0f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:42.782430 24311 raft_consensus.cc:1275] T d2ddfc9daac54dc28d63b46ab1777bf3 P b39c386162de49aca92dbebee7f06ace [term 2 FOLLOWER]: Refusing update from remote peer c0f503bf8bb94af8a2a1139db4e1c0f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:42.784531 25249 consensus_queue.cc:1048] T d2ddfc9daac54dc28d63b46ab1777bf3 P c0f503bf8bb94af8a2a1139db4e1c0f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:42.915210 15057 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:42.997612 15057 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:43.046977 24165 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6bdf4f0b87584bdab10ccc418ab54f02"
dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5"
mode: GRACEFUL
new_leader_uuid: "b39c386162de49aca92dbebee7f06ace"
 from {username='slave'} at 127.0.0.1:55352
I20260709 13:09:43.047623 24165 raft_consensus.cc:606] T 6bdf4f0b87584bdab10ccc418ab54f02 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 3 LEADER]: Received request to transfer leadership to TS b39c386162de49aca92dbebee7f06ace
I20260709 13:09:43.048991 15057 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:09:43.050629 15057 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:43.506016 25286 raft_consensus.cc:993] T 6bdf4f0b87584bdab10ccc418ab54f02 P c0f503bf8bb94af8a2a1139db4e1c0f5: : Instructing follower b39c386162de49aca92dbebee7f06ace to start an election
I20260709 13:09:43.507225 25249 raft_consensus.cc:1081] T 6bdf4f0b87584bdab10ccc418ab54f02 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 3 LEADER]: Signalling peer b39c386162de49aca92dbebee7f06ace to start an election
I20260709 13:09:43.509451 24311 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6bdf4f0b87584bdab10ccc418ab54f02"
dest_uuid: "b39c386162de49aca92dbebee7f06ace"
 from {username='slave'} at 127.0.0.1:54318
I20260709 13:09:43.510212 24311 raft_consensus.cc:493] T 6bdf4f0b87584bdab10ccc418ab54f02 P b39c386162de49aca92dbebee7f06ace [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:43.510574 24311 raft_consensus.cc:3060] T 6bdf4f0b87584bdab10ccc418ab54f02 P b39c386162de49aca92dbebee7f06ace [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:43.520255 24311 raft_consensus.cc:515] T 6bdf4f0b87584bdab10ccc418ab54f02 P b39c386162de49aca92dbebee7f06ace [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:43.524080 24311 leader_election.cc:290] T 6bdf4f0b87584bdab10ccc418ab54f02 P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 4 election: Requested vote from peers c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431), f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171)
I20260709 13:09:43.525817 24161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bdf4f0b87584bdab10ccc418ab54f02" candidate_uuid: "b39c386162de49aca92dbebee7f06ace" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5"
I20260709 13:09:43.527169 24161 raft_consensus.cc:3055] T 6bdf4f0b87584bdab10ccc418ab54f02 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:43.527736 24237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bdf4f0b87584bdab10ccc418ab54f02" candidate_uuid: "b39c386162de49aca92dbebee7f06ace" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "f8d4657116f948038a0c73018238c3ba"
I20260709 13:09:43.527664 24161 raft_consensus.cc:740] T 6bdf4f0b87584bdab10ccc418ab54f02 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c0f503bf8bb94af8a2a1139db4e1c0f5, State: Running, Role: LEADER
I20260709 13:09:43.529337 24237 raft_consensus.cc:3060] T 6bdf4f0b87584bdab10ccc418ab54f02 P f8d4657116f948038a0c73018238c3ba [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:43.529601 24161 consensus_queue.cc:260] T 6bdf4f0b87584bdab10ccc418ab54f02 P c0f503bf8bb94af8a2a1139db4e1c0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:43.533095 24161 raft_consensus.cc:3060] T 6bdf4f0b87584bdab10ccc418ab54f02 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:43.539024 24237 raft_consensus.cc:2468] T 6bdf4f0b87584bdab10ccc418ab54f02 P f8d4657116f948038a0c73018238c3ba [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b39c386162de49aca92dbebee7f06ace in term 4.
I20260709 13:09:43.540516 24279 leader_election.cc:304] T 6bdf4f0b87584bdab10ccc418ab54f02 P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b39c386162de49aca92dbebee7f06ace, f8d4657116f948038a0c73018238c3ba; no voters: 
I20260709 13:09:43.541527 25245 raft_consensus.cc:2804] T 6bdf4f0b87584bdab10ccc418ab54f02 P b39c386162de49aca92dbebee7f06ace [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:43.541874 24161 raft_consensus.cc:2468] T 6bdf4f0b87584bdab10ccc418ab54f02 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b39c386162de49aca92dbebee7f06ace in term 4.
I20260709 13:09:43.542042 25245 raft_consensus.cc:697] T 6bdf4f0b87584bdab10ccc418ab54f02 P b39c386162de49aca92dbebee7f06ace [term 4 LEADER]: Becoming Leader. State: Replica: b39c386162de49aca92dbebee7f06ace, State: Running, Role: LEADER
I20260709 13:09:43.543533 25245 consensus_queue.cc:237] T 6bdf4f0b87584bdab10ccc418ab54f02 P b39c386162de49aca92dbebee7f06ace [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:43.559429 23989 catalog_manager.cc:5697] T 6bdf4f0b87584bdab10ccc418ab54f02 P b39c386162de49aca92dbebee7f06ace reported cstate change: term changed from 3 to 4, leader changed from c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66) to b39c386162de49aca92dbebee7f06ace (127.14.180.68). New cstate: current_term: 4 leader_uuid: "b39c386162de49aca92dbebee7f06ace" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:44.046371 24237 raft_consensus.cc:1275] T 6bdf4f0b87584bdab10ccc418ab54f02 P f8d4657116f948038a0c73018238c3ba [term 4 FOLLOWER]: Refusing update from remote peer b39c386162de49aca92dbebee7f06ace: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:09:44.048017 25245 consensus_queue.cc:1048] T 6bdf4f0b87584bdab10ccc418ab54f02 P b39c386162de49aca92dbebee7f06ace [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:44.053213 15057 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:44.068373 24165 raft_consensus.cc:1275] T 6bdf4f0b87584bdab10ccc418ab54f02 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 4 FOLLOWER]: Refusing update from remote peer b39c386162de49aca92dbebee7f06ace: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:09:44.071610 25245 consensus_queue.cc:1048] T 6bdf4f0b87584bdab10ccc418ab54f02 P b39c386162de49aca92dbebee7f06ace [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:09:44.201668 15057 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:44.253955 24310 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "71cb3d981445473ca321bbe44299879c"
dest_uuid: "b39c386162de49aca92dbebee7f06ace"
mode: GRACEFUL
new_leader_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5"
 from {username='slave'} at 127.0.0.1:36444
I20260709 13:09:44.254760 24310 raft_consensus.cc:606] T 71cb3d981445473ca321bbe44299879c P b39c386162de49aca92dbebee7f06ace [term 2 LEADER]: Received request to transfer leadership to TS c0f503bf8bb94af8a2a1139db4e1c0f5
I20260709 13:09:44.256228 15057 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:09:44.257643 15057 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:44.474612 25245 raft_consensus.cc:993] T 71cb3d981445473ca321bbe44299879c P b39c386162de49aca92dbebee7f06ace: : Instructing follower c0f503bf8bb94af8a2a1139db4e1c0f5 to start an election
I20260709 13:09:44.475317 25245 raft_consensus.cc:1081] T 71cb3d981445473ca321bbe44299879c P b39c386162de49aca92dbebee7f06ace [term 2 LEADER]: Signalling peer c0f503bf8bb94af8a2a1139db4e1c0f5 to start an election
I20260709 13:09:44.477221 24161 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "71cb3d981445473ca321bbe44299879c"
dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5"
 from {username='slave'} at 127.0.0.1:59142
I20260709 13:09:44.477854 24161 raft_consensus.cc:493] T 71cb3d981445473ca321bbe44299879c P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:44.478281 24161 raft_consensus.cc:3060] T 71cb3d981445473ca321bbe44299879c P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:44.484390 24161 raft_consensus.cc:515] T 71cb3d981445473ca321bbe44299879c P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:44.487020 24161 leader_election.cc:290] T 71cb3d981445473ca321bbe44299879c P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 3 election: Requested vote from peers f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171), b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561)
I20260709 13:09:44.487952 24237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71cb3d981445473ca321bbe44299879c" candidate_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f8d4657116f948038a0c73018238c3ba"
I20260709 13:09:44.488628 24237 raft_consensus.cc:3060] T 71cb3d981445473ca321bbe44299879c P f8d4657116f948038a0c73018238c3ba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:44.488883 24311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71cb3d981445473ca321bbe44299879c" candidate_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b39c386162de49aca92dbebee7f06ace"
I20260709 13:09:44.489771 24311 raft_consensus.cc:3055] T 71cb3d981445473ca321bbe44299879c P b39c386162de49aca92dbebee7f06ace [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:44.490075 24311 raft_consensus.cc:740] T 71cb3d981445473ca321bbe44299879c P b39c386162de49aca92dbebee7f06ace [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b39c386162de49aca92dbebee7f06ace, State: Running, Role: LEADER
I20260709 13:09:44.490883 24311 consensus_queue.cc:260] T 71cb3d981445473ca321bbe44299879c P b39c386162de49aca92dbebee7f06ace [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:44.491911 24311 raft_consensus.cc:3060] T 71cb3d981445473ca321bbe44299879c P b39c386162de49aca92dbebee7f06ace [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:44.494880 24237 raft_consensus.cc:2468] T 71cb3d981445473ca321bbe44299879c P f8d4657116f948038a0c73018238c3ba [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0f503bf8bb94af8a2a1139db4e1c0f5 in term 3.
I20260709 13:09:44.496374 24131 leader_election.cc:304] T 71cb3d981445473ca321bbe44299879c P c0f503bf8bb94af8a2a1139db4e1c0f5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0f503bf8bb94af8a2a1139db4e1c0f5, f8d4657116f948038a0c73018238c3ba; no voters: 
I20260709 13:09:44.497339 25250 raft_consensus.cc:2804] T 71cb3d981445473ca321bbe44299879c P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:44.497871 25250 raft_consensus.cc:697] T 71cb3d981445473ca321bbe44299879c P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 3 LEADER]: Becoming Leader. State: Replica: c0f503bf8bb94af8a2a1139db4e1c0f5, State: Running, Role: LEADER
I20260709 13:09:44.498009 24311 raft_consensus.cc:2468] T 71cb3d981445473ca321bbe44299879c P b39c386162de49aca92dbebee7f06ace [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0f503bf8bb94af8a2a1139db4e1c0f5 in term 3.
I20260709 13:09:44.498916 25250 consensus_queue.cc:237] T 71cb3d981445473ca321bbe44299879c P c0f503bf8bb94af8a2a1139db4e1c0f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } }
I20260709 13:09:44.511857 23989 catalog_manager.cc:5697] T 71cb3d981445473ca321bbe44299879c P c0f503bf8bb94af8a2a1139db4e1c0f5 reported cstate change: term changed from 2 to 3, leader changed from b39c386162de49aca92dbebee7f06ace (127.14.180.68) to c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66). New cstate: current_term: 3 leader_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:44.961632 24311 raft_consensus.cc:1275] T 71cb3d981445473ca321bbe44299879c P b39c386162de49aca92dbebee7f06ace [term 3 FOLLOWER]: Refusing update from remote peer c0f503bf8bb94af8a2a1139db4e1c0f5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:44.963771 25249 consensus_queue.cc:1048] T 71cb3d981445473ca321bbe44299879c P c0f503bf8bb94af8a2a1139db4e1c0f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:44.975709 24237 raft_consensus.cc:1275] T 71cb3d981445473ca321bbe44299879c P f8d4657116f948038a0c73018238c3ba [term 3 FOLLOWER]: Refusing update from remote peer c0f503bf8bb94af8a2a1139db4e1c0f5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:44.977737 25311 consensus_queue.cc:1048] T 71cb3d981445473ca321bbe44299879c P c0f503bf8bb94af8a2a1139db4e1c0f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:45.258786 15057 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:45.437765 15057 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:45.490832 24165 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "687efb9bbbd04b0eb768bfa6543380c3"
dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5"
mode: GRACEFUL
new_leader_uuid: "dea34817fcc148d78f090ef5fa72304f"
 from {username='slave'} at 127.0.0.1:55352
I20260709 13:09:45.491572 24165 raft_consensus.cc:606] T 687efb9bbbd04b0eb768bfa6543380c3 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 LEADER]: Received request to transfer leadership to TS dea34817fcc148d78f090ef5fa72304f
I20260709 13:09:45.493110 15057 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:09:45.494931 15057 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:45.562515 25311 raft_consensus.cc:993] T 687efb9bbbd04b0eb768bfa6543380c3 P c0f503bf8bb94af8a2a1139db4e1c0f5: : Instructing follower dea34817fcc148d78f090ef5fa72304f to start an election
I20260709 13:09:45.563174 25308 raft_consensus.cc:1081] T 687efb9bbbd04b0eb768bfa6543380c3 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 LEADER]: Signalling peer dea34817fcc148d78f090ef5fa72304f to start an election
I20260709 13:09:45.565017 25005 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "687efb9bbbd04b0eb768bfa6543380c3"
dest_uuid: "dea34817fcc148d78f090ef5fa72304f"
 from {username='slave'} at 127.0.0.1:37108
I20260709 13:09:45.565495 25005 raft_consensus.cc:493] T 687efb9bbbd04b0eb768bfa6543380c3 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:45.565822 25005 raft_consensus.cc:3060] T 687efb9bbbd04b0eb768bfa6543380c3 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:45.573513 25005 raft_consensus.cc:515] T 687efb9bbbd04b0eb768bfa6543380c3 P dea34817fcc148d78f090ef5fa72304f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:45.575767 25005 leader_election.cc:290] T 687efb9bbbd04b0eb768bfa6543380c3 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 2 election: Requested vote from peers b39c386162de49aca92dbebee7f06ace (127.14.180.68:38561), c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431)
I20260709 13:09:45.576517 24311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687efb9bbbd04b0eb768bfa6543380c3" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b39c386162de49aca92dbebee7f06ace"
I20260709 13:09:45.577627 24311 raft_consensus.cc:3060] T 687efb9bbbd04b0eb768bfa6543380c3 P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:45.578073 24161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "687efb9bbbd04b0eb768bfa6543380c3" candidate_uuid: "dea34817fcc148d78f090ef5fa72304f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5"
I20260709 13:09:45.578651 24161 raft_consensus.cc:3055] T 687efb9bbbd04b0eb768bfa6543380c3 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:45.578950 24161 raft_consensus.cc:740] T 687efb9bbbd04b0eb768bfa6543380c3 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c0f503bf8bb94af8a2a1139db4e1c0f5, State: Running, Role: LEADER
I20260709 13:09:45.579767 24161 consensus_queue.cc:260] T 687efb9bbbd04b0eb768bfa6543380c3 P c0f503bf8bb94af8a2a1139db4e1c0f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:45.581389 24161 raft_consensus.cc:3060] T 687efb9bbbd04b0eb768bfa6543380c3 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:45.586987 24311 raft_consensus.cc:2468] T 687efb9bbbd04b0eb768bfa6543380c3 P b39c386162de49aca92dbebee7f06ace [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dea34817fcc148d78f090ef5fa72304f in term 2.
I20260709 13:09:45.589308 24161 raft_consensus.cc:2468] T 687efb9bbbd04b0eb768bfa6543380c3 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dea34817fcc148d78f090ef5fa72304f in term 2.
I20260709 13:09:45.590190 24911 leader_election.cc:304] T 687efb9bbbd04b0eb768bfa6543380c3 P dea34817fcc148d78f090ef5fa72304f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b39c386162de49aca92dbebee7f06ace, dea34817fcc148d78f090ef5fa72304f; no voters: 
I20260709 13:09:45.591566 25287 raft_consensus.cc:2804] T 687efb9bbbd04b0eb768bfa6543380c3 P dea34817fcc148d78f090ef5fa72304f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:45.592242 25287 raft_consensus.cc:697] T 687efb9bbbd04b0eb768bfa6543380c3 P dea34817fcc148d78f090ef5fa72304f [term 2 LEADER]: Becoming Leader. State: Replica: dea34817fcc148d78f090ef5fa72304f, State: Running, Role: LEADER
I20260709 13:09:45.593180 25287 consensus_queue.cc:237] T 687efb9bbbd04b0eb768bfa6543380c3 P dea34817fcc148d78f090ef5fa72304f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:45.604278 23987 catalog_manager.cc:5697] T 687efb9bbbd04b0eb768bfa6543380c3 P dea34817fcc148d78f090ef5fa72304f reported cstate change: term changed from 1 to 2, leader changed from c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66) to dea34817fcc148d78f090ef5fa72304f (127.14.180.65). New cstate: current_term: 2 leader_uuid: "dea34817fcc148d78f090ef5fa72304f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:46.057992 24311 raft_consensus.cc:1275] T 687efb9bbbd04b0eb768bfa6543380c3 P b39c386162de49aca92dbebee7f06ace [term 2 FOLLOWER]: Refusing update from remote peer dea34817fcc148d78f090ef5fa72304f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:46.059856 25315 consensus_queue.cc:1048] T 687efb9bbbd04b0eb768bfa6543380c3 P dea34817fcc148d78f090ef5fa72304f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:46.076609 24165 raft_consensus.cc:1275] T 687efb9bbbd04b0eb768bfa6543380c3 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 2 FOLLOWER]: Refusing update from remote peer dea34817fcc148d78f090ef5fa72304f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:46.082094 25287 consensus_queue.cc:1048] T 687efb9bbbd04b0eb768bfa6543380c3 P dea34817fcc148d78f090ef5fa72304f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:46.495909 15057 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:46.550340 15057 tablet_server.cc:179] TabletServer@127.14.180.65:36343 shutting down...
W20260709 13:09:46.578670 24280 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 328 similar messages]
W20260709 13:09:46.586791 24280 consensus_peers.cc:597] T 0dbd3426f3e14ef28e7b0b6c4c7de6a2 P b39c386162de49aca92dbebee7f06ace -> Peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Couldn't send request to peer dea34817fcc148d78f090ef5fa72304f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:46.591014 24280 consensus_peers.cc:597] T f662efc86a73450cac065505b63cb883 P b39c386162de49aca92dbebee7f06ace -> Peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Couldn't send request to peer dea34817fcc148d78f090ef5fa72304f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:46.602815 15057 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:46.604092 15057 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:46.605314 15057 raft_consensus.cc:2243] T 502fe798081f4dc693eed179efa2a241 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:46.606271 15057 raft_consensus.cc:2272] T 502fe798081f4dc693eed179efa2a241 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:46.608093 24132 consensus_peers.cc:597] T 03bfe46bf2b74722b6e8eb3015e38f43 P c0f503bf8bb94af8a2a1139db4e1c0f5 -> Peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Couldn't send request to peer dea34817fcc148d78f090ef5fa72304f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:46.609303 15057 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:46.610108 15057 raft_consensus.cc:2243] T a0ff7e0491fb406d9e1f13941504372f P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:46.610637 15057 raft_consensus.cc:2272] T a0ff7e0491fb406d9e1f13941504372f P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.613168 15057 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:46.613849 15057 raft_consensus.cc:2243] T 5bc4e407c8b04739aa0290922bfdbed4 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:46.614305 15057 raft_consensus.cc:2272] T 5bc4e407c8b04739aa0290922bfdbed4 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.617396 15057 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:46.618175 15057 raft_consensus.cc:2243] T 9acec0d1a6e74a4bb39a0d867598acc5 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:46.618698 15057 raft_consensus.cc:2272] T 9acec0d1a6e74a4bb39a0d867598acc5 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.621338 15057 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:46.622169 15057 raft_consensus.cc:2243] T 42868db4862647c28215f3d7cb9adf02 P dea34817fcc148d78f090ef5fa72304f [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:09:46.623430 15057 raft_consensus.cc:2272] T 42868db4862647c28215f3d7cb9adf02 P dea34817fcc148d78f090ef5fa72304f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.626623 15057 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:46.627383 15057 raft_consensus.cc:2243] T 99078769583e49908dd6990f1d806453 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:09:46.627691 24132 consensus_peers.cc:597] T e6f709868be149759ecdc073fe125bec P c0f503bf8bb94af8a2a1139db4e1c0f5 -> Peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Couldn't send request to peer dea34817fcc148d78f090ef5fa72304f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:46.627974 15057 raft_consensus.cc:2272] T 99078769583e49908dd6990f1d806453 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.631361 15057 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:46.632336 15057 raft_consensus.cc:2243] T 01f1144c4a1c482894ec993e5ce24bc4 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:46.632879 15057 raft_consensus.cc:2272] T 01f1144c4a1c482894ec993e5ce24bc4 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.636134 15057 tablet_replica.cc:333] stopping tablet replica
W20260709 13:09:46.636165 24206 consensus_peers.cc:597] T de5786fbd53646a9bc152ac0a2a9aa53 P f8d4657116f948038a0c73018238c3ba -> Peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Couldn't send request to peer dea34817fcc148d78f090ef5fa72304f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:46.636884 15057 raft_consensus.cc:2243] T 45b65ebcb0114044a04e5689db4a466f P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:46.637418 15057 raft_consensus.cc:2272] T 45b65ebcb0114044a04e5689db4a466f P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.639999 15057 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:46.640820 15057 raft_consensus.cc:2243] T 861d7d76be4d484a9eb3acf8abffae5f P dea34817fcc148d78f090ef5fa72304f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:46.641871 15057 raft_consensus.cc:2272] T 861d7d76be4d484a9eb3acf8abffae5f P dea34817fcc148d78f090ef5fa72304f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.645570 15057 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:46.646631 15057 raft_consensus.cc:2243] T ee2c640a38d44afebd95dfec0e30b0d6 P dea34817fcc148d78f090ef5fa72304f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:46.647385 15057 raft_consensus.cc:2272] T ee2c640a38d44afebd95dfec0e30b0d6 P dea34817fcc148d78f090ef5fa72304f [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:46.649134 24206 consensus_peers.cc:597] T 47fcd2aa8e994186872c2e0f9995dd8a P f8d4657116f948038a0c73018238c3ba -> Peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Couldn't send request to peer dea34817fcc148d78f090ef5fa72304f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:46.651849 15057 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:46.659452 15057 raft_consensus.cc:2243] T 93e868a924d74bbc8bf29aa5a7fc67fd P dea34817fcc148d78f090ef5fa72304f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:46.661505 15057 raft_consensus.cc:2272] T 93e868a924d74bbc8bf29aa5a7fc67fd P dea34817fcc148d78f090ef5fa72304f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.665479 15057 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:46.666524 15057 raft_consensus.cc:2243] T 25e4818a4e2e4c9c9f7a8467aa9ef881 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:46.667831 15057 raft_consensus.cc:2272] T 25e4818a4e2e4c9c9f7a8467aa9ef881 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.671576 15057 tablet_replica.cc:333] stopping tablet replica
W20260709 13:09:46.672636 24206 consensus_peers.cc:597] T 5bc4e407c8b04739aa0290922bfdbed4 P f8d4657116f948038a0c73018238c3ba -> Peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Couldn't send request to peer dea34817fcc148d78f090ef5fa72304f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:46.672647 15057 raft_consensus.cc:2243] T bff14fa713b6482f89ecf3e18f785f81 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:46.673700 15057 raft_consensus.cc:2272] T bff14fa713b6482f89ecf3e18f785f81 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.677323 15057 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:46.678148 15057 raft_consensus.cc:2243] T e280ec3a0e394065aca766e4f8bef46d P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:46.678797 15057 raft_consensus.cc:2272] T e280ec3a0e394065aca766e4f8bef46d P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:46.681099 24206 consensus_peers.cc:597] T f735173e22b242178edcdf4821b6f92b P f8d4657116f948038a0c73018238c3ba -> Peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Couldn't send request to peer dea34817fcc148d78f090ef5fa72304f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:46.681744 15057 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:46.682677 15057 raft_consensus.cc:2243] T de5786fbd53646a9bc152ac0a2a9aa53 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:46.683218 15057 raft_consensus.cc:2272] T de5786fbd53646a9bc152ac0a2a9aa53 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.686008 15057 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:46.687014 15057 raft_consensus.cc:2243] T 5a8830d169ce4e46807d04168c3bb086 P dea34817fcc148d78f090ef5fa72304f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:46.687551 15057 raft_consensus.cc:2272] T 5a8830d169ce4e46807d04168c3bb086 P dea34817fcc148d78f090ef5fa72304f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.690636 15057 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:46.691566 15057 raft_consensus.cc:2243] T 03bfe46bf2b74722b6e8eb3015e38f43 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:46.692162 15057 raft_consensus.cc:2272] T 03bfe46bf2b74722b6e8eb3015e38f43 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:46.695343 24132 consensus_peers.cc:597] T d17a6bbfc9d8478988b08964765c3b86 P c0f503bf8bb94af8a2a1139db4e1c0f5 -> Peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Couldn't send request to peer dea34817fcc148d78f090ef5fa72304f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:46.695514 15057 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:46.696532 15057 raft_consensus.cc:2243] T 46f373ffd46f4625bac910b5ccf4b767 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:46.697134 15057 raft_consensus.cc:2272] T 46f373ffd46f4625bac910b5ccf4b767 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:46.699695 24132 consensus_peers.cc:597] T 1541f6b04d914d10823ad78c03d9a847 P c0f503bf8bb94af8a2a1139db4e1c0f5 -> Peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Couldn't send request to peer dea34817fcc148d78f090ef5fa72304f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:46.700364 15057 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:46.701215 15057 raft_consensus.cc:2243] T 3bcebec1ac994b99a49430f4f892d615 P dea34817fcc148d78f090ef5fa72304f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:46.702193 15057 raft_consensus.cc:2272] T 3bcebec1ac994b99a49430f4f892d615 P dea34817fcc148d78f090ef5fa72304f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.704864 15057 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:46.705858 15057 raft_consensus.cc:2243] T ab4ea1ceb7a443be94ec74cd88c9bf47 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:46.706393 15057 raft_consensus.cc:2272] T ab4ea1ceb7a443be94ec74cd88c9bf47 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.709412 15057 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:46.710238 15057 raft_consensus.cc:2243] T aaf99a05bd8842ed9ea668a9da85dbcc P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:46.710927 15057 raft_consensus.cc:2272] T aaf99a05bd8842ed9ea668a9da85dbcc P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.714059 15057 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:46.714875 15057 raft_consensus.cc:2243] T 662a938528e545e6aa4592052da18101 P dea34817fcc148d78f090ef5fa72304f [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:09:46.715775 15057 raft_consensus.cc:2272] T 662a938528e545e6aa4592052da18101 P dea34817fcc148d78f090ef5fa72304f [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.718145 15057 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:46.718845 15057 raft_consensus.cc:2243] T 99b130381d71460388507938ba053f8f P dea34817fcc148d78f090ef5fa72304f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:46.719727 15057 raft_consensus.cc:2272] T 99b130381d71460388507938ba053f8f P dea34817fcc148d78f090ef5fa72304f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.721836 15057 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:46.722476 15057 raft_consensus.cc:2243] T 65f010ca5ab74fa1b0f45b7d5dced706 P dea34817fcc148d78f090ef5fa72304f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:46.723402 15057 raft_consensus.cc:2272] T 65f010ca5ab74fa1b0f45b7d5dced706 P dea34817fcc148d78f090ef5fa72304f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.725548 15057 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:46.726125 15057 raft_consensus.cc:2243] T 03e06f957f794ca696ddc7207eeabff0 P dea34817fcc148d78f090ef5fa72304f [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:09:46.727062 15057 raft_consensus.cc:2272] T 03e06f957f794ca696ddc7207eeabff0 P dea34817fcc148d78f090ef5fa72304f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.729379 15057 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:46.729935 15057 raft_consensus.cc:2243] T c9b7bd5d439d455a9173478e086439e8 P dea34817fcc148d78f090ef5fa72304f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:46.730836 15057 raft_consensus.cc:2272] T c9b7bd5d439d455a9173478e086439e8 P dea34817fcc148d78f090ef5fa72304f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.733206 15057 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:46.733795 15057 raft_consensus.cc:2243] T d17a6bbfc9d8478988b08964765c3b86 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:46.734287 15057 raft_consensus.cc:2272] T d17a6bbfc9d8478988b08964765c3b86 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.737102 15057 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:46.737910 15057 raft_consensus.cc:2243] T e21ef2f479764142935dc2b1b7e87220 P dea34817fcc148d78f090ef5fa72304f [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:09:46.738801 24132 consensus_peers.cc:597] T e845188d32d2466a92eacdb66da16dba P c0f503bf8bb94af8a2a1139db4e1c0f5 -> Peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Couldn't send request to peer dea34817fcc148d78f090ef5fa72304f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:46.739105 15057 raft_consensus.cc:2272] T e21ef2f479764142935dc2b1b7e87220 P dea34817fcc148d78f090ef5fa72304f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.741616 15057 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:46.742257 15057 raft_consensus.cc:2243] T 1dcdde5516f54b19b11611ca9213415d P dea34817fcc148d78f090ef5fa72304f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:46.743525 15057 raft_consensus.cc:2272] T 1dcdde5516f54b19b11611ca9213415d P dea34817fcc148d78f090ef5fa72304f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.746536 15057 tablet_replica.cc:333] stopping tablet replica
W20260709 13:09:46.747202 24132 consensus_peers.cc:597] T bff14fa713b6482f89ecf3e18f785f81 P c0f503bf8bb94af8a2a1139db4e1c0f5 -> Peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Couldn't send request to peer dea34817fcc148d78f090ef5fa72304f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:46.747248 15057 raft_consensus.cc:2243] T b25c31c2fcad44f281a8a045e6cb0c19 P dea34817fcc148d78f090ef5fa72304f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:46.748386 15057 raft_consensus.cc:2272] T b25c31c2fcad44f281a8a045e6cb0c19 P dea34817fcc148d78f090ef5fa72304f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.750474 15057 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:46.751140 15057 raft_consensus.cc:2243] T 7a76ed4e1b6a4c2698999f722da5cfd7 P dea34817fcc148d78f090ef5fa72304f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:46.752112 15057 raft_consensus.cc:2272] T 7a76ed4e1b6a4c2698999f722da5cfd7 P dea34817fcc148d78f090ef5fa72304f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.754798 15057 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:46.755424 15057 raft_consensus.cc:2243] T 430894245c954e33b6586b4704c66b3c P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:46.755918 15057 raft_consensus.cc:2272] T 430894245c954e33b6586b4704c66b3c P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.758419 15057 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:46.759058 15057 raft_consensus.cc:2243] T 0dbd3426f3e14ef28e7b0b6c4c7de6a2 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:46.759650 15057 raft_consensus.cc:2272] T 0dbd3426f3e14ef28e7b0b6c4c7de6a2 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.763031 15057 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:46.763914 15057 raft_consensus.cc:2243] T 687efb9bbbd04b0eb768bfa6543380c3 P dea34817fcc148d78f090ef5fa72304f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:46.765550 15057 raft_consensus.cc:2272] T 687efb9bbbd04b0eb768bfa6543380c3 P dea34817fcc148d78f090ef5fa72304f [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:46.767547 24132 consensus_peers.cc:597] T 45b65ebcb0114044a04e5689db4a466f P c0f503bf8bb94af8a2a1139db4e1c0f5 -> Peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Couldn't send request to peer dea34817fcc148d78f090ef5fa72304f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:46.769964 24206 consensus_peers.cc:597] T b1d1d7dd508b43489431371c4ece4fa4 P f8d4657116f948038a0c73018238c3ba -> Peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Couldn't send request to peer dea34817fcc148d78f090ef5fa72304f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:46.771668 15057 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:46.772670 15057 raft_consensus.cc:2243] T 1541f6b04d914d10823ad78c03d9a847 P dea34817fcc148d78f090ef5fa72304f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:46.773272 15057 raft_consensus.cc:2272] T 1541f6b04d914d10823ad78c03d9a847 P dea34817fcc148d78f090ef5fa72304f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.775826 15057 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:46.776508 15057 raft_consensus.cc:2243] T b53fa043603b41be836d4ccb5c248df8 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:46.776993 15057 raft_consensus.cc:2272] T b53fa043603b41be836d4ccb5c248df8 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.779333 15057 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:46.780012 15057 raft_consensus.cc:2243] T 7da69453741f4b73a0092f56f29b1000 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:46.780591 15057 raft_consensus.cc:2272] T 7da69453741f4b73a0092f56f29b1000 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.783658 15057 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:46.784284 15057 raft_consensus.cc:2243] T e6f709868be149759ecdc073fe125bec P dea34817fcc148d78f090ef5fa72304f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:46.784826 15057 raft_consensus.cc:2272] T e6f709868be149759ecdc073fe125bec P dea34817fcc148d78f090ef5fa72304f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.787308 15057 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:46.787876 15057 raft_consensus.cc:2243] T 2dbbcd71c86041ba949fac653102e076 P dea34817fcc148d78f090ef5fa72304f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:46.788560 15057 raft_consensus.cc:2272] T 2dbbcd71c86041ba949fac653102e076 P dea34817fcc148d78f090ef5fa72304f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.791911 15057 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:46.792765 15057 raft_consensus.cc:2243] T e845188d32d2466a92eacdb66da16dba P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:46.793282 15057 raft_consensus.cc:2272] T e845188d32d2466a92eacdb66da16dba P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.796411 15057 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:46.797272 15057 raft_consensus.cc:2243] T 47fcd2aa8e994186872c2e0f9995dd8a P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:09:46.797698 24132 consensus_peers.cc:597] T ab4ea1ceb7a443be94ec74cd88c9bf47 P c0f503bf8bb94af8a2a1139db4e1c0f5 -> Peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Couldn't send request to peer dea34817fcc148d78f090ef5fa72304f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:46.797873 15057 raft_consensus.cc:2272] T 47fcd2aa8e994186872c2e0f9995dd8a P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:46.800072 24206 consensus_peers.cc:597] T 99078769583e49908dd6990f1d806453 P f8d4657116f948038a0c73018238c3ba -> Peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Couldn't send request to peer dea34817fcc148d78f090ef5fa72304f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:46.800999 15057 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:46.801584 15057 raft_consensus.cc:2243] T 49393e5cc2614c90b69a3bb2348dacb9 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:46.801954 15057 raft_consensus.cc:2272] T 49393e5cc2614c90b69a3bb2348dacb9 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.804219 15057 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:46.804738 15057 raft_consensus.cc:2243] T b1d1d7dd508b43489431371c4ece4fa4 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:46.805115 15057 raft_consensus.cc:2272] T b1d1d7dd508b43489431371c4ece4fa4 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:46.807935 15057 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:46.808634 15057 raft_consensus.cc:2243] T f735173e22b242178edcdf4821b6f92b P dea34817fcc148d78f090ef5fa72304f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:46.809248 15057 raft_consensus.cc:2272] T f735173e22b242178edcdf4821b6f92b P dea34817fcc148d78f090ef5fa72304f [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:46.811141 24206 consensus_peers.cc:597] T 430894245c954e33b6586b4704c66b3c P f8d4657116f948038a0c73018238c3ba -> Peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Couldn't send request to peer dea34817fcc148d78f090ef5fa72304f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:46.812012 15057 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:46.812553 15057 raft_consensus.cc:2243] T f662efc86a73450cac065505b63cb883 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:46.812927 15057 raft_consensus.cc:2272] T f662efc86a73450cac065505b63cb883 P dea34817fcc148d78f090ef5fa72304f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:46.830089 24132 consensus_peers.cc:597] T 2dbbcd71c86041ba949fac653102e076 P c0f503bf8bb94af8a2a1139db4e1c0f5 -> Peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Couldn't send request to peer dea34817fcc148d78f090ef5fa72304f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:46.846854 24132 consensus_peers.cc:597] T 25e4818a4e2e4c9c9f7a8467aa9ef881 P c0f503bf8bb94af8a2a1139db4e1c0f5 -> Peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Couldn't send request to peer dea34817fcc148d78f090ef5fa72304f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:46.853142 24206 consensus_peers.cc:597] T 46f373ffd46f4625bac910b5ccf4b767 P f8d4657116f948038a0c73018238c3ba -> Peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Couldn't send request to peer dea34817fcc148d78f090ef5fa72304f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:46.859510 24280 consensus_peers.cc:597] T a0ff7e0491fb406d9e1f13941504372f P b39c386162de49aca92dbebee7f06ace -> Peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Couldn't send request to peer dea34817fcc148d78f090ef5fa72304f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:46.863868 24206 consensus_peers.cc:597] T b53fa043603b41be836d4ccb5c248df8 P f8d4657116f948038a0c73018238c3ba -> Peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Couldn't send request to peer dea34817fcc148d78f090ef5fa72304f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:46.870841 24206 consensus_peers.cc:597] T 49393e5cc2614c90b69a3bb2348dacb9 P f8d4657116f948038a0c73018238c3ba -> Peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Couldn't send request to peer dea34817fcc148d78f090ef5fa72304f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:46.909646 15057 tablet_server.cc:196] TabletServer@127.14.180.65:36343 shutdown complete.
W20260709 13:09:46.912021 24206 consensus_peers.cc:597] T 01f1144c4a1c482894ec993e5ce24bc4 P f8d4657116f948038a0c73018238c3ba -> Peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Couldn't send request to peer dea34817fcc148d78f090ef5fa72304f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:36343: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:46.914767 24132 consensus_peers.cc:597] T 7da69453741f4b73a0092f56f29b1000 P c0f503bf8bb94af8a2a1139db4e1c0f5 -> Peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Couldn't send request to peer dea34817fcc148d78f090ef5fa72304f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:36343: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:46.947082 24206 consensus_peers.cc:597] T 502fe798081f4dc693eed179efa2a241 P f8d4657116f948038a0c73018238c3ba -> Peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Couldn't send request to peer dea34817fcc148d78f090ef5fa72304f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:36343: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:46.994179 24280 consensus_peers.cc:597] T aaf99a05bd8842ed9ea668a9da85dbcc P b39c386162de49aca92dbebee7f06ace -> Peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Couldn't send request to peer dea34817fcc148d78f090ef5fa72304f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:36343: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:47.011451 15057 tablet_server.cc:179] TabletServer@127.14.180.66:0 shutting down...
W20260709 13:09:47.015553 24206 consensus_peers.cc:597] T ee2c640a38d44afebd95dfec0e30b0d6 P f8d4657116f948038a0c73018238c3ba -> Peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Couldn't send request to peer dea34817fcc148d78f090ef5fa72304f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:36343: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:47.060401 24132 consensus_peers.cc:597] T e280ec3a0e394065aca766e4f8bef46d P c0f503bf8bb94af8a2a1139db4e1c0f5 -> Peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Couldn't send request to peer dea34817fcc148d78f090ef5fa72304f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:36343: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:47.064968 24280 consensus_peers.cc:597] T 352353d793574662ac966f335ae8cfbe P b39c386162de49aca92dbebee7f06ace -> Peer c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431): Couldn't send request to peer c0f503bf8bb94af8a2a1139db4e1c0f5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:47.077858 24206 consensus_peers.cc:597] T 49393e5cc2614c90b69a3bb2348dacb9 P f8d4657116f948038a0c73018238c3ba -> Peer c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431): Couldn't send request to peer c0f503bf8bb94af8a2a1139db4e1c0f5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:47.082079 24280 consensus_peers.cc:597] T 9acec0d1a6e74a4bb39a0d867598acc5 P b39c386162de49aca92dbebee7f06ace -> Peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Couldn't send request to peer dea34817fcc148d78f090ef5fa72304f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:36343: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:47.101588 24206 consensus_peers.cc:597] T aac6068ee4554cce8f2d534a106ef417 P f8d4657116f948038a0c73018238c3ba -> Peer c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431): Couldn't send request to peer c0f503bf8bb94af8a2a1139db4e1c0f5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:47.169324 15057 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:47.170619 15057 tablet_replica.cc:333] T 71cb3d981445473ca321bbe44299879c P c0f503bf8bb94af8a2a1139db4e1c0f5: stopping tablet replica
W20260709 13:09:47.171784 24280 consensus_peers.cc:597] T 0dbd3426f3e14ef28e7b0b6c4c7de6a2 P b39c386162de49aca92dbebee7f06ace -> Peer c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431): Couldn't send request to peer c0f503bf8bb94af8a2a1139db4e1c0f5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:47.171789 15057 raft_consensus.cc:2243] T 71cb3d981445473ca321bbe44299879c P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 3 LEADER]: Raft consensus shutting down.
W20260709 13:09:47.172693 24132 consensus_peers.cc:597] T 5a8830d169ce4e46807d04168c3bb086 P c0f503bf8bb94af8a2a1139db4e1c0f5 -> Peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Couldn't send request to peer dea34817fcc148d78f090ef5fa72304f. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:36343: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:47.173636 15057 raft_consensus.cc:2272] T 71cb3d981445473ca321bbe44299879c P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:47.177204 15057 tablet_replica.cc:333] T 430894245c954e33b6586b4704c66b3c P c0f503bf8bb94af8a2a1139db4e1c0f5: stopping tablet replica
I20260709 13:09:47.178290 15057 raft_consensus.cc:2243] T 430894245c954e33b6586b4704c66b3c P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:47.178998 15057 raft_consensus.cc:2272] T 430894245c954e33b6586b4704c66b3c P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:47.181066 24280 consensus_peers.cc:597] T c7b586130d5842f293b0df4b02792ec6 P b39c386162de49aca92dbebee7f06ace -> Peer c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431): Couldn't send request to peer c0f503bf8bb94af8a2a1139db4e1c0f5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:47.182211 15057 tablet_replica.cc:333] T c5dc7f36da134739916e9685345be3ac P c0f503bf8bb94af8a2a1139db4e1c0f5: stopping tablet replica
I20260709 13:09:47.183099 15057 raft_consensus.cc:2243] T c5dc7f36da134739916e9685345be3ac P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:47.183704 15057 raft_consensus.cc:2272] T c5dc7f36da134739916e9685345be3ac P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:47.186751 15057 tablet_replica.cc:333] T ef112a95c7964753b1c7c5a17656161b P c0f503bf8bb94af8a2a1139db4e1c0f5: stopping tablet replica
I20260709 13:09:47.187675 15057 raft_consensus.cc:2243] T ef112a95c7964753b1c7c5a17656161b P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:47.188288 15057 raft_consensus.cc:2272] T ef112a95c7964753b1c7c5a17656161b P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:47.190671 15057 tablet_replica.cc:333] T 25e4818a4e2e4c9c9f7a8467aa9ef881 P c0f503bf8bb94af8a2a1139db4e1c0f5: stopping tablet replica
I20260709 13:09:47.191392 15057 raft_consensus.cc:2243] T 25e4818a4e2e4c9c9f7a8467aa9ef881 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:47.192231 15057 raft_consensus.cc:2272] T 25e4818a4e2e4c9c9f7a8467aa9ef881 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:47.194314 15057 tablet_replica.cc:333] T e280ec3a0e394065aca766e4f8bef46d P c0f503bf8bb94af8a2a1139db4e1c0f5: stopping tablet replica
I20260709 13:09:47.195040 15057 raft_consensus.cc:2243] T e280ec3a0e394065aca766e4f8bef46d P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:47.196151 15057 raft_consensus.cc:2272] T e280ec3a0e394065aca766e4f8bef46d P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:47.200032 15057 tablet_replica.cc:333] T 0dbd3426f3e14ef28e7b0b6c4c7de6a2 P c0f503bf8bb94af8a2a1139db4e1c0f5: stopping tablet replica
W20260709 13:09:47.200524 24206 consensus_peers.cc:597] T 430894245c954e33b6586b4704c66b3c P f8d4657116f948038a0c73018238c3ba -> Peer c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431): Couldn't send request to peer c0f503bf8bb94af8a2a1139db4e1c0f5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:47.201506 15057 raft_consensus.cc:2243] T 0dbd3426f3e14ef28e7b0b6c4c7de6a2 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:47.202471 15057 raft_consensus.cc:2272] T 0dbd3426f3e14ef28e7b0b6c4c7de6a2 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:47.206066 15057 tablet_replica.cc:333] T 65f010ca5ab74fa1b0f45b7d5dced706 P c0f503bf8bb94af8a2a1139db4e1c0f5: stopping tablet replica
I20260709 13:09:47.207039 15057 raft_consensus.cc:2243] T 65f010ca5ab74fa1b0f45b7d5dced706 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:47.207705 15057 raft_consensus.cc:2272] T 65f010ca5ab74fa1b0f45b7d5dced706 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:47.210368 15057 tablet_replica.cc:333] T 03e06f957f794ca696ddc7207eeabff0 P c0f503bf8bb94af8a2a1139db4e1c0f5: stopping tablet replica
I20260709 13:09:47.211320 15057 raft_consensus.cc:2243] T 03e06f957f794ca696ddc7207eeabff0 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:47.211966 15057 raft_consensus.cc:2272] T 03e06f957f794ca696ddc7207eeabff0 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:47.214388 15057 tablet_replica.cc:333] T 3bcebec1ac994b99a49430f4f892d615 P c0f503bf8bb94af8a2a1139db4e1c0f5: stopping tablet replica
I20260709 13:09:47.215061 15057 raft_consensus.cc:2243] T 3bcebec1ac994b99a49430f4f892d615 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:47.215583 15057 raft_consensus.cc:2272] T 3bcebec1ac994b99a49430f4f892d615 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:47.218022 15057 tablet_replica.cc:333] T ab4ea1ceb7a443be94ec74cd88c9bf47 P c0f503bf8bb94af8a2a1139db4e1c0f5: stopping tablet replica
I20260709 13:09:47.218895 15057 raft_consensus.cc:2243] T ab4ea1ceb7a443be94ec74cd88c9bf47 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:47.219848 15057 raft_consensus.cc:2272] T ab4ea1ceb7a443be94ec74cd88c9bf47 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:47.222167 15057 tablet_replica.cc:333] T d2ddfc9daac54dc28d63b46ab1777bf3 P c0f503bf8bb94af8a2a1139db4e1c0f5: stopping tablet replica
I20260709 13:09:47.222962 15057 raft_consensus.cc:2243] T d2ddfc9daac54dc28d63b46ab1777bf3 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:47.224017 15057 raft_consensus.cc:2272] T d2ddfc9daac54dc28d63b46ab1777bf3 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:47.225260 24280 consensus_peers.cc:597] T e335cd6afc4349cfaafa2970bccb40ff P b39c386162de49aca92dbebee7f06ace -> Peer c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431): Couldn't send request to peer c0f503bf8bb94af8a2a1139db4e1c0f5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:47.226471 15057 tablet_replica.cc:333] T bff14fa713b6482f89ecf3e18f785f81 P c0f503bf8bb94af8a2a1139db4e1c0f5: stopping tablet replica
I20260709 13:09:47.227294 15057 raft_consensus.cc:2243] T bff14fa713b6482f89ecf3e18f785f81 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:47.228121 15057 raft_consensus.cc:2272] T bff14fa713b6482f89ecf3e18f785f81 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:47.230389 15057 tablet_replica.cc:333] T b25c31c2fcad44f281a8a045e6cb0c19 P c0f503bf8bb94af8a2a1139db4e1c0f5: stopping tablet replica
I20260709 13:09:47.231081 15057 raft_consensus.cc:2243] T b25c31c2fcad44f281a8a045e6cb0c19 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:47.231633 15057 raft_consensus.cc:2272] T b25c31c2fcad44f281a8a045e6cb0c19 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:47.234632 15057 tablet_replica.cc:333] T 352353d793574662ac966f335ae8cfbe P c0f503bf8bb94af8a2a1139db4e1c0f5: stopping tablet replica
I20260709 13:09:47.235600 15057 raft_consensus.cc:2243] T 352353d793574662ac966f335ae8cfbe P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:47.236274 15057 raft_consensus.cc:2272] T 352353d793574662ac966f335ae8cfbe P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:47.236914 24280 consensus_peers.cc:597] T 6bdf4f0b87584bdab10ccc418ab54f02 P b39c386162de49aca92dbebee7f06ace -> Peer c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431): Couldn't send request to peer c0f503bf8bb94af8a2a1139db4e1c0f5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:47.238473 15057 tablet_replica.cc:333] T 1dcdde5516f54b19b11611ca9213415d P c0f503bf8bb94af8a2a1139db4e1c0f5: stopping tablet replica
I20260709 13:09:47.239290 15057 raft_consensus.cc:2243] T 1dcdde5516f54b19b11611ca9213415d P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:47.239830 15057 raft_consensus.cc:2272] T 1dcdde5516f54b19b11611ca9213415d P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:47.243156 15057 tablet_replica.cc:333] T 2dbbcd71c86041ba949fac653102e076 P c0f503bf8bb94af8a2a1139db4e1c0f5: stopping tablet replica
I20260709 13:09:47.244009 15057 raft_consensus.cc:2243] T 2dbbcd71c86041ba949fac653102e076 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:47.245033 15057 raft_consensus.cc:2272] T 2dbbcd71c86041ba949fac653102e076 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:47.247974 15057 tablet_replica.cc:333] T e6f709868be149759ecdc073fe125bec P c0f503bf8bb94af8a2a1139db4e1c0f5: stopping tablet replica
I20260709 13:09:47.248584 15057 raft_consensus.cc:2243] T e6f709868be149759ecdc073fe125bec P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:47.249400 15057 raft_consensus.cc:2272] T e6f709868be149759ecdc073fe125bec P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:47.251919 15057 tablet_replica.cc:333] T 03bfe46bf2b74722b6e8eb3015e38f43 P c0f503bf8bb94af8a2a1139db4e1c0f5: stopping tablet replica
I20260709 13:09:47.252530 15057 raft_consensus.cc:2243] T 03bfe46bf2b74722b6e8eb3015e38f43 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:47.253402 15057 raft_consensus.cc:2272] T 03bfe46bf2b74722b6e8eb3015e38f43 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:47.255573 15057 tablet_replica.cc:333] T de5786fbd53646a9bc152ac0a2a9aa53 P c0f503bf8bb94af8a2a1139db4e1c0f5: stopping tablet replica
I20260709 13:09:47.256182 15057 raft_consensus.cc:2243] T de5786fbd53646a9bc152ac0a2a9aa53 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:47.256593 15057 raft_consensus.cc:2272] T de5786fbd53646a9bc152ac0a2a9aa53 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:47.258646 15057 tablet_replica.cc:333] T 5a8830d169ce4e46807d04168c3bb086 P c0f503bf8bb94af8a2a1139db4e1c0f5: stopping tablet replica
I20260709 13:09:47.259199 15057 raft_consensus.cc:2243] T 5a8830d169ce4e46807d04168c3bb086 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:47.259989 15057 raft_consensus.cc:2272] T 5a8830d169ce4e46807d04168c3bb086 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:47.262058 15057 tablet_replica.cc:333] T 1cefd1de9d9a4839b200c2472b3aeefc P c0f503bf8bb94af8a2a1139db4e1c0f5: stopping tablet replica
I20260709 13:09:47.262768 15057 raft_consensus.cc:2243] T 1cefd1de9d9a4839b200c2472b3aeefc P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:47.263335 15057 raft_consensus.cc:2272] T 1cefd1de9d9a4839b200c2472b3aeefc P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:47.266147 24280 consensus_peers.cc:597] T 518a35ead60847e98c0b76330b999d6f P b39c386162de49aca92dbebee7f06ace -> Peer c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431): Couldn't send request to peer c0f503bf8bb94af8a2a1139db4e1c0f5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:47.266227 15057 tablet_replica.cc:333] T e335cd6afc4349cfaafa2970bccb40ff P c0f503bf8bb94af8a2a1139db4e1c0f5: stopping tablet replica
I20260709 13:09:47.267125 15057 raft_consensus.cc:2243] T e335cd6afc4349cfaafa2970bccb40ff P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:47.267709 15057 raft_consensus.cc:2272] T e335cd6afc4349cfaafa2970bccb40ff P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:47.270253 15057 tablet_replica.cc:333] T 861d7d76be4d484a9eb3acf8abffae5f P c0f503bf8bb94af8a2a1139db4e1c0f5: stopping tablet replica
I20260709 13:09:47.271276 15057 raft_consensus.cc:2243] T 861d7d76be4d484a9eb3acf8abffae5f P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:47.271912 15057 raft_consensus.cc:2272] T 861d7d76be4d484a9eb3acf8abffae5f P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:47.274374 15057 tablet_replica.cc:333] T 7da69453741f4b73a0092f56f29b1000 P c0f503bf8bb94af8a2a1139db4e1c0f5: stopping tablet replica
I20260709 13:09:47.275012 15057 raft_consensus.cc:2243] T 7da69453741f4b73a0092f56f29b1000 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:47.276268 15057 raft_consensus.cc:2272] T 7da69453741f4b73a0092f56f29b1000 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:47.279459 15057 tablet_replica.cc:333] T 49393e5cc2614c90b69a3bb2348dacb9 P c0f503bf8bb94af8a2a1139db4e1c0f5: stopping tablet replica
I20260709 13:09:47.280215 15057 raft_consensus.cc:2243] T 49393e5cc2614c90b69a3bb2348dacb9 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:47.280890 15057 raft_consensus.cc:2272] T 49393e5cc2614c90b69a3bb2348dacb9 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:47.284343 15057 tablet_replica.cc:333] T e845188d32d2466a92eacdb66da16dba P c0f503bf8bb94af8a2a1139db4e1c0f5: stopping tablet replica
I20260709 13:09:47.285043 15057 raft_consensus.cc:2243] T e845188d32d2466a92eacdb66da16dba P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:47.286074 15057 raft_consensus.cc:2272] T e845188d32d2466a92eacdb66da16dba P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:47.288910 15057 tablet_replica.cc:333] T 47fcd2aa8e994186872c2e0f9995dd8a P c0f503bf8bb94af8a2a1139db4e1c0f5: stopping tablet replica
I20260709 13:09:47.289768 15057 raft_consensus.cc:2243] T 47fcd2aa8e994186872c2e0f9995dd8a P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:47.290364 15057 raft_consensus.cc:2272] T 47fcd2aa8e994186872c2e0f9995dd8a P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:47.293467 15057 tablet_replica.cc:333] T 99b130381d71460388507938ba053f8f P c0f503bf8bb94af8a2a1139db4e1c0f5: stopping tablet replica
I20260709 13:09:47.294219 15057 raft_consensus.cc:2243] T 99b130381d71460388507938ba053f8f P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:47.294854 15057 raft_consensus.cc:2272] T 99b130381d71460388507938ba053f8f P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:47.297746 24206 consensus_peers.cc:597] T ee2c640a38d44afebd95dfec0e30b0d6 P f8d4657116f948038a0c73018238c3ba -> Peer c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431): Couldn't send request to peer c0f503bf8bb94af8a2a1139db4e1c0f5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:47.298079 15057 tablet_replica.cc:333] T 95774511405b4ed8aadbab3d362c068e P c0f503bf8bb94af8a2a1139db4e1c0f5: stopping tablet replica
I20260709 13:09:47.299111 15057 raft_consensus.cc:2243] T 95774511405b4ed8aadbab3d362c068e P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:47.299675 15057 raft_consensus.cc:2272] T 95774511405b4ed8aadbab3d362c068e P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:47.302630 15057 tablet_replica.cc:333] T 93e868a924d74bbc8bf29aa5a7fc67fd P c0f503bf8bb94af8a2a1139db4e1c0f5: stopping tablet replica
I20260709 13:09:47.303517 15057 raft_consensus.cc:2243] T 93e868a924d74bbc8bf29aa5a7fc67fd P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:47.304126 15057 raft_consensus.cc:2272] T 93e868a924d74bbc8bf29aa5a7fc67fd P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:47.305270 24280 consensus_peers.cc:597] T 9a126a61cad843b4a3b34fac0f85a1d2 P b39c386162de49aca92dbebee7f06ace -> Peer c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431): Couldn't send request to peer c0f503bf8bb94af8a2a1139db4e1c0f5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:47.307340 15057 tablet_replica.cc:333] T ee2c640a38d44afebd95dfec0e30b0d6 P c0f503bf8bb94af8a2a1139db4e1c0f5: stopping tablet replica
I20260709 13:09:47.308284 15057 raft_consensus.cc:2243] T ee2c640a38d44afebd95dfec0e30b0d6 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:47.308926 15057 raft_consensus.cc:2272] T ee2c640a38d44afebd95dfec0e30b0d6 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:47.311935 15057 tablet_replica.cc:333] T 6bdf4f0b87584bdab10ccc418ab54f02 P c0f503bf8bb94af8a2a1139db4e1c0f5: stopping tablet replica
I20260709 13:09:47.312726 15057 raft_consensus.cc:2243] T 6bdf4f0b87584bdab10ccc418ab54f02 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:47.313205 15057 raft_consensus.cc:2272] T 6bdf4f0b87584bdab10ccc418ab54f02 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:47.315959 15057 tablet_replica.cc:333] T d17a6bbfc9d8478988b08964765c3b86 P c0f503bf8bb94af8a2a1139db4e1c0f5: stopping tablet replica
I20260709 13:09:47.316881 15057 raft_consensus.cc:2243] T d17a6bbfc9d8478988b08964765c3b86 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:47.317965 15057 raft_consensus.cc:2272] T d17a6bbfc9d8478988b08964765c3b86 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:47.320999 15057 tablet_replica.cc:333] T c7b586130d5842f293b0df4b02792ec6 P c0f503bf8bb94af8a2a1139db4e1c0f5: stopping tablet replica
I20260709 13:09:47.321774 15057 raft_consensus.cc:2243] T c7b586130d5842f293b0df4b02792ec6 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:47.322431 15057 raft_consensus.cc:2272] T c7b586130d5842f293b0df4b02792ec6 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:47.325435 15057 tablet_replica.cc:333] T 9a126a61cad843b4a3b34fac0f85a1d2 P c0f503bf8bb94af8a2a1139db4e1c0f5: stopping tablet replica
I20260709 13:09:47.326274 15057 raft_consensus.cc:2243] T 9a126a61cad843b4a3b34fac0f85a1d2 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:47.326896 15057 raft_consensus.cc:2272] T 9a126a61cad843b4a3b34fac0f85a1d2 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:47.329861 15057 tablet_replica.cc:333] T 9acec0d1a6e74a4bb39a0d867598acc5 P c0f503bf8bb94af8a2a1139db4e1c0f5: stopping tablet replica
I20260709 13:09:47.330665 15057 raft_consensus.cc:2243] T 9acec0d1a6e74a4bb39a0d867598acc5 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:47.331313 15057 raft_consensus.cc:2272] T 9acec0d1a6e74a4bb39a0d867598acc5 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:47.333834 15057 tablet_replica.cc:333] T 1541f6b04d914d10823ad78c03d9a847 P c0f503bf8bb94af8a2a1139db4e1c0f5: stopping tablet replica
I20260709 13:09:47.334510 15057 raft_consensus.cc:2243] T 1541f6b04d914d10823ad78c03d9a847 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:47.335624 15057 raft_consensus.cc:2272] T 1541f6b04d914d10823ad78c03d9a847 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:47.338413 15057 tablet_replica.cc:333] T aac6068ee4554cce8f2d534a106ef417 P c0f503bf8bb94af8a2a1139db4e1c0f5: stopping tablet replica
I20260709 13:09:47.339234 15057 raft_consensus.cc:2243] T aac6068ee4554cce8f2d534a106ef417 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:09:47.339253 24206 consensus_peers.cc:597] T 47fcd2aa8e994186872c2e0f9995dd8a P f8d4657116f948038a0c73018238c3ba -> Peer c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431): Couldn't send request to peer c0f503bf8bb94af8a2a1139db4e1c0f5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:47.339887 15057 raft_consensus.cc:2272] T aac6068ee4554cce8f2d534a106ef417 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:47.342191 15057 tablet_replica.cc:333] T 502fe798081f4dc693eed179efa2a241 P c0f503bf8bb94af8a2a1139db4e1c0f5: stopping tablet replica
I20260709 13:09:47.342867 15057 raft_consensus.cc:2243] T 502fe798081f4dc693eed179efa2a241 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:47.343429 15057 raft_consensus.cc:2272] T 502fe798081f4dc693eed179efa2a241 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:47.346602 15057 tablet_replica.cc:333] T c5873f7465894eddab6fa84daecdcc84 P c0f503bf8bb94af8a2a1139db4e1c0f5: stopping tablet replica
I20260709 13:09:47.347466 15057 raft_consensus.cc:2243] T c5873f7465894eddab6fa84daecdcc84 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:47.348114 15057 raft_consensus.cc:2272] T c5873f7465894eddab6fa84daecdcc84 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:47.351250 15057 tablet_replica.cc:333] T 45b65ebcb0114044a04e5689db4a466f P c0f503bf8bb94af8a2a1139db4e1c0f5: stopping tablet replica
I20260709 13:09:47.352037 15057 raft_consensus.cc:2243] T 45b65ebcb0114044a04e5689db4a466f P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:47.353260 15057 raft_consensus.cc:2272] T 45b65ebcb0114044a04e5689db4a466f P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:47.355706 15057 tablet_replica.cc:333] T 518a35ead60847e98c0b76330b999d6f P c0f503bf8bb94af8a2a1139db4e1c0f5: stopping tablet replica
I20260709 13:09:47.356211 15057 raft_consensus.cc:2243] T 518a35ead60847e98c0b76330b999d6f P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:47.356657 15057 raft_consensus.cc:2272] T 518a35ead60847e98c0b76330b999d6f P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:47.358892 15057 tablet_replica.cc:333] T 687efb9bbbd04b0eb768bfa6543380c3 P c0f503bf8bb94af8a2a1139db4e1c0f5: stopping tablet replica
I20260709 13:09:47.359334 15057 raft_consensus.cc:2243] T 687efb9bbbd04b0eb768bfa6543380c3 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:47.359766 15057 raft_consensus.cc:2272] T 687efb9bbbd04b0eb768bfa6543380c3 P c0f503bf8bb94af8a2a1139db4e1c0f5 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:47.377703 24280 consensus_peers.cc:597] T 95774511405b4ed8aadbab3d362c068e P b39c386162de49aca92dbebee7f06ace -> Peer c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431): Couldn't send request to peer c0f503bf8bb94af8a2a1139db4e1c0f5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:47.383859 24280 consensus_peers.cc:597] T 1cefd1de9d9a4839b200c2472b3aeefc P b39c386162de49aca92dbebee7f06ace -> Peer c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431): Couldn't send request to peer c0f503bf8bb94af8a2a1139db4e1c0f5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:47.411830 24206 consensus_peers.cc:597] T 502fe798081f4dc693eed179efa2a241 P f8d4657116f948038a0c73018238c3ba -> Peer c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431): Couldn't send request to peer c0f503bf8bb94af8a2a1139db4e1c0f5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:47.435138 24206 connection.cc:573] client connection to 127.14.180.66:37431 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260709 13:09:47.442473 24206 consensus_peers.cc:597] T c5dc7f36da134739916e9685345be3ac P f8d4657116f948038a0c73018238c3ba -> Peer c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431): Couldn't send request to peer c0f503bf8bb94af8a2a1139db4e1c0f5. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.66:37431: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:47.454694 15057 tablet_server.cc:196] TabletServer@127.14.180.66:0 shutdown complete.
W20260709 13:09:47.493992 24206 consensus_peers.cc:597] T de5786fbd53646a9bc152ac0a2a9aa53 P f8d4657116f948038a0c73018238c3ba -> Peer c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431): Couldn't send request to peer c0f503bf8bb94af8a2a1139db4e1c0f5. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.66:37431: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:47.510900 24280 consensus_peers.cc:597] T ef112a95c7964753b1c7c5a17656161b P b39c386162de49aca92dbebee7f06ace -> Peer c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431): Couldn't send request to peer c0f503bf8bb94af8a2a1139db4e1c0f5. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.66:37431: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:47.521093 24280 consensus_peers.cc:597] T c5873f7465894eddab6fa84daecdcc84 P b39c386162de49aca92dbebee7f06ace -> Peer c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431): Couldn't send request to peer c0f503bf8bb94af8a2a1139db4e1c0f5. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.66:37431: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:47.540088 24280 consensus_peers.cc:597] T 9acec0d1a6e74a4bb39a0d867598acc5 P b39c386162de49aca92dbebee7f06ace -> Peer c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431): Couldn't send request to peer c0f503bf8bb94af8a2a1139db4e1c0f5. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.66:37431: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:47.552901 15057 tablet_server.cc:179] TabletServer@127.14.180.67:0 shutting down...
W20260709 13:09:47.581998 24279 consensus_peers.cc:597] T 352353d793574662ac966f335ae8cfbe P b39c386162de49aca92dbebee7f06ace -> Peer f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171): Couldn't send request to peer f8d4657116f948038a0c73018238c3ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:47.610071 24279 consensus_peers.cc:597] T 518a35ead60847e98c0b76330b999d6f P b39c386162de49aca92dbebee7f06ace -> Peer f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171): Couldn't send request to peer f8d4657116f948038a0c73018238c3ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:47.620421 15057 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:47.621569 15057 tablet_replica.cc:333] T 71cb3d981445473ca321bbe44299879c P f8d4657116f948038a0c73018238c3ba: stopping tablet replica
I20260709 13:09:47.622838 15057 raft_consensus.cc:2243] T 71cb3d981445473ca321bbe44299879c P f8d4657116f948038a0c73018238c3ba [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:47.623533 15057 raft_consensus.cc:2272] T 71cb3d981445473ca321bbe44299879c P f8d4657116f948038a0c73018238c3ba [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:47.625929 15057 tablet_replica.cc:333] T c5dc7f36da134739916e9685345be3ac P f8d4657116f948038a0c73018238c3ba: stopping tablet replica
I20260709 13:09:47.626668 15057 raft_consensus.cc:2243] T c5dc7f36da134739916e9685345be3ac P f8d4657116f948038a0c73018238c3ba [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:47.627933 15057 raft_consensus.cc:2272] T c5dc7f36da134739916e9685345be3ac P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:47.631462 15057 tablet_replica.cc:333] T 430894245c954e33b6586b4704c66b3c P f8d4657116f948038a0c73018238c3ba: stopping tablet replica
I20260709 13:09:47.632406 15057 raft_consensus.cc:2243] T 430894245c954e33b6586b4704c66b3c P f8d4657116f948038a0c73018238c3ba [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:47.633347 15057 raft_consensus.cc:2272] T 430894245c954e33b6586b4704c66b3c P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:47.635768 15057 tablet_replica.cc:333] T aaf99a05bd8842ed9ea668a9da85dbcc P f8d4657116f948038a0c73018238c3ba: stopping tablet replica
I20260709 13:09:47.636384 15057 raft_consensus.cc:2243] T aaf99a05bd8842ed9ea668a9da85dbcc P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:47.636864 15057 raft_consensus.cc:2272] T aaf99a05bd8842ed9ea668a9da85dbcc P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:47.640620 15057 tablet_replica.cc:333] T 25e4818a4e2e4c9c9f7a8467aa9ef881 P f8d4657116f948038a0c73018238c3ba: stopping tablet replica
I20260709 13:09:47.641569 15057 raft_consensus.cc:2243] T 25e4818a4e2e4c9c9f7a8467aa9ef881 P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:47.642251 15057 raft_consensus.cc:2272] T 25e4818a4e2e4c9c9f7a8467aa9ef881 P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:47.645013 15057 tablet_replica.cc:333] T 7a76ed4e1b6a4c2698999f722da5cfd7 P f8d4657116f948038a0c73018238c3ba: stopping tablet replica
I20260709 13:09:47.645727 15057 raft_consensus.cc:2243] T 7a76ed4e1b6a4c2698999f722da5cfd7 P f8d4657116f948038a0c73018238c3ba [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:47.646262 15057 raft_consensus.cc:2272] T 7a76ed4e1b6a4c2698999f722da5cfd7 P f8d4657116f948038a0c73018238c3ba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:47.648619 15057 tablet_replica.cc:333] T ef112a95c7964753b1c7c5a17656161b P f8d4657116f948038a0c73018238c3ba: stopping tablet replica
I20260709 13:09:47.649659 15057 raft_consensus.cc:2243] T ef112a95c7964753b1c7c5a17656161b P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:47.650295 15057 raft_consensus.cc:2272] T ef112a95c7964753b1c7c5a17656161b P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:47.653294 15057 tablet_replica.cc:333] T 65f010ca5ab74fa1b0f45b7d5dced706 P f8d4657116f948038a0c73018238c3ba: stopping tablet replica
W20260709 13:09:47.654022 24279 consensus_peers.cc:597] T c7b586130d5842f293b0df4b02792ec6 P b39c386162de49aca92dbebee7f06ace -> Peer f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171): Couldn't send request to peer f8d4657116f948038a0c73018238c3ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:47.654322 15057 raft_consensus.cc:2243] T 65f010ca5ab74fa1b0f45b7d5dced706 P f8d4657116f948038a0c73018238c3ba [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:47.655148 15057 raft_consensus.cc:2272] T 65f010ca5ab74fa1b0f45b7d5dced706 P f8d4657116f948038a0c73018238c3ba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:47.657991 15057 tablet_replica.cc:333] T 03e06f957f794ca696ddc7207eeabff0 P f8d4657116f948038a0c73018238c3ba: stopping tablet replica
I20260709 13:09:47.658768 15057 raft_consensus.cc:2243] T 03e06f957f794ca696ddc7207eeabff0 P f8d4657116f948038a0c73018238c3ba [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:47.659283 15057 raft_consensus.cc:2272] T 03e06f957f794ca696ddc7207eeabff0 P f8d4657116f948038a0c73018238c3ba [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:47.661536 15057 tablet_replica.cc:333] T 518a35ead60847e98c0b76330b999d6f P f8d4657116f948038a0c73018238c3ba: stopping tablet replica
I20260709 13:09:47.662256 15057 raft_consensus.cc:2243] T 518a35ead60847e98c0b76330b999d6f P f8d4657116f948038a0c73018238c3ba [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:47.662818 15057 raft_consensus.cc:2272] T 518a35ead60847e98c0b76330b999d6f P f8d4657116f948038a0c73018238c3ba [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:47.665000 15057 tablet_replica.cc:333] T 6bdf4f0b87584bdab10ccc418ab54f02 P f8d4657116f948038a0c73018238c3ba: stopping tablet replica
I20260709 13:09:47.665553 15057 raft_consensus.cc:2243] T 6bdf4f0b87584bdab10ccc418ab54f02 P f8d4657116f948038a0c73018238c3ba [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:47.666005 15057 raft_consensus.cc:2272] T 6bdf4f0b87584bdab10ccc418ab54f02 P f8d4657116f948038a0c73018238c3ba [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:47.668242 15057 tablet_replica.cc:333] T e21ef2f479764142935dc2b1b7e87220 P f8d4657116f948038a0c73018238c3ba: stopping tablet replica
I20260709 13:09:47.668823 15057 raft_consensus.cc:2243] T e21ef2f479764142935dc2b1b7e87220 P f8d4657116f948038a0c73018238c3ba [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:47.669371 15057 raft_consensus.cc:2272] T e21ef2f479764142935dc2b1b7e87220 P f8d4657116f948038a0c73018238c3ba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:47.671627 15057 tablet_replica.cc:333] T 3bcebec1ac994b99a49430f4f892d615 P f8d4657116f948038a0c73018238c3ba: stopping tablet replica
I20260709 13:09:47.672204 15057 raft_consensus.cc:2243] T 3bcebec1ac994b99a49430f4f892d615 P f8d4657116f948038a0c73018238c3ba [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:47.672657 15057 raft_consensus.cc:2272] T 3bcebec1ac994b99a49430f4f892d615 P f8d4657116f948038a0c73018238c3ba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:47.675819 15057 tablet_replica.cc:333] T ab4ea1ceb7a443be94ec74cd88c9bf47 P f8d4657116f948038a0c73018238c3ba: stopping tablet replica
I20260709 13:09:47.676797 15057 raft_consensus.cc:2243] T ab4ea1ceb7a443be94ec74cd88c9bf47 P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:47.677484 15057 raft_consensus.cc:2272] T ab4ea1ceb7a443be94ec74cd88c9bf47 P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:47.680610 15057 tablet_replica.cc:333] T 352353d793574662ac966f335ae8cfbe P f8d4657116f948038a0c73018238c3ba: stopping tablet replica
I20260709 13:09:47.681527 15057 raft_consensus.cc:2243] T 352353d793574662ac966f335ae8cfbe P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:47.682205 15057 raft_consensus.cc:2272] T 352353d793574662ac966f335ae8cfbe P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:47.685572 15057 tablet_replica.cc:333] T bff14fa713b6482f89ecf3e18f785f81 P f8d4657116f948038a0c73018238c3ba: stopping tablet replica
I20260709 13:09:47.686460 15057 raft_consensus.cc:2243] T bff14fa713b6482f89ecf3e18f785f81 P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:47.687247 15057 raft_consensus.cc:2272] T bff14fa713b6482f89ecf3e18f785f81 P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:47.690958 15057 tablet_replica.cc:333] T b53fa043603b41be836d4ccb5c248df8 P f8d4657116f948038a0c73018238c3ba: stopping tablet replica
I20260709 13:09:47.693157 15057 raft_consensus.cc:2243] T b53fa043603b41be836d4ccb5c248df8 P f8d4657116f948038a0c73018238c3ba [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:47.694357 15057 raft_consensus.cc:2272] T b53fa043603b41be836d4ccb5c248df8 P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:47.696650 24279 consensus_peers.cc:597] T 95774511405b4ed8aadbab3d362c068e P b39c386162de49aca92dbebee7f06ace -> Peer f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171): Couldn't send request to peer f8d4657116f948038a0c73018238c3ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:47.697639 15057 tablet_replica.cc:333] T a0ff7e0491fb406d9e1f13941504372f P f8d4657116f948038a0c73018238c3ba: stopping tablet replica
W20260709 13:09:47.698493 24279 consensus_peers.cc:597] T 9a126a61cad843b4a3b34fac0f85a1d2 P b39c386162de49aca92dbebee7f06ace -> Peer f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171): Couldn't send request to peer f8d4657116f948038a0c73018238c3ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:47.698630 15057 raft_consensus.cc:2243] T a0ff7e0491fb406d9e1f13941504372f P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:47.699532 15057 raft_consensus.cc:2272] T a0ff7e0491fb406d9e1f13941504372f P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:47.702010 15057 tablet_replica.cc:333] T d2ddfc9daac54dc28d63b46ab1777bf3 P f8d4657116f948038a0c73018238c3ba: stopping tablet replica
I20260709 13:09:47.702803 15057 raft_consensus.cc:2243] T d2ddfc9daac54dc28d63b46ab1777bf3 P f8d4657116f948038a0c73018238c3ba [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:47.703430 15057 raft_consensus.cc:2272] T d2ddfc9daac54dc28d63b46ab1777bf3 P f8d4657116f948038a0c73018238c3ba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:47.705665 15057 tablet_replica.cc:333] T 46f373ffd46f4625bac910b5ccf4b767 P f8d4657116f948038a0c73018238c3ba: stopping tablet replica
I20260709 13:09:47.706319 15057 raft_consensus.cc:2243] T 46f373ffd46f4625bac910b5ccf4b767 P f8d4657116f948038a0c73018238c3ba [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:47.707280 15057 raft_consensus.cc:2272] T 46f373ffd46f4625bac910b5ccf4b767 P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:47.709635 15057 tablet_replica.cc:333] T de5786fbd53646a9bc152ac0a2a9aa53 P f8d4657116f948038a0c73018238c3ba: stopping tablet replica
I20260709 13:09:47.710258 15057 raft_consensus.cc:2243] T de5786fbd53646a9bc152ac0a2a9aa53 P f8d4657116f948038a0c73018238c3ba [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:47.711248 15057 raft_consensus.cc:2272] T de5786fbd53646a9bc152ac0a2a9aa53 P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:47.713840 25297 raft_consensus.cc:493] T 42868db4862647c28215f3d7cb9adf02 P b39c386162de49aca92dbebee7f06ace [term 3 FOLLOWER]: Starting pre-election (detected failure of leader dea34817fcc148d78f090ef5fa72304f)
I20260709 13:09:47.714607 15057 tablet_replica.cc:333] T 1cefd1de9d9a4839b200c2472b3aeefc P f8d4657116f948038a0c73018238c3ba: stopping tablet replica
I20260709 13:09:47.714485 25297 raft_consensus.cc:515] T 42868db4862647c28215f3d7cb9adf02 P b39c386162de49aca92dbebee7f06ace [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:47.715539 15057 raft_consensus.cc:2243] T 1cefd1de9d9a4839b200c2472b3aeefc P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:47.716272 15057 raft_consensus.cc:2272] T 1cefd1de9d9a4839b200c2472b3aeefc P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:47.716682 25297 leader_election.cc:290] T 42868db4862647c28215f3d7cb9adf02 P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171), dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343)
I20260709 13:09:47.719558 15057 tablet_replica.cc:333] T f662efc86a73450cac065505b63cb883 P f8d4657116f948038a0c73018238c3ba: stopping tablet replica
W20260709 13:09:47.719924 24279 leader_election.cc:336] T 42868db4862647c28215f3d7cb9adf02 P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:47.720551 15057 raft_consensus.cc:2243] T f662efc86a73450cac065505b63cb883 P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:47.721197 15057 raft_consensus.cc:2272] T f662efc86a73450cac065505b63cb883 P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:47.721755 24280 leader_election.cc:336] T 42868db4862647c28215f3d7cb9adf02 P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Network error: Client connection negotiation failed: client connection to 127.14.180.65:36343: connect: Connection refused (error 111)
I20260709 13:09:47.722270 24280 leader_election.cc:304] T 42868db4862647c28215f3d7cb9adf02 P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b39c386162de49aca92dbebee7f06ace; no voters: dea34817fcc148d78f090ef5fa72304f, f8d4657116f948038a0c73018238c3ba
I20260709 13:09:47.723110 25297 raft_consensus.cc:2749] T 42868db4862647c28215f3d7cb9adf02 P b39c386162de49aca92dbebee7f06ace [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:09:47.724165 15057 tablet_replica.cc:333] T e6f709868be149759ecdc073fe125bec P f8d4657116f948038a0c73018238c3ba: stopping tablet replica
I20260709 13:09:47.724853 15057 raft_consensus.cc:2243] T e6f709868be149759ecdc073fe125bec P f8d4657116f948038a0c73018238c3ba [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:47.725359 15057 raft_consensus.cc:2272] T e6f709868be149759ecdc073fe125bec P f8d4657116f948038a0c73018238c3ba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:47.728161 15057 tablet_replica.cc:333] T 93e868a924d74bbc8bf29aa5a7fc67fd P f8d4657116f948038a0c73018238c3ba: stopping tablet replica
I20260709 13:09:47.728916 15057 raft_consensus.cc:2243] T 93e868a924d74bbc8bf29aa5a7fc67fd P f8d4657116f948038a0c73018238c3ba [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:47.729624 15057 raft_consensus.cc:2272] T 93e868a924d74bbc8bf29aa5a7fc67fd P f8d4657116f948038a0c73018238c3ba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:47.732564 15057 tablet_replica.cc:333] T ee2c640a38d44afebd95dfec0e30b0d6 P f8d4657116f948038a0c73018238c3ba: stopping tablet replica
I20260709 13:09:47.733206 15057 raft_consensus.cc:2243] T ee2c640a38d44afebd95dfec0e30b0d6 P f8d4657116f948038a0c73018238c3ba [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:47.734145 15057 raft_consensus.cc:2272] T ee2c640a38d44afebd95dfec0e30b0d6 P f8d4657116f948038a0c73018238c3ba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:47.736451 15057 tablet_replica.cc:333] T 5bc4e407c8b04739aa0290922bfdbed4 P f8d4657116f948038a0c73018238c3ba: stopping tablet replica
I20260709 13:09:47.737058 15057 raft_consensus.cc:2243] T 5bc4e407c8b04739aa0290922bfdbed4 P f8d4657116f948038a0c73018238c3ba [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:47.737910 15057 raft_consensus.cc:2272] T 5bc4e407c8b04739aa0290922bfdbed4 P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:47.740044 15057 tablet_replica.cc:333] T 01f1144c4a1c482894ec993e5ce24bc4 P f8d4657116f948038a0c73018238c3ba: stopping tablet replica
I20260709 13:09:47.740913 15057 raft_consensus.cc:2243] T 01f1144c4a1c482894ec993e5ce24bc4 P f8d4657116f948038a0c73018238c3ba [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:47.742007 15057 raft_consensus.cc:2272] T 01f1144c4a1c482894ec993e5ce24bc4 P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:47.744467 15057 tablet_replica.cc:333] T 99078769583e49908dd6990f1d806453 P f8d4657116f948038a0c73018238c3ba: stopping tablet replica
I20260709 13:09:47.745124 15057 raft_consensus.cc:2243] T 99078769583e49908dd6990f1d806453 P f8d4657116f948038a0c73018238c3ba [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:47.745947 15057 raft_consensus.cc:2272] T 99078769583e49908dd6990f1d806453 P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:47.748139 15057 tablet_replica.cc:333] T c9b7bd5d439d455a9173478e086439e8 P f8d4657116f948038a0c73018238c3ba: stopping tablet replica
I20260709 13:09:47.748813 15057 raft_consensus.cc:2243] T c9b7bd5d439d455a9173478e086439e8 P f8d4657116f948038a0c73018238c3ba [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:47.749387 15057 raft_consensus.cc:2272] T c9b7bd5d439d455a9173478e086439e8 P f8d4657116f948038a0c73018238c3ba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:47.751622 15057 tablet_replica.cc:333] T 861d7d76be4d484a9eb3acf8abffae5f P f8d4657116f948038a0c73018238c3ba: stopping tablet replica
I20260709 13:09:47.752280 15057 raft_consensus.cc:2243] T 861d7d76be4d484a9eb3acf8abffae5f P f8d4657116f948038a0c73018238c3ba [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:47.752771 15057 raft_consensus.cc:2272] T 861d7d76be4d484a9eb3acf8abffae5f P f8d4657116f948038a0c73018238c3ba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:47.755182 15057 tablet_replica.cc:333] T e335cd6afc4349cfaafa2970bccb40ff P f8d4657116f948038a0c73018238c3ba: stopping tablet replica
I20260709 13:09:47.755849 15057 raft_consensus.cc:2243] T e335cd6afc4349cfaafa2970bccb40ff P f8d4657116f948038a0c73018238c3ba [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:47.756379 15057 raft_consensus.cc:2272] T e335cd6afc4349cfaafa2970bccb40ff P f8d4657116f948038a0c73018238c3ba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:47.759157 15057 tablet_replica.cc:333] T b1d1d7dd508b43489431371c4ece4fa4 P f8d4657116f948038a0c73018238c3ba: stopping tablet replica
I20260709 13:09:47.760044 15057 raft_consensus.cc:2243] T b1d1d7dd508b43489431371c4ece4fa4 P f8d4657116f948038a0c73018238c3ba [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:47.761143 15057 raft_consensus.cc:2272] T b1d1d7dd508b43489431371c4ece4fa4 P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:47.761943 24279 consensus_peers.cc:597] T ef112a95c7964753b1c7c5a17656161b P b39c386162de49aca92dbebee7f06ace -> Peer f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171): Couldn't send request to peer f8d4657116f948038a0c73018238c3ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:47.763000 25297 raft_consensus.cc:493] T 7a76ed4e1b6a4c2698999f722da5cfd7 P b39c386162de49aca92dbebee7f06ace [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dea34817fcc148d78f090ef5fa72304f)
I20260709 13:09:47.763592 25297 raft_consensus.cc:515] T 7a76ed4e1b6a4c2698999f722da5cfd7 P b39c386162de49aca92dbebee7f06ace [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:47.764047 15057 tablet_replica.cc:333] T f735173e22b242178edcdf4821b6f92b P f8d4657116f948038a0c73018238c3ba: stopping tablet replica
I20260709 13:09:47.764840 15057 raft_consensus.cc:2243] T f735173e22b242178edcdf4821b6f92b P f8d4657116f948038a0c73018238c3ba [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:47.765966 25297 leader_election.cc:290] T 7a76ed4e1b6a4c2698999f722da5cfd7 P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171), dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343)
I20260709 13:09:47.766765 15057 raft_consensus.cc:2272] T f735173e22b242178edcdf4821b6f92b P f8d4657116f948038a0c73018238c3ba [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:47.769873 24279 leader_election.cc:336] T 7a76ed4e1b6a4c2698999f722da5cfd7 P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:09:47.770733 15057 tablet_replica.cc:333] T 662a938528e545e6aa4592052da18101 P f8d4657116f948038a0c73018238c3ba: stopping tablet replica
I20260709 13:09:47.771428 15057 raft_consensus.cc:2243] T 662a938528e545e6aa4592052da18101 P f8d4657116f948038a0c73018238c3ba [term 4 FOLLOWER]: Raft consensus shutting down.
W20260709 13:09:47.771442 24280 leader_election.cc:336] T 7a76ed4e1b6a4c2698999f722da5cfd7 P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Network error: Client connection negotiation failed: client connection to 127.14.180.65:36343: connect: Connection refused (error 111)
I20260709 13:09:47.772042 15057 raft_consensus.cc:2272] T 662a938528e545e6aa4592052da18101 P f8d4657116f948038a0c73018238c3ba [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:47.772064 24280 leader_election.cc:304] T 7a76ed4e1b6a4c2698999f722da5cfd7 P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b39c386162de49aca92dbebee7f06ace; no voters: dea34817fcc148d78f090ef5fa72304f, f8d4657116f948038a0c73018238c3ba
I20260709 13:09:47.772863 25297 raft_consensus.cc:2749] T 7a76ed4e1b6a4c2698999f722da5cfd7 P b39c386162de49aca92dbebee7f06ace [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:47.774832 15057 tablet_replica.cc:333] T 95774511405b4ed8aadbab3d362c068e P f8d4657116f948038a0c73018238c3ba: stopping tablet replica
I20260709 13:09:47.775452 15057 raft_consensus.cc:2243] T 95774511405b4ed8aadbab3d362c068e P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:47.775882 15057 raft_consensus.cc:2272] T 95774511405b4ed8aadbab3d362c068e P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:47.777961 15057 tablet_replica.cc:333] T 42868db4862647c28215f3d7cb9adf02 P f8d4657116f948038a0c73018238c3ba: stopping tablet replica
I20260709 13:09:47.778499 15057 raft_consensus.cc:2243] T 42868db4862647c28215f3d7cb9adf02 P f8d4657116f948038a0c73018238c3ba [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:47.778955 15057 raft_consensus.cc:2272] T 42868db4862647c28215f3d7cb9adf02 P f8d4657116f948038a0c73018238c3ba [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:47.781642 15057 tablet_replica.cc:333] T 502fe798081f4dc693eed179efa2a241 P f8d4657116f948038a0c73018238c3ba: stopping tablet replica
I20260709 13:09:47.782657 15057 raft_consensus.cc:2243] T 502fe798081f4dc693eed179efa2a241 P f8d4657116f948038a0c73018238c3ba [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:47.783825 15057 raft_consensus.cc:2272] T 502fe798081f4dc693eed179efa2a241 P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:47.784583 24279 consensus_peers.cc:597] T c5873f7465894eddab6fa84daecdcc84 P b39c386162de49aca92dbebee7f06ace -> Peer f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171): Couldn't send request to peer f8d4657116f948038a0c73018238c3ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:47.786710 15057 tablet_replica.cc:333] T c5873f7465894eddab6fa84daecdcc84 P f8d4657116f948038a0c73018238c3ba: stopping tablet replica
I20260709 13:09:47.787436 15057 raft_consensus.cc:2243] T c5873f7465894eddab6fa84daecdcc84 P f8d4657116f948038a0c73018238c3ba [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:47.788025 15057 raft_consensus.cc:2272] T c5873f7465894eddab6fa84daecdcc84 P f8d4657116f948038a0c73018238c3ba [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:47.790130 24279 consensus_peers.cc:597] T 1cefd1de9d9a4839b200c2472b3aeefc P b39c386162de49aca92dbebee7f06ace -> Peer f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171): Couldn't send request to peer f8d4657116f948038a0c73018238c3ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:47.791013 15057 tablet_replica.cc:333] T 47fcd2aa8e994186872c2e0f9995dd8a P f8d4657116f948038a0c73018238c3ba: stopping tablet replica
I20260709 13:09:47.791759 15057 raft_consensus.cc:2243] T 47fcd2aa8e994186872c2e0f9995dd8a P f8d4657116f948038a0c73018238c3ba [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:47.792874 15057 raft_consensus.cc:2272] T 47fcd2aa8e994186872c2e0f9995dd8a P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:47.795250 15057 tablet_replica.cc:333] T 49393e5cc2614c90b69a3bb2348dacb9 P f8d4657116f948038a0c73018238c3ba: stopping tablet replica
I20260709 13:09:47.795898 15057 raft_consensus.cc:2243] T 49393e5cc2614c90b69a3bb2348dacb9 P f8d4657116f948038a0c73018238c3ba [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:47.796785 15057 raft_consensus.cc:2272] T 49393e5cc2614c90b69a3bb2348dacb9 P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:47.799036 15057 tablet_replica.cc:333] T aac6068ee4554cce8f2d534a106ef417 P f8d4657116f948038a0c73018238c3ba: stopping tablet replica
I20260709 13:09:47.799664 15057 raft_consensus.cc:2243] T aac6068ee4554cce8f2d534a106ef417 P f8d4657116f948038a0c73018238c3ba [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:47.800585 15057 raft_consensus.cc:2272] T aac6068ee4554cce8f2d534a106ef417 P f8d4657116f948038a0c73018238c3ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:47.803397 15057 tablet_replica.cc:333] T c7b586130d5842f293b0df4b02792ec6 P f8d4657116f948038a0c73018238c3ba: stopping tablet replica
I20260709 13:09:47.804100 15057 raft_consensus.cc:2243] T c7b586130d5842f293b0df4b02792ec6 P f8d4657116f948038a0c73018238c3ba [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:47.804725 15057 raft_consensus.cc:2272] T c7b586130d5842f293b0df4b02792ec6 P f8d4657116f948038a0c73018238c3ba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:47.807735 15057 tablet_replica.cc:333] T 9a126a61cad843b4a3b34fac0f85a1d2 P f8d4657116f948038a0c73018238c3ba: stopping tablet replica
I20260709 13:09:47.808296 15057 raft_consensus.cc:2243] T 9a126a61cad843b4a3b34fac0f85a1d2 P f8d4657116f948038a0c73018238c3ba [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:47.808792 15057 raft_consensus.cc:2272] T 9a126a61cad843b4a3b34fac0f85a1d2 P f8d4657116f948038a0c73018238c3ba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:47.834147 25297 raft_consensus.cc:493] T 1dcdde5516f54b19b11611ca9213415d P b39c386162de49aca92dbebee7f06ace [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dea34817fcc148d78f090ef5fa72304f)
I20260709 13:09:47.834784 25297 raft_consensus.cc:515] T 1dcdde5516f54b19b11611ca9213415d P b39c386162de49aca92dbebee7f06ace [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:47.836834 25297 leader_election.cc:290] T 1dcdde5516f54b19b11611ca9213415d P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343), c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431)
W20260709 13:09:47.843119 24280 leader_election.cc:336] T 1dcdde5516f54b19b11611ca9213415d P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Network error: Client connection negotiation failed: client connection to 127.14.180.65:36343: connect: Connection refused (error 111)
W20260709 13:09:47.844039 24280 leader_election.cc:336] T 1dcdde5516f54b19b11611ca9213415d P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431): Network error: Client connection negotiation failed: client connection to 127.14.180.66:37431: connect: Connection refused (error 111)
I20260709 13:09:47.844471 24280 leader_election.cc:304] T 1dcdde5516f54b19b11611ca9213415d P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b39c386162de49aca92dbebee7f06ace; no voters: c0f503bf8bb94af8a2a1139db4e1c0f5, dea34817fcc148d78f090ef5fa72304f
I20260709 13:09:47.845333 25297 raft_consensus.cc:2749] T 1dcdde5516f54b19b11611ca9213415d P b39c386162de49aca92dbebee7f06ace [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:09:47.857187 24279 consensus_peers.cc:597] T aaf99a05bd8842ed9ea668a9da85dbcc P b39c386162de49aca92dbebee7f06ace -> Peer f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171): Couldn't send request to peer f8d4657116f948038a0c73018238c3ba. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:47.881497 25297 raft_consensus.cc:493] T 99b130381d71460388507938ba053f8f P b39c386162de49aca92dbebee7f06ace [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dea34817fcc148d78f090ef5fa72304f)
I20260709 13:09:47.882210 25297 raft_consensus.cc:515] T 99b130381d71460388507938ba053f8f P b39c386162de49aca92dbebee7f06ace [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:47.885123 25297 leader_election.cc:290] T 99b130381d71460388507938ba053f8f P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343), c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431)
I20260709 13:09:47.893841 25344 raft_consensus.cc:493] T 662a938528e545e6aa4592052da18101 P b39c386162de49aca92dbebee7f06ace [term 4 FOLLOWER]: Starting pre-election (detected failure of leader dea34817fcc148d78f090ef5fa72304f)
I20260709 13:09:47.894647 15057 tablet_server.cc:196] TabletServer@127.14.180.67:0 shutdown complete.
I20260709 13:09:47.894373 25344 raft_consensus.cc:515] T 662a938528e545e6aa4592052da18101 P b39c386162de49aca92dbebee7f06ace [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
W20260709 13:09:47.896663 24280 leader_election.cc:336] T 99b130381d71460388507938ba053f8f P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Network error: Client connection negotiation failed: client connection to 127.14.180.65:36343: connect: Connection refused (error 111)
I20260709 13:09:47.896770 25344 leader_election.cc:290] T 662a938528e545e6aa4592052da18101 P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171), dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343)
W20260709 13:09:47.899212 24280 leader_election.cc:336] T 99b130381d71460388507938ba053f8f P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431): Network error: Client connection negotiation failed: client connection to 127.14.180.66:37431: connect: Connection refused (error 111)
I20260709 13:09:47.899683 24280 leader_election.cc:304] T 99b130381d71460388507938ba053f8f P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b39c386162de49aca92dbebee7f06ace; no voters: c0f503bf8bb94af8a2a1139db4e1c0f5, dea34817fcc148d78f090ef5fa72304f
W20260709 13:09:47.900462 24279 consensus_peers.cc:597] T 6bdf4f0b87584bdab10ccc418ab54f02 P b39c386162de49aca92dbebee7f06ace -> Peer f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171): Couldn't send request to peer f8d4657116f948038a0c73018238c3ba. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.67:46171: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:47.900614 25330 raft_consensus.cc:2749] T 99b130381d71460388507938ba053f8f P b39c386162de49aca92dbebee7f06ace [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:09:47.904033 24280 leader_election.cc:336] T 662a938528e545e6aa4592052da18101 P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Network error: Client connection negotiation failed: client connection to 127.14.180.65:36343: connect: Connection refused (error 111)
W20260709 13:09:47.904815 24279 leader_election.cc:336] T 662a938528e545e6aa4592052da18101 P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171): Network error: Client connection negotiation failed: client connection to 127.14.180.67:46171: connect: Connection refused (error 111)
I20260709 13:09:47.905254 24279 leader_election.cc:304] T 662a938528e545e6aa4592052da18101 P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b39c386162de49aca92dbebee7f06ace; no voters: dea34817fcc148d78f090ef5fa72304f, f8d4657116f948038a0c73018238c3ba
I20260709 13:09:47.906181 25330 raft_consensus.cc:2749] T 662a938528e545e6aa4592052da18101 P b39c386162de49aca92dbebee7f06ace [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:09:47.909158 24279 consensus_peers.cc:597] T f662efc86a73450cac065505b63cb883 P b39c386162de49aca92dbebee7f06ace -> Peer f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171): Couldn't send request to peer f8d4657116f948038a0c73018238c3ba. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.67:46171: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:47.918138 24279 consensus_peers.cc:597] T a0ff7e0491fb406d9e1f13941504372f P b39c386162de49aca92dbebee7f06ace -> Peer f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171): Couldn't send request to peer f8d4657116f948038a0c73018238c3ba. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.67:46171: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:47.981807 15057 tablet_server.cc:179] TabletServer@127.14.180.68:0 shutting down...
I20260709 13:09:48.025177 25330 raft_consensus.cc:493] T c9b7bd5d439d455a9173478e086439e8 P b39c386162de49aca92dbebee7f06ace [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dea34817fcc148d78f090ef5fa72304f)
I20260709 13:09:48.026014 25330 raft_consensus.cc:515] T c9b7bd5d439d455a9173478e086439e8 P b39c386162de49aca92dbebee7f06ace [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d4657116f948038a0c73018238c3ba" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 46171 } } peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } }
I20260709 13:09:48.028271 25330 leader_election.cc:290] T c9b7bd5d439d455a9173478e086439e8 P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171), dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343)
I20260709 13:09:48.031330 15057 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:48.032466 15057 tablet_replica.cc:333] T 71cb3d981445473ca321bbe44299879c P b39c386162de49aca92dbebee7f06ace: stopping tablet replica
W20260709 13:09:48.032567 24279 leader_election.cc:336] T c9b7bd5d439d455a9173478e086439e8 P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171): Network error: Client connection negotiation failed: client connection to 127.14.180.67:46171: connect: Connection refused (error 111)
I20260709 13:09:48.033561 15057 raft_consensus.cc:2243] T 71cb3d981445473ca321bbe44299879c P b39c386162de49aca92dbebee7f06ace [term 3 FOLLOWER]: Raft consensus shutting down.
W20260709 13:09:48.033752 24280 leader_election.cc:336] T c9b7bd5d439d455a9173478e086439e8 P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Network error: Client connection negotiation failed: client connection to 127.14.180.65:36343: connect: Connection refused (error 111)
I20260709 13:09:48.034235 15057 raft_consensus.cc:2272] T 71cb3d981445473ca321bbe44299879c P b39c386162de49aca92dbebee7f06ace [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:48.034255 24280 leader_election.cc:304] T c9b7bd5d439d455a9173478e086439e8 P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b39c386162de49aca92dbebee7f06ace; no voters: dea34817fcc148d78f090ef5fa72304f, f8d4657116f948038a0c73018238c3ba
I20260709 13:09:48.035153 25330 raft_consensus.cc:2749] T c9b7bd5d439d455a9173478e086439e8 P b39c386162de49aca92dbebee7f06ace [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:48.036271 25330 raft_consensus.cc:493] T b25c31c2fcad44f281a8a045e6cb0c19 P b39c386162de49aca92dbebee7f06ace [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dea34817fcc148d78f090ef5fa72304f)
I20260709 13:09:48.036727 25330 raft_consensus.cc:515] T b25c31c2fcad44f281a8a045e6cb0c19 P b39c386162de49aca92dbebee7f06ace [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:48.037245 15057 tablet_replica.cc:333] T c5dc7f36da134739916e9685345be3ac P b39c386162de49aca92dbebee7f06ace: stopping tablet replica
I20260709 13:09:48.038136 15057 raft_consensus.cc:2243] T c5dc7f36da134739916e9685345be3ac P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:48.038714 15057 raft_consensus.cc:2272] T c5dc7f36da134739916e9685345be3ac P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:48.038874 25330 leader_election.cc:290] T b25c31c2fcad44f281a8a045e6cb0c19 P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343), c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431)
I20260709 13:09:48.041744 15057 tablet_replica.cc:333] T 2dbbcd71c86041ba949fac653102e076 P b39c386162de49aca92dbebee7f06ace: stopping tablet replica
I20260709 13:09:48.042892 15057 raft_consensus.cc:2243] T 2dbbcd71c86041ba949fac653102e076 P b39c386162de49aca92dbebee7f06ace [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:48.043665 15057 raft_consensus.cc:2272] T 2dbbcd71c86041ba949fac653102e076 P b39c386162de49aca92dbebee7f06ace [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:48.043742 24280 leader_election.cc:336] T b25c31c2fcad44f281a8a045e6cb0c19 P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Network error: Client connection negotiation failed: client connection to 127.14.180.65:36343: connect: Connection refused (error 111)
W20260709 13:09:48.045136 24280 leader_election.cc:336] T b25c31c2fcad44f281a8a045e6cb0c19 P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431): Network error: Client connection negotiation failed: client connection to 127.14.180.66:37431: connect: Connection refused (error 111)
I20260709 13:09:48.045634 24280 leader_election.cc:304] T b25c31c2fcad44f281a8a045e6cb0c19 P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b39c386162de49aca92dbebee7f06ace; no voters: c0f503bf8bb94af8a2a1139db4e1c0f5, dea34817fcc148d78f090ef5fa72304f
I20260709 13:09:48.046478 25344 raft_consensus.cc:2749] T b25c31c2fcad44f281a8a045e6cb0c19 P b39c386162de49aca92dbebee7f06ace [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:48.046522 15057 tablet_replica.cc:333] T aaf99a05bd8842ed9ea668a9da85dbcc P b39c386162de49aca92dbebee7f06ace: stopping tablet replica
I20260709 13:09:48.048012 15057 raft_consensus.cc:2243] T aaf99a05bd8842ed9ea668a9da85dbcc P b39c386162de49aca92dbebee7f06ace [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:48.049237 15057 raft_consensus.cc:2272] T aaf99a05bd8842ed9ea668a9da85dbcc P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:48.052429 15057 tablet_replica.cc:333] T ef112a95c7964753b1c7c5a17656161b P b39c386162de49aca92dbebee7f06ace: stopping tablet replica
I20260709 13:09:48.053246 15057 raft_consensus.cc:2243] T ef112a95c7964753b1c7c5a17656161b P b39c386162de49aca92dbebee7f06ace [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:48.054255 15057 raft_consensus.cc:2272] T ef112a95c7964753b1c7c5a17656161b P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:48.057363 15057 tablet_replica.cc:333] T 7a76ed4e1b6a4c2698999f722da5cfd7 P b39c386162de49aca92dbebee7f06ace: stopping tablet replica
I20260709 13:09:48.058084 15057 raft_consensus.cc:2243] T 7a76ed4e1b6a4c2698999f722da5cfd7 P b39c386162de49aca92dbebee7f06ace [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:48.058656 15057 raft_consensus.cc:2272] T 7a76ed4e1b6a4c2698999f722da5cfd7 P b39c386162de49aca92dbebee7f06ace [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:48.061661 15057 tablet_replica.cc:333] T e280ec3a0e394065aca766e4f8bef46d P b39c386162de49aca92dbebee7f06ace: stopping tablet replica
I20260709 13:09:48.062428 15057 raft_consensus.cc:2243] T e280ec3a0e394065aca766e4f8bef46d P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:48.063040 15057 raft_consensus.cc:2272] T e280ec3a0e394065aca766e4f8bef46d P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:48.065357 15057 tablet_replica.cc:333] T 0dbd3426f3e14ef28e7b0b6c4c7de6a2 P b39c386162de49aca92dbebee7f06ace: stopping tablet replica
I20260709 13:09:48.065992 15057 raft_consensus.cc:2243] T 0dbd3426f3e14ef28e7b0b6c4c7de6a2 P b39c386162de49aca92dbebee7f06ace [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:48.066907 15057 raft_consensus.cc:2272] T 0dbd3426f3e14ef28e7b0b6c4c7de6a2 P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:48.069219 15057 tablet_replica.cc:333] T b25c31c2fcad44f281a8a045e6cb0c19 P b39c386162de49aca92dbebee7f06ace: stopping tablet replica
I20260709 13:09:48.069856 15057 raft_consensus.cc:2243] T b25c31c2fcad44f281a8a045e6cb0c19 P b39c386162de49aca92dbebee7f06ace [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:48.069950 25330 raft_consensus.cc:493] T 687efb9bbbd04b0eb768bfa6543380c3 P b39c386162de49aca92dbebee7f06ace [term 2 FOLLOWER]: Starting pre-election (detected failure of leader dea34817fcc148d78f090ef5fa72304f)
I20260709 13:09:48.070446 15057 raft_consensus.cc:2272] T b25c31c2fcad44f281a8a045e6cb0c19 P b39c386162de49aca92dbebee7f06ace [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:48.070657 25330 raft_consensus.cc:515] T 687efb9bbbd04b0eb768bfa6543380c3 P b39c386162de49aca92dbebee7f06ace [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b39c386162de49aca92dbebee7f06ace" member_type: VOTER last_known_addr { host: "127.14.180.68" port: 38561 } } peers { permanent_uuid: "dea34817fcc148d78f090ef5fa72304f" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 36343 } } peers { permanent_uuid: "c0f503bf8bb94af8a2a1139db4e1c0f5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 37431 } }
I20260709 13:09:48.072695 25330 leader_election.cc:290] T 687efb9bbbd04b0eb768bfa6543380c3 P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343), c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431)
I20260709 13:09:48.072955 15057 tablet_replica.cc:333] T 352353d793574662ac966f335ae8cfbe P b39c386162de49aca92dbebee7f06ace: stopping tablet replica
I20260709 13:09:48.073876 15057 raft_consensus.cc:2243] T 352353d793574662ac966f335ae8cfbe P b39c386162de49aca92dbebee7f06ace [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:48.075081 15057 raft_consensus.cc:2272] T 352353d793574662ac966f335ae8cfbe P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:48.076942 24280 leader_election.cc:336] T 687efb9bbbd04b0eb768bfa6543380c3 P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer dea34817fcc148d78f090ef5fa72304f (127.14.180.65:36343): Network error: Client connection negotiation failed: client connection to 127.14.180.65:36343: connect: Connection refused (error 111)
W20260709 13:09:48.077677 24280 leader_election.cc:336] T 687efb9bbbd04b0eb768bfa6543380c3 P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c0f503bf8bb94af8a2a1139db4e1c0f5 (127.14.180.66:37431): Network error: Client connection negotiation failed: client connection to 127.14.180.66:37431: connect: Connection refused (error 111)
I20260709 13:09:48.078063 15057 tablet_replica.cc:333] T 1dcdde5516f54b19b11611ca9213415d P b39c386162de49aca92dbebee7f06ace: stopping tablet replica
I20260709 13:09:48.078027 24280 leader_election.cc:304] T 687efb9bbbd04b0eb768bfa6543380c3 P b39c386162de49aca92dbebee7f06ace [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b39c386162de49aca92dbebee7f06ace; no voters: c0f503bf8bb94af8a2a1139db4e1c0f5, dea34817fcc148d78f090ef5fa72304f
I20260709 13:09:48.078737 25330 raft_consensus.cc:2749] T 687efb9bbbd04b0eb768bfa6543380c3 P b39c386162de49aca92dbebee7f06ace [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:09:48.078956 15057 raft_consensus.cc:2243] T 1dcdde5516f54b19b11611ca9213415d P b39c386162de49aca92dbebee7f06ace [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:48.079602 15057 raft_consensus.cc:2272] T 1dcdde5516f54b19b11611ca9213415d P b39c386162de49aca92dbebee7f06ace [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:48.081653 15057 tablet_replica.cc:333] T 5bc4e407c8b04739aa0290922bfdbed4 P b39c386162de49aca92dbebee7f06ace: stopping tablet replica
I20260709 13:09:48.082191 15057 raft_consensus.cc:2243] T 5bc4e407c8b04739aa0290922bfdbed4 P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:48.082679 15057 raft_consensus.cc:2272] T 5bc4e407c8b04739aa0290922bfdbed4 P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:48.084612 15057 tablet_replica.cc:333] T c9b7bd5d439d455a9173478e086439e8 P b39c386162de49aca92dbebee7f06ace: stopping tablet replica
I20260709 13:09:48.085386 15057 raft_consensus.cc:2243] T c9b7bd5d439d455a9173478e086439e8 P b39c386162de49aca92dbebee7f06ace [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:48.085984 15057 raft_consensus.cc:2272] T c9b7bd5d439d455a9173478e086439e8 P b39c386162de49aca92dbebee7f06ace [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:48.088909 15057 tablet_replica.cc:333] T b53fa043603b41be836d4ccb5c248df8 P b39c386162de49aca92dbebee7f06ace: stopping tablet replica
I20260709 13:09:48.089643 15057 raft_consensus.cc:2243] T b53fa043603b41be836d4ccb5c248df8 P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:48.090229 15057 raft_consensus.cc:2272] T b53fa043603b41be836d4ccb5c248df8 P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:48.090929 24279 consensus_peers.cc:597] T e335cd6afc4349cfaafa2970bccb40ff P b39c386162de49aca92dbebee7f06ace -> Peer f8d4657116f948038a0c73018238c3ba (127.14.180.67:46171): Couldn't send request to peer f8d4657116f948038a0c73018238c3ba. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.67:46171: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:48.092664 15057 tablet_replica.cc:333] T 7da69453741f4b73a0092f56f29b1000 P b39c386162de49aca92dbebee7f06ace: stopping tablet replica
I20260709 13:09:48.093369 15057 raft_consensus.cc:2243] T 7da69453741f4b73a0092f56f29b1000 P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:48.093843 15057 raft_consensus.cc:2272] T 7da69453741f4b73a0092f56f29b1000 P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:48.095973 15057 tablet_replica.cc:333] T f662efc86a73450cac065505b63cb883 P b39c386162de49aca92dbebee7f06ace: stopping tablet replica
I20260709 13:09:48.096568 15057 raft_consensus.cc:2243] T f662efc86a73450cac065505b63cb883 P b39c386162de49aca92dbebee7f06ace [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:48.097354 15057 raft_consensus.cc:2272] T f662efc86a73450cac065505b63cb883 P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:48.099422 15057 tablet_replica.cc:333] T 01f1144c4a1c482894ec993e5ce24bc4 P b39c386162de49aca92dbebee7f06ace: stopping tablet replica
I20260709 13:09:48.100190 15057 raft_consensus.cc:2243] T 01f1144c4a1c482894ec993e5ce24bc4 P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:48.100759 15057 raft_consensus.cc:2272] T 01f1144c4a1c482894ec993e5ce24bc4 P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:48.102938 15057 tablet_replica.cc:333] T 99078769583e49908dd6990f1d806453 P b39c386162de49aca92dbebee7f06ace: stopping tablet replica
I20260709 13:09:48.103521 15057 raft_consensus.cc:2243] T 99078769583e49908dd6990f1d806453 P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:48.103966 15057 raft_consensus.cc:2272] T 99078769583e49908dd6990f1d806453 P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:48.105932 15057 tablet_replica.cc:333] T 9a126a61cad843b4a3b34fac0f85a1d2 P b39c386162de49aca92dbebee7f06ace: stopping tablet replica
I20260709 13:09:48.106511 15057 raft_consensus.cc:2243] T 9a126a61cad843b4a3b34fac0f85a1d2 P b39c386162de49aca92dbebee7f06ace [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:48.107381 15057 raft_consensus.cc:2272] T 9a126a61cad843b4a3b34fac0f85a1d2 P b39c386162de49aca92dbebee7f06ace [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:48.109256 15057 tablet_replica.cc:333] T 662a938528e545e6aa4592052da18101 P b39c386162de49aca92dbebee7f06ace: stopping tablet replica
I20260709 13:09:48.109828 15057 raft_consensus.cc:2243] T 662a938528e545e6aa4592052da18101 P b39c386162de49aca92dbebee7f06ace [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:48.110244 15057 raft_consensus.cc:2272] T 662a938528e545e6aa4592052da18101 P b39c386162de49aca92dbebee7f06ace [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:48.112349 15057 tablet_replica.cc:333] T 99b130381d71460388507938ba053f8f P b39c386162de49aca92dbebee7f06ace: stopping tablet replica
I20260709 13:09:48.112931 15057 raft_consensus.cc:2243] T 99b130381d71460388507938ba053f8f P b39c386162de49aca92dbebee7f06ace [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:48.113406 15057 raft_consensus.cc:2272] T 99b130381d71460388507938ba053f8f P b39c386162de49aca92dbebee7f06ace [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:48.115680 15057 tablet_replica.cc:333] T 95774511405b4ed8aadbab3d362c068e P b39c386162de49aca92dbebee7f06ace: stopping tablet replica
I20260709 13:09:48.116277 15057 raft_consensus.cc:2243] T 95774511405b4ed8aadbab3d362c068e P b39c386162de49aca92dbebee7f06ace [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:48.117089 15057 raft_consensus.cc:2272] T 95774511405b4ed8aadbab3d362c068e P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:48.119251 15057 tablet_replica.cc:333] T 6bdf4f0b87584bdab10ccc418ab54f02 P b39c386162de49aca92dbebee7f06ace: stopping tablet replica
I20260709 13:09:48.119913 15057 raft_consensus.cc:2243] T 6bdf4f0b87584bdab10ccc418ab54f02 P b39c386162de49aca92dbebee7f06ace [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:09:48.120724 15057 raft_consensus.cc:2272] T 6bdf4f0b87584bdab10ccc418ab54f02 P b39c386162de49aca92dbebee7f06ace [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:48.122756 15057 tablet_replica.cc:333] T e21ef2f479764142935dc2b1b7e87220 P b39c386162de49aca92dbebee7f06ace: stopping tablet replica
I20260709 13:09:48.123343 15057 raft_consensus.cc:2243] T e21ef2f479764142935dc2b1b7e87220 P b39c386162de49aca92dbebee7f06ace [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:48.123780 15057 raft_consensus.cc:2272] T e21ef2f479764142935dc2b1b7e87220 P b39c386162de49aca92dbebee7f06ace [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:48.125926 15057 tablet_replica.cc:333] T d17a6bbfc9d8478988b08964765c3b86 P b39c386162de49aca92dbebee7f06ace: stopping tablet replica
I20260709 13:09:48.126525 15057 raft_consensus.cc:2243] T d17a6bbfc9d8478988b08964765c3b86 P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:48.127040 15057 raft_consensus.cc:2272] T d17a6bbfc9d8478988b08964765c3b86 P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:48.129086 15057 tablet_replica.cc:333] T 518a35ead60847e98c0b76330b999d6f P b39c386162de49aca92dbebee7f06ace: stopping tablet replica
I20260709 13:09:48.129683 15057 raft_consensus.cc:2243] T 518a35ead60847e98c0b76330b999d6f P b39c386162de49aca92dbebee7f06ace [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:09:48.130509 15057 raft_consensus.cc:2272] T 518a35ead60847e98c0b76330b999d6f P b39c386162de49aca92dbebee7f06ace [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:48.132817 15057 tablet_replica.cc:333] T 687efb9bbbd04b0eb768bfa6543380c3 P b39c386162de49aca92dbebee7f06ace: stopping tablet replica
I20260709 13:09:48.133394 15057 raft_consensus.cc:2243] T 687efb9bbbd04b0eb768bfa6543380c3 P b39c386162de49aca92dbebee7f06ace [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:48.133834 15057 raft_consensus.cc:2272] T 687efb9bbbd04b0eb768bfa6543380c3 P b39c386162de49aca92dbebee7f06ace [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:48.136058 15057 tablet_replica.cc:333] T aac6068ee4554cce8f2d534a106ef417 P b39c386162de49aca92dbebee7f06ace: stopping tablet replica
I20260709 13:09:48.136775 15057 raft_consensus.cc:2243] T aac6068ee4554cce8f2d534a106ef417 P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:48.137382 15057 raft_consensus.cc:2272] T aac6068ee4554cce8f2d534a106ef417 P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:48.139696 15057 tablet_replica.cc:333] T 1541f6b04d914d10823ad78c03d9a847 P b39c386162de49aca92dbebee7f06ace: stopping tablet replica
I20260709 13:09:48.140302 15057 raft_consensus.cc:2243] T 1541f6b04d914d10823ad78c03d9a847 P b39c386162de49aca92dbebee7f06ace [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:48.140821 15057 raft_consensus.cc:2272] T 1541f6b04d914d10823ad78c03d9a847 P b39c386162de49aca92dbebee7f06ace [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:48.143265 15057 tablet_replica.cc:333] T 03bfe46bf2b74722b6e8eb3015e38f43 P b39c386162de49aca92dbebee7f06ace: stopping tablet replica
I20260709 13:09:48.143857 15057 raft_consensus.cc:2243] T 03bfe46bf2b74722b6e8eb3015e38f43 P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:48.144358 15057 raft_consensus.cc:2272] T 03bfe46bf2b74722b6e8eb3015e38f43 P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:48.146525 15057 tablet_replica.cc:333] T 5a8830d169ce4e46807d04168c3bb086 P b39c386162de49aca92dbebee7f06ace: stopping tablet replica
I20260709 13:09:48.147183 15057 raft_consensus.cc:2243] T 5a8830d169ce4e46807d04168c3bb086 P b39c386162de49aca92dbebee7f06ace [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:48.147672 15057 raft_consensus.cc:2272] T 5a8830d169ce4e46807d04168c3bb086 P b39c386162de49aca92dbebee7f06ace [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:48.149849 15057 tablet_replica.cc:333] T 46f373ffd46f4625bac910b5ccf4b767 P b39c386162de49aca92dbebee7f06ace: stopping tablet replica
I20260709 13:09:48.150446 15057 raft_consensus.cc:2243] T 46f373ffd46f4625bac910b5ccf4b767 P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:48.150955 15057 raft_consensus.cc:2272] T 46f373ffd46f4625bac910b5ccf4b767 P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:48.153374 15057 tablet_replica.cc:333] T 1cefd1de9d9a4839b200c2472b3aeefc P b39c386162de49aca92dbebee7f06ace: stopping tablet replica
I20260709 13:09:48.154072 15057 raft_consensus.cc:2243] T 1cefd1de9d9a4839b200c2472b3aeefc P b39c386162de49aca92dbebee7f06ace [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:48.155136 15057 raft_consensus.cc:2272] T 1cefd1de9d9a4839b200c2472b3aeefc P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:48.157786 15057 tablet_replica.cc:333] T c5873f7465894eddab6fa84daecdcc84 P b39c386162de49aca92dbebee7f06ace: stopping tablet replica
I20260709 13:09:48.158371 15057 raft_consensus.cc:2243] T c5873f7465894eddab6fa84daecdcc84 P b39c386162de49aca92dbebee7f06ace [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:09:48.159365 15057 raft_consensus.cc:2272] T c5873f7465894eddab6fa84daecdcc84 P b39c386162de49aca92dbebee7f06ace [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:48.161657 15057 tablet_replica.cc:333] T 9acec0d1a6e74a4bb39a0d867598acc5 P b39c386162de49aca92dbebee7f06ace: stopping tablet replica
I20260709 13:09:48.162261 15057 raft_consensus.cc:2243] T 9acec0d1a6e74a4bb39a0d867598acc5 P b39c386162de49aca92dbebee7f06ace [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:48.163386 15057 raft_consensus.cc:2272] T 9acec0d1a6e74a4bb39a0d867598acc5 P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:48.165774 15057 tablet_replica.cc:333] T a0ff7e0491fb406d9e1f13941504372f P b39c386162de49aca92dbebee7f06ace: stopping tablet replica
I20260709 13:09:48.166421 15057 raft_consensus.cc:2243] T a0ff7e0491fb406d9e1f13941504372f P b39c386162de49aca92dbebee7f06ace [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:48.167332 15057 raft_consensus.cc:2272] T a0ff7e0491fb406d9e1f13941504372f P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:48.169374 15057 tablet_replica.cc:333] T d2ddfc9daac54dc28d63b46ab1777bf3 P b39c386162de49aca92dbebee7f06ace: stopping tablet replica
I20260709 13:09:48.169965 15057 raft_consensus.cc:2243] T d2ddfc9daac54dc28d63b46ab1777bf3 P b39c386162de49aca92dbebee7f06ace [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:48.170433 15057 raft_consensus.cc:2272] T d2ddfc9daac54dc28d63b46ab1777bf3 P b39c386162de49aca92dbebee7f06ace [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:48.172572 15057 tablet_replica.cc:333] T 45b65ebcb0114044a04e5689db4a466f P b39c386162de49aca92dbebee7f06ace: stopping tablet replica
I20260709 13:09:48.173133 15057 raft_consensus.cc:2243] T 45b65ebcb0114044a04e5689db4a466f P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:48.173576 15057 raft_consensus.cc:2272] T 45b65ebcb0114044a04e5689db4a466f P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:48.175633 15057 tablet_replica.cc:333] T b1d1d7dd508b43489431371c4ece4fa4 P b39c386162de49aca92dbebee7f06ace: stopping tablet replica
I20260709 13:09:48.176221 15057 raft_consensus.cc:2243] T b1d1d7dd508b43489431371c4ece4fa4 P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:48.176661 15057 raft_consensus.cc:2272] T b1d1d7dd508b43489431371c4ece4fa4 P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:48.178772 15057 tablet_replica.cc:333] T e335cd6afc4349cfaafa2970bccb40ff P b39c386162de49aca92dbebee7f06ace: stopping tablet replica
I20260709 13:09:48.179312 15057 raft_consensus.cc:2243] T e335cd6afc4349cfaafa2970bccb40ff P b39c386162de49aca92dbebee7f06ace [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:48.180095 15057 raft_consensus.cc:2272] T e335cd6afc4349cfaafa2970bccb40ff P b39c386162de49aca92dbebee7f06ace [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:48.182228 15057 tablet_replica.cc:333] T f735173e22b242178edcdf4821b6f92b P b39c386162de49aca92dbebee7f06ace: stopping tablet replica
I20260709 13:09:48.182839 15057 raft_consensus.cc:2243] T f735173e22b242178edcdf4821b6f92b P b39c386162de49aca92dbebee7f06ace [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:48.183347 15057 raft_consensus.cc:2272] T f735173e22b242178edcdf4821b6f92b P b39c386162de49aca92dbebee7f06ace [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:48.185549 15057 tablet_replica.cc:333] T c7b586130d5842f293b0df4b02792ec6 P b39c386162de49aca92dbebee7f06ace: stopping tablet replica
I20260709 13:09:48.186123 15057 raft_consensus.cc:2243] T c7b586130d5842f293b0df4b02792ec6 P b39c386162de49aca92dbebee7f06ace [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:48.187021 15057 raft_consensus.cc:2272] T c7b586130d5842f293b0df4b02792ec6 P b39c386162de49aca92dbebee7f06ace [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:48.189064 15057 tablet_replica.cc:333] T 42868db4862647c28215f3d7cb9adf02 P b39c386162de49aca92dbebee7f06ace: stopping tablet replica
I20260709 13:09:48.189602 15057 raft_consensus.cc:2243] T 42868db4862647c28215f3d7cb9adf02 P b39c386162de49aca92dbebee7f06ace [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:48.190070 15057 raft_consensus.cc:2272] T 42868db4862647c28215f3d7cb9adf02 P b39c386162de49aca92dbebee7f06ace [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:48.192481 15057 tablet_replica.cc:333] T e845188d32d2466a92eacdb66da16dba P b39c386162de49aca92dbebee7f06ace: stopping tablet replica
I20260709 13:09:48.193046 15057 raft_consensus.cc:2243] T e845188d32d2466a92eacdb66da16dba P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:09:48.193660 25330 raft_consensus.cc:670] T e845188d32d2466a92eacdb66da16dba P b39c386162de49aca92dbebee7f06ace: failed to trigger leader election: Illegal state: RaftConsensus is not running: State = Stopping [suppressed 1 similar messages]
I20260709 13:09:48.193845 15057 raft_consensus.cc:2272] T e845188d32d2466a92eacdb66da16dba P b39c386162de49aca92dbebee7f06ace [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:48.267148 15057 tablet_server.cc:196] TabletServer@127.14.180.68:0 shutdown complete.
I20260709 13:09:48.332588 15057 master.cc:562] Master@127.14.180.126:35949 shutting down...
I20260709 13:09:48.367110 15057 raft_consensus.cc:2243] T 00000000000000000000000000000000 P b4b43535cc894944999253af4c68e388 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:48.367755 15057 raft_consensus.cc:2272] T 00000000000000000000000000000000 P b4b43535cc894944999253af4c68e388 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:48.368134 15057 tablet_replica.cc:333] T 00000000000000000000000000000000 P b4b43535cc894944999253af4c68e388: stopping tablet replica
I20260709 13:09:48.416715 15057 master.cc:584] Master@127.14.180.126:35949 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (39723 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 13:09:48.520362 15057 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.14.180.126:37755
I20260709 13:09:48.521706 15057 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:48.528595 25345 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:48.528662 25346 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:48.529387 25348 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:48.530120 15057 server_base.cc:1061] running on GCE node
I20260709 13:09:48.531325 15057 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:48.531523 15057 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:48.531635 15057 hybrid_clock.cc:648] HybridClock initialized: now 1783602588531624 us; error 0 us; skew 500 ppm
I20260709 13:09:48.532136 15057 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:48.534896 15057 webserver.cc:533] Webserver started at http://127.14.180.126:38627/ using document root <none> and password file <none>
I20260709 13:09:48.535413 15057 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:48.535583 15057 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:48.535799 15057 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:48.536960 15057 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602283040513-15057-0/minicluster-data/master-0-root/instance:
uuid: "b625c2133ca44b7593de952682e2cbdc"
format_stamp: "Formatted at 2026-07-09 13:09:48 on dist-test-slave-r9m8"
I20260709 13:09:48.542680 15057 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.001s
I20260709 13:09:48.546518 25353 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:48.547566 15057 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.003s
I20260709 13:09:48.547858 15057 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602283040513-15057-0/minicluster-data/master-0-root
uuid: "b625c2133ca44b7593de952682e2cbdc"
format_stamp: "Formatted at 2026-07-09 13:09:48 on dist-test-slave-r9m8"
I20260709 13:09:48.548126 15057 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602283040513-15057-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602283040513-15057-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602283040513-15057-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:48.576846 15057 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:48.578086 15057 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:48.619251 15057 rpc_server.cc:307] RPC server started. Bound to: 127.14.180.126:37755
I20260709 13:09:48.619352 25404 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.180.126:37755 every 8 connection(s)
I20260709 13:09:48.623555 25405 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:48.635767 25405 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b625c2133ca44b7593de952682e2cbdc: Bootstrap starting.
I20260709 13:09:48.641705 25405 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b625c2133ca44b7593de952682e2cbdc: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:48.646680 25405 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b625c2133ca44b7593de952682e2cbdc: No bootstrap required, opened a new log
I20260709 13:09:48.649135 25405 raft_consensus.cc:359] T 00000000000000000000000000000000 P b625c2133ca44b7593de952682e2cbdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b625c2133ca44b7593de952682e2cbdc" member_type: VOTER }
I20260709 13:09:48.649648 25405 raft_consensus.cc:385] T 00000000000000000000000000000000 P b625c2133ca44b7593de952682e2cbdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:48.649863 25405 raft_consensus.cc:740] T 00000000000000000000000000000000 P b625c2133ca44b7593de952682e2cbdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b625c2133ca44b7593de952682e2cbdc, State: Initialized, Role: FOLLOWER
I20260709 13:09:48.650648 25405 consensus_queue.cc:260] T 00000000000000000000000000000000 P b625c2133ca44b7593de952682e2cbdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b625c2133ca44b7593de952682e2cbdc" member_type: VOTER }
I20260709 13:09:48.651116 25405 raft_consensus.cc:399] T 00000000000000000000000000000000 P b625c2133ca44b7593de952682e2cbdc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:09:48.651341 25405 raft_consensus.cc:493] T 00000000000000000000000000000000 P b625c2133ca44b7593de952682e2cbdc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:09:48.651556 25405 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b625c2133ca44b7593de952682e2cbdc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:48.656504 25405 raft_consensus.cc:515] T 00000000000000000000000000000000 P b625c2133ca44b7593de952682e2cbdc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b625c2133ca44b7593de952682e2cbdc" member_type: VOTER }
I20260709 13:09:48.657027 25405 leader_election.cc:304] T 00000000000000000000000000000000 P b625c2133ca44b7593de952682e2cbdc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b625c2133ca44b7593de952682e2cbdc; no voters: 
I20260709 13:09:48.658289 25405 leader_election.cc:290] T 00000000000000000000000000000000 P b625c2133ca44b7593de952682e2cbdc [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:09:48.658900 25408 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b625c2133ca44b7593de952682e2cbdc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:48.660543 25408 raft_consensus.cc:697] T 00000000000000000000000000000000 P b625c2133ca44b7593de952682e2cbdc [term 1 LEADER]: Becoming Leader. State: Replica: b625c2133ca44b7593de952682e2cbdc, State: Running, Role: LEADER
I20260709 13:09:48.661413 25408 consensus_queue.cc:237] T 00000000000000000000000000000000 P b625c2133ca44b7593de952682e2cbdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b625c2133ca44b7593de952682e2cbdc" member_type: VOTER }
I20260709 13:09:48.661638 25405 sys_catalog.cc:565] T 00000000000000000000000000000000 P b625c2133ca44b7593de952682e2cbdc [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:09:48.668660 25409 sys_catalog.cc:455] T 00000000000000000000000000000000 P b625c2133ca44b7593de952682e2cbdc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b625c2133ca44b7593de952682e2cbdc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b625c2133ca44b7593de952682e2cbdc" member_type: VOTER } }
I20260709 13:09:48.668756 25410 sys_catalog.cc:455] T 00000000000000000000000000000000 P b625c2133ca44b7593de952682e2cbdc [sys.catalog]: SysCatalogTable state changed. Reason: New leader b625c2133ca44b7593de952682e2cbdc. Latest consensus state: current_term: 1 leader_uuid: "b625c2133ca44b7593de952682e2cbdc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b625c2133ca44b7593de952682e2cbdc" member_type: VOTER } }
I20260709 13:09:48.669730 25409 sys_catalog.cc:458] T 00000000000000000000000000000000 P b625c2133ca44b7593de952682e2cbdc [sys.catalog]: This master's current role is: LEADER
I20260709 13:09:48.669749 25410 sys_catalog.cc:458] T 00000000000000000000000000000000 P b625c2133ca44b7593de952682e2cbdc [sys.catalog]: This master's current role is: LEADER
I20260709 13:09:48.681959 25417 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:09:48.682790 15057 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:09:48.687446 25417 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:09:48.696722 25417 catalog_manager.cc:1383] Generated new cluster ID: b5d3639446f04cc5a118c3fa6950a048
I20260709 13:09:48.697079 25417 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:09:48.716190 25417 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:09:48.717674 25417 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:09:48.734813 25417 catalog_manager.cc:6070] T 00000000000000000000000000000000 P b625c2133ca44b7593de952682e2cbdc: Generated new TSK 0
I20260709 13:09:48.735543 25417 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:09:48.749605 15057 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:48.756920 25426 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:48.759460 25427 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:48.760993 25429 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:48.761977 15057 server_base.cc:1061] running on GCE node
I20260709 13:09:48.763185 15057 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:48.763455 15057 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:48.763656 15057 hybrid_clock.cc:648] HybridClock initialized: now 1783602588763639 us; error 0 us; skew 500 ppm
I20260709 13:09:48.764266 15057 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:48.767030 15057 webserver.cc:533] Webserver started at http://127.14.180.65:46799/ using document root <none> and password file <none>
I20260709 13:09:48.767575 15057 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:48.767777 15057 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:48.768072 15057 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:48.769277 15057 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602283040513-15057-0/minicluster-data/ts-0-root/instance:
uuid: "0482fd26e89d4bb89ee847d0108ab167"
format_stamp: "Formatted at 2026-07-09 13:09:48 on dist-test-slave-r9m8"
I20260709 13:09:48.774458 15057 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.000s	sys 0.007s
I20260709 13:09:48.779199 25434 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:48.780167 15057 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:09:48.780516 15057 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602283040513-15057-0/minicluster-data/ts-0-root
uuid: "0482fd26e89d4bb89ee847d0108ab167"
format_stamp: "Formatted at 2026-07-09 13:09:48 on dist-test-slave-r9m8"
I20260709 13:09:48.780858 15057 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602283040513-15057-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602283040513-15057-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602283040513-15057-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:48.799192 15057 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:48.800529 15057 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:48.802052 15057 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:48.804610 15057 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:48.804869 15057 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:48.805146 15057 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:48.805358 15057 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:48.853914 15057 rpc_server.cc:307] RPC server started. Bound to: 127.14.180.65:45331
I20260709 13:09:48.854003 25496 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.180.65:45331 every 8 connection(s)
I20260709 13:09:48.859448 15057 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:48.869158 25501 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:48.869621 25502 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:48.873111 15057 server_base.cc:1061] running on GCE node
W20260709 13:09:48.873492 25505 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:48.874944 15057 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:48.875160 15057 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:48.875381 15057 hybrid_clock.cc:648] HybridClock initialized: now 1783602588875364 us; error 0 us; skew 500 ppm
I20260709 13:09:48.875983 15057 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:48.879343 15057 webserver.cc:533] Webserver started at http://127.14.180.66:44101/ using document root <none> and password file <none>
I20260709 13:09:48.880226 15057 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:48.880507 15057 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:48.880842 15057 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:48.882582 15057 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602283040513-15057-0/minicluster-data/ts-1-root/instance:
uuid: "a8545e52c3ee4ac691870228228b4fa5"
format_stamp: "Formatted at 2026-07-09 13:09:48 on dist-test-slave-r9m8"
I20260709 13:09:48.883947 25497 heartbeater.cc:344] Connected to a master server at 127.14.180.126:37755
I20260709 13:09:48.884434 25497 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:48.885281 25497 heartbeater.cc:507] Master 127.14.180.126:37755 requested a full tablet report, sending...
I20260709 13:09:48.887907 25370 ts_manager.cc:194] Registered new tserver with Master: 0482fd26e89d4bb89ee847d0108ab167 (127.14.180.65:45331)
I20260709 13:09:48.888695 15057 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:09:48.890213 25370 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34862
I20260709 13:09:48.893777 25509 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:48.895475 15057 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.001s
I20260709 13:09:48.895856 15057 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602283040513-15057-0/minicluster-data/ts-1-root
uuid: "a8545e52c3ee4ac691870228228b4fa5"
format_stamp: "Formatted at 2026-07-09 13:09:48 on dist-test-slave-r9m8"
I20260709 13:09:48.896127 15057 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602283040513-15057-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602283040513-15057-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602283040513-15057-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:48.916860 15057 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:48.918108 15057 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:48.919778 15057 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:48.922305 15057 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:48.922609 15057 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:09:48.922915 15057 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:48.923077 15057 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:48.968750 15057 rpc_server.cc:307] RPC server started. Bound to: 127.14.180.66:35803
I20260709 13:09:48.968863 25571 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.180.66:35803 every 8 connection(s)
I20260709 13:09:48.973977 15057 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:48.981185 25575 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:48.984997 25576 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:48.985891 25578 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:48.988139 25572 heartbeater.cc:344] Connected to a master server at 127.14.180.126:37755
I20260709 13:09:48.988605 25572 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:48.989279 15057 server_base.cc:1061] running on GCE node
I20260709 13:09:48.989461 25572 heartbeater.cc:507] Master 127.14.180.126:37755 requested a full tablet report, sending...
I20260709 13:09:48.990442 15057 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:48.990792 15057 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:48.991017 15057 hybrid_clock.cc:648] HybridClock initialized: now 1783602588991000 us; error 0 us; skew 500 ppm
I20260709 13:09:48.991767 15057 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:48.992030 25370 ts_manager.cc:194] Registered new tserver with Master: a8545e52c3ee4ac691870228228b4fa5 (127.14.180.66:35803)
I20260709 13:09:48.993736 25370 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34872
I20260709 13:09:48.994817 15057 webserver.cc:533] Webserver started at http://127.14.180.67:36515/ using document root <none> and password file <none>
I20260709 13:09:48.995515 15057 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:48.995716 15057 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:48.996022 15057 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:48.997272 15057 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602283040513-15057-0/minicluster-data/ts-2-root/instance:
uuid: "6e4379ca45a84c5d807695a3fef07116"
format_stamp: "Formatted at 2026-07-09 13:09:48 on dist-test-slave-r9m8"
I20260709 13:09:49.002108 15057 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.004s
I20260709 13:09:49.006613 25583 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:49.007618 15057 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:09:49.008024 15057 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602283040513-15057-0/minicluster-data/ts-2-root
uuid: "6e4379ca45a84c5d807695a3fef07116"
format_stamp: "Formatted at 2026-07-09 13:09:48 on dist-test-slave-r9m8"
I20260709 13:09:49.008544 15057 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602283040513-15057-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602283040513-15057-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602283040513-15057-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:49.020367 15057 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:49.021665 15057 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:49.023350 15057 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:49.025688 15057 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:49.025951 15057 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:49.026206 15057 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:49.026398 15057 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:49.073036 15057 rpc_server.cc:307] RPC server started. Bound to: 127.14.180.67:39657
I20260709 13:09:49.073148 25645 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.180.67:39657 every 8 connection(s)
I20260709 13:09:49.089313 25646 heartbeater.cc:344] Connected to a master server at 127.14.180.126:37755
I20260709 13:09:49.089784 25646 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:49.090592 25646 heartbeater.cc:507] Master 127.14.180.126:37755 requested a full tablet report, sending...
I20260709 13:09:49.093096 25370 ts_manager.cc:194] Registered new tserver with Master: 6e4379ca45a84c5d807695a3fef07116 (127.14.180.67:39657)
I20260709 13:09:49.093683 15057 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.01645607s
I20260709 13:09:49.094864 25370 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34880
I20260709 13:09:49.124626 25370 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34884:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:09:49.129002 25370 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:09:49.211562 25537 tablet_service.cc:1511] Processing CreateTablet for tablet b6d563892443429682cba0bba950c7d7 (DEFAULT_TABLE table=test-workload [id=204a543d619048de89c53d57ce4d64de]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:09:49.213543 25537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6d563892443429682cba0bba950c7d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:49.223491 25536 tablet_service.cc:1511] Processing CreateTablet for tablet c301576f903c43cc87a0c95425f042fb (DEFAULT_TABLE table=test-workload [id=204a543d619048de89c53d57ce4d64de]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:09:49.225208 25536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c301576f903c43cc87a0c95425f042fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:49.227207 25462 tablet_service.cc:1511] Processing CreateTablet for tablet b6d563892443429682cba0bba950c7d7 (DEFAULT_TABLE table=test-workload [id=204a543d619048de89c53d57ce4d64de]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:09:49.228894 25462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6d563892443429682cba0bba950c7d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:49.233366 25461 tablet_service.cc:1511] Processing CreateTablet for tablet c301576f903c43cc87a0c95425f042fb (DEFAULT_TABLE table=test-workload [id=204a543d619048de89c53d57ce4d64de]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:09:49.235069 25461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c301576f903c43cc87a0c95425f042fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:49.236145 25610 tablet_service.cc:1511] Processing CreateTablet for tablet c301576f903c43cc87a0c95425f042fb (DEFAULT_TABLE table=test-workload [id=204a543d619048de89c53d57ce4d64de]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:09:49.237753 25610 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c301576f903c43cc87a0c95425f042fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:49.239846 25611 tablet_service.cc:1511] Processing CreateTablet for tablet b6d563892443429682cba0bba950c7d7 (DEFAULT_TABLE table=test-workload [id=204a543d619048de89c53d57ce4d64de]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:09:49.241930 25611 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6d563892443429682cba0bba950c7d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:49.244419 25460 tablet_service.cc:1511] Processing CreateTablet for tablet d0cd92d7306d4ed695dc084aabbfb995 (DEFAULT_TABLE table=test-workload [id=204a543d619048de89c53d57ce4d64de]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:09:49.246506 25460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0cd92d7306d4ed695dc084aabbfb995. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:49.261787 25661 tablet_bootstrap.cc:492] T b6d563892443429682cba0bba950c7d7 P a8545e52c3ee4ac691870228228b4fa5: Bootstrap starting.
I20260709 13:09:49.271374 25661 tablet_bootstrap.cc:654] T b6d563892443429682cba0bba950c7d7 P a8545e52c3ee4ac691870228228b4fa5: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:49.275460 25662 tablet_bootstrap.cc:492] T c301576f903c43cc87a0c95425f042fb P 0482fd26e89d4bb89ee847d0108ab167: Bootstrap starting.
I20260709 13:09:49.278506 25537 tablet_service.cc:1511] Processing CreateTablet for tablet d0cd92d7306d4ed695dc084aabbfb995 (DEFAULT_TABLE table=test-workload [id=204a543d619048de89c53d57ce4d64de]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:09:49.280334 25537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0cd92d7306d4ed695dc084aabbfb995. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:49.279978 25609 tablet_service.cc:1511] Processing CreateTablet for tablet d0cd92d7306d4ed695dc084aabbfb995 (DEFAULT_TABLE table=test-workload [id=204a543d619048de89c53d57ce4d64de]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:09:49.281641 25609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0cd92d7306d4ed695dc084aabbfb995. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:49.300608 25664 tablet_bootstrap.cc:492] T b6d563892443429682cba0bba950c7d7 P 6e4379ca45a84c5d807695a3fef07116: Bootstrap starting.
I20260709 13:09:49.296166 25460 tablet_service.cc:1511] Processing CreateTablet for tablet 442972580e8d4c5f9010dd64ba54899b (DEFAULT_TABLE table=test-workload [id=204a543d619048de89c53d57ce4d64de]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:09:49.305138 25460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 442972580e8d4c5f9010dd64ba54899b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:49.304977 25536 tablet_service.cc:1511] Processing CreateTablet for tablet 442972580e8d4c5f9010dd64ba54899b (DEFAULT_TABLE table=test-workload [id=204a543d619048de89c53d57ce4d64de]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:09:49.310992 25536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 442972580e8d4c5f9010dd64ba54899b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:49.313783 25661 tablet_bootstrap.cc:492] T b6d563892443429682cba0bba950c7d7 P a8545e52c3ee4ac691870228228b4fa5: No bootstrap required, opened a new log
I20260709 13:09:49.314445 25661 ts_tablet_manager.cc:1403] T b6d563892443429682cba0bba950c7d7 P a8545e52c3ee4ac691870228228b4fa5: Time spent bootstrapping tablet: real 0.053s	user 0.027s	sys 0.000s
I20260709 13:09:49.309437 25664 tablet_bootstrap.cc:654] T b6d563892443429682cba0bba950c7d7 P 6e4379ca45a84c5d807695a3fef07116: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:49.304841 25662 tablet_bootstrap.cc:654] T c301576f903c43cc87a0c95425f042fb P 0482fd26e89d4bb89ee847d0108ab167: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:49.326383 25661 raft_consensus.cc:359] T b6d563892443429682cba0bba950c7d7 P a8545e52c3ee4ac691870228228b4fa5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } } peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } }
I20260709 13:09:49.327330 25661 raft_consensus.cc:385] T b6d563892443429682cba0bba950c7d7 P a8545e52c3ee4ac691870228228b4fa5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:49.327687 25661 raft_consensus.cc:740] T b6d563892443429682cba0bba950c7d7 P a8545e52c3ee4ac691870228228b4fa5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8545e52c3ee4ac691870228228b4fa5, State: Initialized, Role: FOLLOWER
I20260709 13:09:49.328562 25661 consensus_queue.cc:260] T b6d563892443429682cba0bba950c7d7 P a8545e52c3ee4ac691870228228b4fa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } } peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } }
I20260709 13:09:49.329921 25610 tablet_service.cc:1511] Processing CreateTablet for tablet 442972580e8d4c5f9010dd64ba54899b (DEFAULT_TABLE table=test-workload [id=204a543d619048de89c53d57ce4d64de]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:09:49.331763 25610 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 442972580e8d4c5f9010dd64ba54899b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:49.336215 25460 tablet_service.cc:1511] Processing CreateTablet for tablet ffbf01eb3ff0482fb5f922a5b0a77a83 (DEFAULT_TABLE table=test-workload [id=204a543d619048de89c53d57ce4d64de]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:09:49.340415 25460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffbf01eb3ff0482fb5f922a5b0a77a83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:49.343142 25661 ts_tablet_manager.cc:1434] T b6d563892443429682cba0bba950c7d7 P a8545e52c3ee4ac691870228228b4fa5: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.004s
I20260709 13:09:49.345299 25664 tablet_bootstrap.cc:492] T b6d563892443429682cba0bba950c7d7 P 6e4379ca45a84c5d807695a3fef07116: No bootstrap required, opened a new log
I20260709 13:09:49.346518 25664 ts_tablet_manager.cc:1403] T b6d563892443429682cba0bba950c7d7 P 6e4379ca45a84c5d807695a3fef07116: Time spent bootstrapping tablet: real 0.046s	user 0.004s	sys 0.015s
I20260709 13:09:49.341849 25537 tablet_service.cc:1511] Processing CreateTablet for tablet ffbf01eb3ff0482fb5f922a5b0a77a83 (DEFAULT_TABLE table=test-workload [id=204a543d619048de89c53d57ce4d64de]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:09:49.347301 25609 tablet_service.cc:1511] Processing CreateTablet for tablet ffbf01eb3ff0482fb5f922a5b0a77a83 (DEFAULT_TABLE table=test-workload [id=204a543d619048de89c53d57ce4d64de]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:09:49.348762 25609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffbf01eb3ff0482fb5f922a5b0a77a83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:49.351902 25664 raft_consensus.cc:359] T b6d563892443429682cba0bba950c7d7 P 6e4379ca45a84c5d807695a3fef07116 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } } peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } }
I20260709 13:09:49.353271 25664 raft_consensus.cc:385] T b6d563892443429682cba0bba950c7d7 P 6e4379ca45a84c5d807695a3fef07116 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:49.353739 25664 raft_consensus.cc:740] T b6d563892443429682cba0bba950c7d7 P 6e4379ca45a84c5d807695a3fef07116 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e4379ca45a84c5d807695a3fef07116, State: Initialized, Role: FOLLOWER
I20260709 13:09:49.357229 25462 tablet_service.cc:1511] Processing CreateTablet for tablet 11ad0defd0924408a16ee3f7a8a60106 (DEFAULT_TABLE table=test-workload [id=204a543d619048de89c53d57ce4d64de]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:09:49.358808 25572 heartbeater.cc:499] Master 127.14.180.126:37755 was elected leader, sending a full tablet report...
I20260709 13:09:49.359895 25535 tablet_service.cc:1511] Processing CreateTablet for tablet 11ad0defd0924408a16ee3f7a8a60106 (DEFAULT_TABLE table=test-workload [id=204a543d619048de89c53d57ce4d64de]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:09:49.360262 25664 consensus_queue.cc:260] T b6d563892443429682cba0bba950c7d7 P 6e4379ca45a84c5d807695a3fef07116 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } } peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } }
I20260709 13:09:49.361464 25535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11ad0defd0924408a16ee3f7a8a60106. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:49.362368 25661 tablet_bootstrap.cc:492] T c301576f903c43cc87a0c95425f042fb P a8545e52c3ee4ac691870228228b4fa5: Bootstrap starting.
I20260709 13:09:49.362984 25611 tablet_service.cc:1511] Processing CreateTablet for tablet 11ad0defd0924408a16ee3f7a8a60106 (DEFAULT_TABLE table=test-workload [id=204a543d619048de89c53d57ce4d64de]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:09:49.364584 25611 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11ad0defd0924408a16ee3f7a8a60106. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:49.371062 25461 tablet_service.cc:1511] Processing CreateTablet for tablet 64e29ee66f22432c82e5772ee79dd918 (DEFAULT_TABLE table=test-workload [id=204a543d619048de89c53d57ce4d64de]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:09:49.372284 25537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ffbf01eb3ff0482fb5f922a5b0a77a83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:49.380657 25461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64e29ee66f22432c82e5772ee79dd918. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:49.382685 25661 tablet_bootstrap.cc:654] T c301576f903c43cc87a0c95425f042fb P a8545e52c3ee4ac691870228228b4fa5: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:49.389003 25662 tablet_bootstrap.cc:492] T c301576f903c43cc87a0c95425f042fb P 0482fd26e89d4bb89ee847d0108ab167: No bootstrap required, opened a new log
I20260709 13:09:49.389667 25662 ts_tablet_manager.cc:1403] T c301576f903c43cc87a0c95425f042fb P 0482fd26e89d4bb89ee847d0108ab167: Time spent bootstrapping tablet: real 0.115s	user 0.026s	sys 0.027s
I20260709 13:09:49.393442 25462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11ad0defd0924408a16ee3f7a8a60106. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:49.395805 25662 raft_consensus.cc:359] T c301576f903c43cc87a0c95425f042fb P 0482fd26e89d4bb89ee847d0108ab167 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:49.396752 25662 raft_consensus.cc:385] T c301576f903c43cc87a0c95425f042fb P 0482fd26e89d4bb89ee847d0108ab167 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:49.397130 25662 raft_consensus.cc:740] T c301576f903c43cc87a0c95425f042fb P 0482fd26e89d4bb89ee847d0108ab167 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0482fd26e89d4bb89ee847d0108ab167, State: Initialized, Role: FOLLOWER
I20260709 13:09:49.400676 25662 consensus_queue.cc:260] T c301576f903c43cc87a0c95425f042fb P 0482fd26e89d4bb89ee847d0108ab167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:49.404807 25536 tablet_service.cc:1511] Processing CreateTablet for tablet 64e29ee66f22432c82e5772ee79dd918 (DEFAULT_TABLE table=test-workload [id=204a543d619048de89c53d57ce4d64de]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:09:49.406704 25536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64e29ee66f22432c82e5772ee79dd918. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:49.411749 25646 heartbeater.cc:499] Master 127.14.180.126:37755 was elected leader, sending a full tablet report...
I20260709 13:09:49.413759 25664 ts_tablet_manager.cc:1434] T b6d563892443429682cba0bba950c7d7 P 6e4379ca45a84c5d807695a3fef07116: Time spent starting tablet: real 0.067s	user 0.004s	sys 0.010s
I20260709 13:09:49.415007 25664 tablet_bootstrap.cc:492] T c301576f903c43cc87a0c95425f042fb P 6e4379ca45a84c5d807695a3fef07116: Bootstrap starting.
I20260709 13:09:49.416923 25459 tablet_service.cc:1511] Processing CreateTablet for tablet 1119e418e9964dd1be1dcf47e3fe9734 (DEFAULT_TABLE table=test-workload [id=204a543d619048de89c53d57ce4d64de]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:09:49.419379 25459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1119e418e9964dd1be1dcf47e3fe9734. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:49.423903 25610 tablet_service.cc:1511] Processing CreateTablet for tablet 64e29ee66f22432c82e5772ee79dd918 (DEFAULT_TABLE table=test-workload [id=204a543d619048de89c53d57ce4d64de]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:09:49.431648 25610 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64e29ee66f22432c82e5772ee79dd918. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:49.433113 25664 tablet_bootstrap.cc:654] T c301576f903c43cc87a0c95425f042fb P 6e4379ca45a84c5d807695a3fef07116: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:49.433439 25661 tablet_bootstrap.cc:492] T c301576f903c43cc87a0c95425f042fb P a8545e52c3ee4ac691870228228b4fa5: No bootstrap required, opened a new log
I20260709 13:09:49.434165 25661 ts_tablet_manager.cc:1403] T c301576f903c43cc87a0c95425f042fb P a8545e52c3ee4ac691870228228b4fa5: Time spent bootstrapping tablet: real 0.072s	user 0.009s	sys 0.006s
I20260709 13:09:49.445057 25535 tablet_service.cc:1511] Processing CreateTablet for tablet 1119e418e9964dd1be1dcf47e3fe9734 (DEFAULT_TABLE table=test-workload [id=204a543d619048de89c53d57ce4d64de]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:09:49.446862 25535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1119e418e9964dd1be1dcf47e3fe9734. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:49.437952 25661 raft_consensus.cc:359] T c301576f903c43cc87a0c95425f042fb P a8545e52c3ee4ac691870228228b4fa5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:49.450657 25661 raft_consensus.cc:385] T c301576f903c43cc87a0c95425f042fb P a8545e52c3ee4ac691870228228b4fa5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:49.451041 25661 raft_consensus.cc:740] T c301576f903c43cc87a0c95425f042fb P a8545e52c3ee4ac691870228228b4fa5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8545e52c3ee4ac691870228228b4fa5, State: Initialized, Role: FOLLOWER
I20260709 13:09:49.451923 25661 consensus_queue.cc:260] T c301576f903c43cc87a0c95425f042fb P a8545e52c3ee4ac691870228228b4fa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:49.457676 25610 tablet_service.cc:1511] Processing CreateTablet for tablet 1119e418e9964dd1be1dcf47e3fe9734 (DEFAULT_TABLE table=test-workload [id=204a543d619048de89c53d57ce4d64de]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:09:49.459205 25610 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1119e418e9964dd1be1dcf47e3fe9734. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:49.458812 25462 tablet_service.cc:1511] Processing CreateTablet for tablet a06a18d1f8c346f2b758f593d709eb53 (DEFAULT_TABLE table=test-workload [id=204a543d619048de89c53d57ce4d64de]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:09:49.460287 25462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a06a18d1f8c346f2b758f593d709eb53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:49.461421 25661 ts_tablet_manager.cc:1434] T c301576f903c43cc87a0c95425f042fb P a8545e52c3ee4ac691870228228b4fa5: Time spent starting tablet: real 0.027s	user 0.011s	sys 0.000s
W20260709 13:09:49.473150 25573 tablet.cc:2406] T b6d563892443429682cba0bba950c7d7 P a8545e52c3ee4ac691870228228b4fa5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:09:49.475298 25664 tablet_bootstrap.cc:492] T c301576f903c43cc87a0c95425f042fb P 6e4379ca45a84c5d807695a3fef07116: No bootstrap required, opened a new log
I20260709 13:09:49.476019 25664 ts_tablet_manager.cc:1403] T c301576f903c43cc87a0c95425f042fb P 6e4379ca45a84c5d807695a3fef07116: Time spent bootstrapping tablet: real 0.061s	user 0.014s	sys 0.000s
I20260709 13:09:49.478010 25534 tablet_service.cc:1511] Processing CreateTablet for tablet a06a18d1f8c346f2b758f593d709eb53 (DEFAULT_TABLE table=test-workload [id=204a543d619048de89c53d57ce4d64de]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:09:49.479624 25534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a06a18d1f8c346f2b758f593d709eb53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:49.483737 25664 raft_consensus.cc:359] T c301576f903c43cc87a0c95425f042fb P 6e4379ca45a84c5d807695a3fef07116 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:49.485020 25664 raft_consensus.cc:385] T c301576f903c43cc87a0c95425f042fb P 6e4379ca45a84c5d807695a3fef07116 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:49.485495 25664 raft_consensus.cc:740] T c301576f903c43cc87a0c95425f042fb P 6e4379ca45a84c5d807695a3fef07116 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e4379ca45a84c5d807695a3fef07116, State: Initialized, Role: FOLLOWER
I20260709 13:09:49.488629 25611 tablet_service.cc:1511] Processing CreateTablet for tablet a06a18d1f8c346f2b758f593d709eb53 (DEFAULT_TABLE table=test-workload [id=204a543d619048de89c53d57ce4d64de]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:09:49.490360 25611 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a06a18d1f8c346f2b758f593d709eb53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:49.491541 25661 tablet_bootstrap.cc:492] T d0cd92d7306d4ed695dc084aabbfb995 P a8545e52c3ee4ac691870228228b4fa5: Bootstrap starting.
I20260709 13:09:49.503244 25661 tablet_bootstrap.cc:654] T d0cd92d7306d4ed695dc084aabbfb995 P a8545e52c3ee4ac691870228228b4fa5: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:49.504113 25669 raft_consensus.cc:493] T b6d563892443429682cba0bba950c7d7 P 6e4379ca45a84c5d807695a3fef07116 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.504787 25669 raft_consensus.cc:515] T b6d563892443429682cba0bba950c7d7 P 6e4379ca45a84c5d807695a3fef07116 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } } peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } }
I20260709 13:09:49.507256 25497 heartbeater.cc:499] Master 127.14.180.126:37755 was elected leader, sending a full tablet report...
I20260709 13:09:49.509647 25669 leader_election.cc:290] T b6d563892443429682cba0bba950c7d7 P 6e4379ca45a84c5d807695a3fef07116 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8545e52c3ee4ac691870228228b4fa5 (127.14.180.66:35803), 0482fd26e89d4bb89ee847d0108ab167 (127.14.180.65:45331)
I20260709 13:09:49.506726 25664 consensus_queue.cc:260] T c301576f903c43cc87a0c95425f042fb P 6e4379ca45a84c5d807695a3fef07116 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:49.515369 25664 ts_tablet_manager.cc:1434] T c301576f903c43cc87a0c95425f042fb P 6e4379ca45a84c5d807695a3fef07116: Time spent starting tablet: real 0.039s	user 0.007s	sys 0.001s
I20260709 13:09:49.504128 25662 ts_tablet_manager.cc:1434] T c301576f903c43cc87a0c95425f042fb P 0482fd26e89d4bb89ee847d0108ab167: Time spent starting tablet: real 0.114s	user 0.019s	sys 0.014s
I20260709 13:09:49.519703 25662 tablet_bootstrap.cc:492] T d0cd92d7306d4ed695dc084aabbfb995 P 0482fd26e89d4bb89ee847d0108ab167: Bootstrap starting.
I20260709 13:09:49.535894 25661 tablet_bootstrap.cc:492] T d0cd92d7306d4ed695dc084aabbfb995 P a8545e52c3ee4ac691870228228b4fa5: No bootstrap required, opened a new log
I20260709 13:09:49.536556 25661 ts_tablet_manager.cc:1403] T d0cd92d7306d4ed695dc084aabbfb995 P a8545e52c3ee4ac691870228228b4fa5: Time spent bootstrapping tablet: real 0.045s	user 0.019s	sys 0.006s
I20260709 13:09:49.539414 25461 tablet_service.cc:1511] Processing CreateTablet for tablet cc05b0de0de04e64a129f5138acaf446 (DEFAULT_TABLE table=test-workload [id=204a543d619048de89c53d57ce4d64de]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:09:49.539906 25661 raft_consensus.cc:359] T d0cd92d7306d4ed695dc084aabbfb995 P a8545e52c3ee4ac691870228228b4fa5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:49.540762 25661 raft_consensus.cc:385] T d0cd92d7306d4ed695dc084aabbfb995 P a8545e52c3ee4ac691870228228b4fa5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:49.540974 25461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc05b0de0de04e64a129f5138acaf446. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:49.541067 25661 raft_consensus.cc:740] T d0cd92d7306d4ed695dc084aabbfb995 P a8545e52c3ee4ac691870228228b4fa5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8545e52c3ee4ac691870228228b4fa5, State: Initialized, Role: FOLLOWER
I20260709 13:09:49.543169 25662 tablet_bootstrap.cc:654] T d0cd92d7306d4ed695dc084aabbfb995 P 0482fd26e89d4bb89ee847d0108ab167: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:49.543228 25661 consensus_queue.cc:260] T d0cd92d7306d4ed695dc084aabbfb995 P a8545e52c3ee4ac691870228228b4fa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:49.544704 25547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6d563892443429682cba0bba950c7d7" candidate_uuid: "6e4379ca45a84c5d807695a3fef07116" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8545e52c3ee4ac691870228228b4fa5" is_pre_election: true
I20260709 13:09:49.545533 25547 raft_consensus.cc:2468] T b6d563892443429682cba0bba950c7d7 P a8545e52c3ee4ac691870228228b4fa5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e4379ca45a84c5d807695a3fef07116 in term 0.
I20260709 13:09:49.545997 25661 ts_tablet_manager.cc:1434] T d0cd92d7306d4ed695dc084aabbfb995 P a8545e52c3ee4ac691870228228b4fa5: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:09:49.531761 25664 tablet_bootstrap.cc:492] T d0cd92d7306d4ed695dc084aabbfb995 P 6e4379ca45a84c5d807695a3fef07116: Bootstrap starting.
I20260709 13:09:49.551946 25661 tablet_bootstrap.cc:492] T 442972580e8d4c5f9010dd64ba54899b P a8545e52c3ee4ac691870228228b4fa5: Bootstrap starting.
I20260709 13:09:49.553028 25610 tablet_service.cc:1511] Processing CreateTablet for tablet cc05b0de0de04e64a129f5138acaf446 (DEFAULT_TABLE table=test-workload [id=204a543d619048de89c53d57ce4d64de]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:09:49.549759 25584 leader_election.cc:304] T b6d563892443429682cba0bba950c7d7 P 6e4379ca45a84c5d807695a3fef07116 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e4379ca45a84c5d807695a3fef07116, a8545e52c3ee4ac691870228228b4fa5; no voters: 
I20260709 13:09:49.556298 25669 raft_consensus.cc:2804] T b6d563892443429682cba0bba950c7d7 P 6e4379ca45a84c5d807695a3fef07116 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:49.554488 25610 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc05b0de0de04e64a129f5138acaf446. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:49.556746 25669 raft_consensus.cc:493] T b6d563892443429682cba0bba950c7d7 P 6e4379ca45a84c5d807695a3fef07116 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:49.557165 25669 raft_consensus.cc:3060] T b6d563892443429682cba0bba950c7d7 P 6e4379ca45a84c5d807695a3fef07116 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:49.558701 25661 tablet_bootstrap.cc:654] T 442972580e8d4c5f9010dd64ba54899b P a8545e52c3ee4ac691870228228b4fa5: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:49.561039 25534 tablet_service.cc:1511] Processing CreateTablet for tablet cc05b0de0de04e64a129f5138acaf446 (DEFAULT_TABLE table=test-workload [id=204a543d619048de89c53d57ce4d64de]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:09:49.566160 25472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6d563892443429682cba0bba950c7d7" candidate_uuid: "6e4379ca45a84c5d807695a3fef07116" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0482fd26e89d4bb89ee847d0108ab167" is_pre_election: true
I20260709 13:09:49.566732 25534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc05b0de0de04e64a129f5138acaf446. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:09:49.568297 25585 leader_election.cc:343] T b6d563892443429682cba0bba950c7d7 P 6e4379ca45a84c5d807695a3fef07116 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0482fd26e89d4bb89ee847d0108ab167 (127.14.180.65:45331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:49.568481 25664 tablet_bootstrap.cc:654] T d0cd92d7306d4ed695dc084aabbfb995 P 6e4379ca45a84c5d807695a3fef07116: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:49.569542 25669 raft_consensus.cc:515] T b6d563892443429682cba0bba950c7d7 P 6e4379ca45a84c5d807695a3fef07116 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } } peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } }
I20260709 13:09:49.572793 25547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6d563892443429682cba0bba950c7d7" candidate_uuid: "6e4379ca45a84c5d807695a3fef07116" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8545e52c3ee4ac691870228228b4fa5"
I20260709 13:09:49.574211 25547 raft_consensus.cc:3060] T b6d563892443429682cba0bba950c7d7 P a8545e52c3ee4ac691870228228b4fa5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:49.578758 25472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6d563892443429682cba0bba950c7d7" candidate_uuid: "6e4379ca45a84c5d807695a3fef07116" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0482fd26e89d4bb89ee847d0108ab167"
W20260709 13:09:49.580461 25585 leader_election.cc:343] T b6d563892443429682cba0bba950c7d7 P 6e4379ca45a84c5d807695a3fef07116 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0482fd26e89d4bb89ee847d0108ab167 (127.14.180.65:45331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:49.581586 25669 leader_election.cc:290] T b6d563892443429682cba0bba950c7d7 P 6e4379ca45a84c5d807695a3fef07116 [CANDIDATE]: Term 1 election: Requested vote from peers a8545e52c3ee4ac691870228228b4fa5 (127.14.180.66:35803), 0482fd26e89d4bb89ee847d0108ab167 (127.14.180.65:45331)
I20260709 13:09:49.591317 25547 raft_consensus.cc:2468] T b6d563892443429682cba0bba950c7d7 P a8545e52c3ee4ac691870228228b4fa5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e4379ca45a84c5d807695a3fef07116 in term 1.
I20260709 13:09:49.593968 25584 leader_election.cc:304] T b6d563892443429682cba0bba950c7d7 P 6e4379ca45a84c5d807695a3fef07116 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e4379ca45a84c5d807695a3fef07116, a8545e52c3ee4ac691870228228b4fa5; no voters: 0482fd26e89d4bb89ee847d0108ab167
I20260709 13:09:49.595745 25669 raft_consensus.cc:2804] T b6d563892443429682cba0bba950c7d7 P 6e4379ca45a84c5d807695a3fef07116 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:49.600569 25662 tablet_bootstrap.cc:492] T d0cd92d7306d4ed695dc084aabbfb995 P 0482fd26e89d4bb89ee847d0108ab167: No bootstrap required, opened a new log
I20260709 13:09:49.601060 25661 tablet_bootstrap.cc:492] T 442972580e8d4c5f9010dd64ba54899b P a8545e52c3ee4ac691870228228b4fa5: No bootstrap required, opened a new log
I20260709 13:09:49.601316 25662 ts_tablet_manager.cc:1403] T d0cd92d7306d4ed695dc084aabbfb995 P 0482fd26e89d4bb89ee847d0108ab167: Time spent bootstrapping tablet: real 0.082s	user 0.010s	sys 0.010s
I20260709 13:09:49.602206 25661 ts_tablet_manager.cc:1403] T 442972580e8d4c5f9010dd64ba54899b P a8545e52c3ee4ac691870228228b4fa5: Time spent bootstrapping tablet: real 0.050s	user 0.009s	sys 0.012s
I20260709 13:09:49.605926 25662 raft_consensus.cc:359] T d0cd92d7306d4ed695dc084aabbfb995 P 0482fd26e89d4bb89ee847d0108ab167 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:49.607034 25662 raft_consensus.cc:385] T d0cd92d7306d4ed695dc084aabbfb995 P 0482fd26e89d4bb89ee847d0108ab167 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:49.607367 25662 raft_consensus.cc:740] T d0cd92d7306d4ed695dc084aabbfb995 P 0482fd26e89d4bb89ee847d0108ab167 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0482fd26e89d4bb89ee847d0108ab167, State: Initialized, Role: FOLLOWER
I20260709 13:09:49.608372 25662 consensus_queue.cc:260] T d0cd92d7306d4ed695dc084aabbfb995 P 0482fd26e89d4bb89ee847d0108ab167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:49.609066 25664 tablet_bootstrap.cc:492] T d0cd92d7306d4ed695dc084aabbfb995 P 6e4379ca45a84c5d807695a3fef07116: No bootstrap required, opened a new log
I20260709 13:09:49.609894 25664 ts_tablet_manager.cc:1403] T d0cd92d7306d4ed695dc084aabbfb995 P 6e4379ca45a84c5d807695a3fef07116: Time spent bootstrapping tablet: real 0.084s	user 0.011s	sys 0.002s
I20260709 13:09:49.610574 25661 raft_consensus.cc:359] T 442972580e8d4c5f9010dd64ba54899b P a8545e52c3ee4ac691870228228b4fa5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:49.611447 25661 raft_consensus.cc:385] T 442972580e8d4c5f9010dd64ba54899b P a8545e52c3ee4ac691870228228b4fa5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:49.611732 25661 raft_consensus.cc:740] T 442972580e8d4c5f9010dd64ba54899b P a8545e52c3ee4ac691870228228b4fa5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8545e52c3ee4ac691870228228b4fa5, State: Initialized, Role: FOLLOWER
I20260709 13:09:49.614886 25664 raft_consensus.cc:359] T d0cd92d7306d4ed695dc084aabbfb995 P 6e4379ca45a84c5d807695a3fef07116 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:49.621402 25662 ts_tablet_manager.cc:1434] T d0cd92d7306d4ed695dc084aabbfb995 P 0482fd26e89d4bb89ee847d0108ab167: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.006s
I20260709 13:09:49.621552 25664 raft_consensus.cc:385] T d0cd92d7306d4ed695dc084aabbfb995 P 6e4379ca45a84c5d807695a3fef07116 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:49.623005 25662 tablet_bootstrap.cc:492] T 442972580e8d4c5f9010dd64ba54899b P 0482fd26e89d4bb89ee847d0108ab167: Bootstrap starting.
I20260709 13:09:49.624504 25664 raft_consensus.cc:740] T d0cd92d7306d4ed695dc084aabbfb995 P 6e4379ca45a84c5d807695a3fef07116 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e4379ca45a84c5d807695a3fef07116, State: Initialized, Role: FOLLOWER
I20260709 13:09:49.625540 25664 consensus_queue.cc:260] T d0cd92d7306d4ed695dc084aabbfb995 P 6e4379ca45a84c5d807695a3fef07116 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:49.621516 25669 raft_consensus.cc:697] T b6d563892443429682cba0bba950c7d7 P 6e4379ca45a84c5d807695a3fef07116 [term 1 LEADER]: Becoming Leader. State: Replica: 6e4379ca45a84c5d807695a3fef07116, State: Running, Role: LEADER
I20260709 13:09:49.622642 25661 consensus_queue.cc:260] T 442972580e8d4c5f9010dd64ba54899b P a8545e52c3ee4ac691870228228b4fa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:49.630970 25669 consensus_queue.cc:237] T b6d563892443429682cba0bba950c7d7 P 6e4379ca45a84c5d807695a3fef07116 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } } peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } }
I20260709 13:09:49.631592 25662 tablet_bootstrap.cc:654] T 442972580e8d4c5f9010dd64ba54899b P 0482fd26e89d4bb89ee847d0108ab167: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:49.643047 25677 raft_consensus.cc:493] T c301576f903c43cc87a0c95425f042fb P 6e4379ca45a84c5d807695a3fef07116 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.643911 25677 raft_consensus.cc:515] T c301576f903c43cc87a0c95425f042fb P 6e4379ca45a84c5d807695a3fef07116 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:49.648269 25472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c301576f903c43cc87a0c95425f042fb" candidate_uuid: "6e4379ca45a84c5d807695a3fef07116" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0482fd26e89d4bb89ee847d0108ab167" is_pre_election: true
I20260709 13:09:49.649248 25472 raft_consensus.cc:2468] T c301576f903c43cc87a0c95425f042fb P 0482fd26e89d4bb89ee847d0108ab167 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e4379ca45a84c5d807695a3fef07116 in term 0.
I20260709 13:09:49.650990 25585 leader_election.cc:304] T c301576f903c43cc87a0c95425f042fb P 6e4379ca45a84c5d807695a3fef07116 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0482fd26e89d4bb89ee847d0108ab167, 6e4379ca45a84c5d807695a3fef07116; no voters: 
I20260709 13:09:49.654803 25547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c301576f903c43cc87a0c95425f042fb" candidate_uuid: "6e4379ca45a84c5d807695a3fef07116" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8545e52c3ee4ac691870228228b4fa5" is_pre_election: true
I20260709 13:09:49.655737 25547 raft_consensus.cc:2468] T c301576f903c43cc87a0c95425f042fb P a8545e52c3ee4ac691870228228b4fa5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e4379ca45a84c5d807695a3fef07116 in term 0.
I20260709 13:09:49.657667 25677 leader_election.cc:290] T c301576f903c43cc87a0c95425f042fb P 6e4379ca45a84c5d807695a3fef07116 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0482fd26e89d4bb89ee847d0108ab167 (127.14.180.65:45331), a8545e52c3ee4ac691870228228b4fa5 (127.14.180.66:35803)
I20260709 13:09:49.658859 25677 raft_consensus.cc:2804] T c301576f903c43cc87a0c95425f042fb P 6e4379ca45a84c5d807695a3fef07116 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:49.659299 25677 raft_consensus.cc:493] T c301576f903c43cc87a0c95425f042fb P 6e4379ca45a84c5d807695a3fef07116 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:49.659741 25677 raft_consensus.cc:3060] T c301576f903c43cc87a0c95425f042fb P 6e4379ca45a84c5d807695a3fef07116 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:49.664043 25661 ts_tablet_manager.cc:1434] T 442972580e8d4c5f9010dd64ba54899b P a8545e52c3ee4ac691870228228b4fa5: Time spent starting tablet: real 0.061s	user 0.007s	sys 0.000s
W20260709 13:09:49.675643 25418 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:49.676599 25661 tablet_bootstrap.cc:492] T 11ad0defd0924408a16ee3f7a8a60106 P a8545e52c3ee4ac691870228228b4fa5: Bootstrap starting.
I20260709 13:09:49.691553 25677 raft_consensus.cc:515] T c301576f903c43cc87a0c95425f042fb P 6e4379ca45a84c5d807695a3fef07116 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:49.698822 25669 raft_consensus.cc:493] T d0cd92d7306d4ed695dc084aabbfb995 P 6e4379ca45a84c5d807695a3fef07116 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.700045 25669 raft_consensus.cc:515] T d0cd92d7306d4ed695dc084aabbfb995 P 6e4379ca45a84c5d807695a3fef07116 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:49.703743 25677 leader_election.cc:290] T c301576f903c43cc87a0c95425f042fb P 6e4379ca45a84c5d807695a3fef07116 [CANDIDATE]: Term 1 election: Requested vote from peers 0482fd26e89d4bb89ee847d0108ab167 (127.14.180.65:45331), a8545e52c3ee4ac691870228228b4fa5 (127.14.180.66:35803)
I20260709 13:09:49.705782 25546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c301576f903c43cc87a0c95425f042fb" candidate_uuid: "6e4379ca45a84c5d807695a3fef07116" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8545e52c3ee4ac691870228228b4fa5"
I20260709 13:09:49.706346 25471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0cd92d7306d4ed695dc084aabbfb995" candidate_uuid: "6e4379ca45a84c5d807695a3fef07116" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0482fd26e89d4bb89ee847d0108ab167" is_pre_election: true
I20260709 13:09:49.706944 25669 leader_election.cc:290] T d0cd92d7306d4ed695dc084aabbfb995 P 6e4379ca45a84c5d807695a3fef07116 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0482fd26e89d4bb89ee847d0108ab167 (127.14.180.65:45331), a8545e52c3ee4ac691870228228b4fa5 (127.14.180.66:35803)
I20260709 13:09:49.705775 25547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0cd92d7306d4ed695dc084aabbfb995" candidate_uuid: "6e4379ca45a84c5d807695a3fef07116" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8545e52c3ee4ac691870228228b4fa5" is_pre_election: true
I20260709 13:09:49.706389 25472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c301576f903c43cc87a0c95425f042fb" candidate_uuid: "6e4379ca45a84c5d807695a3fef07116" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0482fd26e89d4bb89ee847d0108ab167"
I20260709 13:09:49.707556 25471 raft_consensus.cc:2468] T d0cd92d7306d4ed695dc084aabbfb995 P 0482fd26e89d4bb89ee847d0108ab167 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e4379ca45a84c5d807695a3fef07116 in term 0.
I20260709 13:09:49.707860 25547 raft_consensus.cc:2468] T d0cd92d7306d4ed695dc084aabbfb995 P a8545e52c3ee4ac691870228228b4fa5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e4379ca45a84c5d807695a3fef07116 in term 0.
I20260709 13:09:49.708014 25472 raft_consensus.cc:3060] T c301576f903c43cc87a0c95425f042fb P 0482fd26e89d4bb89ee847d0108ab167 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:49.709178 25585 leader_election.cc:304] T d0cd92d7306d4ed695dc084aabbfb995 P 6e4379ca45a84c5d807695a3fef07116 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0482fd26e89d4bb89ee847d0108ab167, 6e4379ca45a84c5d807695a3fef07116; no voters: 
I20260709 13:09:49.710268 25669 raft_consensus.cc:2804] T d0cd92d7306d4ed695dc084aabbfb995 P 6e4379ca45a84c5d807695a3fef07116 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:49.710860 25669 raft_consensus.cc:493] T d0cd92d7306d4ed695dc084aabbfb995 P 6e4379ca45a84c5d807695a3fef07116 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:49.710953 25661 tablet_bootstrap.cc:654] T 11ad0defd0924408a16ee3f7a8a60106 P a8545e52c3ee4ac691870228228b4fa5: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:49.711651 25669 raft_consensus.cc:3060] T d0cd92d7306d4ed695dc084aabbfb995 P 6e4379ca45a84c5d807695a3fef07116 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:49.710790 25368 catalog_manager.cc:5697] T b6d563892443429682cba0bba950c7d7 P 6e4379ca45a84c5d807695a3fef07116 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6e4379ca45a84c5d807695a3fef07116 (127.14.180.67). New cstate: current_term: 1 leader_uuid: "6e4379ca45a84c5d807695a3fef07116" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:49.706629 25546 raft_consensus.cc:3060] T c301576f903c43cc87a0c95425f042fb P a8545e52c3ee4ac691870228228b4fa5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:49.720062 25664 ts_tablet_manager.cc:1434] T d0cd92d7306d4ed695dc084aabbfb995 P 6e4379ca45a84c5d807695a3fef07116: Time spent starting tablet: real 0.110s	user 0.029s	sys 0.046s
I20260709 13:09:49.721007 25472 raft_consensus.cc:2468] T c301576f903c43cc87a0c95425f042fb P 0482fd26e89d4bb89ee847d0108ab167 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e4379ca45a84c5d807695a3fef07116 in term 1.
I20260709 13:09:49.721477 25662 tablet_bootstrap.cc:492] T 442972580e8d4c5f9010dd64ba54899b P 0482fd26e89d4bb89ee847d0108ab167: No bootstrap required, opened a new log
I20260709 13:09:49.721903 25664 tablet_bootstrap.cc:492] T 442972580e8d4c5f9010dd64ba54899b P 6e4379ca45a84c5d807695a3fef07116: Bootstrap starting.
I20260709 13:09:49.722034 25662 ts_tablet_manager.cc:1403] T 442972580e8d4c5f9010dd64ba54899b P 0482fd26e89d4bb89ee847d0108ab167: Time spent bootstrapping tablet: real 0.099s	user 0.035s	sys 0.037s
I20260709 13:09:49.722711 25585 leader_election.cc:304] T c301576f903c43cc87a0c95425f042fb P 6e4379ca45a84c5d807695a3fef07116 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0482fd26e89d4bb89ee847d0108ab167, 6e4379ca45a84c5d807695a3fef07116; no voters: 
I20260709 13:09:49.725493 25677 raft_consensus.cc:2804] T c301576f903c43cc87a0c95425f042fb P 6e4379ca45a84c5d807695a3fef07116 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:49.726375 25677 raft_consensus.cc:697] T c301576f903c43cc87a0c95425f042fb P 6e4379ca45a84c5d807695a3fef07116 [term 1 LEADER]: Becoming Leader. State: Replica: 6e4379ca45a84c5d807695a3fef07116, State: Running, Role: LEADER
I20260709 13:09:49.728520 25677 consensus_queue.cc:237] T c301576f903c43cc87a0c95425f042fb P 6e4379ca45a84c5d807695a3fef07116 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:49.735865 25662 raft_consensus.cc:359] T 442972580e8d4c5f9010dd64ba54899b P 0482fd26e89d4bb89ee847d0108ab167 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:49.737169 25662 raft_consensus.cc:385] T 442972580e8d4c5f9010dd64ba54899b P 0482fd26e89d4bb89ee847d0108ab167 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:49.737601 25662 raft_consensus.cc:740] T 442972580e8d4c5f9010dd64ba54899b P 0482fd26e89d4bb89ee847d0108ab167 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0482fd26e89d4bb89ee847d0108ab167, State: Initialized, Role: FOLLOWER
I20260709 13:09:49.739331 25662 consensus_queue.cc:260] T 442972580e8d4c5f9010dd64ba54899b P 0482fd26e89d4bb89ee847d0108ab167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:49.740396 25664 tablet_bootstrap.cc:654] T 442972580e8d4c5f9010dd64ba54899b P 6e4379ca45a84c5d807695a3fef07116: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:49.747587 25546 raft_consensus.cc:2468] T c301576f903c43cc87a0c95425f042fb P a8545e52c3ee4ac691870228228b4fa5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e4379ca45a84c5d807695a3fef07116 in term 1.
I20260709 13:09:49.751153 25662 ts_tablet_manager.cc:1434] T 442972580e8d4c5f9010dd64ba54899b P 0482fd26e89d4bb89ee847d0108ab167: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.006s
I20260709 13:09:49.752585 25662 tablet_bootstrap.cc:492] T b6d563892443429682cba0bba950c7d7 P 0482fd26e89d4bb89ee847d0108ab167: Bootstrap starting.
I20260709 13:09:49.756306 25661 tablet_bootstrap.cc:492] T 11ad0defd0924408a16ee3f7a8a60106 P a8545e52c3ee4ac691870228228b4fa5: No bootstrap required, opened a new log
I20260709 13:09:49.757010 25661 ts_tablet_manager.cc:1403] T 11ad0defd0924408a16ee3f7a8a60106 P a8545e52c3ee4ac691870228228b4fa5: Time spent bootstrapping tablet: real 0.081s	user 0.017s	sys 0.012s
I20260709 13:09:49.760481 25661 raft_consensus.cc:359] T 11ad0defd0924408a16ee3f7a8a60106 P a8545e52c3ee4ac691870228228b4fa5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:49.761304 25662 tablet_bootstrap.cc:654] T b6d563892443429682cba0bba950c7d7 P 0482fd26e89d4bb89ee847d0108ab167: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:49.761442 25661 raft_consensus.cc:385] T 11ad0defd0924408a16ee3f7a8a60106 P a8545e52c3ee4ac691870228228b4fa5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:49.762166 25661 raft_consensus.cc:740] T 11ad0defd0924408a16ee3f7a8a60106 P a8545e52c3ee4ac691870228228b4fa5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8545e52c3ee4ac691870228228b4fa5, State: Initialized, Role: FOLLOWER
I20260709 13:09:49.763931 25664 tablet_bootstrap.cc:492] T 442972580e8d4c5f9010dd64ba54899b P 6e4379ca45a84c5d807695a3fef07116: No bootstrap required, opened a new log
I20260709 13:09:49.764632 25664 ts_tablet_manager.cc:1403] T 442972580e8d4c5f9010dd64ba54899b P 6e4379ca45a84c5d807695a3fef07116: Time spent bootstrapping tablet: real 0.043s	user 0.017s	sys 0.001s
I20260709 13:09:49.764443 25669 raft_consensus.cc:515] T d0cd92d7306d4ed695dc084aabbfb995 P 6e4379ca45a84c5d807695a3fef07116 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:49.767719 25472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0cd92d7306d4ed695dc084aabbfb995" candidate_uuid: "6e4379ca45a84c5d807695a3fef07116" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0482fd26e89d4bb89ee847d0108ab167"
I20260709 13:09:49.768280 25669 leader_election.cc:290] T d0cd92d7306d4ed695dc084aabbfb995 P 6e4379ca45a84c5d807695a3fef07116 [CANDIDATE]: Term 1 election: Requested vote from peers 0482fd26e89d4bb89ee847d0108ab167 (127.14.180.65:45331), a8545e52c3ee4ac691870228228b4fa5 (127.14.180.66:35803)
I20260709 13:09:49.768438 25472 raft_consensus.cc:3060] T d0cd92d7306d4ed695dc084aabbfb995 P 0482fd26e89d4bb89ee847d0108ab167 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:49.768677 25546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0cd92d7306d4ed695dc084aabbfb995" candidate_uuid: "6e4379ca45a84c5d807695a3fef07116" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8545e52c3ee4ac691870228228b4fa5"
I20260709 13:09:49.769613 25546 raft_consensus.cc:3060] T d0cd92d7306d4ed695dc084aabbfb995 P a8545e52c3ee4ac691870228228b4fa5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:49.769361 25661 consensus_queue.cc:260] T 11ad0defd0924408a16ee3f7a8a60106 P a8545e52c3ee4ac691870228228b4fa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:49.775795 25661 ts_tablet_manager.cc:1434] T 11ad0defd0924408a16ee3f7a8a60106 P a8545e52c3ee4ac691870228228b4fa5: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.001s
I20260709 13:09:49.776998 25661 tablet_bootstrap.cc:492] T 64e29ee66f22432c82e5772ee79dd918 P a8545e52c3ee4ac691870228228b4fa5: Bootstrap starting.
I20260709 13:09:49.779983 25666 raft_consensus.cc:493] T 11ad0defd0924408a16ee3f7a8a60106 P a8545e52c3ee4ac691870228228b4fa5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.780652 25666 raft_consensus.cc:515] T 11ad0defd0924408a16ee3f7a8a60106 P a8545e52c3ee4ac691870228228b4fa5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:49.784013 25546 raft_consensus.cc:2468] T d0cd92d7306d4ed695dc084aabbfb995 P a8545e52c3ee4ac691870228228b4fa5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e4379ca45a84c5d807695a3fef07116 in term 1.
I20260709 13:09:49.787143 25472 raft_consensus.cc:2468] T d0cd92d7306d4ed695dc084aabbfb995 P 0482fd26e89d4bb89ee847d0108ab167 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e4379ca45a84c5d807695a3fef07116 in term 1.
I20260709 13:09:49.788657 25585 leader_election.cc:304] T d0cd92d7306d4ed695dc084aabbfb995 P 6e4379ca45a84c5d807695a3fef07116 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0482fd26e89d4bb89ee847d0108ab167, 6e4379ca45a84c5d807695a3fef07116; no voters: 
I20260709 13:09:49.786139 25664 raft_consensus.cc:359] T 442972580e8d4c5f9010dd64ba54899b P 6e4379ca45a84c5d807695a3fef07116 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:49.790693 25664 raft_consensus.cc:385] T 442972580e8d4c5f9010dd64ba54899b P 6e4379ca45a84c5d807695a3fef07116 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:49.791174 25664 raft_consensus.cc:740] T 442972580e8d4c5f9010dd64ba54899b P 6e4379ca45a84c5d807695a3fef07116 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e4379ca45a84c5d807695a3fef07116, State: Initialized, Role: FOLLOWER
I20260709 13:09:49.792209 25669 raft_consensus.cc:2804] T d0cd92d7306d4ed695dc084aabbfb995 P 6e4379ca45a84c5d807695a3fef07116 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:49.793279 25664 consensus_queue.cc:260] T 442972580e8d4c5f9010dd64ba54899b P 6e4379ca45a84c5d807695a3fef07116 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:49.794183 25669 raft_consensus.cc:697] T d0cd92d7306d4ed695dc084aabbfb995 P 6e4379ca45a84c5d807695a3fef07116 [term 1 LEADER]: Becoming Leader. State: Replica: 6e4379ca45a84c5d807695a3fef07116, State: Running, Role: LEADER
I20260709 13:09:49.798245 25666 leader_election.cc:290] T 11ad0defd0924408a16ee3f7a8a60106 P a8545e52c3ee4ac691870228228b4fa5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0482fd26e89d4bb89ee847d0108ab167 (127.14.180.65:45331), 6e4379ca45a84c5d807695a3fef07116 (127.14.180.67:39657)
I20260709 13:09:49.803390 25662 tablet_bootstrap.cc:492] T b6d563892443429682cba0bba950c7d7 P 0482fd26e89d4bb89ee847d0108ab167: No bootstrap required, opened a new log
I20260709 13:09:49.804055 25662 ts_tablet_manager.cc:1403] T b6d563892443429682cba0bba950c7d7 P 0482fd26e89d4bb89ee847d0108ab167: Time spent bootstrapping tablet: real 0.052s	user 0.013s	sys 0.007s
I20260709 13:09:49.804247 25661 tablet_bootstrap.cc:654] T 64e29ee66f22432c82e5772ee79dd918 P a8545e52c3ee4ac691870228228b4fa5: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:49.807468 25662 raft_consensus.cc:359] T b6d563892443429682cba0bba950c7d7 P 0482fd26e89d4bb89ee847d0108ab167 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } } peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } }
I20260709 13:09:49.809064 25662 raft_consensus.cc:385] T b6d563892443429682cba0bba950c7d7 P 0482fd26e89d4bb89ee847d0108ab167 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:49.809939 25664 ts_tablet_manager.cc:1434] T 442972580e8d4c5f9010dd64ba54899b P 6e4379ca45a84c5d807695a3fef07116: Time spent starting tablet: real 0.045s	user 0.009s	sys 0.000s
I20260709 13:09:49.810007 25669 consensus_queue.cc:237] T d0cd92d7306d4ed695dc084aabbfb995 P 6e4379ca45a84c5d807695a3fef07116 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:49.812033 25664 tablet_bootstrap.cc:492] T 64e29ee66f22432c82e5772ee79dd918 P 6e4379ca45a84c5d807695a3fef07116: Bootstrap starting.
I20260709 13:09:49.809533 25662 raft_consensus.cc:740] T b6d563892443429682cba0bba950c7d7 P 0482fd26e89d4bb89ee847d0108ab167 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0482fd26e89d4bb89ee847d0108ab167, State: Initialized, Role: FOLLOWER
I20260709 13:09:49.824362 25662 consensus_queue.cc:260] T b6d563892443429682cba0bba950c7d7 P 0482fd26e89d4bb89ee847d0108ab167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } } peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } }
I20260709 13:09:49.829717 25661 tablet_bootstrap.cc:492] T 64e29ee66f22432c82e5772ee79dd918 P a8545e52c3ee4ac691870228228b4fa5: No bootstrap required, opened a new log
I20260709 13:09:49.832031 25472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ad0defd0924408a16ee3f7a8a60106" candidate_uuid: "a8545e52c3ee4ac691870228228b4fa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0482fd26e89d4bb89ee847d0108ab167" is_pre_election: true
I20260709 13:09:49.832435 25661 ts_tablet_manager.cc:1403] T 64e29ee66f22432c82e5772ee79dd918 P a8545e52c3ee4ac691870228228b4fa5: Time spent bootstrapping tablet: real 0.056s	user 0.021s	sys 0.009s
I20260709 13:09:49.834065 25664 tablet_bootstrap.cc:654] T 64e29ee66f22432c82e5772ee79dd918 P 6e4379ca45a84c5d807695a3fef07116: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:49.834587 25511 leader_election.cc:343] T 11ad0defd0924408a16ee3f7a8a60106 P a8545e52c3ee4ac691870228228b4fa5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0482fd26e89d4bb89ee847d0108ab167 (127.14.180.65:45331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:49.836558 25661 raft_consensus.cc:359] T 64e29ee66f22432c82e5772ee79dd918 P a8545e52c3ee4ac691870228228b4fa5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:49.837621 25661 raft_consensus.cc:385] T 64e29ee66f22432c82e5772ee79dd918 P a8545e52c3ee4ac691870228228b4fa5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:49.838122 25661 raft_consensus.cc:740] T 64e29ee66f22432c82e5772ee79dd918 P a8545e52c3ee4ac691870228228b4fa5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8545e52c3ee4ac691870228228b4fa5, State: Initialized, Role: FOLLOWER
I20260709 13:09:49.839432 25661 consensus_queue.cc:260] T 64e29ee66f22432c82e5772ee79dd918 P a8545e52c3ee4ac691870228228b4fa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:49.847043 25661 ts_tablet_manager.cc:1434] T 64e29ee66f22432c82e5772ee79dd918 P a8545e52c3ee4ac691870228228b4fa5: Time spent starting tablet: real 0.014s	user 0.010s	sys 0.000s
I20260709 13:09:49.847513 25621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ad0defd0924408a16ee3f7a8a60106" candidate_uuid: "a8545e52c3ee4ac691870228228b4fa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e4379ca45a84c5d807695a3fef07116" is_pre_election: true
I20260709 13:09:49.849066 25661 tablet_bootstrap.cc:492] T ffbf01eb3ff0482fb5f922a5b0a77a83 P a8545e52c3ee4ac691870228228b4fa5: Bootstrap starting.
W20260709 13:09:49.851465 25513 leader_election.cc:343] T 11ad0defd0924408a16ee3f7a8a60106 P a8545e52c3ee4ac691870228228b4fa5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6e4379ca45a84c5d807695a3fef07116 (127.14.180.67:39657): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:49.852243 25513 leader_election.cc:304] T 11ad0defd0924408a16ee3f7a8a60106 P a8545e52c3ee4ac691870228228b4fa5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8545e52c3ee4ac691870228228b4fa5; no voters: 0482fd26e89d4bb89ee847d0108ab167, 6e4379ca45a84c5d807695a3fef07116
I20260709 13:09:49.853597 25666 raft_consensus.cc:2749] T 11ad0defd0924408a16ee3f7a8a60106 P a8545e52c3ee4ac691870228228b4fa5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:49.854444 25662 ts_tablet_manager.cc:1434] T b6d563892443429682cba0bba950c7d7 P 0482fd26e89d4bb89ee847d0108ab167: Time spent starting tablet: real 0.050s	user 0.009s	sys 0.001s
I20260709 13:09:49.855862 25662 tablet_bootstrap.cc:492] T ffbf01eb3ff0482fb5f922a5b0a77a83 P 0482fd26e89d4bb89ee847d0108ab167: Bootstrap starting.
I20260709 13:09:49.863847 25661 tablet_bootstrap.cc:654] T ffbf01eb3ff0482fb5f922a5b0a77a83 P a8545e52c3ee4ac691870228228b4fa5: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:49.868943 25369 catalog_manager.cc:5697] T d0cd92d7306d4ed695dc084aabbfb995 P 6e4379ca45a84c5d807695a3fef07116 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6e4379ca45a84c5d807695a3fef07116 (127.14.180.67). New cstate: current_term: 1 leader_uuid: "6e4379ca45a84c5d807695a3fef07116" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:49.871356 25369 catalog_manager.cc:5697] T c301576f903c43cc87a0c95425f042fb P 6e4379ca45a84c5d807695a3fef07116 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6e4379ca45a84c5d807695a3fef07116 (127.14.180.67). New cstate: current_term: 1 leader_uuid: "6e4379ca45a84c5d807695a3fef07116" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:49.877076 25662 tablet_bootstrap.cc:654] T ffbf01eb3ff0482fb5f922a5b0a77a83 P 0482fd26e89d4bb89ee847d0108ab167: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:49.883000 25662 tablet_bootstrap.cc:492] T ffbf01eb3ff0482fb5f922a5b0a77a83 P 0482fd26e89d4bb89ee847d0108ab167: No bootstrap required, opened a new log
I20260709 13:09:49.883327 25661 tablet_bootstrap.cc:492] T ffbf01eb3ff0482fb5f922a5b0a77a83 P a8545e52c3ee4ac691870228228b4fa5: No bootstrap required, opened a new log
I20260709 13:09:49.883683 25662 ts_tablet_manager.cc:1403] T ffbf01eb3ff0482fb5f922a5b0a77a83 P 0482fd26e89d4bb89ee847d0108ab167: Time spent bootstrapping tablet: real 0.028s	user 0.011s	sys 0.002s
I20260709 13:09:49.883957 25661 ts_tablet_manager.cc:1403] T ffbf01eb3ff0482fb5f922a5b0a77a83 P a8545e52c3ee4ac691870228228b4fa5: Time spent bootstrapping tablet: real 0.035s	user 0.022s	sys 0.007s
I20260709 13:09:49.887198 25662 raft_consensus.cc:359] T ffbf01eb3ff0482fb5f922a5b0a77a83 P 0482fd26e89d4bb89ee847d0108ab167 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:49.887789 25664 tablet_bootstrap.cc:492] T 64e29ee66f22432c82e5772ee79dd918 P 6e4379ca45a84c5d807695a3fef07116: No bootstrap required, opened a new log
I20260709 13:09:49.888111 25662 raft_consensus.cc:385] T ffbf01eb3ff0482fb5f922a5b0a77a83 P 0482fd26e89d4bb89ee847d0108ab167 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:49.888513 25664 ts_tablet_manager.cc:1403] T 64e29ee66f22432c82e5772ee79dd918 P 6e4379ca45a84c5d807695a3fef07116: Time spent bootstrapping tablet: real 0.077s	user 0.030s	sys 0.024s
I20260709 13:09:49.888283 25661 raft_consensus.cc:359] T ffbf01eb3ff0482fb5f922a5b0a77a83 P a8545e52c3ee4ac691870228228b4fa5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:49.888552 25662 raft_consensus.cc:740] T ffbf01eb3ff0482fb5f922a5b0a77a83 P 0482fd26e89d4bb89ee847d0108ab167 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0482fd26e89d4bb89ee847d0108ab167, State: Initialized, Role: FOLLOWER
I20260709 13:09:49.889213 25661 raft_consensus.cc:385] T ffbf01eb3ff0482fb5f922a5b0a77a83 P a8545e52c3ee4ac691870228228b4fa5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:49.889711 25661 raft_consensus.cc:740] T ffbf01eb3ff0482fb5f922a5b0a77a83 P a8545e52c3ee4ac691870228228b4fa5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8545e52c3ee4ac691870228228b4fa5, State: Initialized, Role: FOLLOWER
I20260709 13:09:49.889758 25662 consensus_queue.cc:260] T ffbf01eb3ff0482fb5f922a5b0a77a83 P 0482fd26e89d4bb89ee847d0108ab167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:49.890793 25661 consensus_queue.cc:260] T ffbf01eb3ff0482fb5f922a5b0a77a83 P a8545e52c3ee4ac691870228228b4fa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:49.892136 25664 raft_consensus.cc:359] T 64e29ee66f22432c82e5772ee79dd918 P 6e4379ca45a84c5d807695a3fef07116 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:49.892710 25662 ts_tablet_manager.cc:1434] T ffbf01eb3ff0482fb5f922a5b0a77a83 P 0482fd26e89d4bb89ee847d0108ab167: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 13:09:49.893025 25664 raft_consensus.cc:385] T 64e29ee66f22432c82e5772ee79dd918 P 6e4379ca45a84c5d807695a3fef07116 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:49.893364 25661 ts_tablet_manager.cc:1434] T ffbf01eb3ff0482fb5f922a5b0a77a83 P a8545e52c3ee4ac691870228228b4fa5: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.003s
I20260709 13:09:49.893420 25664 raft_consensus.cc:740] T 64e29ee66f22432c82e5772ee79dd918 P 6e4379ca45a84c5d807695a3fef07116 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e4379ca45a84c5d807695a3fef07116, State: Initialized, Role: FOLLOWER
I20260709 13:09:49.893987 25662 tablet_bootstrap.cc:492] T 11ad0defd0924408a16ee3f7a8a60106 P 0482fd26e89d4bb89ee847d0108ab167: Bootstrap starting.
I20260709 13:09:49.894712 25661 tablet_bootstrap.cc:492] T a06a18d1f8c346f2b758f593d709eb53 P a8545e52c3ee4ac691870228228b4fa5: Bootstrap starting.
I20260709 13:09:49.894683 25664 consensus_queue.cc:260] T 64e29ee66f22432c82e5772ee79dd918 P 6e4379ca45a84c5d807695a3fef07116 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:49.897392 25664 ts_tablet_manager.cc:1434] T 64e29ee66f22432c82e5772ee79dd918 P 6e4379ca45a84c5d807695a3fef07116: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:09:49.901659 25662 tablet_bootstrap.cc:654] T 11ad0defd0924408a16ee3f7a8a60106 P 0482fd26e89d4bb89ee847d0108ab167: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:49.905073 25664 tablet_bootstrap.cc:492] T 11ad0defd0924408a16ee3f7a8a60106 P 6e4379ca45a84c5d807695a3fef07116: Bootstrap starting.
I20260709 13:09:49.912765 25661 tablet_bootstrap.cc:654] T a06a18d1f8c346f2b758f593d709eb53 P a8545e52c3ee4ac691870228228b4fa5: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:49.912765 25664 tablet_bootstrap.cc:654] T 11ad0defd0924408a16ee3f7a8a60106 P 6e4379ca45a84c5d807695a3fef07116: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:49.913946 25662 tablet_bootstrap.cc:492] T 11ad0defd0924408a16ee3f7a8a60106 P 0482fd26e89d4bb89ee847d0108ab167: No bootstrap required, opened a new log
I20260709 13:09:49.914541 25662 ts_tablet_manager.cc:1403] T 11ad0defd0924408a16ee3f7a8a60106 P 0482fd26e89d4bb89ee847d0108ab167: Time spent bootstrapping tablet: real 0.021s	user 0.015s	sys 0.003s
I20260709 13:09:49.917760 25662 raft_consensus.cc:359] T 11ad0defd0924408a16ee3f7a8a60106 P 0482fd26e89d4bb89ee847d0108ab167 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:49.918772 25662 raft_consensus.cc:385] T 11ad0defd0924408a16ee3f7a8a60106 P 0482fd26e89d4bb89ee847d0108ab167 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:49.919095 25662 raft_consensus.cc:740] T 11ad0defd0924408a16ee3f7a8a60106 P 0482fd26e89d4bb89ee847d0108ab167 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0482fd26e89d4bb89ee847d0108ab167, State: Initialized, Role: FOLLOWER
I20260709 13:09:49.919915 25662 consensus_queue.cc:260] T 11ad0defd0924408a16ee3f7a8a60106 P 0482fd26e89d4bb89ee847d0108ab167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:49.922935 25662 ts_tablet_manager.cc:1434] T 11ad0defd0924408a16ee3f7a8a60106 P 0482fd26e89d4bb89ee847d0108ab167: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 13:09:49.924494 25662 tablet_bootstrap.cc:492] T a06a18d1f8c346f2b758f593d709eb53 P 0482fd26e89d4bb89ee847d0108ab167: Bootstrap starting.
I20260709 13:09:49.928181 25661 tablet_bootstrap.cc:492] T a06a18d1f8c346f2b758f593d709eb53 P a8545e52c3ee4ac691870228228b4fa5: No bootstrap required, opened a new log
I20260709 13:09:49.928792 25661 ts_tablet_manager.cc:1403] T a06a18d1f8c346f2b758f593d709eb53 P a8545e52c3ee4ac691870228228b4fa5: Time spent bootstrapping tablet: real 0.034s	user 0.014s	sys 0.008s
I20260709 13:09:49.929418 25664 tablet_bootstrap.cc:492] T 11ad0defd0924408a16ee3f7a8a60106 P 6e4379ca45a84c5d807695a3fef07116: No bootstrap required, opened a new log
I20260709 13:09:49.930006 25664 ts_tablet_manager.cc:1403] T 11ad0defd0924408a16ee3f7a8a60106 P 6e4379ca45a84c5d807695a3fef07116: Time spent bootstrapping tablet: real 0.025s	user 0.015s	sys 0.003s
I20260709 13:09:49.931829 25661 raft_consensus.cc:359] T a06a18d1f8c346f2b758f593d709eb53 P a8545e52c3ee4ac691870228228b4fa5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:49.932358 25662 tablet_bootstrap.cc:654] T a06a18d1f8c346f2b758f593d709eb53 P 0482fd26e89d4bb89ee847d0108ab167: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:49.932617 25661 raft_consensus.cc:385] T a06a18d1f8c346f2b758f593d709eb53 P a8545e52c3ee4ac691870228228b4fa5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:49.932996 25661 raft_consensus.cc:740] T a06a18d1f8c346f2b758f593d709eb53 P a8545e52c3ee4ac691870228228b4fa5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8545e52c3ee4ac691870228228b4fa5, State: Initialized, Role: FOLLOWER
I20260709 13:09:49.933115 25664 raft_consensus.cc:359] T 11ad0defd0924408a16ee3f7a8a60106 P 6e4379ca45a84c5d807695a3fef07116 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:49.933880 25664 raft_consensus.cc:385] T 11ad0defd0924408a16ee3f7a8a60106 P 6e4379ca45a84c5d807695a3fef07116 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:49.933888 25661 consensus_queue.cc:260] T a06a18d1f8c346f2b758f593d709eb53 P a8545e52c3ee4ac691870228228b4fa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:49.934414 25664 raft_consensus.cc:740] T 11ad0defd0924408a16ee3f7a8a60106 P 6e4379ca45a84c5d807695a3fef07116 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e4379ca45a84c5d807695a3fef07116, State: Initialized, Role: FOLLOWER
I20260709 13:09:49.935288 25664 consensus_queue.cc:260] T 11ad0defd0924408a16ee3f7a8a60106 P 6e4379ca45a84c5d807695a3fef07116 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:49.936180 25661 ts_tablet_manager.cc:1434] T a06a18d1f8c346f2b758f593d709eb53 P a8545e52c3ee4ac691870228228b4fa5: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.006s
I20260709 13:09:49.937291 25661 tablet_bootstrap.cc:492] T 1119e418e9964dd1be1dcf47e3fe9734 P a8545e52c3ee4ac691870228228b4fa5: Bootstrap starting.
I20260709 13:09:49.940965 25664 ts_tablet_manager.cc:1434] T 11ad0defd0924408a16ee3f7a8a60106 P 6e4379ca45a84c5d807695a3fef07116: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.004s
I20260709 13:09:49.942196 25664 tablet_bootstrap.cc:492] T ffbf01eb3ff0482fb5f922a5b0a77a83 P 6e4379ca45a84c5d807695a3fef07116: Bootstrap starting.
I20260709 13:09:49.943203 25661 tablet_bootstrap.cc:654] T 1119e418e9964dd1be1dcf47e3fe9734 P a8545e52c3ee4ac691870228228b4fa5: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:49.944703 25662 tablet_bootstrap.cc:492] T a06a18d1f8c346f2b758f593d709eb53 P 0482fd26e89d4bb89ee847d0108ab167: No bootstrap required, opened a new log
I20260709 13:09:49.945353 25662 ts_tablet_manager.cc:1403] T a06a18d1f8c346f2b758f593d709eb53 P 0482fd26e89d4bb89ee847d0108ab167: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.004s
I20260709 13:09:49.948681 25662 raft_consensus.cc:359] T a06a18d1f8c346f2b758f593d709eb53 P 0482fd26e89d4bb89ee847d0108ab167 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:49.949357 25664 tablet_bootstrap.cc:654] T ffbf01eb3ff0482fb5f922a5b0a77a83 P 6e4379ca45a84c5d807695a3fef07116: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:49.949479 25662 raft_consensus.cc:385] T a06a18d1f8c346f2b758f593d709eb53 P 0482fd26e89d4bb89ee847d0108ab167 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:49.950119 25662 raft_consensus.cc:740] T a06a18d1f8c346f2b758f593d709eb53 P 0482fd26e89d4bb89ee847d0108ab167 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0482fd26e89d4bb89ee847d0108ab167, State: Initialized, Role: FOLLOWER
I20260709 13:09:49.951172 25662 consensus_queue.cc:260] T a06a18d1f8c346f2b758f593d709eb53 P 0482fd26e89d4bb89ee847d0108ab167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:49.956872 25662 ts_tablet_manager.cc:1434] T a06a18d1f8c346f2b758f593d709eb53 P 0482fd26e89d4bb89ee847d0108ab167: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:09:49.958005 25662 tablet_bootstrap.cc:492] T 64e29ee66f22432c82e5772ee79dd918 P 0482fd26e89d4bb89ee847d0108ab167: Bootstrap starting.
I20260709 13:09:49.961741 25664 tablet_bootstrap.cc:492] T ffbf01eb3ff0482fb5f922a5b0a77a83 P 6e4379ca45a84c5d807695a3fef07116: No bootstrap required, opened a new log
I20260709 13:09:49.962348 25661 tablet_bootstrap.cc:492] T 1119e418e9964dd1be1dcf47e3fe9734 P a8545e52c3ee4ac691870228228b4fa5: No bootstrap required, opened a new log
I20260709 13:09:49.962376 25664 ts_tablet_manager.cc:1403] T ffbf01eb3ff0482fb5f922a5b0a77a83 P 6e4379ca45a84c5d807695a3fef07116: Time spent bootstrapping tablet: real 0.020s	user 0.015s	sys 0.000s
I20260709 13:09:49.963158 25661 ts_tablet_manager.cc:1403] T 1119e418e9964dd1be1dcf47e3fe9734 P a8545e52c3ee4ac691870228228b4fa5: Time spent bootstrapping tablet: real 0.026s	user 0.014s	sys 0.003s
I20260709 13:09:49.965991 25661 raft_consensus.cc:359] T 1119e418e9964dd1be1dcf47e3fe9734 P a8545e52c3ee4ac691870228228b4fa5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:49.966776 25661 raft_consensus.cc:385] T 1119e418e9964dd1be1dcf47e3fe9734 P a8545e52c3ee4ac691870228228b4fa5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:49.966928 25662 tablet_bootstrap.cc:654] T 64e29ee66f22432c82e5772ee79dd918 P 0482fd26e89d4bb89ee847d0108ab167: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:49.967118 25661 raft_consensus.cc:740] T 1119e418e9964dd1be1dcf47e3fe9734 P a8545e52c3ee4ac691870228228b4fa5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8545e52c3ee4ac691870228228b4fa5, State: Initialized, Role: FOLLOWER
I20260709 13:09:49.968228 25664 raft_consensus.cc:359] T ffbf01eb3ff0482fb5f922a5b0a77a83 P 6e4379ca45a84c5d807695a3fef07116 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:49.968245 25661 consensus_queue.cc:260] T 1119e418e9964dd1be1dcf47e3fe9734 P a8545e52c3ee4ac691870228228b4fa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:49.969256 25664 raft_consensus.cc:385] T ffbf01eb3ff0482fb5f922a5b0a77a83 P 6e4379ca45a84c5d807695a3fef07116 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:49.969636 25664 raft_consensus.cc:740] T ffbf01eb3ff0482fb5f922a5b0a77a83 P 6e4379ca45a84c5d807695a3fef07116 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e4379ca45a84c5d807695a3fef07116, State: Initialized, Role: FOLLOWER
I20260709 13:09:49.970634 25664 consensus_queue.cc:260] T ffbf01eb3ff0482fb5f922a5b0a77a83 P 6e4379ca45a84c5d807695a3fef07116 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:49.972149 25661 ts_tablet_manager.cc:1434] T 1119e418e9964dd1be1dcf47e3fe9734 P a8545e52c3ee4ac691870228228b4fa5: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:09:49.973281 25661 tablet_bootstrap.cc:492] T cc05b0de0de04e64a129f5138acaf446 P a8545e52c3ee4ac691870228228b4fa5: Bootstrap starting.
I20260709 13:09:49.978621 25664 ts_tablet_manager.cc:1434] T ffbf01eb3ff0482fb5f922a5b0a77a83 P 6e4379ca45a84c5d807695a3fef07116: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.001s
I20260709 13:09:49.979528 25661 tablet_bootstrap.cc:654] T cc05b0de0de04e64a129f5138acaf446 P a8545e52c3ee4ac691870228228b4fa5: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:49.980432 25664 tablet_bootstrap.cc:492] T 1119e418e9964dd1be1dcf47e3fe9734 P 6e4379ca45a84c5d807695a3fef07116: Bootstrap starting.
I20260709 13:09:49.989719 25664 tablet_bootstrap.cc:654] T 1119e418e9964dd1be1dcf47e3fe9734 P 6e4379ca45a84c5d807695a3fef07116: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:50.003221 25664 tablet_bootstrap.cc:492] T 1119e418e9964dd1be1dcf47e3fe9734 P 6e4379ca45a84c5d807695a3fef07116: No bootstrap required, opened a new log
I20260709 13:09:50.003731 25664 ts_tablet_manager.cc:1403] T 1119e418e9964dd1be1dcf47e3fe9734 P 6e4379ca45a84c5d807695a3fef07116: Time spent bootstrapping tablet: real 0.024s	user 0.014s	sys 0.008s
I20260709 13:09:50.005685 25662 tablet_bootstrap.cc:492] T 64e29ee66f22432c82e5772ee79dd918 P 0482fd26e89d4bb89ee847d0108ab167: No bootstrap required, opened a new log
I20260709 13:09:50.006328 25662 ts_tablet_manager.cc:1403] T 64e29ee66f22432c82e5772ee79dd918 P 0482fd26e89d4bb89ee847d0108ab167: Time spent bootstrapping tablet: real 0.049s	user 0.012s	sys 0.033s
I20260709 13:09:50.007005 25661 tablet_bootstrap.cc:492] T cc05b0de0de04e64a129f5138acaf446 P a8545e52c3ee4ac691870228228b4fa5: No bootstrap required, opened a new log
I20260709 13:09:50.006523 25664 raft_consensus.cc:359] T 1119e418e9964dd1be1dcf47e3fe9734 P 6e4379ca45a84c5d807695a3fef07116 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:50.007517 25661 ts_tablet_manager.cc:1403] T cc05b0de0de04e64a129f5138acaf446 P a8545e52c3ee4ac691870228228b4fa5: Time spent bootstrapping tablet: real 0.034s	user 0.013s	sys 0.015s
I20260709 13:09:50.007452 25664 raft_consensus.cc:385] T 1119e418e9964dd1be1dcf47e3fe9734 P 6e4379ca45a84c5d807695a3fef07116 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:50.007997 25664 raft_consensus.cc:740] T 1119e418e9964dd1be1dcf47e3fe9734 P 6e4379ca45a84c5d807695a3fef07116 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e4379ca45a84c5d807695a3fef07116, State: Initialized, Role: FOLLOWER
I20260709 13:09:50.008737 25664 consensus_queue.cc:260] T 1119e418e9964dd1be1dcf47e3fe9734 P 6e4379ca45a84c5d807695a3fef07116 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:50.009269 25662 raft_consensus.cc:359] T 64e29ee66f22432c82e5772ee79dd918 P 0482fd26e89d4bb89ee847d0108ab167 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:50.010054 25662 raft_consensus.cc:385] T 64e29ee66f22432c82e5772ee79dd918 P 0482fd26e89d4bb89ee847d0108ab167 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:50.010320 25662 raft_consensus.cc:740] T 64e29ee66f22432c82e5772ee79dd918 P 0482fd26e89d4bb89ee847d0108ab167 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0482fd26e89d4bb89ee847d0108ab167, State: Initialized, Role: FOLLOWER
I20260709 13:09:50.010425 25661 raft_consensus.cc:359] T cc05b0de0de04e64a129f5138acaf446 P a8545e52c3ee4ac691870228228b4fa5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:50.011080 25664 ts_tablet_manager.cc:1434] T 1119e418e9964dd1be1dcf47e3fe9734 P 6e4379ca45a84c5d807695a3fef07116: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:09:50.011425 25661 raft_consensus.cc:385] T cc05b0de0de04e64a129f5138acaf446 P a8545e52c3ee4ac691870228228b4fa5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:50.011130 25662 consensus_queue.cc:260] T 64e29ee66f22432c82e5772ee79dd918 P 0482fd26e89d4bb89ee847d0108ab167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:50.011785 25661 raft_consensus.cc:740] T cc05b0de0de04e64a129f5138acaf446 P a8545e52c3ee4ac691870228228b4fa5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8545e52c3ee4ac691870228228b4fa5, State: Initialized, Role: FOLLOWER
I20260709 13:09:50.012290 25664 tablet_bootstrap.cc:492] T a06a18d1f8c346f2b758f593d709eb53 P 6e4379ca45a84c5d807695a3fef07116: Bootstrap starting.
I20260709 13:09:50.012637 25661 consensus_queue.cc:260] T cc05b0de0de04e64a129f5138acaf446 P a8545e52c3ee4ac691870228228b4fa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:50.018235 25661 ts_tablet_manager.cc:1434] T cc05b0de0de04e64a129f5138acaf446 P a8545e52c3ee4ac691870228228b4fa5: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:09:50.018922 25664 tablet_bootstrap.cc:654] T a06a18d1f8c346f2b758f593d709eb53 P 6e4379ca45a84c5d807695a3fef07116: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:50.021458 25662 ts_tablet_manager.cc:1434] T 64e29ee66f22432c82e5772ee79dd918 P 0482fd26e89d4bb89ee847d0108ab167: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.001s
I20260709 13:09:50.027451 25662 tablet_bootstrap.cc:492] T 1119e418e9964dd1be1dcf47e3fe9734 P 0482fd26e89d4bb89ee847d0108ab167: Bootstrap starting.
I20260709 13:09:50.030689 25664 tablet_bootstrap.cc:492] T a06a18d1f8c346f2b758f593d709eb53 P 6e4379ca45a84c5d807695a3fef07116: No bootstrap required, opened a new log
I20260709 13:09:50.031360 25664 ts_tablet_manager.cc:1403] T a06a18d1f8c346f2b758f593d709eb53 P 6e4379ca45a84c5d807695a3fef07116: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.008s
I20260709 13:09:50.034469 25664 raft_consensus.cc:359] T a06a18d1f8c346f2b758f593d709eb53 P 6e4379ca45a84c5d807695a3fef07116 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:50.035128 25662 tablet_bootstrap.cc:654] T 1119e418e9964dd1be1dcf47e3fe9734 P 0482fd26e89d4bb89ee847d0108ab167: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:50.035327 25664 raft_consensus.cc:385] T a06a18d1f8c346f2b758f593d709eb53 P 6e4379ca45a84c5d807695a3fef07116 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:50.035655 25664 raft_consensus.cc:740] T a06a18d1f8c346f2b758f593d709eb53 P 6e4379ca45a84c5d807695a3fef07116 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e4379ca45a84c5d807695a3fef07116, State: Initialized, Role: FOLLOWER
I20260709 13:09:50.036466 25664 consensus_queue.cc:260] T a06a18d1f8c346f2b758f593d709eb53 P 6e4379ca45a84c5d807695a3fef07116 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:50.038630 25664 ts_tablet_manager.cc:1434] T a06a18d1f8c346f2b758f593d709eb53 P 6e4379ca45a84c5d807695a3fef07116: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:09:50.040040 25664 tablet_bootstrap.cc:492] T cc05b0de0de04e64a129f5138acaf446 P 6e4379ca45a84c5d807695a3fef07116: Bootstrap starting.
I20260709 13:09:50.040515 25662 tablet_bootstrap.cc:492] T 1119e418e9964dd1be1dcf47e3fe9734 P 0482fd26e89d4bb89ee847d0108ab167: No bootstrap required, opened a new log
I20260709 13:09:50.041136 25662 ts_tablet_manager.cc:1403] T 1119e418e9964dd1be1dcf47e3fe9734 P 0482fd26e89d4bb89ee847d0108ab167: Time spent bootstrapping tablet: real 0.014s	user 0.009s	sys 0.003s
I20260709 13:09:50.044296 25670 raft_consensus.cc:493] T ffbf01eb3ff0482fb5f922a5b0a77a83 P 0482fd26e89d4bb89ee847d0108ab167 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:50.044145 25662 raft_consensus.cc:359] T 1119e418e9964dd1be1dcf47e3fe9734 P 0482fd26e89d4bb89ee847d0108ab167 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:50.045038 25666 raft_consensus.cc:493] T ffbf01eb3ff0482fb5f922a5b0a77a83 P a8545e52c3ee4ac691870228228b4fa5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:50.045054 25662 raft_consensus.cc:385] T 1119e418e9964dd1be1dcf47e3fe9734 P 0482fd26e89d4bb89ee847d0108ab167 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:50.044921 25670 raft_consensus.cc:515] T ffbf01eb3ff0482fb5f922a5b0a77a83 P 0482fd26e89d4bb89ee847d0108ab167 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:50.045830 25664 tablet_bootstrap.cc:654] T cc05b0de0de04e64a129f5138acaf446 P 6e4379ca45a84c5d807695a3fef07116: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:50.045666 25666 raft_consensus.cc:515] T ffbf01eb3ff0482fb5f922a5b0a77a83 P a8545e52c3ee4ac691870228228b4fa5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:50.051674 25670 leader_election.cc:290] T ffbf01eb3ff0482fb5f922a5b0a77a83 P 0482fd26e89d4bb89ee847d0108ab167 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8545e52c3ee4ac691870228228b4fa5 (127.14.180.66:35803), 6e4379ca45a84c5d807695a3fef07116 (127.14.180.67:39657)
I20260709 13:09:50.053051 25666 leader_election.cc:290] T ffbf01eb3ff0482fb5f922a5b0a77a83 P a8545e52c3ee4ac691870228228b4fa5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0482fd26e89d4bb89ee847d0108ab167 (127.14.180.65:45331), 6e4379ca45a84c5d807695a3fef07116 (127.14.180.67:39657)
I20260709 13:09:50.053972 25666 raft_consensus.cc:493] T a06a18d1f8c346f2b758f593d709eb53 P a8545e52c3ee4ac691870228228b4fa5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:50.054790 25666 raft_consensus.cc:515] T a06a18d1f8c346f2b758f593d709eb53 P a8545e52c3ee4ac691870228228b4fa5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:50.057541 25662 raft_consensus.cc:740] T 1119e418e9964dd1be1dcf47e3fe9734 P 0482fd26e89d4bb89ee847d0108ab167 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0482fd26e89d4bb89ee847d0108ab167, State: Initialized, Role: FOLLOWER
I20260709 13:09:50.059928 25620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a06a18d1f8c346f2b758f593d709eb53" candidate_uuid: "a8545e52c3ee4ac691870228228b4fa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e4379ca45a84c5d807695a3fef07116" is_pre_election: true
I20260709 13:09:50.060937 25620 raft_consensus.cc:2468] T a06a18d1f8c346f2b758f593d709eb53 P 6e4379ca45a84c5d807695a3fef07116 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8545e52c3ee4ac691870228228b4fa5 in term 0.
I20260709 13:09:50.062141 25472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbf01eb3ff0482fb5f922a5b0a77a83" candidate_uuid: "a8545e52c3ee4ac691870228228b4fa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0482fd26e89d4bb89ee847d0108ab167" is_pre_election: true
I20260709 13:09:50.063026 25472 raft_consensus.cc:2468] T ffbf01eb3ff0482fb5f922a5b0a77a83 P 0482fd26e89d4bb89ee847d0108ab167 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8545e52c3ee4ac691870228228b4fa5 in term 0.
I20260709 13:09:50.063306 25471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a06a18d1f8c346f2b758f593d709eb53" candidate_uuid: "a8545e52c3ee4ac691870228228b4fa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0482fd26e89d4bb89ee847d0108ab167" is_pre_election: true
I20260709 13:09:50.064124 25471 raft_consensus.cc:2468] T a06a18d1f8c346f2b758f593d709eb53 P 0482fd26e89d4bb89ee847d0108ab167 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8545e52c3ee4ac691870228228b4fa5 in term 0.
I20260709 13:09:50.063226 25662 consensus_queue.cc:260] T 1119e418e9964dd1be1dcf47e3fe9734 P 0482fd26e89d4bb89ee847d0108ab167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:50.064654 25511 leader_election.cc:304] T ffbf01eb3ff0482fb5f922a5b0a77a83 P a8545e52c3ee4ac691870228228b4fa5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0482fd26e89d4bb89ee847d0108ab167, a8545e52c3ee4ac691870228228b4fa5; no voters: 
I20260709 13:09:50.065335 25513 leader_election.cc:304] T a06a18d1f8c346f2b758f593d709eb53 P a8545e52c3ee4ac691870228228b4fa5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e4379ca45a84c5d807695a3fef07116, a8545e52c3ee4ac691870228228b4fa5; no voters: 
I20260709 13:09:50.066794 25621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbf01eb3ff0482fb5f922a5b0a77a83" candidate_uuid: "a8545e52c3ee4ac691870228228b4fa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e4379ca45a84c5d807695a3fef07116" is_pre_election: true
I20260709 13:09:50.067611 25621 raft_consensus.cc:2468] T ffbf01eb3ff0482fb5f922a5b0a77a83 P 6e4379ca45a84c5d807695a3fef07116 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8545e52c3ee4ac691870228228b4fa5 in term 0.
I20260709 13:09:50.067986 25664 tablet_bootstrap.cc:492] T cc05b0de0de04e64a129f5138acaf446 P 6e4379ca45a84c5d807695a3fef07116: No bootstrap required, opened a new log
I20260709 13:09:50.068629 25664 ts_tablet_manager.cc:1403] T cc05b0de0de04e64a129f5138acaf446 P 6e4379ca45a84c5d807695a3fef07116: Time spent bootstrapping tablet: real 0.029s	user 0.005s	sys 0.008s
I20260709 13:09:50.069038 25669 raft_consensus.cc:493] T 442972580e8d4c5f9010dd64ba54899b P 6e4379ca45a84c5d807695a3fef07116 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:50.069602 25669 raft_consensus.cc:515] T 442972580e8d4c5f9010dd64ba54899b P 6e4379ca45a84c5d807695a3fef07116 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:50.071321 25666 leader_election.cc:290] T a06a18d1f8c346f2b758f593d709eb53 P a8545e52c3ee4ac691870228228b4fa5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0482fd26e89d4bb89ee847d0108ab167 (127.14.180.65:45331), 6e4379ca45a84c5d807695a3fef07116 (127.14.180.67:39657)
I20260709 13:09:50.071995 25666 raft_consensus.cc:2804] T ffbf01eb3ff0482fb5f922a5b0a77a83 P a8545e52c3ee4ac691870228228b4fa5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:50.072465 25666 raft_consensus.cc:493] T ffbf01eb3ff0482fb5f922a5b0a77a83 P a8545e52c3ee4ac691870228228b4fa5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:50.072957 25666 raft_consensus.cc:3060] T ffbf01eb3ff0482fb5f922a5b0a77a83 P a8545e52c3ee4ac691870228228b4fa5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:50.074487 25546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "442972580e8d4c5f9010dd64ba54899b" candidate_uuid: "6e4379ca45a84c5d807695a3fef07116" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8545e52c3ee4ac691870228228b4fa5" is_pre_election: true
I20260709 13:09:50.075307 25546 raft_consensus.cc:2468] T 442972580e8d4c5f9010dd64ba54899b P a8545e52c3ee4ac691870228228b4fa5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e4379ca45a84c5d807695a3fef07116 in term 0.
I20260709 13:09:50.076975 25584 leader_election.cc:304] T 442972580e8d4c5f9010dd64ba54899b P 6e4379ca45a84c5d807695a3fef07116 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e4379ca45a84c5d807695a3fef07116, a8545e52c3ee4ac691870228228b4fa5; no voters: 
I20260709 13:09:50.077553 25669 leader_election.cc:290] T 442972580e8d4c5f9010dd64ba54899b P 6e4379ca45a84c5d807695a3fef07116 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0482fd26e89d4bb89ee847d0108ab167 (127.14.180.65:45331), a8545e52c3ee4ac691870228228b4fa5 (127.14.180.66:35803)
I20260709 13:09:50.077935 25677 raft_consensus.cc:2804] T 442972580e8d4c5f9010dd64ba54899b P 6e4379ca45a84c5d807695a3fef07116 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:50.078366 25677 raft_consensus.cc:493] T 442972580e8d4c5f9010dd64ba54899b P 6e4379ca45a84c5d807695a3fef07116 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:50.078974 25677 raft_consensus.cc:3060] T 442972580e8d4c5f9010dd64ba54899b P 6e4379ca45a84c5d807695a3fef07116 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:50.079393 25471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "442972580e8d4c5f9010dd64ba54899b" candidate_uuid: "6e4379ca45a84c5d807695a3fef07116" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0482fd26e89d4bb89ee847d0108ab167" is_pre_election: true
I20260709 13:09:50.080132 25471 raft_consensus.cc:2468] T 442972580e8d4c5f9010dd64ba54899b P 0482fd26e89d4bb89ee847d0108ab167 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e4379ca45a84c5d807695a3fef07116 in term 0.
I20260709 13:09:50.082864 25666 raft_consensus.cc:515] T ffbf01eb3ff0482fb5f922a5b0a77a83 P a8545e52c3ee4ac691870228228b4fa5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:50.084717 25662 ts_tablet_manager.cc:1434] T 1119e418e9964dd1be1dcf47e3fe9734 P 0482fd26e89d4bb89ee847d0108ab167: Time spent starting tablet: real 0.043s	user 0.006s	sys 0.001s
I20260709 13:09:50.086130 25471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbf01eb3ff0482fb5f922a5b0a77a83" candidate_uuid: "a8545e52c3ee4ac691870228228b4fa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0482fd26e89d4bb89ee847d0108ab167"
I20260709 13:09:50.086849 25471 raft_consensus.cc:3060] T ffbf01eb3ff0482fb5f922a5b0a77a83 P 0482fd26e89d4bb89ee847d0108ab167 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:50.087321 25677 raft_consensus.cc:515] T 442972580e8d4c5f9010dd64ba54899b P 6e4379ca45a84c5d807695a3fef07116 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:50.087865 25707 raft_consensus.cc:2804] T a06a18d1f8c346f2b758f593d709eb53 P a8545e52c3ee4ac691870228228b4fa5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:50.088428 25707 raft_consensus.cc:493] T a06a18d1f8c346f2b758f593d709eb53 P a8545e52c3ee4ac691870228228b4fa5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:50.088785 25707 raft_consensus.cc:3060] T a06a18d1f8c346f2b758f593d709eb53 P a8545e52c3ee4ac691870228228b4fa5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:50.090929 25472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "442972580e8d4c5f9010dd64ba54899b" candidate_uuid: "6e4379ca45a84c5d807695a3fef07116" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0482fd26e89d4bb89ee847d0108ab167"
I20260709 13:09:50.092013 25472 raft_consensus.cc:3060] T 442972580e8d4c5f9010dd64ba54899b P 0482fd26e89d4bb89ee847d0108ab167 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:50.094244 25546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "442972580e8d4c5f9010dd64ba54899b" candidate_uuid: "6e4379ca45a84c5d807695a3fef07116" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8545e52c3ee4ac691870228228b4fa5"
I20260709 13:09:50.095005 25546 raft_consensus.cc:3060] T 442972580e8d4c5f9010dd64ba54899b P a8545e52c3ee4ac691870228228b4fa5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:50.095909 25662 tablet_bootstrap.cc:492] T cc05b0de0de04e64a129f5138acaf446 P 0482fd26e89d4bb89ee847d0108ab167: Bootstrap starting.
I20260709 13:09:50.098429 25547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbf01eb3ff0482fb5f922a5b0a77a83" candidate_uuid: "0482fd26e89d4bb89ee847d0108ab167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8545e52c3ee4ac691870228228b4fa5" is_pre_election: true
I20260709 13:09:50.099468 25547 raft_consensus.cc:2393] T ffbf01eb3ff0482fb5f922a5b0a77a83 P a8545e52c3ee4ac691870228228b4fa5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0482fd26e89d4bb89ee847d0108ab167 in current term 1: Already voted for candidate a8545e52c3ee4ac691870228228b4fa5 in this term.
I20260709 13:09:50.100903 25707 raft_consensus.cc:515] T a06a18d1f8c346f2b758f593d709eb53 P a8545e52c3ee4ac691870228228b4fa5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:50.104532 25621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a06a18d1f8c346f2b758f593d709eb53" candidate_uuid: "a8545e52c3ee4ac691870228228b4fa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e4379ca45a84c5d807695a3fef07116"
I20260709 13:09:50.105193 25621 raft_consensus.cc:3060] T a06a18d1f8c346f2b758f593d709eb53 P 6e4379ca45a84c5d807695a3fef07116 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:50.106257 25546 raft_consensus.cc:2468] T 442972580e8d4c5f9010dd64ba54899b P a8545e52c3ee4ac691870228228b4fa5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e4379ca45a84c5d807695a3fef07116 in term 1.
I20260709 13:09:50.104427 25470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a06a18d1f8c346f2b758f593d709eb53" candidate_uuid: "a8545e52c3ee4ac691870228228b4fa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0482fd26e89d4bb89ee847d0108ab167"
I20260709 13:09:50.108855 25470 raft_consensus.cc:3060] T a06a18d1f8c346f2b758f593d709eb53 P 0482fd26e89d4bb89ee847d0108ab167 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:50.110605 25666 leader_election.cc:290] T ffbf01eb3ff0482fb5f922a5b0a77a83 P a8545e52c3ee4ac691870228228b4fa5 [CANDIDATE]: Term 1 election: Requested vote from peers 0482fd26e89d4bb89ee847d0108ab167 (127.14.180.65:45331), 6e4379ca45a84c5d807695a3fef07116 (127.14.180.67:39657)
I20260709 13:09:50.111369 25471 raft_consensus.cc:2468] T ffbf01eb3ff0482fb5f922a5b0a77a83 P 0482fd26e89d4bb89ee847d0108ab167 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8545e52c3ee4ac691870228228b4fa5 in term 1.
I20260709 13:09:50.112986 25662 tablet_bootstrap.cc:654] T cc05b0de0de04e64a129f5138acaf446 P 0482fd26e89d4bb89ee847d0108ab167: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:50.116055 25620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbf01eb3ff0482fb5f922a5b0a77a83" candidate_uuid: "a8545e52c3ee4ac691870228228b4fa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e4379ca45a84c5d807695a3fef07116"
I20260709 13:09:50.116837 25620 raft_consensus.cc:3060] T ffbf01eb3ff0482fb5f922a5b0a77a83 P 6e4379ca45a84c5d807695a3fef07116 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:50.116858 25511 leader_election.cc:304] T ffbf01eb3ff0482fb5f922a5b0a77a83 P a8545e52c3ee4ac691870228228b4fa5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0482fd26e89d4bb89ee847d0108ab167, a8545e52c3ee4ac691870228228b4fa5; no voters: 
I20260709 13:09:50.118124 25670 raft_consensus.cc:493] T 11ad0defd0924408a16ee3f7a8a60106 P 0482fd26e89d4bb89ee847d0108ab167 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:50.118674 25677 leader_election.cc:290] T 442972580e8d4c5f9010dd64ba54899b P 6e4379ca45a84c5d807695a3fef07116 [CANDIDATE]: Term 1 election: Requested vote from peers 0482fd26e89d4bb89ee847d0108ab167 (127.14.180.65:45331), a8545e52c3ee4ac691870228228b4fa5 (127.14.180.66:35803)
I20260709 13:09:50.071599 25664 raft_consensus.cc:359] T cc05b0de0de04e64a129f5138acaf446 P 6e4379ca45a84c5d807695a3fef07116 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:50.118780 25670 raft_consensus.cc:515] T 11ad0defd0924408a16ee3f7a8a60106 P 0482fd26e89d4bb89ee847d0108ab167 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:50.119484 25664 raft_consensus.cc:385] T cc05b0de0de04e64a129f5138acaf446 P 6e4379ca45a84c5d807695a3fef07116 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:50.119777 25664 raft_consensus.cc:740] T cc05b0de0de04e64a129f5138acaf446 P 6e4379ca45a84c5d807695a3fef07116 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e4379ca45a84c5d807695a3fef07116, State: Initialized, Role: FOLLOWER
I20260709 13:09:50.119848 25472 raft_consensus.cc:2468] T 442972580e8d4c5f9010dd64ba54899b P 0482fd26e89d4bb89ee847d0108ab167 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e4379ca45a84c5d807695a3fef07116 in term 1.
I20260709 13:09:50.121479 25585 leader_election.cc:304] T 442972580e8d4c5f9010dd64ba54899b P 6e4379ca45a84c5d807695a3fef07116 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0482fd26e89d4bb89ee847d0108ab167, 6e4379ca45a84c5d807695a3fef07116; no voters: 
I20260709 13:09:50.121744 25670 leader_election.cc:290] T 11ad0defd0924408a16ee3f7a8a60106 P 0482fd26e89d4bb89ee847d0108ab167 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8545e52c3ee4ac691870228228b4fa5 (127.14.180.66:35803), 6e4379ca45a84c5d807695a3fef07116 (127.14.180.67:39657)
I20260709 13:09:50.122174 25547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ad0defd0924408a16ee3f7a8a60106" candidate_uuid: "0482fd26e89d4bb89ee847d0108ab167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8545e52c3ee4ac691870228228b4fa5" is_pre_election: true
I20260709 13:09:50.122635 25666 raft_consensus.cc:2804] T ffbf01eb3ff0482fb5f922a5b0a77a83 P a8545e52c3ee4ac691870228228b4fa5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:50.123140 25547 raft_consensus.cc:2468] T 11ad0defd0924408a16ee3f7a8a60106 P a8545e52c3ee4ac691870228228b4fa5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0482fd26e89d4bb89ee847d0108ab167 in term 0.
I20260709 13:09:50.124042 25677 raft_consensus.cc:2804] T 442972580e8d4c5f9010dd64ba54899b P 6e4379ca45a84c5d807695a3fef07116 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:50.125084 25435 leader_election.cc:304] T 11ad0defd0924408a16ee3f7a8a60106 P 0482fd26e89d4bb89ee847d0108ab167 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0482fd26e89d4bb89ee847d0108ab167, a8545e52c3ee4ac691870228228b4fa5; no voters: 
I20260709 13:09:50.126341 25670 raft_consensus.cc:2804] T 11ad0defd0924408a16ee3f7a8a60106 P 0482fd26e89d4bb89ee847d0108ab167 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:50.126945 25670 raft_consensus.cc:493] T 11ad0defd0924408a16ee3f7a8a60106 P 0482fd26e89d4bb89ee847d0108ab167 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:50.120709 25664 consensus_queue.cc:260] T cc05b0de0de04e64a129f5138acaf446 P 6e4379ca45a84c5d807695a3fef07116 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:50.127350 25670 raft_consensus.cc:3060] T 11ad0defd0924408a16ee3f7a8a60106 P 0482fd26e89d4bb89ee847d0108ab167 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:50.129107 25664 ts_tablet_manager.cc:1434] T cc05b0de0de04e64a129f5138acaf446 P 6e4379ca45a84c5d807695a3fef07116: Time spent starting tablet: real 0.060s	user 0.005s	sys 0.002s
I20260709 13:09:50.129659 25472 raft_consensus.cc:3060] T b6d563892443429682cba0bba950c7d7 P 0482fd26e89d4bb89ee847d0108ab167 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:50.130525 25677 raft_consensus.cc:697] T 442972580e8d4c5f9010dd64ba54899b P 6e4379ca45a84c5d807695a3fef07116 [term 1 LEADER]: Becoming Leader. State: Replica: 6e4379ca45a84c5d807695a3fef07116, State: Running, Role: LEADER
I20260709 13:09:50.131609 25677 consensus_queue.cc:237] T 442972580e8d4c5f9010dd64ba54899b P 6e4379ca45a84c5d807695a3fef07116 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:50.132509 25470 raft_consensus.cc:2468] T a06a18d1f8c346f2b758f593d709eb53 P 0482fd26e89d4bb89ee847d0108ab167 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8545e52c3ee4ac691870228228b4fa5 in term 1.
I20260709 13:09:50.123287 25666 raft_consensus.cc:697] T ffbf01eb3ff0482fb5f922a5b0a77a83 P a8545e52c3ee4ac691870228228b4fa5 [term 1 LEADER]: Becoming Leader. State: Replica: a8545e52c3ee4ac691870228228b4fa5, State: Running, Role: LEADER
I20260709 13:09:50.134006 25511 leader_election.cc:304] T a06a18d1f8c346f2b758f593d709eb53 P a8545e52c3ee4ac691870228228b4fa5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0482fd26e89d4bb89ee847d0108ab167, a8545e52c3ee4ac691870228228b4fa5; no voters: 
I20260709 13:09:50.134588 25666 consensus_queue.cc:237] T ffbf01eb3ff0482fb5f922a5b0a77a83 P a8545e52c3ee4ac691870228228b4fa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:50.135305 25711 raft_consensus.cc:2804] T a06a18d1f8c346f2b758f593d709eb53 P a8545e52c3ee4ac691870228228b4fa5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:50.136701 25707 leader_election.cc:290] T a06a18d1f8c346f2b758f593d709eb53 P a8545e52c3ee4ac691870228228b4fa5 [CANDIDATE]: Term 1 election: Requested vote from peers 0482fd26e89d4bb89ee847d0108ab167 (127.14.180.65:45331), 6e4379ca45a84c5d807695a3fef07116 (127.14.180.67:39657)
I20260709 13:09:50.137535 25621 raft_consensus.cc:2468] T a06a18d1f8c346f2b758f593d709eb53 P 6e4379ca45a84c5d807695a3fef07116 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8545e52c3ee4ac691870228228b4fa5 in term 1.
I20260709 13:09:50.139770 25670 raft_consensus.cc:515] T 11ad0defd0924408a16ee3f7a8a60106 P 0482fd26e89d4bb89ee847d0108ab167 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:50.142310 25619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbf01eb3ff0482fb5f922a5b0a77a83" candidate_uuid: "0482fd26e89d4bb89ee847d0108ab167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e4379ca45a84c5d807695a3fef07116" is_pre_election: true
I20260709 13:09:50.142481 25618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ad0defd0924408a16ee3f7a8a60106" candidate_uuid: "0482fd26e89d4bb89ee847d0108ab167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e4379ca45a84c5d807695a3fef07116" is_pre_election: true
I20260709 13:09:50.126286 25620 raft_consensus.cc:2468] T ffbf01eb3ff0482fb5f922a5b0a77a83 P 6e4379ca45a84c5d807695a3fef07116 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8545e52c3ee4ac691870228228b4fa5 in term 1.
I20260709 13:09:50.143076 25546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ad0defd0924408a16ee3f7a8a60106" candidate_uuid: "0482fd26e89d4bb89ee847d0108ab167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8545e52c3ee4ac691870228228b4fa5"
I20260709 13:09:50.143296 25618 raft_consensus.cc:2468] T 11ad0defd0924408a16ee3f7a8a60106 P 6e4379ca45a84c5d807695a3fef07116 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0482fd26e89d4bb89ee847d0108ab167 in term 0.
I20260709 13:09:50.143749 25546 raft_consensus.cc:3060] T 11ad0defd0924408a16ee3f7a8a60106 P a8545e52c3ee4ac691870228228b4fa5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:50.144263 25438 leader_election.cc:304] T ffbf01eb3ff0482fb5f922a5b0a77a83 P 0482fd26e89d4bb89ee847d0108ab167 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0482fd26e89d4bb89ee847d0108ab167; no voters: 6e4379ca45a84c5d807695a3fef07116, a8545e52c3ee4ac691870228228b4fa5
I20260709 13:09:50.145092 25670 leader_election.cc:290] T 11ad0defd0924408a16ee3f7a8a60106 P 0482fd26e89d4bb89ee847d0108ab167 [CANDIDATE]: Term 1 election: Requested vote from peers a8545e52c3ee4ac691870228228b4fa5 (127.14.180.66:35803), 6e4379ca45a84c5d807695a3fef07116 (127.14.180.67:39657)
I20260709 13:09:50.145752 25670 raft_consensus.cc:2749] T ffbf01eb3ff0482fb5f922a5b0a77a83 P 0482fd26e89d4bb89ee847d0108ab167 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:50.150074 25678 consensus_queue.cc:1048] T b6d563892443429682cba0bba950c7d7 P 6e4379ca45a84c5d807695a3fef07116 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:50.155467 25662 tablet_bootstrap.cc:492] T cc05b0de0de04e64a129f5138acaf446 P 0482fd26e89d4bb89ee847d0108ab167: No bootstrap required, opened a new log
I20260709 13:09:50.156227 25662 ts_tablet_manager.cc:1403] T cc05b0de0de04e64a129f5138acaf446 P 0482fd26e89d4bb89ee847d0108ab167: Time spent bootstrapping tablet: real 0.061s	user 0.021s	sys 0.003s
I20260709 13:09:50.155354 25711 raft_consensus.cc:697] T a06a18d1f8c346f2b758f593d709eb53 P a8545e52c3ee4ac691870228228b4fa5 [term 1 LEADER]: Becoming Leader. State: Replica: a8545e52c3ee4ac691870228228b4fa5, State: Running, Role: LEADER
I20260709 13:09:50.158306 25620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ad0defd0924408a16ee3f7a8a60106" candidate_uuid: "0482fd26e89d4bb89ee847d0108ab167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e4379ca45a84c5d807695a3fef07116"
I20260709 13:09:50.159329 25620 raft_consensus.cc:3060] T 11ad0defd0924408a16ee3f7a8a60106 P 6e4379ca45a84c5d807695a3fef07116 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:50.161537 25662 raft_consensus.cc:359] T cc05b0de0de04e64a129f5138acaf446 P 0482fd26e89d4bb89ee847d0108ab167 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:50.165493 25662 raft_consensus.cc:385] T cc05b0de0de04e64a129f5138acaf446 P 0482fd26e89d4bb89ee847d0108ab167 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:50.165917 25662 raft_consensus.cc:740] T cc05b0de0de04e64a129f5138acaf446 P 0482fd26e89d4bb89ee847d0108ab167 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0482fd26e89d4bb89ee847d0108ab167, State: Initialized, Role: FOLLOWER
I20260709 13:09:50.158381 25711 consensus_queue.cc:237] T a06a18d1f8c346f2b758f593d709eb53 P a8545e52c3ee4ac691870228228b4fa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:50.169513 25662 consensus_queue.cc:260] T cc05b0de0de04e64a129f5138acaf446 P 0482fd26e89d4bb89ee847d0108ab167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:50.171244 25620 raft_consensus.cc:2468] T 11ad0defd0924408a16ee3f7a8a60106 P 6e4379ca45a84c5d807695a3fef07116 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0482fd26e89d4bb89ee847d0108ab167 in term 1.
I20260709 13:09:50.172313 25662 ts_tablet_manager.cc:1434] T cc05b0de0de04e64a129f5138acaf446 P 0482fd26e89d4bb89ee847d0108ab167: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:09:50.158661 25546 raft_consensus.cc:2468] T 11ad0defd0924408a16ee3f7a8a60106 P a8545e52c3ee4ac691870228228b4fa5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0482fd26e89d4bb89ee847d0108ab167 in term 1.
I20260709 13:09:50.172847 25438 leader_election.cc:304] T 11ad0defd0924408a16ee3f7a8a60106 P 0482fd26e89d4bb89ee847d0108ab167 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0482fd26e89d4bb89ee847d0108ab167, 6e4379ca45a84c5d807695a3fef07116; no voters: 
I20260709 13:09:50.174613 25670 raft_consensus.cc:2804] T 11ad0defd0924408a16ee3f7a8a60106 P 0482fd26e89d4bb89ee847d0108ab167 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:50.175374 25670 raft_consensus.cc:697] T 11ad0defd0924408a16ee3f7a8a60106 P 0482fd26e89d4bb89ee847d0108ab167 [term 1 LEADER]: Becoming Leader. State: Replica: 0482fd26e89d4bb89ee847d0108ab167, State: Running, Role: LEADER
I20260709 13:09:50.175473 25367 catalog_manager.cc:5697] T ffbf01eb3ff0482fb5f922a5b0a77a83 P a8545e52c3ee4ac691870228228b4fa5 reported cstate change: term changed from 0 to 1, leader changed from <none> to a8545e52c3ee4ac691870228228b4fa5 (127.14.180.66). New cstate: current_term: 1 leader_uuid: "a8545e52c3ee4ac691870228228b4fa5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:50.176837 25670 consensus_queue.cc:237] T 11ad0defd0924408a16ee3f7a8a60106 P 0482fd26e89d4bb89ee847d0108ab167 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:50.179790 25677 raft_consensus.cc:493] T 1119e418e9964dd1be1dcf47e3fe9734 P 6e4379ca45a84c5d807695a3fef07116 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:50.180297 25678 consensus_queue.cc:1048] T b6d563892443429682cba0bba950c7d7 P 6e4379ca45a84c5d807695a3fef07116 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:50.180732 25677 raft_consensus.cc:515] T 1119e418e9964dd1be1dcf47e3fe9734 P 6e4379ca45a84c5d807695a3fef07116 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:50.187026 25472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1119e418e9964dd1be1dcf47e3fe9734" candidate_uuid: "6e4379ca45a84c5d807695a3fef07116" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0482fd26e89d4bb89ee847d0108ab167" is_pre_election: true
I20260709 13:09:50.188169 25472 raft_consensus.cc:2468] T 1119e418e9964dd1be1dcf47e3fe9734 P 0482fd26e89d4bb89ee847d0108ab167 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e4379ca45a84c5d807695a3fef07116 in term 0.
I20260709 13:09:50.191928 25585 leader_election.cc:304] T 1119e418e9964dd1be1dcf47e3fe9734 P 6e4379ca45a84c5d807695a3fef07116 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0482fd26e89d4bb89ee847d0108ab167, 6e4379ca45a84c5d807695a3fef07116; no voters: 
I20260709 13:09:50.193861 25677 leader_election.cc:290] T 1119e418e9964dd1be1dcf47e3fe9734 P 6e4379ca45a84c5d807695a3fef07116 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0482fd26e89d4bb89ee847d0108ab167 (127.14.180.65:45331), a8545e52c3ee4ac691870228228b4fa5 (127.14.180.66:35803)
I20260709 13:09:50.194703 25677 raft_consensus.cc:2804] T 1119e418e9964dd1be1dcf47e3fe9734 P 6e4379ca45a84c5d807695a3fef07116 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:50.195214 25677 raft_consensus.cc:493] T 1119e418e9964dd1be1dcf47e3fe9734 P 6e4379ca45a84c5d807695a3fef07116 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:50.195672 25677 raft_consensus.cc:3060] T 1119e418e9964dd1be1dcf47e3fe9734 P 6e4379ca45a84c5d807695a3fef07116 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:50.197093 25547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1119e418e9964dd1be1dcf47e3fe9734" candidate_uuid: "6e4379ca45a84c5d807695a3fef07116" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8545e52c3ee4ac691870228228b4fa5" is_pre_election: true
I20260709 13:09:50.198169 25547 raft_consensus.cc:2468] T 1119e418e9964dd1be1dcf47e3fe9734 P a8545e52c3ee4ac691870228228b4fa5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e4379ca45a84c5d807695a3fef07116 in term 0.
I20260709 13:09:50.204857 25369 catalog_manager.cc:5697] T 442972580e8d4c5f9010dd64ba54899b P 6e4379ca45a84c5d807695a3fef07116 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6e4379ca45a84c5d807695a3fef07116 (127.14.180.67). New cstate: current_term: 1 leader_uuid: "6e4379ca45a84c5d807695a3fef07116" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:50.208441 25677 raft_consensus.cc:515] T 1119e418e9964dd1be1dcf47e3fe9734 P 6e4379ca45a84c5d807695a3fef07116 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:50.212327 25472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1119e418e9964dd1be1dcf47e3fe9734" candidate_uuid: "6e4379ca45a84c5d807695a3fef07116" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0482fd26e89d4bb89ee847d0108ab167"
I20260709 13:09:50.213223 25472 raft_consensus.cc:3060] T 1119e418e9964dd1be1dcf47e3fe9734 P 0482fd26e89d4bb89ee847d0108ab167 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:50.220885 25547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1119e418e9964dd1be1dcf47e3fe9734" candidate_uuid: "6e4379ca45a84c5d807695a3fef07116" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8545e52c3ee4ac691870228228b4fa5"
I20260709 13:09:50.221408 25678 raft_consensus.cc:493] T 64e29ee66f22432c82e5772ee79dd918 P 6e4379ca45a84c5d807695a3fef07116 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:50.223147 25714 raft_consensus.cc:493] T cc05b0de0de04e64a129f5138acaf446 P 0482fd26e89d4bb89ee847d0108ab167 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:50.223253 25678 raft_consensus.cc:515] T 64e29ee66f22432c82e5772ee79dd918 P 6e4379ca45a84c5d807695a3fef07116 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:50.224172 25714 raft_consensus.cc:515] T cc05b0de0de04e64a129f5138acaf446 P 0482fd26e89d4bb89ee847d0108ab167 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:50.228080 25471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e29ee66f22432c82e5772ee79dd918" candidate_uuid: "6e4379ca45a84c5d807695a3fef07116" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0482fd26e89d4bb89ee847d0108ab167" is_pre_election: true
I20260709 13:09:50.228868 25471 raft_consensus.cc:2468] T 64e29ee66f22432c82e5772ee79dd918 P 0482fd26e89d4bb89ee847d0108ab167 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e4379ca45a84c5d807695a3fef07116 in term 0.
I20260709 13:09:50.230454 25585 leader_election.cc:304] T 64e29ee66f22432c82e5772ee79dd918 P 6e4379ca45a84c5d807695a3fef07116 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0482fd26e89d4bb89ee847d0108ab167, 6e4379ca45a84c5d807695a3fef07116; no voters: 
I20260709 13:09:50.231689 25666 raft_consensus.cc:493] T cc05b0de0de04e64a129f5138acaf446 P a8545e52c3ee4ac691870228228b4fa5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:50.233115 25678 leader_election.cc:290] T 64e29ee66f22432c82e5772ee79dd918 P 6e4379ca45a84c5d807695a3fef07116 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0482fd26e89d4bb89ee847d0108ab167 (127.14.180.65:45331), a8545e52c3ee4ac691870228228b4fa5 (127.14.180.66:35803)
I20260709 13:09:50.232667 25666 raft_consensus.cc:515] T cc05b0de0de04e64a129f5138acaf446 P a8545e52c3ee4ac691870228228b4fa5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:50.231609 25669 raft_consensus.cc:2804] T 64e29ee66f22432c82e5772ee79dd918 P 6e4379ca45a84c5d807695a3fef07116 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:50.234810 25669 raft_consensus.cc:493] T 64e29ee66f22432c82e5772ee79dd918 P 6e4379ca45a84c5d807695a3fef07116 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:50.235419 25669 raft_consensus.cc:3060] T 64e29ee66f22432c82e5772ee79dd918 P 6e4379ca45a84c5d807695a3fef07116 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:50.235710 25677 leader_election.cc:290] T 1119e418e9964dd1be1dcf47e3fe9734 P 6e4379ca45a84c5d807695a3fef07116 [CANDIDATE]: Term 1 election: Requested vote from peers 0482fd26e89d4bb89ee847d0108ab167 (127.14.180.65:45331), a8545e52c3ee4ac691870228228b4fa5 (127.14.180.66:35803)
I20260709 13:09:50.239423 25545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e29ee66f22432c82e5772ee79dd918" candidate_uuid: "6e4379ca45a84c5d807695a3fef07116" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8545e52c3ee4ac691870228228b4fa5" is_pre_election: true
I20260709 13:09:50.240726 25545 raft_consensus.cc:2468] T 64e29ee66f22432c82e5772ee79dd918 P a8545e52c3ee4ac691870228228b4fa5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e4379ca45a84c5d807695a3fef07116 in term 0.
I20260709 13:09:50.245314 25677 raft_consensus.cc:493] T cc05b0de0de04e64a129f5138acaf446 P 6e4379ca45a84c5d807695a3fef07116 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:50.246033 25677 raft_consensus.cc:515] T cc05b0de0de04e64a129f5138acaf446 P 6e4379ca45a84c5d807695a3fef07116 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:50.248684 25666 leader_election.cc:290] T cc05b0de0de04e64a129f5138acaf446 P a8545e52c3ee4ac691870228228b4fa5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0482fd26e89d4bb89ee847d0108ab167 (127.14.180.65:45331), 6e4379ca45a84c5d807695a3fef07116 (127.14.180.67:39657)
I20260709 13:09:50.250382 25620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc05b0de0de04e64a129f5138acaf446" candidate_uuid: "a8545e52c3ee4ac691870228228b4fa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e4379ca45a84c5d807695a3fef07116" is_pre_election: true
I20260709 13:09:50.251611 25620 raft_consensus.cc:2468] T cc05b0de0de04e64a129f5138acaf446 P 6e4379ca45a84c5d807695a3fef07116 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8545e52c3ee4ac691870228228b4fa5 in term 0.
I20260709 13:09:50.253484 25513 leader_election.cc:304] T cc05b0de0de04e64a129f5138acaf446 P a8545e52c3ee4ac691870228228b4fa5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e4379ca45a84c5d807695a3fef07116, a8545e52c3ee4ac691870228228b4fa5; no voters: 
I20260709 13:09:50.222226 25547 raft_consensus.cc:3060] T 1119e418e9964dd1be1dcf47e3fe9734 P a8545e52c3ee4ac691870228228b4fa5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:50.254191 25471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc05b0de0de04e64a129f5138acaf446" candidate_uuid: "6e4379ca45a84c5d807695a3fef07116" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0482fd26e89d4bb89ee847d0108ab167" is_pre_election: true
I20260709 13:09:50.254777 25666 raft_consensus.cc:2804] T cc05b0de0de04e64a129f5138acaf446 P a8545e52c3ee4ac691870228228b4fa5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:50.255527 25666 raft_consensus.cc:493] T cc05b0de0de04e64a129f5138acaf446 P a8545e52c3ee4ac691870228228b4fa5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:50.255344 25471 raft_consensus.cc:2468] T cc05b0de0de04e64a129f5138acaf446 P 0482fd26e89d4bb89ee847d0108ab167 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e4379ca45a84c5d807695a3fef07116 in term 0.
I20260709 13:09:50.256297 25666 raft_consensus.cc:3060] T cc05b0de0de04e64a129f5138acaf446 P a8545e52c3ee4ac691870228228b4fa5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:50.257634 25585 leader_election.cc:304] T cc05b0de0de04e64a129f5138acaf446 P 6e4379ca45a84c5d807695a3fef07116 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0482fd26e89d4bb89ee847d0108ab167, 6e4379ca45a84c5d807695a3fef07116; no voters: 
I20260709 13:09:50.259063 25678 raft_consensus.cc:2804] T cc05b0de0de04e64a129f5138acaf446 P 6e4379ca45a84c5d807695a3fef07116 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:50.259630 25678 raft_consensus.cc:493] T cc05b0de0de04e64a129f5138acaf446 P 6e4379ca45a84c5d807695a3fef07116 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:50.260121 25678 raft_consensus.cc:3060] T cc05b0de0de04e64a129f5138acaf446 P 6e4379ca45a84c5d807695a3fef07116 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:50.264984 25369 catalog_manager.cc:5697] T 11ad0defd0924408a16ee3f7a8a60106 P 0482fd26e89d4bb89ee847d0108ab167 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0482fd26e89d4bb89ee847d0108ab167 (127.14.180.65). New cstate: current_term: 1 leader_uuid: "0482fd26e89d4bb89ee847d0108ab167" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:50.265013 25666 raft_consensus.cc:515] T cc05b0de0de04e64a129f5138acaf446 P a8545e52c3ee4ac691870228228b4fa5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:50.273152 25678 raft_consensus.cc:515] T cc05b0de0de04e64a129f5138acaf446 P 6e4379ca45a84c5d807695a3fef07116 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:50.275754 25666 leader_election.cc:290] T cc05b0de0de04e64a129f5138acaf446 P a8545e52c3ee4ac691870228228b4fa5 [CANDIDATE]: Term 1 election: Requested vote from peers 0482fd26e89d4bb89ee847d0108ab167 (127.14.180.65:45331), 6e4379ca45a84c5d807695a3fef07116 (127.14.180.67:39657)
I20260709 13:09:50.275892 25620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc05b0de0de04e64a129f5138acaf446" candidate_uuid: "a8545e52c3ee4ac691870228228b4fa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e4379ca45a84c5d807695a3fef07116"
I20260709 13:09:50.277623 25620 raft_consensus.cc:2393] T cc05b0de0de04e64a129f5138acaf446 P 6e4379ca45a84c5d807695a3fef07116 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a8545e52c3ee4ac691870228228b4fa5 in current term 1: Already voted for candidate 6e4379ca45a84c5d807695a3fef07116 in this term.
I20260709 13:09:50.281216 25677 leader_election.cc:290] T cc05b0de0de04e64a129f5138acaf446 P 6e4379ca45a84c5d807695a3fef07116 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0482fd26e89d4bb89ee847d0108ab167 (127.14.180.65:45331), a8545e52c3ee4ac691870228228b4fa5 (127.14.180.66:35803)
I20260709 13:09:50.283411 25545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc05b0de0de04e64a129f5138acaf446" candidate_uuid: "6e4379ca45a84c5d807695a3fef07116" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8545e52c3ee4ac691870228228b4fa5" is_pre_election: true
I20260709 13:09:50.284760 25545 raft_consensus.cc:2393] T cc05b0de0de04e64a129f5138acaf446 P a8545e52c3ee4ac691870228228b4fa5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e4379ca45a84c5d807695a3fef07116 in current term 1: Already voted for candidate a8545e52c3ee4ac691870228228b4fa5 in this term.
I20260709 13:09:50.300945 25678 leader_election.cc:290] T cc05b0de0de04e64a129f5138acaf446 P 6e4379ca45a84c5d807695a3fef07116 [CANDIDATE]: Term 1 election: Requested vote from peers 0482fd26e89d4bb89ee847d0108ab167 (127.14.180.65:45331), a8545e52c3ee4ac691870228228b4fa5 (127.14.180.66:35803)
I20260709 13:09:50.303056 25545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc05b0de0de04e64a129f5138acaf446" candidate_uuid: "0482fd26e89d4bb89ee847d0108ab167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8545e52c3ee4ac691870228228b4fa5" is_pre_election: true
I20260709 13:09:50.304325 25545 raft_consensus.cc:2393] T cc05b0de0de04e64a129f5138acaf446 P a8545e52c3ee4ac691870228228b4fa5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0482fd26e89d4bb89ee847d0108ab167 in current term 1: Already voted for candidate a8545e52c3ee4ac691870228228b4fa5 in this term.
I20260709 13:09:50.312040 25620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc05b0de0de04e64a129f5138acaf446" candidate_uuid: "0482fd26e89d4bb89ee847d0108ab167" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e4379ca45a84c5d807695a3fef07116" is_pre_election: true
I20260709 13:09:50.313328 25620 raft_consensus.cc:2393] T cc05b0de0de04e64a129f5138acaf446 P 6e4379ca45a84c5d807695a3fef07116 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0482fd26e89d4bb89ee847d0108ab167 in current term 1: Already voted for candidate 6e4379ca45a84c5d807695a3fef07116 in this term.
I20260709 13:09:50.313711 25472 raft_consensus.cc:2468] T 1119e418e9964dd1be1dcf47e3fe9734 P 0482fd26e89d4bb89ee847d0108ab167 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e4379ca45a84c5d807695a3fef07116 in term 1.
I20260709 13:09:50.315068 25714 leader_election.cc:290] T cc05b0de0de04e64a129f5138acaf446 P 0482fd26e89d4bb89ee847d0108ab167 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8545e52c3ee4ac691870228228b4fa5 (127.14.180.66:35803), 6e4379ca45a84c5d807695a3fef07116 (127.14.180.67:39657)
I20260709 13:09:50.315236 25438 leader_election.cc:304] T cc05b0de0de04e64a129f5138acaf446 P 0482fd26e89d4bb89ee847d0108ab167 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0482fd26e89d4bb89ee847d0108ab167; no voters: 6e4379ca45a84c5d807695a3fef07116, a8545e52c3ee4ac691870228228b4fa5
I20260709 13:09:50.322849 25545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc05b0de0de04e64a129f5138acaf446" candidate_uuid: "6e4379ca45a84c5d807695a3fef07116" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8545e52c3ee4ac691870228228b4fa5"
I20260709 13:09:50.326504 25545 raft_consensus.cc:2393] T cc05b0de0de04e64a129f5138acaf446 P a8545e52c3ee4ac691870228228b4fa5 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e4379ca45a84c5d807695a3fef07116 in current term 1: Already voted for candidate a8545e52c3ee4ac691870228228b4fa5 in this term.
I20260709 13:09:50.273414 25669 raft_consensus.cc:515] T 64e29ee66f22432c82e5772ee79dd918 P 6e4379ca45a84c5d807695a3fef07116 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:50.330200 25724 consensus_queue.cc:1048] T d0cd92d7306d4ed695dc084aabbfb995 P 6e4379ca45a84c5d807695a3fef07116 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:50.331875 25669 leader_election.cc:290] T 64e29ee66f22432c82e5772ee79dd918 P 6e4379ca45a84c5d807695a3fef07116 [CANDIDATE]: Term 1 election: Requested vote from peers 0482fd26e89d4bb89ee847d0108ab167 (127.14.180.65:45331), a8545e52c3ee4ac691870228228b4fa5 (127.14.180.66:35803)
I20260709 13:09:50.339010 25545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e29ee66f22432c82e5772ee79dd918" candidate_uuid: "6e4379ca45a84c5d807695a3fef07116" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8545e52c3ee4ac691870228228b4fa5"
I20260709 13:09:50.339807 25545 raft_consensus.cc:3060] T 64e29ee66f22432c82e5772ee79dd918 P a8545e52c3ee4ac691870228228b4fa5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:50.349469 25714 raft_consensus.cc:3060] T cc05b0de0de04e64a129f5138acaf446 P 0482fd26e89d4bb89ee847d0108ab167 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:50.356226 25547 raft_consensus.cc:2468] T 1119e418e9964dd1be1dcf47e3fe9734 P a8545e52c3ee4ac691870228228b4fa5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e4379ca45a84c5d807695a3fef07116 in term 1.
I20260709 13:09:50.359395 25584 leader_election.cc:304] T 1119e418e9964dd1be1dcf47e3fe9734 P 6e4379ca45a84c5d807695a3fef07116 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e4379ca45a84c5d807695a3fef07116, a8545e52c3ee4ac691870228228b4fa5; no voters: 
I20260709 13:09:50.364215 25470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc05b0de0de04e64a129f5138acaf446" candidate_uuid: "a8545e52c3ee4ac691870228228b4fa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0482fd26e89d4bb89ee847d0108ab167" is_pre_election: true
I20260709 13:09:50.364493 25471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc05b0de0de04e64a129f5138acaf446" candidate_uuid: "a8545e52c3ee4ac691870228228b4fa5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0482fd26e89d4bb89ee847d0108ab167"
I20260709 13:09:50.366081 25511 leader_election.cc:304] T cc05b0de0de04e64a129f5138acaf446 P a8545e52c3ee4ac691870228228b4fa5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8545e52c3ee4ac691870228228b4fa5; no voters: 0482fd26e89d4bb89ee847d0108ab167, 6e4379ca45a84c5d807695a3fef07116
I20260709 13:09:50.368059 25666 raft_consensus.cc:2749] T cc05b0de0de04e64a129f5138acaf446 P a8545e52c3ee4ac691870228228b4fa5 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:09:50.368330 25369 catalog_manager.cc:5697] T a06a18d1f8c346f2b758f593d709eb53 P a8545e52c3ee4ac691870228228b4fa5 reported cstate change: term changed from 0 to 1, leader changed from <none> to a8545e52c3ee4ac691870228228b4fa5 (127.14.180.66). New cstate: current_term: 1 leader_uuid: "a8545e52c3ee4ac691870228228b4fa5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:50.371567 25724 raft_consensus.cc:2804] T 1119e418e9964dd1be1dcf47e3fe9734 P 6e4379ca45a84c5d807695a3fef07116 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:50.372282 25724 raft_consensus.cc:697] T 1119e418e9964dd1be1dcf47e3fe9734 P 6e4379ca45a84c5d807695a3fef07116 [term 1 LEADER]: Becoming Leader. State: Replica: 6e4379ca45a84c5d807695a3fef07116, State: Running, Role: LEADER
W20260709 13:09:50.372819 25585 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:45331, user_credentials={real_user=slave}} blocked reactor thread for 92828.8us
I20260709 13:09:50.373191 25545 raft_consensus.cc:2468] T 64e29ee66f22432c82e5772ee79dd918 P a8545e52c3ee4ac691870228228b4fa5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e4379ca45a84c5d807695a3fef07116 in term 1.
I20260709 13:09:50.377271 25469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e29ee66f22432c82e5772ee79dd918" candidate_uuid: "6e4379ca45a84c5d807695a3fef07116" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0482fd26e89d4bb89ee847d0108ab167"
I20260709 13:09:50.378095 25469 raft_consensus.cc:3060] T 64e29ee66f22432c82e5772ee79dd918 P 0482fd26e89d4bb89ee847d0108ab167 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:50.381846 25678 consensus_queue.cc:1048] T c301576f903c43cc87a0c95425f042fb P 6e4379ca45a84c5d807695a3fef07116 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:50.383749 25678 consensus_queue.cc:1048] T d0cd92d7306d4ed695dc084aabbfb995 P 6e4379ca45a84c5d807695a3fef07116 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:50.388651 25469 raft_consensus.cc:2468] T 64e29ee66f22432c82e5772ee79dd918 P 0482fd26e89d4bb89ee847d0108ab167 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e4379ca45a84c5d807695a3fef07116 in term 1.
I20260709 13:09:50.385344 25678 consensus_queue.cc:1048] T c301576f903c43cc87a0c95425f042fb P 6e4379ca45a84c5d807695a3fef07116 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:50.393221 25472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc05b0de0de04e64a129f5138acaf446" candidate_uuid: "6e4379ca45a84c5d807695a3fef07116" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0482fd26e89d4bb89ee847d0108ab167"
I20260709 13:09:50.394174 25585 leader_election.cc:304] T 64e29ee66f22432c82e5772ee79dd918 P 6e4379ca45a84c5d807695a3fef07116 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0482fd26e89d4bb89ee847d0108ab167, 6e4379ca45a84c5d807695a3fef07116; no voters: 
I20260709 13:09:50.390581 25724 consensus_queue.cc:237] T 1119e418e9964dd1be1dcf47e3fe9734 P 6e4379ca45a84c5d807695a3fef07116 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:50.395216 25723 raft_consensus.cc:2804] T 64e29ee66f22432c82e5772ee79dd918 P 6e4379ca45a84c5d807695a3fef07116 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:50.397692 25723 raft_consensus.cc:697] T 64e29ee66f22432c82e5772ee79dd918 P 6e4379ca45a84c5d807695a3fef07116 [term 1 LEADER]: Becoming Leader. State: Replica: 6e4379ca45a84c5d807695a3fef07116, State: Running, Role: LEADER
I20260709 13:09:50.395828 25585 leader_election.cc:304] T cc05b0de0de04e64a129f5138acaf446 P 6e4379ca45a84c5d807695a3fef07116 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e4379ca45a84c5d807695a3fef07116; no voters: 0482fd26e89d4bb89ee847d0108ab167, a8545e52c3ee4ac691870228228b4fa5
I20260709 13:09:50.400923 25722 raft_consensus.cc:2749] T cc05b0de0de04e64a129f5138acaf446 P 6e4379ca45a84c5d807695a3fef07116 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:09:50.399386 25723 consensus_queue.cc:237] T 64e29ee66f22432c82e5772ee79dd918 P 6e4379ca45a84c5d807695a3fef07116 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:50.417339 25714 raft_consensus.cc:2749] T cc05b0de0de04e64a129f5138acaf446 P 0482fd26e89d4bb89ee847d0108ab167 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:50.419625 25470 raft_consensus.cc:2468] T cc05b0de0de04e64a129f5138acaf446 P 0482fd26e89d4bb89ee847d0108ab167 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8545e52c3ee4ac691870228228b4fa5 in term 1.
I20260709 13:09:50.428257 25369 catalog_manager.cc:5697] T 1119e418e9964dd1be1dcf47e3fe9734 P 6e4379ca45a84c5d807695a3fef07116 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6e4379ca45a84c5d807695a3fef07116 (127.14.180.67). New cstate: current_term: 1 leader_uuid: "6e4379ca45a84c5d807695a3fef07116" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:50.452441 25369 catalog_manager.cc:5697] T 64e29ee66f22432c82e5772ee79dd918 P 6e4379ca45a84c5d807695a3fef07116 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6e4379ca45a84c5d807695a3fef07116 (127.14.180.67). New cstate: current_term: 1 leader_uuid: "6e4379ca45a84c5d807695a3fef07116" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:50.557837 25723 consensus_queue.cc:1048] T 442972580e8d4c5f9010dd64ba54899b P 6e4379ca45a84c5d807695a3fef07116 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:50.570058 25669 consensus_queue.cc:1048] T 442972580e8d4c5f9010dd64ba54899b P 6e4379ca45a84c5d807695a3fef07116 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:50.603595 25711 consensus_queue.cc:1048] T a06a18d1f8c346f2b758f593d709eb53 P a8545e52c3ee4ac691870228228b4fa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:50.616809 25713 consensus_queue.cc:1048] T a06a18d1f8c346f2b758f593d709eb53 P a8545e52c3ee4ac691870228228b4fa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:50.657943 25713 consensus_queue.cc:1048] T ffbf01eb3ff0482fb5f922a5b0a77a83 P a8545e52c3ee4ac691870228228b4fa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:50.670064 25666 consensus_queue.cc:1048] T ffbf01eb3ff0482fb5f922a5b0a77a83 P a8545e52c3ee4ac691870228228b4fa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:09:50.688237 25418 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:50.688359 25714 consensus_queue.cc:1048] T 11ad0defd0924408a16ee3f7a8a60106 P 0482fd26e89d4bb89ee847d0108ab167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:50.701360 25670 consensus_queue.cc:1048] T 11ad0defd0924408a16ee3f7a8a60106 P 0482fd26e89d4bb89ee847d0108ab167 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:50.841027 25669 consensus_queue.cc:1048] T 1119e418e9964dd1be1dcf47e3fe9734 P 6e4379ca45a84c5d807695a3fef07116 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:50.852072 25669 consensus_queue.cc:1048] T 1119e418e9964dd1be1dcf47e3fe9734 P 6e4379ca45a84c5d807695a3fef07116 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:50.995186 25669 consensus_queue.cc:1048] T 64e29ee66f22432c82e5772ee79dd918 P 6e4379ca45a84c5d807695a3fef07116 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:51.006469 25678 consensus_queue.cc:1048] T 64e29ee66f22432c82e5772ee79dd918 P 6e4379ca45a84c5d807695a3fef07116 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:09:51.698932 25418 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:52.292321 25669 raft_consensus.cc:493] T cc05b0de0de04e64a129f5138acaf446 P 6e4379ca45a84c5d807695a3fef07116 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:52.292963 25669 raft_consensus.cc:515] T cc05b0de0de04e64a129f5138acaf446 P 6e4379ca45a84c5d807695a3fef07116 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:52.294802 25669 leader_election.cc:290] T cc05b0de0de04e64a129f5138acaf446 P 6e4379ca45a84c5d807695a3fef07116 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0482fd26e89d4bb89ee847d0108ab167 (127.14.180.65:45331), a8545e52c3ee4ac691870228228b4fa5 (127.14.180.66:35803)
I20260709 13:09:52.295686 25472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc05b0de0de04e64a129f5138acaf446" candidate_uuid: "6e4379ca45a84c5d807695a3fef07116" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0482fd26e89d4bb89ee847d0108ab167" is_pre_election: true
I20260709 13:09:52.295887 25547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc05b0de0de04e64a129f5138acaf446" candidate_uuid: "6e4379ca45a84c5d807695a3fef07116" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8545e52c3ee4ac691870228228b4fa5" is_pre_election: true
I20260709 13:09:52.296391 25472 raft_consensus.cc:2468] T cc05b0de0de04e64a129f5138acaf446 P 0482fd26e89d4bb89ee847d0108ab167 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e4379ca45a84c5d807695a3fef07116 in term 1.
I20260709 13:09:52.296586 25547 raft_consensus.cc:2468] T cc05b0de0de04e64a129f5138acaf446 P a8545e52c3ee4ac691870228228b4fa5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e4379ca45a84c5d807695a3fef07116 in term 1.
I20260709 13:09:52.297662 25585 leader_election.cc:304] T cc05b0de0de04e64a129f5138acaf446 P 6e4379ca45a84c5d807695a3fef07116 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0482fd26e89d4bb89ee847d0108ab167, 6e4379ca45a84c5d807695a3fef07116; no voters: 
I20260709 13:09:52.298683 25669 raft_consensus.cc:2804] T cc05b0de0de04e64a129f5138acaf446 P 6e4379ca45a84c5d807695a3fef07116 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:52.299073 25669 raft_consensus.cc:493] T cc05b0de0de04e64a129f5138acaf446 P 6e4379ca45a84c5d807695a3fef07116 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:52.299399 25669 raft_consensus.cc:3060] T cc05b0de0de04e64a129f5138acaf446 P 6e4379ca45a84c5d807695a3fef07116 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:52.305297 25669 raft_consensus.cc:515] T cc05b0de0de04e64a129f5138acaf446 P 6e4379ca45a84c5d807695a3fef07116 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:52.307535 25669 leader_election.cc:290] T cc05b0de0de04e64a129f5138acaf446 P 6e4379ca45a84c5d807695a3fef07116 [CANDIDATE]: Term 2 election: Requested vote from peers 0482fd26e89d4bb89ee847d0108ab167 (127.14.180.65:45331), a8545e52c3ee4ac691870228228b4fa5 (127.14.180.66:35803)
I20260709 13:09:52.308084 25472 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc05b0de0de04e64a129f5138acaf446" candidate_uuid: "6e4379ca45a84c5d807695a3fef07116" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0482fd26e89d4bb89ee847d0108ab167"
I20260709 13:09:52.308215 25547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc05b0de0de04e64a129f5138acaf446" candidate_uuid: "6e4379ca45a84c5d807695a3fef07116" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8545e52c3ee4ac691870228228b4fa5"
I20260709 13:09:52.308784 25472 raft_consensus.cc:3060] T cc05b0de0de04e64a129f5138acaf446 P 0482fd26e89d4bb89ee847d0108ab167 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:52.308950 25547 raft_consensus.cc:3060] T cc05b0de0de04e64a129f5138acaf446 P a8545e52c3ee4ac691870228228b4fa5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:52.314924 25472 raft_consensus.cc:2468] T cc05b0de0de04e64a129f5138acaf446 P 0482fd26e89d4bb89ee847d0108ab167 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e4379ca45a84c5d807695a3fef07116 in term 2.
I20260709 13:09:52.314937 25547 raft_consensus.cc:2468] T cc05b0de0de04e64a129f5138acaf446 P a8545e52c3ee4ac691870228228b4fa5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e4379ca45a84c5d807695a3fef07116 in term 2.
I20260709 13:09:52.316239 25585 leader_election.cc:304] T cc05b0de0de04e64a129f5138acaf446 P 6e4379ca45a84c5d807695a3fef07116 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0482fd26e89d4bb89ee847d0108ab167, 6e4379ca45a84c5d807695a3fef07116; no voters: 
I20260709 13:09:52.317153 25669 raft_consensus.cc:2804] T cc05b0de0de04e64a129f5138acaf446 P 6e4379ca45a84c5d807695a3fef07116 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:52.318351 25669 raft_consensus.cc:697] T cc05b0de0de04e64a129f5138acaf446 P 6e4379ca45a84c5d807695a3fef07116 [term 2 LEADER]: Becoming Leader. State: Replica: 6e4379ca45a84c5d807695a3fef07116, State: Running, Role: LEADER
I20260709 13:09:52.319180 25669 consensus_queue.cc:237] T cc05b0de0de04e64a129f5138acaf446 P 6e4379ca45a84c5d807695a3fef07116 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:52.327755 25367 catalog_manager.cc:5697] T cc05b0de0de04e64a129f5138acaf446 P 6e4379ca45a84c5d807695a3fef07116 reported cstate change: term changed from 0 to 2, leader changed from <none> to 6e4379ca45a84c5d807695a3fef07116 (127.14.180.67). New cstate: current_term: 2 leader_uuid: "6e4379ca45a84c5d807695a3fef07116" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:52.517879 15057 ts_manager.cc:295] Set tserver state for 0482fd26e89d4bb89ee847d0108ab167 to MAINTENANCE_MODE
I20260709 13:09:52.518710 15057 tablet_server.cc:179] TabletServer@127.14.180.65:0 shutting down...
W20260709 13:09:52.524499 25511 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 136 similar messages]
W20260709 13:09:52.529637 25511 consensus_peers.cc:597] T a06a18d1f8c346f2b758f593d709eb53 P a8545e52c3ee4ac691870228228b4fa5 -> Peer 0482fd26e89d4bb89ee847d0108ab167 (127.14.180.65:45331): Couldn't send request to peer 0482fd26e89d4bb89ee847d0108ab167. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:52.548911 15057 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:52.550016 15057 tablet_replica.cc:333] T cc05b0de0de04e64a129f5138acaf446 P 0482fd26e89d4bb89ee847d0108ab167: stopping tablet replica
I20260709 13:09:52.550906 15057 raft_consensus.cc:2243] T cc05b0de0de04e64a129f5138acaf446 P 0482fd26e89d4bb89ee847d0108ab167 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:52.551470 15057 raft_consensus.cc:2272] T cc05b0de0de04e64a129f5138acaf446 P 0482fd26e89d4bb89ee847d0108ab167 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:52.553586 15057 tablet_replica.cc:333] T 64e29ee66f22432c82e5772ee79dd918 P 0482fd26e89d4bb89ee847d0108ab167: stopping tablet replica
I20260709 13:09:52.554414 15057 raft_consensus.cc:2243] T 64e29ee66f22432c82e5772ee79dd918 P 0482fd26e89d4bb89ee847d0108ab167 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:52.554986 15057 raft_consensus.cc:2272] T 64e29ee66f22432c82e5772ee79dd918 P 0482fd26e89d4bb89ee847d0108ab167 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:52.556990 15057 tablet_replica.cc:333] T a06a18d1f8c346f2b758f593d709eb53 P 0482fd26e89d4bb89ee847d0108ab167: stopping tablet replica
I20260709 13:09:52.557596 15057 raft_consensus.cc:2243] T a06a18d1f8c346f2b758f593d709eb53 P 0482fd26e89d4bb89ee847d0108ab167 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:52.558063 15057 raft_consensus.cc:2272] T a06a18d1f8c346f2b758f593d709eb53 P 0482fd26e89d4bb89ee847d0108ab167 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:52.560107 15057 tablet_replica.cc:333] T 11ad0defd0924408a16ee3f7a8a60106 P 0482fd26e89d4bb89ee847d0108ab167: stopping tablet replica
I20260709 13:09:52.560742 15057 raft_consensus.cc:2243] T 11ad0defd0924408a16ee3f7a8a60106 P 0482fd26e89d4bb89ee847d0108ab167 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:52.561584 15057 raft_consensus.cc:2272] T 11ad0defd0924408a16ee3f7a8a60106 P 0482fd26e89d4bb89ee847d0108ab167 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:52.563699 15057 tablet_replica.cc:333] T 1119e418e9964dd1be1dcf47e3fe9734 P 0482fd26e89d4bb89ee847d0108ab167: stopping tablet replica
I20260709 13:09:52.564361 15057 raft_consensus.cc:2243] T 1119e418e9964dd1be1dcf47e3fe9734 P 0482fd26e89d4bb89ee847d0108ab167 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:52.564808 15057 raft_consensus.cc:2272] T 1119e418e9964dd1be1dcf47e3fe9734 P 0482fd26e89d4bb89ee847d0108ab167 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:52.566799 15057 tablet_replica.cc:333] T 442972580e8d4c5f9010dd64ba54899b P 0482fd26e89d4bb89ee847d0108ab167: stopping tablet replica
I20260709 13:09:52.567360 15057 raft_consensus.cc:2243] T 442972580e8d4c5f9010dd64ba54899b P 0482fd26e89d4bb89ee847d0108ab167 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:52.567814 15057 raft_consensus.cc:2272] T 442972580e8d4c5f9010dd64ba54899b P 0482fd26e89d4bb89ee847d0108ab167 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:52.569792 15057 tablet_replica.cc:333] T d0cd92d7306d4ed695dc084aabbfb995 P 0482fd26e89d4bb89ee847d0108ab167: stopping tablet replica
I20260709 13:09:52.571004 15057 raft_consensus.cc:2243] T d0cd92d7306d4ed695dc084aabbfb995 P 0482fd26e89d4bb89ee847d0108ab167 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:52.571703 15057 raft_consensus.cc:2272] T d0cd92d7306d4ed695dc084aabbfb995 P 0482fd26e89d4bb89ee847d0108ab167 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:52.574445 15057 tablet_replica.cc:333] T ffbf01eb3ff0482fb5f922a5b0a77a83 P 0482fd26e89d4bb89ee847d0108ab167: stopping tablet replica
I20260709 13:09:52.575445 15057 raft_consensus.cc:2243] T ffbf01eb3ff0482fb5f922a5b0a77a83 P 0482fd26e89d4bb89ee847d0108ab167 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:52.575990 15057 raft_consensus.cc:2272] T ffbf01eb3ff0482fb5f922a5b0a77a83 P 0482fd26e89d4bb89ee847d0108ab167 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:52.578099 15057 tablet_replica.cc:333] T b6d563892443429682cba0bba950c7d7 P 0482fd26e89d4bb89ee847d0108ab167: stopping tablet replica
I20260709 13:09:52.578806 15057 raft_consensus.cc:2243] T b6d563892443429682cba0bba950c7d7 P 0482fd26e89d4bb89ee847d0108ab167 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:52.579296 15057 raft_consensus.cc:2272] T b6d563892443429682cba0bba950c7d7 P 0482fd26e89d4bb89ee847d0108ab167 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:52.581382 15057 tablet_replica.cc:333] T c301576f903c43cc87a0c95425f042fb P 0482fd26e89d4bb89ee847d0108ab167: stopping tablet replica
I20260709 13:09:52.581943 15057 raft_consensus.cc:2243] T c301576f903c43cc87a0c95425f042fb P 0482fd26e89d4bb89ee847d0108ab167 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:52.582435 15057 raft_consensus.cc:2272] T c301576f903c43cc87a0c95425f042fb P 0482fd26e89d4bb89ee847d0108ab167 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:52.615315 15057 tablet_server.cc:196] TabletServer@127.14.180.65:0 shutdown complete.
W20260709 13:09:52.651830 25585 consensus_peers.cc:597] T 64e29ee66f22432c82e5772ee79dd918 P 6e4379ca45a84c5d807695a3fef07116 -> Peer 0482fd26e89d4bb89ee847d0108ab167 (127.14.180.65:45331): Couldn't send request to peer 0482fd26e89d4bb89ee847d0108ab167. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:45331: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:52.670085 25585 consensus_peers.cc:597] T d0cd92d7306d4ed695dc084aabbfb995 P 6e4379ca45a84c5d807695a3fef07116 -> Peer 0482fd26e89d4bb89ee847d0108ab167 (127.14.180.65:45331): Couldn't send request to peer 0482fd26e89d4bb89ee847d0108ab167. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:45331: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:52.700039 25418 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:09:52.741971 25511 consensus_peers.cc:597] T ffbf01eb3ff0482fb5f922a5b0a77a83 P a8545e52c3ee4ac691870228228b4fa5 -> Peer 0482fd26e89d4bb89ee847d0108ab167 (127.14.180.65:45331): Couldn't send request to peer 0482fd26e89d4bb89ee847d0108ab167. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:45331: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:52.755278 25585 consensus_peers.cc:597] T cc05b0de0de04e64a129f5138acaf446 P 6e4379ca45a84c5d807695a3fef07116 -> Peer 0482fd26e89d4bb89ee847d0108ab167 (127.14.180.65:45331): Couldn't send request to peer 0482fd26e89d4bb89ee847d0108ab167. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:45331: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:52.767046 25547 raft_consensus.cc:1275] T cc05b0de0de04e64a129f5138acaf446 P a8545e52c3ee4ac691870228228b4fa5 [term 2 FOLLOWER]: Refusing update from remote peer 6e4379ca45a84c5d807695a3fef07116: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:09:52.768628 25669 consensus_queue.cc:1048] T cc05b0de0de04e64a129f5138acaf446 P 6e4379ca45a84c5d807695a3fef07116 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:09:52.825295 25585 consensus_peers.cc:597] T 1119e418e9964dd1be1dcf47e3fe9734 P 6e4379ca45a84c5d807695a3fef07116 -> Peer 0482fd26e89d4bb89ee847d0108ab167 (127.14.180.65:45331): Couldn't send request to peer 0482fd26e89d4bb89ee847d0108ab167. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:45331: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:52.856302 25585 consensus_peers.cc:597] T c301576f903c43cc87a0c95425f042fb P 6e4379ca45a84c5d807695a3fef07116 -> Peer 0482fd26e89d4bb89ee847d0108ab167 (127.14.180.65:45331): Couldn't send request to peer 0482fd26e89d4bb89ee847d0108ab167. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:45331: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:52.922742 25585 consensus_peers.cc:597] T 442972580e8d4c5f9010dd64ba54899b P 6e4379ca45a84c5d807695a3fef07116 -> Peer 0482fd26e89d4bb89ee847d0108ab167 (127.14.180.65:45331): Couldn't send request to peer 0482fd26e89d4bb89ee847d0108ab167. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:45331: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:52.924989 25585 consensus_peers.cc:597] T b6d563892443429682cba0bba950c7d7 P 6e4379ca45a84c5d807695a3fef07116 -> Peer 0482fd26e89d4bb89ee847d0108ab167 (127.14.180.65:45331): Couldn't send request to peer 0482fd26e89d4bb89ee847d0108ab167. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:45331: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:53.550860 25764 raft_consensus.cc:493] T 11ad0defd0924408a16ee3f7a8a60106 P a8545e52c3ee4ac691870228228b4fa5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0482fd26e89d4bb89ee847d0108ab167)
I20260709 13:09:53.552116 25764 raft_consensus.cc:515] T 11ad0defd0924408a16ee3f7a8a60106 P a8545e52c3ee4ac691870228228b4fa5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:53.554309 25764 leader_election.cc:290] T 11ad0defd0924408a16ee3f7a8a60106 P a8545e52c3ee4ac691870228228b4fa5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0482fd26e89d4bb89ee847d0108ab167 (127.14.180.65:45331), 6e4379ca45a84c5d807695a3fef07116 (127.14.180.67:39657)
I20260709 13:09:53.555938 25620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ad0defd0924408a16ee3f7a8a60106" candidate_uuid: "a8545e52c3ee4ac691870228228b4fa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6e4379ca45a84c5d807695a3fef07116" is_pre_election: true
W20260709 13:09:53.559140 25511 leader_election.cc:336] T 11ad0defd0924408a16ee3f7a8a60106 P a8545e52c3ee4ac691870228228b4fa5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0482fd26e89d4bb89ee847d0108ab167 (127.14.180.65:45331): Network error: Client connection negotiation failed: client connection to 127.14.180.65:45331: connect: Connection refused (error 111)
I20260709 13:09:53.559628 25511 leader_election.cc:304] T 11ad0defd0924408a16ee3f7a8a60106 P a8545e52c3ee4ac691870228228b4fa5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8545e52c3ee4ac691870228228b4fa5; no voters: 0482fd26e89d4bb89ee847d0108ab167, 6e4379ca45a84c5d807695a3fef07116
I20260709 13:09:53.560405 25764 raft_consensus.cc:2749] T 11ad0defd0924408a16ee3f7a8a60106 P a8545e52c3ee4ac691870228228b4fa5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:09:53.701612 25418 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:09:53.792105 25762 raft_consensus.cc:493] T 11ad0defd0924408a16ee3f7a8a60106 P 6e4379ca45a84c5d807695a3fef07116 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0482fd26e89d4bb89ee847d0108ab167)
I20260709 13:09:53.792773 25762 raft_consensus.cc:515] T 11ad0defd0924408a16ee3f7a8a60106 P 6e4379ca45a84c5d807695a3fef07116 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:53.794889 25762 leader_election.cc:290] T 11ad0defd0924408a16ee3f7a8a60106 P 6e4379ca45a84c5d807695a3fef07116 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0482fd26e89d4bb89ee847d0108ab167 (127.14.180.65:45331), a8545e52c3ee4ac691870228228b4fa5 (127.14.180.66:35803)
I20260709 13:09:53.796209 25545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ad0defd0924408a16ee3f7a8a60106" candidate_uuid: "6e4379ca45a84c5d807695a3fef07116" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a8545e52c3ee4ac691870228228b4fa5" is_pre_election: true
I20260709 13:09:53.796999 25545 raft_consensus.cc:2468] T 11ad0defd0924408a16ee3f7a8a60106 P a8545e52c3ee4ac691870228228b4fa5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e4379ca45a84c5d807695a3fef07116 in term 1.
I20260709 13:09:53.798631 25584 leader_election.cc:304] T 11ad0defd0924408a16ee3f7a8a60106 P 6e4379ca45a84c5d807695a3fef07116 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e4379ca45a84c5d807695a3fef07116, a8545e52c3ee4ac691870228228b4fa5; no voters: 
I20260709 13:09:53.799427 25762 raft_consensus.cc:2804] T 11ad0defd0924408a16ee3f7a8a60106 P 6e4379ca45a84c5d807695a3fef07116 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:09:53.799726 25585 leader_election.cc:336] T 11ad0defd0924408a16ee3f7a8a60106 P 6e4379ca45a84c5d807695a3fef07116 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0482fd26e89d4bb89ee847d0108ab167 (127.14.180.65:45331): Network error: Client connection negotiation failed: client connection to 127.14.180.65:45331: connect: Connection refused (error 111)
I20260709 13:09:53.799760 25762 raft_consensus.cc:493] T 11ad0defd0924408a16ee3f7a8a60106 P 6e4379ca45a84c5d807695a3fef07116 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0482fd26e89d4bb89ee847d0108ab167)
I20260709 13:09:53.800410 25762 raft_consensus.cc:3060] T 11ad0defd0924408a16ee3f7a8a60106 P 6e4379ca45a84c5d807695a3fef07116 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:53.810521 25762 raft_consensus.cc:515] T 11ad0defd0924408a16ee3f7a8a60106 P 6e4379ca45a84c5d807695a3fef07116 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:53.812393 25762 leader_election.cc:290] T 11ad0defd0924408a16ee3f7a8a60106 P 6e4379ca45a84c5d807695a3fef07116 [CANDIDATE]: Term 2 election: Requested vote from peers 0482fd26e89d4bb89ee847d0108ab167 (127.14.180.65:45331), a8545e52c3ee4ac691870228228b4fa5 (127.14.180.66:35803)
I20260709 13:09:53.813565 25545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ad0defd0924408a16ee3f7a8a60106" candidate_uuid: "6e4379ca45a84c5d807695a3fef07116" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a8545e52c3ee4ac691870228228b4fa5"
I20260709 13:09:53.814301 25545 raft_consensus.cc:3060] T 11ad0defd0924408a16ee3f7a8a60106 P a8545e52c3ee4ac691870228228b4fa5 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:53.816614 25585 leader_election.cc:336] T 11ad0defd0924408a16ee3f7a8a60106 P 6e4379ca45a84c5d807695a3fef07116 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 0482fd26e89d4bb89ee847d0108ab167 (127.14.180.65:45331): Network error: Client connection negotiation failed: client connection to 127.14.180.65:45331: connect: Connection refused (error 111)
I20260709 13:09:53.822012 25545 raft_consensus.cc:2468] T 11ad0defd0924408a16ee3f7a8a60106 P a8545e52c3ee4ac691870228228b4fa5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e4379ca45a84c5d807695a3fef07116 in term 2.
I20260709 13:09:53.823292 25584 leader_election.cc:304] T 11ad0defd0924408a16ee3f7a8a60106 P 6e4379ca45a84c5d807695a3fef07116 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e4379ca45a84c5d807695a3fef07116, a8545e52c3ee4ac691870228228b4fa5; no voters: 0482fd26e89d4bb89ee847d0108ab167
I20260709 13:09:53.824400 25762 raft_consensus.cc:2804] T 11ad0defd0924408a16ee3f7a8a60106 P 6e4379ca45a84c5d807695a3fef07116 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:53.825590 25762 raft_consensus.cc:697] T 11ad0defd0924408a16ee3f7a8a60106 P 6e4379ca45a84c5d807695a3fef07116 [term 2 LEADER]: Becoming Leader. State: Replica: 6e4379ca45a84c5d807695a3fef07116, State: Running, Role: LEADER
I20260709 13:09:53.826980 25762 consensus_queue.cc:237] T 11ad0defd0924408a16ee3f7a8a60106 P 6e4379ca45a84c5d807695a3fef07116 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:53.835587 25367 catalog_manager.cc:5697] T 11ad0defd0924408a16ee3f7a8a60106 P 6e4379ca45a84c5d807695a3fef07116 reported cstate change: term changed from 1 to 2, leader changed from 0482fd26e89d4bb89ee847d0108ab167 (127.14.180.65) to 6e4379ca45a84c5d807695a3fef07116 (127.14.180.67). New cstate: current_term: 2 leader_uuid: "6e4379ca45a84c5d807695a3fef07116" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } health_report { overall_health: HEALTHY } } }
W20260709 13:09:54.236961 25585 consensus_peers.cc:597] T 11ad0defd0924408a16ee3f7a8a60106 P 6e4379ca45a84c5d807695a3fef07116 -> Peer 0482fd26e89d4bb89ee847d0108ab167 (127.14.180.65:45331): Couldn't send request to peer 0482fd26e89d4bb89ee847d0108ab167. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:45331: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:54.436075 25547 raft_consensus.cc:1275] T 11ad0defd0924408a16ee3f7a8a60106 P a8545e52c3ee4ac691870228228b4fa5 [term 2 FOLLOWER]: Refusing update from remote peer 6e4379ca45a84c5d807695a3fef07116: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:54.437706 25762 consensus_queue.cc:1048] T 11ad0defd0924408a16ee3f7a8a60106 P 6e4379ca45a84c5d807695a3fef07116 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:09:54.702857 25418 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:09:55.054363 25585 consensus_peers.cc:597] T d0cd92d7306d4ed695dc084aabbfb995 P 6e4379ca45a84c5d807695a3fef07116 -> Peer 0482fd26e89d4bb89ee847d0108ab167 (127.14.180.65:45331): Couldn't send request to peer 0482fd26e89d4bb89ee847d0108ab167. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:45331: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:55.088778 25511 consensus_peers.cc:597] T a06a18d1f8c346f2b758f593d709eb53 P a8545e52c3ee4ac691870228228b4fa5 -> Peer 0482fd26e89d4bb89ee847d0108ab167 (127.14.180.65:45331): Couldn't send request to peer 0482fd26e89d4bb89ee847d0108ab167. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:45331: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:55.107337 25511 consensus_peers.cc:597] T ffbf01eb3ff0482fb5f922a5b0a77a83 P a8545e52c3ee4ac691870228228b4fa5 -> Peer 0482fd26e89d4bb89ee847d0108ab167 (127.14.180.65:45331): Couldn't send request to peer 0482fd26e89d4bb89ee847d0108ab167. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:45331: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:55.153010 25585 consensus_peers.cc:597] T 1119e418e9964dd1be1dcf47e3fe9734 P 6e4379ca45a84c5d807695a3fef07116 -> Peer 0482fd26e89d4bb89ee847d0108ab167 (127.14.180.65:45331): Couldn't send request to peer 0482fd26e89d4bb89ee847d0108ab167. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:45331: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:55.196805 25585 consensus_peers.cc:597] T b6d563892443429682cba0bba950c7d7 P 6e4379ca45a84c5d807695a3fef07116 -> Peer 0482fd26e89d4bb89ee847d0108ab167 (127.14.180.65:45331): Couldn't send request to peer 0482fd26e89d4bb89ee847d0108ab167. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:45331: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:55.322055 25585 consensus_peers.cc:597] T 442972580e8d4c5f9010dd64ba54899b P 6e4379ca45a84c5d807695a3fef07116 -> Peer 0482fd26e89d4bb89ee847d0108ab167 (127.14.180.65:45331): Couldn't send request to peer 0482fd26e89d4bb89ee847d0108ab167. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:45331: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:55.385505 25585 consensus_peers.cc:597] T 64e29ee66f22432c82e5772ee79dd918 P 6e4379ca45a84c5d807695a3fef07116 -> Peer 0482fd26e89d4bb89ee847d0108ab167 (127.14.180.65:45331): Couldn't send request to peer 0482fd26e89d4bb89ee847d0108ab167. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:45331: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:55.476963 25585 consensus_peers.cc:597] T cc05b0de0de04e64a129f5138acaf446 P 6e4379ca45a84c5d807695a3fef07116 -> Peer 0482fd26e89d4bb89ee847d0108ab167 (127.14.180.65:45331): Couldn't send request to peer 0482fd26e89d4bb89ee847d0108ab167. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:45331: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:55.500373 25585 consensus_peers.cc:597] T c301576f903c43cc87a0c95425f042fb P 6e4379ca45a84c5d807695a3fef07116 -> Peer 0482fd26e89d4bb89ee847d0108ab167 (127.14.180.65:45331): Couldn't send request to peer 0482fd26e89d4bb89ee847d0108ab167. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:45331: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:55.704048 25418 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:09:56.705207 25418 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:09:56.961671 25585 consensus_peers.cc:597] T 11ad0defd0924408a16ee3f7a8a60106 P 6e4379ca45a84c5d807695a3fef07116 -> Peer 0482fd26e89d4bb89ee847d0108ab167 (127.14.180.65:45331): Couldn't send request to peer 0482fd26e89d4bb89ee847d0108ab167. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:45331: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:57.559310 25585 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.14.180.65:45331: connect: Connection refused (error 111) [suppressed 97 similar messages]
W20260709 13:09:57.623648 25511 consensus_peers.cc:597] T ffbf01eb3ff0482fb5f922a5b0a77a83 P a8545e52c3ee4ac691870228228b4fa5 -> Peer 0482fd26e89d4bb89ee847d0108ab167 (127.14.180.65:45331): Couldn't send request to peer 0482fd26e89d4bb89ee847d0108ab167. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:45331: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:09:57.642119 15057 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:57.644575 25585 consensus_peers.cc:597] T d0cd92d7306d4ed695dc084aabbfb995 P 6e4379ca45a84c5d807695a3fef07116 -> Peer 0482fd26e89d4bb89ee847d0108ab167 (127.14.180.65:45331): Couldn't send request to peer 0482fd26e89d4bb89ee847d0108ab167. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:45331: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:57.650470 25783 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:57.653236 25786 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:57.654146 25784 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:57.660600 15057 server_base.cc:1061] running on GCE node
I20260709 13:09:57.662698 15057 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:57.663009 15057 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:57.663245 15057 hybrid_clock.cc:648] HybridClock initialized: now 1783602597663218 us; error 0 us; skew 500 ppm
I20260709 13:09:57.663926 15057 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:57.667018 15057 webserver.cc:533] Webserver started at http://127.14.180.65:46799/ using document root <none> and password file <none>
I20260709 13:09:57.667604 15057 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:57.667793 15057 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:09:57.672616 15057 fs_manager.cc:714] Time spent opening directory manager: real 0.004s	user 0.003s	sys 0.002s
I20260709 13:09:57.677145 25791 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:57.678077 15057 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:09:57.678454 15057 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602283040513-15057-0/minicluster-data/ts-0-root
uuid: "0482fd26e89d4bb89ee847d0108ab167"
format_stamp: "Formatted at 2026-07-09 13:09:48 on dist-test-slave-r9m8"
I20260709 13:09:57.678902 15057 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602283040513-15057-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602283040513-15057-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602283040513-15057-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:57.700570 15057 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:57.701918 15057 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:57.703611 15057 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
W20260709 13:09:57.706411 25418 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:09:57.707911 25798 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
W20260709 13:09:57.759636 25585 consensus_peers.cc:597] T b6d563892443429682cba0bba950c7d7 P 6e4379ca45a84c5d807695a3fef07116 -> Peer 0482fd26e89d4bb89ee847d0108ab167 (127.14.180.65:45331): Couldn't send request to peer 0482fd26e89d4bb89ee847d0108ab167. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:45331: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:57.770915 25585 consensus_peers.cc:597] T 442972580e8d4c5f9010dd64ba54899b P 6e4379ca45a84c5d807695a3fef07116 -> Peer 0482fd26e89d4bb89ee847d0108ab167 (127.14.180.65:45331): Couldn't send request to peer 0482fd26e89d4bb89ee847d0108ab167. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:45331: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:09:57.777438 15057 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 13:09:57.777802 15057 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.071s	user 0.003s	sys 0.000s
I20260709 13:09:57.778064 15057 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 13:09:57.784518 25798 tablet_bootstrap.cc:492] T b6d563892443429682cba0bba950c7d7 P 0482fd26e89d4bb89ee847d0108ab167: Bootstrap starting.
I20260709 13:09:57.803797 25798 tablet_bootstrap.cc:492] T b6d563892443429682cba0bba950c7d7 P 0482fd26e89d4bb89ee847d0108ab167: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:57.804834 25798 tablet_bootstrap.cc:492] T b6d563892443429682cba0bba950c7d7 P 0482fd26e89d4bb89ee847d0108ab167: Bootstrap complete.
I20260709 13:09:57.805547 25798 ts_tablet_manager.cc:1403] T b6d563892443429682cba0bba950c7d7 P 0482fd26e89d4bb89ee847d0108ab167: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.007s
I20260709 13:09:57.808542 25798 raft_consensus.cc:359] T b6d563892443429682cba0bba950c7d7 P 0482fd26e89d4bb89ee847d0108ab167 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } } peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } }
I20260709 13:09:57.809314 25798 raft_consensus.cc:740] T b6d563892443429682cba0bba950c7d7 P 0482fd26e89d4bb89ee847d0108ab167 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0482fd26e89d4bb89ee847d0108ab167, State: Initialized, Role: FOLLOWER
I20260709 13:09:57.810086 25798 consensus_queue.cc:260] T b6d563892443429682cba0bba950c7d7 P 0482fd26e89d4bb89ee847d0108ab167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } } peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } }
I20260709 13:09:57.813201 25798 ts_tablet_manager.cc:1434] T b6d563892443429682cba0bba950c7d7 P 0482fd26e89d4bb89ee847d0108ab167: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.002s
I20260709 13:09:57.814129 25798 tablet_bootstrap.cc:492] T c301576f903c43cc87a0c95425f042fb P 0482fd26e89d4bb89ee847d0108ab167: Bootstrap starting.
I20260709 13:09:57.829414 25798 tablet_bootstrap.cc:492] T c301576f903c43cc87a0c95425f042fb P 0482fd26e89d4bb89ee847d0108ab167: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:57.830355 25798 tablet_bootstrap.cc:492] T c301576f903c43cc87a0c95425f042fb P 0482fd26e89d4bb89ee847d0108ab167: Bootstrap complete.
I20260709 13:09:57.830986 25798 ts_tablet_manager.cc:1403] T c301576f903c43cc87a0c95425f042fb P 0482fd26e89d4bb89ee847d0108ab167: Time spent bootstrapping tablet: real 0.017s	user 0.008s	sys 0.008s
I20260709 13:09:57.833171 25798 raft_consensus.cc:359] T c301576f903c43cc87a0c95425f042fb P 0482fd26e89d4bb89ee847d0108ab167 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:57.833830 25798 raft_consensus.cc:740] T c301576f903c43cc87a0c95425f042fb P 0482fd26e89d4bb89ee847d0108ab167 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0482fd26e89d4bb89ee847d0108ab167, State: Initialized, Role: FOLLOWER
I20260709 13:09:57.835005 25798 consensus_queue.cc:260] T c301576f903c43cc87a0c95425f042fb P 0482fd26e89d4bb89ee847d0108ab167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:57.836762 25798 ts_tablet_manager.cc:1434] T c301576f903c43cc87a0c95425f042fb P 0482fd26e89d4bb89ee847d0108ab167: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:09:57.837495 25798 tablet_bootstrap.cc:492] T 64e29ee66f22432c82e5772ee79dd918 P 0482fd26e89d4bb89ee847d0108ab167: Bootstrap starting.
I20260709 13:09:57.837904 15057 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 13:09:57.838263 15057 ts_tablet_manager.cc:595] Time spent register tablets: real 0.060s	user 0.054s	sys 0.003s
W20260709 13:09:57.848794 25585 consensus_peers.cc:597] T 64e29ee66f22432c82e5772ee79dd918 P 6e4379ca45a84c5d807695a3fef07116 -> Peer 0482fd26e89d4bb89ee847d0108ab167 (127.14.180.65:45331): Couldn't send request to peer 0482fd26e89d4bb89ee847d0108ab167. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:45331: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:09:57.855325 25798 tablet_bootstrap.cc:492] T 64e29ee66f22432c82e5772ee79dd918 P 0482fd26e89d4bb89ee847d0108ab167: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:09:57.856757 25511 consensus_peers.cc:597] T a06a18d1f8c346f2b758f593d709eb53 P a8545e52c3ee4ac691870228228b4fa5 -> Peer 0482fd26e89d4bb89ee847d0108ab167 (127.14.180.65:45331): Couldn't send request to peer 0482fd26e89d4bb89ee847d0108ab167. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:45331: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:09:57.857491 25798 tablet_bootstrap.cc:492] T 64e29ee66f22432c82e5772ee79dd918 P 0482fd26e89d4bb89ee847d0108ab167: Bootstrap complete.
I20260709 13:09:57.858325 25798 ts_tablet_manager.cc:1403] T 64e29ee66f22432c82e5772ee79dd918 P 0482fd26e89d4bb89ee847d0108ab167: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.004s
I20260709 13:09:57.861222 25798 raft_consensus.cc:359] T 64e29ee66f22432c82e5772ee79dd918 P 0482fd26e89d4bb89ee847d0108ab167 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:57.861845 25798 raft_consensus.cc:740] T 64e29ee66f22432c82e5772ee79dd918 P 0482fd26e89d4bb89ee847d0108ab167 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0482fd26e89d4bb89ee847d0108ab167, State: Initialized, Role: FOLLOWER
I20260709 13:09:57.863287 25798 consensus_queue.cc:260] T 64e29ee66f22432c82e5772ee79dd918 P 0482fd26e89d4bb89ee847d0108ab167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:57.865073 25798 ts_tablet_manager.cc:1434] T 64e29ee66f22432c82e5772ee79dd918 P 0482fd26e89d4bb89ee847d0108ab167: Time spent starting tablet: real 0.006s	user 0.000s	sys 0.004s
I20260709 13:09:57.865782 25798 tablet_bootstrap.cc:492] T 442972580e8d4c5f9010dd64ba54899b P 0482fd26e89d4bb89ee847d0108ab167: Bootstrap starting.
I20260709 13:09:57.878691 25798 tablet_bootstrap.cc:492] T 442972580e8d4c5f9010dd64ba54899b P 0482fd26e89d4bb89ee847d0108ab167: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:57.879519 25798 tablet_bootstrap.cc:492] T 442972580e8d4c5f9010dd64ba54899b P 0482fd26e89d4bb89ee847d0108ab167: Bootstrap complete.
I20260709 13:09:57.880102 25798 ts_tablet_manager.cc:1403] T 442972580e8d4c5f9010dd64ba54899b P 0482fd26e89d4bb89ee847d0108ab167: Time spent bootstrapping tablet: real 0.014s	user 0.013s	sys 0.000s
I20260709 13:09:57.882490 25798 raft_consensus.cc:359] T 442972580e8d4c5f9010dd64ba54899b P 0482fd26e89d4bb89ee847d0108ab167 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:57.883157 25798 raft_consensus.cc:740] T 442972580e8d4c5f9010dd64ba54899b P 0482fd26e89d4bb89ee847d0108ab167 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0482fd26e89d4bb89ee847d0108ab167, State: Initialized, Role: FOLLOWER
I20260709 13:09:57.883977 25798 consensus_queue.cc:260] T 442972580e8d4c5f9010dd64ba54899b P 0482fd26e89d4bb89ee847d0108ab167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:57.885667 25798 ts_tablet_manager.cc:1434] T 442972580e8d4c5f9010dd64ba54899b P 0482fd26e89d4bb89ee847d0108ab167: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:09:57.886545 25798 tablet_bootstrap.cc:492] T ffbf01eb3ff0482fb5f922a5b0a77a83 P 0482fd26e89d4bb89ee847d0108ab167: Bootstrap starting.
W20260709 13:09:57.892185 25585 consensus_peers.cc:597] T 1119e418e9964dd1be1dcf47e3fe9734 P 6e4379ca45a84c5d807695a3fef07116 -> Peer 0482fd26e89d4bb89ee847d0108ab167 (127.14.180.65:45331): Couldn't send request to peer 0482fd26e89d4bb89ee847d0108ab167. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:45331: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:09:57.901093 25798 tablet_bootstrap.cc:492] T ffbf01eb3ff0482fb5f922a5b0a77a83 P 0482fd26e89d4bb89ee847d0108ab167: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:57.902042 25798 tablet_bootstrap.cc:492] T ffbf01eb3ff0482fb5f922a5b0a77a83 P 0482fd26e89d4bb89ee847d0108ab167: Bootstrap complete.
I20260709 13:09:57.902724 25798 ts_tablet_manager.cc:1403] T ffbf01eb3ff0482fb5f922a5b0a77a83 P 0482fd26e89d4bb89ee847d0108ab167: Time spent bootstrapping tablet: real 0.016s	user 0.016s	sys 0.000s
I20260709 13:09:57.904767 25798 raft_consensus.cc:359] T ffbf01eb3ff0482fb5f922a5b0a77a83 P 0482fd26e89d4bb89ee847d0108ab167 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:57.905306 25798 raft_consensus.cc:740] T ffbf01eb3ff0482fb5f922a5b0a77a83 P 0482fd26e89d4bb89ee847d0108ab167 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0482fd26e89d4bb89ee847d0108ab167, State: Initialized, Role: FOLLOWER
I20260709 13:09:57.905977 25798 consensus_queue.cc:260] T ffbf01eb3ff0482fb5f922a5b0a77a83 P 0482fd26e89d4bb89ee847d0108ab167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:57.907523 25798 ts_tablet_manager.cc:1434] T ffbf01eb3ff0482fb5f922a5b0a77a83 P 0482fd26e89d4bb89ee847d0108ab167: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.002s
I20260709 13:09:57.908208 25798 tablet_bootstrap.cc:492] T a06a18d1f8c346f2b758f593d709eb53 P 0482fd26e89d4bb89ee847d0108ab167: Bootstrap starting.
I20260709 13:09:57.913020 15057 rpc_server.cc:307] RPC server started. Bound to: 127.14.180.65:45331
I20260709 13:09:57.913129 25860 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.180.65:45331 every 8 connection(s)
I20260709 13:09:57.926229 15057 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:57.928979 25798 tablet_bootstrap.cc:492] T a06a18d1f8c346f2b758f593d709eb53 P 0482fd26e89d4bb89ee847d0108ab167: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:57.930106 25798 tablet_bootstrap.cc:492] T a06a18d1f8c346f2b758f593d709eb53 P 0482fd26e89d4bb89ee847d0108ab167: Bootstrap complete.
I20260709 13:09:57.930868 25798 ts_tablet_manager.cc:1403] T a06a18d1f8c346f2b758f593d709eb53 P 0482fd26e89d4bb89ee847d0108ab167: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.012s
I20260709 13:09:57.933842 25798 raft_consensus.cc:359] T a06a18d1f8c346f2b758f593d709eb53 P 0482fd26e89d4bb89ee847d0108ab167 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:57.934616 25798 raft_consensus.cc:740] T a06a18d1f8c346f2b758f593d709eb53 P 0482fd26e89d4bb89ee847d0108ab167 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0482fd26e89d4bb89ee847d0108ab167, State: Initialized, Role: FOLLOWER
I20260709 13:09:57.935534 25798 consensus_queue.cc:260] T a06a18d1f8c346f2b758f593d709eb53 P 0482fd26e89d4bb89ee847d0108ab167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:57.937862 25798 ts_tablet_manager.cc:1434] T a06a18d1f8c346f2b758f593d709eb53 P 0482fd26e89d4bb89ee847d0108ab167: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:09:57.938831 25798 tablet_bootstrap.cc:492] T cc05b0de0de04e64a129f5138acaf446 P 0482fd26e89d4bb89ee847d0108ab167: Bootstrap starting.
I20260709 13:09:57.948089 25861 heartbeater.cc:344] Connected to a master server at 127.14.180.126:37755
I20260709 13:09:57.948616 25861 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:57.949712 25861 heartbeater.cc:507] Master 127.14.180.126:37755 requested a full tablet report, sending...
I20260709 13:09:57.955462 25620 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "11ad0defd0924408a16ee3f7a8a60106"
dest_uuid: "6e4379ca45a84c5d807695a3fef07116"
mode: GRACEFUL
new_leader_uuid: "a8545e52c3ee4ac691870228228b4fa5"
 from {username='slave'} at 127.0.0.1:52070
I20260709 13:09:57.956383 25620 raft_consensus.cc:606] T 11ad0defd0924408a16ee3f7a8a60106 P 6e4379ca45a84c5d807695a3fef07116 [term 2 LEADER]: Received request to transfer leadership to TS a8545e52c3ee4ac691870228228b4fa5
I20260709 13:09:57.957760 25367 ts_manager.cc:194] Re-registered known tserver with Master: 0482fd26e89d4bb89ee847d0108ab167 (127.14.180.65:45331)
I20260709 13:09:57.957991 25798 tablet_bootstrap.cc:492] T cc05b0de0de04e64a129f5138acaf446 P 0482fd26e89d4bb89ee847d0108ab167: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:57.958952 25798 tablet_bootstrap.cc:492] T cc05b0de0de04e64a129f5138acaf446 P 0482fd26e89d4bb89ee847d0108ab167: Bootstrap complete.
I20260709 13:09:57.959193 25620 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "442972580e8d4c5f9010dd64ba54899b"
dest_uuid: "6e4379ca45a84c5d807695a3fef07116"
mode: GRACEFUL
new_leader_uuid: "a8545e52c3ee4ac691870228228b4fa5"
 from {username='slave'} at 127.0.0.1:52070
I20260709 13:09:57.959736 25798 ts_tablet_manager.cc:1403] T cc05b0de0de04e64a129f5138acaf446 P 0482fd26e89d4bb89ee847d0108ab167: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.007s
I20260709 13:09:57.959718 25620 raft_consensus.cc:606] T 442972580e8d4c5f9010dd64ba54899b P 6e4379ca45a84c5d807695a3fef07116 [term 1 LEADER]: Received request to transfer leadership to TS a8545e52c3ee4ac691870228228b4fa5
I20260709 13:09:57.962684 25798 raft_consensus.cc:359] T cc05b0de0de04e64a129f5138acaf446 P 0482fd26e89d4bb89ee847d0108ab167 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:57.963446 25798 raft_consensus.cc:740] T cc05b0de0de04e64a129f5138acaf446 P 0482fd26e89d4bb89ee847d0108ab167 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0482fd26e89d4bb89ee847d0108ab167, State: Initialized, Role: FOLLOWER
I20260709 13:09:57.964223 25798 consensus_queue.cc:260] T cc05b0de0de04e64a129f5138acaf446 P 0482fd26e89d4bb89ee847d0108ab167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:57.965131 25620 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b6d563892443429682cba0bba950c7d7"
dest_uuid: "6e4379ca45a84c5d807695a3fef07116"
mode: GRACEFUL
new_leader_uuid: "a8545e52c3ee4ac691870228228b4fa5"
 from {username='slave'} at 127.0.0.1:52070
I20260709 13:09:57.965728 25620 raft_consensus.cc:606] T b6d563892443429682cba0bba950c7d7 P 6e4379ca45a84c5d807695a3fef07116 [term 1 LEADER]: Received request to transfer leadership to TS a8545e52c3ee4ac691870228228b4fa5
I20260709 13:09:57.966723 25798 ts_tablet_manager.cc:1434] T cc05b0de0de04e64a129f5138acaf446 P 0482fd26e89d4bb89ee847d0108ab167: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:09:57.967727 25798 tablet_bootstrap.cc:492] T 1119e418e9964dd1be1dcf47e3fe9734 P 0482fd26e89d4bb89ee847d0108ab167: Bootstrap starting.
I20260709 13:09:57.968490 25620 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d0cd92d7306d4ed695dc084aabbfb995"
dest_uuid: "6e4379ca45a84c5d807695a3fef07116"
mode: GRACEFUL
new_leader_uuid: "a8545e52c3ee4ac691870228228b4fa5"
 from {username='slave'} at 127.0.0.1:52070
I20260709 13:09:57.969064 25620 raft_consensus.cc:606] T d0cd92d7306d4ed695dc084aabbfb995 P 6e4379ca45a84c5d807695a3fef07116 [term 1 LEADER]: Received request to transfer leadership to TS a8545e52c3ee4ac691870228228b4fa5
I20260709 13:09:57.970299 15057 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:09:57.971038 15057 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:57.970860 25367 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58668
I20260709 13:09:57.971935 15057 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:57.975375 25861 heartbeater.cc:499] Master 127.14.180.126:37755 was elected leader, sending a full tablet report...
I20260709 13:09:57.994038 25798 tablet_bootstrap.cc:492] T 1119e418e9964dd1be1dcf47e3fe9734 P 0482fd26e89d4bb89ee847d0108ab167: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:57.994288 25871 raft_consensus.cc:993] T d0cd92d7306d4ed695dc084aabbfb995 P 6e4379ca45a84c5d807695a3fef07116: : Instructing follower a8545e52c3ee4ac691870228228b4fa5 to start an election
I20260709 13:09:57.995064 25775 raft_consensus.cc:1081] T d0cd92d7306d4ed695dc084aabbfb995 P 6e4379ca45a84c5d807695a3fef07116 [term 1 LEADER]: Signalling peer a8545e52c3ee4ac691870228228b4fa5 to start an election
I20260709 13:09:57.995297 25798 tablet_bootstrap.cc:492] T 1119e418e9964dd1be1dcf47e3fe9734 P 0482fd26e89d4bb89ee847d0108ab167: Bootstrap complete.
I20260709 13:09:57.996135 25798 ts_tablet_manager.cc:1403] T 1119e418e9964dd1be1dcf47e3fe9734 P 0482fd26e89d4bb89ee847d0108ab167: Time spent bootstrapping tablet: real 0.029s	user 0.019s	sys 0.004s
I20260709 13:09:57.997217 25545 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d0cd92d7306d4ed695dc084aabbfb995"
dest_uuid: "a8545e52c3ee4ac691870228228b4fa5"
 from {username='slave'} at 127.0.0.1:47724
I20260709 13:09:57.997923 25545 raft_consensus.cc:493] T d0cd92d7306d4ed695dc084aabbfb995 P a8545e52c3ee4ac691870228228b4fa5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:57.998350 25545 raft_consensus.cc:3060] T d0cd92d7306d4ed695dc084aabbfb995 P a8545e52c3ee4ac691870228228b4fa5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:57.999092 25798 raft_consensus.cc:359] T 1119e418e9964dd1be1dcf47e3fe9734 P 0482fd26e89d4bb89ee847d0108ab167 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:57.999859 25798 raft_consensus.cc:740] T 1119e418e9964dd1be1dcf47e3fe9734 P 0482fd26e89d4bb89ee847d0108ab167 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0482fd26e89d4bb89ee847d0108ab167, State: Initialized, Role: FOLLOWER
I20260709 13:09:58.000655 25798 consensus_queue.cc:260] T 1119e418e9964dd1be1dcf47e3fe9734 P 0482fd26e89d4bb89ee847d0108ab167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:58.003121 25798 ts_tablet_manager.cc:1434] T 1119e418e9964dd1be1dcf47e3fe9734 P 0482fd26e89d4bb89ee847d0108ab167: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:09:58.004128 25798 tablet_bootstrap.cc:492] T 11ad0defd0924408a16ee3f7a8a60106 P 0482fd26e89d4bb89ee847d0108ab167: Bootstrap starting.
I20260709 13:09:58.009548 25545 raft_consensus.cc:515] T d0cd92d7306d4ed695dc084aabbfb995 P a8545e52c3ee4ac691870228228b4fa5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:58.013665 25620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0cd92d7306d4ed695dc084aabbfb995" candidate_uuid: "a8545e52c3ee4ac691870228228b4fa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6e4379ca45a84c5d807695a3fef07116"
I20260709 13:09:58.014379 25620 raft_consensus.cc:3055] T d0cd92d7306d4ed695dc084aabbfb995 P 6e4379ca45a84c5d807695a3fef07116 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:58.014931 25620 raft_consensus.cc:740] T d0cd92d7306d4ed695dc084aabbfb995 P 6e4379ca45a84c5d807695a3fef07116 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6e4379ca45a84c5d807695a3fef07116, State: Running, Role: LEADER
I20260709 13:09:58.016114 25620 consensus_queue.cc:260] T d0cd92d7306d4ed695dc084aabbfb995 P 6e4379ca45a84c5d807695a3fef07116 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:58.017683 25620 raft_consensus.cc:3060] T d0cd92d7306d4ed695dc084aabbfb995 P 6e4379ca45a84c5d807695a3fef07116 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:58.022516 25545 leader_election.cc:290] T d0cd92d7306d4ed695dc084aabbfb995 P a8545e52c3ee4ac691870228228b4fa5 [CANDIDATE]: Term 2 election: Requested vote from peers 0482fd26e89d4bb89ee847d0108ab167 (127.14.180.65:45331), 6e4379ca45a84c5d807695a3fef07116 (127.14.180.67:39657)
I20260709 13:09:58.031008 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0cd92d7306d4ed695dc084aabbfb995" candidate_uuid: "a8545e52c3ee4ac691870228228b4fa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0482fd26e89d4bb89ee847d0108ab167"
I20260709 13:09:58.031445 25620 raft_consensus.cc:2468] T d0cd92d7306d4ed695dc084aabbfb995 P 6e4379ca45a84c5d807695a3fef07116 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8545e52c3ee4ac691870228228b4fa5 in term 2.
W20260709 13:09:58.032537 25511 leader_election.cc:343] T d0cd92d7306d4ed695dc084aabbfb995 P a8545e52c3ee4ac691870228228b4fa5 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 0482fd26e89d4bb89ee847d0108ab167 (127.14.180.65:45331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:58.033171 25513 leader_election.cc:304] T d0cd92d7306d4ed695dc084aabbfb995 P a8545e52c3ee4ac691870228228b4fa5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e4379ca45a84c5d807695a3fef07116, a8545e52c3ee4ac691870228228b4fa5; no voters: 0482fd26e89d4bb89ee847d0108ab167
I20260709 13:09:58.034070 25764 raft_consensus.cc:2804] T d0cd92d7306d4ed695dc084aabbfb995 P a8545e52c3ee4ac691870228228b4fa5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:58.035418 25764 raft_consensus.cc:697] T d0cd92d7306d4ed695dc084aabbfb995 P a8545e52c3ee4ac691870228228b4fa5 [term 2 LEADER]: Becoming Leader. State: Replica: a8545e52c3ee4ac691870228228b4fa5, State: Running, Role: LEADER
I20260709 13:09:58.035879 25798 tablet_bootstrap.cc:492] T 11ad0defd0924408a16ee3f7a8a60106 P 0482fd26e89d4bb89ee847d0108ab167: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:58.036791 25798 tablet_bootstrap.cc:492] T 11ad0defd0924408a16ee3f7a8a60106 P 0482fd26e89d4bb89ee847d0108ab167: Bootstrap complete.
I20260709 13:09:58.036507 25764 consensus_queue.cc:237] T d0cd92d7306d4ed695dc084aabbfb995 P a8545e52c3ee4ac691870228228b4fa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:58.037449 25798 ts_tablet_manager.cc:1403] T 11ad0defd0924408a16ee3f7a8a60106 P 0482fd26e89d4bb89ee847d0108ab167: Time spent bootstrapping tablet: real 0.034s	user 0.013s	sys 0.014s
I20260709 13:09:58.040009 25798 raft_consensus.cc:359] T 11ad0defd0924408a16ee3f7a8a60106 P 0482fd26e89d4bb89ee847d0108ab167 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:58.040738 25798 raft_consensus.cc:740] T 11ad0defd0924408a16ee3f7a8a60106 P 0482fd26e89d4bb89ee847d0108ab167 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0482fd26e89d4bb89ee847d0108ab167, State: Initialized, Role: FOLLOWER
I20260709 13:09:58.041656 25798 consensus_queue.cc:260] T 11ad0defd0924408a16ee3f7a8a60106 P 0482fd26e89d4bb89ee847d0108ab167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:58.043932 25798 ts_tablet_manager.cc:1434] T 11ad0defd0924408a16ee3f7a8a60106 P 0482fd26e89d4bb89ee847d0108ab167: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:09:58.044847 25798 tablet_bootstrap.cc:492] T d0cd92d7306d4ed695dc084aabbfb995 P 0482fd26e89d4bb89ee847d0108ab167: Bootstrap starting.
I20260709 13:09:58.045819 25367 catalog_manager.cc:5697] T d0cd92d7306d4ed695dc084aabbfb995 P a8545e52c3ee4ac691870228228b4fa5 reported cstate change: term changed from 1 to 2, leader changed from 6e4379ca45a84c5d807695a3fef07116 (127.14.180.67) to a8545e52c3ee4ac691870228228b4fa5 (127.14.180.66). New cstate: current_term: 2 leader_uuid: "a8545e52c3ee4ac691870228228b4fa5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:58.061827 25798 tablet_bootstrap.cc:492] T d0cd92d7306d4ed695dc084aabbfb995 P 0482fd26e89d4bb89ee847d0108ab167: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:58.062824 25798 tablet_bootstrap.cc:492] T d0cd92d7306d4ed695dc084aabbfb995 P 0482fd26e89d4bb89ee847d0108ab167: Bootstrap complete.
I20260709 13:09:58.063623 25798 ts_tablet_manager.cc:1403] T d0cd92d7306d4ed695dc084aabbfb995 P 0482fd26e89d4bb89ee847d0108ab167: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.003s
I20260709 13:09:58.066013 25798 raft_consensus.cc:359] T d0cd92d7306d4ed695dc084aabbfb995 P 0482fd26e89d4bb89ee847d0108ab167 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:58.066497 25798 raft_consensus.cc:740] T d0cd92d7306d4ed695dc084aabbfb995 P 0482fd26e89d4bb89ee847d0108ab167 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0482fd26e89d4bb89ee847d0108ab167, State: Initialized, Role: FOLLOWER
I20260709 13:09:58.067180 25798 consensus_queue.cc:260] T d0cd92d7306d4ed695dc084aabbfb995 P 0482fd26e89d4bb89ee847d0108ab167 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:58.068807 25798 ts_tablet_manager.cc:1434] T d0cd92d7306d4ed695dc084aabbfb995 P 0482fd26e89d4bb89ee847d0108ab167: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:09:58.321543 25775 raft_consensus.cc:993] T b6d563892443429682cba0bba950c7d7 P 6e4379ca45a84c5d807695a3fef07116: : Instructing follower a8545e52c3ee4ac691870228228b4fa5 to start an election
I20260709 13:09:58.322294 25882 raft_consensus.cc:1081] T b6d563892443429682cba0bba950c7d7 P 6e4379ca45a84c5d807695a3fef07116 [term 1 LEADER]: Signalling peer a8545e52c3ee4ac691870228228b4fa5 to start an election
I20260709 13:09:58.324231 25547 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b6d563892443429682cba0bba950c7d7"
dest_uuid: "a8545e52c3ee4ac691870228228b4fa5"
 from {username='slave'} at 127.0.0.1:47724
I20260709 13:09:58.324911 25547 raft_consensus.cc:493] T b6d563892443429682cba0bba950c7d7 P a8545e52c3ee4ac691870228228b4fa5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:58.325343 25547 raft_consensus.cc:3060] T b6d563892443429682cba0bba950c7d7 P a8545e52c3ee4ac691870228228b4fa5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:58.332763 25547 raft_consensus.cc:515] T b6d563892443429682cba0bba950c7d7 P a8545e52c3ee4ac691870228228b4fa5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } } peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } }
I20260709 13:09:58.334724 25547 leader_election.cc:290] T b6d563892443429682cba0bba950c7d7 P a8545e52c3ee4ac691870228228b4fa5 [CANDIDATE]: Term 2 election: Requested vote from peers 6e4379ca45a84c5d807695a3fef07116 (127.14.180.67:39657), 0482fd26e89d4bb89ee847d0108ab167 (127.14.180.65:45331)
I20260709 13:09:58.336086 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6d563892443429682cba0bba950c7d7" candidate_uuid: "a8545e52c3ee4ac691870228228b4fa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0482fd26e89d4bb89ee847d0108ab167"
I20260709 13:09:58.335944 25620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6d563892443429682cba0bba950c7d7" candidate_uuid: "a8545e52c3ee4ac691870228228b4fa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6e4379ca45a84c5d807695a3fef07116"
I20260709 13:09:58.336941 25835 raft_consensus.cc:3060] T b6d563892443429682cba0bba950c7d7 P 0482fd26e89d4bb89ee847d0108ab167 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:58.337083 25620 raft_consensus.cc:3055] T b6d563892443429682cba0bba950c7d7 P 6e4379ca45a84c5d807695a3fef07116 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:58.337687 25620 raft_consensus.cc:740] T b6d563892443429682cba0bba950c7d7 P 6e4379ca45a84c5d807695a3fef07116 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6e4379ca45a84c5d807695a3fef07116, State: Running, Role: LEADER
I20260709 13:09:58.338811 25620 consensus_queue.cc:260] T b6d563892443429682cba0bba950c7d7 P 6e4379ca45a84c5d807695a3fef07116 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } } peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } }
I20260709 13:09:58.339848 25871 raft_consensus.cc:993] T 11ad0defd0924408a16ee3f7a8a60106 P 6e4379ca45a84c5d807695a3fef07116: : Instructing follower a8545e52c3ee4ac691870228228b4fa5 to start an election
I20260709 13:09:58.340587 25882 raft_consensus.cc:1081] T 11ad0defd0924408a16ee3f7a8a60106 P 6e4379ca45a84c5d807695a3fef07116 [term 2 LEADER]: Signalling peer a8545e52c3ee4ac691870228228b4fa5 to start an election
I20260709 13:09:58.340613 25620 raft_consensus.cc:3060] T b6d563892443429682cba0bba950c7d7 P 6e4379ca45a84c5d807695a3fef07116 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:58.343010 25547 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "11ad0defd0924408a16ee3f7a8a60106"
dest_uuid: "a8545e52c3ee4ac691870228228b4fa5"
 from {username='slave'} at 127.0.0.1:47724
I20260709 13:09:58.344067 25547 raft_consensus.cc:493] T 11ad0defd0924408a16ee3f7a8a60106 P a8545e52c3ee4ac691870228228b4fa5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:58.344527 25547 raft_consensus.cc:3060] T 11ad0defd0924408a16ee3f7a8a60106 P a8545e52c3ee4ac691870228228b4fa5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:58.347592 25835 raft_consensus.cc:2468] T b6d563892443429682cba0bba950c7d7 P 0482fd26e89d4bb89ee847d0108ab167 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8545e52c3ee4ac691870228228b4fa5 in term 2.
I20260709 13:09:58.348009 25620 raft_consensus.cc:2468] T b6d563892443429682cba0bba950c7d7 P 6e4379ca45a84c5d807695a3fef07116 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8545e52c3ee4ac691870228228b4fa5 in term 2.
I20260709 13:09:58.349184 25511 leader_election.cc:304] T b6d563892443429682cba0bba950c7d7 P a8545e52c3ee4ac691870228228b4fa5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0482fd26e89d4bb89ee847d0108ab167, a8545e52c3ee4ac691870228228b4fa5; no voters: 
I20260709 13:09:58.350195 25764 raft_consensus.cc:2804] T b6d563892443429682cba0bba950c7d7 P a8545e52c3ee4ac691870228228b4fa5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:58.350770 25764 raft_consensus.cc:697] T b6d563892443429682cba0bba950c7d7 P a8545e52c3ee4ac691870228228b4fa5 [term 2 LEADER]: Becoming Leader. State: Replica: a8545e52c3ee4ac691870228228b4fa5, State: Running, Role: LEADER
I20260709 13:09:58.351749 25764 consensus_queue.cc:237] T b6d563892443429682cba0bba950c7d7 P a8545e52c3ee4ac691870228228b4fa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } } peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } }
I20260709 13:09:58.353075 25547 raft_consensus.cc:515] T 11ad0defd0924408a16ee3f7a8a60106 P a8545e52c3ee4ac691870228228b4fa5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:58.355973 25547 leader_election.cc:290] T 11ad0defd0924408a16ee3f7a8a60106 P a8545e52c3ee4ac691870228228b4fa5 [CANDIDATE]: Term 3 election: Requested vote from peers 0482fd26e89d4bb89ee847d0108ab167 (127.14.180.65:45331), 6e4379ca45a84c5d807695a3fef07116 (127.14.180.67:39657)
I20260709 13:09:58.356540 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ad0defd0924408a16ee3f7a8a60106" candidate_uuid: "a8545e52c3ee4ac691870228228b4fa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0482fd26e89d4bb89ee847d0108ab167"
I20260709 13:09:58.357338 25835 raft_consensus.cc:3060] T 11ad0defd0924408a16ee3f7a8a60106 P 0482fd26e89d4bb89ee847d0108ab167 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:09:58.358886 25620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ad0defd0924408a16ee3f7a8a60106" candidate_uuid: "a8545e52c3ee4ac691870228228b4fa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6e4379ca45a84c5d807695a3fef07116"
I20260709 13:09:58.359637 25620 raft_consensus.cc:3055] T 11ad0defd0924408a16ee3f7a8a60106 P 6e4379ca45a84c5d807695a3fef07116 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:58.360407 25620 raft_consensus.cc:740] T 11ad0defd0924408a16ee3f7a8a60106 P 6e4379ca45a84c5d807695a3fef07116 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6e4379ca45a84c5d807695a3fef07116, State: Running, Role: LEADER
I20260709 13:09:58.360903 25367 catalog_manager.cc:5697] T b6d563892443429682cba0bba950c7d7 P a8545e52c3ee4ac691870228228b4fa5 reported cstate change: term changed from 1 to 2, leader changed from 6e4379ca45a84c5d807695a3fef07116 (127.14.180.67) to a8545e52c3ee4ac691870228228b4fa5 (127.14.180.66). New cstate: current_term: 2 leader_uuid: "a8545e52c3ee4ac691870228228b4fa5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:58.361387 25620 consensus_queue.cc:260] T 11ad0defd0924408a16ee3f7a8a60106 P 6e4379ca45a84c5d807695a3fef07116 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:58.363034 25620 raft_consensus.cc:3060] T 11ad0defd0924408a16ee3f7a8a60106 P 6e4379ca45a84c5d807695a3fef07116 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:58.366684 25835 raft_consensus.cc:2468] T 11ad0defd0924408a16ee3f7a8a60106 P 0482fd26e89d4bb89ee847d0108ab167 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8545e52c3ee4ac691870228228b4fa5 in term 3.
I20260709 13:09:58.369122 25511 leader_election.cc:304] T 11ad0defd0924408a16ee3f7a8a60106 P a8545e52c3ee4ac691870228228b4fa5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0482fd26e89d4bb89ee847d0108ab167, a8545e52c3ee4ac691870228228b4fa5; no voters: 
I20260709 13:09:58.370016 25764 raft_consensus.cc:2804] T 11ad0defd0924408a16ee3f7a8a60106 P a8545e52c3ee4ac691870228228b4fa5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:58.370610 25764 raft_consensus.cc:697] T 11ad0defd0924408a16ee3f7a8a60106 P a8545e52c3ee4ac691870228228b4fa5 [term 3 LEADER]: Becoming Leader. State: Replica: a8545e52c3ee4ac691870228228b4fa5, State: Running, Role: LEADER
I20260709 13:09:58.371953 25620 raft_consensus.cc:2468] T 11ad0defd0924408a16ee3f7a8a60106 P 6e4379ca45a84c5d807695a3fef07116 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8545e52c3ee4ac691870228228b4fa5 in term 3.
I20260709 13:09:58.371832 25764 consensus_queue.cc:237] T 11ad0defd0924408a16ee3f7a8a60106 P a8545e52c3ee4ac691870228228b4fa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:58.382300 25367 catalog_manager.cc:5697] T 11ad0defd0924408a16ee3f7a8a60106 P a8545e52c3ee4ac691870228228b4fa5 reported cstate change: term changed from 2 to 3, leader changed from 6e4379ca45a84c5d807695a3fef07116 (127.14.180.67) to a8545e52c3ee4ac691870228228b4fa5 (127.14.180.66). New cstate: current_term: 3 leader_uuid: "a8545e52c3ee4ac691870228228b4fa5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:58.471079 25871 raft_consensus.cc:993] T 442972580e8d4c5f9010dd64ba54899b P 6e4379ca45a84c5d807695a3fef07116: : Instructing follower a8545e52c3ee4ac691870228228b4fa5 to start an election
I20260709 13:09:58.471633 25882 raft_consensus.cc:1081] T 442972580e8d4c5f9010dd64ba54899b P 6e4379ca45a84c5d807695a3fef07116 [term 1 LEADER]: Signalling peer a8545e52c3ee4ac691870228228b4fa5 to start an election
I20260709 13:09:58.473390 25547 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "442972580e8d4c5f9010dd64ba54899b"
dest_uuid: "a8545e52c3ee4ac691870228228b4fa5"
 from {username='slave'} at 127.0.0.1:47724
I20260709 13:09:58.474013 25547 raft_consensus.cc:493] T 442972580e8d4c5f9010dd64ba54899b P a8545e52c3ee4ac691870228228b4fa5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:58.474354 25547 raft_consensus.cc:3060] T 442972580e8d4c5f9010dd64ba54899b P a8545e52c3ee4ac691870228228b4fa5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:58.479554 25547 raft_consensus.cc:515] T 442972580e8d4c5f9010dd64ba54899b P a8545e52c3ee4ac691870228228b4fa5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:58.481329 25547 leader_election.cc:290] T 442972580e8d4c5f9010dd64ba54899b P a8545e52c3ee4ac691870228228b4fa5 [CANDIDATE]: Term 2 election: Requested vote from peers 0482fd26e89d4bb89ee847d0108ab167 (127.14.180.65:45331), 6e4379ca45a84c5d807695a3fef07116 (127.14.180.67:39657)
I20260709 13:09:58.482161 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "442972580e8d4c5f9010dd64ba54899b" candidate_uuid: "a8545e52c3ee4ac691870228228b4fa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0482fd26e89d4bb89ee847d0108ab167"
I20260709 13:09:58.482528 25620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "442972580e8d4c5f9010dd64ba54899b" candidate_uuid: "a8545e52c3ee4ac691870228228b4fa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6e4379ca45a84c5d807695a3fef07116"
I20260709 13:09:58.482930 25835 raft_consensus.cc:3060] T 442972580e8d4c5f9010dd64ba54899b P 0482fd26e89d4bb89ee847d0108ab167 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:58.483184 25620 raft_consensus.cc:3055] T 442972580e8d4c5f9010dd64ba54899b P 6e4379ca45a84c5d807695a3fef07116 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:58.483527 25620 raft_consensus.cc:740] T 442972580e8d4c5f9010dd64ba54899b P 6e4379ca45a84c5d807695a3fef07116 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6e4379ca45a84c5d807695a3fef07116, State: Running, Role: LEADER
I20260709 13:09:58.484476 25620 consensus_queue.cc:260] T 442972580e8d4c5f9010dd64ba54899b P 6e4379ca45a84c5d807695a3fef07116 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:58.485878 25620 raft_consensus.cc:3060] T 442972580e8d4c5f9010dd64ba54899b P 6e4379ca45a84c5d807695a3fef07116 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:58.491153 25835 raft_consensus.cc:2468] T 442972580e8d4c5f9010dd64ba54899b P 0482fd26e89d4bb89ee847d0108ab167 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8545e52c3ee4ac691870228228b4fa5 in term 2.
I20260709 13:09:58.492697 25511 leader_election.cc:304] T 442972580e8d4c5f9010dd64ba54899b P a8545e52c3ee4ac691870228228b4fa5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0482fd26e89d4bb89ee847d0108ab167, a8545e52c3ee4ac691870228228b4fa5; no voters: 
I20260709 13:09:58.493903 25764 raft_consensus.cc:2804] T 442972580e8d4c5f9010dd64ba54899b P a8545e52c3ee4ac691870228228b4fa5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:58.494113 25620 raft_consensus.cc:2468] T 442972580e8d4c5f9010dd64ba54899b P 6e4379ca45a84c5d807695a3fef07116 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8545e52c3ee4ac691870228228b4fa5 in term 2.
I20260709 13:09:58.494488 25764 raft_consensus.cc:697] T 442972580e8d4c5f9010dd64ba54899b P a8545e52c3ee4ac691870228228b4fa5 [term 2 LEADER]: Becoming Leader. State: Replica: a8545e52c3ee4ac691870228228b4fa5, State: Running, Role: LEADER
I20260709 13:09:58.495635 25764 consensus_queue.cc:237] T 442972580e8d4c5f9010dd64ba54899b P a8545e52c3ee4ac691870228228b4fa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:58.503326 25367 catalog_manager.cc:5697] T 442972580e8d4c5f9010dd64ba54899b P a8545e52c3ee4ac691870228228b4fa5 reported cstate change: term changed from 1 to 2, leader changed from 6e4379ca45a84c5d807695a3fef07116 (127.14.180.67) to a8545e52c3ee4ac691870228228b4fa5 (127.14.180.66). New cstate: current_term: 2 leader_uuid: "a8545e52c3ee4ac691870228228b4fa5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:58.629114 25620 raft_consensus.cc:1275] T d0cd92d7306d4ed695dc084aabbfb995 P 6e4379ca45a84c5d807695a3fef07116 [term 2 FOLLOWER]: Refusing update from remote peer a8545e52c3ee4ac691870228228b4fa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:58.630613 25764 consensus_queue.cc:1048] T d0cd92d7306d4ed695dc084aabbfb995 P a8545e52c3ee4ac691870228228b4fa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:58.642360 25835 raft_consensus.cc:3060] T d0cd92d7306d4ed695dc084aabbfb995 P 0482fd26e89d4bb89ee847d0108ab167 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:58.650712 25835 raft_consensus.cc:1275] T d0cd92d7306d4ed695dc084aabbfb995 P 0482fd26e89d4bb89ee847d0108ab167 [term 2 FOLLOWER]: Refusing update from remote peer a8545e52c3ee4ac691870228228b4fa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:58.652176 25764 consensus_queue.cc:1048] T d0cd92d7306d4ed695dc084aabbfb995 P a8545e52c3ee4ac691870228228b4fa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:09:58.707739 25418 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:09:58.781562 25620 raft_consensus.cc:1275] T b6d563892443429682cba0bba950c7d7 P 6e4379ca45a84c5d807695a3fef07116 [term 2 FOLLOWER]: Refusing update from remote peer a8545e52c3ee4ac691870228228b4fa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:58.783383 25875 consensus_queue.cc:1048] T b6d563892443429682cba0bba950c7d7 P a8545e52c3ee4ac691870228228b4fa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:58.795477 25835 raft_consensus.cc:1275] T b6d563892443429682cba0bba950c7d7 P 0482fd26e89d4bb89ee847d0108ab167 [term 2 FOLLOWER]: Refusing update from remote peer a8545e52c3ee4ac691870228228b4fa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:58.798277 25764 consensus_queue.cc:1048] T b6d563892443429682cba0bba950c7d7 P a8545e52c3ee4ac691870228228b4fa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:58.901578 25834 raft_consensus.cc:1275] T 442972580e8d4c5f9010dd64ba54899b P 0482fd26e89d4bb89ee847d0108ab167 [term 2 FOLLOWER]: Refusing update from remote peer a8545e52c3ee4ac691870228228b4fa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:58.903017 25875 consensus_queue.cc:1048] T 442972580e8d4c5f9010dd64ba54899b P a8545e52c3ee4ac691870228228b4fa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:58.911854 25835 raft_consensus.cc:1275] T 11ad0defd0924408a16ee3f7a8a60106 P 0482fd26e89d4bb89ee847d0108ab167 [term 3 FOLLOWER]: Refusing update from remote peer a8545e52c3ee4ac691870228228b4fa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:58.914821 25764 consensus_queue.cc:1048] T 11ad0defd0924408a16ee3f7a8a60106 P a8545e52c3ee4ac691870228228b4fa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:58.916684 25620 raft_consensus.cc:1275] T 442972580e8d4c5f9010dd64ba54899b P 6e4379ca45a84c5d807695a3fef07116 [term 2 FOLLOWER]: Refusing update from remote peer a8545e52c3ee4ac691870228228b4fa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:58.918864 25884 consensus_queue.cc:1048] T 442972580e8d4c5f9010dd64ba54899b P a8545e52c3ee4ac691870228228b4fa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:58.943497 25620 raft_consensus.cc:1275] T 11ad0defd0924408a16ee3f7a8a60106 P 6e4379ca45a84c5d807695a3fef07116 [term 3 FOLLOWER]: Refusing update from remote peer a8545e52c3ee4ac691870228228b4fa5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:58.945765 25896 consensus_queue.cc:1048] T 11ad0defd0924408a16ee3f7a8a60106 P a8545e52c3ee4ac691870228228b4fa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:58.981845 15057 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:59.000226 25547 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "442972580e8d4c5f9010dd64ba54899b"
dest_uuid: "a8545e52c3ee4ac691870228228b4fa5"
mode: GRACEFUL
new_leader_uuid: "6e4379ca45a84c5d807695a3fef07116"
 from {username='slave'} at 127.0.0.1:59550
I20260709 13:09:59.000798 25547 raft_consensus.cc:606] T 442972580e8d4c5f9010dd64ba54899b P a8545e52c3ee4ac691870228228b4fa5 [term 2 LEADER]: Received request to transfer leadership to TS 6e4379ca45a84c5d807695a3fef07116
I20260709 13:09:59.004122 25547 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a06a18d1f8c346f2b758f593d709eb53"
dest_uuid: "a8545e52c3ee4ac691870228228b4fa5"
mode: GRACEFUL
new_leader_uuid: "6e4379ca45a84c5d807695a3fef07116"
 from {username='slave'} at 127.0.0.1:59550
I20260709 13:09:59.004673 25547 raft_consensus.cc:606] T a06a18d1f8c346f2b758f593d709eb53 P a8545e52c3ee4ac691870228228b4fa5 [term 1 LEADER]: Received request to transfer leadership to TS 6e4379ca45a84c5d807695a3fef07116
I20260709 13:09:59.005815 15057 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:09:59.006333 15057 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:59.007030 15057 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:59.254848 25764 raft_consensus.cc:993] T a06a18d1f8c346f2b758f593d709eb53 P a8545e52c3ee4ac691870228228b4fa5: : Instructing follower 6e4379ca45a84c5d807695a3fef07116 to start an election
I20260709 13:09:59.255367 25896 raft_consensus.cc:1081] T a06a18d1f8c346f2b758f593d709eb53 P a8545e52c3ee4ac691870228228b4fa5 [term 1 LEADER]: Signalling peer 6e4379ca45a84c5d807695a3fef07116 to start an election
I20260709 13:09:59.257023 25620 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a06a18d1f8c346f2b758f593d709eb53"
dest_uuid: "6e4379ca45a84c5d807695a3fef07116"
 from {username='slave'} at 127.0.0.1:52056
I20260709 13:09:59.257511 25620 raft_consensus.cc:493] T a06a18d1f8c346f2b758f593d709eb53 P 6e4379ca45a84c5d807695a3fef07116 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:59.257784 25620 raft_consensus.cc:3060] T a06a18d1f8c346f2b758f593d709eb53 P 6e4379ca45a84c5d807695a3fef07116 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:59.265667 25620 raft_consensus.cc:515] T a06a18d1f8c346f2b758f593d709eb53 P 6e4379ca45a84c5d807695a3fef07116 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:59.267735 25620 leader_election.cc:290] T a06a18d1f8c346f2b758f593d709eb53 P 6e4379ca45a84c5d807695a3fef07116 [CANDIDATE]: Term 2 election: Requested vote from peers 0482fd26e89d4bb89ee847d0108ab167 (127.14.180.65:45331), a8545e52c3ee4ac691870228228b4fa5 (127.14.180.66:35803)
I20260709 13:09:59.268440 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a06a18d1f8c346f2b758f593d709eb53" candidate_uuid: "6e4379ca45a84c5d807695a3fef07116" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0482fd26e89d4bb89ee847d0108ab167"
I20260709 13:09:59.268805 25547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a06a18d1f8c346f2b758f593d709eb53" candidate_uuid: "6e4379ca45a84c5d807695a3fef07116" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a8545e52c3ee4ac691870228228b4fa5"
I20260709 13:09:59.269155 25835 raft_consensus.cc:3060] T a06a18d1f8c346f2b758f593d709eb53 P 0482fd26e89d4bb89ee847d0108ab167 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:59.269438 25547 raft_consensus.cc:3055] T a06a18d1f8c346f2b758f593d709eb53 P a8545e52c3ee4ac691870228228b4fa5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:59.269891 25547 raft_consensus.cc:740] T a06a18d1f8c346f2b758f593d709eb53 P a8545e52c3ee4ac691870228228b4fa5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a8545e52c3ee4ac691870228228b4fa5, State: Running, Role: LEADER
I20260709 13:09:59.271579 25547 consensus_queue.cc:260] T a06a18d1f8c346f2b758f593d709eb53 P a8545e52c3ee4ac691870228228b4fa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:59.273051 25547 raft_consensus.cc:3060] T a06a18d1f8c346f2b758f593d709eb53 P a8545e52c3ee4ac691870228228b4fa5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:59.277014 25835 raft_consensus.cc:2468] T a06a18d1f8c346f2b758f593d709eb53 P 0482fd26e89d4bb89ee847d0108ab167 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e4379ca45a84c5d807695a3fef07116 in term 2.
I20260709 13:09:59.278263 25585 leader_election.cc:304] T a06a18d1f8c346f2b758f593d709eb53 P 6e4379ca45a84c5d807695a3fef07116 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0482fd26e89d4bb89ee847d0108ab167, 6e4379ca45a84c5d807695a3fef07116; no voters: 
I20260709 13:09:59.279173 25902 raft_consensus.cc:2804] T a06a18d1f8c346f2b758f593d709eb53 P 6e4379ca45a84c5d807695a3fef07116 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:59.279645 25902 raft_consensus.cc:697] T a06a18d1f8c346f2b758f593d709eb53 P 6e4379ca45a84c5d807695a3fef07116 [term 2 LEADER]: Becoming Leader. State: Replica: 6e4379ca45a84c5d807695a3fef07116, State: Running, Role: LEADER
I20260709 13:09:59.280512 25902 consensus_queue.cc:237] T a06a18d1f8c346f2b758f593d709eb53 P 6e4379ca45a84c5d807695a3fef07116 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:59.283066 25547 raft_consensus.cc:2468] T a06a18d1f8c346f2b758f593d709eb53 P a8545e52c3ee4ac691870228228b4fa5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e4379ca45a84c5d807695a3fef07116 in term 2.
I20260709 13:09:59.288700 25368 catalog_manager.cc:5697] T a06a18d1f8c346f2b758f593d709eb53 P 6e4379ca45a84c5d807695a3fef07116 reported cstate change: term changed from 1 to 2, leader changed from a8545e52c3ee4ac691870228228b4fa5 (127.14.180.66) to 6e4379ca45a84c5d807695a3fef07116 (127.14.180.67). New cstate: current_term: 2 leader_uuid: "6e4379ca45a84c5d807695a3fef07116" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:59.413861 25884 raft_consensus.cc:993] T 442972580e8d4c5f9010dd64ba54899b P a8545e52c3ee4ac691870228228b4fa5: : Instructing follower 6e4379ca45a84c5d807695a3fef07116 to start an election
I20260709 13:09:59.414448 25884 raft_consensus.cc:1081] T 442972580e8d4c5f9010dd64ba54899b P a8545e52c3ee4ac691870228228b4fa5 [term 2 LEADER]: Signalling peer 6e4379ca45a84c5d807695a3fef07116 to start an election
I20260709 13:09:59.416399 25620 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "442972580e8d4c5f9010dd64ba54899b"
dest_uuid: "6e4379ca45a84c5d807695a3fef07116"
 from {username='slave'} at 127.0.0.1:52056
I20260709 13:09:59.417038 25620 raft_consensus.cc:493] T 442972580e8d4c5f9010dd64ba54899b P 6e4379ca45a84c5d807695a3fef07116 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:59.417539 25620 raft_consensus.cc:3060] T 442972580e8d4c5f9010dd64ba54899b P 6e4379ca45a84c5d807695a3fef07116 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:59.423733 25620 raft_consensus.cc:515] T 442972580e8d4c5f9010dd64ba54899b P 6e4379ca45a84c5d807695a3fef07116 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:59.425549 25620 leader_election.cc:290] T 442972580e8d4c5f9010dd64ba54899b P 6e4379ca45a84c5d807695a3fef07116 [CANDIDATE]: Term 3 election: Requested vote from peers 0482fd26e89d4bb89ee847d0108ab167 (127.14.180.65:45331), a8545e52c3ee4ac691870228228b4fa5 (127.14.180.66:35803)
I20260709 13:09:59.426452 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "442972580e8d4c5f9010dd64ba54899b" candidate_uuid: "6e4379ca45a84c5d807695a3fef07116" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0482fd26e89d4bb89ee847d0108ab167"
I20260709 13:09:59.426906 25545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "442972580e8d4c5f9010dd64ba54899b" candidate_uuid: "6e4379ca45a84c5d807695a3fef07116" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a8545e52c3ee4ac691870228228b4fa5"
I20260709 13:09:59.427363 25835 raft_consensus.cc:3060] T 442972580e8d4c5f9010dd64ba54899b P 0482fd26e89d4bb89ee847d0108ab167 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:59.427769 25545 raft_consensus.cc:3055] T 442972580e8d4c5f9010dd64ba54899b P a8545e52c3ee4ac691870228228b4fa5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:59.428072 25545 raft_consensus.cc:740] T 442972580e8d4c5f9010dd64ba54899b P a8545e52c3ee4ac691870228228b4fa5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a8545e52c3ee4ac691870228228b4fa5, State: Running, Role: LEADER
I20260709 13:09:59.428753 25545 consensus_queue.cc:260] T 442972580e8d4c5f9010dd64ba54899b P a8545e52c3ee4ac691870228228b4fa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:59.429754 25545 raft_consensus.cc:3060] T 442972580e8d4c5f9010dd64ba54899b P a8545e52c3ee4ac691870228228b4fa5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:59.434087 25835 raft_consensus.cc:2468] T 442972580e8d4c5f9010dd64ba54899b P 0482fd26e89d4bb89ee847d0108ab167 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e4379ca45a84c5d807695a3fef07116 in term 3.
I20260709 13:09:59.435508 25585 leader_election.cc:304] T 442972580e8d4c5f9010dd64ba54899b P 6e4379ca45a84c5d807695a3fef07116 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0482fd26e89d4bb89ee847d0108ab167, 6e4379ca45a84c5d807695a3fef07116; no voters: 
I20260709 13:09:59.436314 25902 raft_consensus.cc:2804] T 442972580e8d4c5f9010dd64ba54899b P 6e4379ca45a84c5d807695a3fef07116 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:59.436671 25545 raft_consensus.cc:2468] T 442972580e8d4c5f9010dd64ba54899b P a8545e52c3ee4ac691870228228b4fa5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e4379ca45a84c5d807695a3fef07116 in term 3.
I20260709 13:09:59.436959 25902 raft_consensus.cc:697] T 442972580e8d4c5f9010dd64ba54899b P 6e4379ca45a84c5d807695a3fef07116 [term 3 LEADER]: Becoming Leader. State: Replica: 6e4379ca45a84c5d807695a3fef07116, State: Running, Role: LEADER
I20260709 13:09:59.437886 25902 consensus_queue.cc:237] T 442972580e8d4c5f9010dd64ba54899b P 6e4379ca45a84c5d807695a3fef07116 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:09:59.444803 25368 catalog_manager.cc:5697] T 442972580e8d4c5f9010dd64ba54899b P 6e4379ca45a84c5d807695a3fef07116 reported cstate change: term changed from 2 to 3, leader changed from a8545e52c3ee4ac691870228228b4fa5 (127.14.180.66) to 6e4379ca45a84c5d807695a3fef07116 (127.14.180.67). New cstate: current_term: 3 leader_uuid: "6e4379ca45a84c5d807695a3fef07116" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } health_report { overall_health: HEALTHY } } }
W20260709 13:09:59.708750 25418 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:09:59.737599 25545 raft_consensus.cc:1275] T a06a18d1f8c346f2b758f593d709eb53 P a8545e52c3ee4ac691870228228b4fa5 [term 2 FOLLOWER]: Refusing update from remote peer 6e4379ca45a84c5d807695a3fef07116: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:59.739146 25902 consensus_queue.cc:1048] T a06a18d1f8c346f2b758f593d709eb53 P 6e4379ca45a84c5d807695a3fef07116 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:59.750731 25835 raft_consensus.cc:1275] T a06a18d1f8c346f2b758f593d709eb53 P 0482fd26e89d4bb89ee847d0108ab167 [term 2 FOLLOWER]: Refusing update from remote peer 6e4379ca45a84c5d807695a3fef07116: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:59.754117 25871 consensus_queue.cc:1048] T a06a18d1f8c346f2b758f593d709eb53 P 6e4379ca45a84c5d807695a3fef07116 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:59.905961 25835 raft_consensus.cc:1275] T 442972580e8d4c5f9010dd64ba54899b P 0482fd26e89d4bb89ee847d0108ab167 [term 3 FOLLOWER]: Refusing update from remote peer 6e4379ca45a84c5d807695a3fef07116: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:59.907541 25871 consensus_queue.cc:1048] T 442972580e8d4c5f9010dd64ba54899b P 6e4379ca45a84c5d807695a3fef07116 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:59.917927 25545 raft_consensus.cc:1275] T 442972580e8d4c5f9010dd64ba54899b P a8545e52c3ee4ac691870228228b4fa5 [term 3 FOLLOWER]: Refusing update from remote peer 6e4379ca45a84c5d807695a3fef07116: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:59.919827 25909 consensus_queue.cc:1048] T 442972580e8d4c5f9010dd64ba54899b P 6e4379ca45a84c5d807695a3fef07116 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:00.014637 15057 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:00.022166 25620 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1119e418e9964dd1be1dcf47e3fe9734"
dest_uuid: "6e4379ca45a84c5d807695a3fef07116"
mode: GRACEFUL
new_leader_uuid: "a8545e52c3ee4ac691870228228b4fa5"
 from {username='slave'} at 127.0.0.1:52070
I20260709 13:10:00.022718 25620 raft_consensus.cc:606] T 1119e418e9964dd1be1dcf47e3fe9734 P 6e4379ca45a84c5d807695a3fef07116 [term 1 LEADER]: Received request to transfer leadership to TS a8545e52c3ee4ac691870228228b4fa5
I20260709 13:10:00.025701 25620 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a06a18d1f8c346f2b758f593d709eb53"
dest_uuid: "6e4379ca45a84c5d807695a3fef07116"
mode: GRACEFUL
new_leader_uuid: "a8545e52c3ee4ac691870228228b4fa5"
 from {username='slave'} at 127.0.0.1:52070
I20260709 13:10:00.026194 25620 raft_consensus.cc:606] T a06a18d1f8c346f2b758f593d709eb53 P 6e4379ca45a84c5d807695a3fef07116 [term 2 LEADER]: Received request to transfer leadership to TS a8545e52c3ee4ac691870228228b4fa5
I20260709 13:10:00.029464 25545 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d0cd92d7306d4ed695dc084aabbfb995"
dest_uuid: "a8545e52c3ee4ac691870228228b4fa5"
mode: GRACEFUL
new_leader_uuid: "6e4379ca45a84c5d807695a3fef07116"
 from {username='slave'} at 127.0.0.1:59550
I20260709 13:10:00.030119 25545 raft_consensus.cc:606] T d0cd92d7306d4ed695dc084aabbfb995 P a8545e52c3ee4ac691870228228b4fa5 [term 2 LEADER]: Received request to transfer leadership to TS 6e4379ca45a84c5d807695a3fef07116
I20260709 13:10:00.031668 15057 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:10:00.032289 15057 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:00.032955 15057 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:00.305694 25902 raft_consensus.cc:993] T a06a18d1f8c346f2b758f593d709eb53 P 6e4379ca45a84c5d807695a3fef07116: : Instructing follower a8545e52c3ee4ac691870228228b4fa5 to start an election
I20260709 13:10:00.306352 25909 raft_consensus.cc:1081] T a06a18d1f8c346f2b758f593d709eb53 P 6e4379ca45a84c5d807695a3fef07116 [term 2 LEADER]: Signalling peer a8545e52c3ee4ac691870228228b4fa5 to start an election
I20260709 13:10:00.307832 25545 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a06a18d1f8c346f2b758f593d709eb53"
dest_uuid: "a8545e52c3ee4ac691870228228b4fa5"
 from {username='slave'} at 127.0.0.1:47724
I20260709 13:10:00.308368 25545 raft_consensus.cc:493] T a06a18d1f8c346f2b758f593d709eb53 P a8545e52c3ee4ac691870228228b4fa5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:00.308718 25545 raft_consensus.cc:3060] T a06a18d1f8c346f2b758f593d709eb53 P a8545e52c3ee4ac691870228228b4fa5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:00.314280 25545 raft_consensus.cc:515] T a06a18d1f8c346f2b758f593d709eb53 P a8545e52c3ee4ac691870228228b4fa5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:10:00.316203 25545 leader_election.cc:290] T a06a18d1f8c346f2b758f593d709eb53 P a8545e52c3ee4ac691870228228b4fa5 [CANDIDATE]: Term 3 election: Requested vote from peers 0482fd26e89d4bb89ee847d0108ab167 (127.14.180.65:45331), 6e4379ca45a84c5d807695a3fef07116 (127.14.180.67:39657)
I20260709 13:10:00.317085 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a06a18d1f8c346f2b758f593d709eb53" candidate_uuid: "a8545e52c3ee4ac691870228228b4fa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0482fd26e89d4bb89ee847d0108ab167"
I20260709 13:10:00.317480 25620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a06a18d1f8c346f2b758f593d709eb53" candidate_uuid: "a8545e52c3ee4ac691870228228b4fa5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6e4379ca45a84c5d807695a3fef07116"
I20260709 13:10:00.317795 25835 raft_consensus.cc:3060] T a06a18d1f8c346f2b758f593d709eb53 P 0482fd26e89d4bb89ee847d0108ab167 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:00.318070 25620 raft_consensus.cc:3055] T a06a18d1f8c346f2b758f593d709eb53 P 6e4379ca45a84c5d807695a3fef07116 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:00.318404 25620 raft_consensus.cc:740] T a06a18d1f8c346f2b758f593d709eb53 P 6e4379ca45a84c5d807695a3fef07116 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6e4379ca45a84c5d807695a3fef07116, State: Running, Role: LEADER
I20260709 13:10:00.319114 25620 consensus_queue.cc:260] T a06a18d1f8c346f2b758f593d709eb53 P 6e4379ca45a84c5d807695a3fef07116 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:10:00.320086 25620 raft_consensus.cc:3060] T a06a18d1f8c346f2b758f593d709eb53 P 6e4379ca45a84c5d807695a3fef07116 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:00.323869 25835 raft_consensus.cc:2468] T a06a18d1f8c346f2b758f593d709eb53 P 0482fd26e89d4bb89ee847d0108ab167 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8545e52c3ee4ac691870228228b4fa5 in term 3.
I20260709 13:10:00.325335 25511 leader_election.cc:304] T a06a18d1f8c346f2b758f593d709eb53 P a8545e52c3ee4ac691870228228b4fa5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0482fd26e89d4bb89ee847d0108ab167, a8545e52c3ee4ac691870228228b4fa5; no voters: 
I20260709 13:10:00.325863 25620 raft_consensus.cc:2468] T a06a18d1f8c346f2b758f593d709eb53 P 6e4379ca45a84c5d807695a3fef07116 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8545e52c3ee4ac691870228228b4fa5 in term 3.
I20260709 13:10:00.326213 25884 raft_consensus.cc:2804] T a06a18d1f8c346f2b758f593d709eb53 P a8545e52c3ee4ac691870228228b4fa5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:00.327343 25884 raft_consensus.cc:697] T a06a18d1f8c346f2b758f593d709eb53 P a8545e52c3ee4ac691870228228b4fa5 [term 3 LEADER]: Becoming Leader. State: Replica: a8545e52c3ee4ac691870228228b4fa5, State: Running, Role: LEADER
I20260709 13:10:00.328167 25884 consensus_queue.cc:237] T a06a18d1f8c346f2b758f593d709eb53 P a8545e52c3ee4ac691870228228b4fa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:10:00.336241 25369 catalog_manager.cc:5697] T a06a18d1f8c346f2b758f593d709eb53 P a8545e52c3ee4ac691870228228b4fa5 reported cstate change: term changed from 2 to 3, leader changed from 6e4379ca45a84c5d807695a3fef07116 (127.14.180.67) to a8545e52c3ee4ac691870228228b4fa5 (127.14.180.66). New cstate: current_term: 3 leader_uuid: "a8545e52c3ee4ac691870228228b4fa5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:00.375437 25884 raft_consensus.cc:993] T d0cd92d7306d4ed695dc084aabbfb995 P a8545e52c3ee4ac691870228228b4fa5: : Instructing follower 6e4379ca45a84c5d807695a3fef07116 to start an election
I20260709 13:10:00.376396 25764 raft_consensus.cc:1081] T d0cd92d7306d4ed695dc084aabbfb995 P a8545e52c3ee4ac691870228228b4fa5 [term 2 LEADER]: Signalling peer 6e4379ca45a84c5d807695a3fef07116 to start an election
I20260709 13:10:00.378703 25620 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d0cd92d7306d4ed695dc084aabbfb995"
dest_uuid: "6e4379ca45a84c5d807695a3fef07116"
 from {username='slave'} at 127.0.0.1:52056
I20260709 13:10:00.379249 25620 raft_consensus.cc:493] T d0cd92d7306d4ed695dc084aabbfb995 P 6e4379ca45a84c5d807695a3fef07116 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:00.379540 25620 raft_consensus.cc:3060] T d0cd92d7306d4ed695dc084aabbfb995 P 6e4379ca45a84c5d807695a3fef07116 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:00.385372 25620 raft_consensus.cc:515] T d0cd92d7306d4ed695dc084aabbfb995 P 6e4379ca45a84c5d807695a3fef07116 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:10:00.387141 25620 leader_election.cc:290] T d0cd92d7306d4ed695dc084aabbfb995 P 6e4379ca45a84c5d807695a3fef07116 [CANDIDATE]: Term 3 election: Requested vote from peers 0482fd26e89d4bb89ee847d0108ab167 (127.14.180.65:45331), a8545e52c3ee4ac691870228228b4fa5 (127.14.180.66:35803)
I20260709 13:10:00.388231 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0cd92d7306d4ed695dc084aabbfb995" candidate_uuid: "6e4379ca45a84c5d807695a3fef07116" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0482fd26e89d4bb89ee847d0108ab167"
I20260709 13:10:00.388248 25545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0cd92d7306d4ed695dc084aabbfb995" candidate_uuid: "6e4379ca45a84c5d807695a3fef07116" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a8545e52c3ee4ac691870228228b4fa5"
I20260709 13:10:00.389412 25835 raft_consensus.cc:3060] T d0cd92d7306d4ed695dc084aabbfb995 P 0482fd26e89d4bb89ee847d0108ab167 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:00.389436 25545 raft_consensus.cc:3055] T d0cd92d7306d4ed695dc084aabbfb995 P a8545e52c3ee4ac691870228228b4fa5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:00.390144 25545 raft_consensus.cc:740] T d0cd92d7306d4ed695dc084aabbfb995 P a8545e52c3ee4ac691870228228b4fa5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a8545e52c3ee4ac691870228228b4fa5, State: Running, Role: LEADER
I20260709 13:10:00.391011 25545 consensus_queue.cc:260] T d0cd92d7306d4ed695dc084aabbfb995 P a8545e52c3ee4ac691870228228b4fa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:10:00.392201 25545 raft_consensus.cc:3060] T d0cd92d7306d4ed695dc084aabbfb995 P a8545e52c3ee4ac691870228228b4fa5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:00.397531 25835 raft_consensus.cc:2468] T d0cd92d7306d4ed695dc084aabbfb995 P 0482fd26e89d4bb89ee847d0108ab167 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e4379ca45a84c5d807695a3fef07116 in term 3.
I20260709 13:10:00.399151 25585 leader_election.cc:304] T d0cd92d7306d4ed695dc084aabbfb995 P 6e4379ca45a84c5d807695a3fef07116 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0482fd26e89d4bb89ee847d0108ab167, 6e4379ca45a84c5d807695a3fef07116; no voters: 
I20260709 13:10:00.400211 25909 raft_consensus.cc:2804] T d0cd92d7306d4ed695dc084aabbfb995 P 6e4379ca45a84c5d807695a3fef07116 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:00.401429 25545 raft_consensus.cc:2468] T d0cd92d7306d4ed695dc084aabbfb995 P a8545e52c3ee4ac691870228228b4fa5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e4379ca45a84c5d807695a3fef07116 in term 3.
I20260709 13:10:00.404577 25909 raft_consensus.cc:697] T d0cd92d7306d4ed695dc084aabbfb995 P 6e4379ca45a84c5d807695a3fef07116 [term 3 LEADER]: Becoming Leader. State: Replica: 6e4379ca45a84c5d807695a3fef07116, State: Running, Role: LEADER
I20260709 13:10:00.405745 25909 consensus_queue.cc:237] T d0cd92d7306d4ed695dc084aabbfb995 P 6e4379ca45a84c5d807695a3fef07116 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:10:00.415686 25369 catalog_manager.cc:5697] T d0cd92d7306d4ed695dc084aabbfb995 P 6e4379ca45a84c5d807695a3fef07116 reported cstate change: term changed from 2 to 3, leader changed from a8545e52c3ee4ac691870228228b4fa5 (127.14.180.66) to 6e4379ca45a84c5d807695a3fef07116 (127.14.180.67). New cstate: current_term: 3 leader_uuid: "6e4379ca45a84c5d807695a3fef07116" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:00.471834 25920 raft_consensus.cc:993] T 1119e418e9964dd1be1dcf47e3fe9734 P 6e4379ca45a84c5d807695a3fef07116: : Instructing follower a8545e52c3ee4ac691870228228b4fa5 to start an election
I20260709 13:10:00.472362 25909 raft_consensus.cc:1081] T 1119e418e9964dd1be1dcf47e3fe9734 P 6e4379ca45a84c5d807695a3fef07116 [term 1 LEADER]: Signalling peer a8545e52c3ee4ac691870228228b4fa5 to start an election
I20260709 13:10:00.473941 25545 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1119e418e9964dd1be1dcf47e3fe9734"
dest_uuid: "a8545e52c3ee4ac691870228228b4fa5"
 from {username='slave'} at 127.0.0.1:47724
I20260709 13:10:00.474479 25545 raft_consensus.cc:493] T 1119e418e9964dd1be1dcf47e3fe9734 P a8545e52c3ee4ac691870228228b4fa5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:00.474862 25545 raft_consensus.cc:3060] T 1119e418e9964dd1be1dcf47e3fe9734 P a8545e52c3ee4ac691870228228b4fa5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:00.480353 25545 raft_consensus.cc:515] T 1119e418e9964dd1be1dcf47e3fe9734 P a8545e52c3ee4ac691870228228b4fa5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:10:00.482283 25545 leader_election.cc:290] T 1119e418e9964dd1be1dcf47e3fe9734 P a8545e52c3ee4ac691870228228b4fa5 [CANDIDATE]: Term 2 election: Requested vote from peers 0482fd26e89d4bb89ee847d0108ab167 (127.14.180.65:45331), 6e4379ca45a84c5d807695a3fef07116 (127.14.180.67:39657)
I20260709 13:10:00.483553 25620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1119e418e9964dd1be1dcf47e3fe9734" candidate_uuid: "a8545e52c3ee4ac691870228228b4fa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6e4379ca45a84c5d807695a3fef07116"
I20260709 13:10:00.483201 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1119e418e9964dd1be1dcf47e3fe9734" candidate_uuid: "a8545e52c3ee4ac691870228228b4fa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0482fd26e89d4bb89ee847d0108ab167"
I20260709 13:10:00.484297 25620 raft_consensus.cc:3055] T 1119e418e9964dd1be1dcf47e3fe9734 P 6e4379ca45a84c5d807695a3fef07116 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:00.484350 25835 raft_consensus.cc:3060] T 1119e418e9964dd1be1dcf47e3fe9734 P 0482fd26e89d4bb89ee847d0108ab167 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:00.484820 25620 raft_consensus.cc:740] T 1119e418e9964dd1be1dcf47e3fe9734 P 6e4379ca45a84c5d807695a3fef07116 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6e4379ca45a84c5d807695a3fef07116, State: Running, Role: LEADER
I20260709 13:10:00.485780 25620 consensus_queue.cc:260] T 1119e418e9964dd1be1dcf47e3fe9734 P 6e4379ca45a84c5d807695a3fef07116 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:10:00.487175 25620 raft_consensus.cc:3060] T 1119e418e9964dd1be1dcf47e3fe9734 P 6e4379ca45a84c5d807695a3fef07116 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:00.493219 25835 raft_consensus.cc:2468] T 1119e418e9964dd1be1dcf47e3fe9734 P 0482fd26e89d4bb89ee847d0108ab167 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8545e52c3ee4ac691870228228b4fa5 in term 2.
I20260709 13:10:00.494746 25511 leader_election.cc:304] T 1119e418e9964dd1be1dcf47e3fe9734 P a8545e52c3ee4ac691870228228b4fa5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0482fd26e89d4bb89ee847d0108ab167, a8545e52c3ee4ac691870228228b4fa5; no voters: 
I20260709 13:10:00.495195 25620 raft_consensus.cc:2468] T 1119e418e9964dd1be1dcf47e3fe9734 P 6e4379ca45a84c5d807695a3fef07116 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8545e52c3ee4ac691870228228b4fa5 in term 2.
I20260709 13:10:00.495806 25764 raft_consensus.cc:2804] T 1119e418e9964dd1be1dcf47e3fe9734 P a8545e52c3ee4ac691870228228b4fa5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:00.496354 25764 raft_consensus.cc:697] T 1119e418e9964dd1be1dcf47e3fe9734 P a8545e52c3ee4ac691870228228b4fa5 [term 2 LEADER]: Becoming Leader. State: Replica: a8545e52c3ee4ac691870228228b4fa5, State: Running, Role: LEADER
I20260709 13:10:00.497216 25764 consensus_queue.cc:237] T 1119e418e9964dd1be1dcf47e3fe9734 P a8545e52c3ee4ac691870228228b4fa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:10:00.504971 25369 catalog_manager.cc:5697] T 1119e418e9964dd1be1dcf47e3fe9734 P a8545e52c3ee4ac691870228228b4fa5 reported cstate change: term changed from 1 to 2, leader changed from 6e4379ca45a84c5d807695a3fef07116 (127.14.180.67) to a8545e52c3ee4ac691870228228b4fa5 (127.14.180.66). New cstate: current_term: 2 leader_uuid: "a8545e52c3ee4ac691870228228b4fa5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } health_report { overall_health: UNKNOWN } } }
W20260709 13:10:00.709873 25418 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:10:00.735212 25620 raft_consensus.cc:1275] T a06a18d1f8c346f2b758f593d709eb53 P 6e4379ca45a84c5d807695a3fef07116 [term 3 FOLLOWER]: Refusing update from remote peer a8545e52c3ee4ac691870228228b4fa5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:00.737087 25764 consensus_queue.cc:1048] T a06a18d1f8c346f2b758f593d709eb53 P a8545e52c3ee4ac691870228228b4fa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:00.746925 25835 raft_consensus.cc:1275] T a06a18d1f8c346f2b758f593d709eb53 P 0482fd26e89d4bb89ee847d0108ab167 [term 3 FOLLOWER]: Refusing update from remote peer a8545e52c3ee4ac691870228228b4fa5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:00.749477 25884 consensus_queue.cc:1048] T a06a18d1f8c346f2b758f593d709eb53 P a8545e52c3ee4ac691870228228b4fa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:00.804836 25545 raft_consensus.cc:1275] T d0cd92d7306d4ed695dc084aabbfb995 P a8545e52c3ee4ac691870228228b4fa5 [term 3 FOLLOWER]: Refusing update from remote peer 6e4379ca45a84c5d807695a3fef07116: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:00.806212 25909 consensus_queue.cc:1048] T d0cd92d7306d4ed695dc084aabbfb995 P 6e4379ca45a84c5d807695a3fef07116 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:00.815562 25834 raft_consensus.cc:1275] T d0cd92d7306d4ed695dc084aabbfb995 P 0482fd26e89d4bb89ee847d0108ab167 [term 3 FOLLOWER]: Refusing update from remote peer 6e4379ca45a84c5d807695a3fef07116: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:00.817301 25919 consensus_queue.cc:1048] T d0cd92d7306d4ed695dc084aabbfb995 P 6e4379ca45a84c5d807695a3fef07116 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:00.945978 25620 raft_consensus.cc:1275] T 1119e418e9964dd1be1dcf47e3fe9734 P 6e4379ca45a84c5d807695a3fef07116 [term 2 FOLLOWER]: Refusing update from remote peer a8545e52c3ee4ac691870228228b4fa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:00.947278 25764 consensus_queue.cc:1048] T 1119e418e9964dd1be1dcf47e3fe9734 P a8545e52c3ee4ac691870228228b4fa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:00.957283 25834 raft_consensus.cc:1275] T 1119e418e9964dd1be1dcf47e3fe9734 P 0482fd26e89d4bb89ee847d0108ab167 [term 2 FOLLOWER]: Refusing update from remote peer a8545e52c3ee4ac691870228228b4fa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:00.959050 25884 consensus_queue.cc:1048] T 1119e418e9964dd1be1dcf47e3fe9734 P a8545e52c3ee4ac691870228228b4fa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:01.040077 15057 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:01.047580 25545 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1119e418e9964dd1be1dcf47e3fe9734"
dest_uuid: "a8545e52c3ee4ac691870228228b4fa5"
mode: GRACEFUL
new_leader_uuid: "6e4379ca45a84c5d807695a3fef07116"
 from {username='slave'} at 127.0.0.1:59550
I20260709 13:10:01.048139 25545 raft_consensus.cc:606] T 1119e418e9964dd1be1dcf47e3fe9734 P a8545e52c3ee4ac691870228228b4fa5 [term 2 LEADER]: Received request to transfer leadership to TS 6e4379ca45a84c5d807695a3fef07116
I20260709 13:10:01.051707 25620 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d0cd92d7306d4ed695dc084aabbfb995"
dest_uuid: "6e4379ca45a84c5d807695a3fef07116"
mode: GRACEFUL
new_leader_uuid: "a8545e52c3ee4ac691870228228b4fa5"
 from {username='slave'} at 127.0.0.1:52070
I20260709 13:10:01.052218 25620 raft_consensus.cc:606] T d0cd92d7306d4ed695dc084aabbfb995 P 6e4379ca45a84c5d807695a3fef07116 [term 3 LEADER]: Received request to transfer leadership to TS a8545e52c3ee4ac691870228228b4fa5
I20260709 13:10:01.055163 25545 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ffbf01eb3ff0482fb5f922a5b0a77a83"
dest_uuid: "a8545e52c3ee4ac691870228228b4fa5"
mode: GRACEFUL
new_leader_uuid: "6e4379ca45a84c5d807695a3fef07116"
 from {username='slave'} at 127.0.0.1:59550
I20260709 13:10:01.055961 25545 raft_consensus.cc:606] T ffbf01eb3ff0482fb5f922a5b0a77a83 P a8545e52c3ee4ac691870228228b4fa5 [term 1 LEADER]: Received request to transfer leadership to TS 6e4379ca45a84c5d807695a3fef07116
I20260709 13:10:01.057768 15057 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:10:01.058465 15057 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:01.059253 15057 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:01.082999 25918 raft_consensus.cc:993] T ffbf01eb3ff0482fb5f922a5b0a77a83 P a8545e52c3ee4ac691870228228b4fa5: : Instructing follower 6e4379ca45a84c5d807695a3fef07116 to start an election
I20260709 13:10:01.083565 25884 raft_consensus.cc:1081] T ffbf01eb3ff0482fb5f922a5b0a77a83 P a8545e52c3ee4ac691870228228b4fa5 [term 1 LEADER]: Signalling peer 6e4379ca45a84c5d807695a3fef07116 to start an election
I20260709 13:10:01.085268 25620 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ffbf01eb3ff0482fb5f922a5b0a77a83"
dest_uuid: "6e4379ca45a84c5d807695a3fef07116"
 from {username='slave'} at 127.0.0.1:52056
I20260709 13:10:01.085788 25620 raft_consensus.cc:493] T ffbf01eb3ff0482fb5f922a5b0a77a83 P 6e4379ca45a84c5d807695a3fef07116 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:01.086042 25620 raft_consensus.cc:3060] T ffbf01eb3ff0482fb5f922a5b0a77a83 P 6e4379ca45a84c5d807695a3fef07116 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:01.090967 25620 raft_consensus.cc:515] T ffbf01eb3ff0482fb5f922a5b0a77a83 P 6e4379ca45a84c5d807695a3fef07116 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:10:01.092504 25620 leader_election.cc:290] T ffbf01eb3ff0482fb5f922a5b0a77a83 P 6e4379ca45a84c5d807695a3fef07116 [CANDIDATE]: Term 2 election: Requested vote from peers 0482fd26e89d4bb89ee847d0108ab167 (127.14.180.65:45331), a8545e52c3ee4ac691870228228b4fa5 (127.14.180.66:35803)
I20260709 13:10:01.093636 25545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbf01eb3ff0482fb5f922a5b0a77a83" candidate_uuid: "6e4379ca45a84c5d807695a3fef07116" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a8545e52c3ee4ac691870228228b4fa5"
I20260709 13:10:01.093636 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ffbf01eb3ff0482fb5f922a5b0a77a83" candidate_uuid: "6e4379ca45a84c5d807695a3fef07116" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0482fd26e89d4bb89ee847d0108ab167"
I20260709 13:10:01.094638 25545 raft_consensus.cc:3055] T ffbf01eb3ff0482fb5f922a5b0a77a83 P a8545e52c3ee4ac691870228228b4fa5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:01.094666 25834 raft_consensus.cc:3060] T ffbf01eb3ff0482fb5f922a5b0a77a83 P 0482fd26e89d4bb89ee847d0108ab167 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:01.095146 25545 raft_consensus.cc:740] T ffbf01eb3ff0482fb5f922a5b0a77a83 P a8545e52c3ee4ac691870228228b4fa5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a8545e52c3ee4ac691870228228b4fa5, State: Running, Role: LEADER
I20260709 13:10:01.096128 25545 consensus_queue.cc:260] T ffbf01eb3ff0482fb5f922a5b0a77a83 P a8545e52c3ee4ac691870228228b4fa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:10:01.097484 25545 raft_consensus.cc:3060] T ffbf01eb3ff0482fb5f922a5b0a77a83 P a8545e52c3ee4ac691870228228b4fa5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:01.103281 25834 raft_consensus.cc:2468] T ffbf01eb3ff0482fb5f922a5b0a77a83 P 0482fd26e89d4bb89ee847d0108ab167 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e4379ca45a84c5d807695a3fef07116 in term 2.
I20260709 13:10:01.104764 25585 leader_election.cc:304] T ffbf01eb3ff0482fb5f922a5b0a77a83 P 6e4379ca45a84c5d807695a3fef07116 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0482fd26e89d4bb89ee847d0108ab167, 6e4379ca45a84c5d807695a3fef07116; no voters: 
I20260709 13:10:01.105082 25545 raft_consensus.cc:2468] T ffbf01eb3ff0482fb5f922a5b0a77a83 P a8545e52c3ee4ac691870228228b4fa5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e4379ca45a84c5d807695a3fef07116 in term 2.
I20260709 13:10:01.105764 25919 raft_consensus.cc:2804] T ffbf01eb3ff0482fb5f922a5b0a77a83 P 6e4379ca45a84c5d807695a3fef07116 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:01.106468 25919 raft_consensus.cc:697] T ffbf01eb3ff0482fb5f922a5b0a77a83 P 6e4379ca45a84c5d807695a3fef07116 [term 2 LEADER]: Becoming Leader. State: Replica: 6e4379ca45a84c5d807695a3fef07116, State: Running, Role: LEADER
I20260709 13:10:01.107424 25919 consensus_queue.cc:237] T ffbf01eb3ff0482fb5f922a5b0a77a83 P 6e4379ca45a84c5d807695a3fef07116 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:10:01.115656 25369 catalog_manager.cc:5697] T ffbf01eb3ff0482fb5f922a5b0a77a83 P 6e4379ca45a84c5d807695a3fef07116 reported cstate change: term changed from 1 to 2, leader changed from a8545e52c3ee4ac691870228228b4fa5 (127.14.180.66) to 6e4379ca45a84c5d807695a3fef07116 (127.14.180.67). New cstate: current_term: 2 leader_uuid: "6e4379ca45a84c5d807695a3fef07116" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:01.216815 25920 raft_consensus.cc:993] T d0cd92d7306d4ed695dc084aabbfb995 P 6e4379ca45a84c5d807695a3fef07116: : Instructing follower a8545e52c3ee4ac691870228228b4fa5 to start an election
I20260709 13:10:01.217290 25919 raft_consensus.cc:1081] T d0cd92d7306d4ed695dc084aabbfb995 P 6e4379ca45a84c5d807695a3fef07116 [term 3 LEADER]: Signalling peer a8545e52c3ee4ac691870228228b4fa5 to start an election
I20260709 13:10:01.218946 25545 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d0cd92d7306d4ed695dc084aabbfb995"
dest_uuid: "a8545e52c3ee4ac691870228228b4fa5"
 from {username='slave'} at 127.0.0.1:47724
I20260709 13:10:01.219473 25545 raft_consensus.cc:493] T d0cd92d7306d4ed695dc084aabbfb995 P a8545e52c3ee4ac691870228228b4fa5 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:01.219763 25545 raft_consensus.cc:3060] T d0cd92d7306d4ed695dc084aabbfb995 P a8545e52c3ee4ac691870228228b4fa5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:01.224885 25545 raft_consensus.cc:515] T d0cd92d7306d4ed695dc084aabbfb995 P a8545e52c3ee4ac691870228228b4fa5 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:10:01.226643 25545 leader_election.cc:290] T d0cd92d7306d4ed695dc084aabbfb995 P a8545e52c3ee4ac691870228228b4fa5 [CANDIDATE]: Term 4 election: Requested vote from peers 0482fd26e89d4bb89ee847d0108ab167 (127.14.180.65:45331), 6e4379ca45a84c5d807695a3fef07116 (127.14.180.67:39657)
I20260709 13:10:01.227552 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0cd92d7306d4ed695dc084aabbfb995" candidate_uuid: "a8545e52c3ee4ac691870228228b4fa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "0482fd26e89d4bb89ee847d0108ab167"
I20260709 13:10:01.227880 25620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0cd92d7306d4ed695dc084aabbfb995" candidate_uuid: "a8545e52c3ee4ac691870228228b4fa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "6e4379ca45a84c5d807695a3fef07116"
I20260709 13:10:01.228284 25834 raft_consensus.cc:3060] T d0cd92d7306d4ed695dc084aabbfb995 P 0482fd26e89d4bb89ee847d0108ab167 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:01.228542 25620 raft_consensus.cc:3055] T d0cd92d7306d4ed695dc084aabbfb995 P 6e4379ca45a84c5d807695a3fef07116 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:01.228920 25620 raft_consensus.cc:740] T d0cd92d7306d4ed695dc084aabbfb995 P 6e4379ca45a84c5d807695a3fef07116 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6e4379ca45a84c5d807695a3fef07116, State: Running, Role: LEADER
I20260709 13:10:01.229630 25620 consensus_queue.cc:260] T d0cd92d7306d4ed695dc084aabbfb995 P 6e4379ca45a84c5d807695a3fef07116 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:10:01.230630 25620 raft_consensus.cc:3060] T d0cd92d7306d4ed695dc084aabbfb995 P 6e4379ca45a84c5d807695a3fef07116 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:01.234061 25834 raft_consensus.cc:2468] T d0cd92d7306d4ed695dc084aabbfb995 P 0482fd26e89d4bb89ee847d0108ab167 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8545e52c3ee4ac691870228228b4fa5 in term 4.
I20260709 13:10:01.235342 25511 leader_election.cc:304] T d0cd92d7306d4ed695dc084aabbfb995 P a8545e52c3ee4ac691870228228b4fa5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0482fd26e89d4bb89ee847d0108ab167, a8545e52c3ee4ac691870228228b4fa5; no voters: 
I20260709 13:10:01.235507 25620 raft_consensus.cc:2468] T d0cd92d7306d4ed695dc084aabbfb995 P 6e4379ca45a84c5d807695a3fef07116 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8545e52c3ee4ac691870228228b4fa5 in term 4.
I20260709 13:10:01.236356 25884 raft_consensus.cc:2804] T d0cd92d7306d4ed695dc084aabbfb995 P a8545e52c3ee4ac691870228228b4fa5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:01.236938 25884 raft_consensus.cc:697] T d0cd92d7306d4ed695dc084aabbfb995 P a8545e52c3ee4ac691870228228b4fa5 [term 4 LEADER]: Becoming Leader. State: Replica: a8545e52c3ee4ac691870228228b4fa5, State: Running, Role: LEADER
I20260709 13:10:01.237670 25884 consensus_queue.cc:237] T d0cd92d7306d4ed695dc084aabbfb995 P a8545e52c3ee4ac691870228228b4fa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:10:01.245874 25369 catalog_manager.cc:5697] T d0cd92d7306d4ed695dc084aabbfb995 P a8545e52c3ee4ac691870228228b4fa5 reported cstate change: term changed from 3 to 4, leader changed from 6e4379ca45a84c5d807695a3fef07116 (127.14.180.67) to a8545e52c3ee4ac691870228228b4fa5 (127.14.180.66). New cstate: current_term: 4 leader_uuid: "a8545e52c3ee4ac691870228228b4fa5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:01.366746 25918 raft_consensus.cc:993] T 1119e418e9964dd1be1dcf47e3fe9734 P a8545e52c3ee4ac691870228228b4fa5: : Instructing follower 6e4379ca45a84c5d807695a3fef07116 to start an election
I20260709 13:10:01.367372 25884 raft_consensus.cc:1081] T 1119e418e9964dd1be1dcf47e3fe9734 P a8545e52c3ee4ac691870228228b4fa5 [term 2 LEADER]: Signalling peer 6e4379ca45a84c5d807695a3fef07116 to start an election
I20260709 13:10:01.369139 25620 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1119e418e9964dd1be1dcf47e3fe9734"
dest_uuid: "6e4379ca45a84c5d807695a3fef07116"
 from {username='slave'} at 127.0.0.1:52056
I20260709 13:10:01.369621 25620 raft_consensus.cc:493] T 1119e418e9964dd1be1dcf47e3fe9734 P 6e4379ca45a84c5d807695a3fef07116 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:01.369956 25620 raft_consensus.cc:3060] T 1119e418e9964dd1be1dcf47e3fe9734 P 6e4379ca45a84c5d807695a3fef07116 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:01.375253 25620 raft_consensus.cc:515] T 1119e418e9964dd1be1dcf47e3fe9734 P 6e4379ca45a84c5d807695a3fef07116 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:10:01.377197 25620 leader_election.cc:290] T 1119e418e9964dd1be1dcf47e3fe9734 P 6e4379ca45a84c5d807695a3fef07116 [CANDIDATE]: Term 3 election: Requested vote from peers 0482fd26e89d4bb89ee847d0108ab167 (127.14.180.65:45331), a8545e52c3ee4ac691870228228b4fa5 (127.14.180.66:35803)
I20260709 13:10:01.378324 25545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1119e418e9964dd1be1dcf47e3fe9734" candidate_uuid: "6e4379ca45a84c5d807695a3fef07116" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a8545e52c3ee4ac691870228228b4fa5"
I20260709 13:10:01.379056 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1119e418e9964dd1be1dcf47e3fe9734" candidate_uuid: "6e4379ca45a84c5d807695a3fef07116" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0482fd26e89d4bb89ee847d0108ab167"
I20260709 13:10:01.379060 25545 raft_consensus.cc:3055] T 1119e418e9964dd1be1dcf47e3fe9734 P a8545e52c3ee4ac691870228228b4fa5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:01.379648 25834 raft_consensus.cc:3060] T 1119e418e9964dd1be1dcf47e3fe9734 P 0482fd26e89d4bb89ee847d0108ab167 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:01.379765 25545 raft_consensus.cc:740] T 1119e418e9964dd1be1dcf47e3fe9734 P a8545e52c3ee4ac691870228228b4fa5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a8545e52c3ee4ac691870228228b4fa5, State: Running, Role: LEADER
I20260709 13:10:01.380740 25545 consensus_queue.cc:260] T 1119e418e9964dd1be1dcf47e3fe9734 P a8545e52c3ee4ac691870228228b4fa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:10:01.382146 25545 raft_consensus.cc:3060] T 1119e418e9964dd1be1dcf47e3fe9734 P a8545e52c3ee4ac691870228228b4fa5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:01.386379 25834 raft_consensus.cc:2468] T 1119e418e9964dd1be1dcf47e3fe9734 P 0482fd26e89d4bb89ee847d0108ab167 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e4379ca45a84c5d807695a3fef07116 in term 3.
I20260709 13:10:01.387832 25585 leader_election.cc:304] T 1119e418e9964dd1be1dcf47e3fe9734 P 6e4379ca45a84c5d807695a3fef07116 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0482fd26e89d4bb89ee847d0108ab167, 6e4379ca45a84c5d807695a3fef07116; no voters: 
I20260709 13:10:01.388432 25545 raft_consensus.cc:2468] T 1119e418e9964dd1be1dcf47e3fe9734 P a8545e52c3ee4ac691870228228b4fa5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e4379ca45a84c5d807695a3fef07116 in term 3.
I20260709 13:10:01.388767 25919 raft_consensus.cc:2804] T 1119e418e9964dd1be1dcf47e3fe9734 P 6e4379ca45a84c5d807695a3fef07116 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:01.389434 25919 raft_consensus.cc:697] T 1119e418e9964dd1be1dcf47e3fe9734 P 6e4379ca45a84c5d807695a3fef07116 [term 3 LEADER]: Becoming Leader. State: Replica: 6e4379ca45a84c5d807695a3fef07116, State: Running, Role: LEADER
I20260709 13:10:01.391007 25919 consensus_queue.cc:237] T 1119e418e9964dd1be1dcf47e3fe9734 P 6e4379ca45a84c5d807695a3fef07116 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:10:01.400024 25369 catalog_manager.cc:5697] T 1119e418e9964dd1be1dcf47e3fe9734 P 6e4379ca45a84c5d807695a3fef07116 reported cstate change: term changed from 2 to 3, leader changed from a8545e52c3ee4ac691870228228b4fa5 (127.14.180.66) to 6e4379ca45a84c5d807695a3fef07116 (127.14.180.67). New cstate: current_term: 3 leader_uuid: "6e4379ca45a84c5d807695a3fef07116" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:01.609936 25834 raft_consensus.cc:1275] T ffbf01eb3ff0482fb5f922a5b0a77a83 P 0482fd26e89d4bb89ee847d0108ab167 [term 2 FOLLOWER]: Refusing update from remote peer 6e4379ca45a84c5d807695a3fef07116: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:01.611557 25920 consensus_queue.cc:1048] T ffbf01eb3ff0482fb5f922a5b0a77a83 P 6e4379ca45a84c5d807695a3fef07116 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:01.622102 25545 raft_consensus.cc:1275] T ffbf01eb3ff0482fb5f922a5b0a77a83 P a8545e52c3ee4ac691870228228b4fa5 [term 2 FOLLOWER]: Refusing update from remote peer 6e4379ca45a84c5d807695a3fef07116: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:01.623831 25938 consensus_queue.cc:1048] T ffbf01eb3ff0482fb5f922a5b0a77a83 P 6e4379ca45a84c5d807695a3fef07116 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
W20260709 13:10:01.710898 25418 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:10:01.762060 25834 raft_consensus.cc:1275] T d0cd92d7306d4ed695dc084aabbfb995 P 0482fd26e89d4bb89ee847d0108ab167 [term 4 FOLLOWER]: Refusing update from remote peer a8545e52c3ee4ac691870228228b4fa5: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:10:01.763680 25884 consensus_queue.cc:1048] T d0cd92d7306d4ed695dc084aabbfb995 P a8545e52c3ee4ac691870228228b4fa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:01.772722 25620 raft_consensus.cc:1275] T d0cd92d7306d4ed695dc084aabbfb995 P 6e4379ca45a84c5d807695a3fef07116 [term 4 FOLLOWER]: Refusing update from remote peer a8545e52c3ee4ac691870228228b4fa5: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:10:01.774354 25884 consensus_queue.cc:1048] T d0cd92d7306d4ed695dc084aabbfb995 P a8545e52c3ee4ac691870228228b4fa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:01.913277 25545 raft_consensus.cc:1275] T 1119e418e9964dd1be1dcf47e3fe9734 P a8545e52c3ee4ac691870228228b4fa5 [term 3 FOLLOWER]: Refusing update from remote peer 6e4379ca45a84c5d807695a3fef07116: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:01.914924 25938 consensus_queue.cc:1048] T 1119e418e9964dd1be1dcf47e3fe9734 P 6e4379ca45a84c5d807695a3fef07116 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:01.924930 25834 raft_consensus.cc:1275] T 1119e418e9964dd1be1dcf47e3fe9734 P 0482fd26e89d4bb89ee847d0108ab167 [term 3 FOLLOWER]: Refusing update from remote peer 6e4379ca45a84c5d807695a3fef07116: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:01.926378 25938 consensus_queue.cc:1048] T 1119e418e9964dd1be1dcf47e3fe9734 P 6e4379ca45a84c5d807695a3fef07116 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:02.067274 15057 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:02.075775 25620 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1119e418e9964dd1be1dcf47e3fe9734"
dest_uuid: "6e4379ca45a84c5d807695a3fef07116"
mode: GRACEFUL
new_leader_uuid: "a8545e52c3ee4ac691870228228b4fa5"
 from {username='slave'} at 127.0.0.1:52070
I20260709 13:10:02.076356 25620 raft_consensus.cc:606] T 1119e418e9964dd1be1dcf47e3fe9734 P 6e4379ca45a84c5d807695a3fef07116 [term 3 LEADER]: Received request to transfer leadership to TS a8545e52c3ee4ac691870228228b4fa5
I20260709 13:10:02.079319 25545 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "11ad0defd0924408a16ee3f7a8a60106"
dest_uuid: "a8545e52c3ee4ac691870228228b4fa5"
mode: GRACEFUL
new_leader_uuid: "6e4379ca45a84c5d807695a3fef07116"
 from {username='slave'} at 127.0.0.1:59550
I20260709 13:10:02.079903 25545 raft_consensus.cc:606] T 11ad0defd0924408a16ee3f7a8a60106 P a8545e52c3ee4ac691870228228b4fa5 [term 3 LEADER]: Received request to transfer leadership to TS 6e4379ca45a84c5d807695a3fef07116
I20260709 13:10:02.082966 25620 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "64e29ee66f22432c82e5772ee79dd918"
dest_uuid: "6e4379ca45a84c5d807695a3fef07116"
mode: GRACEFUL
new_leader_uuid: "a8545e52c3ee4ac691870228228b4fa5"
 from {username='slave'} at 127.0.0.1:52070
I20260709 13:10:02.083531 25620 raft_consensus.cc:606] T 64e29ee66f22432c82e5772ee79dd918 P 6e4379ca45a84c5d807695a3fef07116 [term 1 LEADER]: Received request to transfer leadership to TS a8545e52c3ee4ac691870228228b4fa5
I20260709 13:10:02.084713 15057 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:10:02.085282 15057 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:02.085919 15057 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:02.089920 25918 raft_consensus.cc:993] T 11ad0defd0924408a16ee3f7a8a60106 P a8545e52c3ee4ac691870228228b4fa5: : Instructing follower 6e4379ca45a84c5d807695a3fef07116 to start an election
I20260709 13:10:02.090941 25884 raft_consensus.cc:1081] T 11ad0defd0924408a16ee3f7a8a60106 P a8545e52c3ee4ac691870228228b4fa5 [term 3 LEADER]: Signalling peer 6e4379ca45a84c5d807695a3fef07116 to start an election
I20260709 13:10:02.093163 25620 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "11ad0defd0924408a16ee3f7a8a60106"
dest_uuid: "6e4379ca45a84c5d807695a3fef07116"
 from {username='slave'} at 127.0.0.1:52056
I20260709 13:10:02.093760 25620 raft_consensus.cc:493] T 11ad0defd0924408a16ee3f7a8a60106 P 6e4379ca45a84c5d807695a3fef07116 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:02.094115 25620 raft_consensus.cc:3060] T 11ad0defd0924408a16ee3f7a8a60106 P 6e4379ca45a84c5d807695a3fef07116 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:02.099375 25620 raft_consensus.cc:515] T 11ad0defd0924408a16ee3f7a8a60106 P 6e4379ca45a84c5d807695a3fef07116 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:10:02.100910 25620 leader_election.cc:290] T 11ad0defd0924408a16ee3f7a8a60106 P 6e4379ca45a84c5d807695a3fef07116 [CANDIDATE]: Term 4 election: Requested vote from peers 0482fd26e89d4bb89ee847d0108ab167 (127.14.180.65:45331), a8545e52c3ee4ac691870228228b4fa5 (127.14.180.66:35803)
I20260709 13:10:02.102058 25545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ad0defd0924408a16ee3f7a8a60106" candidate_uuid: "6e4379ca45a84c5d807695a3fef07116" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "a8545e52c3ee4ac691870228228b4fa5"
I20260709 13:10:02.102780 25545 raft_consensus.cc:3055] T 11ad0defd0924408a16ee3f7a8a60106 P a8545e52c3ee4ac691870228228b4fa5 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:02.102684 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11ad0defd0924408a16ee3f7a8a60106" candidate_uuid: "6e4379ca45a84c5d807695a3fef07116" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "0482fd26e89d4bb89ee847d0108ab167"
I20260709 13:10:02.103492 25545 raft_consensus.cc:740] T 11ad0defd0924408a16ee3f7a8a60106 P a8545e52c3ee4ac691870228228b4fa5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a8545e52c3ee4ac691870228228b4fa5, State: Running, Role: LEADER
I20260709 13:10:02.103757 25834 raft_consensus.cc:3060] T 11ad0defd0924408a16ee3f7a8a60106 P 0482fd26e89d4bb89ee847d0108ab167 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:02.104744 25545 consensus_queue.cc:260] T 11ad0defd0924408a16ee3f7a8a60106 P a8545e52c3ee4ac691870228228b4fa5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:10:02.106042 25545 raft_consensus.cc:3060] T 11ad0defd0924408a16ee3f7a8a60106 P a8545e52c3ee4ac691870228228b4fa5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:02.109964 25834 raft_consensus.cc:2468] T 11ad0defd0924408a16ee3f7a8a60106 P 0482fd26e89d4bb89ee847d0108ab167 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e4379ca45a84c5d807695a3fef07116 in term 4.
I20260709 13:10:02.111518 25585 leader_election.cc:304] T 11ad0defd0924408a16ee3f7a8a60106 P 6e4379ca45a84c5d807695a3fef07116 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0482fd26e89d4bb89ee847d0108ab167, 6e4379ca45a84c5d807695a3fef07116; no voters: 
I20260709 13:10:02.112483 25919 raft_consensus.cc:2804] T 11ad0defd0924408a16ee3f7a8a60106 P 6e4379ca45a84c5d807695a3fef07116 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:02.112530 25545 raft_consensus.cc:2468] T 11ad0defd0924408a16ee3f7a8a60106 P a8545e52c3ee4ac691870228228b4fa5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e4379ca45a84c5d807695a3fef07116 in term 4.
I20260709 13:10:02.113034 25919 raft_consensus.cc:697] T 11ad0defd0924408a16ee3f7a8a60106 P 6e4379ca45a84c5d807695a3fef07116 [term 4 LEADER]: Becoming Leader. State: Replica: 6e4379ca45a84c5d807695a3fef07116, State: Running, Role: LEADER
I20260709 13:10:02.113957 25919 consensus_queue.cc:237] T 11ad0defd0924408a16ee3f7a8a60106 P 6e4379ca45a84c5d807695a3fef07116 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:10:02.121425 25368 catalog_manager.cc:5697] T 11ad0defd0924408a16ee3f7a8a60106 P 6e4379ca45a84c5d807695a3fef07116 reported cstate change: term changed from 3 to 4, leader changed from a8545e52c3ee4ac691870228228b4fa5 (127.14.180.66) to 6e4379ca45a84c5d807695a3fef07116 (127.14.180.67). New cstate: current_term: 4 leader_uuid: "6e4379ca45a84c5d807695a3fef07116" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:02.169768 25920 raft_consensus.cc:993] T 64e29ee66f22432c82e5772ee79dd918 P 6e4379ca45a84c5d807695a3fef07116: : Instructing follower a8545e52c3ee4ac691870228228b4fa5 to start an election
I20260709 13:10:02.170367 25920 raft_consensus.cc:1081] T 64e29ee66f22432c82e5772ee79dd918 P 6e4379ca45a84c5d807695a3fef07116 [term 1 LEADER]: Signalling peer a8545e52c3ee4ac691870228228b4fa5 to start an election
I20260709 13:10:02.172513 25545 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "64e29ee66f22432c82e5772ee79dd918"
dest_uuid: "a8545e52c3ee4ac691870228228b4fa5"
 from {username='slave'} at 127.0.0.1:47724
I20260709 13:10:02.173087 25545 raft_consensus.cc:493] T 64e29ee66f22432c82e5772ee79dd918 P a8545e52c3ee4ac691870228228b4fa5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:02.173488 25545 raft_consensus.cc:3060] T 64e29ee66f22432c82e5772ee79dd918 P a8545e52c3ee4ac691870228228b4fa5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:02.182478 25545 raft_consensus.cc:515] T 64e29ee66f22432c82e5772ee79dd918 P a8545e52c3ee4ac691870228228b4fa5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:10:02.184983 25545 leader_election.cc:290] T 64e29ee66f22432c82e5772ee79dd918 P a8545e52c3ee4ac691870228228b4fa5 [CANDIDATE]: Term 2 election: Requested vote from peers 0482fd26e89d4bb89ee847d0108ab167 (127.14.180.65:45331), 6e4379ca45a84c5d807695a3fef07116 (127.14.180.67:39657)
I20260709 13:10:02.186246 25620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e29ee66f22432c82e5772ee79dd918" candidate_uuid: "a8545e52c3ee4ac691870228228b4fa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6e4379ca45a84c5d807695a3fef07116"
I20260709 13:10:02.187135 25620 raft_consensus.cc:3055] T 64e29ee66f22432c82e5772ee79dd918 P 6e4379ca45a84c5d807695a3fef07116 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:02.187966 25620 raft_consensus.cc:740] T 64e29ee66f22432c82e5772ee79dd918 P 6e4379ca45a84c5d807695a3fef07116 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6e4379ca45a84c5d807695a3fef07116, State: Running, Role: LEADER
I20260709 13:10:02.189108 25620 consensus_queue.cc:260] T 64e29ee66f22432c82e5772ee79dd918 P 6e4379ca45a84c5d807695a3fef07116 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:10:02.190344 25620 raft_consensus.cc:3060] T 64e29ee66f22432c82e5772ee79dd918 P 6e4379ca45a84c5d807695a3fef07116 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:02.186246 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e29ee66f22432c82e5772ee79dd918" candidate_uuid: "a8545e52c3ee4ac691870228228b4fa5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0482fd26e89d4bb89ee847d0108ab167"
I20260709 13:10:02.195209 25834 raft_consensus.cc:3060] T 64e29ee66f22432c82e5772ee79dd918 P 0482fd26e89d4bb89ee847d0108ab167 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:02.197609 25620 raft_consensus.cc:2468] T 64e29ee66f22432c82e5772ee79dd918 P 6e4379ca45a84c5d807695a3fef07116 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8545e52c3ee4ac691870228228b4fa5 in term 2.
I20260709 13:10:02.199465 25513 leader_election.cc:304] T 64e29ee66f22432c82e5772ee79dd918 P a8545e52c3ee4ac691870228228b4fa5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e4379ca45a84c5d807695a3fef07116, a8545e52c3ee4ac691870228228b4fa5; no voters: 
I20260709 13:10:02.200459 25884 raft_consensus.cc:2804] T 64e29ee66f22432c82e5772ee79dd918 P a8545e52c3ee4ac691870228228b4fa5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:02.201061 25884 raft_consensus.cc:697] T 64e29ee66f22432c82e5772ee79dd918 P a8545e52c3ee4ac691870228228b4fa5 [term 2 LEADER]: Becoming Leader. State: Replica: a8545e52c3ee4ac691870228228b4fa5, State: Running, Role: LEADER
I20260709 13:10:02.202271 25884 consensus_queue.cc:237] T 64e29ee66f22432c82e5772ee79dd918 P a8545e52c3ee4ac691870228228b4fa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:10:02.204506 25834 raft_consensus.cc:2468] T 64e29ee66f22432c82e5772ee79dd918 P 0482fd26e89d4bb89ee847d0108ab167 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8545e52c3ee4ac691870228228b4fa5 in term 2.
I20260709 13:10:02.212306 25368 catalog_manager.cc:5697] T 64e29ee66f22432c82e5772ee79dd918 P a8545e52c3ee4ac691870228228b4fa5 reported cstate change: term changed from 1 to 2, leader changed from 6e4379ca45a84c5d807695a3fef07116 (127.14.180.67) to a8545e52c3ee4ac691870228228b4fa5 (127.14.180.66). New cstate: current_term: 2 leader_uuid: "a8545e52c3ee4ac691870228228b4fa5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:02.334200 25919 raft_consensus.cc:993] T 1119e418e9964dd1be1dcf47e3fe9734 P 6e4379ca45a84c5d807695a3fef07116: : Instructing follower a8545e52c3ee4ac691870228228b4fa5 to start an election
I20260709 13:10:02.334687 25919 raft_consensus.cc:1081] T 1119e418e9964dd1be1dcf47e3fe9734 P 6e4379ca45a84c5d807695a3fef07116 [term 3 LEADER]: Signalling peer a8545e52c3ee4ac691870228228b4fa5 to start an election
I20260709 13:10:02.336225 25545 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1119e418e9964dd1be1dcf47e3fe9734"
dest_uuid: "a8545e52c3ee4ac691870228228b4fa5"
 from {username='slave'} at 127.0.0.1:47724
I20260709 13:10:02.336834 25545 raft_consensus.cc:493] T 1119e418e9964dd1be1dcf47e3fe9734 P a8545e52c3ee4ac691870228228b4fa5 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:02.337175 25545 raft_consensus.cc:3060] T 1119e418e9964dd1be1dcf47e3fe9734 P a8545e52c3ee4ac691870228228b4fa5 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:02.343408 25545 raft_consensus.cc:515] T 1119e418e9964dd1be1dcf47e3fe9734 P a8545e52c3ee4ac691870228228b4fa5 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:10:02.345379 25545 leader_election.cc:290] T 1119e418e9964dd1be1dcf47e3fe9734 P a8545e52c3ee4ac691870228228b4fa5 [CANDIDATE]: Term 4 election: Requested vote from peers 0482fd26e89d4bb89ee847d0108ab167 (127.14.180.65:45331), 6e4379ca45a84c5d807695a3fef07116 (127.14.180.67:39657)
I20260709 13:10:02.346724 25620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1119e418e9964dd1be1dcf47e3fe9734" candidate_uuid: "a8545e52c3ee4ac691870228228b4fa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "6e4379ca45a84c5d807695a3fef07116"
I20260709 13:10:02.346724 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1119e418e9964dd1be1dcf47e3fe9734" candidate_uuid: "a8545e52c3ee4ac691870228228b4fa5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "0482fd26e89d4bb89ee847d0108ab167"
I20260709 13:10:02.348167 25620 raft_consensus.cc:3055] T 1119e418e9964dd1be1dcf47e3fe9734 P 6e4379ca45a84c5d807695a3fef07116 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:02.348268 25834 raft_consensus.cc:3060] T 1119e418e9964dd1be1dcf47e3fe9734 P 0482fd26e89d4bb89ee847d0108ab167 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:02.348511 25620 raft_consensus.cc:740] T 1119e418e9964dd1be1dcf47e3fe9734 P 6e4379ca45a84c5d807695a3fef07116 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6e4379ca45a84c5d807695a3fef07116, State: Running, Role: LEADER
I20260709 13:10:02.349475 25620 consensus_queue.cc:260] T 1119e418e9964dd1be1dcf47e3fe9734 P 6e4379ca45a84c5d807695a3fef07116 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:10:02.350751 25620 raft_consensus.cc:3060] T 1119e418e9964dd1be1dcf47e3fe9734 P 6e4379ca45a84c5d807695a3fef07116 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:02.355333 25834 raft_consensus.cc:2468] T 1119e418e9964dd1be1dcf47e3fe9734 P 0482fd26e89d4bb89ee847d0108ab167 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8545e52c3ee4ac691870228228b4fa5 in term 4.
I20260709 13:10:02.356789 25511 leader_election.cc:304] T 1119e418e9964dd1be1dcf47e3fe9734 P a8545e52c3ee4ac691870228228b4fa5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0482fd26e89d4bb89ee847d0108ab167, a8545e52c3ee4ac691870228228b4fa5; no voters: 
I20260709 13:10:02.356810 25620 raft_consensus.cc:2468] T 1119e418e9964dd1be1dcf47e3fe9734 P 6e4379ca45a84c5d807695a3fef07116 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8545e52c3ee4ac691870228228b4fa5 in term 4.
I20260709 13:10:02.357842 25884 raft_consensus.cc:2804] T 1119e418e9964dd1be1dcf47e3fe9734 P a8545e52c3ee4ac691870228228b4fa5 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:02.358382 25884 raft_consensus.cc:697] T 1119e418e9964dd1be1dcf47e3fe9734 P a8545e52c3ee4ac691870228228b4fa5 [term 4 LEADER]: Becoming Leader. State: Replica: a8545e52c3ee4ac691870228228b4fa5, State: Running, Role: LEADER
I20260709 13:10:02.359236 25884 consensus_queue.cc:237] T 1119e418e9964dd1be1dcf47e3fe9734 P a8545e52c3ee4ac691870228228b4fa5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } }
I20260709 13:10:02.367129 25368 catalog_manager.cc:5697] T 1119e418e9964dd1be1dcf47e3fe9734 P a8545e52c3ee4ac691870228228b4fa5 reported cstate change: term changed from 3 to 4, leader changed from 6e4379ca45a84c5d807695a3fef07116 (127.14.180.67) to a8545e52c3ee4ac691870228228b4fa5 (127.14.180.66). New cstate: current_term: 4 leader_uuid: "a8545e52c3ee4ac691870228228b4fa5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:02.560153 25545 raft_consensus.cc:1275] T 11ad0defd0924408a16ee3f7a8a60106 P a8545e52c3ee4ac691870228228b4fa5 [term 4 FOLLOWER]: Refusing update from remote peer 6e4379ca45a84c5d807695a3fef07116: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:10:02.561491 25919 consensus_queue.cc:1048] T 11ad0defd0924408a16ee3f7a8a60106 P 6e4379ca45a84c5d807695a3fef07116 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8545e52c3ee4ac691870228228b4fa5" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 35803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:02.571017 25834 raft_consensus.cc:1275] T 11ad0defd0924408a16ee3f7a8a60106 P 0482fd26e89d4bb89ee847d0108ab167 [term 4 FOLLOWER]: Refusing update from remote peer 6e4379ca45a84c5d807695a3fef07116: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:10:02.574586 25919 consensus_queue.cc:1048] T 11ad0defd0924408a16ee3f7a8a60106 P 6e4379ca45a84c5d807695a3fef07116 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:10:02.712056 25418 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:10:02.762142 25834 raft_consensus.cc:1275] T 1119e418e9964dd1be1dcf47e3fe9734 P 0482fd26e89d4bb89ee847d0108ab167 [term 4 FOLLOWER]: Refusing update from remote peer a8545e52c3ee4ac691870228228b4fa5: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:10:02.763747 25884 consensus_queue.cc:1048] T 1119e418e9964dd1be1dcf47e3fe9734 P a8545e52c3ee4ac691870228228b4fa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:02.773286 25835 raft_consensus.cc:1275] T 64e29ee66f22432c82e5772ee79dd918 P 0482fd26e89d4bb89ee847d0108ab167 [term 2 FOLLOWER]: Refusing update from remote peer a8545e52c3ee4ac691870228228b4fa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:02.782881 25620 raft_consensus.cc:1275] T 1119e418e9964dd1be1dcf47e3fe9734 P 6e4379ca45a84c5d807695a3fef07116 [term 4 FOLLOWER]: Refusing update from remote peer a8545e52c3ee4ac691870228228b4fa5: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:10:02.783857 25764 consensus_queue.cc:1048] T 64e29ee66f22432c82e5772ee79dd918 P a8545e52c3ee4ac691870228228b4fa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0482fd26e89d4bb89ee847d0108ab167" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 45331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:02.788038 25954 consensus_queue.cc:1048] T 1119e418e9964dd1be1dcf47e3fe9734 P a8545e52c3ee4ac691870228228b4fa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:02.800151 25620 raft_consensus.cc:1275] T 64e29ee66f22432c82e5772ee79dd918 P 6e4379ca45a84c5d807695a3fef07116 [term 2 FOLLOWER]: Refusing update from remote peer a8545e52c3ee4ac691870228228b4fa5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:02.803195 25884 consensus_queue.cc:1048] T 64e29ee66f22432c82e5772ee79dd918 P a8545e52c3ee4ac691870228228b4fa5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e4379ca45a84c5d807695a3fef07116" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 39657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:03.095371 15057 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:03.129115 15057 tablet_server.cc:179] TabletServer@127.14.180.65:45331 shutting down...
I20260709 13:10:03.152964 15057 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:03.153637 15057 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:03.154482 15057 raft_consensus.cc:2243] T 11ad0defd0924408a16ee3f7a8a60106 P 0482fd26e89d4bb89ee847d0108ab167 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:03.155047 15057 raft_consensus.cc:2272] T 11ad0defd0924408a16ee3f7a8a60106 P 0482fd26e89d4bb89ee847d0108ab167 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:03.157389 15057 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:03.157966 15057 raft_consensus.cc:2243] T cc05b0de0de04e64a129f5138acaf446 P 0482fd26e89d4bb89ee847d0108ab167 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:03.158366 15057 raft_consensus.cc:2272] T cc05b0de0de04e64a129f5138acaf446 P 0482fd26e89d4bb89ee847d0108ab167 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:03.160303 15057 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:03.160826 15057 raft_consensus.cc:2243] T d0cd92d7306d4ed695dc084aabbfb995 P 0482fd26e89d4bb89ee847d0108ab167 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:03.161239 15057 raft_consensus.cc:2272] T d0cd92d7306d4ed695dc084aabbfb995 P 0482fd26e89d4bb89ee847d0108ab167 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:03.163391 15057 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:03.163991 15057 raft_consensus.cc:2243] T 1119e418e9964dd1be1dcf47e3fe9734 P 0482fd26e89d4bb89ee847d0108ab167 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:03.164390 15057 raft_consensus.cc:2272] T 1119e418e9964dd1be1dcf47e3fe9734 P 0482fd26e89d4bb89ee847d0108ab167 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:03.166749 15057 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:03.167330 15057 raft_consensus.cc:2243] T 442972580e8d4c5f9010dd64ba54899b P 0482fd26e89d4bb89ee847d0108ab167 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:03.167778 15057 raft_consensus.cc:2272] T 442972580e8d4c5f9010dd64ba54899b P 0482fd26e89d4bb89ee847d0108ab167 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:03.169622 15057 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:03.170130 15057 raft_consensus.cc:2243] T ffbf01eb3ff0482fb5f922a5b0a77a83 P 0482fd26e89d4bb89ee847d0108ab167 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:03.170506 15057 raft_consensus.cc:2272] T ffbf01eb3ff0482fb5f922a5b0a77a83 P 0482fd26e89d4bb89ee847d0108ab167 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:03.172413 15057 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:03.172900 15057 raft_consensus.cc:2243] T a06a18d1f8c346f2b758f593d709eb53 P 0482fd26e89d4bb89ee847d0108ab167 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:03.173269 15057 raft_consensus.cc:2272] T a06a18d1f8c346f2b758f593d709eb53 P 0482fd26e89d4bb89ee847d0108ab167 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:03.175300 15057 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:03.176020 15057 raft_consensus.cc:2243] T 64e29ee66f22432c82e5772ee79dd918 P 0482fd26e89d4bb89ee847d0108ab167 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:03.176484 15057 raft_consensus.cc:2272] T 64e29ee66f22432c82e5772ee79dd918 P 0482fd26e89d4bb89ee847d0108ab167 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:03.176970 25511 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 8 similar messages]
I20260709 13:10:03.179347 15057 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:03.180074 15057 raft_consensus.cc:2243] T c301576f903c43cc87a0c95425f042fb P 0482fd26e89d4bb89ee847d0108ab167 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:10:03.180205 25511 consensus_peers.cc:597] T b6d563892443429682cba0bba950c7d7 P a8545e52c3ee4ac691870228228b4fa5 -> Peer 0482fd26e89d4bb89ee847d0108ab167 (127.14.180.65:45331): Couldn't send request to peer 0482fd26e89d4bb89ee847d0108ab167. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:03.180691 15057 raft_consensus.cc:2272] T c301576f903c43cc87a0c95425f042fb P 0482fd26e89d4bb89ee847d0108ab167 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:03.183234 15057 tablet_replica.cc:333] stopping tablet replica
I20260709 13:10:03.183975 15057 raft_consensus.cc:2243] T b6d563892443429682cba0bba950c7d7 P 0482fd26e89d4bb89ee847d0108ab167 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:03.184612 15057 raft_consensus.cc:2272] T b6d563892443429682cba0bba950c7d7 P 0482fd26e89d4bb89ee847d0108ab167 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:03.189767 25585 consensus_peers.cc:597] T 11ad0defd0924408a16ee3f7a8a60106 P 6e4379ca45a84c5d807695a3fef07116 -> Peer 0482fd26e89d4bb89ee847d0108ab167 (127.14.180.65:45331): Couldn't send request to peer 0482fd26e89d4bb89ee847d0108ab167. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:03.197072 25511 consensus_peers.cc:597] T 1119e418e9964dd1be1dcf47e3fe9734 P a8545e52c3ee4ac691870228228b4fa5 -> Peer 0482fd26e89d4bb89ee847d0108ab167 (127.14.180.65:45331): Couldn't send request to peer 0482fd26e89d4bb89ee847d0108ab167. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:03.209625 15057 tablet_server.cc:196] TabletServer@127.14.180.65:45331 shutdown complete.
I20260709 13:10:03.231791 15057 tablet_server.cc:179] TabletServer@127.14.180.66:0 shutting down...
W20260709 13:10:03.291033 25511 consensus_peers.cc:597] T d0cd92d7306d4ed695dc084aabbfb995 P a8545e52c3ee4ac691870228228b4fa5 -> Peer 0482fd26e89d4bb89ee847d0108ab167 (127.14.180.65:45331): Couldn't send request to peer 0482fd26e89d4bb89ee847d0108ab167. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:45331: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:03.312932 15057 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:03.313959 15057 tablet_replica.cc:333] T cc05b0de0de04e64a129f5138acaf446 P a8545e52c3ee4ac691870228228b4fa5: stopping tablet replica
I20260709 13:10:03.317241 15057 raft_consensus.cc:2243] T cc05b0de0de04e64a129f5138acaf446 P a8545e52c3ee4ac691870228228b4fa5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:03.318125 15057 raft_consensus.cc:2272] T cc05b0de0de04e64a129f5138acaf446 P a8545e52c3ee4ac691870228228b4fa5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:03.321024 15057 tablet_replica.cc:333] T a06a18d1f8c346f2b758f593d709eb53 P a8545e52c3ee4ac691870228228b4fa5: stopping tablet replica
I20260709 13:10:03.321981 15057 raft_consensus.cc:2243] T a06a18d1f8c346f2b758f593d709eb53 P a8545e52c3ee4ac691870228228b4fa5 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:03.323719 15057 raft_consensus.cc:2272] T a06a18d1f8c346f2b758f593d709eb53 P a8545e52c3ee4ac691870228228b4fa5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:03.326532 15057 tablet_replica.cc:333] T 64e29ee66f22432c82e5772ee79dd918 P a8545e52c3ee4ac691870228228b4fa5: stopping tablet replica
I20260709 13:10:03.327469 15057 raft_consensus.cc:2243] T 64e29ee66f22432c82e5772ee79dd918 P a8545e52c3ee4ac691870228228b4fa5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:03.328747 15057 raft_consensus.cc:2272] T 64e29ee66f22432c82e5772ee79dd918 P a8545e52c3ee4ac691870228228b4fa5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:03.332074 15057 tablet_replica.cc:333] T 1119e418e9964dd1be1dcf47e3fe9734 P a8545e52c3ee4ac691870228228b4fa5: stopping tablet replica
I20260709 13:10:03.332834 15057 raft_consensus.cc:2243] T 1119e418e9964dd1be1dcf47e3fe9734 P a8545e52c3ee4ac691870228228b4fa5 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:10:03.334604 15057 raft_consensus.cc:2272] T 1119e418e9964dd1be1dcf47e3fe9734 P a8545e52c3ee4ac691870228228b4fa5 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:03.338663 15057 tablet_replica.cc:333] T ffbf01eb3ff0482fb5f922a5b0a77a83 P a8545e52c3ee4ac691870228228b4fa5: stopping tablet replica
I20260709 13:10:03.339687 15057 raft_consensus.cc:2243] T ffbf01eb3ff0482fb5f922a5b0a77a83 P a8545e52c3ee4ac691870228228b4fa5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:03.340641 15057 raft_consensus.cc:2272] T ffbf01eb3ff0482fb5f922a5b0a77a83 P a8545e52c3ee4ac691870228228b4fa5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:03.343674 15057 tablet_replica.cc:333] T d0cd92d7306d4ed695dc084aabbfb995 P a8545e52c3ee4ac691870228228b4fa5: stopping tablet replica
I20260709 13:10:03.344424 15057 raft_consensus.cc:2243] T d0cd92d7306d4ed695dc084aabbfb995 P a8545e52c3ee4ac691870228228b4fa5 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:10:03.345742 15057 raft_consensus.cc:2272] T d0cd92d7306d4ed695dc084aabbfb995 P a8545e52c3ee4ac691870228228b4fa5 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:03.348716 15057 tablet_replica.cc:333] T 442972580e8d4c5f9010dd64ba54899b P a8545e52c3ee4ac691870228228b4fa5: stopping tablet replica
I20260709 13:10:03.349390 15057 raft_consensus.cc:2243] T 442972580e8d4c5f9010dd64ba54899b P a8545e52c3ee4ac691870228228b4fa5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:03.350101 15057 raft_consensus.cc:2272] T 442972580e8d4c5f9010dd64ba54899b P a8545e52c3ee4ac691870228228b4fa5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:03.353004 15057 tablet_replica.cc:333] T b6d563892443429682cba0bba950c7d7 P a8545e52c3ee4ac691870228228b4fa5: stopping tablet replica
I20260709 13:10:03.353655 15057 raft_consensus.cc:2243] T b6d563892443429682cba0bba950c7d7 P a8545e52c3ee4ac691870228228b4fa5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:03.355283 15057 raft_consensus.cc:2272] T b6d563892443429682cba0bba950c7d7 P a8545e52c3ee4ac691870228228b4fa5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:03.358464 15057 tablet_replica.cc:333] T c301576f903c43cc87a0c95425f042fb P a8545e52c3ee4ac691870228228b4fa5: stopping tablet replica
I20260709 13:10:03.359530 15057 raft_consensus.cc:2243] T c301576f903c43cc87a0c95425f042fb P a8545e52c3ee4ac691870228228b4fa5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:03.360993 15057 raft_consensus.cc:2272] T c301576f903c43cc87a0c95425f042fb P a8545e52c3ee4ac691870228228b4fa5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:03.365943 15057 tablet_replica.cc:333] T 11ad0defd0924408a16ee3f7a8a60106 P a8545e52c3ee4ac691870228228b4fa5: stopping tablet replica
I20260709 13:10:03.366580 15057 raft_consensus.cc:2243] T 11ad0defd0924408a16ee3f7a8a60106 P a8545e52c3ee4ac691870228228b4fa5 [term 4 FOLLOWER]: Raft consensus shutting down.
W20260709 13:10:03.367342 25584 consensus_peers.cc:597] T ffbf01eb3ff0482fb5f922a5b0a77a83 P 6e4379ca45a84c5d807695a3fef07116 -> Peer a8545e52c3ee4ac691870228228b4fa5 (127.14.180.66:35803): Couldn't send request to peer a8545e52c3ee4ac691870228228b4fa5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:03.367388 15057 raft_consensus.cc:2272] T 11ad0defd0924408a16ee3f7a8a60106 P a8545e52c3ee4ac691870228228b4fa5 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:03.398206 25585 consensus_peers.cc:597] T 442972580e8d4c5f9010dd64ba54899b P 6e4379ca45a84c5d807695a3fef07116 -> Peer 0482fd26e89d4bb89ee847d0108ab167 (127.14.180.65:45331): Couldn't send request to peer 0482fd26e89d4bb89ee847d0108ab167. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:45331: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:03.412854 25584 consensus_peers.cc:597] T cc05b0de0de04e64a129f5138acaf446 P 6e4379ca45a84c5d807695a3fef07116 -> Peer a8545e52c3ee4ac691870228228b4fa5 (127.14.180.66:35803): Couldn't send request to peer a8545e52c3ee4ac691870228228b4fa5. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.66:35803: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:03.413239 15057 tablet_server.cc:196] TabletServer@127.14.180.66:0 shutdown complete.
I20260709 13:10:03.447630 15057 tablet_server.cc:179] TabletServer@127.14.180.67:0 shutting down...
I20260709 13:10:03.484628 15057 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:03.485646 15057 tablet_replica.cc:333] T cc05b0de0de04e64a129f5138acaf446 P 6e4379ca45a84c5d807695a3fef07116: stopping tablet replica
I20260709 13:10:03.486459 15057 raft_consensus.cc:2243] T cc05b0de0de04e64a129f5138acaf446 P 6e4379ca45a84c5d807695a3fef07116 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:03.487778 15057 raft_consensus.cc:2272] T cc05b0de0de04e64a129f5138acaf446 P 6e4379ca45a84c5d807695a3fef07116 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:03.490314 15057 tablet_replica.cc:333] T 11ad0defd0924408a16ee3f7a8a60106 P 6e4379ca45a84c5d807695a3fef07116: stopping tablet replica
I20260709 13:10:03.491063 15057 raft_consensus.cc:2243] T 11ad0defd0924408a16ee3f7a8a60106 P 6e4379ca45a84c5d807695a3fef07116 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:10:03.492465 15057 raft_consensus.cc:2272] T 11ad0defd0924408a16ee3f7a8a60106 P 6e4379ca45a84c5d807695a3fef07116 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:03.495757 15057 tablet_replica.cc:333] T a06a18d1f8c346f2b758f593d709eb53 P 6e4379ca45a84c5d807695a3fef07116: stopping tablet replica
I20260709 13:10:03.496460 15057 raft_consensus.cc:2243] T a06a18d1f8c346f2b758f593d709eb53 P 6e4379ca45a84c5d807695a3fef07116 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:03.497072 15057 raft_consensus.cc:2272] T a06a18d1f8c346f2b758f593d709eb53 P 6e4379ca45a84c5d807695a3fef07116 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:03.499635 15057 tablet_replica.cc:333] T 64e29ee66f22432c82e5772ee79dd918 P 6e4379ca45a84c5d807695a3fef07116: stopping tablet replica
I20260709 13:10:03.500269 15057 raft_consensus.cc:2243] T 64e29ee66f22432c82e5772ee79dd918 P 6e4379ca45a84c5d807695a3fef07116 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:03.500816 15057 raft_consensus.cc:2272] T 64e29ee66f22432c82e5772ee79dd918 P 6e4379ca45a84c5d807695a3fef07116 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:03.505185 15057 tablet_replica.cc:333] T 1119e418e9964dd1be1dcf47e3fe9734 P 6e4379ca45a84c5d807695a3fef07116: stopping tablet replica
I20260709 13:10:03.505998 15057 raft_consensus.cc:2243] T 1119e418e9964dd1be1dcf47e3fe9734 P 6e4379ca45a84c5d807695a3fef07116 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:03.506975 15057 raft_consensus.cc:2272] T 1119e418e9964dd1be1dcf47e3fe9734 P 6e4379ca45a84c5d807695a3fef07116 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:03.510473 25585 consensus_peers.cc:597] T c301576f903c43cc87a0c95425f042fb P 6e4379ca45a84c5d807695a3fef07116 -> Peer 0482fd26e89d4bb89ee847d0108ab167 (127.14.180.65:45331): Couldn't send request to peer 0482fd26e89d4bb89ee847d0108ab167. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:45331: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:03.511238 15057 tablet_replica.cc:333] T ffbf01eb3ff0482fb5f922a5b0a77a83 P 6e4379ca45a84c5d807695a3fef07116: stopping tablet replica
I20260709 13:10:03.511953 15057 raft_consensus.cc:2243] T ffbf01eb3ff0482fb5f922a5b0a77a83 P 6e4379ca45a84c5d807695a3fef07116 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:03.513232 15057 raft_consensus.cc:2272] T ffbf01eb3ff0482fb5f922a5b0a77a83 P 6e4379ca45a84c5d807695a3fef07116 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:03.515946 15057 tablet_replica.cc:333] T d0cd92d7306d4ed695dc084aabbfb995 P 6e4379ca45a84c5d807695a3fef07116: stopping tablet replica
I20260709 13:10:03.516566 15057 raft_consensus.cc:2243] T d0cd92d7306d4ed695dc084aabbfb995 P 6e4379ca45a84c5d807695a3fef07116 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:03.517269 15057 raft_consensus.cc:2272] T d0cd92d7306d4ed695dc084aabbfb995 P 6e4379ca45a84c5d807695a3fef07116 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:03.520223 15057 tablet_replica.cc:333] T 442972580e8d4c5f9010dd64ba54899b P 6e4379ca45a84c5d807695a3fef07116: stopping tablet replica
I20260709 13:10:03.520906 15057 raft_consensus.cc:2243] T 442972580e8d4c5f9010dd64ba54899b P 6e4379ca45a84c5d807695a3fef07116 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:03.522156 15057 raft_consensus.cc:2272] T 442972580e8d4c5f9010dd64ba54899b P 6e4379ca45a84c5d807695a3fef07116 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:03.525453 15057 tablet_replica.cc:333] T c301576f903c43cc87a0c95425f042fb P 6e4379ca45a84c5d807695a3fef07116: stopping tablet replica
I20260709 13:10:03.526118 15057 raft_consensus.cc:2243] T c301576f903c43cc87a0c95425f042fb P 6e4379ca45a84c5d807695a3fef07116 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:03.527540 15057 raft_consensus.cc:2272] T c301576f903c43cc87a0c95425f042fb P 6e4379ca45a84c5d807695a3fef07116 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:03.530679 15057 tablet_replica.cc:333] T b6d563892443429682cba0bba950c7d7 P 6e4379ca45a84c5d807695a3fef07116: stopping tablet replica
I20260709 13:10:03.531292 15057 raft_consensus.cc:2243] T b6d563892443429682cba0bba950c7d7 P 6e4379ca45a84c5d807695a3fef07116 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:03.531857 15057 raft_consensus.cc:2272] T b6d563892443429682cba0bba950c7d7 P 6e4379ca45a84c5d807695a3fef07116 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:03.570761 15057 tablet_server.cc:196] TabletServer@127.14.180.67:0 shutdown complete.
I20260709 13:10:03.605324 15057 master.cc:562] Master@127.14.180.126:37755 shutting down...
I20260709 13:10:03.633327 15057 raft_consensus.cc:2243] T 00000000000000000000000000000000 P b625c2133ca44b7593de952682e2cbdc [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:03.634064 15057 raft_consensus.cc:2272] T 00000000000000000000000000000000 P b625c2133ca44b7593de952682e2cbdc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:03.634390 15057 tablet_replica.cc:333] T 00000000000000000000000000000000 P b625c2133ca44b7593de952682e2cbdc: stopping tablet replica
I20260709 13:10:03.658408 15057 master.cc:584] Master@127.14.180.126:37755 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (15190 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 13:10:03.711153 15057 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.14.180.126:45953
I20260709 13:10:03.712301 15057 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:03.719049 25968 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:03.719070 25967 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:03.719596 25970 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:03.722090 15057 server_base.cc:1061] running on GCE node
I20260709 13:10:03.723258 15057 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:03.723556 15057 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:03.723727 15057 hybrid_clock.cc:648] HybridClock initialized: now 1783602603723712 us; error 0 us; skew 500 ppm
I20260709 13:10:03.724326 15057 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:03.727344 15057 webserver.cc:533] Webserver started at http://127.14.180.126:42787/ using document root <none> and password file <none>
I20260709 13:10:03.727998 15057 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:03.728184 15057 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:03.728502 15057 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:03.730028 15057 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602283040513-15057-0/minicluster-data/master-0-root/instance:
uuid: "31a71d5be7cc486ba3b747f43a8ffa78"
format_stamp: "Formatted at 2026-07-09 13:10:03 on dist-test-slave-r9m8"
I20260709 13:10:03.735673 15057 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.000s	sys 0.004s
I20260709 13:10:03.740291 25975 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:03.741192 15057 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:10:03.741629 15057 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602283040513-15057-0/minicluster-data/master-0-root
uuid: "31a71d5be7cc486ba3b747f43a8ffa78"
format_stamp: "Formatted at 2026-07-09 13:10:03 on dist-test-slave-r9m8"
I20260709 13:10:03.741976 15057 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602283040513-15057-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602283040513-15057-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602283040513-15057-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:03.769521 15057 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:03.770848 15057 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:03.815246 15057 rpc_server.cc:307] RPC server started. Bound to: 127.14.180.126:45953
I20260709 13:10:03.815347 26026 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.180.126:45953 every 8 connection(s)
I20260709 13:10:03.821542 26027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:03.840451 26027 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 31a71d5be7cc486ba3b747f43a8ffa78: Bootstrap starting.
I20260709 13:10:03.846395 26027 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 31a71d5be7cc486ba3b747f43a8ffa78: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:03.851648 26027 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 31a71d5be7cc486ba3b747f43a8ffa78: No bootstrap required, opened a new log
I20260709 13:10:03.854349 26027 raft_consensus.cc:359] T 00000000000000000000000000000000 P 31a71d5be7cc486ba3b747f43a8ffa78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "31a71d5be7cc486ba3b747f43a8ffa78" member_type: VOTER }
I20260709 13:10:03.855041 26027 raft_consensus.cc:385] T 00000000000000000000000000000000 P 31a71d5be7cc486ba3b747f43a8ffa78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:03.855300 26027 raft_consensus.cc:740] T 00000000000000000000000000000000 P 31a71d5be7cc486ba3b747f43a8ffa78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31a71d5be7cc486ba3b747f43a8ffa78, State: Initialized, Role: FOLLOWER
I20260709 13:10:03.856030 26027 consensus_queue.cc:260] T 00000000000000000000000000000000 P 31a71d5be7cc486ba3b747f43a8ffa78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "31a71d5be7cc486ba3b747f43a8ffa78" member_type: VOTER }
I20260709 13:10:03.856586 26027 raft_consensus.cc:399] T 00000000000000000000000000000000 P 31a71d5be7cc486ba3b747f43a8ffa78 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:10:03.856863 26027 raft_consensus.cc:493] T 00000000000000000000000000000000 P 31a71d5be7cc486ba3b747f43a8ffa78 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:10:03.857185 26027 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 31a71d5be7cc486ba3b747f43a8ffa78 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:03.863272 26027 raft_consensus.cc:515] T 00000000000000000000000000000000 P 31a71d5be7cc486ba3b747f43a8ffa78 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "31a71d5be7cc486ba3b747f43a8ffa78" member_type: VOTER }
I20260709 13:10:03.863945 26027 leader_election.cc:304] T 00000000000000000000000000000000 P 31a71d5be7cc486ba3b747f43a8ffa78 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 31a71d5be7cc486ba3b747f43a8ffa78; no voters: 
I20260709 13:10:03.865322 26027 leader_election.cc:290] T 00000000000000000000000000000000 P 31a71d5be7cc486ba3b747f43a8ffa78 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:10:03.865761 26030 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 31a71d5be7cc486ba3b747f43a8ffa78 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:03.867411 26030 raft_consensus.cc:697] T 00000000000000000000000000000000 P 31a71d5be7cc486ba3b747f43a8ffa78 [term 1 LEADER]: Becoming Leader. State: Replica: 31a71d5be7cc486ba3b747f43a8ffa78, State: Running, Role: LEADER
I20260709 13:10:03.868243 26030 consensus_queue.cc:237] T 00000000000000000000000000000000 P 31a71d5be7cc486ba3b747f43a8ffa78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "31a71d5be7cc486ba3b747f43a8ffa78" member_type: VOTER }
I20260709 13:10:03.868731 26027 sys_catalog.cc:565] T 00000000000000000000000000000000 P 31a71d5be7cc486ba3b747f43a8ffa78 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:10:03.875538 26031 sys_catalog.cc:455] T 00000000000000000000000000000000 P 31a71d5be7cc486ba3b747f43a8ffa78 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "31a71d5be7cc486ba3b747f43a8ffa78" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "31a71d5be7cc486ba3b747f43a8ffa78" member_type: VOTER } }
I20260709 13:10:03.876230 26031 sys_catalog.cc:458] T 00000000000000000000000000000000 P 31a71d5be7cc486ba3b747f43a8ffa78 [sys.catalog]: This master's current role is: LEADER
I20260709 13:10:03.877540 26032 sys_catalog.cc:455] T 00000000000000000000000000000000 P 31a71d5be7cc486ba3b747f43a8ffa78 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 31a71d5be7cc486ba3b747f43a8ffa78. Latest consensus state: current_term: 1 leader_uuid: "31a71d5be7cc486ba3b747f43a8ffa78" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "31a71d5be7cc486ba3b747f43a8ffa78" member_type: VOTER } }
I20260709 13:10:03.878314 26037 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:10:03.878479 26032 sys_catalog.cc:458] T 00000000000000000000000000000000 P 31a71d5be7cc486ba3b747f43a8ffa78 [sys.catalog]: This master's current role is: LEADER
I20260709 13:10:03.883775 26037 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:10:03.892477 15057 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:10:03.896046 26037 catalog_manager.cc:1383] Generated new cluster ID: c52acd47365b40a0893c167f2bfe2d3b
I20260709 13:10:03.896473 26037 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:10:03.914898 26037 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:10:03.916265 26037 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:10:03.933521 26037 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 31a71d5be7cc486ba3b747f43a8ffa78: Generated new TSK 0
I20260709 13:10:03.934456 26037 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:10:03.963690 15057 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:03.970534 26048 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:03.971580 26049 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:03.973937 15057 server_base.cc:1061] running on GCE node
W20260709 13:10:03.973704 26051 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:03.975435 15057 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:03.975685 15057 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:03.975845 15057 hybrid_clock.cc:648] HybridClock initialized: now 1783602603975832 us; error 0 us; skew 500 ppm
I20260709 13:10:03.976516 15057 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:03.979534 15057 webserver.cc:533] Webserver started at http://127.14.180.65:40017/ using document root <none> and password file <none>
I20260709 13:10:03.980089 15057 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:03.980280 15057 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:03.980520 15057 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:03.981793 15057 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602283040513-15057-0/minicluster-data/ts-0-root/instance:
uuid: "90d2fdd4326c4dcb99ca1b5e506fcb98"
format_stamp: "Formatted at 2026-07-09 13:10:03 on dist-test-slave-r9m8"
I20260709 13:10:03.987744 15057 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.001s
I20260709 13:10:03.992187 26056 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:03.993189 15057 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.003s
I20260709 13:10:03.993568 15057 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602283040513-15057-0/minicluster-data/ts-0-root
uuid: "90d2fdd4326c4dcb99ca1b5e506fcb98"
format_stamp: "Formatted at 2026-07-09 13:10:03 on dist-test-slave-r9m8"
I20260709 13:10:03.993913 15057 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602283040513-15057-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602283040513-15057-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602283040513-15057-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:04.012269 15057 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:04.013655 15057 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:04.015408 15057 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:04.018158 15057 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:04.018432 15057 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:04.018790 15057 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:04.019021 15057 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:04.065073 15057 rpc_server.cc:307] RPC server started. Bound to: 127.14.180.65:37999
I20260709 13:10:04.065153 26118 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.180.65:37999 every 8 connection(s)
I20260709 13:10:04.071131 15057 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:04.079217 26123 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:04.080394 26124 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:04.084204 26126 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:04.087250 15057 server_base.cc:1061] running on GCE node
I20260709 13:10:04.089287 15057 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:04.089640 15057 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:04.089867 15057 hybrid_clock.cc:648] HybridClock initialized: now 1783602604089844 us; error 0 us; skew 500 ppm
I20260709 13:10:04.089915 26119 heartbeater.cc:344] Connected to a master server at 127.14.180.126:45953
I20260709 13:10:04.090600 26119 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:04.090698 15057 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:04.091661 26119 heartbeater.cc:507] Master 127.14.180.126:45953 requested a full tablet report, sending...
I20260709 13:10:04.094524 15057 webserver.cc:533] Webserver started at http://127.14.180.66:38373/ using document root <none> and password file <none>
I20260709 13:10:04.095034 25992 ts_manager.cc:194] Registered new tserver with Master: 90d2fdd4326c4dcb99ca1b5e506fcb98 (127.14.180.65:37999)
I20260709 13:10:04.095323 15057 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:04.095676 15057 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:04.096010 15057 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:04.097347 15057 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602283040513-15057-0/minicluster-data/ts-1-root/instance:
uuid: "1e0c787fa6274132b4528b39cfd79fad"
format_stamp: "Formatted at 2026-07-09 13:10:04 on dist-test-slave-r9m8"
I20260709 13:10:04.097512 25992 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:32964
I20260709 13:10:04.102666 15057 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.003s	sys 0.004s
I20260709 13:10:04.106698 26131 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:04.107827 15057 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:10:04.108189 15057 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602283040513-15057-0/minicluster-data/ts-1-root
uuid: "1e0c787fa6274132b4528b39cfd79fad"
format_stamp: "Formatted at 2026-07-09 13:10:04 on dist-test-slave-r9m8"
I20260709 13:10:04.108525 15057 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602283040513-15057-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602283040513-15057-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602283040513-15057-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:04.122412 15057 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:04.123821 15057 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:04.125473 15057 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:04.128037 15057 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:04.128284 15057 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:04.128558 15057 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:04.128755 15057 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:04.176776 15057 rpc_server.cc:307] RPC server started. Bound to: 127.14.180.66:40179
I20260709 13:10:04.176890 26193 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.180.66:40179 every 8 connection(s)
I20260709 13:10:04.181828 15057 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:04.189944 26197 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:04.191125 26198 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:04.194159 15057 server_base.cc:1061] running on GCE node
I20260709 13:10:04.195124 26194 heartbeater.cc:344] Connected to a master server at 127.14.180.126:45953
W20260709 13:10:04.195595 26200 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:04.195699 26194 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:04.196887 26194 heartbeater.cc:507] Master 127.14.180.126:45953 requested a full tablet report, sending...
I20260709 13:10:04.196941 15057 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:04.197400 15057 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:04.197669 15057 hybrid_clock.cc:648] HybridClock initialized: now 1783602604197647 us; error 0 us; skew 500 ppm
I20260709 13:10:04.198463 15057 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:04.199800 25992 ts_manager.cc:194] Registered new tserver with Master: 1e0c787fa6274132b4528b39cfd79fad (127.14.180.66:40179)
I20260709 13:10:04.201467 15057 webserver.cc:533] Webserver started at http://127.14.180.67:34113/ using document root <none> and password file <none>
I20260709 13:10:04.201783 25992 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:32968
I20260709 13:10:04.202188 15057 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:04.202493 15057 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:04.202865 15057 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:04.204524 15057 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602283040513-15057-0/minicluster-data/ts-2-root/instance:
uuid: "a5b5819a169142229b409ab5904e8874"
format_stamp: "Formatted at 2026-07-09 13:10:04 on dist-test-slave-r9m8"
I20260709 13:10:04.210206 15057 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:10:04.214023 26205 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:04.214982 15057 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:10:04.215271 15057 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602283040513-15057-0/minicluster-data/ts-2-root
uuid: "a5b5819a169142229b409ab5904e8874"
format_stamp: "Formatted at 2026-07-09 13:10:04 on dist-test-slave-r9m8"
I20260709 13:10:04.215574 15057 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602283040513-15057-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602283040513-15057-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602283040513-15057-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:04.225389 15057 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:04.226747 15057 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:04.228428 15057 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:04.231310 15057 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:04.231643 15057 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:04.231966 15057 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:04.232124 15057 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:04.280023 15057 rpc_server.cc:307] RPC server started. Bound to: 127.14.180.67:41537
I20260709 13:10:04.280138 26267 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.180.67:41537 every 8 connection(s)
I20260709 13:10:04.296416 26268 heartbeater.cc:344] Connected to a master server at 127.14.180.126:45953
I20260709 13:10:04.296870 26268 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:04.297598 26268 heartbeater.cc:507] Master 127.14.180.126:45953 requested a full tablet report, sending...
I20260709 13:10:04.299825 25992 ts_manager.cc:194] Registered new tserver with Master: a5b5819a169142229b409ab5904e8874 (127.14.180.67:41537)
I20260709 13:10:04.300033 15057 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016429433s
I20260709 13:10:04.301501 25992 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:32976
I20260709 13:10:04.327685 25992 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:32982:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:10:04.330411 25992 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:10:04.380031 26159 tablet_service.cc:1511] Processing CreateTablet for tablet d293029df37c420c81c461c276a12e4e (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=8ced66a7651b4ce58ac1cef37b7114bf]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:10:04.380712 26158 tablet_service.cc:1511] Processing CreateTablet for tablet c631ee2f115b47acbaf22b3ce3ca0f4b (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=8ced66a7651b4ce58ac1cef37b7114bf]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:10:04.381747 26159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d293029df37c420c81c461c276a12e4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:04.382714 26158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c631ee2f115b47acbaf22b3ce3ca0f4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:04.384665 26233 tablet_service.cc:1511] Processing CreateTablet for tablet d293029df37c420c81c461c276a12e4e (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=8ced66a7651b4ce58ac1cef37b7114bf]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:10:04.386309 26233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d293029df37c420c81c461c276a12e4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:04.384780 26232 tablet_service.cc:1511] Processing CreateTablet for tablet c631ee2f115b47acbaf22b3ce3ca0f4b (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=8ced66a7651b4ce58ac1cef37b7114bf]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:10:04.389343 26232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c631ee2f115b47acbaf22b3ce3ca0f4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:04.408448 26084 tablet_service.cc:1511] Processing CreateTablet for tablet d293029df37c420c81c461c276a12e4e (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=8ced66a7651b4ce58ac1cef37b7114bf]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:10:04.410007 26084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d293029df37c420c81c461c276a12e4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:04.412124 26083 tablet_service.cc:1511] Processing CreateTablet for tablet c631ee2f115b47acbaf22b3ce3ca0f4b (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=8ced66a7651b4ce58ac1cef37b7114bf]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:10:04.413606 26083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c631ee2f115b47acbaf22b3ce3ca0f4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:04.417094 26284 tablet_bootstrap.cc:492] T d293029df37c420c81c461c276a12e4e P a5b5819a169142229b409ab5904e8874: Bootstrap starting.
I20260709 13:10:04.437493 26285 tablet_bootstrap.cc:492] T d293029df37c420c81c461c276a12e4e P 90d2fdd4326c4dcb99ca1b5e506fcb98: Bootstrap starting.
I20260709 13:10:04.439029 26284 tablet_bootstrap.cc:654] T d293029df37c420c81c461c276a12e4e P a5b5819a169142229b409ab5904e8874: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:04.440363 26283 tablet_bootstrap.cc:492] T d293029df37c420c81c461c276a12e4e P 1e0c787fa6274132b4528b39cfd79fad: Bootstrap starting.
I20260709 13:10:04.445442 26285 tablet_bootstrap.cc:654] T d293029df37c420c81c461c276a12e4e P 90d2fdd4326c4dcb99ca1b5e506fcb98: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:04.446527 26284 tablet_bootstrap.cc:492] T d293029df37c420c81c461c276a12e4e P a5b5819a169142229b409ab5904e8874: No bootstrap required, opened a new log
I20260709 13:10:04.447144 26284 ts_tablet_manager.cc:1403] T d293029df37c420c81c461c276a12e4e P a5b5819a169142229b409ab5904e8874: Time spent bootstrapping tablet: real 0.031s	user 0.014s	sys 0.005s
I20260709 13:10:04.450265 26283 tablet_bootstrap.cc:654] T d293029df37c420c81c461c276a12e4e P 1e0c787fa6274132b4528b39cfd79fad: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:04.450141 26284 raft_consensus.cc:359] T d293029df37c420c81c461c276a12e4e P a5b5819a169142229b409ab5904e8874 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e0c787fa6274132b4528b39cfd79fad" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 40179 } } peers { permanent_uuid: "a5b5819a169142229b409ab5904e8874" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 41537 } } peers { permanent_uuid: "90d2fdd4326c4dcb99ca1b5e506fcb98" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 37999 } }
I20260709 13:10:04.451040 26284 raft_consensus.cc:385] T d293029df37c420c81c461c276a12e4e P a5b5819a169142229b409ab5904e8874 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:04.451383 26284 raft_consensus.cc:740] T d293029df37c420c81c461c276a12e4e P a5b5819a169142229b409ab5904e8874 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5b5819a169142229b409ab5904e8874, State: Initialized, Role: FOLLOWER
I20260709 13:10:04.452106 26285 tablet_bootstrap.cc:492] T d293029df37c420c81c461c276a12e4e P 90d2fdd4326c4dcb99ca1b5e506fcb98: No bootstrap required, opened a new log
I20260709 13:10:04.452180 26284 consensus_queue.cc:260] T d293029df37c420c81c461c276a12e4e P a5b5819a169142229b409ab5904e8874 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e0c787fa6274132b4528b39cfd79fad" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 40179 } } peers { permanent_uuid: "a5b5819a169142229b409ab5904e8874" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 41537 } } peers { permanent_uuid: "90d2fdd4326c4dcb99ca1b5e506fcb98" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 37999 } }
I20260709 13:10:04.452991 26285 ts_tablet_manager.cc:1403] T d293029df37c420c81c461c276a12e4e P 90d2fdd4326c4dcb99ca1b5e506fcb98: Time spent bootstrapping tablet: real 0.016s	user 0.015s	sys 0.000s
I20260709 13:10:04.455097 26268 heartbeater.cc:499] Master 127.14.180.126:45953 was elected leader, sending a full tablet report...
I20260709 13:10:04.457741 26285 raft_consensus.cc:359] T d293029df37c420c81c461c276a12e4e P 90d2fdd4326c4dcb99ca1b5e506fcb98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e0c787fa6274132b4528b39cfd79fad" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 40179 } } peers { permanent_uuid: "a5b5819a169142229b409ab5904e8874" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 41537 } } peers { permanent_uuid: "90d2fdd4326c4dcb99ca1b5e506fcb98" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 37999 } }
I20260709 13:10:04.458686 26285 raft_consensus.cc:385] T d293029df37c420c81c461c276a12e4e P 90d2fdd4326c4dcb99ca1b5e506fcb98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:04.459013 26285 raft_consensus.cc:740] T d293029df37c420c81c461c276a12e4e P 90d2fdd4326c4dcb99ca1b5e506fcb98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90d2fdd4326c4dcb99ca1b5e506fcb98, State: Initialized, Role: FOLLOWER
I20260709 13:10:04.459066 26284 ts_tablet_manager.cc:1434] T d293029df37c420c81c461c276a12e4e P a5b5819a169142229b409ab5904e8874: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.006s
I20260709 13:10:04.460465 26284 tablet_bootstrap.cc:492] T c631ee2f115b47acbaf22b3ce3ca0f4b P a5b5819a169142229b409ab5904e8874: Bootstrap starting.
I20260709 13:10:04.460333 26285 consensus_queue.cc:260] T d293029df37c420c81c461c276a12e4e P 90d2fdd4326c4dcb99ca1b5e506fcb98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e0c787fa6274132b4528b39cfd79fad" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 40179 } } peers { permanent_uuid: "a5b5819a169142229b409ab5904e8874" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 41537 } } peers { permanent_uuid: "90d2fdd4326c4dcb99ca1b5e506fcb98" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 37999 } }
I20260709 13:10:04.466441 26283 tablet_bootstrap.cc:492] T d293029df37c420c81c461c276a12e4e P 1e0c787fa6274132b4528b39cfd79fad: No bootstrap required, opened a new log
I20260709 13:10:04.467347 26283 ts_tablet_manager.cc:1403] T d293029df37c420c81c461c276a12e4e P 1e0c787fa6274132b4528b39cfd79fad: Time spent bootstrapping tablet: real 0.028s	user 0.017s	sys 0.005s
I20260709 13:10:04.470778 26285 ts_tablet_manager.cc:1434] T d293029df37c420c81c461c276a12e4e P 90d2fdd4326c4dcb99ca1b5e506fcb98: Time spent starting tablet: real 0.017s	user 0.013s	sys 0.004s
I20260709 13:10:04.471230 26119 heartbeater.cc:499] Master 127.14.180.126:45953 was elected leader, sending a full tablet report...
I20260709 13:10:04.472080 26285 tablet_bootstrap.cc:492] T c631ee2f115b47acbaf22b3ce3ca0f4b P 90d2fdd4326c4dcb99ca1b5e506fcb98: Bootstrap starting.
I20260709 13:10:04.470816 26284 tablet_bootstrap.cc:654] T c631ee2f115b47acbaf22b3ce3ca0f4b P a5b5819a169142229b409ab5904e8874: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:04.477468 26283 raft_consensus.cc:359] T d293029df37c420c81c461c276a12e4e P 1e0c787fa6274132b4528b39cfd79fad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e0c787fa6274132b4528b39cfd79fad" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 40179 } } peers { permanent_uuid: "a5b5819a169142229b409ab5904e8874" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 41537 } } peers { permanent_uuid: "90d2fdd4326c4dcb99ca1b5e506fcb98" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 37999 } }
I20260709 13:10:04.478376 26283 raft_consensus.cc:385] T d293029df37c420c81c461c276a12e4e P 1e0c787fa6274132b4528b39cfd79fad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:04.478730 26283 raft_consensus.cc:740] T d293029df37c420c81c461c276a12e4e P 1e0c787fa6274132b4528b39cfd79fad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e0c787fa6274132b4528b39cfd79fad, State: Initialized, Role: FOLLOWER
I20260709 13:10:04.479519 26283 consensus_queue.cc:260] T d293029df37c420c81c461c276a12e4e P 1e0c787fa6274132b4528b39cfd79fad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e0c787fa6274132b4528b39cfd79fad" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 40179 } } peers { permanent_uuid: "a5b5819a169142229b409ab5904e8874" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 41537 } } peers { permanent_uuid: "90d2fdd4326c4dcb99ca1b5e506fcb98" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 37999 } }
I20260709 13:10:04.480618 26285 tablet_bootstrap.cc:654] T c631ee2f115b47acbaf22b3ce3ca0f4b P 90d2fdd4326c4dcb99ca1b5e506fcb98: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:04.482690 26284 tablet_bootstrap.cc:492] T c631ee2f115b47acbaf22b3ce3ca0f4b P a5b5819a169142229b409ab5904e8874: No bootstrap required, opened a new log
I20260709 13:10:04.483299 26284 ts_tablet_manager.cc:1403] T c631ee2f115b47acbaf22b3ce3ca0f4b P a5b5819a169142229b409ab5904e8874: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.002s
I20260709 13:10:04.487665 26290 raft_consensus.cc:493] T d293029df37c420c81c461c276a12e4e P 90d2fdd4326c4dcb99ca1b5e506fcb98 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:04.493341 26285 tablet_bootstrap.cc:492] T c631ee2f115b47acbaf22b3ce3ca0f4b P 90d2fdd4326c4dcb99ca1b5e506fcb98: No bootstrap required, opened a new log
I20260709 13:10:04.493937 26285 ts_tablet_manager.cc:1403] T c631ee2f115b47acbaf22b3ce3ca0f4b P 90d2fdd4326c4dcb99ca1b5e506fcb98: Time spent bootstrapping tablet: real 0.022s	user 0.007s	sys 0.012s
I20260709 13:10:04.491930 26284 raft_consensus.cc:359] T c631ee2f115b47acbaf22b3ce3ca0f4b P a5b5819a169142229b409ab5904e8874 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90d2fdd4326c4dcb99ca1b5e506fcb98" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 37999 } } peers { permanent_uuid: "1e0c787fa6274132b4528b39cfd79fad" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 40179 } } peers { permanent_uuid: "a5b5819a169142229b409ab5904e8874" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 41537 } }
I20260709 13:10:04.494900 26284 raft_consensus.cc:385] T c631ee2f115b47acbaf22b3ce3ca0f4b P a5b5819a169142229b409ab5904e8874 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:04.495294 26283 ts_tablet_manager.cc:1434] T d293029df37c420c81c461c276a12e4e P 1e0c787fa6274132b4528b39cfd79fad: Time spent starting tablet: real 0.028s	user 0.014s	sys 0.008s
I20260709 13:10:04.496029 26194 heartbeater.cc:499] Master 127.14.180.126:45953 was elected leader, sending a full tablet report...
I20260709 13:10:04.495535 26290 raft_consensus.cc:515] T d293029df37c420c81c461c276a12e4e P 90d2fdd4326c4dcb99ca1b5e506fcb98 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e0c787fa6274132b4528b39cfd79fad" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 40179 } } peers { permanent_uuid: "a5b5819a169142229b409ab5904e8874" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 41537 } } peers { permanent_uuid: "90d2fdd4326c4dcb99ca1b5e506fcb98" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 37999 } }
I20260709 13:10:04.496908 26283 tablet_bootstrap.cc:492] T c631ee2f115b47acbaf22b3ce3ca0f4b P 1e0c787fa6274132b4528b39cfd79fad: Bootstrap starting.
I20260709 13:10:04.497349 26285 raft_consensus.cc:359] T c631ee2f115b47acbaf22b3ce3ca0f4b P 90d2fdd4326c4dcb99ca1b5e506fcb98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90d2fdd4326c4dcb99ca1b5e506fcb98" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 37999 } } peers { permanent_uuid: "1e0c787fa6274132b4528b39cfd79fad" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 40179 } } peers { permanent_uuid: "a5b5819a169142229b409ab5904e8874" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 41537 } }
I20260709 13:10:04.498186 26285 raft_consensus.cc:385] T c631ee2f115b47acbaf22b3ce3ca0f4b P 90d2fdd4326c4dcb99ca1b5e506fcb98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:04.498523 26285 raft_consensus.cc:740] T c631ee2f115b47acbaf22b3ce3ca0f4b P 90d2fdd4326c4dcb99ca1b5e506fcb98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90d2fdd4326c4dcb99ca1b5e506fcb98, State: Initialized, Role: FOLLOWER
I20260709 13:10:04.499342 26285 consensus_queue.cc:260] T c631ee2f115b47acbaf22b3ce3ca0f4b P 90d2fdd4326c4dcb99ca1b5e506fcb98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90d2fdd4326c4dcb99ca1b5e506fcb98" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 37999 } } peers { permanent_uuid: "1e0c787fa6274132b4528b39cfd79fad" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 40179 } } peers { permanent_uuid: "a5b5819a169142229b409ab5904e8874" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 41537 } }
I20260709 13:10:04.505682 26285 ts_tablet_manager.cc:1434] T c631ee2f115b47acbaf22b3ce3ca0f4b P 90d2fdd4326c4dcb99ca1b5e506fcb98: Time spent starting tablet: real 0.011s	user 0.000s	sys 0.007s
I20260709 13:10:04.506219 26283 tablet_bootstrap.cc:654] T c631ee2f115b47acbaf22b3ce3ca0f4b P 1e0c787fa6274132b4528b39cfd79fad: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:04.495226 26284 raft_consensus.cc:740] T c631ee2f115b47acbaf22b3ce3ca0f4b P a5b5819a169142229b409ab5904e8874 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5b5819a169142229b409ab5904e8874, State: Initialized, Role: FOLLOWER
I20260709 13:10:04.510485 26284 consensus_queue.cc:260] T c631ee2f115b47acbaf22b3ce3ca0f4b P a5b5819a169142229b409ab5904e8874 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90d2fdd4326c4dcb99ca1b5e506fcb98" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 37999 } } peers { permanent_uuid: "1e0c787fa6274132b4528b39cfd79fad" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 40179 } } peers { permanent_uuid: "a5b5819a169142229b409ab5904e8874" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 41537 } }
I20260709 13:10:04.513068 26284 ts_tablet_manager.cc:1434] T c631ee2f115b47acbaf22b3ce3ca0f4b P a5b5819a169142229b409ab5904e8874: Time spent starting tablet: real 0.029s	user 0.008s	sys 0.000s
I20260709 13:10:04.518177 26283 tablet_bootstrap.cc:492] T c631ee2f115b47acbaf22b3ce3ca0f4b P 1e0c787fa6274132b4528b39cfd79fad: No bootstrap required, opened a new log
I20260709 13:10:04.518893 26283 ts_tablet_manager.cc:1403] T c631ee2f115b47acbaf22b3ce3ca0f4b P 1e0c787fa6274132b4528b39cfd79fad: Time spent bootstrapping tablet: real 0.022s	user 0.020s	sys 0.000s
I20260709 13:10:04.521718 26290 leader_election.cc:290] T d293029df37c420c81c461c276a12e4e P 90d2fdd4326c4dcb99ca1b5e506fcb98 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e0c787fa6274132b4528b39cfd79fad (127.14.180.66:40179), a5b5819a169142229b409ab5904e8874 (127.14.180.67:41537)
I20260709 13:10:04.522154 26283 raft_consensus.cc:359] T c631ee2f115b47acbaf22b3ce3ca0f4b P 1e0c787fa6274132b4528b39cfd79fad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90d2fdd4326c4dcb99ca1b5e506fcb98" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 37999 } } peers { permanent_uuid: "1e0c787fa6274132b4528b39cfd79fad" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 40179 } } peers { permanent_uuid: "a5b5819a169142229b409ab5904e8874" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 41537 } }
I20260709 13:10:04.523022 26283 raft_consensus.cc:385] T c631ee2f115b47acbaf22b3ce3ca0f4b P 1e0c787fa6274132b4528b39cfd79fad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:04.523367 26283 raft_consensus.cc:740] T c631ee2f115b47acbaf22b3ce3ca0f4b P 1e0c787fa6274132b4528b39cfd79fad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e0c787fa6274132b4528b39cfd79fad, State: Initialized, Role: FOLLOWER
I20260709 13:10:04.524109 26283 consensus_queue.cc:260] T c631ee2f115b47acbaf22b3ce3ca0f4b P 1e0c787fa6274132b4528b39cfd79fad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90d2fdd4326c4dcb99ca1b5e506fcb98" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 37999 } } peers { permanent_uuid: "1e0c787fa6274132b4528b39cfd79fad" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 40179 } } peers { permanent_uuid: "a5b5819a169142229b409ab5904e8874" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 41537 } }
I20260709 13:10:04.526465 26283 ts_tablet_manager.cc:1434] T c631ee2f115b47acbaf22b3ce3ca0f4b P 1e0c787fa6274132b4528b39cfd79fad: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:10:04.527503 26292 raft_consensus.cc:493] T c631ee2f115b47acbaf22b3ce3ca0f4b P 1e0c787fa6274132b4528b39cfd79fad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:04.528096 26292 raft_consensus.cc:515] T c631ee2f115b47acbaf22b3ce3ca0f4b P 1e0c787fa6274132b4528b39cfd79fad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90d2fdd4326c4dcb99ca1b5e506fcb98" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 37999 } } peers { permanent_uuid: "1e0c787fa6274132b4528b39cfd79fad" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 40179 } } peers { permanent_uuid: "a5b5819a169142229b409ab5904e8874" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 41537 } }
I20260709 13:10:04.528687 26169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d293029df37c420c81c461c276a12e4e" candidate_uuid: "90d2fdd4326c4dcb99ca1b5e506fcb98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e0c787fa6274132b4528b39cfd79fad" is_pre_election: true
I20260709 13:10:04.529567 26169 raft_consensus.cc:2468] T d293029df37c420c81c461c276a12e4e P 1e0c787fa6274132b4528b39cfd79fad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 90d2fdd4326c4dcb99ca1b5e506fcb98 in term 0.
I20260709 13:10:04.531132 26057 leader_election.cc:304] T d293029df37c420c81c461c276a12e4e P 90d2fdd4326c4dcb99ca1b5e506fcb98 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e0c787fa6274132b4528b39cfd79fad, 90d2fdd4326c4dcb99ca1b5e506fcb98; no voters: 
I20260709 13:10:04.532068 26290 raft_consensus.cc:2804] T d293029df37c420c81c461c276a12e4e P 90d2fdd4326c4dcb99ca1b5e506fcb98 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:04.532477 26290 raft_consensus.cc:493] T d293029df37c420c81c461c276a12e4e P 90d2fdd4326c4dcb99ca1b5e506fcb98 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:04.532830 26290 raft_consensus.cc:3060] T d293029df37c420c81c461c276a12e4e P 90d2fdd4326c4dcb99ca1b5e506fcb98 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:04.534307 26292 leader_election.cc:290] T c631ee2f115b47acbaf22b3ce3ca0f4b P 1e0c787fa6274132b4528b39cfd79fad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 90d2fdd4326c4dcb99ca1b5e506fcb98 (127.14.180.65:37999), a5b5819a169142229b409ab5904e8874 (127.14.180.67:41537)
I20260709 13:10:04.542125 26290 raft_consensus.cc:515] T d293029df37c420c81c461c276a12e4e P 90d2fdd4326c4dcb99ca1b5e506fcb98 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e0c787fa6274132b4528b39cfd79fad" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 40179 } } peers { permanent_uuid: "a5b5819a169142229b409ab5904e8874" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 41537 } } peers { permanent_uuid: "90d2fdd4326c4dcb99ca1b5e506fcb98" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 37999 } }
I20260709 13:10:04.544481 26290 leader_election.cc:290] T d293029df37c420c81c461c276a12e4e P 90d2fdd4326c4dcb99ca1b5e506fcb98 [CANDIDATE]: Term 1 election: Requested vote from peers 1e0c787fa6274132b4528b39cfd79fad (127.14.180.66:40179), a5b5819a169142229b409ab5904e8874 (127.14.180.67:41537)
I20260709 13:10:04.546186 26169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d293029df37c420c81c461c276a12e4e" candidate_uuid: "90d2fdd4326c4dcb99ca1b5e506fcb98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e0c787fa6274132b4528b39cfd79fad"
I20260709 13:10:04.546597 26094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c631ee2f115b47acbaf22b3ce3ca0f4b" candidate_uuid: "1e0c787fa6274132b4528b39cfd79fad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90d2fdd4326c4dcb99ca1b5e506fcb98" is_pre_election: true
I20260709 13:10:04.547005 26169 raft_consensus.cc:3060] T d293029df37c420c81c461c276a12e4e P 1e0c787fa6274132b4528b39cfd79fad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:04.547299 26094 raft_consensus.cc:2468] T c631ee2f115b47acbaf22b3ce3ca0f4b P 90d2fdd4326c4dcb99ca1b5e506fcb98 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e0c787fa6274132b4528b39cfd79fad in term 0.
I20260709 13:10:04.547267 26243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d293029df37c420c81c461c276a12e4e" candidate_uuid: "90d2fdd4326c4dcb99ca1b5e506fcb98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5b5819a169142229b409ab5904e8874" is_pre_election: true
I20260709 13:10:04.548971 26243 raft_consensus.cc:2468] T d293029df37c420c81c461c276a12e4e P a5b5819a169142229b409ab5904e8874 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 90d2fdd4326c4dcb99ca1b5e506fcb98 in term 0.
I20260709 13:10:04.549207 26242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d293029df37c420c81c461c276a12e4e" candidate_uuid: "90d2fdd4326c4dcb99ca1b5e506fcb98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5b5819a169142229b409ab5904e8874"
I20260709 13:10:04.550308 26242 raft_consensus.cc:3060] T d293029df37c420c81c461c276a12e4e P a5b5819a169142229b409ab5904e8874 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:04.551049 26132 leader_election.cc:304] T c631ee2f115b47acbaf22b3ce3ca0f4b P 1e0c787fa6274132b4528b39cfd79fad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e0c787fa6274132b4528b39cfd79fad, 90d2fdd4326c4dcb99ca1b5e506fcb98; no voters: 
I20260709 13:10:04.552274 26292 raft_consensus.cc:2804] T c631ee2f115b47acbaf22b3ce3ca0f4b P 1e0c787fa6274132b4528b39cfd79fad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:04.552748 26292 raft_consensus.cc:493] T c631ee2f115b47acbaf22b3ce3ca0f4b P 1e0c787fa6274132b4528b39cfd79fad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:04.553157 26292 raft_consensus.cc:3060] T c631ee2f115b47acbaf22b3ce3ca0f4b P 1e0c787fa6274132b4528b39cfd79fad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:04.553241 26243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c631ee2f115b47acbaf22b3ce3ca0f4b" candidate_uuid: "1e0c787fa6274132b4528b39cfd79fad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5b5819a169142229b409ab5904e8874" is_pre_election: true
I20260709 13:10:04.554081 26243 raft_consensus.cc:2468] T c631ee2f115b47acbaf22b3ce3ca0f4b P a5b5819a169142229b409ab5904e8874 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e0c787fa6274132b4528b39cfd79fad in term 0.
I20260709 13:10:04.556700 26169 raft_consensus.cc:2468] T d293029df37c420c81c461c276a12e4e P 1e0c787fa6274132b4528b39cfd79fad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90d2fdd4326c4dcb99ca1b5e506fcb98 in term 1.
I20260709 13:10:04.558017 26057 leader_election.cc:304] T d293029df37c420c81c461c276a12e4e P 90d2fdd4326c4dcb99ca1b5e506fcb98 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e0c787fa6274132b4528b39cfd79fad, 90d2fdd4326c4dcb99ca1b5e506fcb98; no voters: 
I20260709 13:10:04.558872 26290 raft_consensus.cc:2804] T d293029df37c420c81c461c276a12e4e P 90d2fdd4326c4dcb99ca1b5e506fcb98 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:04.559337 26290 raft_consensus.cc:697] T d293029df37c420c81c461c276a12e4e P 90d2fdd4326c4dcb99ca1b5e506fcb98 [term 1 LEADER]: Becoming Leader. State: Replica: 90d2fdd4326c4dcb99ca1b5e506fcb98, State: Running, Role: LEADER
I20260709 13:10:04.560096 26242 raft_consensus.cc:2468] T d293029df37c420c81c461c276a12e4e P a5b5819a169142229b409ab5904e8874 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90d2fdd4326c4dcb99ca1b5e506fcb98 in term 1.
I20260709 13:10:04.560204 26290 consensus_queue.cc:237] T d293029df37c420c81c461c276a12e4e P 90d2fdd4326c4dcb99ca1b5e506fcb98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e0c787fa6274132b4528b39cfd79fad" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 40179 } } peers { permanent_uuid: "a5b5819a169142229b409ab5904e8874" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 41537 } } peers { permanent_uuid: "90d2fdd4326c4dcb99ca1b5e506fcb98" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 37999 } }
I20260709 13:10:04.562829 26292 raft_consensus.cc:515] T c631ee2f115b47acbaf22b3ce3ca0f4b P 1e0c787fa6274132b4528b39cfd79fad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90d2fdd4326c4dcb99ca1b5e506fcb98" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 37999 } } peers { permanent_uuid: "1e0c787fa6274132b4528b39cfd79fad" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 40179 } } peers { permanent_uuid: "a5b5819a169142229b409ab5904e8874" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 41537 } }
I20260709 13:10:04.565129 26292 leader_election.cc:290] T c631ee2f115b47acbaf22b3ce3ca0f4b P 1e0c787fa6274132b4528b39cfd79fad [CANDIDATE]: Term 1 election: Requested vote from peers 90d2fdd4326c4dcb99ca1b5e506fcb98 (127.14.180.65:37999), a5b5819a169142229b409ab5904e8874 (127.14.180.67:41537)
I20260709 13:10:04.566444 26094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c631ee2f115b47acbaf22b3ce3ca0f4b" candidate_uuid: "1e0c787fa6274132b4528b39cfd79fad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90d2fdd4326c4dcb99ca1b5e506fcb98"
I20260709 13:10:04.567339 26242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c631ee2f115b47acbaf22b3ce3ca0f4b" candidate_uuid: "1e0c787fa6274132b4528b39cfd79fad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5b5819a169142229b409ab5904e8874"
I20260709 13:10:04.567433 26094 raft_consensus.cc:3060] T c631ee2f115b47acbaf22b3ce3ca0f4b P 90d2fdd4326c4dcb99ca1b5e506fcb98 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:04.568140 26242 raft_consensus.cc:3060] T c631ee2f115b47acbaf22b3ce3ca0f4b P a5b5819a169142229b409ab5904e8874 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:04.573695 25991 catalog_manager.cc:5697] T d293029df37c420c81c461c276a12e4e P 90d2fdd4326c4dcb99ca1b5e506fcb98 reported cstate change: term changed from 0 to 1, leader changed from <none> to 90d2fdd4326c4dcb99ca1b5e506fcb98 (127.14.180.65). New cstate: current_term: 1 leader_uuid: "90d2fdd4326c4dcb99ca1b5e506fcb98" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e0c787fa6274132b4528b39cfd79fad" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a5b5819a169142229b409ab5904e8874" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 41537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "90d2fdd4326c4dcb99ca1b5e506fcb98" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 37999 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:04.576110 26094 raft_consensus.cc:2468] T c631ee2f115b47acbaf22b3ce3ca0f4b P 90d2fdd4326c4dcb99ca1b5e506fcb98 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e0c787fa6274132b4528b39cfd79fad in term 1.
I20260709 13:10:04.576112 26242 raft_consensus.cc:2468] T c631ee2f115b47acbaf22b3ce3ca0f4b P a5b5819a169142229b409ab5904e8874 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e0c787fa6274132b4528b39cfd79fad in term 1.
I20260709 13:10:04.577544 26132 leader_election.cc:304] T c631ee2f115b47acbaf22b3ce3ca0f4b P 1e0c787fa6274132b4528b39cfd79fad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e0c787fa6274132b4528b39cfd79fad, 90d2fdd4326c4dcb99ca1b5e506fcb98; no voters: 
I20260709 13:10:04.578378 26292 raft_consensus.cc:2804] T c631ee2f115b47acbaf22b3ce3ca0f4b P 1e0c787fa6274132b4528b39cfd79fad [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:04.579828 26292 raft_consensus.cc:697] T c631ee2f115b47acbaf22b3ce3ca0f4b P 1e0c787fa6274132b4528b39cfd79fad [term 1 LEADER]: Becoming Leader. State: Replica: 1e0c787fa6274132b4528b39cfd79fad, State: Running, Role: LEADER
I20260709 13:10:04.580716 26292 consensus_queue.cc:237] T c631ee2f115b47acbaf22b3ce3ca0f4b P 1e0c787fa6274132b4528b39cfd79fad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90d2fdd4326c4dcb99ca1b5e506fcb98" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 37999 } } peers { permanent_uuid: "1e0c787fa6274132b4528b39cfd79fad" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 40179 } } peers { permanent_uuid: "a5b5819a169142229b409ab5904e8874" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 41537 } }
I20260709 13:10:04.588460 25991 catalog_manager.cc:5697] T c631ee2f115b47acbaf22b3ce3ca0f4b P 1e0c787fa6274132b4528b39cfd79fad reported cstate change: term changed from 0 to 1, leader changed from <none> to 1e0c787fa6274132b4528b39cfd79fad (127.14.180.66). New cstate: current_term: 1 leader_uuid: "1e0c787fa6274132b4528b39cfd79fad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90d2fdd4326c4dcb99ca1b5e506fcb98" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 37999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e0c787fa6274132b4528b39cfd79fad" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 40179 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a5b5819a169142229b409ab5904e8874" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 41537 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:04.641860 25991 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:32996:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:10:04.644007 25991 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:10:04.669974 26084 tablet_service.cc:1511] Processing CreateTablet for tablet 77a972c0637f4187940b52b2db39422e (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=826f76c42211451cb77b69017fd0d668]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:10:04.671528 26084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77a972c0637f4187940b52b2db39422e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:04.671250 26159 tablet_service.cc:1511] Processing CreateTablet for tablet 77a972c0637f4187940b52b2db39422e (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=826f76c42211451cb77b69017fd0d668]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:10:04.672653 26159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77a972c0637f4187940b52b2db39422e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:04.672534 26233 tablet_service.cc:1511] Processing CreateTablet for tablet 77a972c0637f4187940b52b2db39422e (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=826f76c42211451cb77b69017fd0d668]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:10:04.673993 26233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77a972c0637f4187940b52b2db39422e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:04.678064 26083 tablet_service.cc:1511] Processing CreateTablet for tablet 8765f34b0faf4362bc3e85bb02a8d0f5 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=826f76c42211451cb77b69017fd0d668]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:10:04.679804 26083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8765f34b0faf4362bc3e85bb02a8d0f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:04.682013 26158 tablet_service.cc:1511] Processing CreateTablet for tablet 8765f34b0faf4362bc3e85bb02a8d0f5 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=826f76c42211451cb77b69017fd0d668]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:10:04.683436 26158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8765f34b0faf4362bc3e85bb02a8d0f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:04.690080 26285 tablet_bootstrap.cc:492] T 77a972c0637f4187940b52b2db39422e P 90d2fdd4326c4dcb99ca1b5e506fcb98: Bootstrap starting.
I20260709 13:10:04.694051 26284 tablet_bootstrap.cc:492] T 77a972c0637f4187940b52b2db39422e P a5b5819a169142229b409ab5904e8874: Bootstrap starting.
I20260709 13:10:04.700280 26285 tablet_bootstrap.cc:654] T 77a972c0637f4187940b52b2db39422e P 90d2fdd4326c4dcb99ca1b5e506fcb98: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:04.701849 26284 tablet_bootstrap.cc:654] T 77a972c0637f4187940b52b2db39422e P a5b5819a169142229b409ab5904e8874: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:04.703619 26233 tablet_service.cc:1511] Processing CreateTablet for tablet 8765f34b0faf4362bc3e85bb02a8d0f5 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=826f76c42211451cb77b69017fd0d668]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:10:04.707058 26233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8765f34b0faf4362bc3e85bb02a8d0f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:04.714236 26283 tablet_bootstrap.cc:492] T 77a972c0637f4187940b52b2db39422e P 1e0c787fa6274132b4528b39cfd79fad: Bootstrap starting.
I20260709 13:10:04.718678 26285 tablet_bootstrap.cc:492] T 77a972c0637f4187940b52b2db39422e P 90d2fdd4326c4dcb99ca1b5e506fcb98: No bootstrap required, opened a new log
I20260709 13:10:04.719399 26285 ts_tablet_manager.cc:1403] T 77a972c0637f4187940b52b2db39422e P 90d2fdd4326c4dcb99ca1b5e506fcb98: Time spent bootstrapping tablet: real 0.030s	user 0.008s	sys 0.006s
I20260709 13:10:04.721860 26283 tablet_bootstrap.cc:654] T 77a972c0637f4187940b52b2db39422e P 1e0c787fa6274132b4528b39cfd79fad: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:04.722848 26285 raft_consensus.cc:359] T 77a972c0637f4187940b52b2db39422e P 90d2fdd4326c4dcb99ca1b5e506fcb98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90d2fdd4326c4dcb99ca1b5e506fcb98" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 37999 } } peers { permanent_uuid: "1e0c787fa6274132b4528b39cfd79fad" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 40179 } } peers { permanent_uuid: "a5b5819a169142229b409ab5904e8874" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 41537 } }
I20260709 13:10:04.723752 26285 raft_consensus.cc:385] T 77a972c0637f4187940b52b2db39422e P 90d2fdd4326c4dcb99ca1b5e506fcb98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:04.724130 26285 raft_consensus.cc:740] T 77a972c0637f4187940b52b2db39422e P 90d2fdd4326c4dcb99ca1b5e506fcb98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90d2fdd4326c4dcb99ca1b5e506fcb98, State: Initialized, Role: FOLLOWER
I20260709 13:10:04.725057 26285 consensus_queue.cc:260] T 77a972c0637f4187940b52b2db39422e P 90d2fdd4326c4dcb99ca1b5e506fcb98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90d2fdd4326c4dcb99ca1b5e506fcb98" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 37999 } } peers { permanent_uuid: "1e0c787fa6274132b4528b39cfd79fad" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 40179 } } peers { permanent_uuid: "a5b5819a169142229b409ab5904e8874" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 41537 } }
I20260709 13:10:04.727298 26284 tablet_bootstrap.cc:492] T 77a972c0637f4187940b52b2db39422e P a5b5819a169142229b409ab5904e8874: No bootstrap required, opened a new log
I20260709 13:10:04.728158 26284 ts_tablet_manager.cc:1403] T 77a972c0637f4187940b52b2db39422e P a5b5819a169142229b409ab5904e8874: Time spent bootstrapping tablet: real 0.034s	user 0.006s	sys 0.014s
I20260709 13:10:04.730183 26285 ts_tablet_manager.cc:1434] T 77a972c0637f4187940b52b2db39422e P 90d2fdd4326c4dcb99ca1b5e506fcb98: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 13:10:04.730621 26284 raft_consensus.cc:359] T 77a972c0637f4187940b52b2db39422e P a5b5819a169142229b409ab5904e8874 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90d2fdd4326c4dcb99ca1b5e506fcb98" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 37999 } } peers { permanent_uuid: "1e0c787fa6274132b4528b39cfd79fad" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 40179 } } peers { permanent_uuid: "a5b5819a169142229b409ab5904e8874" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 41537 } }
I20260709 13:10:04.731317 26284 raft_consensus.cc:385] T 77a972c0637f4187940b52b2db39422e P a5b5819a169142229b409ab5904e8874 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:04.731406 26285 tablet_bootstrap.cc:492] T 8765f34b0faf4362bc3e85bb02a8d0f5 P 90d2fdd4326c4dcb99ca1b5e506fcb98: Bootstrap starting.
I20260709 13:10:04.731616 26284 raft_consensus.cc:740] T 77a972c0637f4187940b52b2db39422e P a5b5819a169142229b409ab5904e8874 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5b5819a169142229b409ab5904e8874, State: Initialized, Role: FOLLOWER
I20260709 13:10:04.732509 26284 consensus_queue.cc:260] T 77a972c0637f4187940b52b2db39422e P a5b5819a169142229b409ab5904e8874 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90d2fdd4326c4dcb99ca1b5e506fcb98" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 37999 } } peers { permanent_uuid: "1e0c787fa6274132b4528b39cfd79fad" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 40179 } } peers { permanent_uuid: "a5b5819a169142229b409ab5904e8874" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 41537 } }
I20260709 13:10:04.734596 26284 ts_tablet_manager.cc:1434] T 77a972c0637f4187940b52b2db39422e P a5b5819a169142229b409ab5904e8874: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.000s
I20260709 13:10:04.735690 26284 tablet_bootstrap.cc:492] T 8765f34b0faf4362bc3e85bb02a8d0f5 P a5b5819a169142229b409ab5904e8874: Bootstrap starting.
I20260709 13:10:04.740643 26283 tablet_bootstrap.cc:492] T 77a972c0637f4187940b52b2db39422e P 1e0c787fa6274132b4528b39cfd79fad: No bootstrap required, opened a new log
I20260709 13:10:04.741230 26285 tablet_bootstrap.cc:654] T 8765f34b0faf4362bc3e85bb02a8d0f5 P 90d2fdd4326c4dcb99ca1b5e506fcb98: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:04.741243 26283 ts_tablet_manager.cc:1403] T 77a972c0637f4187940b52b2db39422e P 1e0c787fa6274132b4528b39cfd79fad: Time spent bootstrapping tablet: real 0.027s	user 0.011s	sys 0.000s
I20260709 13:10:04.745292 26283 raft_consensus.cc:359] T 77a972c0637f4187940b52b2db39422e P 1e0c787fa6274132b4528b39cfd79fad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90d2fdd4326c4dcb99ca1b5e506fcb98" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 37999 } } peers { permanent_uuid: "1e0c787fa6274132b4528b39cfd79fad" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 40179 } } peers { permanent_uuid: "a5b5819a169142229b409ab5904e8874" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 41537 } }
I20260709 13:10:04.746073 26284 tablet_bootstrap.cc:654] T 8765f34b0faf4362bc3e85bb02a8d0f5 P a5b5819a169142229b409ab5904e8874: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:04.746249 26283 raft_consensus.cc:385] T 77a972c0637f4187940b52b2db39422e P 1e0c787fa6274132b4528b39cfd79fad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:04.746711 26283 raft_consensus.cc:740] T 77a972c0637f4187940b52b2db39422e P 1e0c787fa6274132b4528b39cfd79fad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e0c787fa6274132b4528b39cfd79fad, State: Initialized, Role: FOLLOWER
I20260709 13:10:04.747617 26283 consensus_queue.cc:260] T 77a972c0637f4187940b52b2db39422e P 1e0c787fa6274132b4528b39cfd79fad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90d2fdd4326c4dcb99ca1b5e506fcb98" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 37999 } } peers { permanent_uuid: "1e0c787fa6274132b4528b39cfd79fad" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 40179 } } peers { permanent_uuid: "a5b5819a169142229b409ab5904e8874" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 41537 } }
I20260709 13:10:04.750355 26283 ts_tablet_manager.cc:1434] T 77a972c0637f4187940b52b2db39422e P 1e0c787fa6274132b4528b39cfd79fad: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:10:04.757508 26283 tablet_bootstrap.cc:492] T 8765f34b0faf4362bc3e85bb02a8d0f5 P 1e0c787fa6274132b4528b39cfd79fad: Bootstrap starting.
I20260709 13:10:04.757761 26284 tablet_bootstrap.cc:492] T 8765f34b0faf4362bc3e85bb02a8d0f5 P a5b5819a169142229b409ab5904e8874: No bootstrap required, opened a new log
I20260709 13:10:04.758411 26284 ts_tablet_manager.cc:1403] T 8765f34b0faf4362bc3e85bb02a8d0f5 P a5b5819a169142229b409ab5904e8874: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.002s
I20260709 13:10:04.759258 26285 tablet_bootstrap.cc:492] T 8765f34b0faf4362bc3e85bb02a8d0f5 P 90d2fdd4326c4dcb99ca1b5e506fcb98: No bootstrap required, opened a new log
I20260709 13:10:04.759848 26285 ts_tablet_manager.cc:1403] T 8765f34b0faf4362bc3e85bb02a8d0f5 P 90d2fdd4326c4dcb99ca1b5e506fcb98: Time spent bootstrapping tablet: real 0.029s	user 0.016s	sys 0.002s
I20260709 13:10:04.762003 26284 raft_consensus.cc:359] T 8765f34b0faf4362bc3e85bb02a8d0f5 P a5b5819a169142229b409ab5904e8874 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90d2fdd4326c4dcb99ca1b5e506fcb98" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 37999 } } peers { permanent_uuid: "1e0c787fa6274132b4528b39cfd79fad" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 40179 } } peers { permanent_uuid: "a5b5819a169142229b409ab5904e8874" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 41537 } }
I20260709 13:10:04.763121 26284 raft_consensus.cc:385] T 8765f34b0faf4362bc3e85bb02a8d0f5 P a5b5819a169142229b409ab5904e8874 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:04.763500 26284 raft_consensus.cc:740] T 8765f34b0faf4362bc3e85bb02a8d0f5 P a5b5819a169142229b409ab5904e8874 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5b5819a169142229b409ab5904e8874, State: Initialized, Role: FOLLOWER
I20260709 13:10:04.763491 26285 raft_consensus.cc:359] T 8765f34b0faf4362bc3e85bb02a8d0f5 P 90d2fdd4326c4dcb99ca1b5e506fcb98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90d2fdd4326c4dcb99ca1b5e506fcb98" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 37999 } } peers { permanent_uuid: "1e0c787fa6274132b4528b39cfd79fad" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 40179 } } peers { permanent_uuid: "a5b5819a169142229b409ab5904e8874" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 41537 } }
I20260709 13:10:04.764451 26285 raft_consensus.cc:385] T 8765f34b0faf4362bc3e85bb02a8d0f5 P 90d2fdd4326c4dcb99ca1b5e506fcb98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:04.764776 26285 raft_consensus.cc:740] T 8765f34b0faf4362bc3e85bb02a8d0f5 P 90d2fdd4326c4dcb99ca1b5e506fcb98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90d2fdd4326c4dcb99ca1b5e506fcb98, State: Initialized, Role: FOLLOWER
I20260709 13:10:04.764988 26284 consensus_queue.cc:260] T 8765f34b0faf4362bc3e85bb02a8d0f5 P a5b5819a169142229b409ab5904e8874 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90d2fdd4326c4dcb99ca1b5e506fcb98" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 37999 } } peers { permanent_uuid: "1e0c787fa6274132b4528b39cfd79fad" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 40179 } } peers { permanent_uuid: "a5b5819a169142229b409ab5904e8874" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 41537 } }
I20260709 13:10:04.765654 26285 consensus_queue.cc:260] T 8765f34b0faf4362bc3e85bb02a8d0f5 P 90d2fdd4326c4dcb99ca1b5e506fcb98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90d2fdd4326c4dcb99ca1b5e506fcb98" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 37999 } } peers { permanent_uuid: "1e0c787fa6274132b4528b39cfd79fad" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 40179 } } peers { permanent_uuid: "a5b5819a169142229b409ab5904e8874" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 41537 } }
I20260709 13:10:04.767809 26283 tablet_bootstrap.cc:654] T 8765f34b0faf4362bc3e85bb02a8d0f5 P 1e0c787fa6274132b4528b39cfd79fad: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:04.770277 26285 ts_tablet_manager.cc:1434] T 8765f34b0faf4362bc3e85bb02a8d0f5 P 90d2fdd4326c4dcb99ca1b5e506fcb98: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.002s
I20260709 13:10:04.773084 26284 ts_tablet_manager.cc:1434] T 8765f34b0faf4362bc3e85bb02a8d0f5 P a5b5819a169142229b409ab5904e8874: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.001s
I20260709 13:10:04.774060 26283 tablet_bootstrap.cc:492] T 8765f34b0faf4362bc3e85bb02a8d0f5 P 1e0c787fa6274132b4528b39cfd79fad: No bootstrap required, opened a new log
I20260709 13:10:04.774634 26283 ts_tablet_manager.cc:1403] T 8765f34b0faf4362bc3e85bb02a8d0f5 P 1e0c787fa6274132b4528b39cfd79fad: Time spent bootstrapping tablet: real 0.017s	user 0.008s	sys 0.007s
I20260709 13:10:04.777575 26283 raft_consensus.cc:359] T 8765f34b0faf4362bc3e85bb02a8d0f5 P 1e0c787fa6274132b4528b39cfd79fad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90d2fdd4326c4dcb99ca1b5e506fcb98" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 37999 } } peers { permanent_uuid: "1e0c787fa6274132b4528b39cfd79fad" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 40179 } } peers { permanent_uuid: "a5b5819a169142229b409ab5904e8874" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 41537 } }
I20260709 13:10:04.778267 26283 raft_consensus.cc:385] T 8765f34b0faf4362bc3e85bb02a8d0f5 P 1e0c787fa6274132b4528b39cfd79fad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:04.778538 26283 raft_consensus.cc:740] T 8765f34b0faf4362bc3e85bb02a8d0f5 P 1e0c787fa6274132b4528b39cfd79fad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e0c787fa6274132b4528b39cfd79fad, State: Initialized, Role: FOLLOWER
I20260709 13:10:04.779318 26283 consensus_queue.cc:260] T 8765f34b0faf4362bc3e85bb02a8d0f5 P 1e0c787fa6274132b4528b39cfd79fad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90d2fdd4326c4dcb99ca1b5e506fcb98" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 37999 } } peers { permanent_uuid: "1e0c787fa6274132b4528b39cfd79fad" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 40179 } } peers { permanent_uuid: "a5b5819a169142229b409ab5904e8874" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 41537 } }
I20260709 13:10:04.781674 26283 ts_tablet_manager.cc:1434] T 8765f34b0faf4362bc3e85bb02a8d0f5 P 1e0c787fa6274132b4528b39cfd79fad: Time spent starting tablet: real 0.007s	user 0.000s	sys 0.004s
I20260709 13:10:04.855033 26290 raft_consensus.cc:493] T 8765f34b0faf4362bc3e85bb02a8d0f5 P 90d2fdd4326c4dcb99ca1b5e506fcb98 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:04.855729 26290 raft_consensus.cc:515] T 8765f34b0faf4362bc3e85bb02a8d0f5 P 90d2fdd4326c4dcb99ca1b5e506fcb98 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90d2fdd4326c4dcb99ca1b5e506fcb98" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 37999 } } peers { permanent_uuid: "1e0c787fa6274132b4528b39cfd79fad" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 40179 } } peers { permanent_uuid: "a5b5819a169142229b409ab5904e8874" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 41537 } }
I20260709 13:10:04.857503 26290 leader_election.cc:290] T 8765f34b0faf4362bc3e85bb02a8d0f5 P 90d2fdd4326c4dcb99ca1b5e506fcb98 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e0c787fa6274132b4528b39cfd79fad (127.14.180.66:40179), a5b5819a169142229b409ab5904e8874 (127.14.180.67:41537)
I20260709 13:10:04.858621 26169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8765f34b0faf4362bc3e85bb02a8d0f5" candidate_uuid: "90d2fdd4326c4dcb99ca1b5e506fcb98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e0c787fa6274132b4528b39cfd79fad" is_pre_election: true
I20260709 13:10:04.858954 26242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8765f34b0faf4362bc3e85bb02a8d0f5" candidate_uuid: "90d2fdd4326c4dcb99ca1b5e506fcb98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5b5819a169142229b409ab5904e8874" is_pre_election: true
I20260709 13:10:04.859318 26169 raft_consensus.cc:2468] T 8765f34b0faf4362bc3e85bb02a8d0f5 P 1e0c787fa6274132b4528b39cfd79fad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 90d2fdd4326c4dcb99ca1b5e506fcb98 in term 0.
I20260709 13:10:04.859628 26242 raft_consensus.cc:2468] T 8765f34b0faf4362bc3e85bb02a8d0f5 P a5b5819a169142229b409ab5904e8874 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 90d2fdd4326c4dcb99ca1b5e506fcb98 in term 0.
I20260709 13:10:04.860376 26057 leader_election.cc:304] T 8765f34b0faf4362bc3e85bb02a8d0f5 P 90d2fdd4326c4dcb99ca1b5e506fcb98 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e0c787fa6274132b4528b39cfd79fad, 90d2fdd4326c4dcb99ca1b5e506fcb98; no voters: 
I20260709 13:10:04.861263 26290 raft_consensus.cc:2804] T 8765f34b0faf4362bc3e85bb02a8d0f5 P 90d2fdd4326c4dcb99ca1b5e506fcb98 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:04.861641 26290 raft_consensus.cc:493] T 8765f34b0faf4362bc3e85bb02a8d0f5 P 90d2fdd4326c4dcb99ca1b5e506fcb98 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:04.862011 26290 raft_consensus.cc:3060] T 8765f34b0faf4362bc3e85bb02a8d0f5 P 90d2fdd4326c4dcb99ca1b5e506fcb98 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:04.867741 26290 raft_consensus.cc:515] T 8765f34b0faf4362bc3e85bb02a8d0f5 P 90d2fdd4326c4dcb99ca1b5e506fcb98 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90d2fdd4326c4dcb99ca1b5e506fcb98" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 37999 } } peers { permanent_uuid: "1e0c787fa6274132b4528b39cfd79fad" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 40179 } } peers { permanent_uuid: "a5b5819a169142229b409ab5904e8874" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 41537 } }
I20260709 13:10:04.869549 26290 leader_election.cc:290] T 8765f34b0faf4362bc3e85bb02a8d0f5 P 90d2fdd4326c4dcb99ca1b5e506fcb98 [CANDIDATE]: Term 1 election: Requested vote from peers 1e0c787fa6274132b4528b39cfd79fad (127.14.180.66:40179), a5b5819a169142229b409ab5904e8874 (127.14.180.67:41537)
I20260709 13:10:04.870782 26242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8765f34b0faf4362bc3e85bb02a8d0f5" candidate_uuid: "90d2fdd4326c4dcb99ca1b5e506fcb98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5b5819a169142229b409ab5904e8874"
I20260709 13:10:04.870627 26169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8765f34b0faf4362bc3e85bb02a8d0f5" candidate_uuid: "90d2fdd4326c4dcb99ca1b5e506fcb98" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e0c787fa6274132b4528b39cfd79fad"
I20260709 13:10:04.871533 26242 raft_consensus.cc:3060] T 8765f34b0faf4362bc3e85bb02a8d0f5 P a5b5819a169142229b409ab5904e8874 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:04.871623 26169 raft_consensus.cc:3060] T 8765f34b0faf4362bc3e85bb02a8d0f5 P 1e0c787fa6274132b4528b39cfd79fad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:04.876314 26288 raft_consensus.cc:493] T 77a972c0637f4187940b52b2db39422e P a5b5819a169142229b409ab5904e8874 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:04.877023 26288 raft_consensus.cc:515] T 77a972c0637f4187940b52b2db39422e P a5b5819a169142229b409ab5904e8874 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90d2fdd4326c4dcb99ca1b5e506fcb98" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 37999 } } peers { permanent_uuid: "1e0c787fa6274132b4528b39cfd79fad" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 40179 } } peers { permanent_uuid: "a5b5819a169142229b409ab5904e8874" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 41537 } }
I20260709 13:10:04.877981 26169 raft_consensus.cc:2468] T 8765f34b0faf4362bc3e85bb02a8d0f5 P 1e0c787fa6274132b4528b39cfd79fad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90d2fdd4326c4dcb99ca1b5e506fcb98 in term 1.
I20260709 13:10:04.878067 26242 raft_consensus.cc:2468] T 8765f34b0faf4362bc3e85bb02a8d0f5 P a5b5819a169142229b409ab5904e8874 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90d2fdd4326c4dcb99ca1b5e506fcb98 in term 1.
I20260709 13:10:04.879352 26057 leader_election.cc:304] T 8765f34b0faf4362bc3e85bb02a8d0f5 P 90d2fdd4326c4dcb99ca1b5e506fcb98 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e0c787fa6274132b4528b39cfd79fad, 90d2fdd4326c4dcb99ca1b5e506fcb98; no voters: 
I20260709 13:10:04.879959 26288 leader_election.cc:290] T 77a972c0637f4187940b52b2db39422e P a5b5819a169142229b409ab5904e8874 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 90d2fdd4326c4dcb99ca1b5e506fcb98 (127.14.180.65:37999), 1e0c787fa6274132b4528b39cfd79fad (127.14.180.66:40179)
I20260709 13:10:04.880700 26290 raft_consensus.cc:2804] T 8765f34b0faf4362bc3e85bb02a8d0f5 P 90d2fdd4326c4dcb99ca1b5e506fcb98 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:04.881354 26290 raft_consensus.cc:697] T 8765f34b0faf4362bc3e85bb02a8d0f5 P 90d2fdd4326c4dcb99ca1b5e506fcb98 [term 1 LEADER]: Becoming Leader. State: Replica: 90d2fdd4326c4dcb99ca1b5e506fcb98, State: Running, Role: LEADER
I20260709 13:10:04.882315 26290 consensus_queue.cc:237] T 8765f34b0faf4362bc3e85bb02a8d0f5 P 90d2fdd4326c4dcb99ca1b5e506fcb98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90d2fdd4326c4dcb99ca1b5e506fcb98" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 37999 } } peers { permanent_uuid: "1e0c787fa6274132b4528b39cfd79fad" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 40179 } } peers { permanent_uuid: "a5b5819a169142229b409ab5904e8874" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 41537 } }
W20260709 13:10:04.887154 26040 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:04.893371 26094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a972c0637f4187940b52b2db39422e" candidate_uuid: "a5b5819a169142229b409ab5904e8874" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90d2fdd4326c4dcb99ca1b5e506fcb98" is_pre_election: true
I20260709 13:10:04.894304 26094 raft_consensus.cc:2468] T 77a972c0637f4187940b52b2db39422e P 90d2fdd4326c4dcb99ca1b5e506fcb98 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a5b5819a169142229b409ab5904e8874 in term 0.
I20260709 13:10:04.894373 25990 catalog_manager.cc:5697] T 8765f34b0faf4362bc3e85bb02a8d0f5 P 90d2fdd4326c4dcb99ca1b5e506fcb98 reported cstate change: term changed from 0 to 1, leader changed from <none> to 90d2fdd4326c4dcb99ca1b5e506fcb98 (127.14.180.65). New cstate: current_term: 1 leader_uuid: "90d2fdd4326c4dcb99ca1b5e506fcb98" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90d2fdd4326c4dcb99ca1b5e506fcb98" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 37999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e0c787fa6274132b4528b39cfd79fad" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a5b5819a169142229b409ab5904e8874" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 41537 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:04.895967 26169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a972c0637f4187940b52b2db39422e" candidate_uuid: "a5b5819a169142229b409ab5904e8874" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e0c787fa6274132b4528b39cfd79fad" is_pre_election: true
I20260709 13:10:04.895923 26206 leader_election.cc:304] T 77a972c0637f4187940b52b2db39422e P a5b5819a169142229b409ab5904e8874 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 90d2fdd4326c4dcb99ca1b5e506fcb98, a5b5819a169142229b409ab5904e8874; no voters: 
I20260709 13:10:04.896785 26169 raft_consensus.cc:2468] T 77a972c0637f4187940b52b2db39422e P 1e0c787fa6274132b4528b39cfd79fad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a5b5819a169142229b409ab5904e8874 in term 0.
I20260709 13:10:04.897038 26288 raft_consensus.cc:2804] T 77a972c0637f4187940b52b2db39422e P a5b5819a169142229b409ab5904e8874 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:04.897518 26288 raft_consensus.cc:493] T 77a972c0637f4187940b52b2db39422e P a5b5819a169142229b409ab5904e8874 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:04.897857 26288 raft_consensus.cc:3060] T 77a972c0637f4187940b52b2db39422e P a5b5819a169142229b409ab5904e8874 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:04.905375 26288 raft_consensus.cc:515] T 77a972c0637f4187940b52b2db39422e P a5b5819a169142229b409ab5904e8874 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90d2fdd4326c4dcb99ca1b5e506fcb98" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 37999 } } peers { permanent_uuid: "1e0c787fa6274132b4528b39cfd79fad" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 40179 } } peers { permanent_uuid: "a5b5819a169142229b409ab5904e8874" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 41537 } }
I20260709 13:10:04.907199 26288 leader_election.cc:290] T 77a972c0637f4187940b52b2db39422e P a5b5819a169142229b409ab5904e8874 [CANDIDATE]: Term 1 election: Requested vote from peers 90d2fdd4326c4dcb99ca1b5e506fcb98 (127.14.180.65:37999), 1e0c787fa6274132b4528b39cfd79fad (127.14.180.66:40179)
I20260709 13:10:04.908025 26094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a972c0637f4187940b52b2db39422e" candidate_uuid: "a5b5819a169142229b409ab5904e8874" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90d2fdd4326c4dcb99ca1b5e506fcb98"
I20260709 13:10:04.908263 26169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a972c0637f4187940b52b2db39422e" candidate_uuid: "a5b5819a169142229b409ab5904e8874" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e0c787fa6274132b4528b39cfd79fad"
I20260709 13:10:04.908675 26094 raft_consensus.cc:3060] T 77a972c0637f4187940b52b2db39422e P 90d2fdd4326c4dcb99ca1b5e506fcb98 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:04.908862 26169 raft_consensus.cc:3060] T 77a972c0637f4187940b52b2db39422e P 1e0c787fa6274132b4528b39cfd79fad [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:04.914387 26169 raft_consensus.cc:2468] T 77a972c0637f4187940b52b2db39422e P 1e0c787fa6274132b4528b39cfd79fad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a5b5819a169142229b409ab5904e8874 in term 1.
I20260709 13:10:04.914392 26094 raft_consensus.cc:2468] T 77a972c0637f4187940b52b2db39422e P 90d2fdd4326c4dcb99ca1b5e506fcb98 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a5b5819a169142229b409ab5904e8874 in term 1.
I20260709 13:10:04.915727 26206 leader_election.cc:304] T 77a972c0637f4187940b52b2db39422e P a5b5819a169142229b409ab5904e8874 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e0c787fa6274132b4528b39cfd79fad, a5b5819a169142229b409ab5904e8874; no voters: 
I20260709 13:10:04.916476 26288 raft_consensus.cc:2804] T 77a972c0637f4187940b52b2db39422e P a5b5819a169142229b409ab5904e8874 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:04.917553 26288 raft_consensus.cc:697] T 77a972c0637f4187940b52b2db39422e P a5b5819a169142229b409ab5904e8874 [term 1 LEADER]: Becoming Leader. State: Replica: a5b5819a169142229b409ab5904e8874, State: Running, Role: LEADER
I20260709 13:10:04.918599 26288 consensus_queue.cc:237] T 77a972c0637f4187940b52b2db39422e P a5b5819a169142229b409ab5904e8874 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90d2fdd4326c4dcb99ca1b5e506fcb98" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 37999 } } peers { permanent_uuid: "1e0c787fa6274132b4528b39cfd79fad" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 40179 } } peers { permanent_uuid: "a5b5819a169142229b409ab5904e8874" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 41537 } }
I20260709 13:10:04.925789 25990 catalog_manager.cc:5697] T 77a972c0637f4187940b52b2db39422e P a5b5819a169142229b409ab5904e8874 reported cstate change: term changed from 0 to 1, leader changed from <none> to a5b5819a169142229b409ab5904e8874 (127.14.180.67). New cstate: current_term: 1 leader_uuid: "a5b5819a169142229b409ab5904e8874" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90d2fdd4326c4dcb99ca1b5e506fcb98" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 37999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e0c787fa6274132b4528b39cfd79fad" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a5b5819a169142229b409ab5904e8874" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 41537 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:04.975363 26242 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "77a972c0637f4187940b52b2db39422e"
dest_uuid: "a5b5819a169142229b409ab5904e8874"
mode: GRACEFUL
new_leader_uuid: "90d2fdd4326c4dcb99ca1b5e506fcb98"
 from {username='slave'} at 127.0.0.1:51802
I20260709 13:10:04.976115 26242 raft_consensus.cc:606] T 77a972c0637f4187940b52b2db39422e P a5b5819a169142229b409ab5904e8874 [term 1 LEADER]: Received request to transfer leadership to TS 90d2fdd4326c4dcb99ca1b5e506fcb98
I20260709 13:10:05.008841 26290 consensus_queue.cc:1048] T d293029df37c420c81c461c276a12e4e P 90d2fdd4326c4dcb99ca1b5e506fcb98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5b5819a169142229b409ab5904e8874" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 41537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:05.010080 26292 consensus_queue.cc:1048] T c631ee2f115b47acbaf22b3ce3ca0f4b P 1e0c787fa6274132b4528b39cfd79fad [LEADER]: Connected to new peer: Peer: permanent_uuid: "90d2fdd4326c4dcb99ca1b5e506fcb98" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 37999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:05.035380 26290 consensus_queue.cc:1048] T d293029df37c420c81c461c276a12e4e P 90d2fdd4326c4dcb99ca1b5e506fcb98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e0c787fa6274132b4528b39cfd79fad" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 40179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:05.037415 26292 consensus_queue.cc:1048] T c631ee2f115b47acbaf22b3ce3ca0f4b P 1e0c787fa6274132b4528b39cfd79fad [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5b5819a169142229b409ab5904e8874" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 41537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:05.352885 26288 consensus_queue.cc:1048] T 77a972c0637f4187940b52b2db39422e P a5b5819a169142229b409ab5904e8874 [LEADER]: Connected to new peer: Peer: permanent_uuid: "90d2fdd4326c4dcb99ca1b5e506fcb98" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 37999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:05.359998 26288 raft_consensus.cc:993] T 77a972c0637f4187940b52b2db39422e P a5b5819a169142229b409ab5904e8874: : Instructing follower 90d2fdd4326c4dcb99ca1b5e506fcb98 to start an election
I20260709 13:10:05.360837 26315 raft_consensus.cc:1081] T 77a972c0637f4187940b52b2db39422e P a5b5819a169142229b409ab5904e8874 [term 1 LEADER]: Signalling peer 90d2fdd4326c4dcb99ca1b5e506fcb98 to start an election
I20260709 13:10:05.363897 26327 consensus_queue.cc:1048] T 77a972c0637f4187940b52b2db39422e P a5b5819a169142229b409ab5904e8874 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e0c787fa6274132b4528b39cfd79fad" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 40179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:05.364166 26093 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "77a972c0637f4187940b52b2db39422e"
dest_uuid: "90d2fdd4326c4dcb99ca1b5e506fcb98"
 from {username='slave'} at 127.0.0.1:34838
I20260709 13:10:05.364979 26093 raft_consensus.cc:493] T 77a972c0637f4187940b52b2db39422e P 90d2fdd4326c4dcb99ca1b5e506fcb98 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:05.365397 26093 raft_consensus.cc:3060] T 77a972c0637f4187940b52b2db39422e P 90d2fdd4326c4dcb99ca1b5e506fcb98 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:05.374745 26093 raft_consensus.cc:515] T 77a972c0637f4187940b52b2db39422e P 90d2fdd4326c4dcb99ca1b5e506fcb98 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90d2fdd4326c4dcb99ca1b5e506fcb98" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 37999 } } peers { permanent_uuid: "1e0c787fa6274132b4528b39cfd79fad" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 40179 } } peers { permanent_uuid: "a5b5819a169142229b409ab5904e8874" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 41537 } }
I20260709 13:10:05.377007 26093 leader_election.cc:290] T 77a972c0637f4187940b52b2db39422e P 90d2fdd4326c4dcb99ca1b5e506fcb98 [CANDIDATE]: Term 2 election: Requested vote from peers 1e0c787fa6274132b4528b39cfd79fad (127.14.180.66:40179), a5b5819a169142229b409ab5904e8874 (127.14.180.67:41537)
I20260709 13:10:05.378777 26242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a972c0637f4187940b52b2db39422e" candidate_uuid: "90d2fdd4326c4dcb99ca1b5e506fcb98" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a5b5819a169142229b409ab5904e8874"
I20260709 13:10:05.378850 26169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a972c0637f4187940b52b2db39422e" candidate_uuid: "90d2fdd4326c4dcb99ca1b5e506fcb98" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1e0c787fa6274132b4528b39cfd79fad"
I20260709 13:10:05.379551 26242 raft_consensus.cc:3055] T 77a972c0637f4187940b52b2db39422e P a5b5819a169142229b409ab5904e8874 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:05.379801 26169 raft_consensus.cc:3060] T 77a972c0637f4187940b52b2db39422e P 1e0c787fa6274132b4528b39cfd79fad [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:05.379973 26242 raft_consensus.cc:740] T 77a972c0637f4187940b52b2db39422e P a5b5819a169142229b409ab5904e8874 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a5b5819a169142229b409ab5904e8874, State: Running, Role: LEADER
I20260709 13:10:05.380927 26242 consensus_queue.cc:260] T 77a972c0637f4187940b52b2db39422e P a5b5819a169142229b409ab5904e8874 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90d2fdd4326c4dcb99ca1b5e506fcb98" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 37999 } } peers { permanent_uuid: "1e0c787fa6274132b4528b39cfd79fad" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 40179 } } peers { permanent_uuid: "a5b5819a169142229b409ab5904e8874" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 41537 } }
I20260709 13:10:05.382375 26242 raft_consensus.cc:3060] T 77a972c0637f4187940b52b2db39422e P a5b5819a169142229b409ab5904e8874 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:05.386947 26290 consensus_queue.cc:1048] T 8765f34b0faf4362bc3e85bb02a8d0f5 P 90d2fdd4326c4dcb99ca1b5e506fcb98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e0c787fa6274132b4528b39cfd79fad" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 40179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:05.389144 26169 raft_consensus.cc:2468] T 77a972c0637f4187940b52b2db39422e P 1e0c787fa6274132b4528b39cfd79fad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90d2fdd4326c4dcb99ca1b5e506fcb98 in term 2.
I20260709 13:10:05.391636 26242 raft_consensus.cc:2468] T 77a972c0637f4187940b52b2db39422e P a5b5819a169142229b409ab5904e8874 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90d2fdd4326c4dcb99ca1b5e506fcb98 in term 2.
I20260709 13:10:05.391717 26057 leader_election.cc:304] T 77a972c0637f4187940b52b2db39422e P 90d2fdd4326c4dcb99ca1b5e506fcb98 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e0c787fa6274132b4528b39cfd79fad, 90d2fdd4326c4dcb99ca1b5e506fcb98; no voters: 
I20260709 13:10:05.393826 26290 raft_consensus.cc:2804] T 77a972c0637f4187940b52b2db39422e P 90d2fdd4326c4dcb99ca1b5e506fcb98 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:05.397440 26290 raft_consensus.cc:697] T 77a972c0637f4187940b52b2db39422e P 90d2fdd4326c4dcb99ca1b5e506fcb98 [term 2 LEADER]: Becoming Leader. State: Replica: 90d2fdd4326c4dcb99ca1b5e506fcb98, State: Running, Role: LEADER
I20260709 13:10:05.398414 26290 consensus_queue.cc:237] T 77a972c0637f4187940b52b2db39422e P 90d2fdd4326c4dcb99ca1b5e506fcb98 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90d2fdd4326c4dcb99ca1b5e506fcb98" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 37999 } } peers { permanent_uuid: "1e0c787fa6274132b4528b39cfd79fad" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 40179 } } peers { permanent_uuid: "a5b5819a169142229b409ab5904e8874" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 41537 } }
I20260709 13:10:05.405634 26331 consensus_queue.cc:1048] T 8765f34b0faf4362bc3e85bb02a8d0f5 P 90d2fdd4326c4dcb99ca1b5e506fcb98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5b5819a169142229b409ab5904e8874" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 41537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:05.410808 25992 catalog_manager.cc:5697] T 77a972c0637f4187940b52b2db39422e P 90d2fdd4326c4dcb99ca1b5e506fcb98 reported cstate change: term changed from 1 to 2, leader changed from a5b5819a169142229b409ab5904e8874 (127.14.180.67) to 90d2fdd4326c4dcb99ca1b5e506fcb98 (127.14.180.65). New cstate: current_term: 2 leader_uuid: "90d2fdd4326c4dcb99ca1b5e506fcb98" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90d2fdd4326c4dcb99ca1b5e506fcb98" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 37999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e0c787fa6274132b4528b39cfd79fad" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a5b5819a169142229b409ab5904e8874" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 41537 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:05.465480 15057 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 13:10:05.467943 15057 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 13:10:05.468804 15057 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 13:10:05.485756 26093 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "77a972c0637f4187940b52b2db39422e"
dest_uuid: "90d2fdd4326c4dcb99ca1b5e506fcb98"
mode: GRACEFUL
new_leader_uuid: "a5b5819a169142229b409ab5904e8874"
 from {username='slave'} at 127.0.0.1:34850
I20260709 13:10:05.486922 26093 raft_consensus.cc:606] T 77a972c0637f4187940b52b2db39422e P 90d2fdd4326c4dcb99ca1b5e506fcb98 [term 2 LEADER]: Received request to transfer leadership to TS a5b5819a169142229b409ab5904e8874
I20260709 13:10:05.488695 15057 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 13:10:05.792985 26169 raft_consensus.cc:1275] T 77a972c0637f4187940b52b2db39422e P 1e0c787fa6274132b4528b39cfd79fad [term 2 FOLLOWER]: Refusing update from remote peer 90d2fdd4326c4dcb99ca1b5e506fcb98: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:05.794471 26330 consensus_queue.cc:1048] T 77a972c0637f4187940b52b2db39422e P 90d2fdd4326c4dcb99ca1b5e506fcb98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e0c787fa6274132b4528b39cfd79fad" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 40179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:05.803601 26242 raft_consensus.cc:1275] T 77a972c0637f4187940b52b2db39422e P a5b5819a169142229b409ab5904e8874 [term 2 FOLLOWER]: Refusing update from remote peer 90d2fdd4326c4dcb99ca1b5e506fcb98: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:05.805297 26331 consensus_queue.cc:1048] T 77a972c0637f4187940b52b2db39422e P 90d2fdd4326c4dcb99ca1b5e506fcb98 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5b5819a169142229b409ab5904e8874" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 41537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:05.811741 26330 raft_consensus.cc:993] T 77a972c0637f4187940b52b2db39422e P 90d2fdd4326c4dcb99ca1b5e506fcb98: : Instructing follower a5b5819a169142229b409ab5904e8874 to start an election
I20260709 13:10:05.812222 26331 raft_consensus.cc:1081] T 77a972c0637f4187940b52b2db39422e P 90d2fdd4326c4dcb99ca1b5e506fcb98 [term 2 LEADER]: Signalling peer a5b5819a169142229b409ab5904e8874 to start an election
I20260709 13:10:05.813735 26242 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "77a972c0637f4187940b52b2db39422e"
dest_uuid: "a5b5819a169142229b409ab5904e8874"
 from {username='slave'} at 127.0.0.1:51784
I20260709 13:10:05.814244 26242 raft_consensus.cc:493] T 77a972c0637f4187940b52b2db39422e P a5b5819a169142229b409ab5904e8874 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:05.814549 26242 raft_consensus.cc:3060] T 77a972c0637f4187940b52b2db39422e P a5b5819a169142229b409ab5904e8874 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:05.819921 26242 raft_consensus.cc:515] T 77a972c0637f4187940b52b2db39422e P a5b5819a169142229b409ab5904e8874 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90d2fdd4326c4dcb99ca1b5e506fcb98" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 37999 } } peers { permanent_uuid: "1e0c787fa6274132b4528b39cfd79fad" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 40179 } } peers { permanent_uuid: "a5b5819a169142229b409ab5904e8874" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 41537 } }
I20260709 13:10:05.821632 26242 leader_election.cc:290] T 77a972c0637f4187940b52b2db39422e P a5b5819a169142229b409ab5904e8874 [CANDIDATE]: Term 3 election: Requested vote from peers 90d2fdd4326c4dcb99ca1b5e506fcb98 (127.14.180.65:37999), 1e0c787fa6274132b4528b39cfd79fad (127.14.180.66:40179)
I20260709 13:10:05.822659 26093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a972c0637f4187940b52b2db39422e" candidate_uuid: "a5b5819a169142229b409ab5904e8874" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "90d2fdd4326c4dcb99ca1b5e506fcb98"
I20260709 13:10:05.823058 26169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a972c0637f4187940b52b2db39422e" candidate_uuid: "a5b5819a169142229b409ab5904e8874" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1e0c787fa6274132b4528b39cfd79fad"
I20260709 13:10:05.823364 26093 raft_consensus.cc:3055] T 77a972c0637f4187940b52b2db39422e P 90d2fdd4326c4dcb99ca1b5e506fcb98 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:05.823721 26169 raft_consensus.cc:3060] T 77a972c0637f4187940b52b2db39422e P 1e0c787fa6274132b4528b39cfd79fad [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:05.823781 26093 raft_consensus.cc:740] T 77a972c0637f4187940b52b2db39422e P 90d2fdd4326c4dcb99ca1b5e506fcb98 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 90d2fdd4326c4dcb99ca1b5e506fcb98, State: Running, Role: LEADER
I20260709 13:10:05.824687 26093 consensus_queue.cc:260] T 77a972c0637f4187940b52b2db39422e P 90d2fdd4326c4dcb99ca1b5e506fcb98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90d2fdd4326c4dcb99ca1b5e506fcb98" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 37999 } } peers { permanent_uuid: "1e0c787fa6274132b4528b39cfd79fad" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 40179 } } peers { permanent_uuid: "a5b5819a169142229b409ab5904e8874" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 41537 } }
I20260709 13:10:05.825719 26093 raft_consensus.cc:3060] T 77a972c0637f4187940b52b2db39422e P 90d2fdd4326c4dcb99ca1b5e506fcb98 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:05.830703 26169 raft_consensus.cc:2468] T 77a972c0637f4187940b52b2db39422e P 1e0c787fa6274132b4528b39cfd79fad [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a5b5819a169142229b409ab5904e8874 in term 3.
I20260709 13:10:05.832113 26206 leader_election.cc:304] T 77a972c0637f4187940b52b2db39422e P a5b5819a169142229b409ab5904e8874 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e0c787fa6274132b4528b39cfd79fad, a5b5819a169142229b409ab5904e8874; no voters: 
I20260709 13:10:05.832281 26093 raft_consensus.cc:2468] T 77a972c0637f4187940b52b2db39422e P 90d2fdd4326c4dcb99ca1b5e506fcb98 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a5b5819a169142229b409ab5904e8874 in term 3.
I20260709 13:10:05.833061 26288 raft_consensus.cc:2804] T 77a972c0637f4187940b52b2db39422e P a5b5819a169142229b409ab5904e8874 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:05.833659 26288 raft_consensus.cc:697] T 77a972c0637f4187940b52b2db39422e P a5b5819a169142229b409ab5904e8874 [term 3 LEADER]: Becoming Leader. State: Replica: a5b5819a169142229b409ab5904e8874, State: Running, Role: LEADER
I20260709 13:10:05.834481 26288 consensus_queue.cc:237] T 77a972c0637f4187940b52b2db39422e P a5b5819a169142229b409ab5904e8874 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90d2fdd4326c4dcb99ca1b5e506fcb98" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 37999 } } peers { permanent_uuid: "1e0c787fa6274132b4528b39cfd79fad" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 40179 } } peers { permanent_uuid: "a5b5819a169142229b409ab5904e8874" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 41537 } }
I20260709 13:10:05.841213 25992 catalog_manager.cc:5697] T 77a972c0637f4187940b52b2db39422e P a5b5819a169142229b409ab5904e8874 reported cstate change: term changed from 2 to 3, leader changed from 90d2fdd4326c4dcb99ca1b5e506fcb98 (127.14.180.65) to a5b5819a169142229b409ab5904e8874 (127.14.180.67). New cstate: current_term: 3 leader_uuid: "a5b5819a169142229b409ab5904e8874" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90d2fdd4326c4dcb99ca1b5e506fcb98" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 37999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e0c787fa6274132b4528b39cfd79fad" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 40179 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a5b5819a169142229b409ab5904e8874" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 41537 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:05.868161 15057 tablet_server.cc:179] TabletServer@127.14.180.65:0 shutting down...
I20260709 13:10:05.888613 15057 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:05.889288 15057 tablet_replica.cc:333] T 8765f34b0faf4362bc3e85bb02a8d0f5 P 90d2fdd4326c4dcb99ca1b5e506fcb98: stopping tablet replica
I20260709 13:10:05.889936 15057 raft_consensus.cc:2243] T 8765f34b0faf4362bc3e85bb02a8d0f5 P 90d2fdd4326c4dcb99ca1b5e506fcb98 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:05.890878 15057 raft_consensus.cc:2272] T 8765f34b0faf4362bc3e85bb02a8d0f5 P 90d2fdd4326c4dcb99ca1b5e506fcb98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:05.893246 15057 tablet_replica.cc:333] T 77a972c0637f4187940b52b2db39422e P 90d2fdd4326c4dcb99ca1b5e506fcb98: stopping tablet replica
I20260709 13:10:05.893807 15057 raft_consensus.cc:2243] T 77a972c0637f4187940b52b2db39422e P 90d2fdd4326c4dcb99ca1b5e506fcb98 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:05.894256 15057 raft_consensus.cc:2272] T 77a972c0637f4187940b52b2db39422e P 90d2fdd4326c4dcb99ca1b5e506fcb98 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:05.897043 15057 tablet_replica.cc:333] T c631ee2f115b47acbaf22b3ce3ca0f4b P 90d2fdd4326c4dcb99ca1b5e506fcb98: stopping tablet replica
I20260709 13:10:05.897598 15057 raft_consensus.cc:2243] T c631ee2f115b47acbaf22b3ce3ca0f4b P 90d2fdd4326c4dcb99ca1b5e506fcb98 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:05.898063 15057 raft_consensus.cc:2272] T c631ee2f115b47acbaf22b3ce3ca0f4b P 90d2fdd4326c4dcb99ca1b5e506fcb98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:05.900246 15057 tablet_replica.cc:333] T d293029df37c420c81c461c276a12e4e P 90d2fdd4326c4dcb99ca1b5e506fcb98: stopping tablet replica
I20260709 13:10:05.900775 15057 raft_consensus.cc:2243] T d293029df37c420c81c461c276a12e4e P 90d2fdd4326c4dcb99ca1b5e506fcb98 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:05.901593 15057 raft_consensus.cc:2272] T d293029df37c420c81c461c276a12e4e P 90d2fdd4326c4dcb99ca1b5e506fcb98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:05.916867 15057 tablet_server.cc:196] TabletServer@127.14.180.65:0 shutdown complete.
I20260709 13:10:05.930089 15057 tablet_server.cc:179] TabletServer@127.14.180.66:0 shutting down...
I20260709 13:10:05.955189 15057 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:05.956000 15057 tablet_replica.cc:333] T 8765f34b0faf4362bc3e85bb02a8d0f5 P 1e0c787fa6274132b4528b39cfd79fad: stopping tablet replica
I20260709 13:10:05.956727 15057 raft_consensus.cc:2243] T 8765f34b0faf4362bc3e85bb02a8d0f5 P 1e0c787fa6274132b4528b39cfd79fad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:05.957244 15057 raft_consensus.cc:2272] T 8765f34b0faf4362bc3e85bb02a8d0f5 P 1e0c787fa6274132b4528b39cfd79fad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:05.959959 15057 tablet_replica.cc:333] T 77a972c0637f4187940b52b2db39422e P 1e0c787fa6274132b4528b39cfd79fad: stopping tablet replica
I20260709 13:10:05.960593 15057 raft_consensus.cc:2243] T 77a972c0637f4187940b52b2db39422e P 1e0c787fa6274132b4528b39cfd79fad [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:05.961097 15057 raft_consensus.cc:2272] T 77a972c0637f4187940b52b2db39422e P 1e0c787fa6274132b4528b39cfd79fad [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:05.963795 15057 tablet_replica.cc:333] T c631ee2f115b47acbaf22b3ce3ca0f4b P 1e0c787fa6274132b4528b39cfd79fad: stopping tablet replica
I20260709 13:10:05.964372 15057 raft_consensus.cc:2243] T c631ee2f115b47acbaf22b3ce3ca0f4b P 1e0c787fa6274132b4528b39cfd79fad [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:05.965188 15057 raft_consensus.cc:2272] T c631ee2f115b47acbaf22b3ce3ca0f4b P 1e0c787fa6274132b4528b39cfd79fad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:05.967681 15057 tablet_replica.cc:333] T d293029df37c420c81c461c276a12e4e P 1e0c787fa6274132b4528b39cfd79fad: stopping tablet replica
I20260709 13:10:05.968245 15057 raft_consensus.cc:2243] T d293029df37c420c81c461c276a12e4e P 1e0c787fa6274132b4528b39cfd79fad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:05.968714 15057 raft_consensus.cc:2272] T d293029df37c420c81c461c276a12e4e P 1e0c787fa6274132b4528b39cfd79fad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:05.982268 15057 tablet_server.cc:196] TabletServer@127.14.180.66:0 shutdown complete.
I20260709 13:10:05.994768 15057 tablet_server.cc:179] TabletServer@127.14.180.67:0 shutting down...
I20260709 13:10:06.013984 15057 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:06.014757 15057 tablet_replica.cc:333] T 8765f34b0faf4362bc3e85bb02a8d0f5 P a5b5819a169142229b409ab5904e8874: stopping tablet replica
I20260709 13:10:06.015359 15057 raft_consensus.cc:2243] T 8765f34b0faf4362bc3e85bb02a8d0f5 P a5b5819a169142229b409ab5904e8874 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.015829 15057 raft_consensus.cc:2272] T 8765f34b0faf4362bc3e85bb02a8d0f5 P a5b5819a169142229b409ab5904e8874 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.018333 15057 tablet_replica.cc:333] T 77a972c0637f4187940b52b2db39422e P a5b5819a169142229b409ab5904e8874: stopping tablet replica
I20260709 13:10:06.018975 15057 raft_consensus.cc:2243] T 77a972c0637f4187940b52b2db39422e P a5b5819a169142229b409ab5904e8874 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:06.019658 15057 pending_rounds.cc:70] T 77a972c0637f4187940b52b2db39422e P a5b5819a169142229b409ab5904e8874: Trying to abort 1 pending ops.
I20260709 13:10:06.019901 15057 pending_rounds.cc:77] T 77a972c0637f4187940b52b2db39422e P a5b5819a169142229b409ab5904e8874: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305636273506967552 op_type: NO_OP noop_request { }
I20260709 13:10:06.020215 15057 raft_consensus.cc:2889] T 77a972c0637f4187940b52b2db39422e P a5b5819a169142229b409ab5904e8874 [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:10:06.020512 15057 raft_consensus.cc:2272] T 77a972c0637f4187940b52b2db39422e P a5b5819a169142229b409ab5904e8874 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.022770 15057 tablet_replica.cc:333] T c631ee2f115b47acbaf22b3ce3ca0f4b P a5b5819a169142229b409ab5904e8874: stopping tablet replica
I20260709 13:10:06.023319 15057 raft_consensus.cc:2243] T c631ee2f115b47acbaf22b3ce3ca0f4b P a5b5819a169142229b409ab5904e8874 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.023768 15057 raft_consensus.cc:2272] T c631ee2f115b47acbaf22b3ce3ca0f4b P a5b5819a169142229b409ab5904e8874 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.026062 15057 tablet_replica.cc:333] T d293029df37c420c81c461c276a12e4e P a5b5819a169142229b409ab5904e8874: stopping tablet replica
I20260709 13:10:06.026654 15057 raft_consensus.cc:2243] T d293029df37c420c81c461c276a12e4e P a5b5819a169142229b409ab5904e8874 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:06.027087 15057 raft_consensus.cc:2272] T d293029df37c420c81c461c276a12e4e P a5b5819a169142229b409ab5904e8874 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.050385 15057 tablet_server.cc:196] TabletServer@127.14.180.67:0 shutdown complete.
I20260709 13:10:06.063350 15057 master.cc:562] Master@127.14.180.126:45953 shutting down...
I20260709 13:10:06.079718 15057 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 31a71d5be7cc486ba3b747f43a8ffa78 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:06.080370 15057 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 31a71d5be7cc486ba3b747f43a8ffa78 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:06.080750 15057 tablet_replica.cc:333] T 00000000000000000000000000000000 P 31a71d5be7cc486ba3b747f43a8ffa78: stopping tablet replica
I20260709 13:10:06.100042 15057 master.cc:584] Master@127.14.180.126:45953 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (2420 ms)
[----------] 6 tests from LeaderRebalancerTest (322912 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 13:10:06.131901 15057 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.14.180.126:40463
I20260709 13:10:06.133165 15057 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:06.139071 26335 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:06.139369 26336 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:06.140276 26338 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:06.141710 15057 server_base.cc:1061] running on GCE node
I20260709 13:10:06.142794 15057 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:06.143039 15057 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:06.143213 15057 hybrid_clock.cc:648] HybridClock initialized: now 1783602606143196 us; error 0 us; skew 500 ppm
I20260709 13:10:06.143836 15057 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:06.146535 15057 webserver.cc:533] Webserver started at http://127.14.180.126:33205/ using document root <none> and password file <none>
I20260709 13:10:06.147153 15057 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:06.147384 15057 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:06.147662 15057 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:06.148838 15057 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602283040513-15057-0/minicluster-data/master-0-root/instance:
uuid: "01f2b5f03c694ea5be1da22fe731b494"
format_stamp: "Formatted at 2026-07-09 13:10:06 on dist-test-slave-r9m8"
I20260709 13:10:06.153553 15057 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:10:06.157433 26343 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:06.158406 15057 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:10:06.158766 15057 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602283040513-15057-0/minicluster-data/master-0-root
uuid: "01f2b5f03c694ea5be1da22fe731b494"
format_stamp: "Formatted at 2026-07-09 13:10:06 on dist-test-slave-r9m8"
I20260709 13:10:06.159039 15057 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602283040513-15057-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602283040513-15057-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602283040513-15057-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:06.173239 15057 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:06.174281 15057 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:06.212630 15057 rpc_server.cc:307] RPC server started. Bound to: 127.14.180.126:40463
I20260709 13:10:06.212759 26394 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.180.126:40463 every 8 connection(s)
I20260709 13:10:06.216850 26395 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:06.228302 26395 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 01f2b5f03c694ea5be1da22fe731b494: Bootstrap starting.
I20260709 13:10:06.233021 26395 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 01f2b5f03c694ea5be1da22fe731b494: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:06.237385 26395 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 01f2b5f03c694ea5be1da22fe731b494: No bootstrap required, opened a new log
I20260709 13:10:06.239743 26395 raft_consensus.cc:359] T 00000000000000000000000000000000 P 01f2b5f03c694ea5be1da22fe731b494 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "01f2b5f03c694ea5be1da22fe731b494" member_type: VOTER }
I20260709 13:10:06.240161 26395 raft_consensus.cc:385] T 00000000000000000000000000000000 P 01f2b5f03c694ea5be1da22fe731b494 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:06.240465 26395 raft_consensus.cc:740] T 00000000000000000000000000000000 P 01f2b5f03c694ea5be1da22fe731b494 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01f2b5f03c694ea5be1da22fe731b494, State: Initialized, Role: FOLLOWER
I20260709 13:10:06.241128 26395 consensus_queue.cc:260] T 00000000000000000000000000000000 P 01f2b5f03c694ea5be1da22fe731b494 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "01f2b5f03c694ea5be1da22fe731b494" member_type: VOTER }
I20260709 13:10:06.241652 26395 raft_consensus.cc:399] T 00000000000000000000000000000000 P 01f2b5f03c694ea5be1da22fe731b494 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:10:06.241895 26395 raft_consensus.cc:493] T 00000000000000000000000000000000 P 01f2b5f03c694ea5be1da22fe731b494 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:10:06.242216 26395 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 01f2b5f03c694ea5be1da22fe731b494 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:06.247733 26395 raft_consensus.cc:515] T 00000000000000000000000000000000 P 01f2b5f03c694ea5be1da22fe731b494 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "01f2b5f03c694ea5be1da22fe731b494" member_type: VOTER }
I20260709 13:10:06.248447 26395 leader_election.cc:304] T 00000000000000000000000000000000 P 01f2b5f03c694ea5be1da22fe731b494 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 01f2b5f03c694ea5be1da22fe731b494; no voters: 
I20260709 13:10:06.249706 26395 leader_election.cc:290] T 00000000000000000000000000000000 P 01f2b5f03c694ea5be1da22fe731b494 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:10:06.250140 26398 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 01f2b5f03c694ea5be1da22fe731b494 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:06.251878 26398 raft_consensus.cc:697] T 00000000000000000000000000000000 P 01f2b5f03c694ea5be1da22fe731b494 [term 1 LEADER]: Becoming Leader. State: Replica: 01f2b5f03c694ea5be1da22fe731b494, State: Running, Role: LEADER
I20260709 13:10:06.252606 26398 consensus_queue.cc:237] T 00000000000000000000000000000000 P 01f2b5f03c694ea5be1da22fe731b494 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "01f2b5f03c694ea5be1da22fe731b494" member_type: VOTER }
I20260709 13:10:06.252842 26395 sys_catalog.cc:565] T 00000000000000000000000000000000 P 01f2b5f03c694ea5be1da22fe731b494 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:10:06.255861 26399 sys_catalog.cc:455] T 00000000000000000000000000000000 P 01f2b5f03c694ea5be1da22fe731b494 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "01f2b5f03c694ea5be1da22fe731b494" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "01f2b5f03c694ea5be1da22fe731b494" member_type: VOTER } }
I20260709 13:10:06.255802 26400 sys_catalog.cc:455] T 00000000000000000000000000000000 P 01f2b5f03c694ea5be1da22fe731b494 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 01f2b5f03c694ea5be1da22fe731b494. Latest consensus state: current_term: 1 leader_uuid: "01f2b5f03c694ea5be1da22fe731b494" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "01f2b5f03c694ea5be1da22fe731b494" member_type: VOTER } }
I20260709 13:10:06.256623 26399 sys_catalog.cc:458] T 00000000000000000000000000000000 P 01f2b5f03c694ea5be1da22fe731b494 [sys.catalog]: This master's current role is: LEADER
I20260709 13:10:06.256829 26400 sys_catalog.cc:458] T 00000000000000000000000000000000 P 01f2b5f03c694ea5be1da22fe731b494 [sys.catalog]: This master's current role is: LEADER
I20260709 13:10:06.260013 26403 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:10:06.265386 26403 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:10:06.270320 15057 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:10:06.274850 26403 catalog_manager.cc:1383] Generated new cluster ID: 7081d075d5f94e9e8767ef5ddd33b82b
I20260709 13:10:06.275182 26403 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:10:06.293041 26403 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:10:06.294523 26403 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:10:06.311720 26403 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 01f2b5f03c694ea5be1da22fe731b494: Generated new TSK 0
I20260709 13:10:06.312461 26403 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:10:06.338675 15057 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:06.344997 26416 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:06.346158 26417 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:06.347863 26419 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:06.348812 15057 server_base.cc:1061] running on GCE node
I20260709 13:10:06.349880 15057 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:06.350091 15057 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:06.350294 15057 hybrid_clock.cc:648] HybridClock initialized: now 1783602606350278 us; error 0 us; skew 500 ppm
I20260709 13:10:06.350952 15057 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:06.353718 15057 webserver.cc:533] Webserver started at http://127.14.180.65:32785/ using document root <none> and password file <none>
I20260709 13:10:06.354424 15057 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:06.354724 15057 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:06.355029 15057 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:06.356240 15057 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602283040513-15057-0/minicluster-data/ts-0-root/instance:
uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c"
format_stamp: "Formatted at 2026-07-09 13:10:06 on dist-test-slave-r9m8"
I20260709 13:10:06.361093 15057 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:10:06.364835 26424 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:06.365736 15057 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:10:06.366076 15057 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602283040513-15057-0/minicluster-data/ts-0-root
uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c"
format_stamp: "Formatted at 2026-07-09 13:10:06 on dist-test-slave-r9m8"
I20260709 13:10:06.366439 15057 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602283040513-15057-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602283040513-15057-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602283040513-15057-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:06.383122 15057 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:06.384367 15057 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:06.385864 15057 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:06.388537 15057 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:06.388811 15057 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:06.389091 15057 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:06.389278 15057 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:06.439671 15057 rpc_server.cc:307] RPC server started. Bound to: 127.14.180.65:46829
I20260709 13:10:06.439792 26486 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.180.65:46829 every 8 connection(s)
I20260709 13:10:06.444466 15057 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:06.452613 26491 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:06.453063 26492 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:06.456749 26494 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:06.457442 15057 server_base.cc:1061] running on GCE node
I20260709 13:10:06.458721 15057 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:06.458976 15057 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:06.459172 15057 hybrid_clock.cc:648] HybridClock initialized: now 1783602606459134 us; error 0 us; skew 500 ppm
I20260709 13:10:06.459761 15057 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:06.460369 26487 heartbeater.cc:344] Connected to a master server at 127.14.180.126:40463
I20260709 13:10:06.460908 26487 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:06.461938 26487 heartbeater.cc:507] Master 127.14.180.126:40463 requested a full tablet report, sending...
I20260709 13:10:06.462870 15057 webserver.cc:533] Webserver started at http://127.14.180.66:41775/ using document root <none> and password file <none>
I20260709 13:10:06.463542 15057 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:06.463922 15057 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:06.464246 15057 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:06.464462 26360 ts_manager.cc:194] Registered new tserver with Master: ff0fe65aa4b1405d84e4597f9aa7f87c (127.14.180.65:46829)
I20260709 13:10:06.465574 15057 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602283040513-15057-0/minicluster-data/ts-1-root/instance:
uuid: "5e0e92538e1f44b2b0663afb330f899e"
format_stamp: "Formatted at 2026-07-09 13:10:06 on dist-test-slave-r9m8"
I20260709 13:10:06.466500 26360 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55024
I20260709 13:10:06.471009 15057 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.001s
I20260709 13:10:06.474900 26499 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:06.475909 15057 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 13:10:06.476190 15057 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602283040513-15057-0/minicluster-data/ts-1-root
uuid: "5e0e92538e1f44b2b0663afb330f899e"
format_stamp: "Formatted at 2026-07-09 13:10:06 on dist-test-slave-r9m8"
I20260709 13:10:06.476488 15057 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602283040513-15057-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602283040513-15057-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602283040513-15057-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:06.496224 15057 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:06.497370 15057 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:06.498839 15057 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:06.501835 15057 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:06.502053 15057 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:06.502364 15057 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:06.502511 15057 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:06.544981 15057 rpc_server.cc:307] RPC server started. Bound to: 127.14.180.66:46615
I20260709 13:10:06.545104 26561 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.180.66:46615 every 8 connection(s)
I20260709 13:10:06.550447 15057 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:06.561522 26565 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:06.562381 26566 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:06.566903 26562 heartbeater.cc:344] Connected to a master server at 127.14.180.126:40463
I20260709 13:10:06.567121 15057 server_base.cc:1061] running on GCE node
W20260709 13:10:06.567188 26568 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:06.567615 26562 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:06.568781 15057 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:10:06.568840 26562 heartbeater.cc:507] Master 127.14.180.126:40463 requested a full tablet report, sending...
W20260709 13:10:06.569082 15057 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:06.569427 15057 hybrid_clock.cc:648] HybridClock initialized: now 1783602606569400 us; error 0 us; skew 500 ppm
I20260709 13:10:06.570334 15057 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:06.572010 26360 ts_manager.cc:194] Registered new tserver with Master: 5e0e92538e1f44b2b0663afb330f899e (127.14.180.66:46615)
I20260709 13:10:06.573537 15057 webserver.cc:533] Webserver started at http://127.14.180.67:34263/ using document root <none> and password file <none>
I20260709 13:10:06.574105 26360 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55040
I20260709 13:10:06.574214 15057 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:06.574788 15057 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:06.575161 15057 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:06.576584 15057 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602283040513-15057-0/minicluster-data/ts-2-root/instance:
uuid: "b5189d1d1a034d8b92a7973b50ab5110"
format_stamp: "Formatted at 2026-07-09 13:10:06 on dist-test-slave-r9m8"
I20260709 13:10:06.581854 15057 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:10:06.585747 26573 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:06.586776 15057 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:10:06.587070 15057 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602283040513-15057-0/minicluster-data/ts-2-root
uuid: "b5189d1d1a034d8b92a7973b50ab5110"
format_stamp: "Formatted at 2026-07-09 13:10:06 on dist-test-slave-r9m8"
I20260709 13:10:06.587330 15057 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602283040513-15057-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602283040513-15057-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602283040513-15057-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:06.597695 15057 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:06.598912 15057 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:06.600320 15057 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:06.602905 15057 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:06.603205 15057 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:06.603497 15057 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:06.603663 15057 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:06.644518 15057 rpc_server.cc:307] RPC server started. Bound to: 127.14.180.67:40219
I20260709 13:10:06.644676 26635 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.180.67:40219 every 8 connection(s)
I20260709 13:10:06.659641 26636 heartbeater.cc:344] Connected to a master server at 127.14.180.126:40463
I20260709 13:10:06.660096 26636 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:06.660884 26636 heartbeater.cc:507] Master 127.14.180.126:40463 requested a full tablet report, sending...
I20260709 13:10:06.663365 26360 ts_manager.cc:194] Registered new tserver with Master: b5189d1d1a034d8b92a7973b50ab5110 (127.14.180.67:40219)
I20260709 13:10:06.664369 15057 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016560453s
I20260709 13:10:06.665194 26360 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55046
I20260709 13:10:06.690392 26360 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55054:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:10:06.693114 26360 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:10:06.776259 26452 tablet_service.cc:1511] Processing CreateTablet for tablet 5b44c782e9fd49aea2b89f4bf967e45b (DEFAULT_TABLE table=test-workload [id=f80774ff5719432abb40899a55694fa7]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:10:06.777757 26452 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b44c782e9fd49aea2b89f4bf967e45b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:06.780675 26601 tablet_service.cc:1511] Processing CreateTablet for tablet 5b44c782e9fd49aea2b89f4bf967e45b (DEFAULT_TABLE table=test-workload [id=f80774ff5719432abb40899a55694fa7]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:10:06.782292 26601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b44c782e9fd49aea2b89f4bf967e45b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:06.783115 26600 tablet_service.cc:1511] Processing CreateTablet for tablet 41be667b2c704042b4fa06f2d1480152 (DEFAULT_TABLE table=test-workload [id=f80774ff5719432abb40899a55694fa7]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:10:06.781885 26526 tablet_service.cc:1511] Processing CreateTablet for tablet 41be667b2c704042b4fa06f2d1480152 (DEFAULT_TABLE table=test-workload [id=f80774ff5719432abb40899a55694fa7]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:10:06.783710 26525 tablet_service.cc:1511] Processing CreateTablet for tablet dbd9c03cee964db394327f6d722ea62f (DEFAULT_TABLE table=test-workload [id=f80774ff5719432abb40899a55694fa7]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:10:06.784628 26526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41be667b2c704042b4fa06f2d1480152. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:06.785384 26525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbd9c03cee964db394327f6d722ea62f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:06.784629 26600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41be667b2c704042b4fa06f2d1480152. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:06.786734 26523 tablet_service.cc:1511] Processing CreateTablet for tablet 7275ca9585794b1c9cc06d7616e89c8d (DEFAULT_TABLE table=test-workload [id=f80774ff5719432abb40899a55694fa7]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:10:06.787612 26524 tablet_service.cc:1511] Processing CreateTablet for tablet 9f5fec4f76024abe9c06d7e99531a089 (DEFAULT_TABLE table=test-workload [id=f80774ff5719432abb40899a55694fa7]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:10:06.788233 26523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7275ca9585794b1c9cc06d7616e89c8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:06.788970 26524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f5fec4f76024abe9c06d7e99531a089. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:06.783710 26598 tablet_service.cc:1511] Processing CreateTablet for tablet 9f5fec4f76024abe9c06d7e99531a089 (DEFAULT_TABLE table=test-workload [id=f80774ff5719432abb40899a55694fa7]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:10:06.791738 26522 tablet_service.cc:1511] Processing CreateTablet for tablet 7aa0adb09fb048749ba647e2334a1585 (DEFAULT_TABLE table=test-workload [id=f80774ff5719432abb40899a55694fa7]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:10:06.792213 26598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f5fec4f76024abe9c06d7e99531a089. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:06.780720 26527 tablet_service.cc:1511] Processing CreateTablet for tablet 5b44c782e9fd49aea2b89f4bf967e45b (DEFAULT_TABLE table=test-workload [id=f80774ff5719432abb40899a55694fa7]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:10:06.794288 26521 tablet_service.cc:1511] Processing CreateTablet for tablet 0d9a4ae1c28749c08418e37aca35973c (DEFAULT_TABLE table=test-workload [id=f80774ff5719432abb40899a55694fa7]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:10:06.796864 26520 tablet_service.cc:1511] Processing CreateTablet for tablet 3cb687f16fd34deea0dcb10953c99dda (DEFAULT_TABLE table=test-workload [id=f80774ff5719432abb40899a55694fa7]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:10:06.797775 26449 tablet_service.cc:1511] Processing CreateTablet for tablet 9f5fec4f76024abe9c06d7e99531a089 (DEFAULT_TABLE table=test-workload [id=f80774ff5719432abb40899a55694fa7]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:10:06.799278 26449 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f5fec4f76024abe9c06d7e99531a089. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:06.801362 26448 tablet_service.cc:1511] Processing CreateTablet for tablet 7275ca9585794b1c9cc06d7616e89c8d (DEFAULT_TABLE table=test-workload [id=f80774ff5719432abb40899a55694fa7]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:10:06.803799 26447 tablet_service.cc:1511] Processing CreateTablet for tablet 7aa0adb09fb048749ba647e2334a1585 (DEFAULT_TABLE table=test-workload [id=f80774ff5719432abb40899a55694fa7]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:10:06.804804 26519 tablet_service.cc:1511] Processing CreateTablet for tablet 04fdfdfcbfbd476e99db1fb5b3fc4e40 (DEFAULT_TABLE table=test-workload [id=f80774ff5719432abb40899a55694fa7]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:10:06.805362 26447 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7aa0adb09fb048749ba647e2334a1585. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:06.808423 26451 tablet_service.cc:1511] Processing CreateTablet for tablet 41be667b2c704042b4fa06f2d1480152 (DEFAULT_TABLE table=test-workload [id=f80774ff5719432abb40899a55694fa7]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:10:06.782474 26599 tablet_service.cc:1511] Processing CreateTablet for tablet dbd9c03cee964db394327f6d722ea62f (DEFAULT_TABLE table=test-workload [id=f80774ff5719432abb40899a55694fa7]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:10:06.811594 26599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbd9c03cee964db394327f6d722ea62f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:06.790393 26596 tablet_service.cc:1511] Processing CreateTablet for tablet 7aa0adb09fb048749ba647e2334a1585 (DEFAULT_TABLE table=test-workload [id=f80774ff5719432abb40899a55694fa7]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:10:06.816253 26596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7aa0adb09fb048749ba647e2334a1585. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:06.799732 26450 tablet_service.cc:1511] Processing CreateTablet for tablet dbd9c03cee964db394327f6d722ea62f (DEFAULT_TABLE table=test-workload [id=f80774ff5719432abb40899a55694fa7]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:10:06.784866 26597 tablet_service.cc:1511] Processing CreateTablet for tablet 7275ca9585794b1c9cc06d7616e89c8d (DEFAULT_TABLE table=test-workload [id=f80774ff5719432abb40899a55694fa7]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:10:06.821534 26597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7275ca9585794b1c9cc06d7616e89c8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:06.793154 26522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7aa0adb09fb048749ba647e2334a1585. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:06.823972 26519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04fdfdfcbfbd476e99db1fb5b3fc4e40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:06.824628 26521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d9a4ae1c28749c08418e37aca35973c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:06.826399 26520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cb687f16fd34deea0dcb10953c99dda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:06.827106 26527 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b44c782e9fd49aea2b89f4bf967e45b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:06.829370 26595 tablet_service.cc:1511] Processing CreateTablet for tablet 0d9a4ae1c28749c08418e37aca35973c (DEFAULT_TABLE table=test-workload [id=f80774ff5719432abb40899a55694fa7]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:10:06.831868 26595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d9a4ae1c28749c08418e37aca35973c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:06.832234 26594 tablet_service.cc:1511] Processing CreateTablet for tablet 3cb687f16fd34deea0dcb10953c99dda (DEFAULT_TABLE table=test-workload [id=f80774ff5719432abb40899a55694fa7]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:10:06.833706 26594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cb687f16fd34deea0dcb10953c99dda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:06.835716 26593 tablet_service.cc:1511] Processing CreateTablet for tablet 04fdfdfcbfbd476e99db1fb5b3fc4e40 (DEFAULT_TABLE table=test-workload [id=f80774ff5719432abb40899a55694fa7]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:10:06.837220 26593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04fdfdfcbfbd476e99db1fb5b3fc4e40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:06.840746 26451 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41be667b2c704042b4fa06f2d1480152. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:06.842104 26450 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbd9c03cee964db394327f6d722ea62f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:06.851742 26448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7275ca9585794b1c9cc06d7616e89c8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:06.879841 26652 tablet_bootstrap.cc:492] T 9f5fec4f76024abe9c06d7e99531a089 P ff0fe65aa4b1405d84e4597f9aa7f87c: Bootstrap starting.
I20260709 13:10:06.884892 26446 tablet_service.cc:1511] Processing CreateTablet for tablet 3cb687f16fd34deea0dcb10953c99dda (DEFAULT_TABLE table=test-workload [id=f80774ff5719432abb40899a55694fa7]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:10:06.886597 26446 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cb687f16fd34deea0dcb10953c99dda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:06.902246 26445 tablet_service.cc:1511] Processing CreateTablet for tablet 04fdfdfcbfbd476e99db1fb5b3fc4e40 (DEFAULT_TABLE table=test-workload [id=f80774ff5719432abb40899a55694fa7]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:10:06.907282 26652 tablet_bootstrap.cc:654] T 9f5fec4f76024abe9c06d7e99531a089 P ff0fe65aa4b1405d84e4597f9aa7f87c: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:06.908308 26445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04fdfdfcbfbd476e99db1fb5b3fc4e40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:06.918943 26652 tablet_bootstrap.cc:492] T 9f5fec4f76024abe9c06d7e99531a089 P ff0fe65aa4b1405d84e4597f9aa7f87c: No bootstrap required, opened a new log
I20260709 13:10:06.919612 26652 ts_tablet_manager.cc:1403] T 9f5fec4f76024abe9c06d7e99531a089 P ff0fe65aa4b1405d84e4597f9aa7f87c: Time spent bootstrapping tablet: real 0.040s	user 0.013s	sys 0.016s
I20260709 13:10:06.922838 26652 raft_consensus.cc:359] T 9f5fec4f76024abe9c06d7e99531a089 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:06.923676 26652 raft_consensus.cc:385] T 9f5fec4f76024abe9c06d7e99531a089 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:06.892331 26653 tablet_bootstrap.cc:492] T 41be667b2c704042b4fa06f2d1480152 P b5189d1d1a034d8b92a7973b50ab5110: Bootstrap starting.
I20260709 13:10:06.887010 26449 tablet_service.cc:1511] Processing CreateTablet for tablet 0d9a4ae1c28749c08418e37aca35973c (DEFAULT_TABLE table=test-workload [id=f80774ff5719432abb40899a55694fa7]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:10:06.925386 26449 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d9a4ae1c28749c08418e37aca35973c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:06.930693 26653 tablet_bootstrap.cc:654] T 41be667b2c704042b4fa06f2d1480152 P b5189d1d1a034d8b92a7973b50ab5110: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:06.903589 26651 tablet_bootstrap.cc:492] T dbd9c03cee964db394327f6d722ea62f P 5e0e92538e1f44b2b0663afb330f899e: Bootstrap starting.
I20260709 13:10:06.938701 26652 raft_consensus.cc:740] T 9f5fec4f76024abe9c06d7e99531a089 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff0fe65aa4b1405d84e4597f9aa7f87c, State: Initialized, Role: FOLLOWER
I20260709 13:10:06.944154 26652 consensus_queue.cc:260] T 9f5fec4f76024abe9c06d7e99531a089 P ff0fe65aa4b1405d84e4597f9aa7f87c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:06.953264 26651 tablet_bootstrap.cc:654] T dbd9c03cee964db394327f6d722ea62f P 5e0e92538e1f44b2b0663afb330f899e: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:06.970461 26653 tablet_bootstrap.cc:492] T 41be667b2c704042b4fa06f2d1480152 P b5189d1d1a034d8b92a7973b50ab5110: No bootstrap required, opened a new log
I20260709 13:10:06.971078 26653 ts_tablet_manager.cc:1403] T 41be667b2c704042b4fa06f2d1480152 P b5189d1d1a034d8b92a7973b50ab5110: Time spent bootstrapping tablet: real 0.079s	user 0.008s	sys 0.006s
I20260709 13:10:06.999694 26653 raft_consensus.cc:359] T 41be667b2c704042b4fa06f2d1480152 P b5189d1d1a034d8b92a7973b50ab5110 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:07.000705 26653 raft_consensus.cc:385] T 41be667b2c704042b4fa06f2d1480152 P b5189d1d1a034d8b92a7973b50ab5110 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:07.001075 26653 raft_consensus.cc:740] T 41be667b2c704042b4fa06f2d1480152 P b5189d1d1a034d8b92a7973b50ab5110 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5189d1d1a034d8b92a7973b50ab5110, State: Initialized, Role: FOLLOWER
I20260709 13:10:07.008545 26653 consensus_queue.cc:260] T 41be667b2c704042b4fa06f2d1480152 P b5189d1d1a034d8b92a7973b50ab5110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:07.010028 26652 ts_tablet_manager.cc:1434] T 9f5fec4f76024abe9c06d7e99531a089 P ff0fe65aa4b1405d84e4597f9aa7f87c: Time spent starting tablet: real 0.090s	user 0.009s	sys 0.017s
I20260709 13:10:07.014156 26652 tablet_bootstrap.cc:492] T 3cb687f16fd34deea0dcb10953c99dda P ff0fe65aa4b1405d84e4597f9aa7f87c: Bootstrap starting.
I20260709 13:10:07.015129 26487 heartbeater.cc:499] Master 127.14.180.126:40463 was elected leader, sending a full tablet report...
I20260709 13:10:07.019176 26653 ts_tablet_manager.cc:1434] T 41be667b2c704042b4fa06f2d1480152 P b5189d1d1a034d8b92a7973b50ab5110: Time spent starting tablet: real 0.048s	user 0.011s	sys 0.001s
I20260709 13:10:07.020076 26636 heartbeater.cc:499] Master 127.14.180.126:40463 was elected leader, sending a full tablet report...
I20260709 13:10:07.020380 26653 tablet_bootstrap.cc:492] T 5b44c782e9fd49aea2b89f4bf967e45b P b5189d1d1a034d8b92a7973b50ab5110: Bootstrap starting.
I20260709 13:10:07.022158 26651 tablet_bootstrap.cc:492] T dbd9c03cee964db394327f6d722ea62f P 5e0e92538e1f44b2b0663afb330f899e: No bootstrap required, opened a new log
I20260709 13:10:07.022686 26651 ts_tablet_manager.cc:1403] T dbd9c03cee964db394327f6d722ea62f P 5e0e92538e1f44b2b0663afb330f899e: Time spent bootstrapping tablet: real 0.119s	user 0.012s	sys 0.020s
I20260709 13:10:07.025745 26651 raft_consensus.cc:359] T dbd9c03cee964db394327f6d722ea62f P 5e0e92538e1f44b2b0663afb330f899e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:07.026540 26651 raft_consensus.cc:385] T dbd9c03cee964db394327f6d722ea62f P 5e0e92538e1f44b2b0663afb330f899e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:07.040670 26651 raft_consensus.cc:740] T dbd9c03cee964db394327f6d722ea62f P 5e0e92538e1f44b2b0663afb330f899e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e0e92538e1f44b2b0663afb330f899e, State: Initialized, Role: FOLLOWER
I20260709 13:10:07.041431 26651 consensus_queue.cc:260] T dbd9c03cee964db394327f6d722ea62f P 5e0e92538e1f44b2b0663afb330f899e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:07.026746 26653 tablet_bootstrap.cc:654] T 5b44c782e9fd49aea2b89f4bf967e45b P b5189d1d1a034d8b92a7973b50ab5110: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:07.029613 26652 tablet_bootstrap.cc:654] T 3cb687f16fd34deea0dcb10953c99dda P ff0fe65aa4b1405d84e4597f9aa7f87c: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:07.048360 26562 heartbeater.cc:499] Master 127.14.180.126:40463 was elected leader, sending a full tablet report...
I20260709 13:10:07.048733 26651 ts_tablet_manager.cc:1434] T dbd9c03cee964db394327f6d722ea62f P 5e0e92538e1f44b2b0663afb330f899e: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.000s
I20260709 13:10:07.050824 26651 tablet_bootstrap.cc:492] T 41be667b2c704042b4fa06f2d1480152 P 5e0e92538e1f44b2b0663afb330f899e: Bootstrap starting.
I20260709 13:10:07.051874 26658 raft_consensus.cc:493] T 41be667b2c704042b4fa06f2d1480152 P b5189d1d1a034d8b92a7973b50ab5110 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.052639 26658 raft_consensus.cc:515] T 41be667b2c704042b4fa06f2d1480152 P b5189d1d1a034d8b92a7973b50ab5110 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:07.058099 26651 tablet_bootstrap.cc:654] T 41be667b2c704042b4fa06f2d1480152 P 5e0e92538e1f44b2b0663afb330f899e: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:07.058830 26652 tablet_bootstrap.cc:492] T 3cb687f16fd34deea0dcb10953c99dda P ff0fe65aa4b1405d84e4597f9aa7f87c: No bootstrap required, opened a new log
I20260709 13:10:07.059485 26652 ts_tablet_manager.cc:1403] T 3cb687f16fd34deea0dcb10953c99dda P ff0fe65aa4b1405d84e4597f9aa7f87c: Time spent bootstrapping tablet: real 0.046s	user 0.011s	sys 0.004s
I20260709 13:10:07.061106 26658 leader_election.cc:290] T 41be667b2c704042b4fa06f2d1480152 P b5189d1d1a034d8b92a7973b50ab5110 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ff0fe65aa4b1405d84e4597f9aa7f87c (127.14.180.65:46829), 5e0e92538e1f44b2b0663afb330f899e (127.14.180.66:46615)
I20260709 13:10:07.063903 26652 raft_consensus.cc:359] T 3cb687f16fd34deea0dcb10953c99dda P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:07.064942 26652 raft_consensus.cc:385] T 3cb687f16fd34deea0dcb10953c99dda P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:07.065310 26652 raft_consensus.cc:740] T 3cb687f16fd34deea0dcb10953c99dda P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff0fe65aa4b1405d84e4597f9aa7f87c, State: Initialized, Role: FOLLOWER
I20260709 13:10:07.066344 26652 consensus_queue.cc:260] T 3cb687f16fd34deea0dcb10953c99dda P ff0fe65aa4b1405d84e4597f9aa7f87c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:07.069310 26462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41be667b2c704042b4fa06f2d1480152" candidate_uuid: "b5189d1d1a034d8b92a7973b50ab5110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" is_pre_election: true
W20260709 13:10:07.070968 26574 leader_election.cc:343] T 41be667b2c704042b4fa06f2d1480152 P b5189d1d1a034d8b92a7973b50ab5110 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ff0fe65aa4b1405d84e4597f9aa7f87c (127.14.180.65:46829): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:07.075691 26652 ts_tablet_manager.cc:1434] T 3cb687f16fd34deea0dcb10953c99dda P ff0fe65aa4b1405d84e4597f9aa7f87c: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:10:07.080897 26652 tablet_bootstrap.cc:492] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P ff0fe65aa4b1405d84e4597f9aa7f87c: Bootstrap starting.
I20260709 13:10:07.082955 26657 raft_consensus.cc:493] T 3cb687f16fd34deea0dcb10953c99dda P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.083539 26657 raft_consensus.cc:515] T 3cb687f16fd34deea0dcb10953c99dda P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:07.099195 26657 leader_election.cc:290] T 3cb687f16fd34deea0dcb10953c99dda P ff0fe65aa4b1405d84e4597f9aa7f87c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e0e92538e1f44b2b0663afb330f899e (127.14.180.66:46615), b5189d1d1a034d8b92a7973b50ab5110 (127.14.180.67:40219)
I20260709 13:10:07.101011 26653 tablet_bootstrap.cc:492] T 5b44c782e9fd49aea2b89f4bf967e45b P b5189d1d1a034d8b92a7973b50ab5110: No bootstrap required, opened a new log
I20260709 13:10:07.101799 26653 ts_tablet_manager.cc:1403] T 5b44c782e9fd49aea2b89f4bf967e45b P b5189d1d1a034d8b92a7973b50ab5110: Time spent bootstrapping tablet: real 0.082s	user 0.009s	sys 0.008s
I20260709 13:10:07.111930 26653 raft_consensus.cc:359] T 5b44c782e9fd49aea2b89f4bf967e45b P b5189d1d1a034d8b92a7973b50ab5110 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } }
I20260709 13:10:07.112960 26653 raft_consensus.cc:385] T 5b44c782e9fd49aea2b89f4bf967e45b P b5189d1d1a034d8b92a7973b50ab5110 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:07.113324 26653 raft_consensus.cc:740] T 5b44c782e9fd49aea2b89f4bf967e45b P b5189d1d1a034d8b92a7973b50ab5110 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5189d1d1a034d8b92a7973b50ab5110, State: Initialized, Role: FOLLOWER
I20260709 13:10:07.114477 26653 consensus_queue.cc:260] T 5b44c782e9fd49aea2b89f4bf967e45b P b5189d1d1a034d8b92a7973b50ab5110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } }
I20260709 13:10:07.117424 26653 ts_tablet_manager.cc:1434] T 5b44c782e9fd49aea2b89f4bf967e45b P b5189d1d1a034d8b92a7973b50ab5110: Time spent starting tablet: real 0.015s	user 0.010s	sys 0.000s
I20260709 13:10:07.118803 26653 tablet_bootstrap.cc:492] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P b5189d1d1a034d8b92a7973b50ab5110: Bootstrap starting.
I20260709 13:10:07.121843 26652 tablet_bootstrap.cc:654] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P ff0fe65aa4b1405d84e4597f9aa7f87c: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:07.126324 26653 tablet_bootstrap.cc:654] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P b5189d1d1a034d8b92a7973b50ab5110: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:07.137955 26651 tablet_bootstrap.cc:492] T 41be667b2c704042b4fa06f2d1480152 P 5e0e92538e1f44b2b0663afb330f899e: No bootstrap required, opened a new log
I20260709 13:10:07.137821 26537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41be667b2c704042b4fa06f2d1480152" candidate_uuid: "b5189d1d1a034d8b92a7973b50ab5110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0e92538e1f44b2b0663afb330f899e" is_pre_election: true
W20260709 13:10:07.145078 26576 leader_election.cc:343] T 41be667b2c704042b4fa06f2d1480152 P b5189d1d1a034d8b92a7973b50ab5110 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e0e92538e1f44b2b0663afb330f899e (127.14.180.66:46615): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:07.145829 26576 leader_election.cc:304] T 41be667b2c704042b4fa06f2d1480152 P b5189d1d1a034d8b92a7973b50ab5110 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5189d1d1a034d8b92a7973b50ab5110; no voters: 5e0e92538e1f44b2b0663afb330f899e, ff0fe65aa4b1405d84e4597f9aa7f87c
I20260709 13:10:07.146963 26658 raft_consensus.cc:2749] T 41be667b2c704042b4fa06f2d1480152 P b5189d1d1a034d8b92a7973b50ab5110 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:07.149273 26537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb687f16fd34deea0dcb10953c99dda" candidate_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0e92538e1f44b2b0663afb330f899e" is_pre_election: true
I20260709 13:10:07.143857 26651 ts_tablet_manager.cc:1403] T 41be667b2c704042b4fa06f2d1480152 P 5e0e92538e1f44b2b0663afb330f899e: Time spent bootstrapping tablet: real 0.093s	user 0.017s	sys 0.044s
W20260709 13:10:07.151887 26427 leader_election.cc:343] T 3cb687f16fd34deea0dcb10953c99dda P ff0fe65aa4b1405d84e4597f9aa7f87c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e0e92538e1f44b2b0663afb330f899e (127.14.180.66:46615): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:07.155726 26651 raft_consensus.cc:359] T 41be667b2c704042b4fa06f2d1480152 P 5e0e92538e1f44b2b0663afb330f899e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:07.157104 26651 raft_consensus.cc:385] T 41be667b2c704042b4fa06f2d1480152 P 5e0e92538e1f44b2b0663afb330f899e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:07.157521 26651 raft_consensus.cc:740] T 41be667b2c704042b4fa06f2d1480152 P 5e0e92538e1f44b2b0663afb330f899e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e0e92538e1f44b2b0663afb330f899e, State: Initialized, Role: FOLLOWER
I20260709 13:10:07.160195 26651 consensus_queue.cc:260] T 41be667b2c704042b4fa06f2d1480152 P 5e0e92538e1f44b2b0663afb330f899e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:07.160981 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb687f16fd34deea0dcb10953c99dda" candidate_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5189d1d1a034d8b92a7973b50ab5110" is_pre_election: true
I20260709 13:10:07.162226 26653 tablet_bootstrap.cc:492] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P b5189d1d1a034d8b92a7973b50ab5110: No bootstrap required, opened a new log
I20260709 13:10:07.162452 26652 tablet_bootstrap.cc:492] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P ff0fe65aa4b1405d84e4597f9aa7f87c: No bootstrap required, opened a new log
I20260709 13:10:07.163096 26652 ts_tablet_manager.cc:1403] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P ff0fe65aa4b1405d84e4597f9aa7f87c: Time spent bootstrapping tablet: real 0.082s	user 0.017s	sys 0.012s
W20260709 13:10:07.163312 26426 leader_election.cc:343] T 3cb687f16fd34deea0dcb10953c99dda P ff0fe65aa4b1405d84e4597f9aa7f87c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5189d1d1a034d8b92a7973b50ab5110 (127.14.180.67:40219): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:07.163872 26426 leader_election.cc:304] T 3cb687f16fd34deea0dcb10953c99dda P ff0fe65aa4b1405d84e4597f9aa7f87c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ff0fe65aa4b1405d84e4597f9aa7f87c; no voters: 5e0e92538e1f44b2b0663afb330f899e, b5189d1d1a034d8b92a7973b50ab5110
I20260709 13:10:07.164728 26657 raft_consensus.cc:2749] T 3cb687f16fd34deea0dcb10953c99dda P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:07.165148 26651 ts_tablet_manager.cc:1434] T 41be667b2c704042b4fa06f2d1480152 P 5e0e92538e1f44b2b0663afb330f899e: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.003s
I20260709 13:10:07.165521 26653 ts_tablet_manager.cc:1403] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P b5189d1d1a034d8b92a7973b50ab5110: Time spent bootstrapping tablet: real 0.047s	user 0.020s	sys 0.006s
I20260709 13:10:07.166301 26651 tablet_bootstrap.cc:492] T 5b44c782e9fd49aea2b89f4bf967e45b P 5e0e92538e1f44b2b0663afb330f899e: Bootstrap starting.
I20260709 13:10:07.166270 26652 raft_consensus.cc:359] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:07.167263 26652 raft_consensus.cc:385] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:07.167578 26652 raft_consensus.cc:740] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff0fe65aa4b1405d84e4597f9aa7f87c, State: Initialized, Role: FOLLOWER
I20260709 13:10:07.168530 26652 consensus_queue.cc:260] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P ff0fe65aa4b1405d84e4597f9aa7f87c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:07.169564 26659 raft_consensus.cc:493] T dbd9c03cee964db394327f6d722ea62f P 5e0e92538e1f44b2b0663afb330f899e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.170087 26659 raft_consensus.cc:515] T dbd9c03cee964db394327f6d722ea62f P 5e0e92538e1f44b2b0663afb330f899e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:07.173715 26652 ts_tablet_manager.cc:1434] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P ff0fe65aa4b1405d84e4597f9aa7f87c: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 13:10:07.175076 26652 tablet_bootstrap.cc:492] T dbd9c03cee964db394327f6d722ea62f P ff0fe65aa4b1405d84e4597f9aa7f87c: Bootstrap starting.
I20260709 13:10:07.175732 26651 tablet_bootstrap.cc:654] T 5b44c782e9fd49aea2b89f4bf967e45b P 5e0e92538e1f44b2b0663afb330f899e: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:07.175913 26659 leader_election.cc:290] T dbd9c03cee964db394327f6d722ea62f P 5e0e92538e1f44b2b0663afb330f899e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ff0fe65aa4b1405d84e4597f9aa7f87c (127.14.180.65:46829), b5189d1d1a034d8b92a7973b50ab5110 (127.14.180.67:40219)
I20260709 13:10:07.183868 26652 tablet_bootstrap.cc:654] T dbd9c03cee964db394327f6d722ea62f P ff0fe65aa4b1405d84e4597f9aa7f87c: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:07.168870 26653 raft_consensus.cc:359] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P b5189d1d1a034d8b92a7973b50ab5110 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:07.184554 26653 raft_consensus.cc:385] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P b5189d1d1a034d8b92a7973b50ab5110 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:07.184916 26653 raft_consensus.cc:740] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P b5189d1d1a034d8b92a7973b50ab5110 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5189d1d1a034d8b92a7973b50ab5110, State: Initialized, Role: FOLLOWER
I20260709 13:10:07.185797 26653 consensus_queue.cc:260] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P b5189d1d1a034d8b92a7973b50ab5110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:07.188598 26653 ts_tablet_manager.cc:1434] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P b5189d1d1a034d8b92a7973b50ab5110: Time spent starting tablet: real 0.023s	user 0.003s	sys 0.003s
I20260709 13:10:07.189797 26653 tablet_bootstrap.cc:492] T 3cb687f16fd34deea0dcb10953c99dda P b5189d1d1a034d8b92a7973b50ab5110: Bootstrap starting.
I20260709 13:10:07.203941 26653 tablet_bootstrap.cc:654] T 3cb687f16fd34deea0dcb10953c99dda P b5189d1d1a034d8b92a7973b50ab5110: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:07.214131 26462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbd9c03cee964db394327f6d722ea62f" candidate_uuid: "5e0e92538e1f44b2b0663afb330f899e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" is_pre_election: true
W20260709 13:10:07.216001 26500 leader_election.cc:343] T dbd9c03cee964db394327f6d722ea62f P 5e0e92538e1f44b2b0663afb330f899e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ff0fe65aa4b1405d84e4597f9aa7f87c (127.14.180.65:46829): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:07.219003 26652 tablet_bootstrap.cc:492] T dbd9c03cee964db394327f6d722ea62f P ff0fe65aa4b1405d84e4597f9aa7f87c: No bootstrap required, opened a new log
I20260709 13:10:07.219627 26652 ts_tablet_manager.cc:1403] T dbd9c03cee964db394327f6d722ea62f P ff0fe65aa4b1405d84e4597f9aa7f87c: Time spent bootstrapping tablet: real 0.045s	user 0.024s	sys 0.017s
I20260709 13:10:07.220531 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbd9c03cee964db394327f6d722ea62f" candidate_uuid: "5e0e92538e1f44b2b0663afb330f899e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5189d1d1a034d8b92a7973b50ab5110" is_pre_election: true
I20260709 13:10:07.222103 26652 raft_consensus.cc:359] T dbd9c03cee964db394327f6d722ea62f P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:07.222946 26652 raft_consensus.cc:385] T dbd9c03cee964db394327f6d722ea62f P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:10:07.222869 26501 leader_election.cc:343] T dbd9c03cee964db394327f6d722ea62f P 5e0e92538e1f44b2b0663afb330f899e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5189d1d1a034d8b92a7973b50ab5110 (127.14.180.67:40219): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:07.223412 26652 raft_consensus.cc:740] T dbd9c03cee964db394327f6d722ea62f P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff0fe65aa4b1405d84e4597f9aa7f87c, State: Initialized, Role: FOLLOWER
I20260709 13:10:07.223522 26501 leader_election.cc:304] T dbd9c03cee964db394327f6d722ea62f P 5e0e92538e1f44b2b0663afb330f899e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0e92538e1f44b2b0663afb330f899e; no voters: b5189d1d1a034d8b92a7973b50ab5110, ff0fe65aa4b1405d84e4597f9aa7f87c
I20260709 13:10:07.224382 26652 consensus_queue.cc:260] T dbd9c03cee964db394327f6d722ea62f P ff0fe65aa4b1405d84e4597f9aa7f87c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:07.224786 26659 raft_consensus.cc:2749] T dbd9c03cee964db394327f6d722ea62f P 5e0e92538e1f44b2b0663afb330f899e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:07.228107 26652 ts_tablet_manager.cc:1434] T dbd9c03cee964db394327f6d722ea62f P ff0fe65aa4b1405d84e4597f9aa7f87c: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:10:07.229274 26652 tablet_bootstrap.cc:492] T 0d9a4ae1c28749c08418e37aca35973c P ff0fe65aa4b1405d84e4597f9aa7f87c: Bootstrap starting.
I20260709 13:10:07.229723 26651 tablet_bootstrap.cc:492] T 5b44c782e9fd49aea2b89f4bf967e45b P 5e0e92538e1f44b2b0663afb330f899e: No bootstrap required, opened a new log
I20260709 13:10:07.230654 26651 ts_tablet_manager.cc:1403] T 5b44c782e9fd49aea2b89f4bf967e45b P 5e0e92538e1f44b2b0663afb330f899e: Time spent bootstrapping tablet: real 0.065s	user 0.015s	sys 0.002s
I20260709 13:10:07.235800 26651 raft_consensus.cc:359] T 5b44c782e9fd49aea2b89f4bf967e45b P 5e0e92538e1f44b2b0663afb330f899e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } }
I20260709 13:10:07.236461 26652 tablet_bootstrap.cc:654] T 0d9a4ae1c28749c08418e37aca35973c P ff0fe65aa4b1405d84e4597f9aa7f87c: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:07.236718 26651 raft_consensus.cc:385] T 5b44c782e9fd49aea2b89f4bf967e45b P 5e0e92538e1f44b2b0663afb330f899e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:07.237192 26651 raft_consensus.cc:740] T 5b44c782e9fd49aea2b89f4bf967e45b P 5e0e92538e1f44b2b0663afb330f899e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e0e92538e1f44b2b0663afb330f899e, State: Initialized, Role: FOLLOWER
I20260709 13:10:07.238584 26653 tablet_bootstrap.cc:492] T 3cb687f16fd34deea0dcb10953c99dda P b5189d1d1a034d8b92a7973b50ab5110: No bootstrap required, opened a new log
I20260709 13:10:07.238202 26651 consensus_queue.cc:260] T 5b44c782e9fd49aea2b89f4bf967e45b P 5e0e92538e1f44b2b0663afb330f899e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } }
I20260709 13:10:07.239216 26653 ts_tablet_manager.cc:1403] T 3cb687f16fd34deea0dcb10953c99dda P b5189d1d1a034d8b92a7973b50ab5110: Time spent bootstrapping tablet: real 0.050s	user 0.017s	sys 0.023s
I20260709 13:10:07.243021 26651 ts_tablet_manager.cc:1434] T 5b44c782e9fd49aea2b89f4bf967e45b P 5e0e92538e1f44b2b0663afb330f899e: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 13:10:07.243331 26653 raft_consensus.cc:359] T 3cb687f16fd34deea0dcb10953c99dda P b5189d1d1a034d8b92a7973b50ab5110 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:07.244257 26651 tablet_bootstrap.cc:492] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P 5e0e92538e1f44b2b0663afb330f899e: Bootstrap starting.
I20260709 13:10:07.244520 26653 raft_consensus.cc:385] T 3cb687f16fd34deea0dcb10953c99dda P b5189d1d1a034d8b92a7973b50ab5110 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:07.245026 26653 raft_consensus.cc:740] T 3cb687f16fd34deea0dcb10953c99dda P b5189d1d1a034d8b92a7973b50ab5110 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5189d1d1a034d8b92a7973b50ab5110, State: Initialized, Role: FOLLOWER
I20260709 13:10:07.246366 26653 consensus_queue.cc:260] T 3cb687f16fd34deea0dcb10953c99dda P b5189d1d1a034d8b92a7973b50ab5110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:07.249776 26653 ts_tablet_manager.cc:1434] T 3cb687f16fd34deea0dcb10953c99dda P b5189d1d1a034d8b92a7973b50ab5110: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:10:07.251355 26653 tablet_bootstrap.cc:492] T 0d9a4ae1c28749c08418e37aca35973c P b5189d1d1a034d8b92a7973b50ab5110: Bootstrap starting.
I20260709 13:10:07.254406 26651 tablet_bootstrap.cc:654] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P 5e0e92538e1f44b2b0663afb330f899e: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:07.258807 26652 tablet_bootstrap.cc:492] T 0d9a4ae1c28749c08418e37aca35973c P ff0fe65aa4b1405d84e4597f9aa7f87c: No bootstrap required, opened a new log
I20260709 13:10:07.259363 26652 ts_tablet_manager.cc:1403] T 0d9a4ae1c28749c08418e37aca35973c P ff0fe65aa4b1405d84e4597f9aa7f87c: Time spent bootstrapping tablet: real 0.030s	user 0.017s	sys 0.011s
I20260709 13:10:07.260121 26653 tablet_bootstrap.cc:654] T 0d9a4ae1c28749c08418e37aca35973c P b5189d1d1a034d8b92a7973b50ab5110: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:07.262416 26652 raft_consensus.cc:359] T 0d9a4ae1c28749c08418e37aca35973c P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:07.263293 26652 raft_consensus.cc:385] T 0d9a4ae1c28749c08418e37aca35973c P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:07.263597 26652 raft_consensus.cc:740] T 0d9a4ae1c28749c08418e37aca35973c P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff0fe65aa4b1405d84e4597f9aa7f87c, State: Initialized, Role: FOLLOWER
I20260709 13:10:07.264508 26652 consensus_queue.cc:260] T 0d9a4ae1c28749c08418e37aca35973c P ff0fe65aa4b1405d84e4597f9aa7f87c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
W20260709 13:10:07.265138 26408 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:07.267251 26652 ts_tablet_manager.cc:1434] T 0d9a4ae1c28749c08418e37aca35973c P ff0fe65aa4b1405d84e4597f9aa7f87c: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:10:07.269107 26652 tablet_bootstrap.cc:492] T 5b44c782e9fd49aea2b89f4bf967e45b P ff0fe65aa4b1405d84e4597f9aa7f87c: Bootstrap starting.
I20260709 13:10:07.271353 26653 tablet_bootstrap.cc:492] T 0d9a4ae1c28749c08418e37aca35973c P b5189d1d1a034d8b92a7973b50ab5110: No bootstrap required, opened a new log
I20260709 13:10:07.271355 26651 tablet_bootstrap.cc:492] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P 5e0e92538e1f44b2b0663afb330f899e: No bootstrap required, opened a new log
I20260709 13:10:07.272311 26653 ts_tablet_manager.cc:1403] T 0d9a4ae1c28749c08418e37aca35973c P b5189d1d1a034d8b92a7973b50ab5110: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.004s
I20260709 13:10:07.272791 26657 raft_consensus.cc:493] T dbd9c03cee964db394327f6d722ea62f P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.273341 26657 raft_consensus.cc:515] T dbd9c03cee964db394327f6d722ea62f P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:07.275748 26657 leader_election.cc:290] T dbd9c03cee964db394327f6d722ea62f P ff0fe65aa4b1405d84e4597f9aa7f87c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e0e92538e1f44b2b0663afb330f899e (127.14.180.66:46615), b5189d1d1a034d8b92a7973b50ab5110 (127.14.180.67:40219)
I20260709 13:10:07.272346 26651 ts_tablet_manager.cc:1403] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P 5e0e92538e1f44b2b0663afb330f899e: Time spent bootstrapping tablet: real 0.028s	user 0.015s	sys 0.006s
I20260709 13:10:07.277088 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbd9c03cee964db394327f6d722ea62f" candidate_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5189d1d1a034d8b92a7973b50ab5110" is_pre_election: true
I20260709 13:10:07.277690 26537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbd9c03cee964db394327f6d722ea62f" candidate_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0e92538e1f44b2b0663afb330f899e" is_pre_election: true
I20260709 13:10:07.278367 26537 raft_consensus.cc:2468] T dbd9c03cee964db394327f6d722ea62f P 5e0e92538e1f44b2b0663afb330f899e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff0fe65aa4b1405d84e4597f9aa7f87c in term 0.
W20260709 13:10:07.278728 26426 leader_election.cc:343] T dbd9c03cee964db394327f6d722ea62f P ff0fe65aa4b1405d84e4597f9aa7f87c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5189d1d1a034d8b92a7973b50ab5110 (127.14.180.67:40219): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:07.275978 26653 raft_consensus.cc:359] T 0d9a4ae1c28749c08418e37aca35973c P b5189d1d1a034d8b92a7973b50ab5110 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:07.279677 26653 raft_consensus.cc:385] T 0d9a4ae1c28749c08418e37aca35973c P b5189d1d1a034d8b92a7973b50ab5110 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:07.280068 26653 raft_consensus.cc:740] T 0d9a4ae1c28749c08418e37aca35973c P b5189d1d1a034d8b92a7973b50ab5110 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5189d1d1a034d8b92a7973b50ab5110, State: Initialized, Role: FOLLOWER
I20260709 13:10:07.279907 26427 leader_election.cc:304] T dbd9c03cee964db394327f6d722ea62f P ff0fe65aa4b1405d84e4597f9aa7f87c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e0e92538e1f44b2b0663afb330f899e, ff0fe65aa4b1405d84e4597f9aa7f87c; no voters: b5189d1d1a034d8b92a7973b50ab5110
I20260709 13:10:07.280478 26651 raft_consensus.cc:359] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P 5e0e92538e1f44b2b0663afb330f899e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:07.281370 26651 raft_consensus.cc:385] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P 5e0e92538e1f44b2b0663afb330f899e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:07.281665 26659 raft_consensus.cc:493] T 41be667b2c704042b4fa06f2d1480152 P 5e0e92538e1f44b2b0663afb330f899e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.281145 26653 consensus_queue.cc:260] T 0d9a4ae1c28749c08418e37aca35973c P b5189d1d1a034d8b92a7973b50ab5110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:07.281894 26657 raft_consensus.cc:2804] T dbd9c03cee964db394327f6d722ea62f P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:07.281724 26651 raft_consensus.cc:740] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P 5e0e92538e1f44b2b0663afb330f899e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e0e92538e1f44b2b0663afb330f899e, State: Initialized, Role: FOLLOWER
I20260709 13:10:07.282498 26657 raft_consensus.cc:493] T dbd9c03cee964db394327f6d722ea62f P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:07.282218 26659 raft_consensus.cc:515] T 41be667b2c704042b4fa06f2d1480152 P 5e0e92538e1f44b2b0663afb330f899e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:07.283026 26657 raft_consensus.cc:3060] T dbd9c03cee964db394327f6d722ea62f P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:07.276805 26652 tablet_bootstrap.cc:654] T 5b44c782e9fd49aea2b89f4bf967e45b P ff0fe65aa4b1405d84e4597f9aa7f87c: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:07.283303 26651 consensus_queue.cc:260] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P 5e0e92538e1f44b2b0663afb330f899e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:07.284790 26659 leader_election.cc:290] T 41be667b2c704042b4fa06f2d1480152 P 5e0e92538e1f44b2b0663afb330f899e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ff0fe65aa4b1405d84e4597f9aa7f87c (127.14.180.65:46829), b5189d1d1a034d8b92a7973b50ab5110 (127.14.180.67:40219)
I20260709 13:10:07.286144 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41be667b2c704042b4fa06f2d1480152" candidate_uuid: "5e0e92538e1f44b2b0663afb330f899e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5189d1d1a034d8b92a7973b50ab5110" is_pre_election: true
I20260709 13:10:07.286952 26611 raft_consensus.cc:2468] T 41be667b2c704042b4fa06f2d1480152 P b5189d1d1a034d8b92a7973b50ab5110 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0e92538e1f44b2b0663afb330f899e in term 0.
I20260709 13:10:07.288548 26501 leader_election.cc:304] T 41be667b2c704042b4fa06f2d1480152 P 5e0e92538e1f44b2b0663afb330f899e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0e92538e1f44b2b0663afb330f899e, b5189d1d1a034d8b92a7973b50ab5110; no voters: 
I20260709 13:10:07.288837 26653 ts_tablet_manager.cc:1434] T 0d9a4ae1c28749c08418e37aca35973c P b5189d1d1a034d8b92a7973b50ab5110: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.000s
I20260709 13:10:07.290397 26653 tablet_bootstrap.cc:492] T 9f5fec4f76024abe9c06d7e99531a089 P b5189d1d1a034d8b92a7973b50ab5110: Bootstrap starting.
I20260709 13:10:07.291543 26462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41be667b2c704042b4fa06f2d1480152" candidate_uuid: "5e0e92538e1f44b2b0663afb330f899e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" is_pre_election: true
W20260709 13:10:07.293629 26500 leader_election.cc:343] T 41be667b2c704042b4fa06f2d1480152 P 5e0e92538e1f44b2b0663afb330f899e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ff0fe65aa4b1405d84e4597f9aa7f87c (127.14.180.65:46829): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:07.297688 26653 tablet_bootstrap.cc:654] T 9f5fec4f76024abe9c06d7e99531a089 P b5189d1d1a034d8b92a7973b50ab5110: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:07.297246 26657 raft_consensus.cc:515] T dbd9c03cee964db394327f6d722ea62f P ff0fe65aa4b1405d84e4597f9aa7f87c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:07.302604 26678 raft_consensus.cc:493] T 9f5fec4f76024abe9c06d7e99531a089 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.302975 26657 leader_election.cc:290] T dbd9c03cee964db394327f6d722ea62f P ff0fe65aa4b1405d84e4597f9aa7f87c [CANDIDATE]: Term 1 election: Requested vote from peers 5e0e92538e1f44b2b0663afb330f899e (127.14.180.66:46615), b5189d1d1a034d8b92a7973b50ab5110 (127.14.180.67:40219)
I20260709 13:10:07.303345 26537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbd9c03cee964db394327f6d722ea62f" candidate_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0e92538e1f44b2b0663afb330f899e"
I20260709 13:10:07.304984 26537 raft_consensus.cc:3060] T dbd9c03cee964db394327f6d722ea62f P 5e0e92538e1f44b2b0663afb330f899e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:07.305188 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbd9c03cee964db394327f6d722ea62f" candidate_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5189d1d1a034d8b92a7973b50ab5110"
I20260709 13:10:07.306792 26652 tablet_bootstrap.cc:492] T 5b44c782e9fd49aea2b89f4bf967e45b P ff0fe65aa4b1405d84e4597f9aa7f87c: No bootstrap required, opened a new log
W20260709 13:10:07.307101 26426 leader_election.cc:343] T dbd9c03cee964db394327f6d722ea62f P ff0fe65aa4b1405d84e4597f9aa7f87c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b5189d1d1a034d8b92a7973b50ab5110 (127.14.180.67:40219): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:07.307430 26652 ts_tablet_manager.cc:1403] T 5b44c782e9fd49aea2b89f4bf967e45b P ff0fe65aa4b1405d84e4597f9aa7f87c: Time spent bootstrapping tablet: real 0.039s	user 0.013s	sys 0.002s
I20260709 13:10:07.303282 26678 raft_consensus.cc:515] T 9f5fec4f76024abe9c06d7e99531a089 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:07.312199 26659 raft_consensus.cc:2804] T 41be667b2c704042b4fa06f2d1480152 P 5e0e92538e1f44b2b0663afb330f899e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:07.313505 26678 leader_election.cc:290] T 9f5fec4f76024abe9c06d7e99531a089 P ff0fe65aa4b1405d84e4597f9aa7f87c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e0e92538e1f44b2b0663afb330f899e (127.14.180.66:46615), b5189d1d1a034d8b92a7973b50ab5110 (127.14.180.67:40219)
I20260709 13:10:07.310101 26652 raft_consensus.cc:359] T 5b44c782e9fd49aea2b89f4bf967e45b P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } }
I20260709 13:10:07.314404 26652 raft_consensus.cc:385] T 5b44c782e9fd49aea2b89f4bf967e45b P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:07.314891 26652 raft_consensus.cc:740] T 5b44c782e9fd49aea2b89f4bf967e45b P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff0fe65aa4b1405d84e4597f9aa7f87c, State: Initialized, Role: FOLLOWER
I20260709 13:10:07.315055 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fec4f76024abe9c06d7e99531a089" candidate_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5189d1d1a034d8b92a7973b50ab5110" is_pre_election: true
I20260709 13:10:07.315807 26536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fec4f76024abe9c06d7e99531a089" candidate_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0e92538e1f44b2b0663afb330f899e" is_pre_election: true
I20260709 13:10:07.315735 26652 consensus_queue.cc:260] T 5b44c782e9fd49aea2b89f4bf967e45b P ff0fe65aa4b1405d84e4597f9aa7f87c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } }
W20260709 13:10:07.316807 26426 leader_election.cc:343] T 9f5fec4f76024abe9c06d7e99531a089 P ff0fe65aa4b1405d84e4597f9aa7f87c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5189d1d1a034d8b92a7973b50ab5110 (127.14.180.67:40219): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:07.317117 26658 raft_consensus.cc:493] T 5b44c782e9fd49aea2b89f4bf967e45b P b5189d1d1a034d8b92a7973b50ab5110 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.317658 26658 raft_consensus.cc:515] T 5b44c782e9fd49aea2b89f4bf967e45b P b5189d1d1a034d8b92a7973b50ab5110 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } }
I20260709 13:10:07.318282 26651 ts_tablet_manager.cc:1434] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P 5e0e92538e1f44b2b0663afb330f899e: Time spent starting tablet: real 0.041s	user 0.012s	sys 0.002s
I20260709 13:10:07.318660 26652 ts_tablet_manager.cc:1434] T 5b44c782e9fd49aea2b89f4bf967e45b P ff0fe65aa4b1405d84e4597f9aa7f87c: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.001s
I20260709 13:10:07.319551 26651 tablet_bootstrap.cc:492] T 7275ca9585794b1c9cc06d7616e89c8d P 5e0e92538e1f44b2b0663afb330f899e: Bootstrap starting.
I20260709 13:10:07.319748 26652 tablet_bootstrap.cc:492] T 7aa0adb09fb048749ba647e2334a1585 P ff0fe65aa4b1405d84e4597f9aa7f87c: Bootstrap starting.
I20260709 13:10:07.322141 26462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b44c782e9fd49aea2b89f4bf967e45b" candidate_uuid: "b5189d1d1a034d8b92a7973b50ab5110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" is_pre_election: true
I20260709 13:10:07.322979 26462 raft_consensus.cc:2468] T 5b44c782e9fd49aea2b89f4bf967e45b P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5189d1d1a034d8b92a7973b50ab5110 in term 0.
I20260709 13:10:07.323855 26658 leader_election.cc:290] T 5b44c782e9fd49aea2b89f4bf967e45b P b5189d1d1a034d8b92a7973b50ab5110 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e0e92538e1f44b2b0663afb330f899e (127.14.180.66:46615), ff0fe65aa4b1405d84e4597f9aa7f87c (127.14.180.65:46829)
I20260709 13:10:07.325134 26574 leader_election.cc:304] T 5b44c782e9fd49aea2b89f4bf967e45b P b5189d1d1a034d8b92a7973b50ab5110 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5189d1d1a034d8b92a7973b50ab5110, ff0fe65aa4b1405d84e4597f9aa7f87c; no voters: 
I20260709 13:10:07.327090 26678 raft_consensus.cc:493] T 0d9a4ae1c28749c08418e37aca35973c P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.327502 26652 tablet_bootstrap.cc:654] T 7aa0adb09fb048749ba647e2334a1585 P ff0fe65aa4b1405d84e4597f9aa7f87c: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:07.327891 26651 tablet_bootstrap.cc:654] T 7275ca9585794b1c9cc06d7616e89c8d P 5e0e92538e1f44b2b0663afb330f899e: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:07.327661 26678 raft_consensus.cc:515] T 0d9a4ae1c28749c08418e37aca35973c P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:07.329908 26678 leader_election.cc:290] T 0d9a4ae1c28749c08418e37aca35973c P ff0fe65aa4b1405d84e4597f9aa7f87c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e0e92538e1f44b2b0663afb330f899e (127.14.180.66:46615), b5189d1d1a034d8b92a7973b50ab5110 (127.14.180.67:40219)
W20260709 13:10:07.331228 26427 leader_election.cc:343] T 9f5fec4f76024abe9c06d7e99531a089 P ff0fe65aa4b1405d84e4597f9aa7f87c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e0e92538e1f44b2b0663afb330f899e (127.14.180.66:46615): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:07.331487 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9a4ae1c28749c08418e37aca35973c" candidate_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5189d1d1a034d8b92a7973b50ab5110" is_pre_election: true
I20260709 13:10:07.332543 26611 raft_consensus.cc:2468] T 0d9a4ae1c28749c08418e37aca35973c P b5189d1d1a034d8b92a7973b50ab5110 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff0fe65aa4b1405d84e4597f9aa7f87c in term 0.
I20260709 13:10:07.333218 26535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9a4ae1c28749c08418e37aca35973c" candidate_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0e92538e1f44b2b0663afb330f899e" is_pre_election: true
I20260709 13:10:07.333518 26536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b44c782e9fd49aea2b89f4bf967e45b" candidate_uuid: "b5189d1d1a034d8b92a7973b50ab5110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0e92538e1f44b2b0663afb330f899e" is_pre_election: true
I20260709 13:10:07.334141 26536 raft_consensus.cc:2468] T 5b44c782e9fd49aea2b89f4bf967e45b P 5e0e92538e1f44b2b0663afb330f899e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5189d1d1a034d8b92a7973b50ab5110 in term 0.
I20260709 13:10:07.334460 26426 leader_election.cc:304] T 0d9a4ae1c28749c08418e37aca35973c P ff0fe65aa4b1405d84e4597f9aa7f87c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5189d1d1a034d8b92a7973b50ab5110, ff0fe65aa4b1405d84e4597f9aa7f87c; no voters: 
I20260709 13:10:07.332985 26658 raft_consensus.cc:2804] T 5b44c782e9fd49aea2b89f4bf967e45b P b5189d1d1a034d8b92a7973b50ab5110 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:07.335569 26658 raft_consensus.cc:493] T 5b44c782e9fd49aea2b89f4bf967e45b P b5189d1d1a034d8b92a7973b50ab5110 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:07.335922 26658 raft_consensus.cc:3060] T 5b44c782e9fd49aea2b89f4bf967e45b P b5189d1d1a034d8b92a7973b50ab5110 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:07.331800 26427 leader_election.cc:304] T 9f5fec4f76024abe9c06d7e99531a089 P ff0fe65aa4b1405d84e4597f9aa7f87c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ff0fe65aa4b1405d84e4597f9aa7f87c; no voters: 5e0e92538e1f44b2b0663afb330f899e, b5189d1d1a034d8b92a7973b50ab5110
I20260709 13:10:07.337818 26678 raft_consensus.cc:2804] T 0d9a4ae1c28749c08418e37aca35973c P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:07.338281 26678 raft_consensus.cc:493] T 0d9a4ae1c28749c08418e37aca35973c P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:07.338402 26427 leader_election.cc:343] T 0d9a4ae1c28749c08418e37aca35973c P ff0fe65aa4b1405d84e4597f9aa7f87c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e0e92538e1f44b2b0663afb330f899e (127.14.180.66:46615): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:07.338851 26678 raft_consensus.cc:3060] T 0d9a4ae1c28749c08418e37aca35973c P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:07.342633 26659 raft_consensus.cc:493] T 41be667b2c704042b4fa06f2d1480152 P 5e0e92538e1f44b2b0663afb330f899e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:07.343185 26659 raft_consensus.cc:3060] T 41be667b2c704042b4fa06f2d1480152 P 5e0e92538e1f44b2b0663afb330f899e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:07.343678 26653 tablet_bootstrap.cc:492] T 9f5fec4f76024abe9c06d7e99531a089 P b5189d1d1a034d8b92a7973b50ab5110: No bootstrap required, opened a new log
I20260709 13:10:07.344463 26653 ts_tablet_manager.cc:1403] T 9f5fec4f76024abe9c06d7e99531a089 P b5189d1d1a034d8b92a7973b50ab5110: Time spent bootstrapping tablet: real 0.054s	user 0.021s	sys 0.004s
I20260709 13:10:07.348943 26653 raft_consensus.cc:359] T 9f5fec4f76024abe9c06d7e99531a089 P b5189d1d1a034d8b92a7973b50ab5110 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:07.350116 26653 raft_consensus.cc:385] T 9f5fec4f76024abe9c06d7e99531a089 P b5189d1d1a034d8b92a7973b50ab5110 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:07.353186 26657 raft_consensus.cc:2749] T 9f5fec4f76024abe9c06d7e99531a089 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:07.349161 26678 raft_consensus.cc:515] T 0d9a4ae1c28749c08418e37aca35973c P ff0fe65aa4b1405d84e4597f9aa7f87c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:07.358732 26652 tablet_bootstrap.cc:492] T 7aa0adb09fb048749ba647e2334a1585 P ff0fe65aa4b1405d84e4597f9aa7f87c: No bootstrap required, opened a new log
I20260709 13:10:07.359097 26537 raft_consensus.cc:2468] T dbd9c03cee964db394327f6d722ea62f P 5e0e92538e1f44b2b0663afb330f899e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff0fe65aa4b1405d84e4597f9aa7f87c in term 1.
I20260709 13:10:07.355866 26653 raft_consensus.cc:740] T 9f5fec4f76024abe9c06d7e99531a089 P b5189d1d1a034d8b92a7973b50ab5110 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5189d1d1a034d8b92a7973b50ab5110, State: Initialized, Role: FOLLOWER
I20260709 13:10:07.360813 26427 leader_election.cc:304] T dbd9c03cee964db394327f6d722ea62f P ff0fe65aa4b1405d84e4597f9aa7f87c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e0e92538e1f44b2b0663afb330f899e, ff0fe65aa4b1405d84e4597f9aa7f87c; no voters: b5189d1d1a034d8b92a7973b50ab5110
I20260709 13:10:07.361270 26536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9a4ae1c28749c08418e37aca35973c" candidate_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0e92538e1f44b2b0663afb330f899e"
I20260709 13:10:07.361255 26653 consensus_queue.cc:260] T 9f5fec4f76024abe9c06d7e99531a089 P b5189d1d1a034d8b92a7973b50ab5110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
W20260709 13:10:07.363116 26427 leader_election.cc:343] T 0d9a4ae1c28749c08418e37aca35973c P ff0fe65aa4b1405d84e4597f9aa7f87c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5e0e92538e1f44b2b0663afb330f899e (127.14.180.66:46615): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:07.364280 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9a4ae1c28749c08418e37aca35973c" candidate_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5189d1d1a034d8b92a7973b50ab5110"
I20260709 13:10:07.365249 26611 raft_consensus.cc:3060] T 0d9a4ae1c28749c08418e37aca35973c P b5189d1d1a034d8b92a7973b50ab5110 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:07.374754 26657 raft_consensus.cc:2804] T dbd9c03cee964db394327f6d722ea62f P ff0fe65aa4b1405d84e4597f9aa7f87c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:07.360919 26678 leader_election.cc:290] T 0d9a4ae1c28749c08418e37aca35973c P ff0fe65aa4b1405d84e4597f9aa7f87c [CANDIDATE]: Term 1 election: Requested vote from peers 5e0e92538e1f44b2b0663afb330f899e (127.14.180.66:46615), b5189d1d1a034d8b92a7973b50ab5110 (127.14.180.67:40219)
I20260709 13:10:07.359603 26652 ts_tablet_manager.cc:1403] T 7aa0adb09fb048749ba647e2334a1585 P ff0fe65aa4b1405d84e4597f9aa7f87c: Time spent bootstrapping tablet: real 0.040s	user 0.016s	sys 0.022s
I20260709 13:10:07.381896 26658 raft_consensus.cc:515] T 5b44c782e9fd49aea2b89f4bf967e45b P b5189d1d1a034d8b92a7973b50ab5110 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } }
I20260709 13:10:07.382639 26678 raft_consensus.cc:493] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.382485 26652 raft_consensus.cc:359] T 7aa0adb09fb048749ba647e2334a1585 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:07.388374 26678 raft_consensus.cc:515] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:07.389035 26652 raft_consensus.cc:385] T 7aa0adb09fb048749ba647e2334a1585 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:07.389564 26652 raft_consensus.cc:740] T 7aa0adb09fb048749ba647e2334a1585 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff0fe65aa4b1405d84e4597f9aa7f87c, State: Initialized, Role: FOLLOWER
I20260709 13:10:07.386276 26536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b44c782e9fd49aea2b89f4bf967e45b" candidate_uuid: "b5189d1d1a034d8b92a7973b50ab5110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0e92538e1f44b2b0663afb330f899e"
I20260709 13:10:07.391099 26536 raft_consensus.cc:3060] T 5b44c782e9fd49aea2b89f4bf967e45b P 5e0e92538e1f44b2b0663afb330f899e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:07.391635 26651 tablet_bootstrap.cc:492] T 7275ca9585794b1c9cc06d7616e89c8d P 5e0e92538e1f44b2b0663afb330f899e: No bootstrap required, opened a new log
I20260709 13:10:07.392472 26651 ts_tablet_manager.cc:1403] T 7275ca9585794b1c9cc06d7616e89c8d P 5e0e92538e1f44b2b0663afb330f899e: Time spent bootstrapping tablet: real 0.073s	user 0.031s	sys 0.018s
I20260709 13:10:07.392864 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fdfdfcbfbd476e99db1fb5b3fc4e40" candidate_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5189d1d1a034d8b92a7973b50ab5110" is_pre_election: true
I20260709 13:10:07.393690 26610 raft_consensus.cc:2468] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P b5189d1d1a034d8b92a7973b50ab5110 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff0fe65aa4b1405d84e4597f9aa7f87c in term 0.
I20260709 13:10:07.395254 26426 leader_election.cc:304] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P ff0fe65aa4b1405d84e4597f9aa7f87c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5189d1d1a034d8b92a7973b50ab5110, ff0fe65aa4b1405d84e4597f9aa7f87c; no voters: 
I20260709 13:10:07.395925 26535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fdfdfcbfbd476e99db1fb5b3fc4e40" candidate_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0e92538e1f44b2b0663afb330f899e" is_pre_election: true
I20260709 13:10:07.396420 26686 raft_consensus.cc:2804] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:07.387207 26657 raft_consensus.cc:697] T dbd9c03cee964db394327f6d722ea62f P ff0fe65aa4b1405d84e4597f9aa7f87c [term 1 LEADER]: Becoming Leader. State: Replica: ff0fe65aa4b1405d84e4597f9aa7f87c, State: Running, Role: LEADER
I20260709 13:10:07.396544 26659 raft_consensus.cc:515] T 41be667b2c704042b4fa06f2d1480152 P 5e0e92538e1f44b2b0663afb330f899e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:07.397502 26686 raft_consensus.cc:493] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:07.397935 26686 raft_consensus.cc:3060] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:07.397020 26678 leader_election.cc:290] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P ff0fe65aa4b1405d84e4597f9aa7f87c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e0e92538e1f44b2b0663afb330f899e (127.14.180.66:46615), b5189d1d1a034d8b92a7973b50ab5110 (127.14.180.67:40219)
I20260709 13:10:07.398087 26657 consensus_queue.cc:237] T dbd9c03cee964db394327f6d722ea62f P ff0fe65aa4b1405d84e4597f9aa7f87c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:07.396759 26535 raft_consensus.cc:2468] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P 5e0e92538e1f44b2b0663afb330f899e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff0fe65aa4b1405d84e4597f9aa7f87c in term 0.
I20260709 13:10:07.400032 26652 consensus_queue.cc:260] T 7aa0adb09fb048749ba647e2334a1585 P ff0fe65aa4b1405d84e4597f9aa7f87c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:07.403369 26659 leader_election.cc:290] T 41be667b2c704042b4fa06f2d1480152 P 5e0e92538e1f44b2b0663afb330f899e [CANDIDATE]: Term 1 election: Requested vote from peers ff0fe65aa4b1405d84e4597f9aa7f87c (127.14.180.65:46829), b5189d1d1a034d8b92a7973b50ab5110 (127.14.180.67:40219)
I20260709 13:10:07.403998 26462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41be667b2c704042b4fa06f2d1480152" candidate_uuid: "5e0e92538e1f44b2b0663afb330f899e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c"
I20260709 13:10:07.406008 26653 ts_tablet_manager.cc:1434] T 9f5fec4f76024abe9c06d7e99531a089 P b5189d1d1a034d8b92a7973b50ab5110: Time spent starting tablet: real 0.061s	user 0.019s	sys 0.008s
I20260709 13:10:07.405824 26651 raft_consensus.cc:359] T 7275ca9585794b1c9cc06d7616e89c8d P 5e0e92538e1f44b2b0663afb330f899e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:07.386165 26611 raft_consensus.cc:2468] T 0d9a4ae1c28749c08418e37aca35973c P b5189d1d1a034d8b92a7973b50ab5110 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff0fe65aa4b1405d84e4597f9aa7f87c in term 1.
I20260709 13:10:07.409694 26686 raft_consensus.cc:515] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:07.411279 26651 raft_consensus.cc:385] T 7275ca9585794b1c9cc06d7616e89c8d P 5e0e92538e1f44b2b0663afb330f899e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:07.415555 26651 raft_consensus.cc:740] T 7275ca9585794b1c9cc06d7616e89c8d P 5e0e92538e1f44b2b0663afb330f899e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e0e92538e1f44b2b0663afb330f899e, State: Initialized, Role: FOLLOWER
W20260709 13:10:07.411792 26500 leader_election.cc:343] T 41be667b2c704042b4fa06f2d1480152 P 5e0e92538e1f44b2b0663afb330f899e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ff0fe65aa4b1405d84e4597f9aa7f87c (127.14.180.65:46829): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:07.415853 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fdfdfcbfbd476e99db1fb5b3fc4e40" candidate_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5189d1d1a034d8b92a7973b50ab5110"
I20260709 13:10:07.416647 26610 raft_consensus.cc:3060] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P b5189d1d1a034d8b92a7973b50ab5110 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:07.417047 26651 consensus_queue.cc:260] T 7275ca9585794b1c9cc06d7616e89c8d P 5e0e92538e1f44b2b0663afb330f899e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:07.415041 26685 raft_consensus.cc:493] T 3cb687f16fd34deea0dcb10953c99dda P b5189d1d1a034d8b92a7973b50ab5110 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.415575 26658 leader_election.cc:290] T 5b44c782e9fd49aea2b89f4bf967e45b P b5189d1d1a034d8b92a7973b50ab5110 [CANDIDATE]: Term 1 election: Requested vote from peers 5e0e92538e1f44b2b0663afb330f899e (127.14.180.66:46615), ff0fe65aa4b1405d84e4597f9aa7f87c (127.14.180.65:46829)
I20260709 13:10:07.418766 26685 raft_consensus.cc:515] T 3cb687f16fd34deea0dcb10953c99dda P b5189d1d1a034d8b92a7973b50ab5110 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:07.419492 26462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b44c782e9fd49aea2b89f4bf967e45b" candidate_uuid: "b5189d1d1a034d8b92a7973b50ab5110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c"
I20260709 13:10:07.420255 26462 raft_consensus.cc:3060] T 5b44c782e9fd49aea2b89f4bf967e45b P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:07.420653 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41be667b2c704042b4fa06f2d1480152" candidate_uuid: "5e0e92538e1f44b2b0663afb330f899e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5189d1d1a034d8b92a7973b50ab5110"
I20260709 13:10:07.421307 26611 raft_consensus.cc:3060] T 41be667b2c704042b4fa06f2d1480152 P b5189d1d1a034d8b92a7973b50ab5110 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:07.421531 26685 leader_election.cc:290] T 3cb687f16fd34deea0dcb10953c99dda P b5189d1d1a034d8b92a7973b50ab5110 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ff0fe65aa4b1405d84e4597f9aa7f87c (127.14.180.65:46829), 5e0e92538e1f44b2b0663afb330f899e (127.14.180.66:46615)
I20260709 13:10:07.414942 26535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fdfdfcbfbd476e99db1fb5b3fc4e40" candidate_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0e92538e1f44b2b0663afb330f899e"
I20260709 13:10:07.422941 26535 raft_consensus.cc:3060] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P 5e0e92538e1f44b2b0663afb330f899e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:07.423410 26461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb687f16fd34deea0dcb10953c99dda" candidate_uuid: "b5189d1d1a034d8b92a7973b50ab5110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" is_pre_election: true
I20260709 13:10:07.424293 26651 ts_tablet_manager.cc:1434] T 7275ca9585794b1c9cc06d7616e89c8d P 5e0e92538e1f44b2b0663afb330f899e: Time spent starting tablet: real 0.031s	user 0.009s	sys 0.002s
I20260709 13:10:07.425154 26426 leader_election.cc:304] T 0d9a4ae1c28749c08418e37aca35973c P ff0fe65aa4b1405d84e4597f9aa7f87c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5189d1d1a034d8b92a7973b50ab5110, ff0fe65aa4b1405d84e4597f9aa7f87c; no voters: 5e0e92538e1f44b2b0663afb330f899e
I20260709 13:10:07.425575 26651 tablet_bootstrap.cc:492] T 3cb687f16fd34deea0dcb10953c99dda P 5e0e92538e1f44b2b0663afb330f899e: Bootstrap starting.
I20260709 13:10:07.434314 26651 tablet_bootstrap.cc:654] T 3cb687f16fd34deea0dcb10953c99dda P 5e0e92538e1f44b2b0663afb330f899e: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:07.410392 26536 raft_consensus.cc:2468] T 5b44c782e9fd49aea2b89f4bf967e45b P 5e0e92538e1f44b2b0663afb330f899e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5189d1d1a034d8b92a7973b50ab5110 in term 1.
I20260709 13:10:07.417995 26686 leader_election.cc:290] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P ff0fe65aa4b1405d84e4597f9aa7f87c [CANDIDATE]: Term 1 election: Requested vote from peers 5e0e92538e1f44b2b0663afb330f899e (127.14.180.66:46615), b5189d1d1a034d8b92a7973b50ab5110 (127.14.180.67:40219)
I20260709 13:10:07.439622 26678 raft_consensus.cc:2804] T 0d9a4ae1c28749c08418e37aca35973c P ff0fe65aa4b1405d84e4597f9aa7f87c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:07.440456 26678 raft_consensus.cc:697] T 0d9a4ae1c28749c08418e37aca35973c P ff0fe65aa4b1405d84e4597f9aa7f87c [term 1 LEADER]: Becoming Leader. State: Replica: ff0fe65aa4b1405d84e4597f9aa7f87c, State: Running, Role: LEADER
I20260709 13:10:07.418121 26653 tablet_bootstrap.cc:492] T 7aa0adb09fb048749ba647e2334a1585 P b5189d1d1a034d8b92a7973b50ab5110: Bootstrap starting.
I20260709 13:10:07.443931 26576 leader_election.cc:304] T 5b44c782e9fd49aea2b89f4bf967e45b P b5189d1d1a034d8b92a7973b50ab5110 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0e92538e1f44b2b0663afb330f899e, b5189d1d1a034d8b92a7973b50ab5110; no voters: 
I20260709 13:10:07.445294 26685 raft_consensus.cc:2804] T 5b44c782e9fd49aea2b89f4bf967e45b P b5189d1d1a034d8b92a7973b50ab5110 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:07.445884 26685 raft_consensus.cc:697] T 5b44c782e9fd49aea2b89f4bf967e45b P b5189d1d1a034d8b92a7973b50ab5110 [term 1 LEADER]: Becoming Leader. State: Replica: b5189d1d1a034d8b92a7973b50ab5110, State: Running, Role: LEADER
I20260709 13:10:07.437886 26537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb687f16fd34deea0dcb10953c99dda" candidate_uuid: "b5189d1d1a034d8b92a7973b50ab5110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0e92538e1f44b2b0663afb330f899e" is_pre_election: true
I20260709 13:10:07.424301 26461 raft_consensus.cc:2468] T 3cb687f16fd34deea0dcb10953c99dda P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5189d1d1a034d8b92a7973b50ab5110 in term 0.
I20260709 13:10:07.413915 26652 ts_tablet_manager.cc:1434] T 7aa0adb09fb048749ba647e2334a1585 P ff0fe65aa4b1405d84e4597f9aa7f87c: Time spent starting tablet: real 0.036s	user 0.008s	sys 0.001s
I20260709 13:10:07.446904 26685 consensus_queue.cc:237] T 5b44c782e9fd49aea2b89f4bf967e45b P b5189d1d1a034d8b92a7973b50ab5110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } }
W20260709 13:10:07.447872 26576 leader_election.cc:343] T 3cb687f16fd34deea0dcb10953c99dda P b5189d1d1a034d8b92a7973b50ab5110 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e0e92538e1f44b2b0663afb330f899e (127.14.180.66:46615): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:07.448390 26652 tablet_bootstrap.cc:492] T 41be667b2c704042b4fa06f2d1480152 P ff0fe65aa4b1405d84e4597f9aa7f87c: Bootstrap starting.
I20260709 13:10:07.451031 26653 tablet_bootstrap.cc:654] T 7aa0adb09fb048749ba647e2334a1585 P b5189d1d1a034d8b92a7973b50ab5110: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:07.453148 26574 leader_election.cc:304] T 3cb687f16fd34deea0dcb10953c99dda P b5189d1d1a034d8b92a7973b50ab5110 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5189d1d1a034d8b92a7973b50ab5110, ff0fe65aa4b1405d84e4597f9aa7f87c; no voters: 5e0e92538e1f44b2b0663afb330f899e
I20260709 13:10:07.454676 26611 raft_consensus.cc:2468] T 41be667b2c704042b4fa06f2d1480152 P b5189d1d1a034d8b92a7973b50ab5110 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e0e92538e1f44b2b0663afb330f899e in term 1.
I20260709 13:10:07.454823 26683 raft_consensus.cc:2804] T 3cb687f16fd34deea0dcb10953c99dda P b5189d1d1a034d8b92a7973b50ab5110 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:07.455577 26683 raft_consensus.cc:493] T 3cb687f16fd34deea0dcb10953c99dda P b5189d1d1a034d8b92a7973b50ab5110 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:07.456041 26683 raft_consensus.cc:3060] T 3cb687f16fd34deea0dcb10953c99dda P b5189d1d1a034d8b92a7973b50ab5110 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:07.456810 26501 leader_election.cc:304] T 41be667b2c704042b4fa06f2d1480152 P 5e0e92538e1f44b2b0663afb330f899e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e0e92538e1f44b2b0663afb330f899e, b5189d1d1a034d8b92a7973b50ab5110; no voters: ff0fe65aa4b1405d84e4597f9aa7f87c
I20260709 13:10:07.441792 26678 consensus_queue.cc:237] T 0d9a4ae1c28749c08418e37aca35973c P ff0fe65aa4b1405d84e4597f9aa7f87c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:07.463688 26659 raft_consensus.cc:2804] T 41be667b2c704042b4fa06f2d1480152 P 5e0e92538e1f44b2b0663afb330f899e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:07.464761 26659 raft_consensus.cc:697] T 41be667b2c704042b4fa06f2d1480152 P 5e0e92538e1f44b2b0663afb330f899e [term 1 LEADER]: Becoming Leader. State: Replica: 5e0e92538e1f44b2b0663afb330f899e, State: Running, Role: LEADER
I20260709 13:10:07.465965 26659 consensus_queue.cc:237] T 41be667b2c704042b4fa06f2d1480152 P 5e0e92538e1f44b2b0663afb330f899e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:07.470049 26683 raft_consensus.cc:515] T 3cb687f16fd34deea0dcb10953c99dda P b5189d1d1a034d8b92a7973b50ab5110 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:07.470435 26462 raft_consensus.cc:2468] T 5b44c782e9fd49aea2b89f4bf967e45b P ff0fe65aa4b1405d84e4597f9aa7f87c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5189d1d1a034d8b92a7973b50ab5110 in term 1.
I20260709 13:10:07.457310 26535 raft_consensus.cc:2468] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P 5e0e92538e1f44b2b0663afb330f899e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff0fe65aa4b1405d84e4597f9aa7f87c in term 1.
I20260709 13:10:07.443985 26610 raft_consensus.cc:2468] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P b5189d1d1a034d8b92a7973b50ab5110 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff0fe65aa4b1405d84e4597f9aa7f87c in term 1.
I20260709 13:10:07.481894 26426 leader_election.cc:304] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P ff0fe65aa4b1405d84e4597f9aa7f87c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5189d1d1a034d8b92a7973b50ab5110, ff0fe65aa4b1405d84e4597f9aa7f87c; no voters: 
I20260709 13:10:07.483129 26686 raft_consensus.cc:2804] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:07.483745 26686 raft_consensus.cc:697] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 1 LEADER]: Becoming Leader. State: Replica: ff0fe65aa4b1405d84e4597f9aa7f87c, State: Running, Role: LEADER
I20260709 13:10:07.484138 26652 tablet_bootstrap.cc:654] T 41be667b2c704042b4fa06f2d1480152 P ff0fe65aa4b1405d84e4597f9aa7f87c: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:07.484824 26686 consensus_queue.cc:237] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P ff0fe65aa4b1405d84e4597f9aa7f87c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:07.492775 26535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb687f16fd34deea0dcb10953c99dda" candidate_uuid: "b5189d1d1a034d8b92a7973b50ab5110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0e92538e1f44b2b0663afb330f899e"
I20260709 13:10:07.492539 26462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb687f16fd34deea0dcb10953c99dda" candidate_uuid: "b5189d1d1a034d8b92a7973b50ab5110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c"
I20260709 13:10:07.491165 26683 leader_election.cc:290] T 3cb687f16fd34deea0dcb10953c99dda P b5189d1d1a034d8b92a7973b50ab5110 [CANDIDATE]: Term 1 election: Requested vote from peers ff0fe65aa4b1405d84e4597f9aa7f87c (127.14.180.65:46829), 5e0e92538e1f44b2b0663afb330f899e (127.14.180.66:46615)
I20260709 13:10:07.497202 26462 raft_consensus.cc:3060] T 3cb687f16fd34deea0dcb10953c99dda P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:07.506373 26653 tablet_bootstrap.cc:492] T 7aa0adb09fb048749ba647e2334a1585 P b5189d1d1a034d8b92a7973b50ab5110: No bootstrap required, opened a new log
I20260709 13:10:07.507320 26653 ts_tablet_manager.cc:1403] T 7aa0adb09fb048749ba647e2334a1585 P b5189d1d1a034d8b92a7973b50ab5110: Time spent bootstrapping tablet: real 0.089s	user 0.026s	sys 0.010s
I20260709 13:10:07.509078 26462 raft_consensus.cc:2468] T 3cb687f16fd34deea0dcb10953c99dda P ff0fe65aa4b1405d84e4597f9aa7f87c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5189d1d1a034d8b92a7973b50ab5110 in term 1.
W20260709 13:10:07.511469 26576 leader_election.cc:343] T 3cb687f16fd34deea0dcb10953c99dda P b5189d1d1a034d8b92a7973b50ab5110 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5e0e92538e1f44b2b0663afb330f899e (127.14.180.66:46615): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:07.512094 26653 raft_consensus.cc:359] T 7aa0adb09fb048749ba647e2334a1585 P b5189d1d1a034d8b92a7973b50ab5110 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:07.513222 26653 raft_consensus.cc:385] T 7aa0adb09fb048749ba647e2334a1585 P b5189d1d1a034d8b92a7973b50ab5110 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:07.513825 26653 raft_consensus.cc:740] T 7aa0adb09fb048749ba647e2334a1585 P b5189d1d1a034d8b92a7973b50ab5110 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5189d1d1a034d8b92a7973b50ab5110, State: Initialized, Role: FOLLOWER
I20260709 13:10:07.515152 26653 consensus_queue.cc:260] T 7aa0adb09fb048749ba647e2334a1585 P b5189d1d1a034d8b92a7973b50ab5110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:07.517200 26574 leader_election.cc:304] T 3cb687f16fd34deea0dcb10953c99dda P b5189d1d1a034d8b92a7973b50ab5110 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5189d1d1a034d8b92a7973b50ab5110, ff0fe65aa4b1405d84e4597f9aa7f87c; no voters: 5e0e92538e1f44b2b0663afb330f899e
I20260709 13:10:07.498242 26358 catalog_manager.cc:5697] T 41be667b2c704042b4fa06f2d1480152 P 5e0e92538e1f44b2b0663afb330f899e reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e0e92538e1f44b2b0663afb330f899e (127.14.180.66). New cstate: current_term: 1 leader_uuid: "5e0e92538e1f44b2b0663afb330f899e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:07.515053 26359 catalog_manager.cc:5697] T dbd9c03cee964db394327f6d722ea62f P ff0fe65aa4b1405d84e4597f9aa7f87c reported cstate change: term changed from 0 to 1, leader changed from <none> to ff0fe65aa4b1405d84e4597f9aa7f87c (127.14.180.65). New cstate: current_term: 1 leader_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:07.519536 26685 raft_consensus.cc:2804] T 3cb687f16fd34deea0dcb10953c99dda P b5189d1d1a034d8b92a7973b50ab5110 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:07.520334 26685 raft_consensus.cc:697] T 3cb687f16fd34deea0dcb10953c99dda P b5189d1d1a034d8b92a7973b50ab5110 [term 1 LEADER]: Becoming Leader. State: Replica: b5189d1d1a034d8b92a7973b50ab5110, State: Running, Role: LEADER
I20260709 13:10:07.521524 26685 consensus_queue.cc:237] T 3cb687f16fd34deea0dcb10953c99dda P b5189d1d1a034d8b92a7973b50ab5110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:07.528393 26360 catalog_manager.cc:5697] T 5b44c782e9fd49aea2b89f4bf967e45b P b5189d1d1a034d8b92a7973b50ab5110 reported cstate change: term changed from 0 to 1, leader changed from <none> to b5189d1d1a034d8b92a7973b50ab5110 (127.14.180.67). New cstate: current_term: 1 leader_uuid: "b5189d1d1a034d8b92a7973b50ab5110" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:07.534067 26653 ts_tablet_manager.cc:1434] T 7aa0adb09fb048749ba647e2334a1585 P b5189d1d1a034d8b92a7973b50ab5110: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.005s
I20260709 13:10:07.535348 26653 tablet_bootstrap.cc:492] T dbd9c03cee964db394327f6d722ea62f P b5189d1d1a034d8b92a7973b50ab5110: Bootstrap starting.
I20260709 13:10:07.536144 26651 tablet_bootstrap.cc:492] T 3cb687f16fd34deea0dcb10953c99dda P 5e0e92538e1f44b2b0663afb330f899e: No bootstrap required, opened a new log
I20260709 13:10:07.536736 26651 ts_tablet_manager.cc:1403] T 3cb687f16fd34deea0dcb10953c99dda P 5e0e92538e1f44b2b0663afb330f899e: Time spent bootstrapping tablet: real 0.111s	user 0.013s	sys 0.016s
I20260709 13:10:07.545543 26653 tablet_bootstrap.cc:654] T dbd9c03cee964db394327f6d722ea62f P b5189d1d1a034d8b92a7973b50ab5110: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:07.547050 26651 raft_consensus.cc:359] T 3cb687f16fd34deea0dcb10953c99dda P 5e0e92538e1f44b2b0663afb330f899e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:07.547916 26651 raft_consensus.cc:385] T 3cb687f16fd34deea0dcb10953c99dda P 5e0e92538e1f44b2b0663afb330f899e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:07.548216 26651 raft_consensus.cc:740] T 3cb687f16fd34deea0dcb10953c99dda P 5e0e92538e1f44b2b0663afb330f899e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e0e92538e1f44b2b0663afb330f899e, State: Initialized, Role: FOLLOWER
I20260709 13:10:07.549399 26651 consensus_queue.cc:260] T 3cb687f16fd34deea0dcb10953c99dda P 5e0e92538e1f44b2b0663afb330f899e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:07.556919 26651 ts_tablet_manager.cc:1434] T 3cb687f16fd34deea0dcb10953c99dda P 5e0e92538e1f44b2b0663afb330f899e: Time spent starting tablet: real 0.020s	user 0.010s	sys 0.000s
I20260709 13:10:07.558648 26651 tablet_bootstrap.cc:492] T 7aa0adb09fb048749ba647e2334a1585 P 5e0e92538e1f44b2b0663afb330f899e: Bootstrap starting.
I20260709 13:10:07.562084 26652 tablet_bootstrap.cc:492] T 41be667b2c704042b4fa06f2d1480152 P ff0fe65aa4b1405d84e4597f9aa7f87c: No bootstrap required, opened a new log
I20260709 13:10:07.563284 26652 ts_tablet_manager.cc:1403] T 41be667b2c704042b4fa06f2d1480152 P ff0fe65aa4b1405d84e4597f9aa7f87c: Time spent bootstrapping tablet: real 0.115s	user 0.029s	sys 0.016s
I20260709 13:10:07.564254 26683 raft_consensus.cc:493] T 9f5fec4f76024abe9c06d7e99531a089 P b5189d1d1a034d8b92a7973b50ab5110 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.564666 26659 raft_consensus.cc:493] T 7275ca9585794b1c9cc06d7616e89c8d P 5e0e92538e1f44b2b0663afb330f899e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.564839 26683 raft_consensus.cc:515] T 9f5fec4f76024abe9c06d7e99531a089 P b5189d1d1a034d8b92a7973b50ab5110 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:07.565189 26659 raft_consensus.cc:515] T 7275ca9585794b1c9cc06d7616e89c8d P 5e0e92538e1f44b2b0663afb330f899e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:07.567487 26652 raft_consensus.cc:359] T 41be667b2c704042b4fa06f2d1480152 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:07.569022 26652 raft_consensus.cc:385] T 41be667b2c704042b4fa06f2d1480152 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:07.568893 26461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fec4f76024abe9c06d7e99531a089" candidate_uuid: "b5189d1d1a034d8b92a7973b50ab5110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" is_pre_election: true
I20260709 13:10:07.569731 26652 raft_consensus.cc:740] T 41be667b2c704042b4fa06f2d1480152 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff0fe65aa4b1405d84e4597f9aa7f87c, State: Initialized, Role: FOLLOWER
I20260709 13:10:07.570137 26461 raft_consensus.cc:2468] T 9f5fec4f76024abe9c06d7e99531a089 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5189d1d1a034d8b92a7973b50ab5110 in term 0.
I20260709 13:10:07.570907 26535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fec4f76024abe9c06d7e99531a089" candidate_uuid: "b5189d1d1a034d8b92a7973b50ab5110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0e92538e1f44b2b0663afb330f899e" is_pre_election: true
I20260709 13:10:07.570979 26652 consensus_queue.cc:260] T 41be667b2c704042b4fa06f2d1480152 P ff0fe65aa4b1405d84e4597f9aa7f87c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:07.568986 26683 leader_election.cc:290] T 9f5fec4f76024abe9c06d7e99531a089 P b5189d1d1a034d8b92a7973b50ab5110 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ff0fe65aa4b1405d84e4597f9aa7f87c (127.14.180.65:46829), 5e0e92538e1f44b2b0663afb330f899e (127.14.180.66:46615)
I20260709 13:10:07.571640 26574 leader_election.cc:304] T 9f5fec4f76024abe9c06d7e99531a089 P b5189d1d1a034d8b92a7973b50ab5110 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5189d1d1a034d8b92a7973b50ab5110, ff0fe65aa4b1405d84e4597f9aa7f87c; no voters: 
I20260709 13:10:07.572304 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7275ca9585794b1c9cc06d7616e89c8d" candidate_uuid: "5e0e92538e1f44b2b0663afb330f899e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5189d1d1a034d8b92a7973b50ab5110" is_pre_election: true
I20260709 13:10:07.572937 26683 raft_consensus.cc:2804] T 9f5fec4f76024abe9c06d7e99531a089 P b5189d1d1a034d8b92a7973b50ab5110 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:07.573305 26683 raft_consensus.cc:493] T 9f5fec4f76024abe9c06d7e99531a089 P b5189d1d1a034d8b92a7973b50ab5110 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:07.574007 26576 leader_election.cc:343] T 9f5fec4f76024abe9c06d7e99531a089 P b5189d1d1a034d8b92a7973b50ab5110 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e0e92538e1f44b2b0663afb330f899e (127.14.180.66:46615): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:07.574157 26501 leader_election.cc:343] T 7275ca9585794b1c9cc06d7616e89c8d P 5e0e92538e1f44b2b0663afb330f899e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5189d1d1a034d8b92a7973b50ab5110 (127.14.180.67:40219): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:07.574424 26652 ts_tablet_manager.cc:1434] T 41be667b2c704042b4fa06f2d1480152 P ff0fe65aa4b1405d84e4597f9aa7f87c: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.001s
I20260709 13:10:07.567474 26659 leader_election.cc:290] T 7275ca9585794b1c9cc06d7616e89c8d P 5e0e92538e1f44b2b0663afb330f899e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ff0fe65aa4b1405d84e4597f9aa7f87c (127.14.180.65:46829), b5189d1d1a034d8b92a7973b50ab5110 (127.14.180.67:40219)
I20260709 13:10:07.573675 26683 raft_consensus.cc:3060] T 9f5fec4f76024abe9c06d7e99531a089 P b5189d1d1a034d8b92a7973b50ab5110 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:07.568869 26462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7275ca9585794b1c9cc06d7616e89c8d" candidate_uuid: "5e0e92538e1f44b2b0663afb330f899e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" is_pre_election: true
I20260709 13:10:07.575851 26652 tablet_bootstrap.cc:492] T 7275ca9585794b1c9cc06d7616e89c8d P ff0fe65aa4b1405d84e4597f9aa7f87c: Bootstrap starting.
W20260709 13:10:07.576728 26500 leader_election.cc:343] T 7275ca9585794b1c9cc06d7616e89c8d P 5e0e92538e1f44b2b0663afb330f899e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ff0fe65aa4b1405d84e4597f9aa7f87c (127.14.180.65:46829): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:07.577435 26500 leader_election.cc:304] T 7275ca9585794b1c9cc06d7616e89c8d P 5e0e92538e1f44b2b0663afb330f899e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0e92538e1f44b2b0663afb330f899e; no voters: b5189d1d1a034d8b92a7973b50ab5110, ff0fe65aa4b1405d84e4597f9aa7f87c
I20260709 13:10:07.580817 26659 raft_consensus.cc:2749] T 7275ca9585794b1c9cc06d7616e89c8d P 5e0e92538e1f44b2b0663afb330f899e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:07.583402 26683 raft_consensus.cc:515] T 9f5fec4f76024abe9c06d7e99531a089 P b5189d1d1a034d8b92a7973b50ab5110 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:07.585122 26652 tablet_bootstrap.cc:654] T 7275ca9585794b1c9cc06d7616e89c8d P ff0fe65aa4b1405d84e4597f9aa7f87c: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:07.586818 26462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fec4f76024abe9c06d7e99531a089" candidate_uuid: "b5189d1d1a034d8b92a7973b50ab5110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c"
I20260709 13:10:07.587581 26462 raft_consensus.cc:3060] T 9f5fec4f76024abe9c06d7e99531a089 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:07.589098 26686 raft_consensus.cc:493] T 7aa0adb09fb048749ba647e2334a1585 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.589733 26686 raft_consensus.cc:515] T 7aa0adb09fb048749ba647e2334a1585 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:07.591578 26653 tablet_bootstrap.cc:492] T dbd9c03cee964db394327f6d722ea62f P b5189d1d1a034d8b92a7973b50ab5110: No bootstrap required, opened a new log
I20260709 13:10:07.592136 26653 ts_tablet_manager.cc:1403] T dbd9c03cee964db394327f6d722ea62f P b5189d1d1a034d8b92a7973b50ab5110: Time spent bootstrapping tablet: real 0.057s	user 0.017s	sys 0.011s
I20260709 13:10:07.592177 26686 leader_election.cc:290] T 7aa0adb09fb048749ba647e2334a1585 P ff0fe65aa4b1405d84e4597f9aa7f87c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e0e92538e1f44b2b0663afb330f899e (127.14.180.66:46615), b5189d1d1a034d8b92a7973b50ab5110 (127.14.180.67:40219)
I20260709 13:10:07.593638 26535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa0adb09fb048749ba647e2334a1585" candidate_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0e92538e1f44b2b0663afb330f899e" is_pre_election: true
I20260709 13:10:07.589098 26683 leader_election.cc:290] T 9f5fec4f76024abe9c06d7e99531a089 P b5189d1d1a034d8b92a7973b50ab5110 [CANDIDATE]: Term 1 election: Requested vote from peers ff0fe65aa4b1405d84e4597f9aa7f87c (127.14.180.65:46829), 5e0e92538e1f44b2b0663afb330f899e (127.14.180.66:46615)
W20260709 13:10:07.595315 26427 leader_election.cc:343] T 7aa0adb09fb048749ba647e2334a1585 P ff0fe65aa4b1405d84e4597f9aa7f87c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e0e92538e1f44b2b0663afb330f899e (127.14.180.66:46615): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:07.596022 26653 raft_consensus.cc:359] T dbd9c03cee964db394327f6d722ea62f P b5189d1d1a034d8b92a7973b50ab5110 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:07.596407 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa0adb09fb048749ba647e2334a1585" candidate_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5189d1d1a034d8b92a7973b50ab5110" is_pre_election: true
I20260709 13:10:07.596889 26653 raft_consensus.cc:385] T dbd9c03cee964db394327f6d722ea62f P b5189d1d1a034d8b92a7973b50ab5110 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:07.597286 26610 raft_consensus.cc:2468] T 7aa0adb09fb048749ba647e2334a1585 P b5189d1d1a034d8b92a7973b50ab5110 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff0fe65aa4b1405d84e4597f9aa7f87c in term 0.
I20260709 13:10:07.597373 26653 raft_consensus.cc:740] T dbd9c03cee964db394327f6d722ea62f P b5189d1d1a034d8b92a7973b50ab5110 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5189d1d1a034d8b92a7973b50ab5110, State: Initialized, Role: FOLLOWER
I20260709 13:10:07.598455 26535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fec4f76024abe9c06d7e99531a089" candidate_uuid: "b5189d1d1a034d8b92a7973b50ab5110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0e92538e1f44b2b0663afb330f899e"
I20260709 13:10:07.598744 26426 leader_election.cc:304] T 7aa0adb09fb048749ba647e2334a1585 P ff0fe65aa4b1405d84e4597f9aa7f87c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5189d1d1a034d8b92a7973b50ab5110, ff0fe65aa4b1405d84e4597f9aa7f87c; no voters: 5e0e92538e1f44b2b0663afb330f899e
I20260709 13:10:07.599072 26652 tablet_bootstrap.cc:492] T 7275ca9585794b1c9cc06d7616e89c8d P ff0fe65aa4b1405d84e4597f9aa7f87c: No bootstrap required, opened a new log
I20260709 13:10:07.599692 26652 ts_tablet_manager.cc:1403] T 7275ca9585794b1c9cc06d7616e89c8d P ff0fe65aa4b1405d84e4597f9aa7f87c: Time spent bootstrapping tablet: real 0.024s	user 0.015s	sys 0.001s
W20260709 13:10:07.600389 26576 leader_election.cc:343] T 9f5fec4f76024abe9c06d7e99531a089 P b5189d1d1a034d8b92a7973b50ab5110 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5e0e92538e1f44b2b0663afb330f899e (127.14.180.66:46615): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:07.600872 26686 raft_consensus.cc:2804] T 7aa0adb09fb048749ba647e2334a1585 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:07.601346 26686 raft_consensus.cc:493] T 7aa0adb09fb048749ba647e2334a1585 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:07.601704 26686 raft_consensus.cc:3060] T 7aa0adb09fb048749ba647e2334a1585 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:07.602259 26462 raft_consensus.cc:2468] T 9f5fec4f76024abe9c06d7e99531a089 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5189d1d1a034d8b92a7973b50ab5110 in term 1.
I20260709 13:10:07.603040 26652 raft_consensus.cc:359] T 7275ca9585794b1c9cc06d7616e89c8d P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:07.603956 26652 raft_consensus.cc:385] T 7275ca9585794b1c9cc06d7616e89c8d P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:07.603771 26574 leader_election.cc:304] T 9f5fec4f76024abe9c06d7e99531a089 P b5189d1d1a034d8b92a7973b50ab5110 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5189d1d1a034d8b92a7973b50ab5110, ff0fe65aa4b1405d84e4597f9aa7f87c; no voters: 5e0e92538e1f44b2b0663afb330f899e
I20260709 13:10:07.604521 26652 raft_consensus.cc:740] T 7275ca9585794b1c9cc06d7616e89c8d P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff0fe65aa4b1405d84e4597f9aa7f87c, State: Initialized, Role: FOLLOWER
I20260709 13:10:07.598312 26653 consensus_queue.cc:260] T dbd9c03cee964db394327f6d722ea62f P b5189d1d1a034d8b92a7973b50ab5110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:07.605389 26683 raft_consensus.cc:2804] T 9f5fec4f76024abe9c06d7e99531a089 P b5189d1d1a034d8b92a7973b50ab5110 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:07.605890 26683 raft_consensus.cc:697] T 9f5fec4f76024abe9c06d7e99531a089 P b5189d1d1a034d8b92a7973b50ab5110 [term 1 LEADER]: Becoming Leader. State: Replica: b5189d1d1a034d8b92a7973b50ab5110, State: Running, Role: LEADER
I20260709 13:10:07.605764 26652 consensus_queue.cc:260] T 7275ca9585794b1c9cc06d7616e89c8d P ff0fe65aa4b1405d84e4597f9aa7f87c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:07.607234 26683 consensus_queue.cc:237] T 9f5fec4f76024abe9c06d7e99531a089 P b5189d1d1a034d8b92a7973b50ab5110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:07.603871 26651 tablet_bootstrap.cc:654] T 7aa0adb09fb048749ba647e2334a1585 P 5e0e92538e1f44b2b0663afb330f899e: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:07.611307 26686 raft_consensus.cc:515] T 7aa0adb09fb048749ba647e2334a1585 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:07.606449 26653 ts_tablet_manager.cc:1434] T dbd9c03cee964db394327f6d722ea62f P b5189d1d1a034d8b92a7973b50ab5110: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:10:07.614285 26653 tablet_bootstrap.cc:492] T 7275ca9585794b1c9cc06d7616e89c8d P b5189d1d1a034d8b92a7973b50ab5110: Bootstrap starting.
I20260709 13:10:07.615818 26535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa0adb09fb048749ba647e2334a1585" candidate_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0e92538e1f44b2b0663afb330f899e"
W20260709 13:10:07.618086 26427 leader_election.cc:343] T 7aa0adb09fb048749ba647e2334a1585 P ff0fe65aa4b1405d84e4597f9aa7f87c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5e0e92538e1f44b2b0663afb330f899e (127.14.180.66:46615): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:07.621325 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa0adb09fb048749ba647e2334a1585" candidate_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5189d1d1a034d8b92a7973b50ab5110"
I20260709 13:10:07.622195 26610 raft_consensus.cc:3060] T 7aa0adb09fb048749ba647e2334a1585 P b5189d1d1a034d8b92a7973b50ab5110 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:07.623034 26653 tablet_bootstrap.cc:654] T 7275ca9585794b1c9cc06d7616e89c8d P b5189d1d1a034d8b92a7973b50ab5110: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:07.630079 26652 ts_tablet_manager.cc:1434] T 7275ca9585794b1c9cc06d7616e89c8d P ff0fe65aa4b1405d84e4597f9aa7f87c: Time spent starting tablet: real 0.030s	user 0.008s	sys 0.001s
I20260709 13:10:07.631539 26358 catalog_manager.cc:5697] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P ff0fe65aa4b1405d84e4597f9aa7f87c reported cstate change: term changed from 0 to 1, leader changed from <none> to ff0fe65aa4b1405d84e4597f9aa7f87c (127.14.180.65). New cstate: current_term: 1 leader_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:07.635243 26358 catalog_manager.cc:5697] T 0d9a4ae1c28749c08418e37aca35973c P ff0fe65aa4b1405d84e4597f9aa7f87c reported cstate change: term changed from 0 to 1, leader changed from <none> to ff0fe65aa4b1405d84e4597f9aa7f87c (127.14.180.65). New cstate: current_term: 1 leader_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:07.637989 26653 tablet_bootstrap.cc:492] T 7275ca9585794b1c9cc06d7616e89c8d P b5189d1d1a034d8b92a7973b50ab5110: No bootstrap required, opened a new log
I20260709 13:10:07.638638 26653 ts_tablet_manager.cc:1403] T 7275ca9585794b1c9cc06d7616e89c8d P b5189d1d1a034d8b92a7973b50ab5110: Time spent bootstrapping tablet: real 0.025s	user 0.015s	sys 0.004s
I20260709 13:10:07.638693 26686 leader_election.cc:290] T 7aa0adb09fb048749ba647e2334a1585 P ff0fe65aa4b1405d84e4597f9aa7f87c [CANDIDATE]: Term 1 election: Requested vote from peers 5e0e92538e1f44b2b0663afb330f899e (127.14.180.66:46615), b5189d1d1a034d8b92a7973b50ab5110 (127.14.180.67:40219)
I20260709 13:10:07.639883 26610 raft_consensus.cc:2468] T 7aa0adb09fb048749ba647e2334a1585 P b5189d1d1a034d8b92a7973b50ab5110 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff0fe65aa4b1405d84e4597f9aa7f87c in term 1.
I20260709 13:10:07.641431 26426 leader_election.cc:304] T 7aa0adb09fb048749ba647e2334a1585 P ff0fe65aa4b1405d84e4597f9aa7f87c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5189d1d1a034d8b92a7973b50ab5110, ff0fe65aa4b1405d84e4597f9aa7f87c; no voters: 5e0e92538e1f44b2b0663afb330f899e
I20260709 13:10:07.641778 26653 raft_consensus.cc:359] T 7275ca9585794b1c9cc06d7616e89c8d P b5189d1d1a034d8b92a7973b50ab5110 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:07.642526 26653 raft_consensus.cc:385] T 7275ca9585794b1c9cc06d7616e89c8d P b5189d1d1a034d8b92a7973b50ab5110 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:07.642767 26686 raft_consensus.cc:2804] T 7aa0adb09fb048749ba647e2334a1585 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:07.643466 26686 raft_consensus.cc:697] T 7aa0adb09fb048749ba647e2334a1585 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 1 LEADER]: Becoming Leader. State: Replica: ff0fe65aa4b1405d84e4597f9aa7f87c, State: Running, Role: LEADER
I20260709 13:10:07.642848 26653 raft_consensus.cc:740] T 7275ca9585794b1c9cc06d7616e89c8d P b5189d1d1a034d8b92a7973b50ab5110 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5189d1d1a034d8b92a7973b50ab5110, State: Initialized, Role: FOLLOWER
I20260709 13:10:07.645525 26686 consensus_queue.cc:237] T 7aa0adb09fb048749ba647e2334a1585 P ff0fe65aa4b1405d84e4597f9aa7f87c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:07.646749 26653 consensus_queue.cc:260] T 7275ca9585794b1c9cc06d7616e89c8d P b5189d1d1a034d8b92a7973b50ab5110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:07.648736 26651 tablet_bootstrap.cc:492] T 7aa0adb09fb048749ba647e2334a1585 P 5e0e92538e1f44b2b0663afb330f899e: No bootstrap required, opened a new log
I20260709 13:10:07.649370 26651 ts_tablet_manager.cc:1403] T 7aa0adb09fb048749ba647e2334a1585 P 5e0e92538e1f44b2b0663afb330f899e: Time spent bootstrapping tablet: real 0.091s	user 0.020s	sys 0.006s
I20260709 13:10:07.649436 26653 ts_tablet_manager.cc:1434] T 7275ca9585794b1c9cc06d7616e89c8d P b5189d1d1a034d8b92a7973b50ab5110: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.003s
I20260709 13:10:07.653012 26651 raft_consensus.cc:359] T 7aa0adb09fb048749ba647e2334a1585 P 5e0e92538e1f44b2b0663afb330f899e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:07.653782 26651 raft_consensus.cc:385] T 7aa0adb09fb048749ba647e2334a1585 P 5e0e92538e1f44b2b0663afb330f899e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:07.654111 26651 raft_consensus.cc:740] T 7aa0adb09fb048749ba647e2334a1585 P 5e0e92538e1f44b2b0663afb330f899e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e0e92538e1f44b2b0663afb330f899e, State: Initialized, Role: FOLLOWER
I20260709 13:10:07.655148 26683 raft_consensus.cc:493] T 7275ca9585794b1c9cc06d7616e89c8d P b5189d1d1a034d8b92a7973b50ab5110 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.654968 26651 consensus_queue.cc:260] T 7aa0adb09fb048749ba647e2334a1585 P 5e0e92538e1f44b2b0663afb330f899e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:07.655678 26683 raft_consensus.cc:515] T 7275ca9585794b1c9cc06d7616e89c8d P b5189d1d1a034d8b92a7973b50ab5110 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:07.657743 26683 leader_election.cc:290] T 7275ca9585794b1c9cc06d7616e89c8d P b5189d1d1a034d8b92a7973b50ab5110 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ff0fe65aa4b1405d84e4597f9aa7f87c (127.14.180.65:46829), 5e0e92538e1f44b2b0663afb330f899e (127.14.180.66:46615)
I20260709 13:10:07.659343 26535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7275ca9585794b1c9cc06d7616e89c8d" candidate_uuid: "b5189d1d1a034d8b92a7973b50ab5110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0e92538e1f44b2b0663afb330f899e" is_pre_election: true
I20260709 13:10:07.660362 26651 ts_tablet_manager.cc:1434] T 7aa0adb09fb048749ba647e2334a1585 P 5e0e92538e1f44b2b0663afb330f899e: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.004s
I20260709 13:10:07.661302 26535 raft_consensus.cc:2468] T 7275ca9585794b1c9cc06d7616e89c8d P 5e0e92538e1f44b2b0663afb330f899e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5189d1d1a034d8b92a7973b50ab5110 in term 0.
I20260709 13:10:07.662125 26462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7275ca9585794b1c9cc06d7616e89c8d" candidate_uuid: "b5189d1d1a034d8b92a7973b50ab5110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" is_pre_election: true
I20260709 13:10:07.662487 26651 tablet_bootstrap.cc:492] T 0d9a4ae1c28749c08418e37aca35973c P 5e0e92538e1f44b2b0663afb330f899e: Bootstrap starting.
I20260709 13:10:07.662859 26462 raft_consensus.cc:2468] T 7275ca9585794b1c9cc06d7616e89c8d P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5189d1d1a034d8b92a7973b50ab5110 in term 0.
I20260709 13:10:07.664506 26576 leader_election.cc:304] T 7275ca9585794b1c9cc06d7616e89c8d P b5189d1d1a034d8b92a7973b50ab5110 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0e92538e1f44b2b0663afb330f899e, b5189d1d1a034d8b92a7973b50ab5110; no voters: 
I20260709 13:10:07.665889 26683 raft_consensus.cc:2804] T 7275ca9585794b1c9cc06d7616e89c8d P b5189d1d1a034d8b92a7973b50ab5110 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:07.666335 26683 raft_consensus.cc:493] T 7275ca9585794b1c9cc06d7616e89c8d P b5189d1d1a034d8b92a7973b50ab5110 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:07.666764 26683 raft_consensus.cc:3060] T 7275ca9585794b1c9cc06d7616e89c8d P b5189d1d1a034d8b92a7973b50ab5110 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:07.669298 26651 tablet_bootstrap.cc:654] T 0d9a4ae1c28749c08418e37aca35973c P 5e0e92538e1f44b2b0663afb330f899e: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:07.671327 26360 catalog_manager.cc:5697] T 3cb687f16fd34deea0dcb10953c99dda P b5189d1d1a034d8b92a7973b50ab5110 reported cstate change: term changed from 0 to 1, leader changed from <none> to b5189d1d1a034d8b92a7973b50ab5110 (127.14.180.67). New cstate: current_term: 1 leader_uuid: "b5189d1d1a034d8b92a7973b50ab5110" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:07.674619 26683 raft_consensus.cc:515] T 7275ca9585794b1c9cc06d7616e89c8d P b5189d1d1a034d8b92a7973b50ab5110 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:07.674124 26360 catalog_manager.cc:5697] T 9f5fec4f76024abe9c06d7e99531a089 P b5189d1d1a034d8b92a7973b50ab5110 reported cstate change: term changed from 0 to 1, leader changed from <none> to b5189d1d1a034d8b92a7973b50ab5110 (127.14.180.67). New cstate: current_term: 1 leader_uuid: "b5189d1d1a034d8b92a7973b50ab5110" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:07.677827 26462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7275ca9585794b1c9cc06d7616e89c8d" candidate_uuid: "b5189d1d1a034d8b92a7973b50ab5110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c"
I20260709 13:10:07.677799 26535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7275ca9585794b1c9cc06d7616e89c8d" candidate_uuid: "b5189d1d1a034d8b92a7973b50ab5110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0e92538e1f44b2b0663afb330f899e"
I20260709 13:10:07.678620 26462 raft_consensus.cc:3060] T 7275ca9585794b1c9cc06d7616e89c8d P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:07.678758 26535 raft_consensus.cc:3060] T 7275ca9585794b1c9cc06d7616e89c8d P 5e0e92538e1f44b2b0663afb330f899e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:07.687878 26535 raft_consensus.cc:2468] T 7275ca9585794b1c9cc06d7616e89c8d P 5e0e92538e1f44b2b0663afb330f899e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5189d1d1a034d8b92a7973b50ab5110 in term 1.
I20260709 13:10:07.689702 26576 leader_election.cc:304] T 7275ca9585794b1c9cc06d7616e89c8d P b5189d1d1a034d8b92a7973b50ab5110 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0e92538e1f44b2b0663afb330f899e, b5189d1d1a034d8b92a7973b50ab5110; no voters: 
I20260709 13:10:07.690292 26462 raft_consensus.cc:2468] T 7275ca9585794b1c9cc06d7616e89c8d P ff0fe65aa4b1405d84e4597f9aa7f87c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5189d1d1a034d8b92a7973b50ab5110 in term 1.
I20260709 13:10:07.690979 26683 leader_election.cc:290] T 7275ca9585794b1c9cc06d7616e89c8d P b5189d1d1a034d8b92a7973b50ab5110 [CANDIDATE]: Term 1 election: Requested vote from peers ff0fe65aa4b1405d84e4597f9aa7f87c (127.14.180.65:46829), 5e0e92538e1f44b2b0663afb330f899e (127.14.180.66:46615)
I20260709 13:10:07.691219 26685 raft_consensus.cc:2804] T 7275ca9585794b1c9cc06d7616e89c8d P b5189d1d1a034d8b92a7973b50ab5110 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:07.692983 26685 raft_consensus.cc:697] T 7275ca9585794b1c9cc06d7616e89c8d P b5189d1d1a034d8b92a7973b50ab5110 [term 1 LEADER]: Becoming Leader. State: Replica: b5189d1d1a034d8b92a7973b50ab5110, State: Running, Role: LEADER
I20260709 13:10:07.693951 26685 consensus_queue.cc:237] T 7275ca9585794b1c9cc06d7616e89c8d P b5189d1d1a034d8b92a7973b50ab5110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:07.694733 26651 tablet_bootstrap.cc:492] T 0d9a4ae1c28749c08418e37aca35973c P 5e0e92538e1f44b2b0663afb330f899e: No bootstrap required, opened a new log
I20260709 13:10:07.695276 26651 ts_tablet_manager.cc:1403] T 0d9a4ae1c28749c08418e37aca35973c P 5e0e92538e1f44b2b0663afb330f899e: Time spent bootstrapping tablet: real 0.033s	user 0.008s	sys 0.023s
I20260709 13:10:07.698055 26358 catalog_manager.cc:5697] T 7aa0adb09fb048749ba647e2334a1585 P ff0fe65aa4b1405d84e4597f9aa7f87c reported cstate change: term changed from 0 to 1, leader changed from <none> to ff0fe65aa4b1405d84e4597f9aa7f87c (127.14.180.65). New cstate: current_term: 1 leader_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:07.698767 26651 raft_consensus.cc:359] T 0d9a4ae1c28749c08418e37aca35973c P 5e0e92538e1f44b2b0663afb330f899e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:07.699846 26651 raft_consensus.cc:385] T 0d9a4ae1c28749c08418e37aca35973c P 5e0e92538e1f44b2b0663afb330f899e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:07.700222 26651 raft_consensus.cc:740] T 0d9a4ae1c28749c08418e37aca35973c P 5e0e92538e1f44b2b0663afb330f899e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e0e92538e1f44b2b0663afb330f899e, State: Initialized, Role: FOLLOWER
I20260709 13:10:07.701045 26651 consensus_queue.cc:260] T 0d9a4ae1c28749c08418e37aca35973c P 5e0e92538e1f44b2b0663afb330f899e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:07.703699 26651 ts_tablet_manager.cc:1434] T 0d9a4ae1c28749c08418e37aca35973c P 5e0e92538e1f44b2b0663afb330f899e: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:10:07.704800 26651 tablet_bootstrap.cc:492] T 9f5fec4f76024abe9c06d7e99531a089 P 5e0e92538e1f44b2b0663afb330f899e: Bootstrap starting.
I20260709 13:10:07.710800 26651 tablet_bootstrap.cc:654] T 9f5fec4f76024abe9c06d7e99531a089 P 5e0e92538e1f44b2b0663afb330f899e: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:07.712318 26686 raft_consensus.cc:493] T 41be667b2c704042b4fa06f2d1480152 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.712922 26686 raft_consensus.cc:515] T 41be667b2c704042b4fa06f2d1480152 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:07.715008 26686 leader_election.cc:290] T 41be667b2c704042b4fa06f2d1480152 P ff0fe65aa4b1405d84e4597f9aa7f87c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e0e92538e1f44b2b0663afb330f899e (127.14.180.66:46615), b5189d1d1a034d8b92a7973b50ab5110 (127.14.180.67:40219)
I20260709 13:10:07.716809 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41be667b2c704042b4fa06f2d1480152" candidate_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5189d1d1a034d8b92a7973b50ab5110" is_pre_election: true
I20260709 13:10:07.717804 26610 raft_consensus.cc:2393] T 41be667b2c704042b4fa06f2d1480152 P b5189d1d1a034d8b92a7973b50ab5110 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ff0fe65aa4b1405d84e4597f9aa7f87c in current term 1: Already voted for candidate 5e0e92538e1f44b2b0663afb330f899e in this term.
I20260709 13:10:07.719913 26535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41be667b2c704042b4fa06f2d1480152" candidate_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0e92538e1f44b2b0663afb330f899e" is_pre_election: true
I20260709 13:10:07.715054 26360 catalog_manager.cc:5697] T 7275ca9585794b1c9cc06d7616e89c8d P b5189d1d1a034d8b92a7973b50ab5110 reported cstate change: term changed from 0 to 1, leader changed from <none> to b5189d1d1a034d8b92a7973b50ab5110 (127.14.180.67). New cstate: current_term: 1 leader_uuid: "b5189d1d1a034d8b92a7973b50ab5110" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:07.721688 26427 leader_election.cc:304] T 41be667b2c704042b4fa06f2d1480152 P ff0fe65aa4b1405d84e4597f9aa7f87c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ff0fe65aa4b1405d84e4597f9aa7f87c; no voters: 5e0e92538e1f44b2b0663afb330f899e, b5189d1d1a034d8b92a7973b50ab5110
I20260709 13:10:07.722460 26686 raft_consensus.cc:3060] T 41be667b2c704042b4fa06f2d1480152 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:07.723189 26651 tablet_bootstrap.cc:492] T 9f5fec4f76024abe9c06d7e99531a089 P 5e0e92538e1f44b2b0663afb330f899e: No bootstrap required, opened a new log
I20260709 13:10:07.723749 26651 ts_tablet_manager.cc:1403] T 9f5fec4f76024abe9c06d7e99531a089 P 5e0e92538e1f44b2b0663afb330f899e: Time spent bootstrapping tablet: real 0.019s	user 0.004s	sys 0.013s
I20260709 13:10:07.726729 26651 raft_consensus.cc:359] T 9f5fec4f76024abe9c06d7e99531a089 P 5e0e92538e1f44b2b0663afb330f899e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:07.727557 26651 raft_consensus.cc:385] T 9f5fec4f76024abe9c06d7e99531a089 P 5e0e92538e1f44b2b0663afb330f899e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:07.727872 26651 raft_consensus.cc:740] T 9f5fec4f76024abe9c06d7e99531a089 P 5e0e92538e1f44b2b0663afb330f899e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e0e92538e1f44b2b0663afb330f899e, State: Initialized, Role: FOLLOWER
I20260709 13:10:07.728590 26651 consensus_queue.cc:260] T 9f5fec4f76024abe9c06d7e99531a089 P 5e0e92538e1f44b2b0663afb330f899e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:07.730795 26651 ts_tablet_manager.cc:1434] T 9f5fec4f76024abe9c06d7e99531a089 P 5e0e92538e1f44b2b0663afb330f899e: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:10:07.732103 26686 raft_consensus.cc:2749] T 41be667b2c704042b4fa06f2d1480152 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:07.780530 26610 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5b44c782e9fd49aea2b89f4bf967e45b"
dest_uuid: "b5189d1d1a034d8b92a7973b50ab5110"
mode: GRACEFUL
new_leader_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c"
 from {username='slave'} at 127.0.0.1:43186
I20260709 13:10:07.781121 26610 raft_consensus.cc:606] T 5b44c782e9fd49aea2b89f4bf967e45b P b5189d1d1a034d8b92a7973b50ab5110 [term 1 LEADER]: Received request to transfer leadership to TS ff0fe65aa4b1405d84e4597f9aa7f87c
I20260709 13:10:07.795233 26535 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "41be667b2c704042b4fa06f2d1480152"
dest_uuid: "5e0e92538e1f44b2b0663afb330f899e"
mode: GRACEFUL
new_leader_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c"
 from {username='slave'} at 127.0.0.1:51404
I20260709 13:10:07.795773 26535 raft_consensus.cc:606] T 41be667b2c704042b4fa06f2d1480152 P 5e0e92538e1f44b2b0663afb330f899e [term 1 LEADER]: Received request to transfer leadership to TS ff0fe65aa4b1405d84e4597f9aa7f87c
I20260709 13:10:07.804615 26610 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9f5fec4f76024abe9c06d7e99531a089"
dest_uuid: "b5189d1d1a034d8b92a7973b50ab5110"
mode: GRACEFUL
new_leader_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c"
 from {username='slave'} at 127.0.0.1:43186
I20260709 13:10:07.805327 26610 raft_consensus.cc:606] T 9f5fec4f76024abe9c06d7e99531a089 P b5189d1d1a034d8b92a7973b50ab5110 [term 1 LEADER]: Received request to transfer leadership to TS ff0fe65aa4b1405d84e4597f9aa7f87c
I20260709 13:10:07.807452 26610 raft_consensus.cc:3060] T dbd9c03cee964db394327f6d722ea62f P b5189d1d1a034d8b92a7973b50ab5110 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:07.811498 26611 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7275ca9585794b1c9cc06d7616e89c8d"
dest_uuid: "b5189d1d1a034d8b92a7973b50ab5110"
mode: GRACEFUL
new_leader_uuid: "5e0e92538e1f44b2b0663afb330f899e"
 from {username='slave'} at 127.0.0.1:43186
I20260709 13:10:07.812242 26611 raft_consensus.cc:606] T 7275ca9585794b1c9cc06d7616e89c8d P b5189d1d1a034d8b92a7973b50ab5110 [term 1 LEADER]: Received request to transfer leadership to TS 5e0e92538e1f44b2b0663afb330f899e
I20260709 13:10:07.816282 26686 consensus_queue.cc:1048] T dbd9c03cee964db394327f6d722ea62f P ff0fe65aa4b1405d84e4597f9aa7f87c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:07.829761 26462 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7aa0adb09fb048749ba647e2334a1585"
dest_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c"
mode: GRACEFUL
new_leader_uuid: "5e0e92538e1f44b2b0663afb330f899e"
 from {username='slave'} at 127.0.0.1:44388
I20260709 13:10:07.830413 26462 raft_consensus.cc:606] T 7aa0adb09fb048749ba647e2334a1585 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 1 LEADER]: Received request to transfer leadership to TS 5e0e92538e1f44b2b0663afb330f899e
I20260709 13:10:07.837646 26657 consensus_queue.cc:1048] T dbd9c03cee964db394327f6d722ea62f P ff0fe65aa4b1405d84e4597f9aa7f87c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:07.838194 26462 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0d9a4ae1c28749c08418e37aca35973c"
dest_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c"
mode: GRACEFUL
new_leader_uuid: "5e0e92538e1f44b2b0663afb330f899e"
 from {username='slave'} at 127.0.0.1:44388
I20260709 13:10:07.838908 26462 raft_consensus.cc:606] T 0d9a4ae1c28749c08418e37aca35973c P ff0fe65aa4b1405d84e4597f9aa7f87c [term 1 LEADER]: Received request to transfer leadership to TS 5e0e92538e1f44b2b0663afb330f899e
I20260709 13:10:07.846537 26610 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3cb687f16fd34deea0dcb10953c99dda"
dest_uuid: "b5189d1d1a034d8b92a7973b50ab5110"
mode: GRACEFUL
new_leader_uuid: "5e0e92538e1f44b2b0663afb330f899e"
 from {username='slave'} at 127.0.0.1:43186
I20260709 13:10:07.846905 26685 consensus_queue.cc:1048] T 5b44c782e9fd49aea2b89f4bf967e45b P b5189d1d1a034d8b92a7973b50ab5110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:07.847281 26610 raft_consensus.cc:606] T 3cb687f16fd34deea0dcb10953c99dda P b5189d1d1a034d8b92a7973b50ab5110 [term 1 LEADER]: Received request to transfer leadership to TS 5e0e92538e1f44b2b0663afb330f899e
I20260709 13:10:07.855142 26462 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "04fdfdfcbfbd476e99db1fb5b3fc4e40"
dest_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c"
mode: GRACEFUL
new_leader_uuid: "b5189d1d1a034d8b92a7973b50ab5110"
 from {username='slave'} at 127.0.0.1:44388
I20260709 13:10:07.855799 26462 raft_consensus.cc:606] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 1 LEADER]: Received request to transfer leadership to TS b5189d1d1a034d8b92a7973b50ab5110
I20260709 13:10:07.858530 26685 consensus_queue.cc:1048] T 5b44c782e9fd49aea2b89f4bf967e45b P b5189d1d1a034d8b92a7973b50ab5110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:07.869494 26535 raft_consensus.cc:3060] T 0d9a4ae1c28749c08418e37aca35973c P 5e0e92538e1f44b2b0663afb330f899e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:07.870630 26685 raft_consensus.cc:993] T 5b44c782e9fd49aea2b89f4bf967e45b P b5189d1d1a034d8b92a7973b50ab5110: : Instructing follower ff0fe65aa4b1405d84e4597f9aa7f87c to start an election
I20260709 13:10:07.871234 26685 raft_consensus.cc:1081] T 5b44c782e9fd49aea2b89f4bf967e45b P b5189d1d1a034d8b92a7973b50ab5110 [term 1 LEADER]: Signalling peer ff0fe65aa4b1405d84e4597f9aa7f87c to start an election
I20260709 13:10:07.873284 26461 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5b44c782e9fd49aea2b89f4bf967e45b"
dest_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c"
 from {username='slave'} at 127.0.0.1:44362
I20260709 13:10:07.873957 26461 raft_consensus.cc:493] T 5b44c782e9fd49aea2b89f4bf967e45b P ff0fe65aa4b1405d84e4597f9aa7f87c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:07.874295 26461 raft_consensus.cc:3060] T 5b44c782e9fd49aea2b89f4bf967e45b P ff0fe65aa4b1405d84e4597f9aa7f87c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:07.878297 26657 consensus_queue.cc:1048] T 0d9a4ae1c28749c08418e37aca35973c P ff0fe65aa4b1405d84e4597f9aa7f87c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:07.881893 26461 raft_consensus.cc:515] T 5b44c782e9fd49aea2b89f4bf967e45b P ff0fe65aa4b1405d84e4597f9aa7f87c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } }
I20260709 13:10:07.885437 26461 leader_election.cc:290] T 5b44c782e9fd49aea2b89f4bf967e45b P ff0fe65aa4b1405d84e4597f9aa7f87c [CANDIDATE]: Term 2 election: Requested vote from peers b5189d1d1a034d8b92a7973b50ab5110 (127.14.180.67:40219), 5e0e92538e1f44b2b0663afb330f899e (127.14.180.66:46615)
I20260709 13:10:07.885643 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b44c782e9fd49aea2b89f4bf967e45b" candidate_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b5189d1d1a034d8b92a7973b50ab5110"
I20260709 13:10:07.886467 26610 raft_consensus.cc:3055] T 5b44c782e9fd49aea2b89f4bf967e45b P b5189d1d1a034d8b92a7973b50ab5110 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:07.887214 26610 raft_consensus.cc:740] T 5b44c782e9fd49aea2b89f4bf967e45b P b5189d1d1a034d8b92a7973b50ab5110 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b5189d1d1a034d8b92a7973b50ab5110, State: Running, Role: LEADER
I20260709 13:10:07.887738 26659 raft_consensus.cc:493] T 3cb687f16fd34deea0dcb10953c99dda P 5e0e92538e1f44b2b0663afb330f899e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.888257 26659 raft_consensus.cc:515] T 3cb687f16fd34deea0dcb10953c99dda P 5e0e92538e1f44b2b0663afb330f899e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:07.886447 26686 raft_consensus.cc:993] T 0d9a4ae1c28749c08418e37aca35973c P ff0fe65aa4b1405d84e4597f9aa7f87c: : Instructing follower 5e0e92538e1f44b2b0663afb330f899e to start an election
I20260709 13:10:07.889590 26686 raft_consensus.cc:1081] T 0d9a4ae1c28749c08418e37aca35973c P ff0fe65aa4b1405d84e4597f9aa7f87c [term 1 LEADER]: Signalling peer 5e0e92538e1f44b2b0663afb330f899e to start an election
I20260709 13:10:07.890897 26659 leader_election.cc:290] T 3cb687f16fd34deea0dcb10953c99dda P 5e0e92538e1f44b2b0663afb330f899e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ff0fe65aa4b1405d84e4597f9aa7f87c (127.14.180.65:46829), b5189d1d1a034d8b92a7973b50ab5110 (127.14.180.67:40219)
I20260709 13:10:07.891991 26536 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0d9a4ae1c28749c08418e37aca35973c"
dest_uuid: "5e0e92538e1f44b2b0663afb330f899e"
 from {username='slave'} at 127.0.0.1:51396
I20260709 13:10:07.892729 26536 raft_consensus.cc:493] T 0d9a4ae1c28749c08418e37aca35973c P 5e0e92538e1f44b2b0663afb330f899e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:07.885841 26537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b44c782e9fd49aea2b89f4bf967e45b" candidate_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5e0e92538e1f44b2b0663afb330f899e"
I20260709 13:10:07.893173 26536 raft_consensus.cc:3060] T 0d9a4ae1c28749c08418e37aca35973c P 5e0e92538e1f44b2b0663afb330f899e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:07.893095 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb687f16fd34deea0dcb10953c99dda" candidate_uuid: "5e0e92538e1f44b2b0663afb330f899e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5189d1d1a034d8b92a7973b50ab5110" is_pre_election: true
I20260709 13:10:07.893784 26537 raft_consensus.cc:3060] T 5b44c782e9fd49aea2b89f4bf967e45b P 5e0e92538e1f44b2b0663afb330f899e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:07.888180 26610 consensus_queue.cc:260] T 5b44c782e9fd49aea2b89f4bf967e45b P b5189d1d1a034d8b92a7973b50ab5110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } }
I20260709 13:10:07.895486 26610 raft_consensus.cc:3060] T 5b44c782e9fd49aea2b89f4bf967e45b P b5189d1d1a034d8b92a7973b50ab5110 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:07.900115 26678 consensus_queue.cc:1048] T 0d9a4ae1c28749c08418e37aca35973c P ff0fe65aa4b1405d84e4597f9aa7f87c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:07.903752 26610 raft_consensus.cc:2468] T 5b44c782e9fd49aea2b89f4bf967e45b P b5189d1d1a034d8b92a7973b50ab5110 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff0fe65aa4b1405d84e4597f9aa7f87c in term 2.
I20260709 13:10:07.907127 26426 leader_election.cc:304] T 5b44c782e9fd49aea2b89f4bf967e45b P ff0fe65aa4b1405d84e4597f9aa7f87c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5189d1d1a034d8b92a7973b50ab5110, ff0fe65aa4b1405d84e4597f9aa7f87c; no voters: 
I20260709 13:10:07.907977 26536 raft_consensus.cc:515] T 0d9a4ae1c28749c08418e37aca35973c P 5e0e92538e1f44b2b0663afb330f899e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:07.909546 26461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb687f16fd34deea0dcb10953c99dda" candidate_uuid: "5e0e92538e1f44b2b0663afb330f899e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" is_pre_election: true
I20260709 13:10:07.914561 26461 raft_consensus.cc:2393] T 3cb687f16fd34deea0dcb10953c99dda P ff0fe65aa4b1405d84e4597f9aa7f87c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e0e92538e1f44b2b0663afb330f899e in current term 1: Already voted for candidate b5189d1d1a034d8b92a7973b50ab5110 in this term.
I20260709 13:10:07.915508 26536 leader_election.cc:290] T 0d9a4ae1c28749c08418e37aca35973c P 5e0e92538e1f44b2b0663afb330f899e [CANDIDATE]: Term 2 election: Requested vote from peers ff0fe65aa4b1405d84e4597f9aa7f87c (127.14.180.65:46829), b5189d1d1a034d8b92a7973b50ab5110 (127.14.180.67:40219)
I20260709 13:10:07.910138 26537 raft_consensus.cc:2468] T 5b44c782e9fd49aea2b89f4bf967e45b P 5e0e92538e1f44b2b0663afb330f899e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff0fe65aa4b1405d84e4597f9aa7f87c in term 2.
I20260709 13:10:07.911998 26677 consensus_queue.cc:1048] T 41be667b2c704042b4fa06f2d1480152 P 5e0e92538e1f44b2b0663afb330f899e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:07.918197 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9a4ae1c28749c08418e37aca35973c" candidate_uuid: "5e0e92538e1f44b2b0663afb330f899e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b5189d1d1a034d8b92a7973b50ab5110"
I20260709 13:10:07.918943 26500 leader_election.cc:304] T 3cb687f16fd34deea0dcb10953c99dda P 5e0e92538e1f44b2b0663afb330f899e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0e92538e1f44b2b0663afb330f899e; no voters: b5189d1d1a034d8b92a7973b50ab5110, ff0fe65aa4b1405d84e4597f9aa7f87c
I20260709 13:10:07.919212 26678 raft_consensus.cc:2804] T 5b44c782e9fd49aea2b89f4bf967e45b P ff0fe65aa4b1405d84e4597f9aa7f87c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:07.920095 26678 raft_consensus.cc:697] T 5b44c782e9fd49aea2b89f4bf967e45b P ff0fe65aa4b1405d84e4597f9aa7f87c [term 2 LEADER]: Becoming Leader. State: Replica: ff0fe65aa4b1405d84e4597f9aa7f87c, State: Running, Role: LEADER
I20260709 13:10:07.918955 26609 raft_consensus.cc:3060] T 0d9a4ae1c28749c08418e37aca35973c P b5189d1d1a034d8b92a7973b50ab5110 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:07.921125 26461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9a4ae1c28749c08418e37aca35973c" candidate_uuid: "5e0e92538e1f44b2b0663afb330f899e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c"
I20260709 13:10:07.921803 26461 raft_consensus.cc:3055] T 0d9a4ae1c28749c08418e37aca35973c P ff0fe65aa4b1405d84e4597f9aa7f87c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:07.922134 26461 raft_consensus.cc:740] T 0d9a4ae1c28749c08418e37aca35973c P ff0fe65aa4b1405d84e4597f9aa7f87c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ff0fe65aa4b1405d84e4597f9aa7f87c, State: Running, Role: LEADER
I20260709 13:10:07.922304 26657 consensus_queue.cc:1048] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P ff0fe65aa4b1405d84e4597f9aa7f87c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:07.922851 26677 raft_consensus.cc:3060] T 3cb687f16fd34deea0dcb10953c99dda P 5e0e92538e1f44b2b0663afb330f899e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:07.923081 26461 consensus_queue.cc:260] T 0d9a4ae1c28749c08418e37aca35973c P ff0fe65aa4b1405d84e4597f9aa7f87c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:07.924554 26461 raft_consensus.cc:3060] T 0d9a4ae1c28749c08418e37aca35973c P ff0fe65aa4b1405d84e4597f9aa7f87c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:07.928196 26678 consensus_queue.cc:237] T 5b44c782e9fd49aea2b89f4bf967e45b P ff0fe65aa4b1405d84e4597f9aa7f87c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } }
I20260709 13:10:07.937088 26461 raft_consensus.cc:2468] T 0d9a4ae1c28749c08418e37aca35973c P ff0fe65aa4b1405d84e4597f9aa7f87c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e0e92538e1f44b2b0663afb330f899e in term 2.
I20260709 13:10:07.938108 26609 raft_consensus.cc:2468] T 0d9a4ae1c28749c08418e37aca35973c P b5189d1d1a034d8b92a7973b50ab5110 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e0e92538e1f44b2b0663afb330f899e in term 2.
I20260709 13:10:07.940056 26677 raft_consensus.cc:2749] T 3cb687f16fd34deea0dcb10953c99dda P 5e0e92538e1f44b2b0663afb330f899e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:07.941592 26500 leader_election.cc:304] T 0d9a4ae1c28749c08418e37aca35973c P 5e0e92538e1f44b2b0663afb330f899e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0e92538e1f44b2b0663afb330f899e, ff0fe65aa4b1405d84e4597f9aa7f87c; no voters: 
I20260709 13:10:07.942541 26686 raft_consensus.cc:993] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P ff0fe65aa4b1405d84e4597f9aa7f87c: : Instructing follower b5189d1d1a034d8b92a7973b50ab5110 to start an election
I20260709 13:10:07.943549 26686 raft_consensus.cc:1081] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 1 LEADER]: Signalling peer b5189d1d1a034d8b92a7973b50ab5110 to start an election
I20260709 13:10:07.945043 26677 raft_consensus.cc:2804] T 0d9a4ae1c28749c08418e37aca35973c P 5e0e92538e1f44b2b0663afb330f899e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:07.945919 26677 raft_consensus.cc:697] T 0d9a4ae1c28749c08418e37aca35973c P 5e0e92538e1f44b2b0663afb330f899e [term 2 LEADER]: Becoming Leader. State: Replica: 5e0e92538e1f44b2b0663afb330f899e, State: Running, Role: LEADER
I20260709 13:10:07.941993 26359 catalog_manager.cc:5697] T 5b44c782e9fd49aea2b89f4bf967e45b P ff0fe65aa4b1405d84e4597f9aa7f87c reported cstate change: term changed from 1 to 2, leader changed from b5189d1d1a034d8b92a7973b50ab5110 (127.14.180.67) to ff0fe65aa4b1405d84e4597f9aa7f87c (127.14.180.65). New cstate: current_term: 2 leader_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:07.946931 26611 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "04fdfdfcbfbd476e99db1fb5b3fc4e40"
dest_uuid: "b5189d1d1a034d8b92a7973b50ab5110"
 from {username='slave'} at 127.0.0.1:43170
I20260709 13:10:07.946877 26677 consensus_queue.cc:237] T 0d9a4ae1c28749c08418e37aca35973c P 5e0e92538e1f44b2b0663afb330f899e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:07.947628 26611 raft_consensus.cc:493] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P b5189d1d1a034d8b92a7973b50ab5110 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:07.948061 26611 raft_consensus.cc:3060] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P b5189d1d1a034d8b92a7973b50ab5110 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:07.953506 26678 consensus_queue.cc:1048] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P ff0fe65aa4b1405d84e4597f9aa7f87c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:07.957261 26358 catalog_manager.cc:5697] T 0d9a4ae1c28749c08418e37aca35973c P 5e0e92538e1f44b2b0663afb330f899e reported cstate change: term changed from 1 to 2, leader changed from ff0fe65aa4b1405d84e4597f9aa7f87c (127.14.180.65) to 5e0e92538e1f44b2b0663afb330f899e (127.14.180.66). New cstate: current_term: 2 leader_uuid: "5e0e92538e1f44b2b0663afb330f899e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:07.961560 26611 raft_consensus.cc:515] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P b5189d1d1a034d8b92a7973b50ab5110 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:07.966688 26610 raft_consensus.cc:1240] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P b5189d1d1a034d8b92a7973b50ab5110 [term 2 FOLLOWER]: Rejecting Update request from peer ff0fe65aa4b1405d84e4597f9aa7f87c for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:07.968115 26611 leader_election.cc:290] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P b5189d1d1a034d8b92a7973b50ab5110 [CANDIDATE]: Term 2 election: Requested vote from peers ff0fe65aa4b1405d84e4597f9aa7f87c (127.14.180.65:46829), 5e0e92538e1f44b2b0663afb330f899e (127.14.180.66:46615)
I20260709 13:10:07.975775 26536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fdfdfcbfbd476e99db1fb5b3fc4e40" candidate_uuid: "b5189d1d1a034d8b92a7973b50ab5110" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5e0e92538e1f44b2b0663afb330f899e"
I20260709 13:10:07.976524 26462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fdfdfcbfbd476e99db1fb5b3fc4e40" candidate_uuid: "b5189d1d1a034d8b92a7973b50ab5110" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c"
I20260709 13:10:07.977176 26462 raft_consensus.cc:3055] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:07.977522 26462 raft_consensus.cc:740] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ff0fe65aa4b1405d84e4597f9aa7f87c, State: Running, Role: LEADER
I20260709 13:10:07.978420 26462 consensus_queue.cc:260] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P ff0fe65aa4b1405d84e4597f9aa7f87c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:07.979506 26462 raft_consensus.cc:3060] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:07.980592 26677 raft_consensus.cc:993] T 41be667b2c704042b4fa06f2d1480152 P 5e0e92538e1f44b2b0663afb330f899e: : Instructing follower ff0fe65aa4b1405d84e4597f9aa7f87c to start an election
I20260709 13:10:07.981205 26677 raft_consensus.cc:1081] T 41be667b2c704042b4fa06f2d1480152 P 5e0e92538e1f44b2b0663afb330f899e [term 1 LEADER]: Signalling peer ff0fe65aa4b1405d84e4597f9aa7f87c to start an election
I20260709 13:10:07.983420 26461 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "41be667b2c704042b4fa06f2d1480152"
dest_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c"
 from {username='slave'} at 127.0.0.1:44376
I20260709 13:10:07.984112 26461 raft_consensus.cc:493] T 41be667b2c704042b4fa06f2d1480152 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:07.984508 26461 raft_consensus.cc:3060] T 41be667b2c704042b4fa06f2d1480152 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:07.991935 26659 consensus_queue.cc:1048] T 41be667b2c704042b4fa06f2d1480152 P 5e0e92538e1f44b2b0663afb330f899e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:07.995188 26461 raft_consensus.cc:515] T 41be667b2c704042b4fa06f2d1480152 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:07.995586 26462 raft_consensus.cc:2468] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5189d1d1a034d8b92a7973b50ab5110 in term 2.
I20260709 13:10:07.996645 26460 raft_consensus.cc:1240] T 41be667b2c704042b4fa06f2d1480152 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 2 FOLLOWER]: Rejecting Update request from peer 5e0e92538e1f44b2b0663afb330f899e for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:07.997047 26574 leader_election.cc:304] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P b5189d1d1a034d8b92a7973b50ab5110 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5189d1d1a034d8b92a7973b50ab5110, ff0fe65aa4b1405d84e4597f9aa7f87c; no voters: 5e0e92538e1f44b2b0663afb330f899e
I20260709 13:10:07.998472 26658 raft_consensus.cc:2804] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P b5189d1d1a034d8b92a7973b50ab5110 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:07.999027 26658 raft_consensus.cc:697] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P b5189d1d1a034d8b92a7973b50ab5110 [term 2 LEADER]: Becoming Leader. State: Replica: b5189d1d1a034d8b92a7973b50ab5110, State: Running, Role: LEADER
I20260709 13:10:07.999540 26659 consensus_queue.cc:1059] T 41be667b2c704042b4fa06f2d1480152 P 5e0e92538e1f44b2b0663afb330f899e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:07.999869 26658 consensus_queue.cc:237] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P b5189d1d1a034d8b92a7973b50ab5110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:08.000734 26677 raft_consensus.cc:3055] T 41be667b2c704042b4fa06f2d1480152 P 5e0e92538e1f44b2b0663afb330f899e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:08.001174 26677 raft_consensus.cc:740] T 41be667b2c704042b4fa06f2d1480152 P 5e0e92538e1f44b2b0663afb330f899e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e0e92538e1f44b2b0663afb330f899e, State: Running, Role: LEADER
I20260709 13:10:08.001219 26536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41be667b2c704042b4fa06f2d1480152" candidate_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5e0e92538e1f44b2b0663afb330f899e"
I20260709 13:10:08.003410 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41be667b2c704042b4fa06f2d1480152" candidate_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b5189d1d1a034d8b92a7973b50ab5110"
I20260709 13:10:08.004352 26610 raft_consensus.cc:3060] T 41be667b2c704042b4fa06f2d1480152 P b5189d1d1a034d8b92a7973b50ab5110 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:08.005070 26677 consensus_queue.cc:260] T 41be667b2c704042b4fa06f2d1480152 P 5e0e92538e1f44b2b0663afb330f899e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:08.006213 26677 raft_consensus.cc:3060] T 41be667b2c704042b4fa06f2d1480152 P 5e0e92538e1f44b2b0663afb330f899e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:08.008796 26685 consensus_queue.cc:1048] T 3cb687f16fd34deea0dcb10953c99dda P b5189d1d1a034d8b92a7973b50ab5110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:08.011660 26658 consensus_queue.cc:1048] T 3cb687f16fd34deea0dcb10953c99dda P b5189d1d1a034d8b92a7973b50ab5110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:08.014775 26360 catalog_manager.cc:5697] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P b5189d1d1a034d8b92a7973b50ab5110 reported cstate change: term changed from 1 to 2, leader changed from ff0fe65aa4b1405d84e4597f9aa7f87c (127.14.180.65) to b5189d1d1a034d8b92a7973b50ab5110 (127.14.180.67). New cstate: current_term: 2 leader_uuid: "b5189d1d1a034d8b92a7973b50ab5110" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:08.018708 26610 raft_consensus.cc:2468] T 41be667b2c704042b4fa06f2d1480152 P b5189d1d1a034d8b92a7973b50ab5110 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff0fe65aa4b1405d84e4597f9aa7f87c in term 2.
I20260709 13:10:08.019636 26611 raft_consensus.cc:1240] T 41be667b2c704042b4fa06f2d1480152 P b5189d1d1a034d8b92a7973b50ab5110 [term 2 FOLLOWER]: Rejecting Update request from peer 5e0e92538e1f44b2b0663afb330f899e for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 13:10:08.020076 26426 leader_election.cc:304] T 41be667b2c704042b4fa06f2d1480152 P ff0fe65aa4b1405d84e4597f9aa7f87c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5189d1d1a034d8b92a7973b50ab5110, ff0fe65aa4b1405d84e4597f9aa7f87c; no voters: 
I20260709 13:10:08.021047 26678 raft_consensus.cc:2804] T 41be667b2c704042b4fa06f2d1480152 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:08.021552 26678 raft_consensus.cc:697] T 41be667b2c704042b4fa06f2d1480152 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 2 LEADER]: Becoming Leader. State: Replica: ff0fe65aa4b1405d84e4597f9aa7f87c, State: Running, Role: LEADER
I20260709 13:10:08.022315 26678 consensus_queue.cc:237] T 41be667b2c704042b4fa06f2d1480152 P ff0fe65aa4b1405d84e4597f9aa7f87c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:08.003968 26461 leader_election.cc:290] T 41be667b2c704042b4fa06f2d1480152 P ff0fe65aa4b1405d84e4597f9aa7f87c [CANDIDATE]: Term 2 election: Requested vote from peers 5e0e92538e1f44b2b0663afb330f899e (127.14.180.66:46615), b5189d1d1a034d8b92a7973b50ab5110 (127.14.180.67:40219)
I20260709 13:10:08.025622 26536 raft_consensus.cc:2468] T 41be667b2c704042b4fa06f2d1480152 P 5e0e92538e1f44b2b0663afb330f899e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff0fe65aa4b1405d84e4597f9aa7f87c in term 2.
I20260709 13:10:08.038056 26359 catalog_manager.cc:5697] T 41be667b2c704042b4fa06f2d1480152 P ff0fe65aa4b1405d84e4597f9aa7f87c reported cstate change: term changed from 1 to 2, leader changed from 5e0e92538e1f44b2b0663afb330f899e (127.14.180.66) to ff0fe65aa4b1405d84e4597f9aa7f87c (127.14.180.65). New cstate: current_term: 2 leader_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:08.039832 26677 raft_consensus.cc:493] T 9f5fec4f76024abe9c06d7e99531a089 P 5e0e92538e1f44b2b0663afb330f899e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:08.040421 26677 raft_consensus.cc:515] T 9f5fec4f76024abe9c06d7e99531a089 P 5e0e92538e1f44b2b0663afb330f899e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:08.040879 26683 raft_consensus.cc:993] T 3cb687f16fd34deea0dcb10953c99dda P b5189d1d1a034d8b92a7973b50ab5110: : Instructing follower 5e0e92538e1f44b2b0663afb330f899e to start an election
I20260709 13:10:08.041402 26683 raft_consensus.cc:1081] T 3cb687f16fd34deea0dcb10953c99dda P b5189d1d1a034d8b92a7973b50ab5110 [term 1 LEADER]: Signalling peer 5e0e92538e1f44b2b0663afb330f899e to start an election
I20260709 13:10:08.042658 26677 leader_election.cc:290] T 9f5fec4f76024abe9c06d7e99531a089 P 5e0e92538e1f44b2b0663afb330f899e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ff0fe65aa4b1405d84e4597f9aa7f87c (127.14.180.65:46829), b5189d1d1a034d8b92a7973b50ab5110 (127.14.180.67:40219)
I20260709 13:10:08.043918 26536 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3cb687f16fd34deea0dcb10953c99dda"
dest_uuid: "5e0e92538e1f44b2b0663afb330f899e"
 from {username='slave'} at 127.0.0.1:51380
I20260709 13:10:08.044543 26536 raft_consensus.cc:493] T 3cb687f16fd34deea0dcb10953c99dda P 5e0e92538e1f44b2b0663afb330f899e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:08.044895 26536 raft_consensus.cc:3060] T 3cb687f16fd34deea0dcb10953c99dda P 5e0e92538e1f44b2b0663afb330f899e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:08.044683 26461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fec4f76024abe9c06d7e99531a089" candidate_uuid: "5e0e92538e1f44b2b0663afb330f899e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" is_pre_election: true
I20260709 13:10:08.045689 26461 raft_consensus.cc:2393] T 9f5fec4f76024abe9c06d7e99531a089 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e0e92538e1f44b2b0663afb330f899e in current term 1: Already voted for candidate b5189d1d1a034d8b92a7973b50ab5110 in this term.
I20260709 13:10:08.044064 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fec4f76024abe9c06d7e99531a089" candidate_uuid: "5e0e92538e1f44b2b0663afb330f899e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5189d1d1a034d8b92a7973b50ab5110" is_pre_election: true
I20260709 13:10:08.048421 26500 leader_election.cc:304] T 9f5fec4f76024abe9c06d7e99531a089 P 5e0e92538e1f44b2b0663afb330f899e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0e92538e1f44b2b0663afb330f899e; no voters: b5189d1d1a034d8b92a7973b50ab5110, ff0fe65aa4b1405d84e4597f9aa7f87c
I20260709 13:10:08.049710 26677 raft_consensus.cc:3060] T 9f5fec4f76024abe9c06d7e99531a089 P 5e0e92538e1f44b2b0663afb330f899e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:08.052943 26536 raft_consensus.cc:515] T 3cb687f16fd34deea0dcb10953c99dda P 5e0e92538e1f44b2b0663afb330f899e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:08.054755 26537 raft_consensus.cc:1240] T 3cb687f16fd34deea0dcb10953c99dda P 5e0e92538e1f44b2b0663afb330f899e [term 2 FOLLOWER]: Rejecting Update request from peer b5189d1d1a034d8b92a7973b50ab5110 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:08.058930 26461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb687f16fd34deea0dcb10953c99dda" candidate_uuid: "5e0e92538e1f44b2b0663afb330f899e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c"
I20260709 13:10:08.059671 26461 raft_consensus.cc:3060] T 3cb687f16fd34deea0dcb10953c99dda P ff0fe65aa4b1405d84e4597f9aa7f87c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:08.059458 26683 consensus_queue.cc:1059] T 3cb687f16fd34deea0dcb10953c99dda P b5189d1d1a034d8b92a7973b50ab5110 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:08.060413 26683 raft_consensus.cc:3055] T 3cb687f16fd34deea0dcb10953c99dda P b5189d1d1a034d8b92a7973b50ab5110 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:08.060757 26683 raft_consensus.cc:740] T 3cb687f16fd34deea0dcb10953c99dda P b5189d1d1a034d8b92a7973b50ab5110 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b5189d1d1a034d8b92a7973b50ab5110, State: Running, Role: LEADER
I20260709 13:10:08.061305 26677 raft_consensus.cc:2749] T 9f5fec4f76024abe9c06d7e99531a089 P 5e0e92538e1f44b2b0663afb330f899e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:08.061570 26536 leader_election.cc:290] T 3cb687f16fd34deea0dcb10953c99dda P 5e0e92538e1f44b2b0663afb330f899e [CANDIDATE]: Term 2 election: Requested vote from peers ff0fe65aa4b1405d84e4597f9aa7f87c (127.14.180.65:46829), b5189d1d1a034d8b92a7973b50ab5110 (127.14.180.67:40219)
I20260709 13:10:08.061733 26683 consensus_queue.cc:260] T 3cb687f16fd34deea0dcb10953c99dda P b5189d1d1a034d8b92a7973b50ab5110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:08.063000 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb687f16fd34deea0dcb10953c99dda" candidate_uuid: "5e0e92538e1f44b2b0663afb330f899e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b5189d1d1a034d8b92a7973b50ab5110"
I20260709 13:10:08.064376 26683 raft_consensus.cc:3060] T 3cb687f16fd34deea0dcb10953c99dda P b5189d1d1a034d8b92a7973b50ab5110 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:08.069036 26678 consensus_queue.cc:1048] T 7aa0adb09fb048749ba647e2334a1585 P ff0fe65aa4b1405d84e4597f9aa7f87c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:08.078791 26461 raft_consensus.cc:2468] T 3cb687f16fd34deea0dcb10953c99dda P ff0fe65aa4b1405d84e4597f9aa7f87c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e0e92538e1f44b2b0663afb330f899e in term 2.
I20260709 13:10:08.080619 26500 leader_election.cc:304] T 3cb687f16fd34deea0dcb10953c99dda P 5e0e92538e1f44b2b0663afb330f899e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0e92538e1f44b2b0663afb330f899e, ff0fe65aa4b1405d84e4597f9aa7f87c; no voters: 
I20260709 13:10:08.080693 26611 raft_consensus.cc:2468] T 3cb687f16fd34deea0dcb10953c99dda P b5189d1d1a034d8b92a7973b50ab5110 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e0e92538e1f44b2b0663afb330f899e in term 2.
I20260709 13:10:08.082423 26537 raft_consensus.cc:3060] T 7aa0adb09fb048749ba647e2334a1585 P 5e0e92538e1f44b2b0663afb330f899e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:08.082751 26677 raft_consensus.cc:2804] T 3cb687f16fd34deea0dcb10953c99dda P 5e0e92538e1f44b2b0663afb330f899e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:08.083458 26677 raft_consensus.cc:697] T 3cb687f16fd34deea0dcb10953c99dda P 5e0e92538e1f44b2b0663afb330f899e [term 2 LEADER]: Becoming Leader. State: Replica: 5e0e92538e1f44b2b0663afb330f899e, State: Running, Role: LEADER
I20260709 13:10:08.086042 26677 consensus_queue.cc:237] T 3cb687f16fd34deea0dcb10953c99dda P 5e0e92538e1f44b2b0663afb330f899e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:08.095340 26684 consensus_queue.cc:1048] T 7aa0adb09fb048749ba647e2334a1585 P ff0fe65aa4b1405d84e4597f9aa7f87c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:08.100955 26358 catalog_manager.cc:5697] T 3cb687f16fd34deea0dcb10953c99dda P 5e0e92538e1f44b2b0663afb330f899e reported cstate change: term changed from 1 to 2, leader changed from b5189d1d1a034d8b92a7973b50ab5110 (127.14.180.67) to 5e0e92538e1f44b2b0663afb330f899e (127.14.180.66). New cstate: current_term: 2 leader_uuid: "5e0e92538e1f44b2b0663afb330f899e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:08.103140 26686 raft_consensus.cc:993] T 7aa0adb09fb048749ba647e2334a1585 P ff0fe65aa4b1405d84e4597f9aa7f87c: : Instructing follower 5e0e92538e1f44b2b0663afb330f899e to start an election
I20260709 13:10:08.103724 26684 raft_consensus.cc:1081] T 7aa0adb09fb048749ba647e2334a1585 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 1 LEADER]: Signalling peer 5e0e92538e1f44b2b0663afb330f899e to start an election
I20260709 13:10:08.105494 26537 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7aa0adb09fb048749ba647e2334a1585"
dest_uuid: "5e0e92538e1f44b2b0663afb330f899e"
 from {username='slave'} at 127.0.0.1:51396
I20260709 13:10:08.106007 26537 raft_consensus.cc:493] T 7aa0adb09fb048749ba647e2334a1585 P 5e0e92538e1f44b2b0663afb330f899e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:08.106328 26537 raft_consensus.cc:3060] T 7aa0adb09fb048749ba647e2334a1585 P 5e0e92538e1f44b2b0663afb330f899e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:08.113058 26537 raft_consensus.cc:515] T 7aa0adb09fb048749ba647e2334a1585 P 5e0e92538e1f44b2b0663afb330f899e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:08.114795 26537 leader_election.cc:290] T 7aa0adb09fb048749ba647e2334a1585 P 5e0e92538e1f44b2b0663afb330f899e [CANDIDATE]: Term 2 election: Requested vote from peers ff0fe65aa4b1405d84e4597f9aa7f87c (127.14.180.65:46829), b5189d1d1a034d8b92a7973b50ab5110 (127.14.180.67:40219)
I20260709 13:10:08.115792 26461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa0adb09fb048749ba647e2334a1585" candidate_uuid: "5e0e92538e1f44b2b0663afb330f899e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c"
I20260709 13:10:08.115978 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa0adb09fb048749ba647e2334a1585" candidate_uuid: "5e0e92538e1f44b2b0663afb330f899e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b5189d1d1a034d8b92a7973b50ab5110"
I20260709 13:10:08.116533 26461 raft_consensus.cc:3055] T 7aa0adb09fb048749ba647e2334a1585 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:08.116609 26610 raft_consensus.cc:3060] T 7aa0adb09fb048749ba647e2334a1585 P b5189d1d1a034d8b92a7973b50ab5110 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:08.116977 26461 raft_consensus.cc:740] T 7aa0adb09fb048749ba647e2334a1585 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ff0fe65aa4b1405d84e4597f9aa7f87c, State: Running, Role: LEADER
I20260709 13:10:08.117846 26461 consensus_queue.cc:260] T 7aa0adb09fb048749ba647e2334a1585 P ff0fe65aa4b1405d84e4597f9aa7f87c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:08.119251 26461 raft_consensus.cc:3060] T 7aa0adb09fb048749ba647e2334a1585 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:08.123003 26610 raft_consensus.cc:2468] T 7aa0adb09fb048749ba647e2334a1585 P b5189d1d1a034d8b92a7973b50ab5110 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e0e92538e1f44b2b0663afb330f899e in term 2.
I20260709 13:10:08.124208 26501 leader_election.cc:304] T 7aa0adb09fb048749ba647e2334a1585 P 5e0e92538e1f44b2b0663afb330f899e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0e92538e1f44b2b0663afb330f899e, b5189d1d1a034d8b92a7973b50ab5110; no voters: 
I20260709 13:10:08.124982 26677 raft_consensus.cc:2804] T 7aa0adb09fb048749ba647e2334a1585 P 5e0e92538e1f44b2b0663afb330f899e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:08.125138 26461 raft_consensus.cc:2468] T 7aa0adb09fb048749ba647e2334a1585 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e0e92538e1f44b2b0663afb330f899e in term 2.
I20260709 13:10:08.125552 26677 raft_consensus.cc:697] T 7aa0adb09fb048749ba647e2334a1585 P 5e0e92538e1f44b2b0663afb330f899e [term 2 LEADER]: Becoming Leader. State: Replica: 5e0e92538e1f44b2b0663afb330f899e, State: Running, Role: LEADER
I20260709 13:10:08.126461 26677 consensus_queue.cc:237] T 7aa0adb09fb048749ba647e2334a1585 P 5e0e92538e1f44b2b0663afb330f899e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:08.133284 26358 catalog_manager.cc:5697] T 7aa0adb09fb048749ba647e2334a1585 P 5e0e92538e1f44b2b0663afb330f899e reported cstate change: term changed from 1 to 2, leader changed from ff0fe65aa4b1405d84e4597f9aa7f87c (127.14.180.65) to 5e0e92538e1f44b2b0663afb330f899e (127.14.180.66). New cstate: current_term: 2 leader_uuid: "5e0e92538e1f44b2b0663afb330f899e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:08.171716 26683 consensus_queue.cc:1048] T 9f5fec4f76024abe9c06d7e99531a089 P b5189d1d1a034d8b92a7973b50ab5110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:08.175515 26683 consensus_queue.cc:1048] T 9f5fec4f76024abe9c06d7e99531a089 P b5189d1d1a034d8b92a7973b50ab5110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:08.190506 26683 raft_consensus.cc:993] T 9f5fec4f76024abe9c06d7e99531a089 P b5189d1d1a034d8b92a7973b50ab5110: : Instructing follower ff0fe65aa4b1405d84e4597f9aa7f87c to start an election
I20260709 13:10:08.191039 26683 raft_consensus.cc:1081] T 9f5fec4f76024abe9c06d7e99531a089 P b5189d1d1a034d8b92a7973b50ab5110 [term 1 LEADER]: Signalling peer ff0fe65aa4b1405d84e4597f9aa7f87c to start an election
I20260709 13:10:08.193256 26462 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9f5fec4f76024abe9c06d7e99531a089"
dest_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c"
 from {username='slave'} at 127.0.0.1:44362
I20260709 13:10:08.193955 26462 raft_consensus.cc:493] T 9f5fec4f76024abe9c06d7e99531a089 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:08.194372 26462 raft_consensus.cc:3060] T 9f5fec4f76024abe9c06d7e99531a089 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:08.201280 26462 raft_consensus.cc:515] T 9f5fec4f76024abe9c06d7e99531a089 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:08.202363 26461 raft_consensus.cc:1240] T 9f5fec4f76024abe9c06d7e99531a089 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 2 FOLLOWER]: Rejecting Update request from peer b5189d1d1a034d8b92a7973b50ab5110 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:08.203527 26462 leader_election.cc:290] T 9f5fec4f76024abe9c06d7e99531a089 P ff0fe65aa4b1405d84e4597f9aa7f87c [CANDIDATE]: Term 2 election: Requested vote from peers 5e0e92538e1f44b2b0663afb330f899e (127.14.180.66:46615), b5189d1d1a034d8b92a7973b50ab5110 (127.14.180.67:40219)
I20260709 13:10:08.204362 26537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fec4f76024abe9c06d7e99531a089" candidate_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5e0e92538e1f44b2b0663afb330f899e"
I20260709 13:10:08.204597 26683 consensus_queue.cc:1059] T 9f5fec4f76024abe9c06d7e99531a089 P b5189d1d1a034d8b92a7973b50ab5110 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:08.204983 26537 raft_consensus.cc:3060] T 9f5fec4f76024abe9c06d7e99531a089 P 5e0e92538e1f44b2b0663afb330f899e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:08.204838 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fec4f76024abe9c06d7e99531a089" candidate_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b5189d1d1a034d8b92a7973b50ab5110"
I20260709 13:10:08.205482 26658 raft_consensus.cc:3055] T 9f5fec4f76024abe9c06d7e99531a089 P b5189d1d1a034d8b92a7973b50ab5110 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:08.205854 26658 raft_consensus.cc:740] T 9f5fec4f76024abe9c06d7e99531a089 P b5189d1d1a034d8b92a7973b50ab5110 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b5189d1d1a034d8b92a7973b50ab5110, State: Running, Role: LEADER
I20260709 13:10:08.206795 26658 consensus_queue.cc:260] T 9f5fec4f76024abe9c06d7e99531a089 P b5189d1d1a034d8b92a7973b50ab5110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:08.207734 26658 raft_consensus.cc:3060] T 9f5fec4f76024abe9c06d7e99531a089 P b5189d1d1a034d8b92a7973b50ab5110 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:08.210973 26537 raft_consensus.cc:2468] T 9f5fec4f76024abe9c06d7e99531a089 P 5e0e92538e1f44b2b0663afb330f899e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff0fe65aa4b1405d84e4597f9aa7f87c in term 2.
I20260709 13:10:08.212319 26427 leader_election.cc:304] T 9f5fec4f76024abe9c06d7e99531a089 P ff0fe65aa4b1405d84e4597f9aa7f87c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0e92538e1f44b2b0663afb330f899e, ff0fe65aa4b1405d84e4597f9aa7f87c; no voters: 
I20260709 13:10:08.213109 26684 raft_consensus.cc:2804] T 9f5fec4f76024abe9c06d7e99531a089 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:08.213649 26684 raft_consensus.cc:697] T 9f5fec4f76024abe9c06d7e99531a089 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 2 LEADER]: Becoming Leader. State: Replica: ff0fe65aa4b1405d84e4597f9aa7f87c, State: Running, Role: LEADER
I20260709 13:10:08.214505 26684 consensus_queue.cc:237] T 9f5fec4f76024abe9c06d7e99531a089 P ff0fe65aa4b1405d84e4597f9aa7f87c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:08.220095 26610 raft_consensus.cc:2468] T 9f5fec4f76024abe9c06d7e99531a089 P b5189d1d1a034d8b92a7973b50ab5110 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff0fe65aa4b1405d84e4597f9aa7f87c in term 2.
I20260709 13:10:08.223423 26359 catalog_manager.cc:5697] T 9f5fec4f76024abe9c06d7e99531a089 P ff0fe65aa4b1405d84e4597f9aa7f87c reported cstate change: term changed from 1 to 2, leader changed from b5189d1d1a034d8b92a7973b50ab5110 (127.14.180.67) to ff0fe65aa4b1405d84e4597f9aa7f87c (127.14.180.65). New cstate: current_term: 2 leader_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:08.252748 26658 consensus_queue.cc:1048] T 7275ca9585794b1c9cc06d7616e89c8d P b5189d1d1a034d8b92a7973b50ab5110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:08.260193 26683 raft_consensus.cc:993] T 7275ca9585794b1c9cc06d7616e89c8d P b5189d1d1a034d8b92a7973b50ab5110: : Instructing follower 5e0e92538e1f44b2b0663afb330f899e to start an election
I20260709 13:10:08.260964 26685 raft_consensus.cc:1081] T 7275ca9585794b1c9cc06d7616e89c8d P b5189d1d1a034d8b92a7973b50ab5110 [term 1 LEADER]: Signalling peer 5e0e92538e1f44b2b0663afb330f899e to start an election
I20260709 13:10:08.262781 26536 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7275ca9585794b1c9cc06d7616e89c8d"
dest_uuid: "5e0e92538e1f44b2b0663afb330f899e"
 from {username='slave'} at 127.0.0.1:51380
I20260709 13:10:08.263387 26536 raft_consensus.cc:493] T 7275ca9585794b1c9cc06d7616e89c8d P 5e0e92538e1f44b2b0663afb330f899e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:08.263813 26536 raft_consensus.cc:3060] T 7275ca9585794b1c9cc06d7616e89c8d P 5e0e92538e1f44b2b0663afb330f899e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:08.268186 26685 consensus_queue.cc:1048] T 7275ca9585794b1c9cc06d7616e89c8d P b5189d1d1a034d8b92a7973b50ab5110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:08.271849 26536 raft_consensus.cc:515] T 7275ca9585794b1c9cc06d7616e89c8d P 5e0e92538e1f44b2b0663afb330f899e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:08.279742 26461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7275ca9585794b1c9cc06d7616e89c8d" candidate_uuid: "5e0e92538e1f44b2b0663afb330f899e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c"
I20260709 13:10:08.281426 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7275ca9585794b1c9cc06d7616e89c8d" candidate_uuid: "5e0e92538e1f44b2b0663afb330f899e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b5189d1d1a034d8b92a7973b50ab5110"
I20260709 13:10:08.282183 26610 raft_consensus.cc:3055] T 7275ca9585794b1c9cc06d7616e89c8d P b5189d1d1a034d8b92a7973b50ab5110 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:08.282498 26536 leader_election.cc:290] T 7275ca9585794b1c9cc06d7616e89c8d P 5e0e92538e1f44b2b0663afb330f899e [CANDIDATE]: Term 2 election: Requested vote from peers ff0fe65aa4b1405d84e4597f9aa7f87c (127.14.180.65:46829), b5189d1d1a034d8b92a7973b50ab5110 (127.14.180.67:40219)
I20260709 13:10:08.282523 26610 raft_consensus.cc:740] T 7275ca9585794b1c9cc06d7616e89c8d P b5189d1d1a034d8b92a7973b50ab5110 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b5189d1d1a034d8b92a7973b50ab5110, State: Running, Role: LEADER
I20260709 13:10:08.284137 26610 consensus_queue.cc:260] T 7275ca9585794b1c9cc06d7616e89c8d P b5189d1d1a034d8b92a7973b50ab5110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:08.285424 26610 raft_consensus.cc:3060] T 7275ca9585794b1c9cc06d7616e89c8d P b5189d1d1a034d8b92a7973b50ab5110 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:08.293545 26610 raft_consensus.cc:2468] T 7275ca9585794b1c9cc06d7616e89c8d P b5189d1d1a034d8b92a7973b50ab5110 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e0e92538e1f44b2b0663afb330f899e in term 2.
I20260709 13:10:08.294728 26501 leader_election.cc:304] T 7275ca9585794b1c9cc06d7616e89c8d P 5e0e92538e1f44b2b0663afb330f899e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e0e92538e1f44b2b0663afb330f899e, b5189d1d1a034d8b92a7973b50ab5110; no voters: ff0fe65aa4b1405d84e4597f9aa7f87c
I20260709 13:10:08.295667 26677 raft_consensus.cc:2804] T 7275ca9585794b1c9cc06d7616e89c8d P 5e0e92538e1f44b2b0663afb330f899e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:08.296121 26677 raft_consensus.cc:697] T 7275ca9585794b1c9cc06d7616e89c8d P 5e0e92538e1f44b2b0663afb330f899e [term 2 LEADER]: Becoming Leader. State: Replica: 5e0e92538e1f44b2b0663afb330f899e, State: Running, Role: LEADER
I20260709 13:10:08.296931 26677 consensus_queue.cc:237] T 7275ca9585794b1c9cc06d7616e89c8d P 5e0e92538e1f44b2b0663afb330f899e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:08.303810 26359 catalog_manager.cc:5697] T 7275ca9585794b1c9cc06d7616e89c8d P 5e0e92538e1f44b2b0663afb330f899e reported cstate change: term changed from 1 to 2, leader changed from b5189d1d1a034d8b92a7973b50ab5110 (127.14.180.67) to 5e0e92538e1f44b2b0663afb330f899e (127.14.180.66). New cstate: current_term: 2 leader_uuid: "5e0e92538e1f44b2b0663afb330f899e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:08.361506 26610 raft_consensus.cc:1275] T 5b44c782e9fd49aea2b89f4bf967e45b P b5189d1d1a034d8b92a7973b50ab5110 [term 2 FOLLOWER]: Refusing update from remote peer ff0fe65aa4b1405d84e4597f9aa7f87c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:08.362980 26684 consensus_queue.cc:1048] T 5b44c782e9fd49aea2b89f4bf967e45b P ff0fe65aa4b1405d84e4597f9aa7f87c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:08.372203 26536 raft_consensus.cc:1275] T 5b44c782e9fd49aea2b89f4bf967e45b P 5e0e92538e1f44b2b0663afb330f899e [term 2 FOLLOWER]: Refusing update from remote peer ff0fe65aa4b1405d84e4597f9aa7f87c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:08.373796 26730 consensus_queue.cc:1048] T 5b44c782e9fd49aea2b89f4bf967e45b P ff0fe65aa4b1405d84e4597f9aa7f87c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:08.377527 26610 raft_consensus.cc:1275] T 0d9a4ae1c28749c08418e37aca35973c P b5189d1d1a034d8b92a7973b50ab5110 [term 2 FOLLOWER]: Refusing update from remote peer 5e0e92538e1f44b2b0663afb330f899e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:08.379812 26677 consensus_queue.cc:1048] T 0d9a4ae1c28749c08418e37aca35973c P 5e0e92538e1f44b2b0663afb330f899e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:08.390848 26462 raft_consensus.cc:1275] T 0d9a4ae1c28749c08418e37aca35973c P ff0fe65aa4b1405d84e4597f9aa7f87c [term 2 FOLLOWER]: Refusing update from remote peer 5e0e92538e1f44b2b0663afb330f899e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:08.392798 26724 consensus_queue.cc:1048] T 0d9a4ae1c28749c08418e37aca35973c P 5e0e92538e1f44b2b0663afb330f899e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:08.422379 26536 raft_consensus.cc:1275] T 41be667b2c704042b4fa06f2d1480152 P 5e0e92538e1f44b2b0663afb330f899e [term 2 FOLLOWER]: Refusing update from remote peer ff0fe65aa4b1405d84e4597f9aa7f87c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:08.424083 26730 consensus_queue.cc:1048] T 41be667b2c704042b4fa06f2d1480152 P ff0fe65aa4b1405d84e4597f9aa7f87c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:08.434734 26610 raft_consensus.cc:1275] T 41be667b2c704042b4fa06f2d1480152 P b5189d1d1a034d8b92a7973b50ab5110 [term 2 FOLLOWER]: Refusing update from remote peer ff0fe65aa4b1405d84e4597f9aa7f87c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:08.436440 26657 consensus_queue.cc:1048] T 41be667b2c704042b4fa06f2d1480152 P ff0fe65aa4b1405d84e4597f9aa7f87c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:08.489164 26462 raft_consensus.cc:1275] T 3cb687f16fd34deea0dcb10953c99dda P ff0fe65aa4b1405d84e4597f9aa7f87c [term 2 FOLLOWER]: Refusing update from remote peer 5e0e92538e1f44b2b0663afb330f899e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:08.490800 26724 consensus_queue.cc:1048] T 3cb687f16fd34deea0dcb10953c99dda P 5e0e92538e1f44b2b0663afb330f899e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:08.500097 26610 raft_consensus.cc:1275] T 3cb687f16fd34deea0dcb10953c99dda P b5189d1d1a034d8b92a7973b50ab5110 [term 2 FOLLOWER]: Refusing update from remote peer 5e0e92538e1f44b2b0663afb330f899e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:08.501441 26461 raft_consensus.cc:1275] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 2 FOLLOWER]: Refusing update from remote peer b5189d1d1a034d8b92a7973b50ab5110: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:08.502591 26726 consensus_queue.cc:1048] T 3cb687f16fd34deea0dcb10953c99dda P 5e0e92538e1f44b2b0663afb330f899e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:08.503815 26685 consensus_queue.cc:1048] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P b5189d1d1a034d8b92a7973b50ab5110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:08.516562 26536 raft_consensus.cc:3060] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P 5e0e92538e1f44b2b0663afb330f899e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:08.524319 26536 raft_consensus.cc:1275] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P 5e0e92538e1f44b2b0663afb330f899e [term 2 FOLLOWER]: Refusing update from remote peer b5189d1d1a034d8b92a7973b50ab5110: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:08.525934 26737 consensus_queue.cc:1048] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P b5189d1d1a034d8b92a7973b50ab5110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:08.596127 26610 raft_consensus.cc:1275] T 9f5fec4f76024abe9c06d7e99531a089 P b5189d1d1a034d8b92a7973b50ab5110 [term 2 FOLLOWER]: Refusing update from remote peer ff0fe65aa4b1405d84e4597f9aa7f87c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:08.597622 26657 consensus_queue.cc:1048] T 9f5fec4f76024abe9c06d7e99531a089 P ff0fe65aa4b1405d84e4597f9aa7f87c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:08.606951 26536 raft_consensus.cc:1275] T 9f5fec4f76024abe9c06d7e99531a089 P 5e0e92538e1f44b2b0663afb330f899e [term 2 FOLLOWER]: Refusing update from remote peer ff0fe65aa4b1405d84e4597f9aa7f87c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:08.609594 26684 consensus_queue.cc:1048] T 9f5fec4f76024abe9c06d7e99531a089 P ff0fe65aa4b1405d84e4597f9aa7f87c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:08.628304 26462 raft_consensus.cc:1275] T 7aa0adb09fb048749ba647e2334a1585 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 2 FOLLOWER]: Refusing update from remote peer 5e0e92538e1f44b2b0663afb330f899e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:08.629630 26726 consensus_queue.cc:1048] T 7aa0adb09fb048749ba647e2334a1585 P 5e0e92538e1f44b2b0663afb330f899e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:08.638008 26610 raft_consensus.cc:1275] T 7aa0adb09fb048749ba647e2334a1585 P b5189d1d1a034d8b92a7973b50ab5110 [term 2 FOLLOWER]: Refusing update from remote peer 5e0e92538e1f44b2b0663afb330f899e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:08.639662 26726 consensus_queue.cc:1048] T 7aa0adb09fb048749ba647e2334a1585 P 5e0e92538e1f44b2b0663afb330f899e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:08.677834 26462 raft_consensus.cc:3060] T 7275ca9585794b1c9cc06d7616e89c8d P ff0fe65aa4b1405d84e4597f9aa7f87c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:08.683956 26462 raft_consensus.cc:1275] T 7275ca9585794b1c9cc06d7616e89c8d P ff0fe65aa4b1405d84e4597f9aa7f87c [term 2 FOLLOWER]: Refusing update from remote peer 5e0e92538e1f44b2b0663afb330f899e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:08.685313 26724 consensus_queue.cc:1048] T 7275ca9585794b1c9cc06d7616e89c8d P 5e0e92538e1f44b2b0663afb330f899e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:08.694334 26610 raft_consensus.cc:1275] T 7275ca9585794b1c9cc06d7616e89c8d P b5189d1d1a034d8b92a7973b50ab5110 [term 2 FOLLOWER]: Refusing update from remote peer 5e0e92538e1f44b2b0663afb330f899e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:08.696269 26724 consensus_queue.cc:1048] T 7275ca9585794b1c9cc06d7616e89c8d P 5e0e92538e1f44b2b0663afb330f899e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:10.893219 26360 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55424:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:10:10.895467 26360 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:10:10.948753 26448 tablet_service.cc:1511] Processing CreateTablet for tablet e98e96ff995841f09a4cdb66e9d7f87d (DEFAULT_TABLE table=soft_deleted_table [id=4f20d84941954977906ae6a52895d6d2]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:10:10.950094 26448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e98e96ff995841f09a4cdb66e9d7f87d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:10.950707 26524 tablet_service.cc:1511] Processing CreateTablet for tablet e98e96ff995841f09a4cdb66e9d7f87d (DEFAULT_TABLE table=soft_deleted_table [id=4f20d84941954977906ae6a52895d6d2]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:10:10.952099 26524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e98e96ff995841f09a4cdb66e9d7f87d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:10.951872 26597 tablet_service.cc:1511] Processing CreateTablet for tablet e98e96ff995841f09a4cdb66e9d7f87d (DEFAULT_TABLE table=soft_deleted_table [id=4f20d84941954977906ae6a52895d6d2]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:10:10.953400 26597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e98e96ff995841f09a4cdb66e9d7f87d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:10.956413 26451 tablet_service.cc:1511] Processing CreateTablet for tablet 505a912bda074202915407e904a3d790 (DEFAULT_TABLE table=soft_deleted_table [id=4f20d84941954977906ae6a52895d6d2]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:10:10.957988 26451 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 505a912bda074202915407e904a3d790. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:10.960311 26521 tablet_service.cc:1511] Processing CreateTablet for tablet 505a912bda074202915407e904a3d790 (DEFAULT_TABLE table=soft_deleted_table [id=4f20d84941954977906ae6a52895d6d2]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:10:10.962072 26521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 505a912bda074202915407e904a3d790. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:10.984130 26599 tablet_service.cc:1511] Processing CreateTablet for tablet 505a912bda074202915407e904a3d790 (DEFAULT_TABLE table=soft_deleted_table [id=4f20d84941954977906ae6a52895d6d2]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:10:10.986297 26751 tablet_bootstrap.cc:492] T e98e96ff995841f09a4cdb66e9d7f87d P ff0fe65aa4b1405d84e4597f9aa7f87c: Bootstrap starting.
I20260709 13:10:10.986488 26599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 505a912bda074202915407e904a3d790. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:10.989169 26452 tablet_service.cc:1511] Processing CreateTablet for tablet 4d80d20237654d6583f181577681e4ba (DEFAULT_TABLE table=soft_deleted_table [id=4f20d84941954977906ae6a52895d6d2]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:10:10.990620 26452 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d80d20237654d6583f181577681e4ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:10.993016 26751 tablet_bootstrap.cc:654] T e98e96ff995841f09a4cdb66e9d7f87d P ff0fe65aa4b1405d84e4597f9aa7f87c: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:11.011108 26522 tablet_service.cc:1511] Processing CreateTablet for tablet 4d80d20237654d6583f181577681e4ba (DEFAULT_TABLE table=soft_deleted_table [id=4f20d84941954977906ae6a52895d6d2]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:10:11.012782 26522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d80d20237654d6583f181577681e4ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:11.016803 26596 tablet_service.cc:1511] Processing CreateTablet for tablet 4d80d20237654d6583f181577681e4ba (DEFAULT_TABLE table=soft_deleted_table [id=4f20d84941954977906ae6a52895d6d2]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:10:11.011094 26752 tablet_bootstrap.cc:492] T e98e96ff995841f09a4cdb66e9d7f87d P 5e0e92538e1f44b2b0663afb330f899e: Bootstrap starting.
I20260709 13:10:11.020682 26596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d80d20237654d6583f181577681e4ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:11.025660 26752 tablet_bootstrap.cc:654] T e98e96ff995841f09a4cdb66e9d7f87d P 5e0e92538e1f44b2b0663afb330f899e: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:11.032605 26448 tablet_service.cc:1511] Processing CreateTablet for tablet 3d85e7002e3541918ceeb148b69b031a (DEFAULT_TABLE table=soft_deleted_table [id=4f20d84941954977906ae6a52895d6d2]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:10:11.034134 26448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d85e7002e3541918ceeb148b69b031a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:11.034263 26524 tablet_service.cc:1511] Processing CreateTablet for tablet 3d85e7002e3541918ceeb148b69b031a (DEFAULT_TABLE table=soft_deleted_table [id=4f20d84941954977906ae6a52895d6d2]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:10:11.036448 26524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d85e7002e3541918ceeb148b69b031a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:11.034407 26599 tablet_service.cc:1511] Processing CreateTablet for tablet 466849fd1988469fb5b4037151d7f2bb (DEFAULT_TABLE table=soft_deleted_table [id=4f20d84941954977906ae6a52895d6d2]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:10:11.040975 26451 tablet_service.cc:1511] Processing CreateTablet for tablet 466849fd1988469fb5b4037151d7f2bb (DEFAULT_TABLE table=soft_deleted_table [id=4f20d84941954977906ae6a52895d6d2]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:10:11.041004 26599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 466849fd1988469fb5b4037151d7f2bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:11.039538 26753 tablet_bootstrap.cc:492] T e98e96ff995841f09a4cdb66e9d7f87d P b5189d1d1a034d8b92a7973b50ab5110: Bootstrap starting.
I20260709 13:10:11.047399 26451 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 466849fd1988469fb5b4037151d7f2bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:11.054171 26597 tablet_service.cc:1511] Processing CreateTablet for tablet 3d85e7002e3541918ceeb148b69b031a (DEFAULT_TABLE table=soft_deleted_table [id=4f20d84941954977906ae6a52895d6d2]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:10:11.056105 26597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d85e7002e3541918ceeb148b69b031a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:11.056740 26452 tablet_service.cc:1511] Processing CreateTablet for tablet fb9df82425e34bcca37fd6c21be9f576 (DEFAULT_TABLE table=soft_deleted_table [id=4f20d84941954977906ae6a52895d6d2]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:10:11.058179 26452 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb9df82425e34bcca37fd6c21be9f576. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:11.062386 26520 tablet_service.cc:1511] Processing CreateTablet for tablet fb9df82425e34bcca37fd6c21be9f576 (DEFAULT_TABLE table=soft_deleted_table [id=4f20d84941954977906ae6a52895d6d2]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:10:11.063975 26520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb9df82425e34bcca37fd6c21be9f576. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:11.065281 26521 tablet_service.cc:1511] Processing CreateTablet for tablet 466849fd1988469fb5b4037151d7f2bb (DEFAULT_TABLE table=soft_deleted_table [id=4f20d84941954977906ae6a52895d6d2]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:10:11.066838 26521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 466849fd1988469fb5b4037151d7f2bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:11.074752 26753 tablet_bootstrap.cc:654] T e98e96ff995841f09a4cdb66e9d7f87d P b5189d1d1a034d8b92a7973b50ab5110: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:11.076933 26751 tablet_bootstrap.cc:492] T e98e96ff995841f09a4cdb66e9d7f87d P ff0fe65aa4b1405d84e4597f9aa7f87c: No bootstrap required, opened a new log
I20260709 13:10:11.077569 26751 ts_tablet_manager.cc:1403] T e98e96ff995841f09a4cdb66e9d7f87d P ff0fe65aa4b1405d84e4597f9aa7f87c: Time spent bootstrapping tablet: real 0.092s	user 0.014s	sys 0.005s
I20260709 13:10:11.080989 26751 raft_consensus.cc:359] T e98e96ff995841f09a4cdb66e9d7f87d P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:11.081789 26751 raft_consensus.cc:385] T e98e96ff995841f09a4cdb66e9d7f87d P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:11.099335 26751 raft_consensus.cc:740] T e98e96ff995841f09a4cdb66e9d7f87d P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff0fe65aa4b1405d84e4597f9aa7f87c, State: Initialized, Role: FOLLOWER
I20260709 13:10:11.085716 26595 tablet_service.cc:1511] Processing CreateTablet for tablet fb9df82425e34bcca37fd6c21be9f576 (DEFAULT_TABLE table=soft_deleted_table [id=4f20d84941954977906ae6a52895d6d2]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:10:11.093230 26447 tablet_service.cc:1511] Processing CreateTablet for tablet 6bff6969f3eb4e2689b75b066440caef (DEFAULT_TABLE table=soft_deleted_table [id=4f20d84941954977906ae6a52895d6d2]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:10:11.100862 26447 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bff6969f3eb4e2689b75b066440caef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:11.103327 26753 tablet_bootstrap.cc:492] T e98e96ff995841f09a4cdb66e9d7f87d P b5189d1d1a034d8b92a7973b50ab5110: No bootstrap required, opened a new log
I20260709 13:10:11.104007 26753 ts_tablet_manager.cc:1403] T e98e96ff995841f09a4cdb66e9d7f87d P b5189d1d1a034d8b92a7973b50ab5110: Time spent bootstrapping tablet: real 0.065s	user 0.007s	sys 0.007s
I20260709 13:10:11.106078 26595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb9df82425e34bcca37fd6c21be9f576. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:11.107270 26753 raft_consensus.cc:359] T e98e96ff995841f09a4cdb66e9d7f87d P b5189d1d1a034d8b92a7973b50ab5110 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:11.108119 26753 raft_consensus.cc:385] T e98e96ff995841f09a4cdb66e9d7f87d P b5189d1d1a034d8b92a7973b50ab5110 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:11.108412 26753 raft_consensus.cc:740] T e98e96ff995841f09a4cdb66e9d7f87d P b5189d1d1a034d8b92a7973b50ab5110 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5189d1d1a034d8b92a7973b50ab5110, State: Initialized, Role: FOLLOWER
I20260709 13:10:11.085248 26752 tablet_bootstrap.cc:492] T e98e96ff995841f09a4cdb66e9d7f87d P 5e0e92538e1f44b2b0663afb330f899e: No bootstrap required, opened a new log
I20260709 13:10:11.109283 26752 ts_tablet_manager.cc:1403] T e98e96ff995841f09a4cdb66e9d7f87d P 5e0e92538e1f44b2b0663afb330f899e: Time spent bootstrapping tablet: real 0.098s	user 0.014s	sys 0.003s
I20260709 13:10:11.109164 26753 consensus_queue.cc:260] T e98e96ff995841f09a4cdb66e9d7f87d P b5189d1d1a034d8b92a7973b50ab5110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:11.114095 26596 tablet_service.cc:1511] Processing CreateTablet for tablet 6bff6969f3eb4e2689b75b066440caef (DEFAULT_TABLE table=soft_deleted_table [id=4f20d84941954977906ae6a52895d6d2]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:10:11.115224 26448 tablet_service.cc:1511] Processing CreateTablet for tablet a708761fa65e433fbebfee909b452c37 (DEFAULT_TABLE table=soft_deleted_table [id=4f20d84941954977906ae6a52895d6d2]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:10:11.116633 26448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a708761fa65e433fbebfee909b452c37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:11.112605 26524 tablet_service.cc:1511] Processing CreateTablet for tablet 6bff6969f3eb4e2689b75b066440caef (DEFAULT_TABLE table=soft_deleted_table [id=4f20d84941954977906ae6a52895d6d2]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:10:11.115568 26751 consensus_queue.cc:260] T e98e96ff995841f09a4cdb66e9d7f87d P ff0fe65aa4b1405d84e4597f9aa7f87c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:11.119382 26524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bff6969f3eb4e2689b75b066440caef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:11.116657 26753 ts_tablet_manager.cc:1434] T e98e96ff995841f09a4cdb66e9d7f87d P b5189d1d1a034d8b92a7973b50ab5110: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 13:10:11.128477 26753 tablet_bootstrap.cc:492] T 505a912bda074202915407e904a3d790 P b5189d1d1a034d8b92a7973b50ab5110: Bootstrap starting.
I20260709 13:10:11.128973 26752 raft_consensus.cc:359] T e98e96ff995841f09a4cdb66e9d7f87d P 5e0e92538e1f44b2b0663afb330f899e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:11.131510 26751 ts_tablet_manager.cc:1434] T e98e96ff995841f09a4cdb66e9d7f87d P ff0fe65aa4b1405d84e4597f9aa7f87c: Time spent starting tablet: real 0.054s	user 0.007s	sys 0.000s
I20260709 13:10:11.129926 26752 raft_consensus.cc:385] T e98e96ff995841f09a4cdb66e9d7f87d P 5e0e92538e1f44b2b0663afb330f899e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:11.132788 26751 tablet_bootstrap.cc:492] T 505a912bda074202915407e904a3d790 P ff0fe65aa4b1405d84e4597f9aa7f87c: Bootstrap starting.
I20260709 13:10:11.132875 26752 raft_consensus.cc:740] T e98e96ff995841f09a4cdb66e9d7f87d P 5e0e92538e1f44b2b0663afb330f899e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e0e92538e1f44b2b0663afb330f899e, State: Initialized, Role: FOLLOWER
I20260709 13:10:11.134176 26752 consensus_queue.cc:260] T e98e96ff995841f09a4cdb66e9d7f87d P 5e0e92538e1f44b2b0663afb330f899e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:11.136852 26752 ts_tablet_manager.cc:1434] T e98e96ff995841f09a4cdb66e9d7f87d P 5e0e92538e1f44b2b0663afb330f899e: Time spent starting tablet: real 0.022s	user 0.001s	sys 0.005s
I20260709 13:10:11.137895 26596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bff6969f3eb4e2689b75b066440caef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:11.136865 26521 tablet_service.cc:1511] Processing CreateTablet for tablet a708761fa65e433fbebfee909b452c37 (DEFAULT_TABLE table=soft_deleted_table [id=4f20d84941954977906ae6a52895d6d2]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:10:11.139093 26521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a708761fa65e433fbebfee909b452c37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:11.141947 26752 tablet_bootstrap.cc:492] T 505a912bda074202915407e904a3d790 P 5e0e92538e1f44b2b0663afb330f899e: Bootstrap starting.
I20260709 13:10:11.145001 26597 tablet_service.cc:1511] Processing CreateTablet for tablet a708761fa65e433fbebfee909b452c37 (DEFAULT_TABLE table=soft_deleted_table [id=4f20d84941954977906ae6a52895d6d2]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:10:11.147152 26597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a708761fa65e433fbebfee909b452c37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:11.146976 26451 tablet_service.cc:1511] Processing CreateTablet for tablet fe0733029c394a438e698d0b85493c36 (DEFAULT_TABLE table=soft_deleted_table [id=4f20d84941954977906ae6a52895d6d2]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:10:11.150207 26522 tablet_service.cc:1511] Processing CreateTablet for tablet fe0733029c394a438e698d0b85493c36 (DEFAULT_TABLE table=soft_deleted_table [id=4f20d84941954977906ae6a52895d6d2]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:10:11.151355 26451 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe0733029c394a438e698d0b85493c36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:11.151923 26522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe0733029c394a438e698d0b85493c36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:11.155926 26753 tablet_bootstrap.cc:654] T 505a912bda074202915407e904a3d790 P b5189d1d1a034d8b92a7973b50ab5110: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:11.158321 26599 tablet_service.cc:1511] Processing CreateTablet for tablet fe0733029c394a438e698d0b85493c36 (DEFAULT_TABLE table=soft_deleted_table [id=4f20d84941954977906ae6a52895d6d2]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:10:11.159956 26599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe0733029c394a438e698d0b85493c36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:11.169615 26751 tablet_bootstrap.cc:654] T 505a912bda074202915407e904a3d790 P ff0fe65aa4b1405d84e4597f9aa7f87c: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:11.172642 26753 tablet_bootstrap.cc:492] T 505a912bda074202915407e904a3d790 P b5189d1d1a034d8b92a7973b50ab5110: No bootstrap required, opened a new log
I20260709 13:10:11.173321 26753 ts_tablet_manager.cc:1403] T 505a912bda074202915407e904a3d790 P b5189d1d1a034d8b92a7973b50ab5110: Time spent bootstrapping tablet: real 0.045s	user 0.011s	sys 0.000s
I20260709 13:10:11.176759 26753 raft_consensus.cc:359] T 505a912bda074202915407e904a3d790 P b5189d1d1a034d8b92a7973b50ab5110 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:11.177587 26753 raft_consensus.cc:385] T 505a912bda074202915407e904a3d790 P b5189d1d1a034d8b92a7973b50ab5110 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:11.178053 26753 raft_consensus.cc:740] T 505a912bda074202915407e904a3d790 P b5189d1d1a034d8b92a7973b50ab5110 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5189d1d1a034d8b92a7973b50ab5110, State: Initialized, Role: FOLLOWER
I20260709 13:10:11.188934 26753 consensus_queue.cc:260] T 505a912bda074202915407e904a3d790 P b5189d1d1a034d8b92a7973b50ab5110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:11.200057 26752 tablet_bootstrap.cc:654] T 505a912bda074202915407e904a3d790 P 5e0e92538e1f44b2b0663afb330f899e: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:11.208388 26753 ts_tablet_manager.cc:1434] T 505a912bda074202915407e904a3d790 P b5189d1d1a034d8b92a7973b50ab5110: Time spent starting tablet: real 0.035s	user 0.008s	sys 0.005s
I20260709 13:10:11.221766 26753 tablet_bootstrap.cc:492] T 466849fd1988469fb5b4037151d7f2bb P b5189d1d1a034d8b92a7973b50ab5110: Bootstrap starting.
I20260709 13:10:11.228749 26753 tablet_bootstrap.cc:654] T 466849fd1988469fb5b4037151d7f2bb P b5189d1d1a034d8b92a7973b50ab5110: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:11.242664 26752 tablet_bootstrap.cc:492] T 505a912bda074202915407e904a3d790 P 5e0e92538e1f44b2b0663afb330f899e: No bootstrap required, opened a new log
I20260709 13:10:11.243305 26752 ts_tablet_manager.cc:1403] T 505a912bda074202915407e904a3d790 P 5e0e92538e1f44b2b0663afb330f899e: Time spent bootstrapping tablet: real 0.102s	user 0.010s	sys 0.004s
I20260709 13:10:11.246152 26752 raft_consensus.cc:359] T 505a912bda074202915407e904a3d790 P 5e0e92538e1f44b2b0663afb330f899e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:11.246939 26752 raft_consensus.cc:385] T 505a912bda074202915407e904a3d790 P 5e0e92538e1f44b2b0663afb330f899e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:11.247327 26752 raft_consensus.cc:740] T 505a912bda074202915407e904a3d790 P 5e0e92538e1f44b2b0663afb330f899e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e0e92538e1f44b2b0663afb330f899e, State: Initialized, Role: FOLLOWER
I20260709 13:10:11.248319 26752 consensus_queue.cc:260] T 505a912bda074202915407e904a3d790 P 5e0e92538e1f44b2b0663afb330f899e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:11.250308 26751 tablet_bootstrap.cc:492] T 505a912bda074202915407e904a3d790 P ff0fe65aa4b1405d84e4597f9aa7f87c: No bootstrap required, opened a new log
I20260709 13:10:11.250968 26752 ts_tablet_manager.cc:1434] T 505a912bda074202915407e904a3d790 P 5e0e92538e1f44b2b0663afb330f899e: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:10:11.250941 26751 ts_tablet_manager.cc:1403] T 505a912bda074202915407e904a3d790 P ff0fe65aa4b1405d84e4597f9aa7f87c: Time spent bootstrapping tablet: real 0.118s	user 0.027s	sys 0.044s
I20260709 13:10:11.252492 26752 tablet_bootstrap.cc:492] T 4d80d20237654d6583f181577681e4ba P 5e0e92538e1f44b2b0663afb330f899e: Bootstrap starting.
I20260709 13:10:11.255347 26753 tablet_bootstrap.cc:492] T 466849fd1988469fb5b4037151d7f2bb P b5189d1d1a034d8b92a7973b50ab5110: No bootstrap required, opened a new log
I20260709 13:10:11.255234 26751 raft_consensus.cc:359] T 505a912bda074202915407e904a3d790 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:11.256013 26753 ts_tablet_manager.cc:1403] T 466849fd1988469fb5b4037151d7f2bb P b5189d1d1a034d8b92a7973b50ab5110: Time spent bootstrapping tablet: real 0.034s	user 0.006s	sys 0.022s
I20260709 13:10:11.256083 26751 raft_consensus.cc:385] T 505a912bda074202915407e904a3d790 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:11.256592 26751 raft_consensus.cc:740] T 505a912bda074202915407e904a3d790 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff0fe65aa4b1405d84e4597f9aa7f87c, State: Initialized, Role: FOLLOWER
I20260709 13:10:11.257756 26751 consensus_queue.cc:260] T 505a912bda074202915407e904a3d790 P ff0fe65aa4b1405d84e4597f9aa7f87c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:11.259442 26753 raft_consensus.cc:359] T 466849fd1988469fb5b4037151d7f2bb P b5189d1d1a034d8b92a7973b50ab5110 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:11.260412 26751 ts_tablet_manager.cc:1434] T 505a912bda074202915407e904a3d790 P ff0fe65aa4b1405d84e4597f9aa7f87c: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:10:11.260548 26752 tablet_bootstrap.cc:654] T 4d80d20237654d6583f181577681e4ba P 5e0e92538e1f44b2b0663afb330f899e: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:11.260450 26753 raft_consensus.cc:385] T 466849fd1988469fb5b4037151d7f2bb P b5189d1d1a034d8b92a7973b50ab5110 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:11.262532 26751 tablet_bootstrap.cc:492] T 4d80d20237654d6583f181577681e4ba P ff0fe65aa4b1405d84e4597f9aa7f87c: Bootstrap starting.
I20260709 13:10:11.261700 26753 raft_consensus.cc:740] T 466849fd1988469fb5b4037151d7f2bb P b5189d1d1a034d8b92a7973b50ab5110 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5189d1d1a034d8b92a7973b50ab5110, State: Initialized, Role: FOLLOWER
I20260709 13:10:11.265573 26753 consensus_queue.cc:260] T 466849fd1988469fb5b4037151d7f2bb P b5189d1d1a034d8b92a7973b50ab5110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:11.268117 26753 ts_tablet_manager.cc:1434] T 466849fd1988469fb5b4037151d7f2bb P b5189d1d1a034d8b92a7973b50ab5110: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:10:11.269284 26753 tablet_bootstrap.cc:492] T 3d85e7002e3541918ceeb148b69b031a P b5189d1d1a034d8b92a7973b50ab5110: Bootstrap starting.
I20260709 13:10:11.274889 26730 raft_consensus.cc:493] T e98e96ff995841f09a4cdb66e9d7f87d P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:11.275501 26730 raft_consensus.cc:515] T e98e96ff995841f09a4cdb66e9d7f87d P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:11.276748 26753 tablet_bootstrap.cc:654] T 3d85e7002e3541918ceeb148b69b031a P b5189d1d1a034d8b92a7973b50ab5110: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:11.278487 26751 tablet_bootstrap.cc:654] T 4d80d20237654d6583f181577681e4ba P ff0fe65aa4b1405d84e4597f9aa7f87c: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:11.277758 26730 leader_election.cc:290] T e98e96ff995841f09a4cdb66e9d7f87d P ff0fe65aa4b1405d84e4597f9aa7f87c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e0e92538e1f44b2b0663afb330f899e (127.14.180.66:46615), b5189d1d1a034d8b92a7973b50ab5110 (127.14.180.67:40219)
I20260709 13:10:11.279825 26536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e98e96ff995841f09a4cdb66e9d7f87d" candidate_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0e92538e1f44b2b0663afb330f899e" is_pre_election: true
I20260709 13:10:11.282397 26536 raft_consensus.cc:2468] T e98e96ff995841f09a4cdb66e9d7f87d P 5e0e92538e1f44b2b0663afb330f899e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff0fe65aa4b1405d84e4597f9aa7f87c in term 0.
I20260709 13:10:11.283948 26427 leader_election.cc:304] T e98e96ff995841f09a4cdb66e9d7f87d P ff0fe65aa4b1405d84e4597f9aa7f87c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0e92538e1f44b2b0663afb330f899e, ff0fe65aa4b1405d84e4597f9aa7f87c; no voters: 
I20260709 13:10:11.281605 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e98e96ff995841f09a4cdb66e9d7f87d" candidate_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5189d1d1a034d8b92a7973b50ab5110" is_pre_election: true
I20260709 13:10:11.285064 26611 raft_consensus.cc:2468] T e98e96ff995841f09a4cdb66e9d7f87d P b5189d1d1a034d8b92a7973b50ab5110 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff0fe65aa4b1405d84e4597f9aa7f87c in term 0.
I20260709 13:10:11.286425 26730 raft_consensus.cc:2804] T e98e96ff995841f09a4cdb66e9d7f87d P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:11.287014 26730 raft_consensus.cc:493] T e98e96ff995841f09a4cdb66e9d7f87d P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:11.287431 26730 raft_consensus.cc:3060] T e98e96ff995841f09a4cdb66e9d7f87d P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:11.292253 26752 tablet_bootstrap.cc:492] T 4d80d20237654d6583f181577681e4ba P 5e0e92538e1f44b2b0663afb330f899e: No bootstrap required, opened a new log
I20260709 13:10:11.293064 26752 ts_tablet_manager.cc:1403] T 4d80d20237654d6583f181577681e4ba P 5e0e92538e1f44b2b0663afb330f899e: Time spent bootstrapping tablet: real 0.041s	user 0.019s	sys 0.000s
I20260709 13:10:11.295315 26751 tablet_bootstrap.cc:492] T 4d80d20237654d6583f181577681e4ba P ff0fe65aa4b1405d84e4597f9aa7f87c: No bootstrap required, opened a new log
I20260709 13:10:11.295783 26753 tablet_bootstrap.cc:492] T 3d85e7002e3541918ceeb148b69b031a P b5189d1d1a034d8b92a7973b50ab5110: No bootstrap required, opened a new log
I20260709 13:10:11.296096 26751 ts_tablet_manager.cc:1403] T 4d80d20237654d6583f181577681e4ba P ff0fe65aa4b1405d84e4597f9aa7f87c: Time spent bootstrapping tablet: real 0.034s	user 0.010s	sys 0.004s
I20260709 13:10:11.296346 26753 ts_tablet_manager.cc:1403] T 3d85e7002e3541918ceeb148b69b031a P b5189d1d1a034d8b92a7973b50ab5110: Time spent bootstrapping tablet: real 0.027s	user 0.017s	sys 0.006s
I20260709 13:10:11.296530 26730 raft_consensus.cc:515] T e98e96ff995841f09a4cdb66e9d7f87d P ff0fe65aa4b1405d84e4597f9aa7f87c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:11.296546 26752 raft_consensus.cc:359] T 4d80d20237654d6583f181577681e4ba P 5e0e92538e1f44b2b0663afb330f899e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:11.297576 26752 raft_consensus.cc:385] T 4d80d20237654d6583f181577681e4ba P 5e0e92538e1f44b2b0663afb330f899e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:11.297914 26752 raft_consensus.cc:740] T 4d80d20237654d6583f181577681e4ba P 5e0e92538e1f44b2b0663afb330f899e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e0e92538e1f44b2b0663afb330f899e, State: Initialized, Role: FOLLOWER
I20260709 13:10:11.298768 26752 consensus_queue.cc:260] T 4d80d20237654d6583f181577681e4ba P 5e0e92538e1f44b2b0663afb330f899e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:11.299954 26536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e98e96ff995841f09a4cdb66e9d7f87d" candidate_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0e92538e1f44b2b0663afb330f899e"
I20260709 13:10:11.299695 26753 raft_consensus.cc:359] T 3d85e7002e3541918ceeb148b69b031a P b5189d1d1a034d8b92a7973b50ab5110 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:11.300872 26536 raft_consensus.cc:3060] T e98e96ff995841f09a4cdb66e9d7f87d P 5e0e92538e1f44b2b0663afb330f899e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:11.300957 26753 raft_consensus.cc:385] T 3d85e7002e3541918ceeb148b69b031a P b5189d1d1a034d8b92a7973b50ab5110 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:11.301411 26753 raft_consensus.cc:740] T 3d85e7002e3541918ceeb148b69b031a P b5189d1d1a034d8b92a7973b50ab5110 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5189d1d1a034d8b92a7973b50ab5110, State: Initialized, Role: FOLLOWER
I20260709 13:10:11.302006 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e98e96ff995841f09a4cdb66e9d7f87d" candidate_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5189d1d1a034d8b92a7973b50ab5110"
I20260709 13:10:11.302671 26611 raft_consensus.cc:3060] T e98e96ff995841f09a4cdb66e9d7f87d P b5189d1d1a034d8b92a7973b50ab5110 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:11.303632 26752 ts_tablet_manager.cc:1434] T 4d80d20237654d6583f181577681e4ba P 5e0e92538e1f44b2b0663afb330f899e: Time spent starting tablet: real 0.010s	user 0.002s	sys 0.005s
I20260709 13:10:11.303483 26753 consensus_queue.cc:260] T 3d85e7002e3541918ceeb148b69b031a P b5189d1d1a034d8b92a7973b50ab5110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:11.304777 26752 tablet_bootstrap.cc:492] T 3d85e7002e3541918ceeb148b69b031a P 5e0e92538e1f44b2b0663afb330f899e: Bootstrap starting.
I20260709 13:10:11.305987 26753 ts_tablet_manager.cc:1434] T 3d85e7002e3541918ceeb148b69b031a P b5189d1d1a034d8b92a7973b50ab5110: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:10:11.311556 26611 raft_consensus.cc:2468] T e98e96ff995841f09a4cdb66e9d7f87d P b5189d1d1a034d8b92a7973b50ab5110 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff0fe65aa4b1405d84e4597f9aa7f87c in term 1.
I20260709 13:10:11.312114 26752 tablet_bootstrap.cc:654] T 3d85e7002e3541918ceeb148b69b031a P 5e0e92538e1f44b2b0663afb330f899e: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:11.313258 26426 leader_election.cc:304] T e98e96ff995841f09a4cdb66e9d7f87d P ff0fe65aa4b1405d84e4597f9aa7f87c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5189d1d1a034d8b92a7973b50ab5110, ff0fe65aa4b1405d84e4597f9aa7f87c; no voters: 
I20260709 13:10:11.314147 26753 tablet_bootstrap.cc:492] T 4d80d20237654d6583f181577681e4ba P b5189d1d1a034d8b92a7973b50ab5110: Bootstrap starting.
W20260709 13:10:11.317720 26408 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:11.324572 26536 raft_consensus.cc:2468] T e98e96ff995841f09a4cdb66e9d7f87d P 5e0e92538e1f44b2b0663afb330f899e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff0fe65aa4b1405d84e4597f9aa7f87c in term 1.
I20260709 13:10:11.300086 26751 raft_consensus.cc:359] T 4d80d20237654d6583f181577681e4ba P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:11.327183 26751 raft_consensus.cc:385] T 4d80d20237654d6583f181577681e4ba P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:11.327582 26751 raft_consensus.cc:740] T 4d80d20237654d6583f181577681e4ba P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff0fe65aa4b1405d84e4597f9aa7f87c, State: Initialized, Role: FOLLOWER
I20260709 13:10:11.318607 26730 leader_election.cc:290] T e98e96ff995841f09a4cdb66e9d7f87d P ff0fe65aa4b1405d84e4597f9aa7f87c [CANDIDATE]: Term 1 election: Requested vote from peers 5e0e92538e1f44b2b0663afb330f899e (127.14.180.66:46615), b5189d1d1a034d8b92a7973b50ab5110 (127.14.180.67:40219)
I20260709 13:10:11.328660 26751 consensus_queue.cc:260] T 4d80d20237654d6583f181577681e4ba P ff0fe65aa4b1405d84e4597f9aa7f87c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:11.329879 26730 raft_consensus.cc:2804] T e98e96ff995841f09a4cdb66e9d7f87d P ff0fe65aa4b1405d84e4597f9aa7f87c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:11.332201 26751 ts_tablet_manager.cc:1434] T 4d80d20237654d6583f181577681e4ba P ff0fe65aa4b1405d84e4597f9aa7f87c: Time spent starting tablet: real 0.036s	user 0.008s	sys 0.000s
I20260709 13:10:11.333534 26751 tablet_bootstrap.cc:492] T 466849fd1988469fb5b4037151d7f2bb P ff0fe65aa4b1405d84e4597f9aa7f87c: Bootstrap starting.
I20260709 13:10:11.333774 26738 raft_consensus.cc:493] T 3d85e7002e3541918ceeb148b69b031a P b5189d1d1a034d8b92a7973b50ab5110 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:11.334093 26753 tablet_bootstrap.cc:654] T 4d80d20237654d6583f181577681e4ba P b5189d1d1a034d8b92a7973b50ab5110: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:11.334582 26738 raft_consensus.cc:515] T 3d85e7002e3541918ceeb148b69b031a P b5189d1d1a034d8b92a7973b50ab5110 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:11.339012 26724 raft_consensus.cc:493] T 505a912bda074202915407e904a3d790 P 5e0e92538e1f44b2b0663afb330f899e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:11.339772 26724 raft_consensus.cc:515] T 505a912bda074202915407e904a3d790 P 5e0e92538e1f44b2b0663afb330f899e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:11.341629 26751 tablet_bootstrap.cc:654] T 466849fd1988469fb5b4037151d7f2bb P ff0fe65aa4b1405d84e4597f9aa7f87c: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:11.342657 26730 raft_consensus.cc:697] T e98e96ff995841f09a4cdb66e9d7f87d P ff0fe65aa4b1405d84e4597f9aa7f87c [term 1 LEADER]: Becoming Leader. State: Replica: ff0fe65aa4b1405d84e4597f9aa7f87c, State: Running, Role: LEADER
I20260709 13:10:11.338325 26462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d85e7002e3541918ceeb148b69b031a" candidate_uuid: "b5189d1d1a034d8b92a7973b50ab5110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" is_pre_election: true
W20260709 13:10:11.345878 26574 leader_election.cc:343] T 3d85e7002e3541918ceeb148b69b031a P b5189d1d1a034d8b92a7973b50ab5110 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ff0fe65aa4b1405d84e4597f9aa7f87c (127.14.180.65:46829): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:11.347666 26724 leader_election.cc:290] T 505a912bda074202915407e904a3d790 P 5e0e92538e1f44b2b0663afb330f899e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ff0fe65aa4b1405d84e4597f9aa7f87c (127.14.180.65:46829), b5189d1d1a034d8b92a7973b50ab5110 (127.14.180.67:40219)
I20260709 13:10:11.343799 26730 consensus_queue.cc:237] T e98e96ff995841f09a4cdb66e9d7f87d P ff0fe65aa4b1405d84e4597f9aa7f87c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:11.352790 26738 leader_election.cc:290] T 3d85e7002e3541918ceeb148b69b031a P b5189d1d1a034d8b92a7973b50ab5110 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ff0fe65aa4b1405d84e4597f9aa7f87c (127.14.180.65:46829), 5e0e92538e1f44b2b0663afb330f899e (127.14.180.66:46615)
I20260709 13:10:11.354844 26753 tablet_bootstrap.cc:492] T 4d80d20237654d6583f181577681e4ba P b5189d1d1a034d8b92a7973b50ab5110: No bootstrap required, opened a new log
I20260709 13:10:11.355525 26753 ts_tablet_manager.cc:1403] T 4d80d20237654d6583f181577681e4ba P b5189d1d1a034d8b92a7973b50ab5110: Time spent bootstrapping tablet: real 0.042s	user 0.016s	sys 0.000s
I20260709 13:10:11.357301 26536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d85e7002e3541918ceeb148b69b031a" candidate_uuid: "b5189d1d1a034d8b92a7973b50ab5110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0e92538e1f44b2b0663afb330f899e" is_pre_election: true
I20260709 13:10:11.361363 26752 tablet_bootstrap.cc:492] T 3d85e7002e3541918ceeb148b69b031a P 5e0e92538e1f44b2b0663afb330f899e: No bootstrap required, opened a new log
I20260709 13:10:11.362684 26462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505a912bda074202915407e904a3d790" candidate_uuid: "5e0e92538e1f44b2b0663afb330f899e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" is_pre_election: true
I20260709 13:10:11.362005 26752 ts_tablet_manager.cc:1403] T 3d85e7002e3541918ceeb148b69b031a P 5e0e92538e1f44b2b0663afb330f899e: Time spent bootstrapping tablet: real 0.057s	user 0.015s	sys 0.018s
I20260709 13:10:11.363626 26462 raft_consensus.cc:2468] T 505a912bda074202915407e904a3d790 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0e92538e1f44b2b0663afb330f899e in term 0.
I20260709 13:10:11.365526 26753 raft_consensus.cc:359] T 4d80d20237654d6583f181577681e4ba P b5189d1d1a034d8b92a7973b50ab5110 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:11.367560 26753 raft_consensus.cc:385] T 4d80d20237654d6583f181577681e4ba P b5189d1d1a034d8b92a7973b50ab5110 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:10:11.366204 26576 leader_election.cc:343] T 3d85e7002e3541918ceeb148b69b031a P b5189d1d1a034d8b92a7973b50ab5110 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e0e92538e1f44b2b0663afb330f899e (127.14.180.66:46615): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:11.367933 26753 raft_consensus.cc:740] T 4d80d20237654d6583f181577681e4ba P b5189d1d1a034d8b92a7973b50ab5110 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5189d1d1a034d8b92a7973b50ab5110, State: Initialized, Role: FOLLOWER
I20260709 13:10:11.366669 26500 leader_election.cc:304] T 505a912bda074202915407e904a3d790 P 5e0e92538e1f44b2b0663afb330f899e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0e92538e1f44b2b0663afb330f899e, ff0fe65aa4b1405d84e4597f9aa7f87c; no voters: 
I20260709 13:10:11.368834 26753 consensus_queue.cc:260] T 4d80d20237654d6583f181577681e4ba P b5189d1d1a034d8b92a7973b50ab5110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:11.370054 26771 raft_consensus.cc:2804] T 505a912bda074202915407e904a3d790 P 5e0e92538e1f44b2b0663afb330f899e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:11.370527 26771 raft_consensus.cc:493] T 505a912bda074202915407e904a3d790 P 5e0e92538e1f44b2b0663afb330f899e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:11.370967 26771 raft_consensus.cc:3060] T 505a912bda074202915407e904a3d790 P 5e0e92538e1f44b2b0663afb330f899e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:11.371650 26753 ts_tablet_manager.cc:1434] T 4d80d20237654d6583f181577681e4ba P b5189d1d1a034d8b92a7973b50ab5110: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.001s
I20260709 13:10:11.368350 26576 leader_election.cc:304] T 3d85e7002e3541918ceeb148b69b031a P b5189d1d1a034d8b92a7973b50ab5110 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5189d1d1a034d8b92a7973b50ab5110; no voters: 5e0e92538e1f44b2b0663afb330f899e, ff0fe65aa4b1405d84e4597f9aa7f87c
I20260709 13:10:11.366621 26752 raft_consensus.cc:359] T 3d85e7002e3541918ceeb148b69b031a P 5e0e92538e1f44b2b0663afb330f899e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:11.378180 26751 tablet_bootstrap.cc:492] T 466849fd1988469fb5b4037151d7f2bb P ff0fe65aa4b1405d84e4597f9aa7f87c: No bootstrap required, opened a new log
I20260709 13:10:11.379041 26751 ts_tablet_manager.cc:1403] T 466849fd1988469fb5b4037151d7f2bb P ff0fe65aa4b1405d84e4597f9aa7f87c: Time spent bootstrapping tablet: real 0.046s	user 0.020s	sys 0.007s
I20260709 13:10:11.380744 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505a912bda074202915407e904a3d790" candidate_uuid: "5e0e92538e1f44b2b0663afb330f899e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5189d1d1a034d8b92a7973b50ab5110" is_pre_election: true
I20260709 13:10:11.381431 26738 raft_consensus.cc:2749] T 3d85e7002e3541918ceeb148b69b031a P b5189d1d1a034d8b92a7973b50ab5110 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:11.381531 26611 raft_consensus.cc:2468] T 505a912bda074202915407e904a3d790 P b5189d1d1a034d8b92a7973b50ab5110 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0e92538e1f44b2b0663afb330f899e in term 0.
I20260709 13:10:11.383656 26753 tablet_bootstrap.cc:492] T fb9df82425e34bcca37fd6c21be9f576 P b5189d1d1a034d8b92a7973b50ab5110: Bootstrap starting.
I20260709 13:10:11.372437 26752 raft_consensus.cc:385] T 3d85e7002e3541918ceeb148b69b031a P 5e0e92538e1f44b2b0663afb330f899e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:11.388530 26752 raft_consensus.cc:740] T 3d85e7002e3541918ceeb148b69b031a P 5e0e92538e1f44b2b0663afb330f899e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e0e92538e1f44b2b0663afb330f899e, State: Initialized, Role: FOLLOWER
I20260709 13:10:11.388676 26751 raft_consensus.cc:359] T 466849fd1988469fb5b4037151d7f2bb P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:11.404022 26724 raft_consensus.cc:493] T 4d80d20237654d6583f181577681e4ba P 5e0e92538e1f44b2b0663afb330f899e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:11.404783 26751 raft_consensus.cc:385] T 466849fd1988469fb5b4037151d7f2bb P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:11.407359 26724 raft_consensus.cc:515] T 4d80d20237654d6583f181577681e4ba P 5e0e92538e1f44b2b0663afb330f899e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:11.409196 26771 raft_consensus.cc:515] T 505a912bda074202915407e904a3d790 P 5e0e92538e1f44b2b0663afb330f899e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:11.408958 26751 raft_consensus.cc:740] T 466849fd1988469fb5b4037151d7f2bb P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff0fe65aa4b1405d84e4597f9aa7f87c, State: Initialized, Role: FOLLOWER
I20260709 13:10:11.406198 26752 consensus_queue.cc:260] T 3d85e7002e3541918ceeb148b69b031a P 5e0e92538e1f44b2b0663afb330f899e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:11.412925 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505a912bda074202915407e904a3d790" candidate_uuid: "5e0e92538e1f44b2b0663afb330f899e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5189d1d1a034d8b92a7973b50ab5110"
I20260709 13:10:11.413429 26771 leader_election.cc:290] T 505a912bda074202915407e904a3d790 P 5e0e92538e1f44b2b0663afb330f899e [CANDIDATE]: Term 1 election: Requested vote from peers ff0fe65aa4b1405d84e4597f9aa7f87c (127.14.180.65:46829), b5189d1d1a034d8b92a7973b50ab5110 (127.14.180.67:40219)
I20260709 13:10:11.414124 26462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505a912bda074202915407e904a3d790" candidate_uuid: "5e0e92538e1f44b2b0663afb330f899e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c"
I20260709 13:10:11.414794 26462 raft_consensus.cc:3060] T 505a912bda074202915407e904a3d790 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:11.420085 26611 raft_consensus.cc:3060] T 505a912bda074202915407e904a3d790 P b5189d1d1a034d8b92a7973b50ab5110 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:11.421833 26751 consensus_queue.cc:260] T 466849fd1988469fb5b4037151d7f2bb P ff0fe65aa4b1405d84e4597f9aa7f87c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:11.423451 26724 leader_election.cc:290] T 4d80d20237654d6583f181577681e4ba P 5e0e92538e1f44b2b0663afb330f899e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ff0fe65aa4b1405d84e4597f9aa7f87c (127.14.180.65:46829), b5189d1d1a034d8b92a7973b50ab5110 (127.14.180.67:40219)
I20260709 13:10:11.425264 26751 ts_tablet_manager.cc:1434] T 466849fd1988469fb5b4037151d7f2bb P ff0fe65aa4b1405d84e4597f9aa7f87c: Time spent starting tablet: real 0.046s	user 0.009s	sys 0.000s
I20260709 13:10:11.433344 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d80d20237654d6583f181577681e4ba" candidate_uuid: "5e0e92538e1f44b2b0663afb330f899e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5189d1d1a034d8b92a7973b50ab5110" is_pre_election: true
I20260709 13:10:11.427515 26359 catalog_manager.cc:5697] T e98e96ff995841f09a4cdb66e9d7f87d P ff0fe65aa4b1405d84e4597f9aa7f87c reported cstate change: term changed from 0 to 1, leader changed from <none> to ff0fe65aa4b1405d84e4597f9aa7f87c (127.14.180.65). New cstate: current_term: 1 leader_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:11.436328 26461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d80d20237654d6583f181577681e4ba" candidate_uuid: "5e0e92538e1f44b2b0663afb330f899e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" is_pre_election: true
I20260709 13:10:11.440285 26751 tablet_bootstrap.cc:492] T 3d85e7002e3541918ceeb148b69b031a P ff0fe65aa4b1405d84e4597f9aa7f87c: Bootstrap starting.
I20260709 13:10:11.441044 26461 raft_consensus.cc:2468] T 4d80d20237654d6583f181577681e4ba P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0e92538e1f44b2b0663afb330f899e in term 0.
I20260709 13:10:11.447427 26611 raft_consensus.cc:2468] T 505a912bda074202915407e904a3d790 P b5189d1d1a034d8b92a7973b50ab5110 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e0e92538e1f44b2b0663afb330f899e in term 1.
I20260709 13:10:11.447899 26766 raft_consensus.cc:493] T 466849fd1988469fb5b4037151d7f2bb P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:11.440047 26610 raft_consensus.cc:2468] T 4d80d20237654d6583f181577681e4ba P b5189d1d1a034d8b92a7973b50ab5110 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0e92538e1f44b2b0663afb330f899e in term 0.
I20260709 13:10:11.448328 26753 tablet_bootstrap.cc:654] T fb9df82425e34bcca37fd6c21be9f576 P b5189d1d1a034d8b92a7973b50ab5110: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:11.449036 26501 leader_election.cc:304] T 505a912bda074202915407e904a3d790 P 5e0e92538e1f44b2b0663afb330f899e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0e92538e1f44b2b0663afb330f899e, b5189d1d1a034d8b92a7973b50ab5110; no voters: 
I20260709 13:10:11.448658 26766 raft_consensus.cc:515] T 466849fd1988469fb5b4037151d7f2bb P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:11.450973 26500 leader_election.cc:304] T 4d80d20237654d6583f181577681e4ba P 5e0e92538e1f44b2b0663afb330f899e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0e92538e1f44b2b0663afb330f899e, ff0fe65aa4b1405d84e4597f9aa7f87c; no voters: 
I20260709 13:10:11.460238 26752 ts_tablet_manager.cc:1434] T 3d85e7002e3541918ceeb148b69b031a P 5e0e92538e1f44b2b0663afb330f899e: Time spent starting tablet: real 0.097s	user 0.017s	sys 0.030s
I20260709 13:10:11.461638 26752 tablet_bootstrap.cc:492] T 466849fd1988469fb5b4037151d7f2bb P 5e0e92538e1f44b2b0663afb330f899e: Bootstrap starting.
I20260709 13:10:11.467510 26724 raft_consensus.cc:2804] T 4d80d20237654d6583f181577681e4ba P 5e0e92538e1f44b2b0663afb330f899e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:11.469463 26724 raft_consensus.cc:493] T 4d80d20237654d6583f181577681e4ba P 5e0e92538e1f44b2b0663afb330f899e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:11.470072 26724 raft_consensus.cc:3060] T 4d80d20237654d6583f181577681e4ba P 5e0e92538e1f44b2b0663afb330f899e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:11.468988 26751 tablet_bootstrap.cc:654] T 3d85e7002e3541918ceeb148b69b031a P ff0fe65aa4b1405d84e4597f9aa7f87c: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:11.462671 26771 raft_consensus.cc:2804] T 505a912bda074202915407e904a3d790 P 5e0e92538e1f44b2b0663afb330f899e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:11.473285 26771 raft_consensus.cc:697] T 505a912bda074202915407e904a3d790 P 5e0e92538e1f44b2b0663afb330f899e [term 1 LEADER]: Becoming Leader. State: Replica: 5e0e92538e1f44b2b0663afb330f899e, State: Running, Role: LEADER
I20260709 13:10:11.474661 26771 consensus_queue.cc:237] T 505a912bda074202915407e904a3d790 P 5e0e92538e1f44b2b0663afb330f899e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:11.479519 26766 leader_election.cc:290] T 466849fd1988469fb5b4037151d7f2bb P ff0fe65aa4b1405d84e4597f9aa7f87c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e0e92538e1f44b2b0663afb330f899e (127.14.180.66:46615), b5189d1d1a034d8b92a7973b50ab5110 (127.14.180.67:40219)
I20260709 13:10:11.481161 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "466849fd1988469fb5b4037151d7f2bb" candidate_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5189d1d1a034d8b92a7973b50ab5110" is_pre_election: true
I20260709 13:10:11.482175 26611 raft_consensus.cc:2468] T 466849fd1988469fb5b4037151d7f2bb P b5189d1d1a034d8b92a7973b50ab5110 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff0fe65aa4b1405d84e4597f9aa7f87c in term 0.
I20260709 13:10:11.483343 26462 raft_consensus.cc:2468] T 505a912bda074202915407e904a3d790 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e0e92538e1f44b2b0663afb330f899e in term 1.
I20260709 13:10:11.483474 26426 leader_election.cc:304] T 466849fd1988469fb5b4037151d7f2bb P ff0fe65aa4b1405d84e4597f9aa7f87c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5189d1d1a034d8b92a7973b50ab5110, ff0fe65aa4b1405d84e4597f9aa7f87c; no voters: 
I20260709 13:10:11.491976 26752 tablet_bootstrap.cc:654] T 466849fd1988469fb5b4037151d7f2bb P 5e0e92538e1f44b2b0663afb330f899e: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:11.487752 26766 raft_consensus.cc:2804] T 466849fd1988469fb5b4037151d7f2bb P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:11.511514 26536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "466849fd1988469fb5b4037151d7f2bb" candidate_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0e92538e1f44b2b0663afb330f899e" is_pre_election: true
I20260709 13:10:11.505877 26766 raft_consensus.cc:493] T 466849fd1988469fb5b4037151d7f2bb P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:11.516587 26427 leader_election.cc:343] T 466849fd1988469fb5b4037151d7f2bb P ff0fe65aa4b1405d84e4597f9aa7f87c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e0e92538e1f44b2b0663afb330f899e (127.14.180.66:46615): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:11.518162 26751 tablet_bootstrap.cc:492] T 3d85e7002e3541918ceeb148b69b031a P ff0fe65aa4b1405d84e4597f9aa7f87c: No bootstrap required, opened a new log
I20260709 13:10:11.518661 26753 tablet_bootstrap.cc:492] T fb9df82425e34bcca37fd6c21be9f576 P b5189d1d1a034d8b92a7973b50ab5110: No bootstrap required, opened a new log
I20260709 13:10:11.518793 26751 ts_tablet_manager.cc:1403] T 3d85e7002e3541918ceeb148b69b031a P ff0fe65aa4b1405d84e4597f9aa7f87c: Time spent bootstrapping tablet: real 0.079s	user 0.019s	sys 0.020s
I20260709 13:10:11.515846 26766 raft_consensus.cc:3060] T 466849fd1988469fb5b4037151d7f2bb P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:11.521631 26753 ts_tablet_manager.cc:1403] T fb9df82425e34bcca37fd6c21be9f576 P b5189d1d1a034d8b92a7973b50ab5110: Time spent bootstrapping tablet: real 0.138s	user 0.019s	sys 0.007s
I20260709 13:10:11.525035 26753 raft_consensus.cc:359] T fb9df82425e34bcca37fd6c21be9f576 P b5189d1d1a034d8b92a7973b50ab5110 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:11.525858 26753 raft_consensus.cc:385] T fb9df82425e34bcca37fd6c21be9f576 P b5189d1d1a034d8b92a7973b50ab5110 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:11.518723 26724 raft_consensus.cc:515] T 4d80d20237654d6583f181577681e4ba P 5e0e92538e1f44b2b0663afb330f899e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:11.526320 26753 raft_consensus.cc:740] T fb9df82425e34bcca37fd6c21be9f576 P b5189d1d1a034d8b92a7973b50ab5110 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5189d1d1a034d8b92a7973b50ab5110, State: Initialized, Role: FOLLOWER
I20260709 13:10:11.527263 26753 consensus_queue.cc:260] T fb9df82425e34bcca37fd6c21be9f576 P b5189d1d1a034d8b92a7973b50ab5110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:11.528404 26724 leader_election.cc:290] T 4d80d20237654d6583f181577681e4ba P 5e0e92538e1f44b2b0663afb330f899e [CANDIDATE]: Term 1 election: Requested vote from peers ff0fe65aa4b1405d84e4597f9aa7f87c (127.14.180.65:46829), b5189d1d1a034d8b92a7973b50ab5110 (127.14.180.67:40219)
I20260709 13:10:11.529606 26462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d80d20237654d6583f181577681e4ba" candidate_uuid: "5e0e92538e1f44b2b0663afb330f899e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c"
I20260709 13:10:11.529877 26751 raft_consensus.cc:359] T 3d85e7002e3541918ceeb148b69b031a P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:11.530740 26751 raft_consensus.cc:385] T 3d85e7002e3541918ceeb148b69b031a P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:11.531034 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d80d20237654d6583f181577681e4ba" candidate_uuid: "5e0e92538e1f44b2b0663afb330f899e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5189d1d1a034d8b92a7973b50ab5110"
I20260709 13:10:11.531975 26611 raft_consensus.cc:3060] T 4d80d20237654d6583f181577681e4ba P b5189d1d1a034d8b92a7973b50ab5110 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:11.530342 26462 raft_consensus.cc:3060] T 4d80d20237654d6583f181577681e4ba P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:11.542655 26753 ts_tablet_manager.cc:1434] T fb9df82425e34bcca37fd6c21be9f576 P b5189d1d1a034d8b92a7973b50ab5110: Time spent starting tablet: real 0.021s	user 0.009s	sys 0.000s
I20260709 13:10:11.542997 26462 raft_consensus.cc:2468] T 4d80d20237654d6583f181577681e4ba P ff0fe65aa4b1405d84e4597f9aa7f87c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e0e92538e1f44b2b0663afb330f899e in term 1.
I20260709 13:10:11.531052 26751 raft_consensus.cc:740] T 3d85e7002e3541918ceeb148b69b031a P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff0fe65aa4b1405d84e4597f9aa7f87c, State: Initialized, Role: FOLLOWER
I20260709 13:10:11.544364 26753 tablet_bootstrap.cc:492] T a708761fa65e433fbebfee909b452c37 P b5189d1d1a034d8b92a7973b50ab5110: Bootstrap starting.
I20260709 13:10:11.545137 26751 consensus_queue.cc:260] T 3d85e7002e3541918ceeb148b69b031a P ff0fe65aa4b1405d84e4597f9aa7f87c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:11.529896 26752 tablet_bootstrap.cc:492] T 466849fd1988469fb5b4037151d7f2bb P 5e0e92538e1f44b2b0663afb330f899e: No bootstrap required, opened a new log
I20260709 13:10:11.546360 26500 leader_election.cc:304] T 4d80d20237654d6583f181577681e4ba P 5e0e92538e1f44b2b0663afb330f899e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0e92538e1f44b2b0663afb330f899e, ff0fe65aa4b1405d84e4597f9aa7f87c; no voters: 
I20260709 13:10:11.547170 26752 ts_tablet_manager.cc:1403] T 466849fd1988469fb5b4037151d7f2bb P 5e0e92538e1f44b2b0663afb330f899e: Time spent bootstrapping tablet: real 0.086s	user 0.021s	sys 0.018s
I20260709 13:10:11.547940 26724 raft_consensus.cc:2804] T 4d80d20237654d6583f181577681e4ba P 5e0e92538e1f44b2b0663afb330f899e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:11.548542 26724 raft_consensus.cc:697] T 4d80d20237654d6583f181577681e4ba P 5e0e92538e1f44b2b0663afb330f899e [term 1 LEADER]: Becoming Leader. State: Replica: 5e0e92538e1f44b2b0663afb330f899e, State: Running, Role: LEADER
I20260709 13:10:11.549427 26724 consensus_queue.cc:237] T 4d80d20237654d6583f181577681e4ba P 5e0e92538e1f44b2b0663afb330f899e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:11.550819 26752 raft_consensus.cc:359] T 466849fd1988469fb5b4037151d7f2bb P 5e0e92538e1f44b2b0663afb330f899e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:11.551604 26753 tablet_bootstrap.cc:654] T a708761fa65e433fbebfee909b452c37 P b5189d1d1a034d8b92a7973b50ab5110: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:11.551819 26752 raft_consensus.cc:385] T 466849fd1988469fb5b4037151d7f2bb P 5e0e92538e1f44b2b0663afb330f899e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:11.552268 26752 raft_consensus.cc:740] T 466849fd1988469fb5b4037151d7f2bb P 5e0e92538e1f44b2b0663afb330f899e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e0e92538e1f44b2b0663afb330f899e, State: Initialized, Role: FOLLOWER
I20260709 13:10:11.527953 26766 raft_consensus.cc:515] T 466849fd1988469fb5b4037151d7f2bb P ff0fe65aa4b1405d84e4597f9aa7f87c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:11.555204 26611 raft_consensus.cc:2468] T 4d80d20237654d6583f181577681e4ba P b5189d1d1a034d8b92a7973b50ab5110 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e0e92538e1f44b2b0663afb330f899e in term 1.
I20260709 13:10:11.556051 26766 leader_election.cc:290] T 466849fd1988469fb5b4037151d7f2bb P ff0fe65aa4b1405d84e4597f9aa7f87c [CANDIDATE]: Term 1 election: Requested vote from peers 5e0e92538e1f44b2b0663afb330f899e (127.14.180.66:46615), b5189d1d1a034d8b92a7973b50ab5110 (127.14.180.67:40219)
I20260709 13:10:11.553172 26752 consensus_queue.cc:260] T 466849fd1988469fb5b4037151d7f2bb P 5e0e92538e1f44b2b0663afb330f899e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:11.557883 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "466849fd1988469fb5b4037151d7f2bb" candidate_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5189d1d1a034d8b92a7973b50ab5110"
I20260709 13:10:11.559084 26610 raft_consensus.cc:3060] T 466849fd1988469fb5b4037151d7f2bb P b5189d1d1a034d8b92a7973b50ab5110 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:11.560392 26752 ts_tablet_manager.cc:1434] T 466849fd1988469fb5b4037151d7f2bb P 5e0e92538e1f44b2b0663afb330f899e: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 13:10:11.561609 26752 tablet_bootstrap.cc:492] T fb9df82425e34bcca37fd6c21be9f576 P 5e0e92538e1f44b2b0663afb330f899e: Bootstrap starting.
I20260709 13:10:11.563587 26536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "466849fd1988469fb5b4037151d7f2bb" candidate_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0e92538e1f44b2b0663afb330f899e"
I20260709 13:10:11.557941 26751 ts_tablet_manager.cc:1434] T 3d85e7002e3541918ceeb148b69b031a P ff0fe65aa4b1405d84e4597f9aa7f87c: Time spent starting tablet: real 0.038s	user 0.007s	sys 0.000s
I20260709 13:10:11.564455 26536 raft_consensus.cc:3060] T 466849fd1988469fb5b4037151d7f2bb P 5e0e92538e1f44b2b0663afb330f899e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:11.565748 26751 tablet_bootstrap.cc:492] T 6bff6969f3eb4e2689b75b066440caef P ff0fe65aa4b1405d84e4597f9aa7f87c: Bootstrap starting.
I20260709 13:10:11.573361 26536 raft_consensus.cc:2468] T 466849fd1988469fb5b4037151d7f2bb P 5e0e92538e1f44b2b0663afb330f899e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff0fe65aa4b1405d84e4597f9aa7f87c in term 1.
I20260709 13:10:11.574996 26427 leader_election.cc:304] T 466849fd1988469fb5b4037151d7f2bb P ff0fe65aa4b1405d84e4597f9aa7f87c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0e92538e1f44b2b0663afb330f899e, ff0fe65aa4b1405d84e4597f9aa7f87c; no voters: 
I20260709 13:10:11.577070 26766 raft_consensus.cc:2804] T 466849fd1988469fb5b4037151d7f2bb P ff0fe65aa4b1405d84e4597f9aa7f87c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:11.577684 26766 raft_consensus.cc:697] T 466849fd1988469fb5b4037151d7f2bb P ff0fe65aa4b1405d84e4597f9aa7f87c [term 1 LEADER]: Becoming Leader. State: Replica: ff0fe65aa4b1405d84e4597f9aa7f87c, State: Running, Role: LEADER
I20260709 13:10:11.578840 26766 consensus_queue.cc:237] T 466849fd1988469fb5b4037151d7f2bb P ff0fe65aa4b1405d84e4597f9aa7f87c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:11.573406 26751 tablet_bootstrap.cc:654] T 6bff6969f3eb4e2689b75b066440caef P ff0fe65aa4b1405d84e4597f9aa7f87c: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:11.585493 26752 tablet_bootstrap.cc:654] T fb9df82425e34bcca37fd6c21be9f576 P 5e0e92538e1f44b2b0663afb330f899e: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:11.588982 26360 catalog_manager.cc:5697] T 505a912bda074202915407e904a3d790 P 5e0e92538e1f44b2b0663afb330f899e reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e0e92538e1f44b2b0663afb330f899e (127.14.180.66). New cstate: current_term: 1 leader_uuid: "5e0e92538e1f44b2b0663afb330f899e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:11.592471 26751 tablet_bootstrap.cc:492] T 6bff6969f3eb4e2689b75b066440caef P ff0fe65aa4b1405d84e4597f9aa7f87c: No bootstrap required, opened a new log
I20260709 13:10:11.593271 26751 ts_tablet_manager.cc:1403] T 6bff6969f3eb4e2689b75b066440caef P ff0fe65aa4b1405d84e4597f9aa7f87c: Time spent bootstrapping tablet: real 0.028s	user 0.012s	sys 0.000s
I20260709 13:10:11.597383 26751 raft_consensus.cc:359] T 6bff6969f3eb4e2689b75b066440caef P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:11.598587 26751 raft_consensus.cc:385] T 6bff6969f3eb4e2689b75b066440caef P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:11.599002 26751 raft_consensus.cc:740] T 6bff6969f3eb4e2689b75b066440caef P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff0fe65aa4b1405d84e4597f9aa7f87c, State: Initialized, Role: FOLLOWER
I20260709 13:10:11.600008 26751 consensus_queue.cc:260] T 6bff6969f3eb4e2689b75b066440caef P ff0fe65aa4b1405d84e4597f9aa7f87c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:11.606794 26752 tablet_bootstrap.cc:492] T fb9df82425e34bcca37fd6c21be9f576 P 5e0e92538e1f44b2b0663afb330f899e: No bootstrap required, opened a new log
I20260709 13:10:11.607486 26752 ts_tablet_manager.cc:1403] T fb9df82425e34bcca37fd6c21be9f576 P 5e0e92538e1f44b2b0663afb330f899e: Time spent bootstrapping tablet: real 0.046s	user 0.015s	sys 0.000s
I20260709 13:10:11.607697 26751 ts_tablet_manager.cc:1434] T 6bff6969f3eb4e2689b75b066440caef P ff0fe65aa4b1405d84e4597f9aa7f87c: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.002s
I20260709 13:10:11.608916 26751 tablet_bootstrap.cc:492] T fb9df82425e34bcca37fd6c21be9f576 P ff0fe65aa4b1405d84e4597f9aa7f87c: Bootstrap starting.
I20260709 13:10:11.610891 26752 raft_consensus.cc:359] T fb9df82425e34bcca37fd6c21be9f576 P 5e0e92538e1f44b2b0663afb330f899e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:11.612143 26752 raft_consensus.cc:385] T fb9df82425e34bcca37fd6c21be9f576 P 5e0e92538e1f44b2b0663afb330f899e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:11.612475 26752 raft_consensus.cc:740] T fb9df82425e34bcca37fd6c21be9f576 P 5e0e92538e1f44b2b0663afb330f899e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e0e92538e1f44b2b0663afb330f899e, State: Initialized, Role: FOLLOWER
I20260709 13:10:11.613394 26752 consensus_queue.cc:260] T fb9df82425e34bcca37fd6c21be9f576 P 5e0e92538e1f44b2b0663afb330f899e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:11.616983 26751 tablet_bootstrap.cc:654] T fb9df82425e34bcca37fd6c21be9f576 P ff0fe65aa4b1405d84e4597f9aa7f87c: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:11.618482 26752 ts_tablet_manager.cc:1434] T fb9df82425e34bcca37fd6c21be9f576 P 5e0e92538e1f44b2b0663afb330f899e: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.001s
I20260709 13:10:11.619784 26752 tablet_bootstrap.cc:492] T 6bff6969f3eb4e2689b75b066440caef P 5e0e92538e1f44b2b0663afb330f899e: Bootstrap starting.
I20260709 13:10:11.624424 26610 raft_consensus.cc:2468] T 466849fd1988469fb5b4037151d7f2bb P b5189d1d1a034d8b92a7973b50ab5110 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff0fe65aa4b1405d84e4597f9aa7f87c in term 1.
I20260709 13:10:11.640271 26752 tablet_bootstrap.cc:654] T 6bff6969f3eb4e2689b75b066440caef P 5e0e92538e1f44b2b0663afb330f899e: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:11.645690 26753 tablet_bootstrap.cc:492] T a708761fa65e433fbebfee909b452c37 P b5189d1d1a034d8b92a7973b50ab5110: No bootstrap required, opened a new log
I20260709 13:10:11.646241 26753 ts_tablet_manager.cc:1403] T a708761fa65e433fbebfee909b452c37 P b5189d1d1a034d8b92a7973b50ab5110: Time spent bootstrapping tablet: real 0.102s	user 0.037s	sys 0.031s
I20260709 13:10:11.647358 26360 catalog_manager.cc:5697] T 4d80d20237654d6583f181577681e4ba P 5e0e92538e1f44b2b0663afb330f899e reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e0e92538e1f44b2b0663afb330f899e (127.14.180.66). New cstate: current_term: 1 leader_uuid: "5e0e92538e1f44b2b0663afb330f899e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:11.648356 26751 tablet_bootstrap.cc:492] T fb9df82425e34bcca37fd6c21be9f576 P ff0fe65aa4b1405d84e4597f9aa7f87c: No bootstrap required, opened a new log
I20260709 13:10:11.649243 26751 ts_tablet_manager.cc:1403] T fb9df82425e34bcca37fd6c21be9f576 P ff0fe65aa4b1405d84e4597f9aa7f87c: Time spent bootstrapping tablet: real 0.041s	user 0.010s	sys 0.024s
I20260709 13:10:11.649389 26753 raft_consensus.cc:359] T a708761fa65e433fbebfee909b452c37 P b5189d1d1a034d8b92a7973b50ab5110 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:11.650251 26753 raft_consensus.cc:385] T a708761fa65e433fbebfee909b452c37 P b5189d1d1a034d8b92a7973b50ab5110 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:11.650576 26753 raft_consensus.cc:740] T a708761fa65e433fbebfee909b452c37 P b5189d1d1a034d8b92a7973b50ab5110 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5189d1d1a034d8b92a7973b50ab5110, State: Initialized, Role: FOLLOWER
I20260709 13:10:11.651414 26753 consensus_queue.cc:260] T a708761fa65e433fbebfee909b452c37 P b5189d1d1a034d8b92a7973b50ab5110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:11.658324 26753 ts_tablet_manager.cc:1434] T a708761fa65e433fbebfee909b452c37 P b5189d1d1a034d8b92a7973b50ab5110: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.001s
I20260709 13:10:11.653700 26751 raft_consensus.cc:359] T fb9df82425e34bcca37fd6c21be9f576 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:11.662099 26751 raft_consensus.cc:385] T fb9df82425e34bcca37fd6c21be9f576 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:11.662447 26359 catalog_manager.cc:5697] T 466849fd1988469fb5b4037151d7f2bb P ff0fe65aa4b1405d84e4597f9aa7f87c reported cstate change: term changed from 0 to 1, leader changed from <none> to ff0fe65aa4b1405d84e4597f9aa7f87c (127.14.180.65). New cstate: current_term: 1 leader_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:11.663916 26751 raft_consensus.cc:740] T fb9df82425e34bcca37fd6c21be9f576 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff0fe65aa4b1405d84e4597f9aa7f87c, State: Initialized, Role: FOLLOWER
I20260709 13:10:11.664397 26753 tablet_bootstrap.cc:492] T 6bff6969f3eb4e2689b75b066440caef P b5189d1d1a034d8b92a7973b50ab5110: Bootstrap starting.
I20260709 13:10:11.664983 26751 consensus_queue.cc:260] T fb9df82425e34bcca37fd6c21be9f576 P ff0fe65aa4b1405d84e4597f9aa7f87c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:11.665712 26752 tablet_bootstrap.cc:492] T 6bff6969f3eb4e2689b75b066440caef P 5e0e92538e1f44b2b0663afb330f899e: No bootstrap required, opened a new log
I20260709 13:10:11.666630 26752 ts_tablet_manager.cc:1403] T 6bff6969f3eb4e2689b75b066440caef P 5e0e92538e1f44b2b0663afb330f899e: Time spent bootstrapping tablet: real 0.047s	user 0.015s	sys 0.020s
I20260709 13:10:11.668068 26751 ts_tablet_manager.cc:1434] T fb9df82425e34bcca37fd6c21be9f576 P ff0fe65aa4b1405d84e4597f9aa7f87c: Time spent starting tablet: real 0.018s	user 0.011s	sys 0.001s
I20260709 13:10:11.669375 26751 tablet_bootstrap.cc:492] T fe0733029c394a438e698d0b85493c36 P ff0fe65aa4b1405d84e4597f9aa7f87c: Bootstrap starting.
I20260709 13:10:11.670030 26752 raft_consensus.cc:359] T 6bff6969f3eb4e2689b75b066440caef P 5e0e92538e1f44b2b0663afb330f899e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:11.670890 26752 raft_consensus.cc:385] T 6bff6969f3eb4e2689b75b066440caef P 5e0e92538e1f44b2b0663afb330f899e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:11.671237 26752 raft_consensus.cc:740] T 6bff6969f3eb4e2689b75b066440caef P 5e0e92538e1f44b2b0663afb330f899e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e0e92538e1f44b2b0663afb330f899e, State: Initialized, Role: FOLLOWER
I20260709 13:10:11.672430 26753 tablet_bootstrap.cc:654] T 6bff6969f3eb4e2689b75b066440caef P b5189d1d1a034d8b92a7973b50ab5110: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:11.672120 26752 consensus_queue.cc:260] T 6bff6969f3eb4e2689b75b066440caef P 5e0e92538e1f44b2b0663afb330f899e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:11.675006 26752 ts_tablet_manager.cc:1434] T 6bff6969f3eb4e2689b75b066440caef P 5e0e92538e1f44b2b0663afb330f899e: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.002s
I20260709 13:10:11.676108 26752 tablet_bootstrap.cc:492] T a708761fa65e433fbebfee909b452c37 P 5e0e92538e1f44b2b0663afb330f899e: Bootstrap starting.
I20260709 13:10:11.678074 26751 tablet_bootstrap.cc:654] T fe0733029c394a438e698d0b85493c36 P ff0fe65aa4b1405d84e4597f9aa7f87c: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:11.688097 26752 tablet_bootstrap.cc:654] T a708761fa65e433fbebfee909b452c37 P 5e0e92538e1f44b2b0663afb330f899e: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:11.699843 26752 tablet_bootstrap.cc:492] T a708761fa65e433fbebfee909b452c37 P 5e0e92538e1f44b2b0663afb330f899e: No bootstrap required, opened a new log
I20260709 13:10:11.700364 26752 ts_tablet_manager.cc:1403] T a708761fa65e433fbebfee909b452c37 P 5e0e92538e1f44b2b0663afb330f899e: Time spent bootstrapping tablet: real 0.025s	user 0.016s	sys 0.001s
I20260709 13:10:11.701977 26753 tablet_bootstrap.cc:492] T 6bff6969f3eb4e2689b75b066440caef P b5189d1d1a034d8b92a7973b50ab5110: No bootstrap required, opened a new log
I20260709 13:10:11.702772 26753 ts_tablet_manager.cc:1403] T 6bff6969f3eb4e2689b75b066440caef P b5189d1d1a034d8b92a7973b50ab5110: Time spent bootstrapping tablet: real 0.039s	user 0.014s	sys 0.000s
I20260709 13:10:11.702632 26752 raft_consensus.cc:359] T a708761fa65e433fbebfee909b452c37 P 5e0e92538e1f44b2b0663afb330f899e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:11.703300 26752 raft_consensus.cc:385] T a708761fa65e433fbebfee909b452c37 P 5e0e92538e1f44b2b0663afb330f899e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:11.703477 26752 raft_consensus.cc:740] T a708761fa65e433fbebfee909b452c37 P 5e0e92538e1f44b2b0663afb330f899e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e0e92538e1f44b2b0663afb330f899e, State: Initialized, Role: FOLLOWER
I20260709 13:10:11.704083 26752 consensus_queue.cc:260] T a708761fa65e433fbebfee909b452c37 P 5e0e92538e1f44b2b0663afb330f899e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:11.706182 26753 raft_consensus.cc:359] T 6bff6969f3eb4e2689b75b066440caef P b5189d1d1a034d8b92a7973b50ab5110 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:11.706897 26752 ts_tablet_manager.cc:1434] T a708761fa65e433fbebfee909b452c37 P 5e0e92538e1f44b2b0663afb330f899e: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.003s
I20260709 13:10:11.706971 26753 raft_consensus.cc:385] T 6bff6969f3eb4e2689b75b066440caef P b5189d1d1a034d8b92a7973b50ab5110 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:11.707465 26753 raft_consensus.cc:740] T 6bff6969f3eb4e2689b75b066440caef P b5189d1d1a034d8b92a7973b50ab5110 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5189d1d1a034d8b92a7973b50ab5110, State: Initialized, Role: FOLLOWER
I20260709 13:10:11.707891 26751 tablet_bootstrap.cc:492] T fe0733029c394a438e698d0b85493c36 P ff0fe65aa4b1405d84e4597f9aa7f87c: No bootstrap required, opened a new log
I20260709 13:10:11.708042 26752 tablet_bootstrap.cc:492] T fe0733029c394a438e698d0b85493c36 P 5e0e92538e1f44b2b0663afb330f899e: Bootstrap starting.
I20260709 13:10:11.708767 26751 ts_tablet_manager.cc:1403] T fe0733029c394a438e698d0b85493c36 P ff0fe65aa4b1405d84e4597f9aa7f87c: Time spent bootstrapping tablet: real 0.040s	user 0.012s	sys 0.024s
I20260709 13:10:11.708189 26753 consensus_queue.cc:260] T 6bff6969f3eb4e2689b75b066440caef P b5189d1d1a034d8b92a7973b50ab5110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:11.709148 26771 raft_consensus.cc:493] T fb9df82425e34bcca37fd6c21be9f576 P 5e0e92538e1f44b2b0663afb330f899e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:11.710657 26753 ts_tablet_manager.cc:1434] T 6bff6969f3eb4e2689b75b066440caef P b5189d1d1a034d8b92a7973b50ab5110: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:10:11.711612 26753 tablet_bootstrap.cc:492] T fe0733029c394a438e698d0b85493c36 P b5189d1d1a034d8b92a7973b50ab5110: Bootstrap starting.
I20260709 13:10:11.711908 26751 raft_consensus.cc:359] T fe0733029c394a438e698d0b85493c36 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:11.712720 26751 raft_consensus.cc:385] T fe0733029c394a438e698d0b85493c36 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:11.713027 26751 raft_consensus.cc:740] T fe0733029c394a438e698d0b85493c36 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff0fe65aa4b1405d84e4597f9aa7f87c, State: Initialized, Role: FOLLOWER
I20260709 13:10:11.713775 26751 consensus_queue.cc:260] T fe0733029c394a438e698d0b85493c36 P ff0fe65aa4b1405d84e4597f9aa7f87c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:11.715943 26751 ts_tablet_manager.cc:1434] T fe0733029c394a438e698d0b85493c36 P ff0fe65aa4b1405d84e4597f9aa7f87c: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:10:11.716881 26752 tablet_bootstrap.cc:654] T fe0733029c394a438e698d0b85493c36 P 5e0e92538e1f44b2b0663afb330f899e: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:11.718216 26753 tablet_bootstrap.cc:654] T fe0733029c394a438e698d0b85493c36 P b5189d1d1a034d8b92a7973b50ab5110: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:11.718680 26773 raft_consensus.cc:493] T a708761fa65e433fbebfee909b452c37 P b5189d1d1a034d8b92a7973b50ab5110 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:11.719224 26773 raft_consensus.cc:515] T a708761fa65e433fbebfee909b452c37 P b5189d1d1a034d8b92a7973b50ab5110 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:11.717913 26751 tablet_bootstrap.cc:492] T a708761fa65e433fbebfee909b452c37 P ff0fe65aa4b1405d84e4597f9aa7f87c: Bootstrap starting.
I20260709 13:10:11.722767 26536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a708761fa65e433fbebfee909b452c37" candidate_uuid: "b5189d1d1a034d8b92a7973b50ab5110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0e92538e1f44b2b0663afb330f899e" is_pre_election: true
I20260709 13:10:11.723536 26536 raft_consensus.cc:2468] T a708761fa65e433fbebfee909b452c37 P 5e0e92538e1f44b2b0663afb330f899e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5189d1d1a034d8b92a7973b50ab5110 in term 0.
I20260709 13:10:11.724696 26773 leader_election.cc:290] T a708761fa65e433fbebfee909b452c37 P b5189d1d1a034d8b92a7973b50ab5110 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ff0fe65aa4b1405d84e4597f9aa7f87c (127.14.180.65:46829), 5e0e92538e1f44b2b0663afb330f899e (127.14.180.66:46615)
I20260709 13:10:11.727332 26766 raft_consensus.cc:493] T 3d85e7002e3541918ceeb148b69b031a P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:11.727991 26462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a708761fa65e433fbebfee909b452c37" candidate_uuid: "b5189d1d1a034d8b92a7973b50ab5110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" is_pre_election: true
I20260709 13:10:11.728135 26766 raft_consensus.cc:515] T 3d85e7002e3541918ceeb148b69b031a P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:11.725876 26576 leader_election.cc:304] T a708761fa65e433fbebfee909b452c37 P b5189d1d1a034d8b92a7973b50ab5110 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0e92538e1f44b2b0663afb330f899e, b5189d1d1a034d8b92a7973b50ab5110; no voters: 
W20260709 13:10:11.730517 26574 leader_election.cc:343] T a708761fa65e433fbebfee909b452c37 P b5189d1d1a034d8b92a7973b50ab5110 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ff0fe65aa4b1405d84e4597f9aa7f87c (127.14.180.65:46829): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:11.730845 26751 tablet_bootstrap.cc:654] T a708761fa65e433fbebfee909b452c37 P ff0fe65aa4b1405d84e4597f9aa7f87c: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:11.709647 26771 raft_consensus.cc:515] T fb9df82425e34bcca37fd6c21be9f576 P 5e0e92538e1f44b2b0663afb330f899e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:11.733286 26771 leader_election.cc:290] T fb9df82425e34bcca37fd6c21be9f576 P 5e0e92538e1f44b2b0663afb330f899e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ff0fe65aa4b1405d84e4597f9aa7f87c (127.14.180.65:46829), b5189d1d1a034d8b92a7973b50ab5110 (127.14.180.67:40219)
I20260709 13:10:11.735050 26462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb9df82425e34bcca37fd6c21be9f576" candidate_uuid: "5e0e92538e1f44b2b0663afb330f899e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" is_pre_election: true
I20260709 13:10:11.735170 26536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d85e7002e3541918ceeb148b69b031a" candidate_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0e92538e1f44b2b0663afb330f899e" is_pre_election: true
I20260709 13:10:11.735736 26462 raft_consensus.cc:2468] T fb9df82425e34bcca37fd6c21be9f576 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0e92538e1f44b2b0663afb330f899e in term 0.
I20260709 13:10:11.736120 26536 raft_consensus.cc:2468] T 3d85e7002e3541918ceeb148b69b031a P 5e0e92538e1f44b2b0663afb330f899e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff0fe65aa4b1405d84e4597f9aa7f87c in term 0.
I20260709 13:10:11.736966 26730 raft_consensus.cc:493] T fe0733029c394a438e698d0b85493c36 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:11.737486 26730 raft_consensus.cc:515] T fe0733029c394a438e698d0b85493c36 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:11.738260 26738 raft_consensus.cc:2804] T a708761fa65e433fbebfee909b452c37 P b5189d1d1a034d8b92a7973b50ab5110 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:11.738705 26738 raft_consensus.cc:493] T a708761fa65e433fbebfee909b452c37 P b5189d1d1a034d8b92a7973b50ab5110 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:11.738294 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb9df82425e34bcca37fd6c21be9f576" candidate_uuid: "5e0e92538e1f44b2b0663afb330f899e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5189d1d1a034d8b92a7973b50ab5110" is_pre_election: true
I20260709 13:10:11.739312 26738 raft_consensus.cc:3060] T a708761fa65e433fbebfee909b452c37 P b5189d1d1a034d8b92a7973b50ab5110 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:11.739651 26730 leader_election.cc:290] T fe0733029c394a438e698d0b85493c36 P ff0fe65aa4b1405d84e4597f9aa7f87c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e0e92538e1f44b2b0663afb330f899e (127.14.180.66:46615), b5189d1d1a034d8b92a7973b50ab5110 (127.14.180.67:40219)
I20260709 13:10:11.739852 26427 leader_election.cc:304] T 3d85e7002e3541918ceeb148b69b031a P ff0fe65aa4b1405d84e4597f9aa7f87c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0e92538e1f44b2b0663afb330f899e, ff0fe65aa4b1405d84e4597f9aa7f87c; no voters: 
I20260709 13:10:11.740906 26500 leader_election.cc:304] T fb9df82425e34bcca37fd6c21be9f576 P 5e0e92538e1f44b2b0663afb330f899e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0e92538e1f44b2b0663afb330f899e, ff0fe65aa4b1405d84e4597f9aa7f87c; no voters: 
I20260709 13:10:11.742692 26771 raft_consensus.cc:2804] T fb9df82425e34bcca37fd6c21be9f576 P 5e0e92538e1f44b2b0663afb330f899e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:11.742482 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe0733029c394a438e698d0b85493c36" candidate_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5189d1d1a034d8b92a7973b50ab5110" is_pre_election: true
I20260709 13:10:11.739673 26610 raft_consensus.cc:2468] T fb9df82425e34bcca37fd6c21be9f576 P b5189d1d1a034d8b92a7973b50ab5110 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0e92538e1f44b2b0663afb330f899e in term 0.
I20260709 13:10:11.747720 26773 raft_consensus.cc:493] T fb9df82425e34bcca37fd6c21be9f576 P b5189d1d1a034d8b92a7973b50ab5110 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:11.748472 26773 raft_consensus.cc:515] T fb9df82425e34bcca37fd6c21be9f576 P b5189d1d1a034d8b92a7973b50ab5110 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:11.749511 26771 raft_consensus.cc:493] T fb9df82425e34bcca37fd6c21be9f576 P 5e0e92538e1f44b2b0663afb330f899e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:11.749946 26771 raft_consensus.cc:3060] T fb9df82425e34bcca37fd6c21be9f576 P 5e0e92538e1f44b2b0663afb330f899e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:11.747519 26769 raft_consensus.cc:2804] T 3d85e7002e3541918ceeb148b69b031a P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:11.751626 26769 raft_consensus.cc:493] T 3d85e7002e3541918ceeb148b69b031a P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:11.749616 26738 raft_consensus.cc:515] T a708761fa65e433fbebfee909b452c37 P b5189d1d1a034d8b92a7973b50ab5110 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:11.752192 26769 raft_consensus.cc:3060] T 3d85e7002e3541918ceeb148b69b031a P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:11.755260 26462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a708761fa65e433fbebfee909b452c37" candidate_uuid: "b5189d1d1a034d8b92a7973b50ab5110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c"
W20260709 13:10:11.756793 26574 leader_election.cc:343] T a708761fa65e433fbebfee909b452c37 P b5189d1d1a034d8b92a7973b50ab5110 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ff0fe65aa4b1405d84e4597f9aa7f87c (127.14.180.65:46829): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:11.747653 26426 leader_election.cc:343] T fe0733029c394a438e698d0b85493c36 P ff0fe65aa4b1405d84e4597f9aa7f87c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b5189d1d1a034d8b92a7973b50ab5110 (127.14.180.67:40219): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:11.758199 26771 raft_consensus.cc:515] T fb9df82425e34bcca37fd6c21be9f576 P 5e0e92538e1f44b2b0663afb330f899e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:11.759152 26738 leader_election.cc:290] T a708761fa65e433fbebfee909b452c37 P b5189d1d1a034d8b92a7973b50ab5110 [CANDIDATE]: Term 1 election: Requested vote from peers ff0fe65aa4b1405d84e4597f9aa7f87c (127.14.180.65:46829), 5e0e92538e1f44b2b0663afb330f899e (127.14.180.66:46615)
I20260709 13:10:11.759883 26535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a708761fa65e433fbebfee909b452c37" candidate_uuid: "b5189d1d1a034d8b92a7973b50ab5110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0e92538e1f44b2b0663afb330f899e"
I20260709 13:10:11.760867 26535 raft_consensus.cc:3060] T a708761fa65e433fbebfee909b452c37 P 5e0e92538e1f44b2b0663afb330f899e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:11.770720 26462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb9df82425e34bcca37fd6c21be9f576" candidate_uuid: "5e0e92538e1f44b2b0663afb330f899e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c"
I20260709 13:10:11.742489 26537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe0733029c394a438e698d0b85493c36" candidate_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0e92538e1f44b2b0663afb330f899e" is_pre_election: true
I20260709 13:10:11.771422 26462 raft_consensus.cc:3060] T fb9df82425e34bcca37fd6c21be9f576 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:11.784061 26427 leader_election.cc:343] T fe0733029c394a438e698d0b85493c36 P ff0fe65aa4b1405d84e4597f9aa7f87c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e0e92538e1f44b2b0663afb330f899e (127.14.180.66:46615): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:11.784662 26427 leader_election.cc:304] T fe0733029c394a438e698d0b85493c36 P ff0fe65aa4b1405d84e4597f9aa7f87c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ff0fe65aa4b1405d84e4597f9aa7f87c; no voters: 5e0e92538e1f44b2b0663afb330f899e, b5189d1d1a034d8b92a7973b50ab5110
I20260709 13:10:11.785399 26730 raft_consensus.cc:2749] T fe0733029c394a438e698d0b85493c36 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:11.786976 26462 raft_consensus.cc:2468] T fb9df82425e34bcca37fd6c21be9f576 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e0e92538e1f44b2b0663afb330f899e in term 1.
I20260709 13:10:11.791909 26766 leader_election.cc:290] T 3d85e7002e3541918ceeb148b69b031a P ff0fe65aa4b1405d84e4597f9aa7f87c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e0e92538e1f44b2b0663afb330f899e (127.14.180.66:46615), b5189d1d1a034d8b92a7973b50ab5110 (127.14.180.67:40219)
I20260709 13:10:11.792713 26500 leader_election.cc:304] T fb9df82425e34bcca37fd6c21be9f576 P 5e0e92538e1f44b2b0663afb330f899e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0e92538e1f44b2b0663afb330f899e, ff0fe65aa4b1405d84e4597f9aa7f87c; no voters: 
I20260709 13:10:11.793653 26724 raft_consensus.cc:2804] T fb9df82425e34bcca37fd6c21be9f576 P 5e0e92538e1f44b2b0663afb330f899e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:11.794574 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d85e7002e3541918ceeb148b69b031a" candidate_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5189d1d1a034d8b92a7973b50ab5110" is_pre_election: true
I20260709 13:10:11.795244 26610 raft_consensus.cc:2468] T 3d85e7002e3541918ceeb148b69b031a P b5189d1d1a034d8b92a7973b50ab5110 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff0fe65aa4b1405d84e4597f9aa7f87c in term 0.
I20260709 13:10:11.795010 26724 raft_consensus.cc:697] T fb9df82425e34bcca37fd6c21be9f576 P 5e0e92538e1f44b2b0663afb330f899e [term 1 LEADER]: Becoming Leader. State: Replica: 5e0e92538e1f44b2b0663afb330f899e, State: Running, Role: LEADER
I20260709 13:10:11.799256 26724 consensus_queue.cc:237] T fb9df82425e34bcca37fd6c21be9f576 P 5e0e92538e1f44b2b0663afb330f899e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:11.800120 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb9df82425e34bcca37fd6c21be9f576" candidate_uuid: "5e0e92538e1f44b2b0663afb330f899e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5189d1d1a034d8b92a7973b50ab5110"
I20260709 13:10:11.796132 26771 leader_election.cc:290] T fb9df82425e34bcca37fd6c21be9f576 P 5e0e92538e1f44b2b0663afb330f899e [CANDIDATE]: Term 1 election: Requested vote from peers ff0fe65aa4b1405d84e4597f9aa7f87c (127.14.180.65:46829), b5189d1d1a034d8b92a7973b50ab5110 (127.14.180.67:40219)
I20260709 13:10:11.800825 26610 raft_consensus.cc:3060] T fb9df82425e34bcca37fd6c21be9f576 P b5189d1d1a034d8b92a7973b50ab5110 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:11.804960 26769 raft_consensus.cc:515] T 3d85e7002e3541918ceeb148b69b031a P ff0fe65aa4b1405d84e4597f9aa7f87c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:11.808063 26461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb9df82425e34bcca37fd6c21be9f576" candidate_uuid: "b5189d1d1a034d8b92a7973b50ab5110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" is_pre_election: true
I20260709 13:10:11.808501 26537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d85e7002e3541918ceeb148b69b031a" candidate_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0e92538e1f44b2b0663afb330f899e"
I20260709 13:10:11.809250 26537 raft_consensus.cc:3060] T 3d85e7002e3541918ceeb148b69b031a P 5e0e92538e1f44b2b0663afb330f899e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:11.809587 26461 raft_consensus.cc:2393] T fb9df82425e34bcca37fd6c21be9f576 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5189d1d1a034d8b92a7973b50ab5110 in current term 1: Already voted for candidate 5e0e92538e1f44b2b0663afb330f899e in this term.
I20260709 13:10:11.809604 26535 raft_consensus.cc:2468] T a708761fa65e433fbebfee909b452c37 P 5e0e92538e1f44b2b0663afb330f899e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5189d1d1a034d8b92a7973b50ab5110 in term 1.
I20260709 13:10:11.812374 26576 leader_election.cc:304] T a708761fa65e433fbebfee909b452c37 P b5189d1d1a034d8b92a7973b50ab5110 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e0e92538e1f44b2b0663afb330f899e, b5189d1d1a034d8b92a7973b50ab5110; no voters: ff0fe65aa4b1405d84e4597f9aa7f87c
I20260709 13:10:11.812598 26773 leader_election.cc:290] T fb9df82425e34bcca37fd6c21be9f576 P b5189d1d1a034d8b92a7973b50ab5110 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ff0fe65aa4b1405d84e4597f9aa7f87c (127.14.180.65:46829), 5e0e92538e1f44b2b0663afb330f899e (127.14.180.66:46615)
I20260709 13:10:11.813223 26738 raft_consensus.cc:2804] T a708761fa65e433fbebfee909b452c37 P b5189d1d1a034d8b92a7973b50ab5110 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:11.813810 26738 raft_consensus.cc:697] T a708761fa65e433fbebfee909b452c37 P b5189d1d1a034d8b92a7973b50ab5110 [term 1 LEADER]: Becoming Leader. State: Replica: b5189d1d1a034d8b92a7973b50ab5110, State: Running, Role: LEADER
I20260709 13:10:11.814817 26738 consensus_queue.cc:237] T a708761fa65e433fbebfee909b452c37 P b5189d1d1a034d8b92a7973b50ab5110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:11.824998 26537 raft_consensus.cc:2468] T 3d85e7002e3541918ceeb148b69b031a P 5e0e92538e1f44b2b0663afb330f899e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff0fe65aa4b1405d84e4597f9aa7f87c in term 1.
I20260709 13:10:11.827069 26427 leader_election.cc:304] T 3d85e7002e3541918ceeb148b69b031a P ff0fe65aa4b1405d84e4597f9aa7f87c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0e92538e1f44b2b0663afb330f899e, ff0fe65aa4b1405d84e4597f9aa7f87c; no voters: 
I20260709 13:10:11.828473 26766 raft_consensus.cc:2804] T 3d85e7002e3541918ceeb148b69b031a P ff0fe65aa4b1405d84e4597f9aa7f87c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:11.832648 26766 raft_consensus.cc:697] T 3d85e7002e3541918ceeb148b69b031a P ff0fe65aa4b1405d84e4597f9aa7f87c [term 1 LEADER]: Becoming Leader. State: Replica: ff0fe65aa4b1405d84e4597f9aa7f87c, State: Running, Role: LEADER
I20260709 13:10:11.833678 26766 consensus_queue.cc:237] T 3d85e7002e3541918ceeb148b69b031a P ff0fe65aa4b1405d84e4597f9aa7f87c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:11.834347 26610 raft_consensus.cc:2468] T fb9df82425e34bcca37fd6c21be9f576 P b5189d1d1a034d8b92a7973b50ab5110 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e0e92538e1f44b2b0663afb330f899e in term 1.
I20260709 13:10:11.837587 26769 leader_election.cc:290] T 3d85e7002e3541918ceeb148b69b031a P ff0fe65aa4b1405d84e4597f9aa7f87c [CANDIDATE]: Term 1 election: Requested vote from peers 5e0e92538e1f44b2b0663afb330f899e (127.14.180.66:46615), b5189d1d1a034d8b92a7973b50ab5110 (127.14.180.67:40219)
I20260709 13:10:11.840349 26535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb9df82425e34bcca37fd6c21be9f576" candidate_uuid: "b5189d1d1a034d8b92a7973b50ab5110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0e92538e1f44b2b0663afb330f899e" is_pre_election: true
I20260709 13:10:11.842506 26753 tablet_bootstrap.cc:492] T fe0733029c394a438e698d0b85493c36 P b5189d1d1a034d8b92a7973b50ab5110: No bootstrap required, opened a new log
I20260709 13:10:11.842937 26751 tablet_bootstrap.cc:492] T a708761fa65e433fbebfee909b452c37 P ff0fe65aa4b1405d84e4597f9aa7f87c: No bootstrap required, opened a new log
I20260709 13:10:11.843124 26753 ts_tablet_manager.cc:1403] T fe0733029c394a438e698d0b85493c36 P b5189d1d1a034d8b92a7973b50ab5110: Time spent bootstrapping tablet: real 0.132s	user 0.019s	sys 0.007s
I20260709 13:10:11.843772 26751 ts_tablet_manager.cc:1403] T a708761fa65e433fbebfee909b452c37 P ff0fe65aa4b1405d84e4597f9aa7f87c: Time spent bootstrapping tablet: real 0.126s	user 0.032s	sys 0.006s
I20260709 13:10:11.840401 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d85e7002e3541918ceeb148b69b031a" candidate_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5189d1d1a034d8b92a7973b50ab5110"
I20260709 13:10:11.845731 26611 raft_consensus.cc:3060] T 3d85e7002e3541918ceeb148b69b031a P b5189d1d1a034d8b92a7973b50ab5110 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:11.846462 26752 tablet_bootstrap.cc:492] T fe0733029c394a438e698d0b85493c36 P 5e0e92538e1f44b2b0663afb330f899e: No bootstrap required, opened a new log
I20260709 13:10:11.847323 26752 ts_tablet_manager.cc:1403] T fe0733029c394a438e698d0b85493c36 P 5e0e92538e1f44b2b0663afb330f899e: Time spent bootstrapping tablet: real 0.139s	user 0.021s	sys 0.041s
I20260709 13:10:11.849596 26753 raft_consensus.cc:359] T fe0733029c394a438e698d0b85493c36 P b5189d1d1a034d8b92a7973b50ab5110 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:11.850279 26753 raft_consensus.cc:385] T fe0733029c394a438e698d0b85493c36 P b5189d1d1a034d8b92a7973b50ab5110 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:11.842383 26769 raft_consensus.cc:493] T 6bff6969f3eb4e2689b75b066440caef P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:11.850538 26753 raft_consensus.cc:740] T fe0733029c394a438e698d0b85493c36 P b5189d1d1a034d8b92a7973b50ab5110 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5189d1d1a034d8b92a7973b50ab5110, State: Initialized, Role: FOLLOWER
I20260709 13:10:11.854012 26753 consensus_queue.cc:260] T fe0733029c394a438e698d0b85493c36 P b5189d1d1a034d8b92a7973b50ab5110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:11.857964 26753 ts_tablet_manager.cc:1434] T fe0733029c394a438e698d0b85493c36 P b5189d1d1a034d8b92a7973b50ab5110: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.002s
I20260709 13:10:11.861958 26752 raft_consensus.cc:359] T fe0733029c394a438e698d0b85493c36 P 5e0e92538e1f44b2b0663afb330f899e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:11.863191 26752 raft_consensus.cc:385] T fe0733029c394a438e698d0b85493c36 P 5e0e92538e1f44b2b0663afb330f899e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:11.864367 26576 leader_election.cc:304] T fb9df82425e34bcca37fd6c21be9f576 P b5189d1d1a034d8b92a7973b50ab5110 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5189d1d1a034d8b92a7973b50ab5110; no voters: 5e0e92538e1f44b2b0663afb330f899e, ff0fe65aa4b1405d84e4597f9aa7f87c
I20260709 13:10:11.864856 26751 raft_consensus.cc:359] T a708761fa65e433fbebfee909b452c37 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:11.866065 26751 raft_consensus.cc:385] T a708761fa65e433fbebfee909b452c37 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:11.866496 26751 raft_consensus.cc:740] T a708761fa65e433fbebfee909b452c37 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff0fe65aa4b1405d84e4597f9aa7f87c, State: Initialized, Role: FOLLOWER
I20260709 13:10:11.871095 26738 raft_consensus.cc:2749] T fb9df82425e34bcca37fd6c21be9f576 P b5189d1d1a034d8b92a7973b50ab5110 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:11.872155 26611 raft_consensus.cc:2468] T 3d85e7002e3541918ceeb148b69b031a P b5189d1d1a034d8b92a7973b50ab5110 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff0fe65aa4b1405d84e4597f9aa7f87c in term 1.
I20260709 13:10:11.855422 26769 raft_consensus.cc:515] T 6bff6969f3eb4e2689b75b066440caef P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:11.863610 26752 raft_consensus.cc:740] T fe0733029c394a438e698d0b85493c36 P 5e0e92538e1f44b2b0663afb330f899e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e0e92538e1f44b2b0663afb330f899e, State: Initialized, Role: FOLLOWER
I20260709 13:10:11.875576 26535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bff6969f3eb4e2689b75b066440caef" candidate_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0e92538e1f44b2b0663afb330f899e" is_pre_election: true
I20260709 13:10:11.876379 26535 raft_consensus.cc:2468] T 6bff6969f3eb4e2689b75b066440caef P 5e0e92538e1f44b2b0663afb330f899e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff0fe65aa4b1405d84e4597f9aa7f87c in term 0.
I20260709 13:10:11.841466 26357 catalog_manager.cc:5697] T a708761fa65e433fbebfee909b452c37 P b5189d1d1a034d8b92a7973b50ab5110 reported cstate change: term changed from 0 to 1, leader changed from <none> to b5189d1d1a034d8b92a7973b50ab5110 (127.14.180.67). New cstate: current_term: 1 leader_uuid: "b5189d1d1a034d8b92a7973b50ab5110" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:11.875106 26751 consensus_queue.cc:260] T a708761fa65e433fbebfee909b452c37 P ff0fe65aa4b1405d84e4597f9aa7f87c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:11.876444 26752 consensus_queue.cc:260] T fe0733029c394a438e698d0b85493c36 P 5e0e92538e1f44b2b0663afb330f899e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:11.877609 26769 leader_election.cc:290] T 6bff6969f3eb4e2689b75b066440caef P ff0fe65aa4b1405d84e4597f9aa7f87c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e0e92538e1f44b2b0663afb330f899e (127.14.180.66:46615), b5189d1d1a034d8b92a7973b50ab5110 (127.14.180.67:40219)
I20260709 13:10:11.882956 26427 leader_election.cc:304] T 6bff6969f3eb4e2689b75b066440caef P ff0fe65aa4b1405d84e4597f9aa7f87c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0e92538e1f44b2b0663afb330f899e, ff0fe65aa4b1405d84e4597f9aa7f87c; no voters: 
I20260709 13:10:11.885767 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bff6969f3eb4e2689b75b066440caef" candidate_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5189d1d1a034d8b92a7973b50ab5110" is_pre_election: true
I20260709 13:10:11.888490 26611 raft_consensus.cc:2468] T 6bff6969f3eb4e2689b75b066440caef P b5189d1d1a034d8b92a7973b50ab5110 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff0fe65aa4b1405d84e4597f9aa7f87c in term 0.
I20260709 13:10:11.889328 26769 raft_consensus.cc:2804] T 6bff6969f3eb4e2689b75b066440caef P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:11.889849 26769 raft_consensus.cc:493] T 6bff6969f3eb4e2689b75b066440caef P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:11.890223 26769 raft_consensus.cc:3060] T 6bff6969f3eb4e2689b75b066440caef P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:11.886830 26359 catalog_manager.cc:5697] T 3d85e7002e3541918ceeb148b69b031a P ff0fe65aa4b1405d84e4597f9aa7f87c reported cstate change: term changed from 0 to 1, leader changed from <none> to ff0fe65aa4b1405d84e4597f9aa7f87c (127.14.180.65). New cstate: current_term: 1 leader_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:11.897867 26769 raft_consensus.cc:515] T 6bff6969f3eb4e2689b75b066440caef P ff0fe65aa4b1405d84e4597f9aa7f87c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:11.897697 26360 catalog_manager.cc:5697] T fb9df82425e34bcca37fd6c21be9f576 P 5e0e92538e1f44b2b0663afb330f899e reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e0e92538e1f44b2b0663afb330f899e (127.14.180.66). New cstate: current_term: 1 leader_uuid: "5e0e92538e1f44b2b0663afb330f899e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:11.900779 26752 ts_tablet_manager.cc:1434] T fe0733029c394a438e698d0b85493c36 P 5e0e92538e1f44b2b0663afb330f899e: Time spent starting tablet: real 0.053s	user 0.010s	sys 0.000s
I20260709 13:10:11.900974 26766 consensus_queue.cc:1048] T e98e96ff995841f09a4cdb66e9d7f87d P ff0fe65aa4b1405d84e4597f9aa7f87c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:11.901996 26751 ts_tablet_manager.cc:1434] T a708761fa65e433fbebfee909b452c37 P ff0fe65aa4b1405d84e4597f9aa7f87c: Time spent starting tablet: real 0.058s	user 0.011s	sys 0.000s
I20260709 13:10:11.902666 26766 consensus_queue.cc:1048] T e98e96ff995841f09a4cdb66e9d7f87d P ff0fe65aa4b1405d84e4597f9aa7f87c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:11.903012 26535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bff6969f3eb4e2689b75b066440caef" candidate_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0e92538e1f44b2b0663afb330f899e"
I20260709 13:10:11.903648 26535 raft_consensus.cc:3060] T 6bff6969f3eb4e2689b75b066440caef P 5e0e92538e1f44b2b0663afb330f899e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:11.904382 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bff6969f3eb4e2689b75b066440caef" candidate_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5189d1d1a034d8b92a7973b50ab5110"
I20260709 13:10:11.904911 26610 raft_consensus.cc:3060] T 6bff6969f3eb4e2689b75b066440caef P b5189d1d1a034d8b92a7973b50ab5110 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:11.906704 26769 leader_election.cc:290] T 6bff6969f3eb4e2689b75b066440caef P ff0fe65aa4b1405d84e4597f9aa7f87c [CANDIDATE]: Term 1 election: Requested vote from peers 5e0e92538e1f44b2b0663afb330f899e (127.14.180.66:46615), b5189d1d1a034d8b92a7973b50ab5110 (127.14.180.67:40219)
I20260709 13:10:11.912344 26535 raft_consensus.cc:2468] T 6bff6969f3eb4e2689b75b066440caef P 5e0e92538e1f44b2b0663afb330f899e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff0fe65aa4b1405d84e4597f9aa7f87c in term 1.
I20260709 13:10:11.915148 26427 leader_election.cc:304] T 6bff6969f3eb4e2689b75b066440caef P ff0fe65aa4b1405d84e4597f9aa7f87c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0e92538e1f44b2b0663afb330f899e, ff0fe65aa4b1405d84e4597f9aa7f87c; no voters: 
I20260709 13:10:11.915544 26610 raft_consensus.cc:2468] T 6bff6969f3eb4e2689b75b066440caef P b5189d1d1a034d8b92a7973b50ab5110 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff0fe65aa4b1405d84e4597f9aa7f87c in term 1.
I20260709 13:10:11.916170 26769 raft_consensus.cc:2804] T 6bff6969f3eb4e2689b75b066440caef P ff0fe65aa4b1405d84e4597f9aa7f87c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:11.916710 26769 raft_consensus.cc:697] T 6bff6969f3eb4e2689b75b066440caef P ff0fe65aa4b1405d84e4597f9aa7f87c [term 1 LEADER]: Becoming Leader. State: Replica: ff0fe65aa4b1405d84e4597f9aa7f87c, State: Running, Role: LEADER
I20260709 13:10:11.917577 26769 consensus_queue.cc:237] T 6bff6969f3eb4e2689b75b066440caef P ff0fe65aa4b1405d84e4597f9aa7f87c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:11.935976 26724 consensus_queue.cc:1048] T 4d80d20237654d6583f181577681e4ba P 5e0e92538e1f44b2b0663afb330f899e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:11.952600 26360 catalog_manager.cc:5697] T 6bff6969f3eb4e2689b75b066440caef P ff0fe65aa4b1405d84e4597f9aa7f87c reported cstate change: term changed from 0 to 1, leader changed from <none> to ff0fe65aa4b1405d84e4597f9aa7f87c (127.14.180.65). New cstate: current_term: 1 leader_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:11.955137 26774 consensus_queue.cc:1048] T 4d80d20237654d6583f181577681e4ba P 5e0e92538e1f44b2b0663afb330f899e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:11.992494 26769 raft_consensus.cc:493] T a708761fa65e433fbebfee909b452c37 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:11.993129 26769 raft_consensus.cc:515] T a708761fa65e433fbebfee909b452c37 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:11.995164 26769 leader_election.cc:290] T a708761fa65e433fbebfee909b452c37 P ff0fe65aa4b1405d84e4597f9aa7f87c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e0e92538e1f44b2b0663afb330f899e (127.14.180.66:46615), b5189d1d1a034d8b92a7973b50ab5110 (127.14.180.67:40219)
I20260709 13:10:11.996620 26537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a708761fa65e433fbebfee909b452c37" candidate_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0e92538e1f44b2b0663afb330f899e" is_pre_election: true
I20260709 13:10:11.997834 26537 raft_consensus.cc:2393] T a708761fa65e433fbebfee909b452c37 P 5e0e92538e1f44b2b0663afb330f899e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ff0fe65aa4b1405d84e4597f9aa7f87c in current term 1: Already voted for candidate b5189d1d1a034d8b92a7973b50ab5110 in this term.
I20260709 13:10:11.996622 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a708761fa65e433fbebfee909b452c37" candidate_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5189d1d1a034d8b92a7973b50ab5110" is_pre_election: true
I20260709 13:10:12.001713 26426 leader_election.cc:304] T a708761fa65e433fbebfee909b452c37 P ff0fe65aa4b1405d84e4597f9aa7f87c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ff0fe65aa4b1405d84e4597f9aa7f87c; no voters: 5e0e92538e1f44b2b0663afb330f899e, b5189d1d1a034d8b92a7973b50ab5110
I20260709 13:10:12.005075 26766 raft_consensus.cc:3060] T a708761fa65e433fbebfee909b452c37 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:12.009249 26769 consensus_queue.cc:1048] T 466849fd1988469fb5b4037151d7f2bb P ff0fe65aa4b1405d84e4597f9aa7f87c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:12.014884 26766 raft_consensus.cc:2749] T a708761fa65e433fbebfee909b452c37 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:12.030957 26769 consensus_queue.cc:1048] T 466849fd1988469fb5b4037151d7f2bb P ff0fe65aa4b1405d84e4597f9aa7f87c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:10:13.050618 26391 debug-util.cc:398] Leaking SignalData structure 0x7b08000613c0 after lost signal to thread 15060
I20260709 13:10:13.055876 26809 raft_consensus.cc:493] T 9f5fec4f76024abe9c06d7e99531a089 P b5189d1d1a034d8b92a7973b50ab5110 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ff0fe65aa4b1405d84e4597f9aa7f87c)
I20260709 13:10:13.056684 26809 raft_consensus.cc:515] T 9f5fec4f76024abe9c06d7e99531a089 P b5189d1d1a034d8b92a7973b50ab5110 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:13.059692 26809 leader_election.cc:290] T 9f5fec4f76024abe9c06d7e99531a089 P b5189d1d1a034d8b92a7973b50ab5110 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ff0fe65aa4b1405d84e4597f9aa7f87c (127.14.180.65:46829), 5e0e92538e1f44b2b0663afb330f899e (127.14.180.66:46615)
I20260709 13:10:13.129086 26766 raft_consensus.cc:493] T 7275ca9585794b1c9cc06d7616e89c8d P ff0fe65aa4b1405d84e4597f9aa7f87c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e0e92538e1f44b2b0663afb330f899e)
I20260709 13:10:13.130010 26766 raft_consensus.cc:515] T 7275ca9585794b1c9cc06d7616e89c8d P ff0fe65aa4b1405d84e4597f9aa7f87c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:13.133108 26766 leader_election.cc:290] T 7275ca9585794b1c9cc06d7616e89c8d P ff0fe65aa4b1405d84e4597f9aa7f87c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e0e92538e1f44b2b0663afb330f899e (127.14.180.66:46615), b5189d1d1a034d8b92a7973b50ab5110 (127.14.180.67:40219)
I20260709 13:10:13.141024 26809 raft_consensus.cc:493] T 41be667b2c704042b4fa06f2d1480152 P b5189d1d1a034d8b92a7973b50ab5110 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ff0fe65aa4b1405d84e4597f9aa7f87c)
I20260709 13:10:13.144973 26809 raft_consensus.cc:515] T 41be667b2c704042b4fa06f2d1480152 P b5189d1d1a034d8b92a7973b50ab5110 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:13.157838 26809 leader_election.cc:290] T 41be667b2c704042b4fa06f2d1480152 P b5189d1d1a034d8b92a7973b50ab5110 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ff0fe65aa4b1405d84e4597f9aa7f87c (127.14.180.65:46829), 5e0e92538e1f44b2b0663afb330f899e (127.14.180.66:46615)
I20260709 13:10:13.160243 26766 raft_consensus.cc:493] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b5189d1d1a034d8b92a7973b50ab5110)
I20260709 13:10:13.164002 26766 raft_consensus.cc:515] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:13.168602 26766 leader_election.cc:290] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P ff0fe65aa4b1405d84e4597f9aa7f87c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e0e92538e1f44b2b0663afb330f899e (127.14.180.66:46615), b5189d1d1a034d8b92a7973b50ab5110 (127.14.180.67:40219)
I20260709 13:10:13.290270 26766 raft_consensus.cc:493] T 0d9a4ae1c28749c08418e37aca35973c P ff0fe65aa4b1405d84e4597f9aa7f87c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e0e92538e1f44b2b0663afb330f899e)
I20260709 13:10:13.291074 26766 raft_consensus.cc:515] T 0d9a4ae1c28749c08418e37aca35973c P ff0fe65aa4b1405d84e4597f9aa7f87c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:13.296063 26766 leader_election.cc:290] T 0d9a4ae1c28749c08418e37aca35973c P ff0fe65aa4b1405d84e4597f9aa7f87c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e0e92538e1f44b2b0663afb330f899e (127.14.180.66:46615), b5189d1d1a034d8b92a7973b50ab5110 (127.14.180.67:40219)
I20260709 13:10:13.318866 26809 raft_consensus.cc:493] T 7275ca9585794b1c9cc06d7616e89c8d P b5189d1d1a034d8b92a7973b50ab5110 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e0e92538e1f44b2b0663afb330f899e)
I20260709 13:10:13.319824 26809 raft_consensus.cc:515] T 7275ca9585794b1c9cc06d7616e89c8d P b5189d1d1a034d8b92a7973b50ab5110 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:13.323860 26809 leader_election.cc:290] T 7275ca9585794b1c9cc06d7616e89c8d P b5189d1d1a034d8b92a7973b50ab5110 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ff0fe65aa4b1405d84e4597f9aa7f87c (127.14.180.65:46829), 5e0e92538e1f44b2b0663afb330f899e (127.14.180.66:46615)
I20260709 13:10:13.338059 26809 raft_consensus.cc:493] T 5b44c782e9fd49aea2b89f4bf967e45b P b5189d1d1a034d8b92a7973b50ab5110 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ff0fe65aa4b1405d84e4597f9aa7f87c)
I20260709 13:10:13.339071 26809 raft_consensus.cc:515] T 5b44c782e9fd49aea2b89f4bf967e45b P b5189d1d1a034d8b92a7973b50ab5110 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } }
I20260709 13:10:13.347316 26809 leader_election.cc:290] T 5b44c782e9fd49aea2b89f4bf967e45b P b5189d1d1a034d8b92a7973b50ab5110 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e0e92538e1f44b2b0663afb330f899e (127.14.180.66:46615), ff0fe65aa4b1405d84e4597f9aa7f87c (127.14.180.65:46829)
I20260709 13:10:13.372036 26766 raft_consensus.cc:493] T 7aa0adb09fb048749ba647e2334a1585 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e0e92538e1f44b2b0663afb330f899e)
I20260709 13:10:13.373406 26766 raft_consensus.cc:515] T 7aa0adb09fb048749ba647e2334a1585 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:13.378058 26766 leader_election.cc:290] T 7aa0adb09fb048749ba647e2334a1585 P ff0fe65aa4b1405d84e4597f9aa7f87c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e0e92538e1f44b2b0663afb330f899e (127.14.180.66:46615), b5189d1d1a034d8b92a7973b50ab5110 (127.14.180.67:40219)
I20260709 13:10:13.392614 26766 raft_consensus.cc:493] T 3cb687f16fd34deea0dcb10953c99dda P ff0fe65aa4b1405d84e4597f9aa7f87c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e0e92538e1f44b2b0663afb330f899e)
I20260709 13:10:13.393610 26766 raft_consensus.cc:515] T 3cb687f16fd34deea0dcb10953c99dda P ff0fe65aa4b1405d84e4597f9aa7f87c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:13.407009 26809 raft_consensus.cc:493] T dbd9c03cee964db394327f6d722ea62f P b5189d1d1a034d8b92a7973b50ab5110 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ff0fe65aa4b1405d84e4597f9aa7f87c)
I20260709 13:10:13.407984 26809 raft_consensus.cc:515] T dbd9c03cee964db394327f6d722ea62f P b5189d1d1a034d8b92a7973b50ab5110 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:13.418044 26809 leader_election.cc:290] T dbd9c03cee964db394327f6d722ea62f P b5189d1d1a034d8b92a7973b50ab5110 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ff0fe65aa4b1405d84e4597f9aa7f87c (127.14.180.65:46829), 5e0e92538e1f44b2b0663afb330f899e (127.14.180.66:46615)
I20260709 13:10:13.429446 26809 raft_consensus.cc:493] T e98e96ff995841f09a4cdb66e9d7f87d P b5189d1d1a034d8b92a7973b50ab5110 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ff0fe65aa4b1405d84e4597f9aa7f87c)
I20260709 13:10:13.447232 26766 leader_election.cc:290] T 3cb687f16fd34deea0dcb10953c99dda P ff0fe65aa4b1405d84e4597f9aa7f87c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5e0e92538e1f44b2b0663afb330f899e (127.14.180.66:46615), b5189d1d1a034d8b92a7973b50ab5110 (127.14.180.67:40219)
I20260709 13:10:13.456168 26808 raft_consensus.cc:493] T 4d80d20237654d6583f181577681e4ba P ff0fe65aa4b1405d84e4597f9aa7f87c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e0e92538e1f44b2b0663afb330f899e)
I20260709 13:10:13.657490 26766 raft_consensus.cc:493] T 505a912bda074202915407e904a3d790 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:13.655552 26808 raft_consensus.cc:515] T 4d80d20237654d6583f181577681e4ba P ff0fe65aa4b1405d84e4597f9aa7f87c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:13.662050 26766 raft_consensus.cc:515] T 505a912bda074202915407e904a3d790 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:13.664721 26808 leader_election.cc:290] T 4d80d20237654d6583f181577681e4ba P ff0fe65aa4b1405d84e4597f9aa7f87c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e0e92538e1f44b2b0663afb330f899e (127.14.180.66:46615), b5189d1d1a034d8b92a7973b50ab5110 (127.14.180.67:40219)
I20260709 13:10:13.667994 26766 leader_election.cc:290] T 505a912bda074202915407e904a3d790 P ff0fe65aa4b1405d84e4597f9aa7f87c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e0e92538e1f44b2b0663afb330f899e (127.14.180.66:46615), b5189d1d1a034d8b92a7973b50ab5110 (127.14.180.67:40219)
I20260709 13:10:13.658130 26809 raft_consensus.cc:515] T e98e96ff995841f09a4cdb66e9d7f87d P b5189d1d1a034d8b92a7973b50ab5110 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:13.678103 26813 raft_consensus.cc:493] T 5b44c782e9fd49aea2b89f4bf967e45b P 5e0e92538e1f44b2b0663afb330f899e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ff0fe65aa4b1405d84e4597f9aa7f87c)
I20260709 13:10:13.680380 26813 raft_consensus.cc:515] T 5b44c782e9fd49aea2b89f4bf967e45b P 5e0e92538e1f44b2b0663afb330f899e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } }
I20260709 13:10:13.690241 26773 raft_consensus.cc:493] T 4d80d20237654d6583f181577681e4ba P b5189d1d1a034d8b92a7973b50ab5110 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e0e92538e1f44b2b0663afb330f899e)
I20260709 13:10:13.690891 26773 raft_consensus.cc:515] T 4d80d20237654d6583f181577681e4ba P b5189d1d1a034d8b92a7973b50ab5110 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:13.691416 26813 leader_election.cc:290] T 5b44c782e9fd49aea2b89f4bf967e45b P 5e0e92538e1f44b2b0663afb330f899e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b5189d1d1a034d8b92a7973b50ab5110 (127.14.180.67:40219), ff0fe65aa4b1405d84e4597f9aa7f87c (127.14.180.65:46829)
I20260709 13:10:13.678404 26814 raft_consensus.cc:493] T a708761fa65e433fbebfee909b452c37 P 5e0e92538e1f44b2b0663afb330f899e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:13.693079 26814 raft_consensus.cc:515] T a708761fa65e433fbebfee909b452c37 P 5e0e92538e1f44b2b0663afb330f899e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:13.693099 26773 leader_election.cc:290] T 4d80d20237654d6583f181577681e4ba P b5189d1d1a034d8b92a7973b50ab5110 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ff0fe65aa4b1405d84e4597f9aa7f87c (127.14.180.65:46829), 5e0e92538e1f44b2b0663afb330f899e (127.14.180.66:46615)
I20260709 13:10:13.689144 26809 leader_election.cc:290] T e98e96ff995841f09a4cdb66e9d7f87d P b5189d1d1a034d8b92a7973b50ab5110 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ff0fe65aa4b1405d84e4597f9aa7f87c (127.14.180.65:46829), 5e0e92538e1f44b2b0663afb330f899e (127.14.180.66:46615)
I20260709 13:10:13.694819 26773 raft_consensus.cc:493] T 7aa0adb09fb048749ba647e2334a1585 P b5189d1d1a034d8b92a7973b50ab5110 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e0e92538e1f44b2b0663afb330f899e)
I20260709 13:10:13.695325 26773 raft_consensus.cc:515] T 7aa0adb09fb048749ba647e2334a1585 P b5189d1d1a034d8b92a7973b50ab5110 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:13.695993 26814 leader_election.cc:290] T a708761fa65e433fbebfee909b452c37 P 5e0e92538e1f44b2b0663afb330f899e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ff0fe65aa4b1405d84e4597f9aa7f87c (127.14.180.65:46829), b5189d1d1a034d8b92a7973b50ab5110 (127.14.180.67:40219)
I20260709 13:10:13.697638 26773 leader_election.cc:290] T 7aa0adb09fb048749ba647e2334a1585 P b5189d1d1a034d8b92a7973b50ab5110 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ff0fe65aa4b1405d84e4597f9aa7f87c (127.14.180.65:46829), 5e0e92538e1f44b2b0663afb330f899e (127.14.180.66:46615)
I20260709 13:10:13.750442 26724 raft_consensus.cc:493] T 41be667b2c704042b4fa06f2d1480152 P 5e0e92538e1f44b2b0663afb330f899e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ff0fe65aa4b1405d84e4597f9aa7f87c)
I20260709 13:10:13.751258 26771 raft_consensus.cc:493] T 9f5fec4f76024abe9c06d7e99531a089 P 5e0e92538e1f44b2b0663afb330f899e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ff0fe65aa4b1405d84e4597f9aa7f87c)
I20260709 13:10:13.752099 26774 raft_consensus.cc:493] T 6bff6969f3eb4e2689b75b066440caef P 5e0e92538e1f44b2b0663afb330f899e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:13.752669 26724 raft_consensus.cc:515] T 41be667b2c704042b4fa06f2d1480152 P 5e0e92538e1f44b2b0663afb330f899e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:13.753504 26771 raft_consensus.cc:515] T 9f5fec4f76024abe9c06d7e99531a089 P 5e0e92538e1f44b2b0663afb330f899e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:13.759337 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b44c782e9fd49aea2b89f4bf967e45b" candidate_uuid: "5e0e92538e1f44b2b0663afb330f899e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5189d1d1a034d8b92a7973b50ab5110" is_pre_election: true
I20260709 13:10:13.759927 26724 leader_election.cc:290] T 41be667b2c704042b4fa06f2d1480152 P 5e0e92538e1f44b2b0663afb330f899e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ff0fe65aa4b1405d84e4597f9aa7f87c (127.14.180.65:46829), b5189d1d1a034d8b92a7973b50ab5110 (127.14.180.67:40219)
I20260709 13:10:13.760756 26771 leader_election.cc:290] T 9f5fec4f76024abe9c06d7e99531a089 P 5e0e92538e1f44b2b0663afb330f899e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ff0fe65aa4b1405d84e4597f9aa7f87c (127.14.180.65:46829), b5189d1d1a034d8b92a7973b50ab5110 (127.14.180.67:40219)
I20260709 13:10:13.754140 26773 raft_consensus.cc:493] T fe0733029c394a438e698d0b85493c36 P b5189d1d1a034d8b92a7973b50ab5110 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:13.762354 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a708761fa65e433fbebfee909b452c37" candidate_uuid: "5e0e92538e1f44b2b0663afb330f899e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5189d1d1a034d8b92a7973b50ab5110" is_pre_election: true
I20260709 13:10:13.753674 26774 raft_consensus.cc:515] T 6bff6969f3eb4e2689b75b066440caef P 5e0e92538e1f44b2b0663afb330f899e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:13.760878 26609 raft_consensus.cc:2468] T 5b44c782e9fd49aea2b89f4bf967e45b P b5189d1d1a034d8b92a7973b50ab5110 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0e92538e1f44b2b0663afb330f899e in term 2.
I20260709 13:10:13.754669 26816 raft_consensus.cc:493] T 466849fd1988469fb5b4037151d7f2bb P b5189d1d1a034d8b92a7973b50ab5110 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:13.769906 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fec4f76024abe9c06d7e99531a089" candidate_uuid: "5e0e92538e1f44b2b0663afb330f899e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5189d1d1a034d8b92a7973b50ab5110" is_pre_election: true
I20260709 13:10:13.771355 26608 raft_consensus.cc:2468] T 9f5fec4f76024abe9c06d7e99531a089 P b5189d1d1a034d8b92a7973b50ab5110 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0e92538e1f44b2b0663afb330f899e in term 2.
I20260709 13:10:13.763509 26773 raft_consensus.cc:515] T fe0733029c394a438e698d0b85493c36 P b5189d1d1a034d8b92a7973b50ab5110 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:13.772222 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41be667b2c704042b4fa06f2d1480152" candidate_uuid: "5e0e92538e1f44b2b0663afb330f899e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5189d1d1a034d8b92a7973b50ab5110" is_pre_election: true
I20260709 13:10:13.774441 26611 raft_consensus.cc:2468] T 41be667b2c704042b4fa06f2d1480152 P b5189d1d1a034d8b92a7973b50ab5110 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0e92538e1f44b2b0663afb330f899e in term 2.
I20260709 13:10:13.766386 26816 raft_consensus.cc:515] T 466849fd1988469fb5b4037151d7f2bb P b5189d1d1a034d8b92a7973b50ab5110 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:13.778574 26773 leader_election.cc:290] T fe0733029c394a438e698d0b85493c36 P b5189d1d1a034d8b92a7973b50ab5110 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ff0fe65aa4b1405d84e4597f9aa7f87c (127.14.180.65:46829), 5e0e92538e1f44b2b0663afb330f899e (127.14.180.66:46615)
I20260709 13:10:13.779959 26816 leader_election.cc:290] T 466849fd1988469fb5b4037151d7f2bb P b5189d1d1a034d8b92a7973b50ab5110 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ff0fe65aa4b1405d84e4597f9aa7f87c (127.14.180.65:46829), 5e0e92538e1f44b2b0663afb330f899e (127.14.180.66:46615)
I20260709 13:10:13.784492 26774 leader_election.cc:290] T 6bff6969f3eb4e2689b75b066440caef P 5e0e92538e1f44b2b0663afb330f899e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ff0fe65aa4b1405d84e4597f9aa7f87c (127.14.180.65:46829), b5189d1d1a034d8b92a7973b50ab5110 (127.14.180.67:40219)
I20260709 13:10:13.786216 26536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7275ca9585794b1c9cc06d7616e89c8d" candidate_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e0e92538e1f44b2b0663afb330f899e" is_pre_election: true
I20260709 13:10:13.788210 26534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fdfdfcbfbd476e99db1fb5b3fc4e40" candidate_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e0e92538e1f44b2b0663afb330f899e" is_pre_election: true
I20260709 13:10:13.789194 26534 raft_consensus.cc:2468] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P 5e0e92538e1f44b2b0663afb330f899e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff0fe65aa4b1405d84e4597f9aa7f87c in term 2.
I20260709 13:10:13.797919 26534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9a4ae1c28749c08418e37aca35973c" candidate_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e0e92538e1f44b2b0663afb330f899e" is_pre_election: true
I20260709 13:10:13.802803 26534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa0adb09fb048749ba647e2334a1585" candidate_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e0e92538e1f44b2b0663afb330f899e" is_pre_election: true
I20260709 13:10:13.805610 26534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb687f16fd34deea0dcb10953c99dda" candidate_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e0e92538e1f44b2b0663afb330f899e" is_pre_election: true
I20260709 13:10:13.808090 26724 consensus_queue.cc:1048] T fb9df82425e34bcca37fd6c21be9f576 P 5e0e92538e1f44b2b0663afb330f899e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:13.811367 26534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d80d20237654d6583f181577681e4ba" candidate_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0e92538e1f44b2b0663afb330f899e" is_pre_election: true
I20260709 13:10:13.815317 26814 raft_consensus.cc:493] T fe0733029c394a438e698d0b85493c36 P 5e0e92538e1f44b2b0663afb330f899e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:13.816406 26814 raft_consensus.cc:515] T fe0733029c394a438e698d0b85493c36 P 5e0e92538e1f44b2b0663afb330f899e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:13.818838 26813 raft_consensus.cc:493] T e98e96ff995841f09a4cdb66e9d7f87d P 5e0e92538e1f44b2b0663afb330f899e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ff0fe65aa4b1405d84e4597f9aa7f87c)
I20260709 13:10:13.819144 26534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505a912bda074202915407e904a3d790" candidate_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0e92538e1f44b2b0663afb330f899e" is_pre_election: true
I20260709 13:10:13.823081 26808 consensus_queue.cc:1048] T 3d85e7002e3541918ceeb148b69b031a P ff0fe65aa4b1405d84e4597f9aa7f87c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:10:13.827509 26391 debug-util.cc:398] Leaking SignalData structure 0x7b08001f1220 after lost signal to thread 26394
I20260709 13:10:13.829620 26809 raft_consensus.cc:493] T 505a912bda074202915407e904a3d790 P b5189d1d1a034d8b92a7973b50ab5110 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:13.830737 26809 raft_consensus.cc:515] T 505a912bda074202915407e904a3d790 P b5189d1d1a034d8b92a7973b50ab5110 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:13.831382 26814 leader_election.cc:290] T fe0733029c394a438e698d0b85493c36 P 5e0e92538e1f44b2b0663afb330f899e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ff0fe65aa4b1405d84e4597f9aa7f87c (127.14.180.65:46829), b5189d1d1a034d8b92a7973b50ab5110 (127.14.180.67:40219)
I20260709 13:10:13.832290 26462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fec4f76024abe9c06d7e99531a089" candidate_uuid: "b5189d1d1a034d8b92a7973b50ab5110" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" is_pre_election: true
I20260709 13:10:13.833076 26814 raft_consensus.cc:493] T 3d85e7002e3541918ceeb148b69b031a P 5e0e92538e1f44b2b0663afb330f899e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:13.833793 26809 leader_election.cc:290] T 505a912bda074202915407e904a3d790 P b5189d1d1a034d8b92a7973b50ab5110 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ff0fe65aa4b1405d84e4597f9aa7f87c (127.14.180.65:46829), 5e0e92538e1f44b2b0663afb330f899e (127.14.180.66:46615)
I20260709 13:10:13.820138 26813 raft_consensus.cc:515] T e98e96ff995841f09a4cdb66e9d7f87d P 5e0e92538e1f44b2b0663afb330f899e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:13.817735 26501 leader_election.cc:304] T 5b44c782e9fd49aea2b89f4bf967e45b P 5e0e92538e1f44b2b0663afb330f899e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0e92538e1f44b2b0663afb330f899e, b5189d1d1a034d8b92a7973b50ab5110; no voters: 
I20260709 13:10:13.841974 26501 leader_election.cc:304] T 9f5fec4f76024abe9c06d7e99531a089 P 5e0e92538e1f44b2b0663afb330f899e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0e92538e1f44b2b0663afb330f899e, b5189d1d1a034d8b92a7973b50ab5110; no voters: 
I20260709 13:10:13.849553 26460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7275ca9585794b1c9cc06d7616e89c8d" candidate_uuid: "b5189d1d1a034d8b92a7973b50ab5110" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" is_pre_election: true
I20260709 13:10:13.850433 26501 leader_election.cc:304] T 41be667b2c704042b4fa06f2d1480152 P 5e0e92538e1f44b2b0663afb330f899e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0e92538e1f44b2b0663afb330f899e, b5189d1d1a034d8b92a7973b50ab5110; no voters: 
I20260709 13:10:13.851145 26460 raft_consensus.cc:2468] T 7275ca9585794b1c9cc06d7616e89c8d P ff0fe65aa4b1405d84e4597f9aa7f87c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5189d1d1a034d8b92a7973b50ab5110 in term 2.
I20260709 13:10:13.842594 26771 raft_consensus.cc:2804] T 5b44c782e9fd49aea2b89f4bf967e45b P 5e0e92538e1f44b2b0663afb330f899e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:13.853399 26771 raft_consensus.cc:493] T 5b44c782e9fd49aea2b89f4bf967e45b P 5e0e92538e1f44b2b0663afb330f899e [term 2 FOLLOWER]: Starting leader election (detected failure of leader ff0fe65aa4b1405d84e4597f9aa7f87c)
I20260709 13:10:13.856032 26774 raft_consensus.cc:2804] T 41be667b2c704042b4fa06f2d1480152 P 5e0e92538e1f44b2b0663afb330f899e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:13.856570 26774 raft_consensus.cc:493] T 41be667b2c704042b4fa06f2d1480152 P 5e0e92538e1f44b2b0663afb330f899e [term 2 FOLLOWER]: Starting leader election (detected failure of leader ff0fe65aa4b1405d84e4597f9aa7f87c)
I20260709 13:10:13.856621 26771 raft_consensus.cc:3060] T 5b44c782e9fd49aea2b89f4bf967e45b P 5e0e92538e1f44b2b0663afb330f899e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:13.857167 26774 raft_consensus.cc:3060] T 41be667b2c704042b4fa06f2d1480152 P 5e0e92538e1f44b2b0663afb330f899e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:13.856788 26459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e98e96ff995841f09a4cdb66e9d7f87d" candidate_uuid: "b5189d1d1a034d8b92a7973b50ab5110" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" is_pre_election: true
I20260709 13:10:13.833817 26814 raft_consensus.cc:515] T 3d85e7002e3541918ceeb148b69b031a P 5e0e92538e1f44b2b0663afb330f899e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:13.859454 26462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbd9c03cee964db394327f6d722ea62f" candidate_uuid: "b5189d1d1a034d8b92a7973b50ab5110" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" is_pre_election: true
W20260709 13:10:13.843943 26391 debug-util.cc:398] Leaking SignalData structure 0x7b08003128e0 after lost signal to thread 26486
W20260709 13:10:13.860443 26391 debug-util.cc:398] Leaking SignalData structure 0x7b080029d0c0 after lost signal to thread 26487
I20260709 13:10:13.846726 26461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41be667b2c704042b4fa06f2d1480152" candidate_uuid: "b5189d1d1a034d8b92a7973b50ab5110" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" is_pre_election: true
W20260709 13:10:13.862407 26391 debug-util.cc:398] Leaking SignalData structure 0x7b080007f2c0 after lost signal to thread 26561
W20260709 13:10:13.865110 26391 debug-util.cc:398] Leaking SignalData structure 0x7b0800031800 after lost signal to thread 26635
I20260709 13:10:13.867595 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e98e96ff995841f09a4cdb66e9d7f87d" candidate_uuid: "5e0e92538e1f44b2b0663afb330f899e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5189d1d1a034d8b92a7973b50ab5110" is_pre_election: true
I20260709 13:10:13.869449 26607 raft_consensus.cc:2468] T e98e96ff995841f09a4cdb66e9d7f87d P b5189d1d1a034d8b92a7973b50ab5110 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0e92538e1f44b2b0663afb330f899e in term 1.
I20260709 13:10:13.880187 26462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d80d20237654d6583f181577681e4ba" candidate_uuid: "b5189d1d1a034d8b92a7973b50ab5110" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" is_pre_election: true
I20260709 13:10:13.847512 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bff6969f3eb4e2689b75b066440caef" candidate_uuid: "5e0e92538e1f44b2b0663afb330f899e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5189d1d1a034d8b92a7973b50ab5110" is_pre_election: true
I20260709 13:10:13.839962 26773 raft_consensus.cc:493] T 6bff6969f3eb4e2689b75b066440caef P b5189d1d1a034d8b92a7973b50ab5110 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:13.854295 26534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fec4f76024abe9c06d7e99531a089" candidate_uuid: "b5189d1d1a034d8b92a7973b50ab5110" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e0e92538e1f44b2b0663afb330f899e" is_pre_election: true
I20260709 13:10:13.854489 26724 raft_consensus.cc:2804] T 9f5fec4f76024abe9c06d7e99531a089 P 5e0e92538e1f44b2b0663afb330f899e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:13.881913 26724 raft_consensus.cc:493] T 9f5fec4f76024abe9c06d7e99531a089 P 5e0e92538e1f44b2b0663afb330f899e [term 2 FOLLOWER]: Starting leader election (detected failure of leader ff0fe65aa4b1405d84e4597f9aa7f87c)
I20260709 13:10:13.882364 26724 raft_consensus.cc:3060] T 9f5fec4f76024abe9c06d7e99531a089 P 5e0e92538e1f44b2b0663afb330f899e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:13.883217 26773 raft_consensus.cc:515] T 6bff6969f3eb4e2689b75b066440caef P b5189d1d1a034d8b92a7973b50ab5110 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:13.884641 26609 raft_consensus.cc:2468] T 6bff6969f3eb4e2689b75b066440caef P b5189d1d1a034d8b92a7973b50ab5110 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0e92538e1f44b2b0663afb330f899e in term 1.
I20260709 13:10:13.855224 26460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b44c782e9fd49aea2b89f4bf967e45b" candidate_uuid: "b5189d1d1a034d8b92a7973b50ab5110" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" is_pre_election: true
I20260709 13:10:13.860226 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe0733029c394a438e698d0b85493c36" candidate_uuid: "5e0e92538e1f44b2b0663afb330f899e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5189d1d1a034d8b92a7973b50ab5110" is_pre_election: true
I20260709 13:10:13.887012 26611 raft_consensus.cc:2468] T fe0733029c394a438e698d0b85493c36 P b5189d1d1a034d8b92a7973b50ab5110 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0e92538e1f44b2b0663afb330f899e in term 0.
I20260709 13:10:13.834491 26809 raft_consensus.cc:493] T 0d9a4ae1c28749c08418e37aca35973c P b5189d1d1a034d8b92a7973b50ab5110 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5e0e92538e1f44b2b0663afb330f899e)
I20260709 13:10:13.888513 26809 raft_consensus.cc:515] T 0d9a4ae1c28749c08418e37aca35973c P b5189d1d1a034d8b92a7973b50ab5110 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:13.880450 26536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41be667b2c704042b4fa06f2d1480152" candidate_uuid: "b5189d1d1a034d8b92a7973b50ab5110" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e0e92538e1f44b2b0663afb330f899e" is_pre_election: true
I20260709 13:10:13.847354 26813 leader_election.cc:290] T e98e96ff995841f09a4cdb66e9d7f87d P 5e0e92538e1f44b2b0663afb330f899e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ff0fe65aa4b1405d84e4597f9aa7f87c (127.14.180.65:46829), b5189d1d1a034d8b92a7973b50ab5110 (127.14.180.67:40219)
I20260709 13:10:13.891420 26458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b44c782e9fd49aea2b89f4bf967e45b" candidate_uuid: "5e0e92538e1f44b2b0663afb330f899e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" is_pre_election: true
I20260709 13:10:13.897392 26535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7275ca9585794b1c9cc06d7616e89c8d" candidate_uuid: "b5189d1d1a034d8b92a7973b50ab5110" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e0e92538e1f44b2b0663afb330f899e" is_pre_election: true
I20260709 13:10:13.897621 26458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa0adb09fb048749ba647e2334a1585" candidate_uuid: "b5189d1d1a034d8b92a7973b50ab5110" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" is_pre_election: true
I20260709 13:10:13.899065 26809 leader_election.cc:290] T 0d9a4ae1c28749c08418e37aca35973c P b5189d1d1a034d8b92a7973b50ab5110 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ff0fe65aa4b1405d84e4597f9aa7f87c (127.14.180.65:46829), 5e0e92538e1f44b2b0663afb330f899e (127.14.180.66:46615)
I20260709 13:10:13.900344 26773 leader_election.cc:290] T 6bff6969f3eb4e2689b75b066440caef P b5189d1d1a034d8b92a7973b50ab5110 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ff0fe65aa4b1405d84e4597f9aa7f87c (127.14.180.65:46829), 5e0e92538e1f44b2b0663afb330f899e (127.14.180.66:46615)
I20260709 13:10:13.902009 26535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b44c782e9fd49aea2b89f4bf967e45b" candidate_uuid: "b5189d1d1a034d8b92a7973b50ab5110" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e0e92538e1f44b2b0663afb330f899e" is_pre_election: true
W20260709 13:10:13.903755 26500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46829, user_credentials={real_user=slave}} blocked reactor thread for 73792.1us
I20260709 13:10:13.904457 26458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe0733029c394a438e698d0b85493c36" candidate_uuid: "b5189d1d1a034d8b92a7973b50ab5110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" is_pre_election: true
I20260709 13:10:13.905686 26458 raft_consensus.cc:2468] T fe0733029c394a438e698d0b85493c36 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5189d1d1a034d8b92a7973b50ab5110 in term 0.
I20260709 13:10:13.883199 26814 leader_election.cc:290] T 3d85e7002e3541918ceeb148b69b031a P 5e0e92538e1f44b2b0663afb330f899e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ff0fe65aa4b1405d84e4597f9aa7f87c (127.14.180.65:46829), b5189d1d1a034d8b92a7973b50ab5110 (127.14.180.67:40219)
I20260709 13:10:13.906087 26536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbd9c03cee964db394327f6d722ea62f" candidate_uuid: "b5189d1d1a034d8b92a7973b50ab5110" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0e92538e1f44b2b0663afb330f899e" is_pre_election: true
I20260709 13:10:13.910485 26534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e98e96ff995841f09a4cdb66e9d7f87d" candidate_uuid: "b5189d1d1a034d8b92a7973b50ab5110" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0e92538e1f44b2b0663afb330f899e" is_pre_election: true
I20260709 13:10:13.910765 26533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d80d20237654d6583f181577681e4ba" candidate_uuid: "b5189d1d1a034d8b92a7973b50ab5110" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0e92538e1f44b2b0663afb330f899e" is_pre_election: true
I20260709 13:10:13.911128 26532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa0adb09fb048749ba647e2334a1585" candidate_uuid: "b5189d1d1a034d8b92a7973b50ab5110" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e0e92538e1f44b2b0663afb330f899e" is_pre_election: true
I20260709 13:10:13.911578 26534 raft_consensus.cc:2468] T e98e96ff995841f09a4cdb66e9d7f87d P 5e0e92538e1f44b2b0663afb330f899e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5189d1d1a034d8b92a7973b50ab5110 in term 1.
I20260709 13:10:13.913708 26534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe0733029c394a438e698d0b85493c36" candidate_uuid: "b5189d1d1a034d8b92a7973b50ab5110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0e92538e1f44b2b0663afb330f899e" is_pre_election: true
I20260709 13:10:13.914489 26534 raft_consensus.cc:2468] T fe0733029c394a438e698d0b85493c36 P 5e0e92538e1f44b2b0663afb330f899e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5189d1d1a034d8b92a7973b50ab5110 in term 0.
I20260709 13:10:13.915158 26774 raft_consensus.cc:515] T 41be667b2c704042b4fa06f2d1480152 P 5e0e92538e1f44b2b0663afb330f899e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:13.915724 26536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "466849fd1988469fb5b4037151d7f2bb" candidate_uuid: "b5189d1d1a034d8b92a7973b50ab5110" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0e92538e1f44b2b0663afb330f899e" is_pre_election: true
I20260709 13:10:13.917660 26774 leader_election.cc:290] T 41be667b2c704042b4fa06f2d1480152 P 5e0e92538e1f44b2b0663afb330f899e [CANDIDATE]: Term 3 election: Requested vote from peers ff0fe65aa4b1405d84e4597f9aa7f87c (127.14.180.65:46829), b5189d1d1a034d8b92a7973b50ab5110 (127.14.180.67:40219)
I20260709 13:10:13.919524 26460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a708761fa65e433fbebfee909b452c37" candidate_uuid: "5e0e92538e1f44b2b0663afb330f899e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" is_pre_election: true
I20260709 13:10:13.920373 26460 raft_consensus.cc:2468] T a708761fa65e433fbebfee909b452c37 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0e92538e1f44b2b0663afb330f899e in term 1.
I20260709 13:10:13.921238 26459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41be667b2c704042b4fa06f2d1480152" candidate_uuid: "5e0e92538e1f44b2b0663afb330f899e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" is_pre_election: true
I20260709 13:10:13.921367 26774 consensus_queue.cc:1048] T 505a912bda074202915407e904a3d790 P 5e0e92538e1f44b2b0663afb330f899e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:13.922885 26501 leader_election.cc:304] T e98e96ff995841f09a4cdb66e9d7f87d P 5e0e92538e1f44b2b0663afb330f899e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0e92538e1f44b2b0663afb330f899e, b5189d1d1a034d8b92a7973b50ab5110; no voters: 
I20260709 13:10:13.923995 26774 raft_consensus.cc:2804] T e98e96ff995841f09a4cdb66e9d7f87d P 5e0e92538e1f44b2b0663afb330f899e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:13.924036 26501 leader_election.cc:304] T fe0733029c394a438e698d0b85493c36 P 5e0e92538e1f44b2b0663afb330f899e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0e92538e1f44b2b0663afb330f899e, b5189d1d1a034d8b92a7973b50ab5110; no voters: 
I20260709 13:10:13.924369 26459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fec4f76024abe9c06d7e99531a089" candidate_uuid: "5e0e92538e1f44b2b0663afb330f899e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" is_pre_election: true
I20260709 13:10:13.924681 26774 raft_consensus.cc:493] T e98e96ff995841f09a4cdb66e9d7f87d P 5e0e92538e1f44b2b0663afb330f899e [term 1 FOLLOWER]: Starting leader election (detected failure of leader ff0fe65aa4b1405d84e4597f9aa7f87c)
I20260709 13:10:13.925420 26774 raft_consensus.cc:3060] T e98e96ff995841f09a4cdb66e9d7f87d P 5e0e92538e1f44b2b0663afb330f899e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:13.928296 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7275ca9585794b1c9cc06d7616e89c8d" candidate_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5189d1d1a034d8b92a7973b50ab5110" is_pre_election: true
I20260709 13:10:13.928716 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fdfdfcbfbd476e99db1fb5b3fc4e40" candidate_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5189d1d1a034d8b92a7973b50ab5110" is_pre_election: true
I20260709 13:10:13.929181 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9a4ae1c28749c08418e37aca35973c" candidate_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5189d1d1a034d8b92a7973b50ab5110" is_pre_election: true
I20260709 13:10:13.929925 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7aa0adb09fb048749ba647e2334a1585" candidate_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5189d1d1a034d8b92a7973b50ab5110" is_pre_election: true
I20260709 13:10:13.932920 26461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe0733029c394a438e698d0b85493c36" candidate_uuid: "5e0e92538e1f44b2b0663afb330f899e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" is_pre_election: true
I20260709 13:10:13.933866 26461 raft_consensus.cc:2468] T fe0733029c394a438e698d0b85493c36 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0e92538e1f44b2b0663afb330f899e in term 0.
I20260709 13:10:13.934052 26606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505a912bda074202915407e904a3d790" candidate_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5189d1d1a034d8b92a7973b50ab5110" is_pre_election: true
I20260709 13:10:13.936808 26606 raft_consensus.cc:2468] T 505a912bda074202915407e904a3d790 P b5189d1d1a034d8b92a7973b50ab5110 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff0fe65aa4b1405d84e4597f9aa7f87c in term 1.
I20260709 13:10:13.930411 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d80d20237654d6583f181577681e4ba" candidate_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5189d1d1a034d8b92a7973b50ab5110" is_pre_election: true
I20260709 13:10:13.940240 26607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cb687f16fd34deea0dcb10953c99dda" candidate_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5189d1d1a034d8b92a7973b50ab5110" is_pre_election: true
I20260709 13:10:13.929932 26611 raft_consensus.cc:2468] T 0d9a4ae1c28749c08418e37aca35973c P b5189d1d1a034d8b92a7973b50ab5110 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff0fe65aa4b1405d84e4597f9aa7f87c in term 2.
I20260709 13:10:13.931835 26814 raft_consensus.cc:2804] T fe0733029c394a438e698d0b85493c36 P 5e0e92538e1f44b2b0663afb330f899e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:13.943318 26814 raft_consensus.cc:493] T fe0733029c394a438e698d0b85493c36 P 5e0e92538e1f44b2b0663afb330f899e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:13.943854 26814 raft_consensus.cc:3060] T fe0733029c394a438e698d0b85493c36 P 5e0e92538e1f44b2b0663afb330f899e [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:13.941159 26427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:46615, user_credentials={real_user=slave}} blocked reactor thread for 116690us
I20260709 13:10:13.927508 26459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bff6969f3eb4e2689b75b066440caef" candidate_uuid: "5e0e92538e1f44b2b0663afb330f899e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" is_pre_election: true
I20260709 13:10:13.949501 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d85e7002e3541918ceeb148b69b031a" candidate_uuid: "5e0e92538e1f44b2b0663afb330f899e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5189d1d1a034d8b92a7973b50ab5110" is_pre_election: true
I20260709 13:10:13.950474 26611 raft_consensus.cc:2468] T 3d85e7002e3541918ceeb148b69b031a P b5189d1d1a034d8b92a7973b50ab5110 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0e92538e1f44b2b0663afb330f899e in term 1.
I20260709 13:10:13.950482 26462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e98e96ff995841f09a4cdb66e9d7f87d" candidate_uuid: "5e0e92538e1f44b2b0663afb330f899e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" is_pre_election: true
I20260709 13:10:13.961954 26458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bff6969f3eb4e2689b75b066440caef" candidate_uuid: "b5189d1d1a034d8b92a7973b50ab5110" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" is_pre_election: true
I20260709 13:10:13.963097 26461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505a912bda074202915407e904a3d790" candidate_uuid: "b5189d1d1a034d8b92a7973b50ab5110" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" is_pre_election: true
I20260709 13:10:13.963539 26774 raft_consensus.cc:515] T e98e96ff995841f09a4cdb66e9d7f87d P 5e0e92538e1f44b2b0663afb330f899e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:13.964226 26458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9a4ae1c28749c08418e37aca35973c" candidate_uuid: "b5189d1d1a034d8b92a7973b50ab5110" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" is_pre_election: true
I20260709 13:10:13.964031 26461 raft_consensus.cc:2468] T 505a912bda074202915407e904a3d790 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5189d1d1a034d8b92a7973b50ab5110 in term 1.
I20260709 13:10:13.967494 26574 leader_election.cc:304] T 7275ca9585794b1c9cc06d7616e89c8d P b5189d1d1a034d8b92a7973b50ab5110 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5189d1d1a034d8b92a7973b50ab5110, ff0fe65aa4b1405d84e4597f9aa7f87c; no voters: 
I20260709 13:10:13.969261 26724 raft_consensus.cc:515] T 9f5fec4f76024abe9c06d7e99531a089 P 5e0e92538e1f44b2b0663afb330f899e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:13.970796 26773 consensus_queue.cc:1048] T a708761fa65e433fbebfee909b452c37 P b5189d1d1a034d8b92a7973b50ab5110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:13.972870 26724 leader_election.cc:290] T 9f5fec4f76024abe9c06d7e99531a089 P 5e0e92538e1f44b2b0663afb330f899e [CANDIDATE]: Term 3 election: Requested vote from peers ff0fe65aa4b1405d84e4597f9aa7f87c (127.14.180.65:46829), b5189d1d1a034d8b92a7973b50ab5110 (127.14.180.67:40219)
I20260709 13:10:13.973500 26773 raft_consensus.cc:2804] T 7275ca9585794b1c9cc06d7616e89c8d P b5189d1d1a034d8b92a7973b50ab5110 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:13.973824 26774 leader_election.cc:290] T e98e96ff995841f09a4cdb66e9d7f87d P 5e0e92538e1f44b2b0663afb330f899e [CANDIDATE]: Term 2 election: Requested vote from peers ff0fe65aa4b1405d84e4597f9aa7f87c (127.14.180.65:46829), b5189d1d1a034d8b92a7973b50ab5110 (127.14.180.67:40219)
I20260709 13:10:13.974022 26773 raft_consensus.cc:493] T 7275ca9585794b1c9cc06d7616e89c8d P b5189d1d1a034d8b92a7973b50ab5110 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5e0e92538e1f44b2b0663afb330f899e)
I20260709 13:10:13.974472 26773 raft_consensus.cc:3060] T 7275ca9585794b1c9cc06d7616e89c8d P b5189d1d1a034d8b92a7973b50ab5110 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:13.978715 26536 raft_consensus.cc:1240] T e98e96ff995841f09a4cdb66e9d7f87d P 5e0e92538e1f44b2b0663afb330f899e [term 2 FOLLOWER]: Rejecting Update request from peer ff0fe65aa4b1405d84e4597f9aa7f87c for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:13.983047 26459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "466849fd1988469fb5b4037151d7f2bb" candidate_uuid: "b5189d1d1a034d8b92a7973b50ab5110" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" is_pre_election: true
I20260709 13:10:13.990845 26818 consensus_queue.cc:1048] T 6bff6969f3eb4e2689b75b066440caef P ff0fe65aa4b1405d84e4597f9aa7f87c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:13.991372 26574 leader_election.cc:304] T fe0733029c394a438e698d0b85493c36 P b5189d1d1a034d8b92a7973b50ab5110 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5189d1d1a034d8b92a7973b50ab5110, ff0fe65aa4b1405d84e4597f9aa7f87c; no voters: 
I20260709 13:10:13.992887 26809 raft_consensus.cc:2804] T fe0733029c394a438e698d0b85493c36 P b5189d1d1a034d8b92a7973b50ab5110 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:13.993400 26809 raft_consensus.cc:493] T fe0733029c394a438e698d0b85493c36 P b5189d1d1a034d8b92a7973b50ab5110 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:13.974736 26501 leader_election.cc:304] T 6bff6969f3eb4e2689b75b066440caef P 5e0e92538e1f44b2b0663afb330f899e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0e92538e1f44b2b0663afb330f899e, b5189d1d1a034d8b92a7973b50ab5110; no voters: 
I20260709 13:10:13.998848 26809 raft_consensus.cc:3060] T fe0733029c394a438e698d0b85493c36 P b5189d1d1a034d8b92a7973b50ab5110 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:14.000794 26501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.67:40219, user_credentials={real_user=slave}} blocked reactor thread for 53145us
I20260709 13:10:14.001370 26724 raft_consensus.cc:2804] T 6bff6969f3eb4e2689b75b066440caef P 5e0e92538e1f44b2b0663afb330f899e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:14.003459 26501 leader_election.cc:304] T 3d85e7002e3541918ceeb148b69b031a P 5e0e92538e1f44b2b0663afb330f899e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0e92538e1f44b2b0663afb330f899e, b5189d1d1a034d8b92a7973b50ab5110; no voters: 
I20260709 13:10:14.006599 26459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d85e7002e3541918ceeb148b69b031a" candidate_uuid: "5e0e92538e1f44b2b0663afb330f899e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" is_pre_election: true
I20260709 13:10:14.008073 26609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fec4f76024abe9c06d7e99531a089" candidate_uuid: "5e0e92538e1f44b2b0663afb330f899e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5189d1d1a034d8b92a7973b50ab5110"
I20260709 13:10:14.008862 26609 raft_consensus.cc:3060] T 9f5fec4f76024abe9c06d7e99531a089 P b5189d1d1a034d8b92a7973b50ab5110 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:14.012820 26608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e98e96ff995841f09a4cdb66e9d7f87d" candidate_uuid: "5e0e92538e1f44b2b0663afb330f899e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5189d1d1a034d8b92a7973b50ab5110"
I20260709 13:10:14.013679 26608 raft_consensus.cc:3060] T e98e96ff995841f09a4cdb66e9d7f87d P b5189d1d1a034d8b92a7973b50ab5110 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:14.014357 26427 leader_election.cc:304] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P ff0fe65aa4b1405d84e4597f9aa7f87c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0e92538e1f44b2b0663afb330f899e, ff0fe65aa4b1405d84e4597f9aa7f87c; no voters: 
I20260709 13:10:14.006698 26724 raft_consensus.cc:493] T 6bff6969f3eb4e2689b75b066440caef P 5e0e92538e1f44b2b0663afb330f899e [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:14.015630 26724 raft_consensus.cc:3060] T 6bff6969f3eb4e2689b75b066440caef P 5e0e92538e1f44b2b0663afb330f899e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:14.017824 26808 raft_consensus.cc:2804] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:14.018364 26808 raft_consensus.cc:493] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 2 FOLLOWER]: Starting leader election (detected failure of leader b5189d1d1a034d8b92a7973b50ab5110)
I20260709 13:10:14.018781 26808 raft_consensus.cc:3060] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:14.020080 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41be667b2c704042b4fa06f2d1480152" candidate_uuid: "5e0e92538e1f44b2b0663afb330f899e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5189d1d1a034d8b92a7973b50ab5110"
I20260709 13:10:14.037518 26769 consensus_queue.cc:1059] T e98e96ff995841f09a4cdb66e9d7f87d P ff0fe65aa4b1405d84e4597f9aa7f87c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 13:10:14.040474 26532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505a912bda074202915407e904a3d790" candidate_uuid: "b5189d1d1a034d8b92a7973b50ab5110" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0e92538e1f44b2b0663afb330f899e" is_pre_election: true
I20260709 13:10:14.041908 26769 raft_consensus.cc:3055] T e98e96ff995841f09a4cdb66e9d7f87d P ff0fe65aa4b1405d84e4597f9aa7f87c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:14.045569 26769 raft_consensus.cc:740] T e98e96ff995841f09a4cdb66e9d7f87d P ff0fe65aa4b1405d84e4597f9aa7f87c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ff0fe65aa4b1405d84e4597f9aa7f87c, State: Running, Role: LEADER
I20260709 13:10:14.047446 26500 leader_election.cc:304] T a708761fa65e433fbebfee909b452c37 P 5e0e92538e1f44b2b0663afb330f899e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e0e92538e1f44b2b0663afb330f899e, ff0fe65aa4b1405d84e4597f9aa7f87c; no voters: b5189d1d1a034d8b92a7973b50ab5110
I20260709 13:10:14.048839 26769 consensus_queue.cc:260] T e98e96ff995841f09a4cdb66e9d7f87d P ff0fe65aa4b1405d84e4597f9aa7f87c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:14.050920 26815 raft_consensus.cc:2804] T a708761fa65e433fbebfee909b452c37 P 5e0e92538e1f44b2b0663afb330f899e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:14.051514 26815 raft_consensus.cc:493] T a708761fa65e433fbebfee909b452c37 P 5e0e92538e1f44b2b0663afb330f899e [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:14.051900 26815 raft_consensus.cc:3060] T a708761fa65e433fbebfee909b452c37 P 5e0e92538e1f44b2b0663afb330f899e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:14.052070 26774 consensus_queue.cc:1048] T 505a912bda074202915407e904a3d790 P 5e0e92538e1f44b2b0663afb330f899e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:10:14.055696 26771 raft_consensus.cc:515] T 5b44c782e9fd49aea2b89f4bf967e45b P 5e0e92538e1f44b2b0663afb330f899e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } }
I20260709 13:10:14.057595 26535 raft_consensus.cc:2393] T 5b44c782e9fd49aea2b89f4bf967e45b P 5e0e92538e1f44b2b0663afb330f899e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5189d1d1a034d8b92a7973b50ab5110 in current term 3: Already voted for candidate 5e0e92538e1f44b2b0663afb330f899e in this term.
I20260709 13:10:14.058627 26769 raft_consensus.cc:3060] T e98e96ff995841f09a4cdb66e9d7f87d P ff0fe65aa4b1405d84e4597f9aa7f87c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:14.059206 26536 raft_consensus.cc:1240] T 5b44c782e9fd49aea2b89f4bf967e45b P 5e0e92538e1f44b2b0663afb330f899e [term 3 FOLLOWER]: Rejecting Update request from peer ff0fe65aa4b1405d84e4597f9aa7f87c for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:14.060981 26771 leader_election.cc:290] T 5b44c782e9fd49aea2b89f4bf967e45b P 5e0e92538e1f44b2b0663afb330f899e [CANDIDATE]: Term 3 election: Requested vote from peers b5189d1d1a034d8b92a7973b50ab5110 (127.14.180.67:40219), ff0fe65aa4b1405d84e4597f9aa7f87c (127.14.180.65:46829)
I20260709 13:10:14.075556 26536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9a4ae1c28749c08418e37aca35973c" candidate_uuid: "b5189d1d1a034d8b92a7973b50ab5110" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e0e92538e1f44b2b0663afb330f899e" is_pre_election: true
I20260709 13:10:14.077975 26815 raft_consensus.cc:515] T a708761fa65e433fbebfee909b452c37 P 5e0e92538e1f44b2b0663afb330f899e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:14.079564 26774 consensus_queue.cc:1048] T fb9df82425e34bcca37fd6c21be9f576 P 5e0e92538e1f44b2b0663afb330f899e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:14.080596 26815 leader_election.cc:290] T a708761fa65e433fbebfee909b452c37 P 5e0e92538e1f44b2b0663afb330f899e [CANDIDATE]: Term 2 election: Requested vote from peers ff0fe65aa4b1405d84e4597f9aa7f87c (127.14.180.65:46829), b5189d1d1a034d8b92a7973b50ab5110 (127.14.180.67:40219)
I20260709 13:10:14.085794 26814 raft_consensus.cc:515] T fe0733029c394a438e698d0b85493c36 P 5e0e92538e1f44b2b0663afb330f899e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
W20260709 13:10:14.034719 26408 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:14.090996 26814 leader_election.cc:290] T fe0733029c394a438e698d0b85493c36 P 5e0e92538e1f44b2b0663afb330f899e [CANDIDATE]: Term 1 election: Requested vote from peers ff0fe65aa4b1405d84e4597f9aa7f87c (127.14.180.65:46829), b5189d1d1a034d8b92a7973b50ab5110 (127.14.180.67:40219)
I20260709 13:10:14.092327 26459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41be667b2c704042b4fa06f2d1480152" candidate_uuid: "5e0e92538e1f44b2b0663afb330f899e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c"
I20260709 13:10:14.092908 26461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f5fec4f76024abe9c06d7e99531a089" candidate_uuid: "5e0e92538e1f44b2b0663afb330f899e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c"
I20260709 13:10:14.102591 26460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b44c782e9fd49aea2b89f4bf967e45b" candidate_uuid: "5e0e92538e1f44b2b0663afb330f899e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c"
I20260709 13:10:14.105201 26456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a708761fa65e433fbebfee909b452c37" candidate_uuid: "5e0e92538e1f44b2b0663afb330f899e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c"
I20260709 13:10:14.106345 26456 raft_consensus.cc:3060] T a708761fa65e433fbebfee909b452c37 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:14.093314 26458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e98e96ff995841f09a4cdb66e9d7f87d" candidate_uuid: "5e0e92538e1f44b2b0663afb330f899e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c"
I20260709 13:10:14.115439 26818 consensus_queue.cc:1059] T 5b44c782e9fd49aea2b89f4bf967e45b P ff0fe65aa4b1405d84e4597f9aa7f87c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:14.116708 26818 raft_consensus.cc:3055] T 5b44c782e9fd49aea2b89f4bf967e45b P ff0fe65aa4b1405d84e4597f9aa7f87c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:14.117074 26818 raft_consensus.cc:740] T 5b44c782e9fd49aea2b89f4bf967e45b P ff0fe65aa4b1405d84e4597f9aa7f87c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ff0fe65aa4b1405d84e4597f9aa7f87c, State: Running, Role: LEADER
I20260709 13:10:14.118196 26818 consensus_queue.cc:260] T 5b44c782e9fd49aea2b89f4bf967e45b P ff0fe65aa4b1405d84e4597f9aa7f87c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } }
I20260709 13:10:14.119140 26536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bff6969f3eb4e2689b75b066440caef" candidate_uuid: "b5189d1d1a034d8b92a7973b50ab5110" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0e92538e1f44b2b0663afb330f899e" is_pre_election: true
I20260709 13:10:14.123332 26818 raft_consensus.cc:3060] T 5b44c782e9fd49aea2b89f4bf967e45b P ff0fe65aa4b1405d84e4597f9aa7f87c [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:10:14.071434 26574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:46829, user_credentials={real_user=slave}} blocked reactor thread for 61596.9us
I20260709 13:10:14.137256 26809 raft_consensus.cc:515] T fe0733029c394a438e698d0b85493c36 P b5189d1d1a034d8b92a7973b50ab5110 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
W20260709 13:10:14.145401 26823 log.cc:927] Time spent T 3d85e7002e3541918ceeb148b69b031a P 5e0e92538e1f44b2b0663afb330f899e: Append to log took a long time: real 0.100s	user 0.005s	sys 0.000s
I20260709 13:10:14.151911 26766 raft_consensus.cc:493] T fb9df82425e34bcca37fd6c21be9f576 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:14.152678 26766 raft_consensus.cc:515] T fb9df82425e34bcca37fd6c21be9f576 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:14.153285 26810 raft_consensus.cc:493] T 466849fd1988469fb5b4037151d7f2bb P 5e0e92538e1f44b2b0663afb330f899e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ff0fe65aa4b1405d84e4597f9aa7f87c)
I20260709 13:10:14.154317 26810 raft_consensus.cc:515] T 466849fd1988469fb5b4037151d7f2bb P 5e0e92538e1f44b2b0663afb330f899e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:14.154707 26813 raft_consensus.cc:2804] T 3d85e7002e3541918ceeb148b69b031a P 5e0e92538e1f44b2b0663afb330f899e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:14.156093 26825 consensus_queue.cc:1048] T a708761fa65e433fbebfee909b452c37 P b5189d1d1a034d8b92a7973b50ab5110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:14.156337 26576 leader_election.cc:304] T 9f5fec4f76024abe9c06d7e99531a089 P b5189d1d1a034d8b92a7973b50ab5110 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5189d1d1a034d8b92a7973b50ab5110; no voters: 5e0e92538e1f44b2b0663afb330f899e, ff0fe65aa4b1405d84e4597f9aa7f87c
I20260709 13:10:14.158051 26537 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51396 (request call id 74) took 2130 ms. Trace:
I20260709 13:10:14.159113 26574 leader_election.cc:304] T 505a912bda074202915407e904a3d790 P b5189d1d1a034d8b92a7973b50ab5110 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5189d1d1a034d8b92a7973b50ab5110, ff0fe65aa4b1405d84e4597f9aa7f87c; no voters: 
I20260709 13:10:14.159523 26730 consensus_queue.cc:1048] T 3d85e7002e3541918ceeb148b69b031a P ff0fe65aa4b1405d84e4597f9aa7f87c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:14.159785 26605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b44c782e9fd49aea2b89f4bf967e45b" candidate_uuid: "5e0e92538e1f44b2b0663afb330f899e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5189d1d1a034d8b92a7973b50ab5110"
I20260709 13:10:14.173265 26730 consensus_queue.cc:1048] T 6bff6969f3eb4e2689b75b066440caef P ff0fe65aa4b1405d84e4597f9aa7f87c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:14.175612 26576 leader_election.cc:304] T 41be667b2c704042b4fa06f2d1480152 P b5189d1d1a034d8b92a7973b50ab5110 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5189d1d1a034d8b92a7973b50ab5110; no voters: 5e0e92538e1f44b2b0663afb330f899e, ff0fe65aa4b1405d84e4597f9aa7f87c
I20260709 13:10:14.166610 26609 raft_consensus.cc:2468] T 9f5fec4f76024abe9c06d7e99531a089 P b5189d1d1a034d8b92a7973b50ab5110 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e0e92538e1f44b2b0663afb330f899e in term 3.
I20260709 13:10:14.163669 26603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe0733029c394a438e698d0b85493c36" candidate_uuid: "5e0e92538e1f44b2b0663afb330f899e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5189d1d1a034d8b92a7973b50ab5110"
I20260709 13:10:14.166509 26825 raft_consensus.cc:2804] T 505a912bda074202915407e904a3d790 P b5189d1d1a034d8b92a7973b50ab5110 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:14.177277 26773 raft_consensus.cc:515] T 7275ca9585794b1c9cc06d7616e89c8d P b5189d1d1a034d8b92a7973b50ab5110 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:14.178297 26808 raft_consensus.cc:515] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:14.158628 26537 rpcz_store.cc:276] 0709 13:10:12.027895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:12.028183 (+   288us) service_pool.cc:224] Handling call
0709 13:10:12.028452 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:13.804178 (+1775726us) raft_consensus.cc:1534] Early marking committed up to index 1
0709 13:10:13.905996 (+101818us) log.cc:844] Serialized 14 byte log entry
0709 13:10:14.139331 (+233335us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:14.141435 (+  2104us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:10:14.152982 (+ 11547us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:14.157611 (+  4629us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:14.157816 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4661,"prepare.queue_time_us":128592,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":58,"raft.queue_time_us":30742,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":138,"thread_start_us":291808,"threads_started":3,"wal-append.queue_time_us":171234}
I20260709 13:10:14.183157 26766 leader_election.cc:290] T fb9df82425e34bcca37fd6c21be9f576 P ff0fe65aa4b1405d84e4597f9aa7f87c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e0e92538e1f44b2b0663afb330f899e (127.14.180.66:46615), b5189d1d1a034d8b92a7973b50ab5110 (127.14.180.67:40219)
I20260709 13:10:14.179210 26426 leader_election.cc:304] T 7275ca9585794b1c9cc06d7616e89c8d P ff0fe65aa4b1405d84e4597f9aa7f87c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ff0fe65aa4b1405d84e4597f9aa7f87c; no voters: 5e0e92538e1f44b2b0663afb330f899e, b5189d1d1a034d8b92a7973b50ab5110
I20260709 13:10:14.196501 26808 leader_election.cc:290] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P ff0fe65aa4b1405d84e4597f9aa7f87c [CANDIDATE]: Term 3 election: Requested vote from peers 5e0e92538e1f44b2b0663afb330f899e (127.14.180.66:46615), b5189d1d1a034d8b92a7973b50ab5110 (127.14.180.67:40219)
I20260709 13:10:14.197099 26810 leader_election.cc:290] T 466849fd1988469fb5b4037151d7f2bb P 5e0e92538e1f44b2b0663afb330f899e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ff0fe65aa4b1405d84e4597f9aa7f87c (127.14.180.65:46829), b5189d1d1a034d8b92a7973b50ab5110 (127.14.180.67:40219)
I20260709 13:10:14.158074 26813 raft_consensus.cc:493] T 3d85e7002e3541918ceeb148b69b031a P 5e0e92538e1f44b2b0663afb330f899e [term 1 FOLLOWER]: Starting leader election (detected failure of leader ff0fe65aa4b1405d84e4597f9aa7f87c)
I20260709 13:10:14.197945 26813 raft_consensus.cc:3060] T 3d85e7002e3541918ceeb148b69b031a P 5e0e92538e1f44b2b0663afb330f899e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:14.162357 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a708761fa65e433fbebfee909b452c37" candidate_uuid: "5e0e92538e1f44b2b0663afb330f899e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5189d1d1a034d8b92a7973b50ab5110"
I20260709 13:10:14.185624 26816 raft_consensus.cc:2749] T 9f5fec4f76024abe9c06d7e99531a089 P b5189d1d1a034d8b92a7973b50ab5110 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:14.190215 26603 raft_consensus.cc:2393] T fe0733029c394a438e698d0b85493c36 P b5189d1d1a034d8b92a7973b50ab5110 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e0e92538e1f44b2b0663afb330f899e in current term 1: Already voted for candidate b5189d1d1a034d8b92a7973b50ab5110 in this term.
I20260709 13:10:14.184141 26534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb9df82425e34bcca37fd6c21be9f576" candidate_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0e92538e1f44b2b0663afb330f899e" is_pre_election: true
I20260709 13:10:14.165330 26608 raft_consensus.cc:2468] T e98e96ff995841f09a4cdb66e9d7f87d P b5189d1d1a034d8b92a7973b50ab5110 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e0e92538e1f44b2b0663afb330f899e in term 2.
I20260709 13:10:14.192381 26459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7275ca9585794b1c9cc06d7616e89c8d" candidate_uuid: "b5189d1d1a034d8b92a7973b50ab5110" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c"
I20260709 13:10:14.231720 26606 raft_consensus.cc:1240] T e98e96ff995841f09a4cdb66e9d7f87d P b5189d1d1a034d8b92a7973b50ab5110 [term 2 FOLLOWER]: Rejecting Update request from peer ff0fe65aa4b1405d84e4597f9aa7f87c for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:14.233861 26426 leader_election.cc:304] T 505a912bda074202915407e904a3d790 P ff0fe65aa4b1405d84e4597f9aa7f87c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5189d1d1a034d8b92a7973b50ab5110, ff0fe65aa4b1405d84e4597f9aa7f87c; no voters: 5e0e92538e1f44b2b0663afb330f899e
I20260709 13:10:14.234741 26809 leader_election.cc:290] T fe0733029c394a438e698d0b85493c36 P b5189d1d1a034d8b92a7973b50ab5110 [CANDIDATE]: Term 1 election: Requested vote from peers ff0fe65aa4b1405d84e4597f9aa7f87c (127.14.180.65:46829), 5e0e92538e1f44b2b0663afb330f899e (127.14.180.66:46615)
I20260709 13:10:14.235848 26426 leader_election.cc:304] T 7aa0adb09fb048749ba647e2334a1585 P ff0fe65aa4b1405d84e4597f9aa7f87c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ff0fe65aa4b1405d84e4597f9aa7f87c; no voters: 5e0e92538e1f44b2b0663afb330f899e, b5189d1d1a034d8b92a7973b50ab5110
I20260709 13:10:14.236049 26459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe0733029c394a438e698d0b85493c36" candidate_uuid: "b5189d1d1a034d8b92a7973b50ab5110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c"
I20260709 13:10:14.236894 26459 raft_consensus.cc:3060] T fe0733029c394a438e698d0b85493c36 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:14.192883 26724 raft_consensus.cc:515] T 6bff6969f3eb4e2689b75b066440caef P 5e0e92538e1f44b2b0663afb330f899e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:14.195572 26773 leader_election.cc:290] T 7275ca9585794b1c9cc06d7616e89c8d P b5189d1d1a034d8b92a7973b50ab5110 [CANDIDATE]: Term 3 election: Requested vote from peers ff0fe65aa4b1405d84e4597f9aa7f87c (127.14.180.65:46829), 5e0e92538e1f44b2b0663afb330f899e (127.14.180.66:46615)
I20260709 13:10:14.197381 26808 raft_consensus.cc:2749] T 7275ca9585794b1c9cc06d7616e89c8d P ff0fe65aa4b1405d84e4597f9aa7f87c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:14.203665 26610 raft_consensus.cc:1240] T 9f5fec4f76024abe9c06d7e99531a089 P b5189d1d1a034d8b92a7973b50ab5110 [term 3 FOLLOWER]: Rejecting Update request from peer ff0fe65aa4b1405d84e4597f9aa7f87c for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:14.187320 26825 raft_consensus.cc:493] T 505a912bda074202915407e904a3d790 P b5189d1d1a034d8b92a7973b50ab5110 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e0e92538e1f44b2b0663afb330f899e)
I20260709 13:10:14.230387 26834 raft_consensus.cc:2749] T 41be667b2c704042b4fa06f2d1480152 P b5189d1d1a034d8b92a7973b50ab5110 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:14.238507 26766 raft_consensus.cc:2804] T 505a912bda074202915407e904a3d790 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:14.240469 26825 raft_consensus.cc:3060] T 505a912bda074202915407e904a3d790 P b5189d1d1a034d8b92a7973b50ab5110 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:14.239176 26769 raft_consensus.cc:2749] T 7aa0adb09fb048749ba647e2334a1585 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:14.253736 26724 leader_election.cc:290] T 6bff6969f3eb4e2689b75b066440caef P 5e0e92538e1f44b2b0663afb330f899e [CANDIDATE]: Term 2 election: Requested vote from peers ff0fe65aa4b1405d84e4597f9aa7f87c (127.14.180.65:46829), b5189d1d1a034d8b92a7973b50ab5110 (127.14.180.67:40219)
I20260709 13:10:14.256050 26535 raft_consensus.cc:1240] T 6bff6969f3eb4e2689b75b066440caef P 5e0e92538e1f44b2b0663afb330f899e [term 2 FOLLOWER]: Rejecting Update request from peer ff0fe65aa4b1405d84e4597f9aa7f87c for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 13:10:14.258931 26501 leader_election.cc:304] T 9f5fec4f76024abe9c06d7e99531a089 P 5e0e92538e1f44b2b0663afb330f899e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0e92538e1f44b2b0663afb330f899e, b5189d1d1a034d8b92a7973b50ab5110; no voters: 
I20260709 13:10:14.261572 26814 raft_consensus.cc:2804] T 9f5fec4f76024abe9c06d7e99531a089 P 5e0e92538e1f44b2b0663afb330f899e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:14.262149 26814 raft_consensus.cc:697] T 9f5fec4f76024abe9c06d7e99531a089 P 5e0e92538e1f44b2b0663afb330f899e [term 3 LEADER]: Becoming Leader. State: Replica: 5e0e92538e1f44b2b0663afb330f899e, State: Running, Role: LEADER
I20260709 13:10:14.263269 26814 consensus_queue.cc:237] T 9f5fec4f76024abe9c06d7e99531a089 P 5e0e92538e1f44b2b0663afb330f899e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:14.264961 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bff6969f3eb4e2689b75b066440caef" candidate_uuid: "5e0e92538e1f44b2b0663afb330f899e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5189d1d1a034d8b92a7973b50ab5110"
I20260709 13:10:14.265136 26606 raft_consensus.cc:1240] T 7275ca9585794b1c9cc06d7616e89c8d P b5189d1d1a034d8b92a7973b50ab5110 [term 3 FOLLOWER]: Rejecting Update request from peer 5e0e92538e1f44b2b0663afb330f899e for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:14.249073 26766 raft_consensus.cc:493] T 505a912bda074202915407e904a3d790 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e0e92538e1f44b2b0663afb330f899e)
I20260709 13:10:14.266953 26611 raft_consensus.cc:3060] T 6bff6969f3eb4e2689b75b066440caef P b5189d1d1a034d8b92a7973b50ab5110 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:14.267261 26766 raft_consensus.cc:3060] T 505a912bda074202915407e904a3d790 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:14.251108 26537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fdfdfcbfbd476e99db1fb5b3fc4e40" candidate_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e0e92538e1f44b2b0663afb330f899e"
I20260709 13:10:14.265978 26604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "466849fd1988469fb5b4037151d7f2bb" candidate_uuid: "5e0e92538e1f44b2b0663afb330f899e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5189d1d1a034d8b92a7973b50ab5110" is_pre_election: true
I20260709 13:10:14.270362 26426 leader_election.cc:304] T 4d80d20237654d6583f181577681e4ba P ff0fe65aa4b1405d84e4597f9aa7f87c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ff0fe65aa4b1405d84e4597f9aa7f87c; no voters: 5e0e92538e1f44b2b0663afb330f899e, b5189d1d1a034d8b92a7973b50ab5110
I20260709 13:10:14.271479 26769 raft_consensus.cc:2749] T 4d80d20237654d6583f181577681e4ba P ff0fe65aa4b1405d84e4597f9aa7f87c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:14.272249 26426 leader_election.cc:304] T 3cb687f16fd34deea0dcb10953c99dda P ff0fe65aa4b1405d84e4597f9aa7f87c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ff0fe65aa4b1405d84e4597f9aa7f87c; no voters: 5e0e92538e1f44b2b0663afb330f899e, b5189d1d1a034d8b92a7973b50ab5110
I20260709 13:10:14.273500 26769 raft_consensus.cc:2749] T 3cb687f16fd34deea0dcb10953c99dda P ff0fe65aa4b1405d84e4597f9aa7f87c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:14.277359 26456 raft_consensus.cc:2468] T a708761fa65e433fbebfee909b452c37 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e0e92538e1f44b2b0663afb330f899e in term 2.
I20260709 13:10:14.278795 26458 raft_consensus.cc:2468] T e98e96ff995841f09a4cdb66e9d7f87d P ff0fe65aa4b1405d84e4597f9aa7f87c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e0e92538e1f44b2b0663afb330f899e in term 2.
I20260709 13:10:14.279443 26769 consensus_queue.cc:1059] T 6bff6969f3eb4e2689b75b066440caef P ff0fe65aa4b1405d84e4597f9aa7f87c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:14.278920 26457 raft_consensus.cc:1240] T a708761fa65e433fbebfee909b452c37 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 2 FOLLOWER]: Rejecting Update request from peer b5189d1d1a034d8b92a7973b50ab5110 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 13:10:14.270848 26501 leader_election.cc:304] T e98e96ff995841f09a4cdb66e9d7f87d P 5e0e92538e1f44b2b0663afb330f899e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0e92538e1f44b2b0663afb330f899e, b5189d1d1a034d8b92a7973b50ab5110; no voters: 
I20260709 13:10:14.280575 26832 raft_consensus.cc:3055] T 6bff6969f3eb4e2689b75b066440caef P ff0fe65aa4b1405d84e4597f9aa7f87c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:14.280967 26832 raft_consensus.cc:740] T 6bff6969f3eb4e2689b75b066440caef P ff0fe65aa4b1405d84e4597f9aa7f87c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ff0fe65aa4b1405d84e4597f9aa7f87c, State: Running, Role: LEADER
I20260709 13:10:14.281682 26774 raft_consensus.cc:2804] T e98e96ff995841f09a4cdb66e9d7f87d P 5e0e92538e1f44b2b0663afb330f899e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:14.282488 26774 raft_consensus.cc:697] T e98e96ff995841f09a4cdb66e9d7f87d P 5e0e92538e1f44b2b0663afb330f899e [term 2 LEADER]: Becoming Leader. State: Replica: 5e0e92538e1f44b2b0663afb330f899e, State: Running, Role: LEADER
I20260709 13:10:14.282019 26832 consensus_queue.cc:260] T 6bff6969f3eb4e2689b75b066440caef P ff0fe65aa4b1405d84e4597f9aa7f87c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:14.283627 26774 consensus_queue.cc:237] T e98e96ff995841f09a4cdb66e9d7f87d P 5e0e92538e1f44b2b0663afb330f899e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:14.284313 26724 consensus_queue.cc:1059] T 7275ca9585794b1c9cc06d7616e89c8d P 5e0e92538e1f44b2b0663afb330f899e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:14.285876 26819 raft_consensus.cc:3055] T 7275ca9585794b1c9cc06d7616e89c8d P 5e0e92538e1f44b2b0663afb330f899e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:14.286242 26819 raft_consensus.cc:740] T 7275ca9585794b1c9cc06d7616e89c8d P 5e0e92538e1f44b2b0663afb330f899e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5e0e92538e1f44b2b0663afb330f899e, State: Running, Role: LEADER
I20260709 13:10:14.274094 26426 leader_election.cc:304] T 0d9a4ae1c28749c08418e37aca35973c P ff0fe65aa4b1405d84e4597f9aa7f87c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b5189d1d1a034d8b92a7973b50ab5110, ff0fe65aa4b1405d84e4597f9aa7f87c; no voters: 5e0e92538e1f44b2b0663afb330f899e
I20260709 13:10:14.287995 26819 consensus_queue.cc:260] T 7275ca9585794b1c9cc06d7616e89c8d P 5e0e92538e1f44b2b0663afb330f899e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:14.281690 26813 raft_consensus.cc:515] T 3d85e7002e3541918ceeb148b69b031a P 5e0e92538e1f44b2b0663afb330f899e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:14.293972 26819 raft_consensus.cc:3060] T 7275ca9585794b1c9cc06d7616e89c8d P 5e0e92538e1f44b2b0663afb330f899e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:14.301627 26769 raft_consensus.cc:2804] T 0d9a4ae1c28749c08418e37aca35973c P ff0fe65aa4b1405d84e4597f9aa7f87c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:14.302165 26769 raft_consensus.cc:493] T 0d9a4ae1c28749c08418e37aca35973c P ff0fe65aa4b1405d84e4597f9aa7f87c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5e0e92538e1f44b2b0663afb330f899e)
I20260709 13:10:14.302773 26769 raft_consensus.cc:3060] T 0d9a4ae1c28749c08418e37aca35973c P ff0fe65aa4b1405d84e4597f9aa7f87c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:14.304206 26500 leader_election.cc:304] T 5b44c782e9fd49aea2b89f4bf967e45b P 5e0e92538e1f44b2b0663afb330f899e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0e92538e1f44b2b0663afb330f899e; no voters: b5189d1d1a034d8b92a7973b50ab5110, ff0fe65aa4b1405d84e4597f9aa7f87c
W20260709 13:10:14.306363 26428 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:14.308449 26829 raft_consensus.cc:2749] T 5b44c782e9fd49aea2b89f4bf967e45b P 5e0e92538e1f44b2b0663afb330f899e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:10:14.308631 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:46615, user_credentials={real_user=slave}} blocked reactor thread for 133219us
I20260709 13:10:14.306228 26500 leader_election.cc:304] T 41be667b2c704042b4fa06f2d1480152 P 5e0e92538e1f44b2b0663afb330f899e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0e92538e1f44b2b0663afb330f899e; no voters: b5189d1d1a034d8b92a7973b50ab5110, ff0fe65aa4b1405d84e4597f9aa7f87c
I20260709 13:10:14.310523 26611 raft_consensus.cc:2468] T 6bff6969f3eb4e2689b75b066440caef P b5189d1d1a034d8b92a7973b50ab5110 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e0e92538e1f44b2b0663afb330f899e in term 2.
I20260709 13:10:14.310065 26535 raft_consensus.cc:1240] T 3d85e7002e3541918ceeb148b69b031a P 5e0e92538e1f44b2b0663afb330f899e [term 2 FOLLOWER]: Rejecting Update request from peer ff0fe65aa4b1405d84e4597f9aa7f87c for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:14.289443 26834 consensus_queue.cc:1059] T a708761fa65e433fbebfee909b452c37 P b5189d1d1a034d8b92a7973b50ab5110 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.022s
I20260709 13:10:14.283654 26832 raft_consensus.cc:3060] T 6bff6969f3eb4e2689b75b066440caef P ff0fe65aa4b1405d84e4597f9aa7f87c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:14.290836 26459 raft_consensus.cc:2468] T fe0733029c394a438e698d0b85493c36 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5189d1d1a034d8b92a7973b50ab5110 in term 1.
I20260709 13:10:14.315516 26462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe0733029c394a438e698d0b85493c36" candidate_uuid: "5e0e92538e1f44b2b0663afb330f899e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c"
I20260709 13:10:14.319684 26574 leader_election.cc:304] T fe0733029c394a438e698d0b85493c36 P b5189d1d1a034d8b92a7973b50ab5110 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5189d1d1a034d8b92a7973b50ab5110, ff0fe65aa4b1405d84e4597f9aa7f87c; no voters: 
I20260709 13:10:14.320076 26808 consensus_queue.cc:1059] T 3d85e7002e3541918ceeb148b69b031a P ff0fe65aa4b1405d84e4597f9aa7f87c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:14.320776 26773 raft_consensus.cc:2804] T fe0733029c394a438e698d0b85493c36 P b5189d1d1a034d8b92a7973b50ab5110 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:14.313589 26829 raft_consensus.cc:2749] T 41be667b2c704042b4fa06f2d1480152 P 5e0e92538e1f44b2b0663afb330f899e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:10:14.321276 26773 raft_consensus.cc:697] T fe0733029c394a438e698d0b85493c36 P b5189d1d1a034d8b92a7973b50ab5110 [term 1 LEADER]: Becoming Leader. State: Replica: b5189d1d1a034d8b92a7973b50ab5110, State: Running, Role: LEADER
I20260709 13:10:14.321437 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d85e7002e3541918ceeb148b69b031a" candidate_uuid: "5e0e92538e1f44b2b0663afb330f899e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5189d1d1a034d8b92a7973b50ab5110"
I20260709 13:10:14.322222 26610 raft_consensus.cc:3060] T 3d85e7002e3541918ceeb148b69b031a P b5189d1d1a034d8b92a7973b50ab5110 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:14.322569 26773 consensus_queue.cc:237] T fe0733029c394a438e698d0b85493c36 P b5189d1d1a034d8b92a7973b50ab5110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:14.323386 26769 raft_consensus.cc:515] T 0d9a4ae1c28749c08418e37aca35973c P ff0fe65aa4b1405d84e4597f9aa7f87c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:14.302136 26766 raft_consensus.cc:515] T 505a912bda074202915407e904a3d790 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:14.356675 26458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "466849fd1988469fb5b4037151d7f2bb" candidate_uuid: "5e0e92538e1f44b2b0663afb330f899e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" is_pre_election: true
I20260709 13:10:14.326727 26833 raft_consensus.cc:3055] T a708761fa65e433fbebfee909b452c37 P b5189d1d1a034d8b92a7973b50ab5110 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:14.336820 26501 leader_election.cc:304] T 6bff6969f3eb4e2689b75b066440caef P 5e0e92538e1f44b2b0663afb330f899e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0e92538e1f44b2b0663afb330f899e, b5189d1d1a034d8b92a7973b50ab5110; no voters: 
I20260709 13:10:14.317847 26500 leader_election.cc:304] T a708761fa65e433fbebfee909b452c37 P 5e0e92538e1f44b2b0663afb330f899e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e0e92538e1f44b2b0663afb330f899e, ff0fe65aa4b1405d84e4597f9aa7f87c; no voters: b5189d1d1a034d8b92a7973b50ab5110
I20260709 13:10:14.311746 26825 raft_consensus.cc:515] T 505a912bda074202915407e904a3d790 P b5189d1d1a034d8b92a7973b50ab5110 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:14.360009 26457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bff6969f3eb4e2689b75b066440caef" candidate_uuid: "5e0e92538e1f44b2b0663afb330f899e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c"
I20260709 13:10:14.333669 26610 raft_consensus.cc:2468] T 3d85e7002e3541918ceeb148b69b031a P b5189d1d1a034d8b92a7973b50ab5110 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e0e92538e1f44b2b0663afb330f899e in term 2.
I20260709 13:10:14.328080 26576 leader_election.cc:304] T 4d80d20237654d6583f181577681e4ba P b5189d1d1a034d8b92a7973b50ab5110 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5189d1d1a034d8b92a7973b50ab5110; no voters: 5e0e92538e1f44b2b0663afb330f899e, ff0fe65aa4b1405d84e4597f9aa7f87c
I20260709 13:10:14.363972 26814 raft_consensus.cc:2804] T a708761fa65e433fbebfee909b452c37 P 5e0e92538e1f44b2b0663afb330f899e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:14.364794 26814 raft_consensus.cc:697] T a708761fa65e433fbebfee909b452c37 P 5e0e92538e1f44b2b0663afb330f899e [term 2 LEADER]: Becoming Leader. State: Replica: 5e0e92538e1f44b2b0663afb330f899e, State: Running, Role: LEADER
I20260709 13:10:14.361564 26537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505a912bda074202915407e904a3d790" candidate_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0e92538e1f44b2b0663afb330f899e"
I20260709 13:10:14.366051 26456 raft_consensus.cc:1240] T a708761fa65e433fbebfee909b452c37 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 2 FOLLOWER]: Rejecting Update request from peer b5189d1d1a034d8b92a7973b50ab5110 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 13:10:14.365979 26814 consensus_queue.cc:237] T a708761fa65e433fbebfee909b452c37 P 5e0e92538e1f44b2b0663afb330f899e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:14.362912 26608 raft_consensus.cc:1240] T 505a912bda074202915407e904a3d790 P b5189d1d1a034d8b92a7973b50ab5110 [term 2 FOLLOWER]: Rejecting Update request from peer 5e0e92538e1f44b2b0663afb330f899e for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:14.368943 26458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d85e7002e3541918ceeb148b69b031a" candidate_uuid: "5e0e92538e1f44b2b0663afb330f899e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c"
I20260709 13:10:14.319656 26462 raft_consensus.cc:2393] T fe0733029c394a438e698d0b85493c36 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e0e92538e1f44b2b0663afb330f899e in current term 1: Already voted for candidate b5189d1d1a034d8b92a7973b50ab5110 in this term.
I20260709 13:10:14.358462 26833 raft_consensus.cc:740] T a708761fa65e433fbebfee909b452c37 P b5189d1d1a034d8b92a7973b50ab5110 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b5189d1d1a034d8b92a7973b50ab5110, State: Running, Role: LEADER
I20260709 13:10:14.373829 26833 consensus_queue.cc:260] T a708761fa65e433fbebfee909b452c37 P b5189d1d1a034d8b92a7973b50ab5110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
W20260709 13:10:14.375675 26576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:46615, user_credentials={real_user=slave}} blocked reactor thread for 47689us
I20260709 13:10:14.376443 26834 raft_consensus.cc:2749] T 4d80d20237654d6583f181577681e4ba P b5189d1d1a034d8b92a7973b50ab5110 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:14.376715 26576 leader_election.cc:304] T 7aa0adb09fb048749ba647e2334a1585 P b5189d1d1a034d8b92a7973b50ab5110 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5189d1d1a034d8b92a7973b50ab5110; no voters: 5e0e92538e1f44b2b0663afb330f899e, ff0fe65aa4b1405d84e4597f9aa7f87c
I20260709 13:10:14.377741 26816 raft_consensus.cc:2749] T 7aa0adb09fb048749ba647e2334a1585 P b5189d1d1a034d8b92a7973b50ab5110 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:14.378026 26809 consensus_queue.cc:1059] T a708761fa65e433fbebfee909b452c37 P b5189d1d1a034d8b92a7973b50ab5110 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:14.379841 26829 raft_consensus.cc:2804] T 6bff6969f3eb4e2689b75b066440caef P 5e0e92538e1f44b2b0663afb330f899e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:14.380527 26829 raft_consensus.cc:697] T 6bff6969f3eb4e2689b75b066440caef P 5e0e92538e1f44b2b0663afb330f899e [term 2 LEADER]: Becoming Leader. State: Replica: 5e0e92538e1f44b2b0663afb330f899e, State: Running, Role: LEADER
I20260709 13:10:14.381539 26829 consensus_queue.cc:237] T 6bff6969f3eb4e2689b75b066440caef P 5e0e92538e1f44b2b0663afb330f899e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
W20260709 13:10:14.383611 26500 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.65:46829, user_credentials={real_user=slave}} blocked reactor thread for 65881.9us
I20260709 13:10:14.390013 26766 leader_election.cc:290] T 505a912bda074202915407e904a3d790 P ff0fe65aa4b1405d84e4597f9aa7f87c [CANDIDATE]: Term 2 election: Requested vote from peers 5e0e92538e1f44b2b0663afb330f899e (127.14.180.66:46615), b5189d1d1a034d8b92a7973b50ab5110 (127.14.180.67:40219)
I20260709 13:10:14.378252 26576 leader_election.cc:304] T e98e96ff995841f09a4cdb66e9d7f87d P b5189d1d1a034d8b92a7973b50ab5110 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e0e92538e1f44b2b0663afb330f899e, b5189d1d1a034d8b92a7973b50ab5110; no voters: ff0fe65aa4b1405d84e4597f9aa7f87c
I20260709 13:10:14.334332 26813 leader_election.cc:290] T 3d85e7002e3541918ceeb148b69b031a P 5e0e92538e1f44b2b0663afb330f899e [CANDIDATE]: Term 2 election: Requested vote from peers ff0fe65aa4b1405d84e4597f9aa7f87c (127.14.180.65:46829), b5189d1d1a034d8b92a7973b50ab5110 (127.14.180.67:40219)
I20260709 13:10:14.394104 26462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505a912bda074202915407e904a3d790" candidate_uuid: "b5189d1d1a034d8b92a7973b50ab5110" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c"
I20260709 13:10:14.395397 26833 raft_consensus.cc:3060] T a708761fa65e433fbebfee909b452c37 P b5189d1d1a034d8b92a7973b50ab5110 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:14.384747 26501 leader_election.cc:304] T 3d85e7002e3541918ceeb148b69b031a P 5e0e92538e1f44b2b0663afb330f899e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0e92538e1f44b2b0663afb330f899e, b5189d1d1a034d8b92a7973b50ab5110; no voters: 
I20260709 13:10:14.389264 26818 raft_consensus.cc:3055] T 3d85e7002e3541918ceeb148b69b031a P ff0fe65aa4b1405d84e4597f9aa7f87c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:14.398808 26818 raft_consensus.cc:740] T 3d85e7002e3541918ceeb148b69b031a P ff0fe65aa4b1405d84e4597f9aa7f87c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ff0fe65aa4b1405d84e4597f9aa7f87c, State: Running, Role: LEADER
I20260709 13:10:14.400193 26818 consensus_queue.cc:260] T 3d85e7002e3541918ceeb148b69b031a P ff0fe65aa4b1405d84e4597f9aa7f87c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:14.400674 26825 leader_election.cc:290] T 505a912bda074202915407e904a3d790 P b5189d1d1a034d8b92a7973b50ab5110 [CANDIDATE]: Term 2 election: Requested vote from peers ff0fe65aa4b1405d84e4597f9aa7f87c (127.14.180.65:46829), 5e0e92538e1f44b2b0663afb330f899e (127.14.180.66:46615)
I20260709 13:10:14.401798 26818 raft_consensus.cc:3060] T 3d85e7002e3541918ceeb148b69b031a P ff0fe65aa4b1405d84e4597f9aa7f87c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:14.403178 26825 raft_consensus.cc:2764] T e98e96ff995841f09a4cdb66e9d7f87d P b5189d1d1a034d8b92a7973b50ab5110 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:10:14.405237 26576 leader_election.cc:304] T dbd9c03cee964db394327f6d722ea62f P b5189d1d1a034d8b92a7973b50ab5110 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5189d1d1a034d8b92a7973b50ab5110; no voters: 5e0e92538e1f44b2b0663afb330f899e, ff0fe65aa4b1405d84e4597f9aa7f87c
I20260709 13:10:14.408704 26774 consensus_queue.cc:1059] T 505a912bda074202915407e904a3d790 P 5e0e92538e1f44b2b0663afb330f899e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:14.410157 26457 raft_consensus.cc:2410] T 6bff6969f3eb4e2689b75b066440caef P ff0fe65aa4b1405d84e4597f9aa7f87c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e0e92538e1f44b2b0663afb330f899e for term 2 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260709 13:10:14.410717 26825 raft_consensus.cc:2749] T dbd9c03cee964db394327f6d722ea62f P b5189d1d1a034d8b92a7973b50ab5110 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:14.415707 26537 raft_consensus.cc:1240] T 41be667b2c704042b4fa06f2d1480152 P 5e0e92538e1f44b2b0663afb330f899e [term 3 FOLLOWER]: Rejecting Update request from peer ff0fe65aa4b1405d84e4597f9aa7f87c for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:14.417958 26819 raft_consensus.cc:3055] T 505a912bda074202915407e904a3d790 P 5e0e92538e1f44b2b0663afb330f899e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:14.418530 26819 raft_consensus.cc:740] T 505a912bda074202915407e904a3d790 P 5e0e92538e1f44b2b0663afb330f899e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e0e92538e1f44b2b0663afb330f899e, State: Running, Role: LEADER
I20260709 13:10:14.418541 26537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9a4ae1c28749c08418e37aca35973c" candidate_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e0e92538e1f44b2b0663afb330f899e"
I20260709 13:10:14.419802 26819 consensus_queue.cc:260] T 505a912bda074202915407e904a3d790 P 5e0e92538e1f44b2b0663afb330f899e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:14.421640 26500 leader_election.cc:304] T 466849fd1988469fb5b4037151d7f2bb P 5e0e92538e1f44b2b0663afb330f899e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0e92538e1f44b2b0663afb330f899e; no voters: b5189d1d1a034d8b92a7973b50ab5110, ff0fe65aa4b1405d84e4597f9aa7f87c
I20260709 13:10:14.423853 26810 raft_consensus.cc:2749] T 466849fd1988469fb5b4037151d7f2bb P 5e0e92538e1f44b2b0663afb330f899e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:14.425124 26500 leader_election.cc:304] T fe0733029c394a438e698d0b85493c36 P 5e0e92538e1f44b2b0663afb330f899e [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e0e92538e1f44b2b0663afb330f899e; no voters: b5189d1d1a034d8b92a7973b50ab5110, ff0fe65aa4b1405d84e4597f9aa7f87c
I20260709 13:10:14.397259 26813 raft_consensus.cc:2804] T 3d85e7002e3541918ceeb148b69b031a P 5e0e92538e1f44b2b0663afb330f899e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:14.431284 26818 consensus_queue.cc:1059] T 41be667b2c704042b4fa06f2d1480152 P ff0fe65aa4b1405d84e4597f9aa7f87c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:14.432478 26819 raft_consensus.cc:3060] T 505a912bda074202915407e904a3d790 P 5e0e92538e1f44b2b0663afb330f899e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:14.434502 26813 raft_consensus.cc:697] T 3d85e7002e3541918ceeb148b69b031a P 5e0e92538e1f44b2b0663afb330f899e [term 2 LEADER]: Becoming Leader. State: Replica: 5e0e92538e1f44b2b0663afb330f899e, State: Running, Role: LEADER
I20260709 13:10:14.434839 26766 raft_consensus.cc:3055] T 41be667b2c704042b4fa06f2d1480152 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:14.442871 26766 raft_consensus.cc:740] T 41be667b2c704042b4fa06f2d1480152 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ff0fe65aa4b1405d84e4597f9aa7f87c, State: Running, Role: LEADER
I20260709 13:10:14.444063 26766 consensus_queue.cc:260] T 41be667b2c704042b4fa06f2d1480152 P ff0fe65aa4b1405d84e4597f9aa7f87c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:14.445446 26766 raft_consensus.cc:3060] T 41be667b2c704042b4fa06f2d1480152 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:14.446590 26813 consensus_queue.cc:237] T 3d85e7002e3541918ceeb148b69b031a P 5e0e92538e1f44b2b0663afb330f899e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:14.446834 26359 catalog_manager.cc:5697] T fe0733029c394a438e698d0b85493c36 P b5189d1d1a034d8b92a7973b50ab5110 reported cstate change: term changed from 0 to 1, leader changed from <none> to b5189d1d1a034d8b92a7973b50ab5110 (127.14.180.67). New cstate: current_term: 1 leader_uuid: "b5189d1d1a034d8b92a7973b50ab5110" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:14.439448 26769 leader_election.cc:290] T 0d9a4ae1c28749c08418e37aca35973c P ff0fe65aa4b1405d84e4597f9aa7f87c [CANDIDATE]: Term 3 election: Requested vote from peers 5e0e92538e1f44b2b0663afb330f899e (127.14.180.66:46615), b5189d1d1a034d8b92a7973b50ab5110 (127.14.180.67:40219)
I20260709 13:10:14.434127 26814 raft_consensus.cc:2749] T fe0733029c394a438e698d0b85493c36 P 5e0e92538e1f44b2b0663afb330f899e [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:10:14.445372 26576 leader_election.cc:304] T 466849fd1988469fb5b4037151d7f2bb P b5189d1d1a034d8b92a7973b50ab5110 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5189d1d1a034d8b92a7973b50ab5110; no voters: 5e0e92538e1f44b2b0663afb330f899e, ff0fe65aa4b1405d84e4597f9aa7f87c
I20260709 13:10:14.453519 26459 raft_consensus.cc:1240] T 0d9a4ae1c28749c08418e37aca35973c P ff0fe65aa4b1405d84e4597f9aa7f87c [term 3 FOLLOWER]: Rejecting Update request from peer 5e0e92538e1f44b2b0663afb330f899e for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:14.454906 26833 raft_consensus.cc:2749] T 466849fd1988469fb5b4037151d7f2bb P b5189d1d1a034d8b92a7973b50ab5110 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:14.455794 26576 leader_election.cc:304] T 5b44c782e9fd49aea2b89f4bf967e45b P b5189d1d1a034d8b92a7973b50ab5110 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5189d1d1a034d8b92a7973b50ab5110; no voters: 5e0e92538e1f44b2b0663afb330f899e, ff0fe65aa4b1405d84e4597f9aa7f87c
I20260709 13:10:14.456784 26833 raft_consensus.cc:3060] T 5b44c782e9fd49aea2b89f4bf967e45b P b5189d1d1a034d8b92a7973b50ab5110 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:14.457362 26576 leader_election.cc:304] T 0d9a4ae1c28749c08418e37aca35973c P b5189d1d1a034d8b92a7973b50ab5110 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5189d1d1a034d8b92a7973b50ab5110; no voters: 5e0e92538e1f44b2b0663afb330f899e, ff0fe65aa4b1405d84e4597f9aa7f87c
I20260709 13:10:14.458330 26825 raft_consensus.cc:2749] T 0d9a4ae1c28749c08418e37aca35973c P b5189d1d1a034d8b92a7973b50ab5110 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:14.459714 26576 leader_election.cc:304] T 6bff6969f3eb4e2689b75b066440caef P b5189d1d1a034d8b92a7973b50ab5110 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b5189d1d1a034d8b92a7973b50ab5110; no voters: 5e0e92538e1f44b2b0663afb330f899e, ff0fe65aa4b1405d84e4597f9aa7f87c
I20260709 13:10:14.460614 26825 raft_consensus.cc:2749] T 6bff6969f3eb4e2689b75b066440caef P b5189d1d1a034d8b92a7973b50ab5110 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:14.461190 26813 consensus_queue.cc:1059] T 0d9a4ae1c28749c08418e37aca35973c P 5e0e92538e1f44b2b0663afb330f899e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:14.462428 26813 raft_consensus.cc:3055] T 0d9a4ae1c28749c08418e37aca35973c P 5e0e92538e1f44b2b0663afb330f899e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:14.462877 26813 raft_consensus.cc:740] T 0d9a4ae1c28749c08418e37aca35973c P 5e0e92538e1f44b2b0663afb330f899e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5e0e92538e1f44b2b0663afb330f899e, State: Running, Role: LEADER
I20260709 13:10:14.464006 26813 consensus_queue.cc:260] T 0d9a4ae1c28749c08418e37aca35973c P 5e0e92538e1f44b2b0663afb330f899e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:14.464890 26537 raft_consensus.cc:1240] T a708761fa65e433fbebfee909b452c37 P 5e0e92538e1f44b2b0663afb330f899e [term 2 LEADER]: Rejecting Update request from peer b5189d1d1a034d8b92a7973b50ab5110 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 13:10:14.465473 26813 raft_consensus.cc:3060] T 0d9a4ae1c28749c08418e37aca35973c P 5e0e92538e1f44b2b0663afb330f899e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:14.467303 26833 raft_consensus.cc:2749] T 5b44c782e9fd49aea2b89f4bf967e45b P b5189d1d1a034d8b92a7973b50ab5110 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:14.469584 26537 raft_consensus.cc:1240] T 9f5fec4f76024abe9c06d7e99531a089 P 5e0e92538e1f44b2b0663afb330f899e [term 3 LEADER]: Rejecting Update request from peer ff0fe65aa4b1405d84e4597f9aa7f87c for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:14.470203 26535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7275ca9585794b1c9cc06d7616e89c8d" candidate_uuid: "b5189d1d1a034d8b92a7973b50ab5110" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e0e92538e1f44b2b0663afb330f899e"
I20260709 13:10:14.477449 26537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe0733029c394a438e698d0b85493c36" candidate_uuid: "b5189d1d1a034d8b92a7973b50ab5110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0e92538e1f44b2b0663afb330f899e"
I20260709 13:10:14.478716 26537 raft_consensus.cc:2393] T fe0733029c394a438e698d0b85493c36 P 5e0e92538e1f44b2b0663afb330f899e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b5189d1d1a034d8b92a7973b50ab5110 in current term 1: Already voted for candidate 5e0e92538e1f44b2b0663afb330f899e in this term.
I20260709 13:10:14.480696 26769 consensus_queue.cc:1059] T 9f5fec4f76024abe9c06d7e99531a089 P ff0fe65aa4b1405d84e4597f9aa7f87c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:14.481841 26537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505a912bda074202915407e904a3d790" candidate_uuid: "b5189d1d1a034d8b92a7973b50ab5110" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e0e92538e1f44b2b0663afb330f899e"
I20260709 13:10:14.482647 26818 raft_consensus.cc:3055] T 9f5fec4f76024abe9c06d7e99531a089 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:14.483260 26818 raft_consensus.cc:740] T 9f5fec4f76024abe9c06d7e99531a089 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ff0fe65aa4b1405d84e4597f9aa7f87c, State: Running, Role: LEADER
I20260709 13:10:14.484570 26818 consensus_queue.cc:260] T 9f5fec4f76024abe9c06d7e99531a089 P ff0fe65aa4b1405d84e4597f9aa7f87c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:14.486444 26818 raft_consensus.cc:3060] T 9f5fec4f76024abe9c06d7e99531a089 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:14.492513 26608 raft_consensus.cc:1240] T 3d85e7002e3541918ceeb148b69b031a P b5189d1d1a034d8b92a7973b50ab5110 [term 2 FOLLOWER]: Rejecting Update request from peer ff0fe65aa4b1405d84e4597f9aa7f87c for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 13:10:14.492705 26610 raft_consensus.cc:1240] T 6bff6969f3eb4e2689b75b066440caef P b5189d1d1a034d8b92a7973b50ab5110 [term 2 FOLLOWER]: Rejecting Update request from peer ff0fe65aa4b1405d84e4597f9aa7f87c for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 13:10:14.494472 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb9df82425e34bcca37fd6c21be9f576" candidate_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5189d1d1a034d8b92a7973b50ab5110" is_pre_election: true
I20260709 13:10:14.494894 26459 raft_consensus.cc:1240] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 3 FOLLOWER]: Rejecting Update request from peer b5189d1d1a034d8b92a7973b50ab5110 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:14.496656 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fdfdfcbfbd476e99db1fb5b3fc4e40" candidate_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5189d1d1a034d8b92a7973b50ab5110"
I20260709 13:10:14.496729 26535 raft_consensus.cc:2468] T 7275ca9585794b1c9cc06d7616e89c8d P 5e0e92538e1f44b2b0663afb330f899e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5189d1d1a034d8b92a7973b50ab5110 in term 3.
I20260709 13:10:14.496877 26833 consensus_queue.cc:1059] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P b5189d1d1a034d8b92a7973b50ab5110 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:10:14.500339 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505a912bda074202915407e904a3d790" candidate_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b5189d1d1a034d8b92a7973b50ab5110"
I20260709 13:10:14.501160 26825 raft_consensus.cc:3055] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P b5189d1d1a034d8b92a7973b50ab5110 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:14.501742 26825 raft_consensus.cc:740] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P b5189d1d1a034d8b92a7973b50ab5110 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b5189d1d1a034d8b92a7973b50ab5110, State: Running, Role: LEADER
I20260709 13:10:14.502938 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9a4ae1c28749c08418e37aca35973c" candidate_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5189d1d1a034d8b92a7973b50ab5110"
I20260709 13:10:14.503189 26825 consensus_queue.cc:260] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P b5189d1d1a034d8b92a7973b50ab5110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:14.508119 26825 raft_consensus.cc:3060] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P b5189d1d1a034d8b92a7973b50ab5110 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:14.506218 26426 leader_election.cc:304] T fb9df82425e34bcca37fd6c21be9f576 P ff0fe65aa4b1405d84e4597f9aa7f87c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ff0fe65aa4b1405d84e4597f9aa7f87c; no voters: 5e0e92538e1f44b2b0663afb330f899e, b5189d1d1a034d8b92a7973b50ab5110
I20260709 13:10:14.511512 26426 leader_election.cc:304] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P ff0fe65aa4b1405d84e4597f9aa7f87c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ff0fe65aa4b1405d84e4597f9aa7f87c; no voters: 5e0e92538e1f44b2b0663afb330f899e, b5189d1d1a034d8b92a7973b50ab5110
I20260709 13:10:14.512878 26769 raft_consensus.cc:2749] T fb9df82425e34bcca37fd6c21be9f576 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:14.513357 26537 raft_consensus.cc:2468] T 505a912bda074202915407e904a3d790 P 5e0e92538e1f44b2b0663afb330f899e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5189d1d1a034d8b92a7973b50ab5110 in term 2.
I20260709 13:10:14.513972 26769 raft_consensus.cc:2749] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:10:14.514883 26576 leader_election.cc:304] T 505a912bda074202915407e904a3d790 P b5189d1d1a034d8b92a7973b50ab5110 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e0e92538e1f44b2b0663afb330f899e, b5189d1d1a034d8b92a7973b50ab5110; no voters: ff0fe65aa4b1405d84e4597f9aa7f87c
I20260709 13:10:14.516162 26833 raft_consensus.cc:2804] T 505a912bda074202915407e904a3d790 P b5189d1d1a034d8b92a7973b50ab5110 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:14.516707 26833 raft_consensus.cc:697] T 505a912bda074202915407e904a3d790 P b5189d1d1a034d8b92a7973b50ab5110 [term 2 LEADER]: Becoming Leader. State: Replica: b5189d1d1a034d8b92a7973b50ab5110, State: Running, Role: LEADER
I20260709 13:10:14.518201 26833 consensus_queue.cc:237] T 505a912bda074202915407e904a3d790 P b5189d1d1a034d8b92a7973b50ab5110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:14.516669 26426 leader_election.cc:304] T 505a912bda074202915407e904a3d790 P ff0fe65aa4b1405d84e4597f9aa7f87c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ff0fe65aa4b1405d84e4597f9aa7f87c; no voters: 5e0e92538e1f44b2b0663afb330f899e, b5189d1d1a034d8b92a7973b50ab5110
I20260709 13:10:14.524086 26766 raft_consensus.cc:2749] T 505a912bda074202915407e904a3d790 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:10:14.524173 26426 leader_election.cc:304] T 0d9a4ae1c28749c08418e37aca35973c P ff0fe65aa4b1405d84e4597f9aa7f87c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ff0fe65aa4b1405d84e4597f9aa7f87c; no voters: 5e0e92538e1f44b2b0663afb330f899e, b5189d1d1a034d8b92a7973b50ab5110
I20260709 13:10:14.525400 26769 raft_consensus.cc:2749] T 0d9a4ae1c28749c08418e37aca35973c P ff0fe65aa4b1405d84e4597f9aa7f87c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:10:14.534370 26576 leader_election.cc:304] T 7275ca9585794b1c9cc06d7616e89c8d P b5189d1d1a034d8b92a7973b50ab5110 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e0e92538e1f44b2b0663afb330f899e, b5189d1d1a034d8b92a7973b50ab5110; no voters: ff0fe65aa4b1405d84e4597f9aa7f87c
I20260709 13:10:14.535476 26833 raft_consensus.cc:2804] T 7275ca9585794b1c9cc06d7616e89c8d P b5189d1d1a034d8b92a7973b50ab5110 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:14.536088 26833 raft_consensus.cc:697] T 7275ca9585794b1c9cc06d7616e89c8d P b5189d1d1a034d8b92a7973b50ab5110 [term 3 LEADER]: Becoming Leader. State: Replica: b5189d1d1a034d8b92a7973b50ab5110, State: Running, Role: LEADER
I20260709 13:10:14.537278 26833 consensus_queue.cc:237] T 7275ca9585794b1c9cc06d7616e89c8d P b5189d1d1a034d8b92a7973b50ab5110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:14.546713 26357 catalog_manager.cc:5697] T 3d85e7002e3541918ceeb148b69b031a P 5e0e92538e1f44b2b0663afb330f899e reported cstate change: term changed from 1 to 2, leader changed from ff0fe65aa4b1405d84e4597f9aa7f87c (127.14.180.65) to 5e0e92538e1f44b2b0663afb330f899e (127.14.180.66). New cstate: current_term: 2 leader_uuid: "5e0e92538e1f44b2b0663afb330f899e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:14.551038 26357 catalog_manager.cc:5697] T 9f5fec4f76024abe9c06d7e99531a089 P 5e0e92538e1f44b2b0663afb330f899e reported cstate change: term changed from 2 to 3, leader changed from ff0fe65aa4b1405d84e4597f9aa7f87c (127.14.180.65) to 5e0e92538e1f44b2b0663afb330f899e (127.14.180.66). New cstate: current_term: 3 leader_uuid: "5e0e92538e1f44b2b0663afb330f899e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:14.553434 26357 catalog_manager.cc:5697] T e98e96ff995841f09a4cdb66e9d7f87d P 5e0e92538e1f44b2b0663afb330f899e reported cstate change: term changed from 1 to 2, leader changed from ff0fe65aa4b1405d84e4597f9aa7f87c (127.14.180.65) to 5e0e92538e1f44b2b0663afb330f899e (127.14.180.66). New cstate: current_term: 2 leader_uuid: "5e0e92538e1f44b2b0663afb330f899e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:14.555977 26357 catalog_manager.cc:5697] T a708761fa65e433fbebfee909b452c37 P 5e0e92538e1f44b2b0663afb330f899e reported cstate change: term changed from 1 to 2, leader changed from b5189d1d1a034d8b92a7973b50ab5110 (127.14.180.67) to 5e0e92538e1f44b2b0663afb330f899e (127.14.180.66). New cstate: current_term: 2 leader_uuid: "5e0e92538e1f44b2b0663afb330f899e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:14.558317 26357 catalog_manager.cc:5697] T 6bff6969f3eb4e2689b75b066440caef P 5e0e92538e1f44b2b0663afb330f899e reported cstate change: term changed from 1 to 2, leader changed from ff0fe65aa4b1405d84e4597f9aa7f87c (127.14.180.65) to 5e0e92538e1f44b2b0663afb330f899e (127.14.180.66). New cstate: current_term: 2 leader_uuid: "5e0e92538e1f44b2b0663afb330f899e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:14.575232 26360 catalog_manager.cc:5697] T 505a912bda074202915407e904a3d790 P b5189d1d1a034d8b92a7973b50ab5110 reported cstate change: term changed from 1 to 2, leader changed from 5e0e92538e1f44b2b0663afb330f899e (127.14.180.66) to b5189d1d1a034d8b92a7973b50ab5110 (127.14.180.67). New cstate: current_term: 2 leader_uuid: "b5189d1d1a034d8b92a7973b50ab5110" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:14.577517 26360 catalog_manager.cc:5697] T 7275ca9585794b1c9cc06d7616e89c8d P b5189d1d1a034d8b92a7973b50ab5110 reported cstate change: term changed from 2 to 3, leader changed from 5e0e92538e1f44b2b0663afb330f899e (127.14.180.66) to b5189d1d1a034d8b92a7973b50ab5110 (127.14.180.67). New cstate: current_term: 3 leader_uuid: "b5189d1d1a034d8b92a7973b50ab5110" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:14.659679 26459 raft_consensus.cc:1275] T 9f5fec4f76024abe9c06d7e99531a089 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 3 FOLLOWER]: Refusing update from remote peer 5e0e92538e1f44b2b0663afb330f899e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:14.661484 26813 consensus_queue.cc:1048] T 9f5fec4f76024abe9c06d7e99531a089 P 5e0e92538e1f44b2b0663afb330f899e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:14.680691 26611 raft_consensus.cc:1275] T e98e96ff995841f09a4cdb66e9d7f87d P b5189d1d1a034d8b92a7973b50ab5110 [term 2 FOLLOWER]: Refusing update from remote peer 5e0e92538e1f44b2b0663afb330f899e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:14.683696 26611 raft_consensus.cc:1275] T 9f5fec4f76024abe9c06d7e99531a089 P b5189d1d1a034d8b92a7973b50ab5110 [term 3 FOLLOWER]: Refusing update from remote peer 5e0e92538e1f44b2b0663afb330f899e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:14.687036 26814 consensus_queue.cc:1048] T e98e96ff995841f09a4cdb66e9d7f87d P 5e0e92538e1f44b2b0663afb330f899e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:14.688573 26814 consensus_queue.cc:1048] T 9f5fec4f76024abe9c06d7e99531a089 P 5e0e92538e1f44b2b0663afb330f899e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:10:14.709440 26459 raft_consensus.cc:1275] T e98e96ff995841f09a4cdb66e9d7f87d P ff0fe65aa4b1405d84e4597f9aa7f87c [term 2 FOLLOWER]: Refusing update from remote peer 5e0e92538e1f44b2b0663afb330f899e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:14.711851 26774 consensus_queue.cc:1048] T e98e96ff995841f09a4cdb66e9d7f87d P 5e0e92538e1f44b2b0663afb330f899e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:14.799970 26833 consensus_queue.cc:1048] T fe0733029c394a438e698d0b85493c36 P b5189d1d1a034d8b92a7973b50ab5110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:14.813760 26809 consensus_queue.cc:1048] T fe0733029c394a438e698d0b85493c36 P b5189d1d1a034d8b92a7973b50ab5110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:14.933558 26535 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e98e96ff995841f09a4cdb66e9d7f87d"
dest_uuid: "5e0e92538e1f44b2b0663afb330f899e"
mode: GRACEFUL
new_leader_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c"
 from {username='slave'} at 127.0.0.1:51404
I20260709 13:10:14.934583 26535 raft_consensus.cc:606] T e98e96ff995841f09a4cdb66e9d7f87d P 5e0e92538e1f44b2b0663afb330f899e [term 2 LEADER]: Received request to transfer leadership to TS ff0fe65aa4b1405d84e4597f9aa7f87c
I20260709 13:10:14.936053 26611 raft_consensus.cc:1275] T a708761fa65e433fbebfee909b452c37 P b5189d1d1a034d8b92a7973b50ab5110 [term 2 FOLLOWER]: Refusing update from remote peer 5e0e92538e1f44b2b0663afb330f899e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260709 13:10:14.936538 26611 pending_rounds.cc:85] T a708761fa65e433fbebfee909b452c37 P b5189d1d1a034d8b92a7973b50ab5110: Aborting all ops after (but not including) 0
I20260709 13:10:14.936762 26611 pending_rounds.cc:107] T a708761fa65e433fbebfee909b452c37 P b5189d1d1a034d8b92a7973b50ab5110: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:10:14.937047 26611 raft_consensus.cc:2889] T a708761fa65e433fbebfee909b452c37 P b5189d1d1a034d8b92a7973b50ab5110 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:14.938584 26774 consensus_queue.cc:1048] T a708761fa65e433fbebfee909b452c37 P 5e0e92538e1f44b2b0663afb330f899e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:14.941099 26610 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "505a912bda074202915407e904a3d790"
dest_uuid: "b5189d1d1a034d8b92a7973b50ab5110"
mode: GRACEFUL
new_leader_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c"
 from {username='slave'} at 127.0.0.1:43186
I20260709 13:10:14.941737 26610 raft_consensus.cc:606] T 505a912bda074202915407e904a3d790 P b5189d1d1a034d8b92a7973b50ab5110 [term 2 LEADER]: Received request to transfer leadership to TS ff0fe65aa4b1405d84e4597f9aa7f87c
I20260709 13:10:14.952934 26457 raft_consensus.cc:1275] T a708761fa65e433fbebfee909b452c37 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 2 FOLLOWER]: Refusing update from remote peer 5e0e92538e1f44b2b0663afb330f899e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:10:14.955201 26829 consensus_queue.cc:1048] T a708761fa65e433fbebfee909b452c37 P 5e0e92538e1f44b2b0663afb330f899e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:14.961303 26535 raft_consensus.cc:1275] T 7275ca9585794b1c9cc06d7616e89c8d P 5e0e92538e1f44b2b0663afb330f899e [term 3 FOLLOWER]: Refusing update from remote peer b5189d1d1a034d8b92a7973b50ab5110: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:14.962752 26535 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4d80d20237654d6583f181577681e4ba"
dest_uuid: "5e0e92538e1f44b2b0663afb330f899e"
mode: GRACEFUL
new_leader_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c"
 from {username='slave'} at 127.0.0.1:51404
I20260709 13:10:14.964253 26535 raft_consensus.cc:606] T 4d80d20237654d6583f181577681e4ba P 5e0e92538e1f44b2b0663afb330f899e [term 1 LEADER]: Received request to transfer leadership to TS ff0fe65aa4b1405d84e4597f9aa7f87c
I20260709 13:10:14.964133 26773 consensus_queue.cc:1048] T 7275ca9585794b1c9cc06d7616e89c8d P b5189d1d1a034d8b92a7973b50ab5110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:14.968181 26537 raft_consensus.cc:1275] T 505a912bda074202915407e904a3d790 P 5e0e92538e1f44b2b0663afb330f899e [term 2 FOLLOWER]: Refusing update from remote peer b5189d1d1a034d8b92a7973b50ab5110: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:14.969753 26809 consensus_queue.cc:1048] T 505a912bda074202915407e904a3d790 P b5189d1d1a034d8b92a7973b50ab5110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:14.978446 26462 raft_consensus.cc:1275] T 3d85e7002e3541918ceeb148b69b031a P ff0fe65aa4b1405d84e4597f9aa7f87c [term 2 FOLLOWER]: Refusing update from remote peer 5e0e92538e1f44b2b0663afb330f899e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:14.981300 26819 consensus_queue.cc:1048] T 3d85e7002e3541918ceeb148b69b031a P 5e0e92538e1f44b2b0663afb330f899e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:14.982275 26459 raft_consensus.cc:1275] T 6bff6969f3eb4e2689b75b066440caef P ff0fe65aa4b1405d84e4597f9aa7f87c [term 2 FOLLOWER]: Refusing update from remote peer 5e0e92538e1f44b2b0663afb330f899e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260709 13:10:14.982519 26462 raft_consensus.cc:1275] T 505a912bda074202915407e904a3d790 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 2 FOLLOWER]: Refusing update from remote peer b5189d1d1a034d8b92a7973b50ab5110: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:14.982829 26459 pending_rounds.cc:85] T 6bff6969f3eb4e2689b75b066440caef P ff0fe65aa4b1405d84e4597f9aa7f87c: Aborting all ops after (but not including) 0
I20260709 13:10:14.983301 26459 pending_rounds.cc:107] T 6bff6969f3eb4e2689b75b066440caef P ff0fe65aa4b1405d84e4597f9aa7f87c: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:10:14.983709 26459 raft_consensus.cc:2889] T 6bff6969f3eb4e2689b75b066440caef P ff0fe65aa4b1405d84e4597f9aa7f87c [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:14.984524 26825 consensus_queue.cc:1048] T 505a912bda074202915407e904a3d790 P b5189d1d1a034d8b92a7973b50ab5110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:14.986435 26819 consensus_queue.cc:1048] T 6bff6969f3eb4e2689b75b066440caef P 5e0e92538e1f44b2b0663afb330f899e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:10:14.997720 26773 raft_consensus.cc:993] T 505a912bda074202915407e904a3d790 P b5189d1d1a034d8b92a7973b50ab5110: : Instructing follower ff0fe65aa4b1405d84e4597f9aa7f87c to start an election
I20260709 13:10:14.998513 26773 raft_consensus.cc:1081] T 505a912bda074202915407e904a3d790 P b5189d1d1a034d8b92a7973b50ab5110 [term 2 LEADER]: Signalling peer ff0fe65aa4b1405d84e4597f9aa7f87c to start an election
I20260709 13:10:15.003450 26458 raft_consensus.cc:3060] T 7275ca9585794b1c9cc06d7616e89c8d P ff0fe65aa4b1405d84e4597f9aa7f87c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:15.006923 26462 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "505a912bda074202915407e904a3d790"
dest_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c"
 from {username='slave'} at 127.0.0.1:44362
I20260709 13:10:15.008190 26610 raft_consensus.cc:1275] T 6bff6969f3eb4e2689b75b066440caef P b5189d1d1a034d8b92a7973b50ab5110 [term 2 FOLLOWER]: Refusing update from remote peer 5e0e92538e1f44b2b0663afb330f899e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:10:15.013001 26829 consensus_queue.cc:1048] T 6bff6969f3eb4e2689b75b066440caef P 5e0e92538e1f44b2b0663afb330f899e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:15.008175 26462 raft_consensus.cc:493] T 505a912bda074202915407e904a3d790 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:15.017741 26462 raft_consensus.cc:3060] T 505a912bda074202915407e904a3d790 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:15.049660 26610 raft_consensus.cc:1275] T 3d85e7002e3541918ceeb148b69b031a P b5189d1d1a034d8b92a7973b50ab5110 [term 2 FOLLOWER]: Refusing update from remote peer 5e0e92538e1f44b2b0663afb330f899e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:15.052851 26829 consensus_queue.cc:1048] T 3d85e7002e3541918ceeb148b69b031a P 5e0e92538e1f44b2b0663afb330f899e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:15.073496 26458 raft_consensus.cc:1275] T 7275ca9585794b1c9cc06d7616e89c8d P ff0fe65aa4b1405d84e4597f9aa7f87c [term 3 FOLLOWER]: Refusing update from remote peer b5189d1d1a034d8b92a7973b50ab5110: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:15.075527 26773 consensus_queue.cc:1048] T 7275ca9585794b1c9cc06d7616e89c8d P b5189d1d1a034d8b92a7973b50ab5110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:15.082159 26462 raft_consensus.cc:515] T 505a912bda074202915407e904a3d790 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:15.088589 26462 leader_election.cc:290] T 505a912bda074202915407e904a3d790 P ff0fe65aa4b1405d84e4597f9aa7f87c [CANDIDATE]: Term 3 election: Requested vote from peers 5e0e92538e1f44b2b0663afb330f899e (127.14.180.66:46615), b5189d1d1a034d8b92a7973b50ab5110 (127.14.180.67:40219)
I20260709 13:10:15.089224 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505a912bda074202915407e904a3d790" candidate_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b5189d1d1a034d8b92a7973b50ab5110"
I20260709 13:10:15.089962 26610 raft_consensus.cc:3055] T 505a912bda074202915407e904a3d790 P b5189d1d1a034d8b92a7973b50ab5110 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:15.090281 26610 raft_consensus.cc:740] T 505a912bda074202915407e904a3d790 P b5189d1d1a034d8b92a7973b50ab5110 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b5189d1d1a034d8b92a7973b50ab5110, State: Running, Role: LEADER
I20260709 13:10:15.091089 26610 consensus_queue.cc:260] T 505a912bda074202915407e904a3d790 P b5189d1d1a034d8b92a7973b50ab5110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:15.092288 26610 raft_consensus.cc:3060] T 505a912bda074202915407e904a3d790 P b5189d1d1a034d8b92a7973b50ab5110 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:15.091104 26534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505a912bda074202915407e904a3d790" candidate_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5e0e92538e1f44b2b0663afb330f899e"
I20260709 13:10:15.094339 26534 raft_consensus.cc:3060] T 505a912bda074202915407e904a3d790 P 5e0e92538e1f44b2b0663afb330f899e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:15.101830 26610 raft_consensus.cc:2468] T 505a912bda074202915407e904a3d790 P b5189d1d1a034d8b92a7973b50ab5110 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff0fe65aa4b1405d84e4597f9aa7f87c in term 3.
I20260709 13:10:15.102195 26534 raft_consensus.cc:2468] T 505a912bda074202915407e904a3d790 P 5e0e92538e1f44b2b0663afb330f899e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff0fe65aa4b1405d84e4597f9aa7f87c in term 3.
I20260709 13:10:15.103583 26426 leader_election.cc:304] T 505a912bda074202915407e904a3d790 P ff0fe65aa4b1405d84e4597f9aa7f87c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5189d1d1a034d8b92a7973b50ab5110, ff0fe65aa4b1405d84e4597f9aa7f87c; no voters: 
I20260709 13:10:15.104525 26766 raft_consensus.cc:2804] T 505a912bda074202915407e904a3d790 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:15.105062 26766 raft_consensus.cc:697] T 505a912bda074202915407e904a3d790 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 3 LEADER]: Becoming Leader. State: Replica: ff0fe65aa4b1405d84e4597f9aa7f87c, State: Running, Role: LEADER
I20260709 13:10:15.105975 26766 consensus_queue.cc:237] T 505a912bda074202915407e904a3d790 P ff0fe65aa4b1405d84e4597f9aa7f87c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:15.122866 26357 catalog_manager.cc:5697] T 505a912bda074202915407e904a3d790 P ff0fe65aa4b1405d84e4597f9aa7f87c reported cstate change: term changed from 2 to 3, leader changed from b5189d1d1a034d8b92a7973b50ab5110 (127.14.180.67) to ff0fe65aa4b1405d84e4597f9aa7f87c (127.14.180.65). New cstate: current_term: 3 leader_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:15.238533 26813 raft_consensus.cc:993] T 4d80d20237654d6583f181577681e4ba P 5e0e92538e1f44b2b0663afb330f899e: : Instructing follower ff0fe65aa4b1405d84e4597f9aa7f87c to start an election
I20260709 13:10:15.239084 26829 raft_consensus.cc:1081] T 4d80d20237654d6583f181577681e4ba P 5e0e92538e1f44b2b0663afb330f899e [term 1 LEADER]: Signalling peer ff0fe65aa4b1405d84e4597f9aa7f87c to start an election
I20260709 13:10:15.240939 26458 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4d80d20237654d6583f181577681e4ba"
dest_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c"
 from {username='slave'} at 127.0.0.1:44376
I20260709 13:10:15.241458 26458 raft_consensus.cc:493] T 4d80d20237654d6583f181577681e4ba P ff0fe65aa4b1405d84e4597f9aa7f87c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:15.241760 26458 raft_consensus.cc:3060] T 4d80d20237654d6583f181577681e4ba P ff0fe65aa4b1405d84e4597f9aa7f87c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:15.247243 26458 raft_consensus.cc:515] T 4d80d20237654d6583f181577681e4ba P ff0fe65aa4b1405d84e4597f9aa7f87c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:15.249055 26458 leader_election.cc:290] T 4d80d20237654d6583f181577681e4ba P ff0fe65aa4b1405d84e4597f9aa7f87c [CANDIDATE]: Term 2 election: Requested vote from peers 5e0e92538e1f44b2b0663afb330f899e (127.14.180.66:46615), b5189d1d1a034d8b92a7973b50ab5110 (127.14.180.67:40219)
I20260709 13:10:15.250223 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d80d20237654d6583f181577681e4ba" candidate_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b5189d1d1a034d8b92a7973b50ab5110"
I20260709 13:10:15.250253 26534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d80d20237654d6583f181577681e4ba" candidate_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5e0e92538e1f44b2b0663afb330f899e"
I20260709 13:10:15.251041 26610 raft_consensus.cc:3060] T 4d80d20237654d6583f181577681e4ba P b5189d1d1a034d8b92a7973b50ab5110 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:15.251211 26534 raft_consensus.cc:3055] T 4d80d20237654d6583f181577681e4ba P 5e0e92538e1f44b2b0663afb330f899e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:15.251704 26534 raft_consensus.cc:740] T 4d80d20237654d6583f181577681e4ba P 5e0e92538e1f44b2b0663afb330f899e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e0e92538e1f44b2b0663afb330f899e, State: Running, Role: LEADER
I20260709 13:10:15.252666 26534 consensus_queue.cc:260] T 4d80d20237654d6583f181577681e4ba P 5e0e92538e1f44b2b0663afb330f899e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:15.254245 26534 raft_consensus.cc:3060] T 4d80d20237654d6583f181577681e4ba P 5e0e92538e1f44b2b0663afb330f899e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:15.256719 26610 raft_consensus.cc:2468] T 4d80d20237654d6583f181577681e4ba P b5189d1d1a034d8b92a7973b50ab5110 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff0fe65aa4b1405d84e4597f9aa7f87c in term 2.
I20260709 13:10:15.258009 26426 leader_election.cc:304] T 4d80d20237654d6583f181577681e4ba P ff0fe65aa4b1405d84e4597f9aa7f87c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5189d1d1a034d8b92a7973b50ab5110, ff0fe65aa4b1405d84e4597f9aa7f87c; no voters: 
I20260709 13:10:15.258733 26766 raft_consensus.cc:2804] T 4d80d20237654d6583f181577681e4ba P ff0fe65aa4b1405d84e4597f9aa7f87c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:15.259297 26766 raft_consensus.cc:697] T 4d80d20237654d6583f181577681e4ba P ff0fe65aa4b1405d84e4597f9aa7f87c [term 2 LEADER]: Becoming Leader. State: Replica: ff0fe65aa4b1405d84e4597f9aa7f87c, State: Running, Role: LEADER
I20260709 13:10:15.260111 26766 consensus_queue.cc:237] T 4d80d20237654d6583f181577681e4ba P ff0fe65aa4b1405d84e4597f9aa7f87c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:15.260737 26818 raft_consensus.cc:493] T 5b44c782e9fd49aea2b89f4bf967e45b P ff0fe65aa4b1405d84e4597f9aa7f87c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.261320 26818 raft_consensus.cc:515] T 5b44c782e9fd49aea2b89f4bf967e45b P ff0fe65aa4b1405d84e4597f9aa7f87c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } }
I20260709 13:10:15.263623 26818 leader_election.cc:290] T 5b44c782e9fd49aea2b89f4bf967e45b P ff0fe65aa4b1405d84e4597f9aa7f87c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b5189d1d1a034d8b92a7973b50ab5110 (127.14.180.67:40219), 5e0e92538e1f44b2b0663afb330f899e (127.14.180.66:46615)
I20260709 13:10:15.265419 26537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b44c782e9fd49aea2b89f4bf967e45b" candidate_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e0e92538e1f44b2b0663afb330f899e" is_pre_election: true
I20260709 13:10:15.266201 26537 raft_consensus.cc:2468] T 5b44c782e9fd49aea2b89f4bf967e45b P 5e0e92538e1f44b2b0663afb330f899e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff0fe65aa4b1405d84e4597f9aa7f87c in term 3.
I20260709 13:10:15.268428 26534 raft_consensus.cc:2468] T 4d80d20237654d6583f181577681e4ba P 5e0e92538e1f44b2b0663afb330f899e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff0fe65aa4b1405d84e4597f9aa7f87c in term 2.
I20260709 13:10:15.268340 26427 leader_election.cc:304] T 5b44c782e9fd49aea2b89f4bf967e45b P ff0fe65aa4b1405d84e4597f9aa7f87c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0e92538e1f44b2b0663afb330f899e, ff0fe65aa4b1405d84e4597f9aa7f87c; no voters: 
I20260709 13:10:15.273144 26766 raft_consensus.cc:2804] T 5b44c782e9fd49aea2b89f4bf967e45b P ff0fe65aa4b1405d84e4597f9aa7f87c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:15.273633 26766 raft_consensus.cc:493] T 5b44c782e9fd49aea2b89f4bf967e45b P ff0fe65aa4b1405d84e4597f9aa7f87c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:15.274025 26766 raft_consensus.cc:3060] T 5b44c782e9fd49aea2b89f4bf967e45b P ff0fe65aa4b1405d84e4597f9aa7f87c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:15.276046 26360 catalog_manager.cc:5697] T 4d80d20237654d6583f181577681e4ba P ff0fe65aa4b1405d84e4597f9aa7f87c reported cstate change: term changed from 1 to 2, leader changed from 5e0e92538e1f44b2b0663afb330f899e (127.14.180.66) to ff0fe65aa4b1405d84e4597f9aa7f87c (127.14.180.65). New cstate: current_term: 2 leader_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:15.287204 26813 raft_consensus.cc:993] T e98e96ff995841f09a4cdb66e9d7f87d P 5e0e92538e1f44b2b0663afb330f899e: : Instructing follower ff0fe65aa4b1405d84e4597f9aa7f87c to start an election
I20260709 13:10:15.287745 26829 raft_consensus.cc:1081] T e98e96ff995841f09a4cdb66e9d7f87d P 5e0e92538e1f44b2b0663afb330f899e [term 2 LEADER]: Signalling peer ff0fe65aa4b1405d84e4597f9aa7f87c to start an election
I20260709 13:10:15.287288 26766 raft_consensus.cc:515] T 5b44c782e9fd49aea2b89f4bf967e45b P ff0fe65aa4b1405d84e4597f9aa7f87c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } }
I20260709 13:10:15.289917 26458 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e98e96ff995841f09a4cdb66e9d7f87d"
dest_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c"
 from {username='slave'} at 127.0.0.1:44376
I20260709 13:10:15.290019 26766 leader_election.cc:290] T 5b44c782e9fd49aea2b89f4bf967e45b P ff0fe65aa4b1405d84e4597f9aa7f87c [CANDIDATE]: Term 4 election: Requested vote from peers b5189d1d1a034d8b92a7973b50ab5110 (127.14.180.67:40219), 5e0e92538e1f44b2b0663afb330f899e (127.14.180.66:46615)
I20260709 13:10:15.290772 26458 raft_consensus.cc:493] T e98e96ff995841f09a4cdb66e9d7f87d P ff0fe65aa4b1405d84e4597f9aa7f87c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:15.291267 26458 raft_consensus.cc:3060] T e98e96ff995841f09a4cdb66e9d7f87d P ff0fe65aa4b1405d84e4597f9aa7f87c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:15.293728 26534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b44c782e9fd49aea2b89f4bf967e45b" candidate_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e0e92538e1f44b2b0663afb330f899e"
I20260709 13:10:15.294358 26611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b44c782e9fd49aea2b89f4bf967e45b" candidate_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5189d1d1a034d8b92a7973b50ab5110"
I20260709 13:10:15.294651 26534 raft_consensus.cc:3060] T 5b44c782e9fd49aea2b89f4bf967e45b P 5e0e92538e1f44b2b0663afb330f899e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:15.302009 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b44c782e9fd49aea2b89f4bf967e45b" candidate_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5189d1d1a034d8b92a7973b50ab5110" is_pre_election: true
I20260709 13:10:15.306417 26534 raft_consensus.cc:2468] T 5b44c782e9fd49aea2b89f4bf967e45b P 5e0e92538e1f44b2b0663afb330f899e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff0fe65aa4b1405d84e4597f9aa7f87c in term 4.
I20260709 13:10:15.308116 26427 leader_election.cc:304] T 5b44c782e9fd49aea2b89f4bf967e45b P ff0fe65aa4b1405d84e4597f9aa7f87c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e0e92538e1f44b2b0663afb330f899e, ff0fe65aa4b1405d84e4597f9aa7f87c; no voters: b5189d1d1a034d8b92a7973b50ab5110
I20260709 13:10:15.309067 26769 raft_consensus.cc:2804] T 5b44c782e9fd49aea2b89f4bf967e45b P ff0fe65aa4b1405d84e4597f9aa7f87c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:15.310331 26769 raft_consensus.cc:697] T 5b44c782e9fd49aea2b89f4bf967e45b P ff0fe65aa4b1405d84e4597f9aa7f87c [term 4 LEADER]: Becoming Leader. State: Replica: ff0fe65aa4b1405d84e4597f9aa7f87c, State: Running, Role: LEADER
I20260709 13:10:15.310432 26458 raft_consensus.cc:515] T e98e96ff995841f09a4cdb66e9d7f87d P ff0fe65aa4b1405d84e4597f9aa7f87c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:15.311211 26769 consensus_queue.cc:237] T 5b44c782e9fd49aea2b89f4bf967e45b P ff0fe65aa4b1405d84e4597f9aa7f87c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } }
I20260709 13:10:15.313876 26534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e98e96ff995841f09a4cdb66e9d7f87d" candidate_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5e0e92538e1f44b2b0663afb330f899e"
I20260709 13:10:15.314105 26458 leader_election.cc:290] T e98e96ff995841f09a4cdb66e9d7f87d P ff0fe65aa4b1405d84e4597f9aa7f87c [CANDIDATE]: Term 3 election: Requested vote from peers 5e0e92538e1f44b2b0663afb330f899e (127.14.180.66:46615), b5189d1d1a034d8b92a7973b50ab5110 (127.14.180.67:40219)
I20260709 13:10:15.314790 26534 raft_consensus.cc:3055] T e98e96ff995841f09a4cdb66e9d7f87d P 5e0e92538e1f44b2b0663afb330f899e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:15.315287 26534 raft_consensus.cc:740] T e98e96ff995841f09a4cdb66e9d7f87d P 5e0e92538e1f44b2b0663afb330f899e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5e0e92538e1f44b2b0663afb330f899e, State: Running, Role: LEADER
I20260709 13:10:15.316429 26534 consensus_queue.cc:260] T e98e96ff995841f09a4cdb66e9d7f87d P 5e0e92538e1f44b2b0663afb330f899e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:15.318495 26534 raft_consensus.cc:3060] T e98e96ff995841f09a4cdb66e9d7f87d P 5e0e92538e1f44b2b0663afb330f899e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:15.320206 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e98e96ff995841f09a4cdb66e9d7f87d" candidate_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b5189d1d1a034d8b92a7973b50ab5110"
I20260709 13:10:15.322621 26610 raft_consensus.cc:3060] T e98e96ff995841f09a4cdb66e9d7f87d P b5189d1d1a034d8b92a7973b50ab5110 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:15.327086 26534 raft_consensus.cc:2468] T e98e96ff995841f09a4cdb66e9d7f87d P 5e0e92538e1f44b2b0663afb330f899e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff0fe65aa4b1405d84e4597f9aa7f87c in term 3.
I20260709 13:10:15.326418 26360 catalog_manager.cc:5697] T 5b44c782e9fd49aea2b89f4bf967e45b P ff0fe65aa4b1405d84e4597f9aa7f87c reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:15.328586 26427 leader_election.cc:304] T e98e96ff995841f09a4cdb66e9d7f87d P ff0fe65aa4b1405d84e4597f9aa7f87c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0e92538e1f44b2b0663afb330f899e, ff0fe65aa4b1405d84e4597f9aa7f87c; no voters: 
I20260709 13:10:15.329562 26769 raft_consensus.cc:2804] T e98e96ff995841f09a4cdb66e9d7f87d P ff0fe65aa4b1405d84e4597f9aa7f87c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:15.330298 26769 raft_consensus.cc:697] T e98e96ff995841f09a4cdb66e9d7f87d P ff0fe65aa4b1405d84e4597f9aa7f87c [term 3 LEADER]: Becoming Leader. State: Replica: ff0fe65aa4b1405d84e4597f9aa7f87c, State: Running, Role: LEADER
I20260709 13:10:15.330744 26610 raft_consensus.cc:2468] T e98e96ff995841f09a4cdb66e9d7f87d P b5189d1d1a034d8b92a7973b50ab5110 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff0fe65aa4b1405d84e4597f9aa7f87c in term 3.
I20260709 13:10:15.331251 26769 consensus_queue.cc:237] T e98e96ff995841f09a4cdb66e9d7f87d P ff0fe65aa4b1405d84e4597f9aa7f87c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:15.343305 26360 catalog_manager.cc:5697] T e98e96ff995841f09a4cdb66e9d7f87d P ff0fe65aa4b1405d84e4597f9aa7f87c reported cstate change: term changed from 2 to 3, leader changed from 5e0e92538e1f44b2b0663afb330f899e (127.14.180.66) to ff0fe65aa4b1405d84e4597f9aa7f87c (127.14.180.65). New cstate: current_term: 3 leader_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:15.375079 26813 raft_consensus.cc:493] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P 5e0e92538e1f44b2b0663afb330f899e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b5189d1d1a034d8b92a7973b50ab5110)
I20260709 13:10:15.375747 26813 raft_consensus.cc:515] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P 5e0e92538e1f44b2b0663afb330f899e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:15.377559 26813 leader_election.cc:290] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P 5e0e92538e1f44b2b0663afb330f899e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ff0fe65aa4b1405d84e4597f9aa7f87c (127.14.180.65:46829), b5189d1d1a034d8b92a7973b50ab5110 (127.14.180.67:40219)
I20260709 13:10:15.378582 26462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fdfdfcbfbd476e99db1fb5b3fc4e40" candidate_uuid: "5e0e92538e1f44b2b0663afb330f899e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" is_pre_election: true
I20260709 13:10:15.378787 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fdfdfcbfbd476e99db1fb5b3fc4e40" candidate_uuid: "5e0e92538e1f44b2b0663afb330f899e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5189d1d1a034d8b92a7973b50ab5110" is_pre_election: true
I20260709 13:10:15.379552 26610 raft_consensus.cc:2468] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P b5189d1d1a034d8b92a7973b50ab5110 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0e92538e1f44b2b0663afb330f899e in term 3.
I20260709 13:10:15.380597 26501 leader_election.cc:304] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P 5e0e92538e1f44b2b0663afb330f899e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e0e92538e1f44b2b0663afb330f899e, b5189d1d1a034d8b92a7973b50ab5110; no voters: ff0fe65aa4b1405d84e4597f9aa7f87c
I20260709 13:10:15.381357 26813 raft_consensus.cc:2804] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P 5e0e92538e1f44b2b0663afb330f899e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:15.381770 26813 raft_consensus.cc:493] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P 5e0e92538e1f44b2b0663afb330f899e [term 2 FOLLOWER]: Starting leader election (detected failure of leader b5189d1d1a034d8b92a7973b50ab5110)
I20260709 13:10:15.382088 26813 raft_consensus.cc:3060] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P 5e0e92538e1f44b2b0663afb330f899e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:15.387753 26813 raft_consensus.cc:515] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P 5e0e92538e1f44b2b0663afb330f899e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:15.389739 26813 leader_election.cc:290] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P 5e0e92538e1f44b2b0663afb330f899e [CANDIDATE]: Term 3 election: Requested vote from peers ff0fe65aa4b1405d84e4597f9aa7f87c (127.14.180.65:46829), b5189d1d1a034d8b92a7973b50ab5110 (127.14.180.67:40219)
I20260709 13:10:15.391021 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fdfdfcbfbd476e99db1fb5b3fc4e40" candidate_uuid: "5e0e92538e1f44b2b0663afb330f899e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5189d1d1a034d8b92a7973b50ab5110"
I20260709 13:10:15.391076 26462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fdfdfcbfbd476e99db1fb5b3fc4e40" candidate_uuid: "5e0e92538e1f44b2b0663afb330f899e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c"
I20260709 13:10:15.398037 26610 raft_consensus.cc:2468] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P b5189d1d1a034d8b92a7973b50ab5110 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e0e92538e1f44b2b0663afb330f899e in term 3.
I20260709 13:10:15.399439 26501 leader_election.cc:304] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P 5e0e92538e1f44b2b0663afb330f899e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e0e92538e1f44b2b0663afb330f899e, b5189d1d1a034d8b92a7973b50ab5110; no voters: ff0fe65aa4b1405d84e4597f9aa7f87c
I20260709 13:10:15.400490 26813 raft_consensus.cc:2804] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P 5e0e92538e1f44b2b0663afb330f899e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:15.401087 26813 raft_consensus.cc:697] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P 5e0e92538e1f44b2b0663afb330f899e [term 3 LEADER]: Becoming Leader. State: Replica: 5e0e92538e1f44b2b0663afb330f899e, State: Running, Role: LEADER
I20260709 13:10:15.402257 26813 consensus_queue.cc:237] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P 5e0e92538e1f44b2b0663afb330f899e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:15.413691 26360 catalog_manager.cc:5697] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P 5e0e92538e1f44b2b0663afb330f899e reported cstate change: term changed from 2 to 3, leader changed from b5189d1d1a034d8b92a7973b50ab5110 (127.14.180.67) to 5e0e92538e1f44b2b0663afb330f899e (127.14.180.66). New cstate: current_term: 3 leader_uuid: "5e0e92538e1f44b2b0663afb330f899e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:15.696379 26610 raft_consensus.cc:1275] T 505a912bda074202915407e904a3d790 P b5189d1d1a034d8b92a7973b50ab5110 [term 3 FOLLOWER]: Refusing update from remote peer ff0fe65aa4b1405d84e4597f9aa7f87c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:15.698259 26769 consensus_queue.cc:1048] T 505a912bda074202915407e904a3d790 P ff0fe65aa4b1405d84e4597f9aa7f87c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:15.698771 26534 raft_consensus.cc:1275] T 5b44c782e9fd49aea2b89f4bf967e45b P 5e0e92538e1f44b2b0663afb330f899e [term 4 FOLLOWER]: Refusing update from remote peer ff0fe65aa4b1405d84e4597f9aa7f87c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:10:15.701464 26769 consensus_queue.cc:1048] T 5b44c782e9fd49aea2b89f4bf967e45b P ff0fe65aa4b1405d84e4597f9aa7f87c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:15.702009 26534 raft_consensus.cc:1275] T 505a912bda074202915407e904a3d790 P 5e0e92538e1f44b2b0663afb330f899e [term 3 FOLLOWER]: Refusing update from remote peer ff0fe65aa4b1405d84e4597f9aa7f87c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:15.705396 26769 consensus_queue.cc:1048] T 505a912bda074202915407e904a3d790 P ff0fe65aa4b1405d84e4597f9aa7f87c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:15.753710 26610 raft_consensus.cc:3060] T 5b44c782e9fd49aea2b89f4bf967e45b P b5189d1d1a034d8b92a7973b50ab5110 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:15.762337 26610 raft_consensus.cc:1275] T 5b44c782e9fd49aea2b89f4bf967e45b P b5189d1d1a034d8b92a7973b50ab5110 [term 4 FOLLOWER]: Refusing update from remote peer ff0fe65aa4b1405d84e4597f9aa7f87c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:10:15.764073 26766 consensus_queue.cc:1048] T 5b44c782e9fd49aea2b89f4bf967e45b P ff0fe65aa4b1405d84e4597f9aa7f87c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:15.777237 26534 raft_consensus.cc:1275] T e98e96ff995841f09a4cdb66e9d7f87d P 5e0e92538e1f44b2b0663afb330f899e [term 3 FOLLOWER]: Refusing update from remote peer ff0fe65aa4b1405d84e4597f9aa7f87c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:15.777343 26611 raft_consensus.cc:1275] T 4d80d20237654d6583f181577681e4ba P b5189d1d1a034d8b92a7973b50ab5110 [term 2 FOLLOWER]: Refusing update from remote peer ff0fe65aa4b1405d84e4597f9aa7f87c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:15.779255 26818 consensus_queue.cc:1048] T e98e96ff995841f09a4cdb66e9d7f87d P ff0fe65aa4b1405d84e4597f9aa7f87c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:15.779335 26766 consensus_queue.cc:1048] T 4d80d20237654d6583f181577681e4ba P ff0fe65aa4b1405d84e4597f9aa7f87c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:15.809597 26611 raft_consensus.cc:1275] T e98e96ff995841f09a4cdb66e9d7f87d P b5189d1d1a034d8b92a7973b50ab5110 [term 3 FOLLOWER]: Refusing update from remote peer ff0fe65aa4b1405d84e4597f9aa7f87c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:15.826853 26766 consensus_queue.cc:1048] T e98e96ff995841f09a4cdb66e9d7f87d P ff0fe65aa4b1405d84e4597f9aa7f87c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:15.830332 26534 raft_consensus.cc:1275] T 4d80d20237654d6583f181577681e4ba P 5e0e92538e1f44b2b0663afb330f899e [term 2 FOLLOWER]: Refusing update from remote peer ff0fe65aa4b1405d84e4597f9aa7f87c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:15.833390 26766 consensus_queue.cc:1048] T 4d80d20237654d6583f181577681e4ba P ff0fe65aa4b1405d84e4597f9aa7f87c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:15.873623 26818 raft_consensus.cc:493] T 41be667b2c704042b4fa06f2d1480152 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.874178 26818 raft_consensus.cc:515] T 41be667b2c704042b4fa06f2d1480152 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:15.876305 26818 leader_election.cc:290] T 41be667b2c704042b4fa06f2d1480152 P ff0fe65aa4b1405d84e4597f9aa7f87c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5e0e92538e1f44b2b0663afb330f899e (127.14.180.66:46615), b5189d1d1a034d8b92a7973b50ab5110 (127.14.180.67:40219)
I20260709 13:10:15.877364 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41be667b2c704042b4fa06f2d1480152" candidate_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5189d1d1a034d8b92a7973b50ab5110" is_pre_election: true
I20260709 13:10:15.877218 26534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41be667b2c704042b4fa06f2d1480152" candidate_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e0e92538e1f44b2b0663afb330f899e" is_pre_election: true
I20260709 13:10:15.878273 26534 raft_consensus.cc:2468] T 41be667b2c704042b4fa06f2d1480152 P 5e0e92538e1f44b2b0663afb330f899e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff0fe65aa4b1405d84e4597f9aa7f87c in term 3.
I20260709 13:10:15.879428 26427 leader_election.cc:304] T 41be667b2c704042b4fa06f2d1480152 P ff0fe65aa4b1405d84e4597f9aa7f87c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e0e92538e1f44b2b0663afb330f899e, ff0fe65aa4b1405d84e4597f9aa7f87c; no voters: b5189d1d1a034d8b92a7973b50ab5110
I20260709 13:10:15.880144 26818 raft_consensus.cc:2804] T 41be667b2c704042b4fa06f2d1480152 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:15.880532 26818 raft_consensus.cc:493] T 41be667b2c704042b4fa06f2d1480152 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:15.880820 26818 raft_consensus.cc:3060] T 41be667b2c704042b4fa06f2d1480152 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:15.886358 26818 raft_consensus.cc:515] T 41be667b2c704042b4fa06f2d1480152 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:15.888688 26818 leader_election.cc:290] T 41be667b2c704042b4fa06f2d1480152 P ff0fe65aa4b1405d84e4597f9aa7f87c [CANDIDATE]: Term 4 election: Requested vote from peers 5e0e92538e1f44b2b0663afb330f899e (127.14.180.66:46615), b5189d1d1a034d8b92a7973b50ab5110 (127.14.180.67:40219)
I20260709 13:10:15.889366 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41be667b2c704042b4fa06f2d1480152" candidate_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5189d1d1a034d8b92a7973b50ab5110"
I20260709 13:10:15.889313 26534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41be667b2c704042b4fa06f2d1480152" candidate_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e0e92538e1f44b2b0663afb330f899e"
I20260709 13:10:15.890261 26534 raft_consensus.cc:3060] T 41be667b2c704042b4fa06f2d1480152 P 5e0e92538e1f44b2b0663afb330f899e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:15.895928 26534 raft_consensus.cc:2468] T 41be667b2c704042b4fa06f2d1480152 P 5e0e92538e1f44b2b0663afb330f899e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff0fe65aa4b1405d84e4597f9aa7f87c in term 4.
I20260709 13:10:15.897056 26427 leader_election.cc:304] T 41be667b2c704042b4fa06f2d1480152 P ff0fe65aa4b1405d84e4597f9aa7f87c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e0e92538e1f44b2b0663afb330f899e, ff0fe65aa4b1405d84e4597f9aa7f87c; no voters: b5189d1d1a034d8b92a7973b50ab5110
I20260709 13:10:15.897805 26818 raft_consensus.cc:2804] T 41be667b2c704042b4fa06f2d1480152 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:15.898334 26818 raft_consensus.cc:697] T 41be667b2c704042b4fa06f2d1480152 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 4 LEADER]: Becoming Leader. State: Replica: ff0fe65aa4b1405d84e4597f9aa7f87c, State: Running, Role: LEADER
I20260709 13:10:15.899243 26818 consensus_queue.cc:237] T 41be667b2c704042b4fa06f2d1480152 P ff0fe65aa4b1405d84e4597f9aa7f87c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:15.900381 26462 raft_consensus.cc:1275] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 3 FOLLOWER]: Refusing update from remote peer 5e0e92538e1f44b2b0663afb330f899e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:15.902050 26829 consensus_queue.cc:1048] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P 5e0e92538e1f44b2b0663afb330f899e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:15.909266 26359 catalog_manager.cc:5697] T 41be667b2c704042b4fa06f2d1480152 P ff0fe65aa4b1405d84e4597f9aa7f87c reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:15.914479 26610 raft_consensus.cc:1275] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P b5189d1d1a034d8b92a7973b50ab5110 [term 3 FOLLOWER]: Refusing update from remote peer 5e0e92538e1f44b2b0663afb330f899e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:15.922183 26813 consensus_queue.cc:1048] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P 5e0e92538e1f44b2b0663afb330f899e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:16.000141 26773 raft_consensus.cc:493] T 41be667b2c704042b4fa06f2d1480152 P b5189d1d1a034d8b92a7973b50ab5110 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ff0fe65aa4b1405d84e4597f9aa7f87c)
I20260709 13:10:16.000746 26773 raft_consensus.cc:515] T 41be667b2c704042b4fa06f2d1480152 P b5189d1d1a034d8b92a7973b50ab5110 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:16.002696 26773 leader_election.cc:290] T 41be667b2c704042b4fa06f2d1480152 P b5189d1d1a034d8b92a7973b50ab5110 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ff0fe65aa4b1405d84e4597f9aa7f87c (127.14.180.65:46829), 5e0e92538e1f44b2b0663afb330f899e (127.14.180.66:46615)
I20260709 13:10:16.003520 26462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41be667b2c704042b4fa06f2d1480152" candidate_uuid: "b5189d1d1a034d8b92a7973b50ab5110" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" is_pre_election: true
I20260709 13:10:16.003762 26534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41be667b2c704042b4fa06f2d1480152" candidate_uuid: "b5189d1d1a034d8b92a7973b50ab5110" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5e0e92538e1f44b2b0663afb330f899e" is_pre_election: true
I20260709 13:10:16.004565 26534 raft_consensus.cc:2368] T 41be667b2c704042b4fa06f2d1480152 P 5e0e92538e1f44b2b0663afb330f899e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5189d1d1a034d8b92a7973b50ab5110 for earlier term 3. Current term is 4.
I20260709 13:10:16.005671 26576 leader_election.cc:400] T 41be667b2c704042b4fa06f2d1480152 P b5189d1d1a034d8b92a7973b50ab5110 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 5e0e92538e1f44b2b0663afb330f899e (127.14.180.66:46615) with higher term. Message: Invalid argument: T 41be667b2c704042b4fa06f2d1480152 P 5e0e92538e1f44b2b0663afb330f899e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5189d1d1a034d8b92a7973b50ab5110 for earlier term 3. Current term is 4.
I20260709 13:10:16.005926 26576 leader_election.cc:403] T 41be667b2c704042b4fa06f2d1480152 P b5189d1d1a034d8b92a7973b50ab5110 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:16.006510 26773 raft_consensus.cc:3060] T 41be667b2c704042b4fa06f2d1480152 P b5189d1d1a034d8b92a7973b50ab5110 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:10:16.012280 26773 raft_consensus.cc:2749] T 41be667b2c704042b4fa06f2d1480152 P b5189d1d1a034d8b92a7973b50ab5110 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 5e0e92538e1f44b2b0663afb330f899e (127.14.180.66:46615) with higher term. Message: Invalid argument: T 41be667b2c704042b4fa06f2d1480152 P 5e0e92538e1f44b2b0663afb330f899e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b5189d1d1a034d8b92a7973b50ab5110 for earlier term 3. Current term is 4.
I20260709 13:10:16.060784 26813 raft_consensus.cc:493] T 0d9a4ae1c28749c08418e37aca35973c P 5e0e92538e1f44b2b0663afb330f899e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.061462 26813 raft_consensus.cc:515] T 0d9a4ae1c28749c08418e37aca35973c P 5e0e92538e1f44b2b0663afb330f899e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:16.063839 26813 leader_election.cc:290] T 0d9a4ae1c28749c08418e37aca35973c P 5e0e92538e1f44b2b0663afb330f899e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ff0fe65aa4b1405d84e4597f9aa7f87c (127.14.180.65:46829), b5189d1d1a034d8b92a7973b50ab5110 (127.14.180.67:40219)
I20260709 13:10:16.064442 26462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9a4ae1c28749c08418e37aca35973c" candidate_uuid: "5e0e92538e1f44b2b0663afb330f899e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" is_pre_election: true
I20260709 13:10:16.064886 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9a4ae1c28749c08418e37aca35973c" candidate_uuid: "5e0e92538e1f44b2b0663afb330f899e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5189d1d1a034d8b92a7973b50ab5110" is_pre_election: true
I20260709 13:10:16.065322 26462 raft_consensus.cc:2468] T 0d9a4ae1c28749c08418e37aca35973c P ff0fe65aa4b1405d84e4597f9aa7f87c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0e92538e1f44b2b0663afb330f899e in term 3.
I20260709 13:10:16.065496 26610 raft_consensus.cc:2468] T 0d9a4ae1c28749c08418e37aca35973c P b5189d1d1a034d8b92a7973b50ab5110 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0e92538e1f44b2b0663afb330f899e in term 2.
I20260709 13:10:16.066530 26500 leader_election.cc:304] T 0d9a4ae1c28749c08418e37aca35973c P 5e0e92538e1f44b2b0663afb330f899e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0e92538e1f44b2b0663afb330f899e, ff0fe65aa4b1405d84e4597f9aa7f87c; no voters: 
I20260709 13:10:16.067327 26813 raft_consensus.cc:2804] T 0d9a4ae1c28749c08418e37aca35973c P 5e0e92538e1f44b2b0663afb330f899e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:16.067727 26813 raft_consensus.cc:493] T 0d9a4ae1c28749c08418e37aca35973c P 5e0e92538e1f44b2b0663afb330f899e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:16.068089 26813 raft_consensus.cc:3060] T 0d9a4ae1c28749c08418e37aca35973c P 5e0e92538e1f44b2b0663afb330f899e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:16.076752 26813 raft_consensus.cc:515] T 0d9a4ae1c28749c08418e37aca35973c P 5e0e92538e1f44b2b0663afb330f899e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:16.079175 26813 leader_election.cc:290] T 0d9a4ae1c28749c08418e37aca35973c P 5e0e92538e1f44b2b0663afb330f899e [CANDIDATE]: Term 4 election: Requested vote from peers ff0fe65aa4b1405d84e4597f9aa7f87c (127.14.180.65:46829), b5189d1d1a034d8b92a7973b50ab5110 (127.14.180.67:40219)
I20260709 13:10:16.079993 26462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9a4ae1c28749c08418e37aca35973c" candidate_uuid: "5e0e92538e1f44b2b0663afb330f899e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c"
I20260709 13:10:16.080680 26462 raft_consensus.cc:3060] T 0d9a4ae1c28749c08418e37aca35973c P ff0fe65aa4b1405d84e4597f9aa7f87c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:16.086346 26610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9a4ae1c28749c08418e37aca35973c" candidate_uuid: "5e0e92538e1f44b2b0663afb330f899e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b5189d1d1a034d8b92a7973b50ab5110"
I20260709 13:10:16.088209 26610 raft_consensus.cc:3060] T 0d9a4ae1c28749c08418e37aca35973c P b5189d1d1a034d8b92a7973b50ab5110 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:10:16.088968 26462 raft_consensus.cc:2468] T 0d9a4ae1c28749c08418e37aca35973c P ff0fe65aa4b1405d84e4597f9aa7f87c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e0e92538e1f44b2b0663afb330f899e in term 4.
I20260709 13:10:16.090310 26500 leader_election.cc:304] T 0d9a4ae1c28749c08418e37aca35973c P 5e0e92538e1f44b2b0663afb330f899e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0e92538e1f44b2b0663afb330f899e, ff0fe65aa4b1405d84e4597f9aa7f87c; no voters: 
I20260709 13:10:16.091136 26813 raft_consensus.cc:2804] T 0d9a4ae1c28749c08418e37aca35973c P 5e0e92538e1f44b2b0663afb330f899e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:16.091692 26813 raft_consensus.cc:697] T 0d9a4ae1c28749c08418e37aca35973c P 5e0e92538e1f44b2b0663afb330f899e [term 4 LEADER]: Becoming Leader. State: Replica: 5e0e92538e1f44b2b0663afb330f899e, State: Running, Role: LEADER
I20260709 13:10:16.092586 26813 consensus_queue.cc:237] T 0d9a4ae1c28749c08418e37aca35973c P 5e0e92538e1f44b2b0663afb330f899e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:16.095430 26610 raft_consensus.cc:2468] T 0d9a4ae1c28749c08418e37aca35973c P b5189d1d1a034d8b92a7973b50ab5110 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e0e92538e1f44b2b0663afb330f899e in term 4.
I20260709 13:10:16.104329 26358 catalog_manager.cc:5697] T 0d9a4ae1c28749c08418e37aca35973c P 5e0e92538e1f44b2b0663afb330f899e reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "5e0e92538e1f44b2b0663afb330f899e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:16.460475 26610 raft_consensus.cc:1275] T 41be667b2c704042b4fa06f2d1480152 P b5189d1d1a034d8b92a7973b50ab5110 [term 4 FOLLOWER]: Refusing update from remote peer ff0fe65aa4b1405d84e4597f9aa7f87c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:10:16.461895 26818 consensus_queue.cc:1048] T 41be667b2c704042b4fa06f2d1480152 P ff0fe65aa4b1405d84e4597f9aa7f87c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:16.468182 26537 raft_consensus.cc:1275] T 41be667b2c704042b4fa06f2d1480152 P 5e0e92538e1f44b2b0663afb330f899e [term 4 FOLLOWER]: Refusing update from remote peer ff0fe65aa4b1405d84e4597f9aa7f87c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:10:16.470420 26818 consensus_queue.cc:1048] T 41be667b2c704042b4fa06f2d1480152 P ff0fe65aa4b1405d84e4597f9aa7f87c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:16.521165 26462 raft_consensus.cc:1275] T 0d9a4ae1c28749c08418e37aca35973c P ff0fe65aa4b1405d84e4597f9aa7f87c [term 4 FOLLOWER]: Refusing update from remote peer 5e0e92538e1f44b2b0663afb330f899e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:10:16.522725 26813 consensus_queue.cc:1048] T 0d9a4ae1c28749c08418e37aca35973c P 5e0e92538e1f44b2b0663afb330f899e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:16.534649 26610 raft_consensus.cc:1275] T 0d9a4ae1c28749c08418e37aca35973c P b5189d1d1a034d8b92a7973b50ab5110 [term 4 FOLLOWER]: Refusing update from remote peer 5e0e92538e1f44b2b0663afb330f899e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:10:16.537328 26887 consensus_queue.cc:1048] T 0d9a4ae1c28749c08418e37aca35973c P 5e0e92538e1f44b2b0663afb330f899e [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:18.058970 26359 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:55424:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:10:18.084925 26359 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:55424:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:10:18.134042 15057 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:10:18.401315 26936 tablet.cc:1724] T fe0733029c394a438e698d0b85493c36 P ff0fe65aa4b1405d84e4597f9aa7f87c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:18.425259 26462 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "505a912bda074202915407e904a3d790"
dest_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c"
mode: GRACEFUL
new_leader_uuid: "b5189d1d1a034d8b92a7973b50ab5110"
 from {username='slave'} at 127.0.0.1:56458
W20260709 13:10:18.398386 26427 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:46615, user_credentials={real_user=slave}} blocked reactor thread for 48882.7us
I20260709 13:10:18.333899 26934 tablet.cc:1724] T fe0733029c394a438e698d0b85493c36 P b5189d1d1a034d8b92a7973b50ab5110: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:10:18.445544 26932 log.cc:927] Time spent T fb9df82425e34bcca37fd6c21be9f576 P b5189d1d1a034d8b92a7973b50ab5110: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:10:18.318531 26933 tablet.cc:1724] T fb9df82425e34bcca37fd6c21be9f576 P 5e0e92538e1f44b2b0663afb330f899e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:18.377811 26943 tablet.cc:1724] T e98e96ff995841f09a4cdb66e9d7f87d P ff0fe65aa4b1405d84e4597f9aa7f87c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:18.462204 26956 tablet.cc:1724] T fe0733029c394a438e698d0b85493c36 P 5e0e92538e1f44b2b0663afb330f899e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:10:18.486375 26488 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:e98e96ff995841f09a4cdb66e9d7f87d)
W20260709 13:10:18.485353 26946 log.cc:927] Time spent T 466849fd1988469fb5b4037151d7f2bb P 5e0e92538e1f44b2b0663afb330f899e: Append to log took a long time: real 0.060s	user 0.003s	sys 0.000s
I20260709 13:10:18.498158 26959 tablet.cc:1724] T 505a912bda074202915407e904a3d790 P ff0fe65aa4b1405d84e4597f9aa7f87c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:18.492363 26953 tablet.cc:1724] T e98e96ff995841f09a4cdb66e9d7f87d P b5189d1d1a034d8b92a7973b50ab5110: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:18.511765 26462 raft_consensus.cc:606] T 505a912bda074202915407e904a3d790 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 3 LEADER]: Received request to transfer leadership to TS b5189d1d1a034d8b92a7973b50ab5110
I20260709 13:10:18.537019 26962 tablet.cc:1724] T 4d80d20237654d6583f181577681e4ba P 5e0e92538e1f44b2b0663afb330f899e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:18.481951 26955 tablet.cc:1724] T 466849fd1988469fb5b4037151d7f2bb P ff0fe65aa4b1405d84e4597f9aa7f87c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:18.549868 26963 tablet.cc:1724] T 505a912bda074202915407e904a3d790 P b5189d1d1a034d8b92a7973b50ab5110: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:18.551193 26966 tablet.cc:1724] T 466849fd1988469fb5b4037151d7f2bb P b5189d1d1a034d8b92a7973b50ab5110: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:18.555927 26947 raft_consensus.cc:993] T 505a912bda074202915407e904a3d790 P ff0fe65aa4b1405d84e4597f9aa7f87c: : Instructing follower b5189d1d1a034d8b92a7973b50ab5110 to start an election
I20260709 13:10:18.556535 26947 raft_consensus.cc:1081] T 505a912bda074202915407e904a3d790 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 3 LEADER]: Signalling peer b5189d1d1a034d8b92a7973b50ab5110 to start an election
W20260709 13:10:18.566845 26488 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:466849fd1988469fb5b4037151d7f2bb)
W20260709 13:10:18.570075 26488 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:466849fd1988469fb5b4037151d7f2bb)
I20260709 13:10:18.582896 26607 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "505a912bda074202915407e904a3d790"
dest_uuid: "b5189d1d1a034d8b92a7973b50ab5110"
 from {username='slave'} at 127.0.0.1:43170
I20260709 13:10:18.583911 26607 raft_consensus.cc:493] T 505a912bda074202915407e904a3d790 P b5189d1d1a034d8b92a7973b50ab5110 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:18.584461 26607 raft_consensus.cc:3060] T 505a912bda074202915407e904a3d790 P b5189d1d1a034d8b92a7973b50ab5110 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:18.524600 26960 tablet.cc:1724] T 3d85e7002e3541918ceeb148b69b031a P 5e0e92538e1f44b2b0663afb330f899e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:18.618803 26953 tablet.cc:1724] T 4d80d20237654d6583f181577681e4ba P b5189d1d1a034d8b92a7973b50ab5110: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:18.652583 26936 tablet.cc:1724] T fb9df82425e34bcca37fd6c21be9f576 P ff0fe65aa4b1405d84e4597f9aa7f87c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:18.658833 26607 raft_consensus.cc:515] T 505a912bda074202915407e904a3d790 P b5189d1d1a034d8b92a7973b50ab5110 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:18.662151 26959 tablet.cc:1724] T 6bff6969f3eb4e2689b75b066440caef P ff0fe65aa4b1405d84e4597f9aa7f87c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:18.663539 26459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505a912bda074202915407e904a3d790" candidate_uuid: "b5189d1d1a034d8b92a7973b50ab5110" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: true dest_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c"
I20260709 13:10:18.664237 26459 raft_consensus.cc:3055] T 505a912bda074202915407e904a3d790 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:18.664598 26459 raft_consensus.cc:740] T 505a912bda074202915407e904a3d790 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ff0fe65aa4b1405d84e4597f9aa7f87c, State: Running, Role: LEADER
I20260709 13:10:18.669016 26956 tablet.cc:1724] T 505a912bda074202915407e904a3d790 P 5e0e92538e1f44b2b0663afb330f899e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:10:18.670116 26964 log.cc:927] Time spent T 3d85e7002e3541918ceeb148b69b031a P ff0fe65aa4b1405d84e4597f9aa7f87c: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:10:18.640444 26943 tablet.cc:1724] T 4d80d20237654d6583f181577681e4ba P ff0fe65aa4b1405d84e4597f9aa7f87c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:18.671967 26960 tablet.cc:1724] T e98e96ff995841f09a4cdb66e9d7f87d P 5e0e92538e1f44b2b0663afb330f899e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:18.672820 26459 consensus_queue.cc:260] T 505a912bda074202915407e904a3d790 P ff0fe65aa4b1405d84e4597f9aa7f87c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:18.675242 26459 raft_consensus.cc:3060] T 505a912bda074202915407e904a3d790 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:18.683511 26536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "505a912bda074202915407e904a3d790" candidate_uuid: "b5189d1d1a034d8b92a7973b50ab5110" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: true dest_uuid: "5e0e92538e1f44b2b0663afb330f899e"
I20260709 13:10:18.684286 26536 raft_consensus.cc:3060] T 505a912bda074202915407e904a3d790 P 5e0e92538e1f44b2b0663afb330f899e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:18.687070 26966 tablet.cc:1724] T fb9df82425e34bcca37fd6c21be9f576 P b5189d1d1a034d8b92a7973b50ab5110: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:18.688997 26535 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a708761fa65e433fbebfee909b452c37"
dest_uuid: "5e0e92538e1f44b2b0663afb330f899e"
mode: GRACEFUL
new_leader_uuid: "b5189d1d1a034d8b92a7973b50ab5110"
 from {username='slave'} at 127.0.0.1:57996
I20260709 13:10:18.689837 26535 raft_consensus.cc:606] T a708761fa65e433fbebfee909b452c37 P 5e0e92538e1f44b2b0663afb330f899e [term 2 LEADER]: Received request to transfer leadership to TS b5189d1d1a034d8b92a7973b50ab5110
I20260709 13:10:18.691557 15057 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 13:10:18.692265 15057 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:18.692901 26607 leader_election.cc:290] T 505a912bda074202915407e904a3d790 P b5189d1d1a034d8b92a7973b50ab5110 [CANDIDATE]: Term 4 election: Requested vote from peers ff0fe65aa4b1405d84e4597f9aa7f87c (127.14.180.65:46829), 5e0e92538e1f44b2b0663afb330f899e (127.14.180.66:46615)
I20260709 13:10:18.688516 26934 tablet.cc:1724] T 3d85e7002e3541918ceeb148b69b031a P b5189d1d1a034d8b92a7973b50ab5110: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:18.702975 26536 raft_consensus.cc:2468] T 505a912bda074202915407e904a3d790 P 5e0e92538e1f44b2b0663afb330f899e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5189d1d1a034d8b92a7973b50ab5110 in term 4.
I20260709 13:10:18.706477 26576 leader_election.cc:304] T 505a912bda074202915407e904a3d790 P b5189d1d1a034d8b92a7973b50ab5110 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0e92538e1f44b2b0663afb330f899e, b5189d1d1a034d8b92a7973b50ab5110; no voters: 
I20260709 13:10:18.707384 26927 raft_consensus.cc:2804] T 505a912bda074202915407e904a3d790 P b5189d1d1a034d8b92a7973b50ab5110 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:18.707937 26927 raft_consensus.cc:697] T 505a912bda074202915407e904a3d790 P b5189d1d1a034d8b92a7973b50ab5110 [term 4 LEADER]: Becoming Leader. State: Replica: b5189d1d1a034d8b92a7973b50ab5110, State: Running, Role: LEADER
I20260709 13:10:18.708841 26927 consensus_queue.cc:237] T 505a912bda074202915407e904a3d790 P b5189d1d1a034d8b92a7973b50ab5110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:18.709230 26943 tablet.cc:1724] T a708761fa65e433fbebfee909b452c37 P ff0fe65aa4b1405d84e4597f9aa7f87c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:18.712565 26963 tablet.cc:1724] T a708761fa65e433fbebfee909b452c37 P b5189d1d1a034d8b92a7973b50ab5110: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:18.722234 26933 tablet.cc:1724] T 466849fd1988469fb5b4037151d7f2bb P 5e0e92538e1f44b2b0663afb330f899e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:18.724449 26956 tablet.cc:1724] T a708761fa65e433fbebfee909b452c37 P 5e0e92538e1f44b2b0663afb330f899e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:18.727272 26536 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "04fdfdfcbfbd476e99db1fb5b3fc4e40"
dest_uuid: "5e0e92538e1f44b2b0663afb330f899e"
mode: GRACEFUL
new_leader_uuid: "b5189d1d1a034d8b92a7973b50ab5110"
 from {username='slave'} at 127.0.0.1:57996
I20260709 13:10:18.727810 26536 raft_consensus.cc:606] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P 5e0e92538e1f44b2b0663afb330f899e [term 3 LEADER]: Received request to transfer leadership to TS b5189d1d1a034d8b92a7973b50ab5110
I20260709 13:10:18.734386 26936 tablet.cc:1724] T 3d85e7002e3541918ceeb148b69b031a P ff0fe65aa4b1405d84e4597f9aa7f87c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:18.729871 26459 raft_consensus.cc:2468] T 505a912bda074202915407e904a3d790 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5189d1d1a034d8b92a7973b50ab5110 in term 4.
I20260709 13:10:18.746299 26358 catalog_manager.cc:5697] T 505a912bda074202915407e904a3d790 P b5189d1d1a034d8b92a7973b50ab5110 reported cstate change: term changed from 3 to 4, leader changed from ff0fe65aa4b1405d84e4597f9aa7f87c (127.14.180.65) to b5189d1d1a034d8b92a7973b50ab5110 (127.14.180.67). New cstate: current_term: 4 leader_uuid: "b5189d1d1a034d8b92a7973b50ab5110" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:18.765646 26536 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0d9a4ae1c28749c08418e37aca35973c"
dest_uuid: "5e0e92538e1f44b2b0663afb330f899e"
mode: GRACEFUL
new_leader_uuid: "b5189d1d1a034d8b92a7973b50ab5110"
 from {username='slave'} at 127.0.0.1:57996
I20260709 13:10:18.766394 26536 raft_consensus.cc:606] T 0d9a4ae1c28749c08418e37aca35973c P 5e0e92538e1f44b2b0663afb330f899e [term 4 LEADER]: Received request to transfer leadership to TS b5189d1d1a034d8b92a7973b50ab5110
I20260709 13:10:18.768424 15057 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:10:18.769040 15057 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:18.770485 26953 tablet.cc:1724] T 6bff6969f3eb4e2689b75b066440caef P b5189d1d1a034d8b92a7973b50ab5110: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:18.787580 26933 tablet.cc:1724] T 6bff6969f3eb4e2689b75b066440caef P 5e0e92538e1f44b2b0663afb330f899e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:18.844687 26358 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 01f2b5f03c694ea5be1da22fe731b494: soft_deleted_table [id=4f20d84941954977906ae6a52895d6d2] alter complete (version 1)
I20260709 13:10:19.126492 26459 raft_consensus.cc:1275] T 505a912bda074202915407e904a3d790 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 4 FOLLOWER]: Refusing update from remote peer b5189d1d1a034d8b92a7973b50ab5110: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:10:19.128473 26887 raft_consensus.cc:993] T a708761fa65e433fbebfee909b452c37 P 5e0e92538e1f44b2b0663afb330f899e: : Instructing follower b5189d1d1a034d8b92a7973b50ab5110 to start an election
I20260709 13:10:19.129086 26887 raft_consensus.cc:1081] T a708761fa65e433fbebfee909b452c37 P 5e0e92538e1f44b2b0663afb330f899e [term 2 LEADER]: Signalling peer b5189d1d1a034d8b92a7973b50ab5110 to start an election
I20260709 13:10:19.128455 26927 consensus_queue.cc:1048] T 505a912bda074202915407e904a3d790 P b5189d1d1a034d8b92a7973b50ab5110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:19.131384 26608 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a708761fa65e433fbebfee909b452c37"
dest_uuid: "b5189d1d1a034d8b92a7973b50ab5110"
 from {username='slave'} at 127.0.0.1:43174
I20260709 13:10:19.132200 26608 raft_consensus.cc:493] T a708761fa65e433fbebfee909b452c37 P b5189d1d1a034d8b92a7973b50ab5110 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:19.132601 26608 raft_consensus.cc:3060] T a708761fa65e433fbebfee909b452c37 P b5189d1d1a034d8b92a7973b50ab5110 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:19.136034 26887 raft_consensus.cc:993] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P 5e0e92538e1f44b2b0663afb330f899e: : Instructing follower b5189d1d1a034d8b92a7973b50ab5110 to start an election
I20260709 13:10:19.142109 26974 raft_consensus.cc:1081] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P 5e0e92538e1f44b2b0663afb330f899e [term 3 LEADER]: Signalling peer b5189d1d1a034d8b92a7973b50ab5110 to start an election
I20260709 13:10:19.142686 26608 raft_consensus.cc:515] T a708761fa65e433fbebfee909b452c37 P b5189d1d1a034d8b92a7973b50ab5110 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:19.144313 26607 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "04fdfdfcbfbd476e99db1fb5b3fc4e40"
dest_uuid: "b5189d1d1a034d8b92a7973b50ab5110"
 from {username='slave'} at 127.0.0.1:43174
I20260709 13:10:19.145028 26607 raft_consensus.cc:493] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P b5189d1d1a034d8b92a7973b50ab5110 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:19.145457 26607 raft_consensus.cc:3060] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P b5189d1d1a034d8b92a7973b50ab5110 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:19.146225 26608 leader_election.cc:290] T a708761fa65e433fbebfee909b452c37 P b5189d1d1a034d8b92a7973b50ab5110 [CANDIDATE]: Term 3 election: Requested vote from peers ff0fe65aa4b1405d84e4597f9aa7f87c (127.14.180.65:46829), 5e0e92538e1f44b2b0663afb330f899e (127.14.180.66:46615)
I20260709 13:10:19.148300 26457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a708761fa65e433fbebfee909b452c37" candidate_uuid: "b5189d1d1a034d8b92a7973b50ab5110" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c"
I20260709 13:10:19.149058 26457 raft_consensus.cc:3060] T a708761fa65e433fbebfee909b452c37 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:19.164338 26536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a708761fa65e433fbebfee909b452c37" candidate_uuid: "b5189d1d1a034d8b92a7973b50ab5110" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5e0e92538e1f44b2b0663afb330f899e"
I20260709 13:10:19.165262 26536 raft_consensus.cc:3055] T a708761fa65e433fbebfee909b452c37 P 5e0e92538e1f44b2b0663afb330f899e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:19.165617 26536 raft_consensus.cc:740] T a708761fa65e433fbebfee909b452c37 P 5e0e92538e1f44b2b0663afb330f899e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5e0e92538e1f44b2b0663afb330f899e, State: Running, Role: LEADER
I20260709 13:10:19.166424 26536 consensus_queue.cc:260] T a708761fa65e433fbebfee909b452c37 P 5e0e92538e1f44b2b0663afb330f899e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:19.167851 26536 raft_consensus.cc:3060] T a708761fa65e433fbebfee909b452c37 P 5e0e92538e1f44b2b0663afb330f899e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:19.172807 26535 raft_consensus.cc:1275] T 505a912bda074202915407e904a3d790 P 5e0e92538e1f44b2b0663afb330f899e [term 4 FOLLOWER]: Refusing update from remote peer b5189d1d1a034d8b92a7973b50ab5110: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:10:19.178121 26536 raft_consensus.cc:2468] T a708761fa65e433fbebfee909b452c37 P 5e0e92538e1f44b2b0663afb330f899e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5189d1d1a034d8b92a7973b50ab5110 in term 3.
I20260709 13:10:19.179517 26929 consensus_queue.cc:1048] T 505a912bda074202915407e904a3d790 P b5189d1d1a034d8b92a7973b50ab5110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:19.181088 26607 raft_consensus.cc:515] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P b5189d1d1a034d8b92a7973b50ab5110 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:19.181767 26457 raft_consensus.cc:2468] T a708761fa65e433fbebfee909b452c37 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5189d1d1a034d8b92a7973b50ab5110 in term 3.
I20260709 13:10:19.182591 26576 leader_election.cc:304] T a708761fa65e433fbebfee909b452c37 P b5189d1d1a034d8b92a7973b50ab5110 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0e92538e1f44b2b0663afb330f899e, b5189d1d1a034d8b92a7973b50ab5110; no voters: 
I20260709 13:10:19.183738 26887 raft_consensus.cc:993] T 0d9a4ae1c28749c08418e37aca35973c P 5e0e92538e1f44b2b0663afb330f899e: : Instructing follower b5189d1d1a034d8b92a7973b50ab5110 to start an election
I20260709 13:10:19.183995 26607 leader_election.cc:290] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P b5189d1d1a034d8b92a7973b50ab5110 [CANDIDATE]: Term 4 election: Requested vote from peers ff0fe65aa4b1405d84e4597f9aa7f87c (127.14.180.65:46829), 5e0e92538e1f44b2b0663afb330f899e (127.14.180.66:46615)
I20260709 13:10:19.184310 26887 raft_consensus.cc:1081] T 0d9a4ae1c28749c08418e37aca35973c P 5e0e92538e1f44b2b0663afb330f899e [term 4 LEADER]: Signalling peer b5189d1d1a034d8b92a7973b50ab5110 to start an election
I20260709 13:10:19.185510 26927 raft_consensus.cc:2804] T a708761fa65e433fbebfee909b452c37 P b5189d1d1a034d8b92a7973b50ab5110 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:19.186158 26927 raft_consensus.cc:697] T a708761fa65e433fbebfee909b452c37 P b5189d1d1a034d8b92a7973b50ab5110 [term 3 LEADER]: Becoming Leader. State: Replica: b5189d1d1a034d8b92a7973b50ab5110, State: Running, Role: LEADER
I20260709 13:10:19.187117 26927 consensus_queue.cc:237] T a708761fa65e433fbebfee909b452c37 P b5189d1d1a034d8b92a7973b50ab5110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:19.190678 26535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fdfdfcbfbd476e99db1fb5b3fc4e40" candidate_uuid: "b5189d1d1a034d8b92a7973b50ab5110" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "5e0e92538e1f44b2b0663afb330f899e"
I20260709 13:10:19.191509 26535 raft_consensus.cc:3055] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P 5e0e92538e1f44b2b0663afb330f899e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:19.191879 26535 raft_consensus.cc:740] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P 5e0e92538e1f44b2b0663afb330f899e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5e0e92538e1f44b2b0663afb330f899e, State: Running, Role: LEADER
I20260709 13:10:19.192925 26535 consensus_queue.cc:260] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P 5e0e92538e1f44b2b0663afb330f899e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:19.194335 26535 raft_consensus.cc:3060] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P 5e0e92538e1f44b2b0663afb330f899e [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:19.185554 26457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fdfdfcbfbd476e99db1fb5b3fc4e40" candidate_uuid: "b5189d1d1a034d8b92a7973b50ab5110" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c"
I20260709 13:10:19.201316 26457 raft_consensus.cc:3060] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:19.200383 26607 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0d9a4ae1c28749c08418e37aca35973c"
dest_uuid: "b5189d1d1a034d8b92a7973b50ab5110"
 from {username='slave'} at 127.0.0.1:43174
I20260709 13:10:19.211870 26607 raft_consensus.cc:493] T 0d9a4ae1c28749c08418e37aca35973c P b5189d1d1a034d8b92a7973b50ab5110 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:19.212440 26607 raft_consensus.cc:3060] T 0d9a4ae1c28749c08418e37aca35973c P b5189d1d1a034d8b92a7973b50ab5110 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:19.216670 26457 raft_consensus.cc:2468] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5189d1d1a034d8b92a7973b50ab5110 in term 4.
I20260709 13:10:19.204308 26535 raft_consensus.cc:2468] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P 5e0e92538e1f44b2b0663afb330f899e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5189d1d1a034d8b92a7973b50ab5110 in term 4.
I20260709 13:10:19.218513 26576 leader_election.cc:304] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P b5189d1d1a034d8b92a7973b50ab5110 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e0e92538e1f44b2b0663afb330f899e, b5189d1d1a034d8b92a7973b50ab5110; no voters: 
I20260709 13:10:19.219447 26977 raft_consensus.cc:2804] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P b5189d1d1a034d8b92a7973b50ab5110 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:19.219882 26358 catalog_manager.cc:5697] T a708761fa65e433fbebfee909b452c37 P b5189d1d1a034d8b92a7973b50ab5110 reported cstate change: term changed from 2 to 3, leader changed from 5e0e92538e1f44b2b0663afb330f899e (127.14.180.66) to b5189d1d1a034d8b92a7973b50ab5110 (127.14.180.67). New cstate: current_term: 3 leader_uuid: "b5189d1d1a034d8b92a7973b50ab5110" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:19.219936 26977 raft_consensus.cc:697] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P b5189d1d1a034d8b92a7973b50ab5110 [term 4 LEADER]: Becoming Leader. State: Replica: b5189d1d1a034d8b92a7973b50ab5110, State: Running, Role: LEADER
I20260709 13:10:19.223701 26977 consensus_queue.cc:237] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P b5189d1d1a034d8b92a7973b50ab5110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:19.235028 26607 raft_consensus.cc:515] T 0d9a4ae1c28749c08418e37aca35973c P b5189d1d1a034d8b92a7973b50ab5110 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:19.239086 26457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9a4ae1c28749c08418e37aca35973c" candidate_uuid: "b5189d1d1a034d8b92a7973b50ab5110" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c"
I20260709 13:10:19.239306 26607 leader_election.cc:290] T 0d9a4ae1c28749c08418e37aca35973c P b5189d1d1a034d8b92a7973b50ab5110 [CANDIDATE]: Term 5 election: Requested vote from peers ff0fe65aa4b1405d84e4597f9aa7f87c (127.14.180.65:46829), 5e0e92538e1f44b2b0663afb330f899e (127.14.180.66:46615)
I20260709 13:10:19.239787 26457 raft_consensus.cc:3060] T 0d9a4ae1c28749c08418e37aca35973c P ff0fe65aa4b1405d84e4597f9aa7f87c [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:19.242223 26535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d9a4ae1c28749c08418e37aca35973c" candidate_uuid: "b5189d1d1a034d8b92a7973b50ab5110" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "5e0e92538e1f44b2b0663afb330f899e"
I20260709 13:10:19.243013 26535 raft_consensus.cc:3055] T 0d9a4ae1c28749c08418e37aca35973c P 5e0e92538e1f44b2b0663afb330f899e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:19.243320 26535 raft_consensus.cc:740] T 0d9a4ae1c28749c08418e37aca35973c P 5e0e92538e1f44b2b0663afb330f899e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5e0e92538e1f44b2b0663afb330f899e, State: Running, Role: LEADER
I20260709 13:10:19.244166 26535 consensus_queue.cc:260] T 0d9a4ae1c28749c08418e37aca35973c P 5e0e92538e1f44b2b0663afb330f899e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:19.243975 26358 catalog_manager.cc:5697] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P b5189d1d1a034d8b92a7973b50ab5110 reported cstate change: term changed from 3 to 4, leader changed from 5e0e92538e1f44b2b0663afb330f899e (127.14.180.66) to b5189d1d1a034d8b92a7973b50ab5110 (127.14.180.67). New cstate: current_term: 4 leader_uuid: "b5189d1d1a034d8b92a7973b50ab5110" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:19.245683 26535 raft_consensus.cc:3060] T 0d9a4ae1c28749c08418e37aca35973c P 5e0e92538e1f44b2b0663afb330f899e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:19.248334 26457 raft_consensus.cc:2468] T 0d9a4ae1c28749c08418e37aca35973c P ff0fe65aa4b1405d84e4597f9aa7f87c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5189d1d1a034d8b92a7973b50ab5110 in term 5.
I20260709 13:10:19.249874 26574 leader_election.cc:304] T 0d9a4ae1c28749c08418e37aca35973c P b5189d1d1a034d8b92a7973b50ab5110 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5189d1d1a034d8b92a7973b50ab5110, ff0fe65aa4b1405d84e4597f9aa7f87c; no voters: 
I20260709 13:10:19.250725 26977 raft_consensus.cc:2804] T 0d9a4ae1c28749c08418e37aca35973c P b5189d1d1a034d8b92a7973b50ab5110 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:19.251520 26977 raft_consensus.cc:697] T 0d9a4ae1c28749c08418e37aca35973c P b5189d1d1a034d8b92a7973b50ab5110 [term 5 LEADER]: Becoming Leader. State: Replica: b5189d1d1a034d8b92a7973b50ab5110, State: Running, Role: LEADER
I20260709 13:10:19.252525 26977 consensus_queue.cc:237] T 0d9a4ae1c28749c08418e37aca35973c P b5189d1d1a034d8b92a7973b50ab5110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } }
I20260709 13:10:19.258656 26535 raft_consensus.cc:2468] T 0d9a4ae1c28749c08418e37aca35973c P 5e0e92538e1f44b2b0663afb330f899e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5189d1d1a034d8b92a7973b50ab5110 in term 5.
I20260709 13:10:19.264101 26358 catalog_manager.cc:5697] T 0d9a4ae1c28749c08418e37aca35973c P b5189d1d1a034d8b92a7973b50ab5110 reported cstate change: term changed from 4 to 5, leader changed from 5e0e92538e1f44b2b0663afb330f899e (127.14.180.66) to b5189d1d1a034d8b92a7973b50ab5110 (127.14.180.67). New cstate: current_term: 5 leader_uuid: "b5189d1d1a034d8b92a7973b50ab5110" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b5189d1d1a034d8b92a7973b50ab5110" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40219 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:19.618166 26535 raft_consensus.cc:1275] T a708761fa65e433fbebfee909b452c37 P 5e0e92538e1f44b2b0663afb330f899e [term 3 FOLLOWER]: Refusing update from remote peer b5189d1d1a034d8b92a7973b50ab5110: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:19.619688 26977 consensus_queue.cc:1048] T a708761fa65e433fbebfee909b452c37 P b5189d1d1a034d8b92a7973b50ab5110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:19.622588 26536 raft_consensus.cc:1275] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P 5e0e92538e1f44b2b0663afb330f899e [term 4 FOLLOWER]: Refusing update from remote peer b5189d1d1a034d8b92a7973b50ab5110: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:10:19.624586 26927 consensus_queue.cc:1048] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P b5189d1d1a034d8b92a7973b50ab5110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:19.632728 26459 raft_consensus.cc:1275] T a708761fa65e433fbebfee909b452c37 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 3 FOLLOWER]: Refusing update from remote peer b5189d1d1a034d8b92a7973b50ab5110: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:19.635691 26927 consensus_queue.cc:1048] T a708761fa65e433fbebfee909b452c37 P b5189d1d1a034d8b92a7973b50ab5110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:19.642124 26458 raft_consensus.cc:1275] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 4 FOLLOWER]: Refusing update from remote peer b5189d1d1a034d8b92a7973b50ab5110: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:10:19.644021 26927 consensus_queue.cc:1048] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P b5189d1d1a034d8b92a7973b50ab5110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:19.696209 26535 raft_consensus.cc:1275] T 0d9a4ae1c28749c08418e37aca35973c P 5e0e92538e1f44b2b0663afb330f899e [term 5 FOLLOWER]: Refusing update from remote peer b5189d1d1a034d8b92a7973b50ab5110: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:10:19.697536 26927 consensus_queue.cc:1048] T 0d9a4ae1c28749c08418e37aca35973c P b5189d1d1a034d8b92a7973b50ab5110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e0e92538e1f44b2b0663afb330f899e" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 46615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:19.711102 26459 raft_consensus.cc:1275] T 0d9a4ae1c28749c08418e37aca35973c P ff0fe65aa4b1405d84e4597f9aa7f87c [term 5 FOLLOWER]: Refusing update from remote peer b5189d1d1a034d8b92a7973b50ab5110: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:10:19.715600 26982 consensus_queue.cc:1048] T 0d9a4ae1c28749c08418e37aca35973c P b5189d1d1a034d8b92a7973b50ab5110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff0fe65aa4b1405d84e4597f9aa7f87c" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 46829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:19.843078 15057 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:10:19.848209 15057 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 13:10:19.848694 15057 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:19.854097 15057 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 13:10:19.854619 15057 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:20.891796 15057 tablet_server.cc:179] TabletServer@127.14.180.65:0 shutting down...
I20260709 13:10:20.925084 15057 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:20.925911 15057 tablet_replica.cc:333] T fb9df82425e34bcca37fd6c21be9f576 P ff0fe65aa4b1405d84e4597f9aa7f87c: stopping tablet replica
I20260709 13:10:20.926752 15057 raft_consensus.cc:2243] T fb9df82425e34bcca37fd6c21be9f576 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:20.927284 15057 raft_consensus.cc:2272] T fb9df82425e34bcca37fd6c21be9f576 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.929387 15057 tablet_replica.cc:333] T 3d85e7002e3541918ceeb148b69b031a P ff0fe65aa4b1405d84e4597f9aa7f87c: stopping tablet replica
I20260709 13:10:20.930073 15057 raft_consensus.cc:2243] T 3d85e7002e3541918ceeb148b69b031a P ff0fe65aa4b1405d84e4597f9aa7f87c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:20.930616 15057 raft_consensus.cc:2272] T 3d85e7002e3541918ceeb148b69b031a P ff0fe65aa4b1405d84e4597f9aa7f87c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.933127 15057 tablet_replica.cc:333] T a708761fa65e433fbebfee909b452c37 P ff0fe65aa4b1405d84e4597f9aa7f87c: stopping tablet replica
I20260709 13:10:20.933950 15057 raft_consensus.cc:2243] T a708761fa65e433fbebfee909b452c37 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:20.934494 15057 raft_consensus.cc:2272] T a708761fa65e433fbebfee909b452c37 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.937919 15057 tablet_replica.cc:333] T 505a912bda074202915407e904a3d790 P ff0fe65aa4b1405d84e4597f9aa7f87c: stopping tablet replica
I20260709 13:10:20.938915 15057 raft_consensus.cc:2243] T 505a912bda074202915407e904a3d790 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:20.939590 15057 raft_consensus.cc:2272] T 505a912bda074202915407e904a3d790 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.942201 15057 tablet_replica.cc:333] T e98e96ff995841f09a4cdb66e9d7f87d P ff0fe65aa4b1405d84e4597f9aa7f87c: stopping tablet replica
I20260709 13:10:20.942883 15057 raft_consensus.cc:2243] T e98e96ff995841f09a4cdb66e9d7f87d P ff0fe65aa4b1405d84e4597f9aa7f87c [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:20.943694 15057 raft_consensus.cc:2272] T e98e96ff995841f09a4cdb66e9d7f87d P ff0fe65aa4b1405d84e4597f9aa7f87c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.945863 15057 tablet_replica.cc:333] T 7aa0adb09fb048749ba647e2334a1585 P ff0fe65aa4b1405d84e4597f9aa7f87c: stopping tablet replica
I20260709 13:10:20.946534 15057 raft_consensus.cc:2243] T 7aa0adb09fb048749ba647e2334a1585 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:20.947256 15057 raft_consensus.cc:2272] T 7aa0adb09fb048749ba647e2334a1585 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.949504 15057 tablet_replica.cc:333] T 5b44c782e9fd49aea2b89f4bf967e45b P ff0fe65aa4b1405d84e4597f9aa7f87c: stopping tablet replica
I20260709 13:10:20.950129 15057 raft_consensus.cc:2243] T 5b44c782e9fd49aea2b89f4bf967e45b P ff0fe65aa4b1405d84e4597f9aa7f87c [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:10:20.951090 15057 raft_consensus.cc:2272] T 5b44c782e9fd49aea2b89f4bf967e45b P ff0fe65aa4b1405d84e4597f9aa7f87c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.955114 15057 tablet_replica.cc:333] T 9f5fec4f76024abe9c06d7e99531a089 P ff0fe65aa4b1405d84e4597f9aa7f87c: stopping tablet replica
I20260709 13:10:20.956025 15057 raft_consensus.cc:2243] T 9f5fec4f76024abe9c06d7e99531a089 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 3 FOLLOWER]: Raft consensus shutting down.
W20260709 13:10:20.956033 26574 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 7 similar messages]
I20260709 13:10:20.956746 15057 raft_consensus.cc:2272] T 9f5fec4f76024abe9c06d7e99531a089 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.959692 15057 tablet_replica.cc:333] T 4d80d20237654d6583f181577681e4ba P ff0fe65aa4b1405d84e4597f9aa7f87c: stopping tablet replica
W20260709 13:10:20.959824 26574 consensus_peers.cc:597] T fe0733029c394a438e698d0b85493c36 P b5189d1d1a034d8b92a7973b50ab5110 -> Peer ff0fe65aa4b1405d84e4597f9aa7f87c (127.14.180.65:46829): Couldn't send request to peer ff0fe65aa4b1405d84e4597f9aa7f87c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:20.960502 15057 raft_consensus.cc:2243] T 4d80d20237654d6583f181577681e4ba P ff0fe65aa4b1405d84e4597f9aa7f87c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:20.961431 15057 raft_consensus.cc:2272] T 4d80d20237654d6583f181577681e4ba P ff0fe65aa4b1405d84e4597f9aa7f87c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.963691 15057 tablet_replica.cc:333] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P ff0fe65aa4b1405d84e4597f9aa7f87c: stopping tablet replica
I20260709 13:10:20.964439 15057 raft_consensus.cc:2243] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:20.964967 15057 raft_consensus.cc:2272] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.967327 15057 tablet_replica.cc:333] T 466849fd1988469fb5b4037151d7f2bb P ff0fe65aa4b1405d84e4597f9aa7f87c: stopping tablet replica
I20260709 13:10:20.967914 15057 raft_consensus.cc:2243] T 466849fd1988469fb5b4037151d7f2bb P ff0fe65aa4b1405d84e4597f9aa7f87c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:20.968742 15057 raft_consensus.cc:2272] T 466849fd1988469fb5b4037151d7f2bb P ff0fe65aa4b1405d84e4597f9aa7f87c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.971299 15057 tablet_replica.cc:333] T 0d9a4ae1c28749c08418e37aca35973c P ff0fe65aa4b1405d84e4597f9aa7f87c: stopping tablet replica
I20260709 13:10:20.972168 15057 raft_consensus.cc:2243] T 0d9a4ae1c28749c08418e37aca35973c P ff0fe65aa4b1405d84e4597f9aa7f87c [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:20.972716 15057 raft_consensus.cc:2272] T 0d9a4ae1c28749c08418e37aca35973c P ff0fe65aa4b1405d84e4597f9aa7f87c [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.975260 15057 tablet_replica.cc:333] T fe0733029c394a438e698d0b85493c36 P ff0fe65aa4b1405d84e4597f9aa7f87c: stopping tablet replica
I20260709 13:10:20.975936 15057 raft_consensus.cc:2243] T fe0733029c394a438e698d0b85493c36 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:20.976485 15057 raft_consensus.cc:2272] T fe0733029c394a438e698d0b85493c36 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.978643 15057 tablet_replica.cc:333] T 6bff6969f3eb4e2689b75b066440caef P ff0fe65aa4b1405d84e4597f9aa7f87c: stopping tablet replica
I20260709 13:10:20.979234 15057 raft_consensus.cc:2243] T 6bff6969f3eb4e2689b75b066440caef P ff0fe65aa4b1405d84e4597f9aa7f87c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:20.979709 15057 raft_consensus.cc:2272] T 6bff6969f3eb4e2689b75b066440caef P ff0fe65aa4b1405d84e4597f9aa7f87c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.981623 15057 tablet_replica.cc:333] T 7275ca9585794b1c9cc06d7616e89c8d P ff0fe65aa4b1405d84e4597f9aa7f87c: stopping tablet replica
I20260709 13:10:20.982193 15057 raft_consensus.cc:2243] T 7275ca9585794b1c9cc06d7616e89c8d P ff0fe65aa4b1405d84e4597f9aa7f87c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:20.982721 15057 raft_consensus.cc:2272] T 7275ca9585794b1c9cc06d7616e89c8d P ff0fe65aa4b1405d84e4597f9aa7f87c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.984781 15057 tablet_replica.cc:333] T 41be667b2c704042b4fa06f2d1480152 P ff0fe65aa4b1405d84e4597f9aa7f87c: stopping tablet replica
I20260709 13:10:20.985361 15057 raft_consensus.cc:2243] T 41be667b2c704042b4fa06f2d1480152 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:10:20.986172 15057 raft_consensus.cc:2272] T 41be667b2c704042b4fa06f2d1480152 P ff0fe65aa4b1405d84e4597f9aa7f87c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.988376 15057 tablet_replica.cc:333] T dbd9c03cee964db394327f6d722ea62f P ff0fe65aa4b1405d84e4597f9aa7f87c: stopping tablet replica
I20260709 13:10:20.988960 15057 raft_consensus.cc:2243] T dbd9c03cee964db394327f6d722ea62f P ff0fe65aa4b1405d84e4597f9aa7f87c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:20.989807 15057 raft_consensus.cc:2272] T dbd9c03cee964db394327f6d722ea62f P ff0fe65aa4b1405d84e4597f9aa7f87c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:20.992157 15057 tablet_replica.cc:333] T 3cb687f16fd34deea0dcb10953c99dda P ff0fe65aa4b1405d84e4597f9aa7f87c: stopping tablet replica
I20260709 13:10:20.992865 15057 raft_consensus.cc:2243] T 3cb687f16fd34deea0dcb10953c99dda P ff0fe65aa4b1405d84e4597f9aa7f87c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:20.993373 15057 raft_consensus.cc:2272] T 3cb687f16fd34deea0dcb10953c99dda P ff0fe65aa4b1405d84e4597f9aa7f87c [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:21.002240 26574 consensus_peers.cc:597] T 0d9a4ae1c28749c08418e37aca35973c P b5189d1d1a034d8b92a7973b50ab5110 -> Peer ff0fe65aa4b1405d84e4597f9aa7f87c (127.14.180.65:46829): Couldn't send request to peer ff0fe65aa4b1405d84e4597f9aa7f87c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:21.041671 26500 consensus_peers.cc:597] T 7aa0adb09fb048749ba647e2334a1585 P 5e0e92538e1f44b2b0663afb330f899e -> Peer ff0fe65aa4b1405d84e4597f9aa7f87c (127.14.180.65:46829): Couldn't send request to peer ff0fe65aa4b1405d84e4597f9aa7f87c. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46829: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:21.044440 15057 tablet_server.cc:196] TabletServer@127.14.180.65:0 shutdown complete.
W20260709 13:10:21.047250 26500 consensus_peers.cc:597] T 6bff6969f3eb4e2689b75b066440caef P 5e0e92538e1f44b2b0663afb330f899e -> Peer ff0fe65aa4b1405d84e4597f9aa7f87c (127.14.180.65:46829): Couldn't send request to peer ff0fe65aa4b1405d84e4597f9aa7f87c. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46829: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:21.085160 15057 tablet_server.cc:179] TabletServer@127.14.180.66:0 shutting down...
W20260709 13:10:21.109057 26500 consensus_peers.cc:597] T fb9df82425e34bcca37fd6c21be9f576 P 5e0e92538e1f44b2b0663afb330f899e -> Peer ff0fe65aa4b1405d84e4597f9aa7f87c (127.14.180.65:46829): Couldn't send request to peer ff0fe65aa4b1405d84e4597f9aa7f87c. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46829: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:21.124089 26576 consensus_peers.cc:597] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P b5189d1d1a034d8b92a7973b50ab5110 -> Peer 5e0e92538e1f44b2b0663afb330f899e (127.14.180.66:46615): Couldn't send request to peer 5e0e92538e1f44b2b0663afb330f899e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:21.127174 15057 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:21.128170 15057 tablet_replica.cc:333] T fb9df82425e34bcca37fd6c21be9f576 P 5e0e92538e1f44b2b0663afb330f899e: stopping tablet replica
I20260709 13:10:21.129324 15057 raft_consensus.cc:2243] T fb9df82425e34bcca37fd6c21be9f576 P 5e0e92538e1f44b2b0663afb330f899e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:21.130493 15057 raft_consensus.cc:2272] T fb9df82425e34bcca37fd6c21be9f576 P 5e0e92538e1f44b2b0663afb330f899e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:21.132956 15057 tablet_replica.cc:333] T 3d85e7002e3541918ceeb148b69b031a P 5e0e92538e1f44b2b0663afb330f899e: stopping tablet replica
I20260709 13:10:21.133626 15057 raft_consensus.cc:2243] T 3d85e7002e3541918ceeb148b69b031a P 5e0e92538e1f44b2b0663afb330f899e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:21.134630 15057 raft_consensus.cc:2272] T 3d85e7002e3541918ceeb148b69b031a P 5e0e92538e1f44b2b0663afb330f899e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:21.136718 15057 tablet_replica.cc:333] T a708761fa65e433fbebfee909b452c37 P 5e0e92538e1f44b2b0663afb330f899e: stopping tablet replica
I20260709 13:10:21.137411 15057 raft_consensus.cc:2243] T a708761fa65e433fbebfee909b452c37 P 5e0e92538e1f44b2b0663afb330f899e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:21.138049 15057 raft_consensus.cc:2272] T a708761fa65e433fbebfee909b452c37 P 5e0e92538e1f44b2b0663afb330f899e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:21.140302 15057 tablet_replica.cc:333] T 505a912bda074202915407e904a3d790 P 5e0e92538e1f44b2b0663afb330f899e: stopping tablet replica
I20260709 13:10:21.141022 15057 raft_consensus.cc:2243] T 505a912bda074202915407e904a3d790 P 5e0e92538e1f44b2b0663afb330f899e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:21.141541 15057 raft_consensus.cc:2272] T 505a912bda074202915407e904a3d790 P 5e0e92538e1f44b2b0663afb330f899e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:21.143778 15057 tablet_replica.cc:333] T e98e96ff995841f09a4cdb66e9d7f87d P 5e0e92538e1f44b2b0663afb330f899e: stopping tablet replica
I20260709 13:10:21.144474 15057 raft_consensus.cc:2243] T e98e96ff995841f09a4cdb66e9d7f87d P 5e0e92538e1f44b2b0663afb330f899e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:21.145002 15057 raft_consensus.cc:2272] T e98e96ff995841f09a4cdb66e9d7f87d P 5e0e92538e1f44b2b0663afb330f899e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:21.147349 15057 tablet_replica.cc:333] T 7aa0adb09fb048749ba647e2334a1585 P 5e0e92538e1f44b2b0663afb330f899e: stopping tablet replica
I20260709 13:10:21.148075 15057 raft_consensus.cc:2243] T 7aa0adb09fb048749ba647e2334a1585 P 5e0e92538e1f44b2b0663afb330f899e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:21.149044 15057 raft_consensus.cc:2272] T 7aa0adb09fb048749ba647e2334a1585 P 5e0e92538e1f44b2b0663afb330f899e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:21.152036 15057 tablet_replica.cc:333] T 3cb687f16fd34deea0dcb10953c99dda P 5e0e92538e1f44b2b0663afb330f899e: stopping tablet replica
I20260709 13:10:21.152863 15057 raft_consensus.cc:2243] T 3cb687f16fd34deea0dcb10953c99dda P 5e0e92538e1f44b2b0663afb330f899e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:21.154376 15057 raft_consensus.cc:2272] T 3cb687f16fd34deea0dcb10953c99dda P 5e0e92538e1f44b2b0663afb330f899e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:21.157550 15057 tablet_replica.cc:333] T fe0733029c394a438e698d0b85493c36 P 5e0e92538e1f44b2b0663afb330f899e: stopping tablet replica
I20260709 13:10:21.158536 15057 raft_consensus.cc:2243] T fe0733029c394a438e698d0b85493c36 P 5e0e92538e1f44b2b0663afb330f899e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:21.159122 15057 raft_consensus.cc:2272] T fe0733029c394a438e698d0b85493c36 P 5e0e92538e1f44b2b0663afb330f899e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:21.161424 15057 tablet_replica.cc:333] T 6bff6969f3eb4e2689b75b066440caef P 5e0e92538e1f44b2b0663afb330f899e: stopping tablet replica
I20260709 13:10:21.162030 15057 raft_consensus.cc:2243] T 6bff6969f3eb4e2689b75b066440caef P 5e0e92538e1f44b2b0663afb330f899e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:21.162918 15057 raft_consensus.cc:2272] T 6bff6969f3eb4e2689b75b066440caef P 5e0e92538e1f44b2b0663afb330f899e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:21.164997 15057 tablet_replica.cc:333] T 41be667b2c704042b4fa06f2d1480152 P 5e0e92538e1f44b2b0663afb330f899e: stopping tablet replica
I20260709 13:10:21.165663 15057 raft_consensus.cc:2243] T 41be667b2c704042b4fa06f2d1480152 P 5e0e92538e1f44b2b0663afb330f899e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:21.166145 15057 raft_consensus.cc:2272] T 41be667b2c704042b4fa06f2d1480152 P 5e0e92538e1f44b2b0663afb330f899e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:21.168242 15057 tablet_replica.cc:333] T 7275ca9585794b1c9cc06d7616e89c8d P 5e0e92538e1f44b2b0663afb330f899e: stopping tablet replica
I20260709 13:10:21.168841 15057 raft_consensus.cc:2243] T 7275ca9585794b1c9cc06d7616e89c8d P 5e0e92538e1f44b2b0663afb330f899e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:21.169337 15057 raft_consensus.cc:2272] T 7275ca9585794b1c9cc06d7616e89c8d P 5e0e92538e1f44b2b0663afb330f899e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:21.171715 15057 tablet_replica.cc:333] T dbd9c03cee964db394327f6d722ea62f P 5e0e92538e1f44b2b0663afb330f899e: stopping tablet replica
I20260709 13:10:21.172379 15057 raft_consensus.cc:2243] T dbd9c03cee964db394327f6d722ea62f P 5e0e92538e1f44b2b0663afb330f899e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:21.172904 15057 raft_consensus.cc:2272] T dbd9c03cee964db394327f6d722ea62f P 5e0e92538e1f44b2b0663afb330f899e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:21.176004 15057 tablet_replica.cc:333] T 9f5fec4f76024abe9c06d7e99531a089 P 5e0e92538e1f44b2b0663afb330f899e: stopping tablet replica
I20260709 13:10:21.176685 15057 raft_consensus.cc:2243] T 9f5fec4f76024abe9c06d7e99531a089 P 5e0e92538e1f44b2b0663afb330f899e [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:21.177609 15057 raft_consensus.cc:2272] T 9f5fec4f76024abe9c06d7e99531a089 P 5e0e92538e1f44b2b0663afb330f899e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:21.180197 15057 tablet_replica.cc:333] T 466849fd1988469fb5b4037151d7f2bb P 5e0e92538e1f44b2b0663afb330f899e: stopping tablet replica
I20260709 13:10:21.181084 15057 raft_consensus.cc:2243] T 466849fd1988469fb5b4037151d7f2bb P 5e0e92538e1f44b2b0663afb330f899e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:21.181653 15057 raft_consensus.cc:2272] T 466849fd1988469fb5b4037151d7f2bb P 5e0e92538e1f44b2b0663afb330f899e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:21.184651 15057 tablet_replica.cc:333] T 0d9a4ae1c28749c08418e37aca35973c P 5e0e92538e1f44b2b0663afb330f899e: stopping tablet replica
I20260709 13:10:21.185520 15057 raft_consensus.cc:2243] T 0d9a4ae1c28749c08418e37aca35973c P 5e0e92538e1f44b2b0663afb330f899e [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:21.187098 15057 raft_consensus.cc:2272] T 0d9a4ae1c28749c08418e37aca35973c P 5e0e92538e1f44b2b0663afb330f899e [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:21.189208 26576 consensus_peers.cc:597] T a708761fa65e433fbebfee909b452c37 P b5189d1d1a034d8b92a7973b50ab5110 -> Peer 5e0e92538e1f44b2b0663afb330f899e (127.14.180.66:46615): Couldn't send request to peer 5e0e92538e1f44b2b0663afb330f899e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:21.190140 26574 consensus_peers.cc:597] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P b5189d1d1a034d8b92a7973b50ab5110 -> Peer ff0fe65aa4b1405d84e4597f9aa7f87c (127.14.180.65:46829): Couldn't send request to peer ff0fe65aa4b1405d84e4597f9aa7f87c. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46829: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:21.190321 15057 tablet_replica.cc:333] T 4d80d20237654d6583f181577681e4ba P 5e0e92538e1f44b2b0663afb330f899e: stopping tablet replica
I20260709 13:10:21.191329 15057 raft_consensus.cc:2243] T 4d80d20237654d6583f181577681e4ba P 5e0e92538e1f44b2b0663afb330f899e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:21.191960 15057 raft_consensus.cc:2272] T 4d80d20237654d6583f181577681e4ba P 5e0e92538e1f44b2b0663afb330f899e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:21.195005 15057 tablet_replica.cc:333] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P 5e0e92538e1f44b2b0663afb330f899e: stopping tablet replica
I20260709 13:10:21.195531 15057 raft_consensus.cc:2243] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P 5e0e92538e1f44b2b0663afb330f899e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:21.196146 15057 raft_consensus.cc:2272] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P 5e0e92538e1f44b2b0663afb330f899e [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:21.198653 15057 tablet_replica.cc:333] T 5b44c782e9fd49aea2b89f4bf967e45b P 5e0e92538e1f44b2b0663afb330f899e: stopping tablet replica
I20260709 13:10:21.199225 15057 raft_consensus.cc:2243] T 5b44c782e9fd49aea2b89f4bf967e45b P 5e0e92538e1f44b2b0663afb330f899e [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:21.199719 15057 raft_consensus.cc:2272] T 5b44c782e9fd49aea2b89f4bf967e45b P 5e0e92538e1f44b2b0663afb330f899e [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:21.201021 26574 consensus_peers.cc:597] T a708761fa65e433fbebfee909b452c37 P b5189d1d1a034d8b92a7973b50ab5110 -> Peer ff0fe65aa4b1405d84e4597f9aa7f87c (127.14.180.65:46829): Couldn't send request to peer ff0fe65aa4b1405d84e4597f9aa7f87c. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46829: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:21.233083 26574 consensus_peers.cc:597] T 7275ca9585794b1c9cc06d7616e89c8d P b5189d1d1a034d8b92a7973b50ab5110 -> Peer ff0fe65aa4b1405d84e4597f9aa7f87c (127.14.180.65:46829): Couldn't send request to peer ff0fe65aa4b1405d84e4597f9aa7f87c. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46829: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:21.244993 15057 tablet_server.cc:196] TabletServer@127.14.180.66:0 shutdown complete.
W20260709 13:10:21.258486 26576 consensus_peers.cc:597] T fe0733029c394a438e698d0b85493c36 P b5189d1d1a034d8b92a7973b50ab5110 -> Peer 5e0e92538e1f44b2b0663afb330f899e (127.14.180.66:46615): Couldn't send request to peer 5e0e92538e1f44b2b0663afb330f899e. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.66:46615: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:21.278021 26576 consensus_peers.cc:597] T 7275ca9585794b1c9cc06d7616e89c8d P b5189d1d1a034d8b92a7973b50ab5110 -> Peer 5e0e92538e1f44b2b0663afb330f899e (127.14.180.66:46615): Couldn't send request to peer 5e0e92538e1f44b2b0663afb330f899e. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.66:46615: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:21.287889 15057 tablet_server.cc:179] TabletServer@127.14.180.67:0 shutting down...
W20260709 13:10:21.296896 26574 consensus_peers.cc:597] T 505a912bda074202915407e904a3d790 P b5189d1d1a034d8b92a7973b50ab5110 -> Peer ff0fe65aa4b1405d84e4597f9aa7f87c (127.14.180.65:46829): Couldn't send request to peer ff0fe65aa4b1405d84e4597f9aa7f87c. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:46829: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:21.323148 15057 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:21.324123 15057 tablet_replica.cc:333] T fb9df82425e34bcca37fd6c21be9f576 P b5189d1d1a034d8b92a7973b50ab5110: stopping tablet replica
I20260709 13:10:21.324896 15057 raft_consensus.cc:2243] T fb9df82425e34bcca37fd6c21be9f576 P b5189d1d1a034d8b92a7973b50ab5110 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:21.325567 15057 raft_consensus.cc:2272] T fb9df82425e34bcca37fd6c21be9f576 P b5189d1d1a034d8b92a7973b50ab5110 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:21.327945 15057 tablet_replica.cc:333] T 3d85e7002e3541918ceeb148b69b031a P b5189d1d1a034d8b92a7973b50ab5110: stopping tablet replica
I20260709 13:10:21.328588 15057 raft_consensus.cc:2243] T 3d85e7002e3541918ceeb148b69b031a P b5189d1d1a034d8b92a7973b50ab5110 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:21.329106 15057 raft_consensus.cc:2272] T 3d85e7002e3541918ceeb148b69b031a P b5189d1d1a034d8b92a7973b50ab5110 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:21.331578 15057 tablet_replica.cc:333] T a708761fa65e433fbebfee909b452c37 P b5189d1d1a034d8b92a7973b50ab5110: stopping tablet replica
I20260709 13:10:21.332178 15057 raft_consensus.cc:2243] T a708761fa65e433fbebfee909b452c37 P b5189d1d1a034d8b92a7973b50ab5110 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:21.332974 15057 raft_consensus.cc:2272] T a708761fa65e433fbebfee909b452c37 P b5189d1d1a034d8b92a7973b50ab5110 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:21.335099 15057 tablet_replica.cc:333] T 505a912bda074202915407e904a3d790 P b5189d1d1a034d8b92a7973b50ab5110: stopping tablet replica
I20260709 13:10:21.335666 15057 raft_consensus.cc:2243] T 505a912bda074202915407e904a3d790 P b5189d1d1a034d8b92a7973b50ab5110 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:10:21.336473 15057 raft_consensus.cc:2272] T 505a912bda074202915407e904a3d790 P b5189d1d1a034d8b92a7973b50ab5110 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:21.338814 15057 tablet_replica.cc:333] T e98e96ff995841f09a4cdb66e9d7f87d P b5189d1d1a034d8b92a7973b50ab5110: stopping tablet replica
I20260709 13:10:21.339478 15057 raft_consensus.cc:2243] T e98e96ff995841f09a4cdb66e9d7f87d P b5189d1d1a034d8b92a7973b50ab5110 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:21.340090 15057 raft_consensus.cc:2272] T e98e96ff995841f09a4cdb66e9d7f87d P b5189d1d1a034d8b92a7973b50ab5110 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:21.342314 15057 tablet_replica.cc:333] T 7aa0adb09fb048749ba647e2334a1585 P b5189d1d1a034d8b92a7973b50ab5110: stopping tablet replica
I20260709 13:10:21.342973 15057 raft_consensus.cc:2243] T 7aa0adb09fb048749ba647e2334a1585 P b5189d1d1a034d8b92a7973b50ab5110 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:21.343429 15057 raft_consensus.cc:2272] T 7aa0adb09fb048749ba647e2334a1585 P b5189d1d1a034d8b92a7973b50ab5110 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:21.345583 15057 tablet_replica.cc:333] T 9f5fec4f76024abe9c06d7e99531a089 P b5189d1d1a034d8b92a7973b50ab5110: stopping tablet replica
I20260709 13:10:21.346171 15057 raft_consensus.cc:2243] T 9f5fec4f76024abe9c06d7e99531a089 P b5189d1d1a034d8b92a7973b50ab5110 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:21.346755 15057 raft_consensus.cc:2272] T 9f5fec4f76024abe9c06d7e99531a089 P b5189d1d1a034d8b92a7973b50ab5110 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:21.349119 15057 tablet_replica.cc:333] T 466849fd1988469fb5b4037151d7f2bb P b5189d1d1a034d8b92a7973b50ab5110: stopping tablet replica
I20260709 13:10:21.349956 15057 raft_consensus.cc:2243] T 466849fd1988469fb5b4037151d7f2bb P b5189d1d1a034d8b92a7973b50ab5110 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:21.350490 15057 raft_consensus.cc:2272] T 466849fd1988469fb5b4037151d7f2bb P b5189d1d1a034d8b92a7973b50ab5110 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:21.352978 15057 tablet_replica.cc:333] T 0d9a4ae1c28749c08418e37aca35973c P b5189d1d1a034d8b92a7973b50ab5110: stopping tablet replica
I20260709 13:10:21.353860 15057 raft_consensus.cc:2243] T 0d9a4ae1c28749c08418e37aca35973c P b5189d1d1a034d8b92a7973b50ab5110 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:10:21.354888 15057 raft_consensus.cc:2272] T 0d9a4ae1c28749c08418e37aca35973c P b5189d1d1a034d8b92a7973b50ab5110 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:21.357441 15057 tablet_replica.cc:333] T 4d80d20237654d6583f181577681e4ba P b5189d1d1a034d8b92a7973b50ab5110: stopping tablet replica
I20260709 13:10:21.358080 15057 raft_consensus.cc:2243] T 4d80d20237654d6583f181577681e4ba P b5189d1d1a034d8b92a7973b50ab5110 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:21.358670 15057 raft_consensus.cc:2272] T 4d80d20237654d6583f181577681e4ba P b5189d1d1a034d8b92a7973b50ab5110 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:21.360960 15057 tablet_replica.cc:333] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P b5189d1d1a034d8b92a7973b50ab5110: stopping tablet replica
I20260709 13:10:21.361617 15057 raft_consensus.cc:2243] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P b5189d1d1a034d8b92a7973b50ab5110 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:10:21.362481 15057 raft_consensus.cc:2272] T 04fdfdfcbfbd476e99db1fb5b3fc4e40 P b5189d1d1a034d8b92a7973b50ab5110 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:21.365023 15057 tablet_replica.cc:333] T 5b44c782e9fd49aea2b89f4bf967e45b P b5189d1d1a034d8b92a7973b50ab5110: stopping tablet replica
I20260709 13:10:21.365759 15057 raft_consensus.cc:2243] T 5b44c782e9fd49aea2b89f4bf967e45b P b5189d1d1a034d8b92a7973b50ab5110 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:21.366321 15057 raft_consensus.cc:2272] T 5b44c782e9fd49aea2b89f4bf967e45b P b5189d1d1a034d8b92a7973b50ab5110 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:21.368703 15057 tablet_replica.cc:333] T fe0733029c394a438e698d0b85493c36 P b5189d1d1a034d8b92a7973b50ab5110: stopping tablet replica
I20260709 13:10:21.369376 15057 raft_consensus.cc:2243] T fe0733029c394a438e698d0b85493c36 P b5189d1d1a034d8b92a7973b50ab5110 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:21.370287 15057 raft_consensus.cc:2272] T fe0733029c394a438e698d0b85493c36 P b5189d1d1a034d8b92a7973b50ab5110 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:21.372655 15057 tablet_replica.cc:333] T 6bff6969f3eb4e2689b75b066440caef P b5189d1d1a034d8b92a7973b50ab5110: stopping tablet replica
I20260709 13:10:21.373286 15057 raft_consensus.cc:2243] T 6bff6969f3eb4e2689b75b066440caef P b5189d1d1a034d8b92a7973b50ab5110 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:21.373821 15057 raft_consensus.cc:2272] T 6bff6969f3eb4e2689b75b066440caef P b5189d1d1a034d8b92a7973b50ab5110 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:21.376055 15057 tablet_replica.cc:333] T 41be667b2c704042b4fa06f2d1480152 P b5189d1d1a034d8b92a7973b50ab5110: stopping tablet replica
I20260709 13:10:21.376643 15057 raft_consensus.cc:2243] T 41be667b2c704042b4fa06f2d1480152 P b5189d1d1a034d8b92a7973b50ab5110 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:21.377151 15057 raft_consensus.cc:2272] T 41be667b2c704042b4fa06f2d1480152 P b5189d1d1a034d8b92a7973b50ab5110 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:21.379448 15057 tablet_replica.cc:333] T 7275ca9585794b1c9cc06d7616e89c8d P b5189d1d1a034d8b92a7973b50ab5110: stopping tablet replica
I20260709 13:10:21.380033 15057 raft_consensus.cc:2243] T 7275ca9585794b1c9cc06d7616e89c8d P b5189d1d1a034d8b92a7973b50ab5110 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:21.380923 15057 raft_consensus.cc:2272] T 7275ca9585794b1c9cc06d7616e89c8d P b5189d1d1a034d8b92a7973b50ab5110 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:21.384429 15057 tablet_replica.cc:333] T 3cb687f16fd34deea0dcb10953c99dda P b5189d1d1a034d8b92a7973b50ab5110: stopping tablet replica
I20260709 13:10:21.385170 15057 raft_consensus.cc:2243] T 3cb687f16fd34deea0dcb10953c99dda P b5189d1d1a034d8b92a7973b50ab5110 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:21.385753 15057 raft_consensus.cc:2272] T 3cb687f16fd34deea0dcb10953c99dda P b5189d1d1a034d8b92a7973b50ab5110 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:21.388185 15057 tablet_replica.cc:333] T dbd9c03cee964db394327f6d722ea62f P b5189d1d1a034d8b92a7973b50ab5110: stopping tablet replica
I20260709 13:10:21.388792 15057 raft_consensus.cc:2243] T dbd9c03cee964db394327f6d722ea62f P b5189d1d1a034d8b92a7973b50ab5110 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:21.389292 15057 raft_consensus.cc:2272] T dbd9c03cee964db394327f6d722ea62f P b5189d1d1a034d8b92a7973b50ab5110 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:21.432581 15057 tablet_server.cc:196] TabletServer@127.14.180.67:0 shutdown complete.
I20260709 13:10:21.472015 15057 master.cc:562] Master@127.14.180.126:40463 shutting down...
I20260709 13:10:21.496840 15057 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 01f2b5f03c694ea5be1da22fe731b494 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:21.497635 15057 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 01f2b5f03c694ea5be1da22fe731b494 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:21.498242 15057 tablet_replica.cc:333] T 00000000000000000000000000000000 P 01f2b5f03c694ea5be1da22fe731b494: stopping tablet replica
I20260709 13:10:21.546836 15057 master.cc:584] Master@127.14.180.126:40463 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (15476 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 13:10:21.608374 15057 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.14.180.126:39253
I20260709 13:10:21.609560 15057 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:21.616097 26994 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:21.616559 26995 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:21.617287 26997 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:21.618037 15057 server_base.cc:1061] running on GCE node
I20260709 13:10:21.619230 15057 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:21.619493 15057 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:21.619659 15057 hybrid_clock.cc:648] HybridClock initialized: now 1783602621619643 us; error 0 us; skew 500 ppm
I20260709 13:10:21.620326 15057 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:21.623188 15057 webserver.cc:533] Webserver started at http://127.14.180.126:45195/ using document root <none> and password file <none>
I20260709 13:10:21.623701 15057 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:21.623929 15057 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:21.624203 15057 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:21.625631 15057 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602283040513-15057-0/minicluster-data/master-0-root/instance:
uuid: "6138d17844114e888ab749ddf76793ed"
format_stamp: "Formatted at 2026-07-09 13:10:21 on dist-test-slave-r9m8"
I20260709 13:10:21.630977 15057 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.001s
I20260709 13:10:21.634958 27002 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:21.635948 15057 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 13:10:21.636267 15057 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602283040513-15057-0/minicluster-data/master-0-root
uuid: "6138d17844114e888ab749ddf76793ed"
format_stamp: "Formatted at 2026-07-09 13:10:21 on dist-test-slave-r9m8"
I20260709 13:10:21.636541 15057 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602283040513-15057-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602283040513-15057-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602283040513-15057-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:21.666726 15057 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:21.667970 15057 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:21.709444 15057 rpc_server.cc:307] RPC server started. Bound to: 127.14.180.126:39253
I20260709 13:10:21.709573 27053 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.180.126:39253 every 8 connection(s)
I20260709 13:10:21.714002 27054 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:21.726809 27054 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6138d17844114e888ab749ddf76793ed: Bootstrap starting.
I20260709 13:10:21.732656 27054 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6138d17844114e888ab749ddf76793ed: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:21.737558 27054 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6138d17844114e888ab749ddf76793ed: No bootstrap required, opened a new log
I20260709 13:10:21.740264 27054 raft_consensus.cc:359] T 00000000000000000000000000000000 P 6138d17844114e888ab749ddf76793ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6138d17844114e888ab749ddf76793ed" member_type: VOTER }
I20260709 13:10:21.740687 27054 raft_consensus.cc:385] T 00000000000000000000000000000000 P 6138d17844114e888ab749ddf76793ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:21.740983 27054 raft_consensus.cc:740] T 00000000000000000000000000000000 P 6138d17844114e888ab749ddf76793ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6138d17844114e888ab749ddf76793ed, State: Initialized, Role: FOLLOWER
I20260709 13:10:21.741693 27054 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6138d17844114e888ab749ddf76793ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6138d17844114e888ab749ddf76793ed" member_type: VOTER }
I20260709 13:10:21.742187 27054 raft_consensus.cc:399] T 00000000000000000000000000000000 P 6138d17844114e888ab749ddf76793ed [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:10:21.742405 27054 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6138d17844114e888ab749ddf76793ed [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:10:21.742743 27054 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 6138d17844114e888ab749ddf76793ed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:21.748351 27054 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6138d17844114e888ab749ddf76793ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6138d17844114e888ab749ddf76793ed" member_type: VOTER }
I20260709 13:10:21.748978 27054 leader_election.cc:304] T 00000000000000000000000000000000 P 6138d17844114e888ab749ddf76793ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6138d17844114e888ab749ddf76793ed; no voters: 
I20260709 13:10:21.750196 27054 leader_election.cc:290] T 00000000000000000000000000000000 P 6138d17844114e888ab749ddf76793ed [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:10:21.750687 27057 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 6138d17844114e888ab749ddf76793ed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:21.752234 27057 raft_consensus.cc:697] T 00000000000000000000000000000000 P 6138d17844114e888ab749ddf76793ed [term 1 LEADER]: Becoming Leader. State: Replica: 6138d17844114e888ab749ddf76793ed, State: Running, Role: LEADER
I20260709 13:10:21.752965 27057 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6138d17844114e888ab749ddf76793ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6138d17844114e888ab749ddf76793ed" member_type: VOTER }
I20260709 13:10:21.753353 27054 sys_catalog.cc:565] T 00000000000000000000000000000000 P 6138d17844114e888ab749ddf76793ed [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:10:21.758051 27058 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6138d17844114e888ab749ddf76793ed [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6138d17844114e888ab749ddf76793ed" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6138d17844114e888ab749ddf76793ed" member_type: VOTER } }
I20260709 13:10:21.758002 27059 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6138d17844114e888ab749ddf76793ed [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6138d17844114e888ab749ddf76793ed. Latest consensus state: current_term: 1 leader_uuid: "6138d17844114e888ab749ddf76793ed" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6138d17844114e888ab749ddf76793ed" member_type: VOTER } }
I20260709 13:10:21.758921 27058 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6138d17844114e888ab749ddf76793ed [sys.catalog]: This master's current role is: LEADER
I20260709 13:10:21.759029 27059 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6138d17844114e888ab749ddf76793ed [sys.catalog]: This master's current role is: LEADER
I20260709 13:10:21.761379 27064 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:10:21.768474 27064 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:10:21.774070 15057 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:10:21.779623 27064 catalog_manager.cc:1383] Generated new cluster ID: 26494b4d7ad14bbbbcfbaff3b689a9c0
I20260709 13:10:21.779956 27064 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:10:21.806504 27064 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:10:21.808024 27064 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:10:21.823051 27064 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 6138d17844114e888ab749ddf76793ed: Generated new TSK 0
I20260709 13:10:21.823799 27064 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:10:21.841018 15057 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:21.847589 27075 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:21.848729 27076 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:21.856670 15057 server_base.cc:1061] running on GCE node
W20260709 13:10:21.856640 27078 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:21.858095 15057 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:21.858305 15057 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:21.858428 15057 hybrid_clock.cc:648] HybridClock initialized: now 1783602621858416 us; error 0 us; skew 500 ppm
I20260709 13:10:21.858968 15057 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:21.861675 15057 webserver.cc:533] Webserver started at http://127.14.180.65:36697/ using document root <none> and password file <none>
I20260709 13:10:21.862150 15057 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:21.862319 15057 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:21.862613 15057 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:21.863736 15057 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602283040513-15057-0/minicluster-data/ts-0-root/instance:
uuid: "e7c0341504c3426280338a5599607a0d"
format_stamp: "Formatted at 2026-07-09 13:10:21 on dist-test-slave-r9m8"
I20260709 13:10:21.868604 15057 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:10:21.872463 27083 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:21.873510 15057 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.000s
I20260709 13:10:21.873888 15057 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602283040513-15057-0/minicluster-data/ts-0-root
uuid: "e7c0341504c3426280338a5599607a0d"
format_stamp: "Formatted at 2026-07-09 13:10:21 on dist-test-slave-r9m8"
I20260709 13:10:21.874190 15057 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602283040513-15057-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602283040513-15057-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602283040513-15057-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:21.891014 15057 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:21.892428 15057 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:21.894012 15057 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:21.896571 15057 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:21.896775 15057 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:21.897130 15057 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:21.897322 15057 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:21.942672 15057 rpc_server.cc:307] RPC server started. Bound to: 127.14.180.65:41105
I20260709 13:10:21.943289 27145 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.180.65:41105 every 8 connection(s)
I20260709 13:10:21.948024 15057 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:21.956271 27150 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:21.958323 27151 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:21.963086 27153 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:21.964347 15057 server_base.cc:1061] running on GCE node
I20260709 13:10:21.965147 27146 heartbeater.cc:344] Connected to a master server at 127.14.180.126:39253
I20260709 13:10:21.965384 15057 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:10:21.965647 27146 heartbeater.cc:461] Registering TS with master...
W20260709 13:10:21.965720 15057 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:21.966192 15057 hybrid_clock.cc:648] HybridClock initialized: now 1783602621966172 us; error 0 us; skew 500 ppm
I20260709 13:10:21.966959 15057 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:21.966878 27146 heartbeater.cc:507] Master 127.14.180.126:39253 requested a full tablet report, sending...
I20260709 13:10:21.969946 27019 ts_manager.cc:194] Registered new tserver with Master: e7c0341504c3426280338a5599607a0d (127.14.180.65:41105)
I20260709 13:10:21.970108 15057 webserver.cc:533] Webserver started at http://127.14.180.66:46703/ using document root <none> and password file <none>
I20260709 13:10:21.970885 15057 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:21.971153 15057 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:21.971527 15057 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:21.972651 27019 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54888
I20260709 13:10:21.973155 15057 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602283040513-15057-0/minicluster-data/ts-1-root/instance:
uuid: "9f0541c7472e4aef9aac8ad7d02e8e48"
format_stamp: "Formatted at 2026-07-09 13:10:21 on dist-test-slave-r9m8"
I20260709 13:10:21.978489 15057 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.003s	sys 0.004s
I20260709 13:10:21.982124 27158 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:21.983099 15057 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:10:21.983456 15057 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602283040513-15057-0/minicluster-data/ts-1-root
uuid: "9f0541c7472e4aef9aac8ad7d02e8e48"
format_stamp: "Formatted at 2026-07-09 13:10:21 on dist-test-slave-r9m8"
I20260709 13:10:21.983737 15057 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602283040513-15057-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602283040513-15057-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602283040513-15057-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:22.009277 15057 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:22.010636 15057 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:22.012506 15057 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:22.015002 15057 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:22.015354 15057 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:22.015717 15057 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:22.015865 15057 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:22.063194 15057 rpc_server.cc:307] RPC server started. Bound to: 127.14.180.66:41411
I20260709 13:10:22.063360 27220 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.180.66:41411 every 8 connection(s)
I20260709 13:10:22.069267 15057 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:22.077929 27224 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:22.080497 27225 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:22.084278 27221 heartbeater.cc:344] Connected to a master server at 127.14.180.126:39253
I20260709 13:10:22.084829 27221 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:22.085505 15057 server_base.cc:1061] running on GCE node
W20260709 13:10:22.085536 27227 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:22.085937 27221 heartbeater.cc:507] Master 127.14.180.126:39253 requested a full tablet report, sending...
I20260709 13:10:22.086995 15057 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:22.087266 15057 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:22.087471 15057 hybrid_clock.cc:648] HybridClock initialized: now 1783602622087453 us; error 0 us; skew 500 ppm
I20260709 13:10:22.088191 15057 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:22.088773 27019 ts_manager.cc:194] Registered new tserver with Master: 9f0541c7472e4aef9aac8ad7d02e8e48 (127.14.180.66:41411)
I20260709 13:10:22.090193 27019 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54896
I20260709 13:10:22.098425 15057 webserver.cc:533] Webserver started at http://127.14.180.67:46699/ using document root <none> and password file <none>
I20260709 13:10:22.099170 15057 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:22.099339 15057 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:22.099572 15057 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:22.100780 15057 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602283040513-15057-0/minicluster-data/ts-2-root/instance:
uuid: "dd2dd298b4404607b3f3a14b89cbbee4"
format_stamp: "Formatted at 2026-07-09 13:10:22 on dist-test-slave-r9m8"
I20260709 13:10:22.105758 15057 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.002s
I20260709 13:10:22.109790 27232 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:22.110790 15057 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:10:22.111132 15057 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602283040513-15057-0/minicluster-data/ts-2-root
uuid: "dd2dd298b4404607b3f3a14b89cbbee4"
format_stamp: "Formatted at 2026-07-09 13:10:22 on dist-test-slave-r9m8"
I20260709 13:10:22.111433 15057 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602283040513-15057-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602283040513-15057-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskjFkGJp/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602283040513-15057-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:22.147234 15057 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:22.148473 15057 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:22.149811 15057 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:22.152330 15057 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:22.152618 15057 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:22.152878 15057 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:22.153072 15057 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:22.197851 15057 rpc_server.cc:307] RPC server started. Bound to: 127.14.180.67:40131
I20260709 13:10:22.197952 27294 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.14.180.67:40131 every 8 connection(s)
I20260709 13:10:22.213686 27295 heartbeater.cc:344] Connected to a master server at 127.14.180.126:39253
I20260709 13:10:22.214151 27295 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:22.214962 27295 heartbeater.cc:507] Master 127.14.180.126:39253 requested a full tablet report, sending...
I20260709 13:10:22.217054 27019 ts_manager.cc:194] Registered new tserver with Master: dd2dd298b4404607b3f3a14b89cbbee4 (127.14.180.67:40131)
I20260709 13:10:22.217785 15057 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016415867s
I20260709 13:10:22.218946 27019 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54906
I20260709 13:10:22.248728 27019 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54908:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:10:22.251518 27019 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:10:22.326486 27260 tablet_service.cc:1511] Processing CreateTablet for tablet 3a5eb0bf903c4627add0ee35d02a4853 (DEFAULT_TABLE table=test-workload [id=b68c3587d73e439290d31a157d930f88]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:10:22.326865 27186 tablet_service.cc:1511] Processing CreateTablet for tablet 3a5eb0bf903c4627add0ee35d02a4853 (DEFAULT_TABLE table=test-workload [id=b68c3587d73e439290d31a157d930f88]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:10:22.328460 27260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a5eb0bf903c4627add0ee35d02a4853. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.328462 27186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a5eb0bf903c4627add0ee35d02a4853. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.329938 27185 tablet_service.cc:1511] Processing CreateTablet for tablet ba62c4ccdf604a349be40020c44728e9 (DEFAULT_TABLE table=test-workload [id=b68c3587d73e439290d31a157d930f88]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:10:22.330926 27259 tablet_service.cc:1511] Processing CreateTablet for tablet ba62c4ccdf604a349be40020c44728e9 (DEFAULT_TABLE table=test-workload [id=b68c3587d73e439290d31a157d930f88]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:10:22.332110 27185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba62c4ccdf604a349be40020c44728e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.332757 27259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba62c4ccdf604a349be40020c44728e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.338922 27184 tablet_service.cc:1511] Processing CreateTablet for tablet 2131193060f9477e9750e3f42ef79986 (DEFAULT_TABLE table=test-workload [id=b68c3587d73e439290d31a157d930f88]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:10:22.340675 27184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2131193060f9477e9750e3f42ef79986. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.345783 27111 tablet_service.cc:1511] Processing CreateTablet for tablet 3a5eb0bf903c4627add0ee35d02a4853 (DEFAULT_TABLE table=test-workload [id=b68c3587d73e439290d31a157d930f88]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:10:22.346617 27109 tablet_service.cc:1511] Processing CreateTablet for tablet 2131193060f9477e9750e3f42ef79986 (DEFAULT_TABLE table=test-workload [id=b68c3587d73e439290d31a157d930f88]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:10:22.347750 27110 tablet_service.cc:1511] Processing CreateTablet for tablet ba62c4ccdf604a349be40020c44728e9 (DEFAULT_TABLE table=test-workload [id=b68c3587d73e439290d31a157d930f88]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:10:22.352056 27108 tablet_service.cc:1511] Processing CreateTablet for tablet d5c696708616494588c1322fabef87f2 (DEFAULT_TABLE table=test-workload [id=b68c3587d73e439290d31a157d930f88]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:10:22.350425 27258 tablet_service.cc:1511] Processing CreateTablet for tablet 2131193060f9477e9750e3f42ef79986 (DEFAULT_TABLE table=test-workload [id=b68c3587d73e439290d31a157d930f88]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:10:22.353870 27258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2131193060f9477e9750e3f42ef79986. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.352123 27111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a5eb0bf903c4627add0ee35d02a4853. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.356868 27108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5c696708616494588c1322fabef87f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.357600 27109 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2131193060f9477e9750e3f42ef79986. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.362618 27110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba62c4ccdf604a349be40020c44728e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.375969 27183 tablet_service.cc:1511] Processing CreateTablet for tablet d5c696708616494588c1322fabef87f2 (DEFAULT_TABLE table=test-workload [id=b68c3587d73e439290d31a157d930f88]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:10:22.377732 27183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5c696708616494588c1322fabef87f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.381614 27107 tablet_service.cc:1511] Processing CreateTablet for tablet c0a2c588c6f148ef9976d15d1a79ba74 (DEFAULT_TABLE table=test-workload [id=b68c3587d73e439290d31a157d930f88]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:10:22.384065 27257 tablet_service.cc:1511] Processing CreateTablet for tablet d5c696708616494588c1322fabef87f2 (DEFAULT_TABLE table=test-workload [id=b68c3587d73e439290d31a157d930f88]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:10:22.385751 27257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5c696708616494588c1322fabef87f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.396689 27182 tablet_service.cc:1511] Processing CreateTablet for tablet c0a2c588c6f148ef9976d15d1a79ba74 (DEFAULT_TABLE table=test-workload [id=b68c3587d73e439290d31a157d930f88]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:10:22.401690 27256 tablet_service.cc:1511] Processing CreateTablet for tablet c0a2c588c6f148ef9976d15d1a79ba74 (DEFAULT_TABLE table=test-workload [id=b68c3587d73e439290d31a157d930f88]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:10:22.403688 27256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0a2c588c6f148ef9976d15d1a79ba74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.407192 27106 tablet_service.cc:1511] Processing CreateTablet for tablet 25b85b28aed94a088553d3df84dfc6dc (DEFAULT_TABLE table=test-workload [id=b68c3587d73e439290d31a157d930f88]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:10:22.398409 27182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0a2c588c6f148ef9976d15d1a79ba74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.421576 27107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0a2c588c6f148ef9976d15d1a79ba74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.423655 27106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25b85b28aed94a088553d3df84dfc6dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.451717 27181 tablet_service.cc:1511] Processing CreateTablet for tablet 25b85b28aed94a088553d3df84dfc6dc (DEFAULT_TABLE table=test-workload [id=b68c3587d73e439290d31a157d930f88]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:10:22.453892 27181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25b85b28aed94a088553d3df84dfc6dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.463182 27255 tablet_service.cc:1511] Processing CreateTablet for tablet 25b85b28aed94a088553d3df84dfc6dc (DEFAULT_TABLE table=test-workload [id=b68c3587d73e439290d31a157d930f88]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:10:22.469146 27255 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25b85b28aed94a088553d3df84dfc6dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.476804 27310 tablet_bootstrap.cc:492] T ba62c4ccdf604a349be40020c44728e9 P 9f0541c7472e4aef9aac8ad7d02e8e48: Bootstrap starting.
I20260709 13:10:22.484892 27105 tablet_service.cc:1511] Processing CreateTablet for tablet fd5b3b92057444cfb3f243b5fdf1ae66 (DEFAULT_TABLE table=test-workload [id=b68c3587d73e439290d31a157d930f88]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:10:22.492149 27260 tablet_service.cc:1511] Processing CreateTablet for tablet fd5b3b92057444cfb3f243b5fdf1ae66 (DEFAULT_TABLE table=test-workload [id=b68c3587d73e439290d31a157d930f88]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:10:22.493753 27260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd5b3b92057444cfb3f243b5fdf1ae66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.499747 27186 tablet_service.cc:1511] Processing CreateTablet for tablet fd5b3b92057444cfb3f243b5fdf1ae66 (DEFAULT_TABLE table=test-workload [id=b68c3587d73e439290d31a157d930f88]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:10:22.501279 27186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd5b3b92057444cfb3f243b5fdf1ae66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.517580 27105 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd5b3b92057444cfb3f243b5fdf1ae66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.544531 27183 tablet_service.cc:1511] Processing CreateTablet for tablet 025d8ae32c8a4cec8fe002fb1682eb12 (DEFAULT_TABLE table=test-workload [id=b68c3587d73e439290d31a157d930f88]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:10:22.559811 27312 tablet_bootstrap.cc:492] T d5c696708616494588c1322fabef87f2 P e7c0341504c3426280338a5599607a0d: Bootstrap starting.
I20260709 13:10:22.566044 27183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 025d8ae32c8a4cec8fe002fb1682eb12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.565604 27109 tablet_service.cc:1511] Processing CreateTablet for tablet c7b039889b334a5c90fee88adac9c25e (DEFAULT_TABLE table=test-workload [id=b68c3587d73e439290d31a157d930f88]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:10:22.559983 27311 tablet_bootstrap.cc:492] T ba62c4ccdf604a349be40020c44728e9 P dd2dd298b4404607b3f3a14b89cbbee4: Bootstrap starting.
I20260709 13:10:22.534509 27111 tablet_service.cc:1511] Processing CreateTablet for tablet 025d8ae32c8a4cec8fe002fb1682eb12 (DEFAULT_TABLE table=test-workload [id=b68c3587d73e439290d31a157d930f88]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:10:22.570864 27310 tablet_bootstrap.cc:654] T ba62c4ccdf604a349be40020c44728e9 P 9f0541c7472e4aef9aac8ad7d02e8e48: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:22.572052 27260 tablet_service.cc:1511] Processing CreateTablet for tablet 025d8ae32c8a4cec8fe002fb1682eb12 (DEFAULT_TABLE table=test-workload [id=b68c3587d73e439290d31a157d930f88]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:10:22.573515 27260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 025d8ae32c8a4cec8fe002fb1682eb12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.567234 27109 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7b039889b334a5c90fee88adac9c25e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.575250 27111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 025d8ae32c8a4cec8fe002fb1682eb12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.593942 27182 tablet_service.cc:1511] Processing CreateTablet for tablet c7b039889b334a5c90fee88adac9c25e (DEFAULT_TABLE table=test-workload [id=b68c3587d73e439290d31a157d930f88]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:10:22.596213 27182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7b039889b334a5c90fee88adac9c25e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.599467 27312 tablet_bootstrap.cc:654] T d5c696708616494588c1322fabef87f2 P e7c0341504c3426280338a5599607a0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:22.605839 27311 tablet_bootstrap.cc:654] T ba62c4ccdf604a349be40020c44728e9 P dd2dd298b4404607b3f3a14b89cbbee4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:22.607946 27310 tablet_bootstrap.cc:492] T ba62c4ccdf604a349be40020c44728e9 P 9f0541c7472e4aef9aac8ad7d02e8e48: No bootstrap required, opened a new log
I20260709 13:10:22.608574 27310 ts_tablet_manager.cc:1403] T ba62c4ccdf604a349be40020c44728e9 P 9f0541c7472e4aef9aac8ad7d02e8e48: Time spent bootstrapping tablet: real 0.132s	user 0.010s	sys 0.005s
I20260709 13:10:22.614192 27312 tablet_bootstrap.cc:492] T d5c696708616494588c1322fabef87f2 P e7c0341504c3426280338a5599607a0d: No bootstrap required, opened a new log
I20260709 13:10:22.614864 27312 ts_tablet_manager.cc:1403] T d5c696708616494588c1322fabef87f2 P e7c0341504c3426280338a5599607a0d: Time spent bootstrapping tablet: real 0.056s	user 0.010s	sys 0.005s
I20260709 13:10:22.617864 27312 raft_consensus.cc:359] T d5c696708616494588c1322fabef87f2 P e7c0341504c3426280338a5599607a0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:22.619329 27255 tablet_service.cc:1511] Processing CreateTablet for tablet c7b039889b334a5c90fee88adac9c25e (DEFAULT_TABLE table=test-workload [id=b68c3587d73e439290d31a157d930f88]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:10:22.620955 27255 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7b039889b334a5c90fee88adac9c25e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:22.622685 27312 raft_consensus.cc:385] T d5c696708616494588c1322fabef87f2 P e7c0341504c3426280338a5599607a0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:22.623162 27312 raft_consensus.cc:740] T d5c696708616494588c1322fabef87f2 P e7c0341504c3426280338a5599607a0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7c0341504c3426280338a5599607a0d, State: Initialized, Role: FOLLOWER
I20260709 13:10:22.626773 27312 consensus_queue.cc:260] T d5c696708616494588c1322fabef87f2 P e7c0341504c3426280338a5599607a0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:22.629200 27146 heartbeater.cc:499] Master 127.14.180.126:39253 was elected leader, sending a full tablet report...
I20260709 13:10:22.633230 27310 raft_consensus.cc:359] T ba62c4ccdf604a349be40020c44728e9 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:22.634133 27310 raft_consensus.cc:385] T ba62c4ccdf604a349be40020c44728e9 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:22.634423 27310 raft_consensus.cc:740] T ba62c4ccdf604a349be40020c44728e9 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f0541c7472e4aef9aac8ad7d02e8e48, State: Initialized, Role: FOLLOWER
I20260709 13:10:22.635460 27310 consensus_queue.cc:260] T ba62c4ccdf604a349be40020c44728e9 P 9f0541c7472e4aef9aac8ad7d02e8e48 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:22.636647 27311 tablet_bootstrap.cc:492] T ba62c4ccdf604a349be40020c44728e9 P dd2dd298b4404607b3f3a14b89cbbee4: No bootstrap required, opened a new log
I20260709 13:10:22.637506 27311 ts_tablet_manager.cc:1403] T ba62c4ccdf604a349be40020c44728e9 P dd2dd298b4404607b3f3a14b89cbbee4: Time spent bootstrapping tablet: real 0.078s	user 0.009s	sys 0.006s
I20260709 13:10:22.640360 27312 ts_tablet_manager.cc:1434] T d5c696708616494588c1322fabef87f2 P e7c0341504c3426280338a5599607a0d: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.001s
I20260709 13:10:22.641782 27312 tablet_bootstrap.cc:492] T 2131193060f9477e9750e3f42ef79986 P e7c0341504c3426280338a5599607a0d: Bootstrap starting.
I20260709 13:10:22.642597 27311 raft_consensus.cc:359] T ba62c4ccdf604a349be40020c44728e9 P dd2dd298b4404607b3f3a14b89cbbee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:22.643751 27311 raft_consensus.cc:385] T ba62c4ccdf604a349be40020c44728e9 P dd2dd298b4404607b3f3a14b89cbbee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:22.644119 27311 raft_consensus.cc:740] T ba62c4ccdf604a349be40020c44728e9 P dd2dd298b4404607b3f3a14b89cbbee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd2dd298b4404607b3f3a14b89cbbee4, State: Initialized, Role: FOLLOWER
I20260709 13:10:22.645529 27310 ts_tablet_manager.cc:1434] T ba62c4ccdf604a349be40020c44728e9 P 9f0541c7472e4aef9aac8ad7d02e8e48: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.006s
I20260709 13:10:22.645165 27311 consensus_queue.cc:260] T ba62c4ccdf604a349be40020c44728e9 P dd2dd298b4404607b3f3a14b89cbbee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:22.646435 27221 heartbeater.cc:499] Master 127.14.180.126:39253 was elected leader, sending a full tablet report...
I20260709 13:10:22.655510 27310 tablet_bootstrap.cc:492] T 3a5eb0bf903c4627add0ee35d02a4853 P 9f0541c7472e4aef9aac8ad7d02e8e48: Bootstrap starting.
I20260709 13:10:22.660032 27312 tablet_bootstrap.cc:654] T 2131193060f9477e9750e3f42ef79986 P e7c0341504c3426280338a5599607a0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:22.662887 27310 tablet_bootstrap.cc:654] T 3a5eb0bf903c4627add0ee35d02a4853 P 9f0541c7472e4aef9aac8ad7d02e8e48: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:22.667948 27295 heartbeater.cc:499] Master 127.14.180.126:39253 was elected leader, sending a full tablet report...
I20260709 13:10:22.668365 27311 ts_tablet_manager.cc:1434] T ba62c4ccdf604a349be40020c44728e9 P dd2dd298b4404607b3f3a14b89cbbee4: Time spent starting tablet: real 0.030s	user 0.013s	sys 0.015s
I20260709 13:10:22.669872 27311 tablet_bootstrap.cc:492] T 3a5eb0bf903c4627add0ee35d02a4853 P dd2dd298b4404607b3f3a14b89cbbee4: Bootstrap starting.
I20260709 13:10:22.677167 27311 tablet_bootstrap.cc:654] T 3a5eb0bf903c4627add0ee35d02a4853 P dd2dd298b4404607b3f3a14b89cbbee4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:22.689507 27311 tablet_bootstrap.cc:492] T 3a5eb0bf903c4627add0ee35d02a4853 P dd2dd298b4404607b3f3a14b89cbbee4: No bootstrap required, opened a new log
I20260709 13:10:22.690217 27311 ts_tablet_manager.cc:1403] T 3a5eb0bf903c4627add0ee35d02a4853 P dd2dd298b4404607b3f3a14b89cbbee4: Time spent bootstrapping tablet: real 0.021s	user 0.018s	sys 0.000s
I20260709 13:10:22.693531 27311 raft_consensus.cc:359] T 3a5eb0bf903c4627add0ee35d02a4853 P dd2dd298b4404607b3f3a14b89cbbee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } }
I20260709 13:10:22.694455 27311 raft_consensus.cc:385] T 3a5eb0bf903c4627add0ee35d02a4853 P dd2dd298b4404607b3f3a14b89cbbee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:22.694832 27311 raft_consensus.cc:740] T 3a5eb0bf903c4627add0ee35d02a4853 P dd2dd298b4404607b3f3a14b89cbbee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd2dd298b4404607b3f3a14b89cbbee4, State: Initialized, Role: FOLLOWER
I20260709 13:10:22.695745 27311 consensus_queue.cc:260] T 3a5eb0bf903c4627add0ee35d02a4853 P dd2dd298b4404607b3f3a14b89cbbee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } }
W20260709 13:10:22.697896 27147 tablet.cc:2406] T d5c696708616494588c1322fabef87f2 P e7c0341504c3426280338a5599607a0d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:10:22.698378 27311 ts_tablet_manager.cc:1434] T 3a5eb0bf903c4627add0ee35d02a4853 P dd2dd298b4404607b3f3a14b89cbbee4: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:10:22.701326 27311 tablet_bootstrap.cc:492] T d5c696708616494588c1322fabef87f2 P dd2dd298b4404607b3f3a14b89cbbee4: Bootstrap starting.
I20260709 13:10:22.706214 27312 tablet_bootstrap.cc:492] T 2131193060f9477e9750e3f42ef79986 P e7c0341504c3426280338a5599607a0d: No bootstrap required, opened a new log
I20260709 13:10:22.706625 27310 tablet_bootstrap.cc:492] T 3a5eb0bf903c4627add0ee35d02a4853 P 9f0541c7472e4aef9aac8ad7d02e8e48: No bootstrap required, opened a new log
I20260709 13:10:22.707010 27312 ts_tablet_manager.cc:1403] T 2131193060f9477e9750e3f42ef79986 P e7c0341504c3426280338a5599607a0d: Time spent bootstrapping tablet: real 0.065s	user 0.014s	sys 0.034s
I20260709 13:10:22.707185 27310 ts_tablet_manager.cc:1403] T 3a5eb0bf903c4627add0ee35d02a4853 P 9f0541c7472e4aef9aac8ad7d02e8e48: Time spent bootstrapping tablet: real 0.052s	user 0.015s	sys 0.027s
I20260709 13:10:22.708776 27311 tablet_bootstrap.cc:654] T d5c696708616494588c1322fabef87f2 P dd2dd298b4404607b3f3a14b89cbbee4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:22.710649 27312 raft_consensus.cc:359] T 2131193060f9477e9750e3f42ef79986 P e7c0341504c3426280338a5599607a0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:22.710911 27310 raft_consensus.cc:359] T 3a5eb0bf903c4627add0ee35d02a4853 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } }
I20260709 13:10:22.711623 27312 raft_consensus.cc:385] T 2131193060f9477e9750e3f42ef79986 P e7c0341504c3426280338a5599607a0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:22.711714 27310 raft_consensus.cc:385] T 3a5eb0bf903c4627add0ee35d02a4853 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:22.712044 27312 raft_consensus.cc:740] T 2131193060f9477e9750e3f42ef79986 P e7c0341504c3426280338a5599607a0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7c0341504c3426280338a5599607a0d, State: Initialized, Role: FOLLOWER
I20260709 13:10:22.712965 27310 raft_consensus.cc:740] T 3a5eb0bf903c4627add0ee35d02a4853 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f0541c7472e4aef9aac8ad7d02e8e48, State: Initialized, Role: FOLLOWER
I20260709 13:10:22.713382 27312 consensus_queue.cc:260] T 2131193060f9477e9750e3f42ef79986 P e7c0341504c3426280338a5599607a0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:22.714133 27310 consensus_queue.cc:260] T 3a5eb0bf903c4627add0ee35d02a4853 P 9f0541c7472e4aef9aac8ad7d02e8e48 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } }
I20260709 13:10:22.716008 27312 ts_tablet_manager.cc:1434] T 2131193060f9477e9750e3f42ef79986 P e7c0341504c3426280338a5599607a0d: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 13:10:22.717424 27312 tablet_bootstrap.cc:492] T 3a5eb0bf903c4627add0ee35d02a4853 P e7c0341504c3426280338a5599607a0d: Bootstrap starting.
I20260709 13:10:22.722054 27311 tablet_bootstrap.cc:492] T d5c696708616494588c1322fabef87f2 P dd2dd298b4404607b3f3a14b89cbbee4: No bootstrap required, opened a new log
I20260709 13:10:22.718837 27310 ts_tablet_manager.cc:1434] T 3a5eb0bf903c4627add0ee35d02a4853 P 9f0541c7472e4aef9aac8ad7d02e8e48: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:10:22.722749 27311 ts_tablet_manager.cc:1403] T d5c696708616494588c1322fabef87f2 P dd2dd298b4404607b3f3a14b89cbbee4: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.009s
I20260709 13:10:22.723804 27310 tablet_bootstrap.cc:492] T d5c696708616494588c1322fabef87f2 P 9f0541c7472e4aef9aac8ad7d02e8e48: Bootstrap starting.
I20260709 13:10:22.726272 27311 raft_consensus.cc:359] T d5c696708616494588c1322fabef87f2 P dd2dd298b4404607b3f3a14b89cbbee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:22.727134 27311 raft_consensus.cc:385] T d5c696708616494588c1322fabef87f2 P dd2dd298b4404607b3f3a14b89cbbee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:22.727438 27311 raft_consensus.cc:740] T d5c696708616494588c1322fabef87f2 P dd2dd298b4404607b3f3a14b89cbbee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd2dd298b4404607b3f3a14b89cbbee4, State: Initialized, Role: FOLLOWER
I20260709 13:10:22.728286 27311 consensus_queue.cc:260] T d5c696708616494588c1322fabef87f2 P dd2dd298b4404607b3f3a14b89cbbee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:22.729218 27312 tablet_bootstrap.cc:654] T 3a5eb0bf903c4627add0ee35d02a4853 P e7c0341504c3426280338a5599607a0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:22.731292 27310 tablet_bootstrap.cc:654] T d5c696708616494588c1322fabef87f2 P 9f0541c7472e4aef9aac8ad7d02e8e48: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:22.733668 27311 ts_tablet_manager.cc:1434] T d5c696708616494588c1322fabef87f2 P dd2dd298b4404607b3f3a14b89cbbee4: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 13:10:22.734927 27311 tablet_bootstrap.cc:492] T fd5b3b92057444cfb3f243b5fdf1ae66 P dd2dd298b4404607b3f3a14b89cbbee4: Bootstrap starting.
I20260709 13:10:22.743578 27312 tablet_bootstrap.cc:492] T 3a5eb0bf903c4627add0ee35d02a4853 P e7c0341504c3426280338a5599607a0d: No bootstrap required, opened a new log
I20260709 13:10:22.744179 27312 ts_tablet_manager.cc:1403] T 3a5eb0bf903c4627add0ee35d02a4853 P e7c0341504c3426280338a5599607a0d: Time spent bootstrapping tablet: real 0.027s	user 0.010s	sys 0.009s
I20260709 13:10:22.744829 27311 tablet_bootstrap.cc:654] T fd5b3b92057444cfb3f243b5fdf1ae66 P dd2dd298b4404607b3f3a14b89cbbee4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:22.746933 27312 raft_consensus.cc:359] T 3a5eb0bf903c4627add0ee35d02a4853 P e7c0341504c3426280338a5599607a0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } }
I20260709 13:10:22.747885 27312 raft_consensus.cc:385] T 3a5eb0bf903c4627add0ee35d02a4853 P e7c0341504c3426280338a5599607a0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:22.748219 27312 raft_consensus.cc:740] T 3a5eb0bf903c4627add0ee35d02a4853 P e7c0341504c3426280338a5599607a0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7c0341504c3426280338a5599607a0d, State: Initialized, Role: FOLLOWER
I20260709 13:10:22.749112 27312 consensus_queue.cc:260] T 3a5eb0bf903c4627add0ee35d02a4853 P e7c0341504c3426280338a5599607a0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } }
I20260709 13:10:22.751785 27312 ts_tablet_manager.cc:1434] T 3a5eb0bf903c4627add0ee35d02a4853 P e7c0341504c3426280338a5599607a0d: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:10:22.752319 27310 tablet_bootstrap.cc:492] T d5c696708616494588c1322fabef87f2 P 9f0541c7472e4aef9aac8ad7d02e8e48: No bootstrap required, opened a new log
I20260709 13:10:22.752734 27312 tablet_bootstrap.cc:492] T c0a2c588c6f148ef9976d15d1a79ba74 P e7c0341504c3426280338a5599607a0d: Bootstrap starting.
I20260709 13:10:22.753007 27310 ts_tablet_manager.cc:1403] T d5c696708616494588c1322fabef87f2 P 9f0541c7472e4aef9aac8ad7d02e8e48: Time spent bootstrapping tablet: real 0.029s	user 0.010s	sys 0.007s
I20260709 13:10:22.757036 27310 raft_consensus.cc:359] T d5c696708616494588c1322fabef87f2 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:22.758149 27310 raft_consensus.cc:385] T d5c696708616494588c1322fabef87f2 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:22.758582 27310 raft_consensus.cc:740] T d5c696708616494588c1322fabef87f2 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f0541c7472e4aef9aac8ad7d02e8e48, State: Initialized, Role: FOLLOWER
I20260709 13:10:22.759672 27312 tablet_bootstrap.cc:654] T c0a2c588c6f148ef9976d15d1a79ba74 P e7c0341504c3426280338a5599607a0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:22.759443 27310 consensus_queue.cc:260] T d5c696708616494588c1322fabef87f2 P 9f0541c7472e4aef9aac8ad7d02e8e48 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:22.761425 27311 tablet_bootstrap.cc:492] T fd5b3b92057444cfb3f243b5fdf1ae66 P dd2dd298b4404607b3f3a14b89cbbee4: No bootstrap required, opened a new log
I20260709 13:10:22.762007 27311 ts_tablet_manager.cc:1403] T fd5b3b92057444cfb3f243b5fdf1ae66 P dd2dd298b4404607b3f3a14b89cbbee4: Time spent bootstrapping tablet: real 0.027s	user 0.012s	sys 0.005s
I20260709 13:10:22.765303 27311 raft_consensus.cc:359] T fd5b3b92057444cfb3f243b5fdf1ae66 P dd2dd298b4404607b3f3a14b89cbbee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:22.766321 27311 raft_consensus.cc:385] T fd5b3b92057444cfb3f243b5fdf1ae66 P dd2dd298b4404607b3f3a14b89cbbee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:22.766687 27311 raft_consensus.cc:740] T fd5b3b92057444cfb3f243b5fdf1ae66 P dd2dd298b4404607b3f3a14b89cbbee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd2dd298b4404607b3f3a14b89cbbee4, State: Initialized, Role: FOLLOWER
W20260709 13:10:22.767769 27067 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:22.767642 27311 consensus_queue.cc:260] T fd5b3b92057444cfb3f243b5fdf1ae66 P dd2dd298b4404607b3f3a14b89cbbee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:22.770052 27311 ts_tablet_manager.cc:1434] T fd5b3b92057444cfb3f243b5fdf1ae66 P dd2dd298b4404607b3f3a14b89cbbee4: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 13:10:22.770975 27310 ts_tablet_manager.cc:1434] T d5c696708616494588c1322fabef87f2 P 9f0541c7472e4aef9aac8ad7d02e8e48: Time spent starting tablet: real 0.018s	user 0.010s	sys 0.001s
I20260709 13:10:22.772568 27311 tablet_bootstrap.cc:492] T 2131193060f9477e9750e3f42ef79986 P dd2dd298b4404607b3f3a14b89cbbee4: Bootstrap starting.
I20260709 13:10:22.773772 27312 tablet_bootstrap.cc:492] T c0a2c588c6f148ef9976d15d1a79ba74 P e7c0341504c3426280338a5599607a0d: No bootstrap required, opened a new log
I20260709 13:10:22.774326 27312 ts_tablet_manager.cc:1403] T c0a2c588c6f148ef9976d15d1a79ba74 P e7c0341504c3426280338a5599607a0d: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.009s
I20260709 13:10:22.776002 27310 tablet_bootstrap.cc:492] T 2131193060f9477e9750e3f42ef79986 P 9f0541c7472e4aef9aac8ad7d02e8e48: Bootstrap starting.
I20260709 13:10:22.777494 27312 raft_consensus.cc:359] T c0a2c588c6f148ef9976d15d1a79ba74 P e7c0341504c3426280338a5599607a0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:22.778290 27312 raft_consensus.cc:385] T c0a2c588c6f148ef9976d15d1a79ba74 P e7c0341504c3426280338a5599607a0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:22.778623 27312 raft_consensus.cc:740] T c0a2c588c6f148ef9976d15d1a79ba74 P e7c0341504c3426280338a5599607a0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7c0341504c3426280338a5599607a0d, State: Initialized, Role: FOLLOWER
I20260709 13:10:22.779452 27312 consensus_queue.cc:260] T c0a2c588c6f148ef9976d15d1a79ba74 P e7c0341504c3426280338a5599607a0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:22.780467 27311 tablet_bootstrap.cc:654] T 2131193060f9477e9750e3f42ef79986 P dd2dd298b4404607b3f3a14b89cbbee4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:22.781948 27312 ts_tablet_manager.cc:1434] T c0a2c588c6f148ef9976d15d1a79ba74 P e7c0341504c3426280338a5599607a0d: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:10:22.783146 27312 tablet_bootstrap.cc:492] T ba62c4ccdf604a349be40020c44728e9 P e7c0341504c3426280338a5599607a0d: Bootstrap starting.
I20260709 13:10:22.784834 27310 tablet_bootstrap.cc:654] T 2131193060f9477e9750e3f42ef79986 P 9f0541c7472e4aef9aac8ad7d02e8e48: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:22.791096 27312 tablet_bootstrap.cc:654] T ba62c4ccdf604a349be40020c44728e9 P e7c0341504c3426280338a5599607a0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:22.801584 27310 tablet_bootstrap.cc:492] T 2131193060f9477e9750e3f42ef79986 P 9f0541c7472e4aef9aac8ad7d02e8e48: No bootstrap required, opened a new log
I20260709 13:10:22.802155 27310 ts_tablet_manager.cc:1403] T 2131193060f9477e9750e3f42ef79986 P 9f0541c7472e4aef9aac8ad7d02e8e48: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.008s
I20260709 13:10:22.804244 27311 tablet_bootstrap.cc:492] T 2131193060f9477e9750e3f42ef79986 P dd2dd298b4404607b3f3a14b89cbbee4: No bootstrap required, opened a new log
I20260709 13:10:22.804565 27312 tablet_bootstrap.cc:492] T ba62c4ccdf604a349be40020c44728e9 P e7c0341504c3426280338a5599607a0d: No bootstrap required, opened a new log
I20260709 13:10:22.804731 27311 ts_tablet_manager.cc:1403] T 2131193060f9477e9750e3f42ef79986 P dd2dd298b4404607b3f3a14b89cbbee4: Time spent bootstrapping tablet: real 0.032s	user 0.017s	sys 0.009s
I20260709 13:10:22.805253 27312 ts_tablet_manager.cc:1403] T ba62c4ccdf604a349be40020c44728e9 P e7c0341504c3426280338a5599607a0d: Time spent bootstrapping tablet: real 0.022s	user 0.006s	sys 0.014s
I20260709 13:10:22.805457 27310 raft_consensus.cc:359] T 2131193060f9477e9750e3f42ef79986 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:22.806346 27310 raft_consensus.cc:385] T 2131193060f9477e9750e3f42ef79986 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:22.806730 27310 raft_consensus.cc:740] T 2131193060f9477e9750e3f42ef79986 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f0541c7472e4aef9aac8ad7d02e8e48, State: Initialized, Role: FOLLOWER
I20260709 13:10:22.807773 27311 raft_consensus.cc:359] T 2131193060f9477e9750e3f42ef79986 P dd2dd298b4404607b3f3a14b89cbbee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:22.807655 27310 consensus_queue.cc:260] T 2131193060f9477e9750e3f42ef79986 P 9f0541c7472e4aef9aac8ad7d02e8e48 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:22.808460 27311 raft_consensus.cc:385] T 2131193060f9477e9750e3f42ef79986 P dd2dd298b4404607b3f3a14b89cbbee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:22.808955 27311 raft_consensus.cc:740] T 2131193060f9477e9750e3f42ef79986 P dd2dd298b4404607b3f3a14b89cbbee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd2dd298b4404607b3f3a14b89cbbee4, State: Initialized, Role: FOLLOWER
I20260709 13:10:22.808533 27312 raft_consensus.cc:359] T ba62c4ccdf604a349be40020c44728e9 P e7c0341504c3426280338a5599607a0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:22.809655 27312 raft_consensus.cc:385] T ba62c4ccdf604a349be40020c44728e9 P e7c0341504c3426280338a5599607a0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:22.809964 27312 raft_consensus.cc:740] T ba62c4ccdf604a349be40020c44728e9 P e7c0341504c3426280338a5599607a0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7c0341504c3426280338a5599607a0d, State: Initialized, Role: FOLLOWER
I20260709 13:10:22.810273 27310 ts_tablet_manager.cc:1434] T 2131193060f9477e9750e3f42ef79986 P 9f0541c7472e4aef9aac8ad7d02e8e48: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:10:22.809978 27311 consensus_queue.cc:260] T 2131193060f9477e9750e3f42ef79986 P dd2dd298b4404607b3f3a14b89cbbee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:22.811102 27316 raft_consensus.cc:493] T 3a5eb0bf903c4627add0ee35d02a4853 P e7c0341504c3426280338a5599607a0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:22.810895 27312 consensus_queue.cc:260] T ba62c4ccdf604a349be40020c44728e9 P e7c0341504c3426280338a5599607a0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:22.811455 27310 tablet_bootstrap.cc:492] T c0a2c588c6f148ef9976d15d1a79ba74 P 9f0541c7472e4aef9aac8ad7d02e8e48: Bootstrap starting.
I20260709 13:10:22.811640 27316 raft_consensus.cc:515] T 3a5eb0bf903c4627add0ee35d02a4853 P e7c0341504c3426280338a5599607a0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } }
I20260709 13:10:22.813165 27311 ts_tablet_manager.cc:1434] T 2131193060f9477e9750e3f42ef79986 P dd2dd298b4404607b3f3a14b89cbbee4: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:10:22.814340 27311 tablet_bootstrap.cc:492] T 25b85b28aed94a088553d3df84dfc6dc P dd2dd298b4404607b3f3a14b89cbbee4: Bootstrap starting.
I20260709 13:10:22.820137 27310 tablet_bootstrap.cc:654] T c0a2c588c6f148ef9976d15d1a79ba74 P 9f0541c7472e4aef9aac8ad7d02e8e48: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:22.821652 27311 tablet_bootstrap.cc:654] T 25b85b28aed94a088553d3df84dfc6dc P dd2dd298b4404607b3f3a14b89cbbee4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:22.825516 27312 ts_tablet_manager.cc:1434] T ba62c4ccdf604a349be40020c44728e9 P e7c0341504c3426280338a5599607a0d: Time spent starting tablet: real 0.020s	user 0.003s	sys 0.003s
I20260709 13:10:22.827128 27312 tablet_bootstrap.cc:492] T 25b85b28aed94a088553d3df84dfc6dc P e7c0341504c3426280338a5599607a0d: Bootstrap starting.
I20260709 13:10:22.826998 27310 tablet_bootstrap.cc:492] T c0a2c588c6f148ef9976d15d1a79ba74 P 9f0541c7472e4aef9aac8ad7d02e8e48: No bootstrap required, opened a new log
I20260709 13:10:22.827983 27310 ts_tablet_manager.cc:1403] T c0a2c588c6f148ef9976d15d1a79ba74 P 9f0541c7472e4aef9aac8ad7d02e8e48: Time spent bootstrapping tablet: real 0.017s	user 0.008s	sys 0.007s
I20260709 13:10:22.830329 27316 leader_election.cc:290] T 3a5eb0bf903c4627add0ee35d02a4853 P e7c0341504c3426280338a5599607a0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dd2dd298b4404607b3f3a14b89cbbee4 (127.14.180.67:40131), 9f0541c7472e4aef9aac8ad7d02e8e48 (127.14.180.66:41411)
I20260709 13:10:22.838013 27310 raft_consensus.cc:359] T c0a2c588c6f148ef9976d15d1a79ba74 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:22.840021 27310 raft_consensus.cc:385] T c0a2c588c6f148ef9976d15d1a79ba74 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:22.840487 27310 raft_consensus.cc:740] T c0a2c588c6f148ef9976d15d1a79ba74 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f0541c7472e4aef9aac8ad7d02e8e48, State: Initialized, Role: FOLLOWER
I20260709 13:10:22.841974 27312 tablet_bootstrap.cc:654] T 25b85b28aed94a088553d3df84dfc6dc P e7c0341504c3426280338a5599607a0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:22.843739 27310 consensus_queue.cc:260] T c0a2c588c6f148ef9976d15d1a79ba74 P 9f0541c7472e4aef9aac8ad7d02e8e48 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:22.848969 27310 ts_tablet_manager.cc:1434] T c0a2c588c6f148ef9976d15d1a79ba74 P 9f0541c7472e4aef9aac8ad7d02e8e48: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.000s
I20260709 13:10:22.856382 27310 tablet_bootstrap.cc:492] T 25b85b28aed94a088553d3df84dfc6dc P 9f0541c7472e4aef9aac8ad7d02e8e48: Bootstrap starting.
I20260709 13:10:22.861898 27312 tablet_bootstrap.cc:492] T 25b85b28aed94a088553d3df84dfc6dc P e7c0341504c3426280338a5599607a0d: No bootstrap required, opened a new log
I20260709 13:10:22.861892 27311 tablet_bootstrap.cc:492] T 25b85b28aed94a088553d3df84dfc6dc P dd2dd298b4404607b3f3a14b89cbbee4: No bootstrap required, opened a new log
I20260709 13:10:22.863121 27311 ts_tablet_manager.cc:1403] T 25b85b28aed94a088553d3df84dfc6dc P dd2dd298b4404607b3f3a14b89cbbee4: Time spent bootstrapping tablet: real 0.049s	user 0.012s	sys 0.010s
I20260709 13:10:22.864723 27310 tablet_bootstrap.cc:654] T 25b85b28aed94a088553d3df84dfc6dc P 9f0541c7472e4aef9aac8ad7d02e8e48: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:22.869489 27312 ts_tablet_manager.cc:1403] T 25b85b28aed94a088553d3df84dfc6dc P e7c0341504c3426280338a5599607a0d: Time spent bootstrapping tablet: real 0.043s	user 0.008s	sys 0.014s
I20260709 13:10:22.871428 27316 raft_consensus.cc:493] T d5c696708616494588c1322fabef87f2 P e7c0341504c3426280338a5599607a0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:22.872052 27316 raft_consensus.cc:515] T d5c696708616494588c1322fabef87f2 P e7c0341504c3426280338a5599607a0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:22.874601 27316 leader_election.cc:290] T d5c696708616494588c1322fabef87f2 P e7c0341504c3426280338a5599607a0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9f0541c7472e4aef9aac8ad7d02e8e48 (127.14.180.66:41411), dd2dd298b4404607b3f3a14b89cbbee4 (127.14.180.67:40131)
I20260709 13:10:22.874441 27312 raft_consensus.cc:359] T 25b85b28aed94a088553d3df84dfc6dc P e7c0341504c3426280338a5599607a0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:22.875461 27312 raft_consensus.cc:385] T 25b85b28aed94a088553d3df84dfc6dc P e7c0341504c3426280338a5599607a0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:22.866533 27311 raft_consensus.cc:359] T 25b85b28aed94a088553d3df84dfc6dc P dd2dd298b4404607b3f3a14b89cbbee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:22.876618 27311 raft_consensus.cc:385] T 25b85b28aed94a088553d3df84dfc6dc P dd2dd298b4404607b3f3a14b89cbbee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:22.876879 27310 tablet_bootstrap.cc:492] T 25b85b28aed94a088553d3df84dfc6dc P 9f0541c7472e4aef9aac8ad7d02e8e48: No bootstrap required, opened a new log
I20260709 13:10:22.876953 27311 raft_consensus.cc:740] T 25b85b28aed94a088553d3df84dfc6dc P dd2dd298b4404607b3f3a14b89cbbee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd2dd298b4404607b3f3a14b89cbbee4, State: Initialized, Role: FOLLOWER
I20260709 13:10:22.876822 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5eb0bf903c4627add0ee35d02a4853" candidate_uuid: "e7c0341504c3426280338a5599607a0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" is_pre_election: true
I20260709 13:10:22.877830 27310 ts_tablet_manager.cc:1403] T 25b85b28aed94a088553d3df84dfc6dc P 9f0541c7472e4aef9aac8ad7d02e8e48: Time spent bootstrapping tablet: real 0.022s	user 0.006s	sys 0.013s
I20260709 13:10:22.877961 27270 raft_consensus.cc:2468] T 3a5eb0bf903c4627add0ee35d02a4853 P dd2dd298b4404607b3f3a14b89cbbee4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e7c0341504c3426280338a5599607a0d in term 0.
I20260709 13:10:22.878228 27311 consensus_queue.cc:260] T 25b85b28aed94a088553d3df84dfc6dc P dd2dd298b4404607b3f3a14b89cbbee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:22.880378 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c696708616494588c1322fabef87f2" candidate_uuid: "e7c0341504c3426280338a5599607a0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" is_pre_election: true
I20260709 13:10:22.880904 27311 ts_tablet_manager.cc:1434] T 25b85b28aed94a088553d3df84dfc6dc P dd2dd298b4404607b3f3a14b89cbbee4: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:10:22.881049 27270 raft_consensus.cc:2468] T d5c696708616494588c1322fabef87f2 P dd2dd298b4404607b3f3a14b89cbbee4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e7c0341504c3426280338a5599607a0d in term 0.
I20260709 13:10:22.881146 27310 raft_consensus.cc:359] T 25b85b28aed94a088553d3df84dfc6dc P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:22.882040 27310 raft_consensus.cc:385] T 25b85b28aed94a088553d3df84dfc6dc P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:22.882088 27311 tablet_bootstrap.cc:492] T c0a2c588c6f148ef9976d15d1a79ba74 P dd2dd298b4404607b3f3a14b89cbbee4: Bootstrap starting.
I20260709 13:10:22.877082 27312 raft_consensus.cc:740] T 25b85b28aed94a088553d3df84dfc6dc P e7c0341504c3426280338a5599607a0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7c0341504c3426280338a5599607a0d, State: Initialized, Role: FOLLOWER
I20260709 13:10:22.882412 27317 raft_consensus.cc:493] T 2131193060f9477e9750e3f42ef79986 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:22.883119 27317 raft_consensus.cc:515] T 2131193060f9477e9750e3f42ef79986 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:22.883488 27087 leader_election.cc:304] T 3a5eb0bf903c4627add0ee35d02a4853 P e7c0341504c3426280338a5599607a0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dd2dd298b4404607b3f3a14b89cbbee4, e7c0341504c3426280338a5599607a0d; no voters: 
I20260709 13:10:22.882443 27310 raft_consensus.cc:740] T 25b85b28aed94a088553d3df84dfc6dc P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f0541c7472e4aef9aac8ad7d02e8e48, State: Initialized, Role: FOLLOWER
I20260709 13:10:22.885167 27310 consensus_queue.cc:260] T 25b85b28aed94a088553d3df84dfc6dc P 9f0541c7472e4aef9aac8ad7d02e8e48 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:22.886308 27196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5eb0bf903c4627add0ee35d02a4853" candidate_uuid: "e7c0341504c3426280338a5599607a0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" is_pre_election: true
I20260709 13:10:22.887171 27196 raft_consensus.cc:2468] T 3a5eb0bf903c4627add0ee35d02a4853 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e7c0341504c3426280338a5599607a0d in term 0.
I20260709 13:10:22.888592 27195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c696708616494588c1322fabef87f2" candidate_uuid: "e7c0341504c3426280338a5599607a0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" is_pre_election: true
I20260709 13:10:22.889587 27195 raft_consensus.cc:2468] T d5c696708616494588c1322fabef87f2 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e7c0341504c3426280338a5599607a0d in term 0.
I20260709 13:10:22.892022 27317 leader_election.cc:290] T 2131193060f9477e9750e3f42ef79986 P 9f0541c7472e4aef9aac8ad7d02e8e48 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e7c0341504c3426280338a5599607a0d (127.14.180.65:41105), dd2dd298b4404607b3f3a14b89cbbee4 (127.14.180.67:40131)
I20260709 13:10:22.897251 27311 tablet_bootstrap.cc:654] T c0a2c588c6f148ef9976d15d1a79ba74 P dd2dd298b4404607b3f3a14b89cbbee4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:22.899667 27316 raft_consensus.cc:2804] T 3a5eb0bf903c4627add0ee35d02a4853 P e7c0341504c3426280338a5599607a0d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:22.900315 27316 raft_consensus.cc:493] T 3a5eb0bf903c4627add0ee35d02a4853 P e7c0341504c3426280338a5599607a0d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:22.900882 27316 raft_consensus.cc:3060] T 3a5eb0bf903c4627add0ee35d02a4853 P e7c0341504c3426280338a5599607a0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:22.907238 27087 leader_election.cc:304] T d5c696708616494588c1322fabef87f2 P e7c0341504c3426280338a5599607a0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dd2dd298b4404607b3f3a14b89cbbee4, e7c0341504c3426280338a5599607a0d; no voters: 
I20260709 13:10:22.910097 27330 raft_consensus.cc:2804] T d5c696708616494588c1322fabef87f2 P e7c0341504c3426280338a5599607a0d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:22.910789 27330 raft_consensus.cc:493] T d5c696708616494588c1322fabef87f2 P e7c0341504c3426280338a5599607a0d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:22.911351 27330 raft_consensus.cc:3060] T d5c696708616494588c1322fabef87f2 P e7c0341504c3426280338a5599607a0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:22.915985 27312 consensus_queue.cc:260] T 25b85b28aed94a088553d3df84dfc6dc P e7c0341504c3426280338a5599607a0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:22.921288 27310 ts_tablet_manager.cc:1434] T 25b85b28aed94a088553d3df84dfc6dc P 9f0541c7472e4aef9aac8ad7d02e8e48: Time spent starting tablet: real 0.043s	user 0.010s	sys 0.029s
I20260709 13:10:22.924034 27310 tablet_bootstrap.cc:492] T fd5b3b92057444cfb3f243b5fdf1ae66 P 9f0541c7472e4aef9aac8ad7d02e8e48: Bootstrap starting.
I20260709 13:10:22.934751 27316 raft_consensus.cc:515] T 3a5eb0bf903c4627add0ee35d02a4853 P e7c0341504c3426280338a5599607a0d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } }
I20260709 13:10:22.937956 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5eb0bf903c4627add0ee35d02a4853" candidate_uuid: "e7c0341504c3426280338a5599607a0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd2dd298b4404607b3f3a14b89cbbee4"
I20260709 13:10:22.938671 27270 raft_consensus.cc:3060] T 3a5eb0bf903c4627add0ee35d02a4853 P dd2dd298b4404607b3f3a14b89cbbee4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:22.943413 27310 tablet_bootstrap.cc:654] T fd5b3b92057444cfb3f243b5fdf1ae66 P 9f0541c7472e4aef9aac8ad7d02e8e48: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:22.945573 27312 ts_tablet_manager.cc:1434] T 25b85b28aed94a088553d3df84dfc6dc P e7c0341504c3426280338a5599607a0d: Time spent starting tablet: real 0.075s	user 0.007s	sys 0.011s
I20260709 13:10:22.946848 27121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2131193060f9477e9750e3f42ef79986" candidate_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7c0341504c3426280338a5599607a0d" is_pre_election: true
I20260709 13:10:22.947125 27312 tablet_bootstrap.cc:492] T 025d8ae32c8a4cec8fe002fb1682eb12 P e7c0341504c3426280338a5599607a0d: Bootstrap starting.
I20260709 13:10:22.947655 27121 raft_consensus.cc:2468] T 2131193060f9477e9750e3f42ef79986 P e7c0341504c3426280338a5599607a0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f0541c7472e4aef9aac8ad7d02e8e48 in term 0.
I20260709 13:10:22.947911 27270 raft_consensus.cc:2468] T 3a5eb0bf903c4627add0ee35d02a4853 P dd2dd298b4404607b3f3a14b89cbbee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7c0341504c3426280338a5599607a0d in term 1.
I20260709 13:10:22.949321 27087 leader_election.cc:304] T 3a5eb0bf903c4627add0ee35d02a4853 P e7c0341504c3426280338a5599607a0d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dd2dd298b4404607b3f3a14b89cbbee4, e7c0341504c3426280338a5599607a0d; no voters: 
I20260709 13:10:22.949316 27161 leader_election.cc:304] T 2131193060f9477e9750e3f42ef79986 P 9f0541c7472e4aef9aac8ad7d02e8e48 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f0541c7472e4aef9aac8ad7d02e8e48, e7c0341504c3426280338a5599607a0d; no voters: 
I20260709 13:10:22.951334 27338 raft_consensus.cc:2804] T 2131193060f9477e9750e3f42ef79986 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:22.951763 27338 raft_consensus.cc:493] T 2131193060f9477e9750e3f42ef79986 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:22.952083 27338 raft_consensus.cc:3060] T 2131193060f9477e9750e3f42ef79986 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:22.954015 27330 raft_consensus.cc:515] T d5c696708616494588c1322fabef87f2 P e7c0341504c3426280338a5599607a0d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:22.962042 27312 tablet_bootstrap.cc:654] T 025d8ae32c8a4cec8fe002fb1682eb12 P e7c0341504c3426280338a5599607a0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:22.962335 27316 leader_election.cc:290] T 3a5eb0bf903c4627add0ee35d02a4853 P e7c0341504c3426280338a5599607a0d [CANDIDATE]: Term 1 election: Requested vote from peers dd2dd298b4404607b3f3a14b89cbbee4 (127.14.180.67:40131), 9f0541c7472e4aef9aac8ad7d02e8e48 (127.14.180.66:41411)
I20260709 13:10:22.963044 27316 raft_consensus.cc:2804] T 3a5eb0bf903c4627add0ee35d02a4853 P e7c0341504c3426280338a5599607a0d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:22.963171 27196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a5eb0bf903c4627add0ee35d02a4853" candidate_uuid: "e7c0341504c3426280338a5599607a0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48"
I20260709 13:10:22.963577 27316 raft_consensus.cc:697] T 3a5eb0bf903c4627add0ee35d02a4853 P e7c0341504c3426280338a5599607a0d [term 1 LEADER]: Becoming Leader. State: Replica: e7c0341504c3426280338a5599607a0d, State: Running, Role: LEADER
I20260709 13:10:22.963866 27196 raft_consensus.cc:3060] T 3a5eb0bf903c4627add0ee35d02a4853 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:22.964512 27316 consensus_queue.cc:237] T 3a5eb0bf903c4627add0ee35d02a4853 P e7c0341504c3426280338a5599607a0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } }
I20260709 13:10:22.966706 27330 leader_election.cc:290] T d5c696708616494588c1322fabef87f2 P e7c0341504c3426280338a5599607a0d [CANDIDATE]: Term 1 election: Requested vote from peers 9f0541c7472e4aef9aac8ad7d02e8e48 (127.14.180.66:41411), dd2dd298b4404607b3f3a14b89cbbee4 (127.14.180.67:40131)
I20260709 13:10:22.971520 27311 tablet_bootstrap.cc:492] T c0a2c588c6f148ef9976d15d1a79ba74 P dd2dd298b4404607b3f3a14b89cbbee4: No bootstrap required, opened a new log
I20260709 13:10:22.972024 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c696708616494588c1322fabef87f2" candidate_uuid: "e7c0341504c3426280338a5599607a0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd2dd298b4404607b3f3a14b89cbbee4"
I20260709 13:10:22.972489 27311 ts_tablet_manager.cc:1403] T c0a2c588c6f148ef9976d15d1a79ba74 P dd2dd298b4404607b3f3a14b89cbbee4: Time spent bootstrapping tablet: real 0.091s	user 0.016s	sys 0.028s
I20260709 13:10:22.972878 27270 raft_consensus.cc:3060] T d5c696708616494588c1322fabef87f2 P dd2dd298b4404607b3f3a14b89cbbee4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:22.975586 27312 tablet_bootstrap.cc:492] T 025d8ae32c8a4cec8fe002fb1682eb12 P e7c0341504c3426280338a5599607a0d: No bootstrap required, opened a new log
I20260709 13:10:22.976274 27312 ts_tablet_manager.cc:1403] T 025d8ae32c8a4cec8fe002fb1682eb12 P e7c0341504c3426280338a5599607a0d: Time spent bootstrapping tablet: real 0.029s	user 0.020s	sys 0.002s
I20260709 13:10:22.976454 27311 raft_consensus.cc:359] T c0a2c588c6f148ef9976d15d1a79ba74 P dd2dd298b4404607b3f3a14b89cbbee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:22.977375 27311 raft_consensus.cc:385] T c0a2c588c6f148ef9976d15d1a79ba74 P dd2dd298b4404607b3f3a14b89cbbee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:22.977757 27311 raft_consensus.cc:740] T c0a2c588c6f148ef9976d15d1a79ba74 P dd2dd298b4404607b3f3a14b89cbbee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd2dd298b4404607b3f3a14b89cbbee4, State: Initialized, Role: FOLLOWER
I20260709 13:10:22.962143 27195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c696708616494588c1322fabef87f2" candidate_uuid: "e7c0341504c3426280338a5599607a0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48"
I20260709 13:10:22.979146 27310 tablet_bootstrap.cc:492] T fd5b3b92057444cfb3f243b5fdf1ae66 P 9f0541c7472e4aef9aac8ad7d02e8e48: No bootstrap required, opened a new log
I20260709 13:10:22.979259 27195 raft_consensus.cc:3060] T d5c696708616494588c1322fabef87f2 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:22.978808 27311 consensus_queue.cc:260] T c0a2c588c6f148ef9976d15d1a79ba74 P dd2dd298b4404607b3f3a14b89cbbee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:22.979880 27310 ts_tablet_manager.cc:1403] T fd5b3b92057444cfb3f243b5fdf1ae66 P 9f0541c7472e4aef9aac8ad7d02e8e48: Time spent bootstrapping tablet: real 0.056s	user 0.021s	sys 0.000s
I20260709 13:10:22.983250 27310 raft_consensus.cc:359] T fd5b3b92057444cfb3f243b5fdf1ae66 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:22.984004 27310 raft_consensus.cc:385] T fd5b3b92057444cfb3f243b5fdf1ae66 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:22.984360 27310 raft_consensus.cc:740] T fd5b3b92057444cfb3f243b5fdf1ae66 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f0541c7472e4aef9aac8ad7d02e8e48, State: Initialized, Role: FOLLOWER
I20260709 13:10:22.984081 27016 catalog_manager.cc:5697] T 3a5eb0bf903c4627add0ee35d02a4853 P e7c0341504c3426280338a5599607a0d reported cstate change: term changed from 0 to 1, leader changed from <none> to e7c0341504c3426280338a5599607a0d (127.14.180.65). New cstate: current_term: 1 leader_uuid: "e7c0341504c3426280338a5599607a0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:22.985188 27310 consensus_queue.cc:260] T fd5b3b92057444cfb3f243b5fdf1ae66 P 9f0541c7472e4aef9aac8ad7d02e8e48 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:22.988025 27312 raft_consensus.cc:359] T 025d8ae32c8a4cec8fe002fb1682eb12 P e7c0341504c3426280338a5599607a0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:22.988914 27312 raft_consensus.cc:385] T 025d8ae32c8a4cec8fe002fb1682eb12 P e7c0341504c3426280338a5599607a0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:22.989279 27312 raft_consensus.cc:740] T 025d8ae32c8a4cec8fe002fb1682eb12 P e7c0341504c3426280338a5599607a0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7c0341504c3426280338a5599607a0d, State: Initialized, Role: FOLLOWER
I20260709 13:10:22.990309 27310 ts_tablet_manager.cc:1434] T fd5b3b92057444cfb3f243b5fdf1ae66 P 9f0541c7472e4aef9aac8ad7d02e8e48: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.004s
I20260709 13:10:22.990207 27312 consensus_queue.cc:260] T 025d8ae32c8a4cec8fe002fb1682eb12 P e7c0341504c3426280338a5599607a0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:22.991603 27310 tablet_bootstrap.cc:492] T c7b039889b334a5c90fee88adac9c25e P 9f0541c7472e4aef9aac8ad7d02e8e48: Bootstrap starting.
I20260709 13:10:22.993175 27312 ts_tablet_manager.cc:1434] T 025d8ae32c8a4cec8fe002fb1682eb12 P e7c0341504c3426280338a5599607a0d: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:10:22.994385 27312 tablet_bootstrap.cc:492] T fd5b3b92057444cfb3f243b5fdf1ae66 P e7c0341504c3426280338a5599607a0d: Bootstrap starting.
I20260709 13:10:22.996667 27196 raft_consensus.cc:2468] T 3a5eb0bf903c4627add0ee35d02a4853 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7c0341504c3426280338a5599607a0d in term 1.
I20260709 13:10:22.999145 27310 tablet_bootstrap.cc:654] T c7b039889b334a5c90fee88adac9c25e P 9f0541c7472e4aef9aac8ad7d02e8e48: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:23.000705 27195 raft_consensus.cc:2468] T d5c696708616494588c1322fabef87f2 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7c0341504c3426280338a5599607a0d in term 1.
I20260709 13:10:23.002121 27312 tablet_bootstrap.cc:654] T fd5b3b92057444cfb3f243b5fdf1ae66 P e7c0341504c3426280338a5599607a0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:23.002365 27085 leader_election.cc:304] T d5c696708616494588c1322fabef87f2 P e7c0341504c3426280338a5599607a0d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f0541c7472e4aef9aac8ad7d02e8e48, e7c0341504c3426280338a5599607a0d; no voters: 
I20260709 13:10:23.003688 27316 raft_consensus.cc:2804] T d5c696708616494588c1322fabef87f2 P e7c0341504c3426280338a5599607a0d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:23.004225 27316 raft_consensus.cc:697] T d5c696708616494588c1322fabef87f2 P e7c0341504c3426280338a5599607a0d [term 1 LEADER]: Becoming Leader. State: Replica: e7c0341504c3426280338a5599607a0d, State: Running, Role: LEADER
I20260709 13:10:23.005136 27316 consensus_queue.cc:237] T d5c696708616494588c1322fabef87f2 P e7c0341504c3426280338a5599607a0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:23.006982 27311 ts_tablet_manager.cc:1434] T c0a2c588c6f148ef9976d15d1a79ba74 P dd2dd298b4404607b3f3a14b89cbbee4: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.001s
I20260709 13:10:23.011010 27269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2131193060f9477e9750e3f42ef79986" candidate_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" is_pre_election: true
I20260709 13:10:23.012081 27269 raft_consensus.cc:2468] T 2131193060f9477e9750e3f42ef79986 P dd2dd298b4404607b3f3a14b89cbbee4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f0541c7472e4aef9aac8ad7d02e8e48 in term 0.
I20260709 13:10:22.994140 27270 raft_consensus.cc:2468] T d5c696708616494588c1322fabef87f2 P dd2dd298b4404607b3f3a14b89cbbee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7c0341504c3426280338a5599607a0d in term 1.
I20260709 13:10:22.960520 27338 raft_consensus.cc:515] T 2131193060f9477e9750e3f42ef79986 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:23.019745 27311 tablet_bootstrap.cc:492] T 025d8ae32c8a4cec8fe002fb1682eb12 P dd2dd298b4404607b3f3a14b89cbbee4: Bootstrap starting.
I20260709 13:10:23.020960 27121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2131193060f9477e9750e3f42ef79986" candidate_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7c0341504c3426280338a5599607a0d"
I20260709 13:10:23.023315 27121 raft_consensus.cc:3060] T 2131193060f9477e9750e3f42ef79986 P e7c0341504c3426280338a5599607a0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:23.024588 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2131193060f9477e9750e3f42ef79986" candidate_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd2dd298b4404607b3f3a14b89cbbee4"
I20260709 13:10:23.025549 27270 raft_consensus.cc:3060] T 2131193060f9477e9750e3f42ef79986 P dd2dd298b4404607b3f3a14b89cbbee4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:23.026149 27312 tablet_bootstrap.cc:492] T fd5b3b92057444cfb3f243b5fdf1ae66 P e7c0341504c3426280338a5599607a0d: No bootstrap required, opened a new log
I20260709 13:10:23.021911 27317 raft_consensus.cc:493] T c0a2c588c6f148ef9976d15d1a79ba74 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:23.026742 27312 ts_tablet_manager.cc:1403] T fd5b3b92057444cfb3f243b5fdf1ae66 P e7c0341504c3426280338a5599607a0d: Time spent bootstrapping tablet: real 0.033s	user 0.015s	sys 0.001s
I20260709 13:10:23.026794 27317 raft_consensus.cc:515] T c0a2c588c6f148ef9976d15d1a79ba74 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:23.029317 27317 leader_election.cc:290] T c0a2c588c6f148ef9976d15d1a79ba74 P 9f0541c7472e4aef9aac8ad7d02e8e48 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e7c0341504c3426280338a5599607a0d (127.14.180.65:41105), dd2dd298b4404607b3f3a14b89cbbee4 (127.14.180.67:40131)
I20260709 13:10:23.029804 27312 raft_consensus.cc:359] T fd5b3b92057444cfb3f243b5fdf1ae66 P e7c0341504c3426280338a5599607a0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:23.030591 27312 raft_consensus.cc:385] T fd5b3b92057444cfb3f243b5fdf1ae66 P e7c0341504c3426280338a5599607a0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:23.030889 27312 raft_consensus.cc:740] T fd5b3b92057444cfb3f243b5fdf1ae66 P e7c0341504c3426280338a5599607a0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7c0341504c3426280338a5599607a0d, State: Initialized, Role: FOLLOWER
I20260709 13:10:23.031773 27120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a2c588c6f148ef9976d15d1a79ba74" candidate_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7c0341504c3426280338a5599607a0d" is_pre_election: true
I20260709 13:10:23.032193 27312 consensus_queue.cc:260] T fd5b3b92057444cfb3f243b5fdf1ae66 P e7c0341504c3426280338a5599607a0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:23.032847 27120 raft_consensus.cc:2468] T c0a2c588c6f148ef9976d15d1a79ba74 P e7c0341504c3426280338a5599607a0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f0541c7472e4aef9aac8ad7d02e8e48 in term 0.
I20260709 13:10:23.034813 27312 ts_tablet_manager.cc:1434] T fd5b3b92057444cfb3f243b5fdf1ae66 P e7c0341504c3426280338a5599607a0d: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:10:23.035053 27269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a2c588c6f148ef9976d15d1a79ba74" candidate_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" is_pre_election: true
I20260709 13:10:23.035966 27312 tablet_bootstrap.cc:492] T c7b039889b334a5c90fee88adac9c25e P e7c0341504c3426280338a5599607a0d: Bootstrap starting.
I20260709 13:10:23.036088 27269 raft_consensus.cc:2468] T c0a2c588c6f148ef9976d15d1a79ba74 P dd2dd298b4404607b3f3a14b89cbbee4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f0541c7472e4aef9aac8ad7d02e8e48 in term 0.
I20260709 13:10:23.037075 27121 raft_consensus.cc:2468] T 2131193060f9477e9750e3f42ef79986 P e7c0341504c3426280338a5599607a0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f0541c7472e4aef9aac8ad7d02e8e48 in term 1.
I20260709 13:10:23.038270 27161 leader_election.cc:304] T c0a2c588c6f148ef9976d15d1a79ba74 P 9f0541c7472e4aef9aac8ad7d02e8e48 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f0541c7472e4aef9aac8ad7d02e8e48, e7c0341504c3426280338a5599607a0d; no voters: 
I20260709 13:10:23.041756 27161 leader_election.cc:304] T 2131193060f9477e9750e3f42ef79986 P 9f0541c7472e4aef9aac8ad7d02e8e48 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f0541c7472e4aef9aac8ad7d02e8e48, e7c0341504c3426280338a5599607a0d; no voters: 
I20260709 13:10:23.043167 27312 tablet_bootstrap.cc:654] T c7b039889b334a5c90fee88adac9c25e P e7c0341504c3426280338a5599607a0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:23.043360 27317 raft_consensus.cc:2804] T c0a2c588c6f148ef9976d15d1a79ba74 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:23.043857 27317 raft_consensus.cc:493] T c0a2c588c6f148ef9976d15d1a79ba74 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:23.044204 27317 raft_consensus.cc:3060] T c0a2c588c6f148ef9976d15d1a79ba74 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:23.055150 27338 leader_election.cc:290] T 2131193060f9477e9750e3f42ef79986 P 9f0541c7472e4aef9aac8ad7d02e8e48 [CANDIDATE]: Term 1 election: Requested vote from peers e7c0341504c3426280338a5599607a0d (127.14.180.65:41105), dd2dd298b4404607b3f3a14b89cbbee4 (127.14.180.67:40131)
I20260709 13:10:23.056258 27338 raft_consensus.cc:2804] T 2131193060f9477e9750e3f42ef79986 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:23.056890 27338 raft_consensus.cc:697] T 2131193060f9477e9750e3f42ef79986 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 1 LEADER]: Becoming Leader. State: Replica: 9f0541c7472e4aef9aac8ad7d02e8e48, State: Running, Role: LEADER
I20260709 13:10:23.061980 27310 tablet_bootstrap.cc:492] T c7b039889b334a5c90fee88adac9c25e P 9f0541c7472e4aef9aac8ad7d02e8e48: No bootstrap required, opened a new log
I20260709 13:10:23.062984 27310 ts_tablet_manager.cc:1403] T c7b039889b334a5c90fee88adac9c25e P 9f0541c7472e4aef9aac8ad7d02e8e48: Time spent bootstrapping tablet: real 0.072s	user 0.031s	sys 0.036s
I20260709 13:10:23.066838 27316 raft_consensus.cc:493] T 25b85b28aed94a088553d3df84dfc6dc P e7c0341504c3426280338a5599607a0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:23.066644 27310 raft_consensus.cc:359] T c7b039889b334a5c90fee88adac9c25e P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:23.067507 27310 raft_consensus.cc:385] T c7b039889b334a5c90fee88adac9c25e P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:23.068043 27310 raft_consensus.cc:740] T c7b039889b334a5c90fee88adac9c25e P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f0541c7472e4aef9aac8ad7d02e8e48, State: Initialized, Role: FOLLOWER
I20260709 13:10:23.067495 27316 raft_consensus.cc:515] T 25b85b28aed94a088553d3df84dfc6dc P e7c0341504c3426280338a5599607a0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:23.069130 27310 consensus_queue.cc:260] T c7b039889b334a5c90fee88adac9c25e P 9f0541c7472e4aef9aac8ad7d02e8e48 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:23.072083 27311 tablet_bootstrap.cc:654] T 025d8ae32c8a4cec8fe002fb1682eb12 P dd2dd298b4404607b3f3a14b89cbbee4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:23.074378 27343 raft_consensus.cc:493] T 025d8ae32c8a4cec8fe002fb1682eb12 P e7c0341504c3426280338a5599607a0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:23.058063 27338 consensus_queue.cc:237] T 2131193060f9477e9750e3f42ef79986 P 9f0541c7472e4aef9aac8ad7d02e8e48 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:23.076277 27343 raft_consensus.cc:515] T 025d8ae32c8a4cec8fe002fb1682eb12 P e7c0341504c3426280338a5599607a0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:23.077414 27317 raft_consensus.cc:515] T c0a2c588c6f148ef9976d15d1a79ba74 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:23.079460 27343 leader_election.cc:290] T 025d8ae32c8a4cec8fe002fb1682eb12 P e7c0341504c3426280338a5599607a0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9f0541c7472e4aef9aac8ad7d02e8e48 (127.14.180.66:41411), dd2dd298b4404607b3f3a14b89cbbee4 (127.14.180.67:40131)
I20260709 13:10:23.072151 27316 leader_election.cc:290] T 25b85b28aed94a088553d3df84dfc6dc P e7c0341504c3426280338a5599607a0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9f0541c7472e4aef9aac8ad7d02e8e48 (127.14.180.66:41411), dd2dd298b4404607b3f3a14b89cbbee4 (127.14.180.67:40131)
I20260709 13:10:23.082406 27269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25b85b28aed94a088553d3df84dfc6dc" candidate_uuid: "e7c0341504c3426280338a5599607a0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" is_pre_election: true
I20260709 13:10:23.087364 27310 ts_tablet_manager.cc:1434] T c7b039889b334a5c90fee88adac9c25e P 9f0541c7472e4aef9aac8ad7d02e8e48: Time spent starting tablet: real 0.024s	user 0.011s	sys 0.009s
I20260709 13:10:23.083837 27195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25b85b28aed94a088553d3df84dfc6dc" candidate_uuid: "e7c0341504c3426280338a5599607a0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" is_pre_election: true
I20260709 13:10:23.081944 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "025d8ae32c8a4cec8fe002fb1682eb12" candidate_uuid: "e7c0341504c3426280338a5599607a0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" is_pre_election: true
I20260709 13:10:23.088080 27269 raft_consensus.cc:2468] T 25b85b28aed94a088553d3df84dfc6dc P dd2dd298b4404607b3f3a14b89cbbee4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e7c0341504c3426280338a5599607a0d in term 0.
I20260709 13:10:23.088284 27195 raft_consensus.cc:2468] T 25b85b28aed94a088553d3df84dfc6dc P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e7c0341504c3426280338a5599607a0d in term 0.
I20260709 13:10:23.087121 27196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "025d8ae32c8a4cec8fe002fb1682eb12" candidate_uuid: "e7c0341504c3426280338a5599607a0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" is_pre_election: true
W20260709 13:10:23.090286 27087 leader_election.cc:343] T 025d8ae32c8a4cec8fe002fb1682eb12 P e7c0341504c3426280338a5599607a0d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dd2dd298b4404607b3f3a14b89cbbee4 (127.14.180.67:40131): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:23.091568 27087 leader_election.cc:304] T 25b85b28aed94a088553d3df84dfc6dc P e7c0341504c3426280338a5599607a0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dd2dd298b4404607b3f3a14b89cbbee4, e7c0341504c3426280338a5599607a0d; no voters: 
I20260709 13:10:23.092953 27316 raft_consensus.cc:2804] T 25b85b28aed94a088553d3df84dfc6dc P e7c0341504c3426280338a5599607a0d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:23.093573 27316 raft_consensus.cc:493] T 25b85b28aed94a088553d3df84dfc6dc P e7c0341504c3426280338a5599607a0d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:23.094115 27316 raft_consensus.cc:3060] T 25b85b28aed94a088553d3df84dfc6dc P e7c0341504c3426280338a5599607a0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:23.094156 27352 raft_consensus.cc:493] T ba62c4ccdf604a349be40020c44728e9 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:23.095000 27352 raft_consensus.cc:515] T ba62c4ccdf604a349be40020c44728e9 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:23.082762 27270 raft_consensus.cc:2468] T 2131193060f9477e9750e3f42ef79986 P dd2dd298b4404607b3f3a14b89cbbee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f0541c7472e4aef9aac8ad7d02e8e48 in term 1.
I20260709 13:10:23.098610 27312 tablet_bootstrap.cc:492] T c7b039889b334a5c90fee88adac9c25e P e7c0341504c3426280338a5599607a0d: No bootstrap required, opened a new log
I20260709 13:10:23.099012 27121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba62c4ccdf604a349be40020c44728e9" candidate_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7c0341504c3426280338a5599607a0d" is_pre_election: true
I20260709 13:10:23.100910 27121 raft_consensus.cc:2468] T ba62c4ccdf604a349be40020c44728e9 P e7c0341504c3426280338a5599607a0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f0541c7472e4aef9aac8ad7d02e8e48 in term 0.
I20260709 13:10:23.099236 27312 ts_tablet_manager.cc:1403] T c7b039889b334a5c90fee88adac9c25e P e7c0341504c3426280338a5599607a0d: Time spent bootstrapping tablet: real 0.063s	user 0.016s	sys 0.025s
I20260709 13:10:23.103617 27161 leader_election.cc:304] T ba62c4ccdf604a349be40020c44728e9 P 9f0541c7472e4aef9aac8ad7d02e8e48 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f0541c7472e4aef9aac8ad7d02e8e48, e7c0341504c3426280338a5599607a0d; no voters: 
I20260709 13:10:23.103937 27317 leader_election.cc:290] T c0a2c588c6f148ef9976d15d1a79ba74 P 9f0541c7472e4aef9aac8ad7d02e8e48 [CANDIDATE]: Term 1 election: Requested vote from peers e7c0341504c3426280338a5599607a0d (127.14.180.65:41105), dd2dd298b4404607b3f3a14b89cbbee4 (127.14.180.67:40131)
I20260709 13:10:23.105862 27121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a2c588c6f148ef9976d15d1a79ba74" candidate_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7c0341504c3426280338a5599607a0d"
I20260709 13:10:23.106691 27121 raft_consensus.cc:3060] T c0a2c588c6f148ef9976d15d1a79ba74 P e7c0341504c3426280338a5599607a0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:23.106143 27317 raft_consensus.cc:2804] T ba62c4ccdf604a349be40020c44728e9 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:23.108108 27317 raft_consensus.cc:493] T ba62c4ccdf604a349be40020c44728e9 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:23.109333 27317 raft_consensus.cc:3060] T ba62c4ccdf604a349be40020c44728e9 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:23.104542 27312 raft_consensus.cc:359] T c7b039889b334a5c90fee88adac9c25e P e7c0341504c3426280338a5599607a0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:23.110692 27312 raft_consensus.cc:385] T c7b039889b334a5c90fee88adac9c25e P e7c0341504c3426280338a5599607a0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:23.111093 27312 raft_consensus.cc:740] T c7b039889b334a5c90fee88adac9c25e P e7c0341504c3426280338a5599607a0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7c0341504c3426280338a5599607a0d, State: Initialized, Role: FOLLOWER
I20260709 13:10:23.112056 27312 consensus_queue.cc:260] T c7b039889b334a5c90fee88adac9c25e P e7c0341504c3426280338a5599607a0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:23.113481 27310 tablet_bootstrap.cc:492] T 025d8ae32c8a4cec8fe002fb1682eb12 P 9f0541c7472e4aef9aac8ad7d02e8e48: Bootstrap starting.
I20260709 13:10:23.114848 27312 ts_tablet_manager.cc:1434] T c7b039889b334a5c90fee88adac9c25e P e7c0341504c3426280338a5599607a0d: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.001s
I20260709 13:10:23.114156 27016 catalog_manager.cc:5697] T d5c696708616494588c1322fabef87f2 P e7c0341504c3426280338a5599607a0d reported cstate change: term changed from 0 to 1, leader changed from <none> to e7c0341504c3426280338a5599607a0d (127.14.180.65). New cstate: current_term: 1 leader_uuid: "e7c0341504c3426280338a5599607a0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:23.120500 27318 raft_consensus.cc:493] T ba62c4ccdf604a349be40020c44728e9 P dd2dd298b4404607b3f3a14b89cbbee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:23.121177 27318 raft_consensus.cc:515] T ba62c4ccdf604a349be40020c44728e9 P dd2dd298b4404607b3f3a14b89cbbee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:23.122133 27352 leader_election.cc:290] T ba62c4ccdf604a349be40020c44728e9 P 9f0541c7472e4aef9aac8ad7d02e8e48 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e7c0341504c3426280338a5599607a0d (127.14.180.65:41105), dd2dd298b4404607b3f3a14b89cbbee4 (127.14.180.67:40131)
I20260709 13:10:23.124631 27311 tablet_bootstrap.cc:492] T 025d8ae32c8a4cec8fe002fb1682eb12 P dd2dd298b4404607b3f3a14b89cbbee4: No bootstrap required, opened a new log
I20260709 13:10:23.125698 27121 raft_consensus.cc:2468] T c0a2c588c6f148ef9976d15d1a79ba74 P e7c0341504c3426280338a5599607a0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f0541c7472e4aef9aac8ad7d02e8e48 in term 1.
I20260709 13:10:23.125334 27311 ts_tablet_manager.cc:1403] T 025d8ae32c8a4cec8fe002fb1682eb12 P dd2dd298b4404607b3f3a14b89cbbee4: Time spent bootstrapping tablet: real 0.106s	user 0.014s	sys 0.005s
I20260709 13:10:23.127215 27161 leader_election.cc:304] T c0a2c588c6f148ef9976d15d1a79ba74 P 9f0541c7472e4aef9aac8ad7d02e8e48 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f0541c7472e4aef9aac8ad7d02e8e48, e7c0341504c3426280338a5599607a0d; no voters: 
I20260709 13:10:23.128197 27352 raft_consensus.cc:2804] T c0a2c588c6f148ef9976d15d1a79ba74 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:23.128544 27318 leader_election.cc:290] T ba62c4ccdf604a349be40020c44728e9 P dd2dd298b4404607b3f3a14b89cbbee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e7c0341504c3426280338a5599607a0d (127.14.180.65:41105), 9f0541c7472e4aef9aac8ad7d02e8e48 (127.14.180.66:41411)
I20260709 13:10:23.128715 27352 raft_consensus.cc:697] T c0a2c588c6f148ef9976d15d1a79ba74 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 1 LEADER]: Becoming Leader. State: Replica: 9f0541c7472e4aef9aac8ad7d02e8e48, State: Running, Role: LEADER
I20260709 13:10:23.129842 27352 consensus_queue.cc:237] T c0a2c588c6f148ef9976d15d1a79ba74 P 9f0541c7472e4aef9aac8ad7d02e8e48 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:23.117297 27316 raft_consensus.cc:515] T 25b85b28aed94a088553d3df84dfc6dc P e7c0341504c3426280338a5599607a0d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
W20260709 13:10:23.135969 27085 leader_election.cc:343] T 025d8ae32c8a4cec8fe002fb1682eb12 P e7c0341504c3426280338a5599607a0d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9f0541c7472e4aef9aac8ad7d02e8e48 (127.14.180.66:41411): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:23.136240 27310 tablet_bootstrap.cc:654] T 025d8ae32c8a4cec8fe002fb1682eb12 P 9f0541c7472e4aef9aac8ad7d02e8e48: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:23.136487 27085 leader_election.cc:304] T 025d8ae32c8a4cec8fe002fb1682eb12 P e7c0341504c3426280338a5599607a0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e7c0341504c3426280338a5599607a0d; no voters: 9f0541c7472e4aef9aac8ad7d02e8e48, dd2dd298b4404607b3f3a14b89cbbee4
I20260709 13:10:23.137462 27311 raft_consensus.cc:359] T 025d8ae32c8a4cec8fe002fb1682eb12 P dd2dd298b4404607b3f3a14b89cbbee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:23.140215 27317 raft_consensus.cc:515] T ba62c4ccdf604a349be40020c44728e9 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:23.142627 27343 raft_consensus.cc:2749] T 025d8ae32c8a4cec8fe002fb1682eb12 P e7c0341504c3426280338a5599607a0d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:23.158874 27311 raft_consensus.cc:385] T 025d8ae32c8a4cec8fe002fb1682eb12 P dd2dd298b4404607b3f3a14b89cbbee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:23.144279 27316 leader_election.cc:290] T 25b85b28aed94a088553d3df84dfc6dc P e7c0341504c3426280338a5599607a0d [CANDIDATE]: Term 1 election: Requested vote from peers 9f0541c7472e4aef9aac8ad7d02e8e48 (127.14.180.66:41411), dd2dd298b4404607b3f3a14b89cbbee4 (127.14.180.67:40131)
I20260709 13:10:23.145099 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25b85b28aed94a088553d3df84dfc6dc" candidate_uuid: "e7c0341504c3426280338a5599607a0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd2dd298b4404607b3f3a14b89cbbee4"
I20260709 13:10:23.159286 27311 raft_consensus.cc:740] T 025d8ae32c8a4cec8fe002fb1682eb12 P dd2dd298b4404607b3f3a14b89cbbee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd2dd298b4404607b3f3a14b89cbbee4, State: Initialized, Role: FOLLOWER
I20260709 13:10:23.159997 27270 raft_consensus.cc:3060] T 25b85b28aed94a088553d3df84dfc6dc P dd2dd298b4404607b3f3a14b89cbbee4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:23.160297 27311 consensus_queue.cc:260] T 025d8ae32c8a4cec8fe002fb1682eb12 P dd2dd298b4404607b3f3a14b89cbbee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:23.147902 27196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25b85b28aed94a088553d3df84dfc6dc" candidate_uuid: "e7c0341504c3426280338a5599607a0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48"
I20260709 13:10:23.166605 27310 tablet_bootstrap.cc:492] T 025d8ae32c8a4cec8fe002fb1682eb12 P 9f0541c7472e4aef9aac8ad7d02e8e48: No bootstrap required, opened a new log
I20260709 13:10:23.166896 27196 raft_consensus.cc:3060] T 25b85b28aed94a088553d3df84dfc6dc P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:23.167183 27310 ts_tablet_manager.cc:1403] T 025d8ae32c8a4cec8fe002fb1682eb12 P 9f0541c7472e4aef9aac8ad7d02e8e48: Time spent bootstrapping tablet: real 0.070s	user 0.020s	sys 0.005s
I20260709 13:10:23.150362 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a2c588c6f148ef9976d15d1a79ba74" candidate_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd2dd298b4404607b3f3a14b89cbbee4"
I20260709 13:10:23.168008 27268 raft_consensus.cc:3060] T c0a2c588c6f148ef9976d15d1a79ba74 P dd2dd298b4404607b3f3a14b89cbbee4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:23.170367 27310 raft_consensus.cc:359] T 025d8ae32c8a4cec8fe002fb1682eb12 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:23.171408 27310 raft_consensus.cc:385] T 025d8ae32c8a4cec8fe002fb1682eb12 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:23.171697 27310 raft_consensus.cc:740] T 025d8ae32c8a4cec8fe002fb1682eb12 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f0541c7472e4aef9aac8ad7d02e8e48, State: Initialized, Role: FOLLOWER
I20260709 13:10:23.173044 27310 consensus_queue.cc:260] T 025d8ae32c8a4cec8fe002fb1682eb12 P 9f0541c7472e4aef9aac8ad7d02e8e48 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:23.151732 27269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba62c4ccdf604a349be40020c44728e9" candidate_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" is_pre_election: true
I20260709 13:10:23.153466 27016 catalog_manager.cc:5697] T 2131193060f9477e9750e3f42ef79986 P 9f0541c7472e4aef9aac8ad7d02e8e48 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9f0541c7472e4aef9aac8ad7d02e8e48 (127.14.180.66). New cstate: current_term: 1 leader_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:23.157717 27195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba62c4ccdf604a349be40020c44728e9" candidate_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" is_pre_election: true
I20260709 13:10:23.174979 27269 raft_consensus.cc:2468] T ba62c4ccdf604a349be40020c44728e9 P dd2dd298b4404607b3f3a14b89cbbee4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f0541c7472e4aef9aac8ad7d02e8e48 in term 0.
I20260709 13:10:23.175741 27310 ts_tablet_manager.cc:1434] T 025d8ae32c8a4cec8fe002fb1682eb12 P 9f0541c7472e4aef9aac8ad7d02e8e48: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:10:23.177786 27270 raft_consensus.cc:2468] T 25b85b28aed94a088553d3df84dfc6dc P dd2dd298b4404607b3f3a14b89cbbee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7c0341504c3426280338a5599607a0d in term 1.
I20260709 13:10:23.179435 27087 leader_election.cc:304] T 25b85b28aed94a088553d3df84dfc6dc P e7c0341504c3426280338a5599607a0d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dd2dd298b4404607b3f3a14b89cbbee4, e7c0341504c3426280338a5599607a0d; no voters: 
I20260709 13:10:23.179843 27268 raft_consensus.cc:2468] T c0a2c588c6f148ef9976d15d1a79ba74 P dd2dd298b4404607b3f3a14b89cbbee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f0541c7472e4aef9aac8ad7d02e8e48 in term 1.
I20260709 13:10:23.180532 27343 raft_consensus.cc:2804] T 25b85b28aed94a088553d3df84dfc6dc P e7c0341504c3426280338a5599607a0d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:23.180792 27121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba62c4ccdf604a349be40020c44728e9" candidate_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7c0341504c3426280338a5599607a0d" is_pre_election: true
I20260709 13:10:23.181058 27343 raft_consensus.cc:697] T 25b85b28aed94a088553d3df84dfc6dc P e7c0341504c3426280338a5599607a0d [term 1 LEADER]: Becoming Leader. State: Replica: e7c0341504c3426280338a5599607a0d, State: Running, Role: LEADER
I20260709 13:10:23.181581 27121 raft_consensus.cc:2468] T ba62c4ccdf604a349be40020c44728e9 P e7c0341504c3426280338a5599607a0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd2dd298b4404607b3f3a14b89cbbee4 in term 0.
I20260709 13:10:23.182071 27343 consensus_queue.cc:237] T 25b85b28aed94a088553d3df84dfc6dc P e7c0341504c3426280338a5599607a0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:23.182729 27235 leader_election.cc:304] T ba62c4ccdf604a349be40020c44728e9 P dd2dd298b4404607b3f3a14b89cbbee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dd2dd298b4404607b3f3a14b89cbbee4, e7c0341504c3426280338a5599607a0d; no voters: 
I20260709 13:10:23.183629 27318 raft_consensus.cc:2804] T ba62c4ccdf604a349be40020c44728e9 P dd2dd298b4404607b3f3a14b89cbbee4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:23.184067 27318 raft_consensus.cc:493] T ba62c4ccdf604a349be40020c44728e9 P dd2dd298b4404607b3f3a14b89cbbee4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:23.184423 27318 raft_consensus.cc:3060] T ba62c4ccdf604a349be40020c44728e9 P dd2dd298b4404607b3f3a14b89cbbee4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:23.183195 27311 ts_tablet_manager.cc:1434] T 025d8ae32c8a4cec8fe002fb1682eb12 P dd2dd298b4404607b3f3a14b89cbbee4: Time spent starting tablet: real 0.057s	user 0.006s	sys 0.001s
I20260709 13:10:23.196130 27317 leader_election.cc:290] T ba62c4ccdf604a349be40020c44728e9 P 9f0541c7472e4aef9aac8ad7d02e8e48 [CANDIDATE]: Term 1 election: Requested vote from peers e7c0341504c3426280338a5599607a0d (127.14.180.65:41105), dd2dd298b4404607b3f3a14b89cbbee4 (127.14.180.67:40131)
I20260709 13:10:23.196383 27311 tablet_bootstrap.cc:492] T c7b039889b334a5c90fee88adac9c25e P dd2dd298b4404607b3f3a14b89cbbee4: Bootstrap starting.
I20260709 13:10:23.197289 27017 catalog_manager.cc:5697] T c0a2c588c6f148ef9976d15d1a79ba74 P 9f0541c7472e4aef9aac8ad7d02e8e48 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9f0541c7472e4aef9aac8ad7d02e8e48 (127.14.180.66). New cstate: current_term: 1 leader_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:23.201961 27311 tablet_bootstrap.cc:654] T c7b039889b334a5c90fee88adac9c25e P dd2dd298b4404607b3f3a14b89cbbee4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:23.189071 27196 raft_consensus.cc:2468] T 25b85b28aed94a088553d3df84dfc6dc P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7c0341504c3426280338a5599607a0d in term 1.
I20260709 13:10:23.190227 27195 raft_consensus.cc:2393] T ba62c4ccdf604a349be40020c44728e9 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dd2dd298b4404607b3f3a14b89cbbee4 in current term 1: Already voted for candidate 9f0541c7472e4aef9aac8ad7d02e8e48 in this term.
I20260709 13:10:23.192848 27121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba62c4ccdf604a349be40020c44728e9" candidate_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7c0341504c3426280338a5599607a0d"
I20260709 13:10:23.193853 27318 raft_consensus.cc:515] T ba62c4ccdf604a349be40020c44728e9 P dd2dd298b4404607b3f3a14b89cbbee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:23.205549 27121 raft_consensus.cc:3060] T ba62c4ccdf604a349be40020c44728e9 P e7c0341504c3426280338a5599607a0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:23.207396 27016 catalog_manager.cc:5697] T 25b85b28aed94a088553d3df84dfc6dc P e7c0341504c3426280338a5599607a0d reported cstate change: term changed from 0 to 1, leader changed from <none> to e7c0341504c3426280338a5599607a0d (127.14.180.65). New cstate: current_term: 1 leader_uuid: "e7c0341504c3426280338a5599607a0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:23.208371 27120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba62c4ccdf604a349be40020c44728e9" candidate_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7c0341504c3426280338a5599607a0d"
I20260709 13:10:23.208509 27194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba62c4ccdf604a349be40020c44728e9" candidate_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48"
I20260709 13:10:23.194947 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba62c4ccdf604a349be40020c44728e9" candidate_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd2dd298b4404607b3f3a14b89cbbee4"
I20260709 13:10:23.210633 27318 leader_election.cc:290] T ba62c4ccdf604a349be40020c44728e9 P dd2dd298b4404607b3f3a14b89cbbee4 [CANDIDATE]: Term 1 election: Requested vote from peers e7c0341504c3426280338a5599607a0d (127.14.180.65:41105), 9f0541c7472e4aef9aac8ad7d02e8e48 (127.14.180.66:41411)
I20260709 13:10:23.210413 27235 leader_election.cc:304] T ba62c4ccdf604a349be40020c44728e9 P dd2dd298b4404607b3f3a14b89cbbee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd2dd298b4404607b3f3a14b89cbbee4; no voters: 9f0541c7472e4aef9aac8ad7d02e8e48, e7c0341504c3426280338a5599607a0d
I20260709 13:10:23.210440 27268 raft_consensus.cc:2393] T ba62c4ccdf604a349be40020c44728e9 P dd2dd298b4404607b3f3a14b89cbbee4 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9f0541c7472e4aef9aac8ad7d02e8e48 in current term 1: Already voted for candidate dd2dd298b4404607b3f3a14b89cbbee4 in this term.
I20260709 13:10:23.214346 27318 raft_consensus.cc:2749] T ba62c4ccdf604a349be40020c44728e9 P dd2dd298b4404607b3f3a14b89cbbee4 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:10:23.224098 27121 raft_consensus.cc:2468] T ba62c4ccdf604a349be40020c44728e9 P e7c0341504c3426280338a5599607a0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f0541c7472e4aef9aac8ad7d02e8e48 in term 1.
I20260709 13:10:23.225469 27161 leader_election.cc:304] T ba62c4ccdf604a349be40020c44728e9 P 9f0541c7472e4aef9aac8ad7d02e8e48 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9f0541c7472e4aef9aac8ad7d02e8e48, e7c0341504c3426280338a5599607a0d; no voters: dd2dd298b4404607b3f3a14b89cbbee4
I20260709 13:10:23.226377 27317 raft_consensus.cc:2804] T ba62c4ccdf604a349be40020c44728e9 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:23.226948 27317 raft_consensus.cc:697] T ba62c4ccdf604a349be40020c44728e9 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 1 LEADER]: Becoming Leader. State: Replica: 9f0541c7472e4aef9aac8ad7d02e8e48, State: Running, Role: LEADER
I20260709 13:10:23.228108 27317 consensus_queue.cc:237] T ba62c4ccdf604a349be40020c44728e9 P 9f0541c7472e4aef9aac8ad7d02e8e48 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:23.229178 27318 raft_consensus.cc:493] T fd5b3b92057444cfb3f243b5fdf1ae66 P dd2dd298b4404607b3f3a14b89cbbee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:23.230094 27318 raft_consensus.cc:515] T fd5b3b92057444cfb3f243b5fdf1ae66 P dd2dd298b4404607b3f3a14b89cbbee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:23.233925 27121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5b3b92057444cfb3f243b5fdf1ae66" candidate_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7c0341504c3426280338a5599607a0d" is_pre_election: true
I20260709 13:10:23.233917 27195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5b3b92057444cfb3f243b5fdf1ae66" candidate_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" is_pre_election: true
I20260709 13:10:23.234660 27318 leader_election.cc:290] T fd5b3b92057444cfb3f243b5fdf1ae66 P dd2dd298b4404607b3f3a14b89cbbee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e7c0341504c3426280338a5599607a0d (127.14.180.65:41105), 9f0541c7472e4aef9aac8ad7d02e8e48 (127.14.180.66:41411)
I20260709 13:10:23.234834 27195 raft_consensus.cc:2468] T fd5b3b92057444cfb3f243b5fdf1ae66 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd2dd298b4404607b3f3a14b89cbbee4 in term 0.
I20260709 13:10:23.236444 27234 leader_election.cc:304] T fd5b3b92057444cfb3f243b5fdf1ae66 P dd2dd298b4404607b3f3a14b89cbbee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f0541c7472e4aef9aac8ad7d02e8e48, dd2dd298b4404607b3f3a14b89cbbee4; no voters: 
I20260709 13:10:23.237210 27318 raft_consensus.cc:2804] T fd5b3b92057444cfb3f243b5fdf1ae66 P dd2dd298b4404607b3f3a14b89cbbee4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:23.237383 27121 raft_consensus.cc:2468] T fd5b3b92057444cfb3f243b5fdf1ae66 P e7c0341504c3426280338a5599607a0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd2dd298b4404607b3f3a14b89cbbee4 in term 0.
I20260709 13:10:23.237797 27311 tablet_bootstrap.cc:492] T c7b039889b334a5c90fee88adac9c25e P dd2dd298b4404607b3f3a14b89cbbee4: No bootstrap required, opened a new log
I20260709 13:10:23.237701 27318 raft_consensus.cc:493] T fd5b3b92057444cfb3f243b5fdf1ae66 P dd2dd298b4404607b3f3a14b89cbbee4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:23.238430 27311 ts_tablet_manager.cc:1403] T c7b039889b334a5c90fee88adac9c25e P dd2dd298b4404607b3f3a14b89cbbee4: Time spent bootstrapping tablet: real 0.042s	user 0.009s	sys 0.008s
I20260709 13:10:23.238473 27318 raft_consensus.cc:3060] T fd5b3b92057444cfb3f243b5fdf1ae66 P dd2dd298b4404607b3f3a14b89cbbee4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:23.241429 27311 raft_consensus.cc:359] T c7b039889b334a5c90fee88adac9c25e P dd2dd298b4404607b3f3a14b89cbbee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:23.242156 27311 raft_consensus.cc:385] T c7b039889b334a5c90fee88adac9c25e P dd2dd298b4404607b3f3a14b89cbbee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:23.242468 27311 raft_consensus.cc:740] T c7b039889b334a5c90fee88adac9c25e P dd2dd298b4404607b3f3a14b89cbbee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd2dd298b4404607b3f3a14b89cbbee4, State: Initialized, Role: FOLLOWER
I20260709 13:10:23.241839 27016 catalog_manager.cc:5697] T ba62c4ccdf604a349be40020c44728e9 P 9f0541c7472e4aef9aac8ad7d02e8e48 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9f0541c7472e4aef9aac8ad7d02e8e48 (127.14.180.66). New cstate: current_term: 1 leader_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:23.243682 27311 consensus_queue.cc:260] T c7b039889b334a5c90fee88adac9c25e P dd2dd298b4404607b3f3a14b89cbbee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:23.245816 27311 ts_tablet_manager.cc:1434] T c7b039889b334a5c90fee88adac9c25e P dd2dd298b4404607b3f3a14b89cbbee4: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:10:23.247238 27318 raft_consensus.cc:515] T fd5b3b92057444cfb3f243b5fdf1ae66 P dd2dd298b4404607b3f3a14b89cbbee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:23.250646 27195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5b3b92057444cfb3f243b5fdf1ae66" candidate_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48"
I20260709 13:10:23.250784 27318 leader_election.cc:290] T fd5b3b92057444cfb3f243b5fdf1ae66 P dd2dd298b4404607b3f3a14b89cbbee4 [CANDIDATE]: Term 1 election: Requested vote from peers e7c0341504c3426280338a5599607a0d (127.14.180.65:41105), 9f0541c7472e4aef9aac8ad7d02e8e48 (127.14.180.66:41411)
I20260709 13:10:23.251323 27195 raft_consensus.cc:3060] T fd5b3b92057444cfb3f243b5fdf1ae66 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:23.252694 27121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5b3b92057444cfb3f243b5fdf1ae66" candidate_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7c0341504c3426280338a5599607a0d"
I20260709 13:10:23.253373 27121 raft_consensus.cc:3060] T fd5b3b92057444cfb3f243b5fdf1ae66 P e7c0341504c3426280338a5599607a0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:23.259896 27195 raft_consensus.cc:2468] T fd5b3b92057444cfb3f243b5fdf1ae66 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd2dd298b4404607b3f3a14b89cbbee4 in term 1.
I20260709 13:10:23.261142 27121 raft_consensus.cc:2468] T fd5b3b92057444cfb3f243b5fdf1ae66 P e7c0341504c3426280338a5599607a0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd2dd298b4404607b3f3a14b89cbbee4 in term 1.
I20260709 13:10:23.261171 27234 leader_election.cc:304] T fd5b3b92057444cfb3f243b5fdf1ae66 P dd2dd298b4404607b3f3a14b89cbbee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f0541c7472e4aef9aac8ad7d02e8e48, dd2dd298b4404607b3f3a14b89cbbee4; no voters: 
I20260709 13:10:23.262248 27318 raft_consensus.cc:2804] T fd5b3b92057444cfb3f243b5fdf1ae66 P dd2dd298b4404607b3f3a14b89cbbee4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:23.262925 27318 raft_consensus.cc:697] T fd5b3b92057444cfb3f243b5fdf1ae66 P dd2dd298b4404607b3f3a14b89cbbee4 [term 1 LEADER]: Becoming Leader. State: Replica: dd2dd298b4404607b3f3a14b89cbbee4, State: Running, Role: LEADER
I20260709 13:10:23.263675 27318 consensus_queue.cc:237] T fd5b3b92057444cfb3f243b5fdf1ae66 P dd2dd298b4404607b3f3a14b89cbbee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:23.272240 27016 catalog_manager.cc:5697] T fd5b3b92057444cfb3f243b5fdf1ae66 P dd2dd298b4404607b3f3a14b89cbbee4 reported cstate change: term changed from 0 to 1, leader changed from <none> to dd2dd298b4404607b3f3a14b89cbbee4 (127.14.180.67). New cstate: current_term: 1 leader_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:23.331689 27318 raft_consensus.cc:493] T 025d8ae32c8a4cec8fe002fb1682eb12 P dd2dd298b4404607b3f3a14b89cbbee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:23.332307 27318 raft_consensus.cc:515] T 025d8ae32c8a4cec8fe002fb1682eb12 P dd2dd298b4404607b3f3a14b89cbbee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:23.334309 27318 leader_election.cc:290] T 025d8ae32c8a4cec8fe002fb1682eb12 P dd2dd298b4404607b3f3a14b89cbbee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e7c0341504c3426280338a5599607a0d (127.14.180.65:41105), 9f0541c7472e4aef9aac8ad7d02e8e48 (127.14.180.66:41411)
I20260709 13:10:23.335294 27121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "025d8ae32c8a4cec8fe002fb1682eb12" candidate_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7c0341504c3426280338a5599607a0d" is_pre_election: true
I20260709 13:10:23.335482 27195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "025d8ae32c8a4cec8fe002fb1682eb12" candidate_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" is_pre_election: true
I20260709 13:10:23.335958 27121 raft_consensus.cc:2468] T 025d8ae32c8a4cec8fe002fb1682eb12 P e7c0341504c3426280338a5599607a0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd2dd298b4404607b3f3a14b89cbbee4 in term 0.
I20260709 13:10:23.336261 27195 raft_consensus.cc:2468] T 025d8ae32c8a4cec8fe002fb1682eb12 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd2dd298b4404607b3f3a14b89cbbee4 in term 0.
I20260709 13:10:23.337195 27235 leader_election.cc:304] T 025d8ae32c8a4cec8fe002fb1682eb12 P dd2dd298b4404607b3f3a14b89cbbee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dd2dd298b4404607b3f3a14b89cbbee4, e7c0341504c3426280338a5599607a0d; no voters: 
I20260709 13:10:23.338025 27318 raft_consensus.cc:2804] T 025d8ae32c8a4cec8fe002fb1682eb12 P dd2dd298b4404607b3f3a14b89cbbee4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:23.338605 27318 raft_consensus.cc:493] T 025d8ae32c8a4cec8fe002fb1682eb12 P dd2dd298b4404607b3f3a14b89cbbee4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:23.338913 27318 raft_consensus.cc:3060] T 025d8ae32c8a4cec8fe002fb1682eb12 P dd2dd298b4404607b3f3a14b89cbbee4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:23.344866 27318 raft_consensus.cc:515] T 025d8ae32c8a4cec8fe002fb1682eb12 P dd2dd298b4404607b3f3a14b89cbbee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:23.347385 27318 leader_election.cc:290] T 025d8ae32c8a4cec8fe002fb1682eb12 P dd2dd298b4404607b3f3a14b89cbbee4 [CANDIDATE]: Term 1 election: Requested vote from peers e7c0341504c3426280338a5599607a0d (127.14.180.65:41105), 9f0541c7472e4aef9aac8ad7d02e8e48 (127.14.180.66:41411)
I20260709 13:10:23.348238 27121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "025d8ae32c8a4cec8fe002fb1682eb12" candidate_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7c0341504c3426280338a5599607a0d"
I20260709 13:10:23.348429 27195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "025d8ae32c8a4cec8fe002fb1682eb12" candidate_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48"
I20260709 13:10:23.349031 27121 raft_consensus.cc:3060] T 025d8ae32c8a4cec8fe002fb1682eb12 P e7c0341504c3426280338a5599607a0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:23.349100 27195 raft_consensus.cc:3060] T 025d8ae32c8a4cec8fe002fb1682eb12 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:23.356546 27121 raft_consensus.cc:2468] T 025d8ae32c8a4cec8fe002fb1682eb12 P e7c0341504c3426280338a5599607a0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd2dd298b4404607b3f3a14b89cbbee4 in term 1.
I20260709 13:10:23.356546 27195 raft_consensus.cc:2468] T 025d8ae32c8a4cec8fe002fb1682eb12 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd2dd298b4404607b3f3a14b89cbbee4 in term 1.
I20260709 13:10:23.358048 27235 leader_election.cc:304] T 025d8ae32c8a4cec8fe002fb1682eb12 P dd2dd298b4404607b3f3a14b89cbbee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dd2dd298b4404607b3f3a14b89cbbee4, e7c0341504c3426280338a5599607a0d; no voters: 
I20260709 13:10:23.358851 27318 raft_consensus.cc:2804] T 025d8ae32c8a4cec8fe002fb1682eb12 P dd2dd298b4404607b3f3a14b89cbbee4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:23.359320 27318 raft_consensus.cc:697] T 025d8ae32c8a4cec8fe002fb1682eb12 P dd2dd298b4404607b3f3a14b89cbbee4 [term 1 LEADER]: Becoming Leader. State: Replica: dd2dd298b4404607b3f3a14b89cbbee4, State: Running, Role: LEADER
I20260709 13:10:23.360168 27318 consensus_queue.cc:237] T 025d8ae32c8a4cec8fe002fb1682eb12 P dd2dd298b4404607b3f3a14b89cbbee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:23.368145 27016 catalog_manager.cc:5697] T 025d8ae32c8a4cec8fe002fb1682eb12 P dd2dd298b4404607b3f3a14b89cbbee4 reported cstate change: term changed from 0 to 1, leader changed from <none> to dd2dd298b4404607b3f3a14b89cbbee4 (127.14.180.67). New cstate: current_term: 1 leader_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:23.398360 27343 consensus_queue.cc:1048] T 3a5eb0bf903c4627add0ee35d02a4853 P e7c0341504c3426280338a5599607a0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:23.412276 27316 consensus_queue.cc:1048] T 3a5eb0bf903c4627add0ee35d02a4853 P e7c0341504c3426280338a5599607a0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:23.414209 27317 raft_consensus.cc:493] T c7b039889b334a5c90fee88adac9c25e P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:23.414883 27317 raft_consensus.cc:515] T c7b039889b334a5c90fee88adac9c25e P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:23.417142 27317 leader_election.cc:290] T c7b039889b334a5c90fee88adac9c25e P 9f0541c7472e4aef9aac8ad7d02e8e48 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e7c0341504c3426280338a5599607a0d (127.14.180.65:41105), dd2dd298b4404607b3f3a14b89cbbee4 (127.14.180.67:40131)
I20260709 13:10:23.418885 27121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7b039889b334a5c90fee88adac9c25e" candidate_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7c0341504c3426280338a5599607a0d" is_pre_election: true
I20260709 13:10:23.419404 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7b039889b334a5c90fee88adac9c25e" candidate_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" is_pre_election: true
I20260709 13:10:23.419754 27121 raft_consensus.cc:2468] T c7b039889b334a5c90fee88adac9c25e P e7c0341504c3426280338a5599607a0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f0541c7472e4aef9aac8ad7d02e8e48 in term 0.
I20260709 13:10:23.421113 27161 leader_election.cc:304] T c7b039889b334a5c90fee88adac9c25e P 9f0541c7472e4aef9aac8ad7d02e8e48 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f0541c7472e4aef9aac8ad7d02e8e48, e7c0341504c3426280338a5599607a0d; no voters: 
I20260709 13:10:23.421649 27268 raft_consensus.cc:2468] T c7b039889b334a5c90fee88adac9c25e P dd2dd298b4404607b3f3a14b89cbbee4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f0541c7472e4aef9aac8ad7d02e8e48 in term 0.
I20260709 13:10:23.421885 27317 raft_consensus.cc:2804] T c7b039889b334a5c90fee88adac9c25e P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:23.422509 27317 raft_consensus.cc:493] T c7b039889b334a5c90fee88adac9c25e P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:23.422923 27317 raft_consensus.cc:3060] T c7b039889b334a5c90fee88adac9c25e P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:23.429756 27317 raft_consensus.cc:515] T c7b039889b334a5c90fee88adac9c25e P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:23.431780 27317 leader_election.cc:290] T c7b039889b334a5c90fee88adac9c25e P 9f0541c7472e4aef9aac8ad7d02e8e48 [CANDIDATE]: Term 1 election: Requested vote from peers e7c0341504c3426280338a5599607a0d (127.14.180.65:41105), dd2dd298b4404607b3f3a14b89cbbee4 (127.14.180.67:40131)
I20260709 13:10:23.432694 27121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7b039889b334a5c90fee88adac9c25e" candidate_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7c0341504c3426280338a5599607a0d"
I20260709 13:10:23.433094 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7b039889b334a5c90fee88adac9c25e" candidate_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd2dd298b4404607b3f3a14b89cbbee4"
I20260709 13:10:23.433463 27121 raft_consensus.cc:3060] T c7b039889b334a5c90fee88adac9c25e P e7c0341504c3426280338a5599607a0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:23.433815 27268 raft_consensus.cc:3060] T c7b039889b334a5c90fee88adac9c25e P dd2dd298b4404607b3f3a14b89cbbee4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:23.440114 27268 raft_consensus.cc:2468] T c7b039889b334a5c90fee88adac9c25e P dd2dd298b4404607b3f3a14b89cbbee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f0541c7472e4aef9aac8ad7d02e8e48 in term 1.
I20260709 13:10:23.441223 27121 raft_consensus.cc:2468] T c7b039889b334a5c90fee88adac9c25e P e7c0341504c3426280338a5599607a0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f0541c7472e4aef9aac8ad7d02e8e48 in term 1.
I20260709 13:10:23.441219 27162 leader_election.cc:304] T c7b039889b334a5c90fee88adac9c25e P 9f0541c7472e4aef9aac8ad7d02e8e48 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f0541c7472e4aef9aac8ad7d02e8e48, dd2dd298b4404607b3f3a14b89cbbee4; no voters: 
I20260709 13:10:23.442590 27317 raft_consensus.cc:2804] T c7b039889b334a5c90fee88adac9c25e P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:23.443120 27317 raft_consensus.cc:697] T c7b039889b334a5c90fee88adac9c25e P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 1 LEADER]: Becoming Leader. State: Replica: 9f0541c7472e4aef9aac8ad7d02e8e48, State: Running, Role: LEADER
I20260709 13:10:23.443959 27317 consensus_queue.cc:237] T c7b039889b334a5c90fee88adac9c25e P 9f0541c7472e4aef9aac8ad7d02e8e48 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:23.452500 27016 catalog_manager.cc:5697] T c7b039889b334a5c90fee88adac9c25e P 9f0541c7472e4aef9aac8ad7d02e8e48 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9f0541c7472e4aef9aac8ad7d02e8e48 (127.14.180.66). New cstate: current_term: 1 leader_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:23.534348 27317 consensus_queue.cc:1048] T 2131193060f9477e9750e3f42ef79986 P 9f0541c7472e4aef9aac8ad7d02e8e48 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:23.546969 27317 consensus_queue.cc:1048] T 2131193060f9477e9750e3f42ef79986 P 9f0541c7472e4aef9aac8ad7d02e8e48 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:23.559959 27317 consensus_queue.cc:1048] T c0a2c588c6f148ef9976d15d1a79ba74 P 9f0541c7472e4aef9aac8ad7d02e8e48 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:23.571098 27316 consensus_queue.cc:1048] T d5c696708616494588c1322fabef87f2 P e7c0341504c3426280338a5599607a0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:23.572120 27356 consensus_queue.cc:1048] T c0a2c588c6f148ef9976d15d1a79ba74 P 9f0541c7472e4aef9aac8ad7d02e8e48 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:23.589720 27316 consensus_queue.cc:1048] T d5c696708616494588c1322fabef87f2 P e7c0341504c3426280338a5599607a0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:23.737231 27195 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ba62c4ccdf604a349be40020c44728e9"
dest_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48"
mode: GRACEFUL
new_leader_uuid: "e7c0341504c3426280338a5599607a0d"
 from {username='slave'} at 127.0.0.1:38502
I20260709 13:10:23.738096 27195 raft_consensus.cc:606] T ba62c4ccdf604a349be40020c44728e9 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 1 LEADER]: Received request to transfer leadership to TS e7c0341504c3426280338a5599607a0d
I20260709 13:10:23.748667 27195 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2131193060f9477e9750e3f42ef79986"
dest_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48"
mode: GRACEFUL
new_leader_uuid: "e7c0341504c3426280338a5599607a0d"
 from {username='slave'} at 127.0.0.1:38502
I20260709 13:10:23.749469 27195 raft_consensus.cc:606] T 2131193060f9477e9750e3f42ef79986 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 1 LEADER]: Received request to transfer leadership to TS e7c0341504c3426280338a5599607a0d
I20260709 13:10:23.758126 27316 consensus_queue.cc:1048] T 25b85b28aed94a088553d3df84dfc6dc P e7c0341504c3426280338a5599607a0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:23.767047 27316 consensus_queue.cc:1048] T 25b85b28aed94a088553d3df84dfc6dc P e7c0341504c3426280338a5599607a0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:23.768424 27352 consensus_queue.cc:1048] T ba62c4ccdf604a349be40020c44728e9 P 9f0541c7472e4aef9aac8ad7d02e8e48 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:23.795675 27352 raft_consensus.cc:993] T ba62c4ccdf604a349be40020c44728e9 P 9f0541c7472e4aef9aac8ad7d02e8e48: : Instructing follower e7c0341504c3426280338a5599607a0d to start an election
I20260709 13:10:23.796157 27352 raft_consensus.cc:1081] T ba62c4ccdf604a349be40020c44728e9 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 1 LEADER]: Signalling peer e7c0341504c3426280338a5599607a0d to start an election
I20260709 13:10:23.799211 27317 consensus_queue.cc:1048] T ba62c4ccdf604a349be40020c44728e9 P 9f0541c7472e4aef9aac8ad7d02e8e48 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:23.802304 27318 consensus_queue.cc:1048] T 025d8ae32c8a4cec8fe002fb1682eb12 P dd2dd298b4404607b3f3a14b89cbbee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:23.802903 27120 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ba62c4ccdf604a349be40020c44728e9"
dest_uuid: "e7c0341504c3426280338a5599607a0d"
 from {username='slave'} at 127.0.0.1:37528
I20260709 13:10:23.803565 27120 raft_consensus.cc:493] T ba62c4ccdf604a349be40020c44728e9 P e7c0341504c3426280338a5599607a0d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:23.803967 27120 raft_consensus.cc:3060] T ba62c4ccdf604a349be40020c44728e9 P e7c0341504c3426280338a5599607a0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:23.813202 27120 raft_consensus.cc:515] T ba62c4ccdf604a349be40020c44728e9 P e7c0341504c3426280338a5599607a0d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:23.816511 27194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba62c4ccdf604a349be40020c44728e9" candidate_uuid: "e7c0341504c3426280338a5599607a0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48"
I20260709 13:10:23.817157 27194 raft_consensus.cc:3055] T ba62c4ccdf604a349be40020c44728e9 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:23.817471 27194 raft_consensus.cc:740] T ba62c4ccdf604a349be40020c44728e9 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9f0541c7472e4aef9aac8ad7d02e8e48, State: Running, Role: LEADER
I20260709 13:10:23.818390 27194 consensus_queue.cc:260] T ba62c4ccdf604a349be40020c44728e9 P 9f0541c7472e4aef9aac8ad7d02e8e48 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:23.819830 27194 raft_consensus.cc:3060] T ba62c4ccdf604a349be40020c44728e9 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:23.819872 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba62c4ccdf604a349be40020c44728e9" candidate_uuid: "e7c0341504c3426280338a5599607a0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dd2dd298b4404607b3f3a14b89cbbee4"
I20260709 13:10:23.820734 27268 raft_consensus.cc:3060] T ba62c4ccdf604a349be40020c44728e9 P dd2dd298b4404607b3f3a14b89cbbee4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:23.821997 27121 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "25b85b28aed94a088553d3df84dfc6dc"
dest_uuid: "e7c0341504c3426280338a5599607a0d"
mode: GRACEFUL
new_leader_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48"
 from {username='slave'} at 127.0.0.1:37548
I20260709 13:10:23.822595 27120 leader_election.cc:290] T ba62c4ccdf604a349be40020c44728e9 P e7c0341504c3426280338a5599607a0d [CANDIDATE]: Term 2 election: Requested vote from peers 9f0541c7472e4aef9aac8ad7d02e8e48 (127.14.180.66:41411), dd2dd298b4404607b3f3a14b89cbbee4 (127.14.180.67:40131)
I20260709 13:10:23.828954 27121 raft_consensus.cc:606] T 25b85b28aed94a088553d3df84dfc6dc P e7c0341504c3426280338a5599607a0d [term 1 LEADER]: Received request to transfer leadership to TS 9f0541c7472e4aef9aac8ad7d02e8e48
I20260709 13:10:23.837232 27330 raft_consensus.cc:993] T 25b85b28aed94a088553d3df84dfc6dc P e7c0341504c3426280338a5599607a0d: : Instructing follower 9f0541c7472e4aef9aac8ad7d02e8e48 to start an election
I20260709 13:10:23.837814 27343 raft_consensus.cc:1081] T 25b85b28aed94a088553d3df84dfc6dc P e7c0341504c3426280338a5599607a0d [term 1 LEADER]: Signalling peer 9f0541c7472e4aef9aac8ad7d02e8e48 to start an election
I20260709 13:10:23.843204 27196 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "25b85b28aed94a088553d3df84dfc6dc"
dest_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48"
 from {username='slave'} at 127.0.0.1:38486
I20260709 13:10:23.842988 27390 consensus_queue.cc:1048] T 025d8ae32c8a4cec8fe002fb1682eb12 P dd2dd298b4404607b3f3a14b89cbbee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:23.843839 27196 raft_consensus.cc:493] T 25b85b28aed94a088553d3df84dfc6dc P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:23.844257 27196 raft_consensus.cc:3060] T 25b85b28aed94a088553d3df84dfc6dc P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:23.847250 27268 raft_consensus.cc:2468] T ba62c4ccdf604a349be40020c44728e9 P dd2dd298b4404607b3f3a14b89cbbee4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7c0341504c3426280338a5599607a0d in term 2.
I20260709 13:10:23.851361 27087 leader_election.cc:304] T ba62c4ccdf604a349be40020c44728e9 P e7c0341504c3426280338a5599607a0d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dd2dd298b4404607b3f3a14b89cbbee4, e7c0341504c3426280338a5599607a0d; no voters: 
I20260709 13:10:23.852548 27330 raft_consensus.cc:2804] T ba62c4ccdf604a349be40020c44728e9 P e7c0341504c3426280338a5599607a0d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:23.853055 27330 raft_consensus.cc:697] T ba62c4ccdf604a349be40020c44728e9 P e7c0341504c3426280338a5599607a0d [term 2 LEADER]: Becoming Leader. State: Replica: e7c0341504c3426280338a5599607a0d, State: Running, Role: LEADER
I20260709 13:10:23.853933 27330 consensus_queue.cc:237] T ba62c4ccdf604a349be40020c44728e9 P e7c0341504c3426280338a5599607a0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:23.860937 27196 raft_consensus.cc:515] T 25b85b28aed94a088553d3df84dfc6dc P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:23.907745 27196 leader_election.cc:290] T 25b85b28aed94a088553d3df84dfc6dc P 9f0541c7472e4aef9aac8ad7d02e8e48 [CANDIDATE]: Term 2 election: Requested vote from peers e7c0341504c3426280338a5599607a0d (127.14.180.65:41105), dd2dd298b4404607b3f3a14b89cbbee4 (127.14.180.67:40131)
I20260709 13:10:23.916285 27120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25b85b28aed94a088553d3df84dfc6dc" candidate_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e7c0341504c3426280338a5599607a0d"
I20260709 13:10:23.920396 27120 raft_consensus.cc:3055] T 25b85b28aed94a088553d3df84dfc6dc P e7c0341504c3426280338a5599607a0d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:23.921146 27120 raft_consensus.cc:740] T 25b85b28aed94a088553d3df84dfc6dc P e7c0341504c3426280338a5599607a0d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e7c0341504c3426280338a5599607a0d, State: Running, Role: LEADER
I20260709 13:10:23.923516 27120 consensus_queue.cc:260] T 25b85b28aed94a088553d3df84dfc6dc P e7c0341504c3426280338a5599607a0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:23.926535 27120 raft_consensus.cc:3060] T 25b85b28aed94a088553d3df84dfc6dc P e7c0341504c3426280338a5599607a0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:23.929152 27364 consensus_queue.cc:1048] T fd5b3b92057444cfb3f243b5fdf1ae66 P dd2dd298b4404607b3f3a14b89cbbee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:10:23.935206 27390 consensus_queue.cc:1048] T fd5b3b92057444cfb3f243b5fdf1ae66 P dd2dd298b4404607b3f3a14b89cbbee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:23.944932 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25b85b28aed94a088553d3df84dfc6dc" candidate_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dd2dd298b4404607b3f3a14b89cbbee4"
I20260709 13:10:23.945997 27270 raft_consensus.cc:3060] T 25b85b28aed94a088553d3df84dfc6dc P dd2dd298b4404607b3f3a14b89cbbee4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:23.967437 27194 raft_consensus.cc:2468] T ba62c4ccdf604a349be40020c44728e9 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7c0341504c3426280338a5599607a0d in term 2.
I20260709 13:10:23.968575 27120 raft_consensus.cc:2468] T 25b85b28aed94a088553d3df84dfc6dc P e7c0341504c3426280338a5599607a0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f0541c7472e4aef9aac8ad7d02e8e48 in term 2.
I20260709 13:10:23.980984 27270 raft_consensus.cc:2468] T 25b85b28aed94a088553d3df84dfc6dc P dd2dd298b4404607b3f3a14b89cbbee4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f0541c7472e4aef9aac8ad7d02e8e48 in term 2.
I20260709 13:10:23.983481 27162 leader_election.cc:304] T 25b85b28aed94a088553d3df84dfc6dc P 9f0541c7472e4aef9aac8ad7d02e8e48 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f0541c7472e4aef9aac8ad7d02e8e48, dd2dd298b4404607b3f3a14b89cbbee4; no voters: 
I20260709 13:10:23.987991 27016 catalog_manager.cc:5697] T ba62c4ccdf604a349be40020c44728e9 P e7c0341504c3426280338a5599607a0d reported cstate change: term changed from 1 to 2, leader changed from 9f0541c7472e4aef9aac8ad7d02e8e48 (127.14.180.66) to e7c0341504c3426280338a5599607a0d (127.14.180.65). New cstate: current_term: 2 leader_uuid: "e7c0341504c3426280338a5599607a0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:23.985123 27352 raft_consensus.cc:2804] T 25b85b28aed94a088553d3df84dfc6dc P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:23.991044 27352 raft_consensus.cc:697] T 25b85b28aed94a088553d3df84dfc6dc P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 2 LEADER]: Becoming Leader. State: Replica: 9f0541c7472e4aef9aac8ad7d02e8e48, State: Running, Role: LEADER
I20260709 13:10:23.992597 27352 consensus_queue.cc:237] T 25b85b28aed94a088553d3df84dfc6dc P 9f0541c7472e4aef9aac8ad7d02e8e48 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:24.007215 27317 consensus_queue.cc:1048] T c7b039889b334a5c90fee88adac9c25e P 9f0541c7472e4aef9aac8ad7d02e8e48 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:24.018908 27270 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fd5b3b92057444cfb3f243b5fdf1ae66"
dest_uuid: "dd2dd298b4404607b3f3a14b89cbbee4"
mode: GRACEFUL
new_leader_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48"
 from {username='slave'} at 127.0.0.1:46088
I20260709 13:10:24.019835 27270 raft_consensus.cc:606] T fd5b3b92057444cfb3f243b5fdf1ae66 P dd2dd298b4404607b3f3a14b89cbbee4 [term 1 LEADER]: Received request to transfer leadership to TS 9f0541c7472e4aef9aac8ad7d02e8e48
I20260709 13:10:24.025485 27338 raft_consensus.cc:993] T 2131193060f9477e9750e3f42ef79986 P 9f0541c7472e4aef9aac8ad7d02e8e48: : Instructing follower e7c0341504c3426280338a5599607a0d to start an election
I20260709 13:10:24.032686 27317 raft_consensus.cc:1081] T 2131193060f9477e9750e3f42ef79986 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 1 LEADER]: Signalling peer e7c0341504c3426280338a5599607a0d to start an election
I20260709 13:10:24.033754 27356 consensus_queue.cc:1048] T c7b039889b334a5c90fee88adac9c25e P 9f0541c7472e4aef9aac8ad7d02e8e48 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:24.035887 27121 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2131193060f9477e9750e3f42ef79986"
dest_uuid: "e7c0341504c3426280338a5599607a0d"
 from {username='slave'} at 127.0.0.1:37528
I20260709 13:10:24.036808 27121 raft_consensus.cc:493] T 2131193060f9477e9750e3f42ef79986 P e7c0341504c3426280338a5599607a0d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:24.037215 27121 raft_consensus.cc:3060] T 2131193060f9477e9750e3f42ef79986 P e7c0341504c3426280338a5599607a0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:24.040100 27018 catalog_manager.cc:5697] T 25b85b28aed94a088553d3df84dfc6dc P 9f0541c7472e4aef9aac8ad7d02e8e48 reported cstate change: term changed from 1 to 2, leader changed from e7c0341504c3426280338a5599607a0d (127.14.180.65) to 9f0541c7472e4aef9aac8ad7d02e8e48 (127.14.180.66). New cstate: current_term: 2 leader_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:24.042029 27270 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "025d8ae32c8a4cec8fe002fb1682eb12"
dest_uuid: "dd2dd298b4404607b3f3a14b89cbbee4"
mode: GRACEFUL
new_leader_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48"
 from {username='slave'} at 127.0.0.1:46088
I20260709 13:10:24.042752 27270 raft_consensus.cc:606] T 025d8ae32c8a4cec8fe002fb1682eb12 P dd2dd298b4404607b3f3a14b89cbbee4 [term 1 LEADER]: Received request to transfer leadership to TS 9f0541c7472e4aef9aac8ad7d02e8e48
I20260709 13:10:24.048585 27121 raft_consensus.cc:515] T 2131193060f9477e9750e3f42ef79986 P e7c0341504c3426280338a5599607a0d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:24.051473 27121 leader_election.cc:290] T 2131193060f9477e9750e3f42ef79986 P e7c0341504c3426280338a5599607a0d [CANDIDATE]: Term 2 election: Requested vote from peers 9f0541c7472e4aef9aac8ad7d02e8e48 (127.14.180.66:41411), dd2dd298b4404607b3f3a14b89cbbee4 (127.14.180.67:40131)
I20260709 13:10:24.052424 27195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2131193060f9477e9750e3f42ef79986" candidate_uuid: "e7c0341504c3426280338a5599607a0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48"
I20260709 13:10:24.053161 27195 raft_consensus.cc:3055] T 2131193060f9477e9750e3f42ef79986 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:24.053258 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2131193060f9477e9750e3f42ef79986" candidate_uuid: "e7c0341504c3426280338a5599607a0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dd2dd298b4404607b3f3a14b89cbbee4"
I20260709 13:10:24.053580 27195 raft_consensus.cc:740] T 2131193060f9477e9750e3f42ef79986 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9f0541c7472e4aef9aac8ad7d02e8e48, State: Running, Role: LEADER
I20260709 13:10:24.053921 27194 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c7b039889b334a5c90fee88adac9c25e"
dest_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48"
mode: GRACEFUL
new_leader_uuid: "dd2dd298b4404607b3f3a14b89cbbee4"
 from {username='slave'} at 127.0.0.1:38502
I20260709 13:10:24.054045 27270 raft_consensus.cc:3060] T 2131193060f9477e9750e3f42ef79986 P dd2dd298b4404607b3f3a14b89cbbee4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:24.054795 27194 raft_consensus.cc:606] T c7b039889b334a5c90fee88adac9c25e P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 1 LEADER]: Received request to transfer leadership to TS dd2dd298b4404607b3f3a14b89cbbee4
I20260709 13:10:24.055008 27195 consensus_queue.cc:260] T 2131193060f9477e9750e3f42ef79986 P 9f0541c7472e4aef9aac8ad7d02e8e48 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:24.056706 27195 raft_consensus.cc:3060] T 2131193060f9477e9750e3f42ef79986 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:24.066928 27270 raft_consensus.cc:2468] T 2131193060f9477e9750e3f42ef79986 P dd2dd298b4404607b3f3a14b89cbbee4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7c0341504c3426280338a5599607a0d in term 2.
I20260709 13:10:24.069176 27087 leader_election.cc:304] T 2131193060f9477e9750e3f42ef79986 P e7c0341504c3426280338a5599607a0d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dd2dd298b4404607b3f3a14b89cbbee4, e7c0341504c3426280338a5599607a0d; no voters: 
I20260709 13:10:24.070399 27330 raft_consensus.cc:2804] T 2131193060f9477e9750e3f42ef79986 P e7c0341504c3426280338a5599607a0d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:24.070946 27330 raft_consensus.cc:697] T 2131193060f9477e9750e3f42ef79986 P e7c0341504c3426280338a5599607a0d [term 2 LEADER]: Becoming Leader. State: Replica: e7c0341504c3426280338a5599607a0d, State: Running, Role: LEADER
I20260709 13:10:24.071815 27330 consensus_queue.cc:237] T 2131193060f9477e9750e3f42ef79986 P e7c0341504c3426280338a5599607a0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:24.073833 27195 raft_consensus.cc:2468] T 2131193060f9477e9750e3f42ef79986 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7c0341504c3426280338a5599607a0d in term 2.
I20260709 13:10:24.084534 27015 catalog_manager.cc:5697] T 2131193060f9477e9750e3f42ef79986 P e7c0341504c3426280338a5599607a0d reported cstate change: term changed from 1 to 2, leader changed from 9f0541c7472e4aef9aac8ad7d02e8e48 (127.14.180.66) to e7c0341504c3426280338a5599607a0d (127.14.180.65). New cstate: current_term: 2 leader_uuid: "e7c0341504c3426280338a5599607a0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:24.202348 27364 raft_consensus.cc:993] T 025d8ae32c8a4cec8fe002fb1682eb12 P dd2dd298b4404607b3f3a14b89cbbee4: : Instructing follower 9f0541c7472e4aef9aac8ad7d02e8e48 to start an election
I20260709 13:10:24.202946 27364 raft_consensus.cc:1081] T 025d8ae32c8a4cec8fe002fb1682eb12 P dd2dd298b4404607b3f3a14b89cbbee4 [term 1 LEADER]: Signalling peer 9f0541c7472e4aef9aac8ad7d02e8e48 to start an election
I20260709 13:10:24.204738 27195 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "025d8ae32c8a4cec8fe002fb1682eb12"
dest_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48"
 from {username='slave'} at 127.0.0.1:38492
I20260709 13:10:24.205374 27195 raft_consensus.cc:493] T 025d8ae32c8a4cec8fe002fb1682eb12 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:24.205724 27195 raft_consensus.cc:3060] T 025d8ae32c8a4cec8fe002fb1682eb12 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:24.212069 27195 raft_consensus.cc:515] T 025d8ae32c8a4cec8fe002fb1682eb12 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:24.214042 27195 leader_election.cc:290] T 025d8ae32c8a4cec8fe002fb1682eb12 P 9f0541c7472e4aef9aac8ad7d02e8e48 [CANDIDATE]: Term 2 election: Requested vote from peers e7c0341504c3426280338a5599607a0d (127.14.180.65:41105), dd2dd298b4404607b3f3a14b89cbbee4 (127.14.180.67:40131)
I20260709 13:10:24.215027 27120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "025d8ae32c8a4cec8fe002fb1682eb12" candidate_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e7c0341504c3426280338a5599607a0d"
I20260709 13:10:24.215251 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "025d8ae32c8a4cec8fe002fb1682eb12" candidate_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dd2dd298b4404607b3f3a14b89cbbee4"
I20260709 13:10:24.215727 27120 raft_consensus.cc:3060] T 025d8ae32c8a4cec8fe002fb1682eb12 P e7c0341504c3426280338a5599607a0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:24.215896 27270 raft_consensus.cc:3055] T 025d8ae32c8a4cec8fe002fb1682eb12 P dd2dd298b4404607b3f3a14b89cbbee4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:24.216368 27270 raft_consensus.cc:740] T 025d8ae32c8a4cec8fe002fb1682eb12 P dd2dd298b4404607b3f3a14b89cbbee4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dd2dd298b4404607b3f3a14b89cbbee4, State: Running, Role: LEADER
I20260709 13:10:24.217207 27270 consensus_queue.cc:260] T 025d8ae32c8a4cec8fe002fb1682eb12 P dd2dd298b4404607b3f3a14b89cbbee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:24.218585 27270 raft_consensus.cc:3060] T 025d8ae32c8a4cec8fe002fb1682eb12 P dd2dd298b4404607b3f3a14b89cbbee4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:24.221962 27120 raft_consensus.cc:2468] T 025d8ae32c8a4cec8fe002fb1682eb12 P e7c0341504c3426280338a5599607a0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f0541c7472e4aef9aac8ad7d02e8e48 in term 2.
I20260709 13:10:24.223764 27161 leader_election.cc:304] T 025d8ae32c8a4cec8fe002fb1682eb12 P 9f0541c7472e4aef9aac8ad7d02e8e48 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f0541c7472e4aef9aac8ad7d02e8e48, e7c0341504c3426280338a5599607a0d; no voters: 
I20260709 13:10:24.224737 27356 raft_consensus.cc:2804] T 025d8ae32c8a4cec8fe002fb1682eb12 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:24.225106 27270 raft_consensus.cc:2468] T 025d8ae32c8a4cec8fe002fb1682eb12 P dd2dd298b4404607b3f3a14b89cbbee4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f0541c7472e4aef9aac8ad7d02e8e48 in term 2.
I20260709 13:10:24.225229 27356 raft_consensus.cc:697] T 025d8ae32c8a4cec8fe002fb1682eb12 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 2 LEADER]: Becoming Leader. State: Replica: 9f0541c7472e4aef9aac8ad7d02e8e48, State: Running, Role: LEADER
I20260709 13:10:24.226774 27356 consensus_queue.cc:237] T 025d8ae32c8a4cec8fe002fb1682eb12 P 9f0541c7472e4aef9aac8ad7d02e8e48 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:24.234244 27015 catalog_manager.cc:5697] T 025d8ae32c8a4cec8fe002fb1682eb12 P 9f0541c7472e4aef9aac8ad7d02e8e48 reported cstate change: term changed from 1 to 2, leader changed from dd2dd298b4404607b3f3a14b89cbbee4 (127.14.180.67) to 9f0541c7472e4aef9aac8ad7d02e8e48 (127.14.180.66). New cstate: current_term: 2 leader_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:24.360601 27195 raft_consensus.cc:1275] T ba62c4ccdf604a349be40020c44728e9 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 2 FOLLOWER]: Refusing update from remote peer e7c0341504c3426280338a5599607a0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:24.362210 27330 consensus_queue.cc:1048] T ba62c4ccdf604a349be40020c44728e9 P e7c0341504c3426280338a5599607a0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:24.372488 27270 raft_consensus.cc:1275] T ba62c4ccdf604a349be40020c44728e9 P dd2dd298b4404607b3f3a14b89cbbee4 [term 2 FOLLOWER]: Refusing update from remote peer e7c0341504c3426280338a5599607a0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:24.374574 27316 consensus_queue.cc:1048] T ba62c4ccdf604a349be40020c44728e9 P e7c0341504c3426280338a5599607a0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:24.395416 27391 raft_consensus.cc:993] T fd5b3b92057444cfb3f243b5fdf1ae66 P dd2dd298b4404607b3f3a14b89cbbee4: : Instructing follower 9f0541c7472e4aef9aac8ad7d02e8e48 to start an election
I20260709 13:10:24.395900 27391 raft_consensus.cc:1081] T fd5b3b92057444cfb3f243b5fdf1ae66 P dd2dd298b4404607b3f3a14b89cbbee4 [term 1 LEADER]: Signalling peer 9f0541c7472e4aef9aac8ad7d02e8e48 to start an election
I20260709 13:10:24.397564 27195 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fd5b3b92057444cfb3f243b5fdf1ae66"
dest_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48"
 from {username='slave'} at 127.0.0.1:38492
I20260709 13:10:24.398110 27195 raft_consensus.cc:493] T fd5b3b92057444cfb3f243b5fdf1ae66 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:24.398456 27195 raft_consensus.cc:3060] T fd5b3b92057444cfb3f243b5fdf1ae66 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:24.404058 27195 raft_consensus.cc:515] T fd5b3b92057444cfb3f243b5fdf1ae66 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:24.405994 27195 leader_election.cc:290] T fd5b3b92057444cfb3f243b5fdf1ae66 P 9f0541c7472e4aef9aac8ad7d02e8e48 [CANDIDATE]: Term 2 election: Requested vote from peers e7c0341504c3426280338a5599607a0d (127.14.180.65:41105), dd2dd298b4404607b3f3a14b89cbbee4 (127.14.180.67:40131)
I20260709 13:10:24.406874 27120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5b3b92057444cfb3f243b5fdf1ae66" candidate_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e7c0341504c3426280338a5599607a0d"
I20260709 13:10:24.407104 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fd5b3b92057444cfb3f243b5fdf1ae66" candidate_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dd2dd298b4404607b3f3a14b89cbbee4"
I20260709 13:10:24.407619 27120 raft_consensus.cc:3060] T fd5b3b92057444cfb3f243b5fdf1ae66 P e7c0341504c3426280338a5599607a0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:24.407747 27270 raft_consensus.cc:3055] T fd5b3b92057444cfb3f243b5fdf1ae66 P dd2dd298b4404607b3f3a14b89cbbee4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:24.408229 27270 raft_consensus.cc:740] T fd5b3b92057444cfb3f243b5fdf1ae66 P dd2dd298b4404607b3f3a14b89cbbee4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dd2dd298b4404607b3f3a14b89cbbee4, State: Running, Role: LEADER
I20260709 13:10:24.409274 27270 consensus_queue.cc:260] T fd5b3b92057444cfb3f243b5fdf1ae66 P dd2dd298b4404607b3f3a14b89cbbee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:24.410327 27270 raft_consensus.cc:3060] T fd5b3b92057444cfb3f243b5fdf1ae66 P dd2dd298b4404607b3f3a14b89cbbee4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:24.413926 27120 raft_consensus.cc:2468] T fd5b3b92057444cfb3f243b5fdf1ae66 P e7c0341504c3426280338a5599607a0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f0541c7472e4aef9aac8ad7d02e8e48 in term 2.
I20260709 13:10:24.415349 27161 leader_election.cc:304] T fd5b3b92057444cfb3f243b5fdf1ae66 P 9f0541c7472e4aef9aac8ad7d02e8e48 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f0541c7472e4aef9aac8ad7d02e8e48, e7c0341504c3426280338a5599607a0d; no voters: 
I20260709 13:10:24.416265 27356 raft_consensus.cc:2804] T fd5b3b92057444cfb3f243b5fdf1ae66 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:24.416759 27356 raft_consensus.cc:697] T fd5b3b92057444cfb3f243b5fdf1ae66 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 2 LEADER]: Becoming Leader. State: Replica: 9f0541c7472e4aef9aac8ad7d02e8e48, State: Running, Role: LEADER
I20260709 13:10:24.417759 27356 consensus_queue.cc:237] T fd5b3b92057444cfb3f243b5fdf1ae66 P 9f0541c7472e4aef9aac8ad7d02e8e48 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:24.418073 27270 raft_consensus.cc:2468] T fd5b3b92057444cfb3f243b5fdf1ae66 P dd2dd298b4404607b3f3a14b89cbbee4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f0541c7472e4aef9aac8ad7d02e8e48 in term 2.
I20260709 13:10:24.425866 27019 catalog_manager.cc:5697] T fd5b3b92057444cfb3f243b5fdf1ae66 P 9f0541c7472e4aef9aac8ad7d02e8e48 reported cstate change: term changed from 1 to 2, leader changed from dd2dd298b4404607b3f3a14b89cbbee4 (127.14.180.67) to 9f0541c7472e4aef9aac8ad7d02e8e48 (127.14.180.66). New cstate: current_term: 2 leader_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:24.464015 27270 raft_consensus.cc:1275] T 25b85b28aed94a088553d3df84dfc6dc P dd2dd298b4404607b3f3a14b89cbbee4 [term 2 FOLLOWER]: Refusing update from remote peer 9f0541c7472e4aef9aac8ad7d02e8e48: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:24.465557 27356 consensus_queue.cc:1048] T 25b85b28aed94a088553d3df84dfc6dc P 9f0541c7472e4aef9aac8ad7d02e8e48 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:24.474645 27120 raft_consensus.cc:1275] T 25b85b28aed94a088553d3df84dfc6dc P e7c0341504c3426280338a5599607a0d [term 2 FOLLOWER]: Refusing update from remote peer 9f0541c7472e4aef9aac8ad7d02e8e48: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:24.477860 27352 consensus_queue.cc:1048] T 25b85b28aed94a088553d3df84dfc6dc P 9f0541c7472e4aef9aac8ad7d02e8e48 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:24.478391 27269 raft_consensus.cc:1275] T 2131193060f9477e9750e3f42ef79986 P dd2dd298b4404607b3f3a14b89cbbee4 [term 2 FOLLOWER]: Refusing update from remote peer e7c0341504c3426280338a5599607a0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:24.481853 27317 raft_consensus.cc:993] T c7b039889b334a5c90fee88adac9c25e P 9f0541c7472e4aef9aac8ad7d02e8e48: : Instructing follower dd2dd298b4404607b3f3a14b89cbbee4 to start an election
I20260709 13:10:24.482404 27352 raft_consensus.cc:1081] T c7b039889b334a5c90fee88adac9c25e P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 1 LEADER]: Signalling peer dd2dd298b4404607b3f3a14b89cbbee4 to start an election
I20260709 13:10:24.482945 27343 consensus_queue.cc:1048] T 2131193060f9477e9750e3f42ef79986 P e7c0341504c3426280338a5599607a0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:24.485467 27269 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c7b039889b334a5c90fee88adac9c25e"
dest_uuid: "dd2dd298b4404607b3f3a14b89cbbee4"
 from {username='slave'} at 127.0.0.1:46074
I20260709 13:10:24.486289 27269 raft_consensus.cc:493] T c7b039889b334a5c90fee88adac9c25e P dd2dd298b4404607b3f3a14b89cbbee4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:24.487035 27269 raft_consensus.cc:3060] T c7b039889b334a5c90fee88adac9c25e P dd2dd298b4404607b3f3a14b89cbbee4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:24.500470 27195 raft_consensus.cc:1275] T 2131193060f9477e9750e3f42ef79986 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 2 FOLLOWER]: Refusing update from remote peer e7c0341504c3426280338a5599607a0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:24.500180 27269 raft_consensus.cc:515] T c7b039889b334a5c90fee88adac9c25e P dd2dd298b4404607b3f3a14b89cbbee4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:24.504797 27269 leader_election.cc:290] T c7b039889b334a5c90fee88adac9c25e P dd2dd298b4404607b3f3a14b89cbbee4 [CANDIDATE]: Term 2 election: Requested vote from peers e7c0341504c3426280338a5599607a0d (127.14.180.65:41105), 9f0541c7472e4aef9aac8ad7d02e8e48 (127.14.180.66:41411)
I20260709 13:10:24.505828 27316 consensus_queue.cc:1048] T 2131193060f9477e9750e3f42ef79986 P e7c0341504c3426280338a5599607a0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:24.507679 27195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7b039889b334a5c90fee88adac9c25e" candidate_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48"
I20260709 13:10:24.508481 27195 raft_consensus.cc:3055] T c7b039889b334a5c90fee88adac9c25e P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:24.508829 27195 raft_consensus.cc:740] T c7b039889b334a5c90fee88adac9c25e P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9f0541c7472e4aef9aac8ad7d02e8e48, State: Running, Role: LEADER
I20260709 13:10:24.509778 27195 consensus_queue.cc:260] T c7b039889b334a5c90fee88adac9c25e P 9f0541c7472e4aef9aac8ad7d02e8e48 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:24.511340 27195 raft_consensus.cc:3060] T c7b039889b334a5c90fee88adac9c25e P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:24.514019 27120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7b039889b334a5c90fee88adac9c25e" candidate_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e7c0341504c3426280338a5599607a0d"
I20260709 13:10:24.518699 27120 raft_consensus.cc:3060] T c7b039889b334a5c90fee88adac9c25e P e7c0341504c3426280338a5599607a0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:24.522584 27195 raft_consensus.cc:2468] T c7b039889b334a5c90fee88adac9c25e P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd2dd298b4404607b3f3a14b89cbbee4 in term 2.
I20260709 13:10:24.524111 27234 leader_election.cc:304] T c7b039889b334a5c90fee88adac9c25e P dd2dd298b4404607b3f3a14b89cbbee4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f0541c7472e4aef9aac8ad7d02e8e48, dd2dd298b4404607b3f3a14b89cbbee4; no voters: 
I20260709 13:10:24.525266 27391 raft_consensus.cc:2804] T c7b039889b334a5c90fee88adac9c25e P dd2dd298b4404607b3f3a14b89cbbee4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:24.525794 27391 raft_consensus.cc:697] T c7b039889b334a5c90fee88adac9c25e P dd2dd298b4404607b3f3a14b89cbbee4 [term 2 LEADER]: Becoming Leader. State: Replica: dd2dd298b4404607b3f3a14b89cbbee4, State: Running, Role: LEADER
I20260709 13:10:24.527148 27391 consensus_queue.cc:237] T c7b039889b334a5c90fee88adac9c25e P dd2dd298b4404607b3f3a14b89cbbee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:24.529778 27120 raft_consensus.cc:2468] T c7b039889b334a5c90fee88adac9c25e P e7c0341504c3426280338a5599607a0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd2dd298b4404607b3f3a14b89cbbee4 in term 2.
I20260709 13:10:24.535929 27018 catalog_manager.cc:5697] T c7b039889b334a5c90fee88adac9c25e P dd2dd298b4404607b3f3a14b89cbbee4 reported cstate change: term changed from 1 to 2, leader changed from 9f0541c7472e4aef9aac8ad7d02e8e48 (127.14.180.66) to dd2dd298b4404607b3f3a14b89cbbee4 (127.14.180.67). New cstate: current_term: 2 leader_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:24.795096 27120 raft_consensus.cc:1275] T 025d8ae32c8a4cec8fe002fb1682eb12 P e7c0341504c3426280338a5599607a0d [term 2 FOLLOWER]: Refusing update from remote peer 9f0541c7472e4aef9aac8ad7d02e8e48: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:24.796578 27352 consensus_queue.cc:1048] T 025d8ae32c8a4cec8fe002fb1682eb12 P 9f0541c7472e4aef9aac8ad7d02e8e48 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:24.805495 27270 raft_consensus.cc:1275] T 025d8ae32c8a4cec8fe002fb1682eb12 P dd2dd298b4404607b3f3a14b89cbbee4 [term 2 FOLLOWER]: Refusing update from remote peer 9f0541c7472e4aef9aac8ad7d02e8e48: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:24.806994 27317 consensus_queue.cc:1048] T 025d8ae32c8a4cec8fe002fb1682eb12 P 9f0541c7472e4aef9aac8ad7d02e8e48 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:24.928361 27194 raft_consensus.cc:1275] T c7b039889b334a5c90fee88adac9c25e P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 2 FOLLOWER]: Refusing update from remote peer dd2dd298b4404607b3f3a14b89cbbee4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:24.929675 27391 consensus_queue.cc:1048] T c7b039889b334a5c90fee88adac9c25e P dd2dd298b4404607b3f3a14b89cbbee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:24.937758 27120 raft_consensus.cc:1275] T c7b039889b334a5c90fee88adac9c25e P e7c0341504c3426280338a5599607a0d [term 2 FOLLOWER]: Refusing update from remote peer dd2dd298b4404607b3f3a14b89cbbee4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:24.939854 27391 consensus_queue.cc:1048] T c7b039889b334a5c90fee88adac9c25e P dd2dd298b4404607b3f3a14b89cbbee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:24.943221 27120 raft_consensus.cc:1275] T fd5b3b92057444cfb3f243b5fdf1ae66 P e7c0341504c3426280338a5599607a0d [term 2 FOLLOWER]: Refusing update from remote peer 9f0541c7472e4aef9aac8ad7d02e8e48: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:24.944857 27317 consensus_queue.cc:1048] T fd5b3b92057444cfb3f243b5fdf1ae66 P 9f0541c7472e4aef9aac8ad7d02e8e48 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:24.955681 27270 raft_consensus.cc:1275] T fd5b3b92057444cfb3f243b5fdf1ae66 P dd2dd298b4404607b3f3a14b89cbbee4 [term 2 FOLLOWER]: Refusing update from remote peer 9f0541c7472e4aef9aac8ad7d02e8e48: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:24.957437 27356 consensus_queue.cc:1048] T fd5b3b92057444cfb3f243b5fdf1ae66 P 9f0541c7472e4aef9aac8ad7d02e8e48 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:27.090821 27018 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54918:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:10:27.093519 27018 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:10:27.158452 27109 tablet_service.cc:1511] Processing CreateTablet for tablet c972f59715c6476fb68a0a9dcc7b54d3 (DEFAULT_TABLE table=soft_deleted_table [id=d3c3b75363a5472a8e8546ae9224d5e4]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:10:27.159821 27183 tablet_service.cc:1511] Processing CreateTablet for tablet c972f59715c6476fb68a0a9dcc7b54d3 (DEFAULT_TABLE table=soft_deleted_table [id=d3c3b75363a5472a8e8546ae9224d5e4]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:10:27.162263 27183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c972f59715c6476fb68a0a9dcc7b54d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.162135 27255 tablet_service.cc:1511] Processing CreateTablet for tablet c972f59715c6476fb68a0a9dcc7b54d3 (DEFAULT_TABLE table=soft_deleted_table [id=d3c3b75363a5472a8e8546ae9224d5e4]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:10:27.165423 27255 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c972f59715c6476fb68a0a9dcc7b54d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.165685 27105 tablet_service.cc:1511] Processing CreateTablet for tablet 83e5ce6906634b63a01333e50b5622be (DEFAULT_TABLE table=soft_deleted_table [id=d3c3b75363a5472a8e8546ae9224d5e4]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:10:27.169791 27260 tablet_service.cc:1511] Processing CreateTablet for tablet 83e5ce6906634b63a01333e50b5622be (DEFAULT_TABLE table=soft_deleted_table [id=d3c3b75363a5472a8e8546ae9224d5e4]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:10:27.171708 27260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83e5ce6906634b63a01333e50b5622be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.175232 27111 tablet_service.cc:1511] Processing CreateTablet for tablet aa6e8c327dde42d3808411b7117dda68 (DEFAULT_TABLE table=soft_deleted_table [id=d3c3b75363a5472a8e8546ae9224d5e4]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:10:27.177068 27256 tablet_service.cc:1511] Processing CreateTablet for tablet aa6e8c327dde42d3808411b7117dda68 (DEFAULT_TABLE table=soft_deleted_table [id=d3c3b75363a5472a8e8546ae9224d5e4]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:10:27.179008 27256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa6e8c327dde42d3808411b7117dda68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.179375 27186 tablet_service.cc:1511] Processing CreateTablet for tablet aa6e8c327dde42d3808411b7117dda68 (DEFAULT_TABLE table=soft_deleted_table [id=d3c3b75363a5472a8e8546ae9224d5e4]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:10:27.183145 27181 tablet_service.cc:1511] Processing CreateTablet for tablet b33f79df36ce42da96dda6972776a01d (DEFAULT_TABLE table=soft_deleted_table [id=d3c3b75363a5472a8e8546ae9224d5e4]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:10:27.181569 27186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa6e8c327dde42d3808411b7117dda68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.184506 27259 tablet_service.cc:1511] Processing CreateTablet for tablet b33f79df36ce42da96dda6972776a01d (DEFAULT_TABLE table=soft_deleted_table [id=d3c3b75363a5472a8e8546ae9224d5e4]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:10:27.169401 27182 tablet_service.cc:1511] Processing CreateTablet for tablet 83e5ce6906634b63a01333e50b5622be (DEFAULT_TABLE table=soft_deleted_table [id=d3c3b75363a5472a8e8546ae9224d5e4]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:10:27.186844 27259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b33f79df36ce42da96dda6972776a01d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.187640 27182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83e5ce6906634b63a01333e50b5622be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.190834 27258 tablet_service.cc:1511] Processing CreateTablet for tablet deb0ef2084cc4ddf88165639552f3161 (DEFAULT_TABLE table=soft_deleted_table [id=d3c3b75363a5472a8e8546ae9224d5e4]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:10:27.192104 27184 tablet_service.cc:1511] Processing CreateTablet for tablet deb0ef2084cc4ddf88165639552f3161 (DEFAULT_TABLE table=soft_deleted_table [id=d3c3b75363a5472a8e8546ae9224d5e4]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:10:27.192790 27258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet deb0ef2084cc4ddf88165639552f3161. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.194074 27184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet deb0ef2084cc4ddf88165639552f3161. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.198796 27257 tablet_service.cc:1511] Processing CreateTablet for tablet e41aaa6d8213447b972d3eed31538da1 (DEFAULT_TABLE table=soft_deleted_table [id=d3c3b75363a5472a8e8546ae9224d5e4]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:10:27.200369 27257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e41aaa6d8213447b972d3eed31538da1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.198037 27185 tablet_service.cc:1511] Processing CreateTablet for tablet e41aaa6d8213447b972d3eed31538da1 (DEFAULT_TABLE table=soft_deleted_table [id=d3c3b75363a5472a8e8546ae9224d5e4]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:10:27.209092 27181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b33f79df36ce42da96dda6972776a01d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.209635 27180 tablet_service.cc:1511] Processing CreateTablet for tablet f9463aebc13b49339561c1f5436e3142 (DEFAULT_TABLE table=soft_deleted_table [id=d3c3b75363a5472a8e8546ae9224d5e4]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:10:27.211331 27180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9463aebc13b49339561c1f5436e3142. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.208333 27254 tablet_service.cc:1511] Processing CreateTablet for tablet f9463aebc13b49339561c1f5436e3142 (DEFAULT_TABLE table=soft_deleted_table [id=d3c3b75363a5472a8e8546ae9224d5e4]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:10:27.216471 27254 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9463aebc13b49339561c1f5436e3142. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.167636 27109 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c972f59715c6476fb68a0a9dcc7b54d3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.223237 27185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e41aaa6d8213447b972d3eed31538da1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.227020 27105 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83e5ce6906634b63a01333e50b5622be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.228528 27110 tablet_service.cc:1511] Processing CreateTablet for tablet b33f79df36ce42da96dda6972776a01d (DEFAULT_TABLE table=soft_deleted_table [id=d3c3b75363a5472a8e8546ae9224d5e4]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:10:27.230172 27110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b33f79df36ce42da96dda6972776a01d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.232779 27106 tablet_service.cc:1511] Processing CreateTablet for tablet deb0ef2084cc4ddf88165639552f3161 (DEFAULT_TABLE table=soft_deleted_table [id=d3c3b75363a5472a8e8546ae9224d5e4]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:10:27.236320 27108 tablet_service.cc:1511] Processing CreateTablet for tablet e41aaa6d8213447b972d3eed31538da1 (DEFAULT_TABLE table=soft_deleted_table [id=d3c3b75363a5472a8e8546ae9224d5e4]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:10:27.239954 27107 tablet_service.cc:1511] Processing CreateTablet for tablet f9463aebc13b49339561c1f5436e3142 (DEFAULT_TABLE table=soft_deleted_table [id=d3c3b75363a5472a8e8546ae9224d5e4]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:10:27.243489 27107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9463aebc13b49339561c1f5436e3142. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.244182 27111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa6e8c327dde42d3808411b7117dda68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.252061 27108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e41aaa6d8213447b972d3eed31538da1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.259162 27104 tablet_service.cc:1511] Processing CreateTablet for tablet d3aeec0e4dd34da6bb82d4774f566271 (DEFAULT_TABLE table=soft_deleted_table [id=d3c3b75363a5472a8e8546ae9224d5e4]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:10:27.260979 27104 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3aeec0e4dd34da6bb82d4774f566271. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.270931 27106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet deb0ef2084cc4ddf88165639552f3161. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.277979 27417 tablet_bootstrap.cc:492] T c972f59715c6476fb68a0a9dcc7b54d3 P dd2dd298b4404607b3f3a14b89cbbee4: Bootstrap starting.
I20260709 13:10:27.280618 27179 tablet_service.cc:1511] Processing CreateTablet for tablet d3aeec0e4dd34da6bb82d4774f566271 (DEFAULT_TABLE table=soft_deleted_table [id=d3c3b75363a5472a8e8546ae9224d5e4]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:10:27.282441 27179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3aeec0e4dd34da6bb82d4774f566271. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.321776 27255 tablet_service.cc:1511] Processing CreateTablet for tablet d3aeec0e4dd34da6bb82d4774f566271 (DEFAULT_TABLE table=soft_deleted_table [id=d3c3b75363a5472a8e8546ae9224d5e4]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:10:27.323676 27255 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3aeec0e4dd34da6bb82d4774f566271. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.324470 27103 tablet_service.cc:1511] Processing CreateTablet for tablet 42dd3577afcf408eba8fc5c82a33e0c8 (DEFAULT_TABLE table=soft_deleted_table [id=d3c3b75363a5472a8e8546ae9224d5e4]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:10:27.325969 27103 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42dd3577afcf408eba8fc5c82a33e0c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.341501 27417 tablet_bootstrap.cc:654] T c972f59715c6476fb68a0a9dcc7b54d3 P dd2dd298b4404607b3f3a14b89cbbee4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:27.368355 27419 tablet_bootstrap.cc:492] T b33f79df36ce42da96dda6972776a01d P e7c0341504c3426280338a5599607a0d: Bootstrap starting.
I20260709 13:10:27.374568 27418 tablet_bootstrap.cc:492] T aa6e8c327dde42d3808411b7117dda68 P 9f0541c7472e4aef9aac8ad7d02e8e48: Bootstrap starting.
I20260709 13:10:27.380445 27185 tablet_service.cc:1511] Processing CreateTablet for tablet 42dd3577afcf408eba8fc5c82a33e0c8 (DEFAULT_TABLE table=soft_deleted_table [id=d3c3b75363a5472a8e8546ae9224d5e4]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:10:27.382059 27185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42dd3577afcf408eba8fc5c82a33e0c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.385550 27256 tablet_service.cc:1511] Processing CreateTablet for tablet 42dd3577afcf408eba8fc5c82a33e0c8 (DEFAULT_TABLE table=soft_deleted_table [id=d3c3b75363a5472a8e8546ae9224d5e4]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:10:27.387133 27256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42dd3577afcf408eba8fc5c82a33e0c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:27.401419 27419 tablet_bootstrap.cc:654] T b33f79df36ce42da96dda6972776a01d P e7c0341504c3426280338a5599607a0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:27.412774 27418 tablet_bootstrap.cc:654] T aa6e8c327dde42d3808411b7117dda68 P 9f0541c7472e4aef9aac8ad7d02e8e48: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:27.437906 27419 tablet_bootstrap.cc:492] T b33f79df36ce42da96dda6972776a01d P e7c0341504c3426280338a5599607a0d: No bootstrap required, opened a new log
I20260709 13:10:27.438527 27419 ts_tablet_manager.cc:1403] T b33f79df36ce42da96dda6972776a01d P e7c0341504c3426280338a5599607a0d: Time spent bootstrapping tablet: real 0.070s	user 0.008s	sys 0.006s
I20260709 13:10:27.439319 27418 tablet_bootstrap.cc:492] T aa6e8c327dde42d3808411b7117dda68 P 9f0541c7472e4aef9aac8ad7d02e8e48: No bootstrap required, opened a new log
I20260709 13:10:27.439450 27417 tablet_bootstrap.cc:492] T c972f59715c6476fb68a0a9dcc7b54d3 P dd2dd298b4404607b3f3a14b89cbbee4: No bootstrap required, opened a new log
I20260709 13:10:27.440047 27418 ts_tablet_manager.cc:1403] T aa6e8c327dde42d3808411b7117dda68 P 9f0541c7472e4aef9aac8ad7d02e8e48: Time spent bootstrapping tablet: real 0.066s	user 0.010s	sys 0.004s
I20260709 13:10:27.440166 27417 ts_tablet_manager.cc:1403] T c972f59715c6476fb68a0a9dcc7b54d3 P dd2dd298b4404607b3f3a14b89cbbee4: Time spent bootstrapping tablet: real 0.163s	user 0.013s	sys 0.017s
I20260709 13:10:27.442027 27419 raft_consensus.cc:359] T b33f79df36ce42da96dda6972776a01d P e7c0341504c3426280338a5599607a0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:27.442968 27419 raft_consensus.cc:385] T b33f79df36ce42da96dda6972776a01d P e7c0341504c3426280338a5599607a0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:27.443099 27417 raft_consensus.cc:359] T c972f59715c6476fb68a0a9dcc7b54d3 P dd2dd298b4404607b3f3a14b89cbbee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:27.443372 27419 raft_consensus.cc:740] T b33f79df36ce42da96dda6972776a01d P e7c0341504c3426280338a5599607a0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7c0341504c3426280338a5599607a0d, State: Initialized, Role: FOLLOWER
I20260709 13:10:27.443919 27417 raft_consensus.cc:385] T c972f59715c6476fb68a0a9dcc7b54d3 P dd2dd298b4404607b3f3a14b89cbbee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:27.444362 27417 raft_consensus.cc:740] T c972f59715c6476fb68a0a9dcc7b54d3 P dd2dd298b4404607b3f3a14b89cbbee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd2dd298b4404607b3f3a14b89cbbee4, State: Initialized, Role: FOLLOWER
I20260709 13:10:27.444443 27419 consensus_queue.cc:260] T b33f79df36ce42da96dda6972776a01d P e7c0341504c3426280338a5599607a0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:27.443542 27418 raft_consensus.cc:359] T aa6e8c327dde42d3808411b7117dda68 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:27.445916 27418 raft_consensus.cc:385] T aa6e8c327dde42d3808411b7117dda68 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:27.445129 27417 consensus_queue.cc:260] T c972f59715c6476fb68a0a9dcc7b54d3 P dd2dd298b4404607b3f3a14b89cbbee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:27.446256 27418 raft_consensus.cc:740] T aa6e8c327dde42d3808411b7117dda68 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f0541c7472e4aef9aac8ad7d02e8e48, State: Initialized, Role: FOLLOWER
I20260709 13:10:27.447412 27419 ts_tablet_manager.cc:1434] T b33f79df36ce42da96dda6972776a01d P e7c0341504c3426280338a5599607a0d: Time spent starting tablet: real 0.008s	user 0.000s	sys 0.008s
I20260709 13:10:27.447314 27418 consensus_queue.cc:260] T aa6e8c327dde42d3808411b7117dda68 P 9f0541c7472e4aef9aac8ad7d02e8e48 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:27.448426 27417 ts_tablet_manager.cc:1434] T c972f59715c6476fb68a0a9dcc7b54d3 P dd2dd298b4404607b3f3a14b89cbbee4: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:10:27.448942 27419 tablet_bootstrap.cc:492] T e41aaa6d8213447b972d3eed31538da1 P e7c0341504c3426280338a5599607a0d: Bootstrap starting.
I20260709 13:10:27.449558 27417 tablet_bootstrap.cc:492] T e41aaa6d8213447b972d3eed31538da1 P dd2dd298b4404607b3f3a14b89cbbee4: Bootstrap starting.
I20260709 13:10:27.456231 27418 ts_tablet_manager.cc:1434] T aa6e8c327dde42d3808411b7117dda68 P 9f0541c7472e4aef9aac8ad7d02e8e48: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:10:27.457602 27418 tablet_bootstrap.cc:492] T e41aaa6d8213447b972d3eed31538da1 P 9f0541c7472e4aef9aac8ad7d02e8e48: Bootstrap starting.
I20260709 13:10:27.458127 27417 tablet_bootstrap.cc:654] T e41aaa6d8213447b972d3eed31538da1 P dd2dd298b4404607b3f3a14b89cbbee4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:27.463310 27419 tablet_bootstrap.cc:654] T e41aaa6d8213447b972d3eed31538da1 P e7c0341504c3426280338a5599607a0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:27.466630 27418 tablet_bootstrap.cc:654] T e41aaa6d8213447b972d3eed31538da1 P 9f0541c7472e4aef9aac8ad7d02e8e48: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:27.472505 27419 tablet_bootstrap.cc:492] T e41aaa6d8213447b972d3eed31538da1 P e7c0341504c3426280338a5599607a0d: No bootstrap required, opened a new log
I20260709 13:10:27.473351 27419 ts_tablet_manager.cc:1403] T e41aaa6d8213447b972d3eed31538da1 P e7c0341504c3426280338a5599607a0d: Time spent bootstrapping tablet: real 0.025s	user 0.011s	sys 0.003s
I20260709 13:10:27.479677 27418 tablet_bootstrap.cc:492] T e41aaa6d8213447b972d3eed31538da1 P 9f0541c7472e4aef9aac8ad7d02e8e48: No bootstrap required, opened a new log
I20260709 13:10:27.479328 27419 raft_consensus.cc:359] T e41aaa6d8213447b972d3eed31538da1 P e7c0341504c3426280338a5599607a0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:27.480206 27419 raft_consensus.cc:385] T e41aaa6d8213447b972d3eed31538da1 P e7c0341504c3426280338a5599607a0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:27.480370 27418 ts_tablet_manager.cc:1403] T e41aaa6d8213447b972d3eed31538da1 P 9f0541c7472e4aef9aac8ad7d02e8e48: Time spent bootstrapping tablet: real 0.023s	user 0.016s	sys 0.004s
I20260709 13:10:27.480597 27419 raft_consensus.cc:740] T e41aaa6d8213447b972d3eed31538da1 P e7c0341504c3426280338a5599607a0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7c0341504c3426280338a5599607a0d, State: Initialized, Role: FOLLOWER
I20260709 13:10:27.480734 27417 tablet_bootstrap.cc:492] T e41aaa6d8213447b972d3eed31538da1 P dd2dd298b4404607b3f3a14b89cbbee4: No bootstrap required, opened a new log
I20260709 13:10:27.481544 27417 ts_tablet_manager.cc:1403] T e41aaa6d8213447b972d3eed31538da1 P dd2dd298b4404607b3f3a14b89cbbee4: Time spent bootstrapping tablet: real 0.032s	user 0.004s	sys 0.018s
I20260709 13:10:27.481643 27419 consensus_queue.cc:260] T e41aaa6d8213447b972d3eed31538da1 P e7c0341504c3426280338a5599607a0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:27.484808 27418 raft_consensus.cc:359] T e41aaa6d8213447b972d3eed31538da1 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:27.485086 27417 raft_consensus.cc:359] T e41aaa6d8213447b972d3eed31538da1 P dd2dd298b4404607b3f3a14b89cbbee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:27.486280 27418 raft_consensus.cc:385] T e41aaa6d8213447b972d3eed31538da1 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:27.486399 27417 raft_consensus.cc:385] T e41aaa6d8213447b972d3eed31538da1 P dd2dd298b4404607b3f3a14b89cbbee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:27.487248 27417 raft_consensus.cc:740] T e41aaa6d8213447b972d3eed31538da1 P dd2dd298b4404607b3f3a14b89cbbee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd2dd298b4404607b3f3a14b89cbbee4, State: Initialized, Role: FOLLOWER
I20260709 13:10:27.487142 27418 raft_consensus.cc:740] T e41aaa6d8213447b972d3eed31538da1 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f0541c7472e4aef9aac8ad7d02e8e48, State: Initialized, Role: FOLLOWER
I20260709 13:10:27.488930 27417 consensus_queue.cc:260] T e41aaa6d8213447b972d3eed31538da1 P dd2dd298b4404607b3f3a14b89cbbee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:27.488741 27418 consensus_queue.cc:260] T e41aaa6d8213447b972d3eed31538da1 P 9f0541c7472e4aef9aac8ad7d02e8e48 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:27.492039 27417 ts_tablet_manager.cc:1434] T e41aaa6d8213447b972d3eed31538da1 P dd2dd298b4404607b3f3a14b89cbbee4: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:10:27.492491 27419 ts_tablet_manager.cc:1434] T e41aaa6d8213447b972d3eed31538da1 P e7c0341504c3426280338a5599607a0d: Time spent starting tablet: real 0.019s	user 0.015s	sys 0.003s
I20260709 13:10:27.492826 27418 ts_tablet_manager.cc:1434] T e41aaa6d8213447b972d3eed31538da1 P 9f0541c7472e4aef9aac8ad7d02e8e48: Time spent starting tablet: real 0.012s	user 0.013s	sys 0.000s
I20260709 13:10:27.493556 27417 tablet_bootstrap.cc:492] T aa6e8c327dde42d3808411b7117dda68 P dd2dd298b4404607b3f3a14b89cbbee4: Bootstrap starting.
I20260709 13:10:27.493989 27418 tablet_bootstrap.cc:492] T c972f59715c6476fb68a0a9dcc7b54d3 P 9f0541c7472e4aef9aac8ad7d02e8e48: Bootstrap starting.
I20260709 13:10:27.497747 27419 tablet_bootstrap.cc:492] T c972f59715c6476fb68a0a9dcc7b54d3 P e7c0341504c3426280338a5599607a0d: Bootstrap starting.
I20260709 13:10:27.501011 27343 raft_consensus.cc:493] T b33f79df36ce42da96dda6972776a01d P e7c0341504c3426280338a5599607a0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.501686 27343 raft_consensus.cc:515] T b33f79df36ce42da96dda6972776a01d P e7c0341504c3426280338a5599607a0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:27.504349 27426 raft_consensus.cc:493] T e41aaa6d8213447b972d3eed31538da1 P e7c0341504c3426280338a5599607a0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.505236 27343 leader_election.cc:290] T b33f79df36ce42da96dda6972776a01d P e7c0341504c3426280338a5599607a0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9f0541c7472e4aef9aac8ad7d02e8e48 (127.14.180.66:41411), dd2dd298b4404607b3f3a14b89cbbee4 (127.14.180.67:40131)
I20260709 13:10:27.504987 27426 raft_consensus.cc:515] T e41aaa6d8213447b972d3eed31538da1 P e7c0341504c3426280338a5599607a0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:27.506006 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33f79df36ce42da96dda6972776a01d" candidate_uuid: "e7c0341504c3426280338a5599607a0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" is_pre_election: true
I20260709 13:10:27.502537 27418 tablet_bootstrap.cc:654] T c972f59715c6476fb68a0a9dcc7b54d3 P 9f0541c7472e4aef9aac8ad7d02e8e48: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:27.509482 27419 tablet_bootstrap.cc:654] T c972f59715c6476fb68a0a9dcc7b54d3 P e7c0341504c3426280338a5599607a0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:27.510135 27426 leader_election.cc:290] T e41aaa6d8213447b972d3eed31538da1 P e7c0341504c3426280338a5599607a0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9f0541c7472e4aef9aac8ad7d02e8e48 (127.14.180.66:41411), dd2dd298b4404607b3f3a14b89cbbee4 (127.14.180.67:40131)
W20260709 13:10:27.510663 27087 leader_election.cc:343] T b33f79df36ce42da96dda6972776a01d P e7c0341504c3426280338a5599607a0d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer dd2dd298b4404607b3f3a14b89cbbee4 (127.14.180.67:40131): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:27.512662 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e41aaa6d8213447b972d3eed31538da1" candidate_uuid: "e7c0341504c3426280338a5599607a0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" is_pre_election: true
I20260709 13:10:27.515164 27270 raft_consensus.cc:2468] T e41aaa6d8213447b972d3eed31538da1 P dd2dd298b4404607b3f3a14b89cbbee4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e7c0341504c3426280338a5599607a0d in term 0.
I20260709 13:10:27.516606 27087 leader_election.cc:304] T e41aaa6d8213447b972d3eed31538da1 P e7c0341504c3426280338a5599607a0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dd2dd298b4404607b3f3a14b89cbbee4, e7c0341504c3426280338a5599607a0d; no voters: 
I20260709 13:10:27.516700 27194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33f79df36ce42da96dda6972776a01d" candidate_uuid: "e7c0341504c3426280338a5599607a0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" is_pre_election: true
I20260709 13:10:27.517335 27417 tablet_bootstrap.cc:654] T aa6e8c327dde42d3808411b7117dda68 P dd2dd298b4404607b3f3a14b89cbbee4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:27.522063 27343 raft_consensus.cc:2804] T e41aaa6d8213447b972d3eed31538da1 P e7c0341504c3426280338a5599607a0d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:27.522710 27343 raft_consensus.cc:493] T e41aaa6d8213447b972d3eed31538da1 P e7c0341504c3426280338a5599607a0d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:27.523085 27343 raft_consensus.cc:3060] T e41aaa6d8213447b972d3eed31538da1 P e7c0341504c3426280338a5599607a0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:27.527015 27194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e41aaa6d8213447b972d3eed31538da1" candidate_uuid: "e7c0341504c3426280338a5599607a0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" is_pre_election: true
I20260709 13:10:27.527817 27194 raft_consensus.cc:2468] T e41aaa6d8213447b972d3eed31538da1 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e7c0341504c3426280338a5599607a0d in term 0.
I20260709 13:10:27.534510 27418 tablet_bootstrap.cc:492] T c972f59715c6476fb68a0a9dcc7b54d3 P 9f0541c7472e4aef9aac8ad7d02e8e48: No bootstrap required, opened a new log
I20260709 13:10:27.541834 27419 tablet_bootstrap.cc:492] T c972f59715c6476fb68a0a9dcc7b54d3 P e7c0341504c3426280338a5599607a0d: No bootstrap required, opened a new log
I20260709 13:10:27.542843 27419 ts_tablet_manager.cc:1403] T c972f59715c6476fb68a0a9dcc7b54d3 P e7c0341504c3426280338a5599607a0d: Time spent bootstrapping tablet: real 0.045s	user 0.025s	sys 0.004s
I20260709 13:10:27.536733 27418 ts_tablet_manager.cc:1403] T c972f59715c6476fb68a0a9dcc7b54d3 P 9f0541c7472e4aef9aac8ad7d02e8e48: Time spent bootstrapping tablet: real 0.043s	user 0.023s	sys 0.006s
W20260709 13:10:27.551179 27085 leader_election.cc:343] T b33f79df36ce42da96dda6972776a01d P e7c0341504c3426280338a5599607a0d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9f0541c7472e4aef9aac8ad7d02e8e48 (127.14.180.66:41411): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:27.551762 27085 leader_election.cc:304] T b33f79df36ce42da96dda6972776a01d P e7c0341504c3426280338a5599607a0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e7c0341504c3426280338a5599607a0d; no voters: 9f0541c7472e4aef9aac8ad7d02e8e48, dd2dd298b4404607b3f3a14b89cbbee4
I20260709 13:10:27.552551 27426 raft_consensus.cc:2749] T b33f79df36ce42da96dda6972776a01d P e7c0341504c3426280338a5599607a0d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:27.560367 27419 raft_consensus.cc:359] T c972f59715c6476fb68a0a9dcc7b54d3 P e7c0341504c3426280338a5599607a0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:27.561267 27419 raft_consensus.cc:385] T c972f59715c6476fb68a0a9dcc7b54d3 P e7c0341504c3426280338a5599607a0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:27.561432 27417 tablet_bootstrap.cc:492] T aa6e8c327dde42d3808411b7117dda68 P dd2dd298b4404607b3f3a14b89cbbee4: No bootstrap required, opened a new log
I20260709 13:10:27.561581 27419 raft_consensus.cc:740] T c972f59715c6476fb68a0a9dcc7b54d3 P e7c0341504c3426280338a5599607a0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7c0341504c3426280338a5599607a0d, State: Initialized, Role: FOLLOWER
I20260709 13:10:27.562325 27417 ts_tablet_manager.cc:1403] T aa6e8c327dde42d3808411b7117dda68 P dd2dd298b4404607b3f3a14b89cbbee4: Time spent bootstrapping tablet: real 0.069s	user 0.019s	sys 0.020s
I20260709 13:10:27.562189 27343 raft_consensus.cc:515] T e41aaa6d8213447b972d3eed31538da1 P e7c0341504c3426280338a5599607a0d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:27.562755 27419 consensus_queue.cc:260] T c972f59715c6476fb68a0a9dcc7b54d3 P e7c0341504c3426280338a5599607a0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:27.564754 27343 leader_election.cc:290] T e41aaa6d8213447b972d3eed31538da1 P e7c0341504c3426280338a5599607a0d [CANDIDATE]: Term 1 election: Requested vote from peers 9f0541c7472e4aef9aac8ad7d02e8e48 (127.14.180.66:41411), dd2dd298b4404607b3f3a14b89cbbee4 (127.14.180.67:40131)
I20260709 13:10:27.565721 27194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e41aaa6d8213447b972d3eed31538da1" candidate_uuid: "e7c0341504c3426280338a5599607a0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48"
I20260709 13:10:27.566483 27194 raft_consensus.cc:3060] T e41aaa6d8213447b972d3eed31538da1 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:27.566079 27417 raft_consensus.cc:359] T aa6e8c327dde42d3808411b7117dda68 P dd2dd298b4404607b3f3a14b89cbbee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:27.567090 27417 raft_consensus.cc:385] T aa6e8c327dde42d3808411b7117dda68 P dd2dd298b4404607b3f3a14b89cbbee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:27.567477 27417 raft_consensus.cc:740] T aa6e8c327dde42d3808411b7117dda68 P dd2dd298b4404607b3f3a14b89cbbee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd2dd298b4404607b3f3a14b89cbbee4, State: Initialized, Role: FOLLOWER
I20260709 13:10:27.568288 27417 consensus_queue.cc:260] T aa6e8c327dde42d3808411b7117dda68 P dd2dd298b4404607b3f3a14b89cbbee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:27.568444 27269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e41aaa6d8213447b972d3eed31538da1" candidate_uuid: "e7c0341504c3426280338a5599607a0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd2dd298b4404607b3f3a14b89cbbee4"
I20260709 13:10:27.569191 27269 raft_consensus.cc:3060] T e41aaa6d8213447b972d3eed31538da1 P dd2dd298b4404607b3f3a14b89cbbee4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:27.570998 27417 ts_tablet_manager.cc:1434] T aa6e8c327dde42d3808411b7117dda68 P dd2dd298b4404607b3f3a14b89cbbee4: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:10:27.572422 27417 tablet_bootstrap.cc:492] T deb0ef2084cc4ddf88165639552f3161 P dd2dd298b4404607b3f3a14b89cbbee4: Bootstrap starting.
I20260709 13:10:27.579351 27417 tablet_bootstrap.cc:654] T deb0ef2084cc4ddf88165639552f3161 P dd2dd298b4404607b3f3a14b89cbbee4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:27.582522 27194 raft_consensus.cc:2468] T e41aaa6d8213447b972d3eed31538da1 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7c0341504c3426280338a5599607a0d in term 1.
I20260709 13:10:27.550751 27418 raft_consensus.cc:359] T c972f59715c6476fb68a0a9dcc7b54d3 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:27.583843 27343 raft_consensus.cc:493] T c972f59715c6476fb68a0a9dcc7b54d3 P e7c0341504c3426280338a5599607a0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.584261 27418 raft_consensus.cc:385] T c972f59715c6476fb68a0a9dcc7b54d3 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:27.584619 27418 raft_consensus.cc:740] T c972f59715c6476fb68a0a9dcc7b54d3 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f0541c7472e4aef9aac8ad7d02e8e48, State: Initialized, Role: FOLLOWER
I20260709 13:10:27.584421 27343 raft_consensus.cc:515] T c972f59715c6476fb68a0a9dcc7b54d3 P e7c0341504c3426280338a5599607a0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:27.582522 27269 raft_consensus.cc:2468] T e41aaa6d8213447b972d3eed31538da1 P dd2dd298b4404607b3f3a14b89cbbee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7c0341504c3426280338a5599607a0d in term 1.
I20260709 13:10:27.583941 27419 ts_tablet_manager.cc:1434] T c972f59715c6476fb68a0a9dcc7b54d3 P e7c0341504c3426280338a5599607a0d: Time spent starting tablet: real 0.041s	user 0.008s	sys 0.001s
I20260709 13:10:27.585433 27418 consensus_queue.cc:260] T c972f59715c6476fb68a0a9dcc7b54d3 P 9f0541c7472e4aef9aac8ad7d02e8e48 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:27.587389 27419 tablet_bootstrap.cc:492] T aa6e8c327dde42d3808411b7117dda68 P e7c0341504c3426280338a5599607a0d: Bootstrap starting.
I20260709 13:10:27.588047 27343 leader_election.cc:290] T c972f59715c6476fb68a0a9dcc7b54d3 P e7c0341504c3426280338a5599607a0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9f0541c7472e4aef9aac8ad7d02e8e48 (127.14.180.66:41411), dd2dd298b4404607b3f3a14b89cbbee4 (127.14.180.67:40131)
I20260709 13:10:27.592360 27417 tablet_bootstrap.cc:492] T deb0ef2084cc4ddf88165639552f3161 P dd2dd298b4404607b3f3a14b89cbbee4: No bootstrap required, opened a new log
I20260709 13:10:27.593092 27417 ts_tablet_manager.cc:1403] T deb0ef2084cc4ddf88165639552f3161 P dd2dd298b4404607b3f3a14b89cbbee4: Time spent bootstrapping tablet: real 0.021s	user 0.017s	sys 0.000s
I20260709 13:10:27.586149 27085 leader_election.cc:304] T e41aaa6d8213447b972d3eed31538da1 P e7c0341504c3426280338a5599607a0d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f0541c7472e4aef9aac8ad7d02e8e48, e7c0341504c3426280338a5599607a0d; no voters: 
I20260709 13:10:27.596804 27417 raft_consensus.cc:359] T deb0ef2084cc4ddf88165639552f3161 P dd2dd298b4404607b3f3a14b89cbbee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:27.597762 27417 raft_consensus.cc:385] T deb0ef2084cc4ddf88165639552f3161 P dd2dd298b4404607b3f3a14b89cbbee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:27.598120 27417 raft_consensus.cc:740] T deb0ef2084cc4ddf88165639552f3161 P dd2dd298b4404607b3f3a14b89cbbee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd2dd298b4404607b3f3a14b89cbbee4, State: Initialized, Role: FOLLOWER
I20260709 13:10:27.598419 27418 ts_tablet_manager.cc:1434] T c972f59715c6476fb68a0a9dcc7b54d3 P 9f0541c7472e4aef9aac8ad7d02e8e48: Time spent starting tablet: real 0.052s	user 0.005s	sys 0.004s
I20260709 13:10:27.599102 27417 consensus_queue.cc:260] T deb0ef2084cc4ddf88165639552f3161 P dd2dd298b4404607b3f3a14b89cbbee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:27.600004 27195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c972f59715c6476fb68a0a9dcc7b54d3" candidate_uuid: "e7c0341504c3426280338a5599607a0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" is_pre_election: true
I20260709 13:10:27.600745 27195 raft_consensus.cc:2468] T c972f59715c6476fb68a0a9dcc7b54d3 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e7c0341504c3426280338a5599607a0d in term 0.
I20260709 13:10:27.601991 27417 ts_tablet_manager.cc:1434] T deb0ef2084cc4ddf88165639552f3161 P dd2dd298b4404607b3f3a14b89cbbee4: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:10:27.602562 27085 leader_election.cc:304] T c972f59715c6476fb68a0a9dcc7b54d3 P e7c0341504c3426280338a5599607a0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f0541c7472e4aef9aac8ad7d02e8e48, e7c0341504c3426280338a5599607a0d; no voters: 
I20260709 13:10:27.603405 27417 tablet_bootstrap.cc:492] T b33f79df36ce42da96dda6972776a01d P dd2dd298b4404607b3f3a14b89cbbee4: Bootstrap starting.
I20260709 13:10:27.603801 27426 raft_consensus.cc:2804] T e41aaa6d8213447b972d3eed31538da1 P e7c0341504c3426280338a5599607a0d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:27.603915 27343 raft_consensus.cc:2804] T c972f59715c6476fb68a0a9dcc7b54d3 P e7c0341504c3426280338a5599607a0d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:27.605579 27343 raft_consensus.cc:493] T c972f59715c6476fb68a0a9dcc7b54d3 P e7c0341504c3426280338a5599607a0d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:27.606171 27343 raft_consensus.cc:3060] T c972f59715c6476fb68a0a9dcc7b54d3 P e7c0341504c3426280338a5599607a0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:27.612113 27417 tablet_bootstrap.cc:654] T b33f79df36ce42da96dda6972776a01d P dd2dd298b4404607b3f3a14b89cbbee4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:27.616261 27269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c972f59715c6476fb68a0a9dcc7b54d3" candidate_uuid: "e7c0341504c3426280338a5599607a0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" is_pre_election: true
I20260709 13:10:27.617360 27269 raft_consensus.cc:2468] T c972f59715c6476fb68a0a9dcc7b54d3 P dd2dd298b4404607b3f3a14b89cbbee4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e7c0341504c3426280338a5599607a0d in term 0.
I20260709 13:10:27.616448 27343 raft_consensus.cc:515] T c972f59715c6476fb68a0a9dcc7b54d3 P e7c0341504c3426280338a5599607a0d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:27.621014 27418 tablet_bootstrap.cc:492] T 83e5ce6906634b63a01333e50b5622be P 9f0541c7472e4aef9aac8ad7d02e8e48: Bootstrap starting.
I20260709 13:10:27.622815 27194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c972f59715c6476fb68a0a9dcc7b54d3" candidate_uuid: "e7c0341504c3426280338a5599607a0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48"
I20260709 13:10:27.623618 27194 raft_consensus.cc:3060] T c972f59715c6476fb68a0a9dcc7b54d3 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:27.624660 27417 tablet_bootstrap.cc:492] T b33f79df36ce42da96dda6972776a01d P dd2dd298b4404607b3f3a14b89cbbee4: No bootstrap required, opened a new log
I20260709 13:10:27.625308 27417 ts_tablet_manager.cc:1403] T b33f79df36ce42da96dda6972776a01d P dd2dd298b4404607b3f3a14b89cbbee4: Time spent bootstrapping tablet: real 0.022s	user 0.015s	sys 0.000s
I20260709 13:10:27.629104 27417 raft_consensus.cc:359] T b33f79df36ce42da96dda6972776a01d P dd2dd298b4404607b3f3a14b89cbbee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:27.629863 27418 tablet_bootstrap.cc:654] T 83e5ce6906634b63a01333e50b5622be P 9f0541c7472e4aef9aac8ad7d02e8e48: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:27.630021 27417 raft_consensus.cc:385] T b33f79df36ce42da96dda6972776a01d P dd2dd298b4404607b3f3a14b89cbbee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:27.630771 27417 raft_consensus.cc:740] T b33f79df36ce42da96dda6972776a01d P dd2dd298b4404607b3f3a14b89cbbee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd2dd298b4404607b3f3a14b89cbbee4, State: Initialized, Role: FOLLOWER
I20260709 13:10:27.631795 27417 consensus_queue.cc:260] T b33f79df36ce42da96dda6972776a01d P dd2dd298b4404607b3f3a14b89cbbee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:27.633409 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c972f59715c6476fb68a0a9dcc7b54d3" candidate_uuid: "e7c0341504c3426280338a5599607a0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd2dd298b4404607b3f3a14b89cbbee4"
I20260709 13:10:27.634177 27270 raft_consensus.cc:3060] T c972f59715c6476fb68a0a9dcc7b54d3 P dd2dd298b4404607b3f3a14b89cbbee4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:27.634722 27417 ts_tablet_manager.cc:1434] T b33f79df36ce42da96dda6972776a01d P dd2dd298b4404607b3f3a14b89cbbee4: Time spent starting tablet: real 0.009s	user 0.012s	sys 0.000s
I20260709 13:10:27.635963 27417 tablet_bootstrap.cc:492] T f9463aebc13b49339561c1f5436e3142 P dd2dd298b4404607b3f3a14b89cbbee4: Bootstrap starting.
I20260709 13:10:27.639602 27419 tablet_bootstrap.cc:654] T aa6e8c327dde42d3808411b7117dda68 P e7c0341504c3426280338a5599607a0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:27.643563 27417 tablet_bootstrap.cc:654] T f9463aebc13b49339561c1f5436e3142 P dd2dd298b4404607b3f3a14b89cbbee4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:27.646629 27426 raft_consensus.cc:697] T e41aaa6d8213447b972d3eed31538da1 P e7c0341504c3426280338a5599607a0d [term 1 LEADER]: Becoming Leader. State: Replica: e7c0341504c3426280338a5599607a0d, State: Running, Role: LEADER
I20260709 13:10:27.647718 27426 consensus_queue.cc:237] T e41aaa6d8213447b972d3eed31538da1 P e7c0341504c3426280338a5599607a0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:27.634040 27194 raft_consensus.cc:2468] T c972f59715c6476fb68a0a9dcc7b54d3 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7c0341504c3426280338a5599607a0d in term 1.
I20260709 13:10:27.620942 27343 leader_election.cc:290] T c972f59715c6476fb68a0a9dcc7b54d3 P e7c0341504c3426280338a5599607a0d [CANDIDATE]: Term 1 election: Requested vote from peers 9f0541c7472e4aef9aac8ad7d02e8e48 (127.14.180.66:41411), dd2dd298b4404607b3f3a14b89cbbee4 (127.14.180.67:40131)
I20260709 13:10:27.655176 27085 leader_election.cc:304] T c972f59715c6476fb68a0a9dcc7b54d3 P e7c0341504c3426280338a5599607a0d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f0541c7472e4aef9aac8ad7d02e8e48, e7c0341504c3426280338a5599607a0d; no voters: 
I20260709 13:10:27.658118 27418 tablet_bootstrap.cc:492] T 83e5ce6906634b63a01333e50b5622be P 9f0541c7472e4aef9aac8ad7d02e8e48: No bootstrap required, opened a new log
I20260709 13:10:27.656558 27343 raft_consensus.cc:2804] T c972f59715c6476fb68a0a9dcc7b54d3 P e7c0341504c3426280338a5599607a0d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:27.659052 27418 ts_tablet_manager.cc:1403] T 83e5ce6906634b63a01333e50b5622be P 9f0541c7472e4aef9aac8ad7d02e8e48: Time spent bootstrapping tablet: real 0.038s	user 0.015s	sys 0.007s
I20260709 13:10:27.659147 27417 tablet_bootstrap.cc:492] T f9463aebc13b49339561c1f5436e3142 P dd2dd298b4404607b3f3a14b89cbbee4: No bootstrap required, opened a new log
I20260709 13:10:27.660030 27417 ts_tablet_manager.cc:1403] T f9463aebc13b49339561c1f5436e3142 P dd2dd298b4404607b3f3a14b89cbbee4: Time spent bootstrapping tablet: real 0.024s	user 0.015s	sys 0.003s
I20260709 13:10:27.659247 27343 raft_consensus.cc:697] T c972f59715c6476fb68a0a9dcc7b54d3 P e7c0341504c3426280338a5599607a0d [term 1 LEADER]: Becoming Leader. State: Replica: e7c0341504c3426280338a5599607a0d, State: Running, Role: LEADER
I20260709 13:10:27.661756 27343 consensus_queue.cc:237] T c972f59715c6476fb68a0a9dcc7b54d3 P e7c0341504c3426280338a5599607a0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:27.663426 27417 raft_consensus.cc:359] T f9463aebc13b49339561c1f5436e3142 P dd2dd298b4404607b3f3a14b89cbbee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:27.664306 27417 raft_consensus.cc:385] T f9463aebc13b49339561c1f5436e3142 P dd2dd298b4404607b3f3a14b89cbbee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:27.664906 27417 raft_consensus.cc:740] T f9463aebc13b49339561c1f5436e3142 P dd2dd298b4404607b3f3a14b89cbbee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd2dd298b4404607b3f3a14b89cbbee4, State: Initialized, Role: FOLLOWER
I20260709 13:10:27.664147 27418 raft_consensus.cc:359] T 83e5ce6906634b63a01333e50b5622be P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:27.665498 27418 raft_consensus.cc:385] T 83e5ce6906634b63a01333e50b5622be P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:27.665949 27418 raft_consensus.cc:740] T 83e5ce6906634b63a01333e50b5622be P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f0541c7472e4aef9aac8ad7d02e8e48, State: Initialized, Role: FOLLOWER
I20260709 13:10:27.665757 27417 consensus_queue.cc:260] T f9463aebc13b49339561c1f5436e3142 P dd2dd298b4404607b3f3a14b89cbbee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:27.667029 27418 consensus_queue.cc:260] T 83e5ce6906634b63a01333e50b5622be P 9f0541c7472e4aef9aac8ad7d02e8e48 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:27.668671 27417 ts_tablet_manager.cc:1434] T f9463aebc13b49339561c1f5436e3142 P dd2dd298b4404607b3f3a14b89cbbee4: Time spent starting tablet: real 0.008s	user 0.001s	sys 0.008s
I20260709 13:10:27.670224 27417 tablet_bootstrap.cc:492] T 83e5ce6906634b63a01333e50b5622be P dd2dd298b4404607b3f3a14b89cbbee4: Bootstrap starting.
I20260709 13:10:27.672821 27270 raft_consensus.cc:2468] T c972f59715c6476fb68a0a9dcc7b54d3 P dd2dd298b4404607b3f3a14b89cbbee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7c0341504c3426280338a5599607a0d in term 1.
I20260709 13:10:27.681053 27417 tablet_bootstrap.cc:654] T 83e5ce6906634b63a01333e50b5622be P dd2dd298b4404607b3f3a14b89cbbee4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:27.684176 27018 catalog_manager.cc:5697] T e41aaa6d8213447b972d3eed31538da1 P e7c0341504c3426280338a5599607a0d reported cstate change: term changed from 0 to 1, leader changed from <none> to e7c0341504c3426280338a5599607a0d (127.14.180.65). New cstate: current_term: 1 leader_uuid: "e7c0341504c3426280338a5599607a0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:27.687436 27405 raft_consensus.cc:493] T b33f79df36ce42da96dda6972776a01d P dd2dd298b4404607b3f3a14b89cbbee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.688067 27405 raft_consensus.cc:515] T b33f79df36ce42da96dda6972776a01d P dd2dd298b4404607b3f3a14b89cbbee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:27.690068 27417 tablet_bootstrap.cc:492] T 83e5ce6906634b63a01333e50b5622be P dd2dd298b4404607b3f3a14b89cbbee4: No bootstrap required, opened a new log
I20260709 13:10:27.690940 27417 ts_tablet_manager.cc:1403] T 83e5ce6906634b63a01333e50b5622be P dd2dd298b4404607b3f3a14b89cbbee4: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.003s
I20260709 13:10:27.693909 27194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33f79df36ce42da96dda6972776a01d" candidate_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" is_pre_election: true
I20260709 13:10:27.694970 27121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33f79df36ce42da96dda6972776a01d" candidate_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7c0341504c3426280338a5599607a0d" is_pre_election: true
I20260709 13:10:27.695672 27121 raft_consensus.cc:2468] T b33f79df36ce42da96dda6972776a01d P e7c0341504c3426280338a5599607a0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd2dd298b4404607b3f3a14b89cbbee4 in term 0.
W20260709 13:10:27.696542 27234 leader_election.cc:343] T b33f79df36ce42da96dda6972776a01d P dd2dd298b4404607b3f3a14b89cbbee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9f0541c7472e4aef9aac8ad7d02e8e48 (127.14.180.66:41411): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:27.690526 27405 leader_election.cc:290] T b33f79df36ce42da96dda6972776a01d P dd2dd298b4404607b3f3a14b89cbbee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e7c0341504c3426280338a5599607a0d (127.14.180.65:41105), 9f0541c7472e4aef9aac8ad7d02e8e48 (127.14.180.66:41411)
I20260709 13:10:27.698463 27235 leader_election.cc:304] T b33f79df36ce42da96dda6972776a01d P dd2dd298b4404607b3f3a14b89cbbee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dd2dd298b4404607b3f3a14b89cbbee4, e7c0341504c3426280338a5599607a0d; no voters: 9f0541c7472e4aef9aac8ad7d02e8e48
I20260709 13:10:27.699258 27417 raft_consensus.cc:359] T 83e5ce6906634b63a01333e50b5622be P dd2dd298b4404607b3f3a14b89cbbee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:27.700189 27417 raft_consensus.cc:385] T 83e5ce6906634b63a01333e50b5622be P dd2dd298b4404607b3f3a14b89cbbee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:27.700207 27405 raft_consensus.cc:2804] T b33f79df36ce42da96dda6972776a01d P dd2dd298b4404607b3f3a14b89cbbee4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:27.700591 27417 raft_consensus.cc:740] T 83e5ce6906634b63a01333e50b5622be P dd2dd298b4404607b3f3a14b89cbbee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd2dd298b4404607b3f3a14b89cbbee4, State: Initialized, Role: FOLLOWER
I20260709 13:10:27.701296 27405 raft_consensus.cc:493] T b33f79df36ce42da96dda6972776a01d P dd2dd298b4404607b3f3a14b89cbbee4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:27.702172 27405 raft_consensus.cc:3060] T b33f79df36ce42da96dda6972776a01d P dd2dd298b4404607b3f3a14b89cbbee4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:27.701838 27417 consensus_queue.cc:260] T 83e5ce6906634b63a01333e50b5622be P dd2dd298b4404607b3f3a14b89cbbee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:27.702776 27419 tablet_bootstrap.cc:492] T aa6e8c327dde42d3808411b7117dda68 P e7c0341504c3426280338a5599607a0d: No bootstrap required, opened a new log
I20260709 13:10:27.703452 27419 ts_tablet_manager.cc:1403] T aa6e8c327dde42d3808411b7117dda68 P e7c0341504c3426280338a5599607a0d: Time spent bootstrapping tablet: real 0.116s	user 0.021s	sys 0.020s
I20260709 13:10:27.704128 27418 ts_tablet_manager.cc:1434] T 83e5ce6906634b63a01333e50b5622be P 9f0541c7472e4aef9aac8ad7d02e8e48: Time spent starting tablet: real 0.044s	user 0.008s	sys 0.001s
I20260709 13:10:27.708024 27419 raft_consensus.cc:359] T aa6e8c327dde42d3808411b7117dda68 P e7c0341504c3426280338a5599607a0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:27.708823 27418 tablet_bootstrap.cc:492] T f9463aebc13b49339561c1f5436e3142 P 9f0541c7472e4aef9aac8ad7d02e8e48: Bootstrap starting.
I20260709 13:10:27.708894 27419 raft_consensus.cc:385] T aa6e8c327dde42d3808411b7117dda68 P e7c0341504c3426280338a5599607a0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:27.710785 27419 raft_consensus.cc:740] T aa6e8c327dde42d3808411b7117dda68 P e7c0341504c3426280338a5599607a0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7c0341504c3426280338a5599607a0d, State: Initialized, Role: FOLLOWER
I20260709 13:10:27.711946 27419 consensus_queue.cc:260] T aa6e8c327dde42d3808411b7117dda68 P e7c0341504c3426280338a5599607a0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:27.716252 27419 ts_tablet_manager.cc:1434] T aa6e8c327dde42d3808411b7117dda68 P e7c0341504c3426280338a5599607a0d: Time spent starting tablet: real 0.012s	user 0.011s	sys 0.000s
I20260709 13:10:27.718000 27419 tablet_bootstrap.cc:492] T 83e5ce6906634b63a01333e50b5622be P e7c0341504c3426280338a5599607a0d: Bootstrap starting.
I20260709 13:10:27.728112 27405 raft_consensus.cc:515] T b33f79df36ce42da96dda6972776a01d P dd2dd298b4404607b3f3a14b89cbbee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:27.730302 27418 tablet_bootstrap.cc:654] T f9463aebc13b49339561c1f5436e3142 P 9f0541c7472e4aef9aac8ad7d02e8e48: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:27.734023 27121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33f79df36ce42da96dda6972776a01d" candidate_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7c0341504c3426280338a5599607a0d"
I20260709 13:10:27.734368 27405 leader_election.cc:290] T b33f79df36ce42da96dda6972776a01d P dd2dd298b4404607b3f3a14b89cbbee4 [CANDIDATE]: Term 1 election: Requested vote from peers e7c0341504c3426280338a5599607a0d (127.14.180.65:41105), 9f0541c7472e4aef9aac8ad7d02e8e48 (127.14.180.66:41411)
I20260709 13:10:27.734829 27121 raft_consensus.cc:3060] T b33f79df36ce42da96dda6972776a01d P e7c0341504c3426280338a5599607a0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:27.735019 27417 ts_tablet_manager.cc:1434] T 83e5ce6906634b63a01333e50b5622be P dd2dd298b4404607b3f3a14b89cbbee4: Time spent starting tablet: real 0.040s	user 0.017s	sys 0.012s
I20260709 13:10:27.736342 27417 tablet_bootstrap.cc:492] T d3aeec0e4dd34da6bb82d4774f566271 P dd2dd298b4404607b3f3a14b89cbbee4: Bootstrap starting.
I20260709 13:10:27.738965 27427 raft_consensus.cc:493] T aa6e8c327dde42d3808411b7117dda68 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.739558 27194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33f79df36ce42da96dda6972776a01d" candidate_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48"
I20260709 13:10:27.739583 27427 raft_consensus.cc:515] T aa6e8c327dde42d3808411b7117dda68 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
W20260709 13:10:27.741547 27234 leader_election.cc:343] T b33f79df36ce42da96dda6972776a01d P dd2dd298b4404607b3f3a14b89cbbee4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9f0541c7472e4aef9aac8ad7d02e8e48 (127.14.180.66:41411): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:27.742085 27427 leader_election.cc:290] T aa6e8c327dde42d3808411b7117dda68 P 9f0541c7472e4aef9aac8ad7d02e8e48 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e7c0341504c3426280338a5599607a0d (127.14.180.65:41105), dd2dd298b4404607b3f3a14b89cbbee4 (127.14.180.67:40131)
I20260709 13:10:27.743991 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6e8c327dde42d3808411b7117dda68" candidate_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" is_pre_election: true
I20260709 13:10:27.744495 27444 raft_consensus.cc:493] T f9463aebc13b49339561c1f5436e3142 P dd2dd298b4404607b3f3a14b89cbbee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.744839 27270 raft_consensus.cc:2468] T aa6e8c327dde42d3808411b7117dda68 P dd2dd298b4404607b3f3a14b89cbbee4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f0541c7472e4aef9aac8ad7d02e8e48 in term 0.
I20260709 13:10:27.745105 27444 raft_consensus.cc:515] T f9463aebc13b49339561c1f5436e3142 P dd2dd298b4404607b3f3a14b89cbbee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:27.743990 27120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6e8c327dde42d3808411b7117dda68" candidate_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7c0341504c3426280338a5599607a0d" is_pre_election: true
I20260709 13:10:27.746905 27120 raft_consensus.cc:2468] T aa6e8c327dde42d3808411b7117dda68 P e7c0341504c3426280338a5599607a0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f0541c7472e4aef9aac8ad7d02e8e48 in term 0.
I20260709 13:10:27.746905 27162 leader_election.cc:304] T aa6e8c327dde42d3808411b7117dda68 P 9f0541c7472e4aef9aac8ad7d02e8e48 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f0541c7472e4aef9aac8ad7d02e8e48, dd2dd298b4404607b3f3a14b89cbbee4; no voters: 
I20260709 13:10:27.747478 27444 leader_election.cc:290] T f9463aebc13b49339561c1f5436e3142 P dd2dd298b4404607b3f3a14b89cbbee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e7c0341504c3426280338a5599607a0d (127.14.180.65:41105), 9f0541c7472e4aef9aac8ad7d02e8e48 (127.14.180.66:41411)
I20260709 13:10:27.748031 27427 raft_consensus.cc:2804] T aa6e8c327dde42d3808411b7117dda68 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:27.751781 27119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9463aebc13b49339561c1f5436e3142" candidate_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7c0341504c3426280338a5599607a0d" is_pre_election: true
I20260709 13:10:27.755556 27417 tablet_bootstrap.cc:654] T d3aeec0e4dd34da6bb82d4774f566271 P dd2dd298b4404607b3f3a14b89cbbee4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:27.752151 27194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9463aebc13b49339561c1f5436e3142" candidate_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" is_pre_election: true
I20260709 13:10:27.752171 27427 raft_consensus.cc:493] T aa6e8c327dde42d3808411b7117dda68 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:27.759799 27427 raft_consensus.cc:3060] T aa6e8c327dde42d3808411b7117dda68 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:27.757493 27235 leader_election.cc:343] T f9463aebc13b49339561c1f5436e3142 P dd2dd298b4404607b3f3a14b89cbbee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e7c0341504c3426280338a5599607a0d (127.14.180.65:41105): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:27.756723 27444 raft_consensus.cc:493] T 83e5ce6906634b63a01333e50b5622be P dd2dd298b4404607b3f3a14b89cbbee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.760957 27444 raft_consensus.cc:515] T 83e5ce6906634b63a01333e50b5622be P dd2dd298b4404607b3f3a14b89cbbee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:27.763348 27444 leader_election.cc:290] T 83e5ce6906634b63a01333e50b5622be P dd2dd298b4404607b3f3a14b89cbbee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e7c0341504c3426280338a5599607a0d (127.14.180.65:41105), 9f0541c7472e4aef9aac8ad7d02e8e48 (127.14.180.66:41411)
I20260709 13:10:27.765043 27119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e5ce6906634b63a01333e50b5622be" candidate_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7c0341504c3426280338a5599607a0d" is_pre_election: true
W20260709 13:10:27.766880 27235 leader_election.cc:343] T 83e5ce6906634b63a01333e50b5622be P dd2dd298b4404607b3f3a14b89cbbee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e7c0341504c3426280338a5599607a0d (127.14.180.65:41105): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:27.767503 27419 tablet_bootstrap.cc:654] T 83e5ce6906634b63a01333e50b5622be P e7c0341504c3426280338a5599607a0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:27.763463 27121 raft_consensus.cc:2468] T b33f79df36ce42da96dda6972776a01d P e7c0341504c3426280338a5599607a0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd2dd298b4404607b3f3a14b89cbbee4 in term 1.
I20260709 13:10:27.772451 27235 leader_election.cc:304] T b33f79df36ce42da96dda6972776a01d P dd2dd298b4404607b3f3a14b89cbbee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: dd2dd298b4404607b3f3a14b89cbbee4, e7c0341504c3426280338a5599607a0d; no voters: 9f0541c7472e4aef9aac8ad7d02e8e48
I20260709 13:10:27.773494 27444 raft_consensus.cc:2804] T b33f79df36ce42da96dda6972776a01d P dd2dd298b4404607b3f3a14b89cbbee4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:27.774061 27444 raft_consensus.cc:697] T b33f79df36ce42da96dda6972776a01d P dd2dd298b4404607b3f3a14b89cbbee4 [term 1 LEADER]: Becoming Leader. State: Replica: dd2dd298b4404607b3f3a14b89cbbee4, State: Running, Role: LEADER
W20260709 13:10:27.774184 27234 leader_election.cc:343] T f9463aebc13b49339561c1f5436e3142 P dd2dd298b4404607b3f3a14b89cbbee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9f0541c7472e4aef9aac8ad7d02e8e48 (127.14.180.66:41411): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:27.775157 27444 consensus_queue.cc:237] T b33f79df36ce42da96dda6972776a01d P dd2dd298b4404607b3f3a14b89cbbee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:27.778256 27418 tablet_bootstrap.cc:492] T f9463aebc13b49339561c1f5436e3142 P 9f0541c7472e4aef9aac8ad7d02e8e48: No bootstrap required, opened a new log
I20260709 13:10:27.775036 27234 leader_election.cc:304] T f9463aebc13b49339561c1f5436e3142 P dd2dd298b4404607b3f3a14b89cbbee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd2dd298b4404607b3f3a14b89cbbee4; no voters: 9f0541c7472e4aef9aac8ad7d02e8e48, e7c0341504c3426280338a5599607a0d
I20260709 13:10:27.779091 27418 ts_tablet_manager.cc:1403] T f9463aebc13b49339561c1f5436e3142 P 9f0541c7472e4aef9aac8ad7d02e8e48: Time spent bootstrapping tablet: real 0.071s	user 0.010s	sys 0.019s
I20260709 13:10:27.779893 27194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e5ce6906634b63a01333e50b5622be" candidate_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" is_pre_election: true
I20260709 13:10:27.779938 27427 raft_consensus.cc:515] T aa6e8c327dde42d3808411b7117dda68 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:27.780879 27194 raft_consensus.cc:2468] T 83e5ce6906634b63a01333e50b5622be P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd2dd298b4404607b3f3a14b89cbbee4 in term 0.
I20260709 13:10:27.784811 27419 tablet_bootstrap.cc:492] T 83e5ce6906634b63a01333e50b5622be P e7c0341504c3426280338a5599607a0d: No bootstrap required, opened a new log
I20260709 13:10:27.785897 27419 ts_tablet_manager.cc:1403] T 83e5ce6906634b63a01333e50b5622be P e7c0341504c3426280338a5599607a0d: Time spent bootstrapping tablet: real 0.068s	user 0.017s	sys 0.000s
I20260709 13:10:27.785624 27418 raft_consensus.cc:359] T f9463aebc13b49339561c1f5436e3142 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:27.787169 27418 raft_consensus.cc:385] T f9463aebc13b49339561c1f5436e3142 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:27.787647 27418 raft_consensus.cc:740] T f9463aebc13b49339561c1f5436e3142 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f0541c7472e4aef9aac8ad7d02e8e48, State: Initialized, Role: FOLLOWER
I20260709 13:10:27.788754 27418 consensus_queue.cc:260] T f9463aebc13b49339561c1f5436e3142 P 9f0541c7472e4aef9aac8ad7d02e8e48 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:27.791827 27418 ts_tablet_manager.cc:1434] T f9463aebc13b49339561c1f5436e3142 P 9f0541c7472e4aef9aac8ad7d02e8e48: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.001s
I20260709 13:10:27.792887 27121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6e8c327dde42d3808411b7117dda68" candidate_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7c0341504c3426280338a5599607a0d"
I20260709 13:10:27.793330 27418 tablet_bootstrap.cc:492] T b33f79df36ce42da96dda6972776a01d P 9f0541c7472e4aef9aac8ad7d02e8e48: Bootstrap starting.
I20260709 13:10:27.793645 27121 raft_consensus.cc:3060] T aa6e8c327dde42d3808411b7117dda68 P e7c0341504c3426280338a5599607a0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:27.804883 27121 raft_consensus.cc:2468] T aa6e8c327dde42d3808411b7117dda68 P e7c0341504c3426280338a5599607a0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f0541c7472e4aef9aac8ad7d02e8e48 in term 1.
I20260709 13:10:27.806370 27161 leader_election.cc:304] T aa6e8c327dde42d3808411b7117dda68 P 9f0541c7472e4aef9aac8ad7d02e8e48 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f0541c7472e4aef9aac8ad7d02e8e48, e7c0341504c3426280338a5599607a0d; no voters: 
I20260709 13:10:27.807598 27406 raft_consensus.cc:2804] T aa6e8c327dde42d3808411b7117dda68 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:27.807929 27418 tablet_bootstrap.cc:654] T b33f79df36ce42da96dda6972776a01d P 9f0541c7472e4aef9aac8ad7d02e8e48: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:27.823349 27419 raft_consensus.cc:359] T 83e5ce6906634b63a01333e50b5622be P e7c0341504c3426280338a5599607a0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:27.824306 27419 raft_consensus.cc:385] T 83e5ce6906634b63a01333e50b5622be P e7c0341504c3426280338a5599607a0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:27.824620 27419 raft_consensus.cc:740] T 83e5ce6906634b63a01333e50b5622be P e7c0341504c3426280338a5599607a0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7c0341504c3426280338a5599607a0d, State: Initialized, Role: FOLLOWER
I20260709 13:10:27.825465 27419 consensus_queue.cc:260] T 83e5ce6906634b63a01333e50b5622be P e7c0341504c3426280338a5599607a0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:27.819113 27405 raft_consensus.cc:2749] T f9463aebc13b49339561c1f5436e3142 P dd2dd298b4404607b3f3a14b89cbbee4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:10:27.830664 27234 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.14.180.66:41411, user_credentials={real_user=slave}} blocked reactor thread for 56540.9us
I20260709 13:10:27.832592 27234 leader_election.cc:304] T 83e5ce6906634b63a01333e50b5622be P dd2dd298b4404607b3f3a14b89cbbee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9f0541c7472e4aef9aac8ad7d02e8e48, dd2dd298b4404607b3f3a14b89cbbee4; no voters: e7c0341504c3426280338a5599607a0d
I20260709 13:10:27.834015 27405 raft_consensus.cc:2804] T 83e5ce6906634b63a01333e50b5622be P dd2dd298b4404607b3f3a14b89cbbee4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:27.834951 27405 raft_consensus.cc:493] T 83e5ce6906634b63a01333e50b5622be P dd2dd298b4404607b3f3a14b89cbbee4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:27.835472 27405 raft_consensus.cc:3060] T 83e5ce6906634b63a01333e50b5622be P dd2dd298b4404607b3f3a14b89cbbee4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:27.828997 27406 raft_consensus.cc:697] T aa6e8c327dde42d3808411b7117dda68 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 1 LEADER]: Becoming Leader. State: Replica: 9f0541c7472e4aef9aac8ad7d02e8e48, State: Running, Role: LEADER
I20260709 13:10:27.840524 27406 consensus_queue.cc:237] T aa6e8c327dde42d3808411b7117dda68 P 9f0541c7472e4aef9aac8ad7d02e8e48 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:27.847299 27419 ts_tablet_manager.cc:1434] T 83e5ce6906634b63a01333e50b5622be P e7c0341504c3426280338a5599607a0d: Time spent starting tablet: real 0.061s	user 0.010s	sys 0.000s
I20260709 13:10:27.848978 27419 tablet_bootstrap.cc:492] T d3aeec0e4dd34da6bb82d4774f566271 P e7c0341504c3426280338a5599607a0d: Bootstrap starting.
I20260709 13:10:27.850744 27427 leader_election.cc:290] T aa6e8c327dde42d3808411b7117dda68 P 9f0541c7472e4aef9aac8ad7d02e8e48 [CANDIDATE]: Term 1 election: Requested vote from peers e7c0341504c3426280338a5599607a0d (127.14.180.65:41105), dd2dd298b4404607b3f3a14b89cbbee4 (127.14.180.67:40131)
I20260709 13:10:27.862967 27451 raft_consensus.cc:493] T f9463aebc13b49339561c1f5436e3142 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.871094 27417 tablet_bootstrap.cc:492] T d3aeec0e4dd34da6bb82d4774f566271 P dd2dd298b4404607b3f3a14b89cbbee4: No bootstrap required, opened a new log
I20260709 13:10:27.871754 27417 ts_tablet_manager.cc:1403] T d3aeec0e4dd34da6bb82d4774f566271 P dd2dd298b4404607b3f3a14b89cbbee4: Time spent bootstrapping tablet: real 0.136s	user 0.045s	sys 0.045s
I20260709 13:10:27.874377 27419 tablet_bootstrap.cc:654] T d3aeec0e4dd34da6bb82d4774f566271 P e7c0341504c3426280338a5599607a0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:27.876313 27417 raft_consensus.cc:359] T d3aeec0e4dd34da6bb82d4774f566271 P dd2dd298b4404607b3f3a14b89cbbee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:27.877450 27417 raft_consensus.cc:385] T d3aeec0e4dd34da6bb82d4774f566271 P dd2dd298b4404607b3f3a14b89cbbee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:27.877926 27417 raft_consensus.cc:740] T d3aeec0e4dd34da6bb82d4774f566271 P dd2dd298b4404607b3f3a14b89cbbee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd2dd298b4404607b3f3a14b89cbbee4, State: Initialized, Role: FOLLOWER
I20260709 13:10:27.878979 27417 consensus_queue.cc:260] T d3aeec0e4dd34da6bb82d4774f566271 P dd2dd298b4404607b3f3a14b89cbbee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:27.888518 27405 raft_consensus.cc:515] T 83e5ce6906634b63a01333e50b5622be P dd2dd298b4404607b3f3a14b89cbbee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:27.864933 27451 raft_consensus.cc:515] T f9463aebc13b49339561c1f5436e3142 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:27.891706 27417 ts_tablet_manager.cc:1434] T d3aeec0e4dd34da6bb82d4774f566271 P dd2dd298b4404607b3f3a14b89cbbee4: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 13:10:27.880352 27426 raft_consensus.cc:493] T 83e5ce6906634b63a01333e50b5622be P e7c0341504c3426280338a5599607a0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:27.898334 27417 tablet_bootstrap.cc:492] T 42dd3577afcf408eba8fc5c82a33e0c8 P dd2dd298b4404607b3f3a14b89cbbee4: Bootstrap starting.
I20260709 13:10:27.897611 27426 raft_consensus.cc:515] T 83e5ce6906634b63a01333e50b5622be P e7c0341504c3426280338a5599607a0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:27.903132 27451 leader_election.cc:290] T f9463aebc13b49339561c1f5436e3142 P 9f0541c7472e4aef9aac8ad7d02e8e48 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e7c0341504c3426280338a5599607a0d (127.14.180.65:41105), dd2dd298b4404607b3f3a14b89cbbee4 (127.14.180.67:40131)
I20260709 13:10:27.903663 27426 leader_election.cc:290] T 83e5ce6906634b63a01333e50b5622be P e7c0341504c3426280338a5599607a0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9f0541c7472e4aef9aac8ad7d02e8e48 (127.14.180.66:41411), dd2dd298b4404607b3f3a14b89cbbee4 (127.14.180.67:40131)
I20260709 13:10:27.904902 27405 leader_election.cc:290] T 83e5ce6906634b63a01333e50b5622be P dd2dd298b4404607b3f3a14b89cbbee4 [CANDIDATE]: Term 1 election: Requested vote from peers e7c0341504c3426280338a5599607a0d (127.14.180.65:41105), 9f0541c7472e4aef9aac8ad7d02e8e48 (127.14.180.66:41411)
I20260709 13:10:27.906837 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e5ce6906634b63a01333e50b5622be" candidate_uuid: "e7c0341504c3426280338a5599607a0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" is_pre_election: true
I20260709 13:10:27.913156 27270 raft_consensus.cc:2393] T 83e5ce6906634b63a01333e50b5622be P dd2dd298b4404607b3f3a14b89cbbee4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e7c0341504c3426280338a5599607a0d in current term 1: Already voted for candidate dd2dd298b4404607b3f3a14b89cbbee4 in this term.
I20260709 13:10:27.929162 27419 tablet_bootstrap.cc:492] T d3aeec0e4dd34da6bb82d4774f566271 P e7c0341504c3426280338a5599607a0d: No bootstrap required, opened a new log
I20260709 13:10:27.930081 27419 ts_tablet_manager.cc:1403] T d3aeec0e4dd34da6bb82d4774f566271 P e7c0341504c3426280338a5599607a0d: Time spent bootstrapping tablet: real 0.081s	user 0.018s	sys 0.007s
I20260709 13:10:27.933904 27419 raft_consensus.cc:359] T d3aeec0e4dd34da6bb82d4774f566271 P e7c0341504c3426280338a5599607a0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:27.938280 27419 raft_consensus.cc:385] T d3aeec0e4dd34da6bb82d4774f566271 P e7c0341504c3426280338a5599607a0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:27.946213 27419 raft_consensus.cc:740] T d3aeec0e4dd34da6bb82d4774f566271 P e7c0341504c3426280338a5599607a0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7c0341504c3426280338a5599607a0d, State: Initialized, Role: FOLLOWER
I20260709 13:10:27.947216 27419 consensus_queue.cc:260] T d3aeec0e4dd34da6bb82d4774f566271 P e7c0341504c3426280338a5599607a0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:27.960044 27419 ts_tablet_manager.cc:1434] T d3aeec0e4dd34da6bb82d4774f566271 P e7c0341504c3426280338a5599607a0d: Time spent starting tablet: real 0.030s	user 0.004s	sys 0.004s
I20260709 13:10:28.491880 27405 raft_consensus.cc:493] T deb0ef2084cc4ddf88165639552f3161 P dd2dd298b4404607b3f3a14b89cbbee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.492244 27444 raft_consensus.cc:493] T d3aeec0e4dd34da6bb82d4774f566271 P dd2dd298b4404607b3f3a14b89cbbee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.492477 27405 raft_consensus.cc:515] T deb0ef2084cc4ddf88165639552f3161 P dd2dd298b4404607b3f3a14b89cbbee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:28.493182 27444 raft_consensus.cc:515] T d3aeec0e4dd34da6bb82d4774f566271 P dd2dd298b4404607b3f3a14b89cbbee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:28.495033 27405 leader_election.cc:290] T deb0ef2084cc4ddf88165639552f3161 P dd2dd298b4404607b3f3a14b89cbbee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e7c0341504c3426280338a5599607a0d (127.14.180.65:41105), 9f0541c7472e4aef9aac8ad7d02e8e48 (127.14.180.66:41411)
I20260709 13:10:28.496071 27444 leader_election.cc:290] T d3aeec0e4dd34da6bb82d4774f566271 P dd2dd298b4404607b3f3a14b89cbbee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e7c0341504c3426280338a5599607a0d (127.14.180.65:41105), 9f0541c7472e4aef9aac8ad7d02e8e48 (127.14.180.66:41411)
W20260709 13:10:28.501283 27067 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:28.501108 27120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3aeec0e4dd34da6bb82d4774f566271" candidate_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7c0341504c3426280338a5599607a0d" is_pre_election: true
I20260709 13:10:28.498096 27015 catalog_manager.cc:5697] T c972f59715c6476fb68a0a9dcc7b54d3 P e7c0341504c3426280338a5599607a0d reported cstate change: term changed from 0 to 1, leader changed from <none> to e7c0341504c3426280338a5599607a0d (127.14.180.65). New cstate: current_term: 1 leader_uuid: "e7c0341504c3426280338a5599607a0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:28.502027 27120 raft_consensus.cc:2468] T d3aeec0e4dd34da6bb82d4774f566271 P e7c0341504c3426280338a5599607a0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd2dd298b4404607b3f3a14b89cbbee4 in term 0.
I20260709 13:10:28.504551 27235 leader_election.cc:304] T d3aeec0e4dd34da6bb82d4774f566271 P dd2dd298b4404607b3f3a14b89cbbee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dd2dd298b4404607b3f3a14b89cbbee4, e7c0341504c3426280338a5599607a0d; no voters: 
I20260709 13:10:28.505748 27458 raft_consensus.cc:2804] T d3aeec0e4dd34da6bb82d4774f566271 P dd2dd298b4404607b3f3a14b89cbbee4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:28.506467 27458 raft_consensus.cc:493] T d3aeec0e4dd34da6bb82d4774f566271 P dd2dd298b4404607b3f3a14b89cbbee4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:28.506897 27458 raft_consensus.cc:3060] T d3aeec0e4dd34da6bb82d4774f566271 P dd2dd298b4404607b3f3a14b89cbbee4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:28.507803 27119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb0ef2084cc4ddf88165639552f3161" candidate_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7c0341504c3426280338a5599607a0d" is_pre_election: true
W20260709 13:10:28.509651 27235 leader_election.cc:343] T deb0ef2084cc4ddf88165639552f3161 P dd2dd298b4404607b3f3a14b89cbbee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e7c0341504c3426280338a5599607a0d (127.14.180.65:41105): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:28.517159 27458 raft_consensus.cc:515] T d3aeec0e4dd34da6bb82d4774f566271 P dd2dd298b4404607b3f3a14b89cbbee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:28.520598 27458 leader_election.cc:290] T d3aeec0e4dd34da6bb82d4774f566271 P dd2dd298b4404607b3f3a14b89cbbee4 [CANDIDATE]: Term 1 election: Requested vote from peers e7c0341504c3426280338a5599607a0d (127.14.180.65:41105), 9f0541c7472e4aef9aac8ad7d02e8e48 (127.14.180.66:41411)
I20260709 13:10:28.522879 27119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3aeec0e4dd34da6bb82d4774f566271" candidate_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7c0341504c3426280338a5599607a0d"
I20260709 13:10:28.523888 27119 raft_consensus.cc:3060] T d3aeec0e4dd34da6bb82d4774f566271 P e7c0341504c3426280338a5599607a0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:28.537772 27119 raft_consensus.cc:2468] T d3aeec0e4dd34da6bb82d4774f566271 P e7c0341504c3426280338a5599607a0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd2dd298b4404607b3f3a14b89cbbee4 in term 1.
I20260709 13:10:28.539592 27458 consensus_queue.cc:1048] T b33f79df36ce42da96dda6972776a01d P dd2dd298b4404607b3f3a14b89cbbee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:28.548307 27235 leader_election.cc:304] T d3aeec0e4dd34da6bb82d4774f566271 P dd2dd298b4404607b3f3a14b89cbbee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dd2dd298b4404607b3f3a14b89cbbee4, e7c0341504c3426280338a5599607a0d; no voters: 
I20260709 13:10:28.549690 27458 raft_consensus.cc:2804] T d3aeec0e4dd34da6bb82d4774f566271 P dd2dd298b4404607b3f3a14b89cbbee4 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:10:28.551653 27162 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.741s	user 0.016s	sys 0.031s
W20260709 13:10:28.552320 27162 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.742s	user 0.016s	sys 0.031s
I20260709 13:10:28.552274 27458 raft_consensus.cc:697] T d3aeec0e4dd34da6bb82d4774f566271 P dd2dd298b4404607b3f3a14b89cbbee4 [term 1 LEADER]: Becoming Leader. State: Replica: dd2dd298b4404607b3f3a14b89cbbee4, State: Running, Role: LEADER
I20260709 13:10:28.553686 27458 consensus_queue.cc:237] T d3aeec0e4dd34da6bb82d4774f566271 P dd2dd298b4404607b3f3a14b89cbbee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:28.565435 27194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e5ce6906634b63a01333e50b5622be" candidate_uuid: "e7c0341504c3426280338a5599607a0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" is_pre_election: true
I20260709 13:10:28.566243 27194 raft_consensus.cc:2468] T 83e5ce6906634b63a01333e50b5622be P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e7c0341504c3426280338a5599607a0d in term 0.
I20260709 13:10:28.570731 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6e8c327dde42d3808411b7117dda68" candidate_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd2dd298b4404607b3f3a14b89cbbee4"
I20260709 13:10:28.571774 27270 raft_consensus.cc:3060] T aa6e8c327dde42d3808411b7117dda68 P dd2dd298b4404607b3f3a14b89cbbee4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:28.572878 27121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e5ce6906634b63a01333e50b5622be" candidate_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7c0341504c3426280338a5599607a0d"
I20260709 13:10:28.573575 27121 raft_consensus.cc:3060] T 83e5ce6906634b63a01333e50b5622be P e7c0341504c3426280338a5599607a0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:28.574851 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9463aebc13b49339561c1f5436e3142" candidate_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" is_pre_election: true
I20260709 13:10:28.575609 27268 raft_consensus.cc:2468] T f9463aebc13b49339561c1f5436e3142 P dd2dd298b4404607b3f3a14b89cbbee4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f0541c7472e4aef9aac8ad7d02e8e48 in term 0.
I20260709 13:10:28.576547 27419 tablet_bootstrap.cc:492] T f9463aebc13b49339561c1f5436e3142 P e7c0341504c3426280338a5599607a0d: Bootstrap starting.
I20260709 13:10:28.582587 27196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e5ce6906634b63a01333e50b5622be" candidate_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48"
I20260709 13:10:28.583345 27196 raft_consensus.cc:3060] T 83e5ce6906634b63a01333e50b5622be P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:28.583462 27270 raft_consensus.cc:2468] T aa6e8c327dde42d3808411b7117dda68 P dd2dd298b4404607b3f3a14b89cbbee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f0541c7472e4aef9aac8ad7d02e8e48 in term 1.
I20260709 13:10:28.588289 27085 leader_election.cc:304] T 83e5ce6906634b63a01333e50b5622be P e7c0341504c3426280338a5599607a0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f0541c7472e4aef9aac8ad7d02e8e48, e7c0341504c3426280338a5599607a0d; no voters: 
I20260709 13:10:28.592008 27418 tablet_bootstrap.cc:492] T b33f79df36ce42da96dda6972776a01d P 9f0541c7472e4aef9aac8ad7d02e8e48: No bootstrap required, opened a new log
I20260709 13:10:28.592887 27418 ts_tablet_manager.cc:1403] T b33f79df36ce42da96dda6972776a01d P 9f0541c7472e4aef9aac8ad7d02e8e48: Time spent bootstrapping tablet: real 0.800s	user 0.033s	sys 0.040s
I20260709 13:10:28.594833 27343 consensus_queue.cc:1048] T e41aaa6d8213447b972d3eed31538da1 P e7c0341504c3426280338a5599607a0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:28.597218 27343 consensus_queue.cc:1048] T c972f59715c6476fb68a0a9dcc7b54d3 P e7c0341504c3426280338a5599607a0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:28.601892 27119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9463aebc13b49339561c1f5436e3142" candidate_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7c0341504c3426280338a5599607a0d" is_pre_election: true
I20260709 13:10:28.603916 27419 tablet_bootstrap.cc:654] T f9463aebc13b49339561c1f5436e3142 P e7c0341504c3426280338a5599607a0d: Neither blocks nor log segments found. Creating new log.
W20260709 13:10:28.610723 27160 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.777s	user 0.021s	sys 0.012s
W20260709 13:10:28.611328 27160 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.778s	user 0.021s	sys 0.012s
I20260709 13:10:28.605684 27162 leader_election.cc:304] T f9463aebc13b49339561c1f5436e3142 P 9f0541c7472e4aef9aac8ad7d02e8e48 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f0541c7472e4aef9aac8ad7d02e8e48, dd2dd298b4404607b3f3a14b89cbbee4; no voters: 
I20260709 13:10:28.605883 27121 raft_consensus.cc:2468] T 83e5ce6906634b63a01333e50b5622be P e7c0341504c3426280338a5599607a0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd2dd298b4404607b3f3a14b89cbbee4 in term 1.
I20260709 13:10:28.615381 27434 raft_consensus.cc:2764] T 83e5ce6906634b63a01333e50b5622be P e7c0341504c3426280338a5599607a0d [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:10:28.618983 27406 raft_consensus.cc:2804] T f9463aebc13b49339561c1f5436e3142 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:28.619776 27406 raft_consensus.cc:493] T f9463aebc13b49339561c1f5436e3142 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:28.620217 27406 raft_consensus.cc:3060] T f9463aebc13b49339561c1f5436e3142 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:28.621011 27161 leader_election.cc:343] T f9463aebc13b49339561c1f5436e3142 P 9f0541c7472e4aef9aac8ad7d02e8e48 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e7c0341504c3426280338a5599607a0d (127.14.180.65:41105): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:28.623557 27453 consensus_queue.cc:1048] T aa6e8c327dde42d3808411b7117dda68 P 9f0541c7472e4aef9aac8ad7d02e8e48 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:28.619128 27235 leader_election.cc:304] T 83e5ce6906634b63a01333e50b5622be P dd2dd298b4404607b3f3a14b89cbbee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dd2dd298b4404607b3f3a14b89cbbee4, e7c0341504c3426280338a5599607a0d; no voters: 
I20260709 13:10:28.627182 27457 raft_consensus.cc:2804] T 83e5ce6906634b63a01333e50b5622be P dd2dd298b4404607b3f3a14b89cbbee4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:28.627967 27457 raft_consensus.cc:697] T 83e5ce6906634b63a01333e50b5622be P dd2dd298b4404607b3f3a14b89cbbee4 [term 1 LEADER]: Becoming Leader. State: Replica: dd2dd298b4404607b3f3a14b89cbbee4, State: Running, Role: LEADER
I20260709 13:10:28.629150 27457 consensus_queue.cc:237] T 83e5ce6906634b63a01333e50b5622be P dd2dd298b4404607b3f3a14b89cbbee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:28.637593 27406 raft_consensus.cc:515] T f9463aebc13b49339561c1f5436e3142 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:28.638916 27194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb0ef2084cc4ddf88165639552f3161" candidate_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" is_pre_election: true
I20260709 13:10:28.640168 27195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3aeec0e4dd34da6bb82d4774f566271" candidate_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" is_pre_election: true
I20260709 13:10:28.641543 27193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3aeec0e4dd34da6bb82d4774f566271" candidate_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48"
I20260709 13:10:28.642293 27417 tablet_bootstrap.cc:654] T 42dd3577afcf408eba8fc5c82a33e0c8 P dd2dd298b4404607b3f3a14b89cbbee4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:28.689311 27406 leader_election.cc:290] T f9463aebc13b49339561c1f5436e3142 P 9f0541c7472e4aef9aac8ad7d02e8e48 [CANDIDATE]: Term 1 election: Requested vote from peers e7c0341504c3426280338a5599607a0d (127.14.180.65:41105), dd2dd298b4404607b3f3a14b89cbbee4 (127.14.180.67:40131)
I20260709 13:10:28.645051 27434 consensus_queue.cc:1048] T c972f59715c6476fb68a0a9dcc7b54d3 P e7c0341504c3426280338a5599607a0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:28.690451 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9463aebc13b49339561c1f5436e3142" candidate_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd2dd298b4404607b3f3a14b89cbbee4"
I20260709 13:10:28.691329 27270 raft_consensus.cc:3060] T f9463aebc13b49339561c1f5436e3142 P dd2dd298b4404607b3f3a14b89cbbee4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:28.647751 27418 raft_consensus.cc:359] T b33f79df36ce42da96dda6972776a01d P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:28.655421 27426 consensus_queue.cc:1048] T e41aaa6d8213447b972d3eed31538da1 P e7c0341504c3426280338a5599607a0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:28.694089 27418 raft_consensus.cc:385] T b33f79df36ce42da96dda6972776a01d P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.694453 27418 raft_consensus.cc:740] T b33f79df36ce42da96dda6972776a01d P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f0541c7472e4aef9aac8ad7d02e8e48, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.694764 27121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9463aebc13b49339561c1f5436e3142" candidate_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7c0341504c3426280338a5599607a0d"
I20260709 13:10:28.695302 27418 consensus_queue.cc:260] T b33f79df36ce42da96dda6972776a01d P 9f0541c7472e4aef9aac8ad7d02e8e48 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
W20260709 13:10:28.667361 27234 consensus_peers.cc:597] T b33f79df36ce42da96dda6972776a01d P dd2dd298b4404607b3f3a14b89cbbee4 -> Peer 9f0541c7472e4aef9aac8ad7d02e8e48 (127.14.180.66:41411): Couldn't send request to peer 9f0541c7472e4aef9aac8ad7d02e8e48. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:28.697834 27418 ts_tablet_manager.cc:1434] T b33f79df36ce42da96dda6972776a01d P 9f0541c7472e4aef9aac8ad7d02e8e48: Time spent starting tablet: real 0.104s	user 0.010s	sys 0.001s
I20260709 13:10:28.698987 27418 tablet_bootstrap.cc:492] T d3aeec0e4dd34da6bb82d4774f566271 P 9f0541c7472e4aef9aac8ad7d02e8e48: Bootstrap starting.
W20260709 13:10:28.699011 27234 leader_election.cc:343] T deb0ef2084cc4ddf88165639552f3161 P dd2dd298b4404607b3f3a14b89cbbee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9f0541c7472e4aef9aac8ad7d02e8e48 (127.14.180.66:41411): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:28.700389 27234 leader_election.cc:304] T deb0ef2084cc4ddf88165639552f3161 P dd2dd298b4404607b3f3a14b89cbbee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dd2dd298b4404607b3f3a14b89cbbee4; no voters: 9f0541c7472e4aef9aac8ad7d02e8e48, e7c0341504c3426280338a5599607a0d
I20260709 13:10:28.701386 27405 raft_consensus.cc:2749] T deb0ef2084cc4ddf88165639552f3161 P dd2dd298b4404607b3f3a14b89cbbee4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:10:28.702761 27234 leader_election.cc:343] T d3aeec0e4dd34da6bb82d4774f566271 P dd2dd298b4404607b3f3a14b89cbbee4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9f0541c7472e4aef9aac8ad7d02e8e48 (127.14.180.66:41411): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:28.703976 27234 leader_election.cc:343] T d3aeec0e4dd34da6bb82d4774f566271 P dd2dd298b4404607b3f3a14b89cbbee4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9f0541c7472e4aef9aac8ad7d02e8e48 (127.14.180.66:41411): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:28.706264 27418 tablet_bootstrap.cc:654] T d3aeec0e4dd34da6bb82d4774f566271 P 9f0541c7472e4aef9aac8ad7d02e8e48: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:28.682156 27018 catalog_manager.cc:5697] T b33f79df36ce42da96dda6972776a01d P dd2dd298b4404607b3f3a14b89cbbee4 reported cstate change: term changed from 0 to 1, leader changed from <none> to dd2dd298b4404607b3f3a14b89cbbee4 (127.14.180.67). New cstate: current_term: 1 leader_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } health_report { overall_health: HEALTHY } } }
W20260709 13:10:28.700480 27161 leader_election.cc:343] T f9463aebc13b49339561c1f5436e3142 P 9f0541c7472e4aef9aac8ad7d02e8e48 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e7c0341504c3426280338a5599607a0d (127.14.180.65:41105): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:28.706022 27270 raft_consensus.cc:2468] T f9463aebc13b49339561c1f5436e3142 P dd2dd298b4404607b3f3a14b89cbbee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f0541c7472e4aef9aac8ad7d02e8e48 in term 1.
I20260709 13:10:28.672079 27196 raft_consensus.cc:2468] T 83e5ce6906634b63a01333e50b5622be P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd2dd298b4404607b3f3a14b89cbbee4 in term 1.
I20260709 13:10:28.675247 27419 tablet_bootstrap.cc:492] T f9463aebc13b49339561c1f5436e3142 P e7c0341504c3426280338a5599607a0d: No bootstrap required, opened a new log
I20260709 13:10:28.713675 27419 ts_tablet_manager.cc:1403] T f9463aebc13b49339561c1f5436e3142 P e7c0341504c3426280338a5599607a0d: Time spent bootstrapping tablet: real 0.753s	user 0.025s	sys 0.003s
I20260709 13:10:28.715245 27162 leader_election.cc:304] T f9463aebc13b49339561c1f5436e3142 P 9f0541c7472e4aef9aac8ad7d02e8e48 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9f0541c7472e4aef9aac8ad7d02e8e48, dd2dd298b4404607b3f3a14b89cbbee4; no voters: e7c0341504c3426280338a5599607a0d
I20260709 13:10:28.716471 27466 raft_consensus.cc:2804] T f9463aebc13b49339561c1f5436e3142 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:28.717063 27466 raft_consensus.cc:697] T f9463aebc13b49339561c1f5436e3142 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 1 LEADER]: Becoming Leader. State: Replica: 9f0541c7472e4aef9aac8ad7d02e8e48, State: Running, Role: LEADER
I20260709 13:10:28.717949 27466 consensus_queue.cc:237] T f9463aebc13b49339561c1f5436e3142 P 9f0541c7472e4aef9aac8ad7d02e8e48 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:28.738480 27017 catalog_manager.cc:5697] T aa6e8c327dde42d3808411b7117dda68 P 9f0541c7472e4aef9aac8ad7d02e8e48 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9f0541c7472e4aef9aac8ad7d02e8e48 (127.14.180.66). New cstate: current_term: 1 leader_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:28.742920 27419 raft_consensus.cc:359] T f9463aebc13b49339561c1f5436e3142 P e7c0341504c3426280338a5599607a0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:28.743868 27419 raft_consensus.cc:385] T f9463aebc13b49339561c1f5436e3142 P e7c0341504c3426280338a5599607a0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.744184 27419 raft_consensus.cc:740] T f9463aebc13b49339561c1f5436e3142 P e7c0341504c3426280338a5599607a0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7c0341504c3426280338a5599607a0d, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.745306 27419 consensus_queue.cc:260] T f9463aebc13b49339561c1f5436e3142 P e7c0341504c3426280338a5599607a0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:28.769644 27419 ts_tablet_manager.cc:1434] T f9463aebc13b49339561c1f5436e3142 P e7c0341504c3426280338a5599607a0d: Time spent starting tablet: real 0.055s	user 0.004s	sys 0.004s
I20260709 13:10:28.770956 27419 tablet_bootstrap.cc:492] T 42dd3577afcf408eba8fc5c82a33e0c8 P e7c0341504c3426280338a5599607a0d: Bootstrap starting.
I20260709 13:10:28.804028 27017 catalog_manager.cc:5697] T d3aeec0e4dd34da6bb82d4774f566271 P dd2dd298b4404607b3f3a14b89cbbee4 reported cstate change: term changed from 0 to 1, leader changed from <none> to dd2dd298b4404607b3f3a14b89cbbee4 (127.14.180.67). New cstate: current_term: 1 leader_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:28.806401 27451 consensus_queue.cc:1048] T aa6e8c327dde42d3808411b7117dda68 P 9f0541c7472e4aef9aac8ad7d02e8e48 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:28.806311 27017 catalog_manager.cc:5697] T 83e5ce6906634b63a01333e50b5622be P dd2dd298b4404607b3f3a14b89cbbee4 reported cstate change: term changed from 0 to 1, leader changed from <none> to dd2dd298b4404607b3f3a14b89cbbee4 (127.14.180.67). New cstate: current_term: 1 leader_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:28.808254 27419 tablet_bootstrap.cc:654] T 42dd3577afcf408eba8fc5c82a33e0c8 P e7c0341504c3426280338a5599607a0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:28.812238 27417 tablet_bootstrap.cc:492] T 42dd3577afcf408eba8fc5c82a33e0c8 P dd2dd298b4404607b3f3a14b89cbbee4: No bootstrap required, opened a new log
I20260709 13:10:28.812908 27417 ts_tablet_manager.cc:1403] T 42dd3577afcf408eba8fc5c82a33e0c8 P dd2dd298b4404607b3f3a14b89cbbee4: Time spent bootstrapping tablet: real 0.920s	user 0.023s	sys 0.022s
I20260709 13:10:28.822793 27417 raft_consensus.cc:359] T 42dd3577afcf408eba8fc5c82a33e0c8 P dd2dd298b4404607b3f3a14b89cbbee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:28.829475 27417 raft_consensus.cc:385] T 42dd3577afcf408eba8fc5c82a33e0c8 P dd2dd298b4404607b3f3a14b89cbbee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.829864 27417 raft_consensus.cc:740] T 42dd3577afcf408eba8fc5c82a33e0c8 P dd2dd298b4404607b3f3a14b89cbbee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd2dd298b4404607b3f3a14b89cbbee4, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.830672 27417 consensus_queue.cc:260] T 42dd3577afcf408eba8fc5c82a33e0c8 P dd2dd298b4404607b3f3a14b89cbbee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:28.833103 27417 ts_tablet_manager.cc:1434] T 42dd3577afcf408eba8fc5c82a33e0c8 P dd2dd298b4404607b3f3a14b89cbbee4: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 13:10:28.835501 27018 catalog_manager.cc:5697] T f9463aebc13b49339561c1f5436e3142 P 9f0541c7472e4aef9aac8ad7d02e8e48 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9f0541c7472e4aef9aac8ad7d02e8e48 (127.14.180.66). New cstate: current_term: 1 leader_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:28.837987 27418 tablet_bootstrap.cc:492] T d3aeec0e4dd34da6bb82d4774f566271 P 9f0541c7472e4aef9aac8ad7d02e8e48: No bootstrap required, opened a new log
I20260709 13:10:28.840443 27418 ts_tablet_manager.cc:1403] T d3aeec0e4dd34da6bb82d4774f566271 P 9f0541c7472e4aef9aac8ad7d02e8e48: Time spent bootstrapping tablet: real 0.142s	user 0.032s	sys 0.036s
I20260709 13:10:28.845197 27418 raft_consensus.cc:359] T d3aeec0e4dd34da6bb82d4774f566271 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:28.846065 27418 raft_consensus.cc:385] T d3aeec0e4dd34da6bb82d4774f566271 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.846400 27418 raft_consensus.cc:740] T d3aeec0e4dd34da6bb82d4774f566271 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f0541c7472e4aef9aac8ad7d02e8e48, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.847231 27418 consensus_queue.cc:260] T d3aeec0e4dd34da6bb82d4774f566271 P 9f0541c7472e4aef9aac8ad7d02e8e48 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:28.848270 27419 tablet_bootstrap.cc:492] T 42dd3577afcf408eba8fc5c82a33e0c8 P e7c0341504c3426280338a5599607a0d: No bootstrap required, opened a new log
I20260709 13:10:28.848892 27419 ts_tablet_manager.cc:1403] T 42dd3577afcf408eba8fc5c82a33e0c8 P e7c0341504c3426280338a5599607a0d: Time spent bootstrapping tablet: real 0.078s	user 0.014s	sys 0.004s
I20260709 13:10:28.850193 27418 ts_tablet_manager.cc:1434] T d3aeec0e4dd34da6bb82d4774f566271 P 9f0541c7472e4aef9aac8ad7d02e8e48: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:10:28.851649 27418 tablet_bootstrap.cc:492] T deb0ef2084cc4ddf88165639552f3161 P 9f0541c7472e4aef9aac8ad7d02e8e48: Bootstrap starting.
I20260709 13:10:28.852052 27419 raft_consensus.cc:359] T 42dd3577afcf408eba8fc5c82a33e0c8 P e7c0341504c3426280338a5599607a0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:28.852932 27419 raft_consensus.cc:385] T 42dd3577afcf408eba8fc5c82a33e0c8 P e7c0341504c3426280338a5599607a0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.853281 27419 raft_consensus.cc:740] T 42dd3577afcf408eba8fc5c82a33e0c8 P e7c0341504c3426280338a5599607a0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7c0341504c3426280338a5599607a0d, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.854523 27419 consensus_queue.cc:260] T 42dd3577afcf408eba8fc5c82a33e0c8 P e7c0341504c3426280338a5599607a0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:28.856977 27419 ts_tablet_manager.cc:1434] T 42dd3577afcf408eba8fc5c82a33e0c8 P e7c0341504c3426280338a5599607a0d: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.003s
I20260709 13:10:28.858035 27419 tablet_bootstrap.cc:492] T deb0ef2084cc4ddf88165639552f3161 P e7c0341504c3426280338a5599607a0d: Bootstrap starting.
I20260709 13:10:28.864600 27419 tablet_bootstrap.cc:654] T deb0ef2084cc4ddf88165639552f3161 P e7c0341504c3426280338a5599607a0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:28.864789 27418 tablet_bootstrap.cc:654] T deb0ef2084cc4ddf88165639552f3161 P 9f0541c7472e4aef9aac8ad7d02e8e48: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:28.881366 27418 tablet_bootstrap.cc:492] T deb0ef2084cc4ddf88165639552f3161 P 9f0541c7472e4aef9aac8ad7d02e8e48: No bootstrap required, opened a new log
I20260709 13:10:28.881826 27418 ts_tablet_manager.cc:1403] T deb0ef2084cc4ddf88165639552f3161 P 9f0541c7472e4aef9aac8ad7d02e8e48: Time spent bootstrapping tablet: real 0.030s	user 0.010s	sys 0.005s
I20260709 13:10:28.884652 27419 tablet_bootstrap.cc:492] T deb0ef2084cc4ddf88165639552f3161 P e7c0341504c3426280338a5599607a0d: No bootstrap required, opened a new log
I20260709 13:10:28.884660 27418 raft_consensus.cc:359] T deb0ef2084cc4ddf88165639552f3161 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:28.885581 27419 ts_tablet_manager.cc:1403] T deb0ef2084cc4ddf88165639552f3161 P e7c0341504c3426280338a5599607a0d: Time spent bootstrapping tablet: real 0.028s	user 0.017s	sys 0.000s
I20260709 13:10:28.885785 27418 raft_consensus.cc:385] T deb0ef2084cc4ddf88165639552f3161 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.886118 27418 raft_consensus.cc:740] T deb0ef2084cc4ddf88165639552f3161 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f0541c7472e4aef9aac8ad7d02e8e48, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.886942 27418 consensus_queue.cc:260] T deb0ef2084cc4ddf88165639552f3161 P 9f0541c7472e4aef9aac8ad7d02e8e48 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:28.889490 27418 ts_tablet_manager.cc:1434] T deb0ef2084cc4ddf88165639552f3161 P 9f0541c7472e4aef9aac8ad7d02e8e48: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:10:28.890944 27418 tablet_bootstrap.cc:492] T 42dd3577afcf408eba8fc5c82a33e0c8 P 9f0541c7472e4aef9aac8ad7d02e8e48: Bootstrap starting.
I20260709 13:10:28.891399 27419 raft_consensus.cc:359] T deb0ef2084cc4ddf88165639552f3161 P e7c0341504c3426280338a5599607a0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:28.892478 27419 raft_consensus.cc:385] T deb0ef2084cc4ddf88165639552f3161 P e7c0341504c3426280338a5599607a0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.892819 27419 raft_consensus.cc:740] T deb0ef2084cc4ddf88165639552f3161 P e7c0341504c3426280338a5599607a0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7c0341504c3426280338a5599607a0d, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.893726 27419 consensus_queue.cc:260] T deb0ef2084cc4ddf88165639552f3161 P e7c0341504c3426280338a5599607a0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:28.897794 27418 tablet_bootstrap.cc:654] T 42dd3577afcf408eba8fc5c82a33e0c8 P 9f0541c7472e4aef9aac8ad7d02e8e48: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:28.898844 27419 ts_tablet_manager.cc:1434] T deb0ef2084cc4ddf88165639552f3161 P e7c0341504c3426280338a5599607a0d: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.003s
I20260709 13:10:28.910811 27426 raft_consensus.cc:493] T f9463aebc13b49339561c1f5436e3142 P e7c0341504c3426280338a5599607a0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.911453 27426 raft_consensus.cc:515] T f9463aebc13b49339561c1f5436e3142 P e7c0341504c3426280338a5599607a0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:28.915154 27269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9463aebc13b49339561c1f5436e3142" candidate_uuid: "e7c0341504c3426280338a5599607a0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" is_pre_election: true
I20260709 13:10:28.915445 27426 leader_election.cc:290] T f9463aebc13b49339561c1f5436e3142 P e7c0341504c3426280338a5599607a0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9f0541c7472e4aef9aac8ad7d02e8e48 (127.14.180.66:41411), dd2dd298b4404607b3f3a14b89cbbee4 (127.14.180.67:40131)
I20260709 13:10:28.916179 27269 raft_consensus.cc:2393] T f9463aebc13b49339561c1f5436e3142 P dd2dd298b4404607b3f3a14b89cbbee4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e7c0341504c3426280338a5599607a0d in current term 1: Already voted for candidate 9f0541c7472e4aef9aac8ad7d02e8e48 in this term.
I20260709 13:10:28.917361 27418 tablet_bootstrap.cc:492] T 42dd3577afcf408eba8fc5c82a33e0c8 P 9f0541c7472e4aef9aac8ad7d02e8e48: No bootstrap required, opened a new log
I20260709 13:10:28.918035 27418 ts_tablet_manager.cc:1403] T 42dd3577afcf408eba8fc5c82a33e0c8 P 9f0541c7472e4aef9aac8ad7d02e8e48: Time spent bootstrapping tablet: real 0.027s	user 0.013s	sys 0.006s
I20260709 13:10:28.919173 27191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9463aebc13b49339561c1f5436e3142" candidate_uuid: "e7c0341504c3426280338a5599607a0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" is_pre_election: true
I20260709 13:10:28.921415 27085 leader_election.cc:304] T f9463aebc13b49339561c1f5436e3142 P e7c0341504c3426280338a5599607a0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e7c0341504c3426280338a5599607a0d; no voters: 9f0541c7472e4aef9aac8ad7d02e8e48, dd2dd298b4404607b3f3a14b89cbbee4
I20260709 13:10:28.921515 27418 raft_consensus.cc:359] T 42dd3577afcf408eba8fc5c82a33e0c8 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:28.922405 27418 raft_consensus.cc:385] T 42dd3577afcf408eba8fc5c82a33e0c8 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:28.922770 27418 raft_consensus.cc:740] T 42dd3577afcf408eba8fc5c82a33e0c8 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f0541c7472e4aef9aac8ad7d02e8e48, State: Initialized, Role: FOLLOWER
I20260709 13:10:28.923168 27426 raft_consensus.cc:3060] T f9463aebc13b49339561c1f5436e3142 P e7c0341504c3426280338a5599607a0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:28.923707 27418 consensus_queue.cc:260] T 42dd3577afcf408eba8fc5c82a33e0c8 P 9f0541c7472e4aef9aac8ad7d02e8e48 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:28.926609 27418 ts_tablet_manager.cc:1434] T 42dd3577afcf408eba8fc5c82a33e0c8 P 9f0541c7472e4aef9aac8ad7d02e8e48: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.000s
I20260709 13:10:28.934777 27426 raft_consensus.cc:2749] T f9463aebc13b49339561c1f5436e3142 P e7c0341504c3426280338a5599607a0d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:28.972743 27191 raft_consensus.cc:3060] T b33f79df36ce42da96dda6972776a01d P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:10:28.975364 27050 debug-util.cc:398] Leaking SignalData structure 0x7b0800063840 after lost signal to thread 15060
W20260709 13:10:28.976677 27050 debug-util.cc:398] Leaking SignalData structure 0x7b0800014f40 after lost signal to thread 27053
W20260709 13:10:28.978145 27050 debug-util.cc:398] Leaking SignalData structure 0x7b08002f4ea0 after lost signal to thread 27145
W20260709 13:10:28.979642 27050 debug-util.cc:398] Leaking SignalData structure 0x7b08001c0920 after lost signal to thread 27220
W20260709 13:10:28.980957 27050 debug-util.cc:398] Leaking SignalData structure 0x7b08001cf900 after lost signal to thread 27294
I20260709 13:10:28.981081 27457 consensus_queue.cc:1048] T d3aeec0e4dd34da6bb82d4774f566271 P dd2dd298b4404607b3f3a14b89cbbee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:28.999495 27453 raft_consensus.cc:493] T b33f79df36ce42da96dda6972776a01d P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader dd2dd298b4404607b3f3a14b89cbbee4)
I20260709 13:10:29.000159 27453 raft_consensus.cc:515] T b33f79df36ce42da96dda6972776a01d P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:29.002797 27466 raft_consensus.cc:493] T deb0ef2084cc4ddf88165639552f3161 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.003479 27466 raft_consensus.cc:515] T deb0ef2084cc4ddf88165639552f3161 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:29.005412 27444 raft_consensus.cc:493] T 42dd3577afcf408eba8fc5c82a33e0c8 P dd2dd298b4404607b3f3a14b89cbbee4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.006079 27444 raft_consensus.cc:515] T 42dd3577afcf408eba8fc5c82a33e0c8 P dd2dd298b4404607b3f3a14b89cbbee4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:29.007689 27121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb0ef2084cc4ddf88165639552f3161" candidate_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7c0341504c3426280338a5599607a0d" is_pre_election: true
I20260709 13:10:29.008477 27444 leader_election.cc:290] T 42dd3577afcf408eba8fc5c82a33e0c8 P dd2dd298b4404607b3f3a14b89cbbee4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e7c0341504c3426280338a5599607a0d (127.14.180.65:41105), 9f0541c7472e4aef9aac8ad7d02e8e48 (127.14.180.66:41411)
I20260709 13:10:29.011183 27269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb0ef2084cc4ddf88165639552f3161" candidate_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" is_pre_election: true
I20260709 13:10:29.011996 27269 raft_consensus.cc:2468] T deb0ef2084cc4ddf88165639552f3161 P dd2dd298b4404607b3f3a14b89cbbee4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f0541c7472e4aef9aac8ad7d02e8e48 in term 0.
I20260709 13:10:29.011919 27453 leader_election.cc:290] T b33f79df36ce42da96dda6972776a01d P 9f0541c7472e4aef9aac8ad7d02e8e48 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e7c0341504c3426280338a5599607a0d (127.14.180.65:41105), dd2dd298b4404607b3f3a14b89cbbee4 (127.14.180.67:40131)
I20260709 13:10:29.008486 27121 raft_consensus.cc:2468] T deb0ef2084cc4ddf88165639552f3161 P e7c0341504c3426280338a5599607a0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f0541c7472e4aef9aac8ad7d02e8e48 in term 0.
I20260709 13:10:29.014323 27121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42dd3577afcf408eba8fc5c82a33e0c8" candidate_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7c0341504c3426280338a5599607a0d" is_pre_election: true
I20260709 13:10:29.015013 27121 raft_consensus.cc:2468] T 42dd3577afcf408eba8fc5c82a33e0c8 P e7c0341504c3426280338a5599607a0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd2dd298b4404607b3f3a14b89cbbee4 in term 0.
I20260709 13:10:29.015050 27117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33f79df36ce42da96dda6972776a01d" candidate_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e7c0341504c3426280338a5599607a0d" is_pre_election: true
I20260709 13:10:29.015908 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33f79df36ce42da96dda6972776a01d" candidate_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" is_pre_election: true
I20260709 13:10:29.016310 27162 leader_election.cc:304] T deb0ef2084cc4ddf88165639552f3161 P 9f0541c7472e4aef9aac8ad7d02e8e48 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f0541c7472e4aef9aac8ad7d02e8e48, dd2dd298b4404607b3f3a14b89cbbee4; no voters: 
I20260709 13:10:29.016999 27196 raft_consensus.cc:3060] T d3aeec0e4dd34da6bb82d4774f566271 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.017374 27451 raft_consensus.cc:2804] T deb0ef2084cc4ddf88165639552f3161 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:29.017902 27451 raft_consensus.cc:493] T deb0ef2084cc4ddf88165639552f3161 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:29.018296 27451 raft_consensus.cc:3060] T deb0ef2084cc4ddf88165639552f3161 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.015089 27193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42dd3577afcf408eba8fc5c82a33e0c8" candidate_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" is_pre_election: true
I20260709 13:10:29.023356 27193 raft_consensus.cc:2468] T 42dd3577afcf408eba8fc5c82a33e0c8 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dd2dd298b4404607b3f3a14b89cbbee4 in term 0.
I20260709 13:10:29.027460 27234 leader_election.cc:304] T 42dd3577afcf408eba8fc5c82a33e0c8 P dd2dd298b4404607b3f3a14b89cbbee4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f0541c7472e4aef9aac8ad7d02e8e48, dd2dd298b4404607b3f3a14b89cbbee4; no voters: 
I20260709 13:10:29.005861 27466 leader_election.cc:290] T deb0ef2084cc4ddf88165639552f3161 P 9f0541c7472e4aef9aac8ad7d02e8e48 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e7c0341504c3426280338a5599607a0d (127.14.180.65:41105), dd2dd298b4404607b3f3a14b89cbbee4 (127.14.180.67:40131)
I20260709 13:10:29.028687 27444 raft_consensus.cc:2804] T 42dd3577afcf408eba8fc5c82a33e0c8 P dd2dd298b4404607b3f3a14b89cbbee4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:29.029112 27444 raft_consensus.cc:493] T 42dd3577afcf408eba8fc5c82a33e0c8 P dd2dd298b4404607b3f3a14b89cbbee4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:29.029469 27444 raft_consensus.cc:3060] T 42dd3577afcf408eba8fc5c82a33e0c8 P dd2dd298b4404607b3f3a14b89cbbee4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.033200 27457 consensus_queue.cc:1048] T 83e5ce6906634b63a01333e50b5622be P dd2dd298b4404607b3f3a14b89cbbee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:29.038024 27457 consensus_queue.cc:1048] T d3aeec0e4dd34da6bb82d4774f566271 P dd2dd298b4404607b3f3a14b89cbbee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:29.038368 27161 leader_election.cc:304] T b33f79df36ce42da96dda6972776a01d P 9f0541c7472e4aef9aac8ad7d02e8e48 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f0541c7472e4aef9aac8ad7d02e8e48; no voters: dd2dd298b4404607b3f3a14b89cbbee4, e7c0341504c3426280338a5599607a0d
I20260709 13:10:29.039788 27466 raft_consensus.cc:2749] T b33f79df36ce42da96dda6972776a01d P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:29.045454 27451 raft_consensus.cc:515] T deb0ef2084cc4ddf88165639552f3161 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:29.054023 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb0ef2084cc4ddf88165639552f3161" candidate_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dd2dd298b4404607b3f3a14b89cbbee4"
I20260709 13:10:29.055049 27268 raft_consensus.cc:3060] T deb0ef2084cc4ddf88165639552f3161 P dd2dd298b4404607b3f3a14b89cbbee4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.058147 27118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb0ef2084cc4ddf88165639552f3161" candidate_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7c0341504c3426280338a5599607a0d"
I20260709 13:10:29.059031 27118 raft_consensus.cc:3060] T deb0ef2084cc4ddf88165639552f3161 P e7c0341504c3426280338a5599607a0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.060117 27444 raft_consensus.cc:515] T 42dd3577afcf408eba8fc5c82a33e0c8 P dd2dd298b4404607b3f3a14b89cbbee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:29.064584 27117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42dd3577afcf408eba8fc5c82a33e0c8" candidate_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7c0341504c3426280338a5599607a0d"
I20260709 13:10:29.065346 27117 raft_consensus.cc:3060] T 42dd3577afcf408eba8fc5c82a33e0c8 P e7c0341504c3426280338a5599607a0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.070091 27268 raft_consensus.cc:2468] T deb0ef2084cc4ddf88165639552f3161 P dd2dd298b4404607b3f3a14b89cbbee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f0541c7472e4aef9aac8ad7d02e8e48 in term 1.
I20260709 13:10:29.071844 27451 leader_election.cc:290] T deb0ef2084cc4ddf88165639552f3161 P 9f0541c7472e4aef9aac8ad7d02e8e48 [CANDIDATE]: Term 1 election: Requested vote from peers e7c0341504c3426280338a5599607a0d (127.14.180.65:41105), dd2dd298b4404607b3f3a14b89cbbee4 (127.14.180.67:40131)
I20260709 13:10:29.073498 27118 raft_consensus.cc:2468] T deb0ef2084cc4ddf88165639552f3161 P e7c0341504c3426280338a5599607a0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f0541c7472e4aef9aac8ad7d02e8e48 in term 1.
I20260709 13:10:29.073843 27191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42dd3577afcf408eba8fc5c82a33e0c8" candidate_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48"
I20260709 13:10:29.074774 27191 raft_consensus.cc:3060] T 42dd3577afcf408eba8fc5c82a33e0c8 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:29.075253 27161 leader_election.cc:304] T deb0ef2084cc4ddf88165639552f3161 P 9f0541c7472e4aef9aac8ad7d02e8e48 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f0541c7472e4aef9aac8ad7d02e8e48, e7c0341504c3426280338a5599607a0d; no voters: 
I20260709 13:10:29.076695 27451 raft_consensus.cc:2804] T deb0ef2084cc4ddf88165639552f3161 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:29.077452 27451 raft_consensus.cc:697] T deb0ef2084cc4ddf88165639552f3161 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 1 LEADER]: Becoming Leader. State: Replica: 9f0541c7472e4aef9aac8ad7d02e8e48, State: Running, Role: LEADER
I20260709 13:10:29.078418 27451 consensus_queue.cc:237] T deb0ef2084cc4ddf88165639552f3161 P 9f0541c7472e4aef9aac8ad7d02e8e48 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:29.101156 27457 consensus_queue.cc:1048] T 83e5ce6906634b63a01333e50b5622be P dd2dd298b4404607b3f3a14b89cbbee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:29.107605 27117 raft_consensus.cc:2468] T 42dd3577afcf408eba8fc5c82a33e0c8 P e7c0341504c3426280338a5599607a0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd2dd298b4404607b3f3a14b89cbbee4 in term 1.
I20260709 13:10:29.121429 27444 leader_election.cc:290] T 42dd3577afcf408eba8fc5c82a33e0c8 P dd2dd298b4404607b3f3a14b89cbbee4 [CANDIDATE]: Term 1 election: Requested vote from peers e7c0341504c3426280338a5599607a0d (127.14.180.65:41105), 9f0541c7472e4aef9aac8ad7d02e8e48 (127.14.180.66:41411)
I20260709 13:10:29.112831 27191 raft_consensus.cc:2468] T 42dd3577afcf408eba8fc5c82a33e0c8 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd2dd298b4404607b3f3a14b89cbbee4 in term 1.
I20260709 13:10:29.123457 27234 leader_election.cc:304] T 42dd3577afcf408eba8fc5c82a33e0c8 P dd2dd298b4404607b3f3a14b89cbbee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f0541c7472e4aef9aac8ad7d02e8e48, dd2dd298b4404607b3f3a14b89cbbee4; no voters: 
I20260709 13:10:29.124749 27444 raft_consensus.cc:2804] T 42dd3577afcf408eba8fc5c82a33e0c8 P dd2dd298b4404607b3f3a14b89cbbee4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:29.125433 27444 raft_consensus.cc:697] T 42dd3577afcf408eba8fc5c82a33e0c8 P dd2dd298b4404607b3f3a14b89cbbee4 [term 1 LEADER]: Becoming Leader. State: Replica: dd2dd298b4404607b3f3a14b89cbbee4, State: Running, Role: LEADER
I20260709 13:10:29.126606 27444 consensus_queue.cc:237] T 42dd3577afcf408eba8fc5c82a33e0c8 P dd2dd298b4404607b3f3a14b89cbbee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:29.146940 27018 catalog_manager.cc:5697] T deb0ef2084cc4ddf88165639552f3161 P 9f0541c7472e4aef9aac8ad7d02e8e48 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9f0541c7472e4aef9aac8ad7d02e8e48 (127.14.180.66). New cstate: current_term: 1 leader_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:29.189221 27017 catalog_manager.cc:5697] T 42dd3577afcf408eba8fc5c82a33e0c8 P dd2dd298b4404607b3f3a14b89cbbee4 reported cstate change: term changed from 0 to 1, leader changed from <none> to dd2dd298b4404607b3f3a14b89cbbee4 (127.14.180.67). New cstate: current_term: 1 leader_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:29.222496 27451 consensus_queue.cc:1048] T f9463aebc13b49339561c1f5436e3142 P 9f0541c7472e4aef9aac8ad7d02e8e48 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:29.251752 27269 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "83e5ce6906634b63a01333e50b5622be"
dest_uuid: "dd2dd298b4404607b3f3a14b89cbbee4"
mode: GRACEFUL
new_leader_uuid: "e7c0341504c3426280338a5599607a0d"
 from {username='slave'} at 127.0.0.1:46088
I20260709 13:10:29.252496 27269 raft_consensus.cc:606] T 83e5ce6906634b63a01333e50b5622be P dd2dd298b4404607b3f3a14b89cbbee4 [term 1 LEADER]: Received request to transfer leadership to TS e7c0341504c3426280338a5599607a0d
I20260709 13:10:29.253820 27466 consensus_queue.cc:1048] T f9463aebc13b49339561c1f5436e3142 P 9f0541c7472e4aef9aac8ad7d02e8e48 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:29.272864 27191 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aa6e8c327dde42d3808411b7117dda68"
dest_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48"
mode: GRACEFUL
new_leader_uuid: "e7c0341504c3426280338a5599607a0d"
 from {username='slave'} at 127.0.0.1:38502
I20260709 13:10:29.273546 27191 raft_consensus.cc:606] T aa6e8c327dde42d3808411b7117dda68 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 1 LEADER]: Received request to transfer leadership to TS e7c0341504c3426280338a5599607a0d
I20260709 13:10:29.283838 27269 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b33f79df36ce42da96dda6972776a01d"
dest_uuid: "dd2dd298b4404607b3f3a14b89cbbee4"
mode: GRACEFUL
new_leader_uuid: "e7c0341504c3426280338a5599607a0d"
 from {username='slave'} at 127.0.0.1:46088
I20260709 13:10:29.284714 27269 raft_consensus.cc:606] T b33f79df36ce42da96dda6972776a01d P dd2dd298b4404607b3f3a14b89cbbee4 [term 1 LEADER]: Received request to transfer leadership to TS e7c0341504c3426280338a5599607a0d
I20260709 13:10:29.299962 27117 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e41aaa6d8213447b972d3eed31538da1"
dest_uuid: "e7c0341504c3426280338a5599607a0d"
mode: GRACEFUL
new_leader_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48"
 from {username='slave'} at 127.0.0.1:37548
I20260709 13:10:29.300555 27117 raft_consensus.cc:606] T e41aaa6d8213447b972d3eed31538da1 P e7c0341504c3426280338a5599607a0d [term 1 LEADER]: Received request to transfer leadership to TS 9f0541c7472e4aef9aac8ad7d02e8e48
I20260709 13:10:29.313267 27269 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d3aeec0e4dd34da6bb82d4774f566271"
dest_uuid: "dd2dd298b4404607b3f3a14b89cbbee4"
mode: GRACEFUL
new_leader_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48"
 from {username='slave'} at 127.0.0.1:46088
I20260709 13:10:29.313975 27269 raft_consensus.cc:606] T d3aeec0e4dd34da6bb82d4774f566271 P dd2dd298b4404607b3f3a14b89cbbee4 [term 1 LEADER]: Received request to transfer leadership to TS 9f0541c7472e4aef9aac8ad7d02e8e48
I20260709 13:10:29.553191 27451 consensus_queue.cc:1048] T deb0ef2084cc4ddf88165639552f3161 P 9f0541c7472e4aef9aac8ad7d02e8e48 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:29.568228 27466 consensus_queue.cc:1048] T deb0ef2084cc4ddf88165639552f3161 P 9f0541c7472e4aef9aac8ad7d02e8e48 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:29.616583 27457 raft_consensus.cc:993] T b33f79df36ce42da96dda6972776a01d P dd2dd298b4404607b3f3a14b89cbbee4: : Instructing follower e7c0341504c3426280338a5599607a0d to start an election
I20260709 13:10:29.617251 27405 raft_consensus.cc:1081] T b33f79df36ce42da96dda6972776a01d P dd2dd298b4404607b3f3a14b89cbbee4 [term 1 LEADER]: Signalling peer e7c0341504c3426280338a5599607a0d to start an election
I20260709 13:10:29.619153 27118 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b33f79df36ce42da96dda6972776a01d"
dest_uuid: "e7c0341504c3426280338a5599607a0d"
 from {username='slave'} at 127.0.0.1:37532
I20260709 13:10:29.619886 27118 raft_consensus.cc:493] T b33f79df36ce42da96dda6972776a01d P e7c0341504c3426280338a5599607a0d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:29.620388 27118 raft_consensus.cc:3060] T b33f79df36ce42da96dda6972776a01d P e7c0341504c3426280338a5599607a0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:29.621953 27405 raft_consensus.cc:993] T 83e5ce6906634b63a01333e50b5622be P dd2dd298b4404607b3f3a14b89cbbee4: : Instructing follower e7c0341504c3426280338a5599607a0d to start an election
I20260709 13:10:29.622529 27444 raft_consensus.cc:1081] T 83e5ce6906634b63a01333e50b5622be P dd2dd298b4404607b3f3a14b89cbbee4 [term 1 LEADER]: Signalling peer e7c0341504c3426280338a5599607a0d to start an election
I20260709 13:10:29.624235 27117 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "83e5ce6906634b63a01333e50b5622be"
dest_uuid: "e7c0341504c3426280338a5599607a0d"
 from {username='slave'} at 127.0.0.1:37532
I20260709 13:10:29.624778 27117 raft_consensus.cc:493] T 83e5ce6906634b63a01333e50b5622be P e7c0341504c3426280338a5599607a0d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:29.625113 27117 raft_consensus.cc:3060] T 83e5ce6906634b63a01333e50b5622be P e7c0341504c3426280338a5599607a0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:29.629879 27444 consensus_queue.cc:1048] T 42dd3577afcf408eba8fc5c82a33e0c8 P dd2dd298b4404607b3f3a14b89cbbee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:29.630036 27118 raft_consensus.cc:515] T b33f79df36ce42da96dda6972776a01d P e7c0341504c3426280338a5599607a0d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:29.633569 27118 leader_election.cc:290] T b33f79df36ce42da96dda6972776a01d P e7c0341504c3426280338a5599607a0d [CANDIDATE]: Term 2 election: Requested vote from peers 9f0541c7472e4aef9aac8ad7d02e8e48 (127.14.180.66:41411), dd2dd298b4404607b3f3a14b89cbbee4 (127.14.180.67:40131)
I20260709 13:10:29.633405 27117 raft_consensus.cc:515] T 83e5ce6906634b63a01333e50b5622be P e7c0341504c3426280338a5599607a0d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:29.635804 27269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33f79df36ce42da96dda6972776a01d" candidate_uuid: "e7c0341504c3426280338a5599607a0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dd2dd298b4404607b3f3a14b89cbbee4"
I20260709 13:10:29.640491 27269 raft_consensus.cc:3055] T b33f79df36ce42da96dda6972776a01d P dd2dd298b4404607b3f3a14b89cbbee4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:29.640933 27269 raft_consensus.cc:740] T b33f79df36ce42da96dda6972776a01d P dd2dd298b4404607b3f3a14b89cbbee4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dd2dd298b4404607b3f3a14b89cbbee4, State: Running, Role: LEADER
I20260709 13:10:29.641868 27269 consensus_queue.cc:260] T b33f79df36ce42da96dda6972776a01d P dd2dd298b4404607b3f3a14b89cbbee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:29.643249 27405 raft_consensus.cc:993] T d3aeec0e4dd34da6bb82d4774f566271 P dd2dd298b4404607b3f3a14b89cbbee4: : Instructing follower 9f0541c7472e4aef9aac8ad7d02e8e48 to start an election
I20260709 13:10:29.643337 27269 raft_consensus.cc:3060] T b33f79df36ce42da96dda6972776a01d P dd2dd298b4404607b3f3a14b89cbbee4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:29.643996 27405 raft_consensus.cc:1081] T d3aeec0e4dd34da6bb82d4774f566271 P dd2dd298b4404607b3f3a14b89cbbee4 [term 1 LEADER]: Signalling peer 9f0541c7472e4aef9aac8ad7d02e8e48 to start an election
I20260709 13:10:29.645887 27195 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d3aeec0e4dd34da6bb82d4774f566271"
dest_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48"
 from {username='slave'} at 127.0.0.1:38492
I20260709 13:10:29.636669 27117 leader_election.cc:290] T 83e5ce6906634b63a01333e50b5622be P e7c0341504c3426280338a5599607a0d [CANDIDATE]: Term 2 election: Requested vote from peers 9f0541c7472e4aef9aac8ad7d02e8e48 (127.14.180.66:41411), dd2dd298b4404607b3f3a14b89cbbee4 (127.14.180.67:40131)
I20260709 13:10:29.637660 27193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b33f79df36ce42da96dda6972776a01d" candidate_uuid: "e7c0341504c3426280338a5599607a0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48"
I20260709 13:10:29.646502 27195 raft_consensus.cc:493] T d3aeec0e4dd34da6bb82d4774f566271 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:29.646672 27193 raft_consensus.cc:3060] T b33f79df36ce42da96dda6972776a01d P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:29.646984 27195 raft_consensus.cc:3060] T d3aeec0e4dd34da6bb82d4774f566271 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:29.637666 27196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e5ce6906634b63a01333e50b5622be" candidate_uuid: "e7c0341504c3426280338a5599607a0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48"
I20260709 13:10:29.639320 27268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83e5ce6906634b63a01333e50b5622be" candidate_uuid: "e7c0341504c3426280338a5599607a0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dd2dd298b4404607b3f3a14b89cbbee4"
I20260709 13:10:29.650830 27268 raft_consensus.cc:3055] T 83e5ce6906634b63a01333e50b5622be P dd2dd298b4404607b3f3a14b89cbbee4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:29.651203 27268 raft_consensus.cc:740] T 83e5ce6906634b63a01333e50b5622be P dd2dd298b4404607b3f3a14b89cbbee4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dd2dd298b4404607b3f3a14b89cbbee4, State: Running, Role: LEADER
I20260709 13:10:29.652057 27268 consensus_queue.cc:260] T 83e5ce6906634b63a01333e50b5622be P dd2dd298b4404607b3f3a14b89cbbee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:29.653297 27268 raft_consensus.cc:3060] T 83e5ce6906634b63a01333e50b5622be P dd2dd298b4404607b3f3a14b89cbbee4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:29.650475 27196 raft_consensus.cc:3060] T 83e5ce6906634b63a01333e50b5622be P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:29.661337 27195 raft_consensus.cc:515] T d3aeec0e4dd34da6bb82d4774f566271 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:29.663792 27196 raft_consensus.cc:2468] T 83e5ce6906634b63a01333e50b5622be P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7c0341504c3426280338a5599607a0d in term 2.
I20260709 13:10:29.667135 27405 consensus_queue.cc:1048] T 42dd3577afcf408eba8fc5c82a33e0c8 P dd2dd298b4404607b3f3a14b89cbbee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:29.670964 27085 leader_election.cc:304] T 83e5ce6906634b63a01333e50b5622be P e7c0341504c3426280338a5599607a0d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f0541c7472e4aef9aac8ad7d02e8e48, e7c0341504c3426280338a5599607a0d; no voters: 
I20260709 13:10:29.672742 27343 raft_consensus.cc:2804] T 83e5ce6906634b63a01333e50b5622be P e7c0341504c3426280338a5599607a0d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:29.673296 27343 raft_consensus.cc:697] T 83e5ce6906634b63a01333e50b5622be P e7c0341504c3426280338a5599607a0d [term 2 LEADER]: Becoming Leader. State: Replica: e7c0341504c3426280338a5599607a0d, State: Running, Role: LEADER
I20260709 13:10:29.674137 27343 consensus_queue.cc:237] T 83e5ce6906634b63a01333e50b5622be P e7c0341504c3426280338a5599607a0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:29.678179 27268 raft_consensus.cc:2468] T 83e5ce6906634b63a01333e50b5622be P dd2dd298b4404607b3f3a14b89cbbee4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7c0341504c3426280338a5599607a0d in term 2.
I20260709 13:10:29.680769 27195 leader_election.cc:290] T d3aeec0e4dd34da6bb82d4774f566271 P 9f0541c7472e4aef9aac8ad7d02e8e48 [CANDIDATE]: Term 2 election: Requested vote from peers e7c0341504c3426280338a5599607a0d (127.14.180.65:41105), dd2dd298b4404607b3f3a14b89cbbee4 (127.14.180.67:40131)
I20260709 13:10:29.681826 27121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3aeec0e4dd34da6bb82d4774f566271" candidate_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e7c0341504c3426280338a5599607a0d"
I20260709 13:10:29.682569 27121 raft_consensus.cc:3060] T d3aeec0e4dd34da6bb82d4774f566271 P e7c0341504c3426280338a5599607a0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:29.687417 27270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3aeec0e4dd34da6bb82d4774f566271" candidate_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dd2dd298b4404607b3f3a14b89cbbee4"
I20260709 13:10:29.688163 27270 raft_consensus.cc:3055] T d3aeec0e4dd34da6bb82d4774f566271 P dd2dd298b4404607b3f3a14b89cbbee4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:29.688460 27270 raft_consensus.cc:740] T d3aeec0e4dd34da6bb82d4774f566271 P dd2dd298b4404607b3f3a14b89cbbee4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: dd2dd298b4404607b3f3a14b89cbbee4, State: Running, Role: LEADER
I20260709 13:10:29.691057 27270 consensus_queue.cc:260] T d3aeec0e4dd34da6bb82d4774f566271 P dd2dd298b4404607b3f3a14b89cbbee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:29.692276 27270 raft_consensus.cc:3060] T d3aeec0e4dd34da6bb82d4774f566271 P dd2dd298b4404607b3f3a14b89cbbee4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:29.698140 27270 raft_consensus.cc:2468] T d3aeec0e4dd34da6bb82d4774f566271 P dd2dd298b4404607b3f3a14b89cbbee4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f0541c7472e4aef9aac8ad7d02e8e48 in term 2.
I20260709 13:10:29.697321 27017 catalog_manager.cc:5697] T 83e5ce6906634b63a01333e50b5622be P e7c0341504c3426280338a5599607a0d reported cstate change: term changed from 1 to 2, leader changed from dd2dd298b4404607b3f3a14b89cbbee4 (127.14.180.67) to e7c0341504c3426280338a5599607a0d (127.14.180.65). New cstate: current_term: 2 leader_uuid: "e7c0341504c3426280338a5599607a0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:29.698140 27121 raft_consensus.cc:2468] T d3aeec0e4dd34da6bb82d4774f566271 P e7c0341504c3426280338a5599607a0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f0541c7472e4aef9aac8ad7d02e8e48 in term 2.
I20260709 13:10:29.704149 27161 leader_election.cc:304] T d3aeec0e4dd34da6bb82d4774f566271 P 9f0541c7472e4aef9aac8ad7d02e8e48 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f0541c7472e4aef9aac8ad7d02e8e48, e7c0341504c3426280338a5599607a0d; no voters: 
I20260709 13:10:29.705737 27453 raft_consensus.cc:2804] T d3aeec0e4dd34da6bb82d4774f566271 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:29.706427 27453 raft_consensus.cc:697] T d3aeec0e4dd34da6bb82d4774f566271 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 2 LEADER]: Becoming Leader. State: Replica: 9f0541c7472e4aef9aac8ad7d02e8e48, State: Running, Role: LEADER
I20260709 13:10:29.707458 27453 consensus_queue.cc:237] T d3aeec0e4dd34da6bb82d4774f566271 P 9f0541c7472e4aef9aac8ad7d02e8e48 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:29.714658 27193 raft_consensus.cc:2468] T b33f79df36ce42da96dda6972776a01d P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7c0341504c3426280338a5599607a0d in term 2.
I20260709 13:10:29.717224 27085 leader_election.cc:304] T b33f79df36ce42da96dda6972776a01d P e7c0341504c3426280338a5599607a0d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f0541c7472e4aef9aac8ad7d02e8e48, e7c0341504c3426280338a5599607a0d; no voters: 
I20260709 13:10:29.718508 27426 raft_consensus.cc:2804] T b33f79df36ce42da96dda6972776a01d P e7c0341504c3426280338a5599607a0d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:29.724324 27269 raft_consensus.cc:2468] T b33f79df36ce42da96dda6972776a01d P dd2dd298b4404607b3f3a14b89cbbee4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7c0341504c3426280338a5599607a0d in term 2.
I20260709 13:10:29.726042 27016 catalog_manager.cc:5697] T d3aeec0e4dd34da6bb82d4774f566271 P 9f0541c7472e4aef9aac8ad7d02e8e48 reported cstate change: term changed from 1 to 2, leader changed from dd2dd298b4404607b3f3a14b89cbbee4 (127.14.180.67) to 9f0541c7472e4aef9aac8ad7d02e8e48 (127.14.180.66). New cstate: current_term: 2 leader_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:29.735677 27426 raft_consensus.cc:697] T b33f79df36ce42da96dda6972776a01d P e7c0341504c3426280338a5599607a0d [term 2 LEADER]: Becoming Leader. State: Replica: e7c0341504c3426280338a5599607a0d, State: Running, Role: LEADER
I20260709 13:10:29.736891 27426 consensus_queue.cc:237] T b33f79df36ce42da96dda6972776a01d P e7c0341504c3426280338a5599607a0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:29.759851 27016 catalog_manager.cc:5697] T b33f79df36ce42da96dda6972776a01d P e7c0341504c3426280338a5599607a0d reported cstate change: term changed from 1 to 2, leader changed from dd2dd298b4404607b3f3a14b89cbbee4 (127.14.180.67) to e7c0341504c3426280338a5599607a0d (127.14.180.65). New cstate: current_term: 2 leader_uuid: "e7c0341504c3426280338a5599607a0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:29.837860 27343 raft_consensus.cc:993] T e41aaa6d8213447b972d3eed31538da1 P e7c0341504c3426280338a5599607a0d: : Instructing follower 9f0541c7472e4aef9aac8ad7d02e8e48 to start an election
I20260709 13:10:29.838445 27426 raft_consensus.cc:1081] T e41aaa6d8213447b972d3eed31538da1 P e7c0341504c3426280338a5599607a0d [term 1 LEADER]: Signalling peer 9f0541c7472e4aef9aac8ad7d02e8e48 to start an election
I20260709 13:10:29.840286 27193 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e41aaa6d8213447b972d3eed31538da1"
dest_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48"
 from {username='slave'} at 127.0.0.1:38486
I20260709 13:10:29.840957 27193 raft_consensus.cc:493] T e41aaa6d8213447b972d3eed31538da1 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:29.841382 27193 raft_consensus.cc:3060] T e41aaa6d8213447b972d3eed31538da1 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:29.850175 27193 raft_consensus.cc:515] T e41aaa6d8213447b972d3eed31538da1 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:29.852624 27193 leader_election.cc:290] T e41aaa6d8213447b972d3eed31538da1 P 9f0541c7472e4aef9aac8ad7d02e8e48 [CANDIDATE]: Term 2 election: Requested vote from peers e7c0341504c3426280338a5599607a0d (127.14.180.65:41105), dd2dd298b4404607b3f3a14b89cbbee4 (127.14.180.67:40131)
I20260709 13:10:29.854318 27269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e41aaa6d8213447b972d3eed31538da1" candidate_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dd2dd298b4404607b3f3a14b89cbbee4"
I20260709 13:10:29.854430 27117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e41aaa6d8213447b972d3eed31538da1" candidate_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e7c0341504c3426280338a5599607a0d"
I20260709 13:10:29.855302 27269 raft_consensus.cc:3060] T e41aaa6d8213447b972d3eed31538da1 P dd2dd298b4404607b3f3a14b89cbbee4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:29.855441 27117 raft_consensus.cc:3055] T e41aaa6d8213447b972d3eed31538da1 P e7c0341504c3426280338a5599607a0d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:29.855959 27117 raft_consensus.cc:740] T e41aaa6d8213447b972d3eed31538da1 P e7c0341504c3426280338a5599607a0d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e7c0341504c3426280338a5599607a0d, State: Running, Role: LEADER
I20260709 13:10:29.857280 27117 consensus_queue.cc:260] T e41aaa6d8213447b972d3eed31538da1 P e7c0341504c3426280338a5599607a0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:29.858814 27117 raft_consensus.cc:3060] T e41aaa6d8213447b972d3eed31538da1 P e7c0341504c3426280338a5599607a0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:29.863281 27451 raft_consensus.cc:993] T aa6e8c327dde42d3808411b7117dda68 P 9f0541c7472e4aef9aac8ad7d02e8e48: : Instructing follower e7c0341504c3426280338a5599607a0d to start an election
I20260709 13:10:29.863898 27451 raft_consensus.cc:1081] T aa6e8c327dde42d3808411b7117dda68 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 1 LEADER]: Signalling peer e7c0341504c3426280338a5599607a0d to start an election
I20260709 13:10:29.866338 27121 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aa6e8c327dde42d3808411b7117dda68"
dest_uuid: "e7c0341504c3426280338a5599607a0d"
 from {username='slave'} at 127.0.0.1:37528
I20260709 13:10:29.866416 27269 raft_consensus.cc:2468] T e41aaa6d8213447b972d3eed31538da1 P dd2dd298b4404607b3f3a14b89cbbee4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f0541c7472e4aef9aac8ad7d02e8e48 in term 2.
I20260709 13:10:29.866990 27121 raft_consensus.cc:493] T aa6e8c327dde42d3808411b7117dda68 P e7c0341504c3426280338a5599607a0d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:29.867295 27117 raft_consensus.cc:2468] T e41aaa6d8213447b972d3eed31538da1 P e7c0341504c3426280338a5599607a0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f0541c7472e4aef9aac8ad7d02e8e48 in term 2.
I20260709 13:10:29.867477 27121 raft_consensus.cc:3060] T aa6e8c327dde42d3808411b7117dda68 P e7c0341504c3426280338a5599607a0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:29.868146 27162 leader_election.cc:304] T e41aaa6d8213447b972d3eed31538da1 P 9f0541c7472e4aef9aac8ad7d02e8e48 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9f0541c7472e4aef9aac8ad7d02e8e48, dd2dd298b4404607b3f3a14b89cbbee4; no voters: 
I20260709 13:10:29.869267 27453 raft_consensus.cc:2804] T e41aaa6d8213447b972d3eed31538da1 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:29.869902 27453 raft_consensus.cc:697] T e41aaa6d8213447b972d3eed31538da1 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 2 LEADER]: Becoming Leader. State: Replica: 9f0541c7472e4aef9aac8ad7d02e8e48, State: Running, Role: LEADER
I20260709 13:10:29.871402 27453 consensus_queue.cc:237] T e41aaa6d8213447b972d3eed31538da1 P 9f0541c7472e4aef9aac8ad7d02e8e48 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:29.875259 27121 raft_consensus.cc:515] T aa6e8c327dde42d3808411b7117dda68 P e7c0341504c3426280338a5599607a0d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:29.880177 27121 leader_election.cc:290] T aa6e8c327dde42d3808411b7117dda68 P e7c0341504c3426280338a5599607a0d [CANDIDATE]: Term 2 election: Requested vote from peers 9f0541c7472e4aef9aac8ad7d02e8e48 (127.14.180.66:41411), dd2dd298b4404607b3f3a14b89cbbee4 (127.14.180.67:40131)
I20260709 13:10:29.881664 27269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6e8c327dde42d3808411b7117dda68" candidate_uuid: "e7c0341504c3426280338a5599607a0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "dd2dd298b4404607b3f3a14b89cbbee4"
I20260709 13:10:29.882069 27193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa6e8c327dde42d3808411b7117dda68" candidate_uuid: "e7c0341504c3426280338a5599607a0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48"
I20260709 13:10:29.882560 27269 raft_consensus.cc:3060] T aa6e8c327dde42d3808411b7117dda68 P dd2dd298b4404607b3f3a14b89cbbee4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:29.882925 27193 raft_consensus.cc:3055] T aa6e8c327dde42d3808411b7117dda68 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:29.883452 27193 raft_consensus.cc:740] T aa6e8c327dde42d3808411b7117dda68 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9f0541c7472e4aef9aac8ad7d02e8e48, State: Running, Role: LEADER
I20260709 13:10:29.888556 27193 consensus_queue.cc:260] T aa6e8c327dde42d3808411b7117dda68 P 9f0541c7472e4aef9aac8ad7d02e8e48 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:29.890512 27193 raft_consensus.cc:3060] T aa6e8c327dde42d3808411b7117dda68 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:29.892273 27269 raft_consensus.cc:2468] T aa6e8c327dde42d3808411b7117dda68 P dd2dd298b4404607b3f3a14b89cbbee4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7c0341504c3426280338a5599607a0d in term 2.
I20260709 13:10:29.891817 27016 catalog_manager.cc:5697] T e41aaa6d8213447b972d3eed31538da1 P 9f0541c7472e4aef9aac8ad7d02e8e48 reported cstate change: term changed from 1 to 2, leader changed from e7c0341504c3426280338a5599607a0d (127.14.180.65) to 9f0541c7472e4aef9aac8ad7d02e8e48 (127.14.180.66). New cstate: current_term: 2 leader_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:29.893973 27087 leader_election.cc:304] T aa6e8c327dde42d3808411b7117dda68 P e7c0341504c3426280338a5599607a0d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dd2dd298b4404607b3f3a14b89cbbee4, e7c0341504c3426280338a5599607a0d; no voters: 
I20260709 13:10:29.895462 27426 raft_consensus.cc:2804] T aa6e8c327dde42d3808411b7117dda68 P e7c0341504c3426280338a5599607a0d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:29.896579 27426 raft_consensus.cc:697] T aa6e8c327dde42d3808411b7117dda68 P e7c0341504c3426280338a5599607a0d [term 2 LEADER]: Becoming Leader. State: Replica: e7c0341504c3426280338a5599607a0d, State: Running, Role: LEADER
I20260709 13:10:29.897673 27426 consensus_queue.cc:237] T aa6e8c327dde42d3808411b7117dda68 P e7c0341504c3426280338a5599607a0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:29.900348 27193 raft_consensus.cc:2468] T aa6e8c327dde42d3808411b7117dda68 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e7c0341504c3426280338a5599607a0d in term 2.
I20260709 13:10:29.909096 27016 catalog_manager.cc:5697] T aa6e8c327dde42d3808411b7117dda68 P e7c0341504c3426280338a5599607a0d reported cstate change: term changed from 1 to 2, leader changed from 9f0541c7472e4aef9aac8ad7d02e8e48 (127.14.180.66) to e7c0341504c3426280338a5599607a0d (127.14.180.65). New cstate: current_term: 2 leader_uuid: "e7c0341504c3426280338a5599607a0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:30.185768 27269 raft_consensus.cc:1275] T d3aeec0e4dd34da6bb82d4774f566271 P dd2dd298b4404607b3f3a14b89cbbee4 [term 2 FOLLOWER]: Refusing update from remote peer 9f0541c7472e4aef9aac8ad7d02e8e48: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:30.187376 27453 consensus_queue.cc:1048] T d3aeec0e4dd34da6bb82d4774f566271 P 9f0541c7472e4aef9aac8ad7d02e8e48 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:30.207149 27117 raft_consensus.cc:1275] T d3aeec0e4dd34da6bb82d4774f566271 P e7c0341504c3426280338a5599607a0d [term 2 FOLLOWER]: Refusing update from remote peer 9f0541c7472e4aef9aac8ad7d02e8e48: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:30.210273 27451 consensus_queue.cc:1048] T d3aeec0e4dd34da6bb82d4774f566271 P 9f0541c7472e4aef9aac8ad7d02e8e48 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:30.245671 27193 raft_consensus.cc:1275] T b33f79df36ce42da96dda6972776a01d P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 2 FOLLOWER]: Refusing update from remote peer e7c0341504c3426280338a5599607a0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:30.247466 27426 consensus_queue.cc:1048] T b33f79df36ce42da96dda6972776a01d P e7c0341504c3426280338a5599607a0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:30.260931 27195 raft_consensus.cc:1275] T 83e5ce6906634b63a01333e50b5622be P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 2 FOLLOWER]: Refusing update from remote peer e7c0341504c3426280338a5599607a0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:30.263360 27269 raft_consensus.cc:1275] T b33f79df36ce42da96dda6972776a01d P dd2dd298b4404607b3f3a14b89cbbee4 [term 2 FOLLOWER]: Refusing update from remote peer e7c0341504c3426280338a5599607a0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:30.265966 27343 consensus_queue.cc:1048] T b33f79df36ce42da96dda6972776a01d P e7c0341504c3426280338a5599607a0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:30.263454 27502 consensus_queue.cc:1048] T 83e5ce6906634b63a01333e50b5622be P e7c0341504c3426280338a5599607a0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 13:10:30.291436 27269 raft_consensus.cc:1275] T 83e5ce6906634b63a01333e50b5622be P dd2dd298b4404607b3f3a14b89cbbee4 [term 2 FOLLOWER]: Refusing update from remote peer e7c0341504c3426280338a5599607a0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:30.293110 27426 consensus_queue.cc:1048] T 83e5ce6906634b63a01333e50b5622be P e7c0341504c3426280338a5599607a0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:30.336163 27269 raft_consensus.cc:1275] T aa6e8c327dde42d3808411b7117dda68 P dd2dd298b4404607b3f3a14b89cbbee4 [term 2 FOLLOWER]: Refusing update from remote peer e7c0341504c3426280338a5599607a0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:30.337970 27343 consensus_queue.cc:1048] T aa6e8c327dde42d3808411b7117dda68 P e7c0341504c3426280338a5599607a0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:30.346259 27117 raft_consensus.cc:1275] T e41aaa6d8213447b972d3eed31538da1 P e7c0341504c3426280338a5599607a0d [term 2 FOLLOWER]: Refusing update from remote peer 9f0541c7472e4aef9aac8ad7d02e8e48: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:30.348281 27451 consensus_queue.cc:1048] T e41aaa6d8213447b972d3eed31538da1 P 9f0541c7472e4aef9aac8ad7d02e8e48 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:30.355365 27193 raft_consensus.cc:1275] T aa6e8c327dde42d3808411b7117dda68 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 2 FOLLOWER]: Refusing update from remote peer e7c0341504c3426280338a5599607a0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:30.357583 27270 raft_consensus.cc:1275] T e41aaa6d8213447b972d3eed31538da1 P dd2dd298b4404607b3f3a14b89cbbee4 [term 2 FOLLOWER]: Refusing update from remote peer 9f0541c7472e4aef9aac8ad7d02e8e48: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:30.360221 27466 consensus_queue.cc:1048] T e41aaa6d8213447b972d3eed31538da1 P 9f0541c7472e4aef9aac8ad7d02e8e48 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:30.360364 27426 consensus_queue.cc:1048] T aa6e8c327dde42d3808411b7117dda68 P e7c0341504c3426280338a5599607a0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:32.321624 27017 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:54918:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:10:32.343039 27017 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:54918:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:10:32.367728 15057 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:10:32.546186 27543 log.cc:927] Time spent T deb0ef2084cc4ddf88165639552f3161 P 9f0541c7472e4aef9aac8ad7d02e8e48: Append to log took a long time: real 0.057s	user 0.001s	sys 0.001s
W20260709 13:10:32.607769 27549 log.cc:927] Time spent T 42dd3577afcf408eba8fc5c82a33e0c8 P e7c0341504c3426280338a5599607a0d: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:10:32.628925 27196 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c0a2c588c6f148ef9976d15d1a79ba74"
dest_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48"
mode: GRACEFUL
new_leader_uuid: "dd2dd298b4404607b3f3a14b89cbbee4"
 from {username='slave'} at 127.0.0.1:56084
I20260709 13:10:32.647773 27196 raft_consensus.cc:606] T c0a2c588c6f148ef9976d15d1a79ba74 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 1 LEADER]: Received request to transfer leadership to TS dd2dd298b4404607b3f3a14b89cbbee4
I20260709 13:10:32.683753 27568 tablet.cc:1724] T 42dd3577afcf408eba8fc5c82a33e0c8 P dd2dd298b4404607b3f3a14b89cbbee4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:10:32.743383 27557 log.cc:927] Time spent T b33f79df36ce42da96dda6972776a01d P e7c0341504c3426280338a5599607a0d: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 13:10:32.747588 27571 tablet.cc:1724] T f9463aebc13b49339561c1f5436e3142 P 9f0541c7472e4aef9aac8ad7d02e8e48: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:10:32.737744 27161 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.65:41105, user_credentials={real_user=slave}} blocked reactor thread for 55183.9us
I20260709 13:10:32.754676 27570 tablet.cc:1724] T 42dd3577afcf408eba8fc5c82a33e0c8 P 9f0541c7472e4aef9aac8ad7d02e8e48: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:32.767499 27579 tablet.cc:1724] T aa6e8c327dde42d3808411b7117dda68 P e7c0341504c3426280338a5599607a0d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:32.770964 27568 tablet.cc:1724] T f9463aebc13b49339561c1f5436e3142 P dd2dd298b4404607b3f3a14b89cbbee4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:10:32.810074 27085 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.66:41411, user_credentials={real_user=slave}} blocked reactor thread for 72784.1us
I20260709 13:10:32.881949 27118 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d5c696708616494588c1322fabef87f2"
dest_uuid: "e7c0341504c3426280338a5599607a0d"
mode: GRACEFUL
new_leader_uuid: "dd2dd298b4404607b3f3a14b89cbbee4"
 from {username='slave'} at 127.0.0.1:56872
I20260709 13:10:32.884258 27586 tablet.cc:1724] T e41aaa6d8213447b972d3eed31538da1 P dd2dd298b4404607b3f3a14b89cbbee4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:32.825330 27580 tablet.cc:1724] T e41aaa6d8213447b972d3eed31538da1 P 9f0541c7472e4aef9aac8ad7d02e8e48: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:32.880721 27584 tablet.cc:1724] T 83e5ce6906634b63a01333e50b5622be P e7c0341504c3426280338a5599607a0d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:32.910761 27118 raft_consensus.cc:606] T d5c696708616494588c1322fabef87f2 P e7c0341504c3426280338a5599607a0d [term 1 LEADER]: Received request to transfer leadership to TS dd2dd298b4404607b3f3a14b89cbbee4
I20260709 13:10:32.893572 27571 tablet.cc:1724] T d3aeec0e4dd34da6bb82d4774f566271 P 9f0541c7472e4aef9aac8ad7d02e8e48: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:32.915302 15057 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:10:32.916023 15057 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:32.916164 27017 catalog_manager.cc:5789] TS e7c0341504c3426280338a5599607a0d (127.14.180.65:41105) does not have the latest schema for tablet b33f79df36ce42da96dda6972776a01d (table soft_deleted_table [id=d3c3b75363a5472a8e8546ae9224d5e4]). Expected version 1 got 0
I20260709 13:10:32.916780 27576 raft_consensus.cc:993] T c0a2c588c6f148ef9976d15d1a79ba74 P 9f0541c7472e4aef9aac8ad7d02e8e48: : Instructing follower dd2dd298b4404607b3f3a14b89cbbee4 to start an election
I20260709 13:10:32.917136 27017 catalog_manager.cc:5789] TS e7c0341504c3426280338a5599607a0d (127.14.180.65:41105) does not have the latest schema for tablet c972f59715c6476fb68a0a9dcc7b54d3 (table soft_deleted_table [id=d3c3b75363a5472a8e8546ae9224d5e4]). Expected version 1 got 0
I20260709 13:10:32.917479 27572 raft_consensus.cc:1081] T c0a2c588c6f148ef9976d15d1a79ba74 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 1 LEADER]: Signalling peer dd2dd298b4404607b3f3a14b89cbbee4 to start an election
W20260709 13:10:32.882941 27087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.14.180.67:40131, user_credentials={real_user=slave}} blocked reactor thread for 89866.2us
I20260709 13:10:32.901889 27570 tablet.cc:1724] T deb0ef2084cc4ddf88165639552f3161 P 9f0541c7472e4aef9aac8ad7d02e8e48: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:32.927333 27261 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c0a2c588c6f148ef9976d15d1a79ba74"
dest_uuid: "dd2dd298b4404607b3f3a14b89cbbee4"
 from {username='slave'} at 127.0.0.1:46074
I20260709 13:10:32.932152 27261 raft_consensus.cc:493] T c0a2c588c6f148ef9976d15d1a79ba74 P dd2dd298b4404607b3f3a14b89cbbee4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:32.932768 27261 raft_consensus.cc:3060] T c0a2c588c6f148ef9976d15d1a79ba74 P dd2dd298b4404607b3f3a14b89cbbee4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:32.955806 27587 tablet.cc:1724] T e41aaa6d8213447b972d3eed31538da1 P e7c0341504c3426280338a5599607a0d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:32.958138 27579 tablet.cc:1724] T 42dd3577afcf408eba8fc5c82a33e0c8 P e7c0341504c3426280338a5599607a0d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:32.974766 27591 tablet.cc:1724] T aa6e8c327dde42d3808411b7117dda68 P dd2dd298b4404607b3f3a14b89cbbee4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:32.976929 27426 raft_consensus.cc:993] T d5c696708616494588c1322fabef87f2 P e7c0341504c3426280338a5599607a0d: : Instructing follower dd2dd298b4404607b3f3a14b89cbbee4 to start an election
I20260709 13:10:32.964150 27586 tablet.cc:1724] T deb0ef2084cc4ddf88165639552f3161 P dd2dd298b4404607b3f3a14b89cbbee4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:32.977734 27585 raft_consensus.cc:1081] T d5c696708616494588c1322fabef87f2 P e7c0341504c3426280338a5599607a0d [term 1 LEADER]: Signalling peer dd2dd298b4404607b3f3a14b89cbbee4 to start an election
I20260709 13:10:32.979283 27570 tablet.cc:1724] T b33f79df36ce42da96dda6972776a01d P 9f0541c7472e4aef9aac8ad7d02e8e48: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:32.980052 27270 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d5c696708616494588c1322fabef87f2"
dest_uuid: "dd2dd298b4404607b3f3a14b89cbbee4"
 from {username='slave'} at 127.0.0.1:46062
I20260709 13:10:32.953971 27568 tablet.cc:1724] T d3aeec0e4dd34da6bb82d4774f566271 P dd2dd298b4404607b3f3a14b89cbbee4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:32.966941 27261 raft_consensus.cc:515] T c0a2c588c6f148ef9976d15d1a79ba74 P dd2dd298b4404607b3f3a14b89cbbee4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:32.971951 27589 tablet.cc:1724] T aa6e8c327dde42d3808411b7117dda68 P 9f0541c7472e4aef9aac8ad7d02e8e48: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:32.980660 27270 raft_consensus.cc:493] T d5c696708616494588c1322fabef87f2 P dd2dd298b4404607b3f3a14b89cbbee4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:32.990409 27270 raft_consensus.cc:3060] T d5c696708616494588c1322fabef87f2 P dd2dd298b4404607b3f3a14b89cbbee4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:32.995036 27017 catalog_manager.cc:5789] TS 9f0541c7472e4aef9aac8ad7d02e8e48 (127.14.180.66:41411) does not have the latest schema for tablet e41aaa6d8213447b972d3eed31538da1 (table soft_deleted_table [id=d3c3b75363a5472a8e8546ae9224d5e4]). Expected version 1 got 0
I20260709 13:10:32.996193 27017 catalog_manager.cc:5789] TS 9f0541c7472e4aef9aac8ad7d02e8e48 (127.14.180.66:41411) does not have the latest schema for tablet d3aeec0e4dd34da6bb82d4774f566271 (table soft_deleted_table [id=d3c3b75363a5472a8e8546ae9224d5e4]). Expected version 1 got 0
I20260709 13:10:32.996798 27017 catalog_manager.cc:5789] TS 9f0541c7472e4aef9aac8ad7d02e8e48 (127.14.180.66:41411) does not have the latest schema for tablet deb0ef2084cc4ddf88165639552f3161 (table soft_deleted_table [id=d3c3b75363a5472a8e8546ae9224d5e4]). Expected version 1 got 0
I20260709 13:10:32.998374 27270 raft_consensus.cc:515] T d5c696708616494588c1322fabef87f2 P dd2dd298b4404607b3f3a14b89cbbee4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:33.001196 27270 leader_election.cc:290] T d5c696708616494588c1322fabef87f2 P dd2dd298b4404607b3f3a14b89cbbee4 [CANDIDATE]: Term 2 election: Requested vote from peers e7c0341504c3426280338a5599607a0d (127.14.180.65:41105), 9f0541c7472e4aef9aac8ad7d02e8e48 (127.14.180.66:41411)
I20260709 13:10:33.004745 27115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c696708616494588c1322fabef87f2" candidate_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e7c0341504c3426280338a5599607a0d"
I20260709 13:10:33.005394 27115 raft_consensus.cc:3055] T d5c696708616494588c1322fabef87f2 P e7c0341504c3426280338a5599607a0d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:33.005718 27115 raft_consensus.cc:740] T d5c696708616494588c1322fabef87f2 P e7c0341504c3426280338a5599607a0d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e7c0341504c3426280338a5599607a0d, State: Running, Role: LEADER
I20260709 13:10:33.005950 27194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c696708616494588c1322fabef87f2" candidate_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48"
I20260709 13:10:33.006626 27194 raft_consensus.cc:3060] T d5c696708616494588c1322fabef87f2 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:32.963418 27580 tablet.cc:1724] T 83e5ce6906634b63a01333e50b5622be P 9f0541c7472e4aef9aac8ad7d02e8e48: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:33.013931 27121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a2c588c6f148ef9976d15d1a79ba74" candidate_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e7c0341504c3426280338a5599607a0d"
I20260709 13:10:33.014642 27121 raft_consensus.cc:3060] T c0a2c588c6f148ef9976d15d1a79ba74 P e7c0341504c3426280338a5599607a0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:33.006682 27115 consensus_queue.cc:260] T d5c696708616494588c1322fabef87f2 P e7c0341504c3426280338a5599607a0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:33.027343 27115 raft_consensus.cc:3060] T d5c696708616494588c1322fabef87f2 P e7c0341504c3426280338a5599607a0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:33.028630 27261 leader_election.cc:290] T c0a2c588c6f148ef9976d15d1a79ba74 P dd2dd298b4404607b3f3a14b89cbbee4 [CANDIDATE]: Term 2 election: Requested vote from peers e7c0341504c3426280338a5599607a0d (127.14.180.65:41105), 9f0541c7472e4aef9aac8ad7d02e8e48 (127.14.180.66:41411)
I20260709 13:10:33.026255 27121 raft_consensus.cc:2468] T c0a2c588c6f148ef9976d15d1a79ba74 P e7c0341504c3426280338a5599607a0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd2dd298b4404607b3f3a14b89cbbee4 in term 2.
I20260709 13:10:33.035132 27192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0a2c588c6f148ef9976d15d1a79ba74" candidate_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48"
I20260709 13:10:33.035678 27235 leader_election.cc:304] T c0a2c588c6f148ef9976d15d1a79ba74 P dd2dd298b4404607b3f3a14b89cbbee4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dd2dd298b4404607b3f3a14b89cbbee4, e7c0341504c3426280338a5599607a0d; no voters: 
I20260709 13:10:33.035953 27192 raft_consensus.cc:3055] T c0a2c588c6f148ef9976d15d1a79ba74 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:33.036477 27192 raft_consensus.cc:740] T c0a2c588c6f148ef9976d15d1a79ba74 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9f0541c7472e4aef9aac8ad7d02e8e48, State: Running, Role: LEADER
I20260709 13:10:33.036880 27550 raft_consensus.cc:2804] T c0a2c588c6f148ef9976d15d1a79ba74 P dd2dd298b4404607b3f3a14b89cbbee4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:33.037434 27550 raft_consensus.cc:697] T c0a2c588c6f148ef9976d15d1a79ba74 P dd2dd298b4404607b3f3a14b89cbbee4 [term 2 LEADER]: Becoming Leader. State: Replica: dd2dd298b4404607b3f3a14b89cbbee4, State: Running, Role: LEADER
I20260709 13:10:33.038378 27550 consensus_queue.cc:237] T c0a2c588c6f148ef9976d15d1a79ba74 P dd2dd298b4404607b3f3a14b89cbbee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:32.989192 27584 tablet.cc:1724] T b33f79df36ce42da96dda6972776a01d P e7c0341504c3426280338a5599607a0d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:33.045457 27115 raft_consensus.cc:2468] T d5c696708616494588c1322fabef87f2 P e7c0341504c3426280338a5599607a0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd2dd298b4404607b3f3a14b89cbbee4 in term 2.
I20260709 13:10:33.047158 27235 leader_election.cc:304] T d5c696708616494588c1322fabef87f2 P dd2dd298b4404607b3f3a14b89cbbee4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: dd2dd298b4404607b3f3a14b89cbbee4, e7c0341504c3426280338a5599607a0d; no voters: 
I20260709 13:10:33.047338 27580 tablet.cc:1724] T c972f59715c6476fb68a0a9dcc7b54d3 P 9f0541c7472e4aef9aac8ad7d02e8e48: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:33.048311 27546 raft_consensus.cc:2804] T d5c696708616494588c1322fabef87f2 P dd2dd298b4404607b3f3a14b89cbbee4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:33.048804 27546 raft_consensus.cc:697] T d5c696708616494588c1322fabef87f2 P dd2dd298b4404607b3f3a14b89cbbee4 [term 2 LEADER]: Becoming Leader. State: Replica: dd2dd298b4404607b3f3a14b89cbbee4, State: Running, Role: LEADER
I20260709 13:10:33.049605 27546 consensus_queue.cc:237] T d5c696708616494588c1322fabef87f2 P dd2dd298b4404607b3f3a14b89cbbee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:33.063634 27594 tablet.cc:1724] T f9463aebc13b49339561c1f5436e3142 P e7c0341504c3426280338a5599607a0d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:33.056353 27194 raft_consensus.cc:2468] T d5c696708616494588c1322fabef87f2 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd2dd298b4404607b3f3a14b89cbbee4 in term 2.
I20260709 13:10:33.054072 27593 tablet.cc:1724] T c972f59715c6476fb68a0a9dcc7b54d3 P dd2dd298b4404607b3f3a14b89cbbee4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:33.051734 27568 tablet.cc:1724] T 83e5ce6906634b63a01333e50b5622be P dd2dd298b4404607b3f3a14b89cbbee4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:33.037567 27192 consensus_queue.cc:260] T c0a2c588c6f148ef9976d15d1a79ba74 P 9f0541c7472e4aef9aac8ad7d02e8e48 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } }
I20260709 13:10:33.078584 27192 raft_consensus.cc:3060] T c0a2c588c6f148ef9976d15d1a79ba74 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:33.092496 27579 tablet.cc:1724] T deb0ef2084cc4ddf88165639552f3161 P e7c0341504c3426280338a5599607a0d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:33.109429 27586 tablet.cc:1724] T b33f79df36ce42da96dda6972776a01d P dd2dd298b4404607b3f3a14b89cbbee4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:33.109709 27584 tablet.cc:1724] T c972f59715c6476fb68a0a9dcc7b54d3 P e7c0341504c3426280338a5599607a0d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:33.112429 27587 tablet.cc:1724] T d3aeec0e4dd34da6bb82d4774f566271 P e7c0341504c3426280338a5599607a0d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:33.113813 27018 catalog_manager.cc:5697] T c0a2c588c6f148ef9976d15d1a79ba74 P dd2dd298b4404607b3f3a14b89cbbee4 reported cstate change: term changed from 1 to 2, leader changed from 9f0541c7472e4aef9aac8ad7d02e8e48 (127.14.180.66) to dd2dd298b4404607b3f3a14b89cbbee4 (127.14.180.67). New cstate: current_term: 2 leader_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:33.137300 27192 raft_consensus.cc:2468] T c0a2c588c6f148ef9976d15d1a79ba74 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dd2dd298b4404607b3f3a14b89cbbee4 in term 2.
I20260709 13:10:33.171456 27017 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 6138d17844114e888ab749ddf76793ed: soft_deleted_table [id=d3c3b75363a5472a8e8546ae9224d5e4] alter complete (version 1)
I20260709 13:10:33.188333 27015 catalog_manager.cc:5697] T d5c696708616494588c1322fabef87f2 P dd2dd298b4404607b3f3a14b89cbbee4 reported cstate change: term changed from 1 to 2, leader changed from e7c0341504c3426280338a5599607a0d (127.14.180.65) to dd2dd298b4404607b3f3a14b89cbbee4 (127.14.180.67). New cstate: current_term: 2 leader_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dd2dd298b4404607b3f3a14b89cbbee4" member_type: VOTER last_known_addr { host: "127.14.180.67" port: 40131 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:33.441718 27117 raft_consensus.cc:1275] T c0a2c588c6f148ef9976d15d1a79ba74 P e7c0341504c3426280338a5599607a0d [term 2 FOLLOWER]: Refusing update from remote peer dd2dd298b4404607b3f3a14b89cbbee4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:33.443233 27546 consensus_queue.cc:1048] T c0a2c588c6f148ef9976d15d1a79ba74 P dd2dd298b4404607b3f3a14b89cbbee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:33.461134 27192 raft_consensus.cc:1275] T c0a2c588c6f148ef9976d15d1a79ba74 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 2 FOLLOWER]: Refusing update from remote peer dd2dd298b4404607b3f3a14b89cbbee4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:33.465807 27546 consensus_queue.cc:1048] T c0a2c588c6f148ef9976d15d1a79ba74 P dd2dd298b4404607b3f3a14b89cbbee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:33.660669 27194 raft_consensus.cc:1275] T d5c696708616494588c1322fabef87f2 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 2 FOLLOWER]: Refusing update from remote peer dd2dd298b4404607b3f3a14b89cbbee4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:33.662158 27550 consensus_queue.cc:1048] T d5c696708616494588c1322fabef87f2 P dd2dd298b4404607b3f3a14b89cbbee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f0541c7472e4aef9aac8ad7d02e8e48" member_type: VOTER last_known_addr { host: "127.14.180.66" port: 41411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:33.675467 27115 raft_consensus.cc:1275] T d5c696708616494588c1322fabef87f2 P e7c0341504c3426280338a5599607a0d [term 2 FOLLOWER]: Refusing update from remote peer dd2dd298b4404607b3f3a14b89cbbee4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:33.677493 27545 consensus_queue.cc:1048] T d5c696708616494588c1322fabef87f2 P dd2dd298b4404607b3f3a14b89cbbee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7c0341504c3426280338a5599607a0d" member_type: VOTER last_known_addr { host: "127.14.180.65" port: 41105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:10:34.064441 15057 tablet_server.cc:179] TabletServer@127.14.180.65:0 shutting down...
W20260709 13:10:34.128988 27161 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 12 similar messages]
W20260709 13:10:34.137920 27235 consensus_peers.cc:597] T d5c696708616494588c1322fabef87f2 P dd2dd298b4404607b3f3a14b89cbbee4 -> Peer e7c0341504c3426280338a5599607a0d (127.14.180.65:41105): Couldn't send request to peer e7c0341504c3426280338a5599607a0d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:34.167683 27161 consensus_peers.cc:597] T e41aaa6d8213447b972d3eed31538da1 P 9f0541c7472e4aef9aac8ad7d02e8e48 -> Peer e7c0341504c3426280338a5599607a0d (127.14.180.65:41105): Couldn't send request to peer e7c0341504c3426280338a5599607a0d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:34.170861 15057 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:34.172132 15057 tablet_replica.cc:333] T f9463aebc13b49339561c1f5436e3142 P e7c0341504c3426280338a5599607a0d: stopping tablet replica
I20260709 13:10:34.173489 15057 raft_consensus.cc:2243] T f9463aebc13b49339561c1f5436e3142 P e7c0341504c3426280338a5599607a0d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:34.174896 15057 raft_consensus.cc:2272] T f9463aebc13b49339561c1f5436e3142 P e7c0341504c3426280338a5599607a0d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:34.178841 15057 tablet_replica.cc:333] T d3aeec0e4dd34da6bb82d4774f566271 P e7c0341504c3426280338a5599607a0d: stopping tablet replica
I20260709 13:10:34.179853 15057 raft_consensus.cc:2243] T d3aeec0e4dd34da6bb82d4774f566271 P e7c0341504c3426280338a5599607a0d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:34.180789 15057 raft_consensus.cc:2272] T d3aeec0e4dd34da6bb82d4774f566271 P e7c0341504c3426280338a5599607a0d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:34.184211 15057 tablet_replica.cc:333] T 83e5ce6906634b63a01333e50b5622be P e7c0341504c3426280338a5599607a0d: stopping tablet replica
I20260709 13:10:34.185024 15057 raft_consensus.cc:2243] T 83e5ce6906634b63a01333e50b5622be P e7c0341504c3426280338a5599607a0d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:34.186959 15057 raft_consensus.cc:2272] T 83e5ce6906634b63a01333e50b5622be P e7c0341504c3426280338a5599607a0d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:34.190282 15057 tablet_replica.cc:333] T 42dd3577afcf408eba8fc5c82a33e0c8 P e7c0341504c3426280338a5599607a0d: stopping tablet replica
I20260709 13:10:34.191248 15057 raft_consensus.cc:2243] T 42dd3577afcf408eba8fc5c82a33e0c8 P e7c0341504c3426280338a5599607a0d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:34.192266 15057 raft_consensus.cc:2272] T 42dd3577afcf408eba8fc5c82a33e0c8 P e7c0341504c3426280338a5599607a0d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:34.196745 15057 tablet_replica.cc:333] T e41aaa6d8213447b972d3eed31538da1 P e7c0341504c3426280338a5599607a0d: stopping tablet replica
I20260709 13:10:34.198814 15057 raft_consensus.cc:2243] T e41aaa6d8213447b972d3eed31538da1 P e7c0341504c3426280338a5599607a0d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:34.200273 15057 raft_consensus.cc:2272] T e41aaa6d8213447b972d3eed31538da1 P e7c0341504c3426280338a5599607a0d [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:34.203321 27161 consensus_peers.cc:597] T f9463aebc13b49339561c1f5436e3142 P 9f0541c7472e4aef9aac8ad7d02e8e48 -> Peer e7c0341504c3426280338a5599607a0d (127.14.180.65:41105): Couldn't send request to peer e7c0341504c3426280338a5599607a0d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:34.204937 15057 tablet_replica.cc:333] T fd5b3b92057444cfb3f243b5fdf1ae66 P e7c0341504c3426280338a5599607a0d: stopping tablet replica
I20260709 13:10:34.206205 15057 raft_consensus.cc:2243] T fd5b3b92057444cfb3f243b5fdf1ae66 P e7c0341504c3426280338a5599607a0d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:34.207566 15057 raft_consensus.cc:2272] T fd5b3b92057444cfb3f243b5fdf1ae66 P e7c0341504c3426280338a5599607a0d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:34.212554 15057 tablet_replica.cc:333] T aa6e8c327dde42d3808411b7117dda68 P e7c0341504c3426280338a5599607a0d: stopping tablet replica
I20260709 13:10:34.213605 15057 raft_consensus.cc:2243] T aa6e8c327dde42d3808411b7117dda68 P e7c0341504c3426280338a5599607a0d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:34.216224 15057 raft_consensus.cc:2272] T aa6e8c327dde42d3808411b7117dda68 P e7c0341504c3426280338a5599607a0d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:34.221084 15057 tablet_replica.cc:333] T 2131193060f9477e9750e3f42ef79986 P e7c0341504c3426280338a5599607a0d: stopping tablet replica
I20260709 13:10:34.222216 15057 raft_consensus.cc:2243] T 2131193060f9477e9750e3f42ef79986 P e7c0341504c3426280338a5599607a0d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:34.224480 15057 raft_consensus.cc:2272] T 2131193060f9477e9750e3f42ef79986 P e7c0341504c3426280338a5599607a0d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:34.228986 15057 tablet_replica.cc:333] T b33f79df36ce42da96dda6972776a01d P e7c0341504c3426280338a5599607a0d: stopping tablet replica
I20260709 13:10:34.230079 15057 raft_consensus.cc:2243] T b33f79df36ce42da96dda6972776a01d P e7c0341504c3426280338a5599607a0d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:34.232040 15057 raft_consensus.cc:2272] T b33f79df36ce42da96dda6972776a01d P e7c0341504c3426280338a5599607a0d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:34.236253 15057 tablet_replica.cc:333] T 25b85b28aed94a088553d3df84dfc6dc P e7c0341504c3426280338a5599607a0d: stopping tablet replica
I20260709 13:10:34.237368 15057 raft_consensus.cc:2243] T 25b85b28aed94a088553d3df84dfc6dc P e7c0341504c3426280338a5599607a0d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:34.238701 15057 raft_consensus.cc:2272] T 25b85b28aed94a088553d3df84dfc6dc P e7c0341504c3426280338a5599607a0d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:34.243395 15057 tablet_replica.cc:333] T c0a2c588c6f148ef9976d15d1a79ba74 P e7c0341504c3426280338a5599607a0d: stopping tablet replica
I20260709 13:10:34.244590 15057 raft_consensus.cc:2243] T c0a2c588c6f148ef9976d15d1a79ba74 P e7c0341504c3426280338a5599607a0d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:34.245474 15057 raft_consensus.cc:2272] T c0a2c588c6f148ef9976d15d1a79ba74 P e7c0341504c3426280338a5599607a0d [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:34.247627 27161 consensus_peers.cc:597] T d3aeec0e4dd34da6bb82d4774f566271 P 9f0541c7472e4aef9aac8ad7d02e8e48 -> Peer e7c0341504c3426280338a5599607a0d (127.14.180.65:41105): Couldn't send request to peer e7c0341504c3426280338a5599607a0d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:34.250492 15057 tablet_replica.cc:333] T ba62c4ccdf604a349be40020c44728e9 P e7c0341504c3426280338a5599607a0d: stopping tablet replica
I20260709 13:10:34.251708 15057 raft_consensus.cc:2243] T ba62c4ccdf604a349be40020c44728e9 P e7c0341504c3426280338a5599607a0d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:34.253542 15057 raft_consensus.cc:2272] T ba62c4ccdf604a349be40020c44728e9 P e7c0341504c3426280338a5599607a0d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:34.258360 15057 tablet_replica.cc:333] T 3a5eb0bf903c4627add0ee35d02a4853 P e7c0341504c3426280338a5599607a0d: stopping tablet replica
I20260709 13:10:34.259452 15057 raft_consensus.cc:2243] T 3a5eb0bf903c4627add0ee35d02a4853 P e7c0341504c3426280338a5599607a0d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:34.261518 15057 raft_consensus.cc:2272] T 3a5eb0bf903c4627add0ee35d02a4853 P e7c0341504c3426280338a5599607a0d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:34.265746 15057 tablet_replica.cc:333] T 025d8ae32c8a4cec8fe002fb1682eb12 P e7c0341504c3426280338a5599607a0d: stopping tablet replica
I20260709 13:10:34.266741 15057 raft_consensus.cc:2243] T 025d8ae32c8a4cec8fe002fb1682eb12 P e7c0341504c3426280338a5599607a0d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:34.267756 15057 raft_consensus.cc:2272] T 025d8ae32c8a4cec8fe002fb1682eb12 P e7c0341504c3426280338a5599607a0d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:34.271589 15057 tablet_replica.cc:333] T c7b039889b334a5c90fee88adac9c25e P e7c0341504c3426280338a5599607a0d: stopping tablet replica
I20260709 13:10:34.272449 15057 raft_consensus.cc:2243] T c7b039889b334a5c90fee88adac9c25e P e7c0341504c3426280338a5599607a0d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:34.273191 15057 raft_consensus.cc:2272] T c7b039889b334a5c90fee88adac9c25e P e7c0341504c3426280338a5599607a0d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:34.277127 15057 tablet_replica.cc:333] T deb0ef2084cc4ddf88165639552f3161 P e7c0341504c3426280338a5599607a0d: stopping tablet replica
I20260709 13:10:34.277997 15057 raft_consensus.cc:2243] T deb0ef2084cc4ddf88165639552f3161 P e7c0341504c3426280338a5599607a0d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:34.278858 15057 raft_consensus.cc:2272] T deb0ef2084cc4ddf88165639552f3161 P e7c0341504c3426280338a5599607a0d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:34.283044 15057 tablet_replica.cc:333] T c972f59715c6476fb68a0a9dcc7b54d3 P e7c0341504c3426280338a5599607a0d: stopping tablet replica
I20260709 13:10:34.283979 15057 raft_consensus.cc:2243] T c972f59715c6476fb68a0a9dcc7b54d3 P e7c0341504c3426280338a5599607a0d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:34.285655 15057 raft_consensus.cc:2272] T c972f59715c6476fb68a0a9dcc7b54d3 P e7c0341504c3426280338a5599607a0d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:34.289975 15057 tablet_replica.cc:333] T d5c696708616494588c1322fabef87f2 P e7c0341504c3426280338a5599607a0d: stopping tablet replica
I20260709 13:10:34.290871 15057 raft_consensus.cc:2243] T d5c696708616494588c1322fabef87f2 P e7c0341504c3426280338a5599607a0d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:34.291899 15057 raft_consensus.cc:2272] T d5c696708616494588c1322fabef87f2 P e7c0341504c3426280338a5599607a0d [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:34.303964 27235 consensus_peers.cc:597] T 42dd3577afcf408eba8fc5c82a33e0c8 P dd2dd298b4404607b3f3a14b89cbbee4 -> Peer e7c0341504c3426280338a5599607a0d (127.14.180.65:41105): Couldn't send request to peer e7c0341504c3426280338a5599607a0d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:34.343464 27161 consensus_peers.cc:597] T fd5b3b92057444cfb3f243b5fdf1ae66 P 9f0541c7472e4aef9aac8ad7d02e8e48 -> Peer e7c0341504c3426280338a5599607a0d (127.14.180.65:41105): Couldn't send request to peer e7c0341504c3426280338a5599607a0d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:34.363438 27235 consensus_peers.cc:597] T c7b039889b334a5c90fee88adac9c25e P dd2dd298b4404607b3f3a14b89cbbee4 -> Peer e7c0341504c3426280338a5599607a0d (127.14.180.65:41105): Couldn't send request to peer e7c0341504c3426280338a5599607a0d. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:41105: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:34.368814 15057 tablet_server.cc:196] TabletServer@127.14.180.65:0 shutdown complete.
W20260709 13:10:34.405088 27161 consensus_peers.cc:597] T 025d8ae32c8a4cec8fe002fb1682eb12 P 9f0541c7472e4aef9aac8ad7d02e8e48 -> Peer e7c0341504c3426280338a5599607a0d (127.14.180.65:41105): Couldn't send request to peer e7c0341504c3426280338a5599607a0d. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:41105: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:34.436761 27161 consensus_peers.cc:597] T deb0ef2084cc4ddf88165639552f3161 P 9f0541c7472e4aef9aac8ad7d02e8e48 -> Peer e7c0341504c3426280338a5599607a0d (127.14.180.65:41105): Couldn't send request to peer e7c0341504c3426280338a5599607a0d. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:41105: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:34.441488 15057 tablet_server.cc:179] TabletServer@127.14.180.66:0 shutting down...
I20260709 13:10:34.486939 15057 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:10:34.488046 27161 consensus_peers.cc:597] T 25b85b28aed94a088553d3df84dfc6dc P 9f0541c7472e4aef9aac8ad7d02e8e48 -> Peer e7c0341504c3426280338a5599607a0d (127.14.180.65:41105): Couldn't send request to peer e7c0341504c3426280338a5599607a0d. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:41105: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:34.490500 15057 tablet_replica.cc:333] T d3aeec0e4dd34da6bb82d4774f566271 P 9f0541c7472e4aef9aac8ad7d02e8e48: stopping tablet replica
I20260709 13:10:34.492058 15057 raft_consensus.cc:2243] T d3aeec0e4dd34da6bb82d4774f566271 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:34.493263 15057 raft_consensus.cc:2272] T d3aeec0e4dd34da6bb82d4774f566271 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:34.496850 15057 tablet_replica.cc:333] T f9463aebc13b49339561c1f5436e3142 P 9f0541c7472e4aef9aac8ad7d02e8e48: stopping tablet replica
I20260709 13:10:34.497680 15057 raft_consensus.cc:2243] T f9463aebc13b49339561c1f5436e3142 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:34.498948 15057 raft_consensus.cc:2272] T f9463aebc13b49339561c1f5436e3142 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:34.501772 15057 tablet_replica.cc:333] T 83e5ce6906634b63a01333e50b5622be P 9f0541c7472e4aef9aac8ad7d02e8e48: stopping tablet replica
I20260709 13:10:34.502648 15057 raft_consensus.cc:2243] T 83e5ce6906634b63a01333e50b5622be P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:34.503559 15057 raft_consensus.cc:2272] T 83e5ce6906634b63a01333e50b5622be P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:34.506619 15057 tablet_replica.cc:333] T 42dd3577afcf408eba8fc5c82a33e0c8 P 9f0541c7472e4aef9aac8ad7d02e8e48: stopping tablet replica
I20260709 13:10:34.507282 15057 raft_consensus.cc:2243] T 42dd3577afcf408eba8fc5c82a33e0c8 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:34.507946 15057 raft_consensus.cc:2272] T 42dd3577afcf408eba8fc5c82a33e0c8 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:34.510944 15057 tablet_replica.cc:333] T e41aaa6d8213447b972d3eed31538da1 P 9f0541c7472e4aef9aac8ad7d02e8e48: stopping tablet replica
I20260709 13:10:34.511583 15057 raft_consensus.cc:2243] T e41aaa6d8213447b972d3eed31538da1 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:34.512753 15057 raft_consensus.cc:2272] T e41aaa6d8213447b972d3eed31538da1 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:34.515812 15057 tablet_replica.cc:333] T fd5b3b92057444cfb3f243b5fdf1ae66 P 9f0541c7472e4aef9aac8ad7d02e8e48: stopping tablet replica
I20260709 13:10:34.516450 15057 raft_consensus.cc:2243] T fd5b3b92057444cfb3f243b5fdf1ae66 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:34.517482 15057 raft_consensus.cc:2272] T fd5b3b92057444cfb3f243b5fdf1ae66 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:34.520406 15057 tablet_replica.cc:333] T 025d8ae32c8a4cec8fe002fb1682eb12 P 9f0541c7472e4aef9aac8ad7d02e8e48: stopping tablet replica
I20260709 13:10:34.521075 15057 raft_consensus.cc:2243] T 025d8ae32c8a4cec8fe002fb1682eb12 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:34.522095 15057 raft_consensus.cc:2272] T 025d8ae32c8a4cec8fe002fb1682eb12 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:34.524830 15057 tablet_replica.cc:333] T b33f79df36ce42da96dda6972776a01d P 9f0541c7472e4aef9aac8ad7d02e8e48: stopping tablet replica
I20260709 13:10:34.525460 15057 raft_consensus.cc:2243] T b33f79df36ce42da96dda6972776a01d P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:34.526041 15057 raft_consensus.cc:2272] T b33f79df36ce42da96dda6972776a01d P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:34.528671 15057 tablet_replica.cc:333] T aa6e8c327dde42d3808411b7117dda68 P 9f0541c7472e4aef9aac8ad7d02e8e48: stopping tablet replica
I20260709 13:10:34.529278 15057 raft_consensus.cc:2243] T aa6e8c327dde42d3808411b7117dda68 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:34.530045 15057 raft_consensus.cc:2272] T aa6e8c327dde42d3808411b7117dda68 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:34.532771 15057 tablet_replica.cc:333] T 2131193060f9477e9750e3f42ef79986 P 9f0541c7472e4aef9aac8ad7d02e8e48: stopping tablet replica
I20260709 13:10:34.533377 15057 raft_consensus.cc:2243] T 2131193060f9477e9750e3f42ef79986 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:34.533946 15057 raft_consensus.cc:2272] T 2131193060f9477e9750e3f42ef79986 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:34.536455 15057 tablet_replica.cc:333] T 25b85b28aed94a088553d3df84dfc6dc P 9f0541c7472e4aef9aac8ad7d02e8e48: stopping tablet replica
I20260709 13:10:34.537025 15057 raft_consensus.cc:2243] T 25b85b28aed94a088553d3df84dfc6dc P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:34.537964 15057 raft_consensus.cc:2272] T 25b85b28aed94a088553d3df84dfc6dc P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:34.540900 15057 tablet_replica.cc:333] T c0a2c588c6f148ef9976d15d1a79ba74 P 9f0541c7472e4aef9aac8ad7d02e8e48: stopping tablet replica
I20260709 13:10:34.541669 15057 raft_consensus.cc:2243] T c0a2c588c6f148ef9976d15d1a79ba74 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:34.542291 15057 raft_consensus.cc:2272] T c0a2c588c6f148ef9976d15d1a79ba74 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:34.545059 15057 tablet_replica.cc:333] T ba62c4ccdf604a349be40020c44728e9 P 9f0541c7472e4aef9aac8ad7d02e8e48: stopping tablet replica
I20260709 13:10:34.545689 15057 raft_consensus.cc:2243] T ba62c4ccdf604a349be40020c44728e9 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:34.546491 15057 raft_consensus.cc:2272] T ba62c4ccdf604a349be40020c44728e9 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:34.550390 15057 tablet_replica.cc:333] T 3a5eb0bf903c4627add0ee35d02a4853 P 9f0541c7472e4aef9aac8ad7d02e8e48: stopping tablet replica
I20260709 13:10:34.551209 15057 raft_consensus.cc:2243] T 3a5eb0bf903c4627add0ee35d02a4853 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:34.551970 15057 raft_consensus.cc:2272] T 3a5eb0bf903c4627add0ee35d02a4853 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:34.555137 15057 tablet_replica.cc:333] T deb0ef2084cc4ddf88165639552f3161 P 9f0541c7472e4aef9aac8ad7d02e8e48: stopping tablet replica
I20260709 13:10:34.555737 15057 raft_consensus.cc:2243] T deb0ef2084cc4ddf88165639552f3161 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:34.556701 15057 raft_consensus.cc:2272] T deb0ef2084cc4ddf88165639552f3161 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:34.559300 15057 tablet_replica.cc:333] T c972f59715c6476fb68a0a9dcc7b54d3 P 9f0541c7472e4aef9aac8ad7d02e8e48: stopping tablet replica
I20260709 13:10:34.559830 15057 raft_consensus.cc:2243] T c972f59715c6476fb68a0a9dcc7b54d3 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:34.560406 15057 raft_consensus.cc:2272] T c972f59715c6476fb68a0a9dcc7b54d3 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:34.562987 15057 tablet_replica.cc:333] T d5c696708616494588c1322fabef87f2 P 9f0541c7472e4aef9aac8ad7d02e8e48: stopping tablet replica
I20260709 13:10:34.563525 15057 raft_consensus.cc:2243] T d5c696708616494588c1322fabef87f2 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:34.564020 15057 raft_consensus.cc:2272] T d5c696708616494588c1322fabef87f2 P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:34.567607 15057 tablet_replica.cc:333] T c7b039889b334a5c90fee88adac9c25e P 9f0541c7472e4aef9aac8ad7d02e8e48: stopping tablet replica
I20260709 13:10:34.568210 15057 raft_consensus.cc:2243] T c7b039889b334a5c90fee88adac9c25e P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:34.568821 15057 raft_consensus.cc:2272] T c7b039889b334a5c90fee88adac9c25e P 9f0541c7472e4aef9aac8ad7d02e8e48 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:34.585088 27235 consensus_peers.cc:597] T c0a2c588c6f148ef9976d15d1a79ba74 P dd2dd298b4404607b3f3a14b89cbbee4 -> Peer e7c0341504c3426280338a5599607a0d (127.14.180.65:41105): Couldn't send request to peer e7c0341504c3426280338a5599607a0d. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.65:41105: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:34.622160 15057 tablet_server.cc:196] TabletServer@127.14.180.66:0 shutdown complete.
I20260709 13:10:34.695576 15057 tablet_server.cc:179] TabletServer@127.14.180.67:0 shutting down...
W20260709 13:10:34.723268 27234 consensus_peers.cc:597] T c7b039889b334a5c90fee88adac9c25e P dd2dd298b4404607b3f3a14b89cbbee4 -> Peer 9f0541c7472e4aef9aac8ad7d02e8e48 (127.14.180.66:41411): Couldn't send request to peer 9f0541c7472e4aef9aac8ad7d02e8e48. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.66:41411: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:34.731256 27234 consensus_peers.cc:597] T c0a2c588c6f148ef9976d15d1a79ba74 P dd2dd298b4404607b3f3a14b89cbbee4 -> Peer 9f0541c7472e4aef9aac8ad7d02e8e48 (127.14.180.66:41411): Couldn't send request to peer 9f0541c7472e4aef9aac8ad7d02e8e48. Status: Network error: Client connection negotiation failed: client connection to 127.14.180.66:41411: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:34.733989 15057 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:34.734982 15057 tablet_replica.cc:333] T d3aeec0e4dd34da6bb82d4774f566271 P dd2dd298b4404607b3f3a14b89cbbee4: stopping tablet replica
I20260709 13:10:34.735842 15057 raft_consensus.cc:2243] T d3aeec0e4dd34da6bb82d4774f566271 P dd2dd298b4404607b3f3a14b89cbbee4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:34.736585 15057 raft_consensus.cc:2272] T d3aeec0e4dd34da6bb82d4774f566271 P dd2dd298b4404607b3f3a14b89cbbee4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:34.739354 15057 tablet_replica.cc:333] T 83e5ce6906634b63a01333e50b5622be P dd2dd298b4404607b3f3a14b89cbbee4: stopping tablet replica
I20260709 13:10:34.740025 15057 raft_consensus.cc:2243] T 83e5ce6906634b63a01333e50b5622be P dd2dd298b4404607b3f3a14b89cbbee4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:34.740646 15057 raft_consensus.cc:2272] T 83e5ce6906634b63a01333e50b5622be P dd2dd298b4404607b3f3a14b89cbbee4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:34.743125 15057 tablet_replica.cc:333] T f9463aebc13b49339561c1f5436e3142 P dd2dd298b4404607b3f3a14b89cbbee4: stopping tablet replica
I20260709 13:10:34.743846 15057 raft_consensus.cc:2243] T f9463aebc13b49339561c1f5436e3142 P dd2dd298b4404607b3f3a14b89cbbee4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:34.744421 15057 raft_consensus.cc:2272] T f9463aebc13b49339561c1f5436e3142 P dd2dd298b4404607b3f3a14b89cbbee4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:34.747066 15057 tablet_replica.cc:333] T b33f79df36ce42da96dda6972776a01d P dd2dd298b4404607b3f3a14b89cbbee4: stopping tablet replica
I20260709 13:10:34.747689 15057 raft_consensus.cc:2243] T b33f79df36ce42da96dda6972776a01d P dd2dd298b4404607b3f3a14b89cbbee4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:34.748317 15057 raft_consensus.cc:2272] T b33f79df36ce42da96dda6972776a01d P dd2dd298b4404607b3f3a14b89cbbee4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:34.750927 15057 tablet_replica.cc:333] T aa6e8c327dde42d3808411b7117dda68 P dd2dd298b4404607b3f3a14b89cbbee4: stopping tablet replica
I20260709 13:10:34.751544 15057 raft_consensus.cc:2243] T aa6e8c327dde42d3808411b7117dda68 P dd2dd298b4404607b3f3a14b89cbbee4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:34.752287 15057 raft_consensus.cc:2272] T aa6e8c327dde42d3808411b7117dda68 P dd2dd298b4404607b3f3a14b89cbbee4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:34.755084 15057 tablet_replica.cc:333] T 2131193060f9477e9750e3f42ef79986 P dd2dd298b4404607b3f3a14b89cbbee4: stopping tablet replica
I20260709 13:10:34.755724 15057 raft_consensus.cc:2243] T 2131193060f9477e9750e3f42ef79986 P dd2dd298b4404607b3f3a14b89cbbee4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:34.756340 15057 raft_consensus.cc:2272] T 2131193060f9477e9750e3f42ef79986 P dd2dd298b4404607b3f3a14b89cbbee4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:34.758862 15057 tablet_replica.cc:333] T c0a2c588c6f148ef9976d15d1a79ba74 P dd2dd298b4404607b3f3a14b89cbbee4: stopping tablet replica
I20260709 13:10:34.759464 15057 raft_consensus.cc:2243] T c0a2c588c6f148ef9976d15d1a79ba74 P dd2dd298b4404607b3f3a14b89cbbee4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:34.760461 15057 raft_consensus.cc:2272] T c0a2c588c6f148ef9976d15d1a79ba74 P dd2dd298b4404607b3f3a14b89cbbee4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:34.762861 15057 tablet_replica.cc:333] T 25b85b28aed94a088553d3df84dfc6dc P dd2dd298b4404607b3f3a14b89cbbee4: stopping tablet replica
I20260709 13:10:34.763439 15057 raft_consensus.cc:2243] T 25b85b28aed94a088553d3df84dfc6dc P dd2dd298b4404607b3f3a14b89cbbee4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:34.763974 15057 raft_consensus.cc:2272] T 25b85b28aed94a088553d3df84dfc6dc P dd2dd298b4404607b3f3a14b89cbbee4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:34.766645 15057 tablet_replica.cc:333] T deb0ef2084cc4ddf88165639552f3161 P dd2dd298b4404607b3f3a14b89cbbee4: stopping tablet replica
I20260709 13:10:34.767436 15057 raft_consensus.cc:2243] T deb0ef2084cc4ddf88165639552f3161 P dd2dd298b4404607b3f3a14b89cbbee4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:34.768350 15057 raft_consensus.cc:2272] T deb0ef2084cc4ddf88165639552f3161 P dd2dd298b4404607b3f3a14b89cbbee4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:34.771627 15057 tablet_replica.cc:333] T d5c696708616494588c1322fabef87f2 P dd2dd298b4404607b3f3a14b89cbbee4: stopping tablet replica
I20260709 13:10:34.772547 15057 raft_consensus.cc:2243] T d5c696708616494588c1322fabef87f2 P dd2dd298b4404607b3f3a14b89cbbee4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:34.773835 15057 raft_consensus.cc:2272] T d5c696708616494588c1322fabef87f2 P dd2dd298b4404607b3f3a14b89cbbee4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:34.776289 15057 tablet_replica.cc:333] T c972f59715c6476fb68a0a9dcc7b54d3 P dd2dd298b4404607b3f3a14b89cbbee4: stopping tablet replica
I20260709 13:10:34.776906 15057 raft_consensus.cc:2243] T c972f59715c6476fb68a0a9dcc7b54d3 P dd2dd298b4404607b3f3a14b89cbbee4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:34.777467 15057 raft_consensus.cc:2272] T c972f59715c6476fb68a0a9dcc7b54d3 P dd2dd298b4404607b3f3a14b89cbbee4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:34.779955 15057 tablet_replica.cc:333] T 025d8ae32c8a4cec8fe002fb1682eb12 P dd2dd298b4404607b3f3a14b89cbbee4: stopping tablet replica
I20260709 13:10:34.780530 15057 raft_consensus.cc:2243] T 025d8ae32c8a4cec8fe002fb1682eb12 P dd2dd298b4404607b3f3a14b89cbbee4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:34.781092 15057 raft_consensus.cc:2272] T 025d8ae32c8a4cec8fe002fb1682eb12 P dd2dd298b4404607b3f3a14b89cbbee4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:34.783877 15057 tablet_replica.cc:333] T 42dd3577afcf408eba8fc5c82a33e0c8 P dd2dd298b4404607b3f3a14b89cbbee4: stopping tablet replica
I20260709 13:10:34.784493 15057 raft_consensus.cc:2243] T 42dd3577afcf408eba8fc5c82a33e0c8 P dd2dd298b4404607b3f3a14b89cbbee4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:34.785594 15057 raft_consensus.cc:2272] T 42dd3577afcf408eba8fc5c82a33e0c8 P dd2dd298b4404607b3f3a14b89cbbee4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:34.788707 15057 tablet_replica.cc:333] T e41aaa6d8213447b972d3eed31538da1 P dd2dd298b4404607b3f3a14b89cbbee4: stopping tablet replica
I20260709 13:10:34.789374 15057 raft_consensus.cc:2243] T e41aaa6d8213447b972d3eed31538da1 P dd2dd298b4404607b3f3a14b89cbbee4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:34.789909 15057 raft_consensus.cc:2272] T e41aaa6d8213447b972d3eed31538da1 P dd2dd298b4404607b3f3a14b89cbbee4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:34.792361 15057 tablet_replica.cc:333] T fd5b3b92057444cfb3f243b5fdf1ae66 P dd2dd298b4404607b3f3a14b89cbbee4: stopping tablet replica
I20260709 13:10:34.792945 15057 raft_consensus.cc:2243] T fd5b3b92057444cfb3f243b5fdf1ae66 P dd2dd298b4404607b3f3a14b89cbbee4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:34.793452 15057 raft_consensus.cc:2272] T fd5b3b92057444cfb3f243b5fdf1ae66 P dd2dd298b4404607b3f3a14b89cbbee4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:34.795894 15057 tablet_replica.cc:333] T ba62c4ccdf604a349be40020c44728e9 P dd2dd298b4404607b3f3a14b89cbbee4: stopping tablet replica
I20260709 13:10:34.796408 15057 raft_consensus.cc:2243] T ba62c4ccdf604a349be40020c44728e9 P dd2dd298b4404607b3f3a14b89cbbee4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:34.796926 15057 raft_consensus.cc:2272] T ba62c4ccdf604a349be40020c44728e9 P dd2dd298b4404607b3f3a14b89cbbee4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:34.799539 15057 tablet_replica.cc:333] T 3a5eb0bf903c4627add0ee35d02a4853 P dd2dd298b4404607b3f3a14b89cbbee4: stopping tablet replica
I20260709 13:10:34.800243 15057 raft_consensus.cc:2243] T 3a5eb0bf903c4627add0ee35d02a4853 P dd2dd298b4404607b3f3a14b89cbbee4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:34.800815 15057 raft_consensus.cc:2272] T 3a5eb0bf903c4627add0ee35d02a4853 P dd2dd298b4404607b3f3a14b89cbbee4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:34.803691 15057 tablet_replica.cc:333] T c7b039889b334a5c90fee88adac9c25e P dd2dd298b4404607b3f3a14b89cbbee4: stopping tablet replica
I20260709 13:10:34.804191 15057 raft_consensus.cc:2243] T c7b039889b334a5c90fee88adac9c25e P dd2dd298b4404607b3f3a14b89cbbee4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:34.805136 15057 raft_consensus.cc:2272] T c7b039889b334a5c90fee88adac9c25e P dd2dd298b4404607b3f3a14b89cbbee4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:34.855087 15057 tablet_server.cc:196] TabletServer@127.14.180.67:0 shutdown complete.
I20260709 13:10:34.902096 15057 master.cc:562] Master@127.14.180.126:39253 shutting down...
I20260709 13:10:34.934196 15057 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 6138d17844114e888ab749ddf76793ed [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:34.935089 15057 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 6138d17844114e888ab749ddf76793ed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:34.935561 15057 tablet_replica.cc:333] T 00000000000000000000000000000000 P 6138d17844114e888ab749ddf76793ed: stopping tablet replica
I20260709 13:10:35.138286 15057 master.cc:584] Master@127.14.180.126:39253 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (13588 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (29064 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (351977 ms total)
[  PASSED  ] 7 tests.
[  FAILED  ] 1 test, listed below:
[  FAILED  ] LeaderRebalancerTest.AddTserver

 1 FAILED TEST
I20260709 13:10:35.200178 15057 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 420 messages since previous log ~16 seconds ago
I20260709 13:10:35.200454 15057 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 420 messages since previous log ~16 seconds ago
I20260709 13:10:35.200649 15057 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 416 messages since previous log ~16 seconds ago
I20260709 13:10:35.200871 15057 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~37 seconds ago
I20260709 13:10:35.201069 15057 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~37 seconds ago
I20260709 13:10:35.201289 15057 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/master/catalog_manager.cc:4755: suppressed but not reported on 1 messages since previous log ~86 seconds ago
I20260709 13:10:35.201520 15057 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 8 messages since previous log ~196 seconds ago
I20260709 13:10:35.201802 15057 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 15 messages since previous log ~1 seconds ago
I20260709 13:10:35.202183 15057 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 53 messages since previous log ~12 seconds ago
